From llvm-testresults at cs.uiuc.edu Tue Jan 1 00:00:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 02:00:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130101080021.486992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7262?compare_to=7258&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7262, Order: 171340, Start Time: 2013-01-01 05:47:16, End Time: 2013-01-01 08:01:31 To: 7258, Order: 171338, Start Time: 2013-01-01 03:03:57, End Time: 2013-01-01 05:17:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (610 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.34% (0.6453 => 0.6733, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1339 => 0.1340) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.78% (0.0676 => 0.0664, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8516 => 499.8551, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 44225.18% (1.1277 => 499.8551, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.06% (0.5229 => 1.6579, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 20.13% (14.9895 => 18.0062, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 54.41% (14.1553 => 21.8566, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/gs/gs: 16.92% (4.1105 => 4.8059, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.18% (1.1048 => 1.7476, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1230.24% (7.1582 => 95.2213, std.dev.: 0.0744) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.88% (3.4629 => 7.8220, std.dev.: 0.0456) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.66% (0.6222 => 1.1054, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.50% (0.0720 => 7.4394, std.dev.: 0.0073) MultiSource/Applications/SIBsim4/SIBsim4: 3829800.00% (0.0001 => 3.8299, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11135000.00% (0.0001 => 11.1351, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577700.00% (0.0001 => 0.5778, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9957800.00% (0.0001 => 9.9579, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5504500.00% (0.0001 => 5.5046, std.dev.: 0.0128) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.61% (1.1194 => 10.3053, std.dev.: 0.0162) MultiSource/Applications/ClamAV/clamscan: 148.98% (22.1758 => 55.2136, std.dev.: 0.0379) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.93% (0.0929 => 0.1718, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.33% (0.1463 => 0.2331, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.97% (2.9384 => 4.6417, std.dev.: 0.0036) SingleSource/Regression/C/sumarray2d: 57.93% (0.0271 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.44% (7.0540 => 10.9649, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.09% (1.5859 => 2.4120, std.dev.: 0.0059) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 49.72% (0.1056 => 0.1581, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 47.19% (0.0231 => 0.0340, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.95% (8.1363 => 11.9560, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/flops: 42.53% (0.1432 => 0.2041, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.65% (2.2024 => 3.1197, std.dev.: 0.0205) MultiSource/Applications/JM/lencod/lencod: 41.08% (21.9371 => 30.9489, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.13% (0.0439 => 0.0602, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.33% (0.6675 => 0.8900, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.41% (1.5415 => 2.0411, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.30% (0.1062 => 0.1405, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.46% (0.5105 => 0.6711, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.22% (0.4615 => 0.6056, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 31.10% (0.3109 => 0.4076, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 30.26% (0.4299 => 0.5600, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.75% (4.2646 => 5.5332, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 29.17% (0.4289 => 0.5540, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 29.12% (0.0814 => 0.1051, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 28.27% (0.4620 => 0.5926, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.48% (0.0746 => 0.0951, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 27.36% (1.1642 => 1.4827, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.64% (1.0722 => 1.3578, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 25.65% (0.2554 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.06% (0.2271 => 0.2840, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.05% (0.1892 => 0.2366, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.98% (3.8922 => 4.8643, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 24.81% (0.6456 => 0.8058, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 24.77% (0.1175 => 0.1466, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.92% (0.1906 => 0.2362, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.38% (0.0479 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.24% (1.4186 => 1.7483, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 22.48% (9.4845 => 11.6170, std.dev.: 0.2162) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.32% (0.0793 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.27% (0.3121 => 0.3816, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 22.17% (5.7591 => 7.0358, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 21.93% (0.3283 => 0.4003, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.62% (0.1337 => 0.1626, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 21.57% (0.3232 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.48% (0.2700 => 0.3280, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 21.31% (0.7115 => 0.8631, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.94% (1.3050 => 1.5783, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 20.73% (0.1655 => 0.1998, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.59% (0.1695 => 0.2044, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.06% (0.1555 => 0.1867, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 19.97% (0.0626 => 0.0751, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.94% (0.0672 => 0.0806, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.81% (4.9449 => 5.9244, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 19.55% (0.7835 => 0.9367, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 19.35% (0.0527 => 0.0629, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.5860 => 0.6991, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 19.28% (1.1840 => 1.4123, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.14% (5.0018 => 5.9592, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 19.13% (3.3354 => 3.9734, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/messages-2: 19.03% (0.0662 => 0.0788, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.95% (0.1029 => 0.1224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 18.94% (0.3379 => 0.4019, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 18.91% (17.1811 => 20.4299, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/em3d/em3d: 18.88% (0.1695 => 0.2015, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.74% (0.1163 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.67% (0.0675 => 0.0801, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.53% (0.0842 => 0.0998, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 18.51% (0.1151 => 0.1364, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.43% (0.8172 => 0.9678, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 18.24% (0.0614 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.20% (0.2758 => 0.3260, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.20% (0.1940 => 0.2293, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.88% (0.1236 => 0.1457, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.63% (0.5020 => 0.5905, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.60% (0.4636 => 0.5452, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.53% (0.0730 => 0.0858, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.44% (0.7433 => 0.8729, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.39% (0.9765 => 1.1463, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.38% (0.0886 => 0.1040, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.27% (0.3423 => 0.4014, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.06% (0.1143 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.5569 => 0.6519, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 17.03% (0.1268 => 0.1484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 16.99% (2.2969 => 2.6872, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.99% (0.2107 => 0.2465, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.69% (0.5981 => 0.6979, std.dev.: 0.0068) MultiSource/Applications/treecc/treecc: 16.55% (2.0273 => 2.3629, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.53% (3.8723 => 4.5123, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 16.34% (0.8921 => 1.0379, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.23% (0.0770 => 0.0895, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.22% (0.3441 => 0.3999, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.14% (0.6450 => 0.7491, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.68% (0.8101 => 0.9371, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.82% (1.1861 => 1.3619, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.41% (0.2603 => 0.2978, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 14.34% (0.3180 => 0.3636, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.18% (0.1044 => 0.1192, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.99% (0.3387 => 0.3861, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.88% (1.5603 => 1.7769, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 13.86% (0.2049 => 0.2333, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.56% (0.8067 => 0.9161, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/Puzzle: 13.25% (0.1268 => 0.1436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3865 => 0.4374, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.49% (0.3282 => 0.3692, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.45% (0.4103 => 0.4614, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 12.27% (0.3098 => 0.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 11.76% (0.4048 => 0.4524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.66% (0.3603 => 0.4023, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.56% (14.3668 => 16.0270, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.09% (0.3092 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.85% (0.3826 => 0.4241, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.78% (0.2430 => 0.2692, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.26% (0.4064 => 0.4481, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.25% (0.3650 => 0.4024, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.14% (0.2831 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2871 => 0.3158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: 9.88% (0.3561 => 0.3913, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.75% (0.3497 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.75% (2.0665 => 2.2680, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.71% (0.3162 => 0.3469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2872 => 0.3143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.6030 => 0.6597, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.39% (10.3673 => 11.3412, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 9.26% (0.2905 => 0.3174, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.23% (0.5925 => 0.6472, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.06% (1.2842 => 1.4006, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.01% (63.2438 => 68.9439, std.dev.: 0.0201) SingleSource/UnitTests/ObjC++/property-reference: 8.82% (0.7326 => 0.7972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.81% (0.3052 => 0.3321, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.75% (2.2022 => 2.3950, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.71% (0.2756 => 0.2996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2802 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.52% (0.2793 => 0.3031, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.65% (0.4879 => 0.5252, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.44% (0.3131 => 0.3364, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.13% (7.9617 => 8.2111, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.68% (32.5116 => 59.0663, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.01% (2.8904 => 3.1508, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3789, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 5.40% (3.1578 => 3.3284, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4478, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.57% (0.9957 => 1.0312, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.50% (2.0360 => 2.1072, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.6802 => 8.9265, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6395 => 3.7095, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (0.6533 => 0.6658, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3432, std.dev.: 0.0763) MultiSource/Benchmarks/Olden/tsp/tsp: 1.57% (1.0785 => 1.0954, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (1.7254 => 1.7516, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.40% (4.4649 => 4.5274, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: 1.29% (2.2771 => 2.3065, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 1.26% (9.1159 => 9.2308, std.dev.: 0.0413) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1702, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.27% (0.8651 => 0.2139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.59% (5.3855 => 4.4923, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.02% (5.3526 => 4.4951, std.dev.: 0.0094) MultiSource/Applications/JM/ldecod/ldecod: -12.98% (10.4361 => 9.0810, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9564, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.43% (1.7609 => 1.6477, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.61% (1.9577 => 0.6733, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -50.09% (8.0499 => 4.0174, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.75% (0.0628 => 0.0347) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.75% (0.0506 => 0.0315) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0205, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.76% (10.7105 => 7.4163, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.8007, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0041, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3706, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.27% (2.5528 => 2.1374, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7323, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.12% (9.5636 => 8.4998, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.97% (1.2373 => 1.1016, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3011, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.64% (1.6805 => 1.5858, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.90% (8.1563 => 7.7563, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8395, std.dev.: 0.0107) MultiSource/Applications/siod/siod: -3.86% (3.2827 => 3.1560, std.dev.: 0.0085) MultiSource/Applications/sgefa/sgefa: -3.50% (0.6223 => 0.6005, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.97% (1.0554 => 1.0346, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5892, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2261, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0017) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 01:02:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 03:02:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130101090208.CD0FD2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7263?compare_to=7256&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7263, Order: 171340, Start Time: 2013-01-01 05:25:37, End Time: 2013-01-01 09:03:18 To: 7256, Order: 171336, Start Time: 2013-01-01 01:00:25, End Time: 2013-01-01 04:33:39 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1101 (713 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.87% (123.5258 => 130.7733, std.dev.: 0.4487) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.83% (11.6398 => 21.1650, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.54% (0.5361 => 0.8285, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.60% (0.2969 => 0.3818, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.96% (0.7426 => 0.9502, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.87% (0.4139 => 0.5251, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 26.37% (1.5932 => 2.0133, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.72% (0.4253 => 0.5347, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.51% (0.4994 => 0.6268, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.39% (0.5900 => 0.7398, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.00% (0.5000 => 0.6250, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.44% (0.1620 => 0.2016, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1021 => 0.1268, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.08% (0.0897 => 0.1113, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.21% (0.3903 => 0.4770, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.13% (0.1003 => 0.1225, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.08% (0.1549 => 0.1891, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.82% (0.1604 => 0.1954, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 21.80% (0.1619 => 0.1972, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.00% (0.1462 => 0.1769, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.72% (0.3890 => 0.4696, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 20.67% (0.0808 => 0.0975, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.26% (0.2014 => 0.2422, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.05% (0.4029 => 0.4837, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.04% (0.1088 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.70% (0.2736 => 0.3275, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.68% (1.3152 => 1.5740, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.50% (0.2866 => 0.3425, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 19.47% (0.1505 => 0.1798, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.33% (4.4195 => 5.2740, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 19.26% (0.5546 => 0.6614, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.13% (3.5627 => 4.2442, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.11% (0.3271 => 0.3896, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.98% (0.4658 => 0.5542, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 18.92% (0.5826 => 0.6928, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 18.88% (1.8794 => 2.2343, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 18.83% (0.5889 => 0.6998, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.80% (0.1968 => 0.2338, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.72% (1.6211 => 1.9245, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.62% (0.1160 => 0.1376, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.23% (0.5026 => 0.5942, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.91% (0.3930 => 0.4634, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.89% (0.4361 => 0.5141, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 17.80% (0.1421 => 0.1674, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 17.76% (0.1284 => 0.1512, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 17.72% (0.7171 => 0.8442, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 17.63% (1.0781 => 1.2682, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.52% (2.7292 => 3.2074, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: 17.38% (0.9697 => 1.1382, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 17.27% (4.2109 => 4.9382, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.06% (0.1090 => 0.1276, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.94% (0.2911 => 0.3404, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.92% (1.9966 => 2.3344, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.88% (1.9694 => 2.3018, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 16.72% (0.2823 => 0.3295, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 16.71% (0.2813 => 0.3283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.69% (0.2792 => 0.3258, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 16.67% (0.2075 => 0.2421, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.62% (0.2725 => 0.3178, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 16.59% (0.2803 => 0.3268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.58% (0.2750 => 0.3206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.58% (0.2811 => 0.3277, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.52% (4.6926 => 5.4676, std.dev.: 0.1271) SingleSource/Regression/C++/ofstream_ctor: 16.51% (0.3004 => 0.3500, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 16.49% (23.5202 => 27.3978, std.dev.: 0.0512) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.45% (0.2729 => 0.3178, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.43% (0.9909 => 1.1537, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/wc: 16.31% (0.3096 => 0.3601, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.30% (2.0673 => 2.4042, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.15% (0.3195 => 0.3711, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.00% (0.3362 => 0.3900, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-4: 15.96% (0.3465 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.90% (0.3446 => 0.3994, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.88% (0.3469 => 0.4020, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.85% (0.3488 => 0.4041, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.85% (0.3060 => 0.3545, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 15.76% (0.2691 => 0.3115, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 15.75% (0.3460 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.52% (0.3124 => 0.3609, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 15.47% (0.3258 => 0.3762, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.43% (0.3267 => 0.3771, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.41% (0.3317 => 0.3828, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 15.39% (0.7875 => 0.9087, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/property: 15.34% (0.3650 => 0.4210, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.33% (0.3282 => 0.3785, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 15.31% (2.1013 => 2.4231, std.dev.: 0.0102) MultiSource/Applications/lua/lua: 15.30% (1.4269 => 1.6452, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: 15.23% (0.3643 => 0.4198, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.01% (0.3678 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.98% (0.3845 => 0.4421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.92% (0.3726 => 0.4282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.90% (0.3477 => 0.3995, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.87% (0.3348 => 0.3846, std.dev.: 0.0089) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (2.1653 => 2.4836, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.64% (0.3981 => 0.4564, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.62% (4.6177 => 5.2930, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.36% (0.3690 => 0.4220, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 14.26% (0.4251 => 0.4857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.03% (0.1383 => 0.1577, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 13.75% (0.5012 => 0.5701, std.dev.: 0.0183) MultiSource/Applications/SPASS/SPASS: 13.27% (5.5417 => 6.2770, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: 13.25% (0.4847 => 0.5489, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.24% (0.6435 => 0.7287, std.dev.: 0.0252) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.65% (0.1028 => 0.1158, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.53% (0.2737 => 0.3080, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 12.50% (2.0346 => 2.2889, std.dev.: 0.0086) MultiSource/Applications/siod/siod: 12.42% (0.6634 => 0.7458, std.dev.: 0.0081) MultiSource/Applications/lambda-0_1_3/lambda: 12.21% (0.3498 => 0.3925, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 12.11% (0.3336 => 0.3740, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.13% (0.2103 => 0.2337, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 11.08% (0.2391 => 0.2656, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 10.46% (11.9555 => 13.2058, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.46% (0.5584 => 0.6112, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.28% (0.3792 => 0.4030, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.68% (29.0505 => 181.4716, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.41% (0.2162 => 0.3533, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.64% (0.3693 => 0.4012, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.62% (3.3903 => 3.6147, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.2122 => 0.2248, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6688, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-2: 5.08% (1.8057 => 1.8974, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6814, std.dev.: 0.1559) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std.dev.: 0.0075) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2076, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5966, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4799, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5758, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.88% (17.2379 => 14.3279, std.dev.: 0.0771) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0492) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2212, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8080, std.dev.: 0.0101) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.22% (0.6293 => 0.6153, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1799, std.dev.: 1.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5810, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0493, std.dev.: 0.0648) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 02:10:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 04:10:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130101101024.EEADD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7264?compare_to=7260&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7264, Order: 171341, Start Time: 2013-01-01 08:34:41, End Time: 2013-01-01 10:11:35 To: 7260, Order: 171340, Start Time: 2013-01-01 05:11:28, End Time: 2013-01-01 06:48:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (817 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.91% (22.4056 => 78.8481, std.dev.: 0.0463) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.60% (0.0717 => 0.1130, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.72% (0.0974 => 0.1507, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 34.67% (0.1500 => 0.2020, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.04% (0.1132 => 0.1506, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.33% (1.6474 => 2.0977, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.60% (0.0699 => 0.0850, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.60% (5.4682 => 6.6494, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.52% (0.0790 => 0.0960, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.62% (2.2587 => 2.7019, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.65% (0.0680 => 0.0800, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.87% (0.6395 => 0.7410, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: 15.69% (1.1450 => 1.3247, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.57% (0.6395 => 0.7327, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.19% (0.6260 => 0.7086, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.32% (0.5941 => 0.6673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.94% (0.5805 => 0.6498, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.86% (0.6230 => 0.6969, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.69% (0.1146 => 0.1280, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.52% (0.5849 => 0.6523, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.39% (0.6033 => 0.6720, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.24% (0.5456 => 0.6069, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.15% (0.7021 => 0.7804, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.09% (0.6440 => 0.7154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.01% (0.5688 => 0.6314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.76% (0.5567 => 0.6166, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.64% (0.5581 => 0.6175, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.60% (0.5575 => 0.6166, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 10.59% (0.4524 => 0.5003, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.58% (0.5925 => 0.6552, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.52% (0.6676 => 0.7378, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.36% (0.5802 => 0.6403, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.30% (1.6364 => 1.8050, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.16% (0.5859 => 0.6454, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.90% (0.5857 => 0.6437, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.83% (0.6052 => 0.6647, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 9.81% (0.4515 => 0.4958, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.76% (0.6446 => 0.7075, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.71% (0.4861 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.44% (0.6189 => 0.6773, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.30% (0.5570 => 0.6088, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.23% (0.6304 => 0.6886, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.23% (0.5569 => 0.6083, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.20% (0.5705 => 0.6230, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.09% (0.5591 => 0.6099, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.5329 => 0.5812, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.05% (0.5478 => 0.5974, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.86% (3.5339 => 3.8471, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.73% (0.1982 => 0.2155, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.62% (0.6660 => 0.7234, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.55% (0.5863 => 0.6364, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.22% (0.6194 => 0.6703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.97% (0.6297 => 0.6799, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.83% (4.5069 => 4.8596, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.74% (0.6681 => 0.7198, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 7.72% (0.3357 => 0.3616, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.66% (0.7524 => 0.8100, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.42% (0.6667 => 0.7162, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.55% (0.7339 => 0.7820, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.40% (0.2001 => 0.2129, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3446 => 0.3656, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.92% (0.3394 => 0.3595, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6750 => 0.7148, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.57% (1.4642 => 1.5457, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.28% (18.2933 => 19.2586, std.dev.: 0.0318) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.15% (1.2784 => 1.3442, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (9.2283 => 9.7003, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2385 => 0.2505, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.99% (1.2515 => 1.3140, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 4.45% (0.3481 => 0.3636, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.11% (5.0226 => 5.1787, std.dev.: 0.0117) MultiSource/Applications/sqlite3/sqlite3: 3.03% (17.1032 => 17.6219, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 2.31% (1.3864 => 1.4184, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.07% (0.9557 => 0.9755, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.84% (31.3723 => 55.4777, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4396, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1157, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4732, std.dev.: 0.0858) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.20% (2.0478 => 2.1133, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3195, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6015, std.dev.: 0.0138) MultiSource/Applications/viterbi/viterbi: 1.06% (4.4335 => 4.4804, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.31% (0.2428 => 0.2299, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.58% (0.3142 => 0.2998, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: -4.43% (0.3812 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.42% (0.9852 => 0.9417, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.27% (0.3837 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.26% (0.3658 => 0.3502, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3831 => 0.3668, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.21% (0.3891 => 0.3727, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4033 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.09% (0.9542 => 0.9152, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.02% (0.3057 => 0.2934, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.01% (0.2871 => 0.2756, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.00% (2.1713 => 2.0844, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: -3.98% (0.4199 => 0.4032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.88% (0.3016 => 0.2899, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -3.87% (0.3205 => 0.3081, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.86% (1.3148 => 1.2640, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.82% (0.6484 => 0.6236, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -3.81% (0.4280 => 0.4117, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: -3.79% (0.3194 => 0.3073, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.78% (0.7198 => 0.6926, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.75% (0.2933 => 0.2823, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.68% (0.4321 => 0.4162, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -3.67% (0.2939 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.64% (0.3931 => 0.3788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.62% (0.2849 => 0.2746, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (0.3621 => 0.3493, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.53% (2.4924 => 2.4044, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.49% (0.4151 => 0.4006, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.42% (0.6441 => 0.6221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.34% (0.3867 => 0.3738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.28% (0.4427 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.21% (4.3330 => 4.1941, std.dev.: 0.0136) SingleSource/UnitTests/ObjC++/property-reference: -3.15% (0.7779 => 0.7534, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1457, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/moments: -2.97% (0.4248 => 0.4122, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.96% (0.3849 => 0.3735, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -2.96% (0.3788 => 0.3676, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.7919 => 0.7688, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.77% (0.4083 => 0.3970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.76% (1.0544 => 1.0253, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.68% (1.2210 => 1.1883, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -2.66% (0.7982 => 0.7770, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.58% (1.2221 => 1.1906, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.41% (6.7716 => 6.6083, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.34% (14.2083 => 13.8761, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -2.24% (7.0961 => 6.9374, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -2.23% (34.0927 => 33.3331, std.dev.: 0.0564) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.19% (1.2300 => 1.2031, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -2.17% (1.5610 => 1.5272, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8455, std.dev.: 0.0210) MultiSource/Applications/lua/lua: -2.09% (4.0594 => 3.9747, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.75% (0.8521 => 0.8372, std.dev.: 0.0055) MultiSource/Applications/treecc/treecc: -1.57% (2.1401 => 2.1065, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -1.55% (2.4021 => 2.3649, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -1.46% (0.9179 => 0.9045, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.10% (8.0126 => 7.9244, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.02% (4.0323 => 3.9910, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.07% (1.8100 => 0.6865, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.85% (8.0445 => 4.0340, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4759, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.26% (0.1622 => 0.1115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.99% (0.1983 => 0.1428, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0279, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7560, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0409, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1997, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1836, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -18.68% (3.3454 => 2.7205, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.55% (2.5106 => 2.1201, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.22% (4.9100 => 4.3589, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6340, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8203, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.88% (4.1534 => 3.9091, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.40% (1.1594 => 1.0968, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.74% (1.7753 => 1.6911, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1816, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.29% (1.0557 => 1.0210, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (7.9763 => 7.7401, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.65% (1.3096 => 1.2749, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7007, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.3040 => 7.1840, std.dev.: 0.0240) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8033, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 02:26:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 04:26:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130101102621.66E9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7265?compare_to=7261&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7265, Order: 171341, Start Time: 2013-01-01 08:31:14, End Time: 2013-01-01 10:27:33 To: 7261, Order: 171340, Start Time: 2013-01-01 05:52:16, End Time: 2013-01-01 07:47:37 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (219 on baseline) Performance Improvements: 4 (50 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1052 (707 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.34% (4.8154 => 4.9280, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.14% (1.8460 => 1.8670, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.84% (6.2059 => 6.6924, std.dev.: 0.0599) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.88% (21.4712 => 21.8756, std.dev.: 0.1211) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.44% (1.4182 => 1.3978, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -2.94% (9.3154 => 9.0412, std.dev.: 0.0768) SingleSource/Benchmarks/Shootout-C++/matrix: -1.36% (4.6772 => 4.6136, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.01% (60.1956 => 59.5887, std.dev.: 0.0560) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.03% (1.1450 => 1.1453, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.56% (0.3963 => 0.3985, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0430 => 0.0431, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0338 => 0.0340, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.19% (0.0306 => 0.0328, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 56.92% (0.0130 => 0.0204, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: 31.14% (0.0167 => 0.0219, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.70% (0.0187 => 0.0167, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.79% (0.1514 => 0.1502, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -2.31% (1.1650 => 1.1381, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.99% (0.4015 => 0.4135, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.74% (0.1437 => 0.1462, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.67% (0.0927 => 0.0961, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.24% (0.0205 => 0.0184, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.81% (0.0553 => 0.0563, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.2768 => 1.2798, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 116.67% (0.0012 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.69% (0.0520 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.87% (0.0223 => 0.0245, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (2.7804 => 2.7654, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.45% (0.0067 => 0.0060, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.97% (30.9088 => 31.2081, std.dev.: 0.2077) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.02% (16.4461 => 19.9033, std.dev.: 0.1375) MultiSource/Applications/sqlite3/sqlite3: 3488.28% (0.6332 => 22.7210, std.dev.: 0.1810) MultiSource/Benchmarks/McCat/08-main/main: 54.78% (0.1831 => 0.2834, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.71% (0.1559 => 0.1548, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23326.26% (0.3123 => 73.1602, std.dev.: 0.0887) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1827.54% (0.3344 => 6.4457, std.dev.: 0.1876) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.21% (0.2364 => 0.3291, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 16.34% (0.6010 => 0.6992, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel: 7.46% (0.0429 => 0.0461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.25% (0.3266 => 0.3470, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/strcat: 5.33% (0.1969 => 0.2074, std.dev.: 0.0006) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.46% (0.0224 => 0.0234, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: -23.91% (0.0230 => 0.0175, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0512, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 14.02% (0.1462 => 0.1667, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3861, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0688, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4924, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5284, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5223, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0550, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3365, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3812, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0820, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: -29.40% (2.1832 => 1.5414, std.dev.: 0.0250) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 146.18% (0.0249 => 0.0613, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 104.40% (0.0250 => 0.0511, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 75.54% (0.0233 => 0.0409, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 70.71% (0.0297 => 0.0507, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 63.61% (0.1440 => 0.2356, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 60.22% (0.8359 => 1.3393, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.96% (0.8611 => 1.3774, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.47% (0.8261 => 1.3174, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.27% (0.8805 => 1.4024, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.08% (0.7932 => 1.2618, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 58.87% (0.8007 => 1.2721, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.83% (0.8316 => 1.3208, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 57.93% (0.8066 => 1.2739, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 57.80% (0.8048 => 1.2700, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 57.69% (0.8177 => 1.2894, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 57.47% (0.8457 => 1.3317, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.86% (0.8597 => 1.3485, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 56.68% (0.8338 => 1.3064, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/shr: 56.02% (0.0191 => 0.0298, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 55.36% (0.8885 => 1.3804, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.07% (0.8716 => 1.3516, std.dev.: 0.0013) SingleSource/Regression/C/test_indvars: 54.74% (0.0232 => 0.0359, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.35% (0.9056 => 1.3978, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.21% (0.9039 => 1.3939, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 53.85% (1.5315 => 2.3562, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.99% (0.9688 => 1.4725, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/ary3: 49.36% (0.0235 => 0.0351, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 43.88% (0.0784 => 0.1128, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.98% (2.1401 => 2.9958, std.dev.: 0.0437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.10% (0.0734 => 0.0999, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 34.55% (3.1832 => 4.2829, std.dev.: 0.1178) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.49% (0.0421 => 0.0562, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.00% (0.0550 => 0.0726, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.94% (0.0989 => 0.1295, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.29% (0.0635 => 0.0821, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.16% (0.8855 => 1.1437, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 28.00% (0.0650 => 0.0832, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.94% (0.1983 => 0.2537, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 27.82% (0.7966 => 1.0182, std.dev.: 0.0211) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.57% (0.2180 => 0.2781, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.38% (0.8286 => 1.0555, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.18% (0.8712 => 1.0993, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.90% (0.8050 => 1.0135, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.85% (0.8204 => 1.0325, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.78% (0.8069 => 1.0149, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.58% (0.8697 => 1.0922, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.50% (0.8086 => 1.0148, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 25.48% (0.2999 => 0.3763, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.39% (0.8317 => 1.0429, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.28% (0.8331 => 1.0437, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.28% (0.8518 => 1.0671, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 24.93% (0.8420 => 1.0519, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.79% (0.9069 => 1.1317, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 24.75% (0.8656 => 1.0798, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.41% (0.9074 => 1.1289, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.27% (0.8927 => 1.1094, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/queens: 23.97% (0.0438 => 0.0543, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.90% (0.9908 => 1.2276, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.75% (0.4783 => 0.5871, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 22.62% (0.1839 => 0.2255, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.43% (4.4880 => 5.4947, std.dev.: 0.0784) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.41% (0.0848 => 0.1038, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.32% (0.6586 => 0.8056, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 21.68% (1.0945 => 1.3318, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 21.40% (0.0757 => 0.0919, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.37% (0.0810 => 0.0975, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 20.24% (0.3800 => 0.4569, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.88% (0.1157 => 0.1387, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 19.87% (0.1565 => 0.1876, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.40% (0.0701 => 0.0837, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.27% (1.3279 => 1.5838, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.13% (1.2526 => 1.4922, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 18.73% (0.0822 => 0.0976, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 18.53% (0.1112 => 0.1318, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.41% (0.1097 => 0.1299, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 18.36% (2.3764 => 2.8127, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 18.12% (0.0745 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.72% (0.3137 => 0.3693, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.49% (0.1778 => 0.2089, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 17.38% (0.4125 => 0.4842, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 17.30% (8.6247 => 10.1164, std.dev.: 0.0434) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.47% (0.5191 => 0.6046, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.45% (0.1137 => 0.1324, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 16.28% (0.2427 => 0.2822, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 16.21% (1.2222 => 1.4203, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/ary: 15.77% (0.2390 => 0.2767, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.58% (0.1425 => 0.1647, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 15.54% (0.2227 => 0.2573, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.2509 => 0.2895, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.34% (0.0691 => 0.0797, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 15.10% (0.0722 => 0.0831, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.06% (0.0830 => 0.0955, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.75% (0.1756 => 0.2015, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 14.69% (0.4397 => 0.5043, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 14.61% (14.2605 => 16.3443, std.dev.: 0.1425) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.20% (0.4127 => 0.4713, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 14.06% (0.8768 => 1.0001, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.94% (1.6386 => 1.8670, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 13.71% (0.1466 => 0.1667, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 13.55% (0.0937 => 0.1064, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 13.50% (1.2568 => 1.4265, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.44% (0.6010 => 0.6818, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.25% (13.1811 => 14.9279, std.dev.: 0.0476) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.10% (0.1885 => 0.2132, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.10% (0.7473 => 0.8452, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.99% (0.9435 => 1.0661, std.dev.: 0.0142) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.91% (0.0829 => 0.0936, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: 12.85% (0.1035 => 0.1168, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 12.58% (1.1271 => 1.2689, std.dev.: 0.0131) MultiSource/Applications/oggenc/oggenc: 12.53% (4.9628 => 5.5846, std.dev.: 0.0561) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.52% (0.4847 => 0.5454, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 12.45% (0.7950 => 0.8940, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.44% (0.3295 => 0.3705, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.31% (1.2602 => 1.4153, std.dev.: 0.0169) MultiSource/Benchmarks/sim/sim: 12.03% (0.3226 => 0.3614, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.74% (0.2240 => 0.2503, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.51% (0.2998 => 0.3343, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.46% (0.6834 => 0.7617, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.45% (0.8321 => 0.9274, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 11.36% (0.6287 => 0.7001, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 10.98% (3.8189 => 4.2384, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.83% (0.1099 => 0.1218, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 10.66% (3.2366 => 3.5816, std.dev.: 0.0475) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.62% (0.8148 => 0.9013, std.dev.: 0.0157) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.45% (0.1091 => 0.1205, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 10.39% (0.1347 => 0.1487, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.24% (4.1763 => 4.6041, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/em3d/em3d: 10.17% (0.1721 => 0.1896, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 10.16% (15.3280 => 16.8846, std.dev.: 0.1415) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.13% (0.6227 => 0.6858, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: 10.00% (1.9948 => 2.1942, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/power/power: 9.94% (0.1247 => 0.1371, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 9.82% (2.2184 => 2.4363, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.70% (0.8340 => 0.9149, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.70% (0.5817 => 0.6381, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.66% (0.1905 => 0.2089, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.65% (0.1150 => 0.1261, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.50% (0.3717 => 0.4070, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.43% (0.5961 => 0.6523, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.40% (8.6476 => 9.4606, std.dev.: 0.0814) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.38% (0.1183 => 0.1294, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.26% (0.4559 => 0.4981, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 9.25% (14.7684 => 16.1350, std.dev.: 0.1055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.04% (0.2378 => 0.2593, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.97% (1.1685 => 1.2733, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.79% (1.1170 => 1.2152, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.73% (1.1606 => 1.2619, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.64% (0.2279 => 0.2476, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 8.59% (6.7320 => 7.3100, std.dev.: 0.0751) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.38% (6.6074 => 7.1610, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.35% (0.3115 => 0.3375, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.26% (0.2519 => 0.2727, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 8.24% (0.1577 => 0.1707, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.11% (4.4873 => 4.8512, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.92% (0.1301 => 0.1404, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.84% (0.2794 => 0.3013, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.83% (4.5702 => 4.9280, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.69% (0.2133 => 0.2297, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.68% (4.1305 => 4.4476, std.dev.: 0.0441) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.66% (0.2741 => 0.2951, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 7.53% (1.4269 => 1.5344, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 7.47% (0.2985 => 0.3208, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.93% (0.1588 => 0.1698, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 6.71% (0.3503 => 0.3738, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 5.56% (0.2088 => 0.2204, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 4.76% (31.8598 => 33.3762, std.dev.: 0.0088) MultiSource/Applications/lambda-0_1_3/lambda: 4.74% (0.7557 => 0.7915, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.11% (0.2844 => 0.2961, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 4.05% (0.9810 => 1.0207, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.3124 => 0.3232, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.36% (0.6943 => 0.7176, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.34% (0.3657 => 0.3779, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.15% (1.2423 => 1.2814, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1508800.00% (0.0001 => 1.5089, std.dev.: 0.0213) MultiSource/Applications/sgefa/sgefa: 372.02% (0.3585 => 1.6922, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 362.31% (1.5671 => 7.2449, std.dev.: 0.2658) MultiSource/Benchmarks/PAQ8p/paq8p: 279.61% (91.7701 => 348.3730, std.dev.: 3.0327) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.15% (28.5821 => 85.5022, std.dev.: 0.0873) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.82% (5.1305 => 14.0483, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 111.90% (1.1365 => 2.4082, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/ary: 100.00% (0.0219 => 0.0438, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 62.81% (0.0199 => 0.0324, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 60.42% (2.8760 => 4.6136, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 60.18% (0.0226 => 0.0362, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.61% (2.7995 => 3.9084, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/pi: 37.77% (1.5795 => 2.1760, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.34% (1.3882 => 1.8510, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.40% (4.5327 => 5.9561, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.24% (2.9096 => 3.7312, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/misr: 18.42% (0.4001 => 0.4738, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.09% (0.7597 => 0.8895, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.83% (4.7794 => 5.5837, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 14.33% (7.5003 => 8.5751, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.71% (1.1857 => 1.3008, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 9.37% (3.1873 => 3.4861, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/ReedSolomon: 7.60% (8.5322 => 9.1806, std.dev.: 0.0794) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3057, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.65% (0.3186 => 0.3398, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.60% (4.9686 => 5.2467, std.dev.: 0.0340) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.40% (3.5679 => 3.7604, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.29% (4.8436 => 5.0998, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.27% (0.6150 => 0.6474, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 4.86% (3.3398 => 3.5021, std.dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 4.75% (6.7064 => 7.0249, std.dev.: 0.0354) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.60% (0.5214 => 0.5454, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.58% (6.1706 => 6.4530, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 4.57% (3.8206 => 3.9952, std.dev.: 0.0674) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.76% (0.3587 => 0.3722, std.dev.: 0.0030) SingleSource/Benchmarks/Dhrystone/dry: 3.37% (0.5081 => 0.5252, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (4.2466 => 4.3881, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/queens: 2.97% (1.7056 => 1.7563, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/power/power: 2.91% (1.2061 => 1.2412, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.55% (1.2337 => 1.2652, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.18% (3.4104 => 3.4849, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/methcall: 2.01% (8.2676 => 8.4340, std.dev.: 0.0281) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.54% (1.9302 => 1.9600, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.54% (8.2783 => 8.4057, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/bh/bh: 1.36% (2.3560 => 2.3880, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/dt: 1.12% (0.9842 => 0.9952, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.23% (2.8951 => 0.8329, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.65% (11.5316 => 4.6535, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/fp-convert: -52.18% (15.8853 => 7.5961, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.55% (4.7482 => 3.0128, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.42% (5.4972 => 3.6053, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.58% (5.4300 => 3.6608, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: -30.96% (1.9999 => 1.3807, std.dev.: 0.0680) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.68% (5.6343 => 4.1310, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.42% (5.0261 => 3.9997, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.93% (5.0243 => 4.1738, std.dev.: 0.0954) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.94% (2.9753 => 2.5307, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.40% (6.3772 => 5.4591, std.dev.: 0.2631) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.95% (9.9065 => 8.7224, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: -10.26% (1.1216 => 1.0065, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: -10.22% (63.1822 => 56.7219, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/flops-8: -9.74% (2.5609 => 2.3114, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/perlin: -9.59% (5.1084 => 4.6187, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.27% (6.2275 => 5.6500, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: -9.13% (5.4641 => 4.9653, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.90% (3.7148 => 3.3841, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.03% (1.0512 => 0.9668, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.49% (5.3218 => 4.9232, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.45% (3.2169 => 2.9773, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.22% (7.2130 => 6.6924, std.dev.: 0.0599) SingleSource/Benchmarks/Stanford/FloatMM: -6.18% (0.8807 => 0.8263, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/sieve: -6.14% (7.0599 => 6.6263, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.06% (0.3269 => 0.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -5.55% (9.3748 => 8.8544, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.39% (4.9453 => 4.6787, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.26% (0.3937 => 0.3730, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -4.41% (0.6910 => 0.6605, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/ffbench: -3.36% (1.4296 => 1.3816, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (8.9760 => 8.6762, std.dev.: 0.0356) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.28% (1.4529 => 1.4052, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.22% (5.1557 => 4.9896, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -3.10% (29.8330 => 28.9077, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.96% (4.7449 => 4.6045, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.83% (6.0224 => 5.8519, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.69% (4.8362 => 4.7060, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/fbench: -2.48% (3.3840 => 3.3000, std.dev.: 0.0270) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.11% (9.2989 => 9.1029, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.02% (3.3479 => 3.2802, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.90% (22.2997 => 21.8756, std.dev.: 0.1211) SingleSource/Benchmarks/Shootout-C++/lists1: -1.78% (0.6166 => 0.6056, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: -1.74% (2.8957 => 2.8453, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -1.61% (1.4861 => 1.4621, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.60% (1.5308 => 1.5063, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/neural/neural: -1.43% (1.0841 => 1.0686, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: -1.11% (3.4237 => 3.3858, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.01% (4.9994 => 4.9488, std.dev.: 0.0091) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.61% (1.0262 => 1.1453, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: 61.79% (0.2463 => 0.3985, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.86% (0.0254 => 0.0340, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.61% (0.0302 => 0.0328, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.45% (0.1438 => 0.1502, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 0.46% (1.1329 => 1.1381, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.70% (0.4164 => 0.4135, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.79% (0.1369 => 0.1462, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 49.92% (0.0641 => 0.0961, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.64% (0.0195 => 0.0184, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.60% (0.0578 => 0.0563, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.90% (1.1437 => 1.2798, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.54% (0.0627 => 0.0586, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.11% (0.0180 => 0.0245, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 244.94% (0.8017 => 2.7654, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.23% (0.0062 => 0.0060, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 02:55:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 04:55:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130101105557.8C7DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7266?compare_to=7262&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7266, Order: 171341, Start Time: 2013-01-01 08:41:30, End Time: 2013-01-01 10:56:15 To: 7262, Order: 171340, Start Time: 2013-01-01 05:47:16, End Time: 2013-01-01 08:01:31 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (611 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1340 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0664 => 0.0664, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8551 => 499.8455, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.33% (1.1277 => 499.8455, std.dev.: 0.0087) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.27% (0.5229 => 1.6590, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 20.14% (14.9895 => 18.0081, std.dev.: 0.0214) MultiSource/Applications/kimwitu++/kc: 54.37% (14.1553 => 21.8515, std.dev.: 0.0395) MultiSource/Benchmarks/MallocBench/gs/gs: 17.11% (4.1105 => 4.8140, std.dev.: 0.0220) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.07% (1.1048 => 1.7464, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1230.40% (7.1582 => 95.2330, std.dev.: 0.0523) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.61% (3.4629 => 7.8126, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.01% (0.6222 => 1.1076, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10230.83% (0.0720 => 7.4382, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 3830000.00% (0.0001 => 3.8301, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11158500.00% (0.0001 => 11.1586, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577800.00% (0.0001 => 0.5779, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9957600.00% (0.0001 => 9.9577, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5505200.00% (0.0001 => 5.5053, std.dev.: 0.0081) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.47% (1.1194 => 10.3037, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 148.97% (22.1758 => 55.2101, std.dev.: 0.0405) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 85.04% (0.0929 => 0.1719, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 59.40% (0.1463 => 0.2332, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.96% (2.9384 => 4.6416, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.47% (7.0540 => 10.9668, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.93% (1.5859 => 2.4094, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 49.72% (0.1056 => 0.1581, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 47.19% (0.0231 => 0.0340, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.00% (8.1363 => 11.9605, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops: 42.46% (0.1432 => 0.2040, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.69% (0.0439 => 0.0622) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.50% (2.2024 => 3.1163, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 41.20% (21.9371 => 30.9760, std.dev.: 0.0172) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.41% (0.6675 => 0.8905, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.86% (0.1062 => 0.1411, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.73% (1.5415 => 2.0461, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 32.04% (0.3109 => 0.4105, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.44% (0.5105 => 0.6710, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 30.68% (0.4299 => 0.5618, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.64% (0.4615 => 0.6029, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.94% (4.2646 => 5.5414, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 29.94% (0.4289 => 0.5573, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 28.38% (0.4620 => 0.5931, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 27.73% (1.1642 => 1.4870, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.61% (0.0746 => 0.0952, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 26.68% (1.0722 => 1.3583, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.42% (0.1892 => 0.2373, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 25.41% (0.2554 => 0.3203, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.23% (0.2271 => 0.2844, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 25.11% (0.1175 => 0.1470, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.05% (3.8922 => 4.8672, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 24.88% (0.6456 => 0.8062, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 23.64% (0.0719 => 0.0889, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.62% (1.4186 => 1.7537, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.38% (0.0479 => 0.0591, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 22.55% (9.4845 => 11.6231, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.45% (0.0793 => 0.0971, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 22.31% (5.7591 => 7.0437, std.dev.: 0.0131) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.27% (0.3121 => 0.3816, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.26% (0.2700 => 0.3301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 21.96% (0.3283 => 0.4004, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 21.69% (0.1655 => 0.2014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.59% (0.1695 => 0.2061, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.54% (0.1337 => 0.1625, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 21.53% (0.3232 => 0.3928, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.49% (0.7115 => 0.8644, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.15% (1.3050 => 1.5810, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 20.98% (0.1163 => 0.1407, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.71% (0.7835 => 0.9458, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 20.00% (0.1555 => 0.1866, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.98% (0.0886 => 0.1063, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 19.97% (0.0626 => 0.0751, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.94% (0.0672 => 0.0806, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.87% (4.9449 => 5.9273, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/ary2: 19.59% (0.3379 => 0.4041, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138) MultiSource/Applications/d/make_dparser: 19.35% (3.3354 => 3.9809, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 19.32% (1.1840 => 1.4128, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.23% (5.0018 => 5.9634, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.22% (0.5860 => 0.6986, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.14% (0.1029 => 0.1226, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 19.04% (17.1811 => 20.4518, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/em3d/em3d: 19.00% (0.1695 => 0.2017, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/15-trie/trie: 18.98% (0.0527 => 0.0627, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.81% (0.0675 => 0.0802, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.62% (0.8172 => 0.9694, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 18.51% (0.7433 => 0.8809, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 18.25% (0.1151 => 0.1361, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.20% (0.1940 => 0.2293, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.07% (0.5020 => 0.5927, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.04% (0.2107 => 0.2487, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.90% (0.4636 => 0.5466, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.64% (0.1236 => 0.1454, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 17.59% (0.0614 => 0.0722, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.40% (0.0730 => 0.0857, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.3423 => 0.4018, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.37% (0.2758 => 0.3237, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.32% (0.9765 => 1.1456, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.26% (0.5569 => 0.6530, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 17.19% (0.1268 => 0.1486, std.dev.: 0.0035) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.15% (0.1143 => 0.1339, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.05% (0.3307 => 0.3871, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.00% (3.8723 => 4.5304, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 16.89% (2.2969 => 2.6848, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.60% (0.5981 => 0.6974, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 16.58% (2.0273 => 2.3635, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.6450 => 0.7515, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 16.04% (0.8921 => 1.0352, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.89% (0.8101 => 0.9388, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.69% (0.3441 => 0.3981, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.24% (1.1861 => 1.3669, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 14.93% (0.2049 => 0.2355, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.60% (0.2603 => 0.2983, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 14.15% (0.3180 => 0.3630, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.09% (0.8067 => 0.9204, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: 14.08% (0.3387 => 0.3864, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 14.07% (1.5603 => 1.7798, std.dev.: 0.0082) SingleSource/Benchmarks/Stanford/Puzzle: 13.25% (0.1268 => 0.1436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.91% (0.3865 => 0.4364, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 12.49% (0.3282 => 0.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.36% (0.4103 => 0.4610, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 12.33% (0.3098 => 0.3480, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.28% (0.4203 => 0.4719, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 11.68% (0.4048 => 0.4521, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 11.66% (0.3603 => 0.4023, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.49% (14.3668 => 16.0173, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 11.28% (0.3422 => 0.3808, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.11% (0.3826 => 0.4251, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.00% (0.3427 => 0.3804, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.91% (0.2430 => 0.2695, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: 10.83% (0.3684 => 0.4083, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.82% (0.3927 => 0.4352, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 10.69% (0.2871 => 0.3178, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3650 => 0.4034, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 10.17% (0.2831 => 0.3119, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.15% (0.3694 => 0.4069, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.68% (0.3162 => 0.3468, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.65% (2.0665 => 2.2659, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 9.55% (0.5925 => 0.6491, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.50% (0.6030 => 0.6603, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.47% (0.2756 => 0.3017, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.43% (10.3673 => 11.3453, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2872 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 9.36% (0.2905 => 0.3177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2793 => 0.3052, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.24% (1.2842 => 1.4028, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2725 => 0.2976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.10% (0.2714 => 0.2961, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.10% (63.2438 => 68.9983, std.dev.: 0.0953) SingleSource/Benchmarks/Shootout-C++/wc: 9.08% (0.3052 => 0.3329, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.79% (2.2022 => 2.3957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.07% (0.3136 => 0.3389, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.4879 => 0.5258, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 7.41% (0.3131 => 0.3363, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.16% (7.9617 => 8.2132, std.dev.: 0.0223) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.65% (32.5116 => 59.0575, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.19% (1.1145 => 1.2949, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.01% (2.8904 => 3.1509, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.29% (3.1578 => 3.3247, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4504, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1067, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (0.9957 => 1.0283, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9189, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7107, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8444 => 28.3443, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (1.7254 => 1.7520, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5215, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2251, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1702, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1996, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.59% (5.3855 => 4.4923, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.04% (5.3526 => 4.4940, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: -12.86% (10.4361 => 9.0935, std.dev.: 0.0186) SingleSource/UnitTests/Vector/constpool: -7.73% (54.1659 => 49.9767, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.46% (1.7609 => 1.6472, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.37% (1.9577 => 0.6584, std.dev.: 0.0160) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.11% (8.0499 => 4.0158, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.83% (0.6962 => 0.3841, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0190, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4124, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.8020, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.56% (2.6546 => 2.0025, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -22.19% (0.0757 => 0.0589, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3709, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001) SingleSource/UnitTests/Vector/multiplies: -16.32% (2.5528 => 2.1363, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7359, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -12.28% (1.2373 => 1.0854, std.dev.: 0.0083) MultiSource/Benchmarks/NPB-serial/is/is: -11.10% (9.5636 => 8.5016, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4228, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2509, std.dev.: 0.0561) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.61% (1.6805 => 1.5863, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.10% (0.4808 => 0.4563, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.47% (1.5835 => 1.5127, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8285, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.35% (8.1563 => 7.8018, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.75% (3.2827 => 3.1597, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: -3.50% (0.6223 => 0.6005, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.01% (1.0554 => 1.0342, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3300, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.11% (4.6441 => 4.5925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0031) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 05:25:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 07:25:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130101132529.8C9E42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7267?compare_to=7263&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7267, Order: 171341, Start Time: 2013-01-01 09:53:32, End Time: 2013-01-01 13:26:40 To: 7263, Order: 171340, Start Time: 2013-01-01 05:25:37, End Time: 2013-01-01 09:03:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1099 (708 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.47% (2.0525 => 2.1031, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.69% (10.7469 => 10.9281, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 1.54% (13.5149 => 13.7232, std.dev.: 0.0531) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.91% (11.6398 => 21.1736, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.99% (0.5361 => 0.8309, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.62% (0.1063 => 0.1431, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.43% (0.2969 => 0.3813, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.76% (0.1106 => 0.1413, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.71% (0.7426 => 0.9484, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.75% (0.4139 => 0.5246, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 26.32% (1.5932 => 2.0126, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.96% (0.0547 => 0.0689, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.65% (0.4253 => 0.5344, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.61% (0.4994 => 0.6273, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.53% (0.5900 => 0.7406, std.dev.: 0.0085) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.12% (0.5000 => 0.6256, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.44% (0.1620 => 0.2016, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1021 => 0.1269, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.67% (0.1103 => 0.1353, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.37% (0.0541 => 0.0662, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.21% (0.1549 => 0.1893, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.16% (0.3903 => 0.4768, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.88% (0.1604 => 0.1955, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.86% (0.1462 => 0.1767, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.57% (0.3890 => 0.4690, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.26% (0.2014 => 0.2422, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 20.20% (0.1218 => 0.1464, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 20.05% (0.4029 => 0.4837, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.71% (0.4658 => 0.5576, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.61% (0.2866 => 0.3428, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 19.60% (0.1505 => 0.1800, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.2736 => 0.3272, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.45% (4.4195 => 5.2791, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.31% (1.3152 => 1.5691, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.09% (3.5627 => 4.2427, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 18.99% (0.5546 => 0.6599, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.80% (0.5826 => 0.6921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.78% (0.5889 => 0.6995, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.75% (0.1968 => 0.2337, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 18.73% (1.8794 => 2.2314, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.68% (0.3271 => 0.3882, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.59% (1.6211 => 1.9225, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.45% (0.1160 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.95% (0.1421 => 0.1676, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.89% (0.4361 => 0.5141, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 17.76% (0.1284 => 0.1512, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.67% (0.5026 => 0.5914, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.66% (0.3930 => 0.4624, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 17.59% (1.0781 => 1.2677, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.57% (2.7292 => 3.2086, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 17.42% (0.9697 => 1.1386, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 17.17% (4.2109 => 4.9341, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.06% (0.1090 => 0.1276, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.92% (1.9694 => 2.3027, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.82% (0.2729 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.69% (0.2750 => 0.3209, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 16.67% (0.2813 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.65% (0.2823 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.63% (1.9966 => 2.3286, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 16.58% (0.2714 => 0.3164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 16.58% (0.2075 => 0.2419, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 16.58% (0.2811 => 0.3277, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 16.55% (0.2803 => 0.3267) SingleSource/UnitTests/ObjC++/property-reference: 16.55% (0.7171 => 0.8358, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.54% (0.2738 => 0.3191, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 16.51% (0.3004 => 0.3500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.48% (0.2725 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.33% (4.6926 => 5.4590, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 16.28% (0.9909 => 1.1522, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.21% (23.5202 => 27.3339, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.21% (2.0673 => 2.4024, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.02% (0.3096 => 0.3592, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.96% (0.3465 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.88% (0.3488 => 0.4042, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3446 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.80% (0.3469 => 0.4017, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 15.78% (0.3460 => 0.4006, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.71% (0.2566 => 0.2969, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 15.70% (0.3496 => 0.4045, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.62% (0.3060 => 0.3538, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 15.52% (0.3267 => 0.3774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.46% (0.3124 => 0.3607, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.38% (0.3258 => 0.3759, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 15.37% (1.4269 => 1.6462, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 15.32% (0.3650 => 0.4209, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 15.29% (0.3643 => 0.4200, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.14% (0.3362 => 0.3871, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 15.13% (0.3477 => 0.4003, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 14.90% (0.3348 => 0.3847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.85% (0.3678 => 0.4224, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.81% (0.7875 => 0.9041, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.71% (0.3726 => 0.4274, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (2.1653 => 2.4835, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 14.68% (0.2691 => 0.3086, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 14.60% (4.6177 => 5.2917, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.59% (0.3625 => 0.4154, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.52% (0.3981 => 0.4559, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.38% (2.1013 => 2.4034, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.31% (0.3690 => 0.4218, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 14.16% (0.4146 => 0.4733, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 14.14% (0.4251 => 0.4852, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.3845 => 0.4384, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.5012 => 0.5706, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.27% (0.6435 => 0.7289, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 13.06% (5.5417 => 6.2654, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: 12.94% (0.4847 => 0.5474, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.71% (0.3084 => 0.3476, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.52% (0.2068 => 0.2327, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.42% (2.0346 => 2.2873, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 12.29% (0.6634 => 0.7449, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.26% (0.1028 => 0.1154, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.18% (0.3498 => 0.3924, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.15% (0.1383 => 0.1551, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 11.08% (0.2391 => 0.2656, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.37% (11.9555 => 13.1948, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.58% (0.5584 => 0.6119, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.22% (0.3792 => 0.4028, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5368, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.92% (0.2802 => 0.3080, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.23% (0.3693 => 0.3923, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2392, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6843, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0804, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2081, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6092, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4796, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5522, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.66% (17.2379 => 14.1945, std.dev.: 0.1094) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7840, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: -7.13% (2.1113 => 1.9607, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2159, std.dev.: 0.0131) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8054, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -2.31% (14.0481 => 13.7232, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1855, std.dev.: 0.0395) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.72% (0.6293 => 0.6185, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2115, std.dev.: 0.0477) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.01% (16.2163 => 16.0520, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 08:06:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 10:06:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130101160615.512C32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7268?compare_to=7264&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7268, Order: 171343, Start Time: 2013-01-01 14:30:51, End Time: 2013-01-01 16:07:24 To: 7264, Order: 171341, Start Time: 2013-01-01 08:34:41, End Time: 2013-01-01 10:11:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (817 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.62% (0.4019 => 0.4285, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.59% (22.4056 => 78.7768, std.dev.: 0.0882) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.46% (0.0717 => 0.1129, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.62% (0.0974 => 0.1506, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.89% (0.0599 => 0.0790) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.38% (1.6474 => 2.0985, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 22.03% (0.0699 => 0.0853, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.46% (5.4682 => 6.6418, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.69% (2.2587 => 2.7035, std.dev.: 0.0285) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.89% (0.6395 => 0.7411, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.62% (1.1450 => 1.3239, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.20% (0.6395 => 0.7303, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.27% (0.6260 => 0.7091, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.29% (0.5941 => 0.6671, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.93% (0.6230 => 0.6973, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.87% (0.5805 => 0.6494, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.76% (0.3834 => 0.4285, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.69% (0.1146 => 0.1280, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.44% (0.6033 => 0.6723, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.22% (0.5849 => 0.6505, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.15% (0.7021 => 0.7804, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.07% (0.6440 => 0.7153, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.03% (0.5456 => 0.6058, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 10.96% (0.4524 => 0.5020, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.85% (0.5688 => 0.6305, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.68% (0.5581 => 0.6177, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.67% (0.5567 => 0.6161, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.67% (0.6676 => 0.7388, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.58% (0.5575 => 0.6165, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.51% (0.5925 => 0.6548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.31% (0.5802 => 0.6400, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.24% (1.6364 => 1.8039, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.10% (0.5859 => 0.6451, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.07% (0.5857 => 0.6447, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 9.83% (0.4515 => 0.4959, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.83% (0.4916 => 0.5399, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.78% (0.6052 => 0.6644, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 9.71% (0.4861 => 0.5333, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.59% (0.6446 => 0.7064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.40% (0.6189 => 0.6771, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.30% (0.5570 => 0.6088, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.26% (0.6304 => 0.6888, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.15% (0.5705 => 0.6227, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.09% (0.5569 => 0.6075, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.07% (0.5478 => 0.5975, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.99% (3.5339 => 3.8517, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.93% (0.5329 => 0.5805, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.85% (0.5591 => 0.6086, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.83% (0.1982 => 0.2157, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.73% (0.5863 => 0.6375, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.56% (0.6660 => 0.7230, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.28% (0.6194 => 0.6707) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.10% (0.6297 => 0.6807, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (4.5069 => 4.8610, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.84% (0.6681 => 0.7205, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.68% (0.7524 => 0.8102, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 7.63% (0.3357 => 0.3613, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.36% (0.6667 => 0.7158, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.65% (0.7339 => 0.7827, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.45% (0.2001 => 0.2130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3446 => 0.3656, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.94% (0.6750 => 0.7151, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.3394 => 0.3591, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.49% (1.4642 => 1.5446, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.13% (1.2784 => 1.3440, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 5.12% (18.2933 => 19.2298, std.dev.: 0.0183) MultiSource/Benchmarks/mafft/pairlocalalign: 5.11% (9.2283 => 9.7003, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 4.99% (1.2515 => 1.3140, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.95% (0.2385 => 0.2503, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 4.54% (0.3481 => 0.3639, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.18% (5.0226 => 5.1823, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 3.00% (17.1032 => 17.6167, std.dev.: 0.0210) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.3864 => 1.4174, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.9557 => 0.9745, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.98% (31.3723 => 55.5213, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/matrix: 15.17% (3.0680 => 3.5335, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.73% (0.9531 => 1.0363, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (5.1955 => 5.4384, std.dev.: 0.0111) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1162, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4713, std.dev.: 0.0416) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3175, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6038, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.11% (4.4335 => 4.4828, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.48% (0.2428 => 0.2295, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.42% (0.9852 => 0.9417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.40% (0.3658 => 0.3497, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3142 => 0.3006, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.31% (0.4176 => 0.3996, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.30% (0.3837 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.27% (0.3891 => 0.3725, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3831 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.06% (0.3057 => 0.2933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.01% (0.2871 => 0.2756, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.98% (0.9542 => 0.9162, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (0.2903 => 0.2789, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.90% (0.3205 => 0.3080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.87% (2.1713 => 2.0873, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.85% (1.3148 => 1.2642, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3884 => 0.3735, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.81% (0.6484 => 0.6237, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.81% (0.4280 => 0.4117, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.80% (0.3026 => 0.2911, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: -3.79% (0.3194 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.72% (0.2933 => 0.2824, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.68% (0.7198 => 0.6933, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.66% (0.3931 => 0.3787, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.65% (0.3621 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.52% (2.4924 => 2.4047, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.43% (0.3323 => 0.3209, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.37% (0.6347 => 0.6133, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.36% (0.7919 => 0.7653, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: -3.35% (0.6441 => 0.6225, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.26% (0.3867 => 0.3741, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.25% (0.4427 => 0.4283, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.11% (0.7779 => 0.7537, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -3.08% (4.3330 => 4.1995, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -3.08% (20.7746 => 20.1346, std.dev.: 0.0619) SingleSource/Benchmarks/Shootout-C++/moments: -2.99% (0.4248 => 0.4121, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -2.96% (0.3788 => 0.3676, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.91% (0.3849 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.90% (1.2210 => 1.1856, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.75% (1.2221 => 1.1885, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.73% (0.7982 => 0.7764, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.70% (1.0544 => 1.0259, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.57% (0.4083 => 0.3978, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.38% (0.5999 => 0.5856, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.37% (14.2083 => 13.8709, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.34% (6.7716 => 6.6130, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.21% (1.2300 => 1.2028, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.19% (0.8521 => 0.8334, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.19% (7.0961 => 6.9405, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -2.19% (34.0927 => 33.3463, std.dev.: 0.0223) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8459, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: -2.13% (1.5610 => 1.5278, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -2.12% (4.0594 => 3.9734, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -1.71% (0.9179 => 0.9022, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.56% (0.9077 => 0.8935, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.18% (4.8802 => 4.8226, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.17% (8.0126 => 7.9186, std.dev.: 0.0086) MultiSource/Applications/ClamAV/clamscan: -1.02% (15.2527 => 15.0965, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.78% (1.8100 => 0.6918, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.94% (8.0445 => 4.0268, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4758, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.63% (0.1622 => 0.1109, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.99% (0.1983 => 0.1428, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -24.88% (1.3643 => 1.0249, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.57% (0.2274 => 0.1738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0382, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.95% (4.1024 => 3.2020, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1833, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -19.01% (3.3454 => 2.7096, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.23% (1.2237 => 1.0006, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.36% (2.5106 => 2.1249, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3586, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6345, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8201, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9088, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.18% (1.1594 => 1.0994, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.73% (1.7753 => 1.6914, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.38% (1.0557 => 1.0200, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.02% (1.3096 => 1.2700, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.95% (7.9763 => 7.7410, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2273, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.88% (2.7523 => 2.7005, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1906, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.35% (4.8776 => 4.8118, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6025, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 08:27:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 10:27:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130101162712.8CC912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7269?compare_to=7265&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7269, Order: 171343, Start Time: 2013-01-01 14:28:22, End Time: 2013-01-01 16:28:24 To: 7265, Order: 171341, Start Time: 2013-01-01 08:31:14, End Time: 2013-01-01 10:27:33 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (165 on baseline) Performance Improvements: 1 (47 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1052 (764 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.07% (1.1154 => 1.1273, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.43% (5.4591 => 5.9738, std.dev.: 0.1795) SingleSource/Benchmarks/Dhrystone/fldry: 3.29% (0.6605 => 0.6822, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.46% (2.4082 => 2.4674, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/pi: 1.81% (2.1760 => 2.2154, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.57% (2.3733 => 2.4106, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/matrix: 1.52% (4.6136 => 4.6836, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: -7.11% (0.1829 => 0.1699, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.13% (1.1453 => 1.1209, std.dev.: 0.0391) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.60% (0.3985 => 0.4009, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0219 => 0.0219, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0431 => 0.0431, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0340 => 0.0339, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0431 => 0.0432, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 16.77% (0.0167 => 0.0195, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.33% (0.1502 => 0.1507, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.43% (1.1381 => 1.1658, std.dev.: 0.0375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4135 => 0.4179, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.74% (0.1462 => 0.1422, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.56% (0.0961 => 0.0946, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.30% (0.0184 => 0.0214, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0563 => 0.0566, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.77% (1.2798 => 1.2896, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.28% (0.0029 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.46% (0.0026 => 0.0016, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.00% (0.0586 => 0.0545, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.12% (0.0245 => 0.0181, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.68% (2.7654 => 2.7843, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -71.43% (0.0007 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0006) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.00% (0.0060 => 0.0078, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.78% (31.2081 => 30.9641, std.dev.: 0.1530) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 20.58% (16.4461 => 19.8301, std.dev.: 1.0395) MultiSource/Applications/sqlite3/sqlite3: 3506.95% (0.6332 => 22.8392, std.dev.: 0.7325) MultiSource/Benchmarks/McCat/08-main/main: 54.56% (0.1831 => 0.2830, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.40% (0.1559 => 0.1506, std.dev.: 0.0412) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23345.41% (0.3123 => 73.2200, std.dev.: 30.3475) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1855.38% (0.3344 => 6.5388, std.dev.: 0.1189) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.47% (0.2364 => 0.3297, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 16.97% (0.6010 => 0.7030, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel: 7.46% (0.0429 => 0.0461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.67% (0.3266 => 0.3484, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 4.01% (0.1969 => 0.2048, std.dev.: 0.0020) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 9.38% (0.0224 => 0.0245, std.dev.: 0.0067) SingleSource/UnitTests/byval-alignment: -25.22% (0.0230 => 0.0172, std.dev.: 0.0053) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0492, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 13.00% (0.1462 => 0.1652, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3949, std.dev.: 0.0130) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0691, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4939, std.dev.: 0.0140) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5322, std.dev.: 0.0934) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5264, std.dev.: 0.1081) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0482, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3370, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3766, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0826, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: -29.60% (2.1832 => 1.5369, std.dev.: 0.0250) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 146.59% (0.0249 => 0.0614, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 102.40% (0.0250 => 0.0506, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 72.96% (0.0233 => 0.0403, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 63.19% (0.1440 => 0.2350, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 60.53% (0.8359 => 1.3419, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.83% (0.8805 => 1.4073, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.76% (0.8261 => 1.3198, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.59% (0.7932 => 1.2659, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.54% (0.8611 => 1.3738, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 59.26% (0.8007 => 1.2752, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 58.50% (0.8457 => 1.3404, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.37% (0.8316 => 1.3170, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 58.09% (0.8177 => 1.2927, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 58.06% (0.8066 => 1.2749, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 57.98% (0.8048 => 1.2714, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 56.66% (0.8338 => 1.3062, std.dev.: 0.0185) SingleSource/UnitTests/SignlessTypes/shr: 56.54% (0.0191 => 0.0299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.15% (0.8597 => 1.3424, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.69% (1.5315 => 2.3844, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 55.49% (0.8885 => 1.3815, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 54.70% (0.8716 => 1.3484, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.68% (0.9056 => 1.4008, std.dev.: 0.0583) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.59% (0.9039 => 1.3973, std.dev.: 0.0834) SingleSource/Regression/C/test_indvars: 53.88% (0.0232 => 0.0357, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.63% (0.9688 => 1.4690, std.dev.: 0.0112) SingleSource/UnitTests/Vector/multiplies: 45.74% (0.0223 => 0.0325, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 41.96% (0.0784 => 0.1113, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.82% (2.1401 => 3.0351, std.dev.: 0.1533) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.24% (0.0734 => 0.1000, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.40% (3.1832 => 4.3101, std.dev.: 0.0533) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.68% (0.0421 => 0.0567, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 31.82% (0.0550 => 0.0725, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 31.04% (0.0989 => 0.1296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.18% (0.8855 => 1.1439, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.98% (0.0635 => 0.0819, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 28.92% (0.0650 => 0.0838, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 27.99% (0.8050 => 1.0303, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.62% (0.8286 => 1.0575, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 26.48% (0.8420 => 1.0650, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.24% (0.8712 => 1.0998, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.23% (0.8086 => 1.0207, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.00% (0.8204 => 1.0337, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.83% (0.8069 => 1.0153, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.76% (0.7966 => 1.0018, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.59% (0.8317 => 1.0445, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.57% (0.8331 => 1.0461, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.53% (0.8697 => 1.0917, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 25.30% (0.8656 => 1.0846, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.14% (0.8518 => 1.0659, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.98% (0.9069 => 1.1334, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.64% (0.9074 => 1.1310, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.40% (0.8927 => 1.1105, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.29% (0.9908 => 1.2315, std.dev.: 0.0297) SingleSource/Benchmarks/Misc/ReedSolomon: 23.98% (0.1839 => 0.2280, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.79% (0.6586 => 0.8087, std.dev.: 0.0177) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.93% (0.4783 => 0.5832, std.dev.: 0.0101) MultiSource/Applications/lemon/lemon: 21.74% (1.0945 => 1.3324, std.dev.: 0.0243) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.92% (0.0822 => 0.0994, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.88% (4.4880 => 5.4249, std.dev.: 0.2795) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.54% (0.0701 => 0.0845, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 20.45% (0.3800 => 0.4577, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.21% (0.0668 => 0.0803, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 19.94% (0.1565 => 0.1877, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.34% (0.0848 => 0.1012, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 19.13% (0.2180 => 0.2597, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.01% (0.0810 => 0.0964, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 18.53% (8.6247 => 10.2229, std.dev.: 0.0998) MultiSource/Benchmarks/PAQ8p/paq8p: 18.41% (2.3764 => 2.8138, std.dev.: 0.0711) SingleSource/Benchmarks/Shootout-C++/hash2: 18.13% (0.4125 => 0.4873, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 17.87% (0.1097 => 0.1293, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.86% (1.2526 => 1.4763, std.dev.: 0.0681) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.38% (0.1778 => 0.2087, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.18% (0.5191 => 0.6083, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary3: 16.23% (0.2427 => 0.2821, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 15.94% (0.2390 => 0.2771, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 15.66% (0.0830 => 0.0960, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 15.34% (0.2509 => 0.2894, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 15.30% (0.0745 => 0.0859, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 14.86% (0.2227 => 0.2558, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 14.82% (14.2605 => 16.3742, std.dev.: 0.4382) MultiSource/Applications/SIBsim4/SIBsim4: 14.62% (1.2568 => 1.4406, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.54% (0.1425 => 0.1618, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 13.44% (0.4397 => 0.4988, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops: 13.34% (0.0937 => 0.1062, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.73% (13.1811 => 14.8589, std.dev.: 0.4516) MultiSource/Applications/oggenc/oggenc: 12.62% (4.9628 => 5.5891, std.dev.: 0.2069) MultiSource/Applications/aha/aha: 12.22% (0.1088 => 0.1221, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.56% (0.1885 => 0.2103, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 11.52% (0.6834 => 0.7621, std.dev.: 0.0226) MultiSource/Benchmarks/sim/sim: 11.35% (0.3226 => 0.3592, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.22% (0.1756 => 0.1953, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 10.32% (15.3280 => 16.9094, std.dev.: 0.2742) MultiSource/Applications/ClamAV/clamscan: 9.90% (14.7684 => 16.2301, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.74% (0.1150 => 0.1262, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 9.64% (3.8189 => 4.1870, std.dev.: 0.0878) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.58% (0.8340 => 0.9139, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/health/health: 9.35% (0.1347 => 0.1473, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.57% (0.2519 => 0.2735, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.50% (0.3717 => 0.4033, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.12% (0.3115 => 0.3368, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.84% (0.2794 => 0.3013, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 7.62% (1.4269 => 1.5356, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 7.21% (0.1721 => 0.1845, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.71% (0.2741 => 0.2925, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 6.67% (0.2985 => 0.3184, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 6.65% (0.3503 => 0.3736, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.73% (0.8995 => 0.9510, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 5.36% (0.2088 => 0.2200, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 4.95% (0.2969 => 0.3116, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 4.86% (0.7557 => 0.7924, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.50% (0.2844 => 0.2972, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 4.43% (0.2755 => 0.2877, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: 4.38% (0.2513 => 0.2623, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 4.29% (0.9810 => 1.0231, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: 4.06% (0.3645 => 0.3793, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.55% (0.3657 => 0.3787, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.46% (0.3124 => 0.3232, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1511400.00% (0.0001 => 1.5115, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: 372.08% (0.3585 => 1.6924, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 361.92% (1.5671 => 7.2388, std.dev.: 0.0281) MultiSource/Benchmarks/PAQ8p/paq8p: 282.89% (91.7701 => 351.3788, std.dev.: 3.7703) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.06% (28.5821 => 85.4780, std.dev.: 0.0626) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.99% (5.1305 => 14.0573, std.dev.: 0.0377) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 117.11% (1.1365 => 2.4674, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/ary: 104.11% (0.0219 => 0.0447, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 97.60% (0.0125 => 0.0247, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 62.85% (2.8760 => 4.6836, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/pi: 40.26% (1.5795 => 2.2154, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.74% (2.7995 => 3.9120, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 35.21% (1.3882 => 1.8770, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.97% (4.5327 => 5.9817, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.44% (2.9096 => 3.7081, std.dev.: 0.0678) SingleSource/Benchmarks/McGill/misr: 18.95% (0.4001 => 0.4759, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.87% (4.7794 => 5.5859, std.dev.: 0.0382) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.62% (0.7597 => 0.8860, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/salsa20: 14.48% (7.5003 => 8.5866, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.81% (0.3186 => 0.3594, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.14% (1.1857 => 1.3059, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.92% (0.1129 => 0.1241, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 9.17% (3.1873 => 3.4796, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/ReedSolomon: 8.08% (8.5322 => 9.2217, std.dev.: 0.0417) MultiSource/Benchmarks/McCat/18-imp/imp: 7.45% (0.1370 => 0.1472, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.41% (23.5781 => 25.3243, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.35% (3.9006 => 4.1484, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.67% (4.9686 => 5.2505, std.dev.: 0.0406) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.44% (3.5679 => 3.7619, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.41% (4.8436 => 5.1056, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.11% (0.6150 => 0.6464, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 4.90% (3.3398 => 3.5033, std.dev.: 0.0195) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.81% (0.5214 => 0.5465, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 4.74% (6.7064 => 7.0244, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 4.72% (3.8206 => 4.0009, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.50% (6.1706 => 6.4480, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/richards_benchmark: 4.15% (1.3037 => 1.3578, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.21% (4.2466 => 4.3831, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 3.15% (1.7056 => 1.7594, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: 2.86% (1.2061 => 1.2406, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.64% (1.2337 => 1.2663, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.23% (3.4104 => 3.4864, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/methcall: 2.03% (8.2676 => 8.4358, std.dev.: 0.0414) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.69% (4.4340 => 4.5091, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.63% (8.2783 => 8.4132, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.26% (1.5941 => 1.6142, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.11% (3.7192 => 3.7606, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: 1.10% (0.9842 => 0.9950, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.12% (2.8951 => 0.8360, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.32% (11.5316 => 4.6913, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/fp-convert: -52.34% (15.8853 => 7.5704, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.34% (4.7482 => 3.0226, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.35% (5.4972 => 3.6087, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.24% (5.4300 => 3.6793, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -30.46% (1.9999 => 1.3907, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.78% (5.6343 => 4.1252, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.45% (5.0261 => 3.9985, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.04% (5.0243 => 4.1681, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.82% (2.9753 => 2.5343, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.96% (9.9065 => 8.7221, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: -10.18% (63.1822 => 56.7505, std.dev.: 0.1176) SingleSource/Benchmarks/McGill/chomp: -9.74% (1.1216 => 1.0124, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/perlin: -9.36% (5.1084 => 4.6302, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -9.35% (2.5609 => 2.3214, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.14% (6.2275 => 5.6581, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: -9.08% (5.4641 => 4.9678, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.77% (3.7148 => 3.3889, std.dev.: 0.0248) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.19% (1.0512 => 0.9651, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.09% (7.2130 => 6.6295, std.dev.: 0.0767) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.81% (4.3552 => 4.0149, std.dev.: 0.0714) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.53% (5.3218 => 4.9213, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/sieve: -6.03% (7.0599 => 6.6344, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.90% (0.3269 => 0.3076, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/FloatMM: -5.70% (0.8807 => 0.8305, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: -5.52% (9.3748 => 8.8570, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.40% (4.9453 => 4.6784, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.28% (0.3937 => 0.3729, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.94% (2.8773 => 2.7638, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (8.9760 => 8.6674, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.10% (5.1557 => 4.9959, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.85% (4.7449 => 4.6098, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.84% (4.9469 => 4.8066, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.77% (6.0224 => 5.8556, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/ffbench: -2.76% (1.4296 => 1.3902, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: -2.53% (4.3087 => 4.1996, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/fbench: -2.53% (3.3840 => 3.2984, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -2.15% (1.4861 => 1.4541, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (9.2989 => 9.1083, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.91% (3.3479 => 3.2840, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.81% (2.6356 => 2.5878, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -1.80% (3.6643 => 3.5983, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.57% (2.4490 => 2.4106, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-5: -1.48% (2.8957 => 2.8529, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-6: -1.26% (2.4416 => 2.4109, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -1.14% (1.0841 => 1.0717, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 9.23% (1.0262 => 1.1209, std.dev.: 0.0391) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.77% (0.2463 => 0.4009, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.50% (0.0384 => 0.0432, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.80% (0.1438 => 0.1507, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 2.90% (1.1329 => 1.1658, std.dev.: 0.0375) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.36% (0.4164 => 0.4179, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.87% (0.1369 => 0.1422, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 47.58% (0.0641 => 0.0946, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.74% (0.0195 => 0.0214, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.08% (0.0578 => 0.0566, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.76% (1.1437 => 1.2896, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 14.29% (0.0014 => 0.0016, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.08% (0.0627 => 0.0545, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.56% (0.0180 => 0.0181, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.30% (0.8017 => 2.7843, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0006) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 25.81% (0.0062 => 0.0078, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 08:50:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 10:50:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130101165019.7DE1A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7270?compare_to=7266&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7270, Order: 171343, Start Time: 2013-01-01 14:36:57, End Time: 2013-01-01 16:51:29 To: 7266, Order: 171341, Start Time: 2013-01-01 08:41:30, End Time: 2013-01-01 10:56:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (220 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.66% (0.6584 => 0.6759, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 1.03% (1.0854 => 1.0966, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1340 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.68% (0.0664 => 0.0715, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8455 => 499.8148, std.dev.: 0.0235) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44221.61% (1.1277 => 499.8148, std.dev.: 0.0235) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.92% (0.5229 => 1.6624, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 20.23% (14.9895 => 18.0223, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 54.51% (14.1553 => 21.8708, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/gs/gs: 17.91% (4.1105 => 4.8468, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.17% (1.1048 => 1.7475, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1230.19% (7.1582 => 95.2179, std.dev.: 0.1360) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.85% (3.4629 => 7.8208, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.13% (0.6222 => 1.1083, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10246.67% (0.0720 => 7.4496, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 3829900.00% (0.0001 => 3.8300, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11189000.00% (0.0001 => 11.1891, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 67000.00% (0.0001 => 0.0671) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577600.00% (0.0001 => 0.5777, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9958400.00% (0.0001 => 9.9585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5499000.00% (0.0001 => 5.4991, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.23% (1.1194 => 10.3011, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 149.05% (22.1758 => 55.2281, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.93% (0.0929 => 0.1718, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 83.95% (0.0243 => 0.0447) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.40% (0.1463 => 0.2332, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.89% (2.9384 => 4.6395, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.64% (7.0540 => 10.9786, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.00% (1.5859 => 2.4105, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 49.72% (0.1056 => 0.1581, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.12% (8.1363 => 11.9700, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/flops: 42.53% (0.1432 => 0.2041, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.68% (2.2024 => 3.1203, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.46% (0.0439 => 0.0621, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 41.13% (21.9371 => 30.9602, std.dev.: 0.0198) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.44% (0.6675 => 0.8907, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.16% (1.5415 => 2.0527, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.49% (0.1062 => 0.1407, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 31.94% (0.3109 => 0.4102, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.91% (0.5105 => 0.6734, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.75% (0.4615 => 0.6034, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 30.66% (0.4299 => 0.5617, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 30.21% (4.2646 => 5.5530, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 29.84% (0.4289 => 0.5569, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 29.36% (0.0814 => 0.1053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.35% (0.1584 => 0.2033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 28.29% (0.4620 => 0.5927, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.75% (0.0746 => 0.0953, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 27.72% (1.1642 => 1.4869, std.dev.: 0.0105) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 26.70% (1.0722 => 1.3585, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.04% (0.1125 => 0.1418, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 25.69% (0.2554 => 0.3210, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.23% (0.2271 => 0.2844, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.11% (0.1892 => 0.2367, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.02% (3.8922 => 4.8662, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 24.83% (0.6456 => 0.8059, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.16% (1.4186 => 1.7613, std.dev.: 0.0029) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.98% (0.1906 => 0.2363, std.dev.: 0.0042) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.25% (0.0770 => 0.0949, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.23% (0.1029 => 0.1268, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.17% (0.0479 => 0.0590, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.91% (0.3121 => 0.3836, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 22.62% (9.4845 => 11.6295, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/mst/mst: 22.53% (0.1163 => 0.1425, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.37% (0.2700 => 0.3304, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.32% (0.0793 => 0.0970, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 22.16% (5.7591 => 7.0356, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 21.99% (0.1655 => 0.2019, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 21.96% (0.3283 => 0.4004, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.73% (0.7115 => 0.8661, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 21.57% (0.3232 => 0.3929, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 21.42% (0.1695 => 0.2058, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.33% (1.3050 => 1.5834, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.26% (0.0842 => 0.1021, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.68% (0.0730 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 20.68% (0.0614 => 0.0741, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.54% (0.7835 => 0.9444, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.39% (0.0672 => 0.0809, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.32% (4.9449 => 5.9498, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.09% (0.0886 => 0.1064, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 19.97% (0.0626 => 0.0751, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.87% (0.1555 => 0.1864, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.61% (0.5860 => 0.7009, std.dev.: 0.0034) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139) SingleSource/Benchmarks/Shootout-C++/ary2: 19.50% (0.3379 => 0.4038, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 19.49% (1.1840 => 1.4148, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 19.46% (3.3354 => 3.9846, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.43% (0.2758 => 0.3294, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 19.31% (0.3423 => 0.4084, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.28% (5.0018 => 5.9663, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 19.17% (0.0527 => 0.0628, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.12% (0.1940 => 0.2311, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 18.97% (17.1811 => 20.4397, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/messages-2: 18.88% (0.0662 => 0.0787, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.67% (0.8172 => 0.9698, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.67% (0.0675 => 0.0801, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.62% (0.1117 => 0.1325, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 18.61% (0.7433 => 0.8816, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.44% (0.5569 => 0.6596, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.37% (0.9765 => 1.1559, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.27% (0.4636 => 0.5483, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.19% (0.5020 => 0.5933, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.16% (0.2065 => 0.2440, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.12% (0.0640 => 0.0756, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.12% (0.1236 => 0.1460, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.08% (0.2107 => 0.2488, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 17.92% (0.0798 => 0.0941, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.30% (0.3307 => 0.3879, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1268 => 0.1485, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.06% (0.1143 => 0.1338, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 17.04% (2.2969 => 2.6883, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: 17.00% (2.0273 => 2.3720, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 16.77% (0.8921 => 1.0417, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.72% (3.8723 => 4.5197, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.57% (0.5981 => 0.6972, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.42% (0.6450 => 0.7509, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.33% (0.3441 => 0.4003, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.23% (0.0770 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.07% (0.8101 => 0.9403, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.40% (1.1861 => 1.3688, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 15.13% (0.3180 => 0.3661, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 15.03% (0.2049 => 0.2357, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.48% (0.2603 => 0.2980, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.46% (0.1044 => 0.1195, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 14.14% (1.5603 => 1.7810, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.07% (0.8067 => 0.9202, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 14.02% (0.3387 => 0.3862, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 13.25% (0.1268 => 0.1436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3865 => 0.4377, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.82% (0.4103 => 0.4629, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 12.49% (0.3098 => 0.3485, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 12.45% (0.3092 => 0.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.32% (0.4203 => 0.4721, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.81% (0.4048 => 0.4526, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.76% (0.3826 => 0.4276, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.73% (0.2430 => 0.2715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.63% (14.3668 => 16.0382, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: 11.34% (0.3422 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: 10.83% (0.3684 => 0.4083, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.70% (0.2831 => 0.3134, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.53% (0.3162 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.48% (0.2871 => 0.3172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.33% (0.3650 => 0.4027, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.92% (2.0665 => 2.2714, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.80% (0.3561 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 9.45% (1.2842 => 1.4055, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 9.42% (10.3673 => 11.3441, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.40% (0.2756 => 0.3015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.6030 => 0.6595, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2872 => 0.3141, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.33% (0.2905 => 0.3176, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2725 => 0.2977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.21% (0.2877 => 0.3142, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.13% (63.2438 => 69.0150, std.dev.: 0.0453) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.12% (0.3136 => 0.3422, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 9.06% (0.2714 => 0.2960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 8.81% (0.3052 => 0.3321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.74% (0.2793 => 0.3037, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.72% (2.2022 => 2.3942, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.85% (0.4879 => 0.5262, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.38% (0.3131 => 0.3362, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.63% (7.9617 => 8.2505, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.69% (32.5116 => 59.0715, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1511, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3791, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4573, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 5.35% (3.1578 => 3.3266, std.dev.: 0.0086) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.85% (0.9957 => 1.0340, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (2.0360 => 2.1071, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9069, std.dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.44% (3.6395 => 3.7284, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3433, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.55% (1.7254 => 1.7521, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.36% (4.4649 => 4.5257, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5872, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.04% (1.4460 => 1.4611, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.37% (6.6874 => 0.1761, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.20% (5.2763 => 1.2031, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.56% (5.3855 => 4.4934, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.88% (5.3526 => 4.5025, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -12.61% (10.4361 => 9.1196, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9220, std.dev.: 0.0533) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.03% (1.7609 => 1.6548, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.47% (1.9577 => 0.6759, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.08% (8.0499 => 4.0182, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.05% (0.3987 => 0.2470, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.58% (1.1492 => 0.7633, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.52% (1.5373 => 1.0220, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4128, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.7953, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.57% (2.6546 => 2.0023, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3706, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.28% (2.5528 => 2.1372, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std.dev.: 0.0041) MultiSource/Benchmarks/NPB-serial/is/is: -11.08% (9.5636 => 8.5042, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4228, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.22% (19.9488 => 18.3085, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7063, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.64% (1.6805 => 1.5858, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.26% (1.5835 => 1.5002, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.60% (8.1563 => 7.7814, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8405, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1562, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -3.50% (0.6223 => 0.6005, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.00% (1.0554 => 1.0343, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2206, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.6441 => 4.5876, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.21% (0.2116 => 0.0715, std.dev.: 0.0007) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 10:06:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 12:06:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130101180620.DA6962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7271?compare_to=7268&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7271, Order: 171344, Start Time: 2013-01-01 16:30:49, End Time: 2013-01-01 18:07:32 To: 7268, Order: 171343, Start Time: 2013-01-01 14:30:51, End Time: 2013-01-01 16:07:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (98 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (814 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.2700 => 1.2879, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.23% (80.0993 => 81.0881, std.dev.: 0.2067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.94% (22.4056 => 78.8532, std.dev.: 0.0555) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.60% (0.0717 => 0.1130, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.83% (0.0974 => 0.1508, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.61% (0.0514 => 0.0769, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368) MultiSource/Benchmarks/FreeBench/neural/neural: 34.80% (0.1500 => 0.2022, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.04% (0.1132 => 0.1506, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.49% (1.6474 => 2.1003, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 22.17% (0.0699 => 0.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.39% (5.4682 => 6.6376, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.23% (2.2587 => 2.7157, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.35% (0.0680 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.98% (0.6395 => 0.7417, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.69% (1.1450 => 1.3246, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.37% (0.6395 => 0.7314, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.27% (0.6260 => 0.7091, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.39% (0.5941 => 0.6677, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.22% (0.1146 => 0.1286, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.77% (0.5805 => 0.6488, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.77% (0.6230 => 0.6963, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.42% (0.5849 => 0.6517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.29% (0.6033 => 0.6714, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.15% (0.6440 => 0.7158, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.13% (0.5456 => 0.6063, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.12% (0.7021 => 0.7802, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.86% (0.5688 => 0.6306, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.78% (0.5567 => 0.6167, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.65% (0.5925 => 0.6556, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.61% (0.5581 => 0.6173, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.55% (0.6676 => 0.7380, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 10.54% (0.4524 => 0.5001, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.51% (0.5575 => 0.6161, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.32% (0.5802 => 0.6401, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.19% (1.6364 => 1.8031, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.16% (0.5859 => 0.6454, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 9.86% (0.4515 => 0.4960, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.85% (0.5857 => 0.6434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.76% (0.6446 => 0.7075, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 9.71% (0.4861 => 0.5333, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.63% (0.6052 => 0.6635, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.48% (0.6189 => 0.6776, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.32% (0.5570 => 0.6089, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.21% (0.5569 => 0.6082, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.16% (0.5478 => 0.5980, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.14% (0.6304 => 0.6880, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.05% (0.5591 => 0.6097, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.99% (0.5329 => 0.5808, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.96% (3.5339 => 3.8505, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.92% (0.5705 => 0.6214, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.73% (0.1982 => 0.2155, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.56% (0.6660 => 0.7230, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.46% (0.5863 => 0.6359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.89% (0.6194 => 0.6683, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.86% (0.6297 => 0.6792, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.78% (4.5069 => 4.8575, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.74% (0.6681 => 0.7198, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.62% (0.7524 => 0.8097, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.51% (0.3357 => 0.3609, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.36% (0.6667 => 0.7158, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.57% (0.7339 => 0.7821, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.40% (0.2001 => 0.2129, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 6.09% (0.3446 => 0.3656, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.91% (0.6750 => 0.7149, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.3394 => 0.3591, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.47% (1.4642 => 1.5443, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2385 => 0.2510, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.17% (18.2933 => 19.2384, std.dev.: 0.0416) MultiSource/Benchmarks/mafft/pairlocalalign: 5.16% (9.2283 => 9.7043, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.09% (1.2784 => 1.3435, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 5.03% (1.2515 => 1.3144, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 4.57% (0.3481 => 0.3640, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.01% (17.1032 => 17.6182, std.dev.: 0.0253) MultiSource/Applications/oggenc/oggenc: 2.95% (5.0226 => 5.1707, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.3864 => 1.4147, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.9557 => 0.9749, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.14% (31.3723 => 55.5726, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.68% (0.9531 => 1.0358, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 3.77% (11.6767 => 12.1169, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5171, std.dev.: 0.1191) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 1.80% (3.7435 => 3.8108, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3198, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (79.7170 => 81.0881, std.dev.: 0.2067) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6025, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566) MultiSource/Applications/viterbi/viterbi: 1.15% (4.4335 => 4.4843, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.40% (0.2428 => 0.2297, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.66% (0.3821 => 0.3643, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.51% (0.3812 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.46% (0.3142 => 0.3002, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.44% (0.9852 => 0.9415, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.38% (0.3880 => 0.3710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3831 => 0.3664, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.33% (0.3837 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.32% (0.3658 => 0.3500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3896 => 0.3728, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.27% (0.3891 => 0.3725, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.4033 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.21% (0.3323 => 0.3183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.15% (0.3057 => 0.2930, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.15% (0.3059 => 0.2932, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.09% (0.9542 => 0.9152, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.06% (0.3252 => 0.3120, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.06% (2.1713 => 2.0832, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.97% (0.3025 => 0.2905, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.93% (1.3148 => 1.2631, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.90% (0.3205 => 0.3080, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.90% (0.2849 => 0.2738, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3884 => 0.3734, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.84% (0.6484 => 0.6235, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: -3.82% (0.3194 => 0.3072, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.81% (0.3016 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.75% (0.2933 => 0.2823, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.74% (0.4280 => 0.4120, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.73% (0.4321 => 0.4160, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.68% (0.7198 => 0.6933, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: -3.64% (0.2939 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.64% (0.3931 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (2.4924 => 2.4036, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (0.3621 => 0.3493, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.43% (0.6441 => 0.6220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.39% (0.3867 => 0.3736, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: -3.37% (4.3330 => 4.1869, std.dev.: 0.0117) SingleSource/UnitTests/ObjC++/Hello: -3.34% (0.6347 => 0.6135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.30% (0.4427 => 0.4281, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.22% (0.7919 => 0.7664, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.11% (0.7982 => 0.7734, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: -3.09% (0.7779 => 0.7539, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.01% (0.4248 => 0.4120, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -3.00% (20.7746 => 20.1515, std.dev.: 0.0603) SingleSource/Benchmarks/Shootout-C++/sieve: -2.96% (0.3788 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.91% (0.3849 => 0.3737, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.84% (0.4083 => 0.3967, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.83% (1.2210 => 1.1864, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.81% (1.2221 => 1.1877, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (1.0544 => 1.0252, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.49% (1.2300 => 1.1994, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.47% (6.7716 => 6.6044, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.38% (0.5999 => 0.5856, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.37% (14.2083 => 13.8710, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.29% (0.8521 => 0.8326, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -2.27% (7.0961 => 6.9351, std.dev.: 0.0090) MultiSource/Applications/lua/lua: -2.25% (4.0594 => 3.9679, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -2.19% (34.0927 => 33.3461, std.dev.: 0.0243) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8461, std.dev.: 0.0208) MultiSource/Applications/hbd/hbd: -1.98% (1.5610 => 1.5301, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: -1.73% (0.9179 => 0.9020, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -1.64% (2.1401 => 2.1050, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -1.58% (2.4021 => 2.3642, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.18% (8.0126 => 7.9182, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.15% (4.8802 => 4.8243, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.05% (4.0323 => 3.9900, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6801, std.dev.: 0.0179) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.89% (8.0445 => 4.0314, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4756, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.19% (0.6962 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.57% (0.1622 => 0.1110, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.74% (0.1983 => 0.1433, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.36% (0.2151 => 0.1584, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0282, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7584, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.35% (0.2274 => 0.1743, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0358, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3993) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1998, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1832, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.73% (3.3454 => 2.7187, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.25% (1.2237 => 1.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.37% (2.5106 => 2.1248, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3585, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6343, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.39% (5.2027 => 4.8183, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9086, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.1594 => 1.0916, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.70% (1.7753 => 1.6919, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (7.9763 => 7.7322, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.90% (5.3830 => 5.2271, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7008, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.66% (1.3096 => 1.2879, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1939, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.13% (1.6307 => 1.6123, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.11% (1.6219 => 1.6039, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 10:30:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 12:30:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130101183021.BD8622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7272?compare_to=7267&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7272, Order: 171343, Start Time: 2013-01-01 14:58:19, End Time: 2013-01-01 18:31:31 To: 7267, Order: 171341, Start Time: 2013-01-01 09:53:32, End Time: 2013-01-01 13:26:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.85% (123.7625 => 128.5258, std.dev.: 1.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.28% (54.1970 => 54.8929, std.dev.: 0.0448) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.06% (11.6398 => 21.1918, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.52% (0.5361 => 0.8284, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.84% (0.0625 => 0.0899, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.43% (0.1063 => 0.1429, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.46% (0.2969 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.76% (0.1106 => 0.1413, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.54% (0.7426 => 0.9471, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.94% (0.4139 => 0.5254, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 26.35% (1.5932 => 2.0130, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.83% (0.5900 => 0.7424, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.63% (0.4253 => 0.5343, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.43% (0.4994 => 0.6264, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.23% (0.0547 => 0.0685, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.06% (0.5000 => 0.6253, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.44% (0.1620 => 0.2016, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.24% (0.1549 => 0.1909, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.0948 => 0.1162, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.19% (0.3903 => 0.4769, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 21.74% (0.1619 => 0.1971, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.80% (0.0947 => 0.1144, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.59% (0.3890 => 0.4691, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.13% (0.1088 => 0.1307, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.11% (0.2014 => 0.2419, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 19.83% (0.4029 => 0.4828, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.74% (0.2736 => 0.3276, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.49% (4.4195 => 5.2807, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.47% (0.2866 => 0.3424, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.40% (1.3152 => 1.5704, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 19.22% (1.8794 => 2.2406, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.19% (0.4658 => 0.5552, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.10% (3.5627 => 4.2430, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.99% (0.3271 => 0.3892, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/Hello: 18.95% (0.5826 => 0.6930, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.83% (0.5889 => 0.6998, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 18.77% (0.5546 => 0.6587, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.60% (1.6211 => 1.9226, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.60% (0.1968 => 0.2334, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.02% (0.1421 => 0.1677, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.82% (0.4361 => 0.5138, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.79% (0.3930 => 0.4629, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.75% (0.5026 => 0.5918, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.52% (2.7292 => 3.2074, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 17.45% (0.1284 => 0.1508, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.40% (0.9697 => 1.1384, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.39% (0.2875 => 0.3375, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.38% (1.0781 => 1.2655, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 17.16% (4.2109 => 4.9336, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.97% (0.1090 => 0.1275, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.77% (1.9694 => 2.2997, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: 16.73% (0.2725 => 0.3181, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.69% (1.9966 => 2.3299, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.65% (0.2792 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.64% (0.2813 => 0.3281, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.61% (0.7171 => 0.8362, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.59% (0.2911 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.58% (0.2750 => 0.3206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.58% (0.2823 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.55% (0.2803 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.54% (0.2811 => 0.3276, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 16.43% (0.2075 => 0.2416, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.42% (0.2729 => 0.3177, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.38% (4.6926 => 5.4613, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 16.30% (23.5202 => 27.3537, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.19% (2.0673 => 2.4020, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 16.17% (0.9909 => 1.1511, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.92% (0.3096 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.90% (0.3446 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.87% (0.3465 => 0.4015, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.83% (0.3488 => 0.4040, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.82% (0.2566 => 0.2972, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 15.80% (0.3469 => 0.4017, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.75% (0.3460 => 0.4005, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.56% (0.3060 => 0.3536, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 15.45% (1.4269 => 1.6474, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.37% (0.3267 => 0.3769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3258 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.32% (0.3643 => 0.4201, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.27% (0.3124 => 0.3601, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.22% (0.3317 => 0.3822, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 15.17% (0.3724 => 0.4289, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.09% (0.3678 => 0.4233) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.08% (0.3362 => 0.3869, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.93% (0.3477 => 0.3996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.81% (0.3348 => 0.3844, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.81% (0.7875 => 0.9041, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 14.69% (0.4146 => 0.4755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.65% (0.3726 => 0.4272, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.61% (2.1653 => 2.4817, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 14.60% (0.2691 => 0.3084, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.59% (0.3625 => 0.4154, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 14.57% (4.6177 => 5.2903, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.47% (0.3690 => 0.4224, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.39% (0.3981 => 0.4554, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 14.32% (2.1013 => 2.4022, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.20% (0.3845 => 0.4391, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 14.14% (0.4251 => 0.4852, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.75% (0.5012 => 0.5701, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.24% (0.6435 => 0.7287) MultiSource/Applications/SPASS/SPASS: 13.07% (5.5417 => 6.2659, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.04% (0.2040 => 0.2306, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 13.00% (0.4847 => 0.5477, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.55% (0.3084 => 0.3471, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.52% (0.2068 => 0.2327, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.50% (0.2737 => 0.3079, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 12.35% (2.0346 => 2.2859, std.dev.: 0.0185) MultiSource/Applications/minisat/minisat: 12.32% (0.3336 => 0.3747, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 12.18% (0.3498 => 0.3924, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.16% (0.1028 => 0.1153, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 12.12% (0.6634 => 0.7438, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 11.13% (0.2391 => 0.2657, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.89% (0.2103 => 0.2332, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.48% (11.9555 => 13.2086, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.46% (0.5584 => 0.6112, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.33% (0.3792 => 0.4032, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5355, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 8.58% (0.2122 => 0.2304, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.17% (0.3693 => 0.3921, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 5.09% (12.0509 => 12.6648, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6744, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1913, std.dev.: 0.0593) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3038, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.19% (7.1849 => 7.2707, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0790, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2094, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.09% (10.3705 => 10.4832, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5862, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8689, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -18.50% (17.2379 => 14.0496, std.dev.: 0.1297) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -9.99% (0.2402 => 0.2162, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7911, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.08% (14.0481 => 13.3346, std.dev.: 0.1946) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2116, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1795, std.dev.: 0.0674) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.80% (0.6293 => 0.6180, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5774, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1691, std.dev.: 0.0877) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 10:44:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 12:44:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130101184427.62C322A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7273?compare_to=7269&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7273, Order: 171348, Start Time: 2013-01-01 16:48:14, End Time: 2013-01-01 18:45:39 To: 7269, Order: 171343, Start Time: 2013-01-01 14:28:22, End Time: 2013-01-01 16:28:24 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 14 (183 on baseline) Performance Improvements: 2 (49 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1044 (744 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.43% (0.2597 => 0.2790, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 6.36% (0.1996 => 0.2123, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.23% (0.8646 => 0.9098, std.dev.: 0.0138) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.02% (73.2200 => 76.1603, std.dev.: 1.1289) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.73% (1.2125 => 1.2577, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.68% (0.4725 => 0.4899, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.07% (0.3621 => 0.3732, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 2.99% (1.3324 => 1.3723, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 85.47% (0.2113 => 0.3919, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 17.22% (1.6022 => 1.8781, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 11.13% (20.7517 => 23.0615, std.dev.: 0.6956) SingleSource/Benchmarks/Shootout-C++/except: 3.12% (0.4845 => 0.4996, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 1.79% (1.4541 => 1.4802, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.29% (4.6913 => 4.7518, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.27% (1.0303 => 1.0069, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.08% (1.0207 => 1.0097, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.43% (1.1209 => 1.1706, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.70% (0.4009 => 0.3981, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.88% (0.0219 => 0.0147, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0431 => 0.0432, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.65% (0.0339 => 0.0330, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.48% (0.0319 => 0.0276, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.56% (0.0432 => 0.0395, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0203 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.51% (0.0195 => 0.0196, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 0.46% (0.1507 => 0.1514, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -1.37% (1.1658 => 1.1498, std.dev.: 0.1010) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.88% (0.4179 => 0.4341, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.23% (0.1422 => 0.1468, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.32% (0.0946 => 0.0943, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.21% (0.0214 => 0.0238, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.41% (0.0566 => 0.0574, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.2896 => 1.2801, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.33% (0.0015 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -56.25% (0.0016 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.02% (0.0545 => 0.0556, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.31% (0.0181 => 0.0187, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.10% (2.7843 => 2.7815, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.10% (0.0078 => 0.0067, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.10% (30.9641 => 30.9961, std.dev.: 0.6559) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.76% (16.4461 => 20.0240, std.dev.: 0.8248) MultiSource/Applications/sqlite3/sqlite3: 3543.30% (0.6332 => 23.0694, std.dev.: 0.7821) MultiSource/Benchmarks/McCat/08-main/main: 53.47% (0.1831 => 0.2810, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.73% (0.1559 => 0.1532, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 24286.90% (0.3123 => 76.1603, std.dev.: 1.1289) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1855.53% (0.3344 => 6.5393, std.dev.: 0.1743) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.68% (0.2364 => 0.3302, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 17.30% (0.6010 => 0.7050, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel: -3.03% (0.0429 => 0.0416, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.74% (0.3266 => 0.3486, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/strcat: 4.27% (0.1969 => 0.2053, std.dev.: 0.0748) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.71% (0.0224 => 0.0248, std.dev.: 0.0012) SingleSource/UnitTests/byval-alignment: -20.00% (0.0230 => 0.0184, std.dev.: 0.0050) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0489, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 16.69% (0.1462 => 0.1706, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4154, std.dev.: 0.0351) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0730, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4906, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5258, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5199, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0534, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3365, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3714, std.dev.: 0.0371) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0805, std.dev.: 0.0213) SingleSource/Regression/C/uint64_to_float: -29.72% (2.1832 => 1.5344, std.dev.: 0.0044) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 148.19% (0.0249 => 0.0618, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 103.20% (0.0250 => 0.0508, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 65.67% (0.0233 => 0.0386, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 64.44% (0.1440 => 0.2368, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 59.98% (0.8359 => 1.3373, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.57% (0.8805 => 1.4050, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.47% (0.8261 => 1.3174, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.17% (0.7932 => 1.2625, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 59.07% (0.8007 => 1.2737, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 58.98% (0.8611 => 1.3690, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 58.24% (0.8048 => 1.2735, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.02% (0.8316 => 1.3141, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 57.97% (0.8177 => 1.2917, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 57.65% (0.8066 => 1.2716, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 57.42% (0.8457 => 1.3313, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 56.22% (0.8338 => 1.3026, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 55.76% (0.8597 => 1.3391, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.64% (1.5315 => 2.3836, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.47% (0.9056 => 1.3989, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 54.46% (0.8716 => 1.3463, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 54.14% (0.8885 => 1.3695, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 53.90% (0.9039 => 1.3911, std.dev.: 0.0013) SingleSource/Regression/C/test_indvars: 52.59% (0.0232 => 0.0354, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.68% (0.9688 => 1.4695, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.42% (2.1401 => 3.0479, std.dev.: 0.1065) SingleSource/Benchmarks/McGill/exptree: 41.58% (0.0784 => 0.1110, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.24% (0.0734 => 0.1000, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.34% (3.1832 => 4.3083, std.dev.: 0.1863) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.61% (0.1983 => 0.2590, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 30.40% (0.0421 => 0.0549, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 28.67% (0.8855 => 1.1394, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.98% (0.2180 => 0.2790, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.29% (0.8286 => 1.0547, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.00% (0.8712 => 1.0977, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.65% (0.8069 => 1.0139, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.62% (0.8204 => 1.0306, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.48% (0.8697 => 1.0913, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.41% (0.8317 => 1.0430, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 25.38% (1.0945 => 1.3723, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.24% (0.8420 => 1.0545, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.18% (0.8331 => 1.0429, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.14% (0.7966 => 0.9969, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.08% (0.8050 => 1.0069, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.06% (0.8518 => 1.0653, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.87% (0.8086 => 1.0097, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 24.83% (0.8656 => 1.0805, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.70% (0.9069 => 1.1309, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.58% (0.8927 => 1.1121, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.52% (0.9074 => 1.1299, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 24.31% (0.1839 => 0.2286, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.06% (0.9908 => 1.2292, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.74% (4.4880 => 5.5536, std.dev.: 0.0968) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.61% (0.6586 => 0.8141, std.dev.: 0.0163) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.23% (0.0848 => 0.1045, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 22.99% (0.0757 => 0.0931, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.52% (0.4783 => 0.5860, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.89% (0.0635 => 0.0774, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 21.58% (0.1112 => 0.1352, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.66% (0.0668 => 0.0806, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.32% (0.0822 => 0.0989, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 20.19% (0.1565 => 0.1881, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 20.13% (0.3800 => 0.4565, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.54% (0.0701 => 0.0838, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.03% (1.3279 => 1.5806, std.dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: 19.00% (8.6247 => 10.2634, std.dev.: 0.0189) MultiSource/Benchmarks/PAQ8p/paq8p: 18.97% (2.3764 => 2.8272, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.97% (0.3137 => 0.3732, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.71% (0.4127 => 0.4899, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 18.57% (0.4125 => 0.4891, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.49% (1.2526 => 1.4842, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 18.39% (0.0745 => 0.0882, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.05% (0.5191 => 0.6128, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 17.82% (0.2390 => 0.2816, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 17.41% (0.1097 => 0.1288, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.99% (0.1778 => 0.2080, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.75% (0.0830 => 0.0969, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 16.66% (0.2227 => 0.2598, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 15.65% (0.0773 => 0.0894, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.30% (0.1157 => 0.1334, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 14.87% (0.4397 => 0.5051, std.dev.: 0.0116) MultiSource/Benchmarks/NPB-serial/is/is: 14.69% (0.0708 => 0.0812, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 14.45% (0.3226 => 0.3692, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 14.28% (1.2568 => 1.4363, std.dev.: 0.0274) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.07% (0.1137 => 0.1297, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 13.72% (0.8768 => 0.9971, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.57% (0.3295 => 0.3742, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 13.37% (4.9628 => 5.6263, std.dev.: 0.2177) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.02% (1.6386 => 1.8519, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.96% (13.1811 => 14.8892, std.dev.: 0.2429) MultiSource/Benchmarks/nbench/nbench: 12.91% (1.1271 => 1.2726, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.76% (0.1756 => 0.1980, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.60% (1.1170 => 1.2577, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/rem: 12.46% (0.1035 => 0.1164, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.86% (0.9435 => 1.0554, std.dev.: 0.0228) MultiSource/Benchmarks/Olden/em3d/em3d: 11.85% (0.1721 => 0.1925, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.78% (0.1885 => 0.2107, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.66% (0.8148 => 0.9098, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.63% (1.2602 => 1.4067, std.dev.: 0.0195) MultiSource/Benchmarks/Olden/mst/mst: 11.55% (0.1177 => 0.1313, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 11.52% (0.6834 => 0.7621, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.44% (0.1905 => 0.2123, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.21% (0.6010 => 0.6684, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.11% (0.7473 => 0.8303, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.50% (0.4847 => 0.5356, std.dev.: 0.0092) MultiSource/Applications/siod/siod: 10.37% (2.2184 => 2.4484, std.dev.: 0.0754) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.98% (0.4559 => 0.5014, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 9.94% (0.1247 => 0.1371, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 9.92% (3.8189 => 4.1976, std.dev.: 0.0932) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.85% (4.1763 => 4.5876, std.dev.: 0.0581) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (0.1466 => 0.1608, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.51% (0.2240 => 0.2453, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.48% (0.1150 => 0.1259, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.47% (0.2998 => 0.3282, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.46% (0.3003 => 0.3287, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.15% (8.6476 => 9.4389, std.dev.: 0.1345) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.98% (0.6227 => 0.6786, std.dev.: 0.0156) MultiSource/Benchmarks/Olden/health/health: 8.91% (0.1347 => 0.1467, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.89% (0.2519 => 0.2743, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.88% (0.1588 => 0.1729, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 8.27% (0.2985 => 0.3232, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: 8.25% (1.4269 => 1.5446, std.dev.: 0.0249) MultiSource/Benchmarks/McCat/18-imp/imp: 8.19% (0.3503 => 0.3790, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.10% (0.5961 => 0.6444, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.85% (6.6074 => 7.1263, std.dev.: 0.0804) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.69% (0.3717 => 0.4003, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 7.65% (0.6287 => 0.6768, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 7.60% (4.1305 => 4.4443, std.dev.: 0.1146) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.34% (0.5817 => 0.6244, std.dev.: 0.0144) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.00% (0.2741 => 0.2933, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (0.8995 => 0.9602, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.55% (4.4873 => 4.7810, std.dev.: 0.0947) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.51% (0.2794 => 0.2976, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 5.99% (0.2088 => 0.2213, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.97% (4.5702 => 4.8429, std.dev.: 0.0912) MultiSource/Benchmarks/Bullet/bullet: 5.61% (31.8598 => 33.6472, std.dev.: 0.1239) MultiSource/Applications/hexxagon/hexxagon: 5.51% (0.9810 => 1.0351, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 5.31% (0.7557 => 0.7958, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.36% (0.3124 => 0.3229, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.22% (1.4479 => 1.4945, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.82% (1.2423 => 1.2773, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1512200.00% (0.0001 => 1.5123, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 374.03% (0.3585 => 1.6994, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: 363.04% (1.5671 => 7.2563, std.dev.: 0.1293) MultiSource/Benchmarks/PAQ8p/paq8p: 280.59% (91.7701 => 349.2658, std.dev.: 1.5848) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.40% (28.5821 => 85.5751, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.10% (5.1305 => 14.0114, std.dev.: 0.0309) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 115.61% (1.1365 => 2.4504, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/ary: 106.39% (0.0219 => 0.0452, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 73.45% (0.0226 => 0.0392, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 62.80% (2.8760 => 4.6821, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/pi: 39.86% (1.5795 => 2.2091, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.71% (2.7995 => 3.9113, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 34.11% (1.3882 => 1.8617, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.50% (4.5327 => 5.9607, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.74% (2.9096 => 3.7168, std.dev.: 0.0513) SingleSource/Benchmarks/McGill/misr: 19.37% (0.4001 => 0.4776, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.91% (0.7597 => 0.8882, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.87% (4.7794 => 5.5858, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 14.07% (7.5003 => 8.5554, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.74% (0.3186 => 0.3592, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.75% (1.1857 => 1.3013, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 9.28% (3.1873 => 3.4832, std.dev.: 0.0720) SingleSource/Benchmarks/Misc/ReedSolomon: 8.09% (8.5322 => 9.2226, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.46% (23.5781 => 25.3378, std.dev.: 0.0122) MultiSource/Applications/aha/aha: 5.72% (3.3398 => 3.5308, std.dev.: 0.0728) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.66% (4.9686 => 5.2496, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (0.6150 => 0.6496, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.46% (4.8436 => 5.1083, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (3.5679 => 3.7608, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: 5.26% (6.7064 => 7.0589, std.dev.: 0.0962) MultiSource/Benchmarks/sim/sim: 5.19% (3.8206 => 4.0187, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.75% (6.1706 => 6.4640, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: 3.61% (1.2061 => 1.2497, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.33% (4.2466 => 4.3881, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.21% (3.4104 => 3.4858, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/methcall: 1.74% (8.2676 => 8.4118, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.53% (1.9302 => 1.9597, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.34% (1.5941 => 1.6155, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.28% (8.2783 => 8.3843, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/flops-7: 1.21% (1.7156 => 1.7364, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (2.5697 => 2.6007, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.06% (3.7192 => 3.7585, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.02% (3.7781 => 3.8168, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.18% (2.8951 => 0.8344, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -58.79% (11.5316 => 4.7518, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/fp-convert: -52.67% (15.8853 => 7.5188, std.dev.: 0.0521) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.48% (4.7482 => 3.0161, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.40% (5.4972 => 3.6062, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.40% (5.4300 => 3.6707, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary3: -30.37% (1.9999 => 1.3926, std.dev.: 0.1918) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.73% (5.6343 => 4.1282, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.57% (5.0261 => 3.9920, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.07% (5.0243 => 4.1669, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -15.04% (2.9753 => 2.5278, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.30% (6.3772 => 5.4651, std.dev.: 0.2360) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.96% (9.9065 => 8.7216, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -10.39% (1.1216 => 1.0051, std.dev.: 0.0257) MultiSource/Benchmarks/mafft/pairlocalalign: -10.18% (63.1822 => 56.7503, std.dev.: 0.0571) SingleSource/Benchmarks/Misc/flops-8: -9.43% (2.5609 => 2.3193, std.dev.: 0.0479) SingleSource/Benchmarks/Misc/perlin: -9.36% (5.1084 => 4.6304, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.23% (6.2275 => 5.6526, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: -9.11% (5.4641 => 4.9663, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.79% (3.7148 => 3.3881, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.76% (1.0512 => 0.9696, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.54% (4.3552 => 4.0269, std.dev.: 0.1201) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.35% (5.3218 => 4.9307, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/FloatMM: -6.32% (0.8807 => 0.8250, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/sieve: -6.14% (7.0599 => 6.6265, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.51% (0.3937 => 0.3720, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -5.49% (9.3748 => 8.8598, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.47% (4.9453 => 4.6748, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.35% (0.3269 => 0.3094, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.28% (7.2130 => 6.8318, std.dev.: 0.1075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.77% (2.8773 => 2.7401, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.52% (2.4490 => 2.3627, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (8.9760 => 8.6722, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/ffbench: -3.31% (1.4296 => 1.3823, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.28% (1.4529 => 1.4053, std.dev.: 0.0088) MultiSource/Applications/lua/lua: -3.20% (29.8330 => 28.8773, std.dev.: 0.1664) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.14% (5.1557 => 4.9940, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.99% (4.7449 => 4.6032, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.86% (6.0224 => 5.8504, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.76% (4.9469 => 4.8102, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/fbench: -2.70% (3.3840 => 3.2926, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.37% (2.6356 => 2.5732, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.12% (9.2989 => 9.1022, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.95% (3.3479 => 3.2825, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: -1.86% (2.8957 => 2.8417, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops-6: -1.40% (2.4416 => 2.4073, std.dev.: 0.0102) MultiSource/Applications/siod/siod: -1.31% (3.6643 => 3.6163, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.07% (4.9994 => 4.9457, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/neural/neural: -1.04% (1.0841 => 1.0728, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 14.07% (1.0262 => 1.1706, std.dev.: 0.0153) SingleSource/Benchmarks/CoyoteBench/fftbench: 61.63% (0.2463 => 0.3981, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 19.51% (0.0123 => 0.0147, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 29.92% (0.0254 => 0.0330, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -8.61% (0.0302 => 0.0276, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.86% (0.0384 => 0.0395, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 6.32% (0.0190 => 0.0202, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 5.29% (0.1438 => 0.1514, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 1.49% (1.1329 => 1.1498, std.dev.: 0.1010) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.25% (0.4164 => 0.4341, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.23% (0.1369 => 0.1468, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 47.11% (0.0641 => 0.0943, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.05% (0.0195 => 0.0238, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.69% (0.0578 => 0.0574, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.93% (1.1437 => 1.2801, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.32% (0.0627 => 0.0556, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (0.0180 => 0.0187, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: 246.95% (0.8017 => 2.7815, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.06% (0.0062 => 0.0067, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 11:34:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 13:34:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130101193442.3973F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7274?compare_to=7270&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7274, Order: 171348, Start Time: 2013-01-01 17:21:29, End Time: 2013-01-01 19:35:53 To: 7270, Order: 171343, Start Time: 2013-01-01 14:36:57, End Time: 2013-01-01 16:51:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (0.8816 => 0.8709, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.64% (0.0715 => 0.0689, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8148 => 499.8535, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 44225.04% (1.1277 => 499.8535, std.dev.: 0.0029) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.48% (0.5229 => 1.6549, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 20.14% (14.9895 => 18.0091, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 54.25% (14.1553 => 21.8347, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 17.35% (4.1105 => 4.8237, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.99% (1.1048 => 1.7455, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1225.76% (7.1582 => 94.9003, std.dev.: 0.0651) SingleSource/Benchmarks/Misc-C++-EH/spirit: 126.24% (3.4629 => 7.8345, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.72% (0.6222 => 1.1058, std.dev.: 0.0138) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.92% (0.0720 => 7.4433, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3831200.00% (0.0001 => 3.8313, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11153200.00% (0.0001 => 11.1533, std.dev.: 0.0190) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 67000.00% (0.0001 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578300.00% (0.0001 => 0.5784, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959100.00% (0.0001 => 9.9592, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5502300.00% (0.0001 => 5.5024, std.dev.: 0.0065) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.11% (1.1194 => 10.3333, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 149.17% (22.1758 => 55.2547, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.71% (0.0929 => 0.1716, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 83.95% (0.0243 => 0.0447) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 59.19% (0.1463 => 0.2329, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 58.67% (0.0271 => 0.0430, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.05% (2.9384 => 4.6440, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.07% (7.0540 => 11.0095, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.13% (1.5859 => 2.4127, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.01% (8.1363 => 11.9612, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.60% (2.2024 => 3.1187, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: 41.47% (21.9371 => 31.0347, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.46% (0.0439 => 0.0621, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 40.99% (0.1432 => 0.2019, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.86% (0.1062 => 0.1411, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.84% (0.6675 => 0.8867, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.26% (1.5415 => 2.0388, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: 31.62% (0.3109 => 0.4092, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.32% (0.5105 => 0.6704, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.83% (0.4615 => 0.6038, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 30.43% (0.4299 => 0.5607, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.92% (4.2646 => 5.5404, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 29.61% (0.4289 => 0.5559, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 27.78% (1.1642 => 1.4876, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.71% (0.1584 => 0.2023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 27.68% (0.4620 => 0.5899, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.48% (0.0746 => 0.0951, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 26.60% (1.0722 => 1.3574, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 26.12% (0.2554 => 0.3221, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.28% (0.2271 => 0.2845, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.16% (0.1892 => 0.2368, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.03% (3.8922 => 4.8664, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 24.44% (0.6456 => 0.8034, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.18% (1.4186 => 1.7475, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.17% (0.3121 => 0.3844, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.70% (0.0793 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.67% (0.0675 => 0.0828, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 22.40% (9.4845 => 11.6091, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.14% (0.1337 => 0.1633, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 22.01% (5.7591 => 7.0267, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.2700 => 0.3290, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 21.63% (0.1655 => 0.2013, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.26% (0.0842 => 0.1021, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 21.21% (0.7115 => 0.8624, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 20.98% (0.1163 => 0.1407, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.90% (1.3050 => 1.5778, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 20.87% (0.7835 => 0.9470, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 20.87% (0.3283 => 0.3968, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 20.51% (0.3232 => 0.3895, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.32% (0.1555 => 0.1871, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.20% (0.0886 => 0.1065, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.93% (4.9449 => 5.9303, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 19.49% (0.0662 => 0.0791, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/15-trie/trie: 19.35% (0.0527 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 19.31% (1.1840 => 1.4126, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.29% (5.0018 => 5.9664, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.23% (3.3354 => 3.9767, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.20% (0.5860 => 0.6985, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.91% (0.8172 => 0.9717, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 18.86% (17.1811 => 20.4207, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.46% (0.2107 => 0.2496, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 18.33% (0.1151 => 0.1362, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 18.32% (0.3379 => 0.3998, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.97% (0.5020 => 0.5922, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.94% (0.1940 => 0.2288, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 17.92% (0.0614 => 0.0724, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 17.88% (0.3423 => 0.4035, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.72% (0.1236 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.70% (0.9765 => 1.1493, std.dev.: 0.0067) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.59% (0.1143 => 0.1344, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.53% (0.0730 => 0.0858, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.37% (0.2758 => 0.3237, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.32% (0.4636 => 0.5439, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.17% (0.7433 => 0.8709, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 17.14% (2.2969 => 2.6905, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 17.03% (0.1268 => 0.1484, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.97% (0.5569 => 0.6514, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 16.83% (2.0273 => 2.3685, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.78% (0.3307 => 0.3862, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 16.53% (3.8723 => 4.5124, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.45% (0.5981 => 0.6965, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.23% (0.0770 => 0.0895, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.11% (0.6450 => 0.7489, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.07% (0.8101 => 0.9403, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/football/football: 15.98% (0.8921 => 1.0347, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.69% (0.3441 => 0.3981, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 15.13% (0.3180 => 0.3661, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.82% (1.1861 => 1.3619, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.56% (0.2603 => 0.2982, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 14.11% (0.3387 => 0.3865, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.62% (0.8067 => 0.9166, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 13.17% (0.1268 => 0.1435, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7642, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.74% (0.3282 => 0.3700, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.29% (0.3865 => 0.4340, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.51% (14.3668 => 16.0204, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.33% (0.4103 => 0.4568, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 11.17% (0.3098 => 0.3444, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.04% (0.4203 => 0.4667, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.02% (0.4048 => 0.4494, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.91% (0.2430 => 0.2695, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.77% (0.3427 => 0.3796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 10.46% (0.3422 => 0.3780, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.44% (0.3603 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.07% (0.3684 => 0.4055, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.04% (0.4064 => 0.4472, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.48% (0.3650 => 0.3996, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.31% (10.3673 => 11.3330, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 9.22% (0.2831 => 0.3092, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5925 => 0.6470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.06% (0.2871 => 0.3131, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.96% (63.2438 => 68.9111, std.dev.: 0.0360) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.95% (2.2022 => 2.3993, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.89% (0.3162 => 0.3443, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.82% (2.0665 => 2.2488, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.76% (0.7326 => 0.7968, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2905 => 0.3159, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.40% (1.2842 => 1.3921, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (0.2756 => 0.2985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2793 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.06% (0.2877 => 0.3109, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.3052 => 0.3294, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.82% (0.2891 => 0.3117, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.80% (0.2872 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.53% (0.2802 => 0.3013, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.52% (0.3935 => 0.4231, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.48% (0.4879 => 0.5244, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.43% (0.3136 => 0.3369, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.96% (0.3177 => 0.3398, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 6.36% (0.3131 => 0.3330, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.36% (7.9617 => 8.2289, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.67% (32.5116 => 59.0639, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6981, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.09% (1.1396 => 1.2432, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.00% (2.8904 => 3.1506, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3779, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4531, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (3.1578 => 3.3255, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (2.0360 => 2.1079, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (0.9957 => 1.0300, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9010, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7184, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.04% (0.8333 => 0.8503, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3432, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.53% (1.7254 => 1.7518, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.42% (4.4649 => 4.5283, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.35% (1.0785 => 1.0931, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2153, std.dev.: 0.0098) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3580, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1703, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.25% (5.2763 => 1.2002, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.63% (5.3855 => 4.4901, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.04% (5.3526 => 4.4940, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -12.71% (10.4361 => 9.1100, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -7.81% (54.1659 => 49.9331, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.17% (1.7609 => 1.6522, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.85% (1.9577 => 0.6686, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.10% (8.0499 => 4.0172, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.97% (0.3987 => 0.2473, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.82% (10.7105 => 7.4092, std.dev.: 0.0261) MultiSource/Benchmarks/PAQ8p/paq8p: -25.01% (85.0658 => 63.7942, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0049, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.39% (1.2258 => 1.0004, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.33% (2.5528 => 2.1359, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.55% (1.2373 => 1.0944, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -11.10% (9.5636 => 8.5017, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2878, std.dev.: 0.0904) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (0.2497 => 0.2351, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.63% (1.6805 => 1.5859, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.83% (0.4808 => 0.4576, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.56% (8.1563 => 7.7842, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/salsa20: -4.54% (10.2830 => 9.8158, std.dev.: 0.0139) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -3.44% (0.6223 => 0.6009, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.98% (1.0554 => 1.0345, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3301, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5883, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0018) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 12:06:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 14:06:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130101200633.E8AEC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7275?compare_to=7271&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7275, Order: 171348, Start Time: 2013-01-01 18:30:46, End Time: 2013-01-01 20:07:45 To: 7271, Order: 171344, Start Time: 2013-01-01 16:30:49, End Time: 2013-01-01 18:07:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (114 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (833 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.60% (0.6801 => 0.7046, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.81% (22.4056 => 78.8251, std.dev.: 0.0379) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.32% (0.0717 => 0.1128, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.83% (0.0974 => 0.1508, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.40% (0.1500 => 0.2016, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.37% (1.6474 => 2.0983, std.dev.: 0.0184) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.60% (0.0699 => 0.0850, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.55% (5.4682 => 6.6468, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.63% (2.2587 => 2.7021, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.65% (0.0680 => 0.0800, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.56% (0.6395 => 0.7390, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 15.39% (1.1450 => 1.3212, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.87% (0.6395 => 0.7282, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.92% (0.6260 => 0.7069, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.13% (0.1146 => 0.1285, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.98% (0.5941 => 0.6653, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 11.78% (0.4524 => 0.5057, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.62% (0.6230 => 0.6954, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.51% (0.5805 => 0.6473, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.12% (0.7021 => 0.7802, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.12% (0.6033 => 0.6704, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.01% (0.5849 => 0.6493, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.78% (0.6440 => 0.7134, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.74% (0.5456 => 0.6042, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.64% (0.5688 => 0.6293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.47% (0.5567 => 0.6150, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.40% (0.6676 => 0.7370, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.37% (0.5581 => 0.6160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.35% (0.5575 => 0.6152, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 10.35% (0.4861 => 0.5364, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.26% (0.5925 => 0.6533, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.14% (1.6364 => 1.8024, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.10% (0.5802 => 0.6388, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 9.94% (0.4515 => 0.4964, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.83% (0.5859 => 0.6435, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.68% (0.4916 => 0.5392, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.54% (0.1982 => 0.2171, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.48% (0.5857 => 0.6412, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.37% (0.6052 => 0.6619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.29% (0.6446 => 0.7045, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.16% (0.6189 => 0.6756, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.95% (0.5329 => 0.5806, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.94% (0.5570 => 0.6068, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (3.5339 => 3.8485, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.89% (0.5478 => 0.5965, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.82% (0.5569 => 0.6060, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.80% (0.6304 => 0.6859, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.71% (0.5591 => 0.6078, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.66% (0.5705 => 0.6199, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.26% (0.5863 => 0.6347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.21% (0.6660 => 0.7207, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.91% (4.5069 => 4.8632, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.83% (0.6194 => 0.6679, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.73% (0.6297 => 0.6784, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 7.51% (0.3357 => 0.3609, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.35% (0.7524 => 0.8077, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.32% (0.6681 => 0.7170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.28% (0.3446 => 0.3697, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.06% (0.6667 => 0.7138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.04% (0.3394 => 0.3633, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 6.50% (0.6750 => 0.7189, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.15% (0.7339 => 0.7790, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (1.4642 => 1.5459, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 5.40% (0.3481 => 0.3669, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.24% (0.2385 => 0.2510, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 5.24% (18.2933 => 19.2510, std.dev.: 0.0164) MultiSource/Applications/Burg/burg: 5.09% (1.2515 => 1.3152, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 5.03% (9.2283 => 9.6929, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.02% (1.2784 => 1.3426, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 3.19% (5.0226 => 5.1826, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 2.94% (17.1032 => 17.6061, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.9557 => 0.9780, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (1.3864 => 1.4127, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.84% (31.3723 => 55.4803, std.dev.: 0.0567) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.81% (0.9531 => 1.0275, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4395, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1147, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5938, std.dev.: 0.0984) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1055, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3169, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.69% (79.7170 => 81.0610, std.dev.: 0.1096) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6020, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.11% (4.4335 => 4.4828, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.2428 => 0.2293, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.55% (0.3142 => 0.2999, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.38% (0.9852 => 0.9420, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.29% (0.3658 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.21% (0.9542 => 0.9140, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.99% (0.6484 => 0.6225, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -3.84% (0.3831 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.4176 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.78% (0.3812 => 0.3668, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: -3.77% (0.3848 => 0.3703, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.72% (0.3896 => 0.3751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.70% (0.3891 => 0.3747, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.67% (0.3837 => 0.3696, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.4033 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.50% (0.4199 => 0.4052, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (2.4924 => 2.4075, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -3.30% (4.3330 => 4.1902, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: -3.29% (1.3148 => 1.2715, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.27% (0.3884 => 0.3757, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.26% (0.3252 => 0.3146, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4280 => 0.4141, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.18% (0.7919 => 0.7667, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -3.13% (0.7982 => 0.7732, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.13% (2.1713 => 2.1034, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: -3.10% (0.6347 => 0.6150, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.08% (0.7198 => 0.6976, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -3.07% (0.6441 => 0.6243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.96% (0.4321 => 0.4193, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.85% (20.7746 => 20.1829, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.85% (1.0544 => 1.0244, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -2.82% (0.7779 => 0.7560, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -2.79% (0.3621 => 0.3520, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.77% (1.2221 => 1.1882, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.75% (0.3931 => 0.3823, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.70% (1.2210 => 1.1880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.55% (0.4427 => 0.4314, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.43% (14.2083 => 13.8636, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.37% (1.2300 => 1.2008, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.36% (6.7716 => 6.6116, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -2.29% (7.0961 => 6.9334, std.dev.: 0.0193) MultiSource/Applications/lua/lua: -2.21% (4.0594 => 3.9698, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -2.15% (16.1920 => 15.8443, std.dev.: 0.0121) MultiSource/Benchmarks/Bullet/bullet: -2.11% (34.0927 => 33.3740, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.87% (0.5999 => 0.5887, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -1.69% (2.4021 => 2.3615, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.68% (0.9179 => 0.9025, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (0.8521 => 0.8393, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: -1.40% (1.5610 => 1.5391, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.39% (0.9077 => 0.8951, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.07% (8.0126 => 7.9272, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.03% (4.0323 => 3.9907, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.07% (1.8100 => 0.7046, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0294, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4758, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.17% (0.6962 => 0.3817, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.50% (0.1622 => 0.1111, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.94% (0.1983 => 0.1429, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.31% (0.2151 => 0.1585, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.74% (1.3643 => 1.0268, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7502, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.39% (0.2274 => 0.1742, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.33% (83.5423 => 64.0487, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3994, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1994, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.70% (3.3454 => 2.7198, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.35% (2.5106 => 2.1252, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3594, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8212, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.87% (4.1534 => 3.9096, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -4.94% (1.1594 => 1.1021, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.71% (1.7753 => 1.6917, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (7.9763 => 7.7370, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2274, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.19% (1.3096 => 1.2809, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7003, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1941, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.8776 => 4.8140, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.17% (1.6219 => 1.6030, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 14:08:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 16:08:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130101220848.5CE7A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7276?compare_to=7275&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7276, Order: 171349, Start Time: 2013-01-01 20:30:55, End Time: 2013-01-01 22:07:27 To: 7275, Order: 171348, Start Time: 2013-01-01 18:30:46, End Time: 2013-01-01 20:07:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 1 (114 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (833 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.12% (0.7046 => 0.6826, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.16% (22.4056 => 78.9032, std.dev.: 0.0542) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.04% (0.0717 => 0.1126, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.11% (0.0974 => 0.1501, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 34.73% (0.1500 => 0.2021, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.55% (0.0599 => 0.0788, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.37% (1.6474 => 2.0983, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.33% (5.4682 => 6.6346, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.32% (0.0699 => 0.0848, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.33% (2.2587 => 2.6954, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.40% (0.6395 => 0.7380, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 15.26% (1.1450 => 1.3197, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.01% (0.6395 => 0.7291, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.07% (0.6260 => 0.7078, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.09% (0.5941 => 0.6659, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 12.02% (0.4524 => 0.5068, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.87% (0.1146 => 0.1282, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.52% (0.6230 => 0.6948, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.46% (0.5805 => 0.6470, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.14% (0.7021 => 0.7803, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.07% (0.6033 => 0.6701, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.99% (0.5849 => 0.6492, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.80% (0.5456 => 0.6045, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.73% (0.6440 => 0.7131, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 10.70% (0.4861 => 0.5381, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.67% (0.5688 => 0.6295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.60% (0.5567 => 0.6157, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.50% (0.5925 => 0.6547, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.35% (0.5575 => 0.6152, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.23% (0.5581 => 0.6152, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.14% (0.6676 => 0.7353, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.08% (0.5802 => 0.6387, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.08% (1.6364 => 1.8013, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 9.88% (0.4515 => 0.4961, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.73% (0.5859 => 0.6429, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.65% (0.5857 => 0.6422, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.48% (0.4916 => 0.5382, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.37% (0.6052 => 0.6619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.20% (0.6446 => 0.7039, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.18% (0.6189 => 0.6757, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.07% (0.5570 => 0.6075, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.99% (0.5329 => 0.5808, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.98% (0.1982 => 0.2160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.89% (0.5569 => 0.6064, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.87% (0.5478 => 0.5964, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (3.5339 => 3.8461, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.82% (0.5705 => 0.6208, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.78% (0.5591 => 0.6082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.71% (0.6304 => 0.6853, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.26% (0.6660 => 0.7210, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.22% (0.5863 => 0.6345, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.04% (0.6194 => 0.6692, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.73% (0.6297 => 0.6784, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.69% (4.5069 => 4.8536, std.dev.: 0.0077) MultiSource/Applications/sgefa/sgefa: 7.63% (0.3357 => 0.3613, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.46% (0.3446 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.44% (0.6681 => 0.7178, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (0.7524 => 0.8074, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.12% (0.6667 => 0.7142, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 7.10% (0.3394 => 0.3635, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.43% (0.6750 => 0.7184, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.34% (0.7339 => 0.7804, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 5.75% (0.3481 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.4642 => 1.5444, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.32% (0.2385 => 0.2512, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (9.2283 => 9.6876, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 4.98% (18.2933 => 19.2036, std.dev.: 0.0191) MultiSource/Applications/Burg/burg: 4.91% (1.2515 => 1.3130, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.2784 => 1.3411, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 2.83% (5.0226 => 5.1646, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 2.81% (17.1032 => 17.5845, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.9557 => 0.9790, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.14% (0.4813 => 0.4916, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.85% (1.3864 => 1.4120, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.95% (31.3723 => 55.5147, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9531 => 1.0285, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (5.1955 => 5.4388, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1149, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.64% (2.0478 => 2.1223, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4146, std.dev.: 0.2079) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3182, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5320 => 4.5990, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.11% (4.4335 => 4.4829, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (0.9852 => 0.9402, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.43% (0.3812 => 0.3643, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.40% (0.3658 => 0.3497, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3831 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3884 => 0.3716, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.25% (0.9542 => 0.9136, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.24% (0.3891 => 0.3726, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.21% (0.3896 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.4199 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.86% (0.6484 => 0.6234, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.76% (0.4280 => 0.4119, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.66% (0.6347 => 0.6115, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.54% (0.6441 => 0.6213, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -3.50% (2.4924 => 2.4052, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.45% (0.7919 => 0.7646, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.43% (4.3330 => 4.1843, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.28% (0.3837 => 0.3711, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.16% (1.3148 => 1.2733, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -3.10% (20.7746 => 20.1307, std.dev.: 0.0246) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.08% (0.4151 => 0.4023, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.7198 => 0.6979, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.99% (1.2221 => 1.1856, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.98% (0.7982 => 0.7744, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.97% (0.7779 => 0.7548, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.83% (1.0544 => 1.0246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.82% (2.1713 => 2.1100, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.81% (1.2210 => 1.1867, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.71% (0.4321 => 0.4204, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.70% (0.3931 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.58% (1.2300 => 1.1983, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8498, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.48% (6.7716 => 6.6035, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.44% (0.4427 => 0.4319, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -2.43% (7.0961 => 6.9240, std.dev.: 0.0096) MultiSource/Applications/lua/lua: -2.32% (4.0594 => 3.9651, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.28% (0.5999 => 0.5862, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -2.24% (16.1920 => 15.8293, std.dev.: 0.0174) MultiSource/Benchmarks/Bullet/bullet: -1.94% (34.0927 => 33.4305, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -1.71% (2.4021 => 2.3610, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.70% (0.9077 => 0.8923, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -1.56% (2.1401 => 2.1068, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: -1.31% (1.5610 => 1.5405, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.16% (4.0323 => 3.9856, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -1.16% (15.2527 => 15.0765, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.14% (8.0126 => 7.9212, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8276, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.29% (1.8100 => 0.6826, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -49.87% (8.0445 => 4.0324, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4759, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.44% (0.1622 => 0.1112, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.74% (0.1983 => 0.1433, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.31% (0.2151 => 0.1585, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.37% (1.3643 => 1.0318, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0372, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3993, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1978, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1829, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.19% (2.9703 => 2.3707, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -19.28% (3.3454 => 2.7005, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.23% (1.2237 => 1.0006, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.59% (2.5106 => 2.1193, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7048, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3587, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6339, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.38% (5.2027 => 4.8190, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9082, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.30% (1.1594 => 1.0979, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.68% (1.7753 => 1.6923, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7305, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.3096 => 1.2824, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7007, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4732, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1956, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6009, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.17% (4.8776 => 4.8203, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 10.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 14:27:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 16:27:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130101222743.B5F142A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7277?compare_to=7273&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7277, Order: 171349, Start Time: 2013-01-01 20:26:56, End Time: 2013-01-01 22:26:38 To: 7273, Order: 171348, Start Time: 2013-01-01 16:48:14, End Time: 2013-01-01 18:45:39 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (141 on baseline) Performance Improvements: 2 (44 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1051 (791 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.00% (0.9135 => 0.9592, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.59% (1.3026 => 1.3624, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.85% (0.8141 => 0.8292, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.58% (40.4007 => 42.2502, std.dev.: 0.1824) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.98% (1.4073 => 1.4352, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.66% (1.5999 => 1.6265, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 1.21% (1.3823 => 1.3990, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (76.1603 => 73.2827, std.dev.: 0.9746) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.79% (23.0615 => 21.7265, std.dev.: 0.1457) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.28% (1.1706 => 1.1439, std.dev.: 0.2426) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.65% (0.3981 => 0.4007, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.30% (0.0147 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.73% (0.0330 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 15.58% (0.0276 => 0.0319, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 9.87% (0.0395 => 0.0434, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 1.49% (0.0202 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0217 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 28.06% (0.0196 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.46% (0.1514 => 0.1521, std.dev.: 0.0113) MultiSource/Applications/lemon/lemon: 4.27% (1.1498 => 1.1989, std.dev.: 0.1053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.82% (0.4341 => 0.4941, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.34% (0.1468 => 0.1463, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.03% (0.0943 => 0.0981, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.94% (0.0238 => 0.0245, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.76% (0.0574 => 0.0630, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.22% (1.2801 => 1.2829, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0007 => 0.0013, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.17% (0.0556 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 44.92% (0.0187 => 0.0271, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (2.7815 => 2.7707, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.88% (0.0067 => 0.0051, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.81% (30.9961 => 31.2466, std.dev.: 0.6977) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.87% (16.4461 => 20.0429, std.dev.: 0.6433) MultiSource/Applications/sqlite3/sqlite3: 3573.52% (0.6332 => 23.2607, std.dev.: 0.6879) MultiSource/Benchmarks/McCat/08-main/main: 55.43% (0.1831 => 0.2846, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.50% (0.1559 => 0.1520, std.dev.: 0.0301) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23365.48% (0.3123 => 73.2827, std.dev.: 0.9746) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1855.14% (0.3344 => 6.5380, std.dev.: 0.2982) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.87% (0.2364 => 0.3283, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 18.40% (0.6010 => 0.7116, std.dev.: 0.2539) SingleSource/Benchmarks/Misc/mandel: 6.29% (0.0429 => 0.0456, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.34% (0.3266 => 0.3473, std.dev.: 0.1056) SingleSource/Benchmarks/Shootout-C++/strcat: 5.84% (0.1969 => 0.2084, std.dev.: 0.0589) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.70% (0.0224 => 0.0239, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -31.30% (0.0230 => 0.0158, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0517, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 16.89% (0.1462 => 0.1709, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4077, std.dev.: 0.0584) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4946, std.dev.: 0.0378) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5281, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5306, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0509, std.dev.: 0.0355) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3372, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3789, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0840, std.dev.: 0.0175) SingleSource/Regression/C/uint64_to_float: -29.90% (2.1832 => 1.5305, std.dev.: 0.0029) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 136.95% (0.0249 => 0.0590, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 95.60% (0.0250 => 0.0489, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 70.37% (0.0297 => 0.0506, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 64.38% (0.0233 => 0.0383, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 63.40% (0.8338 => 1.3624, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/neural/neural: 62.57% (0.1440 => 0.2341, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 61.82% (0.8261 => 1.3368, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 61.31% (0.8359 => 1.3484, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 61.28% (0.8805 => 1.4201, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 61.15% (0.8007 => 1.2903, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 60.77% (0.8048 => 1.2939, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.92% (0.7932 => 1.2685, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.68% (0.8177 => 1.3057, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.23% (0.8611 => 1.3711, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 59.08% (0.8457 => 1.3453, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 58.18% (0.8066 => 1.2759, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.04% (0.8316 => 1.3143, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 57.52% (0.8597 => 1.3542, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 56.43% (0.8885 => 1.3899, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 55.42% (0.9039 => 1.4048, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.37% (1.5315 => 2.3795, std.dev.: 0.0627) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.21% (0.8716 => 1.3528, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.63% (0.9056 => 1.4003, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.95% (0.9688 => 1.4721, std.dev.: 0.0586) SingleSource/Regression/C/test_indvars: 46.55% (0.0232 => 0.0340, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: 44.84% (0.0223 => 0.0323, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.38% (2.1401 => 3.0470, std.dev.: 0.0543) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.05% (0.0421 => 0.0577, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.22% (0.0635 => 0.0865, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.93% (3.1832 => 4.3268, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.52% (0.8855 => 1.1469, std.dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/lpbench: 28.92% (0.0989 => 0.1275, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.59% (0.8286 => 1.0572, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 27.47% (0.8712 => 1.1105, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 27.43% (0.8317 => 1.0598, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.02% (0.2180 => 0.2769, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.92% (0.8697 => 1.1038, std.dev.: 0.0174) MultiSource/Applications/sgefa/sgefa: 26.71% (0.2999 => 0.3800, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 26.68% (0.8518 => 1.0791, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 26.68% (0.9074 => 1.1495, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.65% (0.8204 => 1.0390, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 26.64% (0.8331 => 1.0550, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.59% (0.8086 => 1.0236, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.40% (0.8656 => 1.0941, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.19% (0.9069 => 1.1444, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 26.07% (0.8927 => 1.1254, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.05% (0.7966 => 1.0041, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.90% (0.6586 => 0.8292, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.73% (0.8069 => 1.0145, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.68% (0.8050 => 1.0117, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 25.58% (0.9908 => 1.2442, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.30% (0.8420 => 1.0550, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.06% (0.0848 => 0.1052, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 22.87% (1.0945 => 1.3448, std.dev.: 0.0362) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.29% (0.4783 => 0.5849, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 20.92% (0.3800 => 0.4595, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.83% (0.0701 => 0.0847, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 18.97% (2.3764 => 2.8272, std.dev.: 0.0424) SingleSource/Benchmarks/Misc/himenobmtxpa: 18.79% (0.1778 => 0.2112, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 17.95% (8.6247 => 10.1732, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 17.88% (0.0688 => 0.0811, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.28% (0.0810 => 0.0950, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.18% (0.0850 => 0.0996, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.07% (0.5191 => 0.6077, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.53% (0.1137 => 0.1325, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.38% (0.0745 => 0.0867, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.08% (1.6386 => 1.9021, std.dev.: 0.0543) MultiSource/Benchmarks/McCat/05-eks/eks: 15.92% (0.4397 => 0.5097, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.01% (0.8340 => 0.9592, std.dev.: 0.0092) MultiSource/Benchmarks/nbench/nbench: 14.98% (1.1271 => 1.2959, std.dev.: 0.0618) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.97% (0.4127 => 0.4745, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: 14.51% (0.0937 => 0.1073, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.25% (13.1811 => 15.0590, std.dev.: 0.6995) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.09% (0.0717 => 0.0818, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 13.94% (1.2568 => 1.4320, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/football/football: 13.85% (0.8768 => 0.9982, std.dev.: 0.0313) MultiSource/Applications/oggenc/oggenc: 13.66% (4.9628 => 5.6407, std.dev.: 0.1818) MultiSource/Applications/minisat/minisat: 12.25% (0.6834 => 0.7671, std.dev.: 0.0264) SingleSource/UnitTests/SignlessTypes/rem: 12.17% (0.1035 => 0.1161, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 11.78% (0.3226 => 0.3606, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 10.95% (3.8189 => 4.2372, std.dev.: 0.0318) MultiSource/Applications/hbd/hbd: 9.84% (1.4269 => 1.5673, std.dev.: 0.0476) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.44% (0.3717 => 0.4068, std.dev.: 0.0071) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.44% (0.1091 => 0.1194, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 8.94% (0.1577 => 0.1718, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.75% (0.1588 => 0.1727, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.09% (0.2794 => 0.3020, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 7.76% (0.3503 => 0.3775, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/oourafft: 6.08% (0.2088 => 0.2215, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 5.87% (0.9810 => 1.0386, std.dev.: 0.0129) MultiSource/Benchmarks/Bullet/bullet: 4.91% (31.8598 => 33.4239, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.97% (0.3124 => 0.3248, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1509700.00% (0.0001 => 1.5098, std.dev.: 0.0702) MultiSource/Applications/sgefa/sgefa: 373.67% (0.3585 => 1.6981, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: 362.41% (1.5671 => 7.2465, std.dev.: 0.1923) MultiSource/Benchmarks/PAQ8p/paq8p: 281.27% (91.7701 => 349.8877, std.dev.: 2.1826) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.38% (28.5821 => 85.5694, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 172.77% (5.1305 => 13.9944, std.dev.: 0.0551) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.26% (1.1365 => 2.2873, std.dev.: 0.0660) SingleSource/Benchmarks/Shootout-C++/matrix: 62.03% (2.8760 => 4.6601, std.dev.: 0.0734) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.75% (2.7995 => 3.9122, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/pi: 33.43% (1.5795 => 2.1075, std.dev.: 0.0482) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.31% (1.3882 => 1.8506, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.46% (4.5327 => 5.9587, std.dev.: 0.0340) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.76% (2.9096 => 3.7172, std.dev.: 0.0649) SingleSource/Benchmarks/McGill/misr: 20.77% (0.4001 => 0.4832, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.87% (4.7794 => 5.5857, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.81% (0.7597 => 0.8798, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.47% (0.3186 => 0.3647, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/salsa20: 14.22% (7.5003 => 8.5667, std.dev.: 0.0410) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 10.09% (3.1873 => 3.5088, std.dev.: 0.0435) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.77% (1.1857 => 1.3016, std.dev.: 0.0149) MultiSource/Benchmarks/McCat/18-imp/imp: 8.61% (0.1370 => 0.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 8.10% (8.5322 => 9.2229, std.dev.: 0.0725) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3146, std.dev.: 0.0287) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.87% (0.6150 => 0.6511, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.59% (4.9686 => 5.2463, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.43% (4.8436 => 5.1065, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.38% (3.5679 => 3.7599, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 5.24% (3.8206 => 4.0208, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 5.04% (3.3398 => 3.5082, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.99% (0.5214 => 0.5474, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.95% (2.2485 => 2.3598, std.dev.: 0.0295) MultiSource/Applications/JM/lencod/lencod: 4.81% (6.7064 => 7.0289, std.dev.: 0.0837) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.74% (6.1706 => 6.4631, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 3.59% (1.2061 => 1.2494, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 3.55% (1.7056 => 1.7662, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.29% (4.2466 => 4.3864, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: 3.15% (0.5081 => 0.5241, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.51% (1.5866 => 1.6265, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.37% (3.4104 => 3.4911, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.99% (41.4238 => 42.2502, std.dev.: 0.1824) SingleSource/Benchmarks/Shootout/methcall: 1.89% (8.2676 => 8.4240, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.78% (4.4340 => 4.5131, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.46% (8.2783 => 8.3994, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.15% (2.5697 => 2.5993, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: 1.12% (0.9842 => 0.9952, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.11% (3.7781 => 3.8201, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.09% (1.8231 => 1.8429, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-3: 1.03% (2.0670 => 2.0882, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -70.98% (2.8951 => 0.8402, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.34% (11.5316 => 4.6884, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/fp-convert: -52.49% (15.8853 => 7.5479, std.dev.: 0.0814) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.49% (4.7482 => 3.0157, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.39% (5.4972 => 3.6069, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.49% (5.4300 => 3.6656, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary3: -30.43% (1.9999 => 1.3913, std.dev.: 0.1689) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.74% (5.6343 => 4.1277, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.39% (5.0261 => 4.0011, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.01% (5.0243 => 4.1695, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.96% (2.9753 => 2.5303, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.04% (7.2130 => 6.2727, std.dev.: 0.2452) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.95% (9.9065 => 8.7227, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: -10.18% (63.1822 => 56.7515, std.dev.: 0.0366) SingleSource/Benchmarks/Misc/perlin: -9.35% (5.1084 => 4.6308, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-8: -9.24% (2.5609 => 2.3244, std.dev.: 0.0349) MultiSource/Benchmarks/Olden/em3d/em3d: -9.23% (5.4641 => 4.9599, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.93% (6.2275 => 5.6716, std.dev.: 0.0150) SingleSource/Benchmarks/McGill/chomp: -8.84% (1.1216 => 1.0224, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.75% (3.7148 => 3.3897, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.46% (6.3772 => 5.8376, std.dev.: 0.1501) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.97% (1.0512 => 0.9674, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.42% (5.3218 => 4.9268, std.dev.: 0.0537) SingleSource/Benchmarks/Shootout/sieve: -6.20% (7.0599 => 6.6223, std.dev.: 0.0105) SingleSource/Benchmarks/Stanford/FloatMM: -5.60% (0.8807 => 0.8314, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: -5.51% (9.3748 => 8.8586, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.45% (0.3269 => 0.3091, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.30% (4.9453 => 4.6833, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.11% (0.3937 => 0.3736, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -4.40% (0.6910 => 0.6606, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/methcall: -3.69% (8.9760 => 8.6446, std.dev.: 0.0217) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.05% (1.4529 => 1.4086, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.85% (4.7449 => 4.6096, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.84% (4.9469 => 4.8064, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.71% (5.1557 => 5.0158, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.65% (2.6356 => 2.5658, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.65% (6.0224 => 5.8631, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: -2.47% (3.3840 => 3.3004, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.21% (3.3479 => 3.2738, std.dev.: 0.0125) MultiSource/Applications/lua/lua: -2.15% (29.8330 => 29.1922, std.dev.: 0.1595) SingleSource/Benchmarks/Misc/ffbench: -2.14% (1.4296 => 1.3990, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.03% (9.2989 => 9.1105, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.18% (1.5308 => 1.5127, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/neural/neural: -1.02% (1.0841 => 1.0730, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.47% (1.0262 => 1.1439, std.dev.: 0.2426) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.69% (0.2463 => 0.4007, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.46% (0.0254 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.63% (0.0302 => 0.0319, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.02% (0.0384 => 0.0434, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.77% (0.1438 => 0.1521, std.dev.: 0.0113) MultiSource/Applications/lemon/lemon: 5.83% (1.1329 => 1.1989, std.dev.: 0.1053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.66% (0.4164 => 0.4941, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.87% (0.1369 => 0.1463, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 53.04% (0.0641 => 0.0981, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.64% (0.0195 => 0.0245, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.00% (0.0578 => 0.0630, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.17% (1.1437 => 1.2829, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.14% (0.0014 => 0.0013, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.56% (0.0180 => 0.0271, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: 245.60% (0.8017 => 2.7707, std.dev.: 0.0143) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 6.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 14:50:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 16:50:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130101225050.198502A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7278?compare_to=7274&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7278, Order: 171349, Start Time: 2013-01-01 20:37:03, End Time: 2013-01-01 22:51:00 To: 7274, Order: 171348, Start Time: 2013-01-01 17:21:29, End Time: 2013-01-01 19:35:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 3 (64 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.54% (55.7275 => 56.5847, std.dev.: 0.1826) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.28% (11.3330 => 11.1876, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.02% (2.3993 => 2.3748, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.33% (80.9278 => 79.8549, std.dev.: 0.2139) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0689 => 0.0689, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8535 => 499.8410, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44223.93% (1.1277 => 499.8410, std.dev.: 0.0124) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.29% (0.5229 => 1.6539, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 19.77% (14.9895 => 17.9536, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 53.57% (14.1553 => 21.7377, std.dev.: 0.0236) MultiSource/Benchmarks/MallocBench/gs/gs: 17.04% (4.1105 => 4.8109, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.67% (1.1048 => 1.7419, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1223.68% (7.1582 => 94.7519, std.dev.: 0.0264) SingleSource/Benchmarks/Misc-C++-EH/spirit: 124.12% (3.4629 => 7.7611, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.05% (0.6222 => 1.1016, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.39% (0.0720 => 7.4422, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: 3831300.00% (0.0001 => 3.8314, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11139300.00% (0.0001 => 11.1394, std.dev.: 0.0812) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64400.00% (0.0001 => 0.0645, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577500.00% (0.0001 => 0.5776, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959500.00% (0.0001 => 9.9596, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5509300.00% (0.0001 => 5.5094, std.dev.: 0.0153) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.54% (1.1194 => 10.3381, std.dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: 149.28% (22.1758 => 55.2789, std.dev.: 0.0402) SingleSource/Benchmarks/Misc/lowercase: 101.56% (0.0256 => 0.0516, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 83.85% (0.0929 => 0.1708, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536) MultiSource/Benchmarks/FreeBench/neural/neural: 58.78% (0.1463 => 0.2323, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 58.67% (0.0271 => 0.0430, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.98% (2.9384 => 4.6420, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.32% (7.0540 => 10.9560, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.48% (1.5859 => 2.4023, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.98% (8.1363 => 11.9586, std.dev.: 0.0090) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 41.27% (0.1432 => 0.2023, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.23% (0.0439 => 0.0620) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.98% (2.2024 => 3.1050, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 40.69% (21.9371 => 30.8631, std.dev.: 0.0058) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.77% (0.1062 => 0.1410, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.73% (0.6675 => 0.8860, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.25% (1.5415 => 2.0387, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 31.23% (0.3109 => 0.4080, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 30.70% (0.5105 => 0.6672, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.53% (0.4615 => 0.6024, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 30.17% (0.4299 => 0.5596, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.52% (4.2646 => 5.5237, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: 29.52% (0.4289 => 0.5555, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 28.62% (0.0814 => 0.1047, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 27.64% (0.4620 => 0.5897, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 27.30% (1.1642 => 1.4820, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.27% (0.1584 => 0.2016, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.21% (0.0746 => 0.0949, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 26.26% (1.0722 => 1.3538, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 25.37% (0.2554 => 0.3202, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.14% (0.2271 => 0.2842, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.63% (3.8922 => 4.8508, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 24.52% (0.1892 => 0.2356, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 24.10% (0.6456 => 0.8012, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.87% (0.1906 => 0.2361, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: 23.71% (0.0485 => 0.0600, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 23.37% (0.0719 => 0.0887) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.00% (1.4186 => 1.7449, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.51% (0.1337 => 0.1638, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.33% (0.3121 => 0.3818, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 21.96% (9.4845 => 11.5670, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/dot-syntax-1: 21.92% (0.0479 => 0.0584, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.82% (0.0793 => 0.0966, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 21.39% (0.1655 => 0.2009, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 21.37% (5.7591 => 6.9899, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 21.17% (0.3283 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.15% (0.2700 => 0.3271, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 21.12% (0.7115 => 0.8618, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.00% (0.1695 => 0.2051, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 20.76% (0.3232 => 0.3903, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.67% (1.3050 => 1.5747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.40% (0.7835 => 0.9433, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 20.19% (0.1555 => 0.1869, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.09% (0.0871 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.47% (4.9449 => 5.9076, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: 19.33% (0.0626 => 0.0747, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.20% (0.0672 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.06% (0.5860 => 0.6977, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.99% (5.0018 => 5.9517, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/15-trie/trie: 18.98% (0.0527 => 0.0627, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 18.88% (1.1840 => 1.4075, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.70% (0.1032 => 0.1225, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.66% (0.1163 => 0.1380, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.65% (0.8172 => 0.9696, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.65% (0.0842 => 0.0999, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 18.64% (3.3354 => 3.9572, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: 18.59% (0.3379 => 0.4007, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 18.58% (17.1811 => 20.3735, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.52% (0.0675 => 0.0800, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 18.43% (0.3423 => 0.4054, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0886 => 0.1044, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.78% (0.1940 => 0.2285, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.58% (0.5569 => 0.6548, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 17.50% (0.7433 => 0.8734, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.48% (0.1236 => 0.1452, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.45% (0.4636 => 0.5445, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.09% (0.5020 => 0.5878, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.09% (0.1510 => 0.1768, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.2107 => 0.2463, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 16.88% (0.1268 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.86% (0.2758 => 0.3223, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.66% (0.3307 => 0.3858, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.63% (2.2969 => 2.6789, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.44% (0.5981 => 0.6964, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 16.29% (2.0273 => 2.3576, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 16.18% (3.8723 => 4.4987, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.97% (0.0770 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.84% (0.2065 => 0.2392, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.68% (0.8101 => 0.9371, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.63% (0.6450 => 0.7458, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.62% (0.0730 => 0.0844, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.60% (0.8921 => 1.0313, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.43% (0.0933 => 0.1077, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.43% (0.3441 => 0.3972, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.03% (0.1144 => 0.1316) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.75% (0.0834 => 0.0957, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.33% (1.1861 => 1.3561, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 14.20% (0.2049 => 0.2340, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.15% (0.3180 => 0.3630, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1143 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.70% (0.3387 => 0.3851, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.22% (0.1044 => 0.1182, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.19% (0.8067 => 0.9131, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: 13.09% (1.5603 => 1.7646, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/Puzzle: 13.01% (0.1268 => 0.1433, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.57% (0.3865 => 0.4351, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 12.10% (0.3282 => 0.3679, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 11.77% (0.3092 => 0.3456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.49% (0.4203 => 0.4686, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.31% (14.3668 => 15.9918, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.04% (0.3098 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.02% (0.4048 => 0.4494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.02% (0.4103 => 0.4555, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.55% (0.3603 => 0.3983, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.53% (0.3427 => 0.3788, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.41% (0.2430 => 0.2683, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.32% (0.3826 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.18% (0.3684 => 0.4059, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.09% (0.4064 => 0.4474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.70% (0.3650 => 0.4004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.51% (0.2871 => 0.3144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.47% (0.2831 => 0.3099, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.6030 => 0.6583, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.04% (2.0665 => 2.2534, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.75% (63.2438 => 68.7767, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.70% (0.7326 => 0.7963, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 8.69% (1.2842 => 1.3958, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 8.55% (0.2725 => 0.2958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.52% (0.2793 => 0.3031, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.40% (0.2905 => 0.3149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.31% (0.2877 => 0.3116, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 7.99% (0.3052 => 0.3296, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2802 => 0.3025, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.91% (10.3673 => 11.1876, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.84% (2.2022 => 2.3748, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3935 => 0.4240, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.43% (0.3177 => 0.3413, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.28% (0.4879 => 0.5234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.58% (0.3131 => 0.3337, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (7.9617 => 8.2175, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.69% (32.5116 => 59.0711, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.09% (1.1145 => 1.2938, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3794, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4564, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 5.35% (3.1578 => 3.3269, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.55% (2.0360 => 2.1082, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.6802 => 8.9213, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7111, std.dev.: 0.0106) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (0.6533 => 0.6658, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8444 => 28.3444, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.49% (1.7254 => 1.7511, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.27% (4.4649 => 4.5217, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2213, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1701, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.09% (5.2763 => 1.2087, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -74.99% (0.8651 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.79% (5.3855 => 4.4815, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.22% (5.3526 => 4.4846, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -12.99% (10.4361 => 9.0809, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9437, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.21% (1.7609 => 1.6515, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.00% (1.9577 => 0.6656, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.11% (8.0499 => 4.0162, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.75% (0.0506 => 0.0315) SingleSource/Benchmarks/Misc/mandel-2: -33.59% (1.5373 => 1.0209, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.81% (10.7105 => 7.4107, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.7993, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0039, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3709, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.28% (2.5528 => 2.1373, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -11.54% (1.2373 => 1.0945, std.dev.: 0.0037) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5014, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2875, std.dev.: 0.0177) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.64% (1.6805 => 1.5857, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.70% (8.1563 => 7.7730, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/salsa20: -4.50% (10.2830 => 9.8207, std.dev.: 0.0147) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0068) MultiSource/Applications/sgefa/sgefa: -3.47% (0.6223 => 0.6007, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.00% (1.0554 => 1.0343, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.6441 => 4.5888, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0176) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0010) Report Time: 4.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 14:55:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 16:55:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130101225508.6FFF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7279?compare_to=7272&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7279, Order: 171348, Start Time: 2013-01-01 19:22:09, End Time: 2013-01-01 22:55:17 To: 7272, Order: 171343, Start Time: 2013-01-01 14:58:19, End Time: 2013-01-01 18:31:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1101 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.89% (0.2953 => 0.3068, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.16% (11.6398 => 21.2031, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.47% (0.5361 => 0.8281, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.36% (0.0625 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.34% (0.1063 => 0.1428, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.13% (0.0714 => 0.0922, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.39% (0.2969 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.16% (0.7426 => 0.9443, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 27.12% (1.5932 => 2.0253, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.91% (0.4139 => 0.5253, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.54% (0.5900 => 0.7466, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.01% (0.4994 => 0.6293, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.79% (0.4253 => 0.5350, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.59% (0.0547 => 0.0687, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.20% (0.5000 => 0.6260, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.75% (0.1620 => 0.2021, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.85% (0.1107 => 0.1371, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780) MultiSource/Benchmarks/Olden/em3d/em3d: 23.21% (0.0948 => 0.1168, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.67% (0.1103 => 0.1353, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.37% (0.0541 => 0.0662, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.03% (0.3903 => 0.4763, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.45% (0.1462 => 0.1761, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.33% (0.3271 => 0.3936, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.31% (0.3890 => 0.4680, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 20.30% (0.0808 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.11% (0.2014 => 0.2419, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.03% (0.2866 => 0.3440, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.87% (0.1968 => 0.2359, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.86% (0.4029 => 0.4829, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.74% (0.2736 => 0.3276, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.55% (1.3152 => 1.5723, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 19.53% (0.1505 => 0.1799, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.18% (3.5627 => 4.2460, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.02% (4.4195 => 5.2602, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.94% (0.4658 => 0.5540, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 18.90% (0.5826 => 0.6927, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.72% (0.5546 => 0.6584, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 18.63% (1.8794 => 2.2295, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.58% (0.5889 => 0.6983, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.47% (1.6211 => 1.9205, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.30% (0.5026 => 0.5946, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 18.06% (0.9697 => 1.1448, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.77% (0.2875 => 0.3386, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.68% (0.3930 => 0.4625, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.58% (2.7292 => 3.2089, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.52% (0.4361 => 0.5125, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 17.44% (1.0781 => 1.2661, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.36% (0.0605 => 0.0710) SingleSource/Benchmarks/Shootout-C++/strcat: 17.27% (0.2750 => 0.3225, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.25% (0.1090 => 0.1278, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: 17.25% (0.2725 => 0.3195, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2813 => 0.3298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.23% (0.2792 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 17.20% (0.2803 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.17% (0.2714 => 0.3180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.13% (0.2738 => 0.3207, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.07% (0.2823 => 0.3305, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.04% (0.3004 => 0.3516, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.98% (4.2109 => 4.9259, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.97% (0.2911 => 0.3405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.97% (0.2811 => 0.3288, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.97% (0.2729 => 0.3192, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.93% (2.0673 => 2.4172, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.91% (1.9694 => 2.3024, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 16.86% (0.9909 => 1.1580, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.74% (0.3195 => 0.3730, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.71% (1.9966 => 2.3302, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.57% (0.7171 => 0.8359, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 16.47% (0.3096 => 0.3606, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 16.39% (0.2075 => 0.2415, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.29% (4.6926 => 5.4570, std.dev.: 0.0111) MultiSource/Benchmarks/Bullet/bullet: 16.24% (23.5202 => 27.3396, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.08% (0.3060 => 0.3552, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.97% (0.3469 => 0.4023, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.96% (0.3465 => 0.4018, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.95% (0.3442 => 0.3991, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.93% (0.3446 => 0.3995, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.88% (0.3124 => 0.3620, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.86% (0.3267 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.85% (0.3488 => 0.4041, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.80% (0.3317 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.79% (0.3477 => 0.4026, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3258 => 0.3771, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.63% (0.3282 => 0.3795, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.59% (0.3362 => 0.3886, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.51% (0.2566 => 0.2964, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 15.44% (0.3678 => 0.4246, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 15.29% (0.3643 => 0.4200, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.20% (0.3724 => 0.4290, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.19% (0.3726 => 0.4292, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 15.15% (0.4146 => 0.4774, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 15.08% (1.4269 => 1.6421, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.90% (0.3625 => 0.4165, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.78% (2.1653 => 2.4853, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 14.76% (0.7875 => 0.9037, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.75% (0.3981 => 0.4568, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 14.63% (0.4251 => 0.4873, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.59% (0.3845 => 0.4406, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 14.48% (2.1013 => 2.4055, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 14.31% (4.6177 => 5.2786, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 14.27% (0.2691 => 0.3075, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.89% (0.5012 => 0.5708, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.38% (0.6435 => 0.7296, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 13.02% (0.4847 => 0.5478, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.74% (0.3084 => 0.3477, std.dev.: 0.0128) MultiSource/Applications/SPASS/SPASS: 12.65% (5.5417 => 6.2426, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 12.44% (0.3498 => 0.3933, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.23% (0.2068 => 0.2321, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 12.06% (2.0346 => 2.2800, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.06% (0.2737 => 0.3067, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.89% (0.6634 => 0.7423, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 11.78% (0.3336 => 0.3729, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.84% (0.2103 => 0.2331, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.54% (0.2391 => 0.2643, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 10.02% (11.9555 => 13.1538, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.01% (0.5584 => 0.6087, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.46% (0.3792 => 0.4037, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.80% (29.0505 => 181.5084, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.91% (0.3693 => 0.3985, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2364, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6891, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3039, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0814, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2071, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5982, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4813, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5984, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.33% (17.2379 => 14.0788, std.dev.: 0.1280) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9739, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7985, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -4.38% (14.0481 => 13.4324, std.dev.: 0.2291) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2199, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.37% (0.6293 => 0.6144, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1604, std.dev.: 0.0521) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1350, std.dev.: 0.1029) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0480, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 16:10:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 18:10:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102001002.23D342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7280?compare_to=7276&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7280, Order: 171351, Start Time: 2013-01-01 22:33:14, End Time: 2013-01-02 00:09:54 To: 7276, Order: 171349, Start Time: 2013-01-01 20:30:55, End Time: 2013-01-01 22:07:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (830 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.25% (22.4056 => 78.9232, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.04% (0.0717 => 0.1126, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.83% (0.0974 => 0.1508, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 34.67% (0.1500 => 0.2020, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.44% (1.6474 => 2.0994, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.75% (0.0699 => 0.0851, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.30% (5.4682 => 6.6332, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.66% (2.2587 => 2.7028, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.65% (0.0680 => 0.0800, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.62% (0.6395 => 0.7394, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.34% (1.1450 => 1.3207, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.06% (0.6395 => 0.7294, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.08% (0.6260 => 0.7079, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.09% (0.5941 => 0.6659, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.04% (0.1146 => 0.1284, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 11.80% (0.4524 => 0.5058, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.75% (0.5805 => 0.6487, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.36% (0.6230 => 0.6938, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.7021 => 0.7811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.22% (0.6033 => 0.6710, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.15% (0.5849 => 0.6501, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.96% (0.5456 => 0.6054, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.79% (0.6440 => 0.7135, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.67% (0.5688 => 0.6295, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.44% (0.5575 => 0.6157, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.41% (0.6676 => 0.7371, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.38% (0.5567 => 0.6145, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 10.37% (0.4861 => 0.5365, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.36% (0.5925 => 0.6539, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.20% (1.6364 => 1.8033, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.20% (0.5581 => 0.6150, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.10% (0.5802 => 0.6388, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 9.88% (0.4515 => 0.4961, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.69% (0.5859 => 0.6427, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.62% (0.4916 => 0.5389, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.55% (0.6052 => 0.6630, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.53% (0.5857 => 0.6415, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.23% (0.1982 => 0.2165, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.22% (0.6446 => 0.7040, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.13% (0.6189 => 0.6754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.98% (0.5570 => 0.6070, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.87% (0.5478 => 0.5964, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.87% (0.5569 => 0.6063, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.87% (0.5705 => 0.6211, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.87% (0.6304 => 0.6863, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.86% (3.5339 => 3.8469, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.5329 => 0.5800, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.78% (0.5591 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.38% (0.6660 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.08% (0.5863 => 0.6337, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (4.5069 => 4.8579, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.78% (0.6194 => 0.6676, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.59% (0.6681 => 0.7188, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.56% (0.6297 => 0.6773, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 7.36% (0.3357 => 0.3604, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.31% (0.7524 => 0.8074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 7.14% (0.3446 => 0.3692, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.12% (0.6667 => 0.7142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3394 => 0.3625) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.2001 => 0.2134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.40% (0.6750 => 0.7182, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (0.7339 => 0.7807, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.60% (1.4642 => 1.5462, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.37% (0.3481 => 0.3668, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 5.12% (18.2933 => 19.2302, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2385 => 0.2507, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.08% (9.2283 => 9.6971, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 5.00% (1.2515 => 1.3141, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.91% (1.2784 => 1.3412, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.91% (5.0226 => 5.1689, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: 2.76% (17.1032 => 17.5744, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.9557 => 0.9776, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (1.3864 => 1.4129, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.91% (31.3723 => 55.5006, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9531 => 1.0288, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.67% (5.1955 => 5.4379, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.77% (11.6767 => 12.1167, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5789, std.dev.: 0.0686) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3183, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.30% (79.7170 => 80.7511, std.dev.: 0.1205) MultiSource/Applications/viterbi/viterbi: 1.11% (4.4335 => 4.4829, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.60% (0.2428 => 0.2292, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.68% (0.3142 => 0.2995, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.61% (0.9852 => 0.9398, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.43% (0.3658 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.34% (0.9542 => 0.9128, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.07% (0.6484 => 0.6220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.62% (0.3837 => 0.3698, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.56% (0.6347 => 0.6121, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3848 => 0.3711, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3831 => 0.3695, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.7198 => 0.6945, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: -3.51% (0.3880 => 0.3744, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.4176 => 0.4030, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.49% (2.4924 => 2.4053, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -3.47% (4.3330 => 4.1825, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2707, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.32% (0.4033 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.28% (0.7779 => 0.7524, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -3.11% (0.7982 => 0.7734, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -3.08% (20.7746 => 20.1341, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.05% (0.4321 => 0.4189, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3884 => 0.3767, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.95% (2.1713 => 2.1073, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.93% (0.3931 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.80% (1.2210 => 1.1868, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.77% (1.2221 => 1.1882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.62% (1.2300 => 1.1978, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.62% (1.0544 => 1.0268, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.61% (0.3867 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8506, std.dev.: 0.0153) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6079, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: -2.39% (7.0961 => 6.9268, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.32% (0.8521 => 0.8323, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -2.16% (4.0594 => 3.9719, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8451, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -2.05% (34.0927 => 33.3925, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/football/football: -1.86% (0.9179 => 0.9008, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.73% (0.5999 => 0.5895, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.66% (0.9077 => 0.8926, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -1.56% (1.5610 => 1.5367, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -1.53% (2.4021 => 2.3654, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -1.44% (2.1401 => 2.1092, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.0126 => 7.9236, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -1.11% (15.2527 => 15.0836, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.06% (4.0323 => 3.9895, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.05% (4.8802 => 4.8289, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.08% (1.8100 => 0.6864, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.89% (8.0445 => 4.0307, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.57% (0.1622 => 0.1110, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.99% (0.1983 => 0.1428, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0236, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.48% (0.2274 => 0.1740, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0337, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1993, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1835, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -18.85% (3.3454 => 2.7149, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.23% (1.2237 => 1.0006, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.72% (2.5106 => 2.1159, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3588, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.29% (0.5142 => 0.4613, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6339, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8216, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9083, std.dev.: 0.0230) SingleSource/Benchmarks/McGill/chomp: -5.27% (1.1594 => 1.0983, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -4.75% (0.6299 => 0.6000, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.70% (1.7753 => 1.6918, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (7.9763 => 7.7426, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2274, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7008, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1977, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5998, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -1.29% (3.7241 => 3.6759, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.26% (4.8776 => 4.8161, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.01% (1.6307 => 1.6143, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 5.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 16:41:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 18:41:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102004143.95D022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7281?compare_to=7277&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7281, Order: 171351, Start Time: 2013-01-01 22:45:56, End Time: 2013-01-02 00:42:02 To: 7277, Order: 171349, Start Time: 2013-01-01 20:26:56, End Time: 2013-01-01 22:26:38 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 8 (222 on baseline) Performance Improvements: 38 (51 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1014 (703 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.74% (73.2827 => 76.0226, std.dev.: 0.8030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 6.66% (2.2873 => 2.4397, std.dev.: 0.0327) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.87% (13.9517 => 14.7706, std.dev.: 0.1496) SingleSource/Benchmarks/Misc/pi: 5.02% (2.1075 => 2.2132, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.16% (1.8506 => 1.9276, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/fldry: 3.19% (0.6606 => 0.6817, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.58% (5.5414 => 5.6291, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/random: 1.57% (2.4369 => 2.4752, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -12.25% (0.0996 => 0.0874, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2084 => 0.1983, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.47% (1.5244 => 1.4563, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.40% (0.9592 => 0.9170, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.94% (1.2932 => 1.2423, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.89% (1.3624 => 1.3094, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -3.10% (0.8863 => 0.8588, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.05% (1.9021 => 1.8441, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -3.02% (1.5673 => 1.5199, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.70% (5.0122 => 4.8771, std.dev.: 0.0470) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.59% (0.8292 => 0.8077, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.58% (4.9161 => 4.7891, std.dev.: 0.0444) MultiSource/Benchmarks/nbench/nbench: -2.42% (1.2959 => 1.2645, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.35% (1.2787 => 1.2487, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -2.09% (1.0386 => 1.0169, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.76% (1.2903 => 1.2676, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.71% (1.4261 => 1.4017, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: -1.58% (16.5771 => 16.3145, std.dev.: 0.0502) SingleSource/Benchmarks/Misc-C++/bigfib: -1.52% (0.7116 => 0.7008, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.46% (1.0598 => 1.0443, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.41% (1.2939 => 1.2756, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.40% (15.0590 => 14.8482, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.39% (1.3368 => 1.3182, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.39% (1.1444 => 1.1285, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.20% (1.2442 => 1.2293, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.13% (1.4201 => 1.4040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.10% (1.3057 => 1.2913, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.04% (1.1495 => 1.1375, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -1.04% (7.3790 => 7.3020, std.dev.: 0.0259) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.02% (4.3268 => 4.2826, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (6.5380 => 6.4720, std.dev.: 0.0244) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -12.66% (4.2553 => 3.7167, std.dev.: 0.0980) MultiSource/Applications/SPASS/SPASS: -6.24% (8.8254 => 8.2743, std.dev.: 0.1494) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.40% (0.3647 => 0.3450, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.11% (2.7343 => 2.5946, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.84% (42.2502 => 41.0500, std.dev.: 0.3630) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.73% (4.0502 => 3.9801, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.12% (22.1525 => 21.9040, std.dev.: 0.0486) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.38% (1.1439 => 1.1395, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.55% (0.4007 => 0.3985, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0431 => 0.0430, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.86% (0.0339 => 0.0292, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0319 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0434 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0219 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -30.68% (0.0251 => 0.0174, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.66% (0.1521 => 0.1511, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -4.21% (1.1989 => 1.1484, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -21.55% (0.4941 => 0.3876, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.48% (0.1463 => 0.1470, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.91% (0.0981 => 0.0923, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.57% (0.0245 => 0.0224, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.35% (0.0630 => 0.0590, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.2829 => 1.2820, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0013 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.69% (0.0607 => 0.0530, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.89% (0.0271 => 0.0190, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (2.7707 => 2.7634, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.80% (0.0051 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.07% (31.2466 => 31.2238, std.dev.: 0.2496) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.27% (16.4461 => 19.9440, std.dev.: 0.1587) MultiSource/Applications/sqlite3/sqlite3: 3506.46% (0.6332 => 22.8361, std.dev.: 0.3506) MultiSource/Benchmarks/McCat/08-main/main: 55.65% (0.1831 => 0.2850, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.63% (0.1559 => 0.1518, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 24242.81% (0.3123 => 76.0226, std.dev.: 0.8030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1835.41% (0.3344 => 6.4720, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.93% (0.2364 => 0.3308, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: 16.61% (0.6010 => 0.7008, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: 6.53% (0.0429 => 0.0457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.82% (0.3266 => 0.3456, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 0.71% (0.1969 => 0.1983, std.dev.: 0.0032) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: -24.78% (0.0230 => 0.0173, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0463, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 10.19% (0.1462 => 0.1611, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3992, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0704, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5299, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5231, std.dev.: 0.0806) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0479, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3370, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3746, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0846, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: -29.99% (2.1832 => 1.5285, std.dev.: 0.0046) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 141.37% (0.0249 => 0.0601, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 94.80% (0.0250 => 0.0487, std.dev.: 0.0028) SingleSource/Regression/C/sumarray: 66.95% (0.0233 => 0.0389, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/factor: 63.97% (0.0297 => 0.0487, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 62.85% (0.1440 => 0.2345, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 60.15% (0.8359 => 1.3387, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.57% (0.8261 => 1.3182, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 59.47% (0.8066 => 1.2863, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.45% (0.8805 => 1.4040, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.42% (0.8611 => 1.3728, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.14% (0.7932 => 1.2623, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 58.50% (0.8048 => 1.2756, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 58.31% (0.8007 => 1.2676, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 58.19% (0.8457 => 1.3378, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.15% (0.8316 => 1.3152, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 57.92% (0.8177 => 1.2913, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.04% (0.8338 => 1.3094, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.50% (0.8597 => 1.3454, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 55.72% (0.8885 => 1.3836, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.56% (0.8716 => 1.3559, std.dev.: 0.0059) SingleSource/UnitTests/SignlessTypes/shr: 54.97% (0.0191 => 0.0296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.57% (0.9056 => 1.3998, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.54% (1.5315 => 2.3668, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.36% (0.9039 => 1.3953, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.77% (0.9688 => 1.4703, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/ary3: 43.40% (0.0235 => 0.0337, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.03% (2.1401 => 3.0182, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 40.18% (0.0784 => 0.1099, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 34.60% (0.0734 => 0.0988, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 34.54% (3.1832 => 4.2826, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.18% (0.0550 => 0.0727, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 29.93% (0.0421 => 0.0547, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.45% (0.0635 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.35% (0.1983 => 0.2565, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 29.08% (0.0650 => 0.0839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 28.91% (0.8855 => 1.1415, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.29% (0.2180 => 0.2775, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.15% (0.8286 => 1.0536, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.26% (0.8712 => 1.1000, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.08% (0.8086 => 1.0195, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.99% (0.8069 => 1.0166, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.81% (0.8050 => 1.0128, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.75% (0.8331 => 1.0476, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.74% (0.8697 => 1.0936, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.69% (0.8518 => 1.0706, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.67% (0.8204 => 1.0310, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.65% (0.7966 => 1.0009, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.56% (0.8317 => 1.0443, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 25.38% (0.2999 => 0.3760, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.36% (0.9074 => 1.1375, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 25.24% (0.8656 => 1.0841, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.14% (0.8420 => 1.0537, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.47% (0.8927 => 1.1111, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.43% (0.9069 => 1.1285, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 24.14% (0.1839 => 0.2283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.9908 => 1.2293, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 23.25% (0.0757 => 0.0933, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.75% (0.0989 => 0.1214, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.64% (0.6586 => 0.8077, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 22.21% (1.0945 => 1.3376, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.45% (4.4880 => 5.4506, std.dev.: 0.0352) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.99% (0.0810 => 0.0980, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.92% (0.0822 => 0.0994, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.66% (0.0668 => 0.0806, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.54% (0.0701 => 0.0845, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 20.26% (0.1565 => 0.1882, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 20.13% (0.3800 => 0.4565, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.05% (0.4783 => 0.5742, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.87% (0.0848 => 0.1008, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 18.52% (2.3764 => 2.8164, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.50% (1.3279 => 1.5736, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash2: 17.99% (0.4125 => 0.4867, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: 17.90% (8.6247 => 10.1682, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/tsp/tsp: 17.63% (0.1112 => 0.1308, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.80% (0.5191 => 0.6063, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.27% (0.1137 => 0.1322, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.26% (1.2526 => 1.4563, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.11% (0.0745 => 0.0865, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.80% (0.1778 => 0.2059, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 15.66% (0.2427 => 0.2807, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.30% (0.1157 => 0.1334, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.27% (0.2227 => 0.2567, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 15.15% (0.2390 => 0.2752, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.14% (0.3137 => 0.3612, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.83% (0.4127 => 0.4739, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 14.69% (0.4397 => 0.5043, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 14.69% (0.0708 => 0.0812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.67% (0.2509 => 0.2877, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 14.54% (1.2222 => 1.3999, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.54% (0.3295 => 0.3774, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 14.40% (14.2605 => 16.3145, std.dev.: 0.0502) MultiSource/Applications/SIBsim4/SIBsim4: 14.39% (1.2568 => 1.4376, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: 14.19% (0.8768 => 1.0012, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.09% (0.0717 => 0.0818, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.05% (0.1466 => 0.1672, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 13.34% (0.0937 => 0.1062, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 12.91% (0.1425 => 0.1609, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 12.84% (4.9628 => 5.6002, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.66% (0.7473 => 0.8419, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.65% (13.1811 => 14.8482, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.54% (1.6386 => 1.8441, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.42% (0.0829 => 0.0932, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 12.19% (1.1271 => 1.2645, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.12% (0.1097 => 0.1230, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 12.08% (0.9435 => 1.0575, std.dev.: 0.0079) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.82% (0.1091 => 0.1220, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.67% (0.1885 => 0.2105, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.62% (0.1756 => 0.1960, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 11.53% (0.3226 => 0.3598, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.43% (0.6010 => 0.6697, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.23% (1.2602 => 1.4017, std.dev.: 0.0084) MultiSource/Applications/minisat/minisat: 11.03% (0.6834 => 0.7588, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 10.75% (15.3280 => 16.9751, std.dev.: 0.0275) MultiSource/Applications/d/make_dparser: 10.49% (3.2366 => 3.5760, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.39% (0.1905 => 0.2103, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 10.13% (0.4847 => 0.5338, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/health/health: 10.10% (0.1347 => 0.1483, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.01% (4.1763 => 4.5943, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.95% (0.8340 => 0.9170, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.69% (0.2240 => 0.2457, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.65% (0.4559 => 0.4999, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 9.60% (0.1177 => 0.1290, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.57% (0.1150 => 0.1260, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.50% (2.2184 => 2.4292, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 9.47% (3.8189 => 4.1805, std.dev.: 0.0377) MultiSource/Benchmarks/Olden/power/power: 9.38% (0.1247 => 0.1364, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.30% (0.1183 => 0.1293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 9.29% (0.6287 => 0.6871, std.dev.: 0.0146) MultiSource/Applications/ClamAV/clamscan: 9.08% (14.7684 => 16.1100, std.dev.: 0.0327) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.06% (0.6227 => 0.6791, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.89% (0.2519 => 0.2743, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.83% (0.8321 => 0.9056, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.82% (0.3003 => 0.3268, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.78% (1.1170 => 1.2151, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.61% (0.3717 => 0.4037, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 8.47% (6.7320 => 7.3020, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.36% (0.8148 => 0.8829, std.dev.: 0.0154) MultiSource/Applications/treecc/treecc: 8.28% (1.9948 => 2.1599, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.25% (8.6476 => 9.3611, std.dev.: 0.1124) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.14% (0.5961 => 0.6446, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.12% (0.3115 => 0.3368, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 8.03% (0.7950 => 0.8588, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.55% (0.2794 => 0.3005, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 7.48% (0.5817 => 0.6252, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.37% (0.2998 => 0.3219, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.15% (0.2378 => 0.2548, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.04% (1.1606 => 1.2423, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.99% (6.6074 => 7.0694, std.dev.: 0.0222) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.86% (1.1685 => 1.2487, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 6.77% (0.2985 => 0.3187, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.73% (4.4873 => 4.7891, std.dev.: 0.0444) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.72% (4.5702 => 4.8771, std.dev.: 0.0470) MultiSource/Benchmarks/MallocBench/gs/gs: 6.53% (4.1305 => 4.4003, std.dev.: 0.0684) MultiSource/Applications/hbd/hbd: 6.52% (1.4269 => 1.5199, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.41% (0.2279 => 0.2425, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/em3d/em3d: 5.93% (0.1721 => 0.1823, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.83% (0.8995 => 0.9519, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/18-imp/imp: 5.80% (0.3503 => 0.3706, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.72% (0.2133 => 0.2255, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.55% (0.2741 => 0.2893, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 5.51% (0.2088 => 0.2203, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.34% (0.2844 => 0.2996, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 5.28% (31.8598 => 33.5428, std.dev.: 0.1414) SingleSource/UnitTests/Vector/constpool: 4.60% (8.4179 => 8.8055, std.dev.: 0.0771) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.22% (0.6943 => 0.7236, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.19% (0.3124 => 0.3255, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 3.97% (0.2969 => 0.3087, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 3.71% (0.7557 => 0.7837, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: 3.66% (0.9810 => 1.0169, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 3.57% (0.3645 => 0.3775, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.55% (0.3657 => 0.3787, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 3.52% (0.3263 => 0.3378, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.15% (1.4479 => 1.4935, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.98% (1.2423 => 1.2793, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1506100.00% (0.0001 => 1.5062, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 373.86% (0.3585 => 1.6988, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 362.30% (1.5671 => 7.2447, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/ary3: 306.10% (2.0949 => 8.5073, std.dev.: 0.0860) MultiSource/Benchmarks/PAQ8p/paq8p: 282.62% (91.7701 => 351.1323, std.dev.: 1.7797) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.31% (28.5821 => 85.5481, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.58% (5.1305 => 14.0358, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/ary2: 119.20% (0.0125 => 0.0274, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 114.67% (1.1365 => 2.4397, std.dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/ary: 106.85% (0.0219 => 0.0453, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 60.45% (2.8760 => 4.6144, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 52.65% (0.0226 => 0.0345, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 40.12% (1.5795 => 2.2132, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.24% (2.7995 => 3.8980, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 38.86% (1.3882 => 1.9276, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.11% (4.5327 => 5.9428, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.72% (2.9096 => 3.7160, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/misr: 19.20% (0.4001 => 0.4769, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.90% (4.7794 => 5.5869, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 15.05% (0.7597 => 0.8740, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/salsa20: 14.23% (7.5003 => 8.5677, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.04% (1.1857 => 1.3048, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 9.05% (3.1873 => 3.4758, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3186 => 0.3450, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 7.77% (8.5322 => 9.1948, std.dev.: 0.0166) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.37% (23.5781 => 25.3152, std.dev.: 0.0298) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.88% (3.9006 => 4.1690, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.64% (4.9686 => 5.2487, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.41% (4.8436 => 5.1056, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.29% (3.5679 => 3.7566, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.95% (0.5214 => 0.5472, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.88% (0.6150 => 0.6450, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 4.86% (3.8206 => 4.0062, std.dev.: 0.0613) MultiSource/Applications/aha/aha: 4.84% (3.3398 => 3.5016, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 4.73% (6.7064 => 7.0234, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.67% (6.1706 => 6.4585, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: 3.78% (1.3037 => 1.3530, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: 3.32% (1.2061 => 1.2462, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.19% (4.2466 => 4.3822, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.10% (1.2337 => 1.2719, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/queens: 3.01% (1.7056 => 1.7570, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.11% (3.4104 => 3.4825, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: 1.97% (0.5081 => 0.5181, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/methcall: 1.84% (8.2676 => 8.4199, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/bh/bh: 1.61% (2.3560 => 2.3939, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.55% (1.9302 => 1.9601, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: 1.07% (0.9842 => 0.9947, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.20% (2.8951 => 0.8339, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.52% (11.5316 => 4.6684, std.dev.: 0.0446) SingleSource/Benchmarks/Misc/fp-convert: -52.33% (15.8853 => 7.5729, std.dev.: 0.0497) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.53% (4.7482 => 3.0136, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.57% (5.4972 => 3.5970, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.60% (5.4300 => 3.6599, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: -30.38% (1.9999 => 1.3924, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.67% (5.6343 => 4.1319, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.50% (5.0261 => 3.9955, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.00% (5.0243 => 4.1702, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.01% (7.2130 => 6.2744, std.dev.: 0.3107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.95% (9.9065 => 8.7226, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: -10.14% (63.1822 => 56.7739, std.dev.: 0.0726) SingleSource/Benchmarks/McGill/chomp: -9.62% (1.1216 => 1.0137, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-8: -9.48% (2.5609 => 2.3182, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: -9.41% (5.1084 => 4.6279, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: -9.21% (5.4641 => 4.9611, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.19% (6.2275 => 5.6554, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.78% (3.7148 => 3.3888, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.24% (1.0512 => 0.9646, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.72% (3.2169 => 2.9685, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.52% (5.3218 => 4.9215, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.39% (4.3552 => 4.0333, std.dev.: 0.1134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.01% (6.3772 => 5.9303, std.dev.: 0.0803) SingleSource/Benchmarks/Stanford/FloatMM: -6.37% (0.8807 => 0.8246, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/sieve: -6.10% (7.0599 => 6.6290, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.03% (0.3269 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -5.61% (9.3748 => 8.8493, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.37% (4.9453 => 4.6798, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.28% (0.3937 => 0.3729, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.00% (2.8773 => 2.7622, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/methcall: -3.81% (8.9760 => 8.6344, std.dev.: 0.0361) SingleSource/Benchmarks/Misc/ffbench: -3.73% (1.4296 => 1.3763, std.dev.: 0.0202) MultiSource/Applications/lua/lua: -3.39% (29.8330 => 28.8231, std.dev.: 0.3241) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.35% (1.4529 => 1.4042, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.16% (5.1557 => 4.9928, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.93% (4.7449 => 4.6060, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.81% (4.9469 => 4.8081, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.69% (6.0224 => 5.8605, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/fbench: -2.52% (3.3840 => 3.2988, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.42% (2.6356 => 2.5719, std.dev.: 0.0180) MultiSource/Applications/siod/siod: -2.31% (3.6643 => 3.5796, std.dev.: 0.0195) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.19% (9.2989 => 9.0953, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/neural/neural: -1.92% (1.0841 => 1.0633, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.91% (4.8362 => 4.7436, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.83% (3.3479 => 3.2868, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.77% (22.2997 => 21.9040, std.dev.: 0.0486) SingleSource/Benchmarks/Misc/flops-5: -1.63% (2.8957 => 2.8486, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.36% (2.4490 => 2.4158, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-6: -1.33% (2.4416 => 2.4091, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.04% (4.9994 => 4.9475, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.04% (1.0262 => 1.1395, std.dev.: 0.0211) SingleSource/Benchmarks/CoyoteBench/fftbench: 61.79% (0.2463 => 0.3985, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.39% (0.0408 => 0.0430, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.96% (0.0254 => 0.0292, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.29% (0.0302 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.08% (0.1438 => 0.1511, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.37% (1.1329 => 1.1484, std.dev.: 0.0097) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.92% (0.4164 => 0.3876, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.38% (0.1369 => 0.1470, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 43.99% (0.0641 => 0.0923, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.87% (0.0195 => 0.0224, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.09% (1.1437 => 1.2820, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.47% (0.0627 => 0.0530, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.56% (0.0180 => 0.0190, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 244.69% (0.8017 => 2.7634, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 5.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 17:36:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 19:36:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102013600.1BB8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7282?compare_to=7278&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7282, Order: 171351, Start Time: 2013-01-01 23:21:57, End Time: 2013-01-02 01:36:06 To: 7278, Order: 171349, Start Time: 2013-01-01 20:37:03, End Time: 2013-01-01 22:51:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 3.01% (0.3818 => 0.3933, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.72% (0.0418 => 0.0415, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0689 => 0.0689, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8410 => 499.7781, std.dev.: 0.0375) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 44218.36% (1.1277 => 499.7781, std.dev.: 0.0375) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.56% (0.5229 => 1.6553, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: 20.10% (14.9895 => 18.0023, std.dev.: 0.0134) MultiSource/Applications/kimwitu++/kc: 54.36% (14.1553 => 21.8501, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 17.44% (4.1105 => 4.8275, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.93% (1.1048 => 1.7448, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1223.86% (7.1582 => 94.7643, std.dev.: 0.0615) SingleSource/Benchmarks/Misc-C++-EH/spirit: 124.92% (3.4629 => 7.7886, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.00% (0.6222 => 1.1013, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.47% (0.0720 => 7.4401, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3830200.00% (0.0001 => 3.8303, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11152600.00% (0.0001 => 11.1527, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 64400.00% (0.0001 => 0.0645, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577300.00% (0.0001 => 0.5774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9958900.00% (0.0001 => 9.9590, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5502900.00% (0.0001 => 5.5030, std.dev.: 0.0305) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.61% (1.1194 => 10.3277, std.dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: 149.21% (22.1758 => 55.2645, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.07% (0.0929 => 0.1710, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 83.13% (0.0243 => 0.0445, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 58.99% (0.1463 => 0.2326, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.55% (2.9384 => 4.6295, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.45% (7.0540 => 10.9653, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.84% (1.5859 => 2.4080, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/distray/distray: 50.76% (0.1056 => 0.1592, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 47.19% (0.0231 => 0.0340, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.07% (8.1363 => 11.9661, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.25% (2.2024 => 3.1109, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.23% (0.0439 => 0.0620, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 41.13% (0.1432 => 0.2021, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.79% (21.9371 => 30.8842, std.dev.: 0.0167) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.79% (0.6675 => 0.8864, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.67% (0.1062 => 0.1409) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.28% (1.5415 => 2.0391, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 31.55% (0.3109 => 0.4090, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 30.99% (0.5105 => 0.6687, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.75% (0.4615 => 0.6034, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.74% (4.2646 => 5.5330, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 29.63% (0.4299 => 0.5573, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 29.12% (0.0814 => 0.1051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 28.42% (0.4289 => 0.5508, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 27.79% (1.1642 => 1.4877, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.47% (0.1125 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 27.36% (0.4620 => 0.5884, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.08% (0.0746 => 0.0948, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.66% (1.0722 => 1.3581, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 26.51% (0.2554 => 0.3231, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.02% (0.3121 => 0.3933, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.69% (0.1892 => 0.2378, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.32% (0.2271 => 0.2846, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 25.14% (0.1555 => 0.1946, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (0.1566 => 0.1958, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.02% (0.1175 => 0.1469, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.86% (3.8922 => 4.8597, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 24.23% (0.6456 => 0.8020, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.98% (0.1906 => 0.2363, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.28% (1.4186 => 1.7489, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.80% (0.0886 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.37% (0.0675 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.36% (0.1337 => 0.1636, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 22.17% (5.7591 => 7.0361, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 21.98% (9.4845 => 11.5696, std.dev.: 0.0245) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.53% (0.1695 => 0.2060, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.22% (0.2700 => 0.3273, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.07% (0.7115 => 0.8614, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.93% (1.3050 => 1.5782, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bisort/bisort: 20.85% (0.0614 => 0.0742, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 20.83% (0.3283 => 0.3967, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.65% (0.7835 => 0.9453, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 20.48% (0.1655 => 0.1994, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 20.36% (0.3232 => 0.3890, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.19% (4.9449 => 5.9431, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 20.18% (0.1695 => 0.2037, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807) SingleSource/Benchmarks/Shootout/lists: 19.97% (0.0626 => 0.0751, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.61% (0.5860 => 0.7009, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.28% (5.0018 => 5.9662, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 19.18% (0.0662 => 0.0789, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 19.17% (0.0527 => 0.0628, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.16% (3.3354 => 3.9745, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 19.02% (1.1840 => 1.4092, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 18.86% (17.1811 => 20.4222, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.71% (0.1117 => 0.1326, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.42% (0.8172 => 0.9677, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.31% (0.2065 => 0.2443, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 18.26% (0.7433 => 0.8790, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 18.20% (0.3379 => 0.3994, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.18% (0.2107 => 0.2490, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 18.16% (0.1151 => 0.1360, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.09% (0.1940 => 0.2291, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.94% (0.1143 => 0.1348, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.83% (0.5020 => 0.5915, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.76% (0.3423 => 0.4031, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.74% (0.5569 => 0.6557, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.67% (0.0730 => 0.0859, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.31% (0.9765 => 1.1455, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 17.27% (2.2969 => 2.6935, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.21% (0.4636 => 0.5434, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.11% (0.2758 => 0.3230, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 17.03% (0.1268 => 0.1484, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 16.82% (2.0273 => 2.3683, std.dev.: 0.0081) MultiSource/Applications/lua/lua: 16.78% (3.8723 => 4.5220, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.69% (0.3307 => 0.3859, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.62% (0.5981 => 0.6975, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.6450 => 0.7500, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 15.82% (0.8921 => 1.0332, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.79% (0.8101 => 0.9380, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.66% (0.3441 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.65% (0.0933 => 0.1079, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.18% (1.1861 => 1.3662, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 14.72% (0.3180 => 0.3648, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.33% (0.2603 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 14.30% (0.2049 => 0.2342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.06% (0.8067 => 0.9201, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 13.82% (0.3387 => 0.3855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 13.20% (0.0818 => 0.0926, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.13% (1.5603 => 1.7651, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.29% (0.3865 => 0.4340, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.22% (0.3282 => 0.3683, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.09% (0.4103 => 0.4599, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.51% (14.3668 => 16.0209, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.42% (0.3092 => 0.3445, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.02% (0.4203 => 0.4666, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.97% (0.3098 => 0.3438, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.94% (0.3427 => 0.3802, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.82% (0.4048 => 0.4486, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.69% (0.3694 => 0.4089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.35% (0.3826 => 0.4222, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 10.32% (0.3603 => 0.3975, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.26% (0.3422 => 0.3773, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.18% (0.3684 => 0.4059, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.92% (0.4064 => 0.4467, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.42% (0.3650 => 0.3994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.11% (0.2831 => 0.3089, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 9.09% (0.2871 => 0.3132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.72% (63.2438 => 68.7568, std.dev.: 0.0080) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.61% (0.2905 => 0.3155, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7326 => 0.7952, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.53% (2.0665 => 2.2427, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 8.44% (10.3673 => 11.2426, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 8.41% (1.2842 => 1.3922, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.27% (0.2756 => 0.2984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.09% (0.2793 => 0.3019, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2877 => 0.3108, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (2.2022 => 2.3780, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.76% (0.2872 => 0.3095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.75% (0.2891 => 0.3115, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.50% (0.3052 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2802 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.34% (0.3935 => 0.4224, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.58% (0.3177 => 0.3386, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 6.32% (0.3131 => 0.3329, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.28% (7.9617 => 8.2229, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.66% (32.5116 => 59.0618, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6977, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: 9.07% (1.1396 => 1.2430, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3788, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (4.2280 => 4.4602, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (3.1578 => 3.3274, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.77% (0.9957 => 1.0332, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.62% (0.3316 => 0.3436, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (2.0360 => 2.1075, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9111, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.95% (3.6395 => 3.7103, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3419, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.57% (1.7254 => 1.7525, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.43% (4.4649 => 4.5287, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.17% (9.1159 => 9.2227, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5740, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1998, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.00% (0.8651 => 0.2163, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.75% (5.3855 => 4.4832, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.21% (5.3526 => 4.4852, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -12.91% (10.4361 => 9.0892, std.dev.: 0.0110) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9499, std.dev.: 0.0327) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.67% (1.7609 => 1.6435, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.91% (1.9577 => 0.6283, std.dev.: 0.0244) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.13% (8.0499 => 4.0147, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.97% (0.3987 => 0.2473, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.80% (10.7105 => 7.4120, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.7971, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0040, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -20.31% (0.2161 => 0.1722, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.26% (2.5528 => 2.1378, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2373 => 1.0900, std.dev.: 0.0064) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5008, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2742, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.66% (1.6805 => 1.5854, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.57% (8.1563 => 7.7835, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8410, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -1.99% (1.0554 => 1.0344, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3305, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.16% (4.6441 => 4.5902, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2302, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0008) Report Time: 7.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 19:21:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 21:21:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130102032130.139882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7283?compare_to=7279&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7283, Order: 171351, Start Time: 2013-01-01 23:47:48, End Time: 2013-01-02 03:20:57 To: 7279, Order: 171348, Start Time: 2013-01-01 19:22:09, End Time: 2013-01-01 22:55:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.24% (2.0201 => 2.0653, std.dev.: 0.0123) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.03% (2.0253 => 2.0044, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.50% (11.6398 => 21.2422, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.75% (0.5361 => 0.8296, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.15% (0.1063 => 0.1426, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.76% (0.2969 => 0.3823, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.71% (0.0714 => 0.0919, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.81% (0.7426 => 0.9491, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.76% (0.1106 => 0.1413, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.91% (0.4139 => 0.5253, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.66% (0.5900 => 0.7473, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.81% (1.5932 => 2.0044, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.69% (0.4994 => 0.6277, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.00% (0.5000 => 0.6250, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.90% (0.4253 => 0.5312, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.81% (0.1620 => 0.2022, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.03% (0.1107 => 0.1373, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 22.68% (0.0948 => 0.1163, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.32% (0.3903 => 0.4774, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 22.11% (0.1619 => 0.1977, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.08% (0.1549 => 0.1891, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.82% (0.1604 => 0.1954, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.12% (0.0947 => 0.1147, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.75% (0.2014 => 0.2432, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 20.67% (0.0808 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.57% (0.3890 => 0.4690, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.18% (0.4029 => 0.4842, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 20.01% (0.5826 => 0.6992, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.77% (0.2736 => 0.3277, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 19.71% (0.5889 => 0.7050, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.64% (0.2866 => 0.3429, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 19.47% (0.1505 => 0.1798, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.43% (1.3152 => 1.5707, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.26% (3.5627 => 4.2487, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.99% (4.4195 => 5.2589, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.90% (0.1968 => 0.2340, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 18.84% (0.9697 => 1.1524, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 18.73% (1.8794 => 2.2314, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 18.72% (0.5546 => 0.6584, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.70% (1.6211 => 1.9243, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.66% (0.4658 => 0.5527, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.56% (0.3271 => 0.3878, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.43% (0.2875 => 0.3405, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 18.28% (0.7171 => 0.8482, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.27% (0.5026 => 0.5944, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 18.11% (0.2750 => 0.3248, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714) SingleSource/Benchmarks/Shootout-C++/methcall: 17.95% (0.2813 => 0.3318, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 17.95% (0.2803 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.94% (0.2792 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.91% (0.2725 => 0.3213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.89% (0.2811 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.87% (0.1421 => 0.1675, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.86% (0.2738 => 0.3227, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 17.85% (0.2823 => 0.3327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.83% (0.2714 => 0.3198, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.83% (0.2911 => 0.3430, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.82% (0.4361 => 0.5138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.74% (0.2729 => 0.3213, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 17.68% (0.1284 => 0.1511, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.67% (2.7292 => 3.2114, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/matrix: 17.66% (0.2780 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.63% (0.3930 => 0.4623, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 17.58% (0.3004 => 0.3532, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.54% (2.0673 => 2.4299, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: 17.50% (0.9909 => 1.1643, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 17.34% (0.3096 => 0.3633, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.24% (1.0781 => 1.2640, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.21% (0.3195 => 0.3745, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.18% (4.2109 => 4.9344, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 17.02% (0.3267 => 0.3823, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.98% (1.9694 => 2.3039, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.86% (0.3060 => 0.3576, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 16.77% (23.5202 => 27.4653, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary: 16.73% (0.3258 => 0.3803, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.67% (1.9966 => 2.3295, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.65% (0.3124 => 0.3644, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.64% (4.6926 => 5.4736, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 16.52% (0.3317 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 16.24% (0.2075 => 0.2412, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.18% (0.3282 => 0.3813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.06% (0.3362 => 0.3902, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 15.96% (0.3678 => 0.4265, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 15.86% (0.3348 => 0.3879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.85% (0.3477 => 0.4028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.81% (0.3726 => 0.4315, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 15.64% (1.4269 => 1.6501, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.61% (0.3625 => 0.4191, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.45% (0.3981 => 0.4596, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.34% (0.3690 => 0.4256, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.32% (0.3446 => 0.3974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.32% (0.4146 => 0.4781, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.30% (0.3465 => 0.3995, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.22% (0.3469 => 0.3997, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.20% (0.3460 => 0.3986, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 15.17% (0.4251 => 0.4896, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.11% (0.3845 => 0.4426, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 14.97% (0.7875 => 0.9054, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 14.79% (0.3650 => 0.4190, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 14.75% (4.6177 => 5.2986, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/exceptions: 14.74% (0.3643 => 0.4180, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.69% (2.1653 => 2.4833, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 14.68% (0.2691 => 0.3086, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 14.66% (0.3724 => 0.4270, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.47% (0.5012 => 0.5737, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 14.32% (2.1013 => 2.4023, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.85% (0.6435 => 0.7326, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (0.4847 => 0.5488, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.20% (0.2068 => 0.2341, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 12.91% (5.5417 => 6.2572, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: 12.86% (0.3498 => 0.3948, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.81% (0.3084 => 0.3479, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.75% (0.2737 => 0.3086, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.51% (0.1383 => 0.1556, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.45% (0.1028 => 0.1156, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 12.24% (2.0346 => 2.2836, std.dev.: 0.0075) MultiSource/Applications/siod/siod: 12.12% (0.6634 => 0.7438, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 11.81% (0.3336 => 0.3730, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 11.00% (0.2391 => 0.2654, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 10.52% (11.9555 => 13.2136, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.63% (0.5584 => 0.6122, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.78% (0.3792 => 0.4011, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5180, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.45% (0.3693 => 0.4005, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2400, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6796, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8891, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2099, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3068, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0826, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4782, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5841, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.06% (17.2379 => 14.2963, std.dev.: 0.1545) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1018, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -10.28% (0.2402 => 0.2155, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2283, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std.dev.: 0.0161) SingleSource/Benchmarks/Dhrystone/dry: -3.23% (14.0481 => 13.5945, std.dev.: 0.1436) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1603, std.dev.: 0.0364) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.11% (0.6293 => 0.6160, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5783, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2003, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 3.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 19:47:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 21:47:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102034725.E6ECF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7284?compare_to=7280&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7284, Order: 171352, Start Time: 2013-01-02 02:10:53, End Time: 2013-01-02 03:47:15 To: 7280, Order: 171351, Start Time: 2013-01-01 22:33:14, End Time: 2013-01-02 00:09:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (114 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (831 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.04% (22.4056 => 78.8776, std.dev.: 0.0878) SingleSource/Benchmarks/Misc/lowercase: 64.29% (0.0280 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.04% (0.0717 => 0.1126, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.31% (0.0974 => 0.1503) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.55% (0.0599 => 0.0788, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.39% (1.6474 => 2.0986, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.60% (0.0699 => 0.0850, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.52% (0.0790 => 0.0960, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.30% (5.4682 => 6.6330, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.44% (2.2587 => 2.6979, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.53% (0.6395 => 0.7388, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.25% (1.1450 => 1.3196, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.95% (0.6395 => 0.7287, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.12% (0.6260 => 0.7081, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.27% (0.5941 => 0.6670, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.13% (0.1146 => 0.1285) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.51% (0.5805 => 0.6473, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.41% (0.6230 => 0.6941, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.7021 => 0.7811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.21% (0.6033 => 0.6709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.18% (0.4524 => 0.5030, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.10% (0.5849 => 0.6498, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.85% (0.5456 => 0.6048, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.70% (0.6440 => 0.7129, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.62% (0.5688 => 0.6292, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.62% (0.4916 => 0.5438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.38% (0.5567 => 0.6145, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.38% (0.5925 => 0.6540, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.31% (0.5575 => 0.6150, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.25% (0.5581 => 0.6153, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 10.22% (0.4861 => 0.5358, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.16% (0.6676 => 0.7354, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.08% (0.5802 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.06% (1.6364 => 1.8011, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 9.79% (0.4515 => 0.4957, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.66% (0.5859 => 0.6425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.49% (0.5857 => 0.6413, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.45% (0.6052 => 0.6624, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.40% (0.6446 => 0.7052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.13% (0.6189 => 0.6754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.08% (0.5570 => 0.6076, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.08% (0.1982 => 0.2162, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.98% (0.5591 => 0.6093) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.96% (0.5705 => 0.6216, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.93% (3.5339 => 3.8496, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.93% (0.5478 => 0.5967, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.89% (0.5569 => 0.6064, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.87% (0.6304 => 0.6863, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.82% (0.5329 => 0.5799, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.33% (0.6660 => 0.7215, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.12% (0.5863 => 0.6339, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.91% (4.5069 => 4.8634, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.78% (0.6194 => 0.6676, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.61% (0.6297 => 0.6776, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 7.45% (0.3357 => 0.3607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.44% (0.6681 => 0.7178, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.24% (0.7524 => 0.8069, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3446 => 0.3687, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.96% (0.6667 => 0.7131, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3394 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.70% (0.2001 => 0.2135, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 6.33% (0.6750 => 0.7177, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.27% (0.7339 => 0.7799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.46% (1.4642 => 1.5441, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 5.40% (0.3481 => 0.3669, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2385 => 0.2507) MultiSource/Applications/kimwitu++/kc: 5.09% (18.2933 => 19.2252, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 4.97% (9.2283 => 9.6871, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.87% (1.2784 => 1.3406, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 4.78% (1.2515 => 1.3113, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 2.89% (5.0226 => 5.1680, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 2.84% (17.1032 => 17.5888, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.9557 => 0.9770, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.4813 => 0.4918, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.87% (1.3864 => 1.4123, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.84% (31.3723 => 55.4784, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.60% (0.9531 => 1.0351, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4408, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.62% (0.2380 => 0.2490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1149, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4938, std.dev.: 0.1027) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3179, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6017, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7435 => 3.7852, std.dev.: 0.0122) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4335 => 4.4800, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.44% (0.2428 => 0.2296, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.71% (0.3142 => 0.2994, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.67% (0.9852 => 0.9392, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.32% (0.3658 => 0.3500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.06% (0.9542 => 0.9155, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.99% (0.6484 => 0.6225, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.70% (0.3837 => 0.3695, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.63% (0.3831 => 0.3692, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.58% (0.7198 => 0.6940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.58% (0.3880 => 0.3741, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.54% (0.3896 => 0.3758, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.54% (0.4151 => 0.4004, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.51% (2.4924 => 2.4050, std.dev.: 0.0154) SingleSource/UnitTests/ObjC++/Hello: -3.48% (0.6347 => 0.6126, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.42% (0.4033 => 0.3895, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.37% (1.3148 => 1.2705, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -3.36% (4.3330 => 4.1873, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.32% (0.3891 => 0.3762, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.22% (0.4199 => 0.4064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.12% (0.7919 => 0.7672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.09% (2.1713 => 2.1042, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.08% (0.3931 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.07% (0.7982 => 0.7737, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.01% (0.4280 => 0.4151, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.95% (20.7746 => 20.1614, std.dev.: 0.0239) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.94% (0.3884 => 0.3770) SingleSource/Benchmarks/Shootout-C++/lists: -2.90% (0.3621 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.84% (1.2210 => 1.1863, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -2.84% (0.7779 => 0.7558, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.80% (1.0544 => 1.0249, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.76% (1.2221 => 1.1884, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.67% (0.4427 => 0.4309, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.64% (0.3867 => 0.3765, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (1.2300 => 1.1976, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.50% (14.2083 => 13.8525, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.40% (6.7716 => 6.6088, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: -2.38% (7.0961 => 6.9270, std.dev.: 0.0196) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.34% (0.8521 => 0.8322, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -2.28% (16.1920 => 15.8235, std.dev.: 0.0170) MultiSource/Applications/lua/lua: -2.22% (4.0594 => 3.9694, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -2.13% (34.0927 => 33.3668, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.07% (0.5999 => 0.5875, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -1.63% (2.4021 => 2.3630, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -1.57% (2.1401 => 2.1066, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -1.47% (1.5610 => 1.5380, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -1.21% (15.2527 => 15.0687, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.0126 => 7.9239, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.05% (4.8802 => 4.8292, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6951, std.dev.: 0.0231) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0297, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.50% (0.1622 => 0.1111, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.04% (0.1983 => 0.1427, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2402, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.65% (1.3643 => 1.0280, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7475, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0295, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.35% (0.2274 => 0.1743, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3991, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.99% (4.1024 => 3.2004, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1835, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -19.14% (3.3454 => 2.7050, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.25% (1.2237 => 1.0004, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834) SingleSource/UnitTests/Vector/multiplies: -15.52% (2.5106 => 2.1209, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7053, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3586, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8201, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.39% (1.1594 => 1.0969, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.73% (1.7753 => 1.6913, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (7.9763 => 7.7360, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.74% (1.3096 => 1.2737, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1194, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7009, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4666, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1938, std.dev.: 0.0208) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.33% (4.8776 => 4.8128, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.16% (1.6307 => 1.6118, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.01% (1.6219 => 1.6055, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -1.00% (3.7241 => 3.6867, std.dev.: 0.0112) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 20:06:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 22:06:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102040640.460E02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7285?compare_to=7281&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7285, Order: 171352, Start Time: 2013-01-02 02:07:32, End Time: 2013-01-02 04:06:28 To: 7281, Order: 171351, Start Time: 2013-01-01 22:45:56, End Time: 2013-01-02 00:42:02 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 10 (224 on baseline) Performance Improvements: 1 (51 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1049 (701 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.75% (1.4563 => 1.4963, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.67% (0.8829 => 0.9065, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 2.10% (4.4003 => 4.4929, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.94% (0.6791 => 0.6923, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.46% (4.8771 => 4.9484, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.21% (1.3454 => 1.3617, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 7.12% (3.7167 => 3.9812, std.dev.: 0.0552) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.90% (0.3450 => 0.3550, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.89% (0.8740 => 0.8905, std.dev.: 0.0061) MultiSource/Applications/siod/siod: 1.69% (3.5796 => 3.6402, std.dev.: 0.0175) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -5.21% (21.7136 => 20.5829, std.dev.: 0.0821) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.21% (1.1395 => 1.1419, std.dev.: 0.0205) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.48% (0.3985 => 0.4004, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0219 => 0.0221, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.16% (0.0430 => 0.0435, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 17.81% (0.0292 => 0.0344, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.18% (0.0321 => 0.0328, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.40% (0.0430 => 0.0436, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: 2.29% (0.0218 => 0.0223, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 45.40% (0.0174 => 0.0253, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.66% (0.1511 => 0.1521, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.39% (1.1484 => 1.1324, std.dev.: 0.1012) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.04% (0.3876 => 0.3955, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.77% (0.1470 => 0.1496, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.01% (0.0923 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.32% (0.0224 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.56% (0.0590 => 0.0569, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.2820 => 1.2833, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.53% (0.0530 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.68% (0.0190 => 0.0273, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.55% (2.7634 => 2.7787, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 93.48% (0.0046 => 0.0089, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.16% (31.2238 => 31.1737, std.dev.: 0.4519) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.06% (16.4461 => 19.9096, std.dev.: 0.1217) MultiSource/Applications/sqlite3/sqlite3: 3543.52% (0.6332 => 23.0708, std.dev.: 0.2394) MultiSource/Benchmarks/McCat/08-main/main: 57.35% (0.1831 => 0.2881, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.41% (0.1559 => 0.1537, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23499.26% (0.3123 => 73.7005, std.dev.: 21.9848) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1845.66% (0.3344 => 6.5063, std.dev.: 0.3238) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.88% (0.2364 => 0.3354, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 17.07% (0.6010 => 0.7036, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/mandel: 3.50% (0.0429 => 0.0444, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.01% (0.3266 => 0.3495, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/strcat: 4.32% (0.1969 => 0.2054, std.dev.: 0.0041) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.04% (0.0224 => 0.0242, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0514, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 16.89% (0.1462 => 0.1709, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3942, std.dev.: 0.0806) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0683, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4945, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5198, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5376, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0492, std.dev.: 0.0443) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3367, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3782, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0818, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: -30.01% (2.1832 => 1.5281, std.dev.: 0.0039) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 137.75% (0.0249 => 0.0592, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 100.80% (0.0250 => 0.0502, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 73.82% (0.0233 => 0.0405, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 71.38% (0.0297 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 61.00% (0.8611 => 1.3864, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 60.85% (0.8048 => 1.2945, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/neural/neural: 60.83% (0.1440 => 0.2316, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 60.46% (0.8359 => 1.3413, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 60.36% (0.8805 => 1.4120, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.70% (0.8261 => 1.3193, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.62% (0.7932 => 1.2661, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.12% (0.8177 => 1.3011, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 58.76% (0.8007 => 1.2712, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 58.41% (0.8316 => 1.3173, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 58.39% (0.8597 => 1.3617, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 58.33% (0.8066 => 1.2771, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 57.87% (0.8457 => 1.3351, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.16% (0.8338 => 1.3104, std.dev.: 0.0139) SingleSource/UnitTests/SignlessTypes/shr: 57.07% (0.0191 => 0.0300, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.02% (1.5315 => 2.4048, std.dev.: 0.0725) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 56.49% (0.8885 => 1.3904, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.19% (0.8716 => 1.3526, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.94% (0.9056 => 1.4031, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.45% (0.9039 => 1.3961, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 52.24% (0.9688 => 1.4749, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout/ary3: 50.21% (0.0235 => 0.0353, std.dev.: 0.0014) SingleSource/Regression/C/test_indvars: 49.57% (0.0232 => 0.0347, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 42.09% (0.0784 => 0.1114, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.39% (2.1401 => 3.0259, std.dev.: 0.1420) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.70% (3.1832 => 4.3197, std.dev.: 0.1802) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.73% (0.0421 => 0.0563, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.55% (0.0550 => 0.0729, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 31.45% (0.0989 => 0.1300, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1983 => 0.2593, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.76% (0.0635 => 0.0824, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 29.54% (0.0650 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.09% (0.8855 => 1.1431, std.dev.: 0.0271) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.84% (0.2180 => 0.2787, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.54% (0.8286 => 1.0568, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.94% (0.8712 => 1.1059, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 26.78% (0.2999 => 0.3802, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.04% (0.8050 => 1.0146, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.76% (0.8086 => 1.0169, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.60% (0.8204 => 1.0304, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.58% (0.7966 => 1.0004, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.58% (0.8420 => 1.0574, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.55% (0.8697 => 1.0919, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.52% (0.8069 => 1.0128, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.50% (0.8331 => 1.0455, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.43% (0.8317 => 1.0432, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.41% (0.9074 => 1.1380, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.34% (0.9069 => 1.1367, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.31% (0.8518 => 1.0674, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 24.99% (0.8656 => 1.0819, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.57% (0.9908 => 1.2342, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.40% (0.8927 => 1.1105, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: 24.20% (0.1839 => 0.2284, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.78% (0.6586 => 0.8086, std.dev.: 0.0314) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.62% (4.4880 => 5.5031, std.dev.: 0.0326) MultiSource/Applications/lemon/lemon: 22.02% (1.0945 => 1.3355, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.01% (0.0668 => 0.0815, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.91% (0.4783 => 0.5831, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.70% (0.0848 => 0.1032, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 21.02% (0.1565 => 0.1894, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.80% (0.0822 => 0.0993, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.68% (0.0701 => 0.0846, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 20.21% (0.3800 => 0.4568, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.46% (1.2526 => 1.4963, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.45% (1.3279 => 1.5862, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.14% (0.0810 => 0.0965, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 19.11% (2.3764 => 2.8305, std.dev.: 0.0285) MultiSource/Benchmarks/Olden/tsp/tsp: 18.53% (0.1112 => 0.1318, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.24% (0.1157 => 0.1368, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.14% (0.1097 => 0.1296, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.99% (0.0745 => 0.0879, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 17.83% (0.2227 => 0.2624, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.47% (0.3137 => 0.3685, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.21% (0.0773 => 0.0906, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 17.18% (0.2427 => 0.2844, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 17.16% (0.4125 => 0.4833, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.10% (0.1778 => 0.2082, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 16.90% (0.2390 => 0.2794, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 16.86% (0.2509 => 0.2932, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 16.86% (0.1756 => 0.2052, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 16.85% (0.4397 => 0.5138, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.63% (0.3295 => 0.3843, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.74% (0.1137 => 0.1316, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 15.74% (0.5191 => 0.6008, std.dev.: 0.0170) MultiSource/Applications/Burg/burg: 15.73% (1.2222 => 1.4144, std.dev.: 0.0243) MultiSource/Benchmarks/Ptrdist/ks/ks: 15.21% (0.1466 => 0.1689, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.4127 => 0.4748, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 14.94% (14.2605 => 16.3911, std.dev.: 0.2214) MultiSource/Applications/SIBsim4/SIBsim4: 14.86% (1.2568 => 1.4436, std.dev.: 0.0164) MultiSource/Benchmarks/NPB-serial/is/is: 14.55% (0.0708 => 0.0811, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.45% (0.8768 => 1.0035, std.dev.: 0.0151) SingleSource/UnitTests/SignlessTypes/rem: 14.40% (0.1035 => 0.1184, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.99% (0.0829 => 0.0945, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.91% (0.9435 => 1.0747, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.52% (1.6386 => 1.8601, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.26% (0.1425 => 0.1614, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 13.26% (0.6010 => 0.6807, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 13.15% (4.9628 => 5.6154, std.dev.: 0.1218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.13% (13.1811 => 14.9121, std.dev.: 0.0590) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.05% (0.7473 => 0.8448, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.00% (0.1885 => 0.2130, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 12.76% (1.1271 => 1.2709, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 12.39% (0.6287 => 0.7066, std.dev.: 0.0103) MultiSource/Applications/aha/aha: 12.22% (0.1088 => 0.1221, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.21% (1.2602 => 1.4141, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.97% (0.1905 => 0.2133, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 11.64% (0.1177 => 0.1314, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.59% (0.4847 => 0.5409, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 11.53% (0.0937 => 0.1045, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 11.47% (0.3226 => 0.3596, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.30% (0.6834 => 0.7606, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 11.25% (0.8148 => 0.9065, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.24% (0.1183 => 0.1316, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.18% (0.6227 => 0.6923, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.07% (0.2998 => 0.3330, std.dev.: 0.0096) MultiSource/Applications/lua/lua: 10.98% (3.8189 => 4.2383, std.dev.: 0.1013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.96% (0.8340 => 0.9254, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: 10.95% (15.3280 => 17.0070, std.dev.: 0.2348) MultiSource/Applications/d/make_dparser: 10.88% (3.2366 => 3.5889, std.dev.: 0.0676) MultiSource/Applications/spiff/spiff: 10.81% (0.7950 => 0.8809, std.dev.: 0.0239) MultiSource/Benchmarks/Olden/power/power: 10.75% (0.1247 => 0.1381, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.74% (4.1763 => 4.6249, std.dev.: 0.0455) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.39% (0.3003 => 0.3315, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 10.38% (0.5961 => 0.6580, std.dev.: 0.0160) MultiSource/Applications/siod/siod: 10.38% (2.2184 => 2.4487, std.dev.: 0.0535) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.38% (1.1170 => 1.2329, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.25% (0.8321 => 0.9174, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.19% (0.1099 => 0.1211, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.87% (14.7684 => 16.2257, std.dev.: 0.1060) MultiSource/Applications/treecc/treecc: 9.87% (1.9948 => 2.1916, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.86% (0.3115 => 0.3422, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.78% (0.2279 => 0.2502, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.70% (0.4559 => 0.5001, std.dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 9.54% (6.7320 => 7.3741, std.dev.: 0.1111) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.39% (0.1150 => 0.1258, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.38% (8.6476 => 9.4585, std.dev.: 0.0485) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.22% (0.1301 => 0.1421, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.01% (0.2519 => 0.2746, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.95% (4.4873 => 4.8888, std.dev.: 0.0843) MultiSource/Benchmarks/Olden/em3d/em3d: 8.77% (0.1721 => 0.1872, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 8.77% (4.1305 => 4.4929, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 8.66% (0.2240 => 0.2434, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 8.62% (0.1577 => 0.1713, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 8.44% (0.2985 => 0.3237, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.44% (0.1588 => 0.1722, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.43% (1.1606 => 1.2584, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/health/health: 8.39% (0.1347 => 0.1460, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 8.32% (0.5817 => 0.6301, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 8.28% (4.5702 => 4.9484, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.10% (6.6074 => 7.1423, std.dev.: 0.0904) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.03% (1.1685 => 1.2623, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.02% (0.3717 => 0.4015, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.95% (0.2378 => 0.2567, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 7.62% (0.3503 => 0.3770, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.59% (0.2133 => 0.2295, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.48% (0.2794 => 0.3003, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.58% (0.2741 => 0.2894, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (0.8995 => 0.9497, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 5.29% (0.3645 => 0.3838, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 4.87% (0.7557 => 0.7925, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists: 4.26% (0.2513 => 0.2620, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.24% (0.3657 => 0.3812, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: 4.10% (0.2755 => 0.2868, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 4.05% (0.3263 => 0.3395, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.71% (1.2423 => 1.2884, std.dev.: 0.0140) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1518400.00% (0.0001 => 1.5185, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 371.83% (0.3585 => 1.6915, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: 365.59% (1.5671 => 7.2962, std.dev.: 0.0324) MultiSource/Benchmarks/PAQ8p/paq8p: 278.02% (91.7701 => 346.9083, std.dev.: 3.6626) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.20% (28.5821 => 85.5163, std.dev.: 0.0863) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 172.07% (5.1305 => 13.9586, std.dev.: 0.0549) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 112.57% (1.1365 => 2.4159, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/ary: 105.94% (0.0219 => 0.0451, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 61.36% (2.8760 => 4.6407, std.dev.: 0.0540) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 56.64% (0.0226 => 0.0354, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/pi: 40.28% (1.5795 => 2.2157, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.32% (2.7995 => 3.9004, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 36.77% (1.3882 => 1.8986, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.39% (4.5327 => 5.9555, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.56% (2.9096 => 3.7116, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 20.64% (0.0528 => 0.0637, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 18.70% (0.4001 => 0.4749, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.22% (0.7597 => 0.8905, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.88% (4.7794 => 5.5861, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: 14.36% (7.5003 => 8.5771, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.42% (0.3186 => 0.3550, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 10.13% (3.1873 => 3.5101, std.dev.: 0.0346) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.67% (1.1857 => 1.3003, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.94% (3.9006 => 4.2492, std.dev.: 0.1096) SingleSource/Benchmarks/Misc/ReedSolomon: 7.42% (8.5322 => 9.1652, std.dev.: 0.1381) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3118, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 6.55% (0.2015 => 0.2147, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 6.18% (1.0388 => 1.1030, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.80% (0.6150 => 0.6507, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.72% (4.9686 => 5.2530, std.dev.: 0.0200) MultiSource/Benchmarks/sim/sim: 5.54% (3.8206 => 4.0322, std.dev.: 0.0239) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (3.5679 => 3.7629, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.44% (4.8436 => 5.1070, std.dev.: 0.0097) MultiSource/Applications/aha/aha: 4.89% (3.3398 => 3.5030, std.dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 4.78% (6.7064 => 7.0267, std.dev.: 0.0554) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.76% (0.5214 => 0.5462, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.71% (6.1706 => 6.4615, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/richards_benchmark: 4.04% (1.3037 => 1.3564, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: 3.60% (1.2061 => 1.2495, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 3.45% (1.7056 => 1.7644, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.43% (0.3587 => 0.3710, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.23% (0.4031 => 0.4161, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.09% (4.2466 => 4.3777, std.dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: 3.03% (0.5081 => 0.5235, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.57% (1.2337 => 1.2654, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.13% (3.4104 => 3.4831, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/methcall: 1.79% (8.2676 => 8.4159, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 1.68% (2.3560 => 2.3955, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.57% (8.2783 => 8.4083, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.53% (1.5866 => 1.6109, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.39% (1.9302 => 1.9570, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.26% (2.5697 => 2.6020, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (3.7192 => 3.7599, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.00% (3.7781 => 3.8160, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.07% (2.8951 => 0.8375, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.33% (11.5316 => 4.6901, std.dev.: 0.0347) SingleSource/Benchmarks/Misc/fp-convert: -52.42% (15.8853 => 7.5587, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.35% (4.7482 => 3.0224, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.48% (5.4972 => 3.6018, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.25% (5.4300 => 3.6786, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -30.37% (1.9999 => 1.3925, std.dev.: 0.1170) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.64% (5.6343 => 4.1336, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.42% (5.0261 => 4.0000, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.93% (5.0243 => 4.1739, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.87% (2.9753 => 2.5328, std.dev.: 0.0904) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -12.08% (9.9065 => 8.7102, std.dev.: 0.0164) MultiSource/Benchmarks/mafft/pairlocalalign: -10.13% (63.1822 => 56.7790, std.dev.: 0.2046) SingleSource/Benchmarks/Misc/flops-8: -9.64% (2.5609 => 2.3140, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: -9.39% (5.1084 => 4.6286, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/em3d/em3d: -9.18% (5.4641 => 4.9624, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.16% (6.2275 => 5.6572, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.81% (3.7148 => 3.3876, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -8.73% (1.1216 => 1.0237, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.51% (7.2130 => 6.5992, std.dev.: 0.2266) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.31% (1.0512 => 0.9638, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.50% (4.3552 => 4.0287, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.34% (5.3218 => 4.9310, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.27% (3.2169 => 2.9831, std.dev.: 0.0256) SingleSource/Benchmarks/Stanford/FloatMM: -6.37% (0.8807 => 0.8246, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: -6.29% (21.9654 => 20.5829, std.dev.: 0.0821) SingleSource/Benchmarks/Shootout/sieve: -6.25% (7.0599 => 6.6190, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (0.3269 => 0.3082, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: -5.45% (9.3748 => 8.8639, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.37% (4.9453 => 4.6798, std.dev.: 0.0357) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -4.60% (0.3937 => 0.3756, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.59% (2.8773 => 2.7451, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/methcall: -3.75% (8.9760 => 8.6396, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.28% (1.4529 => 1.4052, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.01% (5.1557 => 5.0007, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.94% (4.7449 => 4.6053, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.82% (4.9469 => 4.8074, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.75% (6.0224 => 5.8567, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fbench: -2.63% (3.3840 => 3.2951, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ffbench: -2.40% (1.4296 => 1.3953, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.32% (22.2997 => 21.7833, std.dev.: 0.1668) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.21% (4.8362 => 4.7295, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.20% (0.5807 => 0.5679, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/fldry: -2.17% (0.6910 => 0.6760, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (9.2989 => 9.1091, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.92% (2.6356 => 2.5849, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.92% (3.3479 => 3.2835, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: -1.60% (2.8957 => 2.8494, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.23% (1.5308 => 1.5120, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.02% (4.9994 => 4.9485, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/neural/neural: -1.01% (1.0841 => 1.0731, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.27% (1.0262 => 1.1419, std.dev.: 0.0205) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.57% (0.2463 => 0.4004, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 79.67% (0.0123 => 0.0221, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.62% (0.0408 => 0.0435, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.43% (0.0254 => 0.0344, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.61% (0.0302 => 0.0328, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.54% (0.0384 => 0.0436, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: 23.89% (0.0180 => 0.0223, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.77% (0.1438 => 0.1521, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -0.04% (1.1329 => 1.1324, std.dev.: 0.1012) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.02% (0.4164 => 0.3955, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.28% (0.1369 => 0.1496, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 49.77% (0.0641 => 0.0960, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.56% (0.0578 => 0.0569, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.21% (1.1437 => 1.2833, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.67% (0.0180 => 0.0273, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 246.60% (0.8017 => 2.7787, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.55% (0.0062 => 0.0089, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 20:31:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 22:31:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102043142.83A772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7286?compare_to=7282&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7286, Order: 171352, Start Time: 2013-01-02 02:17:06, End Time: 2013-01-02 04:31:24 To: 7282, Order: 171351, Start Time: 2013-01-01 23:21:57, End Time: 2013-01-02 01:36:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.79% (0.6283 => 0.6647, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/chomp: 1.06% (1.0900 => 1.1015, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -2.85% (0.3933 => 0.3821, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0415 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.74% (0.0689 => 0.0677, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.7781 => 499.7503, std.dev.: 0.0543) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44215.89% (1.1277 => 499.7503, std.dev.: 0.0543) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.89% (0.5229 => 1.6518, std.dev.: 0.0158) MultiSource/Applications/SPASS/SPASS: 20.01% (14.9895 => 17.9891, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 54.67% (14.1553 => 21.8942, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 17.43% (4.1105 => 4.8268, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.97% (1.1048 => 1.7453, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1224.38% (7.1582 => 94.8021, std.dev.: 0.0639) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.36% (3.4629 => 7.8041, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.02% (0.6222 => 1.1014, std.dev.: 0.0039) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.94% (0.0720 => 7.4426, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3832200.00% (0.0001 => 3.8323, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11160700.00% (0.0001 => 11.1608, std.dev.: 0.0129) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959300.00% (0.0001 => 9.9594, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5499900.00% (0.0001 => 5.5000, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.61% (1.1194 => 10.3277, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 149.28% (22.1758 => 55.2801, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.39% (0.0929 => 0.1713, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 83.13% (0.0243 => 0.0445, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537) MultiSource/Benchmarks/FreeBench/neural/neural: 59.13% (0.1463 => 0.2328, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.43% (2.9384 => 4.6260, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.31% (7.0540 => 10.9557, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.95% (1.5859 => 2.4098, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573) SingleSource/Regression/C/sumarray: 47.19% (0.0231 => 0.0340) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.06% (8.1363 => 11.9651, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.44% (2.2024 => 3.1150, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.23% (0.0439 => 0.0620, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.06% (0.1432 => 0.2020, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 40.77% (21.9371 => 30.8812, std.dev.: 0.0139) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.56% (0.1062 => 0.1429) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.14% (0.6675 => 0.8887, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.36% (1.5415 => 2.0404, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.03% (0.5105 => 0.6689, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 30.88% (0.3109 => 0.4069, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.57% (0.4615 => 0.6026, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 30.22% (0.4299 => 0.5598, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.81% (4.2646 => 5.5357, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 29.47% (0.4289 => 0.5553, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.78% (0.1584 => 0.2024, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 27.76% (1.1642 => 1.4874, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.64% (0.1125 => 0.1436, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 27.36% (0.4620 => 0.5884, std.dev.: 0.0085) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.21% (0.0746 => 0.0949, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 26.73% (1.0722 => 1.3588, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.12% (0.2554 => 0.3221, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.74% (0.1892 => 0.2379, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.14% (0.2271 => 0.2842, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.88% (3.8922 => 4.8605, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 24.85% (0.1175 => 0.1467, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 24.21% (0.6456 => 0.8019, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.98% (0.1906 => 0.2363, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.20% (1.4186 => 1.7477, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.82% (0.0793 => 0.0974, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.51% (0.1337 => 0.1638, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.43% (0.3121 => 0.3821, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 22.22% (5.7591 => 7.0388, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 22.01% (9.4845 => 11.5723, std.dev.: 0.0183) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.97% (0.0842 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 21.69% (0.1655 => 0.2014, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.57% (0.7115 => 0.8650, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.47% (0.1695 => 0.2059, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.44% (0.2700 => 0.3279, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.99% (0.0648 => 0.0784, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 20.90% (0.3283 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.76% (1.3050 => 1.5759, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.52% (0.7835 => 0.9443, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 20.33% (0.1151 => 0.1385, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 20.33% (0.3232 => 0.3889, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.32% (0.0886 => 0.1066, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.24% (0.0672 => 0.0808, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 20.13% (0.1555 => 0.1868, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.79% (4.9449 => 5.9234, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/15-trie/trie: 19.54% (0.0527 => 0.0630, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.22% (0.5860 => 0.6986, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 19.20% (3.3354 => 3.9757, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/messages-2: 19.18% (0.0662 => 0.0789, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.14% (0.1029 => 0.1226, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.11% (0.0675 => 0.0804, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.09% (5.0018 => 5.9566, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 19.00% (1.1840 => 1.4090, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 18.83% (17.1811 => 20.4166, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.60% (0.8172 => 0.9692, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.57% (0.5569 => 0.6603, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.49% (0.2758 => 0.3268, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.43% (0.3423 => 0.4054, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.30% (0.1940 => 0.2295, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 18.26% (0.3379 => 0.3996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.88% (0.1236 => 0.1457, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.85% (0.1143 => 0.1347, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.81% (0.0730 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 17.75% (0.0614 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.42% (0.7433 => 0.8728, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.39% (0.9765 => 1.1463, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.37% (0.5020 => 0.5892, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 17.32% (2.2969 => 2.6948, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.23% (0.4636 => 0.5435, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.2107 => 0.2470, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 17.03% (0.1268 => 0.1484, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.81% (0.3307 => 0.3863, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.76% (3.8723 => 4.5214, std.dev.: 0.0091) MultiSource/Applications/treecc/treecc: 16.67% (2.0273 => 2.3652, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.11% (0.6450 => 0.7489, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.08% (0.2065 => 0.2397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 15.88% (0.8921 => 1.0338, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.87% (0.3441 => 0.3987, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.81% (0.8101 => 0.9382, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.80% (1.1861 => 1.3617, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 14.65% (0.3180 => 0.3646, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 14.40% (0.2049 => 0.2344, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.33% (0.2603 => 0.2976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.07% (0.8067 => 0.9202, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.88% (0.3387 => 0.3857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 13.20% (0.0818 => 0.0926) MultiSource/Applications/hbd/hbd: 13.02% (1.5603 => 1.7635, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/oourafft: 12.28% (0.3282 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.08% (0.3865 => 0.4332, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 11.68% (0.3092 => 0.3453, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.50% (0.4103 => 0.4575, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.49% (14.3668 => 16.0181, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.02% (0.4203 => 0.4666, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.97% (0.3828 => 0.4248, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.83% (0.3427 => 0.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 10.81% (0.3098 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.80% (0.4048 => 0.4485, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.78% (0.2430 => 0.2692, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.40% (0.3826 => 0.4224, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.34% (0.3422 => 0.3776, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.27% (0.3603 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.06% (0.4064 => 0.4473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.04% (0.3684 => 0.4054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.64% (0.2831 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3650 => 0.3993, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 9.02% (0.2871 => 0.3130, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.79% (0.3162 => 0.3440, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.75% (63.2438 => 68.7751, std.dev.: 0.0122) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 8.51% (10.3673 => 11.2493, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.45% (2.0665 => 2.2412, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: 8.41% (1.2842 => 1.3922, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.17% (0.2877 => 0.3112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2793 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (2.2022 => 2.3783, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.99% (0.2891 => 0.3122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.70% (0.2714 => 0.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.69% (0.2872 => 0.3093, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.62% (0.3935 => 0.4235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.47% (0.3052 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.46% (0.2802 => 0.3011, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.4879 => 0.5240, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.27% (0.3136 => 0.3364, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.24% (0.3177 => 0.3407, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 6.29% (0.3131 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (7.9617 => 8.2178, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.20% (0.3817 => 0.3939, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.67% (32.5116 => 59.0645, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6977, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3783, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4607, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (3.1578 => 3.3281, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (2.0360 => 2.1086, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.25% (0.9957 => 1.0281, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9178, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8444 => 28.3447, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (1.7254 => 1.7520, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.50% (3.6395 => 3.6941, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.36% (4.4649 => 4.5258, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2340, std.dev.: 0.0249) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.27% (5.2763 => 1.1993, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -74.99% (0.8651 => 0.2164, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.29% (0.1622 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.82% (5.3855 => 4.4799, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.27% (5.3526 => 4.4815, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -13.00% (10.4361 => 9.0799, std.dev.: 0.0201) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9447, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.64% (1.7609 => 1.6439, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.05% (1.9577 => 0.6647, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.12% (8.0499 => 4.0152, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.83% (0.6962 => 0.3841, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.02% (0.3987 => 0.2471, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.80% (10.7105 => 7.4115, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.8001, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3707, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -18.57% (3.3453 => 2.7240) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.39% (1.2258 => 1.0004) SingleSource/UnitTests/Vector/multiplies: -16.32% (2.5528 => 2.1362, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4270, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7348, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.13% (9.5636 => 8.4996, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: -10.98% (1.2373 => 1.1015, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2751, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4809, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.65% (1.6805 => 1.5855, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.07% (0.4808 => 0.4564, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.48% (8.1563 => 7.7912, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: -4.43% (10.2830 => 9.8271, std.dev.: 0.0191) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1556, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -3.50% (0.6223 => 0.6005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -1.93% (1.0554 => 1.0350, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9551, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5869, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0012) Report Time: 4.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 21:51:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 1 Jan 2013 23:51:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102055151.EDE782A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7287?compare_to=7284&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7287, Order: 171353, Start Time: 2013-01-02 04:11:52, End Time: 2013-01-02 05:48:08 To: 7284, Order: 171352, Start Time: 2013-01-02 02:10:53, End Time: 2013-01-02 03:47:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (118 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (828 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.19% (22.4056 => 78.9105, std.dev.: 0.0666) SingleSource/Benchmarks/Misc/lowercase: 64.29% (0.0280 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.04% (0.0717 => 0.1126, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.21% (0.0974 => 0.1502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.55% (0.0599 => 0.0788, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.30% (1.6474 => 2.0971, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 26.56% (0.0418 => 0.0529, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.75% (0.0699 => 0.0851, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.37% (5.4682 => 6.6369, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.53% (2.2587 => 2.6998, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.57% (0.6395 => 0.7391, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.25% (1.1450 => 1.3196, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.92% (0.6395 => 0.7285, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.23% (0.6260 => 0.7088, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.24% (0.5941 => 0.6668, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.95% (0.1146 => 0.1283, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.61% (0.6230 => 0.6953, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.47% (0.5805 => 0.6471, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 11.25% (0.4524 => 0.5033, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.16% (0.6033 => 0.6706, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.11% (0.7021 => 0.7801, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.96% (0.5849 => 0.6490, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.84% (0.6440 => 0.7138, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.76% (0.5456 => 0.6043, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.69% (0.5688 => 0.6296, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.51% (0.5925 => 0.6548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.48% (0.5575 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.45% (0.5567 => 0.6149, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.43% (0.5581 => 0.6163, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.37% (0.6676 => 0.7368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 10.22% (0.4861 => 0.5358, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (1.6364 => 1.8030, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.17% (0.5802 => 0.6392, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 9.86% (0.4515 => 0.4960, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.71% (0.5859 => 0.6428, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.65% (0.5857 => 0.6422, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.39% (0.6052 => 0.6620, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.28% (0.1982 => 0.2166, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.23% (0.6446 => 0.7041, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.23% (0.6189 => 0.6760, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.99% (0.5570 => 0.6071, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.89% (3.5339 => 3.8482, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.89% (0.5478 => 0.5965, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.89% (0.5569 => 0.6064, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.89% (0.5705 => 0.6212, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.88% (0.5329 => 0.5802, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.80% (0.5591 => 0.6083, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.74% (0.6304 => 0.6855, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.27% (0.6660 => 0.7211, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.19% (0.5863 => 0.6343, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.88% (0.6194 => 0.6682, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.77% (4.5069 => 4.8570, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.75% (0.6297 => 0.6785, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.65% (0.6681 => 0.7192, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.42% (0.3357 => 0.3606, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.30% (0.6667 => 0.7154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.24% (0.7524 => 0.8069, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 6.99% (0.3446 => 0.3687, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 6.81% (0.3394 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.42% (0.7339 => 0.7810, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.34% (0.6750 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.41% (1.4642 => 1.5434, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 5.34% (0.3481 => 0.3667, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2385 => 0.2507, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.10% (18.2933 => 19.2257, std.dev.: 0.0165) MultiSource/Benchmarks/mafft/pairlocalalign: 4.95% (9.2283 => 9.6850, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.83% (1.2784 => 1.3401, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 4.77% (1.2515 => 1.3112, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 3.05% (17.1032 => 17.6254, std.dev.: 0.0162) MultiSource/Applications/oggenc/oggenc: 2.87% (5.0226 => 5.1668, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.9557 => 0.9774, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.24% (0.4813 => 0.4921, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.81% (1.3864 => 1.4115, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.99% (31.3723 => 55.5263, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.66% (0.9531 => 1.0261, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.67% (5.1955 => 5.4383, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.58% (0.2380 => 0.2489, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.74% (11.6767 => 12.1136, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5107, std.dev.: 0.1288) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3179, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6008, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.07% (4.4335 => 4.4810, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.3821 => 0.3630, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.77% (0.3142 => 0.2992, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.62% (0.9852 => 0.9397, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.37% (0.3658 => 0.3498, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.29% (0.9542 => 0.9133, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.99% (0.6484 => 0.6225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.65% (0.3837 => 0.3697, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.62% (0.3812 => 0.3674, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.60% (0.7198 => 0.6939, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3831 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.54% (0.6347 => 0.6122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.53% (0.3880 => 0.3743, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3896 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.49% (0.4151 => 0.4006, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.48% (2.4924 => 2.4056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3848 => 0.3714, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.47% (0.4033 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.44% (0.3891 => 0.3757, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.44% (1.3148 => 1.2696, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.29% (4.3330 => 4.1905, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: -3.24% (0.4199 => 0.4063, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.20% (0.3252 => 0.3148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.15% (2.1713 => 2.1029, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: -3.13% (0.7982 => 0.7732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.11% (0.4280 => 0.4147, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.09% (0.7919 => 0.7674, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.08% (0.3931 => 0.3810, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3884 => 0.3767, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.01% (0.4321 => 0.4191, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1575, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.90% (1.2221 => 1.1867, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: -2.87% (0.7779 => 0.7556, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.74% (1.2210 => 1.1875, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.72% (1.0544 => 1.0257, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.71% (0.4427 => 0.4307, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (1.2300 => 1.1976, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -2.59% (0.3867 => 0.3767, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8496, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.44% (6.7716 => 6.6061, std.dev.: 0.0087) MultiSource/Applications/JM/ldecod/ldecod: -2.40% (7.0961 => 6.9255, std.dev.: 0.0085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.32% (0.8521 => 0.8323, std.dev.: 0.0071) MultiSource/Applications/lua/lua: -2.24% (4.0594 => 3.9686, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -2.13% (34.0927 => 33.3666, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: -2.08% (16.1920 => 15.8550, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.93% (0.5999 => 0.5883, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -1.88% (0.9179 => 0.9006, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -1.75% (2.4021 => 2.3601, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.72% (0.9077 => 0.8921, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -1.64% (2.1401 => 2.1051, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -1.50% (1.5610 => 1.5376, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.19% (15.2527 => 15.0711, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.11% (4.8802 => 4.8259, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.08% (4.0323 => 3.9889, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: -1.06% (1.1530 => 1.1408, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6924, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0297, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4758, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.38% (0.1622 => 0.1113, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.99% (0.1983 => 0.1428, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.53% (1.3643 => 1.0296, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.53% (0.2274 => 0.1739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0321, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.99% (4.1024 => 3.2004, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709) SingleSource/Benchmarks/Misc/fp-convert: -19.02% (3.3454 => 2.7091, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.24% (1.2237 => 1.0005, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -15.73% (2.5106 => 2.1157, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.83% (0.4092 => 0.3526, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7050, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3594, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8203, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.41% (1.1594 => 1.0851, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9085, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.72% (1.7753 => 1.6915, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (7.9763 => 7.7355, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.90% (5.3830 => 5.2271, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3096 => 1.2756, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7003, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1943, std.dev.: 0.0318) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.40% (1.6219 => 1.5992, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.8776 => 4.8143, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5907, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.11% (1.6307 => 1.6126, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 8.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 22:27:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 00:27:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102062741.CA2712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7288?compare_to=7285&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7288, Order: 171353, Start Time: 2013-01-02 04:24:36, End Time: 2013-01-02 06:22:08 To: 7285, Order: 171352, Start Time: 2013-01-02 02:07:32, End Time: 2013-01-02 04:06:28 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 3 (167 on baseline) Performance Improvements: 2 (43 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1055 (766 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 4.19% (2.3968 => 2.4973, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.47% (14.0665 => 14.5546, std.dev.: 0.1715) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.90% (2.4159 => 2.4617, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -2.46% (4.2492 => 4.1445, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout/fib2: -1.18% (4.3560 => 4.3048, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.43% (1.1419 => 1.1370, std.dev.: 0.0741) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.75% (0.4004 => 0.3974, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.36% (0.0221 => 0.0218, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0435 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.74% (0.0344 => 0.0338, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.38% (0.0436 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0204 => 0.0203, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -2.69% (0.0223 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.04% (0.0253 => 0.0220, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -0.59% (0.1521 => 0.1512, std.dev.: 0.0151) MultiSource/Applications/lemon/lemon: 3.39% (1.1324 => 1.1708, std.dev.: 0.0228) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.05% (0.3955 => 0.4115, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.74% (0.1496 => 0.1522, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.63% (0.0960 => 0.0906, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.47% (0.0274 => 0.0259, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.10% (0.0569 => 0.0598, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.09% (1.2833 => 1.2845, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -94.12% (0.0017 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.49% (0.0607 => 0.0513, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.33% (0.0273 => 0.0253, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (2.7787 => 2.7794, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.12% (0.0089 => 0.0090, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.49% (31.1737 => 31.0224, std.dev.: 0.0687) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 20.77% (16.4461 => 19.8617, std.dev.: 1.5184) MultiSource/Applications/sqlite3/sqlite3: 3493.59% (0.6332 => 22.7546, std.dev.: 1.0084) MultiSource/Benchmarks/McCat/08-main/main: 53.19% (0.1831 => 0.2805, std.dev.: 0.0870) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.69% (0.1559 => 0.1517, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23867.92% (0.3123 => 74.8518, std.dev.: 1.7761) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1849.85% (0.3344 => 6.5203, std.dev.: 0.6396) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.07% (0.2364 => 0.3335, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/bigfib: 17.69% (0.6010 => 0.7073, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/mandel: 7.46% (0.0429 => 0.0461, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.39% (0.3266 => 0.3442, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 3.25% (0.1969 => 0.2033, std.dev.: 0.0135) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.59% (0.0224 => 0.0241, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -23.48% (0.0230 => 0.0176, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0468, std.dev.: 0.0089) MultiSource/Applications/oggenc/oggenc: 10.67% (0.1462 => 0.1618, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3962, std.dev.: 0.0206) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0726, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4933, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5292, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5398, std.dev.: 0.1252) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0561, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3373, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3752, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0849, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: -29.57% (2.1832 => 1.5376, std.dev.: 0.0031) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 145.38% (0.0249 => 0.0611, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 102.40% (0.0250 => 0.0506, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 70.71% (0.0297 => 0.0507, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 68.67% (0.0233 => 0.0393, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 62.78% (0.1440 => 0.2344, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 61.90% (0.8611 => 1.3941, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 60.20% (0.8359 => 1.3391, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 60.13% (0.8007 => 1.2822, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 60.10% (0.7932 => 1.2699, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.80% (0.8261 => 1.3201, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 59.68% (0.8048 => 1.2851, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.44% (0.8177 => 1.3037, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.26% (0.8805 => 1.4023, std.dev.: 0.0430) SingleSource/UnitTests/SignlessTypes/shr: 58.64% (0.0191 => 0.0303, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 58.58% (0.8066 => 1.2791, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 58.35% (0.8457 => 1.3392, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.46% (0.8338 => 1.3129, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 57.41% (0.8316 => 1.3090, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.96% (0.8597 => 1.3494, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 56.33% (0.8885 => 1.3890, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.11% (0.8716 => 1.3519, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.92% (0.9056 => 1.4030, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.85% (1.5315 => 2.3715, std.dev.: 0.1165) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.71% (0.9039 => 1.3984, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 52.38% (0.9688 => 1.4763, std.dev.: 0.0313) SingleSource/Regression/C/test_indvars: 52.16% (0.0232 => 0.0353, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 50.21% (0.0235 => 0.0353, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.81% (2.1401 => 3.0349, std.dev.: 0.0618) SingleSource/Benchmarks/McGill/exptree: 40.31% (0.0784 => 0.1100, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.61% (3.1832 => 4.3167, std.dev.: 0.0859) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.68% (0.0421 => 0.0567, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 34.47% (0.0734 => 0.0987, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 33.09% (0.0550 => 0.0732, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 31.14% (0.0989 => 0.1297, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.01% (0.1983 => 0.2598, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 28.82% (0.8855 => 1.1407, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.36% (0.8286 => 1.0553, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.65% (0.8712 => 1.1034, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 26.61% (0.2999 => 0.3797, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.92% (0.8086 => 1.0182, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.92% (0.8697 => 1.0951, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.83% (0.7966 => 1.0024, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.78% (0.8050 => 1.0125, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.74% (0.8317 => 1.0458, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.72% (0.8204 => 1.0314, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.49% (0.8069 => 1.0126, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.49% (0.9074 => 1.1387, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.46% (0.8331 => 1.0452, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.07% (0.9069 => 1.1343, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.04% (0.8420 => 1.0528, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 24.99% (0.8518 => 1.0647, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 24.83% (0.8656 => 1.0805, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/ReedSolomon: 24.58% (0.1839 => 0.2291, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.9908 => 1.2293, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 24.04% (0.0757 => 0.0939, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 23.50% (0.8927 => 1.1025, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: 21.47% (1.0945 => 1.3295, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.96% (0.0668 => 0.0808, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.92% (0.0822 => 0.0994, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.68% (0.0701 => 0.0846, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.34% (0.4783 => 0.5756, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash: 20.11% (0.3800 => 0.4564, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/chomp: 19.55% (0.1565 => 0.1871, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.38% (1.2526 => 1.4954, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: 18.64% (8.6247 => 10.2326, std.dev.: 0.0293) MultiSource/Benchmarks/PAQ8p/paq8p: 18.51% (2.3764 => 2.8163, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash2: 17.96% (0.4125 => 0.4866, std.dev.: 0.0116) MultiSource/Benchmarks/SciMark2-C/scimark2: 17.63% (0.3137 => 0.3690, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.55% (0.1778 => 0.2090, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 17.41% (0.1097 => 0.1288, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.32% (0.5191 => 0.6090, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.29% (0.1157 => 0.1357, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 16.56% (0.2427 => 0.2829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.28% (0.2390 => 0.2779, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.15% (1.3279 => 1.5423, std.dev.: 0.0501) SingleSource/Benchmarks/Shootout-C++/matrix: 15.63% (0.2227 => 0.2575, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 15.22% (1.2222 => 1.4082, std.dev.: 0.0414) SingleSource/UnitTests/SignlessTypes/rem: 14.98% (0.1035 => 0.1190, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 14.96% (0.0722 => 0.0830, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 14.63% (14.2605 => 16.3468, std.dev.: 0.4630) MultiSource/Benchmarks/Prolangs-C/football/football: 13.21% (0.8768 => 0.9926, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.16% (0.4127 => 0.4670, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 12.72% (4.9628 => 5.5940, std.dev.: 0.2128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.54% (13.1811 => 14.8336, std.dev.: 0.2574) MultiSource/Benchmarks/nbench/nbench: 12.53% (1.1271 => 1.2683, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.43% (0.1150 => 0.1293, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.76% (1.6386 => 1.8313, std.dev.: 0.0373) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.23% (0.1425 => 0.1585, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 11.19% (0.6834 => 0.7599, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops: 10.89% (0.0937 => 0.1039, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.70% (1.2602 => 1.3951, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.26% (0.3295 => 0.3633, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.24% (4.1763 => 4.6038, std.dev.: 0.0704) MultiSource/Applications/spiff/spiff: 10.18% (0.7950 => 0.8759, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.12% (0.8321 => 0.9163, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.97% (0.1183 => 0.1301, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.78% (0.8340 => 0.9156, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.77% (0.2998 => 0.3291, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.44% (0.1885 => 0.2063, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.82% (0.3717 => 0.4045, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.72% (0.5961 => 0.6481, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.43% (4.4873 => 4.8657, std.dev.: 0.0719) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 8.33% (0.6287 => 0.6811, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.03% (8.6476 => 9.3418, std.dev.: 0.2243) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.2794 => 0.3018, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.99% (1.1606 => 1.2533, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.48% (0.3115 => 0.3348, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.22% (6.6074 => 7.0844, std.dev.: 0.1126) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.79% (1.1685 => 1.2478, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.45% (0.5817 => 0.6192, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: 6.12% (31.8598 => 33.8095, std.dev.: 0.0616) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.2378 => 0.2521, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.98% (0.2844 => 0.3014, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 5.54% (1.4269 => 1.5060, std.dev.: 0.0234) MultiSource/Applications/lambda-0_1_3/lambda: 4.50% (0.7557 => 0.7897, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.21% (0.6943 => 0.7235, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.92% (1.2423 => 1.2910, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.78% (0.3124 => 0.3242, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.25% (1.4479 => 1.4950, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1513800.00% (0.0001 => 1.5139, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 374.20% (0.3585 => 1.7000, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 362.57% (1.5671 => 7.2489, std.dev.: 0.0322) SingleSource/Benchmarks/Shootout/ary3: 305.69% (2.0949 => 8.4989, std.dev.: 0.4887) MultiSource/Benchmarks/PAQ8p/paq8p: 276.22% (91.7701 => 345.2617, std.dev.: 3.4130) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.02% (28.5821 => 85.4661, std.dev.: 0.0820) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 172.91% (5.1305 => 14.0017, std.dev.: 0.0604) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 116.60% (1.1365 => 2.4617, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary: 103.20% (0.0219 => 0.0445, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 64.60% (0.0226 => 0.0372, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 61.83% (2.8760 => 4.6542, std.dev.: 0.0671) MultiSource/Benchmarks/Prolangs-C++/city/city: 53.27% (0.0199 => 0.0305, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.73% (2.7995 => 3.9117, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/pi: 39.52% (1.5795 => 2.2037, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 34.15% (1.3882 => 1.8623, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.31% (4.5327 => 5.9521, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 27.80% (2.9096 => 3.7186, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/misr: 20.49% (0.4001 => 0.4821, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.77% (0.7597 => 0.8947, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.91% (4.7794 => 5.5874, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/salsa20: 14.02% (7.5003 => 8.5518, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.68% (0.3186 => 0.3590, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.93% (1.1857 => 1.3034, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 8.77% (3.1873 => 3.4667, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/ReedSolomon: 7.45% (8.5322 => 9.1682, std.dev.: 0.1416) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3141, std.dev.: 0.0291) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.25% (3.9006 => 4.1445, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.67% (4.9686 => 5.2505, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.38% (4.8436 => 5.1044, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (3.5679 => 3.7595, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.12% (0.5214 => 0.5481, std.dev.: 0.0040) MultiSource/Applications/aha/aha: 4.86% (3.3398 => 3.5021, std.dev.: 0.0410) MultiSource/Benchmarks/sim/sim: 4.86% (3.8206 => 4.0061, std.dev.: 0.0254) MultiSource/Applications/JM/lencod/lencod: 4.73% (6.7064 => 7.0239, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.58% (6.1706 => 6.4531, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/power/power: 3.40% (1.2061 => 1.2471, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/queens: 3.36% (1.7056 => 1.7629, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (4.2466 => 4.3840, std.dev.: 0.0188) SingleSource/Benchmarks/Dhrystone/dry: 3.03% (0.5081 => 0.5235, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4916, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.97% (2.4490 => 2.4973, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/methcall: 1.75% (8.2676 => 8.4121, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.67% (8.2783 => 8.4164, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.54% (1.9302 => 1.9600, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.36% (3.7781 => 3.8294, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.07% (3.7192 => 3.7590, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-3: 1.06% (2.0670 => 2.0889, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: 1.03% (0.9842 => 0.9943, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.16% (2.8951 => 0.8350, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.05% (11.5316 => 4.7224, std.dev.: 0.0371) SingleSource/Benchmarks/Misc/fp-convert: -52.38% (15.8853 => 7.5652, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.32% (4.7482 => 3.0236, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.35% (5.4972 => 3.6088, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.67% (5.4300 => 3.6561, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/ary3: -30.65% (1.9999 => 1.3869, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.72% (5.6343 => 4.1286, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.57% (5.0261 => 3.9921, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.01% (5.0243 => 4.1699, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -15.06% (2.9753 => 2.5273, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.96% (9.9065 => 8.7221, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: -10.16% (63.1822 => 56.7628, std.dev.: 0.0927) SingleSource/Benchmarks/McGill/chomp: -10.07% (1.1216 => 1.0086, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/perlin: -9.43% (5.1084 => 4.6265, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-8: -9.39% (2.5609 => 2.3204, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.19% (6.2275 => 5.6553, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.17% (7.2130 => 6.5515, std.dev.: 0.1315) MultiSource/Benchmarks/Olden/em3d/em3d: -9.09% (5.4641 => 4.9674, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.94% (3.7148 => 3.3826, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.09% (3.2169 => 2.9568, std.dev.: 0.0990) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.29% (5.3218 => 4.9336, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.87% (4.3552 => 4.0559, std.dev.: 0.1026) SingleSource/Benchmarks/Stanford/FloatMM: -6.72% (0.8807 => 0.8215, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.15% (0.3269 => 0.3068, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/sieve: -6.10% (7.0599 => 6.6290, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: -5.53% (9.3748 => 8.8566, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.37% (4.9453 => 4.6795, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.13% (2.8773 => 2.7297, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -4.95% (0.3937 => 0.3742, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: -3.97% (8.9760 => 8.6196, std.dev.: 0.0522) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.14% (5.1557 => 4.9938, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.01% (4.7449 => 4.6023, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.78% (4.9469 => 4.8093, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.77% (6.0224 => 5.8558, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.51% (2.6356 => 2.5695, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fbench: -2.35% (3.3840 => 3.3046, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/hash: -2.25% (4.3087 => 4.2116, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.13% (9.2989 => 9.1005, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.96% (3.3479 => 3.2823, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.79% (4.8362 => 4.7498, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -1.74% (1.0841 => 1.0652, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-5: -1.64% (2.8957 => 2.8481, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.80% (1.0262 => 1.1370, std.dev.: 0.0741) SingleSource/Benchmarks/CoyoteBench/fftbench: 61.35% (0.2463 => 0.3974, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 5.15% (0.1438 => 0.1512, std.dev.: 0.0151) MultiSource/Applications/lemon/lemon: 3.35% (1.1329 => 1.1708, std.dev.: 0.0228) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.18% (0.4164 => 0.4115, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 11.18% (0.1369 => 0.1522, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 41.34% (0.0641 => 0.0906, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.82% (0.0195 => 0.0259, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.31% (1.1437 => 1.2845, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -18.18% (0.0627 => 0.0513, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.56% (0.0180 => 0.0253, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/puzzle: 246.69% (0.8017 => 2.7794, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.16% (0.0062 => 0.0090, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 8.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 23:28:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 01:28:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102072841.279E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7289?compare_to=7286&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7289, Order: 171354, Start Time: 2013-01-02 05:02:57, End Time: 2013-01-02 07:17:13 To: 7286, Order: 171352, Start Time: 2013-01-02 02:17:06, End Time: 2013-01-02 04:31:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (607 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.05% (2.3113 => 2.2870, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.92% (0.0677 => 0.0664, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7503 => 499.8343, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 44223.34% (1.1277 => 499.8343, std.dev.: 0.0121) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.26% (0.5229 => 1.6537, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 20.12% (14.9895 => 18.0049, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 54.38% (14.1553 => 21.8536, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: 17.39% (4.1105 => 4.8255, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.36% (1.1048 => 1.7496, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1225.11% (7.1582 => 94.8538, std.dev.: 0.0490) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.47% (3.4629 => 7.8078, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.45% (0.6222 => 1.1041, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.89% (0.0720 => 7.4476, std.dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 3830100.00% (0.0001 => 3.8302, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 11155900.00% (0.0001 => 11.1560, std.dev.: 0.0625) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66900.00% (0.0001 => 0.0670, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577700.00% (0.0001 => 0.5778, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9957400.00% (0.0001 => 9.9575, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5502100.00% (0.0001 => 5.5022, std.dev.: 0.0176) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.32% (1.1194 => 10.3356, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: 149.32% (22.1758 => 55.2895, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.39% (0.0929 => 0.1713, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.13% (0.1463 => 0.2328, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.55% (2.9384 => 4.6294, std.dev.: 0.0169) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.22% (7.0540 => 10.9494, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.96% (1.5859 => 2.4099, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.21% (8.1363 => 11.9771, std.dev.: 0.0131) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.69% (0.0439 => 0.0622, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.48% (2.2024 => 3.1160, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops: 40.92% (0.1432 => 0.2018, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.79% (21.9371 => 30.8862, std.dev.: 0.0087) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.99% (0.6675 => 0.8877, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.68% (1.5415 => 2.0453, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.58% (0.1062 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.20% (0.4615 => 0.6055, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 30.97% (0.5105 => 0.6686, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 30.72% (0.3109 => 0.4064, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 30.08% (0.4299 => 0.5592, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 29.91% (0.4289 => 0.5572, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.90% (4.2646 => 5.5396, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 29.12% (0.0814 => 0.1051, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 27.73% (0.4620 => 0.5901, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 27.63% (1.1642 => 1.4859, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.56% (0.1125 => 0.1435, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.35% (0.0746 => 0.0950, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 26.80% (1.0722 => 1.3595, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.11% (0.1892 => 0.2386, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 25.80% (0.2554 => 0.3213, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.60% (0.0457 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.29% (0.1906 => 0.2388, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.23% (0.2271 => 0.2844, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 25.02% (0.1175 => 0.1469, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.88% (3.8922 => 4.8604, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: 24.35% (0.6456 => 0.8028, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.90% (0.3121 => 0.3867, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 23.64% (0.0719 => 0.0889, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.38% (1.4186 => 1.7502, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.02% (0.0443 => 0.0545, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.82% (0.0793 => 0.0974, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 22.27% (5.7591 => 7.0416, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0842 => 0.1028, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 22.05% (9.4845 => 11.5762, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.79% (0.0491 => 0.0598, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 21.69% (0.1655 => 0.2014, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.53% (0.1695 => 0.2060, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.15% (0.2700 => 0.3271, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.13% (1.3050 => 1.5808, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/mst/mst: 21.07% (0.1163 => 0.1408, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.00% (0.7115 => 0.8609, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 20.99% (0.3283 => 0.3972, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 20.73% (0.3232 => 0.3902, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 20.69% (0.7835 => 0.9456, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.65% (0.0886 => 0.1069, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 20.29% (0.0626 => 0.0753, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 20.19% (0.1555 => 0.1869, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.94% (0.0672 => 0.0806, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.81% (4.9449 => 5.9247, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.74% (0.2107 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 19.73% (1.1840 => 1.4176, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 19.35% (0.0527 => 0.0629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 19.34% (0.0662 => 0.0790, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.33% (0.5860 => 0.6993, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 19.30% (3.3354 => 3.9792, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 19.17% (0.1695 => 0.2020, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.14% (5.0018 => 5.9589, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.11% (0.0675 => 0.0804, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 18.83% (17.1811 => 20.4158, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.56% (0.1940 => 0.2300, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 18.50% (0.3379 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.46% (0.1143 => 0.1354, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 18.42% (0.1151 => 0.1363, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.89% (0.5020 => 0.5918, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.85% (0.3423 => 0.4034, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.65% (0.5569 => 0.6552, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 17.61% (0.7433 => 0.8742, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.53% (0.0730 => 0.0858, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.49% (0.4636 => 0.5447, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.40% (0.2758 => 0.3238, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.30% (0.3307 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.29% (0.9765 => 1.1453, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 17.17% (2.2969 => 2.6913, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1268 => 0.1485, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 16.67% (3.8723 => 4.5177, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 16.55% (2.0273 => 2.3629, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.22% (0.2065 => 0.2400, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 16.15% (0.8921 => 1.0362, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.10% (0.8101 => 0.9405, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.05% (0.6450 => 0.7485, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.58% (0.3441 => 0.3977, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.77% (1.1861 => 1.3613, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 14.53% (0.3387 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.37% (0.2603 => 0.2977, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.37% (0.1044 => 0.1194, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 14.31% (0.3180 => 0.3635, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 14.30% (0.2049 => 0.2342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.16% (0.8067 => 0.9209, std.dev.: 0.0064) MultiSource/Applications/hbd/hbd: 13.23% (1.5603 => 1.7668, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: 13.08% (0.0818 => 0.0925, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.70% (0.3865 => 0.4356, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.40% (0.3927 => 0.4414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.33% (0.4103 => 0.4609, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: 12.33% (0.3886 => 0.4365, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.28% (0.3282 => 0.3685, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 12.07% (0.1268 => 0.1421, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.58% (14.3668 => 16.0301, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.44% (0.4203 => 0.4684, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 11.30% (0.3098 => 0.3448, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.29% (0.3427 => 0.3814, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.19% (0.4048 => 0.4501, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.99% (0.2430 => 0.2697, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.82% (0.3826 => 0.4240, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 10.71% (0.3603 => 0.3989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.64% (0.3422 => 0.3786, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 10.40% (0.3684 => 0.4067, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.24% (0.4064 => 0.4480, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.08% (0.3650 => 0.4018, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.27% (0.6030 => 0.6589, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.11% (2.0665 => 2.2548, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.82% (0.2756 => 0.2999, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.78% (0.7326 => 0.7969, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 8.75% (63.2438 => 68.7803, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/fibo: 8.73% (0.2725 => 0.2963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.56% (1.2842 => 1.3941, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 8.55% (0.2877 => 0.3123, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.32% (0.2872 => 0.3111, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2802 => 0.3029, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 8.07% (10.3673 => 11.2041, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (2.2022 => 2.3772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3935 => 0.4243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 6.74% (0.3131 => 0.3342, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (7.9617 => 8.2211, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.68% (32.5116 => 59.0676, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3787, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4525, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 5.30% (3.1578 => 3.3251, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.50% (0.9957 => 1.0305, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1069, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9202, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0313 => 1.0547, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.22% (3.6395 => 3.7202, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3434, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.58% (1.7254 => 1.7527, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.37% (4.4649 => 4.5262, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2275, std.dev.: 0.0298) MultiSource/Applications/lemon/lemon: 1.07% (1.4460 => 1.4615, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5741, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1699, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.21% (5.2763 => 1.2026, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -75.00% (0.8651 => 0.2163, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -42.23% (0.1622 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.79% (5.3855 => 4.4812, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.32% (5.3526 => 4.4791, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -12.95% (10.4361 => 9.0844, std.dev.: 0.0207) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9295, std.dev.: 0.0361) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.59% (1.7609 => 1.6448, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.77% (1.9577 => 0.6702, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.14% (8.0499 => 4.0138, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.02% (0.3987 => 0.2471, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4123, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -25.01% (85.0658 => 63.7946, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0075, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3707, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7238, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.40% (1.2258 => 1.0002, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.46% (2.5528 => 2.1327, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7337, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.53% (1.2373 => 1.0947, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: -11.13% (9.5636 => 8.4992, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9127, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4229, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2926, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7063, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.61% (1.6805 => 1.5862, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.22% (0.8614 => 0.8164, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.67% (8.1563 => 7.7755, std.dev.: 0.0168) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.45% (0.4808 => 0.4594, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.36% (10.2830 => 9.8347, std.dev.: 0.0085) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.01% (1.0554 => 1.0342, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3309, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5856, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8550, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0036) Report Time: 37.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 23:49:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 01:49:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130102074958.9B1E62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7290?compare_to=7283&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7290, Order: 171353, Start Time: 2013-01-02 04:13:25, End Time: 2013-01-02 07:46:55 To: 7283, Order: 171351, Start Time: 2013-01-01 23:47:48, End Time: 2013-01-02 03:20:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (181 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1099 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.38% (0.2088 => 0.2263, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.97% (126.2429 => 131.2598, std.dev.: 0.3012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.19% (54.1958 => 54.8408, std.dev.: 0.0790) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.83% (11.6398 => 21.2811, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.82% (0.5361 => 0.8300, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.66% (0.2969 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.57% (0.0714 => 0.0918, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.78% (0.7426 => 0.9489, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.72% (0.4139 => 0.5245, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.31% (0.5900 => 0.7452, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.96% (0.0547 => 0.0689, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.93% (0.4994 => 0.6289, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.73% (1.5932 => 2.0031, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.96% (0.5000 => 0.6248, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.81% (0.4253 => 0.5308, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.69% (0.1620 => 0.2020, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.39% (0.1103 => 0.1350, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.34% (0.3903 => 0.4775, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 22.29% (0.0821 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.21% (0.1549 => 0.1893, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.88% (0.1604 => 0.1955, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.80% (0.0947 => 0.1144, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 20.79% (0.0808 => 0.0976, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.46% (0.2014 => 0.2426, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.41% (0.3890 => 0.4684, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 20.07% (0.5826 => 0.6995, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.04% (0.1088 => 0.1306, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 19.88% (0.4029 => 0.4830, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 19.73% (0.5889 => 0.7051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.54% (0.2866 => 0.3426, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 19.53% (0.1505 => 0.1799, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.52% (0.2736 => 0.3270, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.37% (1.3152 => 1.5700, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.25% (3.5627 => 4.2485, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.85% (4.4195 => 5.2525, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.83% (0.4658 => 0.5535, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 18.77% (0.9697 => 1.1517, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.70% (0.5026 => 0.5966, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.70% (0.1968 => 0.2336, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.66% (0.5546 => 0.6581, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: 18.66% (0.7171 => 0.8509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.65% (0.3271 => 0.3881, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.44% (1.6211 => 1.9201, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 18.44% (1.8794 => 2.2259, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.43% (0.2875 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 18.15% (0.2750 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.91% (0.2792 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.87% (0.1421 => 0.1675, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 17.87% (0.2714 => 0.3199, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 17.78% (0.2823 => 0.3325, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.75% (0.2738 => 0.3224, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 17.73% (0.2803 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.73% (0.2911 => 0.3427, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.72% (0.2725 => 0.3208, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.70% (0.2729 => 0.3212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 17.68% (0.2811 => 0.3308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.67% (0.2813 => 0.3310, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.61% (0.4361 => 0.5129, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.60% (2.7292 => 3.2095, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.53% (0.3930 => 0.4619, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 17.53% (0.9909 => 1.1646, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 17.52% (0.2780 => 0.3267, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.51% (0.3004 => 0.3530, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.48% (2.0673 => 2.4287, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 17.22% (1.0781 => 1.2638, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 17.22% (0.3096 => 0.3629, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.15% (0.3195 => 0.3743, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 17.05% (4.2109 => 4.9290, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.04% (1.9694 => 2.3049, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.83% (0.3060 => 0.3575, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 16.80% (23.5202 => 27.4718, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/football/football: 16.72% (0.2075 => 0.2422, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.70% (0.3258 => 0.3802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.65% (0.3267 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.57% (1.9966 => 2.3275, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.52% (4.6926 => 5.4680, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.45% (0.3124 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.27% (0.3282 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.25% (0.3317 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.12% (0.3362 => 0.3904, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 15.88% (0.3477 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.85% (0.3678 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.80% (0.3348 => 0.3877, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.78% (0.3625 => 0.4197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.65% (0.3726 => 0.4309, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 15.63% (0.4146 => 0.4794, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 15.47% (0.2566 => 0.2963, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 15.35% (0.3446 => 0.3975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.35% (0.3981 => 0.4592, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.31% (0.3690 => 0.4255, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.28% (0.3488 => 0.4021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.27% (0.3465 => 0.3994, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.24% (1.4269 => 1.6444, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 15.22% (0.3469 => 0.3997, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.20% (0.3460 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.19% (0.3442 => 0.3965, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 15.10% (0.4251 => 0.4893, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.08% (0.3845 => 0.4425, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.71% (0.3643 => 0.4179, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.70% (0.7875 => 0.9033, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.69% (2.1653 => 2.4833, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 14.64% (0.2691 => 0.3085, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.55% (4.6177 => 5.2895, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 14.37% (0.5012 => 0.5732, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 14.36% (2.1013 => 2.4030, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.74% (0.1383 => 0.1573, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.71% (0.6435 => 0.7317, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.58% (0.2040 => 0.2317, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: 13.04% (0.4847 => 0.5479, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 12.84% (0.3498 => 0.3947, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.81% (0.3084 => 0.3479, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.79% (5.5417 => 6.2504, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.68% (0.2737 => 0.3084, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.67% (0.2068 => 0.2330, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.35% (0.1028 => 0.1155, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 12.25% (2.0346 => 2.2839, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.97% (0.6634 => 0.7428, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 11.87% (0.3336 => 0.3732, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.2103 => 0.2333, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 10.75% (0.2391 => 0.2648, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.53% (11.9555 => 13.2147, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.56% (0.5584 => 0.6118, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.72% (0.3792 => 0.4009, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.89% (29.0505 => 181.5329, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.15% (0.3693 => 0.3920, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6873, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3105, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0813, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2090, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5954, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4791, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5490, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.61% (17.2379 => 14.2027, std.dev.: 0.0876) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7913, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.79% (0.2402 => 0.2239, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.84% (14.0481 => 13.5086, std.dev.: 0.0938) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2097, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8036, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1850, std.dev.: 0.0416) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1503, std.dev.: 0.0852) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 15.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 1 23:52:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 01:52:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102075206.9635F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7291?compare_to=7287&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7291, Order: 171354, Start Time: 2013-01-02 06:16:10, End Time: 2013-01-02 07:52:32 To: 7287, Order: 171353, Start Time: 2013-01-02 04:11:52, End Time: 2013-01-02 05:48:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (830 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.37% (3.7685 => 3.8580, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.20% (22.4056 => 78.9128, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/lowercase: 64.29% (0.0280 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.18% (0.0717 => 0.1127, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.21% (0.0974 => 0.1502, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 37.45% (0.0267 => 0.0367, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 34.67% (0.1500 => 0.2020, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.47% (1.6474 => 2.0999, std.dev.: 0.0087) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.42% (5.4682 => 6.6396, std.dev.: 0.0322) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.69% (2.2587 => 2.7035, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.35% (0.0680 => 0.0798, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.59% (0.6395 => 0.7392, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.33% (1.1450 => 1.3205, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.93% (0.6395 => 0.7286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.23% (0.6260 => 0.7088, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.20% (0.5941 => 0.6666, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.95% (0.1146 => 0.1283, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.52% (0.5805 => 0.6474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.49% (0.6230 => 0.6946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.47% (0.4524 => 0.5043, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.18% (0.7021 => 0.7806, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.16% (0.6033 => 0.6706, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.10% (0.5849 => 0.6498, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.80% (0.5456 => 0.6045, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.79% (0.6440 => 0.7135, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.76% (0.5688 => 0.6300, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.46% (0.5575 => 0.6158, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.40% (0.5567 => 0.6146, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 10.35% (0.4861 => 0.5364, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.33% (0.5925 => 0.6537, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.26% (0.6676 => 0.7361, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.21% (0.5581 => 0.6151, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.18% (1.6364 => 1.8030, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (0.5802 => 0.6390, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.88% (0.4515 => 0.4961, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.78% (0.5859 => 0.6432, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.55% (0.6052 => 0.6630, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.54% (0.5857 => 0.6416, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.32% (0.6446 => 0.7047, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.18% (0.1982 => 0.2164, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.15% (0.6189 => 0.6755, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.01% (3.5339 => 3.8523, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.99% (0.5570 => 0.6071, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.98% (0.5591 => 0.6093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.96% (0.5478 => 0.5969, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.96% (0.5569 => 0.6068, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.94% (0.5705 => 0.6215, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.88% (0.5329 => 0.5802, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.77% (0.6304 => 0.6857, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.38% (0.6660 => 0.7218, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.10% (0.5863 => 0.6338, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.79% (4.5069 => 4.8582, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.78% (0.6194 => 0.6676, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.56% (0.6297 => 0.6773, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.51% (0.6681 => 0.7183, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 7.42% (0.3357 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.28% (0.7524 => 0.8072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 7.14% (0.3446 => 0.3692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.08% (0.6667 => 0.7139, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.92% (0.3394 => 0.3629, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 6.46% (0.6750 => 0.7186, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.42% (0.7339 => 0.7810, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.56% (1.4642 => 1.5456, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: 5.43% (0.3481 => 0.3670, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 5.28% (18.2933 => 19.2583, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.07% (0.2385 => 0.2506, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.01% (1.2784 => 1.3424, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: 5.00% (1.2515 => 1.3141, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 4.98% (9.2283 => 9.6881, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1740, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 2.78% (17.1032 => 17.5787, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.50% (0.9557 => 0.9796, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.39% (0.4813 => 0.4928, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.96% (1.3864 => 1.4136, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.83% (31.3723 => 55.4770, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4396, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.08% (54.5751 => 56.8041, std.dev.: 0.0427) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1157, std.dev.: 0.0019) MultiSource/Benchmarks/llubenchmark/llu: 3.06% (3.7435 => 3.8580, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3167, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6015, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.88% (0.1584 => 0.1475, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.65% (0.9852 => 0.9394, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.35% (0.3658 => 0.3499, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.12% (0.6484 => 0.6217, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.05% (0.9542 => 0.9156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.65% (0.3812 => 0.3673, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.63% (0.3831 => 0.3692, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.61% (0.3880 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.54% (0.4176 => 0.4028, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.54% (0.3896 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.52% (0.3891 => 0.3754, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3848 => 0.3713, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (2.4924 => 2.4063, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.37% (1.3148 => 1.2705, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -3.36% (4.3330 => 4.1873, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: -3.36% (0.6347 => 0.6134, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.33% (0.7198 => 0.6958, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: -3.32% (0.6441 => 0.6227, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.30% (0.4151 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.16% (0.7779 => 0.7533, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.10% (2.1713 => 2.1039, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.05% (20.7746 => 20.1411, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.03% (0.7919 => 0.7679, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -2.97% (0.7982 => 0.7745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.92% (1.2210 => 1.1854, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.88% (1.2221 => 1.1869, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -2.84% (0.3621 => 0.3518, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.79% (1.0544 => 1.0250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.62% (1.2300 => 1.1978, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.59% (0.4321 => 0.4209, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -2.59% (0.3867 => 0.3767, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.49% (6.7716 => 6.6028, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.48% (14.2083 => 13.8564, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: -2.40% (7.0961 => 6.9259, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.38% (0.8521 => 0.8318, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -2.27% (4.0594 => 3.9671, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: -2.25% (16.1920 => 15.8282, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.98% (34.0927 => 33.4191, std.dev.: 0.0811) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.90% (0.5999 => 0.5885, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: -1.68% (2.1401 => 2.1041, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.59% (0.9077 => 0.8933, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -1.51% (2.4021 => 2.3658, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: -1.30% (1.5610 => 1.5407, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.19% (8.0126 => 7.9175, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.13% (4.0323 => 3.9868, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8274, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -1.05% (15.2527 => 15.0920, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.79% (1.8100 => 0.6916, std.dev.: 0.0127) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -49.89% (8.0445 => 4.0312, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4756, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.50% (0.1622 => 0.1111, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.79% (0.1983 => 0.1432, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.31% (0.2151 => 0.1585, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0279, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.53% (0.2274 => 0.1739, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7580, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0370, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.99% (4.1024 => 3.2002, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.96% (0.0756 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.19% (2.9703 => 2.3707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.66% (3.3454 => 2.7213, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0003, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.67% (2.5106 => 2.1172, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3584, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.36% (5.2027 => 4.8198, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.93% (1.1594 => 1.0907, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9088, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.75% (1.7753 => 1.6909, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4012, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.94% (7.9763 => 7.7416, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2275, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.3096 => 1.2848, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7008, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3040 => 7.1895, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.57% (1.6219 => 1.5965, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.37% (4.8776 => 4.8110, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.35% (1.6307 => 1.6087, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 13.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 00:53:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 02:53:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102085308.12EA12A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7292?compare_to=7288&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7292, Order: 171354, Start Time: 2013-01-02 06:46:01, End Time: 2013-01-02 08:47:20 To: 7288, Order: 171353, Start Time: 2013-01-02 04:24:36, End Time: 2013-01-02 06:22:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 4 (148 on baseline) Performance Improvements: 1 (43 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1055 (785 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.51% (0.3633 => 0.3942, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.37% (0.8103 => 0.8538, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.30% (1.8313 => 1.8735, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.96% (345.2617 => 352.0213, std.dev.: 2.1444) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -1.19% (33.8095 => 33.4083, std.dev.: 0.1112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.28% (1.1370 => 1.1338, std.dev.: 0.1745) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.03% (0.3974 => 0.4015, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0338 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0203 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0217 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.27% (0.0220 => 0.0193, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: - (0.0001 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -0.33% (0.1512 => 0.1507, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -4.70% (1.1708 => 1.1158, std.dev.: 0.4192) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4115 => 0.4046, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.44% (0.1522 => 0.1424, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.53% (0.0906 => 0.0865, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.96% (0.0259 => 0.0184, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.01% (0.0598 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.2845 => 1.2821, std.dev.: 0.1342) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -11.54% (0.0026 => 0.0023, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.96% (0.0513 => 0.0600, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.77% (0.0253 => 0.0246, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.25% (2.7794 => 2.7725, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.22% (0.0090 => 0.0092, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (31.0224 => 30.9705, std.dev.: 0.1733) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 20.80% (16.4461 => 19.8669, std.dev.: 1.4471) MultiSource/Applications/sqlite3/sqlite3: 3497.16% (0.6332 => 22.7772, std.dev.: 1.4213) MultiSource/Benchmarks/McCat/08-main/main: 54.45% (0.1831 => 0.2828, std.dev.: 0.0967) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.35% (0.1559 => 0.1538, std.dev.: 0.0165) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 24335.13% (0.3123 => 76.3109, std.dev.: 8.9064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1843.87% (0.3344 => 6.5003, std.dev.: 0.1433) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.68% (0.2364 => 0.3302, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 17.85% (0.6010 => 0.7083, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/mandel: 0.47% (0.0429 => 0.0431, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.46% (0.3266 => 0.3477, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 5.89% (0.1969 => 0.2085, std.dev.: 0.0073) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0464, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3899, std.dev.: 0.1754) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0752, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4864, std.dev.: 0.0420) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5315, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5154, std.dev.: 0.0933) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0412, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3367, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3656, std.dev.: 0.1075) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0825, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: -30.12% (2.1832 => 1.5256, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 141.77% (0.0249 => 0.0602, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 96.00% (0.0250 => 0.0490, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 69.24% (0.1440 => 0.2437, std.dev.: 0.0280) SingleSource/Regression/C/sumarray: 68.24% (0.0233 => 0.0392, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/factor: 63.97% (0.0297 => 0.0487, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 62.03% (0.8805 => 1.4267, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 61.82% (0.8316 => 1.3457, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 61.80% (0.8359 => 1.3525, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 61.65% (0.7932 => 1.2822, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 61.59% (0.8261 => 1.3349, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 60.87% (0.8716 => 1.4021, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 60.00% (0.8007 => 1.2811, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.59% (0.8611 => 1.3742, std.dev.: 0.1133) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 59.36% (0.8048 => 1.2825, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 59.28% (0.8457 => 1.3470, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.09% (0.8177 => 1.3009, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 58.81% (0.8066 => 1.2810, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 58.36% (0.9056 => 1.4341, std.dev.: 0.0622) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 58.13% (0.8338 => 1.3185, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 57.94% (0.8597 => 1.3578, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.67% (0.8885 => 1.4009, std.dev.: 0.0219) SingleSource/UnitTests/SignlessTypes/shr: 57.07% (0.0191 => 0.0300, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 55.65% (0.9039 => 1.4069, std.dev.: 0.0379) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.42% (1.5315 => 2.3802, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 53.98% (0.9688 => 1.4918, std.dev.: 0.1202) SingleSource/Regression/C/test_indvars: 53.02% (0.0232 => 0.0355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 46.38% (0.0235 => 0.0344, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 41.20% (0.0784 => 0.1107, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.03% (2.1401 => 3.0182, std.dev.: 0.1577) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.08% (3.1832 => 4.2999, std.dev.: 0.1407) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.73% (0.0421 => 0.0563, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.74% (0.0989 => 0.1293, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.31% (0.1983 => 0.2584, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.03% (0.8317 => 1.0815, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.35% (0.8086 => 1.0459, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 28.32% (0.8855 => 1.1363, std.dev.: 0.0294) MultiSource/Applications/sgefa/sgefa: 28.04% (0.2999 => 0.3840, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 27.87% (0.8712 => 1.1140, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 27.66% (0.7966 => 1.0169, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.38% (0.9069 => 1.1552, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 27.37% (0.8050 => 1.0253, std.dev.: 0.0492) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 27.22% (0.8331 => 1.0599, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 27.11% (0.8286 => 1.0532, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.83% (0.8697 => 1.1030, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 26.78% (0.8420 => 1.0675, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 26.77% (0.0650 => 0.0824, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.32% (0.9908 => 1.2516, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 26.27% (0.8069 => 1.0189, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.24% (0.8204 => 1.0357, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.57% (0.9074 => 1.1394, std.dev.: 0.0900) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.16% (0.8927 => 1.1173, std.dev.: 0.0335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.52% (0.6586 => 0.8135, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/ReedSolomon: 23.33% (0.1839 => 0.2268, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 23.11% (1.0945 => 1.3474, std.dev.: 0.0576) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.83% (0.0701 => 0.0847, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 19.89% (0.3800 => 0.4556, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 19.81% (0.1565 => 0.1875, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.64% (0.3295 => 0.3942, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: 19.21% (2.3764 => 2.8329, std.dev.: 0.0794) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.10% (0.1157 => 0.1378, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 18.71% (0.3137 => 0.3724, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/hash2: 18.47% (0.4125 => 0.4887, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.41% (0.1097 => 0.1299, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 17.85% (8.6247 => 10.1645, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.77% (0.1778 => 0.2094, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.59% (0.0773 => 0.0909, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.51% (0.5191 => 0.6100, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.18% (0.0745 => 0.0873, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 16.61% (0.2390 => 0.2787, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 16.30% (0.2227 => 0.2590, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 16.20% (1.2568 => 1.4604, std.dev.: 0.0504) MultiSource/Benchmarks/NPB-serial/is/is: 15.82% (0.0708 => 0.0820, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.68% (0.4127 => 0.4774, std.dev.: 0.0139) MultiSource/Applications/SPASS/SPASS: 15.23% (14.2605 => 16.4325, std.dev.: 0.3459) SingleSource/Benchmarks/Shootout-C++/ary2: 14.99% (0.2509 => 0.2885, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/rem: 14.78% (0.1035 => 0.1188, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.34% (1.6386 => 1.8735, std.dev.: 0.0128) MultiSource/Applications/oggenc/oggenc: 14.31% (4.9628 => 5.6732, std.dev.: 0.1009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.25% (0.7473 => 0.8538, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.12% (0.1756 => 0.2004, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.49% (13.1811 => 14.9596, std.dev.: 0.4274) MultiSource/Benchmarks/Prolangs-C/football/football: 13.44% (0.8768 => 0.9946, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/ary3: 13.39% (0.2427 => 0.2752, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 13.23% (0.0937 => 0.1061, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.37% (0.1091 => 0.1226, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 11.80% (3.2366 => 3.6184, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.74% (0.4847 => 0.5416, std.dev.: 0.0161) MultiSource/Applications/siod/siod: 11.40% (2.2184 => 2.4712, std.dev.: 0.0368) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.27% (1.2602 => 1.4022, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.47% (0.8340 => 0.9213, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.32% (0.1425 => 0.1572, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.87% (0.2998 => 0.3294, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.52% (0.3717 => 0.4071, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.01% (8.6476 => 9.4269, std.dev.: 0.2239) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.50% (1.1685 => 1.2678, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.49% (0.2378 => 0.2580, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.70% (0.2741 => 0.2952, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.06% (0.3115 => 0.3335, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 4.86% (31.8598 => 33.4083, std.dev.: 0.1112) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.61% (0.6943 => 0.7263, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 3.84% (0.2969 => 0.3083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.75% (0.3657 => 0.3794, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 3.59% (0.3645 => 0.3776, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1506200.00% (0.0001 => 1.5063, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 371.46% (0.3585 => 1.6902, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/matrix: 361.85% (1.5671 => 7.2377, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout/ary3: 301.36% (2.0949 => 8.4080, std.dev.: 0.4213) MultiSource/Benchmarks/PAQ8p/paq8p: 283.59% (91.7701 => 352.0213, std.dev.: 2.1444) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.21% (28.5821 => 85.5191, std.dev.: 0.0797) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.26% (5.1305 => 14.0197, std.dev.: 0.0438) SingleSource/Benchmarks/Shootout-C++/ary2: 121.60% (0.0125 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 111.34% (1.1365 => 2.4019, std.dev.: 0.0325) SingleSource/Benchmarks/Shootout-C++/ary: 101.37% (0.0219 => 0.0441, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 61.73% (2.8760 => 4.6513, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/pi: 39.72% (1.5795 => 2.2068, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.55% (2.7995 => 3.9067, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 34.02% (1.3882 => 1.8605, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.63% (4.5327 => 5.9666, std.dev.: 0.1313) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.05% (2.9096 => 3.7256, std.dev.: 0.1285) SingleSource/Benchmarks/McGill/misr: 19.57% (0.4001 => 0.4784, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.34% (0.7597 => 0.8990, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.97% (4.7794 => 5.5903, std.dev.: 0.1282) SingleSource/Benchmarks/Misc/salsa20: 14.39% (7.5003 => 8.5793, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 10.74% (3.1873 => 3.5296, std.dev.: 0.0586) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.22% (1.1857 => 1.3069, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 8.14% (8.5322 => 9.2266, std.dev.: 0.0164) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.36% (23.5781 => 25.3141, std.dev.: 0.0721) SingleSource/Benchmarks/CoyoteBench/lpbench: 6.13% (3.9006 => 4.1396, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.65% (4.9686 => 5.2494, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.54% (4.8436 => 5.1119, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: 5.52% (6.7064 => 7.0765, std.dev.: 0.1266) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.44% (3.5679 => 3.7620, std.dev.: 0.0068) MultiSource/Applications/aha/aha: 5.02% (3.3398 => 3.5075, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.81% (0.5214 => 0.5465, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.75% (6.1706 => 6.4636, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 3.45% (1.2061 => 1.2477, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.36% (4.2466 => 4.3894, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/queens: 3.21% (1.7056 => 1.7604, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 3.09% (1.3037 => 1.3440, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: 2.81% (0.5081 => 0.5224, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4915, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.11% (1.5866 => 1.6200, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/methcall: 1.84% (8.2676 => 8.4200, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.82% (8.2783 => 8.4292, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.48% (1.9302 => 1.9588, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-7: 1.21% (1.7156 => 1.7364, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.04% (2.5697 => 2.5963, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.00% (3.7192 => 3.7564, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.17% (2.8951 => 0.8346, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.26% (11.5316 => 4.6977, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/fp-convert: -52.01% (15.8853 => 7.6239, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.33% (4.7482 => 3.0232, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.58% (5.4972 => 3.5964, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.32% (5.4300 => 3.6750, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: -30.45% (1.9999 => 1.3909, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.66% (5.6343 => 4.1324, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.43% (5.0261 => 3.9991, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.89% (5.0243 => 4.1755, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.76% (2.9753 => 2.5362, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.90% (9.9065 => 8.7272, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.77% (6.3772 => 5.6902, std.dev.: 0.1186) MultiSource/Benchmarks/mafft/pairlocalalign: -10.20% (63.1822 => 56.7364, std.dev.: 0.0337) SingleSource/Benchmarks/Misc/flops-8: -9.47% (2.5609 => 2.3185, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: -9.42% (5.1084 => 4.6270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.23% (7.2130 => 6.5469, std.dev.: 0.1950) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.07% (6.2275 => 5.6627, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: -9.05% (5.4641 => 4.9695, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.60% (3.7148 => 3.3954, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.37% (1.0512 => 0.9632, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.32% (5.3218 => 4.9321, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.19% (3.2169 => 2.9857, std.dev.: 0.0851) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.73% (4.3552 => 4.0619, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout/sieve: -6.11% (7.0599 => 6.6285, std.dev.: 0.0265) SingleSource/Benchmarks/Stanford/FloatMM: -5.95% (0.8807 => 0.8283, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8540, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.41% (0.3937 => 0.3724, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.10% (4.9453 => 4.6932, std.dev.: 0.0245) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.55% (2.8773 => 2.7463, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.79% (1.4529 => 1.3979, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/methcall: -3.38% (8.9760 => 8.6725, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.04% (5.1557 => 4.9992, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: -2.85% (4.3087 => 4.1857, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/fbench: -2.65% (3.3840 => 3.2944, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.65% (6.0224 => 5.8630, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.60% (4.9469 => 4.8182, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.44% (4.7449 => 4.6289, std.dev.: 0.0447) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.02% (9.2989 => 9.1107, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.99% (2.6356 => 2.5832, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/fldry: -1.75% (0.6910 => 0.6789, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: -1.66% (2.8957 => 2.8476, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: -1.34% (2.4416 => 2.4089, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.49% (1.0262 => 1.1338, std.dev.: 0.1745) SingleSource/Benchmarks/CoyoteBench/fftbench: 63.01% (0.2463 => 0.4015, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.64% (0.0408 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.28% (0.0254 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 4.80% (0.1438 => 0.1507, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -1.51% (1.1329 => 1.1158, std.dev.: 0.4192) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.83% (0.4164 => 0.4046, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.02% (0.1369 => 0.1424, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 34.95% (0.0641 => 0.0865, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.64% (0.0195 => 0.0184, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.35% (0.0578 => 0.0580, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.10% (1.1437 => 1.2821, std.dev.: 0.1342) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 64.29% (0.0014 => 0.0023, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.31% (0.0627 => 0.0600, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.67% (0.0180 => 0.0246, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/puzzle: 245.83% (0.8017 => 2.7725, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.39% (0.0062 => 0.0092, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) Report Time: 77.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 02:03:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 04:03:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102100331.AA0F62A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7293?compare_to=7291&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7293, Order: 171355, Start Time: 2013-01-02 08:21:40, End Time: 2013-01-02 09:58:28 To: 7291, Order: 171354, Start Time: 2013-01-02 06:16:10, End Time: 2013-01-02 07:52:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (119 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (829 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.50% (22.4056 => 78.9802, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.18% (0.0717 => 0.1127, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 55.03% (0.0974 => 0.1510, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.53% (0.1500 => 0.2018, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.59% (1.6474 => 2.1020, std.dev.: 0.0143) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.33% (5.4682 => 6.6347, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.27% (0.0790 => 0.0958, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.45% (0.0582 => 0.0701, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.49% (2.2587 => 2.6990, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.39% (0.6395 => 0.7379, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.31% (1.1450 => 1.3203, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.92% (0.6395 => 0.7285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.07% (0.6260 => 0.7078, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.02% (0.5941 => 0.6655, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.95% (0.1146 => 0.1283, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 11.94% (0.4524 => 0.5064, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.65% (0.5805 => 0.6481, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.52% (0.6230 => 0.6948, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.28% (0.7021 => 0.7813, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.19% (0.6033 => 0.6708, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.99% (0.5849 => 0.6492, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.76% (0.5688 => 0.6300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.76% (0.5456 => 0.6043, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.71% (0.6440 => 0.7130, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.54% (0.5567 => 0.6154, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.48% (0.5575 => 0.6159, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (0.6676 => 0.7369, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.35% (0.5925 => 0.6538, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 10.31% (0.4861 => 0.5362, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.27% (0.5581 => 0.6154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.08% (0.5802 => 0.6387, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.06% (1.6364 => 1.8011, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.75% (0.5859 => 0.6430, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 9.75% (0.4515 => 0.4955, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.68% (0.4916 => 0.5392, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.48% (0.5857 => 0.6412, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.37% (0.6052 => 0.6619, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.23% (0.1982 => 0.2165, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.20% (0.6446 => 0.7039, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.15% (0.6189 => 0.6755, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.99% (0.5570 => 0.6071, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.91% (3.5339 => 3.8487, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.91% (0.5591 => 0.6089, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.88% (0.5329 => 0.5802, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.85% (0.5705 => 0.6210, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.85% (0.6304 => 0.6862, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.80% (0.5478 => 0.5960, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.78% (0.5569 => 0.6058, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.36% (0.6660 => 0.7217, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.17% (0.5863 => 0.6342, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.93% (0.6194 => 0.6685, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.81% (4.5069 => 4.8590, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.59% (0.6297 => 0.6775, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 7.51% (0.3357 => 0.3609, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.44% (0.6681 => 0.7178, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 7.14% (0.3446 => 0.3692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.10% (0.7524 => 0.8058, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.06% (0.6667 => 0.7138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.75% (0.3394 => 0.3623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 6.55% (0.6750 => 0.7192, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.31% (0.7339 => 0.7802, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.46% (0.3481 => 0.3671, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.4642 => 1.5435, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2385 => 0.2505, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 5.02% (18.2933 => 19.2119, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 4.91% (9.2283 => 9.6810, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.84% (1.2784 => 1.3403, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 4.67% (1.2515 => 1.3099, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 2.98% (5.0226 => 5.1724, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 2.90% (17.1032 => 17.5985, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.3864 => 1.4132, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.04% (31.3723 => 55.5407, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.58% (0.9531 => 1.0349, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.65% (5.1955 => 5.4373, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1143, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.5751 => 56.3368, std.dev.: 0.1707) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.14% (2.0478 => 2.1122, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3188, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 1.13% (4.4335 => 4.4835, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (0.3821 => 0.3637, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.66% (0.9852 => 0.9393, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.48% (0.3658 => 0.3494, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.33% (0.9542 => 0.9129, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.03% (0.6484 => 0.6223, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.70% (0.3837 => 0.3695, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.61% (0.3880 => 0.3740, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3848 => 0.3710, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.57% (0.4176 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.54% (0.3812 => 0.3677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.49% (0.4151 => 0.4006, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.49% (0.7198 => 0.6947, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -3.47% (0.4033 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.47% (0.3891 => 0.3756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.3831 => 0.3699, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.44% (2.4924 => 2.4067, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3884 => 0.3751, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -3.41% (4.3330 => 4.1852, std.dev.: 0.0130) MultiSource/Applications/hexxagon/hexxagon: -3.38% (1.3148 => 1.2704, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -3.35% (0.6441 => 0.6225, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.33% (0.7919 => 0.7655, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -3.30% (0.3059 => 0.2958, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.29% (0.3252 => 0.3145, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -3.29% (0.4199 => 0.4061, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: -3.19% (0.7982 => 0.7727, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.16% (0.3323 => 0.3218, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.15% (2.1713 => 2.1028, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -3.14% (20.7746 => 20.1226, std.dev.: 0.0210) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.03% (0.3931 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.94% (0.4321 => 0.4194, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.83% (1.2210 => 1.1865, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.81% (1.0544 => 1.0248, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -2.79% (0.3621 => 0.3520, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: -2.69% (0.3867 => 0.3763, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.63% (1.2221 => 1.1899, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.54% (1.2300 => 1.1988, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.45% (6.7716 => 6.6055, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.45% (14.2083 => 13.8602, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: -2.40% (7.0961 => 6.9261, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/moments: -2.38% (0.4248 => 0.4147, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.29% (0.8521 => 0.8326, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -2.26% (4.0594 => 3.9675, std.dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: -2.20% (16.1920 => 15.8364, std.dev.: 0.0270) MultiSource/Benchmarks/Bullet/bullet: -2.00% (34.0927 => 33.4117, std.dev.: 0.0678) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.73% (0.5999 => 0.5895, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -1.66% (2.4021 => 2.3623, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -1.65% (2.1401 => 2.1048, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: -1.39% (1.5610 => 1.5393, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.21% (8.0126 => 7.9153, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.09% (4.0323 => 3.9882, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: -1.07% (15.2527 => 15.0899, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.19% (1.8100 => 0.6843, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.92% (8.0445 => 4.0286, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4756, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.50% (0.1622 => 0.1111, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.89% (0.1983 => 0.1430, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.27% (0.2151 => 0.1586, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -24.67% (1.3643 => 1.0277, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.66% (0.2274 => 0.1736, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0252, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1831, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.80% (3.3454 => 2.7163, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.62% (2.5106 => 2.1184, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3597, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8202, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.38% (1.1594 => 1.0854, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.68% (1.7753 => 1.6922, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2688, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7347, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2273, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7003, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.60% (1.6307 => 1.6046, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3040 => 7.2006, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.29% (4.8776 => 4.8148, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.27% (1.6219 => 1.6013, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: -1.09% (3.7241 => 3.6834, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 20.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 02:25:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 04:25:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102102539.6D4542A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7294?compare_to=7289&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7294, Order: 171355, Start Time: 2013-01-02 08:11:13, End Time: 2013-01-02 10:25:17 To: 7289, Order: 171354, Start Time: 2013-01-02 05:02:57, End Time: 2013-01-02 07:17:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (0.0664 => 0.0671, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8343 => 499.8468, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44224.45% (1.1277 => 499.8468, std.dev.: 0.0035) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.74% (0.5229 => 1.6510, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 20.12% (14.9895 => 18.0050, std.dev.: 0.0251) MultiSource/Applications/kimwitu++/kc: 54.37% (14.1553 => 21.8517, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: 17.13% (4.1105 => 4.8147, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.99% (1.1048 => 1.7455, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1224.14% (7.1582 => 94.7849, std.dev.: 0.0773) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.49% (3.4629 => 7.8084, std.dev.: 0.0438) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.31% (0.6222 => 1.1032, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.25% (0.0720 => 7.4457, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 3829800.00% (0.0001 => 3.8299, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11148500.00% (0.0001 => 11.1486, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577500.00% (0.0001 => 0.5776, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9958700.00% (0.0001 => 9.9588, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5496500.00% (0.0001 => 5.4966, std.dev.: 0.0049) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.91% (1.1194 => 10.3423, std.dev.: 0.0436) MultiSource/Applications/ClamAV/clamscan: 149.10% (22.1758 => 55.2394, std.dev.: 0.2107) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.28% (0.0929 => 0.1712, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 59.13% (0.1463 => 0.2328, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.55% (2.9384 => 4.6294, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.30% (7.0540 => 10.9550, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.92% (1.5859 => 2.4093, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0008) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.23% (8.1363 => 11.9794, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.35% (2.2024 => 3.1130, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 40.92% (0.1432 => 0.2018, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 40.65% (21.9371 => 30.8544, std.dev.: 0.0361) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 36.90% (0.0439 => 0.0601, std.dev.: 0.0009) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.03% (0.6675 => 0.8880, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.77% (0.1062 => 0.1410, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.53% (1.5415 => 2.0430, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.05% (0.5105 => 0.6690, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.01% (0.4615 => 0.6046, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 30.97% (0.3109 => 0.4072, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.81% (4.2646 => 5.5357, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 29.03% (0.4289 => 0.5534, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 27.71% (0.4620 => 0.5900, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 27.55% (1.1642 => 1.4849, std.dev.: 0.0084) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.08% (0.0746 => 0.0948, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.69% (1.0722 => 1.3584, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.11% (0.1892 => 0.2386, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 26.04% (0.2554 => 0.3219, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.23% (0.2271 => 0.2844, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.64% (3.8922 => 4.8513, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 24.40% (0.6456 => 0.8031, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.01% (0.0479 => 0.0594, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.83% (0.0793 => 0.0982, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 23.78% (0.0719 => 0.0890, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.11% (1.4186 => 1.7465, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.96% (0.1337 => 0.1644, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.65% (0.3121 => 0.3828, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 22.30% (5.7591 => 7.0431, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 22.09% (9.4845 => 11.5792, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.59% (0.2700 => 0.3283, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.11% (0.7115 => 0.8617, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 21.08% (0.3283 => 0.3975, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.91% (1.3050 => 1.5779, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 20.70% (0.3232 => 0.3901, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 20.66% (0.1655 => 0.1997, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.60% (0.1029 => 0.1241, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.41% (0.1695 => 0.2041, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 20.32% (0.1555 => 0.1871, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.83% (0.7835 => 0.9389, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.83% (4.9449 => 5.9254, std.dev.: 0.0144) MultiSource/Applications/d/make_dparser: 19.66% (3.3354 => 3.9910, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/messages-2: 19.64% (0.0662 => 0.0792, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 19.54% (0.0527 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.41% (0.0675 => 0.0806, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 19.35% (0.1695 => 0.2023, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.28% (0.5860 => 0.6990, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 19.17% (0.1163 => 0.1386, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.12% (0.0842 => 0.1003, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.09% (5.0018 => 5.9564, std.dev.: 0.0122) MultiSource/Benchmarks/nbench/nbench: 19.05% (1.1840 => 1.4095, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 18.97% (17.1811 => 20.4395, std.dev.: 0.3678) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.71% (0.8172 => 0.9701, std.dev.: 0.0081) MultiSource/Applications/aha/aha: 18.33% (0.1151 => 0.1362, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.28% (0.0886 => 0.1048, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.25% (0.1940 => 0.2294, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.17% (0.2758 => 0.3259, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 18.05% (0.3379 => 0.3989, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.04% (0.1236 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.95% (0.0730 => 0.0861, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 17.92% (0.0614 => 0.0724, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.85% (0.1143 => 0.1347, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.73% (0.5020 => 0.5910, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 17.41% (0.7433 => 0.8727, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.38% (0.9765 => 1.1462, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 17.32% (0.3423 => 0.4016, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 17.27% (0.1268 => 0.1487, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.22% (0.5569 => 0.6528, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 17.17% (2.2969 => 2.6912, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.06% (0.4636 => 0.5427, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.05% (0.3307 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 16.73% (3.8723 => 4.5202, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.70% (0.5981 => 0.6980, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 16.57% (2.0273 => 2.3632, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.42% (0.2065 => 0.2404, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 16.03% (0.8921 => 1.0351, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.94% (0.6450 => 0.7478, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.90% (0.8101 => 0.9389, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.81% (0.3441 => 0.3985, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.78% (1.1861 => 1.3614, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.66% (0.1044 => 0.1197, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 14.59% (0.3180 => 0.3644, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.06% (0.8067 => 0.9201, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/matrix: 13.45% (0.0818 => 0.0928, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 13.37% (0.2049 => 0.2323, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.15% (1.5603 => 1.7655, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.60% (0.3865 => 0.4352, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.22% (0.3282 => 0.3683, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.97% (0.4103 => 0.4594, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.52% (14.3668 => 16.0222, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.46% (0.3543 => 0.3949, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.46% (0.3543 => 0.3949, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.44% (0.4203 => 0.4684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.36% (0.4048 => 0.4508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 11.30% (0.3098 => 0.3448, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 10.82% (0.3603 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.74% (0.3826 => 0.4237, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.74% (0.2430 => 0.2691, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 10.72% (0.3422 => 0.3789, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 10.48% (0.3684 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3650 => 0.4011, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.77% (0.4064 => 0.4461, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: 9.40% (0.2831 => 0.3097, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.39% (0.3162 => 0.3459, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.12% (0.6030 => 0.6580, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.99% (2.0665 => 2.2522, std.dev.: 0.0130) SingleSource/UnitTests/ObjC++/property-reference: 8.76% (0.7326 => 0.7968, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 8.70% (63.2438 => 68.7446, std.dev.: 0.0907) MultiSource/Applications/hexxagon/hexxagon: 8.54% (1.2842 => 1.3939, std.dev.: 0.0056) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 8.45% (0.2877 => 0.3120, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 8.07% (0.2802 => 0.3028, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 8.05% (10.3673 => 11.2018, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.93% (2.2022 => 2.3769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3935 => 0.4242, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.62% (0.3136 => 0.3375, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.21% (0.4879 => 0.5231, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 6.71% (0.3131 => 0.3341, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.98% (0.3817 => 0.3969, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (7.9617 => 8.2174, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.66% (32.5116 => 59.0605, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.15% (1.1396 => 1.2439, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1511) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3789, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (4.2280 => 4.4582, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 5.32% (3.1578 => 3.3259, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (2.0360 => 2.1079, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.40% (0.9957 => 1.0296, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9130, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6395 => 3.7131, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8444 => 28.3471, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.55% (1.7254 => 1.7522, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.42% (4.4649 => 4.5281, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.30% (9.1159 => 9.2347, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4573, std.dev.: 0.0290) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1997, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.87% (5.3855 => 4.4770, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.23% (5.3526 => 4.4838, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: -12.97% (10.4361 => 9.0828, std.dev.: 0.0197) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9408, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (1.7609 => 1.6420, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.98% (1.9577 => 0.6660, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.10% (8.0499 => 4.0173, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.65% (0.0628 => 0.0379, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.97% (0.3987 => 0.2473, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0233, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -30.76% (10.7105 => 7.4158, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: -24.99% (85.0658 => 63.8040, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0046, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -18.57% (3.3453 => 2.7240) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.39% (1.2258 => 1.0004, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.38% (2.5528 => 2.1347, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7329, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std.dev.: 0.0033) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5009, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2529, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.65% (1.6805 => 1.5856, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.01% (0.4808 => 0.4567, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -4.62% (10.2830 => 9.8076, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.28% (8.1563 => 7.8072, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1563, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.98% (1.0554 => 1.0345, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5855, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0029) Report Time: 5.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 03:17:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 05:17:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102111718.457602A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7295?compare_to=7292&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7295, Order: 171357, Start Time: 2013-01-02 09:13:08, End Time: 2013-01-02 11:15:21 To: 7292, Order: 171354, Start Time: 2013-01-02 06:46:01, End Time: 2013-01-02 08:47:20 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 9 (165 on baseline) Performance Improvements: 1 (39 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1050 (772 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: 86.69% (0.2501 => 0.4669, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/ary3: 79.20% (8.4080 => 15.0668, std.dev.: 2.2378) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.38% (4.5937 => 5.5759, std.dev.: 0.1070) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.80% (3.8203 => 4.3474, std.dev.: 0.1714) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.78% (0.3280 => 0.3568, std.dev.: 0.0057) SingleSource/Benchmarks/Linpack/linpack-pc: 4.69% (49.9745 => 52.3180, std.dev.: 0.4262) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (14.0554 => 14.6025, std.dev.: 0.0342) MultiSource/Benchmarks/BitBench/five11/five11: 1.21% (5.6215 => 5.6896, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.13% (3.5964 => 3.6370, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.90% (1.4021 => 1.3615, std.dev.: 0.0106) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.42% (1.1338 => 1.1386, std.dev.: 0.0258) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.26% (0.4015 => 0.4146, std.dev.: 0.0559) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0218 => 0.0218, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0431 => 0.0434, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0336 => 0.0338, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: 0.99% (0.0203 => 0.0205, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/test1: 0.93% (0.0216 => 0.0218, std.dev.: 0.0059) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 21.24% (0.0193 => 0.0234, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.33% (0.1507 => 0.1512, std.dev.: 0.0190) MultiSource/Applications/lemon/lemon: 2.36% (1.1158 => 1.1421, std.dev.: 0.2474) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.57% (0.4046 => 0.3942, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.48% (0.1424 => 0.1502, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.60% (0.0865 => 0.0948, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 48.91% (0.0184 => 0.0274, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.45% (0.0580 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.2821 => 1.2838, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.22% (0.0023 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.17% (0.0600 => 0.0607, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.91% (0.0246 => 0.0263, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (2.7725 => 2.7737, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.05% (30.9705 => 30.9555, std.dev.: 0.1487) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 20.60% (16.4461 => 19.8344, std.dev.: 0.6076) MultiSource/Applications/sqlite3/sqlite3: 3498.75% (0.6332 => 22.7873, std.dev.: 1.6960) MultiSource/Benchmarks/McCat/08-main/main: 54.40% (0.1831 => 0.2827, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -1.60% (0.1559 => 0.1534, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 24158.89% (0.3123 => 75.7605, std.dev.: 15.4261) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1836.00% (0.3344 => 6.4740, std.dev.: 0.3501) SingleSource/Benchmarks/Misc-C++/Large/ray: 45.05% (0.2364 => 0.3429, std.dev.: 0.0799) SingleSource/Benchmarks/Misc-C++/bigfib: 19.42% (0.6010 => 0.7177, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: 7.23% (0.0429 => 0.0460, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.31% (0.3266 => 0.3570, std.dev.: 0.0594) SingleSource/Benchmarks/Shootout-C++/strcat: 6.09% (0.1969 => 0.2089, std.dev.: 0.0766) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.48% (0.0224 => 0.0243, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: -23.91% (0.0230 => 0.0175, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 16.35% (0.1462 => 0.1701, std.dev.: 0.0274) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3877, std.dev.: 0.2035) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0725, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4916, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5318, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5424, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0577, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3374, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3749, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0833, std.dev.: 0.0190) SingleSource/Regression/C/uint64_to_float: -29.53% (2.1832 => 1.5384, std.dev.: 0.0198) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0008) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0008) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 74.41% (0.0297 => 0.0518, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 62.53% (0.8007 => 1.3014, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 62.38% (0.8261 => 1.3414, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 61.61% (0.8359 => 1.3509, std.dev.: 0.1602) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 61.42% (0.8611 => 1.3900, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 61.11% (0.8048 => 1.2966, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 60.87% (0.8805 => 1.4165, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 60.69% (0.7932 => 1.2746, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 60.43% (0.8316 => 1.3341, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 59.76% (0.8457 => 1.3511, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 59.70% (0.8066 => 1.2881, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 58.60% (0.8177 => 1.2969, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 58.26% (0.8597 => 1.3606, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 57.86% (0.9056 => 1.4296, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.34% (0.8885 => 1.3980, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.26% (0.8338 => 1.3112, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 56.88% (0.9039 => 1.4180, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 56.21% (0.8716 => 1.3615, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 55.56% (0.9688 => 1.5071, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.09% (1.5315 => 2.3752, std.dev.: 0.0584) SingleSource/Regression/C/test_indvars: 48.71% (0.0232 => 0.0345, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 46.64% (0.0223 => 0.0327, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 46.30% (0.0784 => 0.1147, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.84% (2.1401 => 3.0141, std.dev.: 0.1647) SingleSource/Benchmarks/CoyoteBench/lpbench: 34.38% (0.0989 => 0.1329, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 34.26% (3.1832 => 4.2738, std.dev.: 0.2090) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.56% (0.1983 => 0.2589, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.23% (0.8050 => 1.0403, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 29.15% (0.8286 => 1.0701, std.dev.: 0.0665) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 29.08% (0.0650 => 0.0839, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 28.23% (0.8712 => 1.1171, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 28.19% (0.9069 => 1.1626, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 28.17% (0.8420 => 1.0792, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/ReedSolomon: 28.06% (0.1839 => 0.2355, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.43% (0.8697 => 1.1083, std.dev.: 0.0873) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 27.28% (0.8317 => 1.0586, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 27.14% (0.8331 => 1.0592, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.34% (0.8204 => 1.0365, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.12% (0.7966 => 1.0047, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.09% (0.8656 => 1.0914, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 26.05% (0.8518 => 1.0737, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.01% (0.9908 => 1.2485, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.84% (0.8069 => 1.0154, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.69% (0.9074 => 1.1405, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.66% (0.8927 => 1.1218, std.dev.: 0.0329) MultiSource/Applications/sgefa/sgefa: 24.94% (0.2999 => 0.3747, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.68% (0.2180 => 0.2718, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.08% (0.4783 => 0.5887, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.37% (0.6586 => 0.8059, std.dev.: 0.0175) MultiSource/Applications/lemon/lemon: 21.73% (1.0945 => 1.3323, std.dev.: 0.0586) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.39% (4.4880 => 5.4482, std.dev.: 0.1175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.75% (0.0848 => 0.1024, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.36% (0.0668 => 0.0804, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 19.69% (0.1112 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 19.40% (2.3764 => 2.8374, std.dev.: 0.0914) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.22% (1.2526 => 1.4933, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/whetstone: 18.70% (0.0722 => 0.0857, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.41% (0.1097 => 0.1299, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 18.39% (0.0745 => 0.0882, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 18.33% (8.6247 => 10.2053, std.dev.: 0.0564) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.65% (0.0810 => 0.0953, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 17.54% (0.1756 => 0.2064, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (1.3279 => 1.5606, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.46% (0.1157 => 0.1359, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/rem: 17.20% (0.1035 => 0.1213, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.53% (0.5191 => 0.6049, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.09% (0.1137 => 0.1320, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 15.99% (1.2222 => 1.4176, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.86% (0.8340 => 0.9663, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.77% (0.4127 => 0.4778, std.dev.: 0.0101) MultiSource/Benchmarks/SciMark2-C/scimark2: 14.63% (0.3137 => 0.3596, std.dev.: 0.0147) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.39% (0.1091 => 0.1248, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 14.28% (0.4397 => 0.5025, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.12% (0.1466 => 0.1673, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.92% (0.8321 => 0.9479, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 13.73% (0.0830 => 0.0944, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 13.57% (0.8768 => 0.9958, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.38% (0.3295 => 0.3736, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.30% (1.6386 => 1.8565, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.24% (13.1811 => 14.9259, std.dev.: 0.1744) MultiSource/Benchmarks/nbench/nbench: 13.20% (1.1271 => 1.2759, std.dev.: 0.0151) MultiSource/Benchmarks/sim/sim: 12.18% (0.3226 => 0.3619, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.76% (0.1905 => 0.2129, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.61% (0.2998 => 0.3346, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 11.55% (0.6834 => 0.7623, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 11.51% (0.1425 => 0.1589, std.dev.: 0.0038) MultiSource/Applications/aha/aha: 10.94% (0.1088 => 0.1207, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 10.93% (0.9435 => 1.0466, std.dev.: 0.0333) MultiSource/Applications/spiff/spiff: 10.88% (0.7950 => 0.8815, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/power/power: 10.67% (0.1247 => 0.1380, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.65% (0.1183 => 0.1309, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.59% (4.1763 => 4.6187, std.dev.: 0.0479) MultiSource/Applications/d/make_dparser: 10.26% (3.2366 => 3.5686, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.23% (0.6010 => 0.6625, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.22% (0.2279 => 0.2512, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 10.19% (2.2184 => 2.4444, std.dev.: 0.0279) MultiSource/Applications/lua/lua: 9.81% (3.8189 => 4.1936, std.dev.: 0.1306) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.46% (0.6227 => 0.6816, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.38% (1.1685 => 1.2781, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/health/health: 9.35% (0.1347 => 0.1473, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.30% (0.4559 => 0.4983, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.28% (0.3717 => 0.4062, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.84% (1.1170 => 1.2157, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/mst/mst: 8.75% (0.1177 => 0.1280, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.72% (4.4873 => 4.8786, std.dev.: 0.0487) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.63% (6.6074 => 7.1773, std.dev.: 0.0583) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.39% (1.1606 => 1.2580, std.dev.: 0.0240) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.17% (0.5961 => 0.6448, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.02% (0.2844 => 0.3072, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.82% (0.2519 => 0.2716, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.76% (4.5702 => 4.9250, std.dev.: 0.0621) MultiSource/Benchmarks/MallocBench/gs/gs: 7.68% (4.1305 => 4.4479, std.dev.: 0.0709) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.18% (0.1588 => 0.1702, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 6.88% (0.3503 => 0.3744, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 6.47% (0.2985 => 0.3178, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.26% (0.6943 => 0.7239, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.60% (1.2423 => 1.2870, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1518100.00% (0.0001 => 1.5182, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout/ary3: 619.21% (2.0949 => 15.0668, std.dev.: 2.2378) MultiSource/Applications/sgefa/sgefa: 370.01% (0.3585 => 1.6850, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: 364.42% (1.5671 => 7.2779, std.dev.: 0.2818) MultiSource/Benchmarks/PAQ8p/paq8p: 278.61% (91.7701 => 347.4528, std.dev.: 5.3567) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.17% (28.5821 => 85.5080, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.35% (5.1305 => 14.0241, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary2: 124.00% (0.0125 => 0.0280, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 114.18% (1.1365 => 2.4341, std.dev.: 0.0887) SingleSource/Benchmarks/Shootout-C++/ary: 106.39% (0.0219 => 0.0452, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 91.15% (0.0226 => 0.0432, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 63.68% (2.8760 => 4.7074, std.dev.: 0.1206) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.58% (2.7995 => 3.9355, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: 36.54% (1.5795 => 2.1566, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.53% (4.5327 => 5.9620, std.dev.: 0.0362) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.45% (1.3882 => 1.8109, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.69% (2.9096 => 3.7444, std.dev.: 0.2251) SingleSource/Benchmarks/Misc-C++/stepanov_container: 22.42% (4.5547 => 5.5759, std.dev.: 0.1070) SingleSource/Benchmarks/McGill/misr: 20.89% (0.4001 => 0.4837, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.17% (0.7597 => 0.9053, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.07% (4.7794 => 5.5951, std.dev.: 0.2091) SingleSource/Benchmarks/Misc/salsa20: 14.14% (7.5003 => 8.5609, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.99% (0.3186 => 0.3568, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 8.76% (8.5322 => 9.2796, std.dev.: 0.1423) MultiSource/Benchmarks/McCat/18-imp/imp: 7.52% (0.1370 => 0.1473, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.45% (23.5781 => 25.3353, std.dev.: 0.2072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.82% (4.9686 => 5.2576, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.69% (0.6150 => 0.6500, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.49% (4.8436 => 5.1096, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.48% (3.5679 => 3.7634, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.20% (0.5214 => 0.5485, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.00% (6.1706 => 6.4789, std.dev.: 0.0176) MultiSource/Benchmarks/sim/sim: 4.82% (3.8206 => 4.0048, std.dev.: 0.0180) MultiSource/Applications/aha/aha: 4.71% (3.3398 => 3.4970, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/richards_benchmark: 4.34% (1.3037 => 1.3603, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.24% (4.2466 => 4.3841, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: 3.08% (1.2061 => 1.2433, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.37% (3.4104 => 3.4912, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/methcall: 1.92% (8.2676 => 8.4266, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.82% (8.2783 => 8.4292, std.dev.: 0.0245) MultiSource/Benchmarks/BitBench/five11/five11: 1.55% (5.6030 => 5.6896, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.36% (4.4340 => 4.4945, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.19% (1.9302 => 1.9532, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: 1.19% (0.9842 => 0.9959, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.12% (2.5697 => 2.5986, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.06% (3.7781 => 3.8182, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.03% (1.8231 => 1.8418, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -70.96% (2.8951 => 0.8406, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.17% (11.5316 => 4.7085, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/fp-convert: -52.54% (15.8853 => 7.5386, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.32% (4.7482 => 3.0237, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.84% (5.4972 => 3.6370, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.55% (5.4300 => 3.6625, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.61% (5.6343 => 4.1352, std.dev.: 0.0770) SingleSource/Benchmarks/Shootout-C++/ary3: -25.34% (1.9999 => 1.4932, std.dev.: 0.1933) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.53% (5.0261 => 3.9943, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.88% (5.0243 => 4.1760, std.dev.: 0.1097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.52% (2.9753 => 2.5434, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.92% (9.9065 => 8.7252, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.53% (7.2130 => 6.3810, std.dev.: 0.1332) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -11.50% (6.3772 => 5.6437, std.dev.: 0.2791) MultiSource/Benchmarks/mafft/pairlocalalign: -9.90% (63.1822 => 56.9300, std.dev.: 0.1391) SingleSource/Benchmarks/Misc/flops-8: -9.72% (2.5609 => 2.3120, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/perlin: -9.36% (5.1084 => 4.6303, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/em3d/em3d: -9.02% (5.4641 => 4.9714, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.86% (6.2275 => 5.6756, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.68% (3.7148 => 3.3925, std.dev.: 0.0467) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.19% (0.3269 => 0.3034, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.15% (5.3218 => 4.9415, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout/sieve: -6.08% (7.0599 => 6.6310, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/flops: -5.42% (9.3748 => 8.8669, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.31% (0.3937 => 0.3728, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.10% (4.9453 => 4.6932, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.72% (2.8773 => 2.7414, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/methcall: -3.39% (8.9760 => 8.6713, std.dev.: 0.0363) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.37% (1.4529 => 1.4040, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -3.03% (29.8330 => 28.9281, std.dev.: 0.2653) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.93% (5.1557 => 5.0046, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.82% (4.7449 => 4.6109, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.45% (4.9469 => 4.8255, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/fbench: -2.37% (3.3840 => 3.3038, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.05% (9.2989 => 9.1083, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.82% (4.8362 => 4.7481, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/flops-5: -1.65% (2.8957 => 2.8480, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -1.58% (3.6643 => 3.6063, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3479 => 3.3014, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.95% (1.0262 => 1.1386, std.dev.: 0.0258) SingleSource/Benchmarks/CoyoteBench/fftbench: 68.33% (0.2463 => 0.4146, std.dev.: 0.0559) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.37% (0.0408 => 0.0434, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.24% (0.0384 => 0.0431, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0059) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 5.15% (0.1438 => 0.1512, std.dev.: 0.0190) MultiSource/Applications/lemon/lemon: 0.81% (1.1329 => 1.1421, std.dev.: 0.2474) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.33% (0.4164 => 0.3942, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.72% (0.1369 => 0.1502, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 47.89% (0.0641 => 0.0948, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.51% (0.0195 => 0.0274, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.25% (1.1437 => 1.2838, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.86% (0.0014 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 245.98% (0.8017 => 2.7737, std.dev.: 0.0100) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.58% (0.0062 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 7.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 04:10:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 06:10:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102121002.2A6782A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7296?compare_to=7293&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7296, Order: 171361, Start Time: 2013-01-02 10:31:46, End Time: 2013-01-02 12:08:44 To: 7293, Order: 171355, Start Time: 2013-01-02 08:21:40, End Time: 2013-01-02 09:58:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (110 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (835 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.88% (1.2688 => 1.2927, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.03% (22.4056 => 78.8745, std.dev.: 0.0831) SingleSource/Benchmarks/Misc/lowercase: 71.07% (0.0280 => 0.0479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 58.30% (0.0717 => 0.1135, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 56.37% (0.0974 => 0.1523, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.61% (0.0514 => 0.0769, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.67% (0.1500 => 0.2020, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 32.05% (0.0599 => 0.0791, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.41% (1.6474 => 2.0989, std.dev.: 0.0074) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.15% (0.0445 => 0.0548, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.52% (0.0790 => 0.0960, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.41% (5.4682 => 6.6389, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.60% (2.2587 => 2.7013, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.94% (0.0680 => 0.0802, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.48% (0.6395 => 0.7385, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 15.37% (1.1450 => 1.3210, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.79% (0.6395 => 0.7277, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.16% (0.6260 => 0.7084, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.05% (0.5941 => 0.6657, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.04% (0.1146 => 0.1284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 11.94% (0.4524 => 0.5064, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.58% (0.5805 => 0.6477, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.56% (0.6230 => 0.6950, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.34% (0.7021 => 0.7817, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.24% (0.6033 => 0.6711, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.96% (0.5849 => 0.6490, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.84% (0.6440 => 0.7138, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.74% (0.5688 => 0.6299, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.70% (0.5456 => 0.6040, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.55% (0.5925 => 0.6550, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.49% (0.5575 => 0.6160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.47% (0.5567 => 0.6150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.39% (0.4861 => 0.5366, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.36% (0.5581 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.32% (1.6364 => 1.8052, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.29% (0.6676 => 0.7363, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.05% (0.5802 => 0.6385, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 9.83% (0.4515 => 0.4959, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.76% (0.4916 => 0.5396, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (0.5859 => 0.6431, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.60% (0.5857 => 0.6419, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.53% (0.6052 => 0.6629, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.26% (0.6446 => 0.7043, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.23% (0.1982 => 0.2165, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.23% (0.6189 => 0.6760, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.03% (0.5570 => 0.6073, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.97% (0.5705 => 0.6217, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.93% (0.5329 => 0.5805, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.91% (3.5339 => 3.8486, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.90% (0.6304 => 0.6865, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.82% (0.5478 => 0.5961, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.80% (0.5569 => 0.6059, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.73% (0.5591 => 0.6079, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.36% (0.6660 => 0.7217, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.27% (0.5863 => 0.6348, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 8.22% (0.3357 => 0.3633, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.07% (0.6194 => 0.6694, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.94% (4.5069 => 4.8646, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.85% (0.6297 => 0.6791, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.39% (0.6681 => 0.7175, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.26% (0.7524 => 0.8070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 7.20% (0.3446 => 0.3694) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.12% (0.6667 => 0.7142, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 6.89% (0.3394 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.56% (0.6750 => 0.7193, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.49% (0.7339 => 0.7815, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.55% (1.4642 => 1.5454, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.43% (0.3481 => 0.3670, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2385 => 0.2509, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 5.19% (18.2933 => 19.2425, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.98% (1.2784 => 1.3421, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 4.95% (9.2283 => 9.6850, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 4.86% (1.2515 => 1.3123, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.04% (5.0226 => 5.1751, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 2.80% (17.1032 => 17.5825, std.dev.: 0.0232) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.35% (0.9557 => 0.9782, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.10% (1.3864 => 1.4155, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.07% (31.3723 => 55.5494, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.66% (5.1955 => 5.4376, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.20% (0.2380 => 0.2480, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.79% (54.5751 => 56.6459, std.dev.: 0.0633) MultiSource/Benchmarks/nbench/nbench: 3.74% (11.6767 => 12.1139, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3177, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6016, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 1.19% (4.4335 => 4.4864, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: 1.01% (7.4937 => 7.5692, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.52% (0.2428 => 0.2294, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.95% (0.3821 => 0.3632, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.58% (0.9852 => 0.9401, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.52% (0.3142 => 0.3000, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.32% (0.3658 => 0.3500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.29% (0.9542 => 0.9133, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.82% (0.6484 => 0.6236, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: -3.67% (0.3812 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.63% (0.3880 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.54% (0.3896 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: -3.52% (0.3831 => 0.3696, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -3.52% (0.4176 => 0.4029, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.44% (0.3891 => 0.3757, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.43% (0.7919 => 0.7647, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.42% (0.7198 => 0.6952, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (2.4924 => 2.4073, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.37% (0.6441 => 0.6224, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.27% (0.4033 => 0.3901, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -3.18% (4.3330 => 4.1953, std.dev.: 0.0089) MultiSource/Applications/hexxagon/hexxagon: -3.16% (1.3148 => 1.2733, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -3.12% (20.7746 => 20.1265, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/parameter-passing: -3.08% (0.4280 => 0.4148, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.06% (0.7779 => 0.7541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3931 => 0.3811, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.03% (2.1713 => 2.1055, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.99% (0.4151 => 0.4027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.88% (1.2210 => 1.1858, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.75% (1.0544 => 1.0254, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.68% (1.2221 => 1.1894, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (0.7982 => 0.7771, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.40% (6.7716 => 6.6091, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.39% (0.4427 => 0.4321, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.39% (14.2083 => 13.8693, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.37% (0.5999 => 0.5857, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -2.31% (7.0961 => 6.9320, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -2.26% (16.1920 => 15.8268, std.dev.: 0.0336) MultiSource/Applications/lua/lua: -2.15% (4.0594 => 3.9722, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2040, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.96% (34.0927 => 33.4258, std.dev.: 0.0628) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8521 => 0.8387, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -1.57% (2.4021 => 2.3645, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -1.56% (2.1401 => 2.1068, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: -1.36% (1.5610 => 1.5397, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -1.10% (15.2527 => 15.0844, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.06% (4.8802 => 4.8285, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9310, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.02% (1.8100 => 0.7055, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.94% (8.0445 => 4.0274, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4758, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.19% (0.6962 => 0.3816, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.32% (0.1622 => 0.1114, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.79% (0.1983 => 0.1432, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.27% (0.2151 => 0.1586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2406, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.27% (1.3643 => 1.0195, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.57% (0.2274 => 0.1738, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0438, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3995, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1994, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1838, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.19% (2.9703 => 2.3707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.86% (3.3454 => 2.7145, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.56% (2.5106 => 2.1200, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1035, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3595, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8213, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.26% (1.1594 => 1.0868, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9083, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.74% (1.7753 => 1.6911, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.26% (7.9763 => 7.7166, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.88% (2.7523 => 2.7005, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1920, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.50% (1.6219 => 1.5976, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4753, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.18% (4.8776 => 4.8200, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.15% (1.6307 => 1.6120, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 04:30:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 06:30:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130102123006.1FE102A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7297?compare_to=7290&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7297, Order: 171355, Start Time: 2013-01-02 08:53:49, End Time: 2013-01-02 12:27:20 To: 7290, Order: 171353, Start Time: 2013-01-02 04:13:25, End Time: 2013-01-02 07:46:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1102 (710 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.93% (11.6398 => 21.1759, std.dev.: 0.0308) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.67% (0.5361 => 0.8292, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.66% (0.2969 => 0.3820, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.15% (0.0714 => 0.0915, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.63% (0.7426 => 0.9478, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.58% (0.1106 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.08% (0.5900 => 0.7498, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.96% (0.4139 => 0.5255, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.20% (0.1107 => 0.1397, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 25.55% (1.5932 => 2.0002, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.41% (0.4994 => 0.6263, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.94% (0.5000 => 0.6247, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.74% (0.4253 => 0.5305, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.51% (0.1620 => 0.2017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.43% (0.1549 => 0.1912, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.82% (0.1604 => 0.1970, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.19% (0.3903 => 0.4769, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 21.87% (0.1619 => 0.1973, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.01% (0.0947 => 0.1146, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 20.79% (0.0808 => 0.0976, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.57% (0.3890 => 0.4690, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.31% (0.2014 => 0.2423, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 20.13% (0.4029 => 0.4840, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.08% (1.3152 => 1.5793, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 20.05% (0.5826 => 0.6994, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.71% (0.2866 => 0.3431, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.63% (0.2736 => 0.3273, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 19.58% (0.5889 => 0.7042, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.45% (3.5627 => 4.2558, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.41% (0.1968 => 0.2350, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.26% (0.3271 => 0.3901, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.95% (4.4195 => 5.2569, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 18.93% (0.9697 => 1.1533, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.81% (0.4658 => 0.5534, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 18.76% (1.8794 => 2.2319, std.dev.: 0.0092) MultiSource/Applications/Burg/burg: 18.72% (0.5546 => 0.6584, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.65% (1.6211 => 1.9235, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.33% (0.2875 => 0.3402, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 17.93% (0.2750 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.86% (0.2911 => 0.3431, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.85% (2.7292 => 3.2164, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.84% (0.3930 => 0.4631, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.82% (0.4361 => 0.5138, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.80% (0.2792 => 0.3289, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.77% (0.7171 => 0.8445, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 17.73% (0.2803 => 0.3300, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.73% (0.5026 => 0.5917, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 17.71% (0.2823 => 0.3323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.70% (0.2813 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.69% (0.2725 => 0.3207, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.68% (0.2738 => 0.3222, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.65% (0.2714 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.59% (0.2729 => 0.3209, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 17.54% (0.2811 => 0.3304, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 17.45% (0.1284 => 0.1508, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.43% (2.0673 => 2.4276, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 17.38% (0.3004 => 0.3526, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 17.37% (0.2780 => 0.3263, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 17.22% (1.0781 => 1.2637, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: 17.20% (0.9909 => 1.1613, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 17.19% (4.2109 => 4.9346, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.15% (0.3195 => 0.3743, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 17.05% (0.3096 => 0.3624, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.89% (1.9694 => 2.3020, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.73% (0.3060 => 0.3572, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.73% (1.9966 => 2.3306, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.70% (0.1090 => 0.1272, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 16.47% (23.5202 => 27.3935, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout-C++/ary3: 16.47% (0.3267 => 0.3805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.45% (0.3258 => 0.3794, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.34% (4.6926 => 5.4596, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.33% (0.3124 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 16.29% (0.2075 => 0.2413, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.18% (0.3362 => 0.3906, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 16.16% (0.3317 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 16.10% (0.2566 => 0.2979, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.06% (0.3282 => 0.3809, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.93% (0.3477 => 0.4031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.93% (0.3678 => 0.4264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 15.89% (0.3348 => 0.3880, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-4: 15.76% (0.3465 => 0.4011, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.73% (0.3446 => 0.3988, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.69% (0.3442 => 0.3982, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.68% (0.3488 => 0.4035, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 15.68% (0.3469 => 0.4013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 15.67% (0.3726 => 0.4310, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.61% (0.3460 => 0.4000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.56% (0.3496 => 0.4040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.51% (0.4146 => 0.4789, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 15.45% (1.4269 => 1.6474, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.42% (0.3625 => 0.4184, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.32% (0.3981 => 0.4591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.26% (0.3690 => 0.4253, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.96% (0.3724 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.91% (0.4251 => 0.4885, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.82% (0.3845 => 0.4415, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 14.79% (0.7875 => 0.9040, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 14.78% (2.1653 => 2.4854, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 14.76% (2.1013 => 2.4115, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 14.64% (0.2691 => 0.3085, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 14.60% (4.6177 => 5.2921, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/bigfib: 14.23% (0.5012 => 0.5725, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (0.2040 => 0.2320, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.66% (0.6435 => 0.7314, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: 13.18% (0.4847 => 0.5486, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 12.95% (5.5417 => 6.2594, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 12.72% (0.3498 => 0.3943, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.58% (0.3084 => 0.3472, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.57% (0.2068 => 0.2328, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 12.32% (0.6634 => 0.7451, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 12.19% (2.0346 => 2.2827, std.dev.: 0.0174) MultiSource/Applications/minisat/minisat: 11.99% (0.3336 => 0.3736, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 10.87% (0.2391 => 0.2651, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.70% (0.2103 => 0.2328, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 10.46% (11.9555 => 13.2064, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.33% (0.5584 => 0.6105, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.12% (0.3792 => 0.4024, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.78% (29.0505 => 181.5030, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.99% (0.3693 => 0.3951, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6688, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.12% (15.4430 => 16.2336, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6835, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 2.95% (0.6276 => 0.6461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1892, std.dev.: 0.0107) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2836, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4808, std.dev.: 0.0063) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.04% (3.1722 => 3.2053, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.68% (25.4195 => 16.6046, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.96% (17.2379 => 14.1412, std.dev.: 0.1540) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7972, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2337, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8009, std.dev.: 0.0143) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1138, std.dev.: 0.0826) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.13% (0.6293 => 0.6159, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1883, std.dev.: 0.0406) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0406, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 5.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 05:16:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 07:16:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102131649.218542A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7298?compare_to=7294&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7298, Order: 171362, Start Time: 2013-01-02 11:02:04, End Time: 2013-01-02 13:16:21 To: 7294, Order: 171355, Start Time: 2013-01-02 08:11:13, End Time: 2013-01-02 10:25:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.25% (3.7094 => 3.6630, std.dev.: 0.0109) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.04% (0.0671 => 0.0664, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8468 => 499.8337, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.29% (1.1277 => 499.8337, std.dev.: 0.0142) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.64% (0.5229 => 1.6557, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 20.12% (14.9895 => 18.0052, std.dev.: 0.0146) MultiSource/Applications/kimwitu++/kc: 54.25% (14.1553 => 21.8344, std.dev.: 0.0521) MultiSource/Benchmarks/MallocBench/gs/gs: 17.62% (4.1105 => 4.8346, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.81% (1.1048 => 1.7435, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1224.46% (7.1582 => 94.8075, std.dev.: 0.0851) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.32% (3.4629 => 7.8025, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.37% (0.6222 => 1.1036, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.11% (0.0720 => 7.4456, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 3830000.00% (0.0001 => 3.8301, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11150000.00% (0.0001 => 11.1501, std.dev.: 0.0546) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64400.00% (0.0001 => 0.0645, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578100.00% (0.0001 => 0.5782, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959200.00% (0.0001 => 9.9593, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503100.00% (0.0001 => 5.5032, std.dev.: 0.0130) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.33% (1.1194 => 10.3358, std.dev.: 0.0347) MultiSource/Applications/ClamAV/clamscan: 149.28% (22.1758 => 55.2792, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.28% (0.0929 => 0.1712, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537) MultiSource/Benchmarks/FreeBench/neural/neural: 59.13% (0.1463 => 0.2328, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.56% (2.9384 => 4.6297, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.21% (7.0540 => 10.9483, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.09% (1.5859 => 2.4120, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.12% (8.1363 => 11.9704, std.dev.: 0.0130) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.46% (2.2024 => 3.1155, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.23% (0.0439 => 0.0620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 40.92% (0.1432 => 0.2018, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 40.71% (21.9371 => 30.8668, std.dev.: 0.0169) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.03% (0.6675 => 0.8880, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.86% (0.1062 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.66% (1.5415 => 2.0450, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 31.59% (0.3109 => 0.4091, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.07% (0.5105 => 0.6691, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.77% (0.4615 => 0.6035, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 30.70% (0.4299 => 0.5619, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.78% (4.2646 => 5.5348, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 29.73% (0.4289 => 0.5564, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 29.12% (0.0814 => 0.1051, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 27.84% (0.4620 => 0.5906, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 27.78% (1.1642 => 1.4876, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.53% (0.1584 => 0.2020, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.21% (0.0746 => 0.0949, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 26.83% (1.0722 => 1.3599, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.00% (0.1892 => 0.2384, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.28% (0.2271 => 0.2845, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.87% (3.8922 => 4.8600, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/bigfib: 24.40% (0.6456 => 0.8031, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.39% (0.1566 => 0.1948, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.80% (0.0479 => 0.0593) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.63% (1.4186 => 1.7538, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: 23.51% (0.0485 => 0.0599, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.89% (0.1337 => 0.1643, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.70% (0.0793 => 0.0973, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.49% (0.3121 => 0.3823, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 22.29% (5.7591 => 7.0429, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 22.14% (9.4845 => 11.5839, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 21.75% (0.1655 => 0.2015, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.62% (0.7115 => 0.8653, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.50% (0.0842 => 0.1023, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.26% (0.2700 => 0.3274, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 21.20% (0.3283 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 21.10% (0.3232 => 0.3914, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.89% (0.1163 => 0.1406, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 20.85% (0.0614 => 0.0742, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.74% (1.3050 => 1.5757, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 20.59% (0.1695 => 0.2044, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.42% (0.7835 => 0.9435, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 20.42% (0.1151 => 0.1386, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.20% (0.0886 => 0.1065, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.86% (4.9449 => 5.9270, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 19.35% (0.0527 => 0.0629, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.34% (3.3354 => 3.9804, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/messages-2: 19.34% (0.0662 => 0.0790, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.26% (0.0675 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.25% (0.5860 => 0.6988, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.04% (5.0018 => 5.9541, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 18.99% (1.1840 => 1.4088, std.dev.: 0.0111) MultiSource/Applications/sqlite3/sqlite3: 18.86% (17.1811 => 20.4220, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.84% (0.8172 => 0.9712, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 18.61% (0.3379 => 0.4008, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.58% (0.3423 => 0.4059, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 18.27% (0.7433 => 0.8791, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.22% (0.2107 => 0.2491, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.99% (0.1940 => 0.2289, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.96% (0.1236 => 0.1458, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.81% (0.5020 => 0.5914, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.76% (0.1143 => 0.1346, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.53% (0.0730 => 0.0858, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.53% (0.5569 => 0.6545, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.49% (0.4636 => 0.5447, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.37% (0.9765 => 1.1461, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.33% (0.2758 => 0.3236, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 17.26% (2.2969 => 2.6934, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.05% (0.3307 => 0.3871, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.77% (3.8723 => 4.5216, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 16.56% (2.0273 => 2.3630, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.52% (0.5981 => 0.6969, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.39% (0.6450 => 0.7507, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.22% (0.2065 => 0.2400, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 16.20% (0.8921 => 1.0366, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.10% (0.8101 => 0.9405, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.66% (0.3441 => 0.3980, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.80% (1.1861 => 1.3616, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.44% (0.2603 => 0.2979, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 14.40% (0.3180 => 0.3638, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 14.15% (0.2049 => 0.2339, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.97% (0.8067 => 0.9194, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 13.85% (0.3387 => 0.3856, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.23% (1.5603 => 1.7667, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 12.96% (0.0818 => 0.0924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.55% (0.3865 => 0.4350, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 12.22% (0.3886 => 0.4361, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 12.19% (0.3282 => 0.3682, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.14% (0.4103 => 0.4601, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.59% (0.4203 => 0.4690, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.59% (0.3694 => 0.4122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.57% (14.3668 => 16.0290, std.dev.: 0.0203) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: 11.49% (0.3473 => 0.3872, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.44% (0.3497 => 0.3897, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 11.30% (0.3098 => 0.3448, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.29% (0.3427 => 0.3814, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 11.17% (0.4048 => 0.4500, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 10.85% (0.3603 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.70% (0.2430 => 0.2690, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.34% (0.3684 => 0.4065, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.03% (0.3162 => 0.3479, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.78% (0.3650 => 0.4007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2831 => 0.3102, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.25% (0.6030 => 0.6588, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.07% (2.0665 => 2.2540, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5925 => 0.6461, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 8.84% (1.2842 => 1.3977, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7326 => 0.7966, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 8.72% (63.2438 => 68.7556, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.48% (0.2877 => 0.3121, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.43% (0.2905 => 0.3150, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.25% (0.2872 => 0.3109, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.14% (0.1438 => 0.1555, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 8.08% (10.3673 => 11.2049, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.3052 => 0.3298, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2802 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.95% (0.3935 => 0.4248, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3754, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 6.71% (0.3131 => 0.3341, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.64% (0.3177 => 0.3388, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3817 => 0.3968, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (7.9617 => 8.2172, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.68% (32.5116 => 59.0658, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.33% (1.1396 => 1.2459, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1511, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3786, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.44% (3.1578 => 3.3297, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4497, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (2.0360 => 2.1077, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.00% (0.9957 => 1.0256, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.6802 => 8.9037, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3423, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.61% (1.7254 => 1.7532, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0055) MultiSource/Applications/viterbi/viterbi: 1.38% (4.4649 => 4.5263, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5761, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1999, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -74.95% (0.8651 => 0.2167, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.85% (5.3855 => 4.4782, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.22% (5.3526 => 4.4844, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -12.84% (10.4361 => 9.0959, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9850, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.63% (1.7609 => 1.6442, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.10% (1.9577 => 0.6637, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.07% (8.0499 => 4.0193, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.02% (0.3987 => 0.2471, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -33.53% (1.5373 => 1.0218, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.74% (10.7105 => 7.4185, std.dev.: 0.0166) MultiSource/Benchmarks/PAQ8p/paq8p: -24.99% (85.0658 => 63.8062, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0073, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.21% (2.5528 => 2.1389, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.21% (1.2373 => 1.0986, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5012, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4230, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2748, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.65% (1.6805 => 1.5856, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.58% (2.7294 => 2.5772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.61% (10.2830 => 9.8089, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.52% (8.1563 => 7.7877, std.dev.: 0.0204) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: -3.49% (0.6223 => 0.6006, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.00% (1.0554 => 1.0343, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3304, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2247, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5891, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0028) Report Time: 8.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 05:40:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 07:40:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102134015.12BCC2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7299?compare_to=7295&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7299, Order: 171364, Start Time: 2013-01-02 11:36:25, End Time: 2013-01-02 13:39:31 To: 7295, Order: 171357, Start Time: 2013-01-02 09:13:08, End Time: 2013-01-02 11:15:21 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 5 (135 on baseline) Performance Improvements: 5 (35 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1050 (806 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.14% (0.8819 => 0.9008, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.74% (1.2468 => 1.3059, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.92% (1.8109 => 1.8819, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.49% (4.8255 => 4.8972, std.dev.: 0.0276) MultiSource/Applications/JM/lencod/lencod: 1.35% (7.0255 => 7.1206, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel24: -37.67% (0.4669 => 0.2910, std.dev.: 0.0651) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.01% (2.4138 => 2.3412, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/matrix: -1.41% (4.7074 => 4.6412, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.15% (5.0087 => 4.9510, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.01% (3.6370 => 3.6003, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.24% (1.1386 => 1.1755, std.dev.: 0.0980) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.93% (0.4146 => 0.3983, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0218 => 0.0219, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0434 => 0.0432, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0338 => 0.0337, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0431 => 0.0432, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0205 => 0.0204, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 0.92% (0.0218 => 0.0220, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.98% (0.0234 => 0.0248, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 7.41% (0.1512 => 0.1624, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 5.65% (1.1421 => 1.2066, std.dev.: 0.0767) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.24% (0.3942 => 0.3991, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.53% (0.1502 => 0.1419, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0948 => 0.0951, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.73% (0.0274 => 0.0272, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.32% (0.0560 => 0.0601, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.2838 => 1.2869, std.dev.: 0.0371) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 66.67% (0.0018 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0607 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.04% (0.0263 => 0.0271, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.43% (2.7737 => 2.7855, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.79% (0.0076 => 0.0064, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.11% (30.9555 => 30.9894, std.dev.: 0.1362) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 26.00% (16.4461 => 20.7223, std.dev.: 0.8909) MultiSource/Applications/sqlite3/sqlite3: 3661.01% (0.6332 => 23.8147, std.dev.: 0.5577) MultiSource/Benchmarks/McCat/08-main/main: 59.69% (0.1831 => 0.2924, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.17% (0.1559 => 0.1494, std.dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 29859.37% (0.3123 => 93.5631, std.dev.: 18.1908) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1834.09% (0.3344 => 6.4676, std.dev.: 0.1869) SingleSource/Benchmarks/Misc-C++/Large/ray: 37.94% (0.2364 => 0.3261, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 16.19% (0.6010 => 0.6983, std.dev.: 0.0332) SingleSource/Benchmarks/Misc/mandel: 3.26% (0.0429 => 0.0443, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.58% (0.3266 => 0.3481, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 3.86% (0.1969 => 0.2045, std.dev.: 0.0066) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 5.80% (0.0224 => 0.0237, std.dev.: 0.0034) SingleSource/UnitTests/byval-alignment: -26.09% (0.0230 => 0.0170, std.dev.: 0.0046) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 12.11% (0.1462 => 0.1639, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3982, std.dev.: 0.0380) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0724, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4921, std.dev.: 0.0177) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5347, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5157, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0434, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3370, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3822, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0773, std.dev.: 0.0079) SingleSource/Regression/C/uint64_to_float: -29.64% (2.1832 => 1.5361, std.dev.: 0.0018) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 145.78% (0.0249 => 0.0612, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 102.80% (0.0250 => 0.0507, std.dev.: 0.0005) SingleSource/Regression/C/sumarray: 72.96% (0.0233 => 0.0403, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 64.98% (0.0297 => 0.0490, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 63.82% (0.1440 => 0.2359, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 62.51% (0.8359 => 1.3584, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 62.46% (0.8805 => 1.4305, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 62.39% (0.7932 => 1.2881, std.dev.: 0.1024) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 61.96% (0.8007 => 1.2968, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 61.82% (0.8261 => 1.3368, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 60.95% (0.8177 => 1.3161, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 60.92% (0.8066 => 1.2980, std.dev.: 0.0804) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 60.70% (0.8048 => 1.2933, std.dev.: 0.0362) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 59.64% (0.8611 => 1.3747, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 59.55% (0.8316 => 1.3268, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 58.25% (0.8338 => 1.3195, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 58.21% (0.8457 => 1.3380, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.47% (0.8885 => 1.3991, std.dev.: 0.0708) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 56.83% (0.8716 => 1.3669, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.68% (1.5315 => 2.3995, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 56.55% (0.9039 => 1.4151, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.48% (0.8597 => 1.3453, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.55% (0.9056 => 1.3996, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 52.33% (0.9688 => 1.4758, std.dev.: 0.0390) SingleSource/Regression/C/test_indvars: 52.16% (0.0232 => 0.0353, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 45.28% (0.0784 => 0.1139, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.76% (2.1401 => 3.0338, std.dev.: 0.0585) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 39.10% (0.0734 => 0.1021, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 37.00% (3.1832 => 4.3609, std.dev.: 0.1024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 31.59% (0.0421 => 0.0554, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 31.41% (0.8855 => 1.1636, std.dev.: 0.0291) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.41% (0.2180 => 0.2843, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 30.16% (0.8204 => 1.0678, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.09% (0.8286 => 1.0779, std.dev.: 0.0689) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 29.14% (0.8712 => 1.1251, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 29.13% (0.0848 => 0.1095, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 28.72% (0.8050 => 1.0362, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 28.33% (0.8317 => 1.0673, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.18% (0.8331 => 1.0679, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.16% (0.8697 => 1.1146, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 28.14% (0.7966 => 1.0208, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.02% (0.8518 => 1.0905, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 27.91% (0.8069 => 1.0321, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 27.71% (0.8420 => 1.0753, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 27.37% (0.8086 => 1.0299, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.37% (0.9069 => 1.1551, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.29% (0.9074 => 1.1550, std.dev.: 0.0285) MultiSource/Applications/sgefa/sgefa: 27.21% (0.2999 => 0.3815, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.66% (0.9908 => 1.2549, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.37% (0.8927 => 1.1192, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.70% (1.3279 => 1.6559, std.dev.: 0.0943) SingleSource/Benchmarks/Misc/ReedSolomon: 24.25% (0.1839 => 0.2285, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 23.91% (0.0757 => 0.0938, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 23.78% (1.0945 => 1.3548, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.76% (0.3295 => 0.4045, std.dev.: 0.0290) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.55% (0.6586 => 0.8071, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.39% (0.4783 => 0.5854, std.dev.: 0.0365) MultiSource/Benchmarks/Olden/tsp/tsp: 22.21% (0.1112 => 0.1359, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 20.55% (0.8768 => 1.0570, std.dev.: 0.0499) SingleSource/Benchmarks/Shootout-C++/hash: 19.66% (0.3800 => 0.4547, std.dev.: 0.0167) MultiSource/Benchmarks/PAQ8p/paq8p: 19.47% (2.3764 => 2.8392, std.dev.: 0.0922) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 19.14% (0.1097 => 0.1307, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 19.04% (8.6247 => 10.2667, std.dev.: 0.1033) MultiSource/Benchmarks/McCat/05-eks/eks: 18.69% (0.4397 => 0.5219, std.dev.: 0.0175) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.95% (0.0830 => 0.0979, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.58% (0.3003 => 0.3531, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.03% (0.5191 => 0.6075, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 16.24% (14.2605 => 16.5760, std.dev.: 0.7147) SingleSource/Benchmarks/Shootout-C++/ary3: 16.23% (0.2427 => 0.2821, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 15.88% (4.9628 => 5.7510, std.dev.: 0.1285) MultiSource/Applications/SIBsim4/SIBsim4: 15.82% (1.2568 => 1.4556, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.94% (0.1466 => 0.1685, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.81% (0.1756 => 0.2016, std.dev.: 0.0059) MultiSource/Applications/lua/lua: 14.39% (3.8189 => 4.3684, std.dev.: 0.1584) MultiSource/Applications/minisat/minisat: 13.33% (0.6834 => 0.7745, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 12.50% (15.3280 => 17.2437, std.dev.: 0.2269) SingleSource/UnitTests/SignlessTypes/rem: 12.46% (0.1035 => 0.1164, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 11.58% (0.0915 => 0.1021, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: 11.11% (6.7320 => 7.4796, std.dev.: 0.2723) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.09% (0.1091 => 0.1212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.91% (0.1301 => 0.1443, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 10.65% (0.3503 => 0.3876, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.55% (0.8148 => 0.9008, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 10.15% (0.1577 => 0.1737, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.91% (0.1150 => 0.1264, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.75% (0.8340 => 0.9153, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.74% (0.3717 => 0.4079, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.28% (0.4559 => 0.4982, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.52% (0.2741 => 0.2947, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 7.03% (0.7557 => 0.8088, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.00% (0.8995 => 0.9625, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/moments: 4.01% (0.3645 => 0.3791, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1513000.00% (0.0001 => 1.5131, std.dev.: 0.0196) MultiSource/Applications/sgefa/sgefa: 374.00% (0.3585 => 1.6993, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 364.82% (1.5671 => 7.2842, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/ary3: 353.07% (2.0949 => 9.4914, std.dev.: 2.4982) MultiSource/Benchmarks/PAQ8p/paq8p: 282.00% (91.7701 => 350.5628, std.dev.: 4.1575) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.47% (28.5821 => 85.5952, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.50% (5.1305 => 14.0319, std.dev.: 0.0285) SingleSource/Benchmarks/Shootout-C++/ary2: 122.40% (0.0125 => 0.0278, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 113.99% (1.1365 => 2.4320, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/ary: 103.65% (0.0219 => 0.0446, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 71.68% (0.0226 => 0.0388, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 61.38% (2.8760 => 4.6412, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/city/city: 53.77% (0.0199 => 0.0306, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 41.04% (2.7995 => 3.9485, std.dev.: 0.0599) SingleSource/Benchmarks/Misc/pi: 36.17% (1.5795 => 2.1508, std.dev.: 0.0280) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 35.56% (1.3882 => 1.8819, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.72% (4.5327 => 5.9706, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.37% (2.9096 => 3.7351, std.dev.: 0.0560) SingleSource/Benchmarks/McGill/misr: 18.55% (0.4001 => 0.4743, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 18.01% (0.7597 => 0.8965, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.71% (4.7794 => 5.5779, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/salsa20: 14.25% (7.5003 => 8.5688, std.dev.: 0.0344) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1129 => 0.1247, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.14% (1.1857 => 1.3059, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 10.10% (3.1873 => 3.5091, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/ReedSolomon: 8.15% (8.5322 => 9.2274, std.dev.: 0.0361) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.38% (23.5781 => 25.3187, std.dev.: 0.1456) MultiSource/Applications/JM/lencod/lencod: 6.18% (6.7064 => 7.1206, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.78% (4.9686 => 5.2559, std.dev.: 0.0056) MultiSource/Benchmarks/sim/sim: 5.39% (3.8206 => 4.0265, std.dev.: 0.0250) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.29% (3.5679 => 3.7566, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.86% (6.1706 => 6.4703, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.12% (2.2485 => 2.3412, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/power/power: 3.55% (1.2061 => 1.2489, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.28% (4.2466 => 4.3860, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/queens: 3.05% (1.7056 => 1.7576, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.88% (0.4031 => 0.4147, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4916, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 2.38% (2.3560 => 2.4120, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.86% (8.2783 => 8.4326, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/methcall: 1.17% (8.2676 => 8.3643, std.dev.: 0.0306) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.11% (2.5697 => 2.5983, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.08% (3.7192 => 3.7594, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.17% (2.8951 => 0.8346, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.41% (11.5316 => 4.6804, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/fp-convert: -52.19% (15.8853 => 7.5940, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.35% (4.7482 => 3.0222, std.dev.: 0.1345) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.51% (5.4972 => 3.6003, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.96% (5.4300 => 3.6405, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/ary3: -29.76% (1.9999 => 1.4047, std.dev.: 0.1845) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.66% (5.6343 => 4.1322, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.38% (5.0261 => 4.0017, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -17.05% (5.0243 => 4.1679, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.92% (2.9753 => 2.5313, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.95% (9.9065 => 8.7230, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/chomp: -10.16% (1.1216 => 1.0076, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.16% (7.2130 => 6.4805, std.dev.: 0.0829) MultiSource/Benchmarks/mafft/pairlocalalign: -9.98% (63.1822 => 56.8754, std.dev.: 0.1171) SingleSource/Benchmarks/Misc/flops-8: -9.45% (2.5609 => 2.3189, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/perlin: -9.40% (5.1084 => 4.6282, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.17% (6.2275 => 5.6563, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: -8.96% (5.4641 => 4.9744, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.93% (3.7148 => 3.3829, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.35% (5.3218 => 4.9305, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/sieve: -6.15% (7.0599 => 6.6260, std.dev.: 0.0362) SingleSource/Benchmarks/Stanford/FloatMM: -6.04% (0.8807 => 0.8275, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops: -5.49% (9.3748 => 8.8604, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.26% (0.3937 => 0.3730, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.16% (4.3552 => 4.1305, std.dev.: 0.0610) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (8.9760 => 8.6789, std.dev.: 0.0219) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.10% (1.4529 => 1.4078, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.09% (5.1557 => 4.9962, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.79% (6.0224 => 5.8545, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.38% (4.7449 => 4.6319, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.24% (9.2989 => 9.0902, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/fbench: -1.98% (3.3840 => 3.3171, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-5: -1.59% (2.8957 => 2.8497, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/neural/neural: -1.08% (1.0841 => 1.0724, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 14.55% (1.0262 => 1.1755, std.dev.: 0.0980) SingleSource/Benchmarks/CoyoteBench/fftbench: 61.71% (0.2463 => 0.3983, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.05% (0.0123 => 0.0219, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.50% (0.0384 => 0.0432, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 22.22% (0.0180 => 0.0220, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 12.93% (0.1438 => 0.1624, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 6.51% (1.1329 => 1.2066, std.dev.: 0.0767) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4164 => 0.3991, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.65% (0.1369 => 0.1419, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 48.36% (0.0641 => 0.0951, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.49% (0.0195 => 0.0272, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0578 => 0.0601, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.52% (1.1437 => 1.2869, std.dev.: 0.0371) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.39% (0.0627 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.56% (0.0180 => 0.0271, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.45% (0.8017 => 2.7855, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.23% (0.0062 => 0.0064, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 7.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 06:24:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 08:24:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102142402.49ED42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7300?compare_to=7296&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7300, Order: 171373, Start Time: 2013-01-02 12:45:33, End Time: 2013-01-02 14:22:41 To: 7296, Order: 171361, Start Time: 2013-01-02 10:31:46, End Time: 2013-01-02 12:08:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (112 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (836 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.44% (29.0450 => 29.7526, std.dev.: 0.0259) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.33% (22.4056 => 78.9423, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.18% (0.0717 => 0.1127, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.31% (0.0974 => 0.1503, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.57% (1.6474 => 2.1016, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.74% (5.4682 => 6.6572, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.27% (0.0790 => 0.0958, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.66% (2.2587 => 2.7027, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.70% (0.6395 => 0.7399, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.28% (1.1450 => 1.3199, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.17% (0.6395 => 0.7301, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.15% (0.6260 => 0.7083, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 12.33% (0.4524 => 0.5082, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.14% (0.5941 => 0.6662, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.04% (0.1146 => 0.1284, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.54% (0.5805 => 0.6475, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.44% (0.6230 => 0.6943, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.35% (0.7021 => 0.7818, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.16% (0.6033 => 0.6706, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.04% (0.5849 => 0.6495, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.02% (0.5456 => 0.6057, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.87% (0.6440 => 0.7140, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.78% (0.5688 => 0.6301, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 10.53% (0.4861 => 0.5373, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.44% (0.5567 => 0.6148, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.37% (0.5575 => 0.6153, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 10.37% (0.4515 => 0.4983, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.36% (0.5925 => 0.6539, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.32% (0.5581 => 0.6157, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.31% (0.6676 => 0.7364, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.19% (1.6364 => 1.8032, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (0.5802 => 0.6390, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.76% (0.5859 => 0.6431, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.64% (0.4916 => 0.5390, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.56% (0.5857 => 0.6417, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.42% (0.6052 => 0.6622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.39% (0.6446 => 0.7051, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.38% (0.1982 => 0.2168, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.18% (0.6189 => 0.6757, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.00% (3.5339 => 3.8518, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.98% (0.5570 => 0.6070, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.96% (0.5478 => 0.5969, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.92% (0.5705 => 0.6214, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.86% (0.5329 => 0.5801, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.85% (0.5591 => 0.6086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.82% (0.6304 => 0.6860, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.82% (0.5569 => 0.6060, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.41% (0.6660 => 0.7220, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.17% (0.5863 => 0.6342, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.98% (0.6194 => 0.6688, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.85% (4.5069 => 4.8607, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.70% (0.6297 => 0.6782, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.63% (0.3357 => 0.3613, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 7.52% (0.3446 => 0.3705, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.50% (0.6681 => 0.7182, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 7.28% (0.3394 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.26% (0.7524 => 0.8070, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.14% (0.6667 => 0.7143, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 6.76% (0.6750 => 0.7206, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.70% (0.2001 => 0.2135, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.25% (0.7339 => 0.7798, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 5.49% (0.3481 => 0.3672, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.47% (1.4642 => 1.5443, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.16% (0.2385 => 0.2508, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 5.05% (18.2933 => 19.2172, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 4.93% (9.2283 => 9.6837, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.90% (1.2784 => 1.3411, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 4.88% (1.2515 => 1.3126, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1740, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 2.78% (17.1032 => 17.5779, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.9557 => 0.9790, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.3864 => 1.4153, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.01% (31.3723 => 55.5312, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9531 => 1.0273, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4398, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1146, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5303, std.dev.: 0.0949) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.09% (2.0478 => 2.1111, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3180, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 1.14% (4.4335 => 4.4842, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.2428 => 0.2293, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.95% (0.3821 => 0.3632, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.74% (0.3142 => 0.2993, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.60% (0.9852 => 0.9399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.43% (0.3658 => 0.3496, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.27% (0.9542 => 0.9135, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.93% (0.6484 => 0.6229, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.57% (0.3812 => 0.3676, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.54% (0.3837 => 0.3701, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.53% (0.3880 => 0.3743, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.52% (0.3831 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.4176 => 0.4031, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (2.4924 => 2.4064, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.42% (0.4033 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.40% (0.7198 => 0.6953, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.39% (0.3891 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.27% (0.7919 => 0.7660, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.25% (0.4151 => 0.4016, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.23% (0.6441 => 0.6233, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.19% (0.3323 => 0.3217, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -3.18% (4.3330 => 4.1950, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.07% (1.3148 => 1.2744, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.05% (20.7746 => 20.1409, std.dev.: 0.0244) SingleSource/UnitTests/ObjC++/property-reference: -2.98% (0.7779 => 0.7547, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.98% (0.3931 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.94% (0.4321 => 0.4194, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.94% (0.3884 => 0.3770, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.91% (2.1713 => 2.1082, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4280 => 0.4156, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.90% (1.2221 => 1.1867, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.86% (1.0544 => 1.0242, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.85% (1.2210 => 1.1862, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -2.81% (0.7982 => 0.7758, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8591, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6079, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.37% (0.4427 => 0.4322, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -2.33% (7.0961 => 6.9309, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.28% (0.8521 => 0.8327, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8383, std.dev.: 0.0111) MultiSource/Applications/lua/lua: -2.05% (4.0594 => 3.9763, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.95% (0.5999 => 0.5882, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.93% (34.0927 => 33.4347, std.dev.: 0.0414) MultiSource/Benchmarks/Prolangs-C/football/football: -1.83% (0.9179 => 0.9011, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -1.53% (2.1401 => 2.1074, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -1.35% (1.5610 => 1.5399, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: -1.18% (15.2527 => 15.0727, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.12% (8.0126 => 7.9227, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8277, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.13% (1.8100 => 0.6674, std.dev.: 0.0186) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.90% (8.0445 => 4.0300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4759, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.44% (0.1622 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.84% (0.1983 => 0.1431, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.36% (0.2151 => 0.1584, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.61% (0.2274 => 0.1737, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7592, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0350, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3991, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1835, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -18.64% (3.3454 => 2.7218, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -15.61% (2.5106 => 2.1186, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7052, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3587, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.70% (0.5142 => 0.4643, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.34% (5.2027 => 4.8209, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.42% (1.1594 => 1.0966, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.71% (1.7753 => 1.6917, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.73% (6.5803 => 6.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.02% (7.9763 => 7.7351, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2275, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.83% (1.3096 => 1.2725, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.88% (2.7523 => 2.7006, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.71% (6.5735 => 6.4612, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3040 => 7.2009, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.26% (4.8776 => 4.8163, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6219 => 1.6027, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.05% (1.6307 => 1.6135, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 5.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 08:04:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 10:04:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102160400.BFF822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7301?compare_to=7299&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7301, Order: 171384, Start Time: 2013-01-02 14:00:42, End Time: 2013-01-02 16:01:08 To: 7299, Order: 171364, Start Time: 2013-01-02 11:36:25, End Time: 2013-01-02 13:39:31 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 6 (168 on baseline) Performance Improvements: 2 (39 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1052 (769 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 4.32% (0.2821 => 0.2943, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.01% (2.3412 => 2.4117, std.dev.: 0.0272) SingleSource/Benchmarks/Misc/pi: 2.72% (2.1508 => 2.2093, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.03% (3.9551 => 4.0352, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.60% (4.6804 => 4.7551, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.18% (1.4276 => 1.4445, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/05-eks/eks: -2.85% (0.5219 => 0.5070, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.46% (0.8965 => 0.8834, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.41% (1.1755 => 1.1589, std.dev.: 0.0305) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.23% (0.3983 => 0.3992, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.46% (0.0219 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0432 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0337 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0432 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.36% (0.0220 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.02% (0.0248 => 0.0253, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.22% (0.1624 => 0.1523, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -3.27% (1.2066 => 1.1672, std.dev.: 0.2014) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.00% (0.3991 => 0.4031, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.41% (0.1419 => 0.1439, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.79% (0.0951 => 0.0968, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.84% (0.0272 => 0.0277, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.83% (0.0601 => 0.0590, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.2869 => 1.2861, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.33% (0.0030 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0612 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0271 => 0.0271, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.72% (2.7855 => 2.7654, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.69% (0.0064 => 0.0099, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (30.9894 => 30.9461, std.dev.: 0.1495) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 22.97% (16.4461 => 20.2232, std.dev.: 0.4457) MultiSource/Applications/sqlite3/sqlite3: 3659.35% (0.6332 => 23.8042, std.dev.: 0.1466) MultiSource/Benchmarks/McCat/08-main/main: 55.38% (0.1831 => 0.2845, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.67% (0.1559 => 0.1585, std.dev.: 0.0440) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23692.12% (0.3123 => 74.3028, std.dev.: 15.9719) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1838.37% (0.3344 => 6.4819, std.dev.: 0.2888) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.16% (0.2364 => 0.3266, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 16.26% (0.6010 => 0.6987, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/mandel: 7.23% (0.0429 => 0.0460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.77% (0.3266 => 0.3487, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/strcat: 5.08% (0.1969 => 0.2069, std.dev.: 0.0030) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0043) SingleSource/UnitTests/byval-alignment: -23.91% (0.0230 => 0.0175, std.dev.: 0.0057) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0518, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 16.83% (0.1462 => 0.1708, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4054, std.dev.: 0.0279) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0698, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4913, std.dev.: 0.0880) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5309, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5187, std.dev.: 0.0291) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0422, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3365, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3827, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0790, std.dev.: 0.0023) SingleSource/Regression/C/uint64_to_float: -29.80% (2.1832 => 1.5327, std.dev.: 0.0335) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 147.79% (0.0249 => 0.0617, std.dev.: 0.0018) SingleSource/Regression/C/sumarray2d: 104.00% (0.0250 => 0.0510, std.dev.: 0.0098) SingleSource/Regression/C/sumarray: 75.54% (0.0233 => 0.0409, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 71.38% (0.0297 => 0.0509, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 64.88% (0.8007 => 1.3202, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 63.33% (0.8066 => 1.3174, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 62.49% (0.8316 => 1.3513, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 62.38% (0.7932 => 1.2880, std.dev.: 0.0491) MultiSource/Benchmarks/FreeBench/neural/neural: 62.29% (0.1440 => 0.2337, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 61.97% (0.8359 => 1.3539, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 61.33% (0.8048 => 1.2984, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 60.90% (0.8611 => 1.3855, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 60.53% (0.8261 => 1.3261, std.dev.: 0.0763) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 60.40% (0.8457 => 1.3565, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 60.38% (0.8716 => 1.3979, std.dev.: 0.1743) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 60.27% (0.8805 => 1.4112, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 60.27% (0.8177 => 1.3105, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 59.23% (0.8338 => 1.3277, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 58.49% (0.8597 => 1.3625, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.94% (0.8885 => 1.4033, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 57.52% (0.9039 => 1.4238, std.dev.: 0.0968) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 56.59% (0.9056 => 1.4181, std.dev.: 0.0633) SingleSource/Regression/C/test_indvars: 54.74% (0.0232 => 0.0359, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 54.36% (0.9688 => 1.4954, std.dev.: 0.0353) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.14% (1.5315 => 2.3607, std.dev.: 0.0705) SingleSource/UnitTests/Vector/multiplies: 47.09% (0.0223 => 0.0328, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.68% (2.1401 => 3.0106, std.dev.: 0.1008) SingleSource/Benchmarks/McGill/exptree: 39.54% (0.0784 => 0.1094, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.87% (0.0734 => 0.1012, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 34.45% (3.1832 => 4.2797, std.dev.: 0.2245) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.73% (0.0421 => 0.0563, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.43% (0.0989 => 0.1290, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 28.19% (0.1983 => 0.2542, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 28.13% (0.8286 => 1.0617, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 27.40% (0.0635 => 0.0809, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.97% (0.2180 => 0.2768, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.58% (0.8656 => 1.0957, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.57% (0.8204 => 1.0384, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 26.25% (0.8069 => 1.0187, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.11% (0.8050 => 1.0152, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 26.09% (0.8420 => 1.0617, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.00% (0.7966 => 1.0037, std.dev.: 0.0726) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 25.89% (0.8317 => 1.0470, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.69% (0.8518 => 1.0706, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.66% (0.8331 => 1.0469, std.dev.: 0.0513) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 25.53% (0.0701 => 0.0880, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.49% (0.8086 => 1.0147, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 25.34% (0.9074 => 1.1373, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 25.15% (0.9908 => 1.2400, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.85% (0.8927 => 1.1145, std.dev.: 0.0827) MultiSource/Applications/lemon/lemon: 24.13% (1.0945 => 1.3586, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/ReedSolomon: 23.87% (0.1839 => 0.2278, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.73% (4.4880 => 5.5529, std.dev.: 0.1041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.70% (0.0810 => 0.1002, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.26% (0.6586 => 0.8052, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 22.06% (0.0757 => 0.0924, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.82% (0.0848 => 0.1033, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.80% (1.3279 => 1.6174, std.dev.: 0.0875) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.66% (0.4783 => 0.5819, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 21.26% (0.2427 => 0.2943, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 20.40% (0.0745 => 0.0897, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 19.74% (0.1565 => 0.1874, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 19.32% (0.3800 => 0.4534, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.16% (0.0668 => 0.0796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 19.12% (0.2390 => 0.2847, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 18.71% (0.1112 => 0.1320, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 18.65% (2.3764 => 2.8196, std.dev.: 0.0452) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.56% (0.1137 => 0.1348, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 18.36% (8.6247 => 10.2082, std.dev.: 0.3029) SingleSource/Benchmarks/Shootout-C++/hash2: 18.35% (0.4125 => 0.4882, std.dev.: 0.0278) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 17.14% (0.1097 => 0.1285, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.11% (0.0830 => 0.0972, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.95% (0.0773 => 0.0904, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 16.82% (0.1778 => 0.2077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.30% (0.2509 => 0.2918, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.28% (0.5191 => 0.6036, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 15.31% (0.4397 => 0.5070, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.83% (1.2602 => 1.4471, std.dev.: 0.0492) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.75% (0.1756 => 0.2015, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 14.72% (0.0829 => 0.0951, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 14.41% (0.0708 => 0.0810, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.39% (0.1466 => 0.1677, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.02% (1.6386 => 1.8684, std.dev.: 0.0429) MultiSource/Applications/SIBsim4/SIBsim4: 13.96% (1.2568 => 1.4323, std.dev.: 0.0094) MultiSource/Applications/oggenc/oggenc: 13.67% (4.9628 => 5.6410, std.dev.: 0.1251) MultiSource/Applications/minisat/minisat: 13.42% (0.6834 => 0.7751, std.dev.: 0.0110) MultiSource/Applications/lua/lua: 12.88% (3.8189 => 4.3106, std.dev.: 0.0624) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.79% (0.1885 => 0.2126, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 12.04% (0.1088 => 0.1219, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.04% (0.8148 => 0.9129, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.02% (0.1905 => 0.2134, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 11.90% (0.3226 => 0.3610, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 11.71% (1.4269 => 1.5940, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.28% (1.1170 => 1.2430, std.dev.: 0.0472) MultiSource/Benchmarks/Olden/em3d/em3d: 11.21% (0.1721 => 0.1914, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 11.09% (14.7684 => 16.4057, std.dev.: 0.1211) MultiSource/Applications/JM/lencod/lencod: 10.90% (15.3280 => 16.9984, std.dev.: 0.2215) MultiSource/Benchmarks/Olden/power/power: 10.59% (0.1247 => 0.1379, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.42% (0.6227 => 0.6876, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.40% (0.1183 => 0.1306, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.06% (0.8340 => 0.9179, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 9.86% (0.1177 => 0.1293, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.38% (0.1301 => 0.1423, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 9.26% (0.1577 => 0.1723, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.10% (0.4559 => 0.4974, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.06% (0.2240 => 0.2443, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: 9.04% (6.7320 => 7.3404, std.dev.: 0.1635) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.88% (0.3717 => 0.4047, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/bh/bh: 8.81% (0.2985 => 0.3248, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.12% (0.3115 => 0.3368, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 8.06% (0.1588 => 0.1716, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 8.02% (0.3503 => 0.3784, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.02% (0.2794 => 0.3018, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.27% (0.8995 => 0.9649, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.42% (0.2741 => 0.2917, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 5.56% (0.2088 => 0.2204, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 4.72% (0.3263 => 0.3417, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.32% (0.2844 => 0.2967, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1509700.00% (0.0001 => 1.5098, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 373.92% (0.3585 => 1.6990, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 362.06% (1.5671 => 7.2410, std.dev.: 0.0930) MultiSource/Benchmarks/PAQ8p/paq8p: 282.88% (91.7701 => 351.3690, std.dev.: 2.6567) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.15% (28.5821 => 85.5044, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.97% (5.1305 => 14.0559, std.dev.: 0.0414) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 114.13% (1.1365 => 2.4336, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary: 108.68% (0.0219 => 0.0457, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 63.42% (2.8760 => 4.6999, std.dev.: 0.1483) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.20% (2.7995 => 3.9249, std.dev.: 0.1006) SingleSource/Benchmarks/Misc/pi: 39.87% (1.5795 => 2.2093, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 36.91% (1.3882 => 1.9006, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.54% (4.5327 => 5.9621, std.dev.: 0.0500) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.69% (2.9096 => 3.7445, std.dev.: 0.0528) SingleSource/Benchmarks/McGill/misr: 18.40% (0.4001 => 0.4737, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.84% (4.7794 => 5.5841, std.dev.: 0.0598) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.28% (0.7597 => 0.8834, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: 14.56% (7.5003 => 8.5923, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.61% (0.3186 => 0.3556, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.28% (1.1857 => 1.3076, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 9.23% (3.1873 => 3.4814, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/ReedSolomon: 7.89% (8.5322 => 9.2057, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.33% (23.5781 => 25.3065, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.26% (2.2485 => 2.4117, std.dev.: 0.0272) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.82% (0.6150 => 0.6508, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.66% (4.9686 => 5.2496, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.64% (0.3140 => 0.3317, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.59% (4.8436 => 5.1145, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.49% (3.5679 => 3.7636, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 4.93% (3.8206 => 4.0088, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 4.88% (6.7064 => 7.0340, std.dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.80% (1.0388 => 1.0887, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.77% (6.1706 => 6.4652, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.41% (0.5214 => 0.5444, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: 4.39% (1.3037 => 1.3609, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/power/power: 3.59% (1.2061 => 1.2494, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/queens: 3.39% (1.7056 => 1.7634, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.23% (0.4031 => 0.4161, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.11% (4.2466 => 4.3785, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/dry: 2.81% (0.5081 => 0.5224, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.36% (3.4104 => 3.4910, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 2.19% (2.3560 => 2.4075, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout/methcall: 2.13% (8.2676 => 8.4435, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.72% (8.2783 => 8.4210, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.69% (1.4205 => 1.4445, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-7: 1.20% (1.7156 => 1.7362, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.10% (1.9302 => 1.9515, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (3.7192 => 3.7599, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.07% (1.5941 => 1.6111, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.06% (1.8231 => 1.8424, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.20% (2.8951 => 0.8338, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -58.76% (11.5316 => 4.7551, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/fp-convert: -52.44% (15.8853 => 7.5557, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.23% (4.7482 => 3.0279, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.42% (5.4972 => 3.6049, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.31% (5.4300 => 3.6756, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -30.55% (1.9999 => 1.3890, std.dev.: 0.1635) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.67% (5.6343 => 4.1319, std.dev.: 0.1531) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.52% (5.0261 => 3.9949, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.90% (5.0243 => 4.1753, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.97% (2.9753 => 2.5298, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.88% (9.9065 => 8.7294, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -11.35% (6.3772 => 5.6532, std.dev.: 0.2755) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.75% (7.2130 => 6.4377, std.dev.: 0.2855) MultiSource/Benchmarks/mafft/pairlocalalign: -10.31% (63.1822 => 56.6664, std.dev.: 0.0990) SingleSource/Benchmarks/Misc/flops-8: -9.65% (2.5609 => 2.3138, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: -9.48% (1.1216 => 1.0153, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/perlin: -9.42% (5.1084 => 4.6271, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: -9.19% (5.4641 => 4.9622, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.82% (6.2275 => 5.6784, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.78% (3.7148 => 3.3885, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.04% (1.0512 => 0.9667, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.42% (5.3218 => 4.9270, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.20% (4.3552 => 4.0417, std.dev.: 0.1051) SingleSource/Benchmarks/Stanford/FloatMM: -6.59% (0.8807 => 0.8227, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/sieve: -6.12% (7.0599 => 6.6279, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.69% (0.3269 => 0.3083, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: -5.52% (9.3748 => 8.8573, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.26% (0.3937 => 0.3730, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.22% (4.9453 => 4.6872, std.dev.: 0.0181) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.77% (2.8773 => 2.7400, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/methcall: -3.21% (8.9760 => 8.6877, std.dev.: 0.0827) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.83% (5.1557 => 5.0099, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.62% (6.0224 => 5.8647, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/fbench: -2.61% (3.3840 => 3.2957, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.00% (9.2989 => 9.1133, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/fldry: -1.66% (0.6910 => 0.6795, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-5: -1.60% (2.8957 => 2.8494, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: -1.07% (1.0841 => 1.0725, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 12.93% (1.0262 => 1.1589, std.dev.: 0.0305) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.08% (0.2463 => 0.3992, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.90% (0.0408 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.72% (0.0384 => 0.0429, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.91% (0.1438 => 0.1523, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 3.03% (1.1329 => 1.1672, std.dev.: 0.2014) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.19% (0.4164 => 0.4031, std.dev.: 0.0507) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.11% (0.1369 => 0.1439, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 51.01% (0.0641 => 0.0968, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.05% (0.0195 => 0.0277, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.08% (0.0578 => 0.0590, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.45% (1.1437 => 1.2861, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1600.00% (0.0001 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.35% (0.0627 => 0.0606, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 50.56% (0.0180 => 0.0271, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/puzzle: 244.94% (0.8017 => 2.7654, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 59.68% (0.0062 => 0.0099, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 08:24:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 10:24:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102162457.1BB1C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7302?compare_to=7300&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7302, Order: 171384, Start Time: 2013-01-02 14:48:27, End Time: 2013-01-02 16:25:15 To: 7300, Order: 171373, Start Time: 2013-01-02 12:45:33, End Time: 2013-01-02 14:22:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (831 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.20% (22.4056 => 78.9125, std.dev.: 0.0686) SingleSource/Benchmarks/Misc/lowercase: 64.29% (0.0280 => 0.0460, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.04% (0.0717 => 0.1126, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.83% (0.0974 => 0.1508, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.77% (0.1132 => 0.1503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.37% (1.6474 => 2.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.45% (5.4682 => 6.6409, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.32% (0.0699 => 0.0848, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.27% (0.0790 => 0.0958, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.58% (2.2587 => 2.7010, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.61% (0.6395 => 0.7393, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 15.28% (1.1450 => 1.3200, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.87% (0.6395 => 0.7282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.12% (0.6260 => 0.7081, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.09% (0.5941 => 0.6659, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 12.07% (0.4524 => 0.5070, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.04% (0.1146 => 0.1284, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.59% (0.6230 => 0.6952, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.58% (0.5805 => 0.6477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.21% (0.6033 => 0.6709, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.18% (0.7021 => 0.7806, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.03% (0.5849 => 0.6494, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.85% (0.5688 => 0.6305, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.82% (0.6440 => 0.7137, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.80% (0.5456 => 0.6045, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.64% (0.5575 => 0.6168, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.50% (0.5925 => 0.6547, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 10.47% (0.4861 => 0.5370, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.45% (0.5567 => 0.6149, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.43% (0.4515 => 0.4986, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.38% (0.6676 => 0.7369, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.37% (0.5581 => 0.6160, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.27% (1.6364 => 1.8044, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.10% (0.5802 => 0.6388, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.85% (0.5859 => 0.6436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.66% (0.5857 => 0.6423, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.46% (0.4916 => 0.5381, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.42% (0.6052 => 0.6622, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.31% (0.6446 => 0.7046, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.27% (0.6189 => 0.6763, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.23% (0.1982 => 0.2165, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.01% (0.5570 => 0.6072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.93% (0.5478 => 0.5967, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.86% (3.5339 => 3.8470, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.85% (0.5705 => 0.6210, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.5329 => 0.5800, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.80% (0.5569 => 0.6059, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.78% (0.5591 => 0.6082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.72% (0.6304 => 0.6854, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.36% (0.6660 => 0.7217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.27% (0.5863 => 0.6348, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.96% (0.6194 => 0.6687, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.77% (0.6297 => 0.6786, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.74% (4.5069 => 4.8556, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 7.51% (0.3357 => 0.3609, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.43% (0.3446 => 0.3702, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.33% (0.6681 => 0.7171, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.26% (0.6667 => 0.7151, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.15% (0.7524 => 0.8062, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.13% (0.3394 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.75% (0.2001 => 0.2136, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.68% (0.6750 => 0.7201, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.40% (0.7339 => 0.7809, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 5.46% (0.3481 => 0.3671, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.4642 => 1.5435, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.16% (0.2385 => 0.2508, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 5.00% (1.2515 => 1.3141, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 4.99% (18.2933 => 19.2057, std.dev.: 0.0171) MultiSource/Benchmarks/mafft/pairlocalalign: 4.88% (9.2283 => 9.6791, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.82% (1.2784 => 1.3400, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1737, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 2.98% (17.1032 => 17.6125, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.9557 => 0.9783, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.10% (1.3864 => 1.4155, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.14% (31.3723 => 55.5742, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9531 => 1.0284, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.66% (5.1955 => 5.4377, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1159, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5567, std.dev.: 0.0354) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3168, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6030, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.10% (4.4335 => 4.4821, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.68% (0.2428 => 0.2290, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.87% (0.3821 => 0.3635, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.72% (0.9852 => 0.9387, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.58% (0.3142 => 0.2998, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.46% (0.3658 => 0.3495, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.25% (0.9542 => 0.9136, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.07% (0.6484 => 0.6220, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.65% (0.3831 => 0.3691, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.57% (0.4176 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.57% (0.3812 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3848 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.54% (0.3837 => 0.3701, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.53% (0.3880 => 0.3743, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.47% (0.3891 => 0.3756, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -3.47% (2.4924 => 2.4060, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3896 => 0.3761, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.45% (0.7198 => 0.6950, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.4033 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.35% (0.6441 => 0.6225, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.25% (0.7919 => 0.7662, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.23% (0.3252 => 0.3147, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4280 => 0.4145, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.10% (1.3148 => 1.2741, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.06% (0.4151 => 0.4024, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.05% (2.1713 => 2.1051, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.01% (0.3884 => 0.3767, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.00% (0.3931 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.99% (0.4321 => 0.4192, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -2.97% (4.3330 => 4.2043, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -2.95% (20.7746 => 20.1619, std.dev.: 0.0238) SingleSource/UnitTests/ObjC++/property-reference: -2.78% (0.7779 => 0.7563, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (1.0544 => 1.0252, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.68% (1.2221 => 1.1894, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -2.58% (0.7982 => 0.7776, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.57% (1.2210 => 1.1896, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.49% (1.2300 => 1.1994, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8583, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.44% (0.4427 => 0.4319, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -2.33% (7.0961 => 6.9306, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.25% (6.7716 => 6.6192, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.23% (0.5999 => 0.5865, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8396, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -2.06% (4.0594 => 3.9756, std.dev.: 0.0122) MultiSource/Benchmarks/Bullet/bullet: -2.01% (34.0927 => 33.4078, std.dev.: 0.0129) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.01% (0.8521 => 0.8350, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: -1.94% (0.9179 => 0.9001, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -1.70% (2.4021 => 2.3613, std.dev.: 0.0076) MultiSource/Applications/treecc/treecc: -1.46% (2.1401 => 2.1089, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -1.40% (1.5610 => 1.5392, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.23% (0.9077 => 0.8965, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: -1.20% (15.2527 => 15.0703, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.13% (8.0126 => 7.9218, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.06% (4.8802 => 4.8285, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (4.0323 => 3.9917, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.22% (1.8100 => 0.6838, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0298, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4758, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.57% (0.1622 => 0.1110, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.74% (0.1983 => 0.1433, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.36% (0.2151 => 0.1584, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.99% (1.3643 => 1.0233, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0384, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -23.33% (7.5137 => 5.7609, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3995, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.99% (4.1024 => 3.2003, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -18.75% (3.3454 => 2.7183, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0003, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.60% (2.5106 => 2.1190, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7052, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3597, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.60% (0.5142 => 0.4597, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6339, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8216, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9084, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -5.23% (1.1594 => 1.0988, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.73% (1.7753 => 1.6914, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7344, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2275, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2764, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7003, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3040 => 7.2013, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.33% (4.8776 => 4.8129, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.27% (1.6219 => 1.6013, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.6307 => 1.6112, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.00% (3.7241 => 3.6868, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 09:02:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 11:02:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130102170200.25E5A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7303?compare_to=7297&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7303, Order: 171373, Start Time: 2013-01-02 13:27:43, End Time: 2013-01-02 17:01:04 To: 7297, Order: 171355, Start Time: 2013-01-02 08:53:49, End Time: 2013-01-02 12:27:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (708 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.50% (126.8267 => 129.9925, std.dev.: 0.2535) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.86% (2.0903 => 2.1292, std.dev.: 0.0137) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.16% (11.6398 => 21.0867, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.49% (0.5361 => 0.8282, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.24% (0.1063 => 0.1427, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.58% (0.1106 => 0.1411, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.07% (0.7426 => 0.9436, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.58% (0.4139 => 0.5239, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.86% (0.1021 => 0.1285, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.68% (0.5900 => 0.7415, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 25.10% (1.5932 => 1.9931, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.05% (0.0547 => 0.0684, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.91% (0.4994 => 0.6238, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.50% (0.5000 => 0.6225, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.98% (0.4253 => 0.5273, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.97% (0.0897 => 0.1112, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.40% (0.1107 => 0.1366, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.03% (0.3903 => 0.4763, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.95% (0.2014 => 0.2456, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.90% (0.0822 => 0.1002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.69% (0.1549 => 0.1885, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 20.30% (0.0808 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.25% (0.1462 => 0.1758, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.23% (0.3890 => 0.4677, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.10% (0.4029 => 0.4839, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.63% (0.2736 => 0.3273, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 19.41% (0.5826 => 0.6957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.31% (1.3152 => 1.5691, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.30% (0.2866 => 0.3419, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.98% (0.5889 => 0.7007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.97% (4.4195 => 5.2579, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.78% (3.5627 => 4.2317, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 18.68% (0.5546 => 0.6582, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.34% (0.1968 => 0.2329, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.31% (0.3271 => 0.3870, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 18.29% (1.8794 => 2.2232, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.28% (1.6211 => 1.9174, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.21% (0.4658 => 0.5506, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 18.12% (0.9697 => 1.1454, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.75% (0.4361 => 0.5135, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.75% (0.5026 => 0.5918, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.74% (0.2875 => 0.3385, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.69% (0.0605 => 0.0712, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.43% (0.3930 => 0.4615, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 17.37% (0.2803 => 0.3290, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 17.13% (0.2714 => 0.3179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (0.2725 => 0.3191, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.09% (0.2738 => 0.3206, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.08% (0.2729 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 17.06% (0.2813 => 0.3293, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.06% (2.7292 => 3.1947, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 17.06% (0.1284 => 0.1503, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 16.97% (0.2823 => 0.3302, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 16.92% (0.7171 => 0.8384, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.83% (0.2792 => 0.3262, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.83% (1.0781 => 1.2595, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 16.73% (4.2109 => 4.9154, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.73% (0.2911 => 0.3398, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.65% (2.0673 => 2.4115, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 16.64% (0.3004 => 0.3504, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 16.51% (0.3096 => 0.3607, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.47% (0.2780 => 0.3238, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.28% (1.9694 => 2.2900, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 16.26% (0.9909 => 1.1520, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.24% (0.1090 => 0.1267, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.23% (1.9966 => 2.3206, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.00% (4.6926 => 5.4436, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 15.95% (0.2075 => 0.2406, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 15.92% (0.3267 => 0.3787, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.75% (0.3060 => 0.3542, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3258 => 0.3770, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 15.53% (23.5202 => 27.1730, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/ary2: 15.50% (0.3317 => 0.3831, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.43% (0.3124 => 0.3606, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.33% (0.3282 => 0.3785, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.29% (0.3362 => 0.3876, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 15.27% (0.3465 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.14% (0.3488 => 0.4016, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 15.10% (0.3496 => 0.4024, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3469 => 0.3991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.03% (0.4146 => 0.4769, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.00% (0.3460 => 0.3979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.99% (0.3348 => 0.3850, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.98% (0.3477 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.98% (0.3678 => 0.4229, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.93% (1.4269 => 1.6400, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.90% (0.3625 => 0.4165, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.87% (0.3726 => 0.4280) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.85% (0.3690 => 0.4238, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 14.68% (0.3650 => 0.4186, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.60% (0.3643 => 0.4175, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.49% (0.4251 => 0.4867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.45% (0.3724 => 0.4262, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.43% (0.7875 => 0.9011, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.42% (0.3981 => 0.4555, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: 14.37% (2.1653 => 2.4764, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 14.29% (4.6177 => 5.2774, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 14.23% (0.2691 => 0.3074, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.77% (2.1013 => 2.3906, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.63% (0.5012 => 0.5695, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.16% (0.6435 => 0.7282, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.94% (0.2040 => 0.2304, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.84% (0.3498 => 0.3947, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 12.75% (0.4847 => 0.5465, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 12.57% (5.5417 => 6.2382, std.dev.: 0.0198) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.29% (0.3084 => 0.3463, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.2068 => 0.2318, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.02% (0.2737 => 0.3066, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.86% (0.6634 => 0.7421, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 11.79% (2.0346 => 2.2745, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.77% (0.1028 => 0.1149, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 11.30% (0.3336 => 0.3713, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 10.03% (11.9555 => 13.1546, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.01% (0.5584 => 0.6087, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.59% (0.3792 => 0.4004, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5200, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.26% (0.3693 => 0.3998, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6818, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2426, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6804, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.27% (2.0820 => 2.1292, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1978, std.dev.: 0.0077) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3061, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2851, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.19% (3.1722 => 3.2098, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0790, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4783, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5832, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.72% (17.2379 => 14.1827, std.dev.: 0.0540) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2402 => 0.2189, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7936, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -4.95% (14.0481 => 13.3527, std.dev.: 0.1365) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2210, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8051, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.94% (0.6293 => 0.6108, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1518, std.dev.: 0.1265) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1909, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 9.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 10:31:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 12:31:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102183146.6309D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7304?compare_to=7301&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7304, Order: 171390, Start Time: 2013-01-02 16:23:57, End Time: 2013-01-02 18:26:01 To: 7301, Order: 171384, Start Time: 2013-01-02 14:00:42, End Time: 2013-01-02 16:01:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 11 (142 on baseline) Performance Improvements: 3 (42 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1046 (792 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.24% (1.1006 => 1.2133, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.73% (1.1341 => 1.1991, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.68% (1.0469 => 1.1064, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.70% (1.3277 => 1.3901, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.24% (1.0187 => 1.0619, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.89% (1.3261 => 1.3777, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.30% (1.3513 => 1.3959, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.82% (1.3174 => 1.3546, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/random: 3.81% (2.3827 => 2.4734, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (40.1945 => 41.6095, std.dev.: 0.2089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.33% (3.6049 => 3.6529, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -3.94% (0.2943 => 0.2827, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.77% (0.2174 => 0.2005, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.58% (1.9006 => 1.8515, std.dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.45% (1.1589 => 1.1757, std.dev.: 0.1401) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.08% (0.3992 => 0.3949, std.dev.: 0.0219) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.17% (0.0428 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0337 => 0.0338, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0429 => 0.0433, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0217 => 0.0218, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0253 => 0.0251, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -15.38% (0.0013 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.66% (0.1523 => 0.1533, std.dev.: 0.0275) MultiSource/Applications/lemon/lemon: 2.95% (1.1672 => 1.2016, std.dev.: 0.1547) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.41% (0.4031 => 0.3974, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.69% (0.1439 => 0.1449, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.0968 => 0.0944, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.44% (0.0277 => 0.0273, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.41% (0.0590 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.2861 => 1.2911, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.08% (0.0026 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.50% (0.0606 => 0.0609, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.85% (0.0271 => 0.0276, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (2.7654 => 2.7520, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.54% (0.0099 => 0.0046, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.76% (30.9461 => 31.1817, std.dev.: 0.0763) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 23.05% (16.4461 => 20.2367, std.dev.: 0.9712) MultiSource/Applications/sqlite3/sqlite3: 3650.95% (0.6332 => 23.7510, std.dev.: 0.9867) MultiSource/Benchmarks/McCat/08-main/main: 57.29% (0.1831 => 0.2880, std.dev.: 0.0408) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -2.82% (0.1559 => 0.1515, std.dev.: 0.0137) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23782.52% (0.3123 => 74.5851, std.dev.: 19.8807) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1840.16% (0.3344 => 6.4879, std.dev.: 0.2715) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.30% (0.2364 => 0.3293, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 16.81% (0.6010 => 0.7020, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/mandel: 6.76% (0.0429 => 0.0458, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.22% (0.3266 => 0.3469, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/strcat: 3.35% (0.1969 => 0.2035, std.dev.: 0.0036) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 8.93% (0.0224 => 0.0244, std.dev.: 0.0073) SingleSource/UnitTests/byval-alignment: -29.13% (0.0230 => 0.0163, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0519, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 16.96% (0.1462 => 0.1710, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4009, std.dev.: 0.0980) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0721, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4900, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5318, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5388, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0424, std.dev.: 0.0274) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3370, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3736, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0842, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -29.08% (2.1832 => 1.5483, std.dev.: 0.0064) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 143.78% (0.0249 => 0.0607, std.dev.: 0.0022) SingleSource/Regression/C/sumarray2d: 104.40% (0.0250 => 0.0511, std.dev.: 0.0093) SingleSource/Regression/C/sumarray: 73.39% (0.0233 => 0.0404, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/factor: 70.03% (0.0297 => 0.0505, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 67.94% (0.8066 => 1.3546, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 67.86% (0.8316 => 1.3959, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 67.10% (0.8597 => 1.4366, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 66.77% (0.8261 => 1.3777, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 66.72% (0.8338 => 1.3901, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 66.70% (0.8457 => 1.4098, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 66.01% (0.8611 => 1.4295, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/neural/neural: 64.65% (0.1440 => 0.2371, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 64.46% (0.8359 => 1.3747, std.dev.: 0.1476) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 63.96% (0.8885 => 1.4568, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 63.68% (0.9056 => 1.4823, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 62.61% (0.9039 => 1.4698, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 61.32% (0.8805 => 1.4204, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 60.92% (0.7932 => 1.2764, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 60.86% (0.8048 => 1.2946, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 60.32% (0.8007 => 1.2837, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 59.90% (0.8716 => 1.3937, std.dev.: 0.0592) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.45% (0.8177 => 1.3038, std.dev.: 0.0388) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.36% (1.5315 => 2.3947, std.dev.: 0.1009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 56.11% (0.9688 => 1.5124, std.dev.: 0.0449) SingleSource/Regression/C/test_indvars: 54.74% (0.0232 => 0.0359, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 48.94% (0.0235 => 0.0350, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 41.84% (0.0784 => 0.1112, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.51% (2.1401 => 3.0285, std.dev.: 0.1230) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.51% (0.8697 => 1.2133, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.29% (0.8855 => 1.2157, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.83% (0.0734 => 0.0997, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 34.95% (3.1832 => 4.2956, std.dev.: 0.1557) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 33.83% (0.8518 => 1.1400, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.44% (0.8286 => 1.1057, std.dev.: 0.0701) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.25% (0.0421 => 0.0561, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 32.81% (0.8331 => 1.1064, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 32.79% (0.8420 => 1.1181, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 32.22% (0.9069 => 1.1991, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.00% (0.8050 => 1.0626, std.dev.: 0.0330) SingleSource/Benchmarks/CoyoteBench/lpbench: 31.95% (0.0989 => 0.1305, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.95% (0.7966 => 1.0511, std.dev.: 0.0695) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.72% (0.1983 => 0.2612, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 31.65% (0.8927 => 1.1752, std.dev.: 0.0735) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.60% (0.8069 => 1.0619, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.41% (0.8204 => 1.0781, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.26% (0.8317 => 1.0834, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 30.06% (0.9074 => 1.1802, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.50% (0.8656 => 1.1123, std.dev.: 0.0557) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 27.56% (0.0635 => 0.0810, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 27.04% (0.2999 => 0.3810, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: 26.62% (0.1112 => 0.1408, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: 24.31% (0.1839 => 0.2286, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.94% (0.0848 => 0.1051, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.21% (0.0810 => 0.0998, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 22.92% (2.3764 => 2.9210, std.dev.: 0.1251) MultiSource/Applications/lemon/lemon: 22.60% (1.0945 => 1.3419, std.dev.: 0.0554) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.44% (0.6586 => 0.8064, std.dev.: 0.0327) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.68% (0.0701 => 0.0846, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 20.03% (0.3800 => 0.4561, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/chomp: 19.62% (0.1565 => 0.1872, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 18.52% (0.4125 => 0.4889, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.51% (0.1097 => 0.1300, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 17.74% (0.2390 => 0.2814, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 17.54% (8.6247 => 10.1374, std.dev.: 0.5107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.45% (0.0745 => 0.0875, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.66% (0.5191 => 0.6056, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.2427 => 0.2827, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.92% (0.0829 => 0.0961, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.63% (0.0691 => 0.0799, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 15.40% (0.2227 => 0.2570, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 15.35% (0.1778 => 0.2051, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 14.55% (0.2509 => 0.2874, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 14.51% (0.0937 => 0.1073, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.46% (0.1756 => 0.2010, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 13.79% (0.1088 => 0.1238, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 13.59% (0.9435 => 1.0717, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.56% (0.7473 => 0.8486, std.dev.: 0.0145) MultiSource/Applications/oggenc/oggenc: 13.04% (4.9628 => 5.6101, std.dev.: 0.2393) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.69% (13.1811 => 14.8541, std.dev.: 0.4525) SingleSource/UnitTests/SignlessTypes/rem: 12.56% (0.1035 => 0.1165, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.18% (0.1905 => 0.2137, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 11.75% (0.3226 => 0.3605, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.29% (0.6227 => 0.6930, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.10% (4.1763 => 4.5981, std.dev.: 0.1191) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.80% (0.4559 => 0.5006, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.72% (0.1183 => 0.1298, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.47% (0.8340 => 0.9130, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 9.30% (0.5817 => 0.6358, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.31% (0.3115 => 0.3374, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.49% (6.6074 => 7.1025, std.dev.: 0.0835) SingleSource/Benchmarks/Shootout-C++/sieve: 6.97% (0.2755 => 0.2947, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/oourafft: 5.65% (0.2088 => 0.2206, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: 5.57% (0.2513 => 0.2653, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.34% (0.1893 => 0.1994, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 5.05% (0.3645 => 0.3829, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.22% (0.2844 => 0.2964, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1513100.00% (0.0001 => 1.5132, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: 372.13% (0.3585 => 1.6926, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: 362.04% (1.5671 => 7.2406, std.dev.: 0.2572) MultiSource/Benchmarks/PAQ8p/paq8p: 285.20% (91.7701 => 353.5004, std.dev.: 2.9143) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.07% (28.5821 => 85.4818, std.dev.: 0.1676) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 173.90% (5.1305 => 14.0523, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/ary2: 123.20% (0.0125 => 0.0279, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 109.94% (1.1365 => 2.3860, std.dev.: 0.0443) SingleSource/Benchmarks/Shootout-C++/ary: 105.02% (0.0219 => 0.0449, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 77.39% (0.0199 => 0.0353, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 62.82% (2.8760 => 4.6828, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.90% (2.7995 => 3.9165, std.dev.: 0.0376) SingleSource/Benchmarks/Misc/pi: 39.89% (1.5795 => 2.2096, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.37% (1.3882 => 1.8515, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.51% (4.5327 => 5.9608, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.27% (2.9096 => 3.7320, std.dev.: 0.0706) SingleSource/Benchmarks/McGill/misr: 19.42% (0.4001 => 0.4778, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.14% (4.7794 => 5.5988, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.82% (0.7597 => 0.8875, std.dev.: 0.0375) SingleSource/Benchmarks/Misc/salsa20: 14.30% (7.5003 => 8.5726, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.46% (0.3186 => 0.3551, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.27% (1.1857 => 1.3075, std.dev.: 0.0137) MultiSource/Applications/SIBsim4/SIBsim4: 9.52% (3.1873 => 3.4908, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/ReedSolomon: 8.13% (8.5322 => 9.2262, std.dev.: 0.0220) MultiSource/Benchmarks/McCat/18-imp/imp: 7.88% (0.1370 => 0.1478, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.48% (23.5781 => 25.3418, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.33% (4.9686 => 5.2830, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.63% (0.6150 => 0.6496, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.49% (3.5679 => 3.7637, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.46% (4.8436 => 5.1083, std.dev.: 0.0536) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.26% (0.2015 => 0.2121, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.10% (0.5214 => 0.5480, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 4.98% (6.7064 => 7.0405, std.dev.: 0.1003) MultiSource/Benchmarks/sim/sim: 4.94% (3.8206 => 4.0092, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.76% (6.1706 => 6.4642, std.dev.: 0.0393) MultiSource/Applications/aha/aha: 4.56% (3.3398 => 3.4921, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/richards_benchmark: 4.00% (1.3037 => 1.3559, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 3.47% (1.7056 => 1.7647, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/power/power: 3.42% (1.2061 => 1.2473, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.35% (4.2466 => 4.3888, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.37% (3.4104 => 3.4911, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/methcall: 1.80% (8.2676 => 8.4165, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.54% (1.9302 => 1.9599, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.44% (8.2783 => 8.3974, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/flops-7: 1.22% (1.7156 => 1.7366, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.19% (2.8951 => 0.8341, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -58.79% (11.5316 => 4.7522, std.dev.: 0.0807) SingleSource/Benchmarks/Misc/fp-convert: -52.44% (15.8853 => 7.5548, std.dev.: 0.0535) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.36% (4.7482 => 3.0219, std.dev.: 0.0831) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.55% (5.4972 => 3.6529, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.41% (5.4300 => 3.6701, std.dev.: 0.0550) SingleSource/Benchmarks/Shootout-C++/ary3: -30.06% (1.9999 => 1.3988, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.36% (5.6343 => 4.1490, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.32% (5.0261 => 4.0050, std.dev.: 0.0855) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.61% (5.0243 => 4.1898, std.dev.: 0.2088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.51% (2.9753 => 2.5435, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.91% (9.9065 => 8.7269, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.39% (7.2130 => 6.3915, std.dev.: 0.1042) MultiSource/Benchmarks/mafft/pairlocalalign: -10.10% (63.1822 => 56.8013, std.dev.: 0.0651) SingleSource/Benchmarks/McGill/chomp: -9.98% (1.1216 => 1.0097, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/flops-8: -9.67% (2.5609 => 2.3132, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/perlin: -9.41% (5.1084 => 4.6277, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: -8.99% (5.4641 => 4.9731, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.41% (3.7148 => 3.4023, std.dev.: 0.0517) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.16% (1.0512 => 0.9654, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.38% (5.3218 => 4.9291, std.dev.: 0.0443) SingleSource/Benchmarks/Shootout/sieve: -6.06% (7.0599 => 6.6324, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.02% (4.3552 => 4.0928, std.dev.: 0.0459) SingleSource/Benchmarks/Stanford/FloatMM: -5.85% (0.8807 => 0.8292, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops: -5.42% (9.3748 => 8.8671, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.41% (0.3269 => 0.3092, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.32% (4.9453 => 4.6824, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.17% (2.8773 => 2.7286, std.dev.: 0.0228) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.13% (0.3937 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.76% (8.9760 => 8.6385, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.85% (5.1557 => 5.0088, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/fbench: -2.54% (3.3840 => 3.2979, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.47% (4.9469 => 4.8247, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.47% (6.0224 => 5.8738, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/hash: -1.85% (4.3087 => 4.2290, std.dev.: 0.0272) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.81% (9.2989 => 9.1302, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.77% (3.3479 => 3.2885, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops-6: -1.58% (2.4416 => 2.4031, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-5: -1.57% (2.8957 => 2.8501, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: -1.41% (1.4296 => 1.4094, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -1.33% (3.6643 => 3.6157, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/neural/neural: -1.01% (1.0841 => 1.0732, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 14.57% (1.0262 => 1.1757, std.dev.: 0.1401) SingleSource/Benchmarks/CoyoteBench/fftbench: 60.33% (0.2463 => 0.3949, std.dev.: 0.0219) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 78.86% (0.0123 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.13% (0.0408 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.07% (0.0254 => 0.0338, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.76% (0.0384 => 0.0433, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 7.89% (0.0190 => 0.0205, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/test1: 21.11% (0.0180 => 0.0218, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 57.14% (0.0007 => 0.0011, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 6.61% (0.1438 => 0.1533, std.dev.: 0.0275) MultiSource/Applications/lemon/lemon: 6.06% (1.1329 => 1.2016, std.dev.: 0.1547) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.56% (0.4164 => 0.3974, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.84% (0.1369 => 0.1449, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 47.27% (0.0641 => 0.0944, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.00% (0.0195 => 0.0273, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.42% (0.0578 => 0.0564, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.89% (1.1437 => 1.2911, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0014 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.87% (0.0627 => 0.0609, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.33% (0.0180 => 0.0276, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 243.27% (0.8017 => 2.7520, std.dev.: 0.0200) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.81% (0.0062 => 0.0046, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 6.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 10:50:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 12:50:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102185004.E23B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7305?compare_to=7298&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7305, Order: 171390, Start Time: 2013-01-02 16:34:33, End Time: 2013-01-02 18:48:42 To: 7298, Order: 171362, Start Time: 2013-01-02 11:02:04, End Time: 2013-01-02 13:16:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (218 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.00% (0.6637 => 0.6770, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.18% (1.2957 => 1.3110, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0664 => 0.0666, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8337 => 499.8486, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44224.61% (1.1277 => 499.8486, std.dev.: 0.0100) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.82% (0.5229 => 1.6514, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 20.08% (14.9895 => 17.9995, std.dev.: 0.0090) MultiSource/Applications/kimwitu++/kc: 54.33% (14.1553 => 21.8464, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 17.19% (4.1105 => 4.8171, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.16% (1.1048 => 1.7474, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1225.29% (7.1582 => 94.8670, std.dev.: 0.0478) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.07% (3.4629 => 7.7938, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.31% (0.6222 => 1.1032, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.50% (0.0720 => 7.4466, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3830700.00% (0.0001 => 3.8308, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11183500.00% (0.0001 => 11.1836, std.dev.: 0.0481) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577400.00% (0.0001 => 0.5775, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9958500.00% (0.0001 => 9.9586, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5505500.00% (0.0001 => 5.5056, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.12% (1.1194 => 10.3446, std.dev.: 0.0161) MultiSource/Applications/ClamAV/clamscan: 149.21% (22.1758 => 55.2652, std.dev.: 0.0324) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.39% (0.0929 => 0.1713, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.06% (0.1463 => 0.2327, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.70% (2.9384 => 4.6339, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.14% (7.0540 => 10.9434, std.dev.: 0.0191) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.97% (1.5859 => 2.4101, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.34% (8.1363 => 11.9882, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.31% (2.2024 => 3.1123, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.23% (0.0439 => 0.0620, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 40.92% (0.1432 => 0.2018, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.77% (21.9371 => 30.8808, std.dev.: 0.0117) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.08% (0.6675 => 0.8883, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.58% (0.1062 => 0.1408, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.54% (1.5415 => 2.0431, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.17% (0.5105 => 0.6696, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 31.01% (0.3109 => 0.4073, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.70% (0.4615 => 0.6032, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.99% (4.2646 => 5.5435, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/05-eks/eks: 29.77% (0.4299 => 0.5579, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 29.59% (0.4289 => 0.5558, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 29.12% (0.0814 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 27.86% (1.1642 => 1.4886, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 27.77% (0.4620 => 0.5903, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.64% (0.1125 => 0.1436, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.35% (0.0746 => 0.0950, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 26.74% (1.0722 => 1.3589, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.27% (0.1892 => 0.2389, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.60% (0.0457 => 0.0574, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.58% (0.2271 => 0.2852, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 25.45% (0.1175 => 0.1474, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.92% (3.8922 => 4.8621, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.59% (0.0793 => 0.0988, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 24.49% (0.6456 => 0.8037, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.82% (0.1566 => 0.1939, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 23.50% (0.0719 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.13% (1.4186 => 1.7467, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.96% (0.1337 => 0.1644, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.43% (0.3121 => 0.3821, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 22.26% (5.7591 => 7.0410, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 22.15% (0.0614 => 0.0750, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.01% (9.4845 => 11.5721, std.dev.: 0.0095) SingleSource/Benchmarks/McGill/chomp: 21.69% (0.1655 => 0.2014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.53% (0.1695 => 0.2060, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.26% (0.2700 => 0.3274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 21.20% (0.3283 => 0.3979, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.17% (0.7115 => 0.8621, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 20.85% (0.3232 => 0.3906, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.74% (1.3050 => 1.5756, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.68% (0.0730 => 0.0881, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049) MultiSource/Applications/spiff/spiff: 20.42% (0.7835 => 0.9435, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 20.19% (0.1555 => 0.1869, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.75% (4.9449 => 5.9215, std.dev.: 0.0090) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.73% (0.0953 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 19.35% (0.0527 => 0.0629, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.35% (3.3354 => 3.9807, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.34% (0.1029 => 0.1228, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 19.18% (0.0662 => 0.0789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.16% (0.5860 => 0.6983, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.16% (5.0018 => 5.9601, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.12% (0.0842 => 0.1003, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 19.12% (0.1695 => 0.2019, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.11% (0.0675 => 0.0804, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 18.99% (1.1840 => 1.4089, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 18.92% (0.1163 => 0.1383, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.84% (0.8172 => 0.9712, std.dev.: 0.0061) MultiSource/Applications/sqlite3/sqlite3: 18.84% (17.1811 => 20.4185, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.61% (0.1236 => 0.1466, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: 18.50% (0.3379 => 0.4004, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 18.16% (0.1151 => 0.1360, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.14% (0.1940 => 0.2292, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.95% (0.0886 => 0.1045, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.87% (0.5020 => 0.5917, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.85% (0.1143 => 0.1347, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.49% (0.5569 => 0.6543, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.34% (0.9765 => 1.1458, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 17.31% (0.7433 => 0.8720, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.28% (0.4636 => 0.5437, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.2107 => 0.2470, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.19% (0.2758 => 0.3232, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 17.18% (0.3423 => 0.4011, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 17.18% (2.2969 => 2.6914, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1268 => 0.1485, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.87% (0.3307 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.62% (0.5981 => 0.6975, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 16.62% (3.8723 => 4.5157, std.dev.: 0.0169) MultiSource/Applications/treecc/treecc: 16.61% (2.0273 => 2.3641, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.08% (0.6450 => 0.7487, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.02% (0.8101 => 0.9399, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 15.93% (0.8921 => 1.0342, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.58% (0.3441 => 0.3977, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.31% (1.1861 => 1.3677, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.41% (0.2603 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 14.35% (0.2049 => 0.2343, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 14.34% (0.3180 => 0.3636, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.82% (0.3387 => 0.3855, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.62% (0.8067 => 0.9166, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: 13.20% (0.0818 => 0.0926) MultiSource/Applications/hbd/hbd: 13.20% (1.5603 => 1.7663, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.73% (0.3865 => 0.4357, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.53% (0.4103 => 0.4617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.38% (0.3886 => 0.4367, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: 12.28% (0.3282 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.59% (14.3668 => 16.0313, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/trivial-interface: 11.58% (0.3473 => 0.3875, std.dev.: 0.0085) SingleSource/UnitTests/ObjC/for-in: 11.53% (0.3694 => 0.4120, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.49% (0.3561 => 0.3970, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.42% (0.4203 => 0.4683, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.30% (0.3098 => 0.3448, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3427 => 0.3811, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.13% (0.3826 => 0.4252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.07% (0.4048 => 0.4496, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.74% (0.2430 => 0.2691, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 10.71% (0.3603 => 0.3989, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.37% (0.3684 => 0.4066, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.06% (0.4064 => 0.4473, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.73% (0.3650 => 0.4005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2831 => 0.3103, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.52% (0.3162 => 0.3463, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.6030 => 0.6585, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.95% (0.2871 => 0.3128, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.87% (2.0665 => 2.2497, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.82% (0.2756 => 0.2999, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7326 => 0.7970, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 8.72% (63.2438 => 68.7607, std.dev.: 0.0370) MultiSource/Applications/hexxagon/hexxagon: 8.60% (1.2842 => 1.3946, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.55% (0.2725 => 0.2958, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2714 => 0.2943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.38% (0.2877 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.25% (0.2872 => 0.3109, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 8.06% (10.3673 => 11.2030, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/wc: 8.03% (0.3052 => 0.3297, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.95% (2.2022 => 2.3773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.89% (0.2802 => 0.3023, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3935 => 0.4240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.21% (0.4879 => 0.5231, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.71% (0.1625 => 0.1734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.64% (0.3131 => 0.3339, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.20% (7.9617 => 8.2168, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.67% (32.5116 => 59.0640, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3782, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (3.1578 => 3.3358, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4570, std.dev.: 0.0090) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (2.0360 => 2.1087, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.09% (0.9957 => 1.0265, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.6802 => 8.9237, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3439, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6395 => 3.7041, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.58% (1.7254 => 1.7526, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.36% (4.4649 => 4.5258, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5857, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.04% (9.1159 => 9.2110, std.dev.: 0.0205) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.26% (5.2763 => 1.1997, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -74.99% (0.8651 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.29% (0.1622 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.85% (5.3855 => 4.4781, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.31% (5.3526 => 4.4798, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -12.97% (10.4361 => 9.0826, std.dev.: 0.0256) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9290, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.75% (1.7609 => 1.6421, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.42% (1.9577 => 0.6770, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.08% (8.0499 => 4.0183, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.90% (0.3987 => 0.2476, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.83% (10.7105 => 7.4081, std.dev.: 0.0090) MultiSource/Benchmarks/PAQ8p/paq8p: -25.01% (85.0658 => 63.7915, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0047, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -20.18% (0.2161 => 0.1725, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3706, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7238, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.31% (2.5528 => 2.1365, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.13% (1.2373 => 1.0996, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5009, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.12% (1.5660 => 1.4232, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2861, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7036, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (0.2497 => 0.2351, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.67% (1.6805 => 1.5852, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.60% (8.1563 => 7.7811, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/salsa20: -4.57% (10.2830 => 9.8127, std.dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.45% (0.4808 => 0.4594, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: -3.44% (0.6223 => 0.6009, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.99% (1.0554 => 1.0344, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -1.17% (4.6441 => 4.5898, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0130) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0018) Report Time: 4.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 12:29:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 14:29:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102202950.70B362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7306?compare_to=7302&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7306, Order: 171398, Start Time: 2013-01-02 18:53:41, End Time: 2013-01-02 20:30:21 To: 7302, Order: 171384, Start Time: 2013-01-02 14:48:27, End Time: 2013-01-02 16:25:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (109 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (836 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.36% (22.4056 => 78.9479, std.dev.: 0.0639) SingleSource/Benchmarks/Misc/lowercase: 64.64% (0.0280 => 0.0461) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.18% (0.0717 => 0.1127, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.52% (0.0974 => 0.1505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.95% (0.1132 => 0.1505, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.72% (0.0599 => 0.0789, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.52% (1.6474 => 2.1008, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.59% (5.4682 => 6.6486, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.63% (2.2587 => 2.7021, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.65% (0.3834 => 0.4434, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.50% (0.6395 => 0.7386, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.39% (1.1450 => 1.3212, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 13.92% (0.6395 => 0.7285, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.27% (0.6260 => 0.7091, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.17% (0.5941 => 0.6664, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.95% (0.1146 => 0.1283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 11.72% (0.4524 => 0.5054, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.57% (0.6230 => 0.6951, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.54% (0.5805 => 0.6475, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.34% (0.7021 => 0.7817, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.12% (0.6033 => 0.6704, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.08% (0.5849 => 0.6497, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.92% (0.5688 => 0.6309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.80% (0.5456 => 0.6045, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.78% (0.6440 => 0.7134, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.64% (0.5575 => 0.6168, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.58% (0.5925 => 0.6552, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 10.53% (0.4861 => 0.5373, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.45% (0.5567 => 0.6149, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.39% (0.5581 => 0.6161, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.27% (1.6364 => 1.8044, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.26% (0.5802 => 0.6397, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.19% (0.6676 => 0.7356, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.00% (0.5859 => 0.6445, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.83% (0.5857 => 0.6433, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.72% (0.4916 => 0.5394, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 9.72% (0.4515 => 0.4954, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.64% (0.1982 => 0.2173, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.39% (0.6052 => 0.6620, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.27% (0.6189 => 0.6763, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.23% (0.6446 => 0.7041, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.98% (0.5570 => 0.6070, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (3.5339 => 3.8492, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.91% (0.5569 => 0.6065, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.85% (0.5478 => 0.5963, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.85% (0.5705 => 0.6210, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.84% (0.5329 => 0.5800, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.78% (0.5591 => 0.6082, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.74% (0.6304 => 0.6855, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.32% (0.6660 => 0.7214, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.22% (0.5863 => 0.6345, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.99% (0.6194 => 0.6689, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.95% (4.5069 => 4.8653, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.65% (0.6297 => 0.6779, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.62% (0.6681 => 0.7190, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 7.49% (0.3446 => 0.3704, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 7.42% (0.3357 => 0.3606, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.20% (0.7524 => 0.8066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 7.19% (0.3394 => 0.3638, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.06% (0.6667 => 0.7138, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.80% (0.2001 => 0.2137, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.6750 => 0.7195, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (0.7339 => 0.7807, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.57% (1.4642 => 1.5457, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 5.54% (0.3481 => 0.3674, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 5.30% (18.2933 => 19.2624, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.12% (0.2385 => 0.2507, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 5.03% (1.2515 => 1.3145, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.97% (1.2784 => 1.3419, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 4.92% (9.2283 => 9.6820, std.dev.: 0.0075) MultiSource/Applications/oggenc/oggenc: 3.25% (5.0226 => 5.1856, std.dev.: 0.0138) MultiSource/Applications/sqlite3/sqlite3: 2.77% (17.1032 => 17.5765, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.9557 => 0.9790, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4813 => 0.4917, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (1.3864 => 1.4128, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.97% (31.3723 => 55.5196, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.84% (0.9531 => 1.0374, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4396, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6309, std.dev.: 0.0871) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1149, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3183, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6051, std.dev.: 0.0096) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.09% (4.4335 => 4.4819, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: 1.00% (7.4937 => 7.5687, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.2428 => 0.2293, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (0.9852 => 0.9391, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.39% (0.3142 => 0.3004, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.37% (0.3658 => 0.3498, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.29% (0.9542 => 0.9133, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.92% (0.6484 => 0.6230, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -3.65% (0.3812 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.56% (0.3880 => 0.3742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.55% (0.3831 => 0.3695, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.54% (0.4176 => 0.4028, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.54% (0.3896 => 0.3758, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.50% (0.7198 => 0.6946, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3848 => 0.3714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.48% (0.6347 => 0.6126, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.47% (0.7919 => 0.7644, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.47% (0.3837 => 0.3704, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.44% (2.4924 => 2.4067, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: -3.40% (0.4033 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.31% (0.6441 => 0.6228, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.22% (1.3148 => 1.2724, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -3.16% (20.7746 => 20.1175, std.dev.: 0.0364) SingleSource/UnitTests/ObjC++/property-reference: -3.14% (0.7779 => 0.7535, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -3.13% (4.3330 => 4.1975, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: -3.12% (0.7982 => 0.7733, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.11% (0.3252 => 0.3151, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.08% (0.4151 => 0.4023, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.98% (2.1713 => 2.1065, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.85% (1.0544 => 1.0244, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.83% (1.2210 => 1.1864, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.63% (1.2221 => 1.1900, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.61% (1.2300 => 1.1979, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8509, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.47% (6.7716 => 6.6046, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: -2.36% (7.0961 => 6.9288, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.19% (16.1920 => 15.8375, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.15% (0.8521 => 0.8338, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -2.07% (4.0594 => 3.9754, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.94% (34.0927 => 33.4296, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/football/football: -1.81% (0.9179 => 0.9013, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -1.56% (2.1401 => 2.1068, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: -1.43% (1.5610 => 1.5386, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.17% (8.0126 => 7.9190, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8275, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: -1.07% (15.2527 => 15.0892, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.48% (1.8100 => 0.6973, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0298, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4759, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.38% (0.1622 => 0.1113, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.99% (0.1983 => 0.1428, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel-2: -24.67% (1.3643 => 1.0277, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0428, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3993) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.93% (4.1024 => 3.2027, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1833, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.19% (2.9703 => 2.3707, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -18.63% (3.3454 => 2.7221, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0003, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.55% (2.5106 => 2.1202, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1038, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.22% (4.9100 => 4.3591, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.64% (7.1848 => 6.6360, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8216, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9085, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -5.87% (1.1594 => 1.0913, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.77% (1.7753 => 1.6906, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.36% (1.0557 => 1.0202, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.05% (7.9763 => 7.7329, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2764, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7003, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1947, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.35% (4.8776 => 4.8116, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6219 => 1.6017, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 3.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 13:07:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 15:07:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102210711.BA5742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7307?compare_to=7304&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7307, Order: 171400, Start Time: 2013-01-02 19:01:13, End Time: 2013-01-02 21:07:01 To: 7304, Order: 171390, Start Time: 2013-01-02 16:23:57, End Time: 2013-01-02 18:26:01 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 25 (153 on baseline) Performance Improvements: 4 (32 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1031 (791 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 27.31% (0.6676 => 0.8499, std.dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.43% (9.5218 => 11.9434, std.dev.: 0.2734) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.47% (1.0717 => 1.3339, std.dev.: 0.0888) SingleSource/UnitTests/Vector/constpool: 18.80% (8.8935 => 10.5653, std.dev.: 0.4296) SingleSource/Benchmarks/LivermoreLoops/kernel08: 13.60% (0.1243 => 0.1412, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.99% (0.9541 => 1.0303, std.dev.: 0.0107) MultiSource/Benchmarks/Fhourstones/fhourstones: 7.49% (0.1750 => 0.1881, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 6.01% (20.2367 => 21.4531, std.dev.: 0.2373) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.88% (0.4986 => 0.5279, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.27% (1.3038 => 1.3725, std.dev.: 0.0200) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.28% (44.2989 => 46.1963, std.dev.: 0.6977) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.62% (1.2946 => 1.3285, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 17.15% (0.0589 => 0.0690, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 11.72% (1.3002 => 1.4526, std.dev.: 0.0428) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.01% (2.6313 => 2.9210, std.dev.: 0.0480) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.30% (9.0634 => 9.7250, std.dev.: 0.0820) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.63% (0.3551 => 0.3751, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 4.64% (7.1668 => 7.4994, std.dev.: 0.1234) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.55% (2.2951 => 2.3996, std.dev.: 0.0296) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.38% (1.2665 => 1.3220, std.dev.: 0.0207) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.07% (13.9947 => 14.5644, std.dev.: 0.1131) SingleSource/Benchmarks/Linpack/linpack-pc: 3.45% (50.9427 => 52.7021, std.dev.: 0.2390) MultiSource/Applications/lua/lua: 2.42% (28.7816 => 29.4784, std.dev.: 0.2221) MultiSource/Applications/sqlite3/sqlite3: 2.19% (4.4009 => 4.4974, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.38% (1.8686 => 1.8943, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.11% (1.2133 => 1.1392, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.04% (1.0700 => 1.0268, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.29% (1.4366 => 1.3894, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.27% (1.4098 => 1.3919, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.79% (1.1757 => 1.1850, std.dev.: 0.1938) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.06% (0.3949 => 0.3991, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.82% (0.0220 => 0.0216, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0433 => 0.0432, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0338 => 0.0337, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0318 => 0.0318, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0433 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -0.98% (0.0205 => 0.0203, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -0.46% (0.0218 => 0.0217, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.91% (0.0251 => 0.0196, std.dev.: 0.0082) MultiSource/Applications/Burg/burg: -27.27% (0.0011 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.39% (0.1533 => 0.1527, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -0.72% (1.2016 => 1.1930, std.dev.: 0.3651) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.56% (0.3974 => 0.4036, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.45% (0.1449 => 0.1470, std.dev.: 0.0460) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.51% (0.0944 => 0.0996, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.18% (0.0273 => 0.0207, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.94% (0.0564 => 0.0637, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.2911 => 1.2821, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.30% (0.0609 => 0.0595, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.36% (0.0276 => 0.0277, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.33% (2.7520 => 2.7887, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.87% (0.0046 => 0.0051, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.41% (31.1817 => 31.0537, std.dev.: 0.6084) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 30.44% (16.4461 => 21.4531, std.dev.: 0.2373) MultiSource/Applications/sqlite3/sqlite3: 3847.36% (0.6332 => 24.9947, std.dev.: 0.5238) MultiSource/Benchmarks/McCat/08-main/main: 57.84% (0.1831 => 0.2890, std.dev.: 0.0561) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 4.55% (0.1559 => 0.1630, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 29984.21% (0.3123 => 93.9530, std.dev.: 14.3864) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1963.46% (0.3344 => 6.9002, std.dev.: 0.1960) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.81% (0.2364 => 0.3305, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/bigfib: 19.62% (0.6010 => 0.7189, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel: 8.16% (0.0429 => 0.0464, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.72% (0.3266 => 0.3518, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/strcat: 3.71% (0.1969 => 0.2042, std.dev.: 0.0013) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 10.27% (0.0224 => 0.0247, std.dev.: 0.0040) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0522, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 17.31% (0.1462 => 0.1715, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4974, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4940, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5360, std.dev.: 0.1505) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5409, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0552, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3416, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3928, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0750, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: -29.72% (2.1832 => 1.5344, std.dev.: 0.0017) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 146.59% (0.0249 => 0.0614, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 103.60% (0.0250 => 0.0509, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/factor: 71.72% (0.0297 => 0.0510, std.dev.: 0.0080) SingleSource/Regression/C/sumarray: 71.24% (0.0233 => 0.0399, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.85% (0.8177 => 1.3725, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 67.07% (0.8359 => 1.3965, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 66.28% (0.8261 => 1.3736, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 65.23% (1.5315 => 2.5305, std.dev.: 0.0934) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 65.07% (0.8048 => 1.3285, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 64.59% (0.8007 => 1.3179, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 64.59% (0.8457 => 1.3919, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 64.42% (0.8611 => 1.4158, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 63.48% (0.7932 => 1.2967, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 62.66% (0.8316 => 1.3527, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 61.85% (0.8066 => 1.3055, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 61.61% (0.8597 => 1.3894, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 61.55% (0.9056 => 1.4630, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 60.55% (0.8805 => 1.4136, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 60.11% (0.9039 => 1.4472, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 59.16% (0.8716 => 1.3872, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.94% (0.8338 => 1.3169, std.dev.: 0.0534) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.81% (0.8885 => 1.4021, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 55.56% (0.9688 => 1.5071, std.dev.: 0.0249) SingleSource/UnitTests/SignlessTypes/shr: 52.88% (0.0191 => 0.0292, std.dev.: 0.0005) SingleSource/Regression/C/test_indvars: 51.72% (0.0232 => 0.0352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 49.79% (0.0235 => 0.0352, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 46.17% (0.0784 => 0.1146, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 46.10% (0.7473 => 1.0918, std.dev.: 0.1019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 42.81% (0.8321 => 1.1883, std.dev.: 0.1184) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 42.58% (0.5961 => 0.8499, std.dev.: 0.0408) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 42.34% (0.4847 => 0.6899, std.dev.: 0.0762) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 41.38% (0.9435 => 1.3339, std.dev.: 0.0888) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 41.06% (3.1832 => 4.4902, std.dev.: 0.1397) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 38.11% (8.6476 => 11.9434, std.dev.: 0.2734) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.74% (0.0734 => 0.1011, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.92% (0.0421 => 0.0568, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 34.17% (0.8286 => 1.1117, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 32.56% (0.9069 => 1.2022, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 32.41% (0.8855 => 1.1725, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.85% (0.8204 => 1.0817, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.66% (0.8069 => 1.0624, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.43% (0.7966 => 1.0470, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 30.99% (0.8697 => 1.1392, std.dev.: 0.0134) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.74% (0.0989 => 0.1293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.73% (0.8317 => 1.0873, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.55% (0.8050 => 1.0509, std.dev.: 0.0245) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 30.12% (0.0757 => 0.0985, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.71% (0.8420 => 1.0922, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 29.26% (0.8712 => 1.1261, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.79% (0.9074 => 1.1686, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.77% (0.1425 => 0.1835, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.46% (0.8331 => 1.0702, std.dev.: 0.0241) MultiSource/Applications/sgefa/sgefa: 28.01% (0.2999 => 0.3839, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.95% (0.8656 => 1.1075, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.98% (0.8086 => 1.0268, std.dev.: 0.0137) MultiSource/Applications/lemon/lemon: 26.96% (1.0945 => 1.3896, std.dev.: 0.0638) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 26.42% (0.9908 => 1.2526, std.dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.30% (0.4783 => 0.6041, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 26.06% (0.8927 => 1.1253, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.92% (0.8518 => 1.0726, std.dev.: 0.0391) SingleSource/UnitTests/Vector/constpool: 25.51% (8.4179 => 10.5653, std.dev.: 0.4296) SingleSource/Benchmarks/Misc/ReedSolomon: 24.80% (0.1839 => 0.2295, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.73% (1.2526 => 1.5624, std.dev.: 0.0664) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0668 => 0.0824, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.02% (0.0822 => 0.1003, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 21.83% (0.0701 => 0.0854, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 21.09% (2.3764 => 2.8776, std.dev.: 0.0684) SingleSource/Benchmarks/McGill/chomp: 21.02% (0.1565 => 0.1894, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 20.67% (0.1137 => 0.1372, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 20.16% (0.3800 => 0.4566, std.dev.: 0.0052) MultiSource/Benchmarks/NPB-serial/is/is: 20.06% (0.0708 => 0.0850, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.94% (0.5191 => 0.6226, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 19.87% (0.1112 => 0.1333, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 19.61% (0.1035 => 0.1238, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 19.18% (0.1778 => 0.2119, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 18.52% (1.1271 => 1.3358, std.dev.: 0.0283) MultiSource/Benchmarks/Fhourstones/fhourstones: 18.45% (0.1588 => 0.1881, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 18.39% (8.6247 => 10.2107, std.dev.: 0.1317) SingleSource/Benchmarks/Shootout-C++/hash2: 17.92% (0.4125 => 0.4864, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary: 17.91% (0.2390 => 0.2818, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 17.81% (14.2605 => 16.8004, std.dev.: 0.6504) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.56% (0.1099 => 0.1292, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.88% (13.1811 => 15.4060, std.dev.: 0.6189) MultiSource/Benchmarks/sim/sim: 16.77% (0.3226 => 0.3767, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/05-eks/eks: 16.65% (0.4397 => 0.5129, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 16.57% (1.2568 => 1.4651, std.dev.: 0.0099) MultiSource/Applications/oggenc/oggenc: 16.25% (4.9628 => 5.7694, std.dev.: 0.1119) SingleSource/Benchmarks/Misc/whetstone: 16.20% (0.0722 => 0.0839, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 16.07% (0.2427 => 0.2817, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: 15.94% (0.2227 => 0.2582, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 15.86% (0.1885 => 0.2184, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 15.07% (0.2509 => 0.2887, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.54% (0.8995 => 1.0303, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/distray/distray: 13.99% (0.0915 => 0.1043, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 13.87% (0.0937 => 0.1067, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.57% (0.1150 => 0.1306, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.53% (0.8340 => 0.9468, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.44% (0.1079 => 0.1224, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 13.43% (15.3280 => 17.3861, std.dev.: 0.5736) MultiSource/Benchmarks/Olden/power/power: 12.35% (0.1247 => 0.1401, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.34% (0.1183 => 0.1329, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 12.32% (0.1088 => 0.1222, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.64% (0.1091 => 0.1218, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 11.57% (0.6834 => 0.7625, std.dev.: 0.0263) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.93% (1.1606 => 1.2759, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.30% (0.2794 => 0.3026, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.03% (0.3115 => 0.3365, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.53% (1.2423 => 1.3234, std.dev.: 0.0296) SingleSource/Benchmarks/Shootout-C++/sieve: 6.46% (0.2755 => 0.2933, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/moments: 5.05% (0.3645 => 0.3829, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.61% (0.3657 => 0.3789, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1517500.00% (0.0001 => 1.5176, std.dev.: 0.0199) MultiSource/Applications/sgefa/sgefa: 374.20% (0.3585 => 1.7000, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: 364.14% (1.5671 => 7.2735, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: 283.91% (91.7701 => 352.3137, std.dev.: 3.3942) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.59% (28.5821 => 85.6278, std.dev.: 0.0728) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 174.08% (5.1305 => 14.0617, std.dev.: 0.1403) SingleSource/Benchmarks/Shootout-C++/ary2: 124.00% (0.0125 => 0.0280, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 108.53% (1.1365 => 2.3700, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/ary: 107.76% (0.0219 => 0.0455, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 98.23% (0.0226 => 0.0448, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 61.84% (2.8760 => 4.6544, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.38% (2.7995 => 3.9298, std.dev.: 0.0734) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 32.49% (1.3882 => 1.8392, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.32% (4.5327 => 5.9978, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 30.68% (0.0528 => 0.0690, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.78% (2.9096 => 3.7760, std.dev.: 0.0274) SingleSource/Benchmarks/McGill/misr: 20.42% (0.4001 => 0.4818, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.73% (0.3186 => 0.3751, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 17.31% (0.7597 => 0.8912, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.05% (4.7794 => 5.5941, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 14.52% (7.5003 => 8.5891, std.dev.: 0.0852) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.38% (2.5763 => 2.9210, std.dev.: 0.0480) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.29% (1.2822 => 1.4526, std.dev.: 0.0428) MultiSource/Applications/SIBsim4/SIBsim4: 10.52% (3.1873 => 3.5225, std.dev.: 0.0262) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1129 => 0.1247, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 9.63% (1.1857 => 1.2999, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/ReedSolomon: 8.33% (8.5322 => 9.2433, std.dev.: 0.0439) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.35% (23.5781 => 25.3122, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.16% (1.2337 => 1.3220, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.72% (2.2485 => 2.3996, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.51% (4.9686 => 5.2921, std.dev.: 0.1076) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.67% (4.8436 => 5.1184, std.dev.: 0.0202) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.47% (3.5679 => 3.7632, std.dev.: 0.0730) MultiSource/Benchmarks/Bullet/bullet: 5.36% (7.1181 => 7.4994, std.dev.: 0.1234) MultiSource/Applications/aha/aha: 5.24% (3.3398 => 3.5148, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.87% (6.1706 => 6.4711, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/power/power: 3.43% (1.2061 => 1.2475, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (4.2466 => 4.3899, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 2.39% (2.3560 => 2.4123, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.21% (3.4104 => 3.4859, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/methcall: 1.71% (8.2676 => 8.4091, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.04% (3.7781 => 3.8173, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.26% (2.8951 => 0.8320, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.22% (11.5316 => 4.7031, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/fp-convert: -52.55% (15.8853 => 7.5382, std.dev.: 0.0629) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.30% (4.7482 => 3.0245, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.56% (5.4972 => 3.5972, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.42% (5.4300 => 3.6696, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.66% (5.6343 => 4.1324, std.dev.: 0.0308) SingleSource/Benchmarks/Shootout-C++/ary3: -24.13% (1.9999 => 1.5173, std.dev.: 0.1806) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.29% (5.0261 => 4.0065, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.67% (5.0243 => 4.1866, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.50% (2.9753 => 2.5440, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.91% (9.9065 => 8.7264, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -10.12% (63.1822 => 56.7868, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/flops-8: -9.57% (2.5609 => 2.3158, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/perlin: -9.46% (5.1084 => 4.6253, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.06% (6.2275 => 5.6635, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/em3d/em3d: -8.81% (5.4641 => 4.9825, std.dev.: 0.0082) SingleSource/Benchmarks/McGill/chomp: -8.65% (1.1216 => 1.0246, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.43% (3.7148 => 3.4015, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.27% (5.3218 => 4.9348, std.dev.: 0.0437) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.22% (4.3552 => 4.0409, std.dev.: 0.0269) SingleSource/Benchmarks/Stanford/FloatMM: -6.59% (0.8807 => 0.8227, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/sieve: -6.14% (7.0599 => 6.6266, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.34% (4.9453 => 4.6814, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/flops: -5.33% (9.3748 => 8.8748, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.01% (6.0224 => 5.7812, std.dev.: 0.0509) SingleSource/Benchmarks/Shootout-C++/methcall: -3.53% (8.9760 => 8.6590, std.dev.: 0.0416) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.36% (1.4529 => 1.4041, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.99% (5.1557 => 5.0017, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/fbench: -2.20% (3.3840 => 3.3096, std.dev.: 0.0233) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.96% (9.2989 => 9.1162, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.83% (4.8362 => 4.7479, std.dev.: 0.0282) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 15.47% (1.0262 => 1.1850, std.dev.: 0.1938) SingleSource/Benchmarks/CoyoteBench/fftbench: 62.04% (0.2463 => 0.3991, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 75.61% (0.0123 => 0.0216, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0302 => 0.0318, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: 20.56% (0.0180 => 0.0217, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 6.19% (0.1438 => 0.1527, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 5.30% (1.1329 => 1.1930, std.dev.: 0.3651) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.07% (0.4164 => 0.4036, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.38% (0.1369 => 0.1470, std.dev.: 0.0460) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 55.38% (0.0641 => 0.0996, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.15% (0.0195 => 0.0207, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.21% (0.0578 => 0.0637, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.10% (1.1437 => 1.2821, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.10% (0.0627 => 0.0595, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.89% (0.0180 => 0.0277, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.85% (0.8017 => 2.7887, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.74% (0.0062 => 0.0051, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) Report Time: 2.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 13:33:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 15:33:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130102213300.159CB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7308?compare_to=7303&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7308, Order: 171393, Start Time: 2013-01-02 18:00:13, End Time: 2013-01-02 21:33:37 To: 7303, Order: 171373, Start Time: 2013-01-02 13:27:43, End Time: 2013-01-02 17:01:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1288 => 54.8418, std.dev.: 0.1203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.70% (2.1292 => 2.0931, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.02% (11.6398 => 21.0700, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 53.98% (0.5361 => 0.8255, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.96% (0.1063 => 0.1424, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.02% (0.1106 => 0.1427, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.22% (0.2969 => 0.3807, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.06% (0.4139 => 0.5259, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.93% (0.7426 => 0.9426, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.27% (0.5900 => 0.7450, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.49% (0.1620 => 0.2033, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.23% (0.0547 => 0.0685, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 25.06% (1.5932 => 1.9924, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.99% (0.4994 => 0.6242, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.46% (0.5000 => 0.6223, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.79% (0.4253 => 0.5265, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.40% (0.1107 => 0.1366, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.10% (0.2014 => 0.2459, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.06% (0.3903 => 0.4764, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 21.80% (0.1619 => 0.1972, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.38% (0.1604 => 0.1947, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 21.32% (0.0605 => 0.0734, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 20.66% (0.1505 => 0.1816, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.38% (0.1462 => 0.1760, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.21% (0.3890 => 0.4676, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.2736 => 0.3272, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.58% (0.4029 => 0.4818, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.47% (0.2866 => 0.3424, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.46% (1.3152 => 1.5712, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 19.40% (0.5826 => 0.6956, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 19.00% (0.5889 => 0.7008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.93% (4.4195 => 5.2560, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.92% (0.3271 => 0.3890, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.91% (3.5627 => 4.2364, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.55% (0.1968 => 0.2333, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.48% (1.6211 => 1.9206, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 18.41% (0.5546 => 0.6567, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 18.36% (1.8794 => 2.2245, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.33% (0.4658 => 0.5512, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.21% (0.5026 => 0.5941, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 18.08% (0.9697 => 1.1450, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.93% (0.4361 => 0.5143, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.74% (0.2875 => 0.3385, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.1421 => 0.1668, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.38% (0.3930 => 0.4613, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 17.06% (0.2714 => 0.3177, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 17.03% (0.2813 => 0.3292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 17.03% (0.2725 => 0.3189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.00% (0.2823 => 0.3303, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.99% (2.7292 => 3.1930, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.97% (0.2911 => 0.3405, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 16.95% (0.2803 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.89% (0.2729 => 0.3190, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.89% (0.7171 => 0.8382, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.87% (0.2792 => 0.3263, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 16.85% (1.0781 => 1.2598, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 16.77% (4.2109 => 4.9172, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 16.73% (0.3096 => 0.3614, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 16.69% (0.2780 => 0.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.65% (0.2811 => 0.3279, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 16.54% (0.3004 => 0.3501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.54% (2.0673 => 2.4093, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.39% (1.9966 => 2.3238, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.37% (1.9694 => 2.2917, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 16.35% (0.9909 => 1.1529, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.24% (0.1090 => 0.1267, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 15.93% (4.6926 => 5.4402, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 15.86% (0.2075 => 0.2404, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 15.73% (0.3267 => 0.3781, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.68% (0.3258 => 0.3769, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.65% (0.3124 => 0.3613, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 15.59% (0.3317 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.43% (23.5202 => 27.1500, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.39% (0.3282 => 0.3787, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.24% (0.3465 => 0.3993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.18% (0.3446 => 0.3969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.17% (0.3362 => 0.3872, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 15.09% (0.3460 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.08% (0.2566 => 0.2953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.07% (0.3496 => 0.4023, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.05% (0.3469 => 0.3991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.93% (0.3678 => 0.4227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.90% (0.3348 => 0.3847, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.83% (1.4269 => 1.6385, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 14.76% (0.3726 => 0.4276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.70% (0.3477 => 0.3988, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.66% (0.3650 => 0.4185, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.65% (0.3625 => 0.4156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.61% (0.3690 => 0.4229, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: 14.60% (0.3643 => 0.4175, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.54% (0.3981 => 0.4560, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: 14.54% (2.1653 => 2.4802, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.41% (0.7875 => 0.9010, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 14.34% (0.3724 => 0.4258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.33% (0.4251 => 0.4860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.30% (0.4146 => 0.4739, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 14.27% (0.2691 => 0.3075, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 14.15% (4.6177 => 5.2709, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.3845 => 0.4384, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.68% (2.1013 => 2.3887, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 13.63% (0.5012 => 0.5695, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.12% (0.6435 => 0.7279, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.75% (0.2040 => 0.2300, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.65% (0.4847 => 0.5460, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.58% (0.1383 => 0.1557, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 12.26% (0.3498 => 0.3927, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.26% (5.5417 => 6.2210, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.22% (0.3084 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.94% (0.2068 => 0.2315, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 11.83% (0.6634 => 0.7419, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.2737 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.67% (0.1028 => 0.1148, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.60% (2.0346 => 2.2707, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 11.18% (0.3336 => 0.3709, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.41% (0.2103 => 0.2322, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 10.20% (0.2391 => 0.2635, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.88% (11.9555 => 13.1365, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (0.5584 => 0.6077, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.64% (0.3792 => 0.4006, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5305, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.80% (0.3693 => 0.3981, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2356, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8917, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6774, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.69% (0.6276 => 0.6445, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1970, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2798, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0827, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2096, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.09% (50.0626 => 50.6089, std.dev.: 0.0231) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4789, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5627, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.34% (17.2379 => 14.0768, std.dev.: 0.2085) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7996, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -5.18% (14.0481 => 13.3208, std.dev.: 0.2706) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2196, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8047, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.96% (0.6293 => 0.6107, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1193, std.dev.: 0.0349) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0980, std.dev.: 0.1102) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 3.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 13:34:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 15:34:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130102213429.D1E8F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7309?compare_to=7305&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7309, Order: 171401, Start Time: 2013-01-02 19:21:03, End Time: 2013-01-02 21:35:15 To: 7305, Order: 171390, Start Time: 2013-01-02 16:34:33, End Time: 2013-01-02 18:48:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (218 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.75% (0.0666 => 0.0691, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.03% (499.8486 => 499.6778, std.dev.: 0.0788) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44209.46% (1.1277 => 499.6778, std.dev.: 0.0788) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.26% (0.5229 => 1.6537, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 20.09% (14.9895 => 18.0004, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: 54.41% (14.1553 => 21.8579, std.dev.: 0.0388) MultiSource/Benchmarks/MallocBench/gs/gs: 17.43% (4.1105 => 4.8269, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.08% (1.1048 => 1.7465, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1224.99% (7.1582 => 94.8453, std.dev.: 0.0407) SingleSource/Benchmarks/Misc-C++-EH/spirit: 125.42% (3.4629 => 7.8059, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.55% (0.6222 => 1.1047, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.97% (0.0720 => 7.4455, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 3830100.00% (0.0001 => 3.8302, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 11159400.00% (0.0001 => 11.1595, std.dev.: 0.0480) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577200.00% (0.0001 => 0.5773, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9957400.00% (0.0001 => 9.9575, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503500.00% (0.0001 => 5.5036, std.dev.: 0.0022) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.93% (1.1194 => 10.3649, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 149.25% (22.1758 => 55.2726, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.28% (0.0929 => 0.1712, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 83.54% (0.0243 => 0.0446, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 58.99% (0.1463 => 0.2326, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 58.30% (0.0271 => 0.0429, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.62% (2.9384 => 4.6315, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.28% (7.0540 => 10.9535, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.01% (1.5859 => 2.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.19% (8.1363 => 11.9757, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.49% (2.2024 => 3.1162, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.46% (0.0439 => 0.0621, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 40.92% (0.1432 => 0.2018, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 40.76% (21.9371 => 30.8797, std.dev.: 0.0118) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484) MultiSource/Benchmarks/McCat/04-bisect/bisect: 33.24% (0.1062 => 0.1415, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.14% (0.6675 => 0.8887, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.26% (1.5415 => 2.0388, std.dev.: 0.0050) MultiSource/Applications/sgefa/sgefa: 31.42% (0.3109 => 0.4086, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.11% (0.5105 => 0.6693, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.88% (0.4615 => 0.6040, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 29.87% (0.4299 => 0.5583, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.85% (4.2646 => 5.5376, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 29.28% (0.4289 => 0.5545, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.91% (0.1125 => 0.1439, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 27.88% (0.4620 => 0.5908, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 27.72% (1.1642 => 1.4869, std.dev.: 0.0094) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.21% (0.0746 => 0.0949, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 26.80% (1.0722 => 1.3595, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.27% (0.1892 => 0.2389, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/08-main/main: 25.84% (0.2554 => 0.3214, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.36% (0.2271 => 0.2847, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.76% (3.8922 => 4.8561, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 24.50% (0.6456 => 0.8038, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 23.64% (0.0719 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.29% (1.4186 => 1.7490, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.96% (0.1337 => 0.1644, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.70% (0.0793 => 0.0973, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.56% (0.3121 => 0.3825, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 22.39% (5.7591 => 7.0483, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.19% (0.2700 => 0.3299, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.17% (9.4845 => 11.5876, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.73% (0.0842 => 0.1025, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 21.63% (0.1655 => 0.2013, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.53% (0.1695 => 0.2060, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 21.38% (0.3283 => 0.3985, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 21.15% (0.1163 => 0.1409, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 21.11% (0.7115 => 0.8617, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 20.98% (0.3232 => 0.3910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.93% (1.3050 => 1.5781, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.54% (0.0886 => 0.1068, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 20.54% (0.7835 => 0.9444, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 20.13% (0.0626 => 0.0752, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.94% (0.0672 => 0.0806, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.78% (4.9449 => 5.9228, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 19.54% (0.0527 => 0.0630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 19.49% (0.0662 => 0.0791, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 19.38% (3.3354 => 3.9817, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.28% (0.1940 => 0.2314, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.26% (0.0675 => 0.0805, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.5860 => 0.6987, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 19.17% (0.1695 => 0.2020, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.08% (5.0018 => 5.9559, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 18.94% (1.1840 => 1.4082, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 18.84% (17.1811 => 20.4174, std.dev.: 0.0172) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.70% (0.8172 => 0.9700, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ary2: 18.67% (0.3379 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.63% (0.0730 => 0.0866, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.46% (0.2107 => 0.2496, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 18.44% (0.7433 => 0.8804, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.12% (0.1236 => 0.1460, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 18.08% (0.0614 => 0.0725, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 18.00% (0.3423 => 0.4039, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.93% (0.5020 => 0.5920, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.76% (0.1143 => 0.1346, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.49% (0.4636 => 0.5447, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.47% (0.5569 => 0.6542, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.41% (0.9765 => 1.1465, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 17.35% (0.1268 => 0.1488, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.22% (0.2758 => 0.3233, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 17.14% (2.2969 => 2.6906, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.96% (0.3307 => 0.3868, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 16.79% (2.0273 => 2.3677, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 16.75% (3.8723 => 4.5210, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.60% (0.5981 => 0.6974, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.22% (0.2065 => 0.2400, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.6450 => 0.7486, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 15.87% (0.8921 => 1.0337, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.83% (0.8101 => 0.9383, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.66% (0.3441 => 0.3980, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.10% (1.1861 => 1.3652, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.52% (0.8067 => 0.9238, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/09-vor/vor: 14.47% (0.3180 => 0.3640, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 14.35% (0.2049 => 0.2343, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.33% (0.2603 => 0.2976, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.27% (0.1044 => 0.1193, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.85% (0.3387 => 0.3856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 13.33% (0.0818 => 0.0927, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7676, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.86% (0.3865 => 0.4362, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.27% (0.3886 => 0.4363, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.19% (0.3282 => 0.3682, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.72% (0.4103 => 0.4584, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 11.64% (0.3694 => 0.4124, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 11.57% (0.3561 => 0.3973, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.56% (14.3668 => 16.0271, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/trivial-interface: 11.55% (0.3473 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.49% (0.3516 => 0.3920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.47% (0.4203 => 0.4685, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.27% (0.3098 => 0.3447, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 11.19% (0.4048 => 0.4501, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 10.85% (0.3603 => 0.3994, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 10.78% (0.3422 => 0.3791, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.70% (0.2430 => 0.2690, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 10.69% (0.3684 => 0.4078, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3826 => 0.4233, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.81% (0.3650 => 0.4008, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 9.64% (0.2831 => 0.3104, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.61% (0.2871 => 0.3147, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.10% (2.0665 => 2.2545, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: 9.06% (0.5925 => 0.6462, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.00% (1.2842 => 1.3998, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.77% (0.2725 => 0.2964, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7326 => 0.7967, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 8.73% (63.2438 => 68.7668, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.65% (0.2877 => 0.3126, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.61% (0.2905 => 0.3155, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557) SingleSource/Benchmarks/Shootout-C++/wc: 8.19% (0.3052 => 0.3302, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2802 => 0.3029, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.07% (10.3673 => 11.2038, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.90% (2.2022 => 2.3761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3935 => 0.4242, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.3136 => 0.3378, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.4879 => 0.5238, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 6.74% (0.3131 => 0.3342, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.24% (7.9617 => 8.2199, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.67% (32.5116 => 59.0649, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.31% (11.6436 => 12.3779, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (4.2280 => 4.4652, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 5.30% (3.1578 => 3.3253, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (2.0360 => 2.1080, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.08% (0.9957 => 1.0264, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.6802 => 8.9085, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7151, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3440, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (1.7254 => 1.7520, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.49% (4.4649 => 4.5316, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 1.29% (9.1159 => 9.2339, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: 1.04% (1.4460 => 1.4611, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5741, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.24% (5.2763 => 1.2007, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -74.99% (0.8651 => 0.2164, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.80% (5.3855 => 4.4805, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.21% (5.3526 => 4.4851, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: -12.96% (10.4361 => 9.0833, std.dev.: 0.0173) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9573, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.70% (1.7609 => 1.6429, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.09% (1.9577 => 0.6639, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.09% (8.0499 => 4.0179, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.17% (0.6962 => 0.3817, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.75% (0.0506 => 0.0315) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.92% (10.7105 => 7.3989, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.7957, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0052, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3709, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.27% (2.5528 => 2.1375, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4198, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7355, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -11.17% (1.2373 => 1.0991, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.10% (9.5636 => 8.5022, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4228, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.21% (19.9488 => 18.3110, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.57% (1.6805 => 1.5869, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.36% (8.1563 => 7.8007, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8404, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0057) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.01% (1.0554 => 1.0342, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9575, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2194, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5868, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.34% (0.2116 => 0.0691, std.dev.: 0.0019) Report Time: 2.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 14:30:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 16:30:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130102223058.EC8D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7310?compare_to=7306&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7310, Order: 171407, Start Time: 2013-01-02 20:54:15, End Time: 2013-01-02 22:30:53 To: 7306, Order: 171398, Start Time: 2013-01-02 18:53:41, End Time: 2013-01-02 20:30:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (110 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (836 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.14% (22.4056 => 78.8997, std.dev.: 0.0797) SingleSource/Benchmarks/Misc/lowercase: 71.43% (0.0280 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 58.30% (0.0717 => 0.1135, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 55.54% (0.0974 => 0.1515, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.42% (0.0514 => 0.0768, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.89% (0.0599 => 0.0790, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.69% (1.6474 => 2.1036, std.dev.: 0.0144) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.15% (0.0445 => 0.0548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.56% (5.4682 => 6.6471, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.32% (0.0699 => 0.0848, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.63% (2.2587 => 2.7020, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.65% (0.0680 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.56% (0.6395 => 0.7390, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 15.45% (1.1450 => 1.3219, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.03% (0.6395 => 0.7292, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.26% (0.6260 => 0.7090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 12.33% (0.4524 => 0.5082, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.22% (0.5941 => 0.6667, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.04% (0.1146 => 0.1284, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.59% (0.5805 => 0.6478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.51% (0.6230 => 0.6947, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.34% (0.7021 => 0.7817, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.22% (0.6033 => 0.6710, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.10% (0.5849 => 0.6498, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 11.03% (0.4861 => 0.5397, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.76% (0.6440 => 0.7133, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.76% (0.5456 => 0.6043, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.65% (0.5688 => 0.6294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.50% (0.5925 => 0.6547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.42% (0.5575 => 0.6156, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.40% (0.5567 => 0.6146, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.34% (0.6676 => 0.7366, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.30% (0.5581 => 0.6156, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.19% (0.5802 => 0.6393, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.10% (1.6364 => 1.8017, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 9.88% (0.4515 => 0.4961, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.80% (0.5859 => 0.6433, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.51% (0.5857 => 0.6414, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.48% (0.6052 => 0.6626, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.28% (0.6446 => 0.7044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.24% (0.6189 => 0.6761, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.11% (3.5339 => 3.8557, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.10% (0.5329 => 0.5814, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.08% (0.5570 => 0.6076, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.08% (0.1982 => 0.2162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.94% (0.5478 => 0.5968, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.92% (0.5569 => 0.6066, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.87% (0.5705 => 0.6211, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.82% (0.5591 => 0.6084, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.77% (0.6304 => 0.6857, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.42% (0.6660 => 0.7221, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 8.30% (0.3446 => 0.3732, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.12% (0.5863 => 0.6339, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 8.01% (0.3394 => 0.3666, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.88% (0.6194 => 0.6682, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (4.5069 => 4.8612, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.72% (0.6297 => 0.6783, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 7.48% (0.3357 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.42% (0.6681 => 0.7177, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.32% (0.7524 => 0.8075, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 7.11% (0.6750 => 0.7230, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.11% (0.6667 => 0.7141, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (0.7339 => 0.7807, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 6.32% (0.3481 => 0.3701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.4642 => 1.5451, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 5.16% (18.2933 => 19.2372, std.dev.: 0.0313) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.05% (1.2784 => 1.3430, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.03% (0.2385 => 0.2505, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.00% (9.2283 => 9.6899, std.dev.: 0.0165) MultiSource/Applications/Burg/burg: 5.00% (1.2515 => 1.3141, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.93% (0.4813 => 0.4954, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 2.85% (17.1032 => 17.5912, std.dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 2.77% (5.0226 => 5.1617, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.3864 => 1.4131, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.09% (31.3723 => 55.5571, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5337, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3690, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (5.1955 => 5.4386, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.5751 => 56.6684, std.dev.: 0.0442) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1140, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.84% (79.7170 => 81.1825, std.dev.: 0.2841) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3201, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6018, std.dev.: 0.0113) MultiSource/Applications/viterbi/viterbi: 1.13% (4.4335 => 4.4836, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.01% (0.1584 => 0.1473, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.2428 => 0.2293, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.08% (0.3821 => 0.3627, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.68% (0.3142 => 0.2995, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.66% (0.9852 => 0.9393, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -4.62% (0.3831 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.56% (0.3884 => 0.3707, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.48% (0.3880 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.36% (0.4033 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.32% (0.3891 => 0.3723, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.30% (0.9542 => 0.9132, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.29% (0.3658 => 0.3501, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.05% (0.4199 => 0.4029, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.93% (0.4280 => 0.4112, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.89% (0.6347 => 0.6100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.84% (0.6484 => 0.6235, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -3.77% (0.6441 => 0.6198, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.71% (0.7198 => 0.6931, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (2.4924 => 2.4065, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -3.43% (4.3330 => 4.1843, std.dev.: 0.0097) SingleSource/UnitTests/ObjC++/property-reference: -3.39% (0.7779 => 0.7515, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.28% (0.7919 => 0.7659, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -3.15% (20.7746 => 20.1196, std.dev.: 0.0563) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.95% (0.3837 => 0.3724, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.92% (1.2210 => 1.1853, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.84% (1.2221 => 1.1874, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -2.78% (0.7982 => 0.7760, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.74% (1.0544 => 1.0255, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.65% (1.3148 => 1.2799, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.57% (6.7716 => 6.5975, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.56% (14.2083 => 13.8442, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.54% (1.2300 => 1.1988, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.45% (0.4321 => 0.4215, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -2.35% (7.0961 => 6.9290, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.22% (0.8521 => 0.8332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.22% (0.5999 => 0.5866, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8388, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.15% (2.1713 => 2.1247, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -2.14% (4.0594 => 3.9724, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.89% (34.0927 => 33.4484, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -1.69% (2.1401 => 2.1039, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.61% (0.9077 => 0.8931, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -1.57% (2.4021 => 2.3644, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.16% (15.2527 => 15.0765, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.15% (4.0323 => 3.9859, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8275, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.0126 => 7.9264, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.36% (1.8100 => 0.6632, std.dev.: 0.0290) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.89% (8.0445 => 4.0315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.57% (0.1622 => 0.1110, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.89% (0.1983 => 0.1430, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.73% (1.3643 => 1.0269, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.57% (0.2274 => 0.1738, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7487, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0400, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1992, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1836, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -18.63% (3.3454 => 2.7222, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.25% (1.2237 => 1.0004, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.43% (2.5106 => 2.1232, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3586, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8216, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.99% (1.1594 => 1.0899, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.70% (1.7753 => 1.6919, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7347, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.93% (1.3096 => 1.2712, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2273, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.88% (2.7523 => 2.7005, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1908, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8023, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6307 => 1.6096, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 15:33:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 17:33:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130102233308.036EF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7311?compare_to=7307&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7311, Order: 171408, Start Time: 2013-01-02 21:26:28, End Time: 2013-01-02 23:32:08 To: 7307, Order: 171400, Start Time: 2013-01-02 19:01:13, End Time: 2013-01-02 21:07:01 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 16 (136 on baseline) Performance Improvements: 8 (39 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1036 (801 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 151.35% (0.0074 => 0.0186, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-13-SwitchTest: 111.00% (0.0100 => 0.0211, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.61% (1.3169 => 1.4040, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.01% (1.4021 => 1.4864, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.15% (0.3231 => 0.3365, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.83% (1.1725 => 1.2174, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.28% (1.2967 => 1.3392, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 50.06% (10.1766 => 15.2707, std.dev.: 1.8889) SingleSource/Benchmarks/Misc/pi: 14.47% (1.9259 => 2.2045, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 7.31% (8.7247 => 9.3628, std.dev.: 0.0606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.18% (3.9967 => 4.2038, std.dev.: 0.0751) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.67% (0.5945 => 0.6163, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.37% (5.7812 => 5.8605, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.27% (4.8015 => 4.8625, std.dev.: 0.0225) MultiSource/Benchmarks/PAQ8p/paq8p: 1.14% (352.3137 => 356.3184, std.dev.: 0.5045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.05% (3.5794 => 3.6171, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -19.64% (0.8907 => 0.7158, std.dev.: 0.0514) SingleSource/Benchmarks/LivermoreLoops/kernel08: -10.69% (0.1412 => 0.1261, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.24% (1.0303 => 0.9763, std.dev.: 0.0132) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.49% (1.2025 => 1.1485, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: -1.92% (7.5318 => 7.3875, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: -9.28% (4.2415 => 3.8481, std.dev.: 0.1302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.15% (42.3728 => 41.8842, std.dev.: 0.1674) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.10% (2.7898 => 2.7592, std.dev.: 0.0108) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.32% (1.1850 => 1.1693, std.dev.: 0.1460) SingleSource/Benchmarks/CoyoteBench/fftbench: 0.98% (0.3991 => 0.4030, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.93% (0.0216 => 0.0218, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0432 => 0.0432, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.89% (0.0337 => 0.0340, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0318 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0430 => 0.0430, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: 1.84% (0.0217 => 0.0221, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 29.08% (0.0196 => 0.0253, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.46% (0.1527 => 0.1520, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 7.98% (1.1930 => 1.2882, std.dev.: 0.2560) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.49% (0.4036 => 0.4298, std.dev.: 0.1589) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.93% (0.1470 => 0.1427, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.82% (0.0996 => 0.0938, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.30% (0.0207 => 0.0278, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.57% (0.0637 => 0.0647, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.97% (1.2821 => 1.2945, std.dev.: 0.1330) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.84% (0.0595 => 0.0590, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.05% (0.0277 => 0.0263, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.05% (2.7887 => 2.7873, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.69% (0.0051 => 0.0043, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (31.0537 => 30.9127, std.dev.: 0.1215) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 27.07% (16.4461 => 20.8979, std.dev.: 0.8977) MultiSource/Applications/sqlite3/sqlite3: 3579.07% (0.6332 => 23.2959, std.dev.: 0.7013) MultiSource/Benchmarks/McCat/08-main/main: 57.78% (0.1831 => 0.2889, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.19% (0.1559 => 0.1562, std.dev.: 0.0341) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 30921.13% (0.3123 => 96.8790, std.dev.: 15.4689) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1995.39% (0.3344 => 7.0070, std.dev.: 0.1413) SingleSource/Benchmarks/Misc-C++/Large/ray: 41.96% (0.2364 => 0.3356, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 21.43% (0.6010 => 0.7298, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/mandel: 23.31% (0.0429 => 0.0529, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.83% (0.3266 => 0.3587, std.dev.: 0.0356) SingleSource/Benchmarks/Shootout-C++/strcat: 6.20% (0.1969 => 0.2091, std.dev.: 0.0122) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 15.18% (0.0224 => 0.0258, std.dev.: 0.0072) SingleSource/UnitTests/byval-alignment: -17.83% (0.0230 => 0.0189, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0525, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 16.89% (0.1462 => 0.1709, std.dev.: 0.0239) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4323, std.dev.: 0.0277) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0769, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0729) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5395, std.dev.: 0.0809) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5466, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0791, std.dev.: 0.0736) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3479, std.dev.: 0.0159) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3813, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0009, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0829, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: -29.57% (2.1832 => 1.5377, std.dev.: 0.0802) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 145.38% (0.0249 => 0.0611, std.dev.: 0.0018) SingleSource/Regression/C/sumarray2d: 101.60% (0.0250 => 0.0504, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 69.91% (0.8007 => 1.3605, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 68.90% (0.8261 => 1.3953, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 68.84% (0.7932 => 1.3392, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 68.39% (0.8338 => 1.4040, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 67.29% (0.8885 => 1.4864, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 67.14% (0.8359 => 1.3971, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 65.95% (0.8805 => 1.4612, std.dev.: 0.1154) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 63.97% (0.8048 => 1.3196, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 63.80% (0.8611 => 1.4105, std.dev.: 0.0854) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 63.37% (0.8457 => 1.3816, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 62.73% (0.8066 => 1.3126, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 62.45% (0.8716 => 1.4159, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 62.20% (1.5315 => 2.4841, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 60.25% (0.8597 => 1.3777, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 59.42% (0.8316 => 1.3257, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 58.15% (0.9056 => 1.4322, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 56.90% (0.9039 => 1.4182, std.dev.: 0.0448) SingleSource/Regression/C/test_indvars: 56.90% (0.0232 => 0.0364, std.dev.: 0.0028) SingleSource/UnitTests/2003-08-05-CastFPToUint: 56.35% (0.0181 => 0.0283, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 55.71% (0.9688 => 1.5085, std.dev.: 0.0297) SingleSource/UnitTests/SignlessTypes/shr: 53.40% (0.0191 => 0.0293, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 50.36% (0.0421 => 0.0633, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/exptree: 48.21% (0.0784 => 0.1162, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 44.98% (2.1401 => 3.1028, std.dev.: 0.0889) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 41.47% (3.1832 => 4.5032, std.dev.: 0.1630) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.48% (0.8855 => 1.2174, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 34.20% (0.8286 => 1.1120, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 33.38% (0.8518 => 1.1361, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 33.06% (0.8050 => 1.0711, std.dev.: 0.0560) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.67% (0.8317 => 1.1034, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.41% (0.8086 => 1.0707, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.75% (0.8712 => 1.1391, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 30.17% (0.8697 => 1.1321, std.dev.: 0.0948) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.90% (0.8420 => 1.0938, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 29.14% (0.9908 => 1.2795, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 28.32% (0.8069 => 1.0354, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.05% (0.8927 => 1.1431, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.62% (0.8656 => 1.1047, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.62% (0.9074 => 1.1580, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.85% (0.7966 => 1.0105, std.dev.: 0.0219) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 26.42% (0.0757 => 0.0957, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ReedSolomon: 25.77% (0.1839 => 0.2313, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.62% (4.4880 => 5.6380, std.dev.: 0.4038) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.15% (0.9069 => 1.1350, std.dev.: 0.0398) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.25% (0.0668 => 0.0830, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.93% (0.6586 => 0.8162, std.dev.: 0.0209) MultiSource/Applications/lemon/lemon: 23.85% (1.0945 => 1.3555, std.dev.: 0.0437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.29% (0.0644 => 0.0794, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: 22.61% (2.3764 => 2.9137, std.dev.: 0.0329) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 22.42% (0.0745 => 0.0912, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.98% (0.5191 => 0.6280, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 20.61% (0.4125 => 0.4975, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: 20.32% (0.1565 => 0.1883, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 19.50% (8.6247 => 10.3068, std.dev.: 0.5167) SingleSource/Benchmarks/Shootout-C++/matrix: 19.26% (0.2227 => 0.2656, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 17.68% (14.2605 => 16.7819, std.dev.: 0.2453) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.59% (0.0648 => 0.0762, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 17.45% (0.2390 => 0.2807, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 17.01% (0.0635 => 0.0743, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 16.68% (0.1097 => 0.1280, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 16.66% (4.9628 => 5.7896, std.dev.: 0.0979) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1466 => 0.1701, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 15.82% (0.0708 => 0.0820, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 14.56% (0.6834 => 0.7829, std.dev.: 0.0144) MultiSource/Applications/ClamAV/clamscan: 13.73% (14.7684 => 16.7962, std.dev.: 0.2074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.16% (0.1885 => 0.2133, std.dev.: 0.0090) MultiSource/Benchmarks/sim/sim: 12.90% (0.3226 => 0.3642, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 12.49% (3.8189 => 4.2960, std.dev.: 0.0662) MultiSource/Applications/JM/lencod/lencod: 11.52% (15.3280 => 17.0931, std.dev.: 0.3698) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.50% (0.1183 => 0.1319, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.36% (0.4559 => 0.5077, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: 10.92% (0.2985 => 0.3311, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.59% (0.3115 => 0.3445, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 10.47% (1.9948 => 2.2036, std.dev.: 0.0406) MultiSource/Applications/JM/ldecod/ldecod: 9.74% (6.7320 => 7.3875, std.dev.: 0.0287) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.54% (0.8995 => 0.9763, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.71% (0.3124 => 0.3365, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: 7.01% (0.2755 => 0.2948, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 5.55% (0.2091 => 0.2207, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1515700.00% (0.0001 => 1.5158, std.dev.: 0.0372) SingleSource/Benchmarks/Shootout/ary3: 628.95% (2.0949 => 15.2707, std.dev.: 1.8889) MultiSource/Applications/sgefa/sgefa: 374.03% (0.3585 => 1.6994, std.dev.: 0.0522) SingleSource/Benchmarks/Shootout/matrix: 363.31% (1.5671 => 7.2605, std.dev.: 0.0760) MultiSource/Benchmarks/PAQ8p/paq8p: 288.27% (91.7701 => 356.3184, std.dev.: 0.5045) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.41% (28.5821 => 85.5790, std.dev.: 0.1217) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 175.05% (5.1305 => 14.1113, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary2: 116.00% (0.0125 => 0.0270, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 106.85% (0.0219 => 0.0453, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.97% (1.1365 => 2.2954, std.dev.: 0.0805) SingleSource/Benchmarks/Shootout-C++/matrix: 63.38% (2.8760 => 4.6987, std.dev.: 0.1897) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.48% (2.7995 => 3.9328, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/pi: 39.57% (1.5795 => 2.2045, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.03% (1.3882 => 1.8467, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.41% (4.5327 => 5.9565, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 29.94% (2.9096 => 3.7807, std.dev.: 0.0411) SingleSource/Benchmarks/Shootout-C++/heapsort: 28.12% (3.0515 => 3.9095, std.dev.: 0.3000) SingleSource/Benchmarks/Shootout/heapsort: 22.74% (3.2926 => 4.0413, std.dev.: 0.2899) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.71% (1.2822 => 1.5734, std.dev.: 0.0506) SingleSource/Benchmarks/McGill/misr: 21.37% (0.4001 => 0.4856, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.10% (4.7794 => 5.5968, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.81% (0.7597 => 0.8874, std.dev.: 0.0446) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.11% (3.9006 => 4.4901, std.dev.: 0.1852) SingleSource/Benchmarks/Misc/salsa20: 14.79% (7.5003 => 8.6097, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.24% (0.3186 => 0.3544, std.dev.: 0.0137) MultiSource/Applications/SPASS/SPASS: 11.03% (8.4326 => 9.3628, std.dev.: 0.0606) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.63% (0.1129 => 0.1249, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 10.53% (3.1873 => 3.5228, std.dev.: 0.0343) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.46% (1.1857 => 1.3097, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 8.27% (8.5322 => 9.2380, std.dev.: 0.0240) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.45% (23.5781 => 25.3351, std.dev.: 0.0683) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.99% (0.6150 => 0.6580, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.69% (4.9686 => 5.3008, std.dev.: 0.0075) MultiSource/Applications/JM/lencod/lencod: 6.15% (6.7064 => 7.1186, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.78% (4.8436 => 5.1236, std.dev.: 0.0350) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.66% (3.5679 => 3.7700, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.49% (0.5214 => 0.5500, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.31% (3.9917 => 4.2038, std.dev.: 0.0751) MultiSource/Applications/aha/aha: 5.18% (3.3398 => 3.5129, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 5.05% (3.8206 => 4.0137, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.76% (6.1706 => 6.4646, std.dev.: 0.0447) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.65% (0.5889 => 0.6163, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 3.76% (2.3560 => 2.4445, std.dev.: 0.0250) MultiSource/Benchmarks/Olden/power/power: 3.72% (1.2061 => 1.2510, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/queens: 3.51% (1.7056 => 1.7655, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (4.2466 => 4.3897, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.43% (3.4104 => 3.4934, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.05% (1.5866 => 1.6191, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.90% (8.2783 => 8.4359, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.50% (1.9302 => 1.9591, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.36% (1.5941 => 1.6158, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/dt: 1.20% (0.9842 => 0.9960, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.12% (3.7192 => 3.7610, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.11% (41.4238 => 41.8842, std.dev.: 0.1674) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.06% (3.7781 => 3.8182, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -70.96% (2.8951 => 0.8406, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.26% (11.5316 => 4.6979, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/fp-convert: -52.28% (15.8853 => 7.5800, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.19% (4.7482 => 3.0296, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.23% (5.4972 => 3.6157, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.35% (5.4300 => 3.6733, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.54% (5.6343 => 4.1388, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: -25.73% (1.9999 => 1.4854, std.dev.: 0.1212) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.26% (5.0261 => 4.0080, std.dev.: 0.0629) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.54% (5.0243 => 4.1935, std.dev.: 0.0697) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.58% (2.9753 => 2.5416, std.dev.: 0.1101) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.96% (9.9065 => 8.7220, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.34% (7.2130 => 6.3951, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.99% (6.3772 => 5.6763, std.dev.: 0.0947) MultiSource/Benchmarks/mafft/pairlocalalign: -10.13% (63.1822 => 56.7798, std.dev.: 0.0979) SingleSource/Benchmarks/McGill/chomp: -9.66% (1.1216 => 1.0132, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-8: -9.56% (2.5609 => 2.3162, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: -9.16% (5.1084 => 4.6406, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.11% (6.2275 => 5.6603, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/em3d/em3d: -9.08% (5.4641 => 4.9682, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.49% (3.7148 => 3.3994, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.27% (5.3218 => 4.9348, std.dev.: 0.0545) SingleSource/Benchmarks/Stanford/FloatMM: -6.65% (0.8807 => 0.8221, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/sieve: -6.16% (7.0599 => 6.6251, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.49% (4.3552 => 4.1162, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.29% (4.9453 => 4.6835, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.26% (0.3937 => 0.3730, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: -5.18% (9.3748 => 8.8895, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.10% (2.8773 => 2.7592, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.23% (1.4529 => 1.4059, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -2.96% (8.9760 => 8.7103, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -2.79% (3.6643 => 3.5619, std.dev.: 0.0396) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.78% (14.6451 => 14.2376, std.dev.: 0.1342) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.69% (6.0224 => 5.8605, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.66% (4.7449 => 4.6187, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/fbench: -2.53% (3.3840 => 3.2984, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.52% (4.9469 => 4.8223, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/flops-5: -1.94% (2.8957 => 2.8394, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: -1.03% (2.8561 => 2.8267, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 13.94% (1.0262 => 1.1693, std.dev.: 0.1460) SingleSource/Benchmarks/CoyoteBench/fftbench: 63.62% (0.2463 => 0.4030, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 77.24% (0.0123 => 0.0218, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.86% (0.0254 => 0.0340, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.96% (0.0302 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.98% (0.0384 => 0.0430, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: 7.37% (0.0190 => 0.0204, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: 22.78% (0.0180 => 0.0221, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.70% (0.1438 => 0.1520, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 13.71% (1.1329 => 1.2882, std.dev.: 0.2560) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.22% (0.4164 => 0.4298, std.dev.: 0.1589) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.24% (0.1369 => 0.1427, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 46.33% (0.0641 => 0.0938, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.94% (0.0578 => 0.0647, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.19% (1.1437 => 1.2945, std.dev.: 0.1330) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.90% (0.0627 => 0.0590, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.11% (0.0180 => 0.0263, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.67% (0.8017 => 2.7873, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.65% (0.0062 => 0.0043, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 16:22:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 18:22:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130103002212.48AEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7312?compare_to=7309&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7312, Order: 171415, Start Time: 2013-01-02 22:07:23, End Time: 2013-01-03 00:21:27 To: 7309, Order: 171401, Start Time: 2013-01-02 19:21:03, End Time: 2013-01-02 21:35:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (612 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.64% (11.2038 => 11.0199, std.dev.: 0.0051) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.76% (0.0691 => 0.0665, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.03% (499.6778 => 499.8439, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.19% (1.1277 => 499.8439, std.dev.: 0.0057) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.14% (0.5229 => 1.6531, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 19.46% (14.9895 => 17.9068, std.dev.: 0.0284) MultiSource/Applications/kimwitu++/kc: 53.29% (14.1553 => 21.6987, std.dev.: 0.0346) MultiSource/Benchmarks/MallocBench/gs/gs: 16.54% (4.1105 => 4.7902, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.55% (1.1048 => 1.7406, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1224.27% (7.1582 => 94.7942, std.dev.: 0.0662) SingleSource/Benchmarks/Misc-C++-EH/spirit: 124.26% (3.4629 => 7.7660, std.dev.: 0.0351) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.05% (0.6222 => 1.1016, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.00% (0.0720 => 7.4412, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3829800.00% (0.0001 => 3.8299, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11147400.00% (0.0001 => 11.1475, std.dev.: 0.0395) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577300.00% (0.0001 => 0.5774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9956700.00% (0.0001 => 9.9568, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5498000.00% (0.0001 => 5.4981, std.dev.: 0.0153) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.10% (1.1194 => 10.2660, std.dev.: 0.0164) MultiSource/Applications/ClamAV/clamscan: 148.23% (22.1758 => 55.0477, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.18% (0.0929 => 0.1711, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 83.13% (0.0243 => 0.0445, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536) MultiSource/Benchmarks/FreeBench/neural/neural: 58.78% (0.1463 => 0.2323, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.40% (2.9384 => 4.6543, std.dev.: 0.0137) SingleSource/Regression/C/sumarray2d: 57.56% (0.0271 => 0.0427, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.46% (7.0540 => 10.8954, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.52% (1.5859 => 2.4030, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 49.49% (0.0394 => 0.0589, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.80% (8.1363 => 11.9441, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 46.75% (0.0231 => 0.0339) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.02% (2.2024 => 3.1059, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.00% (0.0439 => 0.0619, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 39.98% (21.9371 => 30.7075, std.dev.: 0.0202) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.69% (0.6675 => 0.8857, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.20% (0.1062 => 0.1404, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.03% (1.5415 => 2.0352, std.dev.: 0.0082) MultiSource/Applications/sgefa/sgefa: 31.36% (0.3109 => 0.4084, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.17% (0.5105 => 0.6696, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.25% (0.4615 => 0.6011, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 29.73% (0.4299 => 0.5577, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.37% (4.2646 => 5.5173, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 29.31% (0.4289 => 0.5546, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 28.62% (0.0814 => 0.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 27.88% (0.4620 => 0.5908, std.dev.: 0.0108) MultiSource/Applications/Burg/burg: 27.08% (1.1642 => 1.4795, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.08% (0.0746 => 0.0948, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.07% (1.0722 => 1.3517, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.95% (0.1584 => 0.1995, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.63% (0.1892 => 0.2377, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.60% (0.1125 => 0.1413, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573) MultiSource/Benchmarks/McCat/08-main/main: 24.82% (0.2554 => 0.3188, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.61% (0.2271 => 0.2830, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.61% (3.8922 => 4.8500, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 24.43% (0.1175 => 0.1462, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 24.33% (0.6456 => 0.8027, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.82% (0.1906 => 0.2360, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 23.09% (0.0719 => 0.0885, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.71% (1.4186 => 1.7408, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 22.00% (9.4845 => 11.5712, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.98% (0.3121 => 0.3807, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/dot-syntax-1: 21.92% (0.0479 => 0.0584, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 21.81% (5.7591 => 7.0151, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.56% (0.0793 => 0.0964, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 21.47% (0.1337 => 0.1624, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.30% (0.2700 => 0.3275, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 21.17% (0.3283 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 21.03% (0.1655 => 0.2003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 20.88% (0.3232 => 0.3907, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.77% (0.1695 => 0.2047, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 20.73% (0.7115 => 0.8590, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.50% (1.3050 => 1.5725, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 20.30% (0.0660 => 0.0794) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.21% (0.0871 => 0.1047, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.74% (0.1555 => 0.1862, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 19.48% (0.7835 => 0.9361, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.29% (4.9449 => 5.8990, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.05% (0.0672 => 0.0800, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134) SingleSource/Benchmarks/Shootout-C++/ary2: 18.97% (0.3379 => 0.4020, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.90% (0.1032 => 0.1227, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.76% (0.1029 => 0.1222, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 18.73% (1.1840 => 1.4058, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.70% (0.5860 => 0.6956, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 18.66% (17.1811 => 20.3877, std.dev.: 0.0183) MultiSource/Applications/d/make_dparser: 18.65% (3.3354 => 3.9576, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.64% (5.0018 => 5.9339, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 18.41% (0.1695 => 0.2007, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.37% (0.0675 => 0.0799, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.30% (0.1940 => 0.2295, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.21% (0.8172 => 0.9660, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/messages-2: 17.98% (0.0662 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.72% (0.7433 => 0.8750, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.67% (0.4636 => 0.5455, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.66% (0.2107 => 0.2479, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 17.38% (0.1151 => 0.1351, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 17.10% (0.0614 => 0.0719, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.09% (0.5020 => 0.5878, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.99% (0.1236 => 0.1446, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.97% (0.3423 => 0.4004, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.93% (0.2758 => 0.3225, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.5569 => 0.6511, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.91% (0.9765 => 1.1416, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.75% (0.1510 => 0.1763, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 16.64% (0.1268 => 0.1479, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.60% (0.3307 => 0.3856, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.40% (0.5981 => 0.6962, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 16.28% (2.2969 => 2.6708, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 16.02% (3.8723 => 4.4927, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.97% (0.0770 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.95% (0.6450 => 0.7479, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 15.90% (2.0273 => 2.3497, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 15.61% (0.8921 => 1.0314, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.60% (0.8101 => 0.9365, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.46% (0.3441 => 0.3973, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 15.34% (0.0730 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.22% (0.0933 => 0.1075, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.35% (1.1861 => 1.3563, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.09% (0.1143 => 0.1304, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 14.06% (0.2049 => 0.2337, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 13.84% (0.3180 => 0.3620, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.52% (0.3387 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.31% (0.1044 => 0.1183, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.23% (1.5603 => 1.7667, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.94% (0.8067 => 0.9111, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: 12.59% (0.0818 => 0.0921, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.55% (0.3865 => 0.4350, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 12.28% (0.3282 => 0.3685, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 11.44% (0.4048 => 0.4511, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 11.36% (0.3098 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.30% (0.4203 => 0.4678, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.24% (0.4103 => 0.4564, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.13% (14.3668 => 15.9663, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/parameter-passing: 11.10% (0.3927 => 0.4363, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3422 => 0.3796, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 10.88% (0.3603 => 0.3995, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3826 => 0.4232, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.49% (0.2430 => 0.2685, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.42% (0.3684 => 0.4068, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.42% (0.3427 => 0.3784, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.38% (0.3516 => 0.3881, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.35% (0.3092 => 0.3412, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.11% (0.4064 => 0.4475, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.08% (0.3650 => 0.4018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.68% (0.2871 => 0.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.47% (0.2831 => 0.3099, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.12% (2.0665 => 2.2550, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.79% (0.2877 => 0.3130, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.78% (1.2842 => 1.3969, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.77% (0.2793 => 0.3038, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.76% (0.6030 => 0.6558, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.73% (0.2725 => 0.2963, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.66% (63.2438 => 68.7203, std.dev.: 0.0229) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.59% (0.2714 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.44% (0.2891 => 0.3135, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.38% (0.7326 => 0.7940, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.27% (2.2022 => 2.3844, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2802 => 0.3029, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.86% (0.1438 => 0.1551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3935 => 0.4243, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.44% (0.4879 => 0.5242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.3131 => 0.3349, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 6.29% (10.3673 => 11.0199, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.93% (0.3817 => 0.3929, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.79% (7.9617 => 8.1841, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.71% (32.5116 => 59.0764, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.15% (1.1396 => 1.2439, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3797, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4567, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 5.40% (3.1578 => 3.3283, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (2.0360 => 2.1087, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.95% (0.9957 => 1.0251, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9069, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7166, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3441, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (1.7254 => 1.7520, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 1.28% (4.4649 => 4.5221, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.27% (5.2763 => 1.1994, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -75.27% (0.8651 => 0.2139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.02% (5.3855 => 4.4690, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.48% (5.3526 => 4.4706, std.dev.: 0.0037) MultiSource/Applications/JM/ldecod/ldecod: -13.26% (10.4361 => 9.0518, std.dev.: 0.0149) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9406, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.43% (1.7609 => 1.6477, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.77% (1.9577 => 0.6505, std.dev.: 0.0155) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.08% (8.0499 => 4.0185, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.88% (0.0628 => 0.0365, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -33.66% (1.5373 => 1.0199, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4165, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.7981, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0037, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -20.45% (0.2161 => 0.1719, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.17% (2.9695 => 2.3707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.39% (1.2258 => 1.0004, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.34% (2.5528 => 2.1358, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4274, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0931, std.dev.: 0.0044) MultiSource/Benchmarks/NPB-serial/is/is: -11.10% (9.5636 => 8.5017, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4231, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3075, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.64% (1.6805 => 1.5858, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.65% (10.2830 => 9.8052, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.54% (8.1563 => 7.7862, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -3.34% (0.6223 => 0.6015, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -1.99% (1.0554 => 1.0344, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9572, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.16% (4.6441 => 4.5902, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0020) Report Time: 2.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 16:34:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 18:34:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130103003402.2EFDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7313?compare_to=7310&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7313, Order: 171420, Start Time: 2013-01-02 22:57:59, End Time: 2013-01-03 00:34:47 To: 7310, Order: 171407, Start Time: 2013-01-02 20:54:15, End Time: 2013-01-02 22:30:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (843 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.11% (22.4056 => 78.8919, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/lowercase: 65.00% (0.0280 => 0.0462, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.32% (0.0717 => 0.1128, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.31% (0.0974 => 0.1503, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.61% (0.0514 => 0.0769) SingleSource/Regression/C/sumarraymalloc: 37.83% (0.0267 => 0.0368, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 34.93% (0.1500 => 0.2024, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 32.86% (0.1132 => 0.1504, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.55% (0.0599 => 0.0788, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.49% (1.6474 => 2.1003, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.60% (0.0699 => 0.0850, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.50% (5.4682 => 6.6440, std.dev.: 0.0645) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.67% (2.2587 => 2.7030, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.65% (0.0680 => 0.0800, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 15.74% (1.1450 => 1.3252, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.47% (0.6395 => 0.7384, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.00% (0.6395 => 0.7290, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.10% (0.6260 => 0.7080, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 12.49% (0.4524 => 0.5089, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.22% (0.1146 => 0.1286, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.12% (0.5941 => 0.6661, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.59% (0.5805 => 0.6478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.48% (0.6230 => 0.6945, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.28% (0.7021 => 0.7813, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.22% (0.5849 => 0.6505, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.16% (0.6033 => 0.6706, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 11.01% (0.4861 => 0.5396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.90% (0.6440 => 0.7142, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.89% (0.5456 => 0.6050, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.76% (0.5575 => 0.6175, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 10.76% (0.5688 => 0.6300, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.53% (0.6676 => 0.7379, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.51% (0.5925 => 0.6548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.35% (0.5567 => 0.6143, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.33% (1.6364 => 1.8055, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.32% (0.5581 => 0.6157, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.24% (0.5802 => 0.6396, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.15% (0.4916 => 0.5415, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 9.75% (0.5857 => 0.6428, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 9.75% (0.4515 => 0.4955, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.70% (0.6052 => 0.6639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.69% (0.5859 => 0.6427, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.53% (0.6446 => 0.7060, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.23% (0.6189 => 0.6760, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.14% (0.5570 => 0.6079, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.03% (0.1982 => 0.2161, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.00% (0.5569 => 0.6070, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.98% (0.5591 => 0.6093, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.97% (0.5705 => 0.6217, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.95% (0.5329 => 0.5806, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 8.95% (0.6304 => 0.6868, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.87% (0.5478 => 0.5964, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (3.5339 => 3.8458, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.32% (0.6660 => 0.7214, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.19% (0.5863 => 0.6343, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.95% (4.5069 => 4.8651, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary3: 7.86% (0.3446 => 0.3717, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.85% (0.6194 => 0.6680, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.75% (0.6297 => 0.6785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 7.54% (0.3394 => 0.3650, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 7.54% (0.3357 => 0.3610, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.47% (0.6681 => 0.7180, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.40% (0.7524 => 0.8081, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.20% (0.6667 => 0.7147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 6.92% (0.6750 => 0.7217, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.32% (0.7339 => 0.7803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 6.18% (0.3481 => 0.3696, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.4642 => 1.5452, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.33% (18.2933 => 19.2686, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.20% (0.2385 => 0.2509, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.19% (1.2784 => 1.3447, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 5.14% (1.2515 => 1.3158, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.09% (9.2283 => 9.6982, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 3.23% (17.1032 => 17.6553, std.dev.: 0.0412) MultiSource/Applications/oggenc/oggenc: 2.89% (5.0226 => 5.1676, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.70% (0.9557 => 0.9815, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.41% (0.4813 => 0.4929, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.3864 => 1.4149, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.86% (31.3723 => 55.4843, std.dev.: 0.0614) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9531 => 1.0271, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (5.1955 => 5.4389, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1157, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5772, std.dev.: 0.0667) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1060, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8210 => 28.3223, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (79.7170 => 80.9242, std.dev.: 0.4487) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5320 => 4.5999, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4335 => 4.4802, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.40% (0.2428 => 0.2297, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3821 => 0.3639, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (0.9852 => 0.9391, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.55% (0.3142 => 0.2999, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.43% (0.9542 => 0.9119, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.20% (0.7198 => 0.6896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.99% (0.3812 => 0.3660, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3831 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.95% (0.3896 => 0.3742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.90% (0.3848 => 0.3698, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3880 => 0.3729, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.4176 => 0.4014, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.79% (0.4033 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.62% (0.6484 => 0.6249, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (2.4924 => 2.4037, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -3.55% (0.4199 => 0.4050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3884 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.52% (0.7919 => 0.7640, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: -3.41% (0.4280 => 0.4134, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.16% (20.7746 => 20.1184, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: -3.16% (4.3330 => 4.1962, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.92% (0.3837 => 0.3725, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -2.77% (0.6347 => 0.6171, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.68% (1.3148 => 1.2796, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.65% (1.2210 => 1.1887, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.64% (1.2221 => 1.1898, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -2.59% (0.7982 => 0.7775, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.50% (1.0544 => 1.0280, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -2.44% (0.7779 => 0.7589, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.36% (0.4321 => 0.4219, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.33% (2.1713 => 2.1207, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.30% (1.2300 => 1.2017, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.25% (6.7716 => 6.6191, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.19% (14.2083 => 13.8976, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: -2.12% (7.0961 => 6.9455, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: -2.10% (16.1920 => 15.8525, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -1.97% (34.0927 => 33.4205, std.dev.: 0.0223) MultiSource/Applications/lua/lua: -1.94% (4.0594 => 3.9807, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -1.56% (0.9179 => 0.9036, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: -1.27% (2.1401 => 2.1129, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.22% (0.9077 => 0.8966, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -1.01% (1.5610 => 1.5453, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.88% (1.8100 => 0.6899, std.dev.: 0.0190) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.86% (8.0445 => 4.0338, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4756, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.17% (0.6962 => 0.3817, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.50% (0.1622 => 0.1111, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.84% (0.1983 => 0.1431, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.69% (1.3643 => 1.0274, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.57% (0.2274 => 0.1738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.33% (83.5423 => 64.0482, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3991, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1995, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.82% (3.3454 => 2.7159, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.70% (2.5106 => 2.1165, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1050, std.dev.: 0.0726) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3586, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6340, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8215, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.00% (1.1594 => 1.0898, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9086, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.72% (1.7753 => 1.6915, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.91% (7.9763 => 7.7443, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2277, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.21% (1.3096 => 1.2807, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.88% (2.7523 => 2.7005, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1881, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6023, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6307 => 1.6121, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.07% (4.8776 => 4.8253, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 17:59:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 19:59:48 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130103015948.77E342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7314?compare_to=7311&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7314, Order: 171426, Start Time: 2013-01-02 23:53:29, End Time: 2013-01-03 02:00:10 To: 7311, Order: 171408, Start Time: 2013-01-02 21:26:28, End Time: 2013-01-02 23:32:08 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 13 (130 on baseline) Performance Improvements: 5 (34 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1042 (812 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.82% (1.5085 => 1.5662, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (1.4182 => 1.4517, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 1.31% (2.9137 => 2.9520, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/BitBench/uuencode/uuencode: 89.55% (0.0220 => 0.0417, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 54.60% (0.0619 => 0.0957, std.dev.: 0.0014) SingleSource/Benchmarks/LivermoreLoops/kernel24: 27.60% (0.3228 => 0.4119, std.dev.: 0.0225) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.68% (2.4776 => 2.8413, std.dev.: 0.0990) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.69% (3.0449 => 3.2485, std.dev.: 0.0504) SingleSource/Benchmarks/Dhrystone/fldry: 4.87% (0.6534 => 0.6852, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.36% (3.7700 => 3.8590, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.01% (1.8187 => 1.8552, std.dev.: 0.0141) MultiSource/Benchmarks/NPB-serial/is/is: 1.18% (13.2200 => 13.3764, std.dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.11% (1.3097 => 1.3243, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/garage/garage: -12.99% (0.0847 => 0.0737, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.25% (0.3999 => 0.3829, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.42% (1.3605 => 1.3140, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.06% (1.2174 => 1.1923, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/richards_benchmark: -1.52% (1.3771 => 1.3562, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.05% (1.1693 => 1.1453, std.dev.: 0.0511) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.12% (0.4030 => 0.4025, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.21% (0.0218 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.08% (0.0432 => 0.0441, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.88% (0.0340 => 0.0343, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.56% (0.0320 => 0.0325, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.02% (0.0430 => 0.0443, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/casts: 1.96% (0.0204 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -7.24% (0.0221 => 0.0205, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -34.78% (0.0253 => 0.0165, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -42.86% (0.0014 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.05% (0.1520 => 0.1504, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -4.97% (1.2882 => 1.2242, std.dev.: 0.0862) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.07% (0.4298 => 0.4037, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.96% (0.1427 => 0.1512, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0938 => 0.0938, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0278 => 0.0275, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.41% (0.0647 => 0.0612, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.76% (1.2945 => 1.2846, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.88% (0.0590 => 0.0607, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.94% (0.0263 => 0.0276, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.03% (2.7873 => 2.7586, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 104.65% (0.0043 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.18% (30.9127 => 31.2760, std.dev.: 0.1706) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 21.79% (16.4461 => 20.0299, std.dev.: 0.9092) MultiSource/Applications/sqlite3/sqlite3: 3501.75% (0.6332 => 22.8063, std.dev.: 1.0806) MultiSource/Benchmarks/McCat/08-main/main: 58.06% (0.1831 => 0.2894, std.dev.: 0.0500) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.16% (0.1559 => 0.1998, std.dev.: 0.0234) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 26756.84% (0.3123 => 83.8739, std.dev.: 20.0635) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1997.97% (0.3344 => 7.0156, std.dev.: 0.1622) SingleSource/Benchmarks/Misc-C++/Large/ray: 42.09% (0.2364 => 0.3359, std.dev.: 0.0938) SingleSource/Benchmarks/Misc-C++/bigfib: 19.65% (0.6010 => 0.7191, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/mandel: 6.99% (0.0429 => 0.0459, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.15% (0.3266 => 0.3565, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 4.98% (0.1969 => 0.2067, std.dev.: 0.0033) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 3.12% (0.0224 => 0.0231, std.dev.: 0.0029) SingleSource/UnitTests/byval-alignment: -24.35% (0.0230 => 0.0174, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0521, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 17.03% (0.1462 => 0.1711, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.3908, std.dev.: 0.1042) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0693, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.5356, std.dev.: 0.0590) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5352, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5428, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0787, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3383, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3882, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0776, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: -29.71% (2.1832 => 1.5346, std.dev.: 0.0050) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 151.00% (0.0249 => 0.0625, std.dev.: 0.0008) SingleSource/Regression/C/sumarray: 75.11% (0.0233 => 0.0408, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/factor: 72.05% (0.0297 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 69.29% (0.8177 => 1.3843, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 68.96% (0.7932 => 1.3402, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 68.13% (0.8805 => 1.4804, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 67.96% (0.8359 => 1.4040, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 65.83% (0.8048 => 1.3346, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/neural/neural: 64.24% (0.1440 => 0.2365, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 64.21% (0.8261 => 1.3565, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 64.11% (0.8007 => 1.3140, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 62.81% (0.8066 => 1.3132, std.dev.: 0.0674) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 62.65% (0.8338 => 1.3562, std.dev.: 0.1358) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 62.42% (0.8457 => 1.3736, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 61.66% (0.9688 => 1.5662, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.35% (1.5315 => 2.4710, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 61.17% (0.9056 => 1.4596, std.dev.: 0.0849) SingleSource/Regression/C/test_indvars: 60.78% (0.0232 => 0.0373, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 60.60% (0.9039 => 1.4517, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 60.50% (0.8885 => 1.4260, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 60.12% (0.8716 => 1.3956, std.dev.: 0.0290) SingleSource/UnitTests/SignlessTypes/shr: 58.64% (0.0191 => 0.0303, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 52.50% (0.1099 => 0.1676, std.dev.: 0.0167) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 48.94% (2.1401 => 3.1875, std.dev.: 0.1101) SingleSource/UnitTests/Vector/multiplies: 47.53% (0.0223 => 0.0329, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 46.46% (0.0635 => 0.0930, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.04% (0.0421 => 0.0598, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 41.59% (3.1832 => 4.5072, std.dev.: 0.1471) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 39.78% (0.0734 => 0.1026, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.08% (0.0650 => 0.0891, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 34.65% (0.8855 => 1.1923, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 34.28% (0.8656 => 1.1623, std.dev.: 0.0340) SingleSource/Benchmarks/CoyoteBench/lpbench: 33.67% (0.0989 => 0.1322, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 33.23% (0.8331 => 1.1099, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.04% (0.8286 => 1.1024, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 32.91% (0.9069 => 1.2054, std.dev.: 0.0778) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 32.69% (0.8697 => 1.1540, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 32.32% (0.8927 => 1.1812, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.17% (0.7966 => 1.0529, std.dev.: 0.0931) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.04% (0.8712 => 1.1503, std.dev.: 0.0700) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 31.84% (4.1763 => 5.5059, std.dev.: 0.3547) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.60% (0.8086 => 1.0641, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.07% (0.8050 => 1.0551, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 30.03% (4.4873 => 5.8348, std.dev.: 0.4704) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.76% (0.9074 => 1.1774, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 28.48% (0.8069 => 1.0367, std.dev.: 0.0358) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 28.27% (0.0757 => 0.0971, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.75% (0.6586 => 0.8348, std.dev.: 0.0250) MultiSource/Benchmarks/PAQ8p/paq8p: 24.22% (2.3764 => 2.9520, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: 23.51% (0.1565 => 0.1933, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/salsa20: 22.76% (0.0457 => 0.0561, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 22.06% (1.0945 => 1.3359, std.dev.: 0.0319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 21.74% (0.0745 => 0.0907, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 21.41% (0.4125 => 0.5008, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/hash: 21.39% (0.3800 => 0.4613, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.13% (1.2526 => 1.5173, std.dev.: 0.0709) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.78% (0.5191 => 0.6218, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 18.87% (0.2427 => 0.2885, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 18.19% (0.2227 => 0.2632, std.dev.: 0.0071) MultiSource/Applications/oggenc/oggenc: 17.75% (4.9628 => 5.8436, std.dev.: 0.1042) SingleSource/Benchmarks/Shootout-C++/ary: 17.32% (0.2390 => 0.2804, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 17.25% (0.0626 => 0.0734, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 16.97% (1.2568 => 1.4701, std.dev.: 0.0251) SingleSource/UnitTests/SignlessTypes/rem: 16.04% (0.1035 => 0.1201, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 15.40% (0.0708 => 0.0817, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.80% (0.1466 => 0.1683, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 14.34% (15.3280 => 17.5256, std.dev.: 0.2531) MultiSource/Applications/JM/ldecod/ldecod: 13.80% (6.7320 => 7.6611, std.dev.: 0.3075) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 13.04% (0.1150 => 0.1300, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 11.97% (14.7684 => 16.5361, std.dev.: 0.5965) MultiSource/Applications/viterbi/viterbi: 11.54% (0.1577 => 0.1759, std.dev.: 0.0069) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.27% (0.1091 => 0.1214, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/distray/distray: 11.15% (0.0915 => 0.1017, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 10.77% (3.8189 => 4.2303, std.dev.: 0.0547) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.57% (0.1183 => 0.1308, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.49% (0.2794 => 0.3087, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.57% (0.3115 => 0.3413, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.43% (0.3124 => 0.3356, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 7.38% (0.3645 => 0.3914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 6.68% (0.2755 => 0.2939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.98% (1.4479 => 1.5345, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.77% (0.2774 => 0.2934, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.45% (0.2111 => 0.2226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.70% (0.3657 => 0.3829, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: 4.58% (0.2183 => 0.2283, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1516000.00% (0.0001 => 1.5161, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/ary3: 608.11% (2.0949 => 14.8342, std.dev.: 1.9209) MultiSource/Applications/sgefa/sgefa: 373.70% (0.3585 => 1.6982, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: 355.71% (1.5671 => 7.1415, std.dev.: 0.0755) MultiSource/Benchmarks/PAQ8p/paq8p: 285.45% (91.7701 => 353.7252, std.dev.: 4.1744) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.06% (28.5821 => 85.4769, std.dev.: 0.2211) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 174.49% (5.1305 => 14.0826, std.dev.: 1.3787) SingleSource/Benchmarks/Shootout-C++/ary2: 124.00% (0.0125 => 0.0280, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 117.36% (1.1365 => 2.4703, std.dev.: 0.2216) SingleSource/Benchmarks/Shootout-C++/ary: 108.22% (0.0219 => 0.0456, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 103.41% (0.0205 => 0.0417, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 81.25% (0.0528 => 0.0957, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 61.80% (2.8760 => 4.6535, std.dev.: 0.1235) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.90% (2.7995 => 3.9166, std.dev.: 0.1026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 33.79% (1.3882 => 1.8573, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.37% (4.5327 => 5.9998, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/pi: 31.48% (1.5795 => 2.0768, std.dev.: 0.0679) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 30.22% (2.9096 => 3.7890, std.dev.: 0.0486) SingleSource/Benchmarks/McGill/misr: 19.90% (0.4001 => 0.4797, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.09% (0.7597 => 0.9047, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.07% (4.7794 => 5.5954, std.dev.: 0.0501) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.77% (2.4333 => 2.8413, std.dev.: 0.0990) SingleSource/Benchmarks/Misc/salsa20: 14.30% (7.5003 => 8.5727, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 11.69% (1.1857 => 1.3243, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 11.05% (3.1873 => 3.5395, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.36% (0.1129 => 0.1246, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 8.17% (8.5322 => 9.2297, std.dev.: 0.0291) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.16% (3.5679 => 3.8590, std.dev.: 0.0297) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.45% (23.5781 => 25.3352, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.35% (2.2485 => 2.4138, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.13% (3.9917 => 4.2765, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.78% (4.8436 => 5.1237, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.75% (4.9686 => 5.2545, std.dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: 5.50% (6.7064 => 7.0752, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.18% (6.1706 => 6.4900, std.dev.: 0.0436) MultiSource/Benchmarks/sim/sim: 4.91% (3.8206 => 4.0082, std.dev.: 0.0611) SingleSource/Benchmarks/Misc/richards_benchmark: 4.03% (1.3037 => 1.3562, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.89% (0.5889 => 0.6118, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 3.82% (0.5214 => 0.5413, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 3.76% (1.2061 => 1.2514, std.dev.: 0.0164) SingleSource/Benchmarks/McGill/queens: 3.54% (1.7056 => 1.7660, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.38% (4.2466 => 4.3901, std.dev.: 0.0523) SingleSource/Benchmarks/Dhrystone/dry: 3.15% (0.5081 => 0.5241, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.38% (3.4104 => 3.4917, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.11% (3.7781 => 3.8200, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -70.95% (2.8951 => 0.8410, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -58.87% (11.5316 => 4.7426, std.dev.: 0.1301) SingleSource/Benchmarks/Misc/fp-convert: -52.70% (15.8853 => 7.5145, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.15% (4.7482 => 3.0319, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.27% (5.4972 => 3.6134, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -33.00% (5.4300 => 3.6382, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.54% (5.6343 => 4.1388, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.31% (5.0261 => 4.0054, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.65% (5.0243 => 4.1877, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.69% (2.9753 => 2.5381, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.91% (9.9065 => 8.7265, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -11.81% (6.3772 => 5.6242, std.dev.: 0.2505) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.46% (7.2130 => 6.3863, std.dev.: 0.2076) MultiSource/Benchmarks/mafft/pairlocalalign: -10.18% (63.1822 => 56.7517, std.dev.: 0.1246) SingleSource/Benchmarks/Misc/flops-8: -9.45% (2.5609 => 2.3189, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/perlin: -9.33% (5.1084 => 4.6317, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: -9.19% (5.4641 => 4.9621, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.92% (3.7148 => 3.3833, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.83% (6.2275 => 5.6777, std.dev.: 0.0145) SingleSource/Benchmarks/McGill/chomp: -8.82% (1.1216 => 1.0227, std.dev.: 0.0373) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.01% (1.0512 => 0.9670, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.28% (4.3552 => 4.0381, std.dev.: 0.1088) SingleSource/Benchmarks/Stanford/FloatMM: -6.43% (0.8807 => 0.8241, std.dev.: 0.0206) SingleSource/Benchmarks/Misc/flops: -5.31% (9.3748 => 8.8772, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.30% (4.9453 => 4.6833, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.99% (6.0224 => 5.7821, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.92% (5.1557 => 5.0052, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/methcall: -2.86% (8.9760 => 8.7189, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.53% (2.6356 => 2.5689, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.21% (4.9469 => 4.8378, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/fbench: -2.18% (3.3840 => 3.3101, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-5: -1.65% (2.8957 => 2.8478, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.62% (3.3479 => 3.2937, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/neural/neural: -1.05% (1.0841 => 1.0727, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.61% (1.0262 => 1.1453, std.dev.: 0.0511) SingleSource/Benchmarks/CoyoteBench/fftbench: 63.42% (0.2463 => 0.4025, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 82.93% (0.0123 => 0.0225, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.09% (0.0408 => 0.0441, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 35.04% (0.0254 => 0.0343, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.62% (0.0302 => 0.0325, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.36% (0.0384 => 0.0443, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/casts: 9.47% (0.0190 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 13.89% (0.0180 => 0.0205, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 14.29% (0.0007 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.59% (0.1438 => 0.1504, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 8.06% (1.1329 => 1.2242, std.dev.: 0.0862) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.05% (0.4164 => 0.4037, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.45% (0.1369 => 0.1512, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 46.33% (0.0641 => 0.0938, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.03% (0.0195 => 0.0275, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.88% (0.0578 => 0.0612, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.32% (1.1437 => 1.2846, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.19% (0.0627 => 0.0607, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 53.33% (0.0180 => 0.0276, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 244.09% (0.8017 => 2.7586, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 41.94% (0.0062 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 18:10:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 20:10:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130103021038.F1B002A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7315?compare_to=7308&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7315, Order: 171415, Start Time: 2013-01-02 22:36:34, End Time: 2013-01-03 02:10:52 To: 7308, Order: 171393, Start Time: 2013-01-02 18:00:13, End Time: 2013-01-02 21:33:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (708 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.87% (0.2097 => 0.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (13.3208 => 13.5570, std.dev.: 0.0757) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.06% (11.6398 => 21.0756, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.00% (0.5361 => 0.8256, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.56% (0.0625 => 0.0891, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1063 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.00% (0.7426 => 0.9431, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.50% (0.4139 => 0.5236, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.22% (0.5900 => 0.7447, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.01% (0.4253 => 0.5359, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.23% (0.0547 => 0.0685, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 25.02% (1.5932 => 1.9918, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.59% (0.4994 => 0.6222, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.26% (0.5000 => 0.6213, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.03% (0.1003 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.02% (0.1549 => 0.1921, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.0948 => 0.1160, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.00% (0.0541 => 0.0660, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.73% (0.3903 => 0.4751, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 20.92% (0.0808 => 0.0977, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.45% (0.1462 => 0.1761, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.15% (0.3890 => 0.4674, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.10% (0.2866 => 0.3442, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.06% (0.2014 => 0.2418, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.00% (0.4029 => 0.4835, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.00% (0.1160 => 0.1392, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.56% (0.1968 => 0.2353, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.44% (1.3152 => 1.5709, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.11% (0.3271 => 0.3896, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 18.90% (0.2566 => 0.3051, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.87% (4.4195 => 5.2536, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.77% (3.5627 => 4.2313, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.39% (1.6211 => 1.9192, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 18.31% (0.5889 => 0.6967, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 18.30% (0.5546 => 0.6561, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 18.20% (1.8794 => 2.2214, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.18% (0.4658 => 0.5505, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.83% (0.5026 => 0.5922, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.1421 => 0.1668, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.36% (0.4361 => 0.5118, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.21% (0.1284 => 0.1505, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.20% (0.3930 => 0.4606, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.09% (2.7292 => 3.1955, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 17.07% (0.9697 => 1.1352, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 16.81% (4.2109 => 4.9187, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: 16.75% (1.0781 => 1.2587, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.45% (1.9694 => 2.2933, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.37% (0.2792 => 0.3249, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 16.35% (0.2813 => 0.3273, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.33% (0.2823 => 0.3284, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.32% (0.7171 => 0.8341, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.28% (0.2911 => 0.3385, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.25% (1.9966 => 2.3210, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: 16.21% (0.2714 => 0.3154, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 16.17% (0.9909 => 1.1511, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.15% (0.2725 => 0.3165, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 16.14% (0.2075 => 0.2410, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.09% (4.6926 => 5.4476, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.08% (0.3004 => 0.3487, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.88% (2.0673 => 2.3956, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.74% (0.3195 => 0.3698, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 15.73% (23.5202 => 27.2188, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/wc: 15.67% (0.3096 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.46% (0.3060 => 0.3533, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 15.34% (0.3267 => 0.3768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.08% (0.3124 => 0.3595, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.00% (1.4269 => 1.6409, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.93% (0.3362 => 0.3864, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.84% (0.3282 => 0.3769, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.79% (0.3442 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 14.73% (0.3469 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3496 => 0.4010, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.65% (0.3678 => 0.4217, std.dev.: 0.0059) MultiSource/Applications/treecc/treecc: 14.57% (0.7875 => 0.9022, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 14.47% (4.6177 => 5.2857, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 14.41% (0.3477 => 0.3978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.39% (0.3726 => 0.4262, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: 14.37% (2.1653 => 2.4765, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 14.34% (0.2691 => 0.3077, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.27% (0.3650 => 0.4171, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.25% (0.3643 => 0.4162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.18% (0.3625 => 0.4139, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.09% (0.3690 => 0.4210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.04% (0.3981 => 0.4540, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 13.97% (0.4146 => 0.4725, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 13.76% (2.1013 => 2.3905, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.65% (0.3845 => 0.4370, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.5012 => 0.5685, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.38% (0.1383 => 0.1568, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.99% (0.2040 => 0.2305, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.80% (0.6435 => 0.7259, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.34% (0.4847 => 0.5445, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 12.31% (5.5417 => 6.2237, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.26% (0.3084 => 0.3462, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.24% (0.3498 => 0.3926, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 12.04% (0.6634 => 0.7433, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 11.95% (2.0346 => 2.2778, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.95% (0.2737 => 0.3064, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.87% (0.1028 => 0.1150, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 11.27% (0.3336 => 0.3712, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 10.62% (0.2391 => 0.2645, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 9.88% (11.9555 => 13.1364, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.06% (0.5584 => 0.6090, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.35% (0.3792 => 0.3995, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5253, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.31% (0.3693 => 0.4000, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6711, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2376, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6792, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 3.00% (0.6276 => 0.6464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1985, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.53% (7.1849 => 7.2950, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.40% (1.0927 => 1.1080, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2062, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5861, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4776, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5547, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.54% (17.2379 => 14.2145, std.dev.: 0.1372) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7893, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2146, std.dev.: 0.0109) SingleSource/UnitTests/Vector/build2: -3.77% (11.2080 => 10.7857, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -3.50% (14.0481 => 13.5570, std.dev.: 0.0757) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1686, std.dev.: 0.0619) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.10% (0.6293 => 0.6161, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1435, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0496, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 3.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 18:34:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 20:34:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130103023442.5FAD12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7316?compare_to=7313&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7316, Order: 171432, Start Time: 2013-01-03 00:58:38, End Time: 2013-01-03 02:35:14 To: 7313, Order: 171420, Start Time: 2013-01-02 22:57:59, End Time: 2013-01-03 00:34:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (101 on baseline) Performance Improvements: 4 (118 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1094 (825 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.31% (0.7803 => 0.7905, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.25% (78.8919 => 79.8802, std.dev.: 0.0715) MultiSource/Benchmarks/PAQ8p/paq8p: 1.09% (2.4037 => 2.4299, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.41% (27.9601 => 29.7532, std.dev.: 0.0426) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.82% (0.6274 => 0.6160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -1.78% (0.6171 => 0.6061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7589 => 0.7480, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (2.1207 => 2.0946, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 256.52% (22.4056 => 79.8802, std.dev.: 0.0715) SingleSource/Benchmarks/Misc/lowercase: 65.71% (0.0280 => 0.0464, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 58.44% (0.0717 => 0.1136, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 56.67% (0.0974 => 0.1526, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 55.56% (0.0315 => 0.0490, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 50.58% (0.0514 => 0.0774, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 38.58% (0.0267 => 0.0370, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 35.80% (0.1500 => 0.2037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.75% (0.1132 => 0.1514, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 32.72% (0.0599 => 0.0795) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.65% (1.6474 => 2.1194, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 22.32% (0.0699 => 0.0855, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.30% (5.4682 => 6.6876, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.28% (0.0790 => 0.0966, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.83% (2.2587 => 2.7292, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 18.53% (0.0680 => 0.0806) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 17.53% (0.0582 => 0.0684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.98% (0.6395 => 0.7481, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 16.39% (1.1450 => 1.3327, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 15.32% (0.6395 => 0.7375, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 14.35% (0.6260 => 0.7158, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.88% (0.3834 => 0.4366, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 13.30% (0.5941 => 0.6731, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 13.03% (0.6230 => 0.7042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.78% (0.5805 => 0.6547, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.65% (0.1146 => 0.1291) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.57% (0.5849 => 0.6584, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 12.46% (0.6033 => 0.6785, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.11% (0.7021 => 0.7871, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.10% (0.6440 => 0.7219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.90% (0.5456 => 0.6105, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.85% (0.5688 => 0.6362, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.78% (0.5925 => 0.6623, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.77% (0.5581 => 0.6238, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.70% (0.5575 => 0.6227, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.69% (0.5567 => 0.6218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 11.64% (0.6676 => 0.7453, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.56% (0.5802 => 0.6473, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 11.56% (0.4524 => 0.5047, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.05% (0.5857 => 0.6504, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.01% (1.6364 => 1.8166, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.01% (0.5859 => 0.6504, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 10.94% (0.4515 => 0.5009, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.89% (0.6052 => 0.6711, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.81% (0.6446 => 0.7143, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.57% (0.5570 => 0.6159, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.44% (0.4916 => 0.5429, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 10.43% (0.4861 => 0.5368, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.36% (0.6189 => 0.6830, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.31% (0.5569 => 0.6143, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 10.22% (0.5705 => 0.6288, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.20% (0.5478 => 0.6037, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.10% (0.6304 => 0.6941, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.07% (0.5591 => 0.6154, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.96% (0.5329 => 0.5860, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.72% (3.5339 => 3.8774, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.59% (0.6660 => 0.7299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 9.59% (0.5863 => 0.6425, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.49% (0.1982 => 0.2170, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.33% (0.6194 => 0.6772, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.04% (0.6297 => 0.6866, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.77% (0.6681 => 0.7267, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.64% (4.5069 => 4.8965, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.55% (0.7524 => 0.8167, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 8.40% (0.3357 => 0.3639, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.40% (0.6667 => 0.7227, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.71% (0.7339 => 0.7905, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 6.96% (0.3446 => 0.3686, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.87% (0.6750 => 0.7214, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 6.54% (0.3394 => 0.3616, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.16% (1.4642 => 1.5544, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.91% (0.2385 => 0.2526, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.83% (18.2933 => 19.3592, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (9.2283 => 9.7622, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.75% (1.2784 => 1.3519, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 5.57% (1.2515 => 1.3212, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 5.17% (0.3481 => 0.3661, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 3.83% (17.1032 => 17.7574, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 3.70% (5.0226 => 5.2082, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.85% (0.9557 => 0.9829, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.3864 => 1.4218, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.59% (0.8418 => 0.8552, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.3722 => 1.3912, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.83% (31.3723 => 55.4753, std.dev.: 0.0568) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.2380 => 0.2493, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.68% (5.1955 => 5.4387, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1159, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5429, std.dev.: 0.1658) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3171, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.08% (4.4335 => 4.4815, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3812 => 0.3634, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.66% (0.3880 => 0.3699, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.63% (0.3848 => 0.3670, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.62% (0.3896 => 0.3716, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.52% (0.3891 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.36% (0.4033 => 0.3857, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.22% (0.4199 => 0.4022, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.10% (0.7198 => 0.6903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.07% (0.3884 => 0.3726, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.92% (0.9852 => 0.9466, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4280 => 0.4113, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3821 => 0.3672, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.84% (0.7779 => 0.7480, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -3.80% (0.2871 => 0.2762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.79% (0.3057 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.75% (0.2903 => 0.2794, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -3.68% (0.3205 => 0.3087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.65% (0.2849 => 0.2745, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.65% (0.3837 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.53% (2.1713 => 2.0946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.9542 => 0.9205, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.52% (0.3323 => 0.3206, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -3.44% (0.3026 => 0.2922) SingleSource/Benchmarks/Shootout-C++/random: -3.44% (0.2939 => 0.2838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (0.3025 => 0.2923, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2707, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.05% (0.4321 => 0.4189, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -2.95% (0.3621 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.87% (0.3931 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.85% (0.7919 => 0.7693, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.82% (0.3867 => 0.3758, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1936, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.62% (0.3849 => 0.3748, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -2.51% (2.4924 => 2.4299, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -2.49% (4.3330 => 4.2253, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0301, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1943, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (1.2210 => 1.1938, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -2.20% (0.7982 => 0.7806, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.98% (6.7716 => 6.6377, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.72% (1.2300 => 1.2088, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.68% (0.5999 => 0.5898, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.68% (14.2083 => 13.9698, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -1.66% (7.0961 => 6.9780, std.dev.: 0.0133) MultiSource/Benchmarks/Bullet/bullet: -1.63% (34.0927 => 33.5371, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.60% (0.8521 => 0.8385, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -1.52% (16.1920 => 15.9462, std.dev.: 0.0110) MultiSource/Applications/lua/lua: -1.47% (4.0594 => 3.9996, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -1.04% (1.5610 => 1.5448, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.29% (1.8100 => 0.6825, std.dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.90% (8.0445 => 4.0303, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.84% (0.6962 => 0.3840, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.57% (0.1622 => 0.1110, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.84% (0.1983 => 0.1431, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.31% (0.2151 => 0.1585, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -24.33% (1.3643 => 1.0324, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.61% (0.2274 => 0.1737, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0302, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1997, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.65% (5.3397 => 4.1834, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.72% (3.3454 => 2.7191, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.24% (1.2237 => 1.0005, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.61% (2.5106 => 2.1187, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7052, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.23% (4.9100 => 4.3584, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.39% (5.2027 => 4.8183, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9088, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.74% (1.1594 => 1.0928, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.70% (1.7753 => 1.6918, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1817, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7343, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2273, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2730, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.91% (6.5735 => 6.4481, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7009, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1943, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.8776 => 4.8142, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 19:07:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 21:07:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130103030712.718712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7317?compare_to=7312&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7317, Order: 171430, Start Time: 2013-01-03 00:53:27, End Time: 2013-01-03 03:07:30 To: 7312, Order: 171415, Start Time: 2013-01-02 22:07:23, End Time: 2013-01-03 00:21:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (215 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (611 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.66% (11.0199 => 11.4232, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.73% (10.8954 => 11.0842, std.dev.: 0.0221) MultiSource/Applications/JM/lencod/lencod: 1.46% (30.7075 => 31.1543, std.dev.: 0.0271) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0665 => 0.0664, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8439 => 499.8506, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 44224.78% (1.1277 => 499.8506, std.dev.: 0.0032) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.29% (0.5229 => 1.6591, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 20.24% (14.9895 => 18.0233, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 54.28% (14.1553 => 21.8382, std.dev.: 0.0297) MultiSource/Benchmarks/MallocBench/gs/gs: 17.03% (4.1105 => 4.8104, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.05% (1.1048 => 1.7461, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1236.27% (7.1582 => 95.6528, std.dev.: 0.0906) SingleSource/Benchmarks/Misc-C++-EH/spirit: 124.84% (3.4629 => 7.7859, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.87% (0.6222 => 1.1005, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.31% (0.0720 => 7.4371, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3830100.00% (0.0001 => 3.8302, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11155500.00% (0.0001 => 11.1556, std.dev.: 0.0100) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577700.00% (0.0001 => 0.5778, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9957300.00% (0.0001 => 9.9574, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503500.00% (0.0001 => 5.5036, std.dev.: 0.0249) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.21% (1.1194 => 10.2337, std.dev.: 0.0093) MultiSource/Applications/ClamAV/clamscan: 148.80% (22.1758 => 55.1731, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/lowercase: 101.56% (0.0256 => 0.0516, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.39% (0.0929 => 0.1713, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 83.95% (0.0243 => 0.0447, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.13% (0.1463 => 0.2328, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.37% (2.9384 => 4.6534, std.dev.: 0.0113) SingleSource/Regression/C/sumarray2d: 57.93% (0.0271 => 0.0428, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.13% (7.0540 => 11.0842, std.dev.: 0.0221) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.27% (1.5859 => 2.4149, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577, std.dev.: 0.0014) SingleSource/Regression/C/sumarray: 47.62% (0.0231 => 0.0341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.13% (8.1363 => 11.9709, std.dev.: 0.0093) MultiSource/Applications/JM/lencod/lencod: 42.02% (21.9371 => 31.1543, std.dev.: 0.0271) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 41.76% (0.1432 => 0.2030, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.24% (2.2024 => 3.1106, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 36.67% (0.0439 => 0.0600, std.dev.: 0.0010) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.00% (0.6675 => 0.8878, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.67% (0.1062 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.39% (1.5415 => 2.0408, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 31.52% (0.3109 => 0.4089, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.15% (0.5105 => 0.6695, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.51% (0.4615 => 0.6023, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 30.38% (0.4299 => 0.5605, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.70% (4.2646 => 5.5311, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 29.26% (0.4289 => 0.5544, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 29.24% (0.0814 => 0.1052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 27.77% (0.4620 => 0.5903, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 27.46% (1.1642 => 1.4839, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.21% (0.0746 => 0.0949, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 26.32% (1.0722 => 1.3544, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.49% (0.2554 => 0.3205, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.19% (0.2271 => 0.2843, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.11% (0.1892 => 0.2367, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.81% (3.8922 => 4.8579, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 24.77% (0.1175 => 0.1466, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 24.46% (0.6456 => 0.8035, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.82% (0.1906 => 0.2360, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: 23.37% (0.0719 => 0.0887, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.26% (1.4186 => 1.7486, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.17% (0.0479 => 0.0590, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 22.45% (9.4845 => 11.6136, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.45% (0.0793 => 0.0971, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.30% (0.3121 => 0.3817, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 22.05% (5.7591 => 7.0291, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.81% (0.2700 => 0.3289, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 21.26% (0.3283 => 0.3981, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.17% (0.7115 => 0.8621, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 21.07% (0.1163 => 0.1408, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.00% (1.3050 => 1.5791, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 20.92% (0.3232 => 0.3908, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 20.87% (0.1337 => 0.1616, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.47% (0.1695 => 0.2042, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 20.36% (0.1655 => 0.1992, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.00% (0.1555 => 0.1866, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 19.90% (0.7835 => 0.9394, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.5860 => 0.7023, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.79% (0.0672 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.68% (4.9449 => 5.9180, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/lists: 19.65% (0.0626 => 0.0749, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.98% (5.0018 => 5.9512, std.dev.: 0.0128) MultiSource/Applications/sqlite3/sqlite3: 18.97% (17.1811 => 20.4404, std.dev.: 0.0239) MultiSource/Applications/d/make_dparser: 18.91% (3.3354 => 3.9660, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/messages-2: 18.88% (0.0662 => 0.0787, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 18.87% (1.1840 => 1.4074, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/em3d/em3d: 18.82% (0.1695 => 0.2014, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.52% (0.0675 => 0.0800, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.32% (0.8172 => 0.9669, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 18.26% (0.3379 => 0.3996, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 18.16% (0.1151 => 0.1360, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 18.08% (0.7433 => 0.8777, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.78% (0.1940 => 0.2285, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.72% (0.0886 => 0.1043, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.59% (0.5020 => 0.5903, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bisort/bisort: 17.59% (0.0614 => 0.0722, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.56% (0.4636 => 0.5450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.48% (0.1236 => 0.1452, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.5569 => 0.6541, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.19% (0.9765 => 1.1444, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.18% (0.3307 => 0.3875, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.01% (0.2758 => 0.3227, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.99% (0.0730 => 0.0854, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 16.96% (2.2969 => 2.6864, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 16.80% (0.1268 => 0.1481, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.67% (0.5981 => 0.6978, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 16.40% (3.8723 => 4.5073, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 16.35% (2.0273 => 2.3587, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.02% (0.8101 => 0.9399, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 15.96% (0.8921 => 1.0345, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.88% (0.6450 => 0.7474, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.63% (0.3441 => 0.3979, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.54% (0.0933 => 0.1078, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1143 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.02% (1.1861 => 1.3643, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.11% (0.8067 => 0.9205, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 14.08% (0.3387 => 0.3864, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 14.03% (0.3180 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.89% (0.1044 => 0.1189, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.82% (1.5603 => 1.7759, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 13.32% (0.2049 => 0.2322, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 13.25% (0.1268 => 0.1436, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.83% (0.3282 => 0.3703, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.78% (0.3865 => 0.4359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 12.71% (0.0818 => 0.0922, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.60% (0.4103 => 0.4579, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.56% (0.4203 => 0.4689, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.42% (14.3668 => 16.0082, std.dev.: 0.0165) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 11.36% (0.3098 => 0.3450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.26% (0.4048 => 0.4504, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.04% (0.3497 => 0.3883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.97% (0.3427 => 0.3803, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 10.96% (0.3092 => 0.3431, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 10.94% (0.3603 => 0.3997, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 10.81% (0.3422 => 0.3792, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.78% (0.2430 => 0.2692, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 10.56% (0.3684 => 0.4073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3826 => 0.4218, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 10.18% (10.3673 => 11.4232, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.06% (0.4064 => 0.4473, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.73% (0.3650 => 0.4005, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 9.62% (0.6030 => 0.6610, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2831 => 0.3102, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.43% (0.5925 => 0.6484, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.33% (0.3162 => 0.3457, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.20% (2.0665 => 2.2567, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.10% (2.2022 => 2.4027, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/except: 9.02% (0.2871 => 0.3130, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.95% (0.7326 => 0.7982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.90% (0.2877 => 0.3133, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.87% (63.2438 => 68.8544, std.dev.: 0.0265) SingleSource/Regression/C++/ofstream_ctor: 8.78% (0.2905 => 0.3160, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.75% (1.2842 => 1.3966, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.72% (0.2891 => 0.3143, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.49% (0.2793 => 0.3030, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: 8.36% (0.3052 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.34% (0.1438 => 0.1558, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.31% (0.3935 => 0.4262, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (0.2756 => 0.2985, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2725 => 0.2948, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.46% (0.4879 => 0.5243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.03% (0.3131 => 0.3351, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.77% (0.3177 => 0.3392, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.50% (7.9617 => 8.2407, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.63% (32.5116 => 59.0512, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.96% (1.1145 => 1.2924, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.05% (1.1396 => 1.2427, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.02% (2.8904 => 3.1510, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.30% (11.6436 => 12.3775, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.79% (4.2280 => 4.4729, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (3.1578 => 3.3273, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.56% (2.0360 => 2.1084, std.dev.: 0.0107) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.24% (0.9957 => 1.0280, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.36% (8.6802 => 8.8853, std.dev.: 0.0251) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.20% (3.6395 => 3.7195, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 2.02% (0.8333 => 0.8501, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2197, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3440, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.59% (1.7254 => 1.7529, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.36% (4.4649 => 4.5255, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2362, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.14% (1.4460 => 1.4625, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5813, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.09% (5.2763 => 1.2087, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.76% (0.8651 => 0.2097, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.70% (5.3855 => 4.4861, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.16% (5.3526 => 4.4876, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -12.59% (10.4361 => 9.1222, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9560, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.49% (1.7609 => 1.6467, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.40% (1.9577 => 0.6577, std.dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -50.10% (8.0499 => 4.0167, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.17% (0.6962 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.00% (0.3987 => 0.2472, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.78% (10.7105 => 7.4134, std.dev.: 0.0261) MultiSource/Benchmarks/PAQ8p/paq8p: -24.99% (85.0658 => 63.8070, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.60% (2.6546 => 2.0015, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3709, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.36% (1.6925 => 1.4156, std.dev.: 0.0056) SingleSource/UnitTests/Vector/multiplies: -16.25% (2.5528 => 2.1380, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0993, std.dev.: 0.0032) MultiSource/Benchmarks/NPB-serial/is/is: -11.12% (9.5636 => 8.5000, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4228, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2924, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.64% (1.6805 => 1.5857, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.43% (8.1563 => 7.7953, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8289, std.dev.: 0.0112) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.01% (1.0554 => 1.0342, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3296, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2232, std.dev.: 0.0104) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5883, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0009) Report Time: 4.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 20:34:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 22:34:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130103043425.CEFDC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7318?compare_to=7314&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7318, Order: 171450, Start Time: 2013-01-03 02:30:39, End Time: 2013-01-03 04:35:05 To: 7314, Order: 171426, Start Time: 2013-01-02 23:53:29, End Time: 2013-01-03 02:00:10 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 16 (149 on baseline) Performance Improvements: 9 (37 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1035 (790 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 57.66% (0.0359 => 0.0566, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 46.17% (0.3409 => 0.4983, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.18% (1.3736 => 1.4447, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.27% (1.4260 => 1.4869, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.51% (1.3562 => 1.4038, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.76% (1.0641 => 1.0828, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 14.71% (19.2555 => 22.0877, std.dev.: 0.7716) SingleSource/Benchmarks/Misc/pi: 6.69% (2.0768 => 2.2158, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 5.24% (7.1702 => 7.5457, std.dev.: 0.0672) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.69% (0.5352 => 0.5603, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/mason/mason: 2.39% (0.5438 => 0.5568, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/methcall: 1.88% (8.2639 => 8.4195, std.dev.: 0.0263) MultiSource/Applications/siod/siod: 1.80% (3.5625 => 3.6267, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.72% (5.7821 => 5.8818, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.34% (3.6382 => 3.6869, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.18% (1.8552 => 1.8770, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -22.27% (0.1998 => 0.1553, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -13.30% (0.0767 => 0.0665, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.84% (1.3689 => 1.2889, std.dev.: 0.0190) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uuencode/uuencode: -45.56% (0.0417 => 0.0227, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.62% (0.1183 => 0.1010, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.37% (3.8590 => 3.7675, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.02% (40.9533 => 40.1277, std.dev.: 0.3150) SingleSource/Benchmarks/Shootout-C++/lists1: -1.91% (0.6219 => 0.6100, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.30% (1.3243 => 1.3071, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.92% (1.1453 => 1.1787, std.dev.: 0.1056) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.61% (0.4025 => 0.3960, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 8.00% (0.0225 => 0.0243, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.95% (0.0441 => 0.0454, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 16.62% (0.0343 => 0.0400, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.92% (0.0325 => 0.0328, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0443 => 0.0443, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 2.88% (0.0208 => 0.0214, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: 33.66% (0.0205 => 0.0274, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 53.33% (0.0165 => 0.0253) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 2.06% (0.1504 => 0.1535, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -4.85% (1.2242 => 1.1648, std.dev.: 0.1703) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.98% (0.4037 => 0.4117, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.70% (0.1512 => 0.1456, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.30% (0.0938 => 0.0969, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0275 => 0.0278, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.50% (0.0612 => 0.0560, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.19% (1.2846 => 1.2821, std.dev.: 0.0543) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 13.33% (0.0030 => 0.0034, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.48% (0.0607 => 0.0616, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0276 => 0.0326, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.07% (2.7586 => 2.7882, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.77% (0.0088 => 0.0053, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.30% (31.2760 => 31.6833, std.dev.: 0.3709) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 28.42% (16.4461 => 21.1203, std.dev.: 0.5636) MultiSource/Applications/sqlite3/sqlite3: 3516.28% (0.6332 => 22.8983, std.dev.: 1.0118) MultiSource/Benchmarks/McCat/08-main/main: 56.36% (0.1831 => 0.2863, std.dev.: 0.0963) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.38% (0.1559 => 0.1553, std.dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 32035.64% (0.3123 => 100.3596, std.dev.: 12.8375) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1863.55% (0.3344 => 6.5661, std.dev.: 0.2490) SingleSource/Benchmarks/Misc-C++/Large/ray: 38.45% (0.2364 => 0.3273, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 15.94% (0.6010 => 0.6968, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/mandel: 2.80% (0.0429 => 0.0441, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.85% (0.3266 => 0.3457, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/strcat: 2.08% (0.1969 => 0.2010, std.dev.: 0.0069) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 4.02% (0.0224 => 0.0233, std.dev.: 0.0009) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0078) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0510, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 16.89% (0.1462 => 0.1709, std.dev.: 0.0241) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4240, std.dev.: 0.1921) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0737, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4947, std.dev.: 0.0911) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5603, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5450, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0408, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3370, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3881, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0842, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: -29.69% (2.1832 => 1.5349, std.dev.: 0.0359) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 136.55% (0.0249 => 0.0589, std.dev.: 0.0017) SingleSource/Regression/C/sumarray2d: 92.80% (0.0250 => 0.0482, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 70.83% (0.8457 => 1.4447, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 68.59% (0.8316 => 1.4020, std.dev.: 0.0938) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 68.36% (0.8338 => 1.4038, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 67.81% (0.7932 => 1.3311, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 67.35% (0.8885 => 1.4869, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 66.47% (0.0340 => 0.0566, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 66.43% (0.8007 => 1.3326, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 66.21% (0.2998 => 0.4983, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 65.80% (0.8611 => 1.4277, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 65.61% (0.8066 => 1.3358, std.dev.: 0.1489) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 65.30% (0.8805 => 1.4555, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 64.23% (0.8359 => 1.3728, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 62.45% (0.8048 => 1.3074, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 62.04% (0.9056 => 1.4674, std.dev.: 0.1674) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 60.85% (0.8261 => 1.3288, std.dev.: 0.0594) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 60.28% (0.1425 => 0.2284, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 58.33% (0.8597 => 1.3612, std.dev.: 0.1086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 58.32% (0.8177 => 1.2946, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 56.67% (0.9039 => 1.4161, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 56.35% (0.9688 => 1.5147, std.dev.: 0.0813) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 55.76% (0.8716 => 1.3576, std.dev.: 0.1061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.60% (1.5315 => 2.3830, std.dev.: 0.0624) SingleSource/UnitTests/Vector/multiplies: 53.36% (0.0223 => 0.0342, std.dev.: 0.0006) SingleSource/Regression/C/test_indvars: 50.43% (0.0232 => 0.0349, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 43.20% (2.1401 => 3.0646, std.dev.: 0.0704) SingleSource/Benchmarks/McGill/exptree: 41.33% (0.0784 => 0.1108, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 37.12% (3.1832 => 4.3649, std.dev.: 0.0853) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.07% (0.8927 => 1.2147, std.dev.: 0.0620) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.44% (0.0421 => 0.0566, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 34.35% (0.9069 => 1.2184, std.dev.: 0.0458) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 34.33% (0.8697 => 1.1683, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 34.32% (0.8518 => 1.1441, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 34.01% (0.8656 => 1.1600, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 33.91% (0.8086 => 1.0828, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 33.50% (0.8069 => 1.0772, std.dev.: 0.0538) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 33.11% (0.0734 => 0.0977, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.76% (0.7966 => 1.0576, std.dev.: 0.0569) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.25% (1.6386 => 2.1506, std.dev.: 0.1175) SingleSource/Benchmarks/CoyoteBench/lpbench: 30.64% (0.0989 => 0.1292, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 30.40% (0.8855 => 1.1547, std.dev.: 0.0781) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.19% (0.8712 => 1.1342, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.64% (0.8420 => 1.0916, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 29.00% (0.8286 => 1.0689, std.dev.: 0.0352) MultiSource/Applications/sgefa/sgefa: 28.58% (0.2999 => 0.3856, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 28.51% (0.8317 => 1.0688, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.43% (0.9074 => 1.1654, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 27.87% (0.9908 => 1.2669, std.dev.: 0.0297) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.52% (0.2180 => 0.2780, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 27.38% (0.0650 => 0.0828, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 27.30% (0.8204 => 1.0444, std.dev.: 0.0291) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.19% (0.0810 => 0.1014, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 23.00% (0.1839 => 0.2262, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.81% (0.6586 => 0.8088, std.dev.: 0.0242) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.41% (0.0848 => 0.1038, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 21.60% (2.3764 => 2.8896, std.dev.: 0.0481) MultiSource/Applications/lemon/lemon: 21.43% (1.0945 => 1.3290, std.dev.: 0.0449) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.33% (0.1097 => 0.1331, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.36% (0.0668 => 0.0804, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.19% (0.0822 => 0.0988, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 20.09% (8.6247 => 10.3577, std.dev.: 0.3331) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.76% (0.5191 => 0.6217, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash: 19.71% (0.3800 => 0.4549, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/chomp: 19.36% (0.1565 => 0.1868, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.78% (0.0641 => 0.0755, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 17.72% (1.2222 => 1.4388, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/hash2: 17.48% (0.4125 => 0.4846, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.18% (0.0745 => 0.0873, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.77% (0.4127 => 0.4819, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary: 16.36% (0.2390 => 0.2781, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 16.10% (1.1271 => 1.3086, std.dev.: 0.0399) MultiSource/Applications/aha/aha: 15.44% (0.1088 => 0.1256, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: 15.24% (0.0722 => 0.0832, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 14.94% (0.3226 => 0.3708, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.79% (0.1778 => 0.2041, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.64% (0.0717 => 0.0822, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.53% (0.1466 => 0.1679, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 14.18% (1.2568 => 1.4350, std.dev.: 0.0577) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.12% (0.1756 => 0.2004, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: 13.95% (0.2509 => 0.2859, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 13.18% (0.1905 => 0.2156, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 12.82% (0.6834 => 0.7710, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/flops: 12.27% (0.0937 => 0.1052, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.96% (0.6227 => 0.6972, std.dev.: 0.0124) MultiSource/Applications/oggenc/oggenc: 11.89% (4.9628 => 5.5527, std.dev.: 0.1907) MultiSource/Benchmarks/Olden/health/health: 10.17% (0.1347 => 0.1484, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 10.11% (0.1177 => 0.1296, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.05% (1.1170 => 1.2293, std.dev.: 0.0384) MultiSource/Applications/siod/siod: 9.97% (2.2184 => 2.4396, std.dev.: 0.0557) SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.51% (0.8340 => 0.9133, std.dev.: 0.0229) MultiSource/Applications/viterbi/viterbi: 8.88% (0.1577 => 0.1717, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.85% (0.2519 => 0.2742, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: 8.82% (0.1247 => 0.1357, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.55% (0.2794 => 0.3033, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.83% (0.3115 => 0.3359, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.11% (0.2844 => 0.2961, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1507900.00% (0.0001 => 1.5080, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: 374.34% (0.3585 => 1.7005, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 356.44% (1.5671 => 7.1529, std.dev.: 0.0862) MultiSource/Benchmarks/PAQ8p/paq8p: 287.38% (91.7701 => 355.5016, std.dev.: 1.8215) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.61% (28.5821 => 85.6340, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 174.18% (5.1305 => 14.0668, std.dev.: 0.0554) SingleSource/Benchmarks/Shootout-C++/ary2: 121.60% (0.0125 => 0.0277, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 118.02% (1.1365 => 2.4778, std.dev.: 0.0632) SingleSource/Benchmarks/Shootout-C++/ary: 104.57% (0.0219 => 0.0448, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 61.81% (2.8760 => 4.6536, std.dev.: 0.1113) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 59.73% (0.0226 => 0.0361, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/pi: 40.28% (1.5795 => 2.2158, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.79% (2.7995 => 3.9134, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.52% (4.5327 => 5.9613, std.dev.: 0.0273) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.24% (1.3882 => 1.8080, std.dev.: 0.1528) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.11% (2.9096 => 3.7276, std.dev.: 0.0517) SingleSource/Benchmarks/McGill/misr: 20.97% (0.4001 => 0.4840, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 20.52% (3.0515 => 3.6778, std.dev.: 0.1717) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 17.12% (4.7794 => 5.5975, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.90% (0.7597 => 0.8881, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/salsa20: 14.33% (7.5003 => 8.5752, std.dev.: 0.0231) MultiSource/Benchmarks/McCat/04-bisect/bisect: 10.45% (0.1129 => 0.1247, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.24% (1.1857 => 1.3071, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 8.96% (3.1873 => 3.4728, std.dev.: 0.0953) SingleSource/Benchmarks/Misc/ReedSolomon: 8.10% (8.5322 => 9.2235, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 7.37% (0.1370 => 0.1471, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3094, std.dev.: 0.0452) MultiSource/Benchmarks/Bullet/bullet: 6.01% (7.1181 => 7.5457, std.dev.: 0.0672) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.88% (0.4031 => 0.4268, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.80% (4.9686 => 5.2567, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.69% (4.8436 => 5.1192, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 5.61% (0.2015 => 0.2128, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.59% (3.5679 => 3.7675, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 5.06% (6.7064 => 7.0459, std.dev.: 0.1091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.91% (0.5214 => 0.5470, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 4.73% (3.3398 => 3.4979, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.67% (6.1706 => 6.4586, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/richards_benchmark: 4.15% (1.3037 => 1.3578, std.dev.: 0.0177) SingleSource/Benchmarks/McGill/queens: 3.43% (1.7056 => 1.7641, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.32% (4.2466 => 4.3877, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: 3.29% (1.2061 => 1.2458, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 3.03% (2.3560 => 2.4275, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/mason/mason: 2.83% (0.5415 => 0.5568, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.38% (1.5866 => 1.6243, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.35% (39.2082 => 40.1277, std.dev.: 0.3150) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.11% (3.4104 => 3.4825, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.94% (8.2783 => 8.4393, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/methcall: 1.84% (8.2676 => 8.4195, std.dev.: 0.0263) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.13% (3.7192 => 3.7614, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/five11/five11: 1.11% (5.6030 => 5.6652, std.dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.10% (2.7978 => 2.8285, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (2.5697 => 2.5962, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -70.98% (2.8951 => 0.8401, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -59.54% (11.5316 => 4.6654, std.dev.: 0.0465) SingleSource/Benchmarks/Misc/fp-convert: -52.67% (15.8853 => 7.5180, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.34% (4.7482 => 3.0225, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.32% (5.4972 => 3.6105, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.10% (5.4300 => 3.6869, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.63% (5.6343 => 4.1338, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.41% (5.0261 => 4.0002, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.83% (5.0243 => 4.1787, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.79% (2.9753 => 2.5352, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.96% (9.9065 => 8.7212, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -11.78% (6.3772 => 5.6259, std.dev.: 0.1617) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.96% (7.2130 => 6.4226, std.dev.: 0.0996) MultiSource/Benchmarks/mafft/pairlocalalign: -10.04% (63.1822 => 56.8395, std.dev.: 0.1295) SingleSource/Benchmarks/Misc/flops-8: -9.46% (2.5609 => 2.3187, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: -9.41% (5.1084 => 4.6277, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: -9.02% (5.4641 => 4.9713, std.dev.: 0.0820) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.35% (3.7148 => 3.4046, std.dev.: 0.0391) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.98% (1.0512 => 0.9673, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.31% (5.3218 => 4.9327, std.dev.: 0.0432) SingleSource/Benchmarks/Stanford/FloatMM: -6.72% (0.8807 => 0.8215, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: -5.54% (9.3748 => 8.8552, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.28% (4.9453 => 4.6840, std.dev.: 0.0572) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -4.52% (0.3937 => 0.3759, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: -4.50% (0.6910 => 0.6599, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (8.9760 => 8.6707, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.26% (1.4529 => 1.4056, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.85% (5.1557 => 5.0090, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/fbench: -2.54% (3.3840 => 3.2980, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.33% (6.0224 => 5.8818, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.16% (4.9469 => 4.8402, std.dev.: 0.0299) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (9.2989 => 9.1092, std.dev.: 0.0486) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.95% (3.3479 => 3.2826, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.79% (2.6356 => 2.5883, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops-5: -1.73% (2.8957 => 2.8456, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: -1.42% (2.4416 => 2.4069, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/neural/neural: -1.04% (1.0841 => 1.0728, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 14.86% (1.0262 => 1.1787, std.dev.: 0.1056) SingleSource/Benchmarks/CoyoteBench/fftbench: 60.78% (0.2463 => 0.3960, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 97.56% (0.0123 => 0.0243, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.27% (0.0408 => 0.0454, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 57.48% (0.0254 => 0.0400, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 8.61% (0.0302 => 0.0328, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.36% (0.0384 => 0.0443, std.dev.: 0.0120) SingleSource/UnitTests/Vector/Altivec/casts: 12.63% (0.0190 => 0.0214, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: 52.22% (0.0180 => 0.0274, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 6.75% (0.1438 => 0.1535, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 2.82% (1.1329 => 1.1648, std.dev.: 0.1703) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.13% (0.4164 => 0.4117, std.dev.: 0.0778) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.36% (0.1369 => 0.1456, std.dev.: 0.0330) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 51.17% (0.0641 => 0.0969, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.56% (0.0195 => 0.0278, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.11% (0.0578 => 0.0560, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.10% (1.1437 => 1.2821, std.dev.: 0.0543) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3300.00% (0.0001 => 0.0034, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 92.86% (0.0014 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.75% (0.0627 => 0.0616, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 81.11% (0.0180 => 0.0326, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.79% (0.8017 => 2.7882, std.dev.: 0.0087) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.52% (0.0062 => 0.0053, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 2.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 20:34:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 22:34:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130103043441.AA68B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7319?compare_to=7316&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7319, Order: 171450, Start Time: 2013-01-03 02:59:03, End Time: 2013-01-03 04:35:50 To: 7316, Order: 171432, Start Time: 2013-01-03 00:58:38, End Time: 2013-01-03 02:35:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 1 (130 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (816 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.34% (79.8802 => 78.8086, std.dev.: 0.0730) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.74% (22.4056 => 78.8086, std.dev.: 0.0730) SingleSource/Benchmarks/Misc/lowercase: 72.86% (0.0280 => 0.0484) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.46% (0.0717 => 0.1129, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 56.16% (0.0974 => 0.1521, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 35.07% (0.1500 => 0.2026, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.66% (0.1132 => 0.1513, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.89% (0.0599 => 0.0790) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.99% (1.6474 => 2.1085, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.60% (0.0445 => 0.0550, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.75% (0.0699 => 0.0851, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.39% (5.4682 => 6.6380, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.20% (2.2587 => 2.7149, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.79% (0.0680 => 0.0801, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.94% (1.1450 => 1.3275, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.89% (0.6395 => 0.7411, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.46% (0.6395 => 0.7320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.50% (0.6260 => 0.7105, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.59% (0.5941 => 0.6689, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 12.15% (0.6230 => 0.6987, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.13% (0.5805 => 0.6509, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.87% (0.1146 => 0.1282, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.67% (0.6033 => 0.6737, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.63% (0.5849 => 0.6529, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.29% (0.5456 => 0.6072, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.7021 => 0.7811, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.25% (0.5688 => 0.6328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 11.18% (0.4524 => 0.5030, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.16% (0.6440 => 0.7159, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.97% (0.5925 => 0.6575, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.96% (0.6676 => 0.7408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.96% (0.5575 => 0.6186, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.87% (0.5567 => 0.6172, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.75% (0.5581 => 0.6181, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.52% (1.6364 => 1.8086, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.38% (0.5802 => 0.6404, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.23% (0.5857 => 0.6456, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.21% (0.5859 => 0.6457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.15% (0.6052 => 0.6666, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 9.97% (0.4515 => 0.4965, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.90% (0.6446 => 0.7084, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.86% (0.5570 => 0.6119, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.83% (0.4916 => 0.5399, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.79% (0.1982 => 0.2176, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.78% (0.6189 => 0.6794, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.77% (0.4861 => 0.5336, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.52% (0.5569 => 0.6099, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.44% (0.6304 => 0.6899, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.43% (0.5705 => 0.6243, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.34% (3.5339 => 3.8640, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.31% (0.5329 => 0.5825, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.29% (0.5478 => 0.5987, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.21% (0.5591 => 0.6106, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.97% (0.5863 => 0.6389, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.78% (0.6660 => 0.7245, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.41% (0.6194 => 0.6715, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.24% (0.6297 => 0.6816, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.21% (4.5069 => 4.8768, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.92% (0.6681 => 0.7210, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 7.86% (0.3357 => 0.3621, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.79% (0.7524 => 0.8110, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.77% (0.6667 => 0.7185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.94% (0.7339 => 0.7848, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 6.18% (0.3446 => 0.3659, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 5.96% (0.6750 => 0.7152, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.83% (0.3394 => 0.3592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.59% (1.4642 => 1.5460, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.31% (1.2784 => 1.3463, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.30% (9.2283 => 9.7174, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.16% (0.2385 => 0.2508, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.03% (18.2933 => 19.2126, std.dev.: 0.0136) MultiSource/Applications/Burg/burg: 4.99% (1.2515 => 1.3139, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 4.34% (0.3481 => 0.3632, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.61% (5.0226 => 5.2038, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 3.40% (17.1032 => 17.6839, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.3864 => 1.4189, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.9557 => 0.9756, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.01% (31.3723 => 55.5310, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.34% (0.9531 => 1.0326, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.69% (5.1955 => 5.4394, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1159, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5621, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6469 => 0.6636, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (27.8210 => 28.3223, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6025, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (79.7170 => 80.6357, std.dev.: 0.3140) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6551 => 3.6925, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.88% (0.1584 => 0.1475, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.15% (0.2428 => 0.2303, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3896 => 0.3709, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3880 => 0.3698, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.68% (0.3891 => 0.3709, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.4033 => 0.3848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.51% (0.2903 => 0.2772, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.46% (0.9852 => 0.9413, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.36% (0.4199 => 0.4016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.27% (2.1713 => 2.0786, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -4.26% (0.7779 => 0.7448, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.21% (0.3821 => 0.3660, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.15% (0.3059 => 0.2932, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.11% (1.3148 => 1.2607, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.06% (0.9542 => 0.9155, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.04% (0.4280 => 0.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.95% (0.4151 => 0.3987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.88% (0.3658 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -3.85% (0.3194 => 0.3071, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.70% (0.4321 => 0.4161, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.70% (0.6484 => 0.6244, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: -3.67% (0.3867 => 0.3725, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -3.67% (0.3026 => 0.2915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.66% (0.4427 => 0.4265, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -3.62% (0.2849 => 0.2746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.51% (0.7919 => 0.7641, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (0.3025 => 0.2922, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.40% (20.7746 => 20.0692, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/moments: -3.27% (0.4248 => 0.4109, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.25% (2.4924 => 2.4114, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.22% (0.3788 => 0.3666, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.07% (0.3849 => 0.3731, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.06% (0.4083 => 0.3958, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.89% (4.3330 => 4.2077, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -2.82% (0.7982 => 0.7757, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.60% (1.2210 => 1.1892, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.60% (6.7716 => 6.5954, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.57% (1.0544 => 1.0273, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.54% (1.2221 => 1.1910, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.34% (1.2300 => 1.2012, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -2.15% (7.0961 => 6.9433, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.13% (0.5999 => 0.5871, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -2.02% (16.1920 => 15.8648, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -2.02% (4.0594 => 3.9775, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -2.00% (34.0927 => 33.4123, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.85% (14.2083 => 13.9454, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: -1.74% (1.5610 => 1.5338, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: -1.44% (0.9179 => 0.9047, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -1.24% (2.4021 => 2.3723, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.0126 => 7.9233, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: -1.10% (2.1401 => 2.1166, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.73% (1.8100 => 0.6926, std.dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.89% (8.0445 => 4.0309, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.15% (0.6962 => 0.3819, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.44% (0.1622 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.84% (0.1983 => 0.1431, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.36% (0.2151 => 0.1584, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.55% (1.3643 => 1.0294, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.61% (0.2274 => 0.1737, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7562, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0372, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.35% (4.3779 => 3.3994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1996, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.67% (5.3397 => 4.1828, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -19.02% (3.3454 => 2.7092, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.24% (1.2237 => 1.0005, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.49% (2.5106 => 2.1218, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.65% (7.1848 => 6.6349, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.35% (5.2027 => 4.8203, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.44% (1.1594 => 1.0963, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.74% (1.7753 => 1.6912, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.73% (0.6299 => 0.6001, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7344, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2273, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.89% (2.7523 => 2.7004, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4662, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1938, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.25% (4.8776 => 4.8164, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.24% (1.6219 => 1.6018, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -1.20% (3.7241 => 3.6793, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.10% (1.6307 => 1.6128, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 21:52:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 2 Jan 2013 23:52:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130103055218.D322D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7320?compare_to=7317&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7320, Order: 171453, Start Time: 2013-01-03 03:38:20, End Time: 2013-01-03 05:52:21 To: 7317, Order: 171430, Start Time: 2013-01-03 00:53:27, End Time: 2013-01-03 03:07:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 4 (62 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1093 (613 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (80.2298 => 81.0809, std.dev.: 0.2512) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.66% (11.0842 => 10.8998, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.19% (2.4027 => 2.3740, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.15% (31.1543 => 30.7950, std.dev.: 0.0123) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.03% (95.6528 => 94.6693, std.dev.: 0.0966) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.11% (0.0664 => 0.0678, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8506 => 499.8416, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.99% (1.1277 => 499.8416, std.dev.: 0.0082) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.75% (0.5229 => 1.6563, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 19.72% (14.9895 => 17.9452, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 53.54% (14.1553 => 21.7341, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (4.1105 => 4.7946, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.59% (1.1048 => 1.7411, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1222.53% (7.1582 => 94.6693, std.dev.: 0.0966) SingleSource/Benchmarks/Misc-C++-EH/spirit: 123.69% (3.4629 => 7.7463, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.92% (0.6222 => 1.1008, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10231.67% (0.0720 => 7.4388, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 3829700.00% (0.0001 => 3.8298, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11184300.00% (0.0001 => 11.1844, std.dev.: 0.0331) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 64300.00% (0.0001 => 0.0644, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 578600.00% (0.0001 => 0.5787, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959100.00% (0.0001 => 9.9592, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5500800.00% (0.0001 => 5.5009, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.80% (1.1194 => 10.2962, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 148.47% (22.1758 => 55.1001, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/lowercase: 101.95% (0.0256 => 0.0517) SingleSource/Benchmarks/CoyoteBench/lpbench: 83.85% (0.0929 => 0.1708, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 82.30% (0.0243 => 0.0443, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 81.08% (0.0296 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.74% (2.9384 => 4.6645, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 58.71% (0.1463 => 0.2322, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 57.20% (0.0271 => 0.0426) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.52% (7.0540 => 10.8998, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.52% (1.5859 => 2.4029, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/IntMM: 49.75% (0.0394 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.48% (0.1056 => 0.1568, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.75% (8.1363 => 12.0210, std.dev.: 0.0065) SingleSource/Regression/C/sumarray: 46.75% (0.0231 => 0.0339, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.80% (2.2024 => 3.1009, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.77% (0.0439 => 0.0618, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 40.71% (0.1432 => 0.2015, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: 40.38% (21.9371 => 30.7950, std.dev.: 0.0123) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.61% (0.6675 => 0.8852, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.30% (0.1062 => 0.1405, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.25% (1.5415 => 2.0387, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 31.17% (0.3109 => 0.4078, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 30.48% (0.5105 => 0.6661, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.23% (0.4615 => 0.6010, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 29.59% (0.4289 => 0.5558, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.56% (4.2646 => 5.5251, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/05-eks/eks: 29.31% (0.4299 => 0.5559, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 28.75% (0.0814 => 0.1048, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 28.58% (1.1642 => 1.4969, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 28.10% (0.4620 => 0.5918, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 26.29% (1.0722 => 1.3541, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.69% (0.1584 => 0.1991, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.68% (0.0479 => 0.0602) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.60% (0.1125 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 24.95% (0.1892 => 0.2364, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 24.94% (0.2554 => 0.3191, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.92% (0.2271 => 0.2837, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 24.55% (0.6456 => 0.8041, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.37% (3.8922 => 4.8408, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.66% (0.1906 => 0.2357, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.24% (0.1566 => 0.1930, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 23.09% (0.0719 => 0.0885, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.93% (1.4186 => 1.7439, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.14% (0.1337 => 0.1633, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.92% (0.3121 => 0.3805, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.82% (0.0793 => 0.0966, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 21.72% (0.3283 => 0.3996, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 21.70% (9.4845 => 11.5428, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 21.65% (5.7591 => 7.0057, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 21.32% (0.3232 => 0.3921, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 20.97% (0.1655 => 0.2002, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 20.87% (0.7115 => 0.8600, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.77% (0.1695 => 0.2047, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.65% (1.3050 => 1.5745, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.63% (0.2700 => 0.3257, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 20.33% (0.7835 => 0.9428, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: 20.30% (0.0660 => 0.0794, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.21% (0.0871 => 0.1047, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.81% (0.1555 => 0.1863, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.43% (4.9449 => 5.9059, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: 19.38% (0.3379 => 0.4034, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 19.17% (0.0626 => 0.0746, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.14% (0.1029 => 0.1226, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.05% (0.0672 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.94% (0.5860 => 0.6970, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 18.90% (0.1032 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.84% (0.8172 => 0.9712, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.75% (5.0018 => 5.9395, std.dev.: 0.0126) MultiSource/Applications/d/make_dparser: 18.67% (3.3354 => 3.9580, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 18.66% (0.1163 => 0.1380, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 18.53% (17.1811 => 20.3642, std.dev.: 0.0204) MultiSource/Benchmarks/Olden/em3d/em3d: 18.53% (0.1695 => 0.2009, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 18.40% (1.1840 => 1.4018, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.37% (0.0675 => 0.0799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 17.82% (0.0662 => 0.0780, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 17.81% (0.1151 => 0.1356, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.71% (0.4636 => 0.5457, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.61% (0.0886 => 0.1042, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 17.59% (0.0614 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.51% (0.5569 => 0.6544, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.41% (0.7433 => 0.8727, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.39% (0.5020 => 0.5893, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.37% (0.1940 => 0.2277, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.15% (0.1510 => 0.1769, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.14% (0.0770 => 0.0902, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.04% (0.9765 => 1.1429, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/18-imp/imp: 16.97% (0.3423 => 0.4004, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 16.88% (0.1268 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.86% (0.2758 => 0.3223, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.81% (0.3307 => 0.3863, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.71% (0.2107 => 0.2459, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.67% (0.1236 => 0.1442, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.40% (2.2969 => 2.6735, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.30% (0.5981 => 0.6956, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 16.27% (2.0273 => 2.3572, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.10% (0.0770 => 0.0894, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.07% (3.8723 => 4.4947, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.03% (0.2065 => 0.2396, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.53% (0.6450 => 0.7452, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.53% (0.8921 => 1.0306, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.52% (0.8101 => 0.9358, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.43% (0.3441 => 0.3972, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.79% (0.0730 => 0.0838, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.42% (1.1861 => 1.3571, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 13.84% (0.3180 => 0.3620, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 13.62% (0.2049 => 0.2328, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.38% (1.5603 => 1.7691, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.38% (0.8067 => 0.9146, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.12% (0.1143 => 0.1293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.07% (0.3865 => 0.4370, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.03% (0.1044 => 0.1180, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.53% (0.4103 => 0.4617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.32% (0.3927 => 0.4411, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 12.22% (0.0818 => 0.0918, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.96% (0.3828 => 0.4286, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.92% (0.3473 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 11.88% (0.3098 => 0.3466, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.85% (0.3543 => 0.3963, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.78% (0.4203 => 0.4698, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.72% (0.3497 => 0.3907, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.59% (0.4048 => 0.4517, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.31% (14.3668 => 15.9921, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: 11.31% (0.3422 => 0.3809, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.16% (0.3603 => 0.4005, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.88% (0.4064 => 0.4506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.86% (0.3684 => 0.4084, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2430 => 0.2686, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.40% (0.3826 => 0.4224, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.31% (0.2871 => 0.3167, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.28% (0.3092 => 0.3410, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 10.23% (10.3673 => 11.4276, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.11% (0.3650 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.05% (0.6030 => 0.6636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.84% (0.3162 => 0.3473, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.79% (2.0665 => 2.2688, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/Hello: 9.77% (0.5925 => 0.6504, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2756 => 0.3025, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/fibo: 9.61% (0.2725 => 0.2987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.49% (0.2793 => 0.3058, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.40% (0.2905 => 0.3178, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2714 => 0.2968, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.31% (0.7326 => 0.8008, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2891 => 0.3159, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.18% (1.2842 => 1.4021, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wc: 9.01% (0.3052 => 0.3327, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.84% (0.3935 => 0.4283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.67% (63.2438 => 68.7256, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.93% (0.1438 => 0.1552, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.80% (2.2022 => 2.3740, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.70% (0.3131 => 0.3372, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.30% (0.4879 => 0.5235, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3817 => 0.3975, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.83% (7.9617 => 8.1873, std.dev.: 0.0153) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.69% (32.5116 => 59.0699, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.00% (2.8904 => 3.1505, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3791, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.61% (3.1578 => 3.3348, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4520, std.dev.: 0.0105) SingleSource/Regression/C/uint64_to_float: 5.06% (0.5413 => 0.5687, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.54% (2.0360 => 2.1081, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.21% (0.9957 => 1.0277, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9056, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.91% (0.6533 => 0.6658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (3.6395 => 3.7065, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8444 => 28.3473, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.54% (1.7254 => 1.7520, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 1.40% (4.4649 => 4.5275, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 1.21% (9.1159 => 9.2266, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.14% (5.2763 => 1.2061, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.90% (0.1622 => 0.0910, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.10% (5.3855 => 4.4644, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.63% (5.3526 => 4.4625, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -13.18% (10.4361 => 9.0609, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9538, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.81% (1.7609 => 1.6410, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -66.08% (1.9577 => 0.6640, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.10% (8.0499 => 4.0171, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.12% (0.6962 => 0.3821, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.02% (0.3987 => 0.2471, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0207, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.78% (10.7105 => 7.4135, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -25.00% (85.0658 => 63.8003, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7239, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.41% (1.2258 => 1.0001, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.24% (2.5528 => 2.1381, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2373 => 1.0897, std.dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: -11.11% (9.5636 => 8.5012, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.14% (1.5660 => 1.4228, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2921, std.dev.: 0.0190) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.93% (0.2497 => 0.2349, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5861, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5773, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.47% (10.2830 => 9.8229, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.41% (8.1563 => 7.7962, std.dev.: 0.0170) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -3.50% (0.6223 => 0.6005, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.00% (1.0554 => 1.0343, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3280, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.09% (4.6441 => 4.5933, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0159) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0025) Report Time: 5.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 22:36:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Jan 2013 00:36:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130103063603.226E12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7321?compare_to=7319&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7321, Order: 171457, Start Time: 2013-01-03 04:59:19, End Time: 2013-01-03 06:36:18 To: 7319, Order: 171450, Start Time: 2013-01-03 02:59:03, End Time: 2013-01-03 04:35:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 1 (131 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (815 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (0.8465 => 0.8336, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.33% (22.4056 => 78.9414, std.dev.: 0.0517) SingleSource/Benchmarks/Misc/lowercase: 65.71% (0.0280 => 0.0464, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.46% (0.0717 => 0.1129, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.62% (0.0974 => 0.1506, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.61% (0.0514 => 0.0769, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 35.27% (0.1500 => 0.2029, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.04% (0.1132 => 0.1506, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.89% (0.0599 => 0.0790, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.90% (1.6474 => 2.1070, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 21.46% (0.0699 => 0.0849, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.25% (5.4682 => 6.6302, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.91% (2.2587 => 2.7083, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.17% (0.6395 => 0.7429, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 16.06% (1.1450 => 1.3289, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.99% (0.3834 => 0.4447, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.70% (0.6395 => 0.7335, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.79% (0.6260 => 0.7123, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.79% (0.5941 => 0.6701, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.20% (0.5805 => 0.6513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 12.02% (0.6230 => 0.6979, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.97% (0.5849 => 0.6549, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.80% (0.6033 => 0.6745, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.69% (0.1146 => 0.1280, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.55% (0.5456 => 0.6086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.49% (0.6440 => 0.7180, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.29% (0.5688 => 0.6330, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.7021 => 0.7811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.19% (0.5575 => 0.6199, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.03% (0.5567 => 0.6181, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.97% (0.5925 => 0.6575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.93% (0.5581 => 0.6191, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.92% (0.6676 => 0.7405, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 10.63% (0.4524 => 0.5005, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.50% (0.5802 => 0.6411, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.41% (1.6364 => 1.8068, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.33% (0.6052 => 0.6677, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.31% (0.5857 => 0.6461, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.16% (0.5859 => 0.6454, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.05% (0.6446 => 0.7094, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.91% (0.5570 => 0.6122, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (0.6189 => 0.6795, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 9.75% (0.4515 => 0.4955, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.71% (0.5569 => 0.6110, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.66% (0.4916 => 0.5391, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.50% (0.4861 => 0.5323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.48% (0.5591 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.45% (0.6304 => 0.6900, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.45% (0.5705 => 0.6244, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.44% (0.5478 => 0.5995, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.38% (0.1982 => 0.2168, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (3.5339 => 3.8619, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.25% (0.5329 => 0.5822, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.93% (0.6660 => 0.7255, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.90% (0.5863 => 0.6385, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.35% (0.6194 => 0.6711, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.27% (0.6297 => 0.6818, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.10% (0.6681 => 0.7222, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.04% (4.5069 => 4.8692, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.92% (0.7524 => 0.8120, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.72% (0.6667 => 0.7182, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 7.69% (0.3357 => 0.3615, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.89% (0.7339 => 0.7845, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.75% (0.3446 => 0.3644, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.66% (0.6750 => 0.7132, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.57% (1.4642 => 1.5457, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 5.39% (0.3394 => 0.3577, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.32% (0.2385 => 0.2512, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.30% (1.2784 => 1.3461, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 5.26% (9.2283 => 9.7135, std.dev.: 0.0151) MultiSource/Applications/kimwitu++/kc: 5.08% (18.2933 => 19.2232, std.dev.: 0.0141) MultiSource/Applications/Burg/burg: 4.95% (1.2515 => 1.3135, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 3.91% (0.3481 => 0.3617, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.48% (17.1032 => 17.6984, std.dev.: 0.0161) MultiSource/Applications/oggenc/oggenc: 3.33% (5.0226 => 5.1898, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (1.3864 => 1.4171, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.9557 => 0.9734, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.14% (31.3723 => 55.5715, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4398, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 3.75% (11.6767 => 12.1145, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.5751 => 56.4291, std.dev.: 0.1098) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.96% (2.0478 => 2.1085, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6469 => 0.6636, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (27.8210 => 28.3173, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.06% (4.4335 => 4.4806, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4554, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.25% (0.3812 => 0.3612, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.15% (0.2428 => 0.2303, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.12% (0.3831 => 0.3635, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.06% (0.3896 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.05% (0.3880 => 0.3684, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.96% (0.4176 => 0.3969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.91% (0.4033 => 0.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -4.74% (0.2849 => 0.2714, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.72% (0.3323 => 0.3166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.67% (2.1713 => 2.0698, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.67% (0.4199 => 0.4003, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.66% (0.3884 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (0.9852 => 0.9410, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.46% (0.3025 => 0.2890, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.43% (1.3148 => 1.2565, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.36% (0.7198 => 0.6884, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.34% (0.3252 => 0.3111, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.27% (0.6347 => 0.6076, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -4.25% (0.2989 => 0.2862, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.19% (0.4151 => 0.3977, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.17% (0.3621 => 0.3470, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.05% (0.9542 => 0.9156, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -3.93% (0.3867 => 0.3715, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.93% (0.4427 => 0.4253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.89% (0.3931 => 0.3778, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.85% (0.3658 => 0.3517, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: -3.75% (0.3788 => 0.3646, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.75% (0.6484 => 0.6241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.58% (0.4248 => 0.4096, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.46% (0.3849 => 0.3716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.45% (0.4321 => 0.4172, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.38% (0.7919 => 0.7651, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.36% (0.4083 => 0.3946, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.35% (20.7746 => 20.0787, std.dev.: 0.0228) MultiSource/Benchmarks/MallocBench/gs/gs: -3.18% (4.3330 => 4.1954, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -2.99% (2.4924 => 2.4180, std.dev.: 0.0220) MultiSource/Applications/lambda-0_1_3/lambda: -2.82% (0.7982 => 0.7757, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.71% (6.7716 => 6.5883, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.68% (1.2210 => 1.1883, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.58% (1.0544 => 1.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.50% (1.2221 => 1.1915, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -2.37% (34.0927 => 33.2860, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.35% (1.2300 => 1.2011, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.17% (0.8521 => 0.8336, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -2.09% (1.5610 => 1.5283, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -2.07% (7.0961 => 6.9489, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.06% (14.2083 => 13.9149, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -2.06% (16.1920 => 15.8579, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.02% (0.5999 => 0.5878, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -2.01% (4.0594 => 3.9779, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.73% (0.9077 => 0.8920, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -1.55% (0.9179 => 0.9037, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: -1.30% (2.1401 => 2.1123, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.29% (8.0126 => 7.9094, std.dev.: 0.0103) MultiSource/Applications/siod/siod: -1.19% (2.4021 => 2.3734, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.03% (4.8802 => 4.8301, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.15% (1.8100 => 0.7031, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0134) SingleSource/Benchmarks/Misc/lowercase: -49.92% (8.0445 => 4.0285, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.17% (0.6962 => 0.3817, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.63% (0.1622 => 0.1109, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.04% (0.1983 => 0.1427, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.61% (0.2274 => 0.1737, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0085) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0410, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1995, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1833, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.19% (2.9703 => 2.3707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -18.68% (3.3454 => 2.7204, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.26% (1.2237 => 1.0002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.51% (2.5106 => 2.1211, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.80% (4.2493 => 3.7052, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.24% (4.9100 => 4.3582, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6340, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.33% (5.2027 => 4.8214, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.89% (4.1534 => 3.9087, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.79% (1.1594 => 1.0923, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.68% (1.7753 => 1.6922, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7347, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.87% (2.7523 => 2.7009, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4727, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1946, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout/ary3: -1.41% (3.7241 => 3.6717, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8094, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 22:44:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Jan 2013 00:44:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130103064420.0662B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7322?compare_to=7315&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7322, Order: 171450, Start Time: 2013-01-03 03:08:23, End Time: 2013-01-03 06:44:47 To: 7315, Order: 171415, Start Time: 2013-01-02 22:36:34, End Time: 2013-01-03 02:10:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (183 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1095 (707 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.57% (2.3956 => 2.4331, std.dev.: 0.0141) MultiSource/Applications/hbd/hbd: 1.44% (1.1352 => 1.1515, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: 1.29% (0.8341 => 0.8449, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 1.22% (1.9918 => 2.0161, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.1511 => 1.1644, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.00% (21.0756 => 21.2874, std.dev.: 0.0355) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.36% (126.9921 => 129.9908, std.dev.: 0.4234) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 82.88% (11.6398 => 21.2874, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.86% (0.5361 => 0.8302, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.16% (0.0625 => 0.0901, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.09% (0.1063 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.46% (0.2969 => 0.3814, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.88% (0.7426 => 0.9496, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.58% (0.1106 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.55% (0.1107 => 0.1412, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.40% (0.4139 => 0.5273, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 26.54% (1.5932 => 2.0161, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.43% (0.4253 => 0.5377, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.03% (0.5900 => 0.7436, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.96% (0.0547 => 0.0689, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.91% (0.4994 => 0.6288, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 25.42% (0.0948 => 0.1189, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.96% (0.5000 => 0.6248, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 23.70% (0.0481 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.56% (0.1549 => 0.1914, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.85% (0.1103 => 0.1355, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.21% (0.3903 => 0.4770, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 22.11% (0.1619 => 0.1977, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 21.22% (0.0947 => 0.1148, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 20.67% (0.0808 => 0.0975, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 20.63% (0.4029 => 0.4860, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.62% (0.3890 => 0.4692, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.61% (0.2014 => 0.2429, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 20.53% (0.1218 => 0.1468, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.40% (0.1088 => 0.1310, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.95% (4.4195 => 5.3011, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.88% (1.3152 => 1.5767, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.77% (0.2736 => 0.3277, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 19.73% (0.1505 => 0.1802, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.57% (0.2866 => 0.3427, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 19.52% (0.5826 => 0.6963, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.49% (3.5627 => 4.2572, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.35% (0.3271 => 0.3904, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.23% (1.6211 => 1.9328, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.20% (0.0573 => 0.0683, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.04% (0.4658 => 0.5545, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 18.95% (0.5889 => 0.7005, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/gs/gs: 18.93% (1.8794 => 2.2352, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.90% (0.1968 => 0.2340, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 18.90% (0.5546 => 0.6594, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.79% (0.2911 => 0.3458, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 18.75% (0.9697 => 1.1515, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.68% (0.2875 => 0.3412, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.52% (0.5026 => 0.5957, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.37% (0.2738 => 0.3241, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 18.16% (0.2803 => 0.3312, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.09% (0.3930 => 0.4641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.05% (0.2792 => 0.3296, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 18.02% (0.1421 => 0.1677, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.99% (0.2729 => 0.3220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.98% (0.2725 => 0.3215, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 17.98% (0.2714 => 0.3202, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.86% (0.4361 => 0.5140, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 17.82% (0.7171 => 0.8449, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 17.78% (0.2750 => 0.3239, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.76% (0.1284 => 0.1512, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 17.75% (0.2823 => 0.3324, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.74% (1.0781 => 1.2694, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.74% (2.7292 => 3.2134, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.69% (2.0673 => 2.4331, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/methcall: 17.67% (0.2813 => 0.3310, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 17.51% (0.9909 => 1.1644, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 17.50% (0.2811 => 0.3303, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.48% (0.3060 => 0.3595, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 17.47% (0.3096 => 0.3637, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.46% (0.3362 => 0.3949, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 17.41% (0.3004 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.41% (0.2780 => 0.3264, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.38% (4.2109 => 4.9427, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.28% (1.9694 => 2.3098, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.09% (0.3282 => 0.3843, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.03% (0.3195 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.01% (1.9966 => 2.3362, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.91% (4.6926 => 5.4863, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.88% (0.1090 => 0.1274, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 16.77% (23.5202 => 27.4639, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 16.67% (0.2075 => 0.2421, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 16.64% (0.3258 => 0.3800, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.61% (0.3317 => 0.3868, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.53% (0.3267 => 0.3807, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 16.06% (0.2566 => 0.2978, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 15.94% (0.3726 => 0.4320, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.92% (0.3348 => 0.3881, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.90% (0.3465 => 0.4016, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.85% (0.3678 => 0.4261, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions-2: 15.84% (0.3446 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.77% (0.3469 => 0.4016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.76% (0.3477 => 0.4025, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.74% (0.3488 => 0.4037, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 15.69% (0.3460 => 0.4003, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.69% (1.4269 => 1.6508, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 15.69% (0.3442 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.67% (0.0804 => 0.0930, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.66% (0.3690 => 0.4268, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.56% (0.3625 => 0.4189, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.52% (0.3981 => 0.4599, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.40% (0.3643 => 0.4204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.39% (0.4146 => 0.4784, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.37% (0.3650 => 0.4211, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.29% (0.7875 => 0.9079, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 15.20% (0.3724 => 0.4290, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.14% (0.3845 => 0.4427, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 15.04% (0.0758 => 0.0872, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 15.03% (4.6177 => 5.3119, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 14.98% (0.4251 => 0.4888, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 14.98% (0.2691 => 0.3094, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 14.94% (2.1653 => 2.4889, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 14.53% (0.5012 => 0.5740, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 14.47% (2.1013 => 2.4054, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.88% (0.1383 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.88% (0.6435 => 0.7328, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.53% (0.2040 => 0.2316, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 13.36% (5.5417 => 6.2820, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.23% (0.3084 => 0.3492, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 13.12% (0.4847 => 0.5483, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.98% (0.3498 => 0.3952, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.90% (0.2737 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.86% (0.2068 => 0.2334, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 12.57% (0.6634 => 0.7468, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.55% (0.1028 => 0.1157, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 12.51% (2.0346 => 2.2891, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 12.35% (0.3336 => 0.3748, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 11.33% (0.2391 => 0.2662, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.2103 => 0.2338, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 10.69% (11.9555 => 13.2331, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (0.5584 => 0.6115, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.30% (0.3792 => 0.4031, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.62% (29.0505 => 181.4542, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.80% (0.3693 => 0.4018, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 6.88% (0.2122 => 0.2268, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6092, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6780, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2411, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6786, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-2: 4.35% (1.8057 => 1.8842, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.05% (3.3991 => 3.5028, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1987, std.dev.: 0.0476) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3137, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0812, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6143, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2070, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4817, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5801, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.69% (17.2379 => 14.1892, std.dev.: 0.1342) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9790, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7966, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: -7.29% (0.2402 => 0.2227, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -5.14% (14.0481 => 13.3256, std.dev.: 0.1400) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2068, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8091, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1746, std.dev.: 0.0495) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2594, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0473, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 2 22:52:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 3 Jan 2013 00:52:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130103065240.75AE82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7323?compare_to=7318&baseline=4940 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6 Comparing: Run: 7323, Order: 171457, Start Time: 2013-01-03 04:54:11, End Time: 2013-01-03 06:53:17 To: 7318, Order: 171450, Start Time: 2013-01-03 02:30:39, End Time: 2013-01-03 04:35:05 Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (28 on baseline) Performance Regressions: 7 (162 on baseline) Performance Improvements: 26 (50 on baseline) Added Tests: 0 (56 on baseline) Existing Failures: 42 (40 on baseline) Unchanged Tests: 1027 (764 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.52% (1.2946 => 1.3143, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.87% (1.8080 => 1.8961, std.dev.: 0.0292) SingleSource/Benchmarks/Dhrystone/fldry: 2.73% (0.6599 => 0.6779, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.57% (43.2147 => 44.3247, std.dev.: 0.3376) SingleSource/Benchmarks/Shootout/hash: 1.96% (4.2037 => 4.2859, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout/matrix: 1.46% (7.1529 => 7.2570, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.17% (2.7485 => 2.7806, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -36.04% (0.0566 => 0.0362, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -8.19% (1.2147 => 1.1152, std.dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -8.13% (0.2287 => 0.2101, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.78% (1.2184 => 1.1358, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.64% (1.4447 => 1.3488, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.34% (1.4869 => 1.3927, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.33% (1.4038 => 1.3149, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.93% (1.1683 => 1.0990, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.91% (1.1441 => 1.0765, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.74% (1.1195 => 1.0552, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.74% (1.0828 => 1.0207, std.dev.: 0.0081) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.41% (0.5305 => 0.5018, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.67% (1.0576 => 1.0082, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.45% (1.4277 => 1.3785, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.43% (5.6717 => 5.4769, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.08% (1.3326 => 1.2915, std.dev.: 0.0032) MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.89% (1.1576 => 1.1241, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.69% (0.6217 => 0.6050, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: -1.98% (1.3086 => 1.2827, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -9.93% (6.8356 => 6.1566, std.dev.: 0.1820) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.71% (0.5603 => 0.5283, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/mason/mason: -3.70% (0.5568 => 0.5362, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.19% (0.4268 => 0.4132, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -2.97% (29.6600 => 28.7785, std.dev.: 0.2664) MultiSource/Benchmarks/Olden/bh/bh: -1.55% (2.4275 => 2.3899, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.52% (0.6588 => 0.6488, std.dev.: 0.0025) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.27% (1.1787 => 1.1402, std.dev.: 0.0445) SingleSource/Benchmarks/CoyoteBench/fftbench: -0.05% (0.3960 => 0.3958, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.70% (0.0243 => 0.0217, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.85% (0.0454 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.75% (0.0400 => 0.0337, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.39% (0.0443 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -5.14% (0.0214 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -21.17% (0.0274 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0253 => 0.0251, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.95% (0.1535 => 0.1505, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: -2.63% (1.1648 => 1.1342, std.dev.: 0.0211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.08% (0.4117 => 0.3990, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.48% (0.1456 => 0.1463, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.27% (0.0969 => 0.0947, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.78% (0.0278 => 0.0223, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.79% (0.0560 => 0.0598, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.01% (1.2821 => 1.2820, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -97.06% (0.0034 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.36% (0.0616 => 0.0583, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.94% (0.0326 => 0.0261, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (2.7882 => 2.7819, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.92% (0.0053 => 0.0089, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.72% (31.6833 => 31.1369, std.dev.: 0.1488) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode SingleSource/UnitTests/Vectorizer/gcc-loops New Passes - Compile Time ------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: 20.33% (16.4461 => 19.7903, std.dev.: 1.4804) MultiSource/Applications/sqlite3/sqlite3: 3511.64% (0.6332 => 22.8689, std.dev.: 0.5916) MultiSource/Benchmarks/McCat/08-main/main: 54.83% (0.1831 => 0.2835, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -0.32% (0.1559 => 0.1554, std.dev.: 0.0289) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23880.98% (0.3123 => 74.8926, std.dev.: 14.1086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1860.74% (0.3344 => 6.5567, std.dev.: 0.1516) SingleSource/Benchmarks/Misc-C++/Large/ray: 39.64% (0.2364 => 0.3301, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 17.00% (0.6010 => 0.7032, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/mandel: 6.53% (0.0429 => 0.0457, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.57% (0.3266 => 0.3448, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/strcat: 2.49% (0.1969 => 0.2018, std.dev.: 0.0049) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 1.79% (0.0224 => 0.0228, std.dev.: 0.0018) SingleSource/UnitTests/byval-alignment: -29.57% (0.0230 => 0.0162, std.dev.: 0.0058) New Passes - Execution Time --------------------------- MultiSource/Applications/kimwitu++/kc MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/byval-alignment MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0516, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 12.18% (0.1462 => 0.1640, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4176, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0700, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4944, std.dev.: 0.0413) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5283, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.5261, std.dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0557, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3364, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3776, std.dev.: 0.0479) SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0844, std.dev.: 0.0073) SingleSource/Regression/C/uint64_to_float: -29.84% (2.1832 => 1.5317, std.dev.: 0.0087) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 137.35% (0.0249 => 0.0591, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: 102.80% (0.0250 => 0.0507, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 64.44% (0.1440 => 0.2368, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 63.64% (0.0297 => 0.0486, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 61.43% (0.8359 => 1.3494, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 61.30% (0.8007 => 1.2915, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 61.06% (0.8261 => 1.3305, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 60.73% (0.8177 => 1.3143, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 60.28% (0.8805 => 1.4113, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 60.09% (0.8611 => 1.3785, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 59.68% (0.8316 => 1.3279, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 59.55% (0.8066 => 1.2869, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 59.49% (0.8457 => 1.3488, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 59.42% (0.7932 => 1.2645, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 58.82% (0.8048 => 1.2782, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 57.70% (0.8338 => 1.3149, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 56.88% (0.8716 => 1.3674, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 56.75% (0.8885 => 1.3927, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 56.66% (0.8597 => 1.3468, std.dev.: 0.0149) SingleSource/UnitTests/SignlessTypes/shr: 56.02% (0.0191 => 0.0298, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.22% (0.9056 => 1.4057, std.dev.: 0.0560) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 54.96% (1.5315 => 2.3732, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 54.65% (0.9039 => 1.3979, std.dev.: 0.0321) SingleSource/Regression/C/test_indvars: 53.88% (0.0232 => 0.0357, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.92% (0.9688 => 1.4718, std.dev.: 0.0496) SingleSource/Benchmarks/Shootout/ary3: 49.36% (0.0235 => 0.0351, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 42.22% (0.0784 => 0.1115, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.40% (2.1401 => 3.0261, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.69% (0.0734 => 0.0996, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 35.57% (3.1832 => 4.3155, std.dev.: 0.1110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.68% (0.0421 => 0.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.36% (0.0550 => 0.0728, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 29.52% (0.8855 => 1.1469, std.dev.: 0.0397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.35% (0.0635 => 0.0815, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 28.11% (0.8286 => 1.0615, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 27.09% (0.8069 => 1.0255, std.dev.: 0.0271) MultiSource/Applications/sgefa/sgefa: 27.01% (0.2999 => 0.3809, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 26.66% (0.8712 => 1.1035, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 26.66% (0.8331 => 1.0552, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.61% (0.2180 => 0.2760, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.56% (0.7966 => 1.0082, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 26.38% (0.8518 => 1.0765, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.37% (0.8697 => 1.0990, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 26.31% (0.0650 => 0.0821, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.30% (0.8204 => 1.0362, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.24% (0.8050 => 1.0162, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 26.23% (0.8086 => 1.0207, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 26.09% (0.8317 => 1.0487, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 25.96% (0.8656 => 1.0903, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.24% (0.9069 => 1.1358, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.20% (0.8420 => 1.0542, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.92% (0.8927 => 1.1152, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.83% (0.9074 => 1.1327, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.39% (0.9908 => 1.2325, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/ReedSolomon: 24.14% (0.1839 => 0.2283, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.64% (0.0848 => 0.1040, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.46% (0.6586 => 0.8065, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/chomp: 22.36% (0.1565 => 0.1915, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.03% (4.4880 => 5.4769, std.dev.: 0.0686) MultiSource/Applications/lemon/lemon: 21.76% (1.0945 => 1.3327, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 20.74% (0.0757 => 0.0914, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.54% (0.0701 => 0.0845, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.51% (0.0668 => 0.0805, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.36% (1.2526 => 1.5076, std.dev.: 0.0339) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 20.07% (0.0822 => 0.0987, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 18.92% (0.3800 => 0.4519, std.dev.: 0.0169) MultiSource/Benchmarks/PAQ8p/paq8p: 18.72% (2.3764 => 2.8213, std.dev.: 0.1021) MultiSource/Benchmarks/Olden/tsp/tsp: 18.35% (0.1112 => 0.1316, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 17.83% (0.1778 => 0.2095, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.58% (0.0745 => 0.0876, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 17.53% (0.4125 => 0.4848, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 16.77% (0.1097 => 0.1281, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 16.55% (0.5191 => 0.6050, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 15.95% (0.2427 => 0.2814, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 15.72% (0.2227 => 0.2577, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.48% (0.4127 => 0.4766, std.dev.: 0.0143) MultiSource/Applications/Burg/burg: 15.28% (1.2222 => 1.4089, std.dev.: 0.0545) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.86% (0.1756 => 0.2017, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 14.76% (14.2605 => 16.3648, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.60% (0.1137 => 0.1303, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 14.20% (1.2568 => 1.4353, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 14.13% (0.0722 => 0.0824, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 14.12% (0.1466 => 0.1673, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 13.81% (1.1271 => 1.2827, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 13.40% (0.4397 => 0.4986, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 13.15% (4.9628 => 5.6154, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/flops: 12.81% (0.0937 => 0.1057, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 11.72% (0.3226 => 0.3604, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.46% (0.1885 => 0.2101, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 11.31% (0.6834 => 0.7607, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 11.27% (0.7950 => 0.8846, std.dev.: 0.0270) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.02% (0.1905 => 0.2115, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 10.95% (3.2366 => 3.5911, std.dev.: 0.0530) MultiSource/Applications/JM/lencod/lencod: 10.67% (15.3280 => 16.9635, std.dev.: 0.0539) SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.07% (0.8340 => 0.9180, std.dev.: 0.0253) MultiSource/Benchmarks/Olden/voronoi/voronoi: 9.65% (0.2519 => 0.2762, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: 9.55% (14.7684 => 16.1781, std.dev.: 0.0398) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 9.39% (0.1150 => 0.1258, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 9.30% (3.8189 => 4.1741, std.dev.: 0.0479) MultiSource/Applications/treecc/treecc: 9.03% (1.9948 => 2.1750, std.dev.: 0.0248) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.95% (0.4559 => 0.4967, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 8.88% (6.7320 => 7.3298, std.dev.: 0.0338) MultiSource/Benchmarks/Olden/mst/mst: 8.58% (0.1177 => 0.1278, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.50% (0.6227 => 0.6756, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/power/power: 8.42% (0.1247 => 0.1352, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.33% (1.1170 => 1.2100, std.dev.: 0.0161) MultiSource/Benchmarks/Olden/health/health: 8.31% (0.1347 => 0.1459, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 7.64% (0.2985 => 0.3213, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.44% (0.2794 => 0.3002, std.dev.: 0.0055) MultiSource/Applications/hbd/hbd: 7.43% (1.4269 => 1.5329, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 7.15% (0.1721 => 0.1844, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 6.98% (0.1577 => 0.1687, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.92% (0.2240 => 0.2395, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/18-imp/imp: 6.34% (0.3503 => 0.3725, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.24% (0.2741 => 0.2912, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 5.13% (0.7557 => 0.7945, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 5.12% (31.8598 => 33.4895, std.dev.: 0.4491) MultiSource/Applications/hexxagon/hexxagon: 3.19% (0.9810 => 1.0123, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 1514900.00% (0.0001 => 1.5150, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 374.31% (0.3585 => 1.7004, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 363.08% (1.5671 => 7.2570, std.dev.: 0.0182) MultiSource/Benchmarks/PAQ8p/paq8p: 279.74% (91.7701 => 348.4887, std.dev.: 7.0848) MultiSource/Benchmarks/SciMark2-C/scimark2: 199.31% (28.5821 => 85.5495, std.dev.: 0.0953) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 172.75% (5.1305 => 13.9936, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/ary2: 123.20% (0.0125 => 0.0279, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 116.49% (1.1365 => 2.4604, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout-C++/ary: 107.76% (0.0219 => 0.0455, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 68.14% (0.0226 => 0.0380, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 60.56% (2.8760 => 4.6176, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/pi: 40.28% (1.5795 => 2.2158, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.18% (2.7995 => 3.9244, std.dev.: 0.0381) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 36.59% (1.3882 => 1.8961, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.31% (4.5327 => 5.9518, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 28.02% (2.9096 => 3.7249, std.dev.: 0.0130) SingleSource/Benchmarks/McGill/misr: 20.72% (0.4001 => 0.4830, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 16.89% (4.7794 => 5.5868, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 16.31% (0.7597 => 0.8836, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/salsa20: 14.01% (7.5003 => 8.5511, std.dev.: 0.0704) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.17% (1.1857 => 1.3063, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 9.21% (0.1129 => 0.1233, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 9.04% (3.1873 => 3.4755, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ReedSolomon: 8.07% (8.5322 => 9.2206, std.dev.: 0.0193) SingleSource/Benchmarks/CoyoteBench/huffbench: 7.34% (23.5781 => 25.3084, std.dev.: 0.0639) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.65% (4.9686 => 5.2493, std.dev.: 0.0368) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.50% (0.6150 => 0.6488, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.41% (3.5679 => 3.7611, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 4.99% (3.8206 => 4.0114, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.79% (6.1706 => 6.4662, std.dev.: 0.0426) MultiSource/Applications/JM/lencod/lencod: 4.71% (6.7064 => 7.0226, std.dev.: 0.0178) MultiSource/Applications/aha/aha: 4.64% (3.3398 => 3.4949, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 4.58% (0.5214 => 0.5453, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 4.07% (1.3037 => 1.3567, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: 3.58% (0.5081 => 0.5263, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/queens: 3.49% (1.7056 => 1.7652, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/power/power: 3.35% (1.2061 => 1.2465, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.17% (4.2466 => 4.3813, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.51% (0.4031 => 0.4132, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.15% (3.4104 => 3.4837, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 1.44% (2.3560 => 2.3899, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.41% (1.9302 => 1.9575, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.39% (8.2783 => 8.3930, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops-7: 1.20% (1.7156 => 1.7362, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -71.21% (2.8951 => 0.8336, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -58.86% (11.5316 => 4.7436, std.dev.: 0.0487) SingleSource/Benchmarks/Misc/fp-convert: -52.18% (15.8853 => 7.5958, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -36.33% (4.7482 => 3.0230, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -34.44% (5.4972 => 3.6042, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -32.06% (5.4300 => 3.6891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -30.81% (1.9999 => 1.3838, std.dev.: 0.1674) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.81% (5.6343 => 4.1235, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -20.42% (5.0261 => 4.0000, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -16.92% (5.0243 => 4.1743, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -14.90% (2.9753 => 2.5321, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.58% (7.2130 => 6.2335, std.dev.: 0.1894) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.98% (9.9065 => 8.7197, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -10.20% (63.1822 => 56.7347, std.dev.: 0.1692) SingleSource/Benchmarks/Misc/flops-8: -9.44% (2.5609 => 2.3192, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: -9.29% (5.1084 => 4.6336, std.dev.: 0.1219) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.26% (6.2275 => 5.6511, std.dev.: 0.0355) MultiSource/Benchmarks/Olden/em3d/em3d: -9.17% (5.4641 => 4.9633, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: -9.12% (1.1216 => 1.0193, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.79% (3.7148 => 3.3883, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.78% (1.0512 => 0.9589, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.60% (3.2169 => 2.9725, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -7.41% (5.3218 => 4.9273, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: -7.00% (4.3552 => 4.0503, std.dev.: 0.0958) SingleSource/Benchmarks/Stanford/FloatMM: -6.77% (0.8807 => 0.8211, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/sieve: -6.11% (7.0599 => 6.6286, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/flops: -5.56% (9.3748 => 8.8540, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.32% (4.9453 => 4.6822, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -5.31% (0.3937 => 0.3728, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.26% (22.2997 => 21.3487, std.dev.: 0.3350) MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.80% (2.8773 => 2.7681, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (8.9760 => 8.6406, std.dev.: 0.0634) MultiSource/Applications/lua/lua: -3.53% (29.8330 => 28.7785, std.dev.: 0.2664) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.34% (1.4529 => 1.4044, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.14% (5.1557 => 4.9940, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.89% (4.7449 => 4.6077, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.82% (4.9469 => 4.8072, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/fbench: -2.59% (3.3840 => 3.2963, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.45% (6.0224 => 5.8747, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (9.2989 => 9.0836, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.07% (2.6356 => 2.5810, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/tsp/tsp: -1.99% (1.4861 => 1.4566, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/fldry: -1.90% (0.6910 => 0.6779, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.87% (4.8362 => 4.7457, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.78% (3.3479 => 3.2884, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -1.38% (3.6643 => 3.6136, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: -1.09% (2.8561 => 2.8249, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/neural/neural: -1.08% (1.0841 => 1.0724, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.5308 => 1.5148, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.00% (4.9994 => 4.9492, std.dev.: 0.0127) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 11.11% (1.0262 => 1.1402, std.dev.: 0.0445) SingleSource/Benchmarks/CoyoteBench/fftbench: 60.70% (0.2463 => 0.3958, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 76.42% (0.0123 => 0.0217, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.88% (0.0408 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.68% (0.0254 => 0.0337, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.30% (0.0302 => 0.0315, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.46% (0.0384 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 20.00% (0.0180 => 0.0216, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 4.66% (0.1438 => 0.1505, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 0.11% (1.1329 => 1.1342, std.dev.: 0.0211) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.18% (0.4164 => 0.3990, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.87% (0.1369 => 0.1463, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 47.74% (0.0641 => 0.0947, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.36% (0.0195 => 0.0223, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.46% (0.0578 => 0.0598, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.09% (1.1437 => 1.2820, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0001 => 0.0001, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.86% (0.0014 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.02% (0.0627 => 0.0583, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.00% (0.0180 => 0.0261, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 247.00% (0.8017 => 2.7819, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.55% (0.0062 => 0.0089, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) Report Time: 3.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 11:47:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 13:47:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130104194726.441DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7324?compare_to=7321&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7324, Order: 171468, Start Time: 2013-01-04 18:10:33, End Time: 2013-01-04 19:47:11 To: 7321, Order: 171457, Start Time: 2013-01-03 04:59:19, End Time: 2013-01-03 06:36:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (817 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.25% (22.4056 => 78.9231, std.dev.: 0.0288) SingleSource/Benchmarks/Misc/lowercase: 65.36% (0.0280 => 0.0463, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.18% (0.0717 => 0.1127, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 54.62% (0.0974 => 0.1506, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 49.22% (0.0514 => 0.0767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 38.20% (0.0267 => 0.0369, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 34.60% (0.1500 => 0.2019, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.04% (0.1132 => 0.1506, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.55% (0.0599 => 0.0788, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.62% (1.6474 => 2.1024, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 26.79% (0.0418 => 0.0530, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.39% (0.0790 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.36% (5.4682 => 6.6363, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.79% (2.2587 => 2.7058, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 18.45% (0.0699 => 0.0828, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.50% (0.0680 => 0.0799) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 15.95% (0.6395 => 0.7415, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.75% (1.1450 => 1.3253, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.54% (0.6395 => 0.7325, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.50% (0.6260 => 0.7105, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.66% (0.5941 => 0.6693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 12.06% (0.5805 => 0.6505, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 11.81% (0.5849 => 0.6540, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.80% (0.6230 => 0.6965, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.62% (0.6033 => 0.6734, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.61% (0.1146 => 0.1279, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.27% (0.6440 => 0.7166, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.25% (0.5456 => 0.6070, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.25% (0.7021 => 0.7811, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.16% (0.5688 => 0.6323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.94% (0.5575 => 0.6185, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 10.90% (0.6676 => 0.7404, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 10.89% (0.5567 => 0.6173, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.75% (0.5925 => 0.6562, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.75% (0.5581 => 0.6181, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.34% (0.5802 => 0.6402, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.17% (1.6364 => 1.8029, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: 10.17% (0.4524 => 0.4984, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 10.16% (0.5857 => 0.6452, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.09% (0.5859 => 0.6450, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 9.95% (0.6052 => 0.6654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.90% (0.6446 => 0.7084, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (0.6189 => 0.6795, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.64% (0.4916 => 0.5390, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.59% (0.5569 => 0.6103, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 9.57% (0.4515 => 0.4947, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.54% (0.1982 => 0.2171, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 9.48% (0.5570 => 0.6098, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 9.38% (0.4861 => 0.5317, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.38% (0.6304 => 0.6895, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.27% (0.5478 => 0.5986, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.20% (0.5705 => 0.6230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.18% (0.5591 => 0.6104, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.14% (0.5329 => 0.5816, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.07% (3.5339 => 3.8543, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 8.78% (0.6660 => 0.7245, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.77% (0.5863 => 0.6377, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.30% (0.6194 => 0.6708, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.08% (0.6297 => 0.6806, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.86% (4.5069 => 4.8611, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.81% (0.6681 => 0.7203, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.66% (0.7524 => 0.8100, std.dev.: 0.0164) MultiSource/Applications/sgefa/sgefa: 7.60% (0.3357 => 0.3612, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.59% (0.6667 => 0.7173, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.73% (0.7339 => 0.7833, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 5.70% (0.6750 => 0.7135, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3446 => 0.3641, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.35% (1.4642 => 1.5426, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.30% (0.3394 => 0.3574, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.20% (1.2784 => 1.3449, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 5.01% (9.2283 => 9.6906, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 5.01% (18.2933 => 19.2091, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.99% (0.2385 => 0.2504, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 4.97% (1.2515 => 1.3137, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 3.94% (0.3481 => 0.3618, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 3.36% (17.1032 => 17.6771, std.dev.: 0.0224) MultiSource/Applications/oggenc/oggenc: 3.19% (5.0226 => 5.1828, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 2.10% (1.3864 => 1.4155, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.9557 => 0.9741, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 76.98% (31.3723 => 55.5219, std.dev.: 0.0495) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5336, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9531 => 1.0289, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4397, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 3.76% (11.6767 => 12.1158, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5088, std.dev.: 0.0419) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1065, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6469 => 0.6636, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8210 => 28.3180, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6030, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.12% (4.4335 => 4.4832, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.72% (0.3812 => 0.3594, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.72% (0.3848 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -5.62% (0.3880 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.57% (0.3896 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.31% (0.2428 => 0.2299, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.17% (0.4199 => 0.3982, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.04% (0.3057 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.93% (0.4280 => 0.4069, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.64% (2.1713 => 2.0705, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.50% (0.9852 => 0.9409, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.46% (0.3142 => 0.3002, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.43% (0.4151 => 0.3967, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.40% (1.3148 => 1.2570, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -4.33% (0.6347 => 0.6072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.31% (0.3016 => 0.2886, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.31% (0.9542 => 0.9131, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.21% (0.6441 => 0.6170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.16% (0.3658 => 0.3506, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -4.14% (0.3621 => 0.3471, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.03% (0.4321 => 0.4147, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -3.96% (0.3867 => 0.3714, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.4427 => 0.4255, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.78% (0.6484 => 0.6239, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.60% (0.4248 => 0.4095, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.43% (0.4083 => 0.3943, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.33% (0.3849 => 0.3721, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -3.19% (0.7982 => 0.7727, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -3.16% (20.7746 => 20.1175, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: -3.16% (2.4924 => 2.4136, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.13% (0.7919 => 0.7671, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -3.09% (4.3330 => 4.1991, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.76% (1.0544 => 1.0253, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.72% (1.2221 => 1.1888, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.69% (1.2210 => 1.1881, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.66% (6.7716 => 6.5918, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: -2.64% (34.0927 => 33.1940, std.dev.: 0.0998) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.42% (1.2300 => 1.2002, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.37% (0.5999 => 0.5857, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.19% (0.8521 => 0.8334, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: -2.15% (16.1920 => 15.8444, std.dev.: 0.0263) MultiSource/Applications/JM/ldecod/ldecod: -2.13% (7.0961 => 6.9447, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: -2.08% (1.5610 => 1.5286, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9143, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -1.91% (4.0594 => 3.9818, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: -1.61% (0.9179 => 0.9031, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -1.54% (2.4021 => 2.3652, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: -1.47% (2.1401 => 2.1086, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.26% (8.0126 => 7.9113, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -1.05% (15.2527 => 15.0922, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.04% (4.8802 => 4.8294, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.07% (1.8100 => 0.7047, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0459 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -49.91% (8.0445 => 4.0296, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -47.90% (6.6713 => 3.4757, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.16% (0.6962 => 0.3818, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -31.63% (0.1622 => 0.1109, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -27.79% (0.1983 => 0.1432, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.31% (0.2151 => 0.1585, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2401, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0221, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.39% (0.2274 => 0.1742, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0445, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary: -22.46% (0.0757 => 0.0587, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.36% (4.3779 => 3.3992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1996, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.66% (5.3397 => 4.1830, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.18% (2.9703 => 2.3709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -18.74% (3.3454 => 2.7186, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.25% (1.2237 => 1.0004, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.59% (2.5106 => 2.1191, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -12.81% (4.2493 => 3.7051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.21% (4.9100 => 4.3596, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.46% (0.5142 => 0.4604, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.39% (5.2027 => 4.8181, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.90% (4.1534 => 3.9083, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.78% (1.1594 => 1.0924, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.74% (1.7753 => 1.6912, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.72% (0.6299 => 0.6002, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.73% (6.5803 => 6.3346, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7350, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.89% (5.3830 => 5.2272, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.86% (2.7523 => 2.7010, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4752, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3040 => 7.2005, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6092, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.21% (4.8776 => 4.8186, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: -1.11% (3.7241 => 3.6828, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 12:31:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 14:31:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130104203112.98CF12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7325?compare_to=7320&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7325, Order: 171468, Start Time: 2013-01-04 18:17:07, End Time: 2013-01-04 20:31:02 To: 7320, Order: 171453, Start Time: 2013-01-03 03:38:20, End Time: 2013-01-03 05:52:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 2 (62 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (611 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.06% (1.0897 => 1.1012, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.20% (11.4276 => 10.9478, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.16% (10.2962 => 10.1769, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (0.0678 => 0.0663, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8416 => 499.8415, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.98% (1.1277 => 499.8415, std.dev.: 0.0094) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.50% (0.5229 => 1.6550, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 20.15% (14.9895 => 18.0100, std.dev.: 0.0365) MultiSource/Applications/kimwitu++/kc: 54.08% (14.1553 => 21.8101, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (4.1105 => 4.7946, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.82% (1.1048 => 1.7436, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1226.20% (7.1582 => 94.9320, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++-EH/spirit: 124.30% (3.4629 => 7.7673, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.82% (0.6222 => 1.1002, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.72% (0.0720 => 7.4374, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 3830000.00% (0.0001 => 3.8301, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11143900.00% (0.0001 => 11.1440, std.dev.: 0.0403) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 577500.00% (0.0001 => 0.5776, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9959800.00% (0.0001 => 9.9599, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5501400.00% (0.0001 => 5.5015, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 809.14% (1.1194 => 10.1769, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 147.02% (22.1758 => 54.7795, std.dev.: 0.0396) SingleSource/Benchmarks/Misc/lowercase: 102.34% (0.0256 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 84.61% (0.0929 => 0.1715, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 83.95% (0.0243 => 0.0447) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 59.47% (0.1463 => 0.2333, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.45% (2.9384 => 4.6558, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 57.93% (0.0271 => 0.0428, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.68% (7.0540 => 10.9814, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.07% (1.5859 => 2.4116, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 49.75% (0.0394 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.79% (8.1363 => 12.0249, std.dev.: 0.0110) SingleSource/Regression/C/sumarray: 47.19% (0.0231 => 0.0340, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.69% (0.1432 => 0.2029, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.23% (2.2024 => 3.1105, std.dev.: 0.0187) MultiSource/Applications/JM/lencod/lencod: 40.84% (21.9371 => 30.8954, std.dev.: 0.0412) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.36% (0.0439 => 0.0603, std.dev.: 0.0009) SingleSource/UnitTests/vla: 35.49% (0.0355 => 0.0481, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.03% (0.6675 => 0.8880, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 32.67% (0.1062 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.42% (1.5415 => 2.0412, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 31.07% (0.5105 => 0.6691, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 31.04% (0.3109 => 0.4074, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.70% (0.4615 => 0.6032, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 30.03% (0.4299 => 0.5590, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.65% (4.2646 => 5.5292, std.dev.: 0.0153) SingleSource/Benchmarks/McGill/exptree: 28.99% (0.0814 => 0.1050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 28.86% (0.4289 => 0.5527, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 27.94% (0.4620 => 0.5911, std.dev.: 0.0133) MultiSource/Applications/Burg/burg: 27.25% (1.1642 => 1.4814, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.67% (1.0722 => 1.3582, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 25.37% (0.2554 => 0.3202, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.23% (0.2271 => 0.2844, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 25.02% (0.1175 => 0.1469, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.77% (3.8922 => 4.8562, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 24.63% (0.6456 => 0.8046, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 23.37% (0.0719 => 0.0887, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.20% (1.4186 => 1.7477, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 22.82% (5.7591 => 7.0733, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 22.50% (9.4845 => 11.6187, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.27% (0.3121 => 0.3816, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.21% (0.1337 => 0.1634, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.19% (0.0793 => 0.0969, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.13% (0.0479 => 0.0585, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.1029 => 0.1255, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 21.41% (0.3283 => 0.3986, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.04% (0.2700 => 0.3268, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 20.98% (0.7115 => 0.8608, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 20.95% (0.3232 => 0.3909, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.93% (1.3050 => 1.5781, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.26% (0.1555 => 0.1870, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/chomp: 20.18% (0.1655 => 0.1989, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.00% (0.1695 => 0.2034, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.73% (0.0953 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.72% (4.9449 => 5.9202, std.dev.: 0.0188) MultiSource/Applications/spiff/spiff: 19.67% (0.7835 => 0.9376, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.5860 => 0.6991, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 19.26% (3.3354 => 3.9779, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.19% (0.1032 => 0.1230, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.09% (5.0018 => 5.9565, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.05% (0.0672 => 0.0800, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 19.00% (0.1163 => 0.1384, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 18.96% (17.1811 => 20.4383, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/em3d/em3d: 18.94% (0.1695 => 0.2016, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 18.91% (1.1840 => 1.4079, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.67% (0.0675 => 0.0801, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.65% (0.8172 => 0.9696, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 18.44% (0.3379 => 0.4002, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.22% (0.0730 => 0.0863, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 17.81% (0.1151 => 0.1356, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.73% (0.1940 => 0.2284, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.61% (0.0886 => 0.1042, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 17.59% (0.0614 => 0.0722, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.41% (0.5020 => 0.5894, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.28% (0.9765 => 1.1452, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/18-imp/imp: 17.27% (0.3423 => 0.4014, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.19% (0.4636 => 0.5433, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.15% (0.1236 => 0.1448, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1268 => 0.1485, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 17.06% (0.7433 => 0.8701, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.04% (0.2758 => 0.3228, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.93% (0.5569 => 0.6512, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.85% (0.2107 => 0.2462, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 16.71% (2.2969 => 2.6806, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.63% (0.3307 => 0.3857, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.49% (0.5981 => 0.6967, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 16.42% (3.8723 => 4.5080, std.dev.: 0.0155) MultiSource/Applications/treecc/treecc: 16.39% (2.0273 => 2.3595, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.23% (0.0770 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.03% (0.2065 => 0.2396, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.00% (0.8101 => 0.9397, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: 15.94% (0.8921 => 1.0343, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.92% (0.6450 => 0.7477, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.58% (0.3441 => 0.3977, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.54% (0.0933 => 0.1078, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.75% (1.1861 => 1.3611, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.17% (0.1143 => 0.1305, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 14.06% (0.3180 => 0.3627, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.97% (0.3387 => 0.3860, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 13.64% (1.5603 => 1.7732, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.60% (0.1044 => 0.1186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 13.42% (0.2049 => 0.2324, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.39% (0.8067 => 0.9147, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/Puzzle: 12.85% (0.1268 => 0.1431, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.73% (0.3865 => 0.4357, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 12.71% (0.0818 => 0.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.55% (0.3282 => 0.3694, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.48% (0.3927 => 0.4417, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.04% (0.4103 => 0.4597, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.87% (0.4203 => 0.4702, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 11.69% (0.3473 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.63% (0.3543 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.62% (14.3668 => 16.0366, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 11.62% (0.3098 => 0.3458, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.52% (0.3516 => 0.3921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.26% (0.4048 => 0.4504, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3427 => 0.3807, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.99% (0.3603 => 0.3999, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3422 => 0.3796, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 10.64% (0.3684 => 0.4076, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.38% (0.3826 => 0.4223, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3650 => 0.4014, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.92% (0.4064 => 0.4467, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2831 => 0.3102, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3162 => 0.3461, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.30% (0.2871 => 0.3138, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.17% (2.0665 => 2.2561, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7326 => 0.7967, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: 8.65% (0.2877 => 0.3126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.62% (1.2842 => 1.3949, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2872 => 0.3119, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.57% (2.2022 => 2.3909, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 8.39% (63.2438 => 68.5531, std.dev.: 0.1003) SingleSource/Benchmarks/Shootout-C++/wc: 8.32% (0.3052 => 0.3306, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.31% (0.3935 => 0.4262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2793 => 0.3022, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.16% (0.2756 => 0.2981, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.50% (0.4879 => 0.5245, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 6.96% (0.3131 => 0.3349, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 5.60% (10.3673 => 10.9478, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.11% (0.3817 => 0.3974, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.21% (7.9617 => 8.2176, std.dev.: 0.0118) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 81.67% (32.5116 => 59.0628, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 15.18% (3.0680 => 3.5338) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.01% (2.8904 => 3.1509, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.32% (11.6436 => 12.3790, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.58% (3.1578 => 3.3339, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4588, std.dev.: 0.0098) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Misc/ffbench: 4.08% (0.9505 => 0.9893, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.55% (2.0360 => 2.1082, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.24% (0.9957 => 1.0280, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.6802 => 8.9031, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7163, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.96% (0.6533 => 0.6661, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.79% (27.8444 => 28.3432, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.52% (1.7254 => 1.7517, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 1.40% (4.4649 => 4.5273, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.25% (6.5088 => 6.5902, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2255, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.13% (5.2763 => 1.2067, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.76% (0.8651 => 0.2097, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (5.3855 => 4.4710, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.57% (5.3526 => 4.4659, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: -12.88% (10.4361 => 9.0920, std.dev.: 0.0228) SingleSource/UnitTests/Vector/constpool: -7.91% (54.1659 => 49.8820, std.dev.: 0.0341) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.54% (1.7609 => 1.6457, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.51% (1.9577 => 0.6556, std.dev.: 0.0051) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.47% (2.0460 => 1.0133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -50.11% (8.0499 => 4.0161, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -45.10% (0.6962 => 0.3822, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.02% (0.3987 => 0.2471, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.76% (10.7105 => 7.4162, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -24.99% (85.0658 => 63.8041, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0076, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -20.16% (2.9695 => 2.3708, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -18.58% (3.3453 => 2.7238, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -18.40% (1.2258 => 1.0002, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.32% (2.5528 => 2.1362, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.10% (9.5636 => 8.5019, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2373 => 1.1012, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.13% (1.5660 => 1.4231, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2978, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.63% (1.6805 => 1.5859, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.57% (2.7294 => 2.5774, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -4.57% (10.2830 => 9.8133, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.45% (0.4808 => 0.4594, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8034, std.dev.: 0.0171) MultiSource/Applications/siod/siod: -3.82% (3.2827 => 3.1572, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -3.52% (0.6223 => 0.6004, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.01% (1.0554 => 1.0342, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3305, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.21% (4.6441 => 4.5880, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2343, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.67% (0.2116 => 0.0663, std.dev.: 0.0033) Report Time: 2.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 13:49:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 15:49:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130104214925.374302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7326?compare_to=7324&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7326, Order: 171497, Start Time: 2013-01-04 20:11:00, End Time: 2013-01-04 21:49:13 To: 7324, Order: 171468, Start Time: 2013-01-04 18:10:33, End Time: 2013-01-04 19:47:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 69 (101 on baseline) Performance Improvements: 28 (133 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1005 (810 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 89.90% (0.6070 => 1.1527, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 88.48% (0.6181 => 1.1650, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 88.26% (0.6173 => 1.1621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 87.94% (0.6185 => 1.1624, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 87.66% (0.6323 => 1.1866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 84.65% (0.6450 => 1.1910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 84.20% (0.6505 => 1.1982, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 82.55% (0.6734 => 1.2293, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 82.43% (0.6540 => 1.1931, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 81.39% (0.5986 => 1.0858, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 80.62% (0.6693 => 1.2089, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 80.16% (0.6795 => 1.2242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 79.96% (0.6104 => 1.0985, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 79.94% (0.6098 => 1.0973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 79.80% (0.6103 => 1.0973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 79.28% (0.6230 => 1.1169, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 78.98% (0.6895 => 1.2341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 78.34% (0.7105 => 1.2671, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 77.09% (0.7415 => 1.3131, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 76.91% (0.6402 => 1.1326, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 76.63% (0.7166 => 1.2657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 76.43% (0.6377 => 1.1251, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 76.43% (0.7245 => 1.2782, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 74.66% (0.6654 => 1.1622, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 74.63% (0.6452 => 1.1267, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 73.82% (0.6562 => 1.1406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 73.77% (0.7404 => 1.2866, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 72.96% (0.6708 => 1.1602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 72.32% (0.6806 => 1.1728, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 71.60% (0.6965 => 1.1952, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 69.80% (0.7325 => 1.2438, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 69.27% (0.7084 => 1.1991, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 68.89% (0.7203 => 1.2165, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 68.34% (0.7173 => 1.2075, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 68.06% (0.8100 => 1.3613, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 62.80% (0.7833 => 1.2752, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.15% (0.0799 => 0.0936, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.85% (0.3621 => 0.4231, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.98% (0.1156 => 0.1306, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 12.31% (0.0837 => 0.0940, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 10.74% (0.1127 => 0.1248, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.61% (0.5816 => 0.6433, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.02% (0.1756 => 0.1932, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.60% (2.7058 => 2.9655, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.26% (2.1024 => 2.2970, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 9.11% (0.2019 => 0.2203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.33% (0.3167 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.88% (0.7811 => 0.8270, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.05% (4.8611 => 5.1068, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.01% (0.5390 => 0.5660, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.99% (0.2504 => 0.2629, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.69% (0.2133 => 0.2233, std.dev.: 0.0028) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.62% (0.5501 => 0.5700, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 3.54% (0.3612 => 0.3740, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.15% (5.1828 => 5.3458, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (3.8543 => 3.9447, std.dev.: 0.0147) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (9.6906 => 9.8587, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3819 => 1.4029, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 1.41% (0.7427 => 0.7532, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 1.32% (1.3137 => 1.3311, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.23% (0.9131 => 0.9243, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 31.81% (4.0296 => 5.3113, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: 14.74% (1.0133 => 1.1627) SingleSource/Benchmarks/Linpack/linpack-pc: 9.07% (71.1639 => 77.6154, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 5.53% (3.1738 => 3.3492, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.64% (3.2401 => 3.3258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.28% (4.1047 => 4.1982, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 1.12% (7.2005 => 7.2810, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (3.6854 => 3.7235, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.99% (0.2171 => 0.1889, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -7.74% (0.4984 => 0.4598, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -7.56% (0.5317 => 0.4915, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.54% (0.7135 => 0.6811, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -4.15% (0.3618 => 0.3468, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.78% (1.5426 => 1.4843, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -3.71% (0.3641 => 0.3506, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -3.11% (0.3574 => 0.3463, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.46% (6.6363 => 6.5392, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -1.21% (1.3253 => 1.3093, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.06% (0.9741 => 0.9638, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -22.23% (3.5336 => 2.7480, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -16.21% (0.6002 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -10.84% (0.3818 => 0.3404, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -4.75% (2.7186 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.96% (1.0004 => 0.9608, std.dev.: 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.92% (3.0632 => 2.9432, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.20% (2.3709 => 2.2950, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.33% (2.1015 => 2.0526, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.21% (3.4757 => 3.3989) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.94% (3.1196 => 3.0591, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.90% (4.3596 => 4.2769, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.87% (4.1830 => 4.1048, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -1.71% (7.5561 => 7.4270, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.38% (5.2272 => 5.1553, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.35% (5.4397 => 5.3664, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.13% (4.4047 => 4.3550, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.07% (3.6505 => 3.6114, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 251.89% (22.4056 => 78.8427, std.dev.: 0.0647) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.27% (0.5456 => 1.1527, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.75% (0.5567 => 1.1621, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.74% (0.5581 => 1.1650, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.61% (0.5688 => 1.1866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.50% (0.5575 => 1.1624, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.41% (0.5805 => 1.1982, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.33% (0.6395 => 1.3131, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.98% (0.5849 => 1.1931, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.76% (0.6033 => 1.2293, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.48% (0.5941 => 1.2089, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.28% (0.5859 => 1.1910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.41% (0.6260 => 1.2671, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.21% (0.5478 => 1.0858, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.80% (0.6189 => 1.2242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.04% (0.5569 => 1.0973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.00% (0.5570 => 1.0973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.54% (0.6440 => 1.2657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.48% (0.5591 => 1.0985, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.78% (0.5705 => 1.1169, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.76% (0.6304 => 1.2341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.21% (0.5802 => 1.1326, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.50% (0.6395 => 1.2438, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.72% (0.6676 => 1.2866, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.51% (0.5925 => 1.1406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.37% (0.5857 => 1.1267, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.04% (0.6052 => 1.1622, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.92% (0.6660 => 1.2782, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.90% (0.5863 => 1.1251, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.85% (0.6230 => 1.1952, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.31% (0.6194 => 1.1602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.25% (0.6297 => 1.1728, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.02% (0.6446 => 1.1991, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.08% (0.6681 => 1.2165, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.12% (0.6667 => 1.2075, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.93% (0.7524 => 1.3613, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.76% (0.7339 => 1.2752, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.22% (0.0974 => 0.1580, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 46.87% (0.1500 => 0.2203, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 39.43% (1.6474 => 2.2970, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.16% (0.1132 => 0.1564, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.65% (0.0680 => 0.0936, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.16% (0.0445 => 0.0597, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.29% (2.2587 => 2.9655, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.04% (0.0699 => 0.0881, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.95% (0.0622 => 0.0771, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.81% (0.1081 => 0.1306, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.72% (0.5329 => 0.6433, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.59% (5.4682 => 6.5392, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.79% (0.7021 => 0.8270, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.77% (0.0634 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.13% (0.4916 => 0.5660, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 14.35% (1.1450 => 1.3093, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.31% (4.5069 => 5.1068, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 12.85% (0.0864 => 0.0975, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.89% (0.4515 => 0.5052, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.62% (3.5339 => 3.9447, std.dev.: 0.0147) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 11.41% (0.3357 => 0.3740, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 9.71% (0.1761 => 0.1932, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.43% (0.1441 => 0.1548, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (9.2283 => 9.8587, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 6.43% (5.0226 => 5.3458, std.dev.: 0.0130) MultiSource/Applications/Burg/burg: 6.36% (1.2515 => 1.3311, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.80% (1.2784 => 1.3526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.36% (0.3319 => 0.3497, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 4.64% (18.2933 => 19.1415, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3255 => 0.3399, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 2.57% (17.1032 => 17.5426, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 2.31% (1.3864 => 1.4184, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.3722 => 1.4029, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.37% (1.4642 => 1.4843, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.54% (31.3723 => 55.6972, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.93% (1.2783 => 1.3669, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.46% (0.9531 => 1.0147, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1932 => 3.3492, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0992, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4690, std.dev.: 0.1099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3664, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0100) MultiSource/Applications/sqlite3/sqlite3: 2.01% (4.5320 => 4.6231, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6551 => 3.7235, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8210 => 28.1734, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.32% (0.1281 => 0.1136, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.44% (0.2428 => 0.2296, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3880 => 0.3692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.70% (0.3891 => 0.3708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.69% (0.4176 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.61% (0.3142 => 0.2997, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.56% (0.7198 => 0.6870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.48% (0.4199 => 0.4011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.43% (0.3658 => 0.3496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3884 => 0.3717, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -4.25% (0.4280 => 0.4098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.17% (1.3148 => 1.2600, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (0.3025 => 0.2899, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.12% (0.3059 => 0.2933, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.10% (0.9852 => 0.9448, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.03% (2.1713 => 2.0837, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.02% (0.4151 => 0.3984, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.98% (0.4321 => 0.4149, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.92% (0.3931 => 0.3777, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.92% (0.6484 => 0.6230, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -3.91% (0.3194 => 0.3069, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.78% (0.3621 => 0.3484, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.66% (0.4427 => 0.4265, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.60% (0.7919 => 0.7634, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: -3.47% (0.6347 => 0.6127, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.46% (4.3330 => 4.1830, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists1: -3.41% (0.3867 => 0.3735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.33% (0.3788 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.32% (0.6441 => 0.6227, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -3.21% (0.7982 => 0.7726, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.18% (0.7779 => 0.7532, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.9542 => 0.9243, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.12% (0.3849 => 0.3729, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.06% (20.7746 => 20.1396, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/moments: -2.97% (0.4248 => 0.4122, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.77% (1.2221 => 1.1882, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (1.0544 => 1.0252, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -2.72% (2.4924 => 2.4245, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.67% (1.2210 => 1.1884, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (1.2300 => 1.1997, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: -2.27% (1.5610 => 1.5255, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.21% (0.8521 => 0.8333, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.21% (6.7716 => 6.6222, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9085, std.dev.: 0.0075) MultiSource/Applications/lua/lua: -2.08% (4.0594 => 3.9750, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: -2.05% (34.0927 => 33.3925, std.dev.: 0.0318) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.00% (0.5999 => 0.5879, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.98% (16.1920 => 15.8706, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -1.95% (7.0961 => 6.9580, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -1.61% (2.4021 => 2.3635, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: -1.38% (2.1401 => 2.1106, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.28% (1.8100 => 0.6828, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.05% (6.6713 => 3.3989) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.82% (1.3643 => 1.0257, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -23.38% (83.5423 => 64.0119, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7576, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -23.12% (0.0757 => 0.0582, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.74% (2.9703 => 2.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1783, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4051, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1381, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.89% (4.9100 => 4.2769, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1982, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -6.68% (1.1594 => 1.0819, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.65% (1.7753 => 1.6927, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.16% (3.1919 => 3.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0526, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.73% (3.7241 => 3.6223, std.dev.: 0.0332) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7650, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.55% (4.8776 => 4.8022, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.54% (1.6086 => 1.5839, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: -1.13% (3.7092 => 3.6673, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3550, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.02% (1.6219 => 1.6054, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 14:11:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 16:11:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130104221123.9F03D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7327?compare_to=7322&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7327, Order: 171468, Start Time: 2013-01-04 18:37:43, End Time: 2013-01-04 22:11:08 To: 7322, Order: 171450, Start Time: 2013-01-03 03:08:23, End Time: 2013-01-03 06:44:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (182 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1098 (708 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.54% (14.1892 => 14.4076, std.dev.: 0.0453) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.65% (2.4331 => 2.3929, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -1.44% (1.1644 => 1.1476, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.30% (1.1515 => 1.1365, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.94% (11.6398 => 21.1770, std.dev.: 0.0868) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.05% (0.5361 => 0.8312, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.19% (0.2969 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.81% (0.7426 => 0.9491, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.55% (0.4139 => 0.5238, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.79% (1.5932 => 2.0041, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.41% (0.0547 => 0.0686, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.31% (0.5900 => 0.7393, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.14% (0.4253 => 0.5322, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.07% (0.4994 => 0.6246, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.40% (0.5000 => 0.6220, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.01% (0.1620 => 0.2009, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.85% (0.3903 => 0.4756, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.59% (0.1462 => 0.1763, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 20.30% (0.0808 => 0.0972, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.13% (0.3890 => 0.4673, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 19.73% (0.4029 => 0.4824, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 19.20% (0.1505 => 0.1794, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.19% (4.4195 => 5.2675, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.09% (0.2866 => 0.3413, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.07% (1.3152 => 1.5660, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 18.71% (1.8794 => 2.2311, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.58% (3.5627 => 4.2248, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.53% (0.4658 => 0.5521, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.53% (0.3271 => 0.3877, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 18.43% (0.5546 => 0.6568, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.35% (0.0605 => 0.0716) SingleSource/UnitTests/ObjC++/Hello: 18.25% (0.5826 => 0.6889, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.23% (1.6211 => 1.9166, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.10% (0.1160 => 0.1370, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 17.85% (0.5889 => 0.6940, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.59% (0.4361 => 0.5128, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 17.45% (0.1421 => 0.1669, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 17.45% (0.1284 => 0.1508, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.25% (0.3930 => 0.4608, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 17.20% (0.9697 => 1.1365, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.19% (0.5026 => 0.5890, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.91% (2.7292 => 3.1906, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.87% (0.2875 => 0.3360, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.76% (4.2109 => 4.9165, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 16.70% (1.0781 => 1.2581, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.61% (0.1090 => 0.1271, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.52% (4.6926 => 5.4676, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 16.48% (0.2075 => 0.2417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.35% (1.9694 => 2.2913, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/random: 16.23% (0.2803 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.18% (0.2911 => 0.3382, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.12% (0.2792 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.10% (1.9966 => 2.3181, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 16.04% (0.2811 => 0.3262, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 16.01% (0.7171 => 0.8319, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.85% (23.5202 => 27.2481, std.dev.: 0.0404) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: 15.81% (0.9909 => 1.1476, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.75% (2.0673 => 2.3929, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3195 => 0.3697, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.20% (0.3060 => 0.3525, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.07% (0.3258 => 0.3749, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 15.01% (1.4269 => 1.6411, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.95% (0.3124 => 0.3591, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.90% (0.3282 => 0.3771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.86% (0.3317 => 0.3810, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.78% (0.3362 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.68% (0.3678 => 0.4218, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 14.64% (0.2691 => 0.3085, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: 14.63% (0.3465 => 0.3972, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3488 => 0.3998, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 14.62% (0.3496 => 0.4007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.62% (0.3469 => 0.3976, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3477 => 0.3982, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.49% (0.7875 => 0.9016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.49% (0.3348 => 0.3833, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 14.38% (4.6177 => 5.2817, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: 14.38% (2.1653 => 2.4766, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/sieve: 14.30% (0.3726 => 0.4259, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.30% (0.3845 => 0.4395, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 14.27% (0.3650 => 0.4171, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.07% (0.3724 => 0.4248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.04% (0.3981 => 0.4540, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 13.87% (0.4146 => 0.4721, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 13.81% (0.4251 => 0.4838, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.79% (2.1013 => 2.3910, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.53% (0.2040 => 0.2316, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 13.41% (0.5012 => 0.5684, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 13.39% (0.4847 => 0.5496, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.93% (0.6435 => 0.7267, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.84% (0.3084 => 0.3480, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.69% (0.3498 => 0.3942, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.49% (5.5417 => 6.2337, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (0.1383 => 0.1554, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.17% (0.2737 => 0.3070, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 12.14% (2.0346 => 2.2816, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.96% (0.1028 => 0.1151, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.79% (0.6634 => 0.7416, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 11.72% (0.3336 => 0.3727, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.2103 => 0.2338, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: 10.66% (0.2391 => 0.2646, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 10.34% (11.9555 => 13.1912, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.15% (0.5584 => 0.6095, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.20% (0.3792 => 0.3989, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.69% (29.0505 => 181.4751, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.99% (0.3693 => 0.3951, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6085, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6768, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2373, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8946, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6857, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 2.80% (0.6276 => 0.6452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2024, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2909, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3041, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0827, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5840, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4781, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/chomp: 1.00% (1.5594 => 1.5750, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5847, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.42% (17.2379 => 14.4076, std.dev.: 0.0453) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -9.20% (0.2402 => 0.2181, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9787, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8038, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2130, std.dev.: 0.0230) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8011, std.dev.: 0.0132) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1607, std.dev.: 0.0489) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.03% (0.6293 => 0.6165, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5813, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2358, std.dev.: 0.0408) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 15:51:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 17:51:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130104235106.E53E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7328?compare_to=7326&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7328, Order: 171535, Start Time: 2013-01-04 22:12:40, End Time: 2013-01-04 23:50:52 To: 7326, Order: 171497, Start Time: 2013-01-04 20:11:00, End Time: 2013-01-04 21:49:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (808 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.36% (80.0685 => 81.1582, std.dev.: 0.2406) SingleSource/Benchmarks/McGill/chomp: 1.27% (1.0819 => 1.0956, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 253.23% (22.4056 => 79.1440, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.14% (0.5456 => 1.1520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.78% (0.5567 => 1.1623, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.58% (0.5688 => 1.1864, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.57% (0.5575 => 1.1628, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.48% (0.5581 => 1.1635, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.58% (0.5805 => 1.1992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.35% (0.6395 => 1.3132, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.02% (0.5849 => 1.1933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.51% (0.6033 => 1.2278, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.48% (0.5941 => 1.2089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.45% (0.5859 => 1.1920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.56% (0.6260 => 1.2680, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.47% (0.5478 => 1.0872, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.93% (0.6189 => 1.2250, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.20% (0.5569 => 1.0982, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.97% (0.5570 => 1.0971, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.73% (0.5591 => 1.0999, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.63% (0.6440 => 1.2663, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.16% (0.5705 => 1.1191, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.84% (0.6304 => 1.2346, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.57% (0.5802 => 1.1347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.93% (0.6395 => 1.2466, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.81% (0.5925 => 1.1424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.69% (0.5857 => 1.1286, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.54% (0.6676 => 1.2854, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.22% (0.6052 => 1.1633, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.14% (0.5863 => 1.1265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.95% (0.6660 => 1.2784, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.85% (0.6230 => 1.1952, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.34% (0.6194 => 1.1604, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.25% (0.6297 => 1.1728, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.15% (0.6446 => 1.1999, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.38% (0.6681 => 1.2185, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.31% (0.6667 => 1.2088, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.10% (0.7524 => 1.3626, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 76.99% (0.0717 => 0.1269, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.11% (0.7339 => 1.2778, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 64.27% (0.0974 => 0.1600, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.06% (0.0514 => 0.0833, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 55.56% (0.0315 => 0.0490, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 47.40% (0.1500 => 0.2211) SingleSource/Regression/C/sumarray2d: 46.08% (0.0293 => 0.0428) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.91% (0.0599 => 0.0862, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 39.84% (1.6474 => 2.3037, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.88% (0.0445 => 0.0618, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.43% (0.1132 => 0.1567, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.94% (0.0680 => 0.0938, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.65% (2.2587 => 2.9735, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.73% (0.0582 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.18% (0.0699 => 0.0903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 27.33% (0.0622 => 0.0792, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 26.41% (0.0621 => 0.0785, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.00% (0.1081 => 0.1308, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.96% (0.5329 => 0.6446, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.19% (5.4682 => 6.5721, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.37% (0.0566 => 0.0670, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.7021 => 0.8288, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 15.51% (0.0864 => 0.0998, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.44% (0.4916 => 0.5675, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 14.89% (1.1450 => 1.3155, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.33% (4.5069 => 5.1077, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 12.25% (0.4515 => 0.5068, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.99% (3.5339 => 3.9575, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 11.86% (0.3357 => 0.3755, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.69% (0.2001 => 0.2235, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.40% (1.6364 => 1.8230, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 11.36% (0.1761 => 0.1961, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 7.41% (9.2283 => 9.9117, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.22% (0.1441 => 0.1545, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 6.96% (5.0226 => 5.3723, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.66% (1.2515 => 1.3349, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 6.55% (0.1879 => 0.2002, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.97% (1.2784 => 1.3547, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.97% (0.3319 => 0.3517, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 5.23% (18.2933 => 19.2497, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 3.09% (17.1032 => 17.6310, std.dev.: 0.0256) MultiSource/Applications/SIBsim4/SIBsim4: 2.60% (1.3864 => 1.4224, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.47% (1.3722 => 1.4061, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.63% (1.4642 => 1.4880, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.51% (31.3723 => 55.6897, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.23% (0.9531 => 1.0220, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 4.25% (3.1932 => 3.3290, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0990, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4530, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3677, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.22% (2.0478 => 2.1138, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (3.6551 => 3.7331, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.90% (4.5320 => 4.6183, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (79.7170 => 81.1582, std.dev.: 0.2406) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8210 => 28.1739, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.76% (0.1281 => 0.1156, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.61% (0.3194 => 0.2983, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.61% (0.3057 => 0.2916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.57% (0.3831 => 0.3656, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.48% (0.3880 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.44% (0.3848 => 0.3677, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.41% (0.3896 => 0.3724, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.32% (0.3891 => 0.3723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.31% (0.3252 => 0.3112, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.30% (2.1713 => 2.0780, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4033 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.4176 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3821 => 0.3662, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.12% (1.3148 => 1.2606, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.05% (0.2989 => 0.2868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.96% (0.4321 => 0.4150, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.91% (0.3884 => 0.3732, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.91% (0.3658 => 0.3515, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.4151 => 0.3989, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.81% (0.3016 => 0.2901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.81% (0.3621 => 0.3483, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.81% (0.6484 => 0.6237, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: -3.79% (0.4280 => 0.4118, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.77% (0.9852 => 0.9481, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (0.3025 => 0.2913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.68% (0.2933 => 0.2825, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.55% (0.4427 => 0.4270, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.43% (0.3849 => 0.3717, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.39% (0.3867 => 0.3736, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.38% (0.7919 => 0.7651, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: -3.32% (0.4248 => 0.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3788 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.28% (0.4083 => 0.3949, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -3.22% (20.7746 => 20.1052, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.09% (0.9542 => 0.9247, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.96% (4.3330 => 4.2046, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference-object: -2.89% (0.6441 => 0.6255, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -2.84% (2.4924 => 2.4216, std.dev.: 0.0165) SingleSource/UnitTests/ObjC++/property-reference: -2.78% (0.7779 => 0.7563, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (0.7982 => 0.7778, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.44% (1.0544 => 1.0287, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.36% (1.2221 => 1.1932, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.34% (1.2210 => 1.1924, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.26% (0.8521 => 0.8328, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.24% (6.7716 => 6.6202, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.19% (1.2300 => 1.2031, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.18% (0.5999 => 0.5868, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -2.09% (1.5610 => 1.5283, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -1.91% (4.0594 => 3.9819, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.84% (14.2083 => 13.9467, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -1.76% (34.0927 => 33.4936, std.dev.: 0.0211) MultiSource/Applications/JM/lencod/lencod: -1.75% (16.1920 => 15.9094, std.dev.: 0.0168) MultiSource/Applications/JM/ldecod/ldecod: -1.58% (7.0961 => 6.9838, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.82% (1.8100 => 0.6911, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.05% (6.6713 => 3.3988, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.57% (4.3504 => 3.3251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0185, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.73% (2.9703 => 2.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.55% (4.1024 => 3.1773, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4055, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.81% (2.5106 => 2.1387, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.88% (4.9100 => 4.2775, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1987, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7824, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.50% (1.1594 => 1.0956, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.67% (1.7753 => 1.6924, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3830 => 5.1550, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0593, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3982, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0523, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.57% (7.9763 => 7.7711, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.50% (1.3096 => 1.2769, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6406, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.09% (1.6086 => 1.5750, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8085, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -1.10% (1.4516 => 1.4357, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 18:42:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 20:42:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105024243.816A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7329?compare_to=7328&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7329, Order: 171572, Start Time: 2013-01-05 01:03:56, End Time: 2013-01-05 02:42:36 To: 7328, Order: 171535, Start Time: 2013-01-04 22:12:40, End Time: 2013-01-04 23:50:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 8 (109 on baseline) Performance Improvements: 2 (125 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1092 (810 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.68% (0.3923 => 0.4656, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.91% (79.1440 => 81.4496, std.dev.: 0.0500) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.07% (6.5721 => 6.7082, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (0.8328 => 0.8461, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.4216 => 2.4529, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: 65.83% (2.9430 => 4.8803, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.18% (2.2952 => 2.4141, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.87% (3.7541 => 3.8617, std.dev.: 0.0393) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.92% (2.3037 => 2.2365, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.18% (81.1582 => 80.2015, std.dev.: 0.2776) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 263.52% (22.4056 => 81.4496, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 113.03% (0.5456 => 1.1623, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.97% (0.5567 => 1.1689, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 109.69% (0.5581 => 1.1703, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.58% (0.5688 => 1.1921, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.42% (0.5575 => 1.1675, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 108.22% (0.5805 => 1.2087, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.02% (0.6395 => 1.3175, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 105.47% (0.5941 => 1.2207, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 105.21% (0.5849 => 1.2003, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.76% (0.5859 => 1.1997, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.08% (0.6033 => 1.2312, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.48% (0.6260 => 1.2738, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.63% (0.5478 => 1.0936, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 99.34% (0.6189 => 1.2337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.31% (0.5569 => 1.1044, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 98.22% (0.5570 => 1.1041, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.36% (0.6440 => 1.2710, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.30% (0.5591 => 1.1031, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 97.07% (0.6304 => 1.2423, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.63% (0.5705 => 1.1218, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 96.23% (0.5802 => 1.1385, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.47% (0.6395 => 1.2500, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.81% (0.6676 => 1.2939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.60% (0.5925 => 1.1471, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.47% (0.5863 => 1.1343, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.39% (0.5857 => 1.1327, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 93.13% (0.6052 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.02% (0.6230 => 1.2025, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 92.21% (0.6660 => 1.2801, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.13% (0.6194 => 1.1653, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.42% (0.6446 => 1.2081, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 87.22% (0.6297 => 1.1789, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 83.36% (0.6681 => 1.2250, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 83.07% (0.6667 => 1.2205, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.78% (0.7524 => 1.3677, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.03% (0.0717 => 0.1255, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.89% (0.7339 => 1.2835, std.dev.: 0.0016) SingleSource/Regression/C/sumarraymalloc: 67.42% (0.0267 => 0.0447, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 64.48% (0.0974 => 0.1602, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 47.53% (0.1500 => 0.2213, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 46.08% (0.0293 => 0.0428, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.41% (0.0599 => 0.0865, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.78% (0.1132 => 0.1571, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.65% (0.0445 => 0.0617, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.24% (0.0680 => 0.0940, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.22% (0.0693 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.76% (1.6474 => 2.2365, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.47% (2.2587 => 2.9921, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.41% (0.0582 => 0.0759, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 27.81% (0.0622 => 0.0795, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.67% (0.0621 => 0.0768, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.68% (5.4682 => 6.7082, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.73% (0.5329 => 0.6487, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 21.44% (0.3834 => 0.4656, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.09% (0.1081 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.08% (0.0566 => 0.0674, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.69% (0.7021 => 0.8333, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.58% (0.4916 => 0.5682, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 15.05% (0.0864 => 0.0994, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3152, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.77% (4.5069 => 5.1276, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 12.56% (0.4515 => 0.5082, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 12.09% (0.3357 => 0.3763, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.05% (3.5339 => 3.9596, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.94% (0.2001 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.75% (1.6364 => 1.8286, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 11.30% (0.1761 => 0.1960, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.68% (0.1731 => 0.1864, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.35% (1.2515 => 1.3435, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 7.34% (9.2283 => 9.9054, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 7.17% (5.0226 => 5.3826, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/ReedSolomon: 6.65% (0.1879 => 0.2004, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.2784 => 1.3609, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3319 => 0.3521, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 6.01% (18.2933 => 19.3932, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/matrix: 4.70% (0.3255 => 0.3408, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 3.47% (17.1032 => 17.6960, std.dev.: 0.0280) MultiSource/Applications/SIBsim4/SIBsim4: 3.04% (1.3864 => 1.4285, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.51% (1.3722 => 1.4066, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6750 => 0.6887, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.9557 => 0.9732, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.75% (1.4642 => 1.4898, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 1.34% (0.8418 => 0.8531, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 1.29% (15.5079 => 15.7077, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.76% (31.3723 => 55.7680, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.58% (0.9531 => 1.0253, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.63% (3.1932 => 3.3409, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5525, std.dev.: 0.0280) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0983, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.28% (5.1955 => 5.3659, std.dev.: 0.0057) MultiSource/Benchmarks/llubenchmark/llu: 3.16% (3.7435 => 3.8617, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6551 => 3.7244, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6049, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8210 => 28.1734, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.09% (0.1281 => 0.1139, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.36% (0.3194 => 0.2991, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.66% (0.3821 => 0.3643, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.7198 => 0.6874, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.42% (0.3142 => 0.3003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.42% (0.2871 => 0.2744, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.24% (0.2903 => 0.2780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.09% (0.3252 => 0.3119, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.95% (2.1713 => 2.0856, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3831 => 0.3681, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3812 => 0.3663) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.82% (0.3848 => 0.3701, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.79% (0.9852 => 0.9479, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.75% (0.3891 => 0.3745, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.74% (1.3148 => 1.2656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.72% (0.3896 => 0.3751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.66% (0.4176 => 0.4023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.59% (0.3931 => 0.3790, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.58% (0.3016 => 0.2908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.57% (0.4033 => 0.3889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.55% (0.3658 => 0.3528, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.40% (0.4151 => 0.4010, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.38% (0.6484 => 0.6265, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.33% (0.4199 => 0.4059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (0.3025 => 0.2925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.20% (0.3621 => 0.3505, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.18% (0.4280 => 0.4144, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.17% (20.7746 => 20.1163, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.95% (0.7919 => 0.7685, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -2.87% (0.4248 => 0.4126, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.86% (0.3849 => 0.3739, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.85% (0.4321 => 0.4198, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.9542 => 0.9271, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.59% (0.6441 => 0.6274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.55% (0.7779 => 0.7581, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -2.49% (4.3330 => 4.2249, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.31% (1.0544 => 1.0300, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -2.18% (0.7982 => 0.7808, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.16% (6.7716 => 6.6254, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.15% (1.2221 => 1.1958, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.97% (1.2210 => 1.1970, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (1.2300 => 1.2063, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.92% (14.2083 => 13.9361, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: -1.58% (2.4924 => 2.4529, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -1.54% (4.0594 => 3.9969, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -1.51% (16.1920 => 15.9476, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: -1.44% (7.0961 => 6.9940, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: -1.36% (1.5610 => 1.5397, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.20% (34.0927 => 33.6828, std.dev.: 0.0383) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.51% (1.8100 => 0.6785, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3108, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.30% (1.3643 => 1.0192, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.38% (83.5423 => 64.0132, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.20% (5.3397 => 4.1010, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1781, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4051, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -18.73% (2.9703 => 2.4141, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0079) SingleSource/UnitTests/Vector/multiplies: -14.88% (2.5106 => 2.1370, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2800, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1988, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.42% (0.5142 => 0.4606, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7822, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8720, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.20% (1.1594 => 1.0991, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.68% (1.7753 => 1.6923, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3830 => 5.1550, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (7.9763 => 7.7566, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/ary3: -2.32% (3.7241 => 3.6378, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.95% (1.6086 => 1.5772, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4752, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8048, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6219 => 1.5982, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.01% (1.4516 => 1.4369, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 20:44:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 4 Jan 2013 22:44:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105044432.5406D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7330?compare_to=7329&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7330, Order: 171590, Start Time: 2013-01-05 03:05:54, End Time: 2013-01-05 04:44:25 To: 7329, Order: 171572, Start Time: 2013-01-05 01:03:56, End Time: 2013-01-05 02:42:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 6 (109 on baseline) Performance Improvements: 3 (120 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1093 (815 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.56% (81.4496 => 86.7927, std.dev.: 0.1346) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.58% (2.2365 => 2.3165, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.07% (6.7082 => 6.8470, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: 1.57% (20.1163 => 20.4314, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.58% (0.6785 => 0.6960, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: 1.63% (1.0192 => 1.0358, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -7.40% (4.8803 => 4.5193, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.93% (2.4141 => 2.2950, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.02% (29.7700 => 29.4649, std.dev.: 0.0937) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 287.37% (22.4056 => 86.7927, std.dev.: 0.1346) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.19% (0.5456 => 1.1577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.41% (0.5567 => 1.1658, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.17% (0.5575 => 1.1661, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 109.16% (0.5581 => 1.1673, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.65% (0.5688 => 1.1868, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.32% (0.5805 => 1.2035, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.50% (0.6395 => 1.3142, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.65% (0.5849 => 1.1970, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.56% (0.5941 => 1.2153, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.20% (0.5859 => 1.1964, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.65% (0.6033 => 1.2286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.07% (0.6260 => 1.2712, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.01% (0.5478 => 1.0902, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.80% (0.6189 => 1.2304, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.85% (0.5569 => 1.1018, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.52% (0.5570 => 1.1002, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.85% (0.6440 => 1.2677, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.82% (0.5591 => 1.1004, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.30% (0.6304 => 1.2375, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.88% (0.5705 => 1.1175, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.57% (0.5802 => 1.1347, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.86% (0.6395 => 1.2461, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.29% (0.6676 => 1.2904, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.08% (0.5925 => 1.1440, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.91% (0.5857 => 1.1299, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.70% (0.5863 => 1.1298, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.58% (0.6052 => 1.1655, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.47% (0.6230 => 1.1991, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.53% (0.6660 => 1.2756, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.52% (0.6194 => 1.1615, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.63% (0.6297 => 1.1752, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.43% (0.6446 => 1.2017, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.59% (0.6681 => 1.2199, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.33% (0.6667 => 1.2156, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.38% (0.7524 => 1.3647, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.17% (0.7339 => 1.2782, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 67.42% (0.0267 => 0.0447) SingleSource/Benchmarks/CoyoteBench/lpbench: 64.07% (0.0974 => 0.1598, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.06% (0.0514 => 0.0833, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.91% (0.0599 => 0.0862, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.62% (1.6474 => 2.3165, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.88% (0.0445 => 0.0618, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.52% (0.1132 => 0.1568, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.94% (0.0680 => 0.0938, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.93% (0.0693 => 0.0942, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.52% (2.2587 => 2.9932, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.90% (0.0582 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.18% (0.0699 => 0.0903, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 25.21% (5.4682 => 6.8470, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.44% (0.0622 => 0.0774, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.51% (0.0621 => 0.0767, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.56% (0.5329 => 0.6478, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.81% (0.1081 => 0.1306) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.67% (0.7021 => 0.8332, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.44% (0.4916 => 0.5675, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 15.28% (0.0864 => 0.0996, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.88% (1.1450 => 1.3154, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.59% (4.5069 => 5.1192, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.20% (3.5339 => 3.9649, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 11.89% (0.3357 => 0.3756, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.49% (0.2001 => 0.2231, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.46% (1.6364 => 1.8239, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.78% (0.2385 => 0.2642, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 10.68% (0.1761 => 0.1949, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.05% (0.1441 => 0.1557, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 7.30% (5.0226 => 5.3891, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 7.08% (1.2515 => 1.3401, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 7.04% (9.2283 => 9.8779, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 6.53% (18.2933 => 19.4886, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.1879 => 0.2000, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.38% (1.2784 => 1.3599, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.06% (0.3319 => 0.3520, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.3255 => 0.3429, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 4.08% (17.1032 => 17.8010, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary: 3.03% (0.3394 => 0.3497, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.3864 => 1.4261, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.76% (0.4524 => 0.4649, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.44% (0.6750 => 0.6915, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.3722 => 1.4053, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.16% (0.4813 => 0.4917, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.9557 => 0.9753, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.55% (1.4642 => 1.4869, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 1.31% (15.5079 => 15.7105, std.dev.: 0.0149) MultiSource/Applications/spiff/spiff: 1.21% (0.8418 => 0.8520, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6773, std.dev.: 0.0186) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.65% (0.9531 => 1.0260, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.69% (3.1932 => 3.3430, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0997, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.33% (2.0478 => 2.1159, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.01% (54.5751 => 56.2162, std.dev.: 0.2039) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.5320 => 4.6215, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6551 => 3.7242, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8210 => 28.1746, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.24% (0.1281 => 0.1137, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.2428 => 0.2308, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.77% (0.3896 => 0.3710, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.66% (0.3821 => 0.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.65% (0.3891 => 0.3710, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.4176 => 0.3985, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.4033 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.29% (0.4199 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.28% (0.7198 => 0.6890, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3884 => 0.3718, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4280 => 0.4109, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.80% (0.9852 => 0.9478, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.79% (0.3059 => 0.2943, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.69% (0.3658 => 0.3523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.65% (0.2903 => 0.2797, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.57% (0.3252 => 0.3136, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.54% (1.3148 => 1.2683, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.45% (2.1713 => 2.0963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: -3.43% (0.3205 => 0.3095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (0.3025 => 0.2925, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -3.21% (0.6347 => 0.6143, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.07% (0.6441 => 0.6243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.03% (0.7919 => 0.7679, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.00% (0.3931 => 0.3813, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.99% (0.4321 => 0.4192, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.96% (0.4151 => 0.4028, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.9542 => 0.9266, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -2.88% (0.7779 => 0.7555, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -2.85% (4.3330 => 4.2096, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -2.36% (0.7982 => 0.7794, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.25% (1.0544 => 1.0307, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.18% (6.7716 => 6.6238, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (1.2210 => 1.1963, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.00% (1.2221 => 1.1976, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.93% (1.2300 => 1.2062, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.74% (14.2083 => 13.9615, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: -1.68% (2.4924 => 2.4505, std.dev.: 0.0131) SingleSource/UnitTests/Vector/constpool: -1.65% (20.7746 => 20.4314, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.65% (7.0961 => 6.9790, std.dev.: 0.0176) MultiSource/Applications/JM/lencod/lencod: -1.64% (16.1920 => 15.9272, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -1.56% (4.0594 => 3.9960, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.23% (0.8521 => 0.8416, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.15% (34.0927 => 33.7000, std.dev.: 0.0324) MultiSource/Applications/hbd/hbd: -1.03% (1.5610 => 1.5449, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.55% (1.8100 => 0.6960, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3105, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.08% (1.3643 => 1.0358, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: -23.38% (83.5423 => 64.0135, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: -23.12% (0.0757 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.74% (2.9703 => 2.2950, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1783, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4047, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.82% (2.5106 => 2.1386, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.83% (1.0217 => 0.8804, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.89% (4.9100 => 4.2771, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7823, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.81% (4.1534 => 3.8707, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.24% (1.1594 => 1.0987, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.66% (1.7753 => 1.6926, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7653, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: -2.04% (3.7241 => 3.6480, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.03% (1.6086 => 1.5760, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.60% (1.3096 => 1.2887, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.8776 => 4.8006, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4759, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7092 => 3.6657, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4351, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3551, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 22:34:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 00:34:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105063423.CD7332A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7331?compare_to=7325&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7331, Order: 171595, Start Time: 2013-01-05 04:17:33, End Time: 2013-01-05 06:34:16 To: 7325, Order: 171468, Start Time: 2013-01-04 18:17:07, End Time: 2013-01-04 20:31:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 75 (218 on baseline) Performance Improvements: 30 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 993 (605 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 121.44% (0.6759 => 1.4967, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 119.60% (0.6898 => 1.5148, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 118.97% (0.6899 => 1.5107, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 118.40% (0.6925 => 1.5124, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 115.87% (0.7194 => 1.5530, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 114.31% (0.7240 => 1.5516, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 113.46% (0.7280 => 1.5540, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 113.39% (0.7289 => 1.5554, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 111.52% (0.7545 => 1.5959, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 109.10% (0.7485 => 1.5651, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 108.68% (0.7605 => 1.5870, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 107.35% (0.7715 => 1.5997, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 104.80% (0.7986 => 1.6355, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 103.11% (0.8029 => 1.6308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 102.55% (0.8326 => 1.6864, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 101.12% (0.8190 => 1.6472, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 98.76% (0.8389 => 1.6674, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.74% (0.6682 => 1.3280, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.78% (0.6810 => 1.3401, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.41% (0.6847 => 1.3448, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.32% (0.6824 => 1.3397, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 94.03% (0.7106 => 1.3788, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.94% (0.7148 => 1.3791, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 92.60% (0.7189 => 1.3846, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.48% (0.7226 => 1.3836, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 90.81% (0.9153 => 1.7465, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 90.29% (0.7457 => 1.4190, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 90.17% (0.7384 => 1.4042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.15% (0.7518 => 1.4145, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.79% (0.7633 => 1.4258, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 85.97% (0.7843 => 1.4586, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 83.45% (0.7958 => 1.4599, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 83.42% (0.8239 => 1.5112, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.79% (0.8132 => 1.4783, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.75% (0.8186 => 1.4878, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 75.07% (0.8857 => 1.5506, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.03% (0.0902 => 0.1236, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 16.58% (0.0603 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 14.55% (0.0969 => 0.1110, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.43% (0.1318 => 0.1495, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.97% (0.6691 => 0.7559, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/chomp: 12.27% (0.1989 => 0.2233, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 11.78% (0.1307 => 0.1461, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.37% (3.1105 => 3.4332, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.25% (2.4116 => 2.6588, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.87% (94.9320 => 104.3040, std.dev.: 0.0429) MultiSource/Benchmarks/FreeBench/neural/neural: 9.04% (0.2333 => 0.2544, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 8.36% (0.3458 => 0.3747, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.96% (0.1634 => 0.1764, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.66% (0.8880 => 0.9471, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.05% (0.2364 => 0.2507, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.58% (5.5292 => 5.8377, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.34% (0.2844 => 0.2996, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.06% (0.6032 => 0.6337, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 4.15% (0.4074 => 0.4243, std.dev.: 0.0010) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.94% (0.6093 => 0.6333, std.dev.: 0.0006) SingleSource/Benchmarks/Linpack/linpack-pc: 3.92% (0.3109 => 0.3231, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (7.7673 => 8.0325, std.dev.: 0.0105) MultiSource/Applications/oggenc/oggenc: 3.18% (7.0733 => 7.2980, std.dev.: 0.0150) MultiSource/Benchmarks/PAQ8p/paq8p: 2.93% (10.9478 => 11.2688, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.30% (0.5433 => 0.5558, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.24% (4.8562 => 4.9652, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.95% (1.4814 => 1.5103, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 1.70% (21.8101 => 22.1812, std.dev.: 0.0624) MultiSource/Applications/minisat/minisat: 1.59% (0.8608 => 0.8745, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.56% (10.1769 => 10.3353, std.dev.: 0.0498) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.16% (1.5781 => 1.5964, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 1.13% (54.7795 => 55.3994, std.dev.: 0.0262) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: 45.89% (3.1398 => 4.5805, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 32.20% (4.0161 => 5.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: 15.01% (1.0133 => 1.1654) SingleSource/Benchmarks/Linpack/linpack-pc: 9.48% (71.2313 => 77.9864, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.77% (3.2366 => 3.3263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.20% (4.1057 => 4.1962, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.57% (3.7163 => 3.7745, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/IntMM: -17.80% (0.0590 => 0.0485, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -13.42% (0.2392 => 0.2071, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -7.95% (0.5911 => 0.5441, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -7.89% (0.5527 => 0.5091, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: -4.21% (0.8046 => 0.7707, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.14% (0.3986 => 0.3821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -3.40% (0.3349 => 0.3235, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -3.40% (0.4002 => 0.3866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -3.38% (0.3909 => 0.3777, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (1.2067 => 1.1845, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.17% (1.6457 => 1.6264, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -22.02% (3.5338 => 2.7557, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -16.22% (0.6004 => 0.5030, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -10.86% (0.3822 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -4.92% (2.7238 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.97% (1.0002 => 0.9605, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.38% (3.2055 => 3.0970, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.21% (2.3708 => 2.2947, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.90% (3.1509 => 3.0595, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.59% (4.4266 => 4.3121, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.39% (2.1020 => 2.0517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.14% (3.4794 => 3.4048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.91% (4.4054 => 4.3213, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.88% (4.1835 => 4.1048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.41% (5.2273 => 5.1537, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (2.3095 => 2.2782, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.29% (1.0280 => 1.0147, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.25% (5.8496 => 5.7766, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: -1.17% (4.5273 => 4.4745, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.6975 => 3.6562, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1339 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.32% (0.0663 => 0.0685, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8415 => 499.8409, std.dev.: 0.0117) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44223.92% (1.1277 => 499.8409, std.dev.: 0.0117) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.71% (0.5229 => 1.6561, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 20.98% (14.9895 => 18.1344, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 56.70% (14.1553 => 22.1812, std.dev.: 0.0624) MultiSource/Benchmarks/MallocBench/gs/gs: 17.54% (4.1105 => 4.8314, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.52% (1.1048 => 1.7513, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1357.13% (7.1582 => 104.3040, std.dev.: 0.0429) SingleSource/Benchmarks/Misc-C++-EH/spirit: 131.96% (3.4629 => 8.0325, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.45% (0.6222 => 1.0979, std.dev.: 0.0053) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10268.33% (0.0720 => 7.4652, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3832100.00% (0.0001 => 3.8322, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11128100.00% (0.0001 => 11.1282, std.dev.: 0.0611) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66400.00% (0.0001 => 0.0665, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908600.00% (0.0001 => 9.9087, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486500.00% (0.0001 => 5.4866, std.dev.: 0.0289) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.29% (1.1194 => 10.3353, std.dev.: 0.0498) MultiSource/Applications/ClamAV/clamscan: 149.82% (22.1758 => 55.3994, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/lowercase: 123.44% (0.0256 => 0.0572, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.08% (0.0929 => 0.1803, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 80.74% (0.0296 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.89% (0.1463 => 0.2544, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 67.65% (1.5859 => 2.6588, std.dev.: 0.0049) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.14% (0.0439 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.05% (2.9384 => 4.6147, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 55.88% (2.2024 => 3.4332, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.35% (7.0540 => 10.9581, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.07% (0.5105 => 0.7559, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.02% (8.1363 => 11.9623, std.dev.: 0.0147) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.89% (0.6675 => 0.9471, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 41.46% (21.9371 => 31.0326, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/flops: 39.11% (0.1432 => 0.1992, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.31% (0.4615 => 0.6337, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.89% (4.2646 => 5.8377, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 36.47% (0.3109 => 0.4243, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 35.63% (0.0814 => 0.1104, std.dev.: 0.0001) SingleSource/UnitTests/vla: 35.49% (0.0355 => 0.0481, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 34.92% (0.1655 => 0.2233, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.45% (1.5415 => 2.0572, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.94% (0.1337 => 0.1764, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.92% (0.2271 => 0.2996, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.53% (0.1906 => 0.2507, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 30.77% (0.4299 => 0.5622, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 29.73% (1.1642 => 1.5103, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.23% (0.0479 => 0.0619, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.57% (3.8922 => 4.9652, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.15% (0.1584 => 0.2014, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 26.72% (5.7591 => 7.2980, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.72% (0.0408 => 0.0517, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.37% (0.3121 => 0.3944, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 25.88% (1.0722 => 1.3497, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 25.28% (0.1175 => 0.1472, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 25.02% (0.2554 => 0.3193, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.21% (0.0793 => 0.0985, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.19% (0.1695 => 0.2105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.98% (1.4186 => 1.7588, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 23.56% (9.4845 => 11.7191, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 22.91% (0.7115 => 0.8745, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.33% (1.3050 => 1.5964, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.19% (0.1032 => 0.1261, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.13% (0.1143 => 0.1396, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.2700 => 0.3290, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.68% (0.0672 => 0.0811, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.45% (0.7835 => 0.9437, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.36% (4.9449 => 5.9519, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout/lists: 20.29% (0.0626 => 0.0753, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 20.08% (1.1840 => 1.4218, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.89% (0.4636 => 0.5558, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.82% (0.1236 => 0.1481, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.73% (0.0730 => 0.0874, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 19.72% (17.1811 => 20.5696, std.dev.: 0.0264) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.57% (5.0018 => 5.9807, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.41% (0.0675 => 0.0806, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 19.38% (0.6456 => 0.7707, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.36% (0.0842 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.32% (0.5860 => 0.6992, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 19.32% (3.3354 => 3.9797, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.05% (0.1029 => 0.1225, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 18.92% (0.1163 => 0.1383, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.86% (0.8172 => 0.9713, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/em3d/em3d: 18.82% (0.1695 => 0.2014, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.0953 => 0.1132, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 18.70% (0.4289 => 0.5091, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 18.42% (0.1151 => 0.1363, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 18.24% (0.0614 => 0.0726, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.20% (0.1940 => 0.2293, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 18.01% (0.7433 => 0.8772, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.93% (0.3307 => 0.3900, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.91% (0.5020 => 0.5919, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 17.84% (2.2969 => 2.7067, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0886 => 0.1044, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 17.77% (0.4620 => 0.5441, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.67% (0.5569 => 0.6553, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.40% (0.2758 => 0.3238, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: 17.37% (0.2049 => 0.2405, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.17% (0.9765 => 1.1442, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 17.14% (3.8723 => 4.5359, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.99% (0.2107 => 0.2465, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 16.97% (0.3423 => 0.4004, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 16.96% (0.1268 => 0.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 16.86% (0.3232 => 0.3777, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 16.82% (2.0273 => 2.3683, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.59% (0.0838 => 0.0977, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 16.46% (0.8921 => 1.0389, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 16.39% (0.3283 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.35% (0.5981 => 0.6959, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.08% (0.8101 => 0.9404, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.07% (0.3441 => 0.3994, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0082) SingleSource/UnitTests/SignlessTypes/rem: 15.73% (0.1144 => 0.1324) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.50% (0.6450 => 0.7450, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.43% (0.0933 => 0.1077, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.04% (0.1044 => 0.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.02% (1.1861 => 1.3643, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 14.43% (0.3180 => 0.3639, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3379 => 0.3866, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.28% (0.8067 => 0.9219, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.66% (1.5603 => 1.7735, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 13.58% (0.3387 => 0.3847, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.44% (0.0759 => 0.0861, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.99% (0.3865 => 0.4367, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.41% (0.1330 => 0.1495, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.14% (0.4103 => 0.4601, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.94% (0.4203 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.67% (14.3668 => 16.0441, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.27% (0.3603 => 0.4009, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.21% (0.3427 => 0.3811, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.18% (0.3282 => 0.3649, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.16% (0.3422 => 0.3804, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.13% (0.3092 => 0.3436, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.82% (0.2430 => 0.2693, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 10.80% (0.3684 => 0.4082, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.80% (0.3694 => 0.4056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3473 => 0.3810, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.65% (0.2871 => 0.3148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3497 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.46% (0.1892 => 0.2071, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.44% (0.6030 => 0.6599, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 9.26% (0.2905 => 0.3174, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.10% (2.0665 => 2.2545, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7326 => 0.7984, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2756 => 0.2998, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 8.70% (10.3673 => 11.2688, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.68% (0.3650 => 0.3967, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 8.67% (63.2438 => 68.7254, std.dev.: 0.0641) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3951, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.55% (0.2877 => 0.3123, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: 8.55% (0.2725 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.22% (0.3052 => 0.3303, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.90% (0.3935 => 0.4246, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.89% (0.2802 => 0.3023, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.83% (2.2022 => 2.3746, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.59% (0.3136 => 0.3374, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.32% (0.3131 => 0.3235, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1561, std.dev.: 0.0117) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2403, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3292, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4575, std.dev.: 0.0041) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (3.1578 => 3.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (3.6395 => 3.7745, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.68% (2.0360 => 2.1109, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9099, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.30% (1.0313 => 1.0550, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 2.12% (0.8333 => 0.8510, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (0.9957 => 1.0147, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.69% (1.7254 => 1.7545, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.48% (1.0785 => 1.0945, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1629, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2142, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0205) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.55% (5.2763 => 1.1845, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (5.3855 => 4.4711, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.46% (5.3526 => 4.4718, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -12.96% (10.4361 => 9.0839, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 50.0024, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.64% (1.7609 => 1.6264, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.45% (1.9577 => 0.6372, std.dev.: 0.0183) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.37% (1.5373 => 1.0243, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4257, std.dev.: 0.0196) MultiSource/Benchmarks/PAQ8p/paq8p: -24.98% (85.0658 => 63.8187, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0062, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2258 => 0.9605, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.54% (2.5528 => 2.1306, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.38% (1.2373 => 1.0965, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4947, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.26% (0.9540 => 0.8657, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2718, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4757, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.65% (1.6805 => 1.5855, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.46% (1.5835 => 1.5128, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8336, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.05% (8.1563 => 7.8262, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -2.15% (1.0554 => 1.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6562, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.25% (3.6994 => 3.6533, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2314, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0156) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0019) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 4 22:49:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 00:49:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105064931.471632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7332?compare_to=7330&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7332, Order: 171597, Start Time: 2013-01-05 05:11:05, End Time: 2013-01-05 06:49:24 To: 7330, Order: 171590, Start Time: 2013-01-05 03:05:54, End Time: 2013-01-05 04:44:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 1 (110 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (823 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -1.34% (1.0358 => 1.0219, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 288.14% (22.4056 => 86.9657, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.90% (0.5456 => 1.1561, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.22% (0.5567 => 1.1647, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 109.03% (0.5581 => 1.1666, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.75% (0.5575 => 1.1638, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.37% (0.5688 => 1.1852, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.10% (0.5805 => 1.2022, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.54% (0.6395 => 1.3144, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.48% (0.5941 => 1.2148, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.24% (0.5849 => 1.1946, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.11% (0.5859 => 1.1959, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.43% (0.6033 => 1.2273, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.76% (0.6260 => 1.2693, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.92% (0.5478 => 1.0897, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.56% (0.6189 => 1.2289, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.50% (0.5569 => 1.0999, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.29% (0.5570 => 1.0989, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.57% (0.6304 => 1.2392, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.48% (0.6440 => 1.2653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.46% (0.5591 => 1.0984, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.86% (0.5705 => 1.1174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.73% (0.5802 => 1.1356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.90% (0.6395 => 1.2464, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.38% (0.6676 => 1.2910, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.66% (0.5925 => 1.1415, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.54% (0.5857 => 1.1277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.51% (0.5863 => 1.1287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.37% (0.6052 => 1.1642, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.26% (0.6230 => 1.1978, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.52% (0.6660 => 1.2755, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.50% (0.6194 => 1.1614, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.47% (0.6297 => 1.1742, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.35% (0.6446 => 1.2012, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.61% (0.6681 => 1.2200, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.15% (0.6667 => 1.2144, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.42% (0.7524 => 1.3650, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.99% (0.7339 => 1.2769, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.06% (0.0514 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.70% (0.0974 => 0.1575, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.07% (0.0599 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.81% (1.6474 => 2.3197, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.60% (0.1132 => 0.1569, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.09% (0.0680 => 0.0939, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.16% (0.0445 => 0.0597, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 32.83% (2.2587 => 3.0003, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.07% (0.0582 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 25.73% (5.4682 => 6.8752, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.44% (0.0622 => 0.0774, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.51% (0.0621 => 0.0767, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.71% (0.5329 => 0.6486, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.91% (0.1081 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.87% (0.7021 => 0.8346, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.46% (0.4916 => 0.5676, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.95% (1.1450 => 1.3162, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.49% (4.5069 => 5.1147, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/exptree: 13.08% (0.0864 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.31% (3.5339 => 3.9690, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 11.92% (0.4515 => 0.5053, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.79% (0.2001 => 0.2237, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 11.77% (0.3357 => 0.3752, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.75% (1.6364 => 1.8286, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.78% (0.2385 => 0.2642, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.16% (0.1761 => 0.1940, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.05% (0.1441 => 0.1557, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.11% (1.2515 => 1.3405, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 7.10% (9.2283 => 9.8831, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 7.09% (5.0226 => 5.3786, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 6.81% (18.2933 => 19.5396, std.dev.: 0.0328) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1731 => 0.1848, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.2784 => 1.3584, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 6.08% (0.3255 => 0.3453, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.85% (0.3319 => 0.3513, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 4.12% (17.1032 => 17.8084, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3394 => 0.3517, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 3.29% (0.4524 => 0.4673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.28% (0.3446 => 0.3559, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.18% (0.4813 => 0.4966, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4264, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.6750 => 0.6940, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.9557 => 0.9798, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 2.51% (0.4861 => 0.4983, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.45% (1.3722 => 1.4058, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.67% (0.7447 => 0.7571, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.4642 => 1.4874, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.48% (0.8418 => 0.8543, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.28% (15.5079 => 15.7059, std.dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6665, std.dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.11% (0.9531 => 1.0209, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1932 => 3.3512, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.5751 => 56.6707, std.dev.: 0.0222) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1003, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.42% (2.0478 => 2.1178, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.32% (5.1955 => 5.3678, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.16% (3.6551 => 3.7340, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.95% (4.5320 => 4.6203, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (27.8210 => 28.1731, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.24% (0.1281 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.76% (0.1584 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.11% (0.2428 => 0.2304, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.62% (0.3812 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.61% (0.7198 => 0.6866, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.46% (0.3142 => 0.3002, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3831 => 0.3661, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.42% (0.3891 => 0.3719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.33% (0.4176 => 0.3995, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -4.24% (0.4033 => 0.3862, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.12% (0.3837 => 0.3679, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.10% (0.4199 => 0.4027, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.99% (0.3884 => 0.3729, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.81% (0.4280 => 0.4117, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.79% (0.9852 => 0.9479, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.69% (0.3658 => 0.3523, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.59% (0.6484 => 0.6251, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.9542 => 0.9242, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.97% (1.3148 => 1.2758, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.91% (2.1713 => 2.1082, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.87% (0.7919 => 0.7692, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -2.82% (4.3330 => 4.2108, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.72% (0.4151 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.58% (0.6347 => 0.6183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.55% (0.6441 => 0.6277, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.54% (0.3931 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.48% (0.4321 => 0.4214, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (1.0544 => 1.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.29% (1.2210 => 1.1930, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -2.26% (0.7779 => 0.7603, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.26% (1.2221 => 1.1945, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.22% (6.7716 => 6.6216, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -2.17% (0.7982 => 0.7809, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.16% (20.7746 => 20.3258, std.dev.: 0.0307) MultiSource/Benchmarks/PAQ8p/paq8p: -2.05% (2.4924 => 2.4414, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (1.2300 => 1.2056, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.76% (14.2083 => 13.9584, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.70% (0.8521 => 0.8376, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -1.70% (16.1920 => 15.9170, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: -1.64% (7.0961 => 6.9798, std.dev.: 0.0149) MultiSource/Applications/lua/lua: -1.48% (4.0594 => 3.9993, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.10% (1.3643 => 1.0219, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7561, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0205, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.75% (2.9703 => 2.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1781, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.13% (0.6299 => 0.5031, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -14.86% (2.5106 => 2.1376, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2799, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8711, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -4.99% (1.1594 => 1.1016, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.69% (1.7753 => 1.6921, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0526, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7776, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -2.09% (3.7241 => 3.6461, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.72% (1.6086 => 1.5809, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4654, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.36% (4.8776 => 4.8111, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7092 => 3.6593, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6048, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 00:21:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 02:21:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130105082121.C573E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7333?compare_to=7327&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7333, Order: 171595, Start Time: 2013-01-05 04:41:52, End Time: 2013-01-05 08:21:15 To: 7327, Order: 171468, Start Time: 2013-01-04 18:37:43, End Time: 2013-01-04 22:11:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 17 (184 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1084 (704 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.14% (21.1770 => 23.7473, std.dev.: 0.7738) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.19% (0.8312 => 0.8494, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.17% (0.9491 => 0.9697, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 1.84% (0.6940 => 0.7068, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 1.73% (0.6889 => 0.7008, std.dev.: 0.0002) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.69% (24.9082 => 25.3293, std.dev.: 0.0608) MultiSource/Applications/hbd/hbd: 1.68% (1.1365 => 1.1556, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 1.65% (0.8319 => 0.8456, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.57% (0.7267 => 0.7381, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 1.50% (1.1476 => 1.1648, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.32% (5.4676 => 5.5400, std.dev.: 0.0047) MultiSource/Applications/d/make_dparser: 1.22% (1.2581 => 1.2734, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 1.21% (13.1912 => 13.3504, std.dev.: 0.0122) MultiSource/Applications/SPASS/SPASS: 1.10% (6.2337 => 6.3021, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (2.2913 => 2.3156, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: 58.57% (29.2871 => 46.4417, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.68% (53.8701 => 54.7754, std.dev.: 0.0874) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -4.05% (2.5123 => 2.4105, std.dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 104.02% (11.6398 => 23.7473, std.dev.: 0.7738) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.44% (0.5361 => 0.8494, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.52% (0.0625 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.52% (0.1063 => 0.1430, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.58% (0.7426 => 0.9697, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.11% (0.1106 => 0.1428, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.52% (0.0547 => 0.0703, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.33% (0.2969 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.04% (0.4139 => 0.5258, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.71% (0.5900 => 0.7476, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 26.51% (1.5932 => 2.0155, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.21% (0.4994 => 0.6303, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.11% (0.0475 => 0.0599, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.03% (0.0584 => 0.0736, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.40% (0.5000 => 0.6270, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 25.17% (0.0604 => 0.0756, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.02% (0.4253 => 0.5317, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.98% (0.1549 => 0.1936, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.98% (0.1021 => 0.1276, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.30% (0.0897 => 0.1115, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.21% (0.1107 => 0.1375, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 23.35% (0.1619 => 0.1997, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 23.31% (0.0948 => 0.1169, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.93% (0.1003 => 0.1233, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.85% (0.1103 => 0.1355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.44% (0.3903 => 0.4779, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.37% (0.0541 => 0.0662, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.32% (0.1604 => 0.1962, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 22.18% (0.0947 => 0.1157, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.14% (0.2014 => 0.2460, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 21.59% (0.1505 => 0.1830, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.38% (0.2736 => 0.3321, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.86% (0.1462 => 0.1767, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 20.85% (0.1218 => 0.1472, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.68% (0.1088 => 0.1313, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.66% (0.2866 => 0.3458, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.64% (0.3890 => 0.4693, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 20.43% (0.4029 => 0.4852, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 20.29% (0.5826 => 0.7008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 20.02% (0.5889 => 0.7068, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.85% (1.3152 => 1.5763, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.57% (0.3271 => 0.3911, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.45% (4.4195 => 5.2791, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 19.22% (0.5546 => 0.6612, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.20% (0.0573 => 0.0683, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 19.17% (0.9697 => 1.1556, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: 19.16% (1.8794 => 2.2394, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.13% (3.5627 => 4.2444, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.07% (1.6211 => 1.9302, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.02% (0.5026 => 0.5982, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.96% (0.4658 => 0.5541, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.90% (0.1968 => 0.2340, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.71% (0.1160 => 0.1377, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.44% (0.4361 => 0.5165, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.12% (0.2875 => 0.3396, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.12% (0.3930 => 0.4642, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 18.12% (1.0781 => 1.2734, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 18.09% (0.1421 => 0.1678, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 18.07% (0.1284 => 0.1516, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.06% (4.6926 => 5.5400, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 17.93% (0.2750 => 0.3243, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.92% (0.7171 => 0.8456, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.87% (2.7292 => 3.2168, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.65% (2.0673 => 2.4322, std.dev.: 0.0647) SingleSource/Benchmarks/Shootout-C++/random: 17.62% (0.2803 => 0.3297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.59% (0.2792 => 0.3283, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.58% (1.9694 => 2.3156, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 17.58% (4.2109 => 4.9511, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/methcall: 17.56% (0.2813 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.55% (0.2911 => 0.3422, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 17.55% (0.9909 => 1.1648, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 17.54% (0.2725 => 0.3203, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.52% (0.2729 => 0.3207) SingleSource/Benchmarks/Shootout-C++/except: 17.50% (0.2811 => 0.3303, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.50% (0.2714 => 0.3189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.49% (0.2738 => 0.3217, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.46% (0.2823 => 0.3316, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 17.38% (0.3004 => 0.3526, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 17.34% (0.2780 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.18% (1.9966 => 2.3397, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 17.17% (0.3267 => 0.3828, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.06% (0.3195 => 0.3740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 17.02% (0.3096 => 0.3623, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 16.94% (0.3258 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.79% (0.1090 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.70% (0.3060 => 0.3571, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/moments: 16.59% (0.3678 => 0.4288, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 16.56% (23.5202 => 27.4153, std.dev.: 0.6042) SingleSource/Benchmarks/Shootout-C++/lists1: 16.42% (0.3477 => 0.4048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.42% (0.3362 => 0.3914, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: 16.37% (0.3317 => 0.3860, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 16.29% (0.2566 => 0.2984, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.22% (0.3625 => 0.4213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 16.19% (0.2075 => 0.2411, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.15% (0.3282 => 0.3812, std.dev.: 0.0120) MultiSource/Applications/lua/lua: 15.97% (1.4269 => 1.6548, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3446 => 0.3993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.86% (0.3726 => 0.4317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.86% (0.3348 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.85% (0.3469 => 0.4019, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 15.76% (0.3496 => 0.4047, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.74% (0.3488 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.73% (0.3465 => 0.4010, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.72% (0.3442 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.69% (0.3460 => 0.4003, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.47% (0.3845 => 0.4440, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.47% (0.3690 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.47% (0.3981 => 0.4597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.44% (0.4146 => 0.4786, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: 15.40% (0.3650 => 0.4212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 15.38% (0.4251 => 0.4905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 15.15% (0.7875 => 0.9068, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 15.02% (2.1653 => 2.4905, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 14.94% (0.5012 => 0.5761, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 14.88% (4.6177 => 5.3050, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.85% (0.2068 => 0.2375, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.70% (0.6435 => 0.7381, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 14.60% (0.2691 => 0.3084, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 14.13% (2.1013 => 2.3982, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.04% (0.3084 => 0.3517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.74% (0.2737 => 0.3113, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 13.72% (0.3498 => 0.3978, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 13.72% (5.5417 => 6.3021, std.dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: 13.53% (0.4847 => 0.5503, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.18% (0.0804 => 0.0910, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 12.86% (0.3336 => 0.3765, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 12.76% (2.0346 => 2.2942, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 12.54% (0.6634 => 0.7466, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.08% (0.2103 => 0.2357, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 11.67% (11.9555 => 13.3504, std.dev.: 0.0122) MultiSource/Applications/lemon/lemon: 11.29% (0.2391 => 0.2661, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.01% (0.5584 => 0.6143, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.14% (0.3792 => 0.4025, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5317, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.18% (0.3693 => 0.4032, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2420, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.07% (12.0509 => 12.6622, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6770, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.19% (1.8057 => 1.8813, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3009, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.19% (4.0317 => 4.0795, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2071, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5884, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4759, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.66% (2.4764 => 2.4105, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5907, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.42% (17.2379 => 14.4070, std.dev.: 0.0859) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -8.24% (0.2402 => 0.2204, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7983, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.45% (14.0481 => 13.4225, std.dev.: 0.1189) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2280, std.dev.: 0.2823) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7973, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1436, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5691, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5004, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1982, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 00:55:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 02:55:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105085558.266792A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7334?compare_to=7332&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7334, Order: 171605, Start Time: 2013-01-05 07:13:04, End Time: 2013-01-05 08:55:49 To: 7332, Order: 171597, Start Time: 2013-01-05 05:11:05, End Time: 2013-01-05 06:49:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 3 (92 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1099 (850 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.48% (3.0003 => 2.9558, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.30% (2.3197 => 2.2895, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -1.12% (2.4414 => 2.4140, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 286.97% (22.4056 => 86.7027, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.94% (0.5456 => 1.1509, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.03% (0.5567 => 1.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.02% (0.5575 => 1.1597, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.81% (0.5581 => 1.1598, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 107.56% (0.5688 => 1.1806, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.01% (0.5805 => 1.1959, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.18% (0.6395 => 1.3057, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.42% (0.5849 => 1.1898, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.37% (0.5941 => 1.2082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.14% (0.5859 => 1.1902, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.42% (0.6033 => 1.2212, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.92% (0.6260 => 1.2640, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.85% (0.6189 => 1.2245, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.65% (0.5478 => 1.0827, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.37% (0.5570 => 1.0938, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.30% (0.5569 => 1.0932, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 95.82% (0.6440 => 1.2611, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.53% (0.5591 => 1.0932, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.26% (0.6304 => 1.2309, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.07% (0.5705 => 1.1129, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.43% (0.5802 => 1.1281, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.31% (0.6395 => 1.2362, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.18% (0.6676 => 1.2830, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.79% (0.5857 => 1.1233, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.54% (0.5925 => 1.1349, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.47% (0.5863 => 1.1226, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.25% (0.6230 => 1.1915, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.13% (0.6052 => 1.1567, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.51% (0.6660 => 1.2688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.92% (0.6194 => 1.1578, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.42% (0.6446 => 1.1952, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.39% (0.6297 => 1.1674, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: 85.00% (0.0280 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.57% (0.6681 => 1.2131, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.12% (0.6667 => 1.2075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.04% (0.7524 => 1.3546, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.78% (0.0717 => 0.1246, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 72.88% (0.7339 => 1.2688, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 67.04% (0.0267 => 0.0446, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.35% (0.0974 => 0.1591, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.87% (0.0514 => 0.0832, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.74% (0.0599 => 0.0861, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 38.98% (1.6474 => 2.2895, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.98% (0.0445 => 0.0614) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.63% (0.1132 => 0.1558, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 30.86% (2.2587 => 2.9558, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.07% (0.0582 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.04% (0.0699 => 0.0902, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 27.33% (0.0622 => 0.0792, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 24.53% (5.4682 => 6.8098, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0621 => 0.0766, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.74% (0.5329 => 0.6434, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.26% (0.1081 => 0.1300, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.91% (0.3834 => 0.4559, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.17% (0.7021 => 0.8297, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.05% (0.4916 => 0.5656, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 14.93% (0.0864 => 0.0993, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 14.23% (1.1450 => 1.3079, std.dev.: 0.0450) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.93% (4.5069 => 5.0897, std.dev.: 0.1249) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.35% (1.6364 => 1.8221, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.34% (0.2001 => 0.2228, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.06% (3.5339 => 3.9246, std.dev.: 0.0216) MultiSource/Applications/sgefa/sgefa: 10.96% (0.3357 => 0.3725, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/chomp: 10.73% (0.1761 => 0.1950, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.15% (0.1441 => 0.1544, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.87% (0.1731 => 0.1850, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 6.63% (5.0226 => 5.3555, std.dev.: 0.0457) MultiSource/Benchmarks/mafft/pairlocalalign: 6.58% (9.2283 => 9.8355, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 5.99% (0.3255 => 0.3450, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.80% (1.2784 => 1.3526, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 3.86% (0.3394 => 0.3525, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.45% (0.3446 => 0.3565, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4524 => 0.4679, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.66% (0.4813 => 0.4941, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.53% (0.4861 => 0.4984, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6750 => 0.6900, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.9557 => 0.9753, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.63% (31.3723 => 55.7279, std.dev.: 0.0634) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.09% (0.9531 => 1.0207, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3671, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.85% (0.2081 => 0.2182, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 4.31% (3.1932 => 3.3308, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.85% (54.5751 => 56.6767, std.dev.: 0.0337) MultiSource/Benchmarks/nbench/nbench: 3.59% (11.6767 => 12.0957, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.14% (0.6469 => 0.6672, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (3.6551 => 3.7186, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3024, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.40% (0.1281 => 0.1135, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.97% (0.1431 => 0.1317, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.52% (0.2428 => 0.2294, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.95% (0.3821 => 0.3632, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: -4.05% (0.4199 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.02% (0.3884 => 0.3728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.01% (0.9542 => 0.9159, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -3.83% (0.4280 => 0.4116, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -3.15% (2.4924 => 2.4140, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.97% (0.6441 => 0.6250, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.67% (0.7779 => 0.7571, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.65% (1.2210 => 1.1886, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.59% (1.2221 => 1.1904, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8497, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.48% (2.1713 => 2.1174, std.dev.: 0.0183) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.45% (6.7716 => 6.6059, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.45% (34.0927 => 33.5993, std.dev.: 0.0970) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -64.62% (1.8100 => 0.6404, std.dev.: 0.0246) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0652, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1050, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.73% (2.9703 => 2.2951, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.52% (4.1024 => 3.1786, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.20% (4.3779 => 3.4059, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -14.88% (2.5106 => 2.1370, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2804, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1983, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.98% (0.3626 => 0.3228, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7825, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8717, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.35% (1.1594 => 1.0974, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1555, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2743, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7625, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.85% (1.6086 => 1.5789, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8082, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: -1.26% (3.7092 => 3.6626, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.22% (1.6219 => 1.6021, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3554, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 01:23:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 03:23:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105092358.5A4562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7335?compare_to=7331&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7335, Order: 171605, Start Time: 2013-01-05 07:04:34, End Time: 2013-01-05 09:23:52 To: 7331, Order: 171595, Start Time: 2013-01-05 04:17:33, End Time: 2013-01-05 06:34:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (218 on baseline) Performance Improvements: 6 (64 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1091 (607 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 27.93% (0.3995 => 0.5111, std.dev.: 0.0259) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.27% (3.4332 => 3.3896, std.dev.: 0.0151) MultiSource/Applications/JM/lencod/lencod: -1.19% (31.0326 => 30.6647, std.dev.: 0.0209) MultiSource/Applications/lua/lua: -1.14% (4.5359 => 4.4841, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.10% (2.6588 => 2.6296, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -1.05% (22.1812 => 21.9494, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: -1.02% (1.3497 => 1.3359, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1340 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.29% (0.0685 => 0.0687, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8409 => 499.8604, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44225.65% (1.1277 => 499.8604, std.dev.: 0.0023) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.99% (0.5229 => 1.6523, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 19.90% (14.9895 => 17.9722, std.dev.: 0.0565) MultiSource/Applications/kimwitu++/kc: 55.06% (14.1553 => 21.9494, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 16.66% (4.1105 => 4.7955, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.15% (1.1048 => 1.7472, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1357.20% (7.1582 => 104.3093, std.dev.: 0.0985) SingleSource/Benchmarks/Misc-C++-EH/spirit: 129.98% (3.4629 => 7.9641, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.54% (0.6222 => 1.0922, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10217.64% (0.0720 => 7.4287, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3832000.00% (0.0001 => 3.8321, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 11074500.00% (0.0001 => 11.0746, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66500.00% (0.0001 => 0.0666, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487700.00% (0.0001 => 5.4878, std.dev.: 0.0374) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.12% (1.1194 => 10.2551, std.dev.: 0.0135) MultiSource/Applications/ClamAV/clamscan: 148.60% (22.1758 => 55.1280, std.dev.: 0.0393) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.33% (0.0929 => 0.1796, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.73% (0.0296 => 0.0532, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 73.00% (0.1463 => 0.2531, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 65.81% (1.5859 => 2.6296, std.dev.: 0.0016) SingleSource/Regression/C/sumarray: 64.07% (0.0231 => 0.0379, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.68% (0.0439 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.74% (2.9384 => 4.6056, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.29% (7.0540 => 10.8837, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 53.90% (2.2024 => 3.3896, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.73% (0.1056 => 0.1560, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.48% (0.5105 => 0.7529, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.21% (8.1363 => 11.8957, std.dev.: 0.0113) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404) SingleSource/Benchmarks/Misc/dt: 42.64% (0.0265 => 0.0378, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.87% (0.6675 => 0.9403, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 39.78% (21.9371 => 30.6647, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops: 37.57% (0.1432 => 0.1970, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.07% (0.4615 => 0.6326, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.10% (4.2646 => 5.8041, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 35.73% (0.3109 => 0.4220, std.dev.: 0.0109) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.40% (0.0814 => 0.1094, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 33.78% (0.1655 => 0.2214, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.21% (1.5415 => 2.0534, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.32% (0.1906 => 0.2522, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.40% (0.2271 => 0.2984, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 30.68% (0.4299 => 0.5618, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.67% (0.1337 => 0.1747, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 29.82% (1.1642 => 1.5114, std.dev.: 0.0502) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.77% (0.3121 => 0.4019, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 26.43% (0.0719 => 0.0909, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.36% (3.8922 => 4.9181, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 26.13% (0.1175 => 0.1482, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 25.64% (5.7591 => 7.2357, std.dev.: 0.0143) SingleSource/Benchmarks/Stanford/Oscar: 25.47% (0.0636 => 0.0798) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.16% (0.0457 => 0.0572, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.13% (0.1584 => 0.1982, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 24.98% (0.2554 => 0.3192, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.59% (1.0722 => 1.3359, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 23.28% (0.1555 => 0.1917, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.18% (0.1566 => 0.1929, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.15% (1.4186 => 1.7470, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.83% (0.1695 => 0.2082, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.83% (9.4845 => 11.6496, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 21.78% (0.7115 => 0.8665, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.67% (1.3050 => 1.5878, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.52% (0.2700 => 0.3281, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 20.85% (0.3098 => 0.3744, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.18% (0.7835 => 0.9416, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.09% (0.0871 => 0.1046, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 20.07% (0.1151 => 0.1382, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.82% (4.9449 => 5.9250, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.49% (0.0672 => 0.0803, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 19.36% (1.1840 => 1.4132, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.35% (0.4636 => 0.5533, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/lists: 19.33% (0.0626 => 0.0747, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.10% (0.5860 => 0.6979, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.86% (0.8172 => 0.9713, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.77% (0.1236 => 0.1468, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 18.77% (17.1811 => 20.4059, std.dev.: 0.0436) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.76% (0.1029 => 0.1222, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.70% (5.0018 => 5.9372, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/bigfib: 18.66% (0.6456 => 0.7661, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.54% (3.3354 => 3.9538, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/hash: 18.44% (0.4289 => 0.5080, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/messages-2: 18.43% (0.0662 => 0.0784, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.37% (0.0675 => 0.0799, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.25% (0.1940 => 0.2294, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 17.40% (0.4620 => 0.5424, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.28% (0.2107 => 0.2471, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.24% (0.1143 => 0.1340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.18% (0.3307 => 0.3875, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.5569 => 0.6525, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0886 => 0.1037, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.95% (0.5981 => 0.6995, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.91% (0.3423 => 0.4002, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.88% (0.9765 => 1.1413, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.87% (0.5020 => 0.5867, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 16.85% (0.0730 => 0.0853, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 16.84% (0.7433 => 0.8685, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 16.84% (0.2049 => 0.2394, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.75% (0.0770 => 0.0899, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.64% (0.2758 => 0.3217, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 16.62% (0.3232 => 0.3769, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.49% (0.1510 => 0.1759, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 16.25% (2.2969 => 2.6702, std.dev.: 0.0939) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary3: 16.14% (0.3283 => 0.3813, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 15.90% (2.0273 => 2.3496, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 15.80% (3.8723 => 4.4841, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.38% (0.8921 => 1.0293, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.33% (0.6450 => 0.7439, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.16% (0.8101 => 0.9329, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.76% (0.3441 => 0.3949, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.58% (0.0933 => 0.1069, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.30% (1.1861 => 1.3557, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.3379 => 0.3861, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 13.49% (0.3180 => 0.3609, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.33% (0.8067 => 0.9142, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.31% (0.1044 => 0.1183, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 12.96% (0.3387 => 0.3826, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.88% (0.3865 => 0.4363, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 12.77% (1.5603 => 1.7596, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.56% (0.2603 => 0.2930, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.59% (0.4203 => 0.4690, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.43% (0.4103 => 0.4572, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.22% (0.4048 => 0.4502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.05% (0.3603 => 0.4001, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.98% (0.1330 => 0.1476, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.84% (0.3422 => 0.3793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.80% (0.3473 => 0.3848, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.76% (14.3668 => 15.9124, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 10.75% (0.3497 => 0.3873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.73% (0.3282 => 0.3634, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 10.45% (0.3684 => 0.4069, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.21% (0.3427 => 0.3777, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.11% (0.4064 => 0.4475, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.08% (0.2430 => 0.2675, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.01% (0.3826 => 0.4209, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 9.96% (0.3092 => 0.3400, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.6030 => 0.6607, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.51% (0.2871 => 0.3144) SingleSource/Benchmarks/Shootout-C++/strcat: 9.40% (0.2831 => 0.3097, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.25% (0.1892 => 0.2067, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.15% (0.1268 => 0.1384, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.98% (2.0665 => 2.2521, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2756 => 0.2998, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3952, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/fibo: 8.55% (0.2725 => 0.2958, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.34% (0.2891 => 0.3132, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 8.30% (10.3673 => 11.2281, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.22% (0.3650 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.00% (0.3162 => 0.3415, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 7.98% (63.2438 => 68.2913, std.dev.: 0.0872) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.3052 => 0.3294, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.83% (0.3935 => 0.4243, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.95% (2.2022 => 2.3553, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.33% (0.3817 => 0.3944, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.94% (7.9617 => 8.1161, std.dev.: 0.0174) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2437, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (1.1145 => 1.2927, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.04% (1.1396 => 1.2426, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3284, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0597, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4522, std.dev.: 0.0113) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3140, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.80% (3.6395 => 3.7779, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.61% (2.0360 => 2.1094, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.6802 => 8.9218, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.69% (0.9957 => 1.0225, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2457, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.32% (9.1159 => 9.2363, std.dev.: 0.0258) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.23% (10.3460 => 10.4730, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.58% (5.2763 => 1.1832, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -44.45% (0.1622 => 0.0901, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.65% (5.3855 => 4.4350, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.10% (5.3526 => 4.4371, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -13.34% (10.4361 => 9.0441, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.84% (1.7609 => 1.6228, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9624, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.88% (1.9577 => 0.6484, std.dev.: 0.0210) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3086, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0212, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.53% (10.7105 => 7.4411, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7790, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0073, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2947, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5893, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0043) SingleSource/UnitTests/Vector/multiplies: -16.27% (2.5528 => 2.1374, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -11.60% (1.2373 => 1.0938, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4955, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.94% (1.5660 => 1.4260) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2610, std.dev.: 0.0263) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.36% (10.2830 => 9.8347, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.99% (8.1563 => 7.8308, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0301) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.11% (1.0554 => 1.0331, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.29% (3.7221 => 3.6739, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2328, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.53% (0.2116 => 0.0687, std.dev.: 0.0018) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 03:00:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 05:00:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105110053.7D5B92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7336?compare_to=7334&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7336, Order: 171614, Start Time: 2013-01-05 09:21:42, End Time: 2013-01-05 11:00:02 To: 7334, Order: 171605, Start Time: 2013-01-05 07:13:04, End Time: 2013-01-05 08:55:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (108 on baseline) Performance Improvements: 0 (125 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (811 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 6.46% (0.6404 => 0.6818, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 287.94% (22.4056 => 86.9200, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.05% (0.5456 => 1.1515, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.23% (0.5567 => 1.1592, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.13% (0.5575 => 1.1603, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.02% (0.5688 => 1.1832, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.67% (0.5581 => 1.1590, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.29% (0.5805 => 1.1975, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.53% (0.6395 => 1.3080, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.65% (0.5941 => 1.2099, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.44% (0.5849 => 1.1899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.26% (0.5859 => 1.1909, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.59% (0.6033 => 1.2222, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.24% (0.6260 => 1.2660, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.01% (0.5478 => 1.0847, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.00% (0.6189 => 1.2254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.73% (0.5569 => 1.0956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.57% (0.5570 => 1.0949, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.10% (0.6440 => 1.2629, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.85% (0.5591 => 1.0950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.48% (0.6304 => 1.2323, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.43% (0.5705 => 1.1149, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.92% (0.5802 => 1.1309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.82% (0.6395 => 1.2395, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.48% (0.6676 => 1.2850, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.20% (0.5857 => 1.1257, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.00% (0.5925 => 1.1376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.80% (0.5863 => 1.1245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.70% (0.6230 => 1.1943, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.62% (0.6052 => 1.1597, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.69% (0.6660 => 1.2700, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.87% (0.6194 => 1.1575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.82% (0.6446 => 1.1978, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.68% (0.6297 => 1.1692, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.78% (0.6681 => 1.2145, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.22% (0.6667 => 1.2082, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.22% (0.7524 => 1.3560, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.31% (0.7339 => 1.2719, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.67% (0.0514 => 0.0831, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.40% (0.0974 => 0.1572, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.33% (0.1500 => 0.2195, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.91% (0.0599 => 0.0862) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 39.14% (1.6474 => 2.2922, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.63% (0.1132 => 0.1558, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.50% (0.0693 => 0.0939, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.03% (2.2587 => 2.9596, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.73% (0.0582 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.04% (0.0699 => 0.0881, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 25.35% (5.4682 => 6.8543, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.92% (0.5329 => 0.6444, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.35% (0.1081 => 0.1301, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.12% (0.7021 => 0.8293, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.65% (0.4916 => 0.5636, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 14.34% (1.1450 => 1.3092, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.84% (4.5069 => 5.0854, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.23% (3.5339 => 3.9309, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 11.14% (0.3357 => 0.3731, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.09% (0.2001 => 0.2223, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.88% (1.6364 => 1.8144, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 9.77% (0.1761 => 0.1933, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.56% (0.1441 => 0.1550, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.59% (1.2515 => 1.3340, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 6.46% (5.0226 => 5.3472, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (9.2283 => 9.8137, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 6.26% (18.2933 => 19.4377, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.74% (1.2784 => 1.3518, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 3.35% (17.1032 => 17.6767, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.93% (0.3446 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.70% (0.4813 => 0.4943, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 2.50% (0.4524 => 0.4637, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.6750 => 0.6907, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (0.4861 => 0.4974, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.16% (1.3864 => 1.4163, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.9557 => 0.9734, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.74% (1.3722 => 1.3961, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.66% (31.3723 => 55.7363, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9531 => 1.0272, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0018) MultiSource/Benchmarks/llubenchmark/llu: 5.10% (3.7435 => 3.9343, std.dev.: 0.0676) SingleSource/Benchmarks/Shootout-C++/hash2: 4.70% (3.1932 => 3.3433, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5545, std.dev.: 0.0634) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0992, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.35% (2.0478 => 2.1163, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3672, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6551 => 3.7285, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3036, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6102, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.26% (0.1584 => 0.1469, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.60% (0.2428 => 0.2292, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.08% (0.3821 => 0.3627, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.00% (0.3142 => 0.2985, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.96% (0.3831 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.95% (0.9852 => 0.9364, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3880 => 0.3692, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.81% (0.3884 => 0.3697, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.70% (0.3891 => 0.3708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.67% (0.4176 => 0.3981, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.64% (0.4033 => 0.3846, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.48% (0.3837 => 0.3665, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.33% (0.4199 => 0.4017, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.26% (0.3658 => 0.3502, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.11% (0.4280 => 0.4104, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.03% (0.6484 => 0.6223, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.99% (0.9542 => 0.9161, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.93% (0.2695 => 0.2589, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.67% (0.3323 => 0.3201, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.45% (1.3148 => 1.2695, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.35% (0.7919 => 0.7654, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: -3.31% (0.3205 => 0.3099, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.24% (0.7779 => 0.7527, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -3.21% (4.3330 => 4.1937, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.20% (0.4151 => 0.4018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.11% (2.1713 => 2.1038, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -3.08% (0.7982 => 0.7736, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -2.99% (0.3406 => 0.3304, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.98% (0.6347 => 0.6158, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (2.4924 => 2.4194, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.86% (20.7746 => 20.1813, std.dev.: 0.0462) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.85% (1.0544 => 1.0244, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: -2.84% (0.6441 => 0.6258, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.78% (1.2210 => 1.1871, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.73% (0.4321 => 0.4203, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.69% (1.2221 => 1.1892, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.65% (6.7716 => 6.5924, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.52% (1.2300 => 1.1990, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -2.42% (16.1920 => 15.7997, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.30% (14.2083 => 13.8809, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.30% (0.8521 => 0.8325, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.28% (0.4427 => 0.4326, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.23% (7.0961 => 6.9377, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.22% (0.5999 => 0.5866, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -1.74% (4.0594 => 3.9888, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.72% (0.6736 => 0.6620, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.59% (0.9077 => 0.8933, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: -1.54% (2.1401 => 2.1071, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -1.54% (2.4021 => 2.3651, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.41% (8.0126 => 7.8999, std.dev.: 0.0116) MultiSource/Applications/ClamAV/clamscan: -1.21% (15.2527 => 15.0680, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: -1.12% (1.5610 => 1.5435, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.33% (1.8100 => 0.6818, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0445 => 5.3065, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.61% (1.3643 => 1.0285, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7502, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0607, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1783, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.28% (4.3779 => 3.4025, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.88% (2.5106 => 2.1370, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2796, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.55% (1.1594 => 1.0950, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1731, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7722, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: -2.52% (3.7241 => 3.6304, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.20% (1.6086 => 1.5732, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.70% (4.8776 => 4.7949, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6012, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4353, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 04:10:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 06:10:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105121057.D51CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7337?compare_to=7335&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7337, Order: 171614, Start Time: 2013-01-05 09:54:33, End Time: 2013-01-05 12:10:51 To: 7335, Order: 171605, Start Time: 2013-01-05 07:04:34, End Time: 2013-01-05 09:23:52 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (213 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (611 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (11.2281 => 11.3602, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (0.0687 => 0.0670, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8604 => 499.8467, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.44% (1.1277 => 499.8467, std.dev.: 0.0056) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.52% (0.5229 => 1.6394, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 19.74% (14.9895 => 17.9484, std.dev.: 0.0182) MultiSource/Applications/kimwitu++/kc: 54.70% (14.1553 => 21.8980, std.dev.: 0.0496) MultiSource/Benchmarks/MallocBench/gs/gs: 15.94% (4.1105 => 4.7656, std.dev.: 0.0232) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.48% (1.1048 => 1.7398, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1350.33% (7.1582 => 103.8173, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++-EH/spirit: 129.54% (3.4629 => 7.9488, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.33% (0.6222 => 1.0909, std.dev.: 0.0083) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10211.67% (0.0720 => 7.4244, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3831900.00% (0.0001 => 3.8320, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11068000.00% (0.0001 => 11.0681, std.dev.: 0.0242) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483900.00% (0.0001 => 5.4840, std.dev.: 0.0074) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.64% (1.1194 => 10.2497, std.dev.: 0.0152) MultiSource/Applications/ClamAV/clamscan: 147.93% (22.1758 => 54.9802, std.dev.: 0.0542) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.33% (0.0929 => 0.1796, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/factor: 79.05% (0.0296 => 0.0530, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.45% (0.1463 => 0.2523, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 65.77% (1.5859 => 2.6289, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.55% (2.9384 => 4.6001, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 54.67% (0.0439 => 0.0679, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 54.31% (2.2024 => 3.3986, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.04% (7.0540 => 10.8660, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.09% (0.5105 => 0.7509, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 45.62% (8.1363 => 11.8481, std.dev.: 0.0175) SingleSource/UnitTests/Vector/multiplies: 44.44% (0.0279 => 0.0403, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: 42.64% (0.0265 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.84% (0.6675 => 0.9401, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 40.82% (0.0730 => 0.1028, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.68% (21.9371 => 30.6420, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/flops: 37.85% (0.1432 => 0.1974, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.45% (0.4615 => 0.6297, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.98% (4.2646 => 5.7989, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 35.35% (0.3109 => 0.4208, std.dev.: 0.0014) SingleSource/UnitTests/vla: 34.93% (0.0355 => 0.0479, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.52% (0.0814 => 0.1095) SingleSource/Benchmarks/McGill/chomp: 32.51% (0.1655 => 0.2193, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.23% (1.5415 => 2.0384, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.62% (0.2271 => 0.2989, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.43% (0.1906 => 0.2505, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.11% (0.1337 => 0.1753, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 30.89% (0.4299 => 0.5627, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 28.32% (1.1642 => 1.4939, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.42% (3.8922 => 4.9204, std.dev.: 0.0133) MultiSource/Benchmarks/NPB-serial/is/is: 26.29% (0.0719 => 0.0908, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.74% (0.0408 => 0.0513, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.56% (5.7591 => 7.2310, std.dev.: 0.0171) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.44% (0.3121 => 0.3915, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Oscar: 25.31% (0.0636 => 0.0797, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.87% (0.1584 => 0.1978, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.44% (0.1125 => 0.1400, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.22% (0.0479 => 0.0595, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 24.14% (1.0722 => 1.3310, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 23.81% (0.2554 => 0.3162, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.95% (0.0793 => 0.0975, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 22.61% (9.4845 => 11.6285, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.52% (1.4186 => 1.7381, std.dev.: 0.0119) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.48% (0.1566 => 0.1918, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.01% (0.1695 => 0.2068, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.49% (0.7115 => 0.8644, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.29% (1.3050 => 1.5828, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 20.76% (0.3098 => 0.3741, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.26% (0.2700 => 0.3247, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.74% (0.4636 => 0.5551, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.63% (0.0871 => 0.1042, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.49% (0.0672 => 0.0803, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.26% (4.9449 => 5.8971, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.09% (0.1032 => 0.1229, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 19.08% (1.1840 => 1.4099, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/lists: 19.01% (0.0626 => 0.0745, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.93% (0.1236 => 0.1470, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.89% (0.7835 => 0.9315, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 18.80% (0.6456 => 0.7670, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.59% (5.0018 => 5.9317, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.50% (0.5860 => 0.6944, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 18.41% (17.1811 => 20.3440, std.dev.: 0.0267) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.34% (0.8172 => 0.9671, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.23% (0.1163 => 0.1375, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 18.17% (0.1695 => 0.2003, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.15% (0.0953 => 0.1126, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.07% (0.0675 => 0.0797, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 18.05% (0.4289 => 0.5063, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 18.01% (3.3354 => 3.9361, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 17.62% (0.4620 => 0.5434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.40% (0.0730 => 0.0857, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.33% (0.3307 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 17.32% (0.1143 => 0.1341, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 17.12% (0.1151 => 0.1348, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.04% (0.0886 => 0.1037, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.01% (0.0770 => 0.0901, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 16.94% (0.0614 => 0.0718, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.91% (0.1940 => 0.2268, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 16.89% (0.3232 => 0.3778, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.86% (0.2758 => 0.3223, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.61% (0.5020 => 0.5854, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 16.30% (0.3283 => 0.3818, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.29% (0.1117 => 0.1299, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.29% (0.1510 => 0.1756, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.28% (0.2107 => 0.2450, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.26% (0.9765 => 1.1353, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 16.25% (0.1268 => 0.1474, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.23% (0.5569 => 0.6473, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 16.07% (0.3423 => 0.3973, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 16.04% (0.7433 => 0.8625, std.dev.: 0.0048) MultiSource/Applications/siod/siod: 15.94% (2.2969 => 2.6631, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 15.86% (0.2049 => 0.2374, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.67% (0.5981 => 0.6918, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 15.65% (3.8723 => 4.4782, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.54% (2.0273 => 2.3423, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: 15.21% (0.8921 => 1.0278, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.92% (0.8101 => 0.9310, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.73% (0.3441 => 0.3948, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.58% (0.0933 => 0.1069, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.28% (0.6450 => 0.7371, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 13.88% (0.3379 => 0.3848, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.88% (1.1861 => 1.3507, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: 13.81% (0.0818 => 0.0931, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 13.36% (0.3180 => 0.3605, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.03% (0.1044 => 0.1180, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.86% (0.3865 => 0.4362, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7604, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.68% (0.2603 => 0.2933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.54% (0.8067 => 0.9079, std.dev.: 0.0114) MultiSource/Benchmarks/sim/sim: 12.25% (0.3387 => 0.3802, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.80% (0.4203 => 0.4699) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.60% (0.4103 => 0.4579, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 11.36% (0.4048 => 0.4508, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.21% (0.3603 => 0.4007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3422 => 0.3796, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.83% (0.1330 => 0.1474, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.63% (14.3668 => 15.8934, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: 10.61% (0.3684 => 0.4075, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.57% (0.3282 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.27% (0.6030 => 0.6649, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.04% (0.3427 => 0.3771, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.00% (0.2430 => 0.2673, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 9.97% (0.5925 => 0.6516, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.82% (0.3828 => 0.4204, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.72% (0.4064 => 0.4459, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904) MultiSource/Benchmarks/PAQ8p/paq8p: 9.58% (10.3673 => 11.3602, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: 9.56% (0.7326 => 0.8026, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 9.51% (0.3092 => 0.3386, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.47% (0.3497 => 0.3828) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.34% (2.0665 => 2.2596, std.dev.: 0.0069) SingleSource/Regression/C++/ofstream_ctor: 9.29% (0.2905 => 0.3175, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.25% (0.1892 => 0.2067, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 8.83% (0.2877 => 0.3131, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.61% (0.2891 => 0.3140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.60% (0.3650 => 0.3964, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.35% (0.2756 => 0.2986, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 8.29% (0.3052 => 0.3305, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.29% (0.3162 => 0.3424, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 8.25% (1.2842 => 1.3902, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (0.3935 => 0.4257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2802 => 0.3031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.00% (0.2725 => 0.2943, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 7.92% (63.2438 => 68.2542, std.dev.: 0.0681) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.65% (2.2022 => 2.3487, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.88% (0.4879 => 0.5166, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.26% (0.3177 => 0.3344, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.60% (7.9617 => 8.0888, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2398, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.60% (0.2944 => 0.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3289, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0595, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4523, std.dev.: 0.0136) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3144, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.00% (3.6395 => 3.7852, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.63% (2.0360 => 2.1100, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9235, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2206, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.92% (0.9957 => 1.0148, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2441, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.20% (9.1159 => 9.2254, std.dev.: 0.0202) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1780, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -44.57% (0.1622 => 0.0899, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.82% (5.3855 => 4.4259, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.21% (5.3526 => 4.4314, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: -13.72% (10.4361 => 9.0038, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.46% (1.7609 => 1.6119, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9218, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.89% (1.9577 => 0.6482, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.05% (0.3987 => 0.2470, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.66% (1.5373 => 1.0199, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4259, std.dev.: 0.0369) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7736, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.39% (2.5528 => 2.1344, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.66% (1.6925 => 1.4275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7322, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4957, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -10.93% (1.2373 => 1.1021, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2610, std.dev.: 0.1035) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5794, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (0.2497 => 0.2359, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.49% (1.5835 => 1.5124, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8370, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.23% (8.1563 => 7.8112, std.dev.: 0.0131) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0091) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.68% (3.6994 => 3.6374, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3296, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.52% (3.7221 => 3.6655, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0086) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.34% (0.2116 => 0.0670, std.dev.: 0.0025) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 05:00:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 07:00:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130105130027.1801E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7338?compare_to=7333&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7338, Order: 171613, Start Time: 2013-01-05 09:21:04, End Time: 2013-01-05 13:00:20 To: 7333, Order: 171595, Start Time: 2013-01-05 04:41:52, End Time: 2013-01-05 08:21:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (180 on baseline) Performance Improvements: 9 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1088 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.18% (0.5094 => 0.5205, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.13% (0.5113 => 0.5222, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 1.13% (2.0155 => 2.0383, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 14.94% (0.3527 => 0.4054, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.23% (125.1172 => 129.1613, std.dev.: 0.6581) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.14% (0.5503 => 0.5385, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.14% (2.2942 => 2.2451, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -1.55% (5.3050 => 5.2230, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -1.42% (2.4905 => 2.4551, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.35% (3.2168 => 3.1733, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.19% (5.2791 => 5.2165, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: -1.13% (4.9511 => 4.8950, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: -1.12% (1.2734 => 1.2591, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (2.3982 => 2.3733, std.dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 103.48% (11.6398 => 23.6852, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.00% (0.5361 => 0.8417, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.08% (0.0625 => 0.0913, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.03% (0.1063 => 0.1446, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.51% (0.0714 => 0.0939, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.71% (0.0547 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.53% (0.0452 => 0.0590, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.38% (0.7426 => 0.9608, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.30% (0.2969 => 0.3839, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 28.89% (0.1620 => 0.2088, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.48% (0.1106 => 0.1421, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.46% (0.0390 => 0.0501, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 27.94% (1.5932 => 2.0383, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.63% (0.4994 => 0.6374, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.47% (0.5900 => 0.7521, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.25% (0.0822 => 0.1046, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.11% (0.1103 => 0.1402, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.96% (0.4139 => 0.5255, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.54% (0.0584 => 0.0739, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.44% (0.5000 => 0.6272, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.21% (0.4253 => 0.5325, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.20% (0.0897 => 0.1123, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 24.79% (0.0948 => 0.1183, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.25% (0.1604 => 0.1993, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.62% (0.1160 => 0.1434, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 23.41% (0.1619 => 0.1998, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.40% (0.1107 => 0.1366, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 23.39% (0.1462 => 0.1804, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 22.64% (0.0698 => 0.0856, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.47% (0.1549 => 0.1897, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.33% (0.1003 => 0.1227, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.83% (0.3903 => 0.4755, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 20.95% (0.1284 => 0.1553, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.40% (0.1088 => 0.1310, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.32% (0.2736 => 0.3292, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.18% (0.3271 => 0.3931, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 20.03% (0.1218 => 0.1462, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 19.82% (0.5826 => 0.6981, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 19.78% (0.5889 => 0.7054, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 19.78% (0.4029 => 0.4826, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.72% (0.3890 => 0.4657, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.58% (1.3152 => 1.5727, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 19.53% (0.1505 => 0.1799, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.43% (0.2866 => 0.3423, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.24% (0.5026 => 0.5993, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.04% (0.4658 => 0.5545, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 18.93% (0.1421 => 0.1690, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 18.85% (0.9697 => 1.1525, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.82% (0.2875 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.80% (3.5627 => 4.2324, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/methcall: 18.63% (0.2813 => 0.3337, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679) MultiSource/Benchmarks/MallocBench/gs/gs: 18.47% (1.8794 => 2.2265, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.37% (0.3930 => 0.4652, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: 18.30% (0.5546 => 0.6561, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 18.28% (0.2823 => 0.3339, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.22% (0.2738 => 0.3237, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 18.11% (0.2750 => 0.3248, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 18.05% (0.2714 => 0.3204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 18.05% (0.2803 => 0.3309, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.05% (0.2792 => 0.3296, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.03% (4.4195 => 5.2165, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.02% (1.6211 => 1.9132, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/fibo: 17.98% (0.2725 => 0.3215, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 17.98% (0.3004 => 0.3544, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.97% (0.2911 => 0.3434, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 17.92% (0.9909 => 1.1685, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.89% (4.6926 => 5.5321, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.85% (0.2729 => 0.3216, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.84% (0.1968 => 0.2319, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.83% (2.0673 => 2.4358, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 17.79% (0.2811 => 0.3311, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.67% (0.7171 => 0.8438, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 17.66% (0.2780 => 0.3271, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.46% (0.3362 => 0.3949, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 17.44% (0.3096 => 0.3636, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.40% (0.3195 => 0.3751, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.13% (0.4361 => 0.5108, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.09% (0.3060 => 0.3583, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 17.06% (23.5202 => 27.5329, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/ary3: 17.02% (0.3267 => 0.3823, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.91% (0.3258 => 0.3809, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.79% (1.0781 => 1.2591, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: 16.76% (0.2566 => 0.2996, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.74% (0.3124 => 0.3647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 16.64% (0.3317 => 0.3869, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.61% (1.9694 => 2.2965, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.48% (0.3282 => 0.3823, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/sieve: 16.32% (0.3726 => 0.4334, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.30% (1.9966 => 2.3220, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.27% (2.7292 => 3.1733, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/lists: 16.25% (0.3348 => 0.3892, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 16.25% (4.2109 => 4.8950, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists1: 16.19% (0.3477 => 0.4040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 16.07% (0.3678 => 0.4269, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.00% (0.3625 => 0.4205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.96% (0.1090 => 0.1264, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.95% (0.3981 => 0.4616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.93% (0.3690 => 0.4278, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 15.73% (0.4146 => 0.4798, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 15.55% (0.4251 => 0.4912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.42% (0.3488 => 0.4026, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 15.34% (0.3469 => 0.4001, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.32% (0.3446 => 0.3974, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.29% (0.3845 => 0.4433, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 15.27% (0.3465 => 0.3994, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.17% (0.3460 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.16% (0.3496 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 15.10% (0.5012 => 0.5769, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.04% (0.6435 => 0.7403, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 14.86% (1.4269 => 1.6389, std.dev.: 0.0364) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 14.78% (0.0758 => 0.0870, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 14.74% (0.3643 => 0.4180, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 13.96% (0.7875 => 0.8974, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.85% (0.2737 => 0.3116, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 13.38% (2.1653 => 2.4551, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.35% (0.2068 => 0.2344, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1028 => 0.1165, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.29% (0.3084 => 0.3494, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 13.11% (4.6177 => 5.2230, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 12.94% (2.1013 => 2.3733, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.85% (5.5417 => 6.2536, std.dev.: 0.0102) MultiSource/Applications/lambda-0_1_3/lambda: 12.81% (0.3498 => 0.3946, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 12.67% (0.2075 => 0.2338, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.65% (0.2103 => 0.2348, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.35% (0.1383 => 0.1540, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 11.20% (0.6634 => 0.7377, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 11.10% (0.4847 => 0.5385, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 10.81% (11.9555 => 13.2475, std.dev.: 0.1751) MultiSource/Applications/sqlite3/sqlite3: 10.35% (2.0346 => 2.2451, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: 8.74% (0.2391 => 0.2600, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.69% (0.5584 => 0.6069, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.72% (0.3792 => 0.4009, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5204, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 87.51% (0.2162 => 0.4054, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.39% (0.0734 => 0.0869, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.70% (0.3693 => 0.4125, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2395, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6712, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6836, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5026, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.45% (1.0927 => 1.1085, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2820, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2076, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4795, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.40% (2.4764 => 2.3922, std.dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.71% (25.4195 => 16.5952, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.33% (17.2379 => 14.4224, std.dev.: 0.0494) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0177) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2104, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.54% (0.6293 => 0.6133, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1565, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2806, std.dev.: 0.0501) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 05:04:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 07:04:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105130446.64F072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7339?compare_to=7336&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7339, Order: 171620, Start Time: 2013-01-05 11:26:19, End Time: 2013-01-05 13:04:40 To: 7336, Order: 171614, Start Time: 2013-01-05 09:21:42, End Time: 2013-01-05 11:00:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 2 (119 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (819 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -4.40% (3.9343 => 3.7611, std.dev.: 0.0321) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.21% (1.0272 => 1.0148, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 287.78% (22.4056 => 86.8850, std.dev.: 0.0582) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.58% (0.5456 => 1.1544, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.69% (0.5567 => 1.1618, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.45% (0.5575 => 1.1621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.28% (0.5581 => 1.1624, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.14% (0.5688 => 1.1839, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.96% (0.5805 => 1.2014, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.94% (0.6395 => 1.3106, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.04% (0.5941 => 1.2122, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.86% (0.5849 => 1.1924, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.77% (0.5859 => 1.1939, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.97% (0.6033 => 1.2245, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.56% (0.6260 => 1.2680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.32% (0.6189 => 1.2274, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.81% (0.5478 => 1.0836, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.51% (0.6440 => 1.2655, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.48% (0.5569 => 1.0942, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.46% (0.5570 => 1.0943, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.94% (0.6304 => 1.2352, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.67% (0.5591 => 1.0940, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.34% (0.5705 => 1.1144, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.76% (0.5802 => 1.1300, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.78% (0.6395 => 1.2392, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.83% (0.6676 => 1.2873, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.08% (0.5857 => 1.1250, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.83% (0.5863 => 1.1247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.75% (0.5925 => 1.1361, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.44% (0.6230 => 1.1927, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.44% (0.6052 => 1.1586, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.98% (0.6660 => 1.2719, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.79% (0.6194 => 1.1570, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.63% (0.6297 => 1.1689, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.62% (0.6446 => 1.1965, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.45% (0.6681 => 1.2123, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.43% (0.6667 => 1.2096, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.82% (0.7524 => 1.3605, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.34% (0.0717 => 0.1250, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.28% (0.7339 => 1.2717, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.06% (0.0514 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.70% (0.0974 => 0.1575, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.41% (0.0599 => 0.0865, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 39.30% (1.6474 => 2.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.07% (0.1132 => 0.1563, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.94% (0.0680 => 0.0938) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.93% (0.0693 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.27% (2.2587 => 2.9649, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.07% (0.0582 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.47% (0.0699 => 0.0884, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 25.17% (5.4682 => 6.8445, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.44% (0.0622 => 0.0774, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0621 => 0.0766, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.17% (0.5329 => 0.6457, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.35% (0.1081 => 0.1301, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.44% (0.7021 => 0.8316, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.85% (0.4916 => 0.5646, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 14.40% (1.1450 => 1.3099, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.95% (4.5069 => 5.0906, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 12.09% (0.4515 => 0.5061, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.49% (0.2001 => 0.2231, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.25% (3.5339 => 3.9315, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3357 => 0.3730, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.98% (1.6364 => 1.8161, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 9.77% (0.1761 => 0.1933, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 6.85% (5.0226 => 5.3665, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (9.2283 => 9.8475, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: 6.67% (1.2515 => 1.3350, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 6.12% (18.2933 => 19.4134, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.98% (1.2784 => 1.3549, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.88% (0.3319 => 0.3514, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.3255 => 0.3436, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 3.28% (17.1032 => 17.6637, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3394 => 0.3499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.48% (0.4524 => 0.4636, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.31% (0.4813 => 0.4924, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.19% (1.3864 => 1.4167, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.3722 => 1.3994, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.9557 => 0.9739, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.4642 => 1.4792, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.65% (31.3723 => 55.7335, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.47% (0.9531 => 1.0148, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 4.34% (3.1932 => 3.3319, std.dev.: 0.0089) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0988, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4947, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.27% (5.1955 => 5.3655, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1042, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (3.6551 => 3.7252, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3035, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.70% (4.5320 => 4.6092, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.40% (0.1281 => 0.1135, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.60% (0.2428 => 0.2292, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.84% (0.3142 => 0.2990, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.67% (0.9852 => 0.9392, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.59% (0.3837 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.54% (0.3831 => 0.3657, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.53% (0.3884 => 0.3708, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.51% (0.3880 => 0.3705, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.43% (0.7198 => 0.6879, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.37% (0.3891 => 0.3721, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4033 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.02% (0.3658 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.93% (0.2695 => 0.2589, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.87% (0.9542 => 0.9173, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.75% (0.6484 => 0.6241, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.47% (0.7919 => 0.7644, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.34% (0.3057 => 0.2955, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -3.33% (1.3148 => 1.2710, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -3.21% (0.3205 => 0.3102, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.21% (4.3330 => 4.1941, std.dev.: 0.0202) SingleSource/UnitTests/ObjC++/property-reference: -3.19% (0.7779 => 0.7531, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.18% (0.4151 => 0.4019, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.09% (2.1713 => 2.1043, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -2.98% (2.4924 => 2.4181, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -2.88% (0.6347 => 0.6164, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.87% (0.3931 => 0.3818, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -2.84% (0.7982 => 0.7755, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.68% (1.0544 => 1.0261, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.59% (0.4321 => 0.4209, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2393, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.46% (1.2210 => 1.1910, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.41% (1.2300 => 1.2004, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (14.2083 => 13.8669, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.38% (6.7716 => 6.6105, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.36% (1.2221 => 1.1933, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -2.26% (16.1920 => 15.8264, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.25% (0.8521 => 0.8329, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: -2.15% (7.0961 => 6.9432, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.03% (0.5999 => 0.5877, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -1.93% (4.0594 => 3.9809, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/football/football: -1.51% (0.9179 => 0.9040, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -1.51% (2.4021 => 2.3659, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -1.38% (2.1401 => 2.1106, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.23% (8.0126 => 7.9138, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -1.16% (1.5610 => 1.5429, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -1.09% (34.0927 => 33.7207, std.dev.: 0.0977) MultiSource/Applications/ClamAV/clamscan: -1.09% (15.2527 => 15.0867, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.86% (1.8100 => 0.6903, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3111, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3262, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0653, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1797, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.29% (4.3779 => 3.4022, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1383, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6844, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2803, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7822, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8709, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -6.50% (1.1594 => 1.0840, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.96% (2.1154 => 2.0527, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7694, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: -2.51% (3.7241 => 3.6307, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.78% (1.6086 => 1.5800, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.55% (4.8776 => 4.8018, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.55% (1.6219 => 1.5968, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 06:57:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 08:57:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105145729.C06BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7340?compare_to=7337&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7340, Order: 171623, Start Time: 2013-01-05 12:41:18, End Time: 2013-01-05 14:57:22 To: 7337, Order: 171614, Start Time: 2013-01-05 09:54:33, End Time: 2013-01-05 12:10:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (604 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.12% (0.0670 => 0.0711, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8467 => 499.8554, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.21% (1.1277 => 499.8554, std.dev.: 0.0034) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.18% (0.5229 => 1.6481, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 20.51% (14.9895 => 18.0640, std.dev.: 0.0304) MultiSource/Applications/kimwitu++/kc: 55.75% (14.1553 => 22.0465, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 16.72% (4.1105 => 4.7976, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.87% (1.1048 => 1.7441, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1350.62% (7.1582 => 103.8385, std.dev.: 0.1042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 130.62% (3.4629 => 7.9861, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.70% (0.6222 => 1.0932, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10224.58% (0.0720 => 7.4337, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 3831500.00% (0.0001 => 3.8316, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11105300.00% (0.0001 => 11.1054, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574300.00% (0.0001 => 0.5744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908100.00% (0.0001 => 9.9082, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491700.00% (0.0001 => 5.4918, std.dev.: 0.0058) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.24% (1.1194 => 10.2676, std.dev.: 0.0024) MultiSource/Applications/ClamAV/clamscan: 148.16% (22.1758 => 55.0323, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0015) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.11% (0.0929 => 0.1794, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 73.00% (0.1463 => 0.2531, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 65.94% (1.5859 => 2.6316, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.67% (2.9384 => 4.6035, std.dev.: 0.0197) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 55.13% (0.0439 => 0.0681, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 54.32% (2.2024 => 3.3987, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.02% (7.0540 => 10.8643, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.89% (0.5105 => 0.7550, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.64% (8.1363 => 11.9309, std.dev.: 0.0066) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.36% (0.6675 => 0.9436, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 40.81% (21.9371 => 30.8898, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.73% (0.4615 => 0.6310, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.24% (4.2646 => 5.8103, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 35.73% (0.3109 => 0.4220, std.dev.: 0.0008) SingleSource/UnitTests/vla: 34.93% (0.0355 => 0.0479, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.89% (0.0814 => 0.1098, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 32.93% (0.1655 => 0.2200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.92% (1.5415 => 2.0489, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.66% (0.2271 => 0.2990, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.22% (0.1906 => 0.2501, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.04% (0.1337 => 0.1752, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 30.59% (0.4299 => 0.5614, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 28.91% (1.1642 => 1.5008, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.74% (3.8922 => 4.9330, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.11% (5.7591 => 7.2630, std.dev.: 0.0157) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.99% (0.3121 => 0.3932, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Oscar: 25.63% (0.0636 => 0.0799, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.38% (0.1584 => 0.1986, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 25.05% (1.0722 => 1.3408, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 24.47% (0.2554 => 0.3179, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.43% (0.0479 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.71% (1.4186 => 1.7549, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.58% (0.0793 => 0.0980, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 23.11% (9.4845 => 11.6761, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.80% (0.1566 => 0.1923, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.54% (0.1695 => 0.2077, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 22.01% (0.7115 => 0.8681, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.52% (1.3050 => 1.5859, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: 20.92% (0.3098 => 0.3746, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.78% (0.2700 => 0.3261, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.25% (0.4636 => 0.5575, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.09% (0.0672 => 0.0807, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.88% (4.9449 => 5.9278, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 19.54% (0.0527 => 0.0630, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 19.54% (1.1840 => 1.4154, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 19.49% (0.0662 => 0.0791, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.32% (0.7835 => 0.9349, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.24% (0.0842 => 0.1004, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.17% (0.1236 => 0.1473, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 19.16% (0.6456 => 0.7693, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.16% (0.1143 => 0.1362, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.12% (5.0018 => 5.9579, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 18.86% (17.1811 => 20.4221, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.85% (0.1029 => 0.1223, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.83% (0.8172 => 0.9711, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 18.82% (0.1695 => 0.2014, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.81% (0.0675 => 0.0802, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.79% (0.5860 => 0.6961, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 18.76% (3.3354 => 3.9611, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 18.75% (0.4289 => 0.5093, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.66% (0.1163 => 0.1380, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.36% (0.0730 => 0.0864, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 17.90% (0.4620 => 0.5447, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.72% (0.0886 => 0.1043, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.69% (0.3307 => 0.3892, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 17.64% (0.1151 => 0.1354, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.61% (0.2107 => 0.2478, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.47% (0.5020 => 0.5897, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 17.43% (0.0614 => 0.0721, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 17.02% (0.3232 => 0.3782, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.01% (0.0770 => 0.0901, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 16.94% (0.3423 => 0.4003, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.93% (0.5569 => 0.6512, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.86% (0.2758 => 0.3223, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.82% (0.1510 => 0.1764, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 16.82% (0.7433 => 0.8683, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 16.64% (0.1268 => 0.1479, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.58% (0.9765 => 1.1384, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 16.57% (2.2969 => 2.6775, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 16.57% (3.8723 => 4.5138, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 16.51% (0.3283 => 0.3825, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.11% (0.0838 => 0.0973, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 16.03% (2.0273 => 2.3522, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.97% (0.5981 => 0.6936, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.74% (0.2065 => 0.2390, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 15.72% (0.8921 => 1.0323, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.28% (0.8101 => 0.9339, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.02% (0.3441 => 0.3958, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.87% (0.6450 => 0.7409, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.18% (0.1044 => 0.1192, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.12% (0.3379 => 0.3856, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.08% (1.1861 => 1.3531, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 14.03% (0.3180 => 0.3626, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 13.94% (0.0818 => 0.0932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3865 => 0.4377, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.18% (0.0759 => 0.0859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.07% (0.8067 => 0.9121, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 12.80% (1.5603 => 1.7600, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.79% (0.2603 => 0.2936, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.37% (0.3387 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.14% (0.4103 => 0.4601, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 11.88% (0.4048 => 0.4529, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.60% (0.3603 => 0.4021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.28% (0.3422 => 0.3808, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.18% (14.3668 => 15.9728, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.06% (0.3473 => 0.3857, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.85% (0.3282 => 0.3638, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.69% (0.3826 => 0.4235, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.48% (0.3427 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.33% (0.2430 => 0.2681, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.14% (0.4064 => 0.4476, std.dev.: 0.0130) MultiSource/Benchmarks/Olden/bh/bh: 10.09% (0.3092 => 0.3404, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 10.07% (10.3673 => 11.4117, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.82% (0.6030 => 0.6622, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.28% (2.0665 => 2.2582, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 9.20% (0.7326 => 0.8000, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.20% (0.1892 => 0.2066, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.09% (0.2871 => 0.3132, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 8.83% (0.2877 => 0.3131, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.77% (0.3650 => 0.3970, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2905 => 0.3159, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.72% (0.2891 => 0.3143, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.67% (1.2842 => 1.3955, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.53% (0.2872 => 0.3117, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (0.2756 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.31% (0.2793 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2725 => 0.2950, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.14% (0.2714 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.94% (63.2438 => 68.2639, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.89% (2.2022 => 2.3539, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (7.9617 => 8.1212, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.15% (32.5116 => 59.2191, std.dev.: 0.0182) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.98% (1.1145 => 1.2926, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3284, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4570, std.dev.: 0.0114) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (3.1578 => 3.3148, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.94% (3.6395 => 3.7830, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.66% (2.0360 => 2.1106, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9183, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (0.9957 => 1.0147, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2447, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2239, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.05% (1.3045 => 1.3182, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.05% (3.8532 => 3.8936, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1681, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.63% (5.2763 => 1.1805, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.96% (0.1622 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.76% (5.3855 => 4.4288, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.16% (5.3526 => 4.4340, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -13.43% (10.4361 => 9.0347, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.73% (1.7609 => 1.6071, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -7.96% (54.1659 => 49.8556, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.26% (1.9577 => 0.6605, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.54% (1.5373 => 1.0217, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4207, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7692, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0070, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.39% (2.5528 => 2.1344, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -11.88% (1.2373 => 1.0903, std.dev.: 0.0050) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.08% (0.9540 => 0.8674, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3068, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4759, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.74% (0.4808 => 0.4580, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8329, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.06% (8.1563 => 7.8248, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1556, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (2.3135 => 2.2801, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.37% (3.6994 => 3.6487, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7221 => 3.6766, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.40% (0.2116 => 0.0711, std.dev.: 0.0013) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 07:03:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 09:03:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105150306.552DB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7341?compare_to=7339&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7341, Order: 171625, Start Time: 2013-01-05 13:28:20, End Time: 2013-01-05 15:03:00 To: 7339, Order: 171620, Start Time: 2013-01-05 11:26:19, End Time: 2013-01-05 13:04:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (98 on baseline) Performance Improvements: 12 (136 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1088 (810 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.40% (1.0840 => 1.0992, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.22% (80.0450 => 81.0240, std.dev.: 0.1455) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -74.11% (86.8850 => 22.4950, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: -18.86% (6.8445 => 5.5536, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: -7.46% (19.4134 => 17.9644, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -6.08% (17.6637 => 16.5898, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.39% (2.2949 => 2.2172, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.62% (2.9649 => 2.8872, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.54% (3.9315 => 3.8711, std.dev.: 0.0056) MultiSource/Applications/oggenc/oggenc: -1.37% (5.3665 => 5.2930, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -1.34% (2.3659 => 2.3341, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.21% (0.9739 => 0.9621, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (2.4181 => 2.3933, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -1.00% (15.6375 => 15.4808, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.50% (0.5456 => 1.1485, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.02% (0.5575 => 1.1597, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.90% (0.5581 => 1.1603, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.65% (0.5567 => 1.1560, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 107.59% (0.5688 => 1.1808, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.29% (0.5805 => 1.1975, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.30% (0.6395 => 1.3065, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.43% (0.5941 => 1.2086, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 102.77% (0.5849 => 1.1860, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.64% (0.6033 => 1.2225, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.42% (0.5859 => 1.1860, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.93% (0.6260 => 1.2641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.72% (0.5478 => 1.0831, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 96.78% (0.6189 => 1.2179, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.68% (0.5569 => 1.0953, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.41% (0.5570 => 1.0940, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.05% (0.5591 => 1.0961, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.02% (0.6440 => 1.2624, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.53% (0.5705 => 1.1155, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.10% (0.6304 => 1.2299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.52% (0.5802 => 1.1286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.60% (0.6395 => 1.2381, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 91.87% (0.6676 => 1.2809, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.61% (0.5925 => 1.1353, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.57% (0.5857 => 1.1220, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.46% (0.6230 => 1.1928, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.39% (0.5863 => 1.1221, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.26% (0.6052 => 1.1575, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.56% (0.6660 => 1.2691, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.29% (0.6194 => 1.1539, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.76% (0.6446 => 1.1974, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.09% (0.6297 => 1.1655, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.29% (0.6681 => 1.2112, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.43% (0.6667 => 1.2029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.12% (0.7524 => 1.3552, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.78% (0.0717 => 0.1246, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.01% (0.7339 => 1.2697, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.50% (0.0974 => 0.1573, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.41% (0.0599 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.81% (0.1132 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.35% (0.0680 => 0.0934, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.59% (1.6474 => 2.2172, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.73% (0.0582 => 0.0755) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.83% (2.2587 => 2.8872, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.89% (0.0699 => 0.0880, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.03% (0.0621 => 0.0764, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.87% (0.5329 => 0.6441, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.35% (0.1081 => 0.1301, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.23% (0.7021 => 0.8231, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.85% (0.4916 => 0.5646, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 13.79% (1.1450 => 1.3029, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.84% (4.5069 => 5.0854, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.58% (0.4515 => 0.5038, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.24% (0.2001 => 0.2226, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 11.08% (0.3357 => 0.3729, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.77% (1.6364 => 1.8127, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1761 => 0.1934, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.54% (3.5339 => 3.8711, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.58% (1.2515 => 1.3339, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.18% (9.2283 => 9.7990, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.73% (1.2784 => 1.3516, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 5.38% (5.0226 => 5.2930, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3255 => 0.3421, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.3864 => 1.4151, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.3722 => 1.3970, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.56% (5.4682 => 5.5536, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.50% (31.3723 => 55.6846, std.dev.: 0.0334) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.99% (1.2783 => 1.3677, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.45% (0.9531 => 1.0146, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 4.04% (3.1932 => 3.3222, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1002, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3674, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.5751 => 56.3602, std.dev.: 0.1336) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6551 => 3.7279, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3036, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6097, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.64% (79.7170 => 81.0240, std.dev.: 0.1455) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.52% (0.2428 => 0.2294, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.34% (0.3821 => 0.3617, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.12% (0.3142 => 0.2981, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.88% (0.9852 => 0.9371, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3880 => 0.3692, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.70% (0.3891 => 0.3708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.69% (0.4176 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.69% (0.4033 => 0.3844, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: -4.36% (0.4199 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.21% (0.3658 => 0.3504, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.11% (0.4280 => 0.4104, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.99% (0.9542 => 0.9161, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.98% (2.4924 => 2.3933, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.86% (1.3148 => 1.2641, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.2695 => 0.2592, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -3.80% (0.2871 => 0.2762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.69% (0.6484 => 0.6245, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (0.3025 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.65% (2.1713 => 2.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.57% (0.3026 => 0.2918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.55% (0.2933 => 0.2829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.54% (0.4151 => 0.4004, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.31% (0.3931 => 0.3801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.25% (0.7919 => 0.7662, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -3.16% (0.7982 => 0.7730, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: -3.11% (4.3330 => 4.1983, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -3.03% (0.7779 => 0.7543, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -3.01% (0.3621 => 0.3512, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -3.00% (17.1032 => 16.5898, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/lists1: -2.87% (0.3867 => 0.3756, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.84% (0.6347 => 0.6167, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.83% (2.4021 => 2.3341, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (1.0544 => 1.0252, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.73% (1.2221 => 1.1887, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.69% (1.2210 => 1.1881, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.68% (1.2300 => 1.1970, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -2.58% (0.6441 => 0.6275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -2.57% (0.4248 => 0.4139, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.52% (6.7716 => 6.6012, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.42% (14.2083 => 13.8639, std.dev.: 0.0134) MultiSource/Applications/JM/lencod/lencod: -2.39% (16.1920 => 15.8054, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.33% (0.5999 => 0.5859, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.31% (0.8521 => 0.8324, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -2.18% (7.0961 => 6.9416, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -2.09% (4.0594 => 3.9747, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -2.02% (34.0927 => 33.4033, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: -1.80% (18.2933 => 17.9644, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: -1.77% (1.5610 => 1.5333, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.71% (0.9077 => 0.8922, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -1.64% (20.7746 => 20.4339, std.dev.: 0.0616) MultiSource/Applications/treecc/treecc: -1.61% (2.1401 => 2.1056, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: -1.54% (0.9179 => 0.9038, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.42% (8.0126 => 7.8989, std.dev.: 0.0152) MultiSource/Applications/ClamAV/clamscan: -1.20% (15.2527 => 15.0696, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.09% (1.8100 => 0.7223, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0692, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1044, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1796, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.30% (4.3779 => 3.4016, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1378, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.09% (1.2842 => 1.1675, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.19% (1.1594 => 1.0992, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1806, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.55% (7.9763 => 7.7726, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: -2.05% (3.7241 => 3.6478, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4716, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8029, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4516 => 1.4368, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 09:25:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 11:25:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130105172533.CB8E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7342?compare_to=7338&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7342, Order: 171625, Start Time: 2013-01-05 13:51:13, End Time: 2013-01-05 17:25:26 To: 7338, Order: 171613, Start Time: 2013-01-05 09:21:04, End Time: 2013-01-05 13:00:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 9 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1090 (711 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel05: 2.18% (0.5404 => 0.5522, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/treeadd/treeadd: 1.63% (10.7534 => 10.9282, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.13% (54.3304 => 54.9435, std.dev.: 0.0206) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -45.26% (23.6852 => 12.9657, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -28.93% (0.8417 => 0.5982, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -14.87% (0.9608 => 0.8179, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.50% (5.5321 => 5.1727, std.dev.: 0.0068) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.40% (0.5222 => 0.4992, std.dev.: 0.0063) MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.00% (0.5205 => 0.4997, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: -2.56% (13.2475 => 12.9086, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: -2.01% (2.2451 => 2.1999, std.dev.: 0.0122) MultiSource/Applications/oggenc/oggenc: -1.72% (2.0383 => 2.0033, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.28% (0.0625 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.47% (0.1063 => 0.1440, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.13% (0.0714 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.48% (0.2969 => 0.3785, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.86% (0.5900 => 0.7485, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.24% (0.4139 => 0.5225, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.96% (0.0547 => 0.0689, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.77% (0.4253 => 0.5349, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 25.74% (1.5932 => 2.0033, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.31% (0.4994 => 0.6258, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.19% (0.1620 => 0.2028, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.39% (0.1021 => 0.1270, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.28% (0.5000 => 0.6214, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 23.10% (0.0948 => 0.1167, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 21.93% (0.1619 => 0.1974, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.16% (0.3903 => 0.4729, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.00% (0.2014 => 0.2437, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 20.18% (0.4029 => 0.4842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.99% (0.2736 => 0.3283, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.95% (0.3890 => 0.4666, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.70% (0.1462 => 0.1750, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 19.40% (0.1505 => 0.1797, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 19.36% (0.5826 => 0.6954, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.23% (1.3152 => 1.5681, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 18.98% (0.5889 => 0.7007, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.91% (0.2866 => 0.3408, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 18.90% (0.9697 => 1.1530, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.78% (0.2875 => 0.3415, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.66% (0.5026 => 0.5964, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 18.40% (0.2750 => 0.3256, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.38% (0.4658 => 0.5514, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 18.35% (0.2823 => 0.3341, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 18.32% (0.5546 => 0.6562, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 18.27% (0.2813 => 0.3327, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.26% (3.5627 => 4.2131, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.25% (0.3271 => 0.3868, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hello: 18.24% (0.2714 => 0.3209, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.19% (0.2792 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 18.19% (0.2803 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.17% (0.2911 => 0.3440, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/fibo: 18.17% (0.2725 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.15% (0.2738 => 0.3235, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 18.14% (0.2811 => 0.3321, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 18.14% (0.7171 => 0.8472, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 18.10% (1.8794 => 2.2196, std.dev.: 0.0067) SingleSource/Regression/C++/ofstream_ctor: 18.08% (0.3004 => 0.3547, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.03% (0.2729 => 0.3221, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 18.01% (0.9909 => 1.1694, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.97% (1.6211 => 1.9124, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.91% (2.0673 => 2.4376, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.85% (0.3362 => 0.3962, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.81% (4.4195 => 5.2064, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 17.77% (0.2780 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 17.68% (0.1284 => 0.1511, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.59% (0.3195 => 0.3757) SingleSource/Benchmarks/Shootout-C++/wc: 17.57% (0.3096 => 0.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.23% (0.3267 => 0.3830, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 17.10% (0.3258 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.96% (0.3060 => 0.3579, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 16.82% (0.3317 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.77% (0.3124 => 0.3648, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 16.75% (1.0781 => 1.2587, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.74% (0.3930 => 0.4588, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 16.64% (23.5202 => 27.4343, std.dev.: 0.0185) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.62% (2.7292 => 3.1828, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.60% (1.9694 => 2.2964, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.48% (0.3282 => 0.3823, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.46% (0.3845 => 0.4478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.44% (0.4361 => 0.5078, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.34% (1.9966 => 2.3229, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/moments: 16.34% (0.3678 => 0.4279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 16.34% (0.3348 => 0.3895, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 16.32% (0.3726 => 0.4334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 16.25% (0.3477 => 0.4042, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.17% (0.3625 => 0.4211, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 16.04% (0.4146 => 0.4811, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.98% (4.2109 => 4.8838, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.96% (0.3690 => 0.4279, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.95% (0.3981 => 0.4616, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.77% (0.3488 => 0.4038, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 15.76% (0.4251 => 0.4921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.76% (0.3465 => 0.4011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3446 => 0.3989, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.65% (0.3469 => 0.4012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.65% (0.3496 => 0.4043, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.64% (0.3460 => 0.4001, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.26% (0.3650 => 0.4207, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.15% (0.3643 => 0.4195, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 15.08% (0.5012 => 0.5768, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 14.89% (1.4269 => 1.6394) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.03% (0.6435 => 0.7338, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.87% (0.7875 => 0.8967, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.64% (0.2068 => 0.2350, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: 13.34% (2.1653 => 2.4542, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.23% (0.1028 => 0.1164, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.23% (0.2737 => 0.3099, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.15% (2.1013 => 2.3777, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 13.06% (4.6177 => 5.2209, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 12.59% (5.5417 => 6.2393, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 12.58% (0.2075 => 0.2336, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.12% (0.3498 => 0.3922, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 11.60% (0.3336 => 0.3723, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.58% (0.5361 => 0.5982, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.39% (11.6398 => 12.9657, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (0.1383 => 0.1536, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.81% (0.6634 => 0.7351, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.25% (0.2040 => 0.2249, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.23% (4.6926 => 5.1727, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.14% (0.7426 => 0.8179, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.38% (0.5584 => 0.6052, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.12% (2.0346 => 2.1999, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 7.97% (11.9555 => 12.9086, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.25% (0.3792 => 0.4029, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5246, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.86% (0.3693 => 0.4057, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2426, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6715, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6880, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2040, std.dev.: 0.0047) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3063, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2898, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.22% (4.0317 => 4.0809, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2090, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5972, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4797, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5697, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.22% (17.2379 => 14.2694, std.dev.: 0.1201) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -10.20% (0.2402 => 0.2157, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: -6.22% (14.0481 => 13.1746, std.dev.: 0.1584) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2185, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8063, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.26% (0.6293 => 0.6151, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1661, std.dev.: 0.0247) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5791, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1524, std.dev.: 0.0817) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0480, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 09:40:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 11:40:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105174023.C04D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7343?compare_to=7340&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7343, Order: 171625, Start Time: 2013-01-05 15:27:33, End Time: 2013-01-05 17:40:17 To: 7340, Order: 171623, Start Time: 2013-01-05 12:41:18, End Time: 2013-01-05 14:57:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (219 on baseline) Performance Improvements: 15 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1081 (603 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (10.8643 => 11.0008, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 5.87% (73.5397 => 77.8582, std.dev.: 0.1365) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -64.27% (103.8385 => 37.1001, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: -21.30% (7.9861 => 6.2848, std.dev.: 0.0230) MultiSource/Applications/kimwitu++/kc: -9.13% (22.0465 => 20.0329, std.dev.: 0.0232) MultiSource/Applications/sqlite3/sqlite3: -6.91% (20.4221 => 19.0106, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.90% (2.6316 => 2.5289, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.11% (3.3987 => 3.2931, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -1.75% (2.6775 => 2.6306, std.dev.: 0.0156) MultiSource/Benchmarks/PAQ8p/paq8p: -1.66% (11.4117 => 11.2222, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.55% (4.9330 => 4.8563, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: -1.39% (18.0640 => 17.8137, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.34% (1.0932 => 1.0786, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.27% (10.2676 => 10.1368, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (0.9436 => 0.9326, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: -1.07% (1.3408 => 1.3265, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.51% (1.3182 => 1.2983, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.31% (0.0711 => 0.0659, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8554 => 499.8433, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 44224.14% (1.1277 => 499.8433, std.dev.: 0.0039) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.01% (0.5229 => 1.6472, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: 18.84% (14.9895 => 17.8137, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 41.52% (14.1553 => 20.0329, std.dev.: 0.0232) MultiSource/Benchmarks/MallocBench/gs/gs: 16.57% (4.1105 => 4.7916, std.dev.: 0.0248) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.89% (1.1048 => 1.7444, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 418.29% (7.1582 => 37.1001, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.49% (3.4629 => 6.2848, std.dev.: 0.0230) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.35% (0.6222 => 1.0786, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10219.44% (0.0720 => 7.4300, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 3831700.00% (0.0001 => 3.8318, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 11095900.00% (0.0001 => 11.0960, std.dev.: 0.0649) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 63900.00% (0.0001 => 0.0640, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908000.00% (0.0001 => 9.9081, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485200.00% (0.0001 => 5.4853, std.dev.: 0.0090) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 805.56% (1.1194 => 10.1368, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 147.27% (22.1758 => 54.8348, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.54% (0.0929 => 0.1798, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 86.35% (0.0271 => 0.0505, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.86% (0.1463 => 0.2529, std.dev.: 0.0001) SingleSource/UnitTests/Vector/sumarray-dbl: 67.06% (0.0170 => 0.0284, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 64.94% (0.0231 => 0.0381) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.46% (1.5859 => 2.5289, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.00% (0.0439 => 0.0698, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.60% (2.9384 => 4.6015, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.95% (7.0540 => 11.0008, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.52% (2.2024 => 3.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346) MultiSource/Benchmarks/FreeBench/distray/distray: 48.01% (0.1056 => 0.1563) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.35% (0.5105 => 0.7522, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.82% (8.1363 => 11.9458, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: 43.77% (0.0265 => 0.0381) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 40.52% (21.9371 => 30.8251, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.72% (0.6675 => 0.9326, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.84% (0.4615 => 0.6315, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.11% (4.2646 => 5.8046, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 36.06% (0.3109 => 0.4230, std.dev.: 0.0005) SingleSource/UnitTests/vla: 34.93% (0.0355 => 0.0479, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.64% (0.0814 => 0.1096, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 33.84% (0.1655 => 0.2215, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.44% (1.5415 => 2.0415, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.71% (0.1337 => 0.1761, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.62% (0.2271 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.43% (0.1906 => 0.2505, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 30.57% (0.4299 => 0.5613, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 28.75% (1.1642 => 1.4989, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 26.70% (0.0719 => 0.0911, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.02% (0.3121 => 0.3933, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 25.79% (0.0636 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.19% (0.1584 => 0.1983, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.17% (5.7591 => 7.2089, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.77% (3.8922 => 4.8563, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/tsp/tsp: 24.68% (0.1175 => 0.1465, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 24.43% (0.2554 => 0.3178, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 23.72% (1.0722 => 1.3265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.37% (1.4186 => 1.7501, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.20% (0.0793 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.80% (0.1566 => 0.1923, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 22.73% (9.4845 => 11.6408, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.65% (0.1695 => 0.2079, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.43% (1.3050 => 1.5847, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.22% (0.7115 => 0.8625, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 21.05% (0.3098 => 0.3750, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.93% (0.2700 => 0.3265, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.32% (0.0886 => 0.1066, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.97% (0.4636 => 0.5562, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.88% (4.9449 => 5.9280, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 19.74% (0.7835 => 0.9382, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 19.65% (0.0626 => 0.0749, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.63% (0.0871 => 0.1042, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.35% (0.0672 => 0.0802, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.20% (0.1151 => 0.1372, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 19.19% (1.1840 => 1.4112, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 19.12% (0.4289 => 0.5109, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/em3d/em3d: 19.06% (0.1695 => 0.2018, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.02% (5.0018 => 5.9533, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/15-trie/trie: 18.98% (0.0527 => 0.0627, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.85% (0.1029 => 0.1223, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.81% (0.0675 => 0.0802, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.68% (0.0953 => 0.1131, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.61% (0.1236 => 0.1466, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.54% (0.8172 => 0.9687, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.5860 => 0.6942, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/messages-2: 18.43% (0.0662 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.40% (3.3354 => 3.9492, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 18.36% (0.6456 => 0.7641, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.67% (0.0730 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 17.66% (0.4620 => 0.5436, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.63% (0.1940 => 0.2282, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.40% (0.5569 => 0.6538, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.14% (0.0770 => 0.0902, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.13% (0.0648 => 0.0759, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 17.11% (0.7433 => 0.8705, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.08% (0.3232 => 0.3784, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.94% (0.3423 => 0.4003, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.89% (0.5020 => 0.5868, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 16.84% (0.2049 => 0.2394, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 16.80% (0.1268 => 0.1481, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.75% (0.2758 => 0.3220, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 16.57% (0.3283 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.54% (0.3307 => 0.3854, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.49% (0.1510 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.49% (0.9765 => 1.1375, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.27% (0.1143 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.10% (0.0770 => 0.0894, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.89% (3.8723 => 4.4878, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.88% (0.2065 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.87% (0.0838 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.78% (0.5981 => 0.6925, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.51% (2.0273 => 2.3418, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 15.24% (0.8921 => 1.0281, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.21% (0.8101 => 0.9333, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.00% (0.3441 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.79% (0.0933 => 0.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.76% (0.6450 => 0.7402, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 14.53% (2.2969 => 2.6306, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3379 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.19% (1.1861 => 1.3544, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.06% (0.3180 => 0.3627, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.60% (0.1044 => 0.1186, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 13.55% (0.1144 => 0.1299, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.18% (0.0759 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3865 => 0.4374, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.15% (0.8067 => 0.9128, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.02% (0.3387 => 0.3828, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.75% (1.5603 => 1.7593, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.64% (0.2603 => 0.2932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.04% (0.3886 => 0.4354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.97% (0.4203 => 0.4706, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.78% (0.3828 => 0.4279, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.60% (0.3473 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.60% (0.3543 => 0.3954, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 11.60% (0.3561 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 11.55% (0.3603 => 0.4019, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.54% (0.3543 => 0.3952, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.50% (0.4103 => 0.4575, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 11.46% (0.4048 => 0.4512, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.20% (0.1330 => 0.1479, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.16% (0.3422 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.09% (0.3282 => 0.3646, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.84% (14.3668 => 15.9244, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.69% (0.3826 => 0.4235, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 10.65% (17.1811 => 19.0106, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 10.45% (0.3092 => 0.3415, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.16% (0.2430 => 0.2677, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.98% (0.3427 => 0.3769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2871 => 0.3155, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.82% (0.2831 => 0.3109, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.6030 => 0.6617, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.2905 => 0.3185, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.62% (0.1892 => 0.2074, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.59% (2.0665 => 2.2647, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 9.52% (0.2877 => 0.3151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5925 => 0.6488, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.36% (0.2756 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.34% (0.2793 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2725 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.24% (0.2891 => 0.3158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7326 => 0.7999, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: 9.15% (0.1268 => 0.1384, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.69% (1.2842 => 1.3958, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.41% (0.3650 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.25% (10.3673 => 11.2222, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3935 => 0.4252, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.86% (63.2438 => 68.2147, std.dev.: 0.0296) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.60% (2.2022 => 2.3696, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.01% (0.4879 => 0.5172, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.51% (0.3131 => 0.3241, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (7.9617 => 8.1264, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2403, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (1.1145 => 1.2927, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3286, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4427, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (3.1578 => 3.3160, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (3.6395 => 3.7750, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.57% (2.0360 => 2.1087, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9226, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.71% (0.9957 => 1.0227, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.06% (1.0313 => 1.0525, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649) MultiSource/Benchmarks/Olden/tsp/tsp: 1.50% (1.0785 => 1.0947, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2425, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2181, std.dev.: 0.0289) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4585, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.59% (5.2763 => 1.1826, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.25% (0.8651 => 0.2141, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.91% (0.1622 => 0.0926, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.49% (5.3855 => 4.4435, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.88% (5.3526 => 4.4489, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -13.35% (10.4361 => 9.0434, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.69% (1.7609 => 1.6078, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.8978, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.36% (1.9577 => 0.6586, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.28% (1.5373 => 1.0257, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4315, std.dev.: 0.0332) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7739, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0057, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.62% (1.2258 => 0.9608) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.27% (2.5528 => 2.1374, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.65% (1.2373 => 1.0932, std.dev.: 0.0032) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4918, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.19% (0.9540 => 0.8663, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.94% (1.5660 => 1.4260) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2578, std.dev.: 0.0352) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5796, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8369, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.20% (8.1563 => 7.8135, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: -1.60% (3.6994 => 3.6402, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2786) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6698, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2295, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8586, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0018) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 10:49:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 12:49:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105184905.295D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7344?compare_to=7341&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7344, Order: 171627, Start Time: 2013-01-05 17:14:27, End Time: 2013-01-05 18:48:59 To: 7341, Order: 171625, Start Time: 2013-01-05 13:28:20, End Time: 2013-01-05 15:03:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (137 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (809 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.61% (0.5456 => 1.1491, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.16% (0.5575 => 1.1605, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.06% (0.5581 => 1.1612, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.76% (0.5567 => 1.1566, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 107.59% (0.5688 => 1.1808, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.34% (0.5805 => 1.1978, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.22% (0.6395 => 1.3060, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.55% (0.5941 => 1.2093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 102.82% (0.5849 => 1.1863, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.80% (0.6033 => 1.2235, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.56% (0.5859 => 1.1868, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.87% (0.6260 => 1.2637, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.85% (0.5478 => 1.0838, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 96.88% (0.6189 => 1.2185, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.88% (0.5569 => 1.0964, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.52% (0.5570 => 1.0946, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.07% (0.6440 => 1.2627, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.96% (0.5591 => 1.0956, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.57% (0.5705 => 1.1157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.21% (0.6304 => 1.2306, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.45% (0.5802 => 1.1282, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.59% (0.6395 => 1.2380, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.02% (0.6676 => 1.2819, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.74% (0.5857 => 1.1230, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.53% (0.5925 => 1.1348, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.46% (0.6230 => 1.1928, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.44% (0.5863 => 1.1224, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.29% (0.6052 => 1.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.74% (0.6660 => 1.2703, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.41% (0.6194 => 1.1546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.84% (0.6446 => 1.1979, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.07% (0.6297 => 1.1654, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.50% (0.6681 => 1.2126, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.44% (0.6667 => 1.2030, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 79.98% (0.7524 => 1.3542, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.14% (0.7339 => 1.2707, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.50% (0.0974 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.41% (0.0599 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.81% (0.1132 => 0.1560, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.65% (0.0680 => 0.0936, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.58% (1.6474 => 2.2171, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.75% (2.2587 => 2.8854, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.04% (0.0699 => 0.0881, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.72% (0.5329 => 0.6433, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.54% (0.1081 => 0.1303, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.22% (0.7021 => 0.8230, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.77% (0.0634 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.87% (0.4916 => 0.5647, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.57% (1.1450 => 1.3004, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (4.5069 => 5.0822, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4515 => 0.5040, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.19% (0.2001 => 0.2225, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 11.14% (0.3357 => 0.3731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.68% (1.6364 => 1.8112, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.77% (0.1761 => 0.1933, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.62% (3.5339 => 3.8740, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.77% (0.1441 => 0.1553, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.26% (1.2515 => 1.3298, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.11% (9.2283 => 9.7917, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.88% (0.3319 => 0.3514, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.75% (1.2784 => 1.3519, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.36% (5.0226 => 5.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.3864 => 1.4152, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3959, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.35% (5.4682 => 5.5419, std.dev.: 0.0133) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.52% (31.3723 => 55.6912, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.90% (0.9531 => 1.0189, std.dev.: 0.0083) MultiSource/Benchmarks/llubenchmark/llu: 5.38% (3.7435 => 3.9450, std.dev.: 0.0726) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (3.1932 => 3.3315, std.dev.: 0.0087) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0981, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5240, std.dev.: 0.1060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3673, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6551 => 3.7283, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3044, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6105, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.07% (0.1584 => 0.1472, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.60% (0.2428 => 0.2292, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.24% (0.7198 => 0.6821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3821 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.09% (0.3142 => 0.2982, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.93% (0.9852 => 0.9366, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3812 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -4.43% (0.3880 => 0.3708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.37% (0.3658 => 0.3498, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.34% (0.3891 => 0.3722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.31% (0.4033 => 0.3859, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/property: -4.12% (0.4199 => 0.4026, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.09% (0.9542 => 0.9152, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.05% (2.4924 => 2.3915, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.96% (0.6484 => 0.6227, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.92% (0.3059 => 0.2939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4280 => 0.4113, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.90% (0.2695 => 0.2590, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.89% (1.3148 => 1.2636, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.86% (0.3057 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.80% (0.7919 => 0.7618, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.71% (2.1713 => 2.0907, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.71% (0.4151 => 0.3997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.70% (0.3026 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.68% (0.2933 => 0.2825, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.68% (0.3205 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.62% (0.2849 => 0.2746, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.54% (0.4321 => 0.4168, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -3.47% (0.2939 => 0.2837, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -3.47% (4.3330 => 4.1827, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: -3.32% (0.7982 => 0.7717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.26% (0.3931 => 0.3803, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.21% (0.7779 => 0.7529, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -3.21% (17.1032 => 16.5540, std.dev.: 0.0138) MultiSource/Applications/siod/siod: -3.00% (2.4021 => 2.3301, std.dev.: 0.0139) SingleSource/UnitTests/ObjC++/Hello: -2.99% (0.6347 => 0.6157, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.86% (1.0544 => 1.0242, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.86% (1.2221 => 1.1872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.82% (1.2210 => 1.1866, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.72% (1.2300 => 1.1965, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (14.2083 => 13.8255, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/moments: -2.64% (0.4248 => 0.4136, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.63% (6.7716 => 6.5932, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: -2.54% (16.1920 => 15.7800, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.37% (0.8521 => 0.8319, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -2.31% (20.7746 => 20.2947, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.28% (0.5999 => 0.5862, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -2.25% (4.0594 => 3.9681, std.dev.: 0.0110) MultiSource/Applications/JM/ldecod/ldecod: -2.21% (7.0961 => 6.9392, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -2.15% (34.0927 => 33.3598, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: -1.96% (18.2933 => 17.9341, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.90% (1.5610 => 1.5314, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: -1.79% (2.1401 => 2.1018, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.72% (0.6736 => 0.6620, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -1.55% (0.9179 => 0.9037, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.51% (0.9077 => 0.8940, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.50% (8.0126 => 7.8928, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: -1.29% (15.2527 => 15.0565, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6923, std.dev.: 0.0357) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.87% (8.0445 => 5.3199, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.54% (1.3643 => 1.0295, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3254, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7493, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0584, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1790, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.20% (4.3779 => 3.4058, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.32% (0.3418 => 0.2826, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.93% (0.4092 => 0.3522, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1980, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.27% (0.5142 => 0.4614, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7814, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8719, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.49% (1.1594 => 1.0957, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.16% (3.1919 => 3.0590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7705, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: -2.32% (3.7241 => 3.6376, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.83% (1.6086 => 1.5791, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.64% (4.8776 => 4.7976, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4762, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4351, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0443 => 1.0332, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 12:23:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 14:23:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105202309.63E822A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7345?compare_to=7343&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7345, Order: 171627, Start Time: 2013-01-05 18:10:31, End Time: 2013-01-05 20:23:02 To: 7343, Order: 171625, Start Time: 2013-01-05 15:27:33, End Time: 2013-01-05 17:40:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (605 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.01% (3.8323 => 3.7554, std.dev.: 0.0126) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0659 => 0.0658, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8433 => 499.8471, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.47% (1.1277 => 499.8471, std.dev.: 0.0124) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.32% (0.5229 => 1.6436, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 18.73% (14.9895 => 17.7976, std.dev.: 0.0214) MultiSource/Applications/kimwitu++/kc: 41.55% (14.1553 => 20.0368, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: 16.49% (4.1105 => 4.7884, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.91% (1.1048 => 1.7446, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 417.57% (7.1582 => 37.0484, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.80% (3.4629 => 6.2954, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.61% (0.6222 => 1.0802, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10214.17% (0.0720 => 7.4262, std.dev.: 0.0083) MultiSource/Applications/SIBsim4/SIBsim4: 3831800.00% (0.0001 => 3.8319, std.dev.: 0.0047) MultiSource/Applications/SPASS/SPASS: 11067600.00% (0.0001 => 11.0677, std.dev.: 0.0688) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490800.00% (0.0001 => 5.4909, std.dev.: 0.0034) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 806.93% (1.1194 => 10.1522, std.dev.: 0.0170) MultiSource/Applications/ClamAV/clamscan: 147.39% (22.1758 => 54.8606, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 114.40% (0.0243 => 0.0521) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.76% (0.0929 => 0.1800, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 86.35% (0.0271 => 0.0505, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/factor: 79.73% (0.0296 => 0.0532, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 73.07% (0.1463 => 0.2532, std.dev.: 0.0005) SingleSource/Regression/C/sumarray: 64.94% (0.0231 => 0.0381, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.72% (1.5859 => 2.5330, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.45% (0.0439 => 0.0700, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.47% (2.9384 => 4.5976, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.95% (7.0540 => 10.9300, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.71% (2.2024 => 3.2973, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.73% (0.1056 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.05% (0.5105 => 0.7507, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.00% (8.1363 => 11.9604, std.dev.: 0.0037) SingleSource/UnitTests/Vector/multiplies: 45.16% (0.0279 => 0.0405, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: 43.40% (0.0265 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.35% (21.9371 => 30.7894, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.90% (0.6675 => 0.9338, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/04-bisect/bisect: 39.08% (0.1062 => 0.1477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.23% (0.4615 => 0.6333, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.02% (4.2646 => 5.8008, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 35.77% (0.3109 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.89% (0.0814 => 0.1098, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 34.02% (0.1655 => 0.2218, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.79% (0.1906 => 0.2531, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0446, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.84% (0.2271 => 0.2994, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.79% (0.1337 => 0.1762, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 31.19% (0.4299 => 0.5640, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4950, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 26.84% (0.0719 => 0.0912, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.76% (0.1125 => 0.1426, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.47% (0.0408 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.02% (0.3121 => 0.3933, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Oscar: 25.79% (0.0636 => 0.0800, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.19% (5.7591 => 7.2099, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.94% (3.8922 => 4.8630, std.dev.: 0.0217) MultiSource/Benchmarks/Olden/tsp/tsp: 24.43% (0.1175 => 0.1462, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 24.16% (0.2554 => 0.3171, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 23.98% (1.0722 => 1.3293, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.33% (0.0793 => 0.0978, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 22.97% (9.4845 => 11.6635, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.97% (1.4186 => 1.7445, std.dev.: 0.0146) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.92% (0.1566 => 0.1925, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.77% (0.1695 => 0.2081, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.63% (1.3050 => 1.5873, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 21.14% (0.3098 => 0.3753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.01% (0.7115 => 0.8610, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.74% (0.2700 => 0.3260, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.99% (4.9449 => 5.9335, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.98% (0.0871 => 0.1045, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.54% (0.4636 => 0.5542, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 19.54% (0.7835 => 0.9366, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.49% (0.0672 => 0.0803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 19.14% (1.1840 => 1.4106, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.08% (5.0018 => 5.9563, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.05% (0.1029 => 0.1225, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.00% (0.0842 => 0.1002) MultiSource/Benchmarks/McCat/15-trie/trie: 18.98% (0.0527 => 0.0627, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.81% (0.0675 => 0.0802, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.77% (0.1236 => 0.1468, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 18.74% (0.1163 => 0.1381, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.71% (0.8172 => 0.9701, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.68% (0.0953 => 0.1131, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 18.58% (0.0662 => 0.0785, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 18.57% (0.6456 => 0.7655, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 18.54% (3.3354 => 3.9538, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.5860 => 0.6942, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 18.24% (0.0614 => 0.0726, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 18.16% (0.4289 => 0.5068, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.89% (0.1940 => 0.2287, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 17.76% (0.3423 => 0.4031, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.72% (0.0886 => 0.1043, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 17.64% (0.1151 => 0.1354, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 17.60% (0.4620 => 0.5433, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.23% (0.3232 => 0.3789, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.93% (0.5020 => 0.5870, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 16.72% (0.1268 => 0.1480, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.71% (0.1143 => 0.1334, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.69% (0.3283 => 0.3831, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.69% (0.3307 => 0.3859, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.69% (0.1510 => 0.1762, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.66% (0.9765 => 1.1392, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.59% (0.5569 => 0.6493, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 16.36% (0.7433 => 0.8649, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.33% (0.2107 => 0.2451, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.27% (0.2065 => 0.2401, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.99% (0.0838 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.97% (0.0770 => 0.0893, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.87% (0.5981 => 0.6930, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.71% (3.8723 => 4.4808, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 15.71% (2.0273 => 2.3457, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.60% (0.8101 => 0.9365, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.24% (0.6450 => 0.7433, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.8921 => 1.0266, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.05% (0.3441 => 0.3959, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.62% (0.3379 => 0.3873, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 14.40% (2.2969 => 2.6277, std.dev.: 0.0212) MultiSource/Benchmarks/McCat/09-vor/vor: 14.03% (0.3180 => 0.3626, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.97% (1.1861 => 1.3518, std.dev.: 0.0090) SingleSource/UnitTests/SignlessTypes/rem: 13.72% (0.1144 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.60% (0.1044 => 0.1186, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.31% (0.0759 => 0.0860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.30% (0.8067 => 0.9140, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.01% (0.3865 => 0.4368, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.75% (0.2603 => 0.2935, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 12.58% (0.3387 => 0.3813, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 12.57% (1.5603 => 1.7565, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 12.30% (0.3927 => 0.4410, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.99% (0.4203 => 0.4707, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.91% (0.4048 => 0.4530, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.72% (0.4103 => 0.4584, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-4: 11.66% (0.3543 => 0.3956, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.49% (0.3543 => 0.3950, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 11.46% (0.3603 => 0.4016, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.42% (0.3694 => 0.4116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 11.37% (0.3561 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.32% (0.3826 => 0.4259, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.24% (0.3282 => 0.3651, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.88% (14.3668 => 15.9301, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 10.77% (17.1811 => 19.0313, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.53% (0.4064 => 0.4492, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.36% (0.3427 => 0.3782, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.21% (0.2430 => 0.2678, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.12% (0.2905 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.78% (0.1892 => 0.2077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.72% (0.6030 => 0.6616, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.62% (0.5925 => 0.6495, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (2.0665 => 2.2652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3162 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2725 => 0.2980, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.31% (0.1268 => 0.1386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.18% (0.1438 => 0.1570, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.10% (0.7326 => 0.7993, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2793 => 0.3047, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.00% (0.2877 => 0.3136, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.62% (0.3052 => 0.3315, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.53% (1.2842 => 1.3937, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3935 => 0.4254, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.04% (0.3136 => 0.3388, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 7.68% (63.2438 => 68.0991, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.30% (2.2022 => 2.3629, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.19% (10.3673 => 11.1127, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3817 => 0.3967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.3131 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (7.9617 => 8.1446, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2421, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.24% (1.1396 => 1.2449, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3290, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4673, std.dev.: 0.0090) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.82% (3.6395 => 3.7784, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.69% (2.0360 => 2.1112, std.dev.: 0.0152) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9125, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.98% (0.8333 => 0.8498, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2433, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2196, std.dev.: 0.0257) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.57% (5.2763 => 1.1834, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -44.08% (0.1622 => 0.0907, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.56% (5.3855 => 4.4397, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.06% (5.3526 => 4.4396, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -13.41% (10.4361 => 9.0363, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.47% (1.7609 => 1.6118, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9022, std.dev.: 0.0402) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.49% (1.9577 => 0.6561, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3058, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.52% (1.5373 => 1.0220, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4346, std.dev.: 0.0235) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7781, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0076, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.69% (2.9695 => 2.2956, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.66% (0.0757 => 0.0593, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.62% (1.2258 => 0.9608, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.04% (0.2161 => 0.1728, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.41% (2.5528 => 2.1338, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7342, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: -11.59% (1.2373 => 1.0939, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2988, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7065, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5733, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.45% (1.5835 => 1.5130, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8354, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.20% (8.1563 => 7.8141, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -3.82% (3.2827 => 3.1572, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.73% (3.7221 => 3.6576, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3298, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -1.57% (3.6994 => 3.6415, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0018) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 12:46:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 14:46:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105204645.C4FC02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7346?compare_to=7344&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7346, Order: 171631, Start Time: 2013-01-05 19:12:18, End Time: 2013-01-05 20:46:39 To: 7344, Order: 171627, Start Time: 2013-01-05 17:14:27, End Time: 2013-01-05 18:48:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (810 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.28% (0.3663 => 0.3783, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -4.67% (3.9450 => 3.7608, std.dev.: 0.0347) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.47% (0.5456 => 1.1483, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.88% (0.5581 => 1.1602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 107.78% (0.5575 => 1.1584, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 107.52% (0.5688 => 1.1804, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.51% (0.5567 => 1.1552, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.18% (0.5805 => 1.1969, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.25% (0.6395 => 1.3062, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.13% (0.5941 => 1.2068, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.60% (0.6033 => 1.2223, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 102.53% (0.5849 => 1.1846, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.36% (0.5859 => 1.1856, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.65% (0.6260 => 1.2623, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.48% (0.5478 => 1.0818, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 96.82% (0.6189 => 1.2181, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.55% (0.5569 => 1.0946, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.28% (0.5570 => 1.0933, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 95.98% (0.6440 => 1.2621, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.69% (0.5591 => 1.0941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.09% (0.5705 => 1.1130, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 94.86% (0.6304 => 1.2284, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.14% (0.5802 => 1.1264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.20% (0.6395 => 1.2355, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 91.79% (0.6676 => 1.2804, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.53% (0.5857 => 1.1218, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.37% (0.5863 => 1.1220, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.36% (0.5925 => 1.1338, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.19% (0.6230 => 1.1911, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.13% (0.6052 => 1.1567, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.45% (0.6660 => 1.2684, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.10% (0.6194 => 1.1527, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.59% (0.6446 => 1.1963, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 84.72% (0.6297 => 1.1632, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.07% (0.6681 => 1.2097, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.20% (0.6667 => 1.2014, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 79.85% (0.7524 => 1.3532, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.92% (0.0717 => 0.1247, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 72.99% (0.7339 => 1.2696, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.09% (0.0974 => 0.1569, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 47.07% (0.1500 => 0.2206, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.41% (0.0599 => 0.0859, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.72% (0.1132 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.35% (0.0680 => 0.0934, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.58% (1.6474 => 2.2170, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.63% (2.2587 => 2.8827, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.89% (0.0699 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.28% (0.0622 => 0.0773, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.87% (0.5329 => 0.6441, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.26% (0.7021 => 0.8233, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.77% (0.4916 => 0.5642, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 13.58% (1.1450 => 1.3005, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (4.5069 => 5.0831, std.dev.: 0.0060) SingleSource/Benchmarks/McGill/exptree: 12.38% (0.0864 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4515 => 0.5040, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.90% (0.3357 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.83% (1.6364 => 1.8137, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.56% (3.5339 => 3.8717, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 9.54% (0.1761 => 0.1929, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.35% (1.2515 => 1.3310, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (9.2283 => 9.7994, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.77% (1.2784 => 1.3521, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3319 => 0.3501, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 5.14% (5.0226 => 5.2807, std.dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.3864 => 1.4147, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.84% (1.3722 => 1.3975, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 1.51% (0.6750 => 0.6852, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.41% (5.4682 => 5.5451, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.53% (31.3723 => 55.6952, std.dev.: 0.0287) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.09% (0.9531 => 1.0207, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.31% (3.1932 => 3.3309, std.dev.: 0.0086) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0987, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5332, std.dev.: 0.0892) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.28% (5.1955 => 5.3657, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6551 => 3.7288, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3030, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6093, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.53% (10.3489 => 10.5070, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.20% (0.1584 => 0.1470, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.56% (0.2428 => 0.2293, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.24% (0.7198 => 0.6821, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.23% (0.3821 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.16% (0.3142 => 0.2980, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.00% (0.9852 => 0.9359, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.32% (0.3658 => 0.3500, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -4.28% (2.4924 => 2.3858, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.21% (0.3323 => 0.3183, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.12% (0.9542 => 0.9149, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3831 => 0.3681, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.91% (0.7919 => 0.7609, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3812 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.90% (0.3896 => 0.3744, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3884 => 0.3733, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3880 => 0.3730, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.86% (0.2695 => 0.2591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.86% (0.6484 => 0.6234, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.85% (0.3848 => 0.3700, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.4176 => 0.4017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.76% (0.3057 => 0.2942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.75% (0.3891 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.4033 => 0.3883, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.67% (1.3148 => 1.2665, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -3.67% (0.4199 => 0.4045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.61% (0.3016 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.51% (0.2903 => 0.2801, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.49% (0.4321 => 0.4170, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.46% (4.3330 => 4.1830, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.45% (2.1713 => 2.0964, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.44% (0.3252 => 0.3140, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.44% (0.3026 => 0.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.42% (0.4151 => 0.4009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -3.35% (0.7982 => 0.7715, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -3.34% (0.4280 => 0.4137, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.28% (0.3931 => 0.3802, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -3.08% (17.1032 => 16.5764, std.dev.: 0.0084) MultiSource/Applications/siod/siod: -3.03% (2.4021 => 2.3292, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -2.94% (0.3406 => 0.3306, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.88% (1.0544 => 1.0240, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.82% (0.7779 => 0.7560, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.77% (1.2210 => 1.1872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.69% (0.4427 => 0.4308) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.63% (1.2300 => 1.1977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.61% (0.3867 => 0.3766, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.57% (0.6347 => 0.6184, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.55% (1.2221 => 1.1909, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8504, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference-object: -2.52% (0.6441 => 0.6279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.47% (0.4248 => 0.4143, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7930, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.46% (6.7716 => 6.6048, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.37% (0.5999 => 0.5857, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.31% (0.8521 => 0.8324, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -2.29% (7.0961 => 6.9334, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -2.20% (4.0594 => 3.9699, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -2.10% (18.2933 => 17.9099, std.dev.: 0.0172) SingleSource/UnitTests/Vector/constpool: -1.98% (20.7746 => 20.3638, std.dev.: 0.0361) MultiSource/Benchmarks/Bullet/bullet: -1.83% (34.0927 => 33.4698, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -1.74% (1.5610 => 1.5339, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -1.73% (0.9179 => 0.9020, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.62% (0.6736 => 0.6627, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: -1.58% (2.1401 => 2.1063, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.43% (0.9077 => 0.8947, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.29% (8.0126 => 7.9093, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -1.14% (15.2527 => 15.0790, std.dev.: 0.0196) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3962, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.02% (8.0445 => 5.3081, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.46% (1.3643 => 1.0306, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0654, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1050, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.52% (4.1024 => 3.1786, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.26% (4.3779 => 3.4033, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.82% (2.5106 => 2.1385, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.93% (0.4092 => 0.3522, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6842, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2802, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7821, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8716, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.67% (1.1594 => 1.0937, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: -2.69% (3.7241 => 3.6239, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7625, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.3096 => 1.2823, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.68% (4.8776 => 4.7958, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.51% (1.6086 => 1.5843, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6693, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 13:50:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 15:50:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130105215031.B0CCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7347?compare_to=7342&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7347, Order: 171627, Start Time: 2013-01-05 18:16:30, End Time: 2013-01-05 21:50:25 To: 7342, Order: 171625, Start Time: 2013-01-05 13:51:13, End Time: 2013-01-05 17:25:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (707 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.60% (2.0623 => 2.1159, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.40% (54.9435 => 54.1766, std.dev.: 0.2819) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.76% (0.0625 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.75% (0.1063 => 0.1443, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.55% (0.2969 => 0.3787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.85% (0.1106 => 0.1403, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.53% (0.5900 => 0.7465, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.19% (0.4139 => 0.5223, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.03% (0.4994 => 0.6294, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.03% (0.4253 => 0.5360, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.62% (1.5932 => 2.0013, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.72% (0.5000 => 0.6236, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.31% (0.1107 => 0.1365, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.13% (0.1604 => 0.1959, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.69% (0.1549 => 0.1885, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.37% (0.3903 => 0.4737, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.00% (0.2014 => 0.2437, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.47% (0.2736 => 0.3296, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 20.20% (0.4029 => 0.4843, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 20.03% (0.1218 => 0.1462, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 19.87% (0.1505 => 0.1804, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.57% (1.3152 => 1.5726, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 19.53% (0.5826 => 0.6964, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.46% (0.3890 => 0.4647, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.43% (0.2866 => 0.3423, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 19.15% (0.5889 => 0.7017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.96% (0.2875 => 0.3420, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 18.95% (0.9697 => 1.1535, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.79% (0.2911 => 0.3458, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 18.61% (0.5546 => 0.6578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 18.56% (0.2823 => 0.3347, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 18.55% (0.2750 => 0.3260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 18.52% (0.7171 => 0.8499, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.52% (0.2738 => 0.3245, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 18.49% (0.2813 => 0.3333, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 18.41% (0.3004 => 0.3557, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.38% (0.4658 => 0.5514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.37% (0.2792 => 0.3305, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.36% (0.5026 => 0.5949, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 18.31% (0.2714 => 0.3211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 18.29% (0.2811 => 0.3325, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.27% (3.5627 => 4.2135, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: 18.25% (0.9909 => 1.1717, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 18.23% (0.2803 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.22% (2.0673 => 2.4440, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.21% (0.2729 => 0.3226, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 18.17% (0.3362 => 0.3973, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (1.8794 => 2.2188, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.04% (4.4195 => 5.2167, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 17.99% (0.2780 => 0.3280, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.94% (0.3060 => 0.3609, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.85% (0.3271 => 0.3855, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.83% (1.6211 => 1.9101, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 17.73% (0.3096 => 0.3645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.62% (0.3195 => 0.3758, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 17.45% (0.3267 => 0.3837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.37% (0.3282 => 0.3852, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 17.25% (0.3258 => 0.3820, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 17.13% (0.1284 => 0.1504, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.03% (1.9694 => 2.3048, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 17.00% (0.3317 => 0.3881, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.93% (0.3124 => 0.3653, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.92% (0.3930 => 0.4595, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 16.84% (0.2566 => 0.2998, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.79% (0.1090 => 0.1273, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 16.78% (23.5202 => 27.4661, std.dev.: 0.0175) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.64% (0.3845 => 0.4485, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.63% (2.7292 => 3.1830, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 16.60% (1.0781 => 1.2571, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 16.53% (0.3678 => 0.4286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 16.50% (0.4146 => 0.4830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 16.49% (0.3348 => 0.3900, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.42% (1.9966 => 2.3245, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/sieve: 16.40% (0.3726 => 0.4337, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 16.39% (0.3477 => 0.4047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.33% (0.4361 => 0.5073, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 16.21% (4.2109 => 4.8935, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 16.13% (0.3465 => 0.4024, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.11% (0.3625 => 0.4209, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.05% (0.3981 => 0.4620, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 16.05% (0.3446 => 0.3999, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.04% (0.3690 => 0.4282, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 16.04% (0.3442 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.03% (0.3488 => 0.4047, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/synchronized: 15.94% (0.3469 => 0.4022, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.92% (0.3460 => 0.4011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.88% (0.3496 => 0.4051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 15.83% (0.4251 => 0.4924, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 15.54% (0.3643 => 0.4209, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: 15.48% (0.3650 => 0.4215, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.36% (0.3724 => 0.4296, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 15.12% (0.5012 => 0.5770, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.72% (1.4269 => 1.6370, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.09% (0.6435 => 0.7342, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.08% (0.7875 => 0.8984, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.45% (2.1653 => 2.4566, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.2737 => 0.3101, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.22% (4.6177 => 5.2282, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 13.02% (2.1013 => 2.3748, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.94% (0.1028 => 0.1161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 12.92% (0.2075 => 0.2343, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.56% (0.0804 => 0.0905, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.52% (0.2068 => 0.2327, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2325, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: 12.12% (0.3498 => 0.3922, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.96% (0.3084 => 0.3453, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 11.72% (0.3336 => 0.3727, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.38% (0.5361 => 0.5971, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.27% (11.6398 => 12.9513, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.2103 => 0.2329, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.72% (0.6634 => 0.7345, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.49% (0.2040 => 0.2254, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.16% (4.6926 => 5.1696, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.78% (0.7426 => 0.8152, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 8.70% (0.2391 => 0.2599, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.22% (0.5584 => 0.6043, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 8.04% (2.0346 => 2.1982, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 7.94% (11.9555 => 12.9048, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.51% (0.3792 => 0.4039, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5278, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.72% (0.3693 => 0.4052, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2398, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6717, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 4.90% (0.2122 => 0.2226, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6779, std.dev.: 0.0085) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.63% (2.0820 => 2.1159, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3070, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.16% (4.0317 => 4.0785, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5867, std.dev.: 0.0394) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4770, std.dev.: 0.0080) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.29% (2.4764 => 2.4197, std.dev.: 0.0088) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.93% (25.4195 => 16.5412, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691) SingleSource/Benchmarks/Dhrystone/fldry: -16.54% (17.2379 => 14.3866, std.dev.: 0.0557) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1016, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9802, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7923, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.30% (14.0481 => 13.3035, std.dev.: 0.1692) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2240, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8050, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7748, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.81% (0.6293 => 0.6116, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1837, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5720, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (105.3826 => 104.0882, std.dev.: 0.1110) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 14:44:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 16:44:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130105224429.BB5712A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7348?compare_to=7346&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7348, Order: 171633, Start Time: 2013-01-05 21:09:49, End Time: 2013-01-05 22:44:22 To: 7346, Order: 171631, Start Time: 2013-01-05 19:12:18, End Time: 2013-01-05 20:46:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (144 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (804 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.28% (0.5456 => 1.1473, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.83% (0.5581 => 1.1599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 107.79% (0.5688 => 1.1819, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 107.70% (0.5575 => 1.1579, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.45% (0.5567 => 1.1549, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.17% (0.5805 => 1.1968, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.10% (0.6395 => 1.3052, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.30% (0.5941 => 1.2078, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 102.63% (0.5849 => 1.1852, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.62% (0.6033 => 1.2224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.42% (0.5859 => 1.1860, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.73% (0.6260 => 1.2628, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.63% (0.5478 => 1.0826, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 96.75% (0.6189 => 1.2177, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.50% (0.5569 => 1.0943, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.34% (0.5570 => 1.0936, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 95.92% (0.6440 => 1.2617, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.69% (0.5591 => 1.0941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.23% (0.6304 => 1.2307, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.18% (0.5705 => 1.1135, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.31% (0.5802 => 1.1274, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.14% (0.6395 => 1.2351, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 91.88% (0.6676 => 1.2810, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.45% (0.5857 => 1.1213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.36% (0.5925 => 1.1338, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.35% (0.5863 => 1.1219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.30% (0.6230 => 1.1918, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.14% (0.6052 => 1.1568, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.50% (0.6660 => 1.2687, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.15% (0.6194 => 1.1530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.71% (0.6446 => 1.1971, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 84.74% (0.6297 => 1.1633, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.07% (0.6681 => 1.2097, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.20% (0.6667 => 1.2014, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 79.82% (0.7524 => 1.3530, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.64% (0.0717 => 0.1245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.06% (0.7339 => 1.2701, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.67% (0.0514 => 0.0831, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.99% (0.0974 => 0.1568, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.40% (0.1500 => 0.2196, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.24% (0.0599 => 0.0858, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.63% (0.1132 => 0.1558, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.21% (0.0680 => 0.0933, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.55% (1.6474 => 2.2166, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.38% (0.0582 => 0.0753, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.74% (2.2587 => 2.8853, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.61% (0.0699 => 0.0878, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.95% (0.0622 => 0.0771) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.03% (0.0621 => 0.0764, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.64% (0.5329 => 0.6429, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.35% (0.1081 => 0.1301, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.16% (0.7021 => 0.8226, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.77% (0.0634 => 0.0734, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.77% (0.4916 => 0.5642, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 13.57% (1.1450 => 1.3004, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (4.5069 => 5.0795, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 12.38% (0.0864 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.47% (0.4515 => 0.5033, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 10.90% (0.3357 => 0.3723, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.71% (1.6364 => 1.8117, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.60% (3.5339 => 3.8733, std.dev.: 0.0191) SingleSource/Benchmarks/McGill/chomp: 9.43% (0.1761 => 0.1927, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.36% (0.1441 => 0.1547, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.28% (1.2515 => 1.3301, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (9.2283 => 9.7893, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (1.2784 => 1.3510, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3319 => 0.3502, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 5.27% (5.0226 => 5.2875, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.3864 => 1.4152, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.3722 => 1.3957, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.37% (5.4682 => 5.5431, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.54% (31.3723 => 55.6983, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.66% (0.9531 => 1.0166, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 4.46% (3.1932 => 3.3357, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0990, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5751 => 56.4260, std.dev.: 0.0970) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3672, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6551 => 3.7190, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3044, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6107, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.63% (0.1281 => 0.1132, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.16% (0.3142 => 0.2980, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3821 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.93% (0.7198 => 0.6843, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.92% (0.9852 => 0.9367, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.54% (0.3812 => 0.3639, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -4.46% (0.3831 => 0.3660, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.44% (0.3896 => 0.3723, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.40% (0.3884 => 0.3713, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3848 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.33% (0.4176 => 0.3995, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.32% (0.3658 => 0.3500, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.32% (0.3891 => 0.3723, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.28% (2.4924 => 2.3857, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -4.21% (0.2871 => 0.2750, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.15% (0.3057 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.15% (0.9542 => 0.9146, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.14% (0.4199 => 0.4025, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.98% (0.6484 => 0.6226, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.96% (1.3148 => 1.2627, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: -3.96% (0.3205 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.93% (0.7919 => 0.7608, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.90% (0.2849 => 0.2738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.89% (0.2933 => 0.2819, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.88% (0.4280 => 0.4114, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.86% (2.1713 => 2.0875, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -3.79% (0.3059 => 0.2943, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.75% (0.4321 => 0.4159, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.75% (0.2695 => 0.2594, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.74% (0.2939 => 0.2829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.73% (0.4151 => 0.3996, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -3.60% (4.3330 => 4.1769, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -3.60% (0.7982 => 0.7695, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.59% (0.3931 => 0.3790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.45% (0.2989 => 0.2886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.27% (0.7779 => 0.7525, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.17% (2.4021 => 2.3260, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.12% (0.3621 => 0.3508, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.09% (0.6441 => 0.6242, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.98% (1.0544 => 1.0230, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -2.96% (17.1032 => 16.5962, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.96% (0.3483 => 0.3380, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -2.94% (0.3406 => 0.3306, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.92% (1.2210 => 1.1853, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.89% (1.2221 => 1.1868, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -2.78% (0.4248 => 0.4130, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.74% (1.2300 => 1.1963, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.66% (6.7716 => 6.5918, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8398, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.50% (0.5999 => 0.5849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.50% (0.4083 => 0.3981, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.50% (16.1920 => 15.7876, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.43% (0.8521 => 0.8314, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.32% (7.0961 => 6.9314, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -2.24% (18.2933 => 17.8840, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -2.11% (34.0927 => 33.3719, std.dev.: 0.0120) MultiSource/Applications/lua/lua: -1.99% (4.0594 => 3.9785, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -1.98% (20.7746 => 20.3641, std.dev.: 0.0339) MultiSource/Applications/hbd/hbd: -1.88% (1.5610 => 1.5317, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: -1.72% (2.1401 => 2.1032, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.72% (0.6736 => 0.6620, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: -1.69% (0.9179 => 0.9024, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.52% (0.9077 => 0.8939, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.33% (8.0126 => 7.9061, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -1.23% (15.2527 => 15.0656, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.68% (1.8100 => 0.6936, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3094, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -23.41% (0.0756 => 0.0579, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0639, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9703 => 2.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.54% (4.1024 => 3.1776, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.38% (4.3779 => 3.3982, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1383, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7816, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6340, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.33% (1.1594 => 1.0976, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3830 => 5.1550, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7611, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.25% (1.3096 => 1.2801, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/ary3: -2.11% (3.7241 => 3.6457, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.94% (1.6086 => 1.5774, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8089, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6686, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.06% (1.4516 => 1.4362, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 15:06:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 17:06:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130105230617.B05CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7349?compare_to=7345&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7349, Order: 171633, Start Time: 2013-01-05 20:53:29, End Time: 2013-01-05 23:06:12 To: 7345, Order: 171627, Start Time: 2013-01-05 18:10:31, End Time: 2013-01-05 20:23:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 3 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.48% (0.6561 => 0.6724, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.93% (11.1127 => 10.8986, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.23% (10.9300 => 10.7961, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: -1.12% (7.2099 => 7.1294, std.dev.: 0.0081) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (0.0658 => 0.0682, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8471 => 499.8417, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 44224.00% (1.1277 => 499.8417, std.dev.: 0.0132) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 212.43% (0.5229 => 1.6337, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 17.89% (14.9895 => 17.6716, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: 41.02% (14.1553 => 19.9618, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 15.87% (4.1105 => 4.7629, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.76% (1.1048 => 1.7319, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 415.50% (7.1582 => 36.9004, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: 80.72% (3.4629 => 6.2580, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 72.66% (0.6222 => 1.0743, std.dev.: 0.0029) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10210.97% (0.0720 => 7.4239, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3832000.00% (0.0001 => 3.8321, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11055700.00% (0.0001 => 11.0558, std.dev.: 0.0322) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574300.00% (0.0001 => 0.5744, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487800.00% (0.0001 => 5.4879, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.83% (1.1194 => 10.2182, std.dev.: 0.0197) MultiSource/Applications/ClamAV/clamscan: 147.80% (22.1758 => 54.9524, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 112.76% (0.0243 => 0.0517) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.79% (0.0929 => 0.1791, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 85.24% (0.0271 => 0.0502, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 78.72% (0.0296 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.98% (0.1463 => 0.2516, std.dev.: 0.0004) SingleSource/UnitTests/Vector/sumarray-dbl: 66.47% (0.0170 => 0.0283, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.81% (1.5859 => 2.5185, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 58.54% (0.0439 => 0.0696, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.77% (2.9384 => 4.6064, std.dev.: 0.0151) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.05% (7.0540 => 10.7961, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 48.98% (2.2024 => 3.2812, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.25% (0.1056 => 0.1555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.54% (8.1363 => 11.9230, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 45.95% (0.5105 => 0.7451, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: 44.44% (0.0279 => 0.0403, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: 42.64% (0.0265 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 40.82% (0.0730 => 0.1028, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 40.11% (21.9371 => 30.7367, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 38.98% (0.6675 => 0.9277, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 37.01% (0.1432 => 0.1962, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.21% (0.4615 => 0.6286, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.20% (4.2646 => 5.7658, std.dev.: 0.0072) MultiSource/Applications/sgefa/sgefa: 34.77% (0.3109 => 0.4190, std.dev.: 0.0001) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 34.40% (0.0814 => 0.1094, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 33.35% (0.1655 => 0.2207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.85% (1.5415 => 2.0325, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.18% (0.2271 => 0.2979, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.90% (0.1906 => 0.2495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.52% (0.1337 => 0.1745, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.87% (0.4299 => 0.5583, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 28.90% (1.1642 => 1.5006, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 26.01% (0.0719 => 0.0906) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.76% (0.3121 => 0.3925, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 25.16% (0.0636 => 0.0796, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.93% (0.0746 => 0.0932, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.49% (0.1584 => 0.1972, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.18% (3.8922 => 4.8335, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 23.88% (0.2554 => 0.3164, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.79% (5.7591 => 7.1294, std.dev.: 0.0081) MultiSource/Applications/lemon/lemon: 23.18% (1.0722 => 1.3207, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.08% (0.0793 => 0.0976, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.31% (1.4186 => 1.7351, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 22.11% (9.4845 => 11.5817, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.09% (0.1566 => 0.1912, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.90% (1.3050 => 1.5777, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/matrix: 20.34% (0.3098 => 0.3728, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 20.32% (0.7115 => 0.8561, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/whetstone: 20.30% (0.0660 => 0.0794, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.89% (0.2700 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.39% (0.4636 => 0.5535, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.27% (4.9449 => 5.8978, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.09% (0.1032 => 0.1229, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.06% (0.0871 => 0.1037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.05% (0.0672 => 0.0800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 19.01% (0.0626 => 0.0745, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 18.58% (0.7835 => 0.9291, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.53% (0.0842 => 0.0998, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.48% (5.0018 => 5.9262, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.37% (0.1236 => 0.1463, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 18.31% (0.1163 => 0.1376, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.27% (0.1029 => 0.1217, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 18.26% (1.1840 => 1.4002, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/em3d/em3d: 18.23% (0.1695 => 0.2004, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.22% (0.0675 => 0.0798, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 18.16% (0.4289 => 0.5068, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.16% (0.5860 => 0.6924, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.05% (0.0953 => 0.1125, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.88% (0.8172 => 0.9633, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/messages-2: 17.82% (0.0662 => 0.0780, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 17.67% (0.6456 => 0.7597, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 17.61% (3.3354 => 3.9226, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.26% (0.0730 => 0.0856, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.16% (0.1940 => 0.2273, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.16% (0.0886 => 0.1038, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 16.94% (0.1151 => 0.1346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 16.86% (0.4620 => 0.5399, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 16.78% (0.0614 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.62% (0.0770 => 0.0898, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.37% (0.3232 => 0.3761, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.35% (0.5020 => 0.5841, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.21% (0.3307 => 0.3843, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.21% (0.2758 => 0.3205, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.11% (0.1117 => 0.1297, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.07% (0.9765 => 1.1334, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.03% (0.1510 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.00% (0.5569 => 0.6460, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.90% (0.2107 => 0.2442, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 15.87% (0.3283 => 0.3804, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.84% (0.1143 => 0.1324, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 15.80% (0.3423 => 0.3964, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 15.54% (0.7433 => 0.8588, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.45% (0.5981 => 0.6905, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 15.21% (3.8723 => 4.4614, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: 15.03% (2.0273 => 2.3320, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.91% (0.8101 => 0.9309, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.47% (0.3441 => 0.3939, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.47% (0.0933 => 0.1068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.42% (0.8921 => 1.0207, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.33% (0.6450 => 0.7374, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 13.97% (0.3379 => 0.3851, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 13.81% (0.0818 => 0.0931, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 13.73% (2.2969 => 2.6123, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 13.40% (0.3180 => 0.3606, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.22% (0.1044 => 0.1182, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.20% (1.1861 => 1.3427, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 13.11% (0.1144 => 0.1294, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.38% (0.8067 => 0.9066, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.37% (0.3865 => 0.4343, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.22% (0.2603 => 0.2921, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 11.96% (0.3387 => 0.3792, std.dev.: 0.0080) MultiSource/Applications/hbd/hbd: 11.76% (1.5603 => 1.7438, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.67% (0.4103 => 0.4582, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 11.23% (0.3694 => 0.4109, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: 11.23% (0.3543 => 0.3941, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.23% (0.4203 => 0.4675, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 11.21% (0.3828 => 0.4257, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.82% (0.4048 => 0.4486, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: 10.66% (0.3603 => 0.3987, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.60% (0.1330 => 0.1471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.46% (0.3422 => 0.3780, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.39% (0.3282 => 0.3623, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.23% (14.3668 => 15.8366, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: 10.12% (0.3684 => 0.4057, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.06% (17.1811 => 18.9089, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.01% (0.3826 => 0.4209, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.74% (0.4064 => 0.4460, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.63% (0.2430 => 0.2664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.45% (0.6030 => 0.6600, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 9.41% (0.3092 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.34% (0.3427 => 0.3747, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.27% (0.5925 => 0.6474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.18% (0.2831 => 0.3091, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.76% (0.7326 => 0.7968, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.68% (2.0665 => 2.2459, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.67% (0.1892 => 0.2056, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.2756 => 0.2992, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.27% (0.2877 => 0.3115, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 8.26% (0.2905 => 0.3145, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2891 => 0.3128, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.18% (0.2714 => 0.2936, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.03% (0.3162 => 0.3416, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.97% (1.2842 => 1.3866, std.dev.: 0.0110) SingleSource/Benchmarks/Stanford/Puzzle: 7.97% (0.1268 => 0.1369, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 7.90% (0.3052 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.89% (0.3650 => 0.3938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.82% (0.2802 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.65% (0.3935 => 0.4236, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 7.61% (63.2438 => 68.0591, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.43% (0.3136 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.64% (2.2022 => 2.3485, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.64% (0.4879 => 0.5154, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 5.12% (10.3673 => 10.8986, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.00% (0.3177 => 0.3336, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3817 => 0.3957, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.53% (7.9617 => 8.0838, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2497, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.98% (1.1145 => 1.2926, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.80% (0.2944 => 0.3262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.90% (11.6436 => 12.3301, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.84% (2.8904 => 3.0592, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4436, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (3.1578 => 3.3163, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.96% (3.6395 => 3.7836, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (2.0360 => 2.1093, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.86% (8.6802 => 8.9287, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 2.20% (0.8333 => 0.8516, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7570, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2446, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fbench: 1.25% (2.2771 => 2.3056, std.dev.: 0.0095) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2128, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.76% (5.2763 => 1.1736, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -74.97% (0.8651 => 0.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -44.39% (0.1622 => 0.0902, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.02% (5.3855 => 4.4150, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.44% (5.3526 => 4.4190, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: -14.00% (10.4361 => 8.9749, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.93% (1.7609 => 1.6037, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9551, std.dev.: 0.0773) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.65% (1.9577 => 0.6724, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4273, std.dev.: 0.0325) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7720, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0052, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -16.37% (2.5528 => 2.1348, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: -12.22% (1.2373 => 1.0861, std.dev.: 0.0077) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2725, std.dev.: 0.0297) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0184) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.48% (10.2830 => 9.8220, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.27% (8.1563 => 7.8084, std.dev.: 0.0121) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0056) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3311, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7221 => 3.6754, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/ary3: -1.25% (3.6994 => 3.6532, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.77% (0.2116 => 0.0682, std.dev.: 0.0017) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 16:42:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 18:42:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106004216.F2EB72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7350?compare_to=7348&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7350, Order: 171639, Start Time: 2013-01-05 23:07:38, End Time: 2013-01-06 00:42:09 To: 7348, Order: 171633, Start Time: 2013-01-05 21:09:49, End Time: 2013-01-05 22:44:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (146 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (802 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.94% (0.5456 => 1.1509, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.26% (0.5581 => 1.1623, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.16% (0.5575 => 1.1605, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.14% (0.5567 => 1.1587, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.02% (0.5688 => 1.1832, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.70% (0.5805 => 1.1999, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.52% (0.6395 => 1.3079, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.91% (0.5941 => 1.2114, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.30% (0.5849 => 1.1891, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.23% (0.6033 => 1.2261, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.90% (0.5859 => 1.1888, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 101.95% (0.6260 => 1.2642, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.79% (0.5478 => 1.0835, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.09% (0.6189 => 1.2198, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.79% (0.5569 => 1.0959, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.48% (0.5570 => 1.0944, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.44% (0.6440 => 1.2651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.01% (0.5591 => 1.0959, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.67% (0.5705 => 1.1163, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.53% (0.6304 => 1.2326, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.76% (0.5802 => 1.1300, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.59% (0.6395 => 1.2380, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.29% (0.6676 => 1.2837, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.75% (0.5925 => 1.1361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.70% (0.5857 => 1.1228, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.64% (0.6230 => 1.1939, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.59% (0.5863 => 1.1233, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.34% (0.6052 => 1.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.86% (0.6660 => 1.2711, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.42% (0.6194 => 1.1547, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.99% (0.6446 => 1.1989, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.17% (0.6297 => 1.1660, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.42% (0.6681 => 1.2121, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.44% (0.7524 => 1.3576, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.41% (0.6667 => 1.2028, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.92% (0.0717 => 0.1247, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.33% (0.7339 => 1.2721, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.70% (0.0974 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.81% (0.1132 => 0.1560, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.35% (1.6474 => 2.2133, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.58% (2.2587 => 2.8817, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.89% (0.0699 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.64% (0.5329 => 0.6429, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.54% (0.1081 => 0.1303, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.16% (0.7021 => 0.8226, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.81% (0.4916 => 0.5644, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 13.60% (1.1450 => 1.3007, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.73% (4.5069 => 5.0806, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/05-eks/eks: 11.65% (0.4515 => 0.5041, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 10.96% (0.3357 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.65% (1.6364 => 1.8107, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.60% (0.1761 => 0.1930, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.45% (3.5339 => 3.8679, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.36% (0.1441 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.21% (9.2283 => 9.8017, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 6.10% (1.2515 => 1.3279, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.72% (1.2784 => 1.3515, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.50% (5.0226 => 5.2990, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (1.3864 => 1.4154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.3722 => 1.3969, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.50% (1.4642 => 1.4861, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7022, std.dev.: 0.0310) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.84% (0.9531 => 1.0183, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 4.18% (3.1932 => 3.3268, std.dev.: 0.0097) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0973, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4766, std.dev.: 0.0548) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.32% (5.1955 => 5.3682, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6551 => 3.7289, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5320 => 4.6157, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3029, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.26% (0.1584 => 0.1469, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.87% (0.3142 => 0.2989, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.85% (0.9852 => 0.9374, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -4.48% (2.4924 => 2.3808, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.41% (0.3831 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.38% (0.3884 => 0.3714, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.37% (0.3658 => 0.3498, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.34% (1.3148 => 1.2578, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.29% (0.3891 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.25% (2.1713 => 2.0790, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.21% (0.3252 => 0.3115, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.21% (0.3896 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3880 => 0.3717, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.17% (0.4151 => 0.3978, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.17% (0.4321 => 0.4141, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.15% (0.7198 => 0.6899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.07% (0.4033 => 0.3869, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.05% (0.4199 => 0.4029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.03% (0.7919 => 0.7600, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4280 => 0.4113, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.88% (0.9542 => 0.9172, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.2695 => 0.2592, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.76% (0.3931 => 0.3783, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.75% (0.7982 => 0.7683, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.73% (0.6484 => 0.6242, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -3.71% (0.2989 => 0.2878, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.71% (4.3330 => 4.1721, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (0.3621 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.37% (0.4427 => 0.4278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.32% (0.6347 => 0.6136, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.29% (2.4021 => 2.3230, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists1: -3.28% (0.3867 => 0.3740, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.09% (0.6441 => 0.6242, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -3.09% (17.1032 => 16.5752, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: -3.06% (0.4248 => 0.4118, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.05% (0.7779 => 0.7542, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.96% (0.3849 => 0.3735, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.93% (1.0544 => 1.0235, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.93% (0.3483 => 0.3381, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.91% (0.4083 => 0.3964, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -2.88% (0.3788 => 0.3679, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.84% (20.7746 => 20.1836, std.dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.75% (1.2300 => 1.1962, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.67% (1.2221 => 1.1895, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.66% (1.2210 => 1.1885, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.64% (14.2083 => 13.8339, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.63% (6.7716 => 6.5936, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -2.55% (18.2933 => 17.8276, std.dev.: 0.0118) MultiSource/Applications/JM/lencod/lencod: -2.44% (16.1920 => 15.7973, std.dev.: 0.0080) MultiSource/Applications/lua/lua: -2.36% (4.0594 => 3.9638, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.35% (0.5999 => 0.5858, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -2.34% (34.0927 => 33.2952, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -2.30% (7.0961 => 6.9326, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.23% (0.8521 => 0.8331, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -2.17% (1.5610 => 1.5271, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -1.80% (2.1401 => 2.1015, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.6736 => 0.6625, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.50% (0.9077 => 0.8941, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.35% (8.0126 => 7.9048, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: -1.23% (15.2527 => 15.0650, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.46% (1.8100 => 0.6795, std.dev.: 0.0108) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.76% (0.6962 => 0.3428, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.03% (1.3643 => 1.0228, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0598, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.73% (2.9703 => 2.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1806, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.20% (4.3779 => 3.4060, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1384, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8710, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.97% (1.1594 => 1.0902, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.55% (7.9763 => 7.7733, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: -2.41% (3.7241 => 3.6342, std.dev.: 0.0303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.95% (1.6086 => 1.5772, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.48% (4.8776 => 4.8052, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6662, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.09% (1.4516 => 1.4358, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.04% (4.4002 => 4.3546, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.02% (1.6307 => 1.6140, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 17:49:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 19:49:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106014915.561112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7351?compare_to=7349&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7351, Order: 171640, Start Time: 2013-01-05 23:36:31, End Time: 2013-01-06 01:49:09 To: 7349, Order: 171633, Start Time: 2013-01-05 20:53:29, End Time: 2013-01-05 23:06:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.02% (0.4035 => 0.4157, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 2.57% (10.8986 => 11.1791, std.dev.: 0.0168) MultiSource/Applications/lambda-0_1_3/lambda: 1.21% (0.8588 => 0.8692, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.47% (0.0682 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8417 => 499.8292, std.dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44222.89% (1.1277 => 499.8292, std.dev.: 0.0096) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.15% (0.5229 => 1.6427, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 18.61% (14.9895 => 17.7797, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 41.75% (14.1553 => 20.0653, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/gs/gs: 16.35% (4.1105 => 4.7825, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.14% (1.1048 => 1.7361, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.10% (7.1582 => 37.2296, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.72% (3.4629 => 6.2928, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.56% (0.6222 => 1.0799, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10218.61% (0.0720 => 7.4294, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 3834900.00% (0.0001 => 3.8350, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11090400.00% (0.0001 => 11.0905, std.dev.: 0.0410) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908500.00% (0.0001 => 9.9086, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0178) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.69% (1.1194 => 10.2279, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 148.61% (22.1758 => 55.1308, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.11% (0.0929 => 0.1794, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 85.24% (0.0271 => 0.0502, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.05% (0.0296 => 0.0530, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.32% (0.1463 => 0.2521, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.23% (0.0439 => 0.0699, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.15% (1.5859 => 2.5240, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.80% (2.9384 => 4.6075, std.dev.: 0.0220) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.28% (7.0540 => 10.8121, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.36% (2.2024 => 3.2895, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.73% (0.1056 => 0.1560, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.97% (8.1363 => 11.9582, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 46.62% (0.5105 => 0.7485, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: 44.44% (0.0279 => 0.0403, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 43.40% (0.0265 => 0.0380) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 40.93% (21.9371 => 30.9165, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.54% (0.6675 => 0.9314, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 37.22% (0.1432 => 0.1965, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.45% (0.4615 => 0.6297, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.76% (4.2646 => 5.7897, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 35.57% (0.3109 => 0.4215, std.dev.: 0.0003) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478) SingleSource/Benchmarks/McGill/exptree: 34.40% (0.0814 => 0.1094, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 33.66% (0.1655 => 0.2212, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.26% (1.5415 => 2.0388, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.31% (0.2271 => 0.2982, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.95% (0.1906 => 0.2496, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.37% (0.1337 => 0.1743, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 30.03% (0.4299 => 0.5590, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 28.16% (1.1642 => 1.4920, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.83% (0.3121 => 0.3927, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/Oscar: 25.31% (0.0636 => 0.0797, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 24.90% (0.2554 => 0.3190, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.68% (0.1584 => 0.1975, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.63% (3.8922 => 4.8509, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 24.35% (5.7591 => 7.1612, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 23.46% (1.0722 => 1.3237, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.95% (0.0793 => 0.0975, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.85% (1.4186 => 1.7428, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.65% (0.1695 => 0.2079, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.60% (9.4845 => 11.6281, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.22% (0.1566 => 0.1914, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.22% (0.2700 => 0.3273, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 21.07% (0.1163 => 0.1408, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.07% (1.3050 => 1.5799, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 20.77% (0.7115 => 0.8593, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.75% (0.0886 => 0.1061, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.74% (0.4636 => 0.5551, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.56% (4.9449 => 5.9122, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.49% (0.0672 => 0.0803, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.1695 => 0.2024, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 19.33% (0.0626 => 0.0747, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.81% (5.0018 => 5.9426, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 18.79% (0.7835 => 0.9307, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 18.62% (1.1840 => 1.4045, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.61% (0.1236 => 0.1466, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 18.51% (0.4289 => 0.5083, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.31% (0.5860 => 0.6933, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 18.31% (0.6456 => 0.7638, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.15% (0.0953 => 0.1126, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 18.13% (0.0662 => 0.0782, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 18.08% (3.3354 => 3.9386, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.00% (0.8172 => 0.9643, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.53% (0.0730 => 0.0858, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 17.49% (0.4620 => 0.5428, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.42% (0.1940 => 0.2278, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 17.38% (0.1151 => 0.1351, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.2107 => 0.2469, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 17.10% (0.0614 => 0.0719, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 17.02% (0.3232 => 0.3782, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.01% (0.2758 => 0.3227, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.97% (0.5569 => 0.6514, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 16.94% (0.7433 => 0.8692, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.69% (0.5020 => 0.5858, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.69% (0.3307 => 0.3859, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.62% (0.0770 => 0.0898, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 16.59% (0.2049 => 0.2389, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.51% (0.3283 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.42% (0.1510 => 0.1758, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.22% (0.9765 => 1.1349, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.13% (0.3423 => 0.3975, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.01% (0.1143 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.69% (0.2065 => 0.2389, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 15.63% (3.8723 => 4.4776, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.45% (0.0770 => 0.0889, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.43% (0.5981 => 0.6904, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: 15.24% (2.0273 => 2.3362, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.95% (0.8921 => 1.0255, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.84% (0.8101 => 0.9303, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.74% (0.6450 => 0.7401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.56% (0.3441 => 0.3942, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3379 => 0.3868, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.37% (0.3180 => 0.3637, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 14.15% (2.2969 => 2.6219, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.60% (1.1861 => 1.3474, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.41% (0.1044 => 0.1184, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.18% (0.8067 => 0.9130, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 13.11% (0.1144 => 0.1294, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3865 => 0.4371, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: 12.40% (1.5603 => 1.7537, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.37% (0.2603 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.31% (0.3387 => 0.3804, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.97% (0.4203 => 0.4706, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.87% (0.4103 => 0.4590, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.43% (0.3603 => 0.4015, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.13% (0.3422 => 0.3803, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.98% (0.1330 => 0.1476, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.77% (14.3668 => 15.9147, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 10.61% (0.3561 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.53% (0.3826 => 0.4229, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.44% (17.1811 => 18.9750, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.43% (0.4064 => 0.4488, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.08% (0.2430 => 0.2675, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.89% (0.3427 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.72% (0.6030 => 0.6616, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.72% (0.2871 => 0.3150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.48% (2.0665 => 2.2624, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/Hello: 9.40% (0.5925 => 0.6482, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.20% (0.7326 => 0.8000, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.20% (0.1892 => 0.2066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2756 => 0.3007, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2877 => 0.3134, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 8.92% (0.2725 => 0.2968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.92% (0.2793 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.84% (0.2714 => 0.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.79% (0.2891 => 0.3145, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3951, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 8.60% (0.1268 => 0.1377, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.58% (0.3650 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.52% (0.3052 => 0.3312, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3162 => 0.3429, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 8.39% (0.2802 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 8.13% (63.2438 => 68.3884, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 7.83% (10.3673 => 11.1791, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.64% (2.2022 => 2.3484, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.88% (0.4879 => 0.5166, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.45% (0.3177 => 0.3350, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.89% (7.9617 => 8.1125, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2420, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (1.1145 => 1.2927, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3293, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4479, std.dev.: 0.0115) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3137, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (3.6395 => 3.7767, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (2.0360 => 2.1097, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.6802 => 8.9395, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2470, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2274, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.63% (5.2763 => 1.1803, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -74.93% (0.8651 => 0.2169, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.65% (5.3855 => 4.4352, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.10% (5.3526 => 4.4374, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0188, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.82% (1.7609 => 1.6056, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.50% (54.1659 => 50.1059, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.35% (1.9577 => 0.6784, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4343, std.dev.: 0.0213) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7749, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0060, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -16.28% (2.5528 => 2.1373, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -12.97% (3.1443 => 2.7365, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2373 => 1.0900, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4939, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.16% (0.9540 => 0.8666, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3013, std.dev.: 0.0366) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8282, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.12% (8.1563 => 7.8200, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.11% (1.0554 => 1.0331, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.70% (3.6994 => 3.6365, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0009) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 18:17:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 20:17:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130106021723.5B9BB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7352?compare_to=7347&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7352, Order: 171637, Start Time: 2013-01-05 22:42:54, End Time: 2013-01-06 02:17:17 To: 7347, Order: 171627, Start Time: 2013-01-05 18:16:30, End Time: 2013-01-05 21:50:25 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (711 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.40% (120.8036 => 128.5403, std.dev.: 1.0257) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.30% (14.3866 => 14.1997, std.dev.: 0.0329) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.04% (0.0625 => 0.0919) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.22% (0.1063 => 0.1448, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.45% (0.2969 => 0.3784) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.58% (0.5900 => 0.7468, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.49% (1.5932 => 2.0153, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.41% (0.4139 => 0.5232, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.43% (0.0633 => 0.0794, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.09% (0.4994 => 0.6247, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.66% (0.4253 => 0.5302, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.32% (0.1620 => 0.2014, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.30% (0.5000 => 0.6215, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.94% (0.1107 => 0.1361, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.92% (0.1549 => 0.1904, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.70% (0.2014 => 0.2451, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.43% (0.1619 => 0.1966, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.38% (0.1604 => 0.1947, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.86% (0.3903 => 0.4717, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.07% (0.2736 => 0.3285, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 19.65% (0.9697 => 1.1602, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.36% (0.1090 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.33% (0.2866 => 0.3420, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.1088 => 0.1298, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 19.24% (0.4029 => 0.4804, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.23% (1.3152 => 1.5681, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.23% (0.3890 => 0.4638, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 19.07% (0.3362 => 0.4003, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 18.87% (0.1505 => 0.1789, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.71% (0.3271 => 0.3883, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.68% (0.2875 => 0.3412, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.52% (0.5826 => 0.6905, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.38% (0.2911 => 0.3446, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.29% (0.4658 => 0.5510, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 18.29% (0.2750 => 0.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 18.28% (0.2823 => 0.3339, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 18.17% (0.2813 => 0.3324, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.14% (0.5889 => 0.6957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 18.09% (0.2714 => 0.3205, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.08% (0.2738 => 0.3233, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 18.06% (0.2725 => 0.3217, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.05% (0.2792 => 0.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 18.02% (0.2803 => 0.3308, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.99% (0.2729 => 0.3220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.91% (0.2780 => 0.3278, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/except: 17.89% (0.2811 => 0.3314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.83% (3.5627 => 4.1980, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 17.74% (0.3004 => 0.3537, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.73% (1.8794 => 2.2126, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 17.72% (0.5546 => 0.6529, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.71% (2.0673 => 2.4335, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 17.66% (0.9909 => 1.1659, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.64% (1.6211 => 1.9070, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.61% (0.3060 => 0.3599, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 17.57% (0.3096 => 0.3640, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 17.54% (0.7171 => 0.8429, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.37% (0.3195 => 0.3750, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.21% (4.4195 => 5.1799, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 17.20% (0.3267 => 0.3829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.00% (0.3258 => 0.3812, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.94% (0.3282 => 0.3838, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 16.82% (0.3317 => 0.3875, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.77% (0.3124 => 0.3648, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.62% (1.0781 => 1.2573, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.35% (1.9694 => 2.2914, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists: 16.34% (0.3348 => 0.3895, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 16.28% (0.3477 => 0.4043, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 16.21% (23.5202 => 27.3336, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/sieve: 16.21% (0.3726 => 0.4330, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 16.18% (0.3678 => 0.4273, std.dev.: 0.0086) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.04% (2.7292 => 3.1670, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.91% (0.4361 => 0.5055, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.89% (0.3625 => 0.4201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.88% (0.3690 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.81% (0.3845 => 0.4453, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.77% (0.3981 => 0.4609, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.74% (1.9966 => 2.3108, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.61% (0.4146 => 0.4793, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 15.50% (4.2109 => 4.8638, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.40% (0.3488 => 0.4025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 15.38% (0.4251 => 0.4905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.38% (0.3465 => 0.3998, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 15.38% (0.3446 => 0.3976, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.29% (0.3460 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.28% (0.3469 => 0.3999, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.19% (0.3496 => 0.4027, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.90% (0.5012 => 0.5759, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.80% (0.3643 => 0.4182, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.74% (0.3724 => 0.4273, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.35% (1.4269 => 1.6317, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 14.11% (0.2566 => 0.2928, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.85% (0.6435 => 0.7326, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.51% (0.7875 => 0.8939, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.95% (2.1653 => 2.4456, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.79% (0.2737 => 0.3087, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.74% (0.1028 => 0.1159, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 12.59% (4.6177 => 5.1989, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (2.1013 => 2.3634, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 12.03% (5.5417 => 6.2081, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.2075 => 0.2323, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 11.89% (0.3498 => 0.3914, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.80% (0.3084 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.61% (0.2068 => 0.2308, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.28% (11.6398 => 12.9528, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.10% (0.5361 => 0.5956, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.85% (0.3336 => 0.3698, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.52% (0.6634 => 0.7332, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.2103 => 0.2323, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.27% (0.4847 => 0.5345, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.14% (4.6926 => 5.1684, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.95% (0.2040 => 0.2243, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.62% (0.1383 => 0.1516, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.33% (0.7426 => 0.8119, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.99% (0.2391 => 0.2582, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 7.78% (2.0346 => 2.1928, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.59% (11.9555 => 12.8634, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.91% (0.3792 => 0.4016, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.89% (29.0505 => 181.5342, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.64% (0.3693 => 0.4086, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.45% (3.3903 => 3.6090, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6791, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2391, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6849, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-2: 4.36% (1.8057 => 1.8844, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2065, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3076, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2087, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.14% (4.0317 => 4.0777, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6015, std.dev.: 0.0127) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4779, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5599, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.63% (17.2379 => 14.1997, std.dev.: 0.0329) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1018, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8032, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -6.00% (0.2402 => 0.2258, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (14.0481 => 13.4743, std.dev.: 0.1138) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2165, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8035, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2231, std.dev.: 0.0478) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.68% (0.6293 => 0.6187, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7182, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2328, std.dev.: 0.0366) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0468, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 18:40:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 20:40:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106024021.722122A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7353?compare_to=7350&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7353, Order: 171642, Start Time: 2013-01-06 01:05:34, End Time: 2013-01-06 02:40:15 To: 7350, Order: 171639, Start Time: 2013-01-05 23:07:38, End Time: 2013-01-06 00:42:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (143 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (805 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.94% (0.5456 => 1.1509, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.38% (0.5575 => 1.1617, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.28% (0.5581 => 1.1624, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.18% (0.5688 => 1.1841, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.96% (0.5567 => 1.1577, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.74% (0.5805 => 1.2001, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.55% (0.6395 => 1.3081, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.96% (0.5941 => 1.2117, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.04% (0.5849 => 1.1876, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.00% (0.6033 => 1.2247, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.90% (0.5859 => 1.1888, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.03% (0.6260 => 1.2647, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.77% (0.5478 => 1.0834, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.08% (0.6189 => 1.2197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.79% (0.5569 => 1.0959, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.37% (0.5570 => 1.0938, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.32% (0.6440 => 1.2643, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.17% (0.5591 => 1.0968, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.57% (0.5705 => 1.1157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.46% (0.6304 => 1.2322, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.78% (0.5802 => 1.1301, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.53% (0.6395 => 1.2376, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.18% (0.6676 => 1.2830, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.63% (0.5925 => 1.1354, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.53% (0.5857 => 1.1218, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.51% (0.6230 => 1.1931, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.42% (0.5863 => 1.1223, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.23% (0.6052 => 1.1573, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.95% (0.6660 => 1.2717, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.29% (0.6194 => 1.1539, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.82% (0.6446 => 1.1978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.14% (0.6297 => 1.1658, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.71% (0.6681 => 1.2207, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.40% (0.6667 => 1.2027, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.25% (0.7524 => 1.3562, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.18% (0.7339 => 1.2710, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.81% (0.0974 => 0.1576, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.90% (0.1132 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.31% (1.6474 => 2.2126, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.38% (0.0582 => 0.0753, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.46% (2.2587 => 2.8789, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.89% (0.0699 => 0.0880, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.57% (0.5329 => 0.6425, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.03% (0.7021 => 0.8217, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.75% (0.4916 => 0.5641, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 13.55% (1.1450 => 1.3002, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (4.5069 => 5.0769, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 12.38% (0.0864 => 0.0971, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 10.96% (0.3357 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.57% (1.6364 => 1.8094, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 9.54% (0.1761 => 0.1929, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.42% (3.5339 => 3.8669, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.43% (0.1441 => 0.1548, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.34% (1.2515 => 1.3309, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (9.2283 => 9.7930, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.73% (1.2784 => 1.3517, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 5.49% (5.0226 => 5.2981, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.3864 => 1.4147, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.77% (1.3722 => 1.3965, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7005, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.05% (0.9531 => 1.0203, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (3.1932 => 3.3344, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0993, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.5751 => 56.3931, std.dev.: 0.1604) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.32% (5.1955 => 5.3682, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6551 => 3.7221, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6108, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3028, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.08% (3.7435 => 3.7840, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.32% (0.1584 => 0.1468, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.77% (0.2428 => 0.2288, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.31% (0.3821 => 0.3618, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.90% (0.9852 => 0.9369, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.55% (2.4924 => 2.3790, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.34% (1.3148 => 1.2577, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3884 => 0.3716, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3896 => 0.3728, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.31% (0.3831 => 0.3666, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -4.30% (0.3880 => 0.3713, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3812 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: -4.27% (0.3205 => 0.3068, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.24% (0.3016 => 0.2888, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.24% (2.1713 => 2.0792, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.21% (0.2849 => 0.2729) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.19% (0.3891 => 0.3728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4033 => 0.3865, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.16% (0.3658 => 0.3506, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.15% (0.7198 => 0.6899, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.05% (0.4321 => 0.4146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.94% (0.7919 => 0.7607, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.4151 => 0.3989, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.88% (0.4280 => 0.4114, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.82% (0.3931 => 0.3781, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -3.81% (0.7982 => 0.7678, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.78% (0.2695 => 0.2593, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.76% (0.6484 => 0.6240, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -3.66% (4.3330 => 4.1743, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: -3.65% (0.2989 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.32% (0.4427 => 0.4280, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.32% (2.4021 => 2.3224, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.31% (0.6347 => 0.6137, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.26% (0.6441 => 0.6231, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -3.08% (0.3867 => 0.3748, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.07% (17.1032 => 16.5774, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/moments: -3.04% (0.4248 => 0.4119, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -3.02% (0.3406 => 0.3303, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.00% (0.7779 => 0.7546, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.96% (0.3483 => 0.3380, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -2.93% (0.3788 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.92% (0.9542 => 0.9263, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.88% (1.2300 => 1.1946, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.87% (1.0544 => 1.0241, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1927, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.74% (0.4083 => 0.3971, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.71% (1.2210 => 1.1879, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.67% (1.2221 => 1.1895, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.64% (6.7716 => 6.5925, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -2.58% (18.2933 => 17.8219, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.51% (14.2083 => 13.8510, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -2.46% (34.0927 => 33.2527, std.dev.: 0.0212) MultiSource/Applications/JM/lencod/lencod: -2.43% (16.1920 => 15.7989, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -2.41% (4.0594 => 3.9615, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.38% (0.5999 => 0.5856, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.36% (7.0961 => 6.9286, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.30% (0.8521 => 0.8325, std.dev.: 0.0072) MultiSource/Applications/hbd/hbd: -2.09% (1.5610 => 1.5284, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: -1.89% (2.1401 => 2.0996, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -1.68% (0.9179 => 0.9025, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.65% (0.6736 => 0.6625, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.53% (0.9077 => 0.8938, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.23% (8.0126 => 7.9142, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -1.22% (15.2527 => 15.0670, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.83% (1.8100 => 0.6727, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0289, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7493, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.33% (83.5423 => 64.0539, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1796, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.28% (4.3779 => 3.4023, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6847, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.80% (4.9100 => 4.2815, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1977, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.07% (5.2027 => 4.7827, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -2.82% (3.7241 => 3.6191, std.dev.: 0.0248) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.67% (7.9763 => 7.7635, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2810, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.77% (1.6086 => 1.5802, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.8776 => 4.8066, std.dev.: 0.0104) MultiSource/Applications/lemon/lemon: -1.17% (1.4516 => 1.4346, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.02% (1.6219 => 1.6053, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 20:32:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 5 Jan 2013 22:32:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106043200.A50372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7354?compare_to=7351&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7354, Order: 171642, Start Time: 2013-01-06 02:19:19, End Time: 2013-01-06 04:31:54 To: 7351, Order: 171640, Start Time: 2013-01-05 23:36:31, End Time: 2013-01-06 01:49:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -6.09% (0.6784 => 0.6371, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.48% (81.1588 => 79.9550, std.dev.: 0.2061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.08% (0.0672 => 0.0658, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8292 => 499.8516, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44224.87% (1.1277 => 499.8516, std.dev.: 0.0025) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.52% (0.5229 => 1.6394, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 18.58% (14.9895 => 17.7745, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 41.74% (14.1553 => 20.0632, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/gs/gs: 16.17% (4.1105 => 4.7753, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.19% (1.1048 => 1.7366, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 419.95% (7.1582 => 37.2189, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.77% (3.4629 => 6.2945, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.66% (0.6222 => 1.0805, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10223.19% (0.0720 => 7.4327, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 3832100.00% (0.0001 => 3.8322, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11111500.00% (0.0001 => 11.1116, std.dev.: 0.0388) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487000.00% (0.0001 => 5.4871, std.dev.: 0.0411) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.16% (1.1194 => 10.2219, std.dev.: 0.0468) MultiSource/Applications/ClamAV/clamscan: 148.44% (22.1758 => 55.0937, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.11% (0.0929 => 0.1794, std.dev.: 0.0024) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.05% (0.0296 => 0.0530) MultiSource/Benchmarks/FreeBench/neural/neural: 72.52% (0.1463 => 0.2524, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.23% (0.0439 => 0.0699) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.12% (1.5859 => 2.5235, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.78% (2.9384 => 4.6068, std.dev.: 0.0193) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.33% (7.0540 => 10.8156, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.41% (2.2024 => 3.2907, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 47.73% (0.1056 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.03% (8.1363 => 11.9628, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 46.54% (0.5105 => 0.7481, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: 44.44% (0.0279 => 0.0403, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 40.89% (21.9371 => 30.9073, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.63% (0.6675 => 0.9320, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 37.36% (0.1432 => 0.1967, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.47% (0.4615 => 0.6298, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.75% (4.2646 => 5.7894, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 35.06% (0.3109 => 0.4199, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 34.52% (0.0814 => 0.1095) SingleSource/UnitTests/vla: 34.37% (0.0355 => 0.0477, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 33.72% (0.1655 => 0.2213, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.09% (1.5415 => 2.0362, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.26% (0.2271 => 0.2981, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.95% (0.1906 => 0.2496, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.52% (0.1337 => 0.1745, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 30.50% (0.4299 => 0.5610, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 28.13% (1.1642 => 1.4917, std.dev.: 0.0111) MultiSource/Benchmarks/NPB-serial/is/is: 26.29% (0.0719 => 0.0908, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.66% (0.3121 => 0.3922, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 25.16% (0.0636 => 0.0796, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.81% (0.1584 => 0.1977, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.51% (3.8922 => 4.8461, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.44% (0.1125 => 0.1400, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.25% (5.7591 => 7.1558, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/08-main/main: 24.12% (0.2554 => 0.3170, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 23.55% (1.0722 => 1.3247, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.83% (0.1695 => 0.2082, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.82% (0.0793 => 0.0974, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.80% (1.4186 => 1.7420, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.76% (0.0479 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.47% (9.4845 => 11.6157, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.41% (0.1566 => 0.1917, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.11% (1.3050 => 1.5805, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/matrix: 21.01% (0.3098 => 0.3749, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 20.72% (0.7115 => 0.8589, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.41% (0.2700 => 0.3251, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.30% (0.4636 => 0.5577, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.53% (4.9449 => 5.9107, std.dev.: 0.0256) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.48% (0.0842 => 0.1006, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.35% (0.0672 => 0.0802, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 19.33% (0.0626 => 0.0747, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.78% (5.0018 => 5.9409, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.77% (0.1236 => 0.1468, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 18.74% (0.7835 => 0.9303, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 18.70% (1.1840 => 1.4054, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.46% (0.1029 => 0.1219, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 18.30% (0.4289 => 0.5074, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 18.29% (0.1695 => 0.2005, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 18.28% (0.6456 => 0.7636, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.23% (0.5860 => 0.6928, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.15% (0.0953 => 0.1126, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.10% (3.3354 => 3.9390, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.09% (0.8172 => 0.9650, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.07% (0.0675 => 0.0797, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.06% (0.0886 => 0.1046, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 18.06% (0.1163 => 0.1373, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.81% (0.0730 => 0.0860, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 17.49% (0.4620 => 0.5428, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.32% (0.1940 => 0.2276, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 17.12% (0.1151 => 0.1348, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 17.11% (0.3232 => 0.3785, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 16.94% (0.0614 => 0.0718, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.78% (0.3307 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.75% (0.0770 => 0.0899, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.68% (0.2758 => 0.3218, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 16.64% (0.2049 => 0.2390, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.49% (0.1510 => 0.1759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.42% (0.3283 => 0.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.41% (0.5020 => 0.5844, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 16.32% (0.1268 => 0.1475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.27% (0.5569 => 0.6475, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 16.16% (0.3423 => 0.3976, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.14% (0.9765 => 1.1341, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.04% (0.2107 => 0.2445, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.01% (0.1143 => 0.1326, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 15.93% (0.7433 => 0.8617, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.71% (0.0770 => 0.0891) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.64% (0.2065 => 0.2388, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 15.48% (3.8723 => 4.4718, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.37% (0.5981 => 0.6900, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966) MultiSource/Applications/treecc/treecc: 15.23% (2.0273 => 2.3361, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.91% (0.8101 => 0.9309, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.79% (0.0933 => 0.1071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 14.68% (0.8921 => 1.0231, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.65% (0.3441 => 0.3945, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3379 => 0.3870, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.33% (0.6450 => 0.7374, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 14.27% (2.2969 => 2.6247, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 14.18% (0.0818 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 13.68% (0.3180 => 0.3615, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.60% (1.1861 => 1.3474, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.41% (0.1044 => 0.1184, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 13.20% (0.1144 => 0.1295) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.88% (0.3865 => 0.4363, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.64% (0.8067 => 0.9087, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 12.40% (0.3387 => 0.3807, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.28% (1.5603 => 1.7519, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.26% (0.2603 => 0.2922, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.65% (0.4103 => 0.4581, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.43% (0.3603 => 0.4015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.05% (0.3422 => 0.3800, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.83% (0.1330 => 0.1474, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.78% (0.3684 => 0.4081, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (14.3668 => 15.9034, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.64% (0.3516 => 0.3890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 10.49% (0.3497 => 0.3864, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.49% (17.1811 => 18.9833, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.4064 => 0.4484, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.04% (0.2430 => 0.2674, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.95% (0.3427 => 0.3768, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2871 => 0.3153, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.6030 => 0.6614, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 9.67% (0.3092 => 0.3391, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 9.33% (0.5925 => 0.6478, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.22% (2.0665 => 2.2571, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.14% (0.1892 => 0.2065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.14% (0.2756 => 0.3008, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7326 => 0.7990, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2905 => 0.3164, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 8.90% (0.2877 => 0.3133, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.77% (0.2714 => 0.2952, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.74% (0.2793 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1268 => 0.1376, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.39% (0.3052 => 0.3308, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 8.39% (0.2802 => 0.3037, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: 8.36% (1.2842 => 1.3916, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.13% (63.2438 => 68.3879, std.dev.: 0.0180) MultiSource/Benchmarks/PAQ8p/paq8p: 7.92% (10.3673 => 11.1887, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.64% (2.2022 => 2.3485, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.05% (0.4879 => 0.5174, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.19% (0.3177 => 0.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.08% (7.9617 => 8.1275, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2486, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.00% (1.1145 => 1.2928, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3289, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.87% (2.8904 => 3.0601, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4569, std.dev.: 0.0084) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (3.1578 => 3.3159, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.12% (3.6395 => 3.7893, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (2.0360 => 2.1102, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.08% (8.6802 => 8.9473, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2437, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2245, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1678, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.63% (5.2763 => 1.1801, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -74.94% (0.8651 => 0.2168, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.63% (5.3855 => 4.4362, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.15% (5.3526 => 4.4348, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -13.54% (10.4361 => 9.0229, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.81% (1.7609 => 1.6057, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.53% (54.1659 => 50.0879, std.dev.: 0.0268) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.46% (1.9577 => 0.6371, std.dev.: 0.0142) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0221, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4306, std.dev.: 0.0239) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7705, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0062, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.35% (0.0756 => 0.0587) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.66% (0.0757 => 0.0593, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030) SingleSource/UnitTests/Vector/multiplies: -16.32% (2.5528 => 2.1361, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -13.13% (3.1443 => 2.7313, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -11.97% (1.2373 => 1.0892, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4927, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.03% (0.9540 => 0.8679, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2974, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.33% (8.1563 => 7.8030, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8393, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3308, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.47% (3.7221 => 3.6675, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: -1.43% (3.6994 => 3.6466, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2285, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0015) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 22:43:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 00:43:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130106064349.7F8182A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7355?compare_to=7352&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7355, Order: 171642, Start Time: 2013-01-06 03:09:22, End Time: 2013-01-06 06:43:43 To: 7352, Order: 171637, Start Time: 2013-01-05 22:42:54, End Time: 2013-01-06 02:17:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1102 (710 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.40% (0.0625 => 0.0915, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.94% (0.1063 => 0.1445, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.16% (0.0475 => 0.0623, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.12% (0.1106 => 0.1417, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.59% (0.2969 => 0.3788, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.13% (0.0822 => 0.1045, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.80% (0.5900 => 0.7481, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.55% (0.4139 => 0.5238, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 26.16% (1.5932 => 2.0100, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.93% (0.4253 => 0.5356, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.63% (0.4994 => 0.6274, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.43% (0.1620 => 0.2032, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.54% (0.5000 => 0.6227, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.75% (0.1103 => 0.1365, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.68% (0.0642 => 0.0794, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.31% (0.1107 => 0.1365, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 22.68% (0.0948 => 0.1163, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.69% (0.1549 => 0.1885, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 21.68% (0.1619 => 0.1970, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.21% (0.3903 => 0.4731, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.80% (0.2014 => 0.2433, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 20.13% (0.4029 => 0.4840, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.96% (0.2736 => 0.3282, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.78% (0.3271 => 0.3918, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 19.78% (0.9697 => 1.1615, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.59% (0.0582 => 0.0696, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.56% (1.3152 => 1.5725, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.39% (0.2738 => 0.3269, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.36% (0.1968 => 0.2349, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 19.26% (0.5826 => 0.6948, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.23% (0.2875 => 0.3428, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681) SingleSource/UnitTests/ObjC++/property-reference-object: 18.92% (0.5889 => 0.7003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 18.88% (0.2823 => 0.3356, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.87% (2.0673 => 2.4575, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/strcat: 18.84% (0.2750 => 0.3268, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.83% (0.2911 => 0.3459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 18.77% (0.2813 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.70% (0.2866 => 0.3402, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 18.68% (0.2714 => 0.3221, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/random: 18.66% (0.2803 => 0.3326, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.62% (0.2792 => 0.3312, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.58% (0.2729 => 0.3236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 18.57% (0.2725 => 0.3231, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 18.55% (0.5546 => 0.6575, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 18.49% (0.9909 => 1.1741, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/except: 18.46% (0.2811 => 0.3330, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 18.34% (0.3004 => 0.3555, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.30% (3.5627 => 4.2145, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.25% (0.4658 => 0.5508, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 18.24% (0.2780 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 18.09% (0.3096 => 0.3656, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 18.04% (0.7171 => 0.8465, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 18.01% (1.8794 => 2.2179, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.00% (0.3195 => 0.3770, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.91% (0.3060 => 0.3608, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.88% (1.6211 => 1.9110, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 17.74% (0.3258 => 0.3836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 17.69% (0.3267 => 0.3845, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.45% (0.5026 => 0.5903, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 17.37% (0.3317 => 0.3893, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.27% (4.4195 => 5.1827, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.25% (0.3124 => 0.3663, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 17.23% (23.5202 => 27.5722, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.10% (0.3362 => 0.3937, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 17.06% (0.1284 => 0.1503, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 17.02% (0.3678 => 0.4304, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.85% (0.3282 => 0.3835, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 16.76% (0.3348 => 0.3909, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.71% (1.0781 => 1.2582, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.69% (0.3930 => 0.4586, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: 16.64% (0.3726 => 0.4346, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 16.59% (0.3477 => 0.4054, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 16.57% (0.4146 => 0.4833, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.47% (0.3625 => 0.4222, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.40% (0.4361 => 0.5076, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.29% (0.3690 => 0.4291, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.25% (0.3845 => 0.4470, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.25% (0.3981 => 0.4628, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.22% (1.9694 => 2.2888, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.98% (1.9966 => 2.3157, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.97% (2.7292 => 3.1651, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 15.91% (0.3469 => 0.4021, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3446 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 15.86% (0.4251 => 0.4925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.80% (0.3488 => 0.4039, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 15.72% (4.2109 => 4.8730, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/exceptions-3: 15.72% (0.3460 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 15.68% (0.3496 => 0.4044, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 15.42% (0.5012 => 0.5785, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.26% (0.3650 => 0.4207, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 15.18% (0.3643 => 0.4196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.88% (0.1028 => 0.1181, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.68% (1.4269 => 1.6364, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.20% (0.6435 => 0.7349, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 13.94% (0.7875 => 0.8973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.19% (0.2737 => 0.3098, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: 13.06% (2.1653 => 2.4481, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 12.85% (2.1013 => 2.3713, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 12.66% (4.6177 => 5.2023, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 12.49% (5.5417 => 6.2337, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 12.29% (0.3498 => 0.3928, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 12.24% (0.2075 => 0.2329, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 12.15% (0.2691 => 0.3018, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.14% (0.2068 => 0.2319, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.56% (11.6398 => 12.9858, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.40% (0.5361 => 0.5972, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.20% (0.6634 => 0.7377, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.12% (0.3336 => 0.3707, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.2103 => 0.2329, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.38% (0.4847 => 0.5350, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.21% (4.6926 => 5.1715, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.00% (0.2040 => 0.2244, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.91% (0.1383 => 0.1520, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.55% (0.7426 => 0.8135, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.07% (0.2391 => 0.2584, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.93% (0.5584 => 0.6027, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.90% (11.9555 => 12.9000, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 7.76% (2.0346 => 2.1924, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.30% (0.3792 => 0.4031, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5353, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.32% (0.5917 => 0.6705, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.92% (0.2802 => 0.3080, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.53% (0.3693 => 0.4045, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2380, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6597, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6801, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5022, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2136, std.dev.: 0.0422) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2995, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0789, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2084, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5837, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4763, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.38% (2.4764 => 2.4174, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5639, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.56% (17.2379 => 14.2106, std.dev.: 0.0360) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8062, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2219, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -3.71% (14.0481 => 13.5271, std.dev.: 0.1817) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8069, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1523, std.dev.: 0.0643) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1832, std.dev.: 0.0684) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 23:14:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 01:14:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106071426.C01D32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7356?compare_to=7354&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7356, Order: 171650, Start Time: 2013-01-06 05:02:06, End Time: 2013-01-06 07:14:20 To: 7354, Order: 171642, Start Time: 2013-01-06 02:19:19, End Time: 2013-01-06 04:31:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (607 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.60% (0.6371 => 0.6664, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.87% (42.0294 => 42.8160, std.dev.: 0.0478) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0658 => 0.0658, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8516 => 499.8491, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.65% (1.1277 => 499.8491, std.dev.: 0.0074) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.35% (0.5229 => 1.6385, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 18.56% (14.9895 => 17.7718, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 41.53% (14.1553 => 20.0341, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 16.16% (4.1105 => 4.7746, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.04% (1.1048 => 1.7350, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 419.90% (7.1582 => 37.2157, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.70% (3.4629 => 6.2920, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.42% (0.6222 => 1.0790, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10209.72% (0.0720 => 7.4230, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11076200.00% (0.0001 => 11.0763, std.dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495800.00% (0.0001 => 5.4959, std.dev.: 0.0274) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.44% (1.1194 => 10.2250, std.dev.: 0.0213) MultiSource/Applications/ClamAV/clamscan: 148.47% (22.1758 => 55.0994, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.90% (0.0929 => 0.1792, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 85.24% (0.0271 => 0.0502, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 78.72% (0.0296 => 0.0529, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.32% (0.1463 => 0.2521, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.20% (1.5859 => 2.5247, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.77% (2.9384 => 4.6064, std.dev.: 0.0072) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 54.67% (0.0439 => 0.0679, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.23% (7.0540 => 10.8086, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.29% (2.2024 => 3.2880, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.07% (0.5105 => 0.7508, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.95% (8.1363 => 11.9563, std.dev.: 0.0063) SingleSource/UnitTests/Vector/multiplies: 44.09% (0.0279 => 0.0402, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.99% (21.9371 => 30.9294, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.66% (0.6675 => 0.9322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 37.29% (0.1432 => 0.1966, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.42% (0.4615 => 0.6296, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.37% (4.2646 => 5.8155, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 35.19% (0.3109 => 0.4203, std.dev.: 0.0004) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 34.28% (0.0814 => 0.1093, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 32.39% (0.1655 => 0.2191, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.03% (1.5415 => 2.0352, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.22% (0.2271 => 0.2980, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.95% (0.1906 => 0.2496, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.22% (0.1337 => 0.1741, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 30.01% (0.4299 => 0.5589, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 28.08% (1.1642 => 1.4911, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.74% (0.0408 => 0.0513, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.63% (0.3121 => 0.3921, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934) SingleSource/Benchmarks/Stanford/Oscar: 25.16% (0.0636 => 0.0796, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.75% (0.1584 => 0.1976, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.50% (3.8922 => 4.8458, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.44% (0.1125 => 0.1400, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.26% (5.7591 => 7.1563, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 24.12% (0.2554 => 0.3170, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 23.43% (1.0722 => 1.3234, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 22.76% (0.0479 => 0.0588, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 22.69% (9.4845 => 11.6361, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.59% (1.4186 => 1.7391, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.57% (0.0793 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.16% (0.1566 => 0.1913, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.36% (0.1695 => 0.2057, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.07% (1.3050 => 1.5799, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 21.01% (0.3098 => 0.3749, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 20.86% (0.7115 => 0.8599, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.33% (0.2700 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.69% (0.4636 => 0.5549, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.64% (0.0672 => 0.0804, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.48% (4.9449 => 5.9080, std.dev.: 0.0069) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.40% (0.0871 => 0.1040, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.19% (0.1032 => 0.1230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 19.17% (0.0626 => 0.0746, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 19.16% (0.7835 => 0.9336, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.02% (5.0018 => 5.9530, std.dev.: 0.0079) MultiSource/Benchmarks/nbench/nbench: 18.68% (1.1840 => 1.4052, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.61% (0.1236 => 0.1466) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.53% (0.0842 => 0.0998, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 18.41% (0.1695 => 0.2007, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 18.34% (0.6456 => 0.7640, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 18.31% (0.1163 => 0.1376, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.14% (0.5860 => 0.6923, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 18.13% (0.0662 => 0.0782, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 18.09% (3.3354 => 3.9387, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.07% (0.0675 => 0.0797, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.05% (0.0953 => 0.1125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 17.98% (0.4289 => 0.5060, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.94% (0.8172 => 0.9638, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 17.64% (0.4620 => 0.5435, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.40% (0.0730 => 0.0857, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.27% (0.0886 => 0.1039, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.22% (0.1940 => 0.2274, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 17.03% (0.1151 => 0.1347, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 17.02% (0.3232 => 0.3782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.78% (0.3307 => 0.3862, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.75% (0.0770 => 0.0899, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.47% (0.5020 => 0.5847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.46% (0.2758 => 0.3212, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.45% (0.3283 => 0.3823, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.42% (0.1510 => 0.1758, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.38% (0.1117 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 16.32% (0.1268 => 0.1475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.11% (0.9765 => 1.1338, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.98% (0.5569 => 0.6459, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.95% (0.2107 => 0.2443, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.92% (0.1143 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 15.89% (0.3423 => 0.3967, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 15.85% (0.7433 => 0.8611, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 15.67% (0.2049 => 0.2370, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.58% (0.0770 => 0.0890, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.50% (0.5981 => 0.6908, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.50% (0.2065 => 0.2385, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 15.43% (3.8723 => 4.4698, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 15.31% (2.0273 => 2.3376, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 14.79% (0.8101 => 0.9299, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.64% (0.8921 => 1.0227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.56% (0.3441 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.40% (0.6450 => 0.7379, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 14.18% (2.2969 => 2.6225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.91% (0.3379 => 0.3849, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.86% (1.1861 => 1.3505, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 13.74% (0.3180 => 0.3617, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.41% (0.1044 => 0.1184, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 13.11% (0.1144 => 0.1294) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.99% (0.3865 => 0.4367, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.50% (0.8067 => 0.9075, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 12.31% (0.3387 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.29% (0.2603 => 0.2923, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.24% (1.5603 => 1.7513, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.56% (0.4048 => 0.4516, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.53% (0.4103 => 0.4576, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3603 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.02% (0.3422 => 0.3799, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.90% (14.3668 => 15.9332, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 10.90% (0.1330 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.80% (0.3684 => 0.4082, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.77% (0.3473 => 0.3847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.56% (0.3826 => 0.4230, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.56% (17.1811 => 18.9953, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.45% (0.3282 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.96% (0.2430 => 0.2672, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.84% (0.4064 => 0.4464, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.75% (0.3427 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 9.67% (0.3092 => 0.3391, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.65% (0.6030 => 0.6612) SingleSource/UnitTests/ObjC++/Hello: 9.35% (0.5925 => 0.6479, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.21% (2.0665 => 2.2569, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.16% (0.2871 => 0.3134, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.09% (0.1892 => 0.2064, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.08% (0.7326 => 0.7991, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2877 => 0.3134, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2905 => 0.3162, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.79% (0.2891 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.52% (0.3650 => 0.3961, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.45% (0.3052 => 0.3310, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 8.44% (0.1268 => 0.1375, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.31% (1.2842 => 1.3909, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.12% (63.2438 => 68.3775, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.81% (10.3673 => 11.1765, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.65% (2.2022 => 2.3486, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.37% (0.4879 => 0.5190, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.51% (0.3131 => 0.3241, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.86% (7.9617 => 8.1094, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.19% (32.5116 => 59.2330, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.96% (1.1145 => 1.2924, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.35% (1.1396 => 1.2462, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3288, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4668, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (3.1578 => 3.3156, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.04% (3.6395 => 3.7867, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (2.0360 => 2.1103, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.6802 => 8.9148, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2444, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.30% (10.3460 => 10.4800, std.dev.: 0.0168) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2168, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5762, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.61% (5.2763 => 1.1814, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.18% (0.8651 => 0.2147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -44.39% (0.1622 => 0.0902, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.75% (5.3855 => 4.4298, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.03% (5.3526 => 4.4409, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -13.68% (10.4361 => 9.0087, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.81% (1.7609 => 1.6057, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.52% (54.1659 => 50.0919, std.dev.: 0.0242) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.96% (1.9577 => 0.6664, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3056, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4245, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7719, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0037, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.45% (2.5528 => 2.1329, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7326, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -11.61% (1.2373 => 1.0937, std.dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4924, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2905, std.dev.: 0.0118) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -5.94% (1.5835 => 1.4894, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.99% (0.4808 => 0.4568, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8300, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.01% (8.1563 => 7.8296, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1556, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.68% (3.7221 => 3.6594, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3307, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2297, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0029) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 5 23:29:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 01:29:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106072920.90E8E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7357?compare_to=7353&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7357, Order: 171651, Start Time: 2013-01-06 05:54:44, End Time: 2013-01-06 07:29:14 To: 7353, Order: 171642, Start Time: 2013-01-06 01:05:34, End Time: 2013-01-06 02:40:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (144 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (805 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.04% (0.6727 => 0.6999, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.96% (0.5456 => 1.1510, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.38% (0.5575 => 1.1617, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.33% (0.5581 => 1.1627, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.28% (0.5688 => 1.1847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.98% (0.5567 => 1.1578, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.77% (0.5805 => 1.2003, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.53% (0.6395 => 1.3080, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.79% (0.5941 => 1.2107, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.30% (0.5849 => 1.1891, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.02% (0.6033 => 1.2248, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.00% (0.5859 => 1.1894, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.35% (0.6260 => 1.2667, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.99% (0.5478 => 1.0846, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.11% (0.6189 => 1.2199, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.95% (0.5569 => 1.0968, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.75% (0.5570 => 1.0959, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.35% (0.6440 => 1.2645, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.08% (0.5591 => 1.0963, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.61% (0.6304 => 1.2331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.46% (0.5705 => 1.1151, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.79% (0.5802 => 1.1302, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.54% (0.6395 => 1.2377, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.26% (0.6676 => 1.2835, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.80% (0.5925 => 1.1364, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.70% (0.5857 => 1.1228, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.62% (0.6230 => 1.1938, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.54% (0.5863 => 1.1230, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.29% (0.6052 => 1.1577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.02% (0.6660 => 1.2722, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.68% (0.6194 => 1.1563, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.85% (0.6446 => 1.1980, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.12% (0.6297 => 1.1657, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.35% (0.6681 => 1.2116, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.56% (0.6667 => 1.2038, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.41% (0.7524 => 1.3574, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.20% (0.0717 => 0.1249, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.27% (0.7339 => 1.2716, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.81% (0.0974 => 0.1576, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.67% (0.0514 => 0.0831, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.74% (0.0599 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.90% (0.1132 => 0.1561, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.39% (1.6474 => 2.2139, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.56% (2.2587 => 2.8811, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.04% (0.0699 => 0.0881, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.28% (0.0622 => 0.0773, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.79% (0.5329 => 0.6437, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.63% (0.1081 => 0.1304, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.08% (0.7021 => 0.8220, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.85% (0.4916 => 0.5646, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 13.58% (1.1450 => 1.3005, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.79% (4.5069 => 5.0835, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 12.15% (0.0864 => 0.0969, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.61% (0.4515 => 0.5039, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.2001 => 0.2230, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 11.11% (0.3357 => 0.3730, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.73% (1.6364 => 1.8120, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1761 => 0.1934, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.45% (3.5339 => 3.8679, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.56% (0.1441 => 0.1550, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 6.42% (1.2515 => 1.3318, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (9.2283 => 9.8137, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.87% (1.2784 => 1.3535, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 5.49% (5.0226 => 5.2981, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.09% (1.3864 => 1.4154, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.3722 => 1.3969, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.60% (31.3723 => 55.7181, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.04% (0.9531 => 1.0202, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash2: 4.39% (3.1932 => 3.3334, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1000, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5241, std.dev.: 0.1185) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.28% (5.1955 => 5.3660, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6551 => 3.7250, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3022, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.70% (4.5320 => 4.6091, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.72% (0.2428 => 0.2289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.29% (0.3821 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.84% (0.3142 => 0.2990, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.81% (0.9852 => 0.9378, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.49% (2.4924 => 2.3805, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3831 => 0.3661, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.43% (0.3812 => 0.3643, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (0.2903 => 0.2775, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.37% (0.3848 => 0.3680, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.36% (0.3896 => 0.3726, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.29% (0.3658 => 0.3501, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.28% (2.1713 => 2.0783, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.27% (1.3148 => 1.2586, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4033 => 0.3865, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (0.3025 => 0.2899, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.13% (0.7198 => 0.6901, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.11% (0.3891 => 0.3731, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.10% (0.4199 => 0.4027, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.07% (0.4321 => 0.4145, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.02% (0.4151 => 0.3984, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.92% (0.3059 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.91% (0.9542 => 0.9169, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.82% (0.6484 => 0.6236, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.82% (0.3931 => 0.3781, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.79% (0.4280 => 0.4118, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.78% (0.2695 => 0.2593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3884 => 0.3739, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.71% (0.7919 => 0.7625, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -3.68% (0.7982 => 0.7688, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -3.68% (4.3330 => 4.1737, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.37% (0.4427 => 0.4278, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.29% (0.6347 => 0.6138, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.24% (2.4021 => 2.3243, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference-object: -3.23% (0.6441 => 0.6233, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.18% (0.3621 => 0.3506, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.17% (0.3849 => 0.3727, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -3.08% (17.1032 => 16.5767, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/moments: -3.06% (0.4248 => 0.4118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.05% (0.7779 => 0.7542, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -3.03% (0.3867 => 0.3750, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -3.02% (0.3406 => 0.3303, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.01% (1.0544 => 1.0227, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: -2.88% (0.3788 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.83% (1.2300 => 1.1952, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.77% (0.4083 => 0.3970, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.75% (1.2221 => 1.1885, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2176, std.dev.: 0.0298) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.63% (1.2210 => 1.1889, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.63% (14.2083 => 13.8349, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.62% (6.7716 => 6.5941, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: -2.54% (18.2933 => 17.8285, std.dev.: 0.0151) MultiSource/Applications/JM/lencod/lencod: -2.43% (16.1920 => 15.7983, std.dev.: 0.0162) MultiSource/Benchmarks/Bullet/bullet: -2.40% (34.0927 => 33.2732, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.37% (0.5999 => 0.5857, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -2.32% (4.0594 => 3.9653, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -2.29% (7.0961 => 6.9335, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -2.25% (1.5610 => 1.5258, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.19% (0.8521 => 0.8334, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -1.80% (2.1401 => 2.1015, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/football/football: -1.74% (0.9179 => 0.9019, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.66% (0.6736 => 0.6624, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.38% (8.0126 => 7.9019, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.37% (0.9077 => 0.8953, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: -1.25% (15.2527 => 15.0616, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.33% (1.8100 => 0.6999, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3120, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.32% (1.3643 => 1.0188, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7589, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0624, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.59% (0.0757 => 0.0586, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.48% (4.1024 => 3.1802, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1378, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8713, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.93% (1.1594 => 1.0907, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.62% (7.9763 => 7.7675, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/ary3: -1.85% (3.7241 => 3.6552, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.78% (6.5735 => 6.4563, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.77% (1.6086 => 1.5802, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.32% (4.8776 => 4.8130, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.31% (1.3096 => 1.2925, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4350, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3551, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 01:30:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 03:30:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106093031.8AA2B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7358?compare_to=7357&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7358, Order: 171653, Start Time: 2013-01-06 07:52:45, End Time: 2013-01-06 09:30:24 To: 7357, Order: 171651, Start Time: 2013-01-06 05:54:44, End Time: 2013-01-06 07:29:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (136 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (811 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1512 => 1.1633, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.16% (0.5456 => 1.1521, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.57% (0.5575 => 1.1628, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.48% (0.5581 => 1.1635, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.46% (0.5688 => 1.1857, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.25% (0.5567 => 1.1593, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.08% (0.5805 => 1.2021, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.02% (0.6395 => 1.3111, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.17% (0.5941 => 1.2130, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.49% (0.5849 => 1.1902, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.33% (0.6033 => 1.2267, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.14% (0.5859 => 1.1902, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.20% (0.6260 => 1.2658, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.85% (0.5478 => 1.0838, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.62% (0.6189 => 1.2231, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.95% (0.5569 => 1.0968, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.58% (0.6440 => 1.2660, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.48% (0.5570 => 1.0944, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.02% (0.6304 => 1.2357, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.98% (0.5591 => 1.0957, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.43% (0.5705 => 1.1149, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.29% (0.5802 => 1.1331, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.85% (0.6395 => 1.2397, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.60% (0.6676 => 1.2858, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.56% (0.5925 => 1.1350, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.52% (0.5863 => 1.1229, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.51% (0.6230 => 1.1931, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.45% (0.5857 => 1.1213, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.39% (0.6052 => 1.1583, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.05% (0.6660 => 1.2724, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.42% (0.6194 => 1.1547, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.79% (0.6446 => 1.1976, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 84.99% (0.6297 => 1.1649, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.78% (0.6681 => 1.2145, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.75% (0.7524 => 1.3600, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.62% (0.6667 => 1.2042, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.29% (0.7339 => 1.2718, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.01% (0.0974 => 0.1578, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.67% (0.0514 => 0.0831, std.dev.: 0.0020) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.73% (0.1500 => 0.2201, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.74% (0.0599 => 0.0861, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.16% (0.1132 => 0.1564, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.79% (0.0680 => 0.0937, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.93% (0.0693 => 0.0942, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.53% (1.6474 => 2.2163, std.dev.: 0.0197) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.16% (0.0445 => 0.0597, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.81% (2.2587 => 2.8868, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0621 => 0.0766, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.72% (0.5329 => 0.6433, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.63% (0.1081 => 0.1304, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.20% (0.0566 => 0.0669, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.56% (0.0598 => 0.0703, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.43% (0.7021 => 0.8245, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.91% (0.4916 => 0.5649, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 13.63% (1.1450 => 1.3011, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.82% (4.5069 => 5.0849, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.54% (0.2001 => 0.2232, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.41% (1.6364 => 1.8231, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 11.05% (0.3357 => 0.3728, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 9.82% (0.1761 => 0.1934, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.61% (3.5339 => 3.8736, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 6.69% (1.2515 => 1.3352, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 6.67% (9.2283 => 9.8434, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.48% (0.3319 => 0.3534, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.84% (1.2784 => 1.3530, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 5.42% (5.0226 => 5.2948, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.3864 => 1.4222, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.10% (0.4813 => 0.4914, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.93% (1.3722 => 1.3987, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.40% (0.8418 => 0.8536, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.58% (31.3723 => 55.7120, std.dev.: 0.0177) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.73% (0.9531 => 1.0172, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 4.74% (3.1932 => 3.3447, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0976, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5148, std.dev.: 0.4784) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3667, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.77% (3.6551 => 3.7198, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3047, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6086, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.52% (0.2428 => 0.2294, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.61% (0.3142 => 0.2997, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.58% (0.9852 => 0.9401, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.48% (0.3057 => 0.2920, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.45% (0.7198 => 0.6878, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: -4.40% (0.3205 => 0.3064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.37% (0.3848 => 0.3680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.33% (0.3812 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3884 => 0.3716, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3896 => 0.3728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.29% (0.3658 => 0.3501, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3831 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.18% (0.3016 => 0.2890, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -4.18% (0.3880 => 0.3718, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.16% (0.3891 => 0.3729, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.16% (1.3148 => 1.2601, std.dev.: 0.0192) MultiSource/Benchmarks/PAQ8p/paq8p: -4.16% (2.4924 => 2.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.4033 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.12% (0.4199 => 0.4026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.08% (0.2939 => 0.2819, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.07% (0.4151 => 0.3982, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.93% (0.2695 => 0.2589, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0863, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.83% (0.4280 => 0.4116, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.77% (0.9542 => 0.9182, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: -3.71% (0.2989 => 0.2878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.66% (0.6484 => 0.6247, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.43% (20.7746 => 20.0615, std.dev.: 0.0221) MultiSource/Applications/lambda-0_1_3/lambda: -3.42% (0.7982 => 0.7709, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.28% (0.7919 => 0.7659, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.28% (0.4427 => 0.4282, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.26% (0.6347 => 0.6140, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -3.26% (0.3867 => 0.3741, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -3.15% (4.3330 => 4.1966, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.12% (0.3849 => 0.3729, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -3.06% (17.1032 => 16.5794, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.01% (0.4321 => 0.4191, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -2.96% (2.4021 => 2.3309, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.93% (0.3483 => 0.3381, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -2.88% (0.3788 => 0.3679, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.77% (1.0544 => 1.0252, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.69% (0.4083 => 0.3973, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -2.62% (0.7779 => 0.7575, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.50% (14.2083 => 13.8535, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.49% (1.2221 => 1.1917, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.2210 => 1.1907, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.48% (6.7716 => 6.6037, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: -2.41% (16.1920 => 15.8015, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: -2.40% (18.2933 => 17.8546, std.dev.: 0.0389) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.37% (1.2300 => 1.2008, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -2.25% (34.0927 => 33.3264, std.dev.: 0.0702) MultiSource/Applications/JM/ldecod/ldecod: -2.22% (7.0961 => 6.9383, std.dev.: 0.0107) MultiSource/Applications/hbd/hbd: -2.10% (1.5610 => 1.5282, std.dev.: 0.0037) MultiSource/Applications/lua/lua: -2.05% (4.0594 => 3.9760, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.8521 => 0.8368, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: -1.61% (0.9179 => 0.9031, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -1.50% (2.1401 => 2.1079, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.21% (8.0126 => 7.9158, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -1.14% (15.2527 => 15.0793, std.dev.: 0.0218) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.31% (1.8100 => 0.7002, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.22% (0.2151 => 0.1587, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -24.53% (1.3643 => 1.0297, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0592, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.69% (2.9703 => 2.2962, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.54% (4.1024 => 3.1779, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4045, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0051) SingleSource/UnitTests/Vector/multiplies: -14.82% (2.5106 => 2.1385, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.83% (1.0217 => 0.8804, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2802, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1978, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.15% (1.1594 => 1.0997, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.96% (2.1154 => 2.0527, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7702, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -2.03% (3.7241 => 3.6486, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.79% (1.3096 => 1.2862, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4767, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6664, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 01:59:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 03:59:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106095935.1D6022A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7359?compare_to=7356&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7359, Order: 171653, Start Time: 2013-01-06 07:44:38, End Time: 2013-01-06 09:59:29 To: 7356, Order: 171650, Start Time: 2013-01-06 05:02:06, End Time: 2013-01-06 07:14:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (214 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (609 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.47% (76.8039 => 77.9291, std.dev.: 0.2227) SingleSource/Benchmarks/Misc/flops-5: 1.37% (1.4894 => 1.5098, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1338 => 0.1340, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.38% (0.0658 => 0.0700, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -1.59% (499.8491 => 491.8808, std.dev.: 3.7660) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 43518.05% (1.1277 => 491.8808, std.dev.: 3.7660) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.63% (0.5229 => 1.6452, std.dev.: 0.0461) MultiSource/Applications/SPASS/SPASS: 18.97% (14.9895 => 17.8324, std.dev.: 0.3794) MultiSource/Applications/kimwitu++/kc: 42.00% (14.1553 => 20.1008, std.dev.: 0.4707) MultiSource/Benchmarks/MallocBench/gs/gs: 16.64% (4.1105 => 4.7944, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.73% (1.1048 => 1.7426, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.84% (7.1582 => 37.2828, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.91% (3.4629 => 6.2995, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.61% (0.6222 => 1.0802, std.dev.: 0.0126) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10212.78% (0.0720 => 7.4252, std.dev.: 0.1129) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0195) MultiSource/Applications/SPASS/SPASS: 11073600.00% (0.0001 => 11.0737, std.dev.: 0.7898) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489900.00% (0.0001 => 5.4900, std.dev.: 0.0096) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.44% (1.1194 => 10.2250, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 149.02% (22.1758 => 55.2228, std.dev.: 1.1497) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.22% (0.0929 => 0.1795, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 79.05% (0.0296 => 0.0530, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.86% (0.1463 => 0.2529, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.50% (1.5859 => 2.5295, std.dev.: 0.0200) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.61% (2.9384 => 4.6019, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 55.13% (0.0439 => 0.0681, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.99% (7.0540 => 10.8622, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.59% (2.2024 => 3.2946, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.24% (8.1363 => 11.9801, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 46.86% (0.5105 => 0.7497, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404) SingleSource/Benchmarks/Misc/dt: 43.40% (0.0265 => 0.0380) MultiSource/Applications/JM/lencod/lencod: 41.55% (21.9371 => 31.0526, std.dev.: 0.4151) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.66% (0.6675 => 0.9322, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.66% (0.4615 => 0.6307, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.08% (4.2646 => 5.8034, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 35.28% (0.3109 => 0.4206, std.dev.: 0.0008) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 34.52% (0.0814 => 0.1095, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 32.69% (0.1655 => 0.2196, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.38% (1.5415 => 2.0406, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.57% (0.2271 => 0.2988, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/05-eks/eks: 31.31% (0.4299 => 0.5645, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.27% (0.1906 => 0.2502, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.04% (0.1337 => 0.1752, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 28.71% (1.1642 => 1.4984, std.dev.: 0.0080) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 26.38% (0.1175 => 0.1485, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.92% (0.3121 => 0.3930, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.74% (0.0408 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0031) SingleSource/Benchmarks/Stanford/Oscar: 25.47% (0.0636 => 0.0798, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936) MultiSource/Benchmarks/McCat/08-main/main: 25.14% (0.2554 => 0.3196, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.84% (3.8922 => 4.8592, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 24.59% (5.7591 => 7.1752, std.dev.: 0.1095) MultiSource/Applications/lemon/lemon: 23.90% (1.0722 => 1.3285, std.dev.: 0.0303) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0061) MultiSource/Applications/viterbi/viterbi: 23.22% (0.1555 => 0.1916, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/dot-syntax-1: 23.17% (0.0479 => 0.0590, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.01% (1.4186 => 1.7450, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 22.98% (9.4845 => 11.6641, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.36% (0.1695 => 0.2074, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 21.57% (0.7115 => 0.8650, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.43% (1.3050 => 1.5847, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.63% (0.2700 => 0.3257, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 20.51% (0.7835 => 0.9442, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.36% (0.4636 => 0.5580, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.95% (4.9449 => 5.9316, std.dev.: 0.0267) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.71% (0.0842 => 0.1008, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.64% (0.0672 => 0.0804, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 19.33% (1.1840 => 1.4129, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.28% (0.1940 => 0.2314, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.25% (0.1117 => 0.1332, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.18% (0.2758 => 0.3287, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.15% (0.5860 => 0.6982, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.13% (5.0018 => 5.9584, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/15-trie/trie: 18.98% (0.0527 => 0.0627, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.93% (0.1236 => 0.1470, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.81% (0.0675 => 0.0802, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.76% (0.1029 => 0.1222, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.73% (0.8172 => 0.9703, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 18.51% (0.6456 => 0.7651, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.47% (3.3354 => 3.9514, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 18.47% (0.4289 => 0.5081, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/messages-2: 18.43% (0.0662 => 0.0784) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.36% (0.0953 => 0.1128, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.70% (0.3423 => 0.4029, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.67% (0.0730 => 0.0859, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 17.64% (0.4620 => 0.5435, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.61% (0.0886 => 0.1042, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 17.20% (0.1151 => 0.1349, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 17.05% (0.3232 => 0.3783, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.01% (0.0770 => 0.0901, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.90% (0.3307 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.73% (0.9765 => 1.1399, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: 16.72% (0.1268 => 0.1480, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.69% (0.1510 => 0.1762, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.61% (0.5020 => 0.5854, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.56% (0.5569 => 0.6491, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: 16.54% (0.3283 => 0.3826, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 16.48% (3.8723 => 4.5106, std.dev.: 0.1044) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.45% (0.1143 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.42% (0.2107 => 0.2453, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 16.29% (0.7433 => 0.8644, std.dev.: 0.0273) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.10% (0.0770 => 0.0894, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.84% (0.2065 => 0.2392, std.dev.: 0.0075) MultiSource/Applications/treecc/treecc: 15.79% (2.0273 => 2.3474, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.67% (0.5981 => 0.6918, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.43% (0.3441 => 0.3972, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: 15.35% (0.8921 => 1.0290, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.21% (0.6450 => 0.7431, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.07% (0.8101 => 0.9322, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 14.68% (2.2969 => 2.6340, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.06% (0.3379 => 0.3854, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.97% (1.1861 => 1.3518, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/09-vor/vor: 13.77% (0.3180 => 0.3618, std.dev.: 0.0143) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.60% (0.1044 => 0.1186, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.14% (0.8067 => 0.9127, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3865 => 0.4369, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 12.63% (1.5603 => 1.7573, std.dev.: 0.0454) MultiSource/Benchmarks/sim/sim: 12.52% (0.3387 => 0.3811, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.45% (0.2603 => 0.2927, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.21% (0.4103 => 0.4604, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.99% (0.4203 => 0.4707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.4048 => 0.4520, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 11.49% (0.3603 => 0.4017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.98% (14.3668 => 15.9443, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.87% (17.1811 => 19.0484, std.dev.: 0.5179) SingleSource/Benchmarks/Shootout-C++/lists1: 10.80% (0.3684 => 0.4082, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 10.77% (0.3092 => 0.3425, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions-4: 10.70% (0.3543 => 0.3922, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.66% (0.3826 => 0.4234, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.24% (0.4064 => 0.4480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.77% (0.6030 => 0.6619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5925 => 0.6488, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (2.0665 => 2.2602, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.30% (0.1892 => 0.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.30% (0.2871 => 0.3138, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.17% (0.7326 => 0.7998, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 8.93% (1.2842 => 1.3989, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 8.68% (0.1268 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.63% (0.3650 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.60% (0.3162 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (0.2756 => 0.2989, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 8.45% (0.3052 => 0.3310, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 8.29% (63.2438 => 68.4893, std.dev.: 0.1084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.18% (0.2714 => 0.2936, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.50% (10.3673 => 11.1451, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.99% (2.2022 => 2.3562, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.54% (0.3177 => 0.3353, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.38% (0.3817 => 0.3946, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.24% (7.9617 => 8.1399, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2483, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.20% (1.1145 => 1.2950, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3297, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.82% (4.2280 => 4.4740, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (3.1578 => 3.3155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.94% (3.6395 => 3.7828, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.65% (2.0360 => 2.1104, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.46% (8.6802 => 8.8941, std.dev.: 0.0263) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.97% (0.9957 => 1.0153, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2430, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.60% (5.2763 => 1.1818, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -44.27% (0.1622 => 0.0904, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.49% (5.3855 => 4.4438, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.84% (5.3526 => 4.4513, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -13.32% (10.4361 => 9.0465, std.dev.: 0.1331) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.46% (1.7609 => 1.6119, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -7.56% (54.1659 => 50.0722, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.84% (1.9577 => 0.6491, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.47% (0.3987 => 0.2493, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4332, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7654, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0082, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.75% (3.3453 => 2.5844, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2949, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.61% (1.2258 => 0.9609) MultiSource/Benchmarks/FreeBench/mason/mason: -20.18% (0.2161 => 0.1725, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.37% (2.5528 => 2.1350, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7326, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.37% (1.2373 => 1.0966, std.dev.: 0.0158) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4933, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.25% (0.9540 => 0.8658, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2749, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.01% (1.6805 => 1.5795, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.27% (10.2830 => 9.8439, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.08% (8.1563 => 7.8236, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3282, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.58% (3.7221 => 3.6632, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.46% (3.6994 => 3.6455, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2361, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.92% (0.2116 => 0.0700, std.dev.: 0.0015) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 03:16:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 05:16:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130106111608.77BAC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7360?compare_to=7355&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7360, Order: 171653, Start Time: 2013-01-06 07:37:03, End Time: 2013-01-06 11:16:02 To: 7355, Order: 171642, Start Time: 2013-01-06 03:09:22, End Time: 2013-01-06 06:43:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1102 (712 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.24% (0.0625 => 0.0914, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.31% (0.1063 => 0.1449, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.85% (0.2969 => 0.3796, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.53% (0.4139 => 0.5237, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.32% (0.5900 => 0.7453, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 26.31% (1.5932 => 2.0124, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 26.21% (0.0599 => 0.0756, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.11% (0.0475 => 0.0599, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.99% (0.4994 => 0.6292, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.47% (0.1107 => 0.1389, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.21% (0.4253 => 0.5325, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 24.89% (0.0948 => 0.1184, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 24.71% (0.0947 => 0.1181, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.62% (0.5000 => 0.6231, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.53% (0.1003 => 0.1249, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.76% (0.1549 => 0.1917, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.63% (0.1604 => 0.1983, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.37% (0.3903 => 0.4737, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.14% (0.2736 => 0.3287, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.02% (0.3271 => 0.3926, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 19.82% (0.9697 => 1.1619, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 19.78% (0.4029 => 0.4826, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.66% (0.2014 => 0.2410, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 19.53% (0.1505 => 0.1799, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 19.43% (0.5826 => 0.6958, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.36% (0.3890 => 0.4643, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.13% (0.2875 => 0.3425, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 19.07% (0.5889 => 0.7012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.98% (0.2866 => 0.3410, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.89% (1.3152 => 1.5637, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.79% (0.2911 => 0.3458, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 18.76% (0.2750 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 18.70% (0.2823 => 0.3351, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 18.70% (0.2813 => 0.3339, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.63% (0.2738 => 0.3248, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 18.50% (0.2714 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 18.50% (0.2725 => 0.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.48% (0.2792 => 0.3308, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/random: 18.48% (0.2803 => 0.3321, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 18.44% (0.3004 => 0.3558, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 18.43% (0.2811 => 0.3329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.40% (0.2729 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.37% (2.0673 => 2.4471, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 18.28% (0.5546 => 0.6560, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 18.27% (0.2780 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.27% (0.4658 => 0.5509, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.24% (3.5627 => 4.2126, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 18.21% (0.7171 => 0.8477, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.15% (0.3195 => 0.3775, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.07% (0.3060 => 0.3613, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 18.04% (1.8794 => 2.2185, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 17.97% (0.9909 => 1.1690, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 17.96% (0.3096 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.88% (0.3362 => 0.3963, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.78% (1.6211 => 1.9093, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 17.63% (0.3267 => 0.3843, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.49% (0.5026 => 0.5905, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 17.46% (0.3258 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.34% (0.3282 => 0.3851, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.18% (4.4195 => 5.1788, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary2: 17.15% (0.3317 => 0.3886, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.13% (0.3124 => 0.3659, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 17.06% (23.5202 => 27.5326, std.dev.: 0.0283) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.92% (1.0781 => 1.2605, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.69% (0.3930 => 0.4586, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 16.64% (0.3726 => 0.4346, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 16.58% (0.3348 => 0.3903, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 16.57% (0.3477 => 0.4053, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.53% (0.4361 => 0.5082, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 16.50% (0.3678 => 0.4285, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.50% (0.3625 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.37% (0.3690 => 0.4294, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.18% (1.9694 => 2.2881, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.18% (0.3981 => 0.4625, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 16.16% (0.4146 => 0.4816, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.08% (2.7292 => 3.1680, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.04% (1.9966 => 2.3168, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 15.86% (0.4251 => 0.4925, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.83% (0.3488 => 0.4040, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986) SingleSource/UnitTests/ObjC/exceptions-2: 15.79% (0.3446 => 0.3990, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.76% (0.3465 => 0.4011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.73% (0.3496 => 0.4046, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: 15.72% (4.2109 => 4.8730, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.71% (0.3845 => 0.4449, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 15.66% (0.3460 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.60% (0.3469 => 0.4010, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 15.22% (0.5012 => 0.5775, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 15.18% (0.3650 => 0.4204, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 15.09% (0.3724 => 0.4286, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.07% (0.3643 => 0.4192, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.81% (1.4269 => 1.6382, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 14.30% (0.2566 => 0.2933, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.05% (0.6435 => 0.7339, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.01% (0.1028 => 0.1172, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 13.98% (0.7875 => 0.8976, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.08% (2.1653 => 2.4485, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.01% (0.2737 => 0.3093, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 13.01% (0.2691 => 0.3041, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 12.82% (4.6177 => 5.2095, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.56% (0.0804 => 0.0905, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.34% (5.5417 => 6.2256, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 12.24% (0.2075 => 0.2329, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 12.21% (0.3498 => 0.3925, std.dev.: 0.0098) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3564, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.04% (0.2068 => 0.2317, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.54% (11.6398 => 12.9829, std.dev.: 0.0201) MultiSource/Applications/minisat/minisat: 11.42% (0.3336 => 0.3717, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.01% (0.5361 => 0.5951, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.79% (0.6634 => 0.7350, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.2103 => 0.2329, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.26% (4.6926 => 5.1741, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.95% (0.2040 => 0.2243, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.55% (0.7426 => 0.8135, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.24% (0.1383 => 0.1497, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.08% (0.5584 => 0.6035, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 7.94% (2.0346 => 2.1962, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 7.88% (11.9555 => 12.8973, std.dev.: 0.0271) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.14% (0.3792 => 0.4025, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.64% (29.0505 => 181.4599, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.18% (0.3693 => 0.4069, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 7.28% (0.2802 => 0.3006, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6125, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2440, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.10% (12.0509 => 12.6655, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8955, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6824, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3026, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2784, std.dev.: 0.0063) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2091, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5930, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4774, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5643, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -17.21% (17.2379 => 14.2717, std.dev.: 0.0734) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -11.03% (0.2402 => 0.2137, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7941, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -4.67% (14.0481 => 13.3925, std.dev.: 0.2118) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2254, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8058, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.56% (0.6293 => 0.6132, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1761, std.dev.: 0.0294) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5741, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 03:28:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 05:28:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106112850.34B7F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7361?compare_to=7358&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7361, Order: 171655, Start Time: 2013-01-06 09:54:05, End Time: 2013-01-06 11:28:45 To: 7358, Order: 171653, Start Time: 2013-01-06 07:52:45, End Time: 2013-01-06 09:30:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 1 (140 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (808 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.18% (76.6943 => 77.5959, std.dev.: 0.0231) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.31% (81.0349 => 79.9719, std.dev.: 0.3660) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.18% (0.5456 => 1.1522, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.50% (0.5575 => 1.1624, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.37% (0.5688 => 1.1852, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.31% (0.5581 => 1.1626, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.21% (0.5567 => 1.1591, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.89% (0.5805 => 1.2010, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.91% (0.6395 => 1.3104, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.92% (0.5941 => 1.2115, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.23% (0.6033 => 1.2261, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.20% (0.5849 => 1.1885, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.07% (0.5859 => 1.1898, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.25% (0.6260 => 1.2661, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.79% (0.5478 => 1.0835, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.61% (0.6189 => 1.2230, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.75% (0.5569 => 1.0957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.52% (0.6440 => 1.2656, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.37% (0.5570 => 1.0938, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.94% (0.5591 => 1.0955, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.70% (0.6304 => 1.2337, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.37% (0.5705 => 1.1146, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.83% (0.5802 => 1.1304, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.53% (0.6395 => 1.2376, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.51% (0.6676 => 1.2852, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.82% (0.5857 => 1.1235, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.70% (0.5925 => 1.1358, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.52% (0.5863 => 1.1229, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.35% (0.6230 => 1.1921, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.24% (0.6052 => 1.1574, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.11% (0.6660 => 1.2728, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.16% (0.6194 => 1.1531, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.62% (0.6446 => 1.1965, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.12% (0.6297 => 1.1657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.60% (0.6681 => 1.2133, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.77% (0.7524 => 1.3601, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.50% (0.6667 => 1.2034, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.23% (0.7339 => 1.2713, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.70% (0.0974 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.28% (0.0514 => 0.0829, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 59.55% (0.0267 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.33% (0.0315 => 0.0483, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.99% (0.1132 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.65% (0.0680 => 0.0936, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.93% (0.0693 => 0.0942, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.59% (1.6474 => 2.2172, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.04% (0.0699 => 0.0902, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.67% (2.2587 => 2.8836, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.95% (0.0622 => 0.0771, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.77% (0.5329 => 0.6436, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.36% (0.7021 => 0.8240, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.81% (0.4916 => 0.5644, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 13.55% (1.1450 => 1.3002, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (4.5069 => 5.0853, std.dev.: 0.0295) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.2001 => 0.2230, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 11.20% (0.3357 => 0.3733, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.58% (1.6364 => 1.8095, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 9.65% (0.1761 => 0.1931, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.58% (3.5339 => 3.8725, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.36% (0.1441 => 0.1547, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 6.48% (1.2515 => 1.3326, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.41% (9.2283 => 9.8194, std.dev.: 0.0169) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.2784 => 1.3566, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3319 => 0.3501, std.dev.: 0.0045) MultiSource/Applications/oggenc/oggenc: 5.47% (5.0226 => 5.2971, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.10% (0.4813 => 0.4914, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.00% (1.3864 => 1.4141, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.53% (31.3723 => 55.6958, std.dev.: 0.0324) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.65% (0.9531 => 1.0165, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (3.1932 => 3.3252, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0989, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3665, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5751 => 56.3692, std.dev.: 0.1028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6551 => 3.7241, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6108, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3030, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.24% (10.3489 => 10.4769, std.dev.: 0.0114) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.48% (0.1281 => 0.1134, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.20% (0.1584 => 0.1470, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.72% (0.2428 => 0.2289, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.29% (0.3821 => 0.3619, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.01% (0.3812 => 0.3621, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.99% (0.3831 => 0.3640, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3848 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.90% (0.3896 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.90% (0.3880 => 0.3690, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.81% (0.3891 => 0.3704, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.72% (0.4176 => 0.3979, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.71% (0.9852 => 0.9388, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.68% (0.3142 => 0.2995, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -4.60% (0.4199 => 0.4006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.54% (0.3658 => 0.3492, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -4.46% (0.2871 => 0.2743, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4280 => 0.4091, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.36% (0.7198 => 0.6884, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.18% (0.3205 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.15% (2.4924 => 2.3889, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.13% (0.2933 => 0.2812, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.10% (1.3148 => 1.2609, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.07% (2.1713 => 2.0829, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.94% (0.7919 => 0.7607, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.93% (0.6484 => 0.6229, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.91% (0.4321 => 0.4152, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.4151 => 0.3989, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.90% (0.2695 => 0.2590, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -3.85% (0.7982 => 0.7675, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.79% (0.9542 => 0.9180, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (0.3025 => 0.2912, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -3.49% (4.3330 => 4.1816, std.dev.: 0.0289) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.49% (0.3931 => 0.3794, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.48% (20.7746 => 20.0522, std.dev.: 0.0356) SingleSource/UnitTests/ObjC++/Hello: -3.42% (0.6347 => 0.6130, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.34% (0.3621 => 0.3500, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.23% (2.4021 => 2.3246, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: -3.18% (0.6441 => 0.6236, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -3.16% (17.1032 => 16.5626, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.12% (0.4427 => 0.4289, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -2.97% (0.3406 => 0.3305, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.96% (0.3849 => 0.3735, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.94% (0.7779 => 0.7550, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.87% (1.0544 => 1.0241, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.87% (0.3483 => 0.3383, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -2.80% (0.4248 => 0.4129, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.77% (1.2210 => 1.1872, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.76% (1.2300 => 1.1961, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.74% (0.4083 => 0.3971, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.58% (14.2083 => 13.8418, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -2.51% (4.0594 => 3.9577, std.dev.: 0.0088) MultiSource/Benchmarks/Bullet/bullet: -2.47% (34.0927 => 33.2518, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.46% (1.2221 => 1.1920, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -2.43% (16.1920 => 15.7978, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.43% (6.7716 => 6.6071, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: -2.37% (18.2933 => 17.8598, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.33% (0.5999 => 0.5859, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -2.30% (7.0961 => 6.9332, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.26% (0.8521 => 0.8328, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: -2.22% (1.5610 => 1.5264, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: -1.88% (2.1401 => 2.0998, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.68% (0.6736 => 0.6623, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.42% (8.0126 => 7.8992, std.dev.: 0.0321) MultiSource/Applications/ClamAV/clamscan: -1.35% (15.2527 => 15.0465, std.dev.: 0.0292) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.25% (1.8100 => 0.6832, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3981, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.07% (1.3643 => 1.0223, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0618, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.48% (4.1024 => 3.1801, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1382, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.83% (0.4092 => 0.3526, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2804, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.09% (1.2842 => 1.1675, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.07% (5.2027 => 4.7827, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8711, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.11% (1.1594 => 1.1002, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.38% (1.3096 => 1.2653, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7702, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.02% (1.6086 => 1.5761, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4655, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7071, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8028, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6003, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 04:43:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 06:43:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106124334.206FC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7362?compare_to=7359&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7362, Order: 171655, Start Time: 2013-01-06 10:30:02, End Time: 2013-01-06 12:43:29 To: 7359, Order: 171653, Start Time: 2013-01-06 07:44:38, End Time: 2013-01-06 09:59:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (220 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.01% (10.2250 => 10.1216, std.dev.: 0.0089) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1340 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.57% (0.0700 => 0.0696, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 1.61% (491.8808 => 499.8052, std.dev.: 0.0255) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.76% (1.1277 => 499.8052, std.dev.: 0.0255) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.05% (0.5229 => 1.6474, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 18.96% (14.9895 => 17.8317, std.dev.: 0.0159) MultiSource/Applications/kimwitu++/kc: 42.01% (14.1553 => 20.1014, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 17.09% (4.1105 => 4.8130, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.06% (1.1048 => 1.7463, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.36% (7.1582 => 37.3202, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.06% (3.4629 => 6.3047, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.93% (0.6222 => 1.0822, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10219.72% (0.0720 => 7.4302, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11059400.00% (0.0001 => 11.0595, std.dev.: 0.0522) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908600.00% (0.0001 => 9.9087, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491200.00% (0.0001 => 5.4913, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 804.20% (1.1194 => 10.1216, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 147.33% (22.1758 => 54.8468, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.33% (0.0929 => 0.1796, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 79.73% (0.0296 => 0.0532) MultiSource/Benchmarks/FreeBench/neural/neural: 73.34% (0.1463 => 0.2536, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 64.07% (0.0231 => 0.0379, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.87% (1.5859 => 2.5353, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.23% (0.0439 => 0.0699, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.20% (2.9384 => 4.5897, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.14% (7.0540 => 10.8729, std.dev.: 0.0165) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 50.03% (2.2024 => 3.3042, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.40% (0.5105 => 0.7525, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.00% (8.1363 => 11.9607, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 42.64% (0.0265 => 0.0378, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 40.94% (21.9371 => 30.9185, std.dev.: 0.0182) SingleSource/Benchmarks/CoyoteBench/almabench: 40.82% (0.0730 => 0.1028, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.91% (0.6675 => 0.9339, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.88% (0.4615 => 0.6317, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.23% (4.2646 => 5.8097, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 35.67% (0.3109 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 34.77% (0.0814 => 0.1097, std.dev.: 0.0000) SingleSource/UnitTests/vla: 34.65% (0.0355 => 0.0478, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 34.02% (0.1655 => 0.2218, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.88% (1.5415 => 2.0483, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.72% (0.2271 => 0.3014, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.37% (0.1906 => 0.2504, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.19% (0.1337 => 0.1754, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 31.17% (0.4299 => 0.5639, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 29.44% (1.1642 => 1.5069, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.11% (0.3121 => 0.3967, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 26.56% (0.1555 => 0.1968, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 25.63% (0.0636 => 0.0799, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.01% (3.8922 => 4.8656, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.73% (0.0457 => 0.0570, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.59% (5.7591 => 7.1754, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 24.43% (0.1175 => 0.1462, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 24.14% (1.0722 => 1.3310, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 24.08% (0.2554 => 0.3169, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 23.33% (0.0793 => 0.0978, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.30% (1.4186 => 1.7491, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.95% (0.1695 => 0.2084, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.80% (0.0443 => 0.0544, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.73% (0.1566 => 0.1922, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 22.66% (9.4845 => 11.6337, std.dev.: 0.0210) MultiSource/Applications/minisat/minisat: 22.14% (0.7115 => 0.8690, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.69% (1.3050 => 1.5880, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.61% (0.1032 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.52% (0.2700 => 0.3281, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 21.38% (0.0491 => 0.0596, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.00% (0.7835 => 0.9480, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.53% (0.4636 => 0.5588, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.97% (4.9449 => 5.9323, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.79% (0.0672 => 0.0805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 19.65% (0.0626 => 0.0749, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 19.36% (1.1840 => 1.4132, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.31% (0.8172 => 0.9750, std.dev.: 0.0043) MultiSource/Applications/aha/aha: 19.20% (0.1151 => 0.1372, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.18% (5.0018 => 5.9611, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 18.98% (0.4289 => 0.5103, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.93% (0.1236 => 0.1470, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.67% (3.3354 => 3.9582, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.53% (0.0842 => 0.0998, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.52% (0.0675 => 0.0800, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.52% (0.5860 => 0.6945, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 18.43% (0.6456 => 0.7646, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.05% (0.0953 => 0.1125, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.81% (0.0730 => 0.0860, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 17.66% (0.4620 => 0.5436, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.38% (0.0886 => 0.1040, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.32% (0.1940 => 0.2276, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.5569 => 0.6533, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.09% (0.5020 => 0.5878, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 17.08% (0.3232 => 0.3784, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 17.06% (0.3423 => 0.4007, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 16.98% (0.2049 => 0.2397, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.96% (0.3307 => 0.3868, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: 16.84% (0.7433 => 0.8685, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.75% (0.0770 => 0.0899, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.68% (0.2758 => 0.3218, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.62% (0.1510 => 0.1761, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 16.50% (3.8723 => 4.5114, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.3283 => 0.3824, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.48% (0.9765 => 1.1374, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.36% (0.1143 => 0.1330, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.07% (2.0273 => 2.3531, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.03% (0.1117 => 0.1296, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.90% (0.5981 => 0.6932, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.74% (0.2065 => 0.2390, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.50% (0.8921 => 1.0304, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.48% (0.8101 => 0.9355, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.40% (0.6450 => 0.7443, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.14% (0.3441 => 0.3962, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.11% (0.0933 => 0.1074, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 14.69% (2.2969 => 2.6342, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3379 => 0.3871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.19% (1.1861 => 1.3544, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 13.81% (0.3180 => 0.3619, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.79% (0.1044 => 0.1188, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.71% (0.8067 => 0.9173, std.dev.: 0.0068) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.27% (1.5603 => 1.7673, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.18% (0.0759 => 0.0859, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3865 => 0.4369, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.87% (0.2603 => 0.2938, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.04% (0.4203 => 0.4709, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.80% (0.4103 => 0.4587, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/moments: 11.54% (0.4048 => 0.4515, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.44% (0.2430 => 0.2708, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.35% (0.3603 => 0.4012, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.10% (0.3422 => 0.3802, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.07% (14.3668 => 15.9573, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 10.95% (17.1811 => 19.0616, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.87% (0.3543 => 0.3928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.79% (0.3282 => 0.3636, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3826 => 0.4232, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 10.48% (0.3092 => 0.3416, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.15% (0.3427 => 0.3775, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2871 => 0.3160, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.51% (0.1892 => 0.2072, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.51% (0.2756 => 0.3018, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.47% (0.2905 => 0.3180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.42% (2.0665 => 2.2611, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 9.34% (0.6030 => 0.6593, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.03% (0.2725 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.99% (1.2842 => 1.3997, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.88% (0.3650 => 0.3974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.86% (0.7326 => 0.7975, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.79% (0.2891 => 0.3145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3162 => 0.3437, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 8.60% (0.1268 => 0.1377, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.41% (0.3935 => 0.4266, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.01% (63.2438 => 68.3098, std.dev.: 0.0453) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: 7.56% (10.3673 => 11.1511, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.74% (2.2022 => 2.3507, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.09% (0.4879 => 0.5176, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.15% (7.9617 => 8.1328, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2430, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.01% (1.1145 => 1.2929, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3293, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4499, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (3.1578 => 3.3154, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.79% (3.6395 => 3.7776, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (2.0360 => 2.1097, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.49% (8.6802 => 8.8962, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (0.9957 => 1.0147, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2462, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.31% (1.4460 => 1.4649, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2159, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0197) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1780, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.33% (0.8651 => 0.2134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -44.27% (0.1622 => 0.0904, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.88% (5.3855 => 4.4226, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.25% (5.3526 => 4.4293, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -13.18% (10.4361 => 9.0607, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.68% (1.7609 => 1.6081, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9224, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.79% (1.9577 => 0.6698, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3066, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4301, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7796, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0054, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -18.32% (0.2161 => 0.1765, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.33% (2.5528 => 2.1360, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7355, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4908, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.27% (0.9540 => 0.8656, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3038, std.dev.: 0.0481) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.87% (1.8329 => 1.7069, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.04% (0.3463 => 0.3254, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5796, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (0.2497 => 0.2359, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8297, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.15% (8.1563 => 7.8177, std.dev.: 0.0085) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.15% (1.0554 => 1.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6561, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.11% (0.2116 => 0.0696, std.dev.: 0.0018) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 07:42:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 09:42:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106154229.95EC82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7363?compare_to=7361&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7363, Order: 171656, Start Time: 2013-01-06 14:07:44, End Time: 2013-01-06 15:42:24 To: 7361, Order: 171655, Start Time: 2013-01-06 09:54:05, End Time: 2013-01-06 11:28:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (97 on baseline) Performance Improvements: 0 (142 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (805 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.02% (0.5456 => 1.1513, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.68% (0.5575 => 1.1634, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.60% (0.5581 => 1.1642, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.21% (0.5688 => 1.1843, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.17% (0.5567 => 1.1589, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.08% (0.5805 => 1.2021, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.63% (0.6395 => 1.3086, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.02% (0.5941 => 1.2121, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.40% (0.5849 => 1.1897, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.22% (0.6033 => 1.2260, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.00% (0.5859 => 1.1894, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.38% (0.6260 => 1.2669, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.75% (0.5478 => 1.0833, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.35% (0.6189 => 1.2214, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.77% (0.5569 => 1.0958, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.43% (0.5570 => 1.0941, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.37% (0.6440 => 1.2646, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.87% (0.5591 => 1.0951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.78% (0.6304 => 1.2342, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.32% (0.5705 => 1.1143, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.48% (0.5802 => 1.1284, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.46% (0.6395 => 1.2372, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.41% (0.6676 => 1.2845, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.70% (0.5925 => 1.1358, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.55% (0.5857 => 1.1219, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.39% (0.5863 => 1.1221, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.36% (0.6230 => 1.1922, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.26% (0.6052 => 1.1575, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.95% (0.6660 => 1.2717, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.31% (0.6194 => 1.1540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.73% (0.6446 => 1.1972, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.12% (0.6297 => 1.1657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.10% (0.6681 => 1.2099, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.46% (0.7524 => 1.3578, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.38% (0.6667 => 1.2026, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.06% (0.0717 => 0.1248, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.17% (0.7339 => 1.2709, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.81% (0.0974 => 0.1576, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 59.93% (0.0267 => 0.0427, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.74% (0.0599 => 0.0861, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.07% (0.1132 => 0.1563, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.65% (0.0680 => 0.0936, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.93% (0.0693 => 0.0942, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.48% (1.6474 => 2.2155, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.73% (0.0582 => 0.0755, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.63% (2.2587 => 2.8827, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0621 => 0.0766, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.62% (0.5329 => 0.6428, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.45% (0.7021 => 0.8246, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.81% (0.4916 => 0.5644, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.64% (1.1450 => 1.3012, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 12.96% (0.0864 => 0.0976, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.66% (4.5069 => 5.0776, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.34% (0.2001 => 0.2228, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.02% (0.3357 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.62% (1.6364 => 1.8102, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1761 => 0.1935, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.50% (3.5339 => 3.8696, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.22% (0.1441 => 0.1545, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.42% (1.2515 => 1.3319, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.34% (9.2283 => 9.8137, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.62% (1.2784 => 1.3502, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.60% (0.3319 => 0.3505, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.38% (5.0226 => 5.2930, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.3864 => 1.4151, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.79% (1.3722 => 1.3967, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.54% (31.3723 => 55.6979, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3691, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.58% (0.9531 => 1.0158, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.75% (3.1932 => 3.3450, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5514, std.dev.: 0.0595) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0968, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3672, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0114) MultiSource/Benchmarks/llubenchmark/llu: 1.90% (3.7435 => 3.8146, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6551 => 3.7215, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.5320 => 4.6128, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3053, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.40% (0.1281 => 0.1135, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.26% (0.1584 => 0.1469, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.2428 => 0.2287, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.90% (0.3880 => 0.3690, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.88% (0.3896 => 0.3706, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.77% (0.3142 => 0.2992, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.71% (0.9852 => 0.9388, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.55% (0.4199 => 0.4008, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.4176 => 0.3988, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.48% (0.3658 => 0.3494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.38% (0.7198 => 0.6883, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.28% (0.4280 => 0.4097, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.25% (0.3057 => 0.2927, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.21% (2.4924 => 2.3875, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -4.15% (1.3148 => 1.2603, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.10% (0.2903 => 0.2784, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.05% (0.4151 => 0.3983, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.97% (0.2695 => 0.2588, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.91% (0.4321 => 0.4152, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.89% (0.6484 => 0.6232, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.85% (0.9542 => 0.9175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.85% (0.3016 => 0.2900, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.75% (2.1713 => 2.0899, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.72% (0.2933 => 0.2824, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.71% (0.7919 => 0.7625, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -3.63% (0.7982 => 0.7692, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -3.63% (0.3059 => 0.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (0.3025 => 0.2920, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -3.42% (20.7746 => 20.0643, std.dev.: 0.0191) MultiSource/Benchmarks/MallocBench/gs/gs: -3.39% (4.3330 => 4.1862, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: -3.29% (0.3621 => 0.3502, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.28% (0.3931 => 0.3802, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.28% (0.6347 => 0.6139, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.23% (2.4021 => 2.3245, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.14% (0.4427 => 0.4288, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.12% (0.6441 => 0.6240, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.06% (17.1032 => 16.5797, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.99% (0.3483 => 0.3379, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.90% (1.0544 => 1.0238, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.88% (0.3849 => 0.3738, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.85% (1.2300 => 1.1950, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: -2.75% (0.4248 => 0.4131, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.73% (1.2210 => 1.1877, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.72% (0.4083 => 0.3972, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (14.2083 => 13.8264, std.dev.: 0.0151) SingleSource/UnitTests/ObjC++/property-reference: -2.66% (0.7779 => 0.7572, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: -2.64% (0.3788 => 0.3688, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.56% (1.2221 => 1.1908, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.55% (0.5999 => 0.5846, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: -2.53% (16.1920 => 15.7822, std.dev.: 0.0178) MultiSource/Applications/lua/lua: -2.52% (4.0594 => 3.9573, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: -2.49% (18.2933 => 17.8372, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -2.42% (34.0927 => 33.2663, std.dev.: 0.0448) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.36% (6.7716 => 6.6116, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -2.29% (7.0961 => 6.9333, std.dev.: 0.0083) MultiSource/Applications/hbd/hbd: -2.14% (1.5610 => 1.5276, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.04% (0.8521 => 0.8347, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: -1.79% (2.1401 => 2.1018, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.74% (0.6736 => 0.6619, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.67% (0.9179 => 0.9026, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.64% (0.9077 => 0.8928, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.43% (8.0126 => 7.8977, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: -1.30% (15.2527 => 15.0547, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.48% (1.8100 => 0.6973, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3985, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3097, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.71% (1.3643 => 1.0272, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3254, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0652, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.52% (4.1024 => 3.1787, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.25% (4.3779 => 3.4040, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.88% (2.5106 => 2.1370, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2794, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.37% (4.7378 => 4.1989, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6343, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8718, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -6.11% (1.1594 => 1.0886, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.35% (1.3096 => 1.2657, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7685, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6292, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4648, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.8776 => 4.8005, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.52% (1.6086 => 1.5842, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.45% (1.6219 => 1.5984, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -1.13% (1.4516 => 1.4352, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.11% (1.0443 => 1.0327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3548, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 07:45:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 09:45:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130106154538.0C4732A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7364?compare_to=7360&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7364, Order: 171655, Start Time: 2013-01-06 12:11:21, End Time: 2013-01-06 15:45:33 To: 7360, Order: 171653, Start Time: 2013-01-06 07:37:03, End Time: 2013-01-06 11:16:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.56% (0.2090 => 0.2248, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.1122 => 54.8077, std.dev.: 0.0366) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.56% (0.0625 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.03% (0.1063 => 0.1446, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.03% (0.1106 => 0.1416, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.92% (0.2969 => 0.3798, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.64% (1.5932 => 2.0176, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.48% (0.4139 => 0.5235, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.48% (0.0642 => 0.0812, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.23% (0.1620 => 0.2045, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.19% (0.4994 => 0.6302, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.17% (0.5900 => 0.7444, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.02% (0.1107 => 0.1395, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.51% (0.4253 => 0.5338, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.08% (0.5000 => 0.6254, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.66% (0.1549 => 0.1931, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.44% (0.1604 => 0.1980, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.41% (0.0897 => 0.1107, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.39% (0.1103 => 0.1350, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.47% (0.3903 => 0.4741, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.25% (0.2014 => 0.2442, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 21.01% (0.0947 => 0.1146, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 20.33% (0.4029 => 0.4848, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 20.29% (0.9697 => 1.1665, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/08-main/main: 20.28% (0.1218 => 0.1465, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 19.96% (0.5826 => 0.6989, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.96% (0.2736 => 0.3282, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.72% (0.2875 => 0.3442, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 19.61% (0.5889 => 0.7044, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 19.60% (0.1505 => 0.1800, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.57% (0.3271 => 0.3911, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.56% (0.3890 => 0.4651, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 19.49% (0.2714 => 0.3243, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 19.37% (0.3004 => 0.3586, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 19.35% (0.2750 => 0.3282, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 19.31% (0.2823 => 0.3368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 19.27% (0.2725 => 0.3250, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.21% (1.3152 => 1.5679, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/methcall: 19.20% (0.2813 => 0.3353, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.13% (0.2792 => 0.3326, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.12% (0.2866 => 0.3414, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.10% (0.2738 => 0.3261, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.07% (0.2911 => 0.3466, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 18.98% (0.2803 => 0.3335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 18.96% (0.2811 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.94% (0.2729 => 0.3246, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.80% (0.1968 => 0.2338, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 18.74% (0.2780 => 0.3301) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.72% (0.4658 => 0.5530, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.72% (2.0673 => 2.4542, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 18.67% (0.3096 => 0.3674, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 18.65% (0.9909 => 1.1757, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 18.57% (0.5546 => 0.6576, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.50% (0.3195 => 0.3786, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.49% (3.5627 => 4.2213, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: 18.48% (0.7171 => 0.8496, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 18.33% (1.8794 => 2.2239, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 18.18% (0.3267 => 0.3861, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.13% (0.5026 => 0.5937, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 18.08% (0.3258 => 0.3847, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 18.00% (0.3362 => 0.3967, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.97% (0.3060 => 0.3610, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.86% (1.6211 => 1.9107, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/ary2: 17.85% (0.3317 => 0.3909, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.67% (0.3124 => 0.3676, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.34% (4.4195 => 5.1860, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.25% (0.3282 => 0.3848, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 17.20% (23.5202 => 27.5649, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/lists: 17.17% (0.3348 => 0.3923, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 17.17% (1.0781 => 1.2632, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 17.10% (0.3678 => 0.4307, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 17.07% (0.3726 => 0.4362, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.02% (0.3930 => 0.4599, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 17.00% (0.3477 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 16.88% (0.4146 => 0.4846, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.83% (0.3845 => 0.4492, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.77% (0.3625 => 0.4233, std.dev.: 0.0052) MultiSource/Benchmarks/nbench/nbench: 16.72% (0.2566 => 0.2995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.65% (0.3981 => 0.4644, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.64% (0.3690 => 0.4304, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.58% (0.4361 => 0.5084, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.57% (1.9694 => 2.2957, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.42% (1.9966 => 2.3244, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.36% (2.7292 => 3.1757, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 16.14% (0.4251 => 0.4937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.11% (0.3488 => 0.4050, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 16.08% (0.3465 => 0.4022, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 16.04% (0.3460 => 0.4015, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: 15.98% (0.3442 => 0.3992, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.97% (4.2109 => 4.8833, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-2: 15.96% (0.3446 => 0.3996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.94% (0.3469 => 0.4022, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.90% (0.3496 => 0.4052, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 15.90% (0.5012 => 0.5809, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.87% (0.1090 => 0.1263, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 15.56% (0.3650 => 0.4218, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions: 15.40% (0.3643 => 0.4204, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.31% (0.3724 => 0.4294, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.77% (1.4269 => 1.6377, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.56% (0.6435 => 0.7372, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.17% (0.7875 => 0.8991, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.49% (2.1653 => 2.4573, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.41% (0.2737 => 0.3104, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.93% (4.6177 => 5.2148, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: 12.55% (0.3498 => 0.3937, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 12.53% (0.2075 => 0.2335, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 12.48% (5.5417 => 6.2332, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: 12.44% (2.1013 => 2.3627, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.19% (0.2068 => 0.2320, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.3084 => 0.3456, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.74% (11.6398 => 13.0061, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 11.57% (0.3336 => 0.3722, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 11.15% (0.6634 => 0.7374, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.12% (0.5361 => 0.5957, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.50% (0.4847 => 0.5356, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.39% (0.2040 => 0.2252, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.19% (4.6926 => 5.1709, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.05% (0.1383 => 0.1522, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.52% (0.7426 => 0.8133, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.20% (2.0346 => 2.2015, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 8.02% (11.9555 => 12.9140, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.97% (0.5584 => 0.6029, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.43% (0.3792 => 0.4036, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5200, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.10% (0.3693 => 0.4066, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 5.94% (0.2122 => 0.2248, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6795, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2372, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.67% (79.9355 => 83.6694, std.dev.: 0.0096) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5013, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 2.93% (0.6276 => 0.6460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std.dev.: 0.0435) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3024, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0805, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2072, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6128, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4785, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.20% (2.4764 => 2.4219, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5610, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.38% (17.2379 => 14.2419, std.dev.: 0.0983) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2217, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8046, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -3.23% (14.0481 => 13.5945, std.dev.: 0.1337) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1663, std.dev.: 0.0856) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1925, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 08:27:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 10:27:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106162730.EF73B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7365?compare_to=7362&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7365, Order: 171656, Start Time: 2013-01-06 14:14:28, End Time: 2013-01-06 16:27:26 To: 7362, Order: 171655, Start Time: 2013-01-06 10:30:02, End Time: 2013-01-06 12:43:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.94% (0.1339 => 0.1365, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.89% (0.0696 => 0.0662, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8052 => 499.8415, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44223.98% (1.1277 => 499.8415, std.dev.: 0.0112) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.90% (0.5229 => 1.6466, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 19.05% (14.9895 => 17.8443, std.dev.: 0.0107) MultiSource/Applications/kimwitu++/kc: 42.06% (14.1553 => 20.1090, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 16.56% (4.1105 => 4.7913, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.63% (1.1048 => 1.7415, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.19% (7.1582 => 37.3076, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.06% (3.4629 => 6.3047, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.88% (0.6222 => 1.0819, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10210.83% (0.0720 => 7.4238, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3831800.00% (0.0001 => 3.8319, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 11078500.00% (0.0001 => 11.0786, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 64200.00% (0.0001 => 0.0643, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574200.00% (0.0001 => 0.5743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908500.00% (0.0001 => 9.9086, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488800.00% (0.0001 => 5.4889, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 804.06% (1.1194 => 10.1200, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 147.19% (22.1758 => 54.8174, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.76% (0.0929 => 0.1800, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.14% (0.1463 => 0.2533, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.81% (1.5859 => 2.5344, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.68% (0.0439 => 0.0701, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.05% (2.9384 => 4.5853, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.18% (7.0540 => 10.8756, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.91% (2.2024 => 3.3017, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.52% (0.5105 => 0.7531, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.86% (8.1363 => 11.9492, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.83% (21.9371 => 30.8932, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/almabench: 40.82% (0.0730 => 0.1028, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.01% (0.6675 => 0.9346, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.91% (0.1062 => 0.1454, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.75% (0.4615 => 0.6311, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.17% (4.2646 => 5.8073, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 35.51% (0.3109 => 0.4213, std.dev.: 0.0013) SingleSource/UnitTests/vla: 34.93% (0.0355 => 0.0479, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 34.52% (0.0814 => 0.1095, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 34.14% (0.1655 => 0.2220, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.60% (1.5415 => 2.0441, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.62% (0.2271 => 0.2989, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.37% (0.1906 => 0.2504, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.26% (0.1337 => 0.1755, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 30.96% (0.4299 => 0.5630, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 28.70% (1.1642 => 1.4983, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 26.82% (0.1555 => 0.1972, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 26.70% (0.0719 => 0.0911, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.73% (0.3121 => 0.3924, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Oscar: 25.63% (0.0636 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.02% (3.8922 => 4.8662, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/08-main/main: 24.98% (0.2554 => 0.3192, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.73% (0.0457 => 0.0570, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 24.46% (5.7591 => 7.1677, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 24.43% (0.1175 => 0.1462, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.04% (1.0722 => 1.3300, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.17% (1.4186 => 1.7473, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/hash: 23.09% (0.0485 => 0.0597, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.89% (0.1695 => 0.2083, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.73% (9.4845 => 11.6403, std.dev.: 0.0102) MultiSource/Applications/minisat/minisat: 22.21% (0.7115 => 0.8695, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.52% (1.3050 => 1.5859, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/matrix: 21.40% (0.3098 => 0.3761, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.78% (0.7835 => 0.9463, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.59% (0.2700 => 0.3256, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 20.33% (0.1151 => 0.1385, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.95% (0.4636 => 0.5561, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.78% (4.9449 => 5.9231, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 19.65% (0.0626 => 0.0749, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.64% (0.0672 => 0.0804, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.41% (0.0675 => 0.0806, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.22% (5.0018 => 5.9629, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 19.16% (1.1840 => 1.4108, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.00% (0.8172 => 0.9725, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.85% (0.1236 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.84% (0.5860 => 0.6964, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.76% (0.0842 => 0.1000, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 18.68% (0.4289 => 0.5090, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.66% (0.1940 => 0.2302, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 18.66% (0.1163 => 0.1380, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 18.59% (3.3354 => 3.9555, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.56% (0.1029 => 0.1220, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 18.54% (0.6456 => 0.7653, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.15% (0.0953 => 0.1126, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 18.13% (0.0662 => 0.0782) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.05% (0.5020 => 0.5926, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 17.79% (0.4620 => 0.5442, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.67% (0.0730 => 0.0859, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.3423 => 0.4025, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.49% (0.0886 => 0.1041, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 17.30% (0.3232 => 0.3791) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 16.98% (0.2049 => 0.2397, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.90% (0.3307 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.88% (0.0770 => 0.0900, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 16.86% (0.7433 => 0.8686, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.75% (0.1510 => 0.1763, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.66% (0.5569 => 0.6497, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.50% (0.9765 => 1.1376, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.46% (0.2758 => 0.3212, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.40% (3.8723 => 4.5074, std.dev.: 0.0076) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.36% (0.1143 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.33% (0.2107 => 0.2451, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.78% (0.5981 => 0.6925, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 15.77% (2.0273 => 2.3471, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.36% (0.8101 => 0.9345, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.32% (0.8921 => 1.0288, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.02% (0.3441 => 0.3958, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.90% (0.0933 => 0.1072, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 14.84% (2.2969 => 2.6377, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.78% (0.6450 => 0.7403, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 14.59% (0.3379 => 0.3872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0818 => 0.0935, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.89% (1.1861 => 1.3508, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 13.74% (0.3180 => 0.3617, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.70% (0.1044 => 0.1187, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.39% (1.5603 => 1.7693, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.12% (0.3865 => 0.4372, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.95% (0.8067 => 0.9112, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.64% (0.2603 => 0.2932, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.06% (0.4203 => 0.4710, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.4103 => 0.4585, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/moments: 11.61% (0.4048 => 0.4518, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.55% (0.3603 => 0.4019, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.06% (14.3668 => 15.9559, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.95% (17.1811 => 19.0619, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 10.83% (0.3092 => 0.3427, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.66% (0.3826 => 0.4234, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.63% (0.3828 => 0.4235, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.51% (0.3282 => 0.3627, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.51% (0.4064 => 0.4491, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.29% (0.2430 => 0.2680, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.29% (0.3694 => 0.4074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.21% (0.3427 => 0.3777) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 10.00% (0.2831 => 0.3114, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.60% (0.2905 => 0.3184, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.6030 => 0.6594, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.35% (2.0665 => 2.2597, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 9.32% (1.2842 => 1.4039, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.25% (0.1892 => 0.2067, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5925 => 0.6470, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.10% (0.2725 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 9.03% (0.2714 => 0.2959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7326 => 0.7976, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 8.68% (0.1268 => 0.1378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.63% (0.3162 => 0.3435, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.46% (0.3935 => 0.4268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 7.94% (63.2438 => 68.2653, std.dev.: 0.0513) MultiSource/Benchmarks/PAQ8p/paq8p: 7.55% (10.3673 => 11.1496, std.dev.: 0.0130) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.77% (2.2022 => 2.3512, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.05% (0.4879 => 0.5174, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.23% (0.3177 => 0.3343, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.99% (7.9617 => 8.1198, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2424, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.00% (1.1145 => 1.2928, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.15% (1.1396 => 1.2439, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3287, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0595, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4643, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3140, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (3.6395 => 3.7745, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (2.0360 => 2.1098, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9198, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2493, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2409, std.dev.: 0.0286) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4537, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.70% (5.2763 => 1.1766, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.85% (5.3855 => 4.4240, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.29% (5.3526 => 4.4271, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -13.17% (10.4361 => 9.0613, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.59% (1.7609 => 1.6097, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9699, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.85% (1.9577 => 0.6489, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0208, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4261, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7723, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0054, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2953) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2258 => 0.9605, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.30% (2.5528 => 2.1368, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4943, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: -11.07% (1.2373 => 1.1003, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.17% (0.9540 => 0.8665, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2770, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8335, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.15% (8.1563 => 7.8182, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2271, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/ary3: -1.12% (3.6994 => 3.6579, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0071) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.08% (0.1485 => 0.1365, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.71% (0.2116 => 0.0662, std.dev.: 0.0031) Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 12:14:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 14:14:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130106201441.EF6BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7366?compare_to=7364&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7366, Order: 171656, Start Time: 2013-01-06 16:40:42, End Time: 2013-01-06 20:14:36 To: 7364, Order: 171655, Start Time: 2013-01-06 12:11:21, End Time: 2013-01-06 15:45:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1101 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.14% (2.7825 => 2.8143, std.dev.: 0.0058) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.72% (0.0625 => 0.0917, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.12% (0.1063 => 0.1447, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.16% (0.0475 => 0.0623, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.03% (0.1106 => 0.1416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.90% (0.5900 => 0.7487, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.73% (0.1620 => 0.2053, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.67% (0.4139 => 0.5243, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 26.51% (1.5932 => 2.0156, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.39% (0.4994 => 0.6312, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.22% (0.4253 => 0.5368, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.95% (0.0541 => 0.0676, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.78% (0.1021 => 0.1274, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.75% (0.1604 => 0.2001, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.70% (0.5000 => 0.6235, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 22.17% (0.1619 => 0.1978, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.47% (0.3903 => 0.4741, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 21.00% (0.1505 => 0.1821, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.90% (0.2014 => 0.2435, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 20.27% (0.9697 => 1.1663, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 20.20% (0.1218 => 0.1464, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.15% (0.4029 => 0.4841, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 20.10% (0.5826 => 0.6997, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.99% (0.2736 => 0.3283, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.98% (0.2738 => 0.3285, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.89% (0.2866 => 0.3436, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.79% (0.2875 => 0.3444, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 19.75% (0.5889 => 0.7052, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.68% (1.3152 => 1.5740, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.64% (0.3890 => 0.4654, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 19.48% (0.2813 => 0.3361, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 19.47% (0.3004 => 0.3589, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.41% (0.2911 => 0.3476, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.35% (0.3271 => 0.3904, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 19.35% (0.2750 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 19.34% (0.2823 => 0.3369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.23% (0.2792 => 0.3329, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 19.20% (0.2714 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 19.19% (0.2803 => 0.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 19.14% (0.2811 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 19.12% (0.2725 => 0.3246, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.09% (0.2729 => 0.3250, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 18.92% (0.2780 => 0.3306, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.91% (2.0673 => 2.4583, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 18.90% (0.7171 => 0.8526, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 18.84% (0.5546 => 0.6591, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 18.73% (0.9909 => 1.1765, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 18.67% (0.3096 => 0.3674, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.65% (0.3195 => 0.3791, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.55% (3.5627 => 4.2235, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 18.31% (1.8794 => 2.2236, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 18.30% (0.3267 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 18.30% (0.1284 => 0.1519, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.17% (0.3060 => 0.3616, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.15% (0.3124 => 0.3691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 18.14% (0.3258 => 0.3849, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.07% (0.5026 => 0.5934, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.04% (1.6211 => 1.9136, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 17.94% (0.3317 => 0.3912, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.94% (0.1968 => 0.2321, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.76% (0.3362 => 0.3959, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.67% (0.4658 => 0.5481, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 17.50% (0.3726 => 0.4378, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 17.32% (0.3348 => 0.3928, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.31% (4.4195 => 5.1845, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.31% (0.3282 => 0.3850, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 17.26% (23.5202 => 27.5792, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.15% (0.4361 => 0.5109, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 17.13% (0.3678 => 0.4308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 17.11% (0.3477 => 0.4072, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.10% (0.1421 => 0.1664, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.08% (0.3625 => 0.4244, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.05% (0.3930 => 0.4600, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 17.04% (1.0781 => 1.2618, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.80% (0.3690 => 0.4310, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.77% (1.9694 => 2.2997, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.73% (0.3981 => 0.4647, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.72% (0.3845 => 0.4488, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 16.67% (0.4146 => 0.4837, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.55% (2.7292 => 3.1809, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 16.37% (0.4251 => 0.4947, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.32% (1.9966 => 2.3225, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 16.16% (0.3465 => 0.4025, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 16.16% (0.3460 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.11% (0.3488 => 0.4050, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 16.11% (0.3446 => 0.4001, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.10% (0.2566 => 0.2979, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 16.04% (0.3442 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 16.03% (0.3469 => 0.4025, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 16.02% (0.3496 => 0.4056, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.85% (4.2109 => 4.8784, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/bigfib: 15.76% (0.5012 => 0.5802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 15.59% (0.3650 => 0.4219, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.48% (0.3643 => 0.4207, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.41% (0.3724 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.98% (1.4269 => 1.6407, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.59% (0.6435 => 0.7374, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 14.25% (0.7875 => 0.8997, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.0804 => 0.0913, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 13.31% (2.1653 => 2.4536, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.26% (0.2737 => 0.3100, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.93% (4.6177 => 5.2149, std.dev.: 0.0138) MultiSource/Applications/lambda-0_1_3/lambda: 12.66% (0.3498 => 0.3941, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 12.58% (0.2075 => 0.2336, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.57% (2.1013 => 2.3655, std.dev.: 0.0063) MultiSource/Applications/SPASS/SPASS: 12.52% (5.5417 => 6.2354, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 12.37% (0.2691 => 0.3024, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.23% (0.2068 => 0.2321, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.03% (0.3084 => 0.3455, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.74% (11.6398 => 13.0062, std.dev.: 0.0157) MultiSource/Applications/minisat/minisat: 11.39% (0.3336 => 0.3716, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.17% (0.5361 => 0.5960, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.02% (0.6634 => 0.7365, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 10.54% (0.4847 => 0.5358, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.48% (0.1383 => 0.1528, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.34% (4.6926 => 5.1776, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.29% (0.2040 => 0.2250, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.60% (0.7426 => 0.8139, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 8.02% (2.0346 => 2.1978, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.00% (11.9555 => 12.9116, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (0.5584 => 0.6026, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.54% (0.3792 => 0.4040, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5174, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.04% (0.3693 => 0.3990, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6137, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2385, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6829, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-2: 4.38% (1.8057 => 1.8847, std.dev.: 0.0061) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2793, std.dev.: 0.0069) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0815, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2094, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6860, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5887, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4768, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.75% (2.4764 => 2.4330, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5821, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.15% (17.2379 => 14.1086, std.dev.: 0.0925) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -7.70% (0.2402 => 0.2217, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7921, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2090, std.dev.: 0.0165) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.68% (14.0481 => 13.5311, std.dev.: 0.1193) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8055, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.1980, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4982, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1490, std.dev.: 0.0804) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 13:10:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 15:10:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106211004.1C36F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7367?compare_to=7363&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7367, Order: 171665, Start Time: 2013-01-06 19:35:00, End Time: 2013-01-06 21:09:59 To: 7363, Order: 171656, Start Time: 2013-01-06 14:07:44, End Time: 2013-01-06 15:42:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (94 on baseline) Performance Improvements: 0 (142 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (808 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.64% (1.2657 => 1.2865, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.22% (0.5456 => 1.1524, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.46% (0.5567 => 1.1605, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.45% (0.5575 => 1.1621, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.42% (0.5581 => 1.1632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.19% (0.5688 => 1.1842, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.93% (0.5805 => 1.2012, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.78% (0.6395 => 1.3096, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.14% (0.5941 => 1.2128, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.30% (0.5849 => 1.1891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.28% (0.6033 => 1.2264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.07% (0.5859 => 1.1898, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.28% (0.6260 => 1.2663, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.83% (0.5478 => 1.0837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.41% (0.6189 => 1.2218, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.86% (0.5569 => 1.0963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.58% (0.6440 => 1.2660, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.46% (0.5570 => 1.0943, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.23% (0.5591 => 1.0971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.80% (0.6304 => 1.2343, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.34% (0.5705 => 1.1144, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.64% (0.5802 => 1.1293, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.62% (0.6395 => 1.2382, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.41% (0.6676 => 1.2845, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.71% (0.5925 => 1.1359, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.65% (0.5857 => 1.1225, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.56% (0.5863 => 1.1231, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.56% (0.6230 => 1.1934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.16% (0.6052 => 1.1569, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.02% (0.6660 => 1.2722, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.31% (0.6194 => 1.1540, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 85.82% (0.6446 => 1.1978, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.12% (0.6297 => 1.1657, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.38% (0.6681 => 1.2118, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.54% (0.7524 => 1.3584, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.50% (0.6667 => 1.2034, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.92% (0.0717 => 0.1247, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.17% (0.7339 => 1.2709, std.dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.81% (0.0974 => 0.1576, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.28% (0.0514 => 0.0829) SingleSource/Regression/C/sumarraymalloc: 59.55% (0.0267 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.90% (0.1132 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.65% (0.0680 => 0.0936, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.70% (1.6474 => 2.2190, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.38% (0.0582 => 0.0753, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.76% (0.0699 => 0.0900, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.84% (2.2587 => 2.8876, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.95% (0.0622 => 0.0771, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.19% (0.0621 => 0.0765, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.66% (0.5329 => 0.6430, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.26% (0.7021 => 0.8233, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.71% (0.4916 => 0.5639, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 13.60% (1.1450 => 1.3007, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.65% (4.5069 => 5.0772, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 11.56% (0.4515 => 0.5037, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.29% (0.2001 => 0.2227, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 11.08% (0.3357 => 0.3729, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.54% (1.6364 => 1.8088, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.31% (0.2385 => 0.2631, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.22% (0.1761 => 0.1941, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.68% (3.5339 => 3.8760, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.01% (0.1441 => 0.1542, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.25% (9.2283 => 9.8054, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 6.14% (1.2515 => 1.3284, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.55% (1.2784 => 1.3493, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 5.53% (5.0226 => 5.3005, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3319 => 0.3500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.3864 => 1.4147, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3722 => 1.3962, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6707, std.dev.: 0.0448) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.70% (0.9531 => 1.0170, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 4.23% (3.1932 => 3.3284, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5469, std.dev.: 0.1182) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0976, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.32% (5.1955 => 5.3678, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6551 => 3.7273, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6109, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3035, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.25% (0.1431 => 0.1313) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.20% (0.1584 => 0.1470) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.81% (0.2428 => 0.2287, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.06% (0.3812 => 0.3619, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.01% (0.3896 => 0.3701, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3884 => 0.3690, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.94% (0.3848 => 0.3658, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.86% (0.3891 => 0.3702, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.81% (0.4176 => 0.3975, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.81% (0.3142 => 0.2991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.76% (0.9852 => 0.9383, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.60% (0.4199 => 0.4006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.48% (0.3658 => 0.3494, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.42% (0.2871 => 0.2744, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.39% (0.4280 => 0.4092, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -4.25% (2.4924 => 2.3864, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.19% (0.3057 => 0.2929, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.17% (1.3148 => 1.2600, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.06% (2.1713 => 2.0831, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.06% (0.2933 => 0.2814, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.98% (0.4321 => 0.4149, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.95% (0.6484 => 0.6228, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.91% (0.9542 => 0.9169, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.90% (0.2695 => 0.2590, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (0.3025 => 0.2912, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -3.73% (4.3330 => 4.1715, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.71% (0.4151 => 0.3997, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -3.63% (0.7982 => 0.7692, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.62% (0.7919 => 0.7632, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.54% (0.3931 => 0.3792, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -3.42% (20.7746 => 20.0632, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (0.3621 => 0.3498, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.30% (2.4021 => 2.3228, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -3.17% (17.1032 => 16.5609, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.16% (0.4427 => 0.4287, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.15% (0.6347 => 0.6147, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.01% (0.6441 => 0.6247, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.99% (0.3849 => 0.3734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.87% (0.3483 => 0.3383, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.85% (1.0544 => 1.0243, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.85% (1.2300 => 1.1950, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.82% (0.4083 => 0.3968, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.78% (1.2221 => 1.1881, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.77% (1.2210 => 1.1872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.73% (0.4248 => 0.4132, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.72% (0.3788 => 0.3685, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.69% (6.7716 => 6.5894, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.56% (14.2083 => 13.8452, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: -2.52% (16.1920 => 15.7835, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -2.47% (0.7779 => 0.7587, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -2.46% (18.2933 => 17.8430, std.dev.: 0.0091) MultiSource/Applications/lua/lua: -2.44% (4.0594 => 3.9605, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.43% (0.5999 => 0.5853, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -2.37% (34.0927 => 33.2837, std.dev.: 0.0384) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.36% (0.8521 => 0.8320, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -2.26% (7.0961 => 6.9358, std.dev.: 0.0190) MultiSource/Applications/hbd/hbd: -2.09% (1.5610 => 1.5283, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: -1.83% (2.1401 => 2.1010, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.74% (0.6736 => 0.6619, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -1.63% (0.9179 => 0.9029, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.55% (8.0126 => 7.8885, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: -1.39% (15.2527 => 15.0410, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.15% (1.8100 => 0.6851, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3986, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3112, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.47% (1.3643 => 1.0305, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0620, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.46% (4.1024 => 3.1812, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4057, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1384, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.86% (4.9100 => 4.2786, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.37% (4.7378 => 4.1990, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.81% (1.1594 => 1.0920, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0523, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7585, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/ary3: -2.12% (3.7241 => 3.6450, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.06% (1.6086 => 1.5754, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.3096 => 1.2865, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7072, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.60% (4.8776 => 4.7997, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.04% (4.4002 => 4.3546, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 13:54:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 15:54:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130106215443.099092A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7368?compare_to=7365&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7368, Order: 171665, Start Time: 2013-01-06 19:41:43, End Time: 2013-01-06 21:54:38 To: 7365, Order: 171656, Start Time: 2013-01-06 14:14:28, End Time: 2013-01-06 16:27:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (608 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.98% (0.1365 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.45% (0.0662 => 0.0659, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8415 => 499.8599, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44225.61% (1.1277 => 499.8599, std.dev.: 0.0052) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.82% (0.5229 => 1.6514, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 18.94% (14.9895 => 17.8290, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 41.97% (14.1553 => 20.0963, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 16.30% (4.1105 => 4.7807, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.86% (1.1048 => 1.7440, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.36% (7.1582 => 37.3198, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 82.15% (3.4629 => 6.3078, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.88% (0.6222 => 1.0819, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10217.08% (0.0720 => 7.4283, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 3832000.00% (0.0001 => 3.8321, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11116700.00% (0.0001 => 11.1168, std.dev.: 0.0270) MultiSource/Applications/kimwitu++/kc: 50400.00% (0.0001 => 0.0505, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908800.00% (0.0001 => 9.9089) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482600.00% (0.0001 => 5.4827, std.dev.: 0.0092) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 803.96% (1.1194 => 10.1189, std.dev.: 0.0132) MultiSource/Applications/ClamAV/clamscan: 147.20% (22.1758 => 54.8194, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.43% (0.0929 => 0.1797, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.62% (0.1463 => 0.2540, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.02% (1.5859 => 2.5378, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.45% (0.0439 => 0.0700) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.20% (2.9384 => 4.5899, std.dev.: 0.0063) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.96% (7.0540 => 10.8601, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 50.04% (2.2024 => 3.3045, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.50% (0.5105 => 0.7530, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.80% (8.1363 => 11.9440, std.dev.: 0.0080) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.85% (21.9371 => 30.8985, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/almabench: 40.68% (0.0730 => 0.1027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.94% (0.6675 => 0.9341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.72% (0.4615 => 0.6356, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.26% (4.2646 => 5.8109, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: 36.22% (0.3109 => 0.4235, std.dev.: 0.0012) SingleSource/UnitTests/vla: 34.93% (0.0355 => 0.0479, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 34.64% (0.0814 => 0.1096, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 33.96% (0.1655 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.65% (1.5415 => 2.0448, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.11% (0.1906 => 0.2518, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.53% (0.2271 => 0.2987, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.19% (0.1337 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 30.29% (0.4299 => 0.5601, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 28.36% (1.1642 => 1.4944, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 26.56% (0.1555 => 0.1968, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 26.43% (0.0719 => 0.0909, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.73% (0.3121 => 0.3924, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 25.47% (0.0636 => 0.0798, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.19% (0.1584 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.93% (3.8922 => 4.8626, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 24.49% (5.7591 => 7.1697, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.00% (1.0722 => 1.3295, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 23.96% (0.2554 => 0.3166, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.95% (1.4186 => 1.7441, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.77% (0.1695 => 0.2081, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.70% (0.0793 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 22.70% (9.4845 => 11.6373, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.61% (0.1566 => 0.1920, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.80% (0.7115 => 0.8666, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.71% (1.3050 => 1.5883, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.50% (0.0842 => 0.1023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 21.37% (0.3098 => 0.3760, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.48% (0.2700 => 0.3253, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.28% (0.7835 => 0.9424, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.23% (0.4636 => 0.5574, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.09% (0.0886 => 0.1064, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.79% (0.0672 => 0.0805, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.77% (4.9449 => 5.9227, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 19.42% (1.1840 => 1.4139, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.04% (5.0018 => 5.9540, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: 18.98% (0.4289 => 0.5103, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.93% (0.1236 => 0.1470, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.58% (0.8172 => 0.9690, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/bigfib: 18.56% (0.6456 => 0.7654, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 18.55% (3.3354 => 3.9541, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.52% (0.0675 => 0.0800, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 18.49% (0.1163 => 0.1378, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.46% (0.1029 => 0.1219, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.5860 => 0.6942, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 18.28% (0.0662 => 0.0783, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 18.23% (0.1695 => 0.2004, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.05% (0.0953 => 0.1125, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 17.90% (0.4620 => 0.5447, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.67% (0.0730 => 0.0859, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.47% (0.1940 => 0.2279, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 17.46% (0.1151 => 0.1352, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 17.46% (0.7433 => 0.8731, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.37% (0.2758 => 0.3237, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.23% (0.5020 => 0.5885, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 17.14% (0.3232 => 0.3786, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/ReedSolomon: 17.03% (0.2049 => 0.2398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.90% (0.3307 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.83% (0.5569 => 0.6506, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.75% (0.0770 => 0.0899, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 16.66% (0.3283 => 0.3830, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.62% (0.1510 => 0.1761, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 16.56% (0.1268 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.51% (0.9765 => 1.1377, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.27% (0.1143 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 16.27% (0.3423 => 0.3980, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.23% (0.2107 => 0.2449, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.03% (2.0273 => 2.3523, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 15.93% (3.8723 => 4.4893, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.84% (0.0770 => 0.0892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.80% (0.5981 => 0.6926, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.65% (0.0933 => 0.1079, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 15.13% (0.8921 => 1.0271, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.08% (0.8101 => 0.9323, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.94% (0.3441 => 0.3955, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.59% (0.6450 => 0.7391, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 14.56% (2.2969 => 2.6313, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.3379 => 0.3861, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.98% (0.1044 => 0.1190, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.94% (1.1861 => 1.3514, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 13.71% (0.3180 => 0.3616, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.20% (0.3865 => 0.4375, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.07% (0.8067 => 0.9121, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 12.74% (1.5603 => 1.7591, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.68% (0.2603 => 0.2933, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 12.52% (0.3387 => 0.3811, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.06% (0.4203 => 0.4710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.87% (0.4103 => 0.4590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.59% (0.4048 => 0.4517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.41% (0.3603 => 0.4014, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.13% (0.1330 => 0.1478, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.05% (14.3668 => 15.9537, std.dev.: 0.0143) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 11.02% (0.3684 => 0.4090, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.98% (17.1811 => 19.0669, std.dev.: 0.0150) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.61% (0.4064 => 0.4495, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.56% (0.3826 => 0.4230, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.54% (0.3282 => 0.3628, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.36% (0.3543 => 0.3910, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.30% (0.3516 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.24% (0.2871 => 0.3165, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.18% (0.3427 => 0.3776, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.16% (0.2430 => 0.2677, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 9.86% (0.3092 => 0.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.48% (2.0665 => 2.2624, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.6030 => 0.6594, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.33% (0.2905 => 0.3176, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.30% (0.1892 => 0.2068, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.29% (0.2756 => 0.3012, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.10% (0.5925 => 0.6464, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.95% (0.2793 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.92% (0.2714 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: 8.81% (0.2725 => 0.2965, std.dev.: 0.0087) SingleSource/Benchmarks/Stanford/Puzzle: 8.75% (0.1268 => 0.1379, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.74% (1.2842 => 1.3965, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.63% (0.3162 => 0.3435, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.46% (0.2802 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.31% (0.3935 => 0.4262, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.89% (63.2438 => 68.2328, std.dev.: 0.0407) MultiSource/Benchmarks/PAQ8p/paq8p: 7.56% (10.3673 => 11.1515, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.68% (2.2022 => 2.3493, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.3177 => 0.3339, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.3131 => 0.3246, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.96% (0.3817 => 0.3930, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.00% (7.9617 => 8.1211, std.dev.: 0.0074) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2395, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3299, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0597, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4599, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3141, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.79% (3.6395 => 3.7775, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (2.0360 => 2.1101, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.37% (8.6802 => 8.8863, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2434, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 1.16% (9.1159 => 9.2215, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1775, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -75.36% (0.8651 => 0.2132, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -44.20% (0.1622 => 0.0905, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.88% (5.3855 => 4.4226, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.35% (5.3526 => 4.4237, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -13.19% (10.4361 => 9.0593, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.80% (1.7609 => 1.6059, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9507, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.57% (1.9577 => 0.6544, std.dev.: 0.0118) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3089, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0208, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4282, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7711, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0073, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.28% (2.5528 => 2.1373, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7332, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4918, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: -11.20% (1.2373 => 1.0987, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.23% (0.9540 => 0.8659, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.64% (19.9488 => 18.2243, std.dev.: 0.0372) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8339, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.16% (8.1563 => 7.8174, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1542, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -1.47% (3.6994 => 3.6452, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/lists: -1.31% (6.2999 => 6.2172, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0018) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 15:08:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 17:08:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130106230822.79E152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7369?compare_to=7367&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7369, Order: 171668, Start Time: 2013-01-06 21:33:40, End Time: 2013-01-06 23:08:18 To: 7367, Order: 171665, Start Time: 2013-01-06 19:35:00, End Time: 2013-01-06 21:09:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 1 (144 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (803 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.94% (0.3929 => 0.4359, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.15% (1.2865 => 1.2717, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.11% (0.5456 => 1.1518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.61% (0.5575 => 1.1630, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.44% (0.5581 => 1.1633, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.42% (0.5567 => 1.1603, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.32% (0.5688 => 1.1849, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.03% (0.5805 => 1.2018, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.10% (0.6395 => 1.3116, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.33% (0.5941 => 1.2139, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.38% (0.6033 => 1.2270, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.27% (0.5849 => 1.1889, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.24% (0.5859 => 1.1908, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.36% (0.6260 => 1.2668, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.10% (0.5478 => 1.0852, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.46% (0.6189 => 1.2221, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.22% (0.5569 => 1.0983, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.75% (0.5570 => 1.0959, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.65% (0.6440 => 1.2664, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.26% (0.5591 => 1.0973, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.80% (0.6304 => 1.2343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.79% (0.5705 => 1.1170, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.97% (0.5802 => 1.1312, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.85% (0.6395 => 1.2397, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.36% (0.6676 => 1.2842, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.99% (0.5857 => 1.1245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.95% (0.5925 => 1.1373, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.80% (0.6230 => 1.1949, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.71% (0.5863 => 1.1240, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.56% (0.6052 => 1.1593, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.31% (0.6660 => 1.2741, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.78% (0.6194 => 1.1569, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.10% (0.6446 => 1.1996, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.47% (0.6297 => 1.1679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.42% (0.6681 => 1.2121, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.86% (0.7524 => 1.3608, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.73% (0.6667 => 1.2049, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.20% (0.0717 => 0.1249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.25% (0.7339 => 1.2715, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.73% (0.0974 => 0.1585, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.28% (0.0514 => 0.0829, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 59.55% (0.0267 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.57% (0.0599 => 0.0860, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.25% (0.1132 => 0.1565, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.79% (0.0680 => 0.0937) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.69% (1.6474 => 2.2189, std.dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.48% (0.0445 => 0.0594, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.04% (0.0699 => 0.0902, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.83% (2.2587 => 2.8873, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.12% (0.0622 => 0.0772, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.51% (0.0621 => 0.0767, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.77% (0.5329 => 0.6436, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.44% (0.1081 => 0.1302, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.46% (0.7021 => 0.8247, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.77% (0.0634 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.73% (0.4916 => 0.5640, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.69% (0.3834 => 0.4359, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 13.64% (1.1450 => 1.3012, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.64% (4.5069 => 5.0765, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.35% (0.3357 => 0.3738, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.24% (0.2001 => 0.2226, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.59% (1.6364 => 1.8097, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 9.65% (0.1761 => 0.1931, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.56% (3.5339 => 3.8718, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.01% (0.1441 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.39% (9.2283 => 9.8181, std.dev.: 0.0159) MultiSource/Applications/Burg/burg: 6.24% (1.2515 => 1.3296, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (0.3319 => 0.3510, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.74% (1.2784 => 1.3518, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.46% (5.0226 => 5.2970, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (1.3864 => 1.4143, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.77% (1.3722 => 1.3965, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (5.4682 => 5.5242, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.58% (31.3723 => 55.7124, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.86% (0.9531 => 1.0185, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 4.37% (3.1932 => 3.3329, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0989, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4729, std.dev.: 0.0856) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6551 => 3.7243, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3032, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6093, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.40% (0.1281 => 0.1135, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.39% (0.1584 => 0.1467, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.64% (0.2428 => 0.2291, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3821 => 0.3624, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.10% (0.3884 => 0.3686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.09% (0.3831 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.07% (0.3848 => 0.3653, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.95% (0.3896 => 0.3703, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.93% (0.3891 => 0.3699, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.89% (0.4176 => 0.3972, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.84% (0.3142 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.70% (0.9852 => 0.9389, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.43% (0.3658 => 0.3496, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -4.42% (2.4924 => 2.3822, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.25% (0.7198 => 0.6892, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.20% (0.2903 => 0.2781, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.04% (0.7919 => 0.7599, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.02% (1.3148 => 1.2619, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.01% (0.6484 => 0.6224, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.99% (0.3205 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.97% (0.2849 => 0.2736, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.92% (0.2933 => 0.2818, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.88% (0.9542 => 0.9172, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.87% (2.1713 => 2.0872, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -3.87% (0.3025 => 0.2908, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.84% (0.4321 => 0.4155, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.81% (0.4151 => 0.3993, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.78% (0.2695 => 0.2593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -3.77% (0.3026 => 0.2912, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -3.70% (0.7982 => 0.7687, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -3.67% (0.2939 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -3.65% (4.3330 => 4.1748, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.54% (0.3931 => 0.3792, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.45% (0.2989 => 0.2886) MultiSource/Applications/siod/siod: -3.19% (2.4021 => 2.3255, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (0.3621 => 0.3507, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.03% (0.3867 => 0.3750, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.02% (17.1032 => 16.5873, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.99% (0.3483 => 0.3379, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.96% (0.6347 => 0.6159, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.94% (0.4427 => 0.4297, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -2.92% (0.6441 => 0.6253, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -2.92% (20.7746 => 20.1683, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.89% (1.0544 => 1.0239, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.87% (1.2210 => 1.1860, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.75% (0.3849 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.75% (1.2221 => 1.1885, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.69% (0.4083 => 0.3973, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.68% (1.2300 => 1.1970, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: -2.64% (0.4248 => 0.4136, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.62% (14.2083 => 13.8361, std.dev.: 0.0170) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.60% (6.7716 => 6.5954, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: -2.52% (0.7779 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.52% (0.5999 => 0.5848, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -2.43% (16.1920 => 15.7991, std.dev.: 0.0219) MultiSource/Applications/kimwitu++/kc: -2.36% (18.2933 => 17.8616, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -2.33% (4.0594 => 3.9650, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.29% (0.8521 => 0.8326, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -2.19% (7.0961 => 6.9404, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -2.12% (34.0927 => 33.3706, std.dev.: 0.0166) MultiSource/Applications/hbd/hbd: -2.08% (1.5610 => 1.5285, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -1.97% (2.1401 => 2.0980, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.74% (0.6736 => 0.6619, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: -1.72% (0.9179 => 0.9021, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.56% (0.9077 => 0.8935, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.40% (8.0126 => 7.9002, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -1.34% (15.2527 => 15.0485, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.86% (1.8100 => 0.6723, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3145, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0623, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1806, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4050, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2797, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.81% (4.1534 => 3.8706, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.47% (1.1594 => 1.0960, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.89% (1.3096 => 1.2717, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7706, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/ary3: -2.33% (3.7241 => 3.6373, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.67% (1.6086 => 1.5817, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.65% (4.8776 => 4.7971, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7092 => 3.6559, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.32% (1.6219 => 1.6005, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -1.09% (1.4516 => 1.4358, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 16:37:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 18:37:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107003759.4C0A42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7370?compare_to=7368&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7370, Order: 171671, Start Time: 2013-01-06 22:25:04, End Time: 2013-01-07 00:37:54 To: 7368, Order: 171665, Start Time: 2013-01-06 19:41:43, End Time: 2013-01-06 21:54:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0659 => 0.0658, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8599 => 499.8590, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.53% (1.1277 => 499.8590, std.dev.: 0.0048) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.74% (0.5229 => 1.6458, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 18.82% (14.9895 => 17.8102, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 41.80% (14.1553 => 20.0728, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/gs/gs: 16.52% (4.1105 => 4.7896, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.53% (1.1048 => 1.7404, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 417.35% (7.1582 => 37.0327, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.59% (3.4629 => 6.2883, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.75% (0.6222 => 1.0811, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10217.50% (0.0720 => 7.4286, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: 3831800.00% (0.0001 => 3.8319, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11087300.00% (0.0001 => 11.0874, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574300.00% (0.0001 => 0.5744, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908300.00% (0.0001 => 9.9084, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485500.00% (0.0001 => 5.4856, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 804.44% (1.1194 => 10.1243, std.dev.: 0.0376) MultiSource/Applications/ClamAV/clamscan: 146.95% (22.1758 => 54.7624, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.43% (0.0929 => 0.1797, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 73.07% (0.1463 => 0.2532, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 64.07% (0.0231 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.82% (1.5859 => 2.5346, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.23% (0.0439 => 0.0699) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.55% (2.9384 => 4.6001, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.44% (7.0540 => 10.8234, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.81% (2.2024 => 3.2994, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.60% (0.5105 => 0.7535, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 47.25% (0.1056 => 0.1555, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.53% (8.1363 => 11.9219, std.dev.: 0.0118) SingleSource/UnitTests/Vector/multiplies: 45.16% (0.0279 => 0.0405, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: 42.64% (0.0265 => 0.0378, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.90% (21.9371 => 30.9100, std.dev.: 0.0207) SingleSource/Benchmarks/CoyoteBench/almabench: 40.55% (0.0730 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.97% (0.6675 => 0.9343, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.55% (0.4615 => 0.6348, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 37.22% (0.1432 => 0.1965, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.17% (4.2646 => 5.8069, std.dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 35.45% (0.3109 => 0.4211, std.dev.: 0.0003) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 34.89% (0.0814 => 0.1098, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 34.08% (0.1655 => 0.2219, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.62% (1.5415 => 2.0443, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.11% (0.1906 => 0.2518, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.53% (0.2271 => 0.2987, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 30.45% (0.4299 => 0.5608, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.44% (0.1337 => 0.1744, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4949, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 26.43% (0.0719 => 0.0909, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.70% (0.3121 => 0.3923, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/Oscar: 25.63% (0.0636 => 0.0799, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.19% (0.1584 => 0.1983, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.94% (3.8922 => 4.8631, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.61% (5.7591 => 7.1763, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 23.88% (1.0722 => 1.3282, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 23.81% (0.2554 => 0.3162, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.21% (1.4186 => 1.7478, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.95% (0.1695 => 0.2084, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.77% (9.4845 => 11.6444, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.70% (0.0793 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.67% (0.1566 => 0.1921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.63% (1.3050 => 1.5873, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 21.36% (0.7115 => 0.8635, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 21.24% (0.3098 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 20.72% (0.1163 => 0.1404, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.48% (0.2700 => 0.3253, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.19% (0.4636 => 0.5572, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 20.15% (0.7835 => 0.9414, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.80% (4.9449 => 5.9242, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.49% (0.0672 => 0.0803, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.12% (5.0018 => 5.9581, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 18.94% (1.1840 => 1.4083, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.69% (0.1236 => 0.1467, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.69% (0.5860 => 0.6955, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 18.65% (0.4289 => 0.5089, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 18.62% (0.6456 => 0.7658, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.52% (0.0675 => 0.0800, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.47% (0.8172 => 0.9681, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.46% (0.1029 => 0.1219, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 18.38% (3.3354 => 3.9485, std.dev.: 0.0122) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.26% (0.0953 => 0.1127, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 18.17% (0.1695 => 0.2003, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 17.98% (0.0662 => 0.0781, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 17.90% (0.4620 => 0.5447, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.81% (0.0730 => 0.0860, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.63% (0.1940 => 0.2282, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 17.55% (0.1151 => 0.1353, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 17.33% (0.3232 => 0.3792) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 17.26% (0.0614 => 0.0720, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 17.21% (0.7433 => 0.8712, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.18% (0.5569 => 0.6526, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 17.15% (0.3283 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 17.08% (0.2049 => 0.2399, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.97% (0.5020 => 0.5872, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.96% (0.3307 => 0.3868, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.57% (0.2758 => 0.3215, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.56% (0.1510 => 0.1760, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.54% (0.1143 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.52% (0.9765 => 1.1378, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.51% (0.0648 => 0.0755, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 16.40% (0.1268 => 0.1476, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.39% (0.3423 => 0.3984, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.20% (0.1117 => 0.1298, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.82% (3.8723 => 4.4850, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 15.74% (2.0273 => 2.3463, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.71% (0.0770 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.62% (0.5981 => 0.6915, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.59% (0.2065 => 0.2387, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.39% (0.8921 => 1.0294, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.36% (0.8101 => 0.9345, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.16% (0.6450 => 0.7428, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3379 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.73% (0.3441 => 0.3948, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 14.68% (0.0933 => 0.1070, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 14.45% (2.2969 => 2.6287, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: 14.06% (0.0818 => 0.0933, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.91% (1.1861 => 1.3511, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.86% (0.8067 => 0.9185, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 13.71% (0.3180 => 0.3616, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 13.64% (0.1144 => 0.1300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.51% (0.3865 => 0.4387, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 13.41% (0.1044 => 0.1184, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.18% (0.0759 => 0.0859, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.72% (0.2603 => 0.2934, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.63% (1.5603 => 1.7573, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 12.61% (0.3387 => 0.3814, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.32% (0.4203 => 0.4721, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.94% (0.4103 => 0.4593, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.80% (0.3603 => 0.4028, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 11.72% (0.3422 => 0.3823, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.71% (0.4048 => 0.4522, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.05% (0.1330 => 0.1477, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.96% (14.3668 => 15.9412, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists1: 10.91% (0.3684 => 0.4086, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.90% (0.4064 => 0.4507, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 10.87% (17.1811 => 19.0479, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.66% (0.3826 => 0.4234, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 10.60% (0.3282 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.35% (0.6030 => 0.6654, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.25% (0.2430 => 0.2679, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 10.19% (0.5925 => 0.6529, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/strcat: 10.14% (0.2831 => 0.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.04% (0.3427 => 0.3771, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.98% (0.2905 => 0.3195, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 9.93% (0.3092 => 0.3399, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 9.75% (0.7326 => 0.8040, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/fibo: 9.69% (0.2725 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.69% (0.2756 => 0.3023, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.68% (2.0665 => 2.2666, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: 9.66% (0.2877 => 0.3155, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.51% (0.2891 => 0.3166, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.49% (0.2793 => 0.3058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.43% (0.2714 => 0.2970, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.31% (0.1268 => 0.1386, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.30% (0.1892 => 0.2068, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.16% (0.2872 => 0.3135, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 8.99% (0.2802 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.98% (0.3052 => 0.3326, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.74% (0.3935 => 0.4279, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.73% (1.2842 => 1.3963, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3162 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 8.16% (10.3673 => 11.2137, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.07% (0.3136 => 0.3389, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 7.58% (63.2438 => 68.0380, std.dev.: 0.0393) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.65% (2.2022 => 2.3486, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.4879 => 0.5182, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.38% (0.3177 => 0.3348, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.89% (7.9617 => 8.1119, std.dev.: 0.0197) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.20% (32.5116 => 59.2365, std.dev.: 0.0139) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6959, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.33% (1.1396 => 1.2459, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3283, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (4.2280 => 4.4724, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.87% (3.6395 => 3.7803, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.61% (2.0360 => 2.1096, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9056, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2443, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.12% (9.1159 => 9.2177, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5750, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1676, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.64% (5.2763 => 1.1799, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.14% (5.3855 => 4.4088, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.57% (5.3526 => 4.4124, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -13.24% (10.4361 => 9.0543, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.24% (1.7609 => 1.6158, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9594, std.dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.93% (1.9577 => 0.6474, std.dev.: 0.0150) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3081, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0207, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4318, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7763, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0084, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2948, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0907, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.29% (2.5528 => 2.1370, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.74% (1.2373 => 1.0921, std.dev.: 0.0046) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.26% (0.9540 => 0.8657, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.94% (1.5660 => 1.4260, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3044, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4757, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8375, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.13% (8.1563 => 7.8191, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.57% (3.7221 => 3.6635, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.21% (3.6994 => 3.6547, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2324, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0033) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 16:41:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 18:41:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107004122.180E22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7371?compare_to=7366&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7371, Order: 171666, Start Time: 2013-01-06 21:07:15, End Time: 2013-01-07 00:41:17 To: 7366, Order: 171656, Start Time: 2013-01-06 16:40:42, End Time: 2013-01-06 20:14:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1097 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.84% (126.1850 => 129.7642, std.dev.: 0.3129) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.63% (0.3990 => 0.4095, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.24% (1.1663 => 1.1518, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -1.22% (1.1765 => 1.1621, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.18% (2.4583 => 2.4293, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.64% (0.0625 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.89% (0.2969 => 0.3797, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.44% (0.5900 => 0.7460, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.33% (0.0714 => 0.0902, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.31% (0.4139 => 0.5228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.22% (0.1106 => 0.1396, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.17% (0.4994 => 0.6301, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 25.46% (1.5932 => 1.9988, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.43% (0.1620 => 0.2032, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.22% (0.5000 => 0.6211, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.99% (0.1619 => 0.1975, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.63% (0.1549 => 0.1884, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.55% (0.2014 => 0.2448, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.37% (0.3903 => 0.4737, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 20.03% (0.1218 => 0.1462, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.58% (0.4029 => 0.4818, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.43% (0.3890 => 0.4646, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 19.40% (0.1505 => 0.1797, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.21% (1.3152 => 1.5678, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 19.09% (0.5826 => 0.6938, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.05% (0.2866 => 0.3412, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.86% (0.2736 => 0.3252, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 18.78% (0.9697 => 1.1518, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 18.75% (0.5889 => 0.6993, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.64% (3.5627 => 4.2268, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 18.61% (0.5546 => 0.6578, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.55% (0.2738 => 0.3246, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.37% (0.2875 => 0.3403, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.00% (0.2911 => 0.3435, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 17.99% (0.2813 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 17.96% (0.2823 => 0.3330, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.93% (0.7171 => 0.8457, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 17.93% (0.2750 => 0.3243, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.92% (0.3271 => 0.3857, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 17.88% (1.8794 => 2.2154, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.85% (1.6211 => 1.9104, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 17.83% (0.2714 => 0.3198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.80% (0.2792 => 0.3289, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 17.78% (0.3004 => 0.3538, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 17.76% (0.2725 => 0.3209, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.75% (0.4658 => 0.5485, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.75% (0.5026 => 0.5918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.74% (0.2729 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 17.73% (0.2803 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.61% (0.2811 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.58% (0.1968 => 0.2314, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 17.52% (0.2780 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.51% (2.0673 => 2.4293, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 17.31% (0.3096 => 0.3632, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 17.28% (0.9909 => 1.1621, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.25% (4.4195 => 5.1819, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.18% (0.3195 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 17.11% (23.5202 => 27.5451, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 16.96% (0.3267 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.84% (0.3930 => 0.4592, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.76% (0.3060 => 0.3573, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.76% (0.3258 => 0.3804, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.75% (1.0781 => 1.2587, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.65% (1.9694 => 2.2973, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 16.58% (0.3317 => 0.3867, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.58% (0.4361 => 0.5084, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.49% (0.3124 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.40% (2.7292 => 3.1768, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.30% (0.3362 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.20% (1.9966 => 2.3200, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.15% (0.3282 => 0.3812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 16.04% (0.3348 => 0.3885, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 16.00% (0.3726 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.88% (0.3477 => 0.4029, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.85% (0.3678 => 0.4261, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.68% (0.3845 => 0.4448, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.67% (0.3465 => 0.4008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.67% (4.2109 => 4.8706, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.65% (0.3981 => 0.4604, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 15.63% (0.4146 => 0.4794, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.58% (0.3690 => 0.4265, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.56% (0.3625 => 0.4189, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.55% (0.3446 => 0.3982, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.54% (0.3488 => 0.4030, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 15.49% (0.3442 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.45% (0.3469 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.43% (0.3460 => 0.3994, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.39% (0.3496 => 0.4034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 15.15% (0.4251 => 0.4895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 14.99% (0.3650 => 0.4197, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.88% (0.3643 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.82% (0.3724 => 0.4276, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.81% (1.4269 => 1.6382, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.76% (0.5012 => 0.5752, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.49% (0.1028 => 0.1177, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.46% (0.6435 => 0.7301, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: 13.18% (2.1653 => 2.4507, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 12.74% (4.6177 => 5.2060, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.68% (0.2737 => 0.3084, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (2.1013 => 2.3610, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 12.33% (5.5417 => 6.2249, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/football/football: 12.29% (0.2075 => 0.2330, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.85% (0.2068 => 0.2313, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.51% (0.3084 => 0.3439, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 11.12% (0.3336 => 0.3707, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.09% (0.6634 => 0.7370, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.07% (11.6398 => 12.9280, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.82% (0.5361 => 0.5941, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.44% (0.2040 => 0.2253, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.19% (0.4847 => 0.5341, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.89% (4.6926 => 5.1569, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.44% (0.7426 => 0.8127, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.46% (0.1383 => 0.1500, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.32% (0.2391 => 0.2590, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 7.88% (2.0346 => 2.1949, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.79% (0.5584 => 0.6019, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8548, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5267, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.89% (0.3693 => 0.4095, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6759, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2384, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8954, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6800, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2110, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3066, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0802, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2085, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4815, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.55% (2.4764 => 2.4132, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5540, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.47% (17.2379 => 14.2259, std.dev.: 0.0551) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -8.99% (0.2402 => 0.2186, std.dev.: 0.0052) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7943, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0096) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.80% (14.0481 => 13.5145, std.dev.: 0.1304) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2318, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8106, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1205, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5824, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1712, std.dev.: 0.0605) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0474, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 17:06:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 19:06:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107010625.705642A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7372?compare_to=7369&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7372, Order: 171674, Start Time: 2013-01-06 23:31:43, End Time: 2013-01-07 01:06:19 To: 7369, Order: 171668, Start Time: 2013-01-06 21:33:40, End Time: 2013-01-06 23:08:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (806 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.17% (0.5456 => 1.1576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.61% (0.5575 => 1.1686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 109.44% (0.5581 => 1.1689, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.28% (0.5688 => 1.1904, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.14% (0.5567 => 1.1643, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.68% (0.5805 => 1.2056, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.15% (0.6395 => 1.3183, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 105.03% (0.5941 => 1.2181, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.39% (0.6033 => 1.2331, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.29% (0.5849 => 1.1949, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.86% (0.5859 => 1.1944, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.59% (0.6260 => 1.2745, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.53% (0.5478 => 1.0930, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.47% (0.6189 => 1.2283, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.28% (0.5569 => 1.1042, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.83% (0.5570 => 1.1019, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.56% (0.6440 => 1.2723, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.41% (0.5591 => 1.1037, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.93% (0.5705 => 1.1235, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.76% (0.6304 => 1.2404, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.88% (0.5802 => 1.1365, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.87% (0.6395 => 1.2462, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.51% (0.6676 => 1.2919, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.02% (0.5863 => 1.1317, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.98% (0.5925 => 1.1434, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.84% (0.6230 => 1.2014, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.83% (0.5857 => 1.1294, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.50% (0.6052 => 1.1650, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 92.28% (0.6660 => 1.2806, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.71% (0.6194 => 1.1627, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.17% (0.6446 => 1.2065, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.26% (0.6297 => 1.1729, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.55% (0.6681 => 1.2196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.82% (0.6667 => 1.2122, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.55% (0.7524 => 1.3660, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.03% (0.0717 => 0.1255, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.37% (0.7339 => 1.2797, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.83% (0.0974 => 0.1586, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.26% (0.0514 => 0.0834, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.33% (0.1500 => 0.2210, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.41% (0.0599 => 0.0865, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.69% (0.1132 => 0.1570, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.51% (0.0693 => 0.0946, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.32% (1.6474 => 2.2293, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.16% (0.0445 => 0.0597, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.41% (0.0582 => 0.0759) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.53% (2.2587 => 2.9032, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.92% (0.0622 => 0.0777, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.37% (0.1081 => 0.1312, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.34% (0.5329 => 0.6466, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.70% (0.7021 => 0.8264, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.14% (0.1146 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.26% (0.4916 => 0.5666, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 14.22% (1.1450 => 1.3078, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 13.19% (0.0864 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.19% (4.5069 => 5.1013, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 12.36% (0.4515 => 0.5073, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.84% (0.2001 => 0.2238, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 11.83% (0.3357 => 0.3754, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.14% (1.6364 => 1.8187, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.69% (0.2385 => 0.2640, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.33% (3.5339 => 3.8990, std.dev.: 0.0131) SingleSource/Benchmarks/McGill/chomp: 10.22% (0.1761 => 0.1941, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.43% (0.1441 => 0.1548) MultiSource/Applications/Burg/burg: 6.86% (1.2515 => 1.3373, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (9.2283 => 9.8571, std.dev.: 0.0100) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.15% (0.3319 => 0.3523, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.98% (1.2784 => 1.3549, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 5.65% (5.0226 => 5.3062, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3255 => 0.3421, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.50% (0.4524 => 0.4637, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.45% (1.3864 => 1.4203, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.16% (1.3722 => 1.4019, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.56% (0.6750 => 0.6855, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.41% (5.4682 => 5.5452, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.40% (1.4642 => 1.4847, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.28% (0.8418 => 0.8526, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.65% (31.3723 => 55.7324, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.44% (0.9531 => 1.0145, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 4.74% (3.1932 => 3.3446, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0966, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3672, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.5751 => 56.3536, std.dev.: 0.1013) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.18% (2.0478 => 2.1129, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6551 => 3.7244, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6108, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3032, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (79.7170 => 80.9232, std.dev.: 0.1618) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.93% (0.1281 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.27% (0.2428 => 0.2300, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.92% (0.3821 => 0.3633, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.70% (0.3831 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3812 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.63% (0.3848 => 0.3670, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.52% (0.3891 => 0.3715, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.51% (0.3880 => 0.3705, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.42% (0.3142 => 0.3003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.34% (0.4033 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.33% (0.3323 => 0.3179, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.30% (0.9852 => 0.9428, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.24% (0.4199 => 0.4021, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.07% (0.3658 => 0.3509, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.00% (0.4280 => 0.4109, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.99% (2.4924 => 2.3930, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.89% (0.7198 => 0.6918, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -3.80% (0.2871 => 0.2762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.76% (0.3057 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.73% (0.6484 => 0.6242, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.71% (0.3205 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.61% (2.1713 => 2.0930, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.61% (0.9542 => 0.9198, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.60% (1.3148 => 1.2675, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -3.58% (0.2849 => 0.2747, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.54% (0.4151 => 0.4004, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.49% (0.7919 => 0.7643, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.47% (0.3252 => 0.3139, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (0.3025 => 0.2920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.47% (0.3026 => 0.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -3.32% (0.7982 => 0.7717, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.26% (0.3931 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.13% (4.3330 => 4.1974, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.84% (20.7746 => 20.1853, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.81% (17.1032 => 16.6229, std.dev.: 0.0220) SingleSource/UnitTests/ObjC++/Hello: -2.79% (0.6347 => 0.6170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -2.64% (2.4021 => 2.3387, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -2.59% (0.3867 => 0.3767, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.56% (0.6441 => 0.6276, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (1.2221 => 1.1921, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.44% (1.2210 => 1.1912, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.42% (1.0544 => 1.0289, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.38% (14.2083 => 13.8700, std.dev.: 0.0110) SingleSource/UnitTests/ObjC++/property-reference: -2.37% (0.7779 => 0.7595, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (1.2300 => 1.2018, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.12% (0.5999 => 0.5872, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.09% (6.7716 => 6.6302, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -2.02% (34.0927 => 33.4039, std.dev.: 0.0417) MultiSource/Applications/JM/lencod/lencod: -2.01% (16.1920 => 15.8661, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.00% (0.8521 => 0.8351, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -1.96% (4.0594 => 3.9798, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -1.84% (7.0961 => 6.9652, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: -1.83% (18.2933 => 17.9585, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: -1.69% (1.5610 => 1.5346, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: -1.46% (2.1401 => 2.1089, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.40% (0.9077 => 0.8950, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: -1.10% (0.9179 => 0.9078, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.06% (8.0126 => 7.9276, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: -1.00% (15.2527 => 15.1001, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.06% (1.8100 => 0.6686, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3141, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.50% (1.3643 => 1.0301, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3262, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7570, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0587, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1805, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4047, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0074) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1381, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6843, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2797, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1978, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7813, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8713, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.91% (1.1594 => 1.0909, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.16% (3.1919 => 3.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.72% (1.3096 => 1.2740, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7765, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.22% (1.6086 => 1.5729, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.7241 => 3.6488, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7072, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4668, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.56% (4.8776 => 4.8016, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4353, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3551, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 19:04:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 21:04:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107030436.0FE692A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7373?compare_to=7372&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7373, Order: 171679, Start Time: 2013-01-07 01:29:52, End Time: 2013-01-07 03:04:30 To: 7372, Order: 171674, Start Time: 2013-01-06 23:31:43, End Time: 2013-01-07 01:06:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (146 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (799 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.66% (3.7768 => 3.8772, std.dev.: 0.0353) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.07% (0.5456 => 1.1516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.45% (0.5575 => 1.1621, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.42% (0.5581 => 1.1632, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.09% (0.5688 => 1.1836, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 107.94% (0.5567 => 1.1576, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.46% (0.5805 => 1.1985, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.72% (0.6395 => 1.3092, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.85% (0.5941 => 1.2111, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.18% (0.6033 => 1.2258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.06% (0.5849 => 1.1877, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.99% (0.5859 => 1.1893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.16% (0.6260 => 1.2655, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.12% (0.5478 => 1.0853, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.11% (0.5569 => 1.0977, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.09% (0.6189 => 1.2198, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.66% (0.5570 => 1.0954, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.61% (0.6440 => 1.2662, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.08% (0.5591 => 1.0963, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.65% (0.5705 => 1.1162, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.54% (0.6304 => 1.2327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.62% (0.5802 => 1.1292, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.00% (0.6395 => 1.2406, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.29% (0.6676 => 1.2837, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 91.81% (0.5925 => 1.1365, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 91.81% (0.6230 => 1.1950, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.78% (0.5863 => 1.1244, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.75% (0.5857 => 1.1231, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.59% (0.6052 => 1.1595, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.95% (0.6660 => 1.2717, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.60% (0.6194 => 1.1558, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.29% (0.6446 => 1.2008, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.41% (0.6297 => 1.1675, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.47% (0.6681 => 1.2124, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 80.76% (0.6667 => 1.2051, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.45% (0.7524 => 1.3577, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.92% (0.0717 => 0.1247, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.31% (0.7339 => 1.2719, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.40% (0.0974 => 0.1572, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 59.18% (0.0267 => 0.0425, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.33% (0.0315 => 0.0483, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 45.05% (0.0293 => 0.0425, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.41% (0.0599 => 0.0859, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.72% (0.1132 => 0.1559, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.35% (0.0680 => 0.0934) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.64% (0.0693 => 0.0940, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 34.65% (1.6474 => 2.2183, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.48% (0.0445 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 29.55% (0.0582 => 0.0754, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 27.80% (2.2587 => 2.8866, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.95% (0.0622 => 0.0771, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.03% (0.0621 => 0.0764, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.49% (0.5329 => 0.6421, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.35% (0.1081 => 0.1301, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.19% (0.7021 => 0.8228, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.77% (0.0634 => 0.0734, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.61% (0.4916 => 0.5634, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 13.51% (1.1450 => 1.2997, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (4.5069 => 5.0782, std.dev.: 0.0107) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.54% (0.4515 => 0.5036, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 11.05% (0.3357 => 0.3728, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.99% (0.2001 => 0.2221, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.52% (1.6364 => 1.8086, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.66% (3.5339 => 3.8752, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 9.60% (0.1761 => 0.1930, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 6.18% (1.2515 => 1.3289, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (9.2283 => 9.7959, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.60% (1.2784 => 1.3500, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3319 => 0.3499, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 5.18% (5.0226 => 5.2826, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.20% (0.4813 => 0.4919, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.04% (1.3864 => 1.4147, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3960, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.19% (1.4642 => 1.4816, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.10% (5.4682 => 5.5285, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.65% (31.3723 => 55.7342, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.83% (0.9531 => 1.0182, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 4.50% (3.1932 => 3.3368, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5903, std.dev.: 0.0853) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0968, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 3.57% (3.7435 => 3.8772, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3663, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.27% (2.0478 => 2.1147, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.39% (79.7170 => 81.6199, std.dev.: 0.0227) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6551 => 3.7288, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3037, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6079, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.63% (0.1281 => 0.1132, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.32% (0.1431 => 0.1312, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.13% (0.1584 => 0.1471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.72% (0.2428 => 0.2289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.38% (0.3812 => 0.3607, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.27% (0.3831 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.22% (0.3891 => 0.3688, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.18% (0.3896 => 0.3694, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.08% (0.4176 => 0.3964, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.00% (0.3142 => 0.2985, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.98% (0.4033 => 0.3832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.95% (0.4199 => 0.3991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.91% (0.9852 => 0.9368, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.81% (0.3884 => 0.3697, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -4.67% (0.4280 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.43% (0.3658 => 0.3496, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.34% (2.4924 => 2.3842, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: -4.25% (0.2871 => 0.2749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.19% (0.3057 => 0.2929, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.13% (0.9542 => 0.9148, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.13% (2.1713 => 2.0817, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -4.11% (1.3148 => 1.2608, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.08% (0.3016 => 0.2893, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.04% (0.6484 => 0.6222, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.02% (0.4151 => 0.3984, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.97% (0.6441 => 0.6185, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.93% (0.3205 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.83% (0.3026 => 0.2910, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.82% (0.2695 => 0.2592, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.74% (0.3931 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.70% (0.4321 => 0.4161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -3.59% (4.3330 => 4.1776, std.dev.: 0.0137) MultiSource/Applications/lambda-0_1_3/lambda: -3.46% (0.7982 => 0.7706, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: -3.45% (0.2989 => 0.2886, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (0.3621 => 0.3497, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.38% (0.7779 => 0.7516, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.32% (0.7919 => 0.7656, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: -3.18% (0.3867 => 0.3744, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.14% (17.1032 => 16.5656, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.05% (0.4427 => 0.4292, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.05% (1.2210 => 1.1838, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.99% (0.3483 => 0.3379, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -2.98% (2.4021 => 2.3305, std.dev.: 0.0193) MultiSource/Benchmarks/sim/sim: -2.94% (0.3406 => 0.3306, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.91% (1.2221 => 1.1865, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.90% (1.0544 => 1.0238, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (14.2083 => 13.8040, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.82% (1.2300 => 1.1953, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.81% (6.7716 => 6.5815, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.81% (0.3849 => 0.3741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.73% (0.4248 => 0.4132, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -2.64% (16.1920 => 15.7640, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.60% (0.4083 => 0.3977, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -2.49% (4.0594 => 3.9582, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -2.47% (7.0961 => 6.9207, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.39% (0.8521 => 0.8317, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2797, std.dev.: 0.0319) MultiSource/Applications/kimwitu++/kc: -2.37% (18.2933 => 17.8603, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: -2.26% (34.0927 => 33.3214, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.17% (0.5999 => 0.5869, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -2.17% (1.5610 => 1.5272, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: -1.87% (2.1401 => 2.1000, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.69% (0.6736 => 0.6622, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.64% (8.0126 => 7.8812, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: -1.46% (0.9179 => 0.9045, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -1.37% (15.2527 => 15.0437, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.46% (1.8100 => 0.6795, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3160, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0637, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.48% (4.1024 => 3.1802, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4056, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2802, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1978, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -5.24% (1.1594 => 1.0986, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0593, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7722, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.41% (1.3096 => 1.2781, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: -2.25% (3.7241 => 3.6403, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.91% (1.6086 => 1.5779, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8088, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.38% (1.6219 => 1.5995, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: -1.16% (1.4516 => 1.4348, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6702, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.03% (1.6307 => 1.6139, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 19:25:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 21:25:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107032523.8602D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7374?compare_to=7370&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7374, Order: 171679, Start Time: 2013-01-07 01:12:30, End Time: 2013-01-07 03:25:19 To: 7370, Order: 171671, Start Time: 2013-01-06 22:25:04, End Time: 2013-01-07 00:37:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (606 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.02% (11.2137 => 11.3281, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.86% (0.6474 => 0.6724, std.dev.: 0.0089) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1338 => 0.1339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0658 => 0.0659, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8590 => 499.8601, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44225.63% (1.1277 => 499.8601, std.dev.: 0.0053) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.57% (0.5229 => 1.6501, std.dev.: 0.0170) MultiSource/Applications/SPASS/SPASS: 18.78% (14.9895 => 17.8050, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 41.70% (14.1553 => 20.0580, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 16.78% (4.1105 => 4.8003, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.88% (1.1048 => 1.7443, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 417.14% (7.1582 => 37.0178, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 81.75% (3.4629 => 6.2937, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.45% (0.6222 => 1.0792, std.dev.: 0.0064) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10216.39% (0.0720 => 7.4278, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11072600.00% (0.0001 => 11.0727, std.dev.: 0.0637) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486100.00% (0.0001 => 5.4862, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 803.79% (1.1194 => 10.1170, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 147.36% (22.1758 => 54.8532, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 113.58% (0.0243 => 0.0519, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.86% (0.0929 => 0.1801, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 85.61% (0.0271 => 0.0503, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.27% (0.1463 => 0.2535, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.72% (1.5859 => 2.5330, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.23% (0.0439 => 0.0699, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.29% (2.9384 => 4.5925, std.dev.: 0.0189) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.71% (7.0540 => 10.8425, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.77% (2.2024 => 3.2985, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.62% (0.5105 => 0.7536, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.89% (8.1363 => 11.9516, std.dev.: 0.0086) SingleSource/UnitTests/Vector/multiplies: 44.80% (0.0279 => 0.0404, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 43.02% (0.0265 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 40.68% (0.0730 => 0.1027, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.59% (21.9371 => 30.8419, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 39.90% (0.6675 => 0.9338, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.64% (0.4615 => 0.6352, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 37.57% (0.1432 => 0.1970, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.41% (4.2646 => 5.8175, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 36.25% (0.3109 => 0.4236, std.dev.: 0.0064) SingleSource/UnitTests/vla: 35.21% (0.0355 => 0.0480, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 35.14% (0.0814 => 0.1100, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 34.02% (0.1655 => 0.2218, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.83% (1.5415 => 2.0476, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.32% (0.1906 => 0.2522, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.01% (0.2271 => 0.2998, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.64% (0.1337 => 0.1760, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 30.84% (0.4299 => 0.5625, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 28.74% (1.1642 => 1.4988, std.dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.14% (0.3121 => 0.3968, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: 26.70% (0.0719 => 0.0911, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.23% (0.0408 => 0.0515, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 25.63% (0.0636 => 0.0799, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.38% (0.1584 => 0.1986, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.05% (0.0479 => 0.0599, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 24.95% (0.0457 => 0.0571, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.85% (3.8922 => 4.8594, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 24.67% (5.7591 => 7.1798, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 24.13% (1.0722 => 1.3309, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 23.96% (0.2554 => 0.3166, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.46% (1.4186 => 1.7514, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 23.04% (9.4845 => 11.6701, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.01% (0.1695 => 0.2085, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.73% (0.1566 => 0.1922, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.57% (0.0793 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.72% (1.3050 => 1.5884, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 21.60% (0.7115 => 0.8652, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799) SingleSource/Benchmarks/Shootout-C++/matrix: 20.92% (0.3098 => 0.3746, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.81% (0.2700 => 0.3262, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.68% (0.0730 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 20.26% (0.7835 => 0.9422, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.98% (0.0871 => 0.1045, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.83% (4.9449 => 5.9253, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 19.79% (0.0672 => 0.0805, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.52% (0.4636 => 0.5541, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: 19.49% (0.0626 => 0.0748, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 19.18% (1.1840 => 1.4111, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.17% (0.1236 => 0.1473, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.03% (5.0018 => 5.9536, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.89% (0.5860 => 0.6967, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.88% (0.0842 => 0.1001, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.76% (0.1029 => 0.1222, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.73% (3.3354 => 3.9600, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.65% (0.8172 => 0.9696, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/mst/mst: 18.57% (0.1163 => 0.1379, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 18.49% (0.4289 => 0.5082, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 18.47% (0.1695 => 0.2008, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.37% (0.0675 => 0.0799, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.26% (0.0953 => 0.1127, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 18.22% (0.6456 => 0.7632, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 18.13% (0.0662 => 0.0782) MultiSource/Applications/aha/aha: 17.72% (0.1151 => 0.1355, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.61% (0.0886 => 0.1042, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.55% (0.2758 => 0.3242, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.53% (0.1940 => 0.2280, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 17.51% (0.4620 => 0.5429, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 17.43% (0.0614 => 0.0721, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.42% (0.5569 => 0.6539, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.14% (0.0770 => 0.0902, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.89% (0.1510 => 0.1765, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 16.86% (0.3232 => 0.3777, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.83% (0.5020 => 0.5865, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.72% (0.9765 => 1.1398, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.72% (0.3307 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.67% (0.0648 => 0.0756, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 16.64% (0.1268 => 0.1479, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 16.45% (0.3283 => 0.3823, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 16.43% (0.7433 => 0.8654, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.3423 => 0.3982, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 15.96% (2.0273 => 2.3509, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 15.95% (3.8723 => 4.4899, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.72% (0.5981 => 0.6921, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 15.71% (0.0770 => 0.0891, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.57% (0.8921 => 1.0310, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.49% (0.8101 => 0.9356, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.49% (0.1143 => 0.1320, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.19% (0.6450 => 0.7430, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.02% (0.3441 => 0.3958, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.01% (0.0933 => 0.1073, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 14.65% (2.2969 => 2.6334, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.50% (1.1861 => 1.3581, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 14.47% (0.3180 => 0.3640, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.46% (0.1044 => 0.1195, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3379 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.18% (0.0818 => 0.0934, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 13.81% (0.1144 => 0.1302) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.69% (0.8067 => 0.9171, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.18% (0.0759 => 0.0859, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.87% (0.2603 => 0.2938, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.83% (0.3865 => 0.4361, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7604, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.97% (0.4203 => 0.4706, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.48% (0.4103 => 0.4574, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.31% (14.3668 => 15.9910, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.28% (0.1330 => 0.1480, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.24% (0.4048 => 0.4503, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 11.21% (0.3603 => 0.4007, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.11% (0.3826 => 0.4251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.07% (0.3886 => 0.4316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.02% (0.3422 => 0.3799, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.94% (17.1811 => 19.0603, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists1: 10.72% (0.3684 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.48% (0.3427 => 0.3786, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 10.36% (0.3282 => 0.3622, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.33% (0.2430 => 0.2681, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.98% (0.6030 => 0.6632, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 9.93% (0.3092 => 0.3399, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.78% (0.2831 => 0.3108, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.67% (0.1892 => 0.2075, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 9.52% (0.5925 => 0.6489, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.27% (10.3673 => 11.3281, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.26% (2.0665 => 2.2579, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7326 => 0.8001, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.84% (0.2793 => 0.3040, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.77% (1.2842 => 1.3968, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.51% (0.3935 => 0.4270, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.32% (0.3052 => 0.3306, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 8.28% (0.1268 => 0.1373, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/random: 8.28% (0.2802 => 0.3034, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 7.44% (63.2438 => 67.9496, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.29% (2.2022 => 2.3407, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.98% (0.4879 => 0.5171, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.29% (0.3177 => 0.3345, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.94% (7.9617 => 8.1161, std.dev.: 0.0101) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.20% (32.5116 => 59.2377, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (1.1145 => 1.2925, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.14% (1.1396 => 1.2438, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3291, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4635, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (3.1578 => 3.3158, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.69% (3.6395 => 3.7737, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (2.0360 => 2.1089, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.52% (8.6802 => 8.8990, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.50% (1.0785 => 1.0947, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2457, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.14% (9.1159 => 9.2196, std.dev.: 0.0294) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1774, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.32% (0.8651 => 0.2135, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.23% (5.3855 => 4.4039, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.61% (5.3526 => 4.4102, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -13.03% (10.4361 => 9.0759, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.65% (1.7609 => 1.6085, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9388, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.65% (1.9577 => 0.6724, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3056, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4302, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7704, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.39% (2.5528 => 2.1344, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0979, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4934, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.25% (0.9540 => 0.8658, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2959, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.09% (1.6805 => 1.5782, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5732, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5057, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -4.39% (10.2830 => 9.8311, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.03% (8.1563 => 7.8273, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.86% (3.2827 => 3.1561, std.dev.: 0.0065) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.89% (3.6994 => 3.6293, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary3: -1.89% (3.7221 => 3.6517, std.dev.: 0.0138) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2354, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0027) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 21:02:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 23:02:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107050248.2B6082A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7375?compare_to=7373&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7375, Order: 171685, Start Time: 2013-01-07 03:27:56, End Time: 2013-01-07 05:02:42 To: 7373, Order: 171679, Start Time: 2013-01-07 01:29:52, End Time: 2013-01-07 03:04:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 12 (109 on baseline) Performance Improvements: 1 (117 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1089 (818 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.60% (0.3910 => 0.4129, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 1.73% (17.8603 => 18.1686, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: 1.44% (0.7706 => 0.7817, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 1.19% (2.3305 => 2.3582, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.16% (2.0817 => 2.1059, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.16% (0.9592 => 0.9703, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.15% (4.1776 => 4.2258, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 1.09% (1.5272 => 1.5438, std.dev.: 0.0020) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.05% (42.7318 => 43.1826, std.dev.: 0.0129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (22.3928 => 22.6234, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.02% (33.3214 => 33.6614, std.dev.: 0.0259) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.14% (29.3468 => 29.6801, std.dev.: 0.0240) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.85% (81.6199 => 80.1072, std.dev.: 0.5118) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.96% (0.5456 => 1.1510, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.55% (0.5581 => 1.1639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.39% (0.5688 => 1.1853, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.37% (0.5567 => 1.1600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.32% (0.5575 => 1.1614, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.55% (0.5805 => 1.1990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.33% (0.6395 => 1.3067, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.93% (0.5849 => 1.1928, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.40% (0.5941 => 1.2084, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.09% (0.5859 => 1.1899, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.87% (0.6033 => 1.2239, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.46% (0.6260 => 1.2674, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.48% (0.5478 => 1.0873, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.00% (0.6189 => 1.2254, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.79% (0.5570 => 1.0961, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.52% (0.5569 => 1.0944, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.40% (0.6440 => 1.2648, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.16% (0.5705 => 1.1191, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.07% (0.6304 => 1.2360, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.05% (0.5591 => 1.0961, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.85% (0.5802 => 1.1305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.03% (0.6395 => 1.2408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.76% (0.5925 => 1.1421, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.75% (0.6676 => 1.2868, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.31% (0.6230 => 1.1981, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.29% (0.5863 => 1.1274, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.87% (0.5857 => 1.1238, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.85% (0.6052 => 1.1611, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.99% (0.6660 => 1.2720, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.63% (0.6194 => 1.1622, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.02% (0.6446 => 1.1991, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.39% (0.6297 => 1.1674, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.57% (0.6681 => 1.2131, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.22% (0.6667 => 1.2082, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.85% (0.7524 => 1.3607, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.62% (0.0717 => 0.1252, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.10% (0.7339 => 1.2777, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 67.42% (0.0267 => 0.0447, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.32% (0.0974 => 0.1581, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 46.93% (0.1500 => 0.2204, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.41% (0.0599 => 0.0865, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.25% (0.1132 => 0.1565) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.24% (0.0680 => 0.0940, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.36% (0.0693 => 0.0945, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.66% (1.6474 => 2.2348, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.58% (0.0582 => 0.0760, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.72% (2.2587 => 2.9074, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.92% (0.0622 => 0.0777, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.88% (0.5329 => 0.6495, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.09% (0.1081 => 0.1309, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.22% (0.7021 => 0.8300, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.34% (0.4916 => 0.5670, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 14.32% (1.1450 => 1.3090, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.33% (4.5069 => 5.1075, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 12.29% (0.4515 => 0.5070, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 11.59% (0.3357 => 0.3746, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.12% (1.6364 => 1.8184, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.61% (0.2385 => 0.2638, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1761 => 0.1946, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.37% (3.5339 => 3.9004, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.05% (0.1441 => 0.1557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.69% (0.3834 => 0.4129, std.dev.: 0.0069) MultiSource/Applications/Burg/burg: 7.02% (1.2515 => 1.3393, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.99% (0.1731 => 0.1852, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.53% (9.2283 => 9.8306, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.21% (0.3319 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.04% (1.2784 => 1.3556, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.70% (5.0226 => 5.3090, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.3255 => 0.3433, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.59% (0.3394 => 0.3516, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3446 => 0.3560, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.12% (0.4813 => 0.4963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.79% (0.4524 => 0.4650, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 2.41% (0.4861 => 0.4978, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.33% (1.3864 => 1.4187, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6750 => 0.6900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.3722 => 1.4025, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (5.4682 => 5.5834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.65% (1.4642 => 1.4884, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.9557 => 0.9703, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.46% (0.8418 => 0.8541, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6782, std.dev.: 0.0392) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.56% (0.9531 => 1.0156, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash2: 4.63% (3.1932 => 3.3411, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1000, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.5751 => 56.4297, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.86% (5.9709 => 6.1414) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6551 => 3.7266, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6134, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3032, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3489 => 10.4590, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.09% (0.1281 => 0.1139, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.13% (0.3821 => 0.3625, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3896 => 0.3708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: -4.64% (0.4033 => 0.3846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.4176 => 0.3988, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.40% (0.7198 => 0.6881, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.37% (0.9852 => 0.9421, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.10% (0.4199 => 0.4027, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.79% (0.9542 => 0.9180, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.76% (0.4280 => 0.4119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.76% (0.3323 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.72% (0.6484 => 0.6243, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4028, std.dev.: 0.0096) MultiSource/Applications/hexxagon/hexxagon: -3.20% (1.3148 => 1.2727, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -3.03% (0.6347 => 0.6155, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.01% (2.1713 => 2.1059, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.94% (0.4151 => 0.4029, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.94% (20.7746 => 20.1648, std.dev.: 0.0416) MultiSource/Applications/sqlite3/sqlite3: -2.90% (17.1032 => 16.6069, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.65% (0.7919 => 0.7709, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.55% (1.2210 => 1.1899, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8497, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: -2.52% (0.6441 => 0.6279, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.51% (1.2221 => 1.1914, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: -2.47% (4.3330 => 4.2258, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.40% (6.7716 => 6.6091, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.38% (1.0544 => 1.0293, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.28% (1.2300 => 1.2020, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: -2.25% (0.7779 => 0.7604, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -2.24% (16.1920 => 15.8292, std.dev.: 0.0132) MultiSource/Applications/lambda-0_1_3/lambda: -2.07% (0.7982 => 0.7817, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -1.98% (7.0961 => 6.9553, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.83% (0.5999 => 0.5889, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.83% (2.4021 => 2.3582, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.63% (0.8521 => 0.8382, std.dev.: 0.0054) MultiSource/Applications/lua/lua: -1.53% (4.0594 => 3.9971, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.30% (8.0126 => 7.9081, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.27% (34.0927 => 33.6614, std.dev.: 0.0259) MultiSource/Benchmarks/Prolangs-C/football/football: -1.18% (0.9179 => 0.9071, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: -1.10% (1.5610 => 1.5438, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -1.03% (15.2527 => 15.0955, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.54% (1.8100 => 0.6961, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3153, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.53% (1.3643 => 1.0297, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7562, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0659, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.14% (5.3397 => 4.1043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.48% (4.1024 => 3.1803, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4053, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1379, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1983, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.74% (0.5142 => 0.4641, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7814, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.81% (4.1534 => 3.8707, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.17% (1.1594 => 1.0879, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7699, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.35% (1.3096 => 1.2788, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -2.22% (3.7241 => 3.6414, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.79% (1.6086 => 1.5798, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8028, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6023, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.19% (3.7092 => 3.6652, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.07% (1.4516 => 1.4361, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 21:08:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 6 Jan 2013 23:08:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107050833.AB9962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7376?compare_to=7371&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7376, Order: 171679, Start Time: 2013-01-07 01:34:56, End Time: 2013-01-07 05:08:29 To: 7371, Order: 171666, Start Time: 2013-01-06 21:07:15, End Time: 2013-01-07 00:41:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1101 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.04% (54.2594 => 54.8221, std.dev.: 0.0819) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.16% (0.0625 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.43% (0.1063 => 0.1429, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.96% (0.2969 => 0.3799, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.24% (0.5900 => 0.7448, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.17% (0.4139 => 0.5222, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.65% (0.4994 => 0.6275, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.18% (0.4253 => 0.5324, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.06% (0.1620 => 0.2026, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 24.79% (1.5932 => 1.9882, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.38% (0.5000 => 0.6219, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.68% (0.0948 => 0.1163, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.05% (0.2014 => 0.2458, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.82% (0.1549 => 0.1887, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.74% (0.1619 => 0.1971, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.52% (0.3903 => 0.4743, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.96% (0.4029 => 0.4833, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 19.64% (0.5826 => 0.6970, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.29% (1.3152 => 1.5689, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 19.27% (0.5889 => 0.7024, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.23% (0.3890 => 0.4638, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.22% (0.1462 => 0.1743, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.08% (0.2736 => 0.3258, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.95% (0.2866 => 0.3409, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.28% (3.5627 => 4.2140, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 18.21% (0.7171 => 0.8477, std.dev.: 0.0073) MultiSource/Applications/Burg/burg: 18.14% (0.5546 => 0.6552, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 17.94% (0.9697 => 1.1437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.84% (0.2875 => 0.3388, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.82% (0.3271 => 0.3854, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 17.63% (1.8794 => 2.2108, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.61% (1.6211 => 1.9065, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.55% (0.2792 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.43% (0.5026 => 0.5902, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 17.41% (0.2803 => 0.3291, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.35% (0.2738 => 0.3213, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 17.34% (0.3004 => 0.3525, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 17.32% (0.2725 => 0.3197, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.30% (0.4658 => 0.5464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 17.28% (0.2714 => 0.3183, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.28% (0.2911 => 0.3414, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.19% (0.2729 => 0.3198) SingleSource/Benchmarks/Shootout-C++/except: 17.18% (0.2811 => 0.3294, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.17% (0.2813 => 0.3296, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 17.14% (0.2823 => 0.3307, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.98% (4.4195 => 5.1698, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.96% (2.0673 => 2.4180, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.87% (0.2780 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.84% (0.3195 => 0.3733, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.67% (0.9909 => 1.1561, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 16.67% (0.3096 => 0.3612, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.64% (0.3930 => 0.4584, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.60% (1.9694 => 2.2963, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: 16.49% (23.5202 => 27.3991, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.44% (0.4361 => 0.5078, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 16.42% (0.3258 => 0.3793, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.38% (1.0781 => 1.2547, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.27% (0.3060 => 0.3558, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.22% (0.3267 => 0.3797, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.21% (1.9966 => 2.3202, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.01% (2.7292 => 3.1662, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 15.95% (0.3317 => 0.3846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.85% (0.3124 => 0.3619, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.75% (0.3442 => 0.3984, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.70% (0.3362 => 0.3890, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3465 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.58% (0.3446 => 0.3983, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.56% (4.2109 => 4.8660, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/moments: 15.55% (0.3678 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.52% (0.3460 => 0.3997, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.51% (0.3469 => 0.4007, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 15.47% (0.3496 => 0.4037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 15.46% (0.3726 => 0.4302, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.45% (0.3981 => 0.4596, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 15.38% (0.3348 => 0.3863, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists1: 15.36% (0.3477 => 0.4011, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.31% (0.3625 => 0.4180, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 15.18% (0.3650 => 0.4204, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.09% (0.3690 => 0.4247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.03% (0.4146 => 0.4769, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 14.93% (0.3643 => 0.4187, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.93% (0.3845 => 0.4419, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: 14.88% (0.3724 => 0.4278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.70% (0.4251 => 0.4876, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.44% (1.4269 => 1.6329, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 14.19% (0.5012 => 0.5723, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.56% (0.7875 => 0.8943, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.22% (0.6435 => 0.7286, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.05% (2.1653 => 2.4479, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.65% (0.1028 => 0.1158, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 12.59% (4.6177 => 5.1992, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.42% (0.2737 => 0.3077, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.08% (2.1013 => 2.3552, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 12.05% (0.2075 => 0.2325, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.97% (5.5417 => 6.2051, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.85% (0.2068 => 0.2313, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.38% (0.3498 => 0.3896, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.35% (0.3084 => 0.3434, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.00% (0.3336 => 0.3703, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.84% (11.6398 => 12.9015, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.73% (0.5361 => 0.5936, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.48% (0.6634 => 0.7329, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.27% (0.2103 => 0.2319, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.00% (0.2040 => 0.2244, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.54% (4.6926 => 5.1403, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.00% (0.7426 => 0.8094, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.10% (0.1383 => 0.1495) MultiSource/Applications/lemon/lemon: 8.07% (0.2391 => 0.2584, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.54% (0.5584 => 0.6005, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.52% (2.0346 => 2.1876, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8540, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.04% (0.3792 => 0.4021, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.89% (29.0505 => 181.5344, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.99% (0.2802 => 0.3082, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.99% (0.3693 => 0.4062, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6774, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2407, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6830, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2091, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3094, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2848, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.19% (3.1722 => 3.2099, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4822, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5902, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.81% (2.4764 => 2.4069, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5765, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.64% (17.2379 => 14.1966, std.dev.: 0.0912) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.18% (2.1113 => 1.9597, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -4.29% (14.0481 => 13.4456, std.dev.: 0.1213) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2303, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7963, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.21% (0.6293 => 0.6154, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1577, std.dev.: 0.0363) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1343, std.dev.: 0.1018) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 22:12:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 00:12:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107061238.A1C5B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7377?compare_to=7374&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7377, Order: 171688, Start Time: 2013-01-07 03:59:17, End Time: 2013-01-07 06:12:33 To: 7374, Order: 171679, Start Time: 2013-01-07 01:12:30, End Time: 2013-01-07 03:25:19 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 27 (223 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1070 (601 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2006-12-11-LoadConstants: 8.64% (0.1320 => 0.1434, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 2.63% (11.3281 => 11.6264, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.77% (2.3407 => 2.3821, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.76% (6.2937 => 6.4042, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: 1.70% (20.0580 => 20.3980, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.55% (10.8425 => 11.0101, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.53% (4.4039 => 4.4712, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 1.47% (17.8050 => 18.0673, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.44% (1.5733 => 1.5960, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.37% (4.4102 => 4.4705, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 1.34% (4.8003 => 4.8645, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.23% (10.1170 => 10.2417, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.21% (1.0792 => 1.0923, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.21% (8.1161 => 8.2144, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 1.21% (67.9496 => 68.7725, std.dev.: 0.0434) MultiSource/Applications/treecc/treecc: 1.20% (2.3509 => 2.3790, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (37.0178 => 37.4506, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.17% (0.9338 => 0.9447, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.16% (4.4899 => 4.5420, std.dev.: 0.0117) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.11% (49.1504 => 49.6958, std.dev.: 0.0327) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.08% (3.2985 => 3.3340, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.07% (1.5357 => 1.5521, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.05% (1.3296 => 1.3435, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.04% (1.5315 => 1.5475, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.03% (1.4963 => 1.5117, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.88% (3.7474 => 3.8177, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.43% (1.2924 => 1.3109, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.14% (0.6724 => 0.6513, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0659 => 0.0656, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8601 => 499.8486, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.61% (1.1277 => 499.8486, std.dev.: 0.0080) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.58% (0.5229 => 1.6554, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 20.53% (14.9895 => 18.0673, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 44.10% (14.1553 => 20.3980, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 18.34% (4.1105 => 4.8645, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 59.11% (1.1048 => 1.7578, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.18% (7.1582 => 37.4506, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.94% (3.4629 => 6.4042, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.55% (0.6222 => 1.0923, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10211.53% (0.0720 => 7.4243, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11082500.00% (0.0001 => 11.0826, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908100.00% (0.0001 => 9.9082, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0314) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.93% (1.1194 => 10.2417, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: 149.04% (22.1758 => 55.2259, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 115.64% (0.0243 => 0.0524, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.29% (0.0929 => 0.1805, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 87.45% (0.0271 => 0.0508, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 74.23% (0.1463 => 0.2549, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.91% (1.5859 => 2.5518, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.14% (0.0439 => 0.0703, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 57.58% (0.0231 => 0.0364, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.13% (2.9384 => 4.6171, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.08% (7.0540 => 11.0101, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.38% (2.2024 => 3.3340, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 49.62% (0.1056 => 0.1580, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.13% (0.5105 => 0.7613, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.79% (8.1363 => 12.0243, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 41.78% (21.9371 => 31.1023, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.53% (0.6675 => 0.9447, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.42% (0.1062 => 0.1470, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.96% (0.4615 => 0.6367, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.55% (4.2646 => 5.8659, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 37.05% (0.3109 => 0.4261, std.dev.: 0.0005) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 36.49% (0.0814 => 0.1111, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 35.53% (0.1655 => 0.2243, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.91% (0.2271 => 0.3041, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.66% (1.5415 => 2.0604, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 32.87% (0.4299 => 0.5712, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.48% (0.1906 => 0.2525, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.09% (0.1337 => 0.1766) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.90% (0.0479 => 0.0627, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 29.95% (1.1642 => 1.5129, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 28.51% (0.1175 => 0.1510, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.90% (0.1584 => 0.2026, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.70% (0.0408 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.43% (0.3121 => 0.3977, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.29% (0.1125 => 0.1432, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.48% (0.0457 => 0.0578, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.70% (3.8922 => 4.8926, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.60% (0.1695 => 0.2129, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.46% (0.1143 => 0.1434, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.45% (5.7591 => 7.2248, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 25.20% (1.0722 => 1.3424, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.52% (1.4186 => 1.7664, std.dev.: 0.0017) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 23.68% (9.4845 => 11.7301, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 22.59% (0.7115 => 0.8722, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.56% (0.2700 => 0.3309, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 22.51% (0.1555 => 0.1905, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.48% (1.3050 => 1.5983, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 21.98% (0.1151 => 0.1404, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.16% (0.7835 => 0.9493, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.03% (0.1032 => 0.1249, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.84% (4.9449 => 5.9754, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/em3d/em3d: 20.83% (0.1695 => 0.2048, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.58% (0.4636 => 0.5590, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 20.21% (1.1840 => 1.4233, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.08% (5.0018 => 6.0060, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 19.86% (0.4289 => 0.5141, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.68% (0.5860 => 0.7013, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 19.52% (0.6456 => 0.7716, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.50% (3.3354 => 3.9858, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 19.10% (0.7433 => 0.8853, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.08% (0.8172 => 0.9731, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.94% (0.2107 => 0.2506, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 18.85% (0.4620 => 0.5491, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.69% (0.5020 => 0.5958, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 18.20% (0.2049 => 0.2422, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.17% (0.3307 => 0.3908, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.17% (0.3423 => 0.4045, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.90% (0.5569 => 0.6566, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.77% (0.9765 => 1.1500, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 17.45% (0.3232 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 17.35% (2.0273 => 2.3790, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 17.29% (3.8723 => 4.5420, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.29% (0.2065 => 0.2422, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 17.03% (0.3283 => 0.3842, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.65% (0.5981 => 0.6977, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.55% (0.8101 => 0.9442, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.47% (0.0838 => 0.0976) MultiSource/Benchmarks/Prolangs-C/football/football: 16.34% (0.8921 => 1.0379, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.27% (2.2969 => 2.6705, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.16% (0.3441 => 0.3997, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.09% (0.1044 => 0.1212, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.98% (0.6450 => 0.7481, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 15.82% (0.3180 => 0.3683, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.97% (1.1861 => 1.3637, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3379 => 0.3884, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.48% (0.8067 => 0.9235, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.89% (0.3865 => 0.4402, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.50% (1.5603 => 1.7710, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.11% (0.3927 => 0.4442, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.04% (0.4103 => 0.4638, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 12.82% (0.3886 => 0.4384, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.68% (0.4203 => 0.4736, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 12.23% (0.4048 => 0.4543, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.18% (0.1330 => 0.1492, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 12.14% (10.3673 => 11.6264, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/sieve: 12.13% (0.3603 => 0.4040, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 12.05% (0.3543 => 0.3970, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.93% (0.3561 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.79% (0.3282 => 0.3669, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.77% (0.3092 => 0.3456, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 11.62% (0.3684 => 0.4112, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.60% (0.3826 => 0.4270, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.57% (14.3668 => 16.0293, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: 11.43% (17.1811 => 19.1457, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3427 => 0.3808, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: 10.35% (0.2831 => 0.3124, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2871 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.85% (2.0665 => 2.2700, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.40% (0.2756 => 0.3015, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.40% (0.2905 => 0.3178, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 9.36% (1.2842 => 1.4044, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 9.22% (0.6030 => 0.6586, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.21% (0.3650 => 0.3986, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 9.10% (0.2725 => 0.2973, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.04% (0.3162 => 0.3448, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.99% (0.2891 => 0.3151, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.91% (0.2872 => 0.3128, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7326 => 0.7976, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.84% (0.5925 => 0.6449, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.74% (63.2438 => 68.7725, std.dev.: 0.0434) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2802 => 0.3045, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.17% (2.2022 => 2.3821, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3817 => 0.3986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (7.9617 => 8.2144, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.15% (32.5116 => 59.2192, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.99% (1.1145 => 1.2927, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3290, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4630, std.dev.: 0.0094) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (3.1578 => 3.3158, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.85% (3.6395 => 3.7798, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.68% (2.0360 => 2.1110, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.6802 => 8.9296, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2447, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.19% (10.3460 => 10.4695, std.dev.: 0.0201) MultiSource/Applications/minisat/minisat: 1.11% (9.1159 => 9.2175, std.dev.: 0.0393) MultiSource/Benchmarks/llubenchmark/llu: 1.05% (3.7781 => 3.8177, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1704, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1780, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -74.89% (0.8651 => 0.2172, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (5.3855 => 4.4712, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.48% (5.3526 => 4.4705, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -12.58% (10.4361 => 9.1233, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.34% (1.7609 => 1.6141, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -7.47% (54.1659 => 50.1182, std.dev.: 0.0233) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.73% (1.9577 => 0.6513, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.69% (0.0628 => 0.0385, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3052, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4319, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7821, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.56% (2.6546 => 2.0025, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.43% (2.5528 => 2.1334, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4920, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: -11.02% (1.2373 => 1.1009, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.21% (0.9540 => 0.8661, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2584, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.95% (0.4808 => 0.4570, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5077, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8381, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.18% (8.1563 => 7.8150, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.84% (3.6994 => 3.6314, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6698, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0030) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 6 23:01:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 01:01:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107070102.5C92B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7378?compare_to=7375&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7378, Order: 171691, Start Time: 2013-01-07 05:26:10, End Time: 2013-01-07 07:00:58 To: 7375, Order: 171685, Start Time: 2013-01-07 03:27:56, End Time: 2013-01-07 05:02:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (811 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.09% (0.5456 => 1.1517, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.23% (0.5567 => 1.1648, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.91% (0.5688 => 1.1883, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.91% (0.5581 => 1.1659, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.65% (0.5575 => 1.1632, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.89% (0.5805 => 1.2010, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.80% (0.6395 => 1.3097, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.10% (0.5849 => 1.1938, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.75% (0.5941 => 1.2105, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.75% (0.6033 => 1.2292, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.33% (0.5859 => 1.1913, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.96% (0.6260 => 1.2705, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 99.01% (0.6189 => 1.2317, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.47% (0.5478 => 1.0872, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.32% (0.5569 => 1.0989, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.20% (0.5570 => 1.0984, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.68% (0.6440 => 1.2666, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.58% (0.5591 => 1.0991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.58% (0.5705 => 1.1215, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.18% (0.6304 => 1.2367, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.38% (0.5802 => 1.1336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.51% (0.6395 => 1.2439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.37% (0.5925 => 1.1457, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.26% (0.5857 => 1.1319, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.99% (0.6676 => 1.2884, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.86% (0.6230 => 1.2015, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.68% (0.5863 => 1.1297, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.40% (0.6052 => 1.1644, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.34% (0.6660 => 1.2743, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.46% (0.6194 => 1.1611, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.55% (0.6446 => 1.2025, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.95% (0.6297 => 1.1709, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.34% (0.6681 => 1.2182, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.72% (0.6667 => 1.2115, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.35% (0.7524 => 1.3645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.90% (0.0717 => 0.1254, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.25% (0.7339 => 1.2788, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.11% (0.0974 => 0.1579, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 47.07% (0.1500 => 0.2206, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 45.39% (0.0293 => 0.0426, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.24% (0.0599 => 0.0864, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.43% (0.1132 => 0.1567, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.24% (0.0680 => 0.0940, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.36% (0.0693 => 0.0945, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.63% (1.6474 => 2.2344, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.93% (0.0445 => 0.0596, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.41% (0.0582 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.96% (2.2587 => 2.9128, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.92% (0.0622 => 0.0777, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.90% (0.5329 => 0.6496, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.09% (0.1081 => 0.1309, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.26% (0.7021 => 0.8303, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.36% (0.4916 => 0.5671, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 14.50% (1.1450 => 1.3110, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.34% (4.5069 => 5.1083, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 11.85% (0.4515 => 0.5050, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: 11.68% (0.3357 => 0.3749, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.39% (0.2001 => 0.2229, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.54% (3.5339 => 3.9062, std.dev.: 0.0156) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1761 => 0.1944, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.77% (0.1441 => 0.1553, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.22% (0.1731 => 0.1856, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.19% (1.2515 => 1.3415, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.68% (9.2283 => 9.8450, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.33% (0.3319 => 0.3529, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.13% (1.2784 => 1.3568, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 5.88% (5.0226 => 5.3181, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.3255 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 2.98% (0.4524 => 0.4659, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.87% (0.4813 => 0.4951, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.52% (1.3864 => 1.4213, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.44% (5.4682 => 5.6017, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash2: 2.35% (0.4861 => 0.4975, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.6750 => 0.6907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.26% (1.3722 => 1.4032, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.62% (1.4642 => 1.4879, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.57% (0.8418 => 0.8550, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.9557 => 0.9701, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.37% (22.4056 => 22.7120, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6638, std.dev.: 0.0331) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.31% (0.9531 => 1.0228, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.74% (3.1932 => 3.3447, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0982, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.28% (5.1955 => 5.3657, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.5751 => 56.3154, std.dev.: 0.1750) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.92% (2.0478 => 2.1075, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6551 => 3.7229, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3038, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6085, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.01% (0.1281 => 0.1140, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.51% (0.4033 => 0.3851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.4176 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.50% (0.3891 => 0.3716, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.28% (0.9852 => 0.9430, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.17% (0.7198 => 0.6898, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.09% (0.3884 => 0.3725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.88% (0.9542 => 0.9172, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.71% (0.4280 => 0.4121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.69% (0.6484 => 0.6245, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.59% (0.2871 => 0.2768, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.56% (0.3059 => 0.2950, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.51% (0.2903 => 0.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.44% (0.3026 => 0.2922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.42% (0.3658 => 0.3533, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.38% (2.1713 => 2.0980, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -3.34% (1.3148 => 1.2709, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.32% (0.3252 => 0.3144, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.06% (0.4151 => 0.4024, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.99% (20.7746 => 20.1537, std.dev.: 0.0221) SingleSource/UnitTests/ObjC++/property-reference-object: -2.98% (0.6441 => 0.6249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.97% (0.7919 => 0.7684, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.67% (0.3931 => 0.3826, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.52% (17.1032 => 16.6724, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.38% (0.4321 => 0.4218, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.37% (0.7779 => 0.7595, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.33% (0.4427 => 0.4324, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.31% (6.7716 => 6.6149, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1944, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.20% (14.2083 => 13.8964, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.2210 => 1.1942, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.12% (1.2300 => 1.2039, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (4.3330 => 4.2431, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -2.04% (0.7982 => 0.7819, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -2.02% (16.1920 => 15.8655, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.00% (0.5999 => 0.5879, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8521 => 0.8361, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -1.84% (2.4021 => 2.3579, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.73% (7.0961 => 6.9732, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.58% (0.9077 => 0.8934, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -1.49% (4.0594 => 3.9989, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.24% (8.0126 => 7.9130, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.24% (34.0927 => 33.6695, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.22% (1.8100 => 0.6839, std.dev.: 0.0258) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0260, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0602, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.61% (4.1024 => 3.1747, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.20% (4.3779 => 3.4061, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.47% (1.2237 => 0.9610) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0054) SingleSource/UnitTests/Vector/multiplies: -15.06% (2.5106 => 2.1325, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7819, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8709, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.53% (1.1594 => 1.0837, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2633 => 2.1805, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0523, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.88% (1.3096 => 1.2719, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7700, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/ary3: -2.21% (3.7241 => 3.6418, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.80% (1.6086 => 1.5797, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4636, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.31% (4.8776 => 4.8137, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6007, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -1.11% (1.4516 => 1.4355, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6697, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 00:58:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 02:58:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107085818.3C6E32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7379?compare_to=7377&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7379, Order: 171701, Start Time: 2013-01-07 06:43:06, End Time: 2013-01-07 08:58:12 To: 7377, Order: 171688, Start Time: 2013-01-07 03:59:17, End Time: 2013-01-07 06:12:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (223 on baseline) Performance Improvements: 3 (63 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (603 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.59% (0.6513 => 0.6747, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (11.6264 => 11.2090, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (4.4712 => 4.4168, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.21% (2.3821 => 2.3532, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1339 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.43% (0.0656 => 0.0731, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8486 => 499.8029, std.dev.: 0.0272) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.56% (1.1277 => 499.8029, std.dev.: 0.0272) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.06% (0.5229 => 1.6527, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 20.37% (14.9895 => 18.0434, std.dev.: 0.1498) MultiSource/Applications/kimwitu++/kc: 44.24% (14.1553 => 20.4178, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/gs/gs: 18.28% (4.1105 => 4.8617, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.18% (1.1048 => 1.7476, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.73% (7.1582 => 37.4898, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.25% (3.4629 => 6.4151, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.91% (0.6222 => 1.0945, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10214.31% (0.0720 => 7.4263, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 3832600.00% (0.0001 => 3.8327, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11055200.00% (0.0001 => 11.0553, std.dev.: 0.7962) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484900.00% (0.0001 => 5.4850, std.dev.: 0.0067) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 807.56% (1.1194 => 10.1592, std.dev.: 0.2072) MultiSource/Applications/ClamAV/clamscan: 147.76% (22.1758 => 54.9417, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 115.64% (0.0243 => 0.0524, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.86% (0.0929 => 0.1801, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 86.72% (0.0271 => 0.0506, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534) MultiSource/Benchmarks/FreeBench/neural/neural: 73.55% (0.1463 => 0.2539, std.dev.: 0.0005) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.53% (1.5859 => 2.5458, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.91% (0.0439 => 0.0702, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.53% (2.9384 => 4.5996, std.dev.: 0.0706) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.42% (7.0540 => 10.8929, std.dev.: 0.1273) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.09% (2.2024 => 3.3276, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0232 => 0.0348, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.64% (0.5105 => 0.7588, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.48% (8.1363 => 11.9993, std.dev.: 0.0116) SingleSource/UnitTests/Vector/multiplies: 45.52% (0.0279 => 0.0406, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.18% (0.6675 => 0.9424, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: 40.64% (21.9371 => 30.8520, std.dev.: 0.0224) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.30% (0.1062 => 0.1490, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.74% (0.4615 => 0.6403, std.dev.: 0.0166) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 37.02% (0.3109 => 0.4260, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.98% (4.2646 => 5.8418, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 36.49% (0.0814 => 0.1111, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 35.23% (0.1655 => 0.2238, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.90% (1.5415 => 2.0640, std.dev.: 0.0448) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.77% (0.2271 => 0.3038, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 33.13% (0.1337 => 0.1780, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.42% (0.1906 => 0.2524, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/05-eks/eks: 32.19% (0.4299 => 0.5683, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.32% (0.0479 => 0.0629, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 30.18% (0.0719 => 0.0936, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 30.13% (1.1642 => 1.5150, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: 29.16% (0.3121 => 0.4031, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.13% (0.0793 => 0.1024, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 27.65% (0.1555 => 0.1985, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.46% (0.1584 => 0.2019, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.02% (0.1125 => 0.1429, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 26.47% (0.2554 => 0.3230, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.07% (0.1143 => 0.1441, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.62% (0.1175 => 0.1476, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.53% (0.0842 => 0.1057, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.37% (0.1695 => 0.2125, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.35% (3.8922 => 4.8787, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 24.83% (1.0722 => 1.3384, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 24.79% (5.7591 => 7.1870, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.51% (1.4186 => 1.7663, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.44% (0.0675 => 0.0840, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 24.41% (0.1151 => 0.1432, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.23% (0.0648 => 0.0805, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 23.98% (0.0442 => 0.0548, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.82% (0.1566 => 0.1939, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.81% (0.1029 => 0.1274, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 23.54% (9.4845 => 11.7167, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 23.34% (0.0437 => 0.0539, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 23.27% (0.3098 => 0.3819, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 23.05% (0.7115 => 0.8755, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bisort/bisort: 22.48% (0.0614 => 0.0752, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.44% (0.2700 => 0.3306, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.30% (1.3050 => 1.5960, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/mst/mst: 22.27% (0.1163 => 0.1422, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 21.47% (0.1695 => 0.2059, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.39% (0.8172 => 0.9920, std.dev.: 0.0426) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.17% (0.7835 => 0.9494, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.93% (0.1032 => 0.1248, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.78% (0.0770 => 0.0930, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 20.69% (1.1840 => 1.4290, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.62% (4.9449 => 5.9643, std.dev.: 0.0180) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.60% (0.4636 => 0.5591, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 20.26% (0.4289 => 0.5158, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.88% (0.5860 => 0.7025, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.74% (5.0018 => 5.9893, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/bigfib: 19.66% (0.6456 => 0.7725, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.43% (0.1940 => 0.2317, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.39% (0.5569 => 0.6649, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 19.25% (3.3354 => 3.9775, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 19.13% (0.7433 => 0.8855, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.93% (0.2758 => 0.3280, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 18.87% (0.4620 => 0.5492, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 18.81% (0.3423 => 0.4067, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.75% (0.2107 => 0.2502, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.67% (0.0798 => 0.0947, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.55% (0.5020 => 0.5951, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.39% (0.3307 => 0.3915, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 17.76% (0.3232 => 0.3806, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 17.69% (3.8723 => 4.5572, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.61% (0.9765 => 1.1485, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 17.45% (0.3283 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 17.28% (0.2049 => 0.2403, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0098) MultiSource/Applications/treecc/treecc: 17.08% (2.0273 => 2.3735, std.dev.: 0.0309) MultiSource/Benchmarks/VersaBench/bmm/bmm: 17.00% (0.0759 => 0.0888, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.71% (0.6450 => 0.7528, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.64% (0.5981 => 0.6976, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.44% (0.8101 => 0.9433, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.27% (2.2969 => 2.6705, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.07% (0.3441 => 0.3994, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 15.96% (0.8921 => 1.0345, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.87% (0.0838 => 0.0971, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 15.63% (0.3379 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.19% (1.1861 => 1.3663, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.80% (0.8067 => 0.9261, std.dev.: 0.0096) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.23% (0.3865 => 0.4415, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 13.78% (1.5603 => 1.7753, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.64% (0.2603 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.53% (0.1330 => 0.1510, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.23% (0.4103 => 0.4646, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 13.06% (0.3927 => 0.4440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.4203 => 0.4750, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 12.87% (0.3886 => 0.4386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.55% (0.3603 => 0.4055, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 12.52% (0.4048 => 0.4555, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.27% (0.3422 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.17% (0.3828 => 0.4294, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.10% (0.3826 => 0.4289, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.97% (0.3684 => 0.4125, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 11.94% (0.3543 => 0.3966, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.94% (0.3543 => 0.3966, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 11.92% (0.3516 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.87% (0.3092 => 0.3459, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.49% (0.4064 => 0.4531, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 11.29% (0.2871 => 0.3195, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.23% (17.1811 => 19.1104, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.2430 => 0.2701, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.13% (14.3668 => 15.9662, std.dev.: 0.3739) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.06% (2.0665 => 2.2951, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.92% (0.1438 => 0.1595, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2831 => 0.3140, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 10.67% (0.2905 => 0.3215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.53% (0.3427 => 0.3788, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.94% (1.2842 => 1.4119, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.87% (0.2756 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.78% (0.3650 => 0.4007, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.71% (0.3162 => 0.3469, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2877 => 0.3154, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.61% (0.2725 => 0.2987, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 9.59% (0.6030 => 0.6608, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.51% (0.2891 => 0.3166, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.49% (0.2793 => 0.3058, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.35% (0.5925 => 0.6479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2714 => 0.2967, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.20% (0.7326 => 0.8000, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 9.14% (0.2802 => 0.3058, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.12% (0.2872 => 0.3134, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.91% (0.3052 => 0.3324, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.72% (0.3935 => 0.4278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.71% (0.3136 => 0.3409, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: 8.43% (63.2438 => 68.5778, std.dev.: 0.0630) MultiSource/Benchmarks/PAQ8p/paq8p: 8.12% (10.3673 => 11.2090, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.86% (2.2022 => 2.3532, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.09% (0.4879 => 0.5176, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3817 => 0.3986, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.88% (7.9617 => 8.1911, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2558, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.20% (1.1145 => 1.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 5.90% (11.6436 => 12.3304, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4520, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (3.1578 => 3.3146, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.76% (3.6395 => 3.7764, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (2.0360 => 2.1101, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2448, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2272, std.dev.: 0.0393) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5771, std.dev.: 0.0229) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4506, std.dev.: 0.0292) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.38% (6.6874 => 0.1754, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.59% (5.2763 => 1.1822, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/salsa20: -75.26% (0.8651 => 0.2140, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.99% (5.3855 => 4.4168, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.23% (5.3526 => 4.4304, std.dev.: 0.0731) MultiSource/Applications/JM/ldecod/ldecod: -12.80% (10.4361 => 9.1008, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.31% (1.7609 => 1.6145, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -7.98% (54.1659 => 49.8432, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.54% (1.9577 => 0.6747, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -42.25% (0.0400 => 0.0231, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.40% (0.0628 => 0.0368, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.05% (0.3987 => 0.2470, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3083, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4172, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7678, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -21.66% (0.0757 => 0.0593, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.29% (2.5528 => 2.1369, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.16% (3.1443 => 2.7305, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4917, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.23% (0.9540 => 0.8659, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0244) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2568, std.dev.: 0.0203) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -6.72% (0.1592 => 0.1485, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5736) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.39% (10.2830 => 9.8312, std.dev.: 0.0156) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.97% (8.1563 => 7.8329, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.77% (3.2827 => 3.1589, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -65.45% (0.2116 => 0.0731, std.dev.: 0.0053) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 01:03:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 03:03:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107090304.E2B432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7380?compare_to=7378&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7380, Order: 171702, Start Time: 2013-01-07 07:24:26, End Time: 2013-01-07 09:02:59 To: 7378, Order: 171691, Start Time: 2013-01-07 05:26:10, End Time: 2013-01-07 07:00:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1102 (840 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.87% (0.5456 => 1.1505, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.87% (0.5567 => 1.1628, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.56% (0.5581 => 1.1640, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.49% (0.5688 => 1.1859, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.16% (0.5575 => 1.1605, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.44% (0.5805 => 1.1984, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.74% (0.6395 => 1.3093, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.73% (0.5849 => 1.1916, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.58% (0.6033 => 1.2282, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.30% (0.5941 => 1.2078, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.00% (0.5859 => 1.1894, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.80% (0.6260 => 1.2695, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.68% (0.6189 => 1.2296, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.10% (0.5478 => 1.0852, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.97% (0.5570 => 1.0971, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.91% (0.5569 => 1.0966, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.49% (0.5705 => 1.1210, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.40% (0.6440 => 1.2648, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.26% (0.5591 => 1.0973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.84% (0.6304 => 1.2346, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.09% (0.5802 => 1.1319, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 93.96% (0.6395 => 1.2404, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.98% (0.5925 => 1.1434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.83% (0.5857 => 1.1294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 92.69% (0.6676 => 1.2864, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.56% (0.5863 => 1.1290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.54% (0.6230 => 1.1995, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.09% (0.6052 => 1.1625, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.95% (0.6660 => 1.2717, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.25% (0.6194 => 1.1598, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.36% (0.6446 => 1.2013, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.72% (0.6297 => 1.1695, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.20% (0.6681 => 1.2173, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.46% (0.6667 => 1.2098, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.95% (0.7524 => 1.3615, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.17% (0.0717 => 0.1256, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.81% (0.7339 => 1.2756, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.01% (0.0974 => 0.1578, std.dev.: 0.0013) SingleSource/Regression/C/sumarraymalloc: 60.67% (0.0267 => 0.0429, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.13% (0.1500 => 0.2207, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 39.12% (0.0680 => 0.0946, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.60% (0.1132 => 0.1569, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.56% (1.6474 => 2.2332, std.dev.: 0.0502) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.38% (0.0445 => 0.0598, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.84% (2.2587 => 2.9100, std.dev.: 0.0284) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.54% (0.5329 => 0.6477, std.dev.: 0.0133) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.18% (0.1081 => 0.1310, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.96% (0.0566 => 0.0679, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 18.56% (0.0598 => 0.0709, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.09% (0.7021 => 0.8291, std.dev.: 0.0397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.64% (0.4916 => 0.5685, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 14.25% (1.1450 => 1.3082, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.36% (4.5069 => 5.1091, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 12.34% (0.4515 => 0.5072, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.74% (0.2001 => 0.2236, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 11.71% (0.3357 => 0.3750, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.42% (1.6364 => 1.8233, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.15% (0.2385 => 0.2651, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1761 => 0.1946, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.24% (3.5339 => 3.8956, std.dev.: 0.0789) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.47% (0.3319 => 0.3567, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: 7.29% (1.2515 => 1.3427, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.16% (0.1731 => 0.1855, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 6.71% (9.2283 => 9.8472, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.2784 => 1.3566, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.3255 => 0.3447, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 5.48% (5.0226 => 5.2978, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 3.48% (0.3394 => 0.3512, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4524 => 0.4665, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3446 => 0.3553, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.62% (0.4813 => 0.4939, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 2.43% (1.3864 => 1.4201, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 2.37% (0.4861 => 0.4976, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.3722 => 1.4046, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.92% (1.4642 => 1.4923, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.82% (0.8418 => 0.8571, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (22.4056 => 22.7040, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.39% (31.3723 => 55.6503, std.dev.: 0.0435) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.33% (1.2783 => 1.3720, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.22% (0.9531 => 1.0219, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 4.41% (3.1932 => 3.3340, std.dev.: 0.0107) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0992, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3672, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6551 => 3.7318, std.dev.: 0.0075) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3036, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6095, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.85% (0.1281 => 0.1142, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2428 => 0.2309, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3821 => 0.3639, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.43% (0.9852 => 0.9416, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -3.95% (2.4924 => 2.3939, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.88% (0.9542 => 0.9172, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.73% (0.3831 => 0.3688, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.66% (0.3884 => 0.3742, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.64% (0.3896 => 0.3754, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: -3.57% (0.4176 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.50% (0.4033 => 0.3892, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.47% (0.6484 => 0.6259, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -3.17% (0.4199 => 0.4066, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.93% (2.1713 => 2.1076, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1933, std.dev.: 0.0215) SingleSource/UnitTests/ObjC/parameter-passing: -2.76% (0.4280 => 0.4162, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.73% (17.1032 => 16.6358, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.68% (0.7919 => 0.7707, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: -2.66% (0.6347 => 0.6178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.31% (0.7779 => 0.7599, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (14.2083 => 13.8944, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference-object: -2.19% (0.6441 => 0.6300, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.18% (1.2221 => 1.1954, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (1.2210 => 1.1947, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: -2.12% (4.3330 => 4.2410, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0322, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -2.10% (16.1920 => 15.8527, std.dev.: 0.0165) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.88% (6.7716 => 6.6442, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.84% (1.2300 => 1.2074, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.78% (0.7982 => 0.7840, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -1.70% (7.0961 => 6.9758, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -1.65% (2.4021 => 2.3624, std.dev.: 0.0022) MultiSource/Applications/lua/lua: -1.28% (4.0594 => 4.0073, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (8.0126 => 7.9283, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.19% (1.8100 => 0.6843, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3092, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.16% (1.3643 => 1.0347, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0584, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.69% (2.9703 => 2.2964, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.54% (4.1024 => 3.1778, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4049, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0041) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1378, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.83% (0.4092 => 0.3526, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.28% (4.2493 => 3.6849, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2801, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1981, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8713, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1796, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7766, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4753, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.33% (4.8776 => 4.8125, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 01:40:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 03:40:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107094000.3A26F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7381?compare_to=7376&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7381, Order: 171691, Start Time: 2013-01-07 06:01:18, End Time: 2013-01-07 09:39:55 To: 7376, Order: 171679, Start Time: 2013-01-07 01:34:56, End Time: 2013-01-07 05:08:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (177 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1101 (713 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.43% (1.9882 => 1.9598, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.84% (0.0625 => 0.0874, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.25% (0.0822 => 0.1046, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0547 => 0.0696, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.02% (0.5900 => 0.7494, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.11% (0.4994 => 0.6298, std.dev.: 0.0279) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.09% (0.4139 => 0.5219, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.25% (0.4253 => 0.5327, std.dev.: 0.0078) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.94% (0.5000 => 0.6197, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.46% (0.0584 => 0.0721, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.22% (0.0633 => 0.0780, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 23.01% (1.5932 => 1.9598, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.34% (0.2014 => 0.2464, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.32% (0.1604 => 0.1962, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 21.99% (0.1619 => 0.1975, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.95% (0.1549 => 0.1889, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.57% (0.3903 => 0.4745, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.01% (0.0947 => 0.1146, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 20.15% (0.5826 => 0.7000, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 19.81% (0.4029 => 0.4827, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.70% (0.1462 => 0.1750, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 19.68% (0.5889 => 0.7048, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.37% (1.3152 => 1.5700, std.dev.: 0.0565) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.33% (0.3890 => 0.4642, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.12% (0.2736 => 0.3259, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.02% (0.2866 => 0.3411, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 18.77% (0.7171 => 0.8517, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679) MultiSource/Applications/hbd/hbd: 18.49% (0.9697 => 1.1490, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.40% (3.5627 => 4.2184, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: 18.23% (0.5546 => 0.6557, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.99% (0.1968 => 0.2322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.96% (0.2750 => 0.3244) MultiSource/Benchmarks/MallocBench/gs/gs: 17.92% (1.8794 => 2.2162, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.88% (0.3271 => 0.3856, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.88% (0.2875 => 0.3389, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.88% (1.6211 => 1.9109, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.80% (0.4658 => 0.5487, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.55% (0.5026 => 0.5908, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.37% (0.2792 => 0.3277, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 17.30% (0.2803 => 0.3288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 17.29% (0.2823 => 0.3311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.28% (0.2813 => 0.3299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.24% (0.2738 => 0.3210, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 17.21% (0.2714 => 0.3181, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.14% (0.2725 => 0.3192, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 17.13% (0.1284 => 0.1504, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.06% (4.4195 => 5.1736, std.dev.: 0.1356) SingleSource/Benchmarks/Shootout-C++/except: 17.04% (0.2811 => 0.3290, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.00% (2.0673 => 2.4188, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.97% (0.2729 => 0.3192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.91% (0.2780 => 0.3250, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.88% (0.9909 => 1.1582, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 16.88% (0.3004 => 0.3511, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 16.86% (0.3096 => 0.3618, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.72% (0.3930 => 0.4587, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary: 16.70% (0.3258 => 0.3802, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.68% (0.3267 => 0.3812, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.65% (0.3195 => 0.3727, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.51% (0.4361 => 0.5081, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.47% (1.9694 => 2.2937, std.dev.: 0.0796) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.34% (0.3060 => 0.3560, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 16.25% (0.3446 => 0.4006, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 16.25% (0.3465 => 0.4028, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.23% (0.3124 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.20% (0.3488 => 0.4053, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 16.18% (23.5202 => 27.3255, std.dev.: 0.0262) SingleSource/UnitTests/ObjC/exceptions-3: 16.16% (0.3460 => 0.4019, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 16.15% (0.3442 => 0.3998, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/synchronized: 16.14% (0.3469 => 0.4029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.13% (1.9966 => 2.3187, std.dev.: 0.0712) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.08% (2.7292 => 3.1681, std.dev.: 0.0959) MultiSource/Applications/d/make_dparser: 16.06% (1.0781 => 1.2512, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/for-in: 16.02% (0.3496 => 0.4056, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.02% (0.2566 => 0.2977, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.00% (0.3362 => 0.3900, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 15.86% (0.3317 => 0.3843, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.75% (0.3650 => 0.4225, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.72% (4.2109 => 4.8727, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: 15.65% (0.3477 => 0.4021, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/moments: 15.63% (0.3678 => 0.4253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.54% (0.3726 => 0.4305, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.54% (0.3282 => 0.3792, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.50% (0.3625 => 0.4187, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 15.50% (0.3348 => 0.3867, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.48% (0.3643 => 0.4207, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 15.47% (0.3724 => 0.4300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.20% (0.3690 => 0.4251, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.15% (0.3981 => 0.4584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.98% (0.4146 => 0.4767, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 14.94% (0.4251 => 0.4886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 14.65% (1.4269 => 1.6360, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.46% (0.3845 => 0.4401, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 14.39% (0.5012 => 0.5733, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 14.01% (0.7875 => 0.8978, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.97% (0.6435 => 0.7334, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.34% (0.2737 => 0.3102, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (2.1653 => 2.4508, std.dev.: 0.0162) MultiSource/Applications/JM/lencod/lencod: 12.59% (4.6177 => 5.1991, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 12.59% (5.5417 => 6.2392, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 12.56% (2.1013 => 2.3652, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/football/football: 12.43% (0.2075 => 0.2333, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.41% (0.2691 => 0.3025, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.96% (0.3084 => 0.3453, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 11.72% (0.3336 => 0.3727, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.64% (11.6398 => 12.9941, std.dev.: 0.0269) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.22% (0.2103 => 0.2339, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.08% (0.6634 => 0.7369, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.82% (0.5361 => 0.5941, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.19% (4.6926 => 5.1709, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 10.09% (0.4847 => 0.5336, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.92% (0.7426 => 0.8163, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.71% (0.2040 => 0.2238, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.89% (0.1383 => 0.1506, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: 8.36% (0.2391 => 0.2591, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.31% (0.5584 => 0.6048, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 7.82% (2.0346 => 2.1938, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 7.68% (11.9555 => 12.8735, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.80% (0.3792 => 0.4050, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5310, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0277) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.75% (0.3693 => 0.4053, std.dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2398, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6662, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8928, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6851, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2824, std.dev.: 0.0280) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0828, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2086, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.09% (10.3705 => 10.4840, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5931, std.dev.: 0.0291) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5741, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -18.17% (17.2379 => 14.1061, std.dev.: 0.0855) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.07% (0.2402 => 0.2160, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8126, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2213, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8015, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/dry: -3.43% (14.0481 => 13.5661, std.dev.: 0.1454) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1390, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5004, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1267, std.dev.: 0.0723) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0495, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 03:04:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 05:04:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107110421.2F0B22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7382?compare_to=7380&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7382, Order: 171713, Start Time: 2013-01-07 09:28:27, End Time: 2013-01-07 11:03:25 To: 7380, Order: 171702, Start Time: 2013-01-07 07:24:26, End Time: 2013-01-07 09:02:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (107 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (809 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (80.0332 => 81.2276, std.dev.: 0.1614) SingleSource/Benchmarks/McGill/chomp: 1.39% (1.0843 => 1.0994, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.90% (0.5456 => 1.1561, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.55% (0.5688 => 1.1919, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.30% (0.5567 => 1.1652, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.99% (0.5575 => 1.1651, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.65% (0.5581 => 1.1645, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.37% (0.5805 => 1.2038, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.22% (0.6395 => 1.3188, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.88% (0.5941 => 1.2172, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.26% (0.5849 => 1.1947, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.01% (0.6033 => 1.2308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.77% (0.5859 => 1.1939, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.00% (0.6260 => 1.2708, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.12% (0.5478 => 1.0908, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.84% (0.6189 => 1.2306, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.10% (0.5569 => 1.1032, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.74% (0.5570 => 1.1014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.28% (0.6440 => 1.2705, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.05% (0.5591 => 1.1017, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 97.00% (0.5705 => 1.1239, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.86% (0.6304 => 1.2410, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 96.14% (0.5802 => 1.1380, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.07% (0.6395 => 1.2475, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.95% (0.6676 => 1.2948, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.54% (0.5925 => 1.1467, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.26% (0.5857 => 1.1319, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.18% (0.6230 => 1.2035, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.87% (0.5863 => 1.1308, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.76% (0.6052 => 1.1666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.86% (0.6660 => 1.2778, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.02% (0.6194 => 1.1646, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.56% (0.6446 => 1.2090, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.50% (0.6297 => 1.1744, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 83.16% (0.6681 => 1.2237, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.26% (0.6667 => 1.2151, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.58% (0.7524 => 1.3662, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 76.71% (0.0717 => 0.1267, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.89% (0.7339 => 1.2835, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.04% (0.0974 => 0.1588, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 63.04% (0.0514 => 0.0838, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 61.05% (0.0267 => 0.0430, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 46.08% (0.0293 => 0.0428, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 45.24% (0.0599 => 0.0870, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.96% (0.1132 => 0.1573, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.82% (0.0680 => 0.0944, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.09% (0.0693 => 0.0950, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.81% (1.6474 => 2.2374, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.93% (0.0582 => 0.0762, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.97% (2.2587 => 2.9130, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.72% (0.0622 => 0.0782, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.48% (0.0621 => 0.0773, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.03% (0.5329 => 0.6503, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.46% (0.1081 => 0.1313, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.7021 => 0.8298, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.62% (0.4916 => 0.5684, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: 14.45% (1.1450 => 1.3104, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.71% (4.5069 => 5.1249, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.69% (0.4515 => 0.5088, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 11.95% (0.3357 => 0.3758, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.89% (0.2001 => 0.2239, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.35% (1.6364 => 1.8221, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.19% (0.2385 => 0.2652, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 11.19% (0.1761 => 0.1958, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.58% (3.5339 => 3.9078, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.05% (0.1441 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.45% (0.1731 => 0.1860, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.38% (1.2515 => 1.3439, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.66% (0.3319 => 0.3540, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 6.64% (9.2283 => 9.8415, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.27% (1.2784 => 1.3585, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 5.98% (5.0226 => 5.3230, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.3255 => 0.3419, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 2.87% (1.3864 => 1.4262, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.40% (1.3722 => 1.4052, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 2.39% (0.4524 => 0.4632, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.27% (5.4682 => 5.5922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 1.96% (0.6750 => 0.6882, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.80% (1.4642 => 1.4905, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 1.62% (0.8418 => 0.8554, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 1.38% (0.7447 => 0.7550, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.33% (0.9557 => 0.9684, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (22.4056 => 22.6771, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.58% (31.3723 => 55.7095, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.76% (0.9531 => 1.0175, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 4.12% (3.1932 => 3.3249, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (54.5751 => 56.5810, std.dev.: 0.0978) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0989, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.27% (5.1955 => 5.3656, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6551 => 3.7317, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.89% (79.7170 => 81.2276, std.dev.: 0.1614) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.5320 => 4.6127, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3037, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.62% (0.1281 => 0.1145, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.98% (0.3837 => 0.3646, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.74% (0.3821 => 0.3640, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.43% (0.3812 => 0.3643, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3831 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.38% (0.3880 => 0.3710, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.35% (0.3884 => 0.3715, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.31% (0.3896 => 0.3728, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.30% (0.3323 => 0.3180, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.16% (0.3891 => 0.3729, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: -4.07% (0.4176 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.4033 => 0.3870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.02% (0.3057 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.98% (0.9852 => 0.9460, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.86% (0.2903 => 0.2791, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.84% (0.3205 => 0.3082, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.76% (0.3059 => 0.2944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.68% (0.7198 => 0.6933, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.68% (0.3016 => 0.2905, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -3.64% (0.3026 => 0.2916, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.59% (2.1713 => 2.0934, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.52% (1.3148 => 1.2685, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.50% (0.7779 => 0.7507, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.47% (0.3252 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (0.3025 => 0.2921, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -3.40% (2.4924 => 2.4076, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.36% (0.4280 => 0.4136, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.36% (20.7746 => 20.0769, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.9542 => 0.9226, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: -3.18% (0.6441 => 0.6236, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.11% (0.4151 => 0.4022, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.84% (0.7919 => 0.7694, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.82% (0.3931 => 0.3820, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.70% (17.1032 => 16.6417, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: -2.42% (4.3330 => 4.2280, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.39% (0.4427 => 0.4321, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.26% (1.2221 => 1.1945, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -2.17% (0.7982 => 0.7809, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.16% (1.2210 => 1.1946, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.15% (14.2083 => 13.9035, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.08% (6.7716 => 6.6305, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.06% (1.2300 => 1.2047, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.03% (1.0544 => 1.0330, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -1.89% (16.1920 => 15.8857, std.dev.: 0.0254) MultiSource/Applications/siod/siod: -1.77% (2.4021 => 2.3596, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -1.68% (7.0961 => 6.9769, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.65% (0.8521 => 0.8380, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -1.52% (1.5610 => 1.5373, std.dev.: 0.0027) MultiSource/Applications/lua/lua: -1.47% (4.0594 => 3.9997, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: -1.47% (34.0927 => 33.5931, std.dev.: 0.0266) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.09% (8.0126 => 7.9250, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.39% (1.8100 => 0.6808, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.61% (1.3643 => 1.0286, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.60% (4.3504 => 3.3235, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0597, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1781, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.24% (4.3779 => 3.4041, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.90% (2.5106 => 2.1364, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.60% (0.5142 => 0.4597, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7816, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8712, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.18% (1.1594 => 1.0994, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.78% (7.9763 => 7.7545, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/ary3: -2.74% (3.7241 => 3.6220, std.dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2743, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.70% (1.6086 => 1.5813, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8035, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.37% (3.7092 => 3.6582, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6009, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.25% (1.4516 => 1.4334, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 03:42:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 05:42:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107114207.576B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7383?compare_to=7379&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7383, Order: 171712, Start Time: 2013-01-07 09:28:47, End Time: 2013-01-07 11:42:01 To: 7379, Order: 171701, Start Time: 2013-01-07 06:43:06, End Time: 2013-01-07 08:58:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 8 (219 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1089 (605 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.11% (10.1592 => 10.3732, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (4.4168 => 4.5035, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.53% (2.3532 => 2.3891, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (4.4304 => 4.4969, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 1.02% (54.9417 => 55.5008, std.dev.: 0.0717) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 3.54% (75.2491 => 77.9126, std.dev.: 0.1422) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.35% (41.8693 => 42.8516, std.dev.: 0.1071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.83% (79.8277 => 81.2889, std.dev.: 0.0562) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.11% (2.2951 => 2.2696, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.99% (0.0731 => 0.0658, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8029 => 499.8516, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44224.87% (1.1277 => 499.8516, std.dev.: 0.0034) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.85% (0.5229 => 1.6516, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 20.11% (14.9895 => 18.0042, std.dev.: 0.0297) MultiSource/Applications/kimwitu++/kc: 44.24% (14.1553 => 20.4176, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 17.83% (4.1105 => 4.8434, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.83% (1.1048 => 1.7547, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.09% (7.1582 => 37.5155, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.87% (3.4629 => 6.4018, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.09% (0.6222 => 1.0894, std.dev.: 0.0065) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10217.22% (0.0720 => 7.4284, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 11091200.00% (0.0001 => 11.0913, std.dev.: 0.0641) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908700.00% (0.0001 => 9.9088, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488200.00% (0.0001 => 5.4883, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.68% (1.1194 => 10.3732, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 150.28% (22.1758 => 55.5008, std.dev.: 0.0717) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 115.23% (0.0243 => 0.0523, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.08% (0.0929 => 0.1803, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 87.08% (0.0271 => 0.0507, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 73.89% (0.1463 => 0.2544, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.16% (1.5859 => 2.5559, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.22% (2.9384 => 4.6197, std.dev.: 0.0013) SingleSource/Regression/C/sumarray: 57.14% (0.0231 => 0.0363, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 55.81% (0.0439 => 0.0684, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.21% (7.0540 => 10.9485, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.26% (2.2024 => 3.3313, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0232 => 0.0348, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.80% (0.5105 => 0.7596, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.87% (8.1363 => 12.0315, std.dev.: 0.0181) SingleSource/UnitTests/Vector/multiplies: 45.16% (0.0279 => 0.0405, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 44.15% (0.0265 => 0.0382, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.30% (0.6675 => 0.9432, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 41.15% (21.9371 => 30.9653, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.94% (0.4615 => 0.6366, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0010) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.93% (4.2646 => 5.8397, std.dev.: 0.0121) MultiSource/Applications/sgefa/sgefa: 36.44% (0.3109 => 0.4242, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 36.36% (0.0814 => 0.1110, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 34.44% (0.1655 => 0.2225, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.47% (1.5415 => 2.0575, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.80% (0.2271 => 0.3016, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.16% (0.1906 => 0.2519, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.01% (0.1337 => 0.1765, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 31.96% (0.4299 => 0.5673, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 29.62% (1.1642 => 1.5090, std.dev.: 0.0098) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.46% (0.1584 => 0.2019, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.30% (0.3121 => 0.3973, std.dev.: 0.0073) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.23% (0.0793 => 0.1001, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 26.04% (0.2554 => 0.3219, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.84% (3.8922 => 4.8979, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.70% (0.1175 => 0.1477, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.63% (0.1143 => 0.1436, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.50% (5.7591 => 7.2275, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 24.86% (1.0722 => 1.3388, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.16% (1.4186 => 1.7613, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.83% (0.1695 => 0.2099, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.82% (0.1566 => 0.1939, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 23.62% (9.4845 => 11.7251, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.52% (0.2700 => 0.3308, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 22.25% (0.1555 => 0.1901, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.20% (1.3050 => 1.5947, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.05% (0.7115 => 0.8684, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 21.91% (0.0648 => 0.0790, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 21.56% (0.3098 => 0.3766, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.17% (4.9449 => 5.9917, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.03% (0.1032 => 0.1249, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 20.74% (0.7835 => 0.9460, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.13% (0.4636 => 0.5569, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 19.92% (1.1840 => 1.4199, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.89% (5.0018 => 5.9966, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 19.64% (0.6456 => 0.7724, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.48% (0.1940 => 0.2318, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.43% (0.8172 => 0.9760, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.32% (0.5860 => 0.6992, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.12% (3.3354 => 3.9732, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 18.84% (0.4289 => 0.5097, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 18.53% (0.4620 => 0.5476, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.35% (0.1117 => 0.1322, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 18.16% (0.7433 => 0.8783, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.03% (0.5020 => 0.5925, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.02% (0.3307 => 0.3903, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 17.64% (0.3232 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.62% (0.3423 => 0.4026, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.5569 => 0.6550, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.51% (0.9765 => 1.1475, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 17.27% (0.3283 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 16.93% (3.8723 => 4.5280, std.dev.: 0.0194) MultiSource/Applications/treecc/treecc: 16.83% (2.0273 => 2.3685, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.51% (0.0933 => 0.1087, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 16.47% (0.8921 => 1.0390, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.40% (0.5981 => 0.6962, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 16.37% (2.2969 => 2.6729, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.25% (0.6450 => 0.7498, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.24% (0.8101 => 0.9417, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.87% (0.0838 => 0.0971, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 15.53% (0.3180 => 0.3674, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.68% (1.1861 => 1.3602, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.66% (0.0798 => 0.0915, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3379 => 0.3869, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.26% (0.8067 => 0.9217, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.64% (0.2603 => 0.2958, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.40% (0.3387 => 0.3841, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 13.30% (1.5603 => 1.7678, std.dev.: 0.0075) SingleSource/UnitTests/ObjC/parameter-passing: 13.09% (0.3927 => 0.4441, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.01% (0.4103 => 0.4637, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 12.79% (0.3886 => 0.4383, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.73% (0.4203 => 0.4738, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.40% (0.4048 => 0.4550, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 12.22% (0.3543 => 0.3976, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.19% (0.3543 => 0.3975, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.18% (0.1330 => 0.1492, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 12.15% (0.3473 => 0.3895, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3603 => 0.4039, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.92% (0.3422 => 0.3830, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.91% (0.3282 => 0.3673, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.90% (0.3497 => 0.3913, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.70% (0.3684 => 0.4115, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.51% (0.3092 => 0.3448, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.50% (0.3826 => 0.4266, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 11.38% (17.1811 => 19.1367, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.03% (14.3668 => 15.9514, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 10.70% (0.2831 => 0.3134, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.68% (0.3427 => 0.3793, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.15% (0.1892 => 0.2084, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.83% (2.0665 => 2.2696, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.6030 => 0.6602, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 9.33% (1.2842 => 1.4040, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.32% (0.3650 => 0.3990, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.13% (0.2891 => 0.3155, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.09% (0.2905 => 0.3169, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.01% (0.5925 => 0.6459, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.96% (63.2438 => 68.9080, std.dev.: 0.0681) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.71% (0.2802 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.64% (0.2756 => 0.2994, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.49% (2.2022 => 2.3891, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.46% (0.3935 => 0.4268, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.45% (0.3136 => 0.3401, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 7.21% (10.3673 => 11.1150, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3817 => 0.3989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.06% (0.3131 => 0.3258, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (7.9617 => 8.1901, std.dev.: 0.0176) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2391, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.98% (1.1145 => 1.2926, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3287, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0596, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (4.2280 => 4.4688, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3130, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.14% (3.6395 => 3.7903, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.67% (2.0360 => 2.1107, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (8.6802 => 8.9139, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2444, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2187, std.dev.: 0.0386) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.56% (5.2763 => 1.1838, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.38% (5.3855 => 4.5035, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.99% (5.3526 => 4.4969, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -12.54% (10.4361 => 9.1271, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.21% (1.7609 => 1.6164, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -7.44% (54.1659 => 50.1383, std.dev.: 0.0744) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.08% (1.9577 => 0.6836, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0212, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4216, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7793, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9695 => 2.2949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.27% (2.5528 => 2.1374, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -11.90% (1.2373 => 1.0901, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: -11.12% (9.5636 => 8.5001, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.23% (0.9540 => 0.8659, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2747, std.dev.: 0.0260) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8375, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.14% (8.1563 => 7.8185, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -1.83% (3.6994 => 3.6318, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6696, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2308, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0036) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 05:02:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 07:02:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107130230.7B2C42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7384?compare_to=7382&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7384, Order: 171724, Start Time: 2013-01-07 11:27:49, End Time: 2013-01-07 13:02:26 To: 7382, Order: 171713, Start Time: 2013-01-07 09:28:27, End Time: 2013-01-07 11:03:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (805 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.82% (20.0769 => 20.4432, std.dev.: 0.0238) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.00% (1.0175 => 1.0277, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.62% (0.5456 => 1.1546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.51% (0.5688 => 1.1917, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.32% (0.5567 => 1.1653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.97% (0.5575 => 1.1650, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.58% (0.5581 => 1.1641, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.27% (0.5805 => 1.2032, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.04% (0.6395 => 1.3176, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.86% (0.5941 => 1.2171, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.09% (0.5849 => 1.1937, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.74% (0.5859 => 1.1937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.73% (0.6033 => 1.2291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.18% (0.6260 => 1.2719, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.03% (0.5478 => 1.0903, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.45% (0.6189 => 1.2282, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.15% (0.5569 => 1.1035, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.50% (0.5570 => 1.1001, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.03% (0.6440 => 1.2689, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.94% (0.6304 => 1.2415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.92% (0.5591 => 1.1010, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.83% (0.5705 => 1.1229, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.97% (0.5802 => 1.1370, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.93% (0.6395 => 1.2466, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.74% (0.6676 => 1.2934, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.40% (0.5925 => 1.1459, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.31% (0.6230 => 1.2043, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.93% (0.5857 => 1.1300, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.73% (0.6052 => 1.1664, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.55% (0.5863 => 1.1289, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.65% (0.6660 => 1.2764, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.81% (0.6194 => 1.1633, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.37% (0.6446 => 1.2078, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.58% (0.6297 => 1.1749, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 83.10% (0.6681 => 1.2233, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.09% (0.6667 => 1.2140, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.45% (0.7524 => 1.3652, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.17% (0.0717 => 0.1256, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.68% (0.7339 => 1.2820, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.53% (0.0974 => 0.1583, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 60.67% (0.0267 => 0.0429) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.00% (0.1500 => 0.2205, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.69% (0.1132 => 0.1570, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.53% (0.0680 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.80% (0.0693 => 0.0948, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.69% (1.6474 => 2.2354, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.76% (0.0582 => 0.0761, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.92% (2.2587 => 2.9119, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.03% (0.5329 => 0.6503, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.18% (0.1081 => 0.1310, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.89% (0.7021 => 0.8277, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.64% (0.4916 => 0.5685, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 14.38% (1.1450 => 1.3096, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.39% (4.5069 => 5.1105, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 12.49% (0.4515 => 0.5079, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.77% (0.3357 => 0.3752, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.69% (0.2001 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.17% (1.6364 => 1.8192, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.07% (0.2385 => 0.2649, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.62% (0.1761 => 0.1948, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.49% (3.5339 => 3.9046, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.56% (0.1441 => 0.1550, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.17% (1.2515 => 1.3412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.05% (0.1731 => 0.1853, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.58% (9.2283 => 9.8355, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.48% (0.3319 => 0.3534, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.21% (1.2784 => 1.3578, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 5.89% (5.0226 => 5.3185, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.3255 => 0.3398, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.3864 => 1.4222, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.3722 => 1.4035, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.15% (5.4682 => 5.5855, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.71% (1.4642 => 1.4892, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 1.53% (0.6750 => 0.6853, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (22.4056 => 22.6515, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.09% (0.9557 => 0.9661, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7014, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (3.1932 => 3.3330, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5793, std.dev.: 0.1257) MultiSource/Benchmarks/nbench/nbench: 3.59% (11.6767 => 12.0960, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.35% (5.1955 => 5.3698, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6551 => 3.7289, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6113, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3049, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.93% (0.1281 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.45% (0.3194 => 0.2988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.71% (0.3821 => 0.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -4.30% (0.3026 => 0.2896, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.24% (2.1713 => 2.0792, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/methcall: -4.23% (0.3025 => 0.2897, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.21% (0.3252 => 0.3115, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.13% (0.7198 => 0.6901, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.12% (0.9852 => 0.9446, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.10% (1.3148 => 1.2609, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -4.09% (0.3812 => 0.3656, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.07% (0.3831 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.05% (0.3880 => 0.3723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3848 => 0.3693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.98% (0.3896 => 0.3741, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.96% (0.3884 => 0.3730, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.4176 => 0.4016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.81% (0.2989 => 0.2875, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.78% (0.4151 => 0.3994, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.77% (0.3658 => 0.3520, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.4033 => 0.3881, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -3.68% (2.4924 => 2.4006, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.9542 => 0.9193, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.53% (0.6347 => 0.6123, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.49% (0.6484 => 0.6258, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.38% (0.6441 => 0.6223, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.38% (0.3931 => 0.3798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.38% (0.4199 => 0.4057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.03% (0.7779 => 0.7543, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.98% (0.4427 => 0.4295, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.7919 => 0.7688, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.88% (0.3849 => 0.3738, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -2.87% (0.3867 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.87% (0.4321 => 0.4197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.85% (0.4248 => 0.4127, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.75% (17.1032 => 16.6326, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: -2.69% (0.3788 => 0.3686, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -2.52% (4.3330 => 4.2236, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.50% (14.2083 => 13.8536, std.dev.: 0.0176) MultiSource/Applications/lambda-0_1_3/lambda: -2.37% (0.7982 => 0.7793, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.36% (1.2221 => 1.1933, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.22% (6.7716 => 6.6212, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.21% (1.0544 => 1.0311, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.18% (1.2210 => 1.1944, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.14% (1.2300 => 1.2037, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -2.13% (16.1920 => 15.8469, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -1.91% (2.4021 => 2.3562, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -1.88% (1.5610 => 1.5316, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.82% (0.8521 => 0.8366, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.77% (0.5999 => 0.5893, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.70% (7.0961 => 6.9756, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.64% (34.0927 => 33.5322, std.dev.: 0.0574) SingleSource/UnitTests/Vector/constpool: -1.60% (20.7746 => 20.4432, std.dev.: 0.0238) MultiSource/Applications/lua/lua: -1.40% (4.0594 => 4.0027, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.22% (8.0126 => 7.9147, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: -1.07% (2.1401 => 2.1173, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.33% (1.8100 => 0.7000, std.dev.: 0.0195) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3134, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.33% (83.5423 => 64.0535, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1045, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1797, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4055, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1384, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.28% (4.2493 => 3.6848, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7821, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.32% (1.1594 => 1.0861, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3830 => 5.1549, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7622, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.47% (1.3096 => 1.2772, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/ary3: -2.23% (3.7241 => 3.6410, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.73% (1.6086 => 1.5808, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8048, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7092 => 3.6558, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6003, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4351, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 06:06:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 08:06:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107140642.8D0C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7385?compare_to=7381&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7385, Order: 171716, Start Time: 2013-01-07 10:32:59, End Time: 2013-01-07 14:06:37 To: 7381, Order: 171691, Start Time: 2013-01-07 06:01:18, End Time: 2013-01-07 09:39:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (181 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1099 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.04% (1.9598 => 1.9802, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2086 => 0.2202, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.76% (2.0575 => 2.1143, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.08% (0.0625 => 0.0888, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.40% (0.1063 => 0.1418, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.16% (0.2969 => 0.3805, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.42% (0.0547 => 0.0697, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.50% (0.4139 => 0.5236, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.00% (0.5900 => 0.7434, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.75% (0.4253 => 0.5348, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.62% (0.1620 => 0.2035, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.69% (0.4994 => 0.6227, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.34% (0.5000 => 0.6217, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.29% (1.5932 => 1.9802, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 23.10% (0.0948 => 0.1167, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.63% (0.1003 => 0.1230, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.26% (0.1604 => 0.1961, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.08% (0.1549 => 0.1891, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.83% (0.3903 => 0.4755, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 21.80% (0.1619 => 0.1972, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 20.28% (0.1218 => 0.1465, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.22% (0.1088 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.18% (0.1462 => 0.1757, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.03% (0.4029 => 0.4836, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.01% (0.2014 => 0.2417, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.64% (0.3890 => 0.4654, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 19.60% (0.1505 => 0.1800, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.55% (0.5826 => 0.6965, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.23% (0.2866 => 0.3417, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 19.09% (0.5889 => 0.7013, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 18.57% (0.5546 => 0.6576, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 18.34% (1.8794 => 2.2240, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: 18.33% (0.9697 => 1.1474, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.26% (1.3152 => 1.5553, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.22% (0.3271 => 0.3867, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.12% (0.4658 => 0.5502, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.08% (3.5627 => 4.2067, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.99% (0.1968 => 0.2322, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.98% (1.6211 => 1.9126, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.67% (0.1160 => 0.1365, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.39% (0.7171 => 0.8418, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.13% (4.4195 => 5.1764, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.10% (0.3930 => 0.4602, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.90% (0.2911 => 0.3403, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.80% (0.2750 => 0.3212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.76% (0.2714 => 0.3169, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.76% (0.2823 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.70% (0.2803 => 0.3271) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.69% (0.5026 => 0.5865, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.69% (0.2738 => 0.3195, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.67% (0.4361 => 0.5088, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: 16.64% (1.0781 => 1.2575, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (0.2725 => 0.3177, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 16.58% (0.2811 => 0.3277, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 16.46% (23.5202 => 27.3907, std.dev.: 0.0304) MultiSource/Applications/hexxagon/hexxagon: 16.43% (0.9909 => 1.1537, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.41% (2.0673 => 2.4066, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.38% (0.2729 => 0.3176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.33% (0.2780 => 0.3234, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.22% (1.9694 => 2.2889, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wc: 16.18% (0.3096 => 0.3597, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.10% (1.9966 => 2.3180, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.82% (2.7292 => 3.1609, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/trivial-interface: 15.80% (0.3442 => 0.3986, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.80% (4.2109 => 4.8762, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/exceptions-4: 15.79% (0.3465 => 0.4012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 15.79% (0.3446 => 0.3990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.78% (0.3258 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.75% (0.3060 => 0.3542, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.74% (0.3488 => 0.4037, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 15.65% (0.3469 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.65% (0.3317 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.62% (0.3496 => 0.4042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.50% (0.3362 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.48% (0.3650 => 0.4215, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 15.46% (0.3726 => 0.4302, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.45% (0.3625 => 0.4185, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.36% (0.3124 => 0.3604, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 15.36% (0.3678 => 0.4243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.36% (0.3477 => 0.4011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.17% (0.3724 => 0.4289, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.15% (0.3643 => 0.4195, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 15.05% (0.4146 => 0.4770, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0048) MultiSource/Applications/lua/lua: 15.03% (1.4269 => 1.6413, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.97% (0.3981 => 0.4577, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.65% (0.2566 => 0.2942, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 14.61% (0.4251 => 0.4872, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.30% (0.3845 => 0.4395, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 14.22% (0.7875 => 0.8995, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 14.15% (0.5012 => 0.5721, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.60% (0.6435 => 0.7310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.55% (0.2737 => 0.3108, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.10% (2.1653 => 2.4490, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 13.00% (5.5417 => 6.2619, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.62% (0.2068 => 0.2329, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.62% (4.6177 => 5.2004, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 12.58% (0.2075 => 0.2336, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 12.52% (0.2691 => 0.3028, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3563, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.08% (11.6398 => 13.0457, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.03% (0.3084 => 0.3455, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 12.01% (0.3498 => 0.3918, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.60% (0.2103 => 0.2347, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.57% (0.5361 => 0.5981, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.38% (0.6634 => 0.7389, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.87% (4.6926 => 5.2025, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.36% (0.7426 => 0.8195, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.00% (0.2040 => 0.2244, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (0.5584 => 0.6081, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.82% (0.2391 => 0.2602, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.32% (2.0346 => 2.2039, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 8.17% (11.9555 => 12.9317, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (0.1383 => 0.1491, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.30% (0.3792 => 0.4031, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5183, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.2802 => 0.3053, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.66% (0.3693 => 0.3939, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2400, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6711, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6796, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.88% (0.6276 => 0.6457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2115, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.55% (2.0820 => 2.1143, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2925, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3040, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.22% (4.0317 => 4.0810, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2075, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.10% (50.0626 => 50.6117, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4759, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5905, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.22% (17.2379 => 14.2687, std.dev.: 0.0984) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013) SingleSource/Benchmarks/Shootout-C++/ary2: -9.16% (0.2402 => 0.2182, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7875, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (41.7953 => 40.2036, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7946, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2238, std.dev.: 0.0789) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5766, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2501, std.dev.: 0.0549) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 06:25:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 08:25:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107142531.9632A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7386?compare_to=7383&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7386, Order: 171728, Start Time: 2013-01-07 12:12:27, End Time: 2013-01-07 14:25:27 To: 7383, Order: 171712, Start Time: 2013-01-07 09:28:47, End Time: 2013-01-07 11:42:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (221 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (602 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.59% (11.1150 => 11.5137, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0658 => 0.0659, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8516 => 499.8393, std.dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.78% (1.1277 => 499.8393, std.dev.: 0.0149) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.22% (0.5229 => 1.6535, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 20.20% (14.9895 => 18.0169, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 44.04% (14.1553 => 20.3888, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8499, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.85% (1.1048 => 1.7550, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.93% (7.1582 => 37.5758, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.46% (3.4629 => 6.3877, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.38% (0.6222 => 1.0912, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10212.22% (0.0720 => 7.4248, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3832200.00% (0.0001 => 3.8323, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11079400.00% (0.0001 => 11.0795, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16700.00% (0.0001 => 0.0168, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908500.00% (0.0001 => 9.9086, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486700.00% (0.0001 => 5.4868, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.08% (1.1194 => 10.3777, std.dev.: 0.0133) MultiSource/Applications/ClamAV/clamscan: 149.71% (22.1758 => 55.3753, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 115.64% (0.0243 => 0.0524, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.62% (0.0929 => 0.1808, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 87.45% (0.0271 => 0.0508, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534) MultiSource/Benchmarks/FreeBench/neural/neural: 73.96% (0.1463 => 0.2545, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.85% (1.5859 => 2.5509, std.dev.: 0.0006) SingleSource/Regression/C/sumarray: 57.14% (0.0231 => 0.0363, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.75% (2.9384 => 4.6060, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 56.04% (0.0439 => 0.0685, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.31% (7.0540 => 10.9555, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 50.92% (2.2024 => 3.3238, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.70% (0.5105 => 0.7591, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.22% (8.1363 => 11.9786, std.dev.: 0.0090) SingleSource/UnitTests/Vector/multiplies: 45.52% (0.0279 => 0.0406) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.42% (0.6675 => 0.9440, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 41.12% (21.9371 => 30.9577, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.57% (0.4615 => 0.6395, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.42% (0.1062 => 0.1470, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.15% (4.2646 => 5.8488, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 36.36% (0.0814 => 0.1110, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 36.28% (0.3109 => 0.4237, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 34.56% (0.1655 => 0.2227, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.58% (0.1906 => 0.2546, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.36% (1.5415 => 2.0558, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.29% (0.2271 => 0.3027, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.09% (0.1337 => 0.1766, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 31.57% (0.4299 => 0.5656, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 29.84% (1.1642 => 1.5116, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 29.07% (0.0719 => 0.0928, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.43% (0.3121 => 0.3977, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.80% (0.2554 => 0.3213, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.78% (0.1125 => 0.1415, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 25.62% (0.1175 => 0.1476, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.51% (3.8922 => 4.8852, std.dev.: 0.0212) MultiSource/Applications/oggenc/oggenc: 25.42% (5.7591 => 7.2228, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.70% (1.0722 => 1.3370, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.58% (0.1143 => 0.1424, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.35% (1.4186 => 1.7640, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.01% (0.1695 => 0.2102, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.82% (0.1566 => 0.1939, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 23.66% (9.4845 => 11.7284, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 22.44% (0.1555 => 0.1904, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.33% (0.2700 => 0.3303, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.29% (1.3050 => 1.5959, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 22.02% (0.7115 => 0.8682, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.92% (0.3098 => 0.3777, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.52% (0.1236 => 0.1502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.12% (0.1032 => 0.1250, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.97% (0.4636 => 0.5608, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 20.94% (0.7835 => 0.9476, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.91% (4.9449 => 5.9788, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 20.14% (0.4289 => 0.5153, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 20.12% (1.1840 => 1.4222, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.90% (5.0018 => 5.9970, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.79% (0.1940 => 0.2324, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.74% (0.8172 => 0.9785, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 19.66% (0.6456 => 0.7725, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.61% (0.5860 => 0.7009, std.dev.: 0.0046) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 19.17% (3.3354 => 3.9748, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 18.92% (0.4620 => 0.5494, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.59% (0.0834 => 0.0989, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.36% (0.3307 => 0.3914, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.06% (0.5569 => 0.6575, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.03% (0.5020 => 0.5925, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 17.98% (0.3232 => 0.3813, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 17.97% (0.7433 => 0.8769, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.88% (0.3423 => 0.4035, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 17.64% (0.3283 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.57% (0.9765 => 1.1481, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 16.87% (3.8723 => 4.5257, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 16.79% (2.0273 => 2.3676, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.54% (0.6450 => 0.7517, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.50% (0.5981 => 0.6968, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.35% (0.0838 => 0.0975, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.21% (0.8101 => 0.9414, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 16.05% (0.8921 => 1.0353, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 15.99% (2.2969 => 2.6641, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.98% (0.3441 => 0.3991, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.66% (0.3180 => 0.3678, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.97% (0.3379 => 0.3885, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.84% (1.1861 => 1.3621, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.81% (0.8067 => 0.9262, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.13% (0.3865 => 0.4411, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.79% (1.5603 => 1.7754, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3927 => 0.4450, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 13.23% (0.3886 => 0.4400, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.4203 => 0.4750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.77% (0.4048 => 0.4565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.64% (0.3828 => 0.4312, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.53% (0.3543 => 0.3987, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 12.52% (0.3603 => 0.4054, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.29% (0.3516 => 0.3948, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 12.24% (0.3422 => 0.3841, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 12.21% (0.3497 => 0.3924, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.21% (0.3473 => 0.3897, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.16% (0.3543 => 0.3974, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.03% (0.1330 => 0.1490, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 11.92% (0.3684 => 0.4123, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.79% (0.3282 => 0.3669, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.63% (0.3826 => 0.4271, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.30% (0.2831 => 0.3151, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.25% (17.1811 => 19.1137, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.22% (14.3668 => 15.9790, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (10.3673 => 11.5137, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.4064 => 0.4513, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.30% (2.0665 => 2.2794, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 10.25% (0.1268 => 0.1398, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.17% (0.2871 => 0.3163, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.91% (0.2877 => 0.3162, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.63% (1.2842 => 1.4079, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.58% (0.2891 => 0.3168, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.54% (0.2905 => 0.3182, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.48% (0.3650 => 0.3996, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.42% (0.3162 => 0.3460, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.6030 => 0.6597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.31% (0.2802 => 0.3063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.27% (0.3052 => 0.3335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.25% (0.2756 => 0.3011, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2725 => 0.2977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2793 => 0.3050, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.93% (0.3136 => 0.3416, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.92% (0.2714 => 0.2956, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.86% (63.2438 => 68.8461, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.79% (0.3935 => 0.4281, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.87% (2.2022 => 2.3756, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.4879 => 0.5229, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.82% (0.3817 => 0.4001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.47% (0.3131 => 0.3271, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.02% (7.9617 => 8.2023, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.17% (32.5116 => 59.2274, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.98% (1.1145 => 1.2926, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 5.88% (11.6436 => 12.3285, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0596, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4631, std.dev.: 0.0096) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 5.01% (3.1578 => 3.3159, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (3.6395 => 3.7747, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.66% (2.0360 => 2.1105, std.dev.: 0.0184) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.89% (8.6802 => 8.9314, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.38% (1.0313 => 1.0558, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.04% (0.9957 => 1.0160, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.48% (1.0785 => 1.0945, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2447, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.41% (9.1159 => 9.2445, std.dev.: 0.0268) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5854, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1703, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1795, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.10% (0.8651 => 0.2154, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.94% (5.3855 => 4.4734, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.37% (5.3526 => 4.4766, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -12.58% (10.4361 => 9.1231, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.34% (1.7609 => 1.6140, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -7.93% (54.1659 => 49.8717, std.dev.: 0.0347) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.06% (1.9577 => 0.6644, std.dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3059, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0193, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.84% (10.7105 => 7.4073, std.dev.: 0.0258) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7796, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0060, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.62% (0.2161 => 0.1737, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.43% (2.5528 => 2.1333, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7310, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4922, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: -11.15% (1.2373 => 1.0993, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.26% (0.9540 => 0.8657, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.94% (1.5660 => 1.4260, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.59% (19.9488 => 18.2350, std.dev.: 0.0365) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.01% (4.8142 => 4.4769, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8399, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.09% (8.1563 => 7.8231, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0093) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.05% (3.6994 => 3.6604, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0105) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.86% (0.2116 => 0.0659, std.dev.: 0.0024) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 07:00:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 09:00:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107150015.B6DF02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7387?compare_to=7384&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7387, Order: 171730, Start Time: 2013-01-07 13:25:38, End Time: 2013-01-07 15:00:11 To: 7384, Order: 171724, Start Time: 2013-01-07 11:27:49, End Time: 2013-01-07 13:02:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (134 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1100 (806 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.34% (0.3705 => 0.3903, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.15% (1.0861 => 1.0986, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.20% (0.5456 => 1.1523, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.11% (0.5567 => 1.1641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.97% (0.5688 => 1.1886, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.63% (0.5575 => 1.1631, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.17% (0.5581 => 1.1618, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.93% (0.5805 => 1.2012, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.71% (0.6395 => 1.3155, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.36% (0.5941 => 1.2141, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.76% (0.5849 => 1.1918, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.51% (0.6033 => 1.2278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.31% (0.5859 => 1.1912, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.73% (0.6260 => 1.2691, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.64% (0.6189 => 1.2294, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.50% (0.5478 => 1.0874, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.61% (0.5569 => 1.1005, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.07% (0.5570 => 1.0977, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.71% (0.6440 => 1.2668, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.53% (0.5591 => 1.0988, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.43% (0.6304 => 1.2383, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.39% (0.5705 => 1.1204, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.50% (0.5802 => 1.1343, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.53% (0.6395 => 1.2440, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.44% (0.6676 => 1.2914, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.05% (0.5925 => 1.1438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.86% (0.6230 => 1.2015, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.68% (0.5857 => 1.1285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.25% (0.6052 => 1.1635, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.24% (0.5863 => 1.1271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.17% (0.6660 => 1.2732, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.68% (0.6194 => 1.1625, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.00% (0.6446 => 1.2054, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.33% (0.6297 => 1.1733, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.83% (0.6681 => 1.2215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.75% (0.6667 => 1.2117, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.19% (0.7524 => 1.3633, std.dev.: 0.0219) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.90% (0.0717 => 0.1254, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.47% (0.7339 => 1.2804, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.91% (0.0974 => 0.1577, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.67% (0.0267 => 0.0429, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.80% (0.1500 => 0.2202, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 45.73% (0.0293 => 0.0427, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.41% (0.0599 => 0.0865, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.52% (0.1132 => 0.1568, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.52% (1.6474 => 2.2326, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.41% (0.0582 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.72% (2.2587 => 2.9075, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.24% (0.0622 => 0.0779, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.73% (0.5329 => 0.6487, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.37% (0.1081 => 0.1312, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.95% (0.7021 => 0.8281, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.46% (0.4916 => 0.5676, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.32% (1.1450 => 1.3090, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.38% (4.5069 => 5.1098, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 12.20% (0.4515 => 0.5066, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.79% (0.2001 => 0.2237, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 11.62% (0.3357 => 0.3747, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.01% (1.6364 => 1.8166, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.94% (0.2385 => 0.2646, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.39% (0.1761 => 0.1944, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.36% (3.5339 => 3.9000, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.11% (1.2515 => 1.3405, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.51% (0.3319 => 0.3535, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.46% (9.2283 => 9.8248, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (1.2784 => 1.3563, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.40% (5.0226 => 5.2936, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 4.73% (0.3255 => 0.3409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.83% (0.4524 => 0.4652, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.42% (1.3864 => 1.4200, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.3722 => 1.4036, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.12% (5.4682 => 5.5839, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.76% (0.8418 => 0.8566, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 1.73% (0.6750 => 0.6867, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.72% (1.4642 => 1.4894, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.9557 => 0.9674, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.03% (22.4056 => 22.6356, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.59% (31.3723 => 55.7134, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.48% (0.9531 => 1.0244, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.42% (3.1932 => 3.3344, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 3.59% (11.6767 => 12.0954, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5135, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3663, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6551 => 3.7214, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6106, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3035, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.93% (0.1281 => 0.1141, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.49% (0.3142 => 0.3001, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.45% (0.7198 => 0.6878, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.30% (0.9852 => 0.9428, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/exceptions-3: -4.24% (0.3848 => 0.3685, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.21% (0.2871 => 0.2750, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3896 => 0.3733, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.18% (0.3831 => 0.3671, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.18% (0.3880 => 0.3718, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.17% (0.3812 => 0.3653, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.07% (0.4176 => 0.4006, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.98% (0.3016 => 0.2896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.97% (0.4033 => 0.3873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.93% (0.2903 => 0.2789, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.85% (0.3658 => 0.3517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.85% (0.2933 => 0.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.81% (1.3148 => 1.2647, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.78% (2.1713 => 2.0892, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.75% (0.9542 => 0.9184, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (0.3025 => 0.2913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.66% (0.3884 => 0.3742, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.62% (0.4199 => 0.4047, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.50% (2.4924 => 2.4051, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.50% (0.6484 => 0.6257, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.29% (0.4280 => 0.4139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.90% (0.6441 => 0.6254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.82% (0.4321 => 0.4199, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.76% (17.1032 => 16.6320, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.75% (0.3931 => 0.3823, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.70% (0.3849 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.69% (0.4427 => 0.4308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.66% (0.7919 => 0.7708, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.58% (14.2083 => 13.8411, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: -2.50% (4.3330 => 4.2245, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: -2.47% (0.4248 => 0.4143, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.39% (1.2221 => 1.1929, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.38% (1.2210 => 1.1919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.38% (0.7779 => 0.7594, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -2.34% (0.7982 => 0.7795, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.26% (1.2300 => 1.2022, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.25% (6.7716 => 6.6193, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -2.21% (16.1920 => 15.8339, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -2.01% (2.4021 => 2.3537, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.86% (7.0961 => 6.9639, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (0.8521 => 0.8368, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.77% (0.5999 => 0.5893, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -1.73% (1.5610 => 1.5340, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.63% (4.0594 => 3.9932, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.61% (34.0927 => 33.5452, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.21% (0.9179 => 0.9068, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.17% (8.0126 => 7.9186, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: -1.07% (2.1401 => 2.1173, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -1.03% (20.7746 => 20.5610, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -1.03% (15.2527 => 15.0962, std.dev.: 0.0149) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.02% (1.8100 => 0.7055, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3126, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.22% (1.3643 => 1.0339, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0635, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -23.12% (0.0757 => 0.0582, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1783, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1379, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.83% (1.0217 => 0.8804, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2806, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7823, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.24% (1.1594 => 1.0986, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1731, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.66% (7.9763 => 7.7641, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: -2.58% (3.7241 => 3.6282, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.47% (1.3096 => 1.2772, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.82% (1.6086 => 1.5794, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4642, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.56% (3.7092 => 3.6513, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.8776 => 4.8062, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.11% (1.6219 => 1.6039, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 08:58:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 10:58:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107165827.0E56E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7388?compare_to=7387&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7388, Order: 171735, Start Time: 2013-01-07 15:23:41, End Time: 2013-01-07 16:58:22 To: 7387, Order: 171730, Start Time: 2013-01-07 13:25:38, End Time: 2013-01-07 15:00:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 1 (113 on baseline) Added Tests: 0 (58 on baseline) Unchanged Tests: 1101 (821 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.12% (20.5610 => 20.1244, std.dev.: 0.0207) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.08% (0.5456 => 1.1571, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.79% (0.5567 => 1.1679, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.72% (0.5575 => 1.1692, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.46% (0.5688 => 1.1914, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.92% (0.5581 => 1.1660, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.29% (0.5805 => 1.2033, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.38% (0.6395 => 1.3198, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.88% (0.5941 => 1.2172, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.48% (0.5849 => 1.1960, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.23% (0.6033 => 1.2321, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.15% (0.5859 => 1.1961, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.56% (0.6260 => 1.2743, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.43% (0.5478 => 1.0925, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.64% (0.6189 => 1.2294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.99% (0.5570 => 1.1028, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.76% (0.5569 => 1.1013, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.50% (0.6440 => 1.2719, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.16% (0.5591 => 1.1023, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.94% (0.6304 => 1.2415, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.79% (0.5705 => 1.1227, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 96.14% (0.5802 => 1.1380, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.51% (0.6395 => 1.2503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.52% (0.6676 => 1.2986, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.49% (0.5925 => 1.1464, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.29% (0.6230 => 1.2042, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.19% (0.5863 => 1.1327, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.19% (0.5857 => 1.1315, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.56% (0.6052 => 1.1654, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.86% (0.6660 => 1.2778, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 88.19% (0.6446 => 1.2131, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.92% (0.6194 => 1.1640, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.88% (0.6297 => 1.1768, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.98% (0.6681 => 1.2225, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.24% (0.6667 => 1.2150, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.82% (0.7524 => 1.3680, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.73% (0.0717 => 0.1260, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 75.20% (0.7339 => 1.2858, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.35% (0.0974 => 0.1591, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 63.04% (0.0514 => 0.0838, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 61.05% (0.0267 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 46.08% (0.0293 => 0.0428, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 45.41% (0.0599 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 39.05% (0.1132 => 0.1574, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.68% (0.0680 => 0.0943, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.23% (0.0693 => 0.0951, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 36.09% (1.6474 => 2.2420, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.10% (0.0582 => 0.0763) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.32% (2.2587 => 2.9210, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.95% (0.0790 => 0.0995, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.64% (0.0621 => 0.0774, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.29% (0.5329 => 0.6517, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.83% (0.1081 => 0.1317, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.64% (0.7021 => 0.8330, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.19% (0.4916 => 0.5712, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.71% (1.1450 => 1.3134, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0864 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.80% (4.5069 => 5.1290, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4515 => 0.5101, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937) MultiSource/Applications/sgefa/sgefa: 12.21% (0.3357 => 0.3767, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.94% (0.2001 => 0.2240, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 11.58% (0.1761 => 0.1965, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.32% (1.6364 => 1.8216, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.28% (0.2385 => 0.2654, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.74% (3.5339 => 3.9134, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.98% (0.1441 => 0.1556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.74% (0.1731 => 0.1865) MultiSource/Applications/Burg/burg: 7.57% (1.2515 => 1.3463, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.81% (9.2283 => 9.8568, std.dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.75% (0.3319 => 0.3543, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.38% (1.2784 => 1.3600, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 6.01% (5.0226 => 5.3247, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.53% (0.3255 => 0.3435, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 3.43% (0.4524 => 0.4679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.33% (0.3394 => 0.3507, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.13% (0.3446 => 0.3554, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.98% (1.3864 => 1.4277, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (0.4861 => 0.4995, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.74% (0.4813 => 0.4945, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (5.4682 => 5.6136, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.49% (1.3722 => 1.4064, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6750 => 0.6911, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.99% (1.4642 => 1.4934, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.87% (0.9557 => 0.9736, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.82% (0.8418 => 0.8571, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.38% (22.4056 => 22.7149, std.dev.: 0.0179) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.56% (31.3723 => 55.7059, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.48% (0.9531 => 1.0149, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1932 => 3.3467, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0977, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.5751 => 56.4468, std.dev.: 0.1378) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3675, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.09% (3.6551 => 3.7314, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3030, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6094, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.62% (0.1281 => 0.1145) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3821 => 0.3639, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.62% (0.3812 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.49% (0.3831 => 0.3659, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.39% (0.3142 => 0.3004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.34% (0.3891 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.19% (0.4176 => 0.4001, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.7198 => 0.6907, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3884 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.81% (0.9852 => 0.9477, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.76% (0.4199 => 0.4041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.39% (0.4280 => 0.4135, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.31% (2.4924 => 2.4098, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -3.16% (1.3148 => 1.2732, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -3.13% (20.7746 => 20.1244, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.98% (0.9542 => 0.9258, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.85% (2.1713 => 2.1095, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.77% (0.7919 => 0.7700, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.67% (0.4151 => 0.4040, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.63% (17.1032 => 16.6528, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/Hello: -2.41% (0.6347 => 0.6194, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.38% (14.2083 => 13.8700, std.dev.: 0.0137) SingleSource/UnitTests/ObjC++/property-reference-object: -2.27% (0.6441 => 0.6295, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.22% (1.2210 => 1.1939, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.18% (1.2221 => 1.1955, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -2.17% (4.3330 => 4.2388, std.dev.: 0.0161) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.07% (6.7716 => 6.6315, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.00% (1.0544 => 1.0333, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.2300 => 1.2054, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -1.75% (16.1920 => 15.9087, std.dev.: 0.0116) SingleSource/UnitTests/ObjC++/property-reference: -1.72% (0.7779 => 0.7645, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8521 => 0.8387, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: -1.54% (7.0961 => 6.9871, std.dev.: 0.0091) MultiSource/Applications/siod/siod: -1.50% (2.4021 => 2.3661, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (0.7982 => 0.7865, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.28% (4.0594 => 4.0074, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.13% (1.5610 => 1.5434, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.09% (34.0927 => 33.7216, std.dev.: 0.0430) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.07% (8.0126 => 7.9272, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.32% (1.8100 => 0.7001, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3126, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.09% (0.1983 => 0.1426, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -24.28% (1.3643 => 1.0330, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0622, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1806, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.25% (4.3779 => 3.4036, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.18% (0.6299 => 0.5028, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -14.81% (2.5106 => 2.1389, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2797, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7818, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.24% (1.1594 => 1.0986, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3981, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.60% (7.9763 => 7.7691, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.57% (3.7241 => 3.6284, std.dev.: 0.0268) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.83% (1.6219 => 1.5923, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.76% (1.3096 => 1.2866, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8086, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4351, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 09:09:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 11:09:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107170921.37EAD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7389?compare_to=7386&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7389, Order: 171734, Start Time: 2013-01-07 14:56:00, End Time: 2013-01-07 17:09:17 To: 7386, Order: 171728, Start Time: 2013-01-07 12:12:27, End Time: 2013-01-07 14:25:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 25 (224 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (192 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1072 (598 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.41% (1.4896 => 1.5106, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.34% (1.5031 => 1.5233, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.34% (1.5874 => 1.6087, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.33% (1.5888 => 1.6099, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.32% (1.6222 => 1.6436, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.31% (1.5465 => 1.5667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.30% (1.5607 => 1.5810, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.29% (1.5539 => 1.5740, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.23% (1.5068 => 1.5254, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.23% (1.5094 => 1.5279, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.21% (1.7371 => 1.7582, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.20% (1.6342 => 1.6538, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.18% (1.5116 => 1.5294, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.18% (1.6588 => 1.6783, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.16% (1.3761 => 1.3921, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.13% (1.6398 => 1.6583, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.07% (1.4168 => 1.4320, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.06% (1.3375 => 1.3517, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.06% (1.3809 => 1.3955, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.05% (1.3220 => 1.3359, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.05% (2.3756 => 2.4005, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.04% (1.5424 => 1.5585, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.03% (1.3958 => 1.4102, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.02% (1.3725 => 1.3865, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.01% (4.4734 => 4.5186, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.39% (11.5137 => 11.3537, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.46% (0.0659 => 0.0695, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8393 => 499.7471, std.dev.: 0.0473) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44215.61% (1.1277 => 499.7471, std.dev.: 0.0473) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.44% (0.5229 => 1.6599, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 20.82% (14.9895 => 18.1102, std.dev.: 0.0191) MultiSource/Applications/kimwitu++/kc: 44.61% (14.1553 => 20.4701, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/gs/gs: 18.62% (4.1105 => 4.8760, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 59.62% (1.1048 => 1.7635, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.86% (7.1582 => 37.9283, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.34% (3.4629 => 6.4182, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.86% (0.6222 => 1.0942, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10214.86% (0.0720 => 7.4267, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3832700.00% (0.0001 => 3.8328, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11086900.00% (0.0001 => 11.0870, std.dev.: 0.0136) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908300.00% (0.0001 => 9.9084, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489400.00% (0.0001 => 5.4895, std.dev.: 0.0161) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 828.52% (1.1194 => 10.3939, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 150.49% (22.1758 => 55.5489, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/lowercase: 125.78% (0.0256 => 0.0578, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 117.28% (0.0243 => 0.0528, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.48% (0.0929 => 0.1816, std.dev.: 0.0024) SingleSource/Regression/C/sumarray2d: 88.93% (0.0271 => 0.0512, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537) MultiSource/Benchmarks/FreeBench/neural/neural: 74.78% (0.1463 => 0.2557, std.dev.: 0.0005) SingleSource/Regression/C/sumarray: 66.67% (0.0231 => 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.68% (1.5859 => 2.5641, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 61.28% (0.0439 => 0.0708, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.73% (2.9384 => 4.6346, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.94% (7.0540 => 11.0000, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.98% (2.2024 => 3.3472, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.62% (0.5105 => 0.7638, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 49.53% (0.1056 => 0.1579, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.39% (8.1363 => 12.0734, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: 46.59% (0.0279 => 0.0409) SingleSource/Benchmarks/Misc/dt: 45.66% (0.0265 => 0.0386) SingleSource/Benchmarks/CoyoteBench/almabench: 42.88% (0.0730 => 0.1043, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 42.34% (21.9371 => 31.2250, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.87% (0.6675 => 0.9470, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 39.80% (0.1432 => 0.2002, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 39.15% (0.4615 => 0.6422, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.79% (0.1062 => 0.1474, std.dev.: 0.0010) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.87% (4.2646 => 5.8797, std.dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 37.12% (0.3109 => 0.4263, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 36.31% (0.1655 => 0.2256, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.17% (1.5415 => 2.0682, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.55% (0.2271 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.21% (0.1906 => 0.2539, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 32.68% (0.4299 => 0.5704, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.54% (0.1337 => 0.1772, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 31.37% (1.1642 => 1.5294, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.32% (0.0479 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 28.17% (0.1555 => 0.1993, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.97% (0.3121 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.91% (0.1125 => 0.1439, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 27.35% (0.0746 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.27% (0.1584 => 0.2016, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.91% (0.0457 => 0.0580, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 26.30% (0.1175 => 0.1484, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 26.27% (0.2554 => 0.3225, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.25% (0.1143 => 0.1443, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.16% (3.8922 => 4.9105, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.84% (0.1695 => 0.2133, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 25.73% (5.7591 => 7.2408, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 25.26% (1.0722 => 1.3430, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.71% (0.1566 => 0.1953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.65% (1.4186 => 1.7683, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 24.39% (9.4845 => 11.7982, std.dev.: 0.0143) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.75% (0.0842 => 0.1042, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.70% (0.2700 => 0.3340, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.70% (0.0730 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.07% (1.3050 => 1.6061, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 22.84% (0.7115 => 0.8740, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 22.53% (0.1163 => 0.1425, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 22.42% (0.0660 => 0.0808, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.97% (0.7835 => 0.9556, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 21.95% (0.1695 => 0.2067, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.61% (0.1032 => 0.1255, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.58% (0.0871 => 0.1059, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.43% (0.3098 => 0.3762, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.40% (4.9449 => 6.0031, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.13% (0.1940 => 0.2350, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 20.79% (1.1840 => 1.4301, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.60% (0.1029 => 0.1241, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.60% (0.4636 => 0.5591, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.53% (5.0018 => 6.0287, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.31% (0.5860 => 0.7050, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.22% (0.8172 => 0.9824, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 19.69% (0.6456 => 0.7727, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 19.59% (3.3354 => 3.9887, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.24% (0.5020 => 0.5986, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 18.98% (0.4289 => 0.5103, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.75% (0.2107 => 0.2502, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 18.66% (0.7433 => 0.8820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.63% (0.3307 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 18.59% (0.2049 => 0.2430, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 18.48% (0.4620 => 0.5474, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.24% (0.5569 => 0.6585, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.17% (0.1117 => 0.1320, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 18.14% (0.3423 => 0.4044, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.07% (0.9765 => 1.1530, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.92% (0.0770 => 0.0908, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.82% (0.2065 => 0.2433, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 17.71% (3.8723 => 4.5579, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: 17.50% (2.0273 => 2.3821, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 17.23% (0.3232 => 0.3789, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.09% (0.5981 => 0.7003, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.93% (0.6450 => 0.7542, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.78% (0.8101 => 0.9460, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.71% (0.0838 => 0.0978, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.68% (2.2969 => 2.6800, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 16.25% (0.8921 => 1.0371, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 15.69% (0.3180 => 0.3679, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.56% (1.1861 => 1.3707, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.28% (0.0759 => 0.0875, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.99% (0.8067 => 0.9276, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3379 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.41% (0.2603 => 0.2978, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 14.00% (1.5603 => 1.7788, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.89% (0.3865 => 0.4402, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 13.70% (0.3387 => 0.3851, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 13.09% (0.3927 => 0.4441, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.87% (0.3886 => 0.4386, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.80% (0.4103 => 0.4628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 12.77% (0.3282 => 0.3701, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.63% (0.1330 => 0.1498, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.51% (0.4203 => 0.4729, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.30% (0.4048 => 0.4546, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.00% (0.3092 => 0.3463, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 11.94% (0.3543 => 0.3966, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.91% (0.3543 => 0.3965, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 11.87% (0.3497 => 0.3912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.80% (0.3516 => 0.3931, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.74% (17.1811 => 19.1977, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/lists: 11.60% (0.3422 => 0.3819, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 11.54% (0.3684 => 0.4109, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.53% (14.3668 => 16.0236, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.17% (0.4064 => 0.4518, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.13% (0.3826 => 0.4252, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.00% (0.3427 => 0.3804, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2831 => 0.3123, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.15% (0.1438 => 0.1584, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.14% (0.1114 => 0.1227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.10% (0.2871 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.99% (0.1892 => 0.2081, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.56% (2.0665 => 2.2640, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 9.51% (10.3673 => 11.3537, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: 9.49% (63.2438 => 69.2432, std.dev.: 0.0312) SingleSource/Regression/C++/ofstream_ctor: 9.33% (0.2905 => 0.3176, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.00% (2.2022 => 2.4005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.96% (0.3650 => 0.3977, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.94% (1.2842 => 1.3990, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.93% (0.2756 => 0.3002, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7326 => 0.7979, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.90% (0.2877 => 0.3133, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.74% (0.2793 => 0.3037, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3162 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.13% (0.3052 => 0.3300, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.4879 => 0.5264, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3817 => 0.3984, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.26% (7.9617 => 8.2210, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.20% (32.5116 => 59.2348, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.96% (1.1145 => 1.2924, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3291, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.60% (4.2280 => 4.4647, std.dev.: 0.0079) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.03% (3.1578 => 3.3166, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.81% (3.6395 => 3.7780, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.63% (2.0360 => 2.1099, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9071, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2461, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2191, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4508, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.44% (6.6874 => 0.1711, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.44% (5.2763 => 1.1901, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.78% (0.8651 => 0.2182, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.10% (5.3855 => 4.5186, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.77% (5.3526 => 4.5086, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -12.22% (10.4361 => 9.1610, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.58% (1.7609 => 1.6275, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -7.51% (54.1659 => 50.0958, std.dev.: 0.0645) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.36% (1.9577 => 0.6586, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3065, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.65% (1.5373 => 1.0200, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4233, std.dev.: 0.0290) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7784, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.36% (2.6546 => 2.0080, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.26% (2.5528 => 2.1378, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -11.25% (1.2373 => 1.0981, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4912, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.21% (0.9540 => 0.8661, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2826, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.53% (0.2497 => 0.2359, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.39% (10.2830 => 9.8318, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.10% (8.1563 => 7.8219, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9574, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.60% (3.7221 => 3.6625, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.31% (3.6994 => 3.6509, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2298, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.16% (0.2116 => 0.0695, std.dev.: 0.0008) Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 10:33:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 12:33:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107183328.1670E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7390?compare_to=7385&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7390, Order: 171734, Start Time: 2013-01-07 14:59:46, End Time: 2013-01-07 18:33:23 To: 7385, Order: 171716, Start Time: 2013-01-07 10:32:59, End Time: 2013-01-07 14:06:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (192 on baseline) Unchanged Tests: 1100 (709 on baseline) Total Tests: 1102 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 29.72% (57.7610 => 74.9263, std.dev.: 0.0338) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.14% (54.2215 => 54.8374, std.dev.: 0.0567) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.96% (0.2969 => 0.3799, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.36% (0.4139 => 0.5230, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.07% (0.5900 => 0.7438, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.42% (0.4253 => 0.5334, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.69% (0.1620 => 0.2020, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.43% (0.4994 => 0.6214, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.00% (0.5000 => 0.6200, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.42% (1.5932 => 1.9664, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 23.10% (0.0948 => 0.1167, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.67% (0.1107 => 0.1358, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.13% (0.1604 => 0.1959, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.05% (0.1619 => 0.1976, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.89% (0.1549 => 0.1888, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.62% (0.3903 => 0.4747, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.22% (0.0947 => 0.1148, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 20.20% (0.1218 => 0.1464, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.13% (0.1088 => 0.1307, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.96% (0.4029 => 0.4833, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.86% (0.2014 => 0.2414, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.77% (0.1462 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.38% (0.3890 => 0.4644, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.2736 => 0.3266, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 19.18% (0.0808 => 0.0963, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.12% (0.5826 => 0.6940, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.05% (0.2866 => 0.3412, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.85% (0.5889 => 0.6999, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.34% (0.3271 => 0.3871, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 18.21% (0.5546 => 0.6556, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.16% (1.3152 => 1.5541, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 18.09% (1.8794 => 2.2193, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.01% (3.5627 => 4.2043, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.84% (0.1968 => 0.2319, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.82% (0.4658 => 0.5488, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.77% (1.6211 => 1.9091, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.22% (0.2875 => 0.3370, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: 17.18% (0.9697 => 1.1363, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.11% (4.4195 => 5.1757, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 16.98% (0.2750 => 0.3217, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.86% (0.7171 => 0.8380, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.79% (0.3930 => 0.4590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.74% (0.2813 => 0.3284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.65% (0.2792 => 0.3257, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.63% (0.2911 => 0.3395, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 16.61% (0.2823 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.49% (0.4361 => 0.5080, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/except: 16.40% (0.2811 => 0.3272, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.38% (2.0673 => 2.4060, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.37% (0.2780 => 0.3235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.36% (0.2738 => 0.3186, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 16.31% (0.3004 => 0.3494, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.29% (0.2714 => 0.3156, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.23% (1.9694 => 2.2890, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 16.23% (0.9909 => 1.1517, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.18% (0.3195 => 0.3712, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1689, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 16.01% (0.3267 => 0.3790, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.99% (1.9966 => 2.3159, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 15.92% (0.3096 => 0.3589, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 15.84% (0.3258 => 0.3774, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.84% (4.2109 => 4.8777, std.dev.: 0.0072) MultiSource/Applications/d/make_dparser: 15.82% (1.0781 => 1.2487, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 15.76% (23.5202 => 27.2280, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.69% (0.3060 => 0.3540, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3465 => 0.4006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.60% (0.3488 => 0.4032, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 15.52% (0.3678 => 0.4249, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3446 => 0.3979, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 15.44% (0.3477 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.44% (0.3362 => 0.3881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.44% (0.3317 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.43% (0.3124 => 0.3606, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.40% (0.3442 => 0.3972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.39% (0.3469 => 0.4003, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.36% (0.3496 => 0.4033, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 15.17% (0.3348 => 0.3856, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.06% (0.3625 => 0.4171, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 15.06% (0.3726 => 0.4287, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 15.01% (0.3650 => 0.4198, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.91% (0.3643 => 0.4186, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.90% (0.3724 => 0.4279, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 14.84% (1.4269 => 1.6387, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.67% (0.3981 => 0.4565, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.61% (0.4251 => 0.4872, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.58% (0.3690 => 0.4228, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.52% (0.4146 => 0.4748, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 14.50% (0.2566 => 0.2938, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 14.19% (0.5012 => 0.5723, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.3845 => 0.4390, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.71% (0.6435 => 0.7317, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.15% (0.2737 => 0.3097, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.78% (2.1653 => 2.4420, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 12.74% (5.5417 => 6.2475, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 12.60% (4.6177 => 5.1996, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: 12.58% (0.2075 => 0.2336, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 12.34% (2.1013 => 2.3607, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.27% (11.6398 => 13.0677, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.58% (0.5361 => 0.5982, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 11.44% (0.3498 => 0.3898, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.39% (0.3336 => 0.3716, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.32% (0.2103 => 0.2341, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.97% (0.6634 => 0.7362, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.49% (0.2040 => 0.2254, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.38% (4.6926 => 5.1799, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.21% (0.7426 => 0.8184, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.83% (0.5584 => 0.6077, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 8.45% (0.2391 => 0.2593, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.24% (0.1383 => 0.1497, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 8.06% (2.0346 => 2.1985, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.78% (11.9555 => 12.8862, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.01% (0.3792 => 0.4020, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.64% (29.0505 => 181.4612, std.dev.: 0.0400) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.26% (0.3693 => 0.4035, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 5.89% (0.2122 => 0.2247, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2418, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8936, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6735, std.dev.: 0.0088) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1928, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2894, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3001, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0803, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5853, std.dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.18% (2.4764 => 2.4473, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5799, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8689, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.98% (17.2379 => 14.3116, std.dev.: 0.1724) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1015, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8018, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -5.04% (14.0481 => 13.3399, std.dev.: 0.1999) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2254, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8109, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1256, std.dev.: 0.0588) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5684, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7161, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1717, std.dev.: 0.0381) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (16.2163 => 16.0506, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 10:57:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 12:57:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107185712.C17F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7391?compare_to=7388&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7391, Order: 171755, Start Time: 2013-01-07 17:21:49, End Time: 2013-01-07 18:57:07 To: 7388, Order: 171735, Start Time: 2013-01-07 15:23:41, End Time: 2013-01-07 16:58:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (108 on baseline) Added Tests: 2 (60 on baseline) Unchanged Tests: 1102 (822 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/SmallPT/smallpt Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/SmallPT/smallpt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.99% (0.5456 => 1.1621, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 110.51% (0.5567 => 1.1719, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 110.36% (0.5688 => 1.1965, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 110.35% (0.5575 => 1.1727, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 109.77% (0.5581 => 1.1707, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.98% (0.5805 => 1.2073, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 107.22% (0.6395 => 1.3252, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 105.77% (0.5941 => 1.2225, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 105.18% (0.5849 => 1.2001, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 105.04% (0.6033 => 1.2370, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.97% (0.5859 => 1.2009, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 104.14% (0.6260 => 1.2779, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 100.02% (0.5478 => 1.0957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 99.31% (0.6189 => 1.2335, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 98.87% (0.5570 => 1.1077, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.62% (0.5569 => 1.1061, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 98.11% (0.6440 => 1.2758, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.96% (0.5591 => 1.1068, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 97.68% (0.6304 => 1.2462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 97.60% (0.5705 => 1.1273, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 96.76% (0.5802 => 1.1416, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 96.23% (0.6395 => 1.2549, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 95.07% (0.6676 => 1.3023, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 94.26% (0.5925 => 1.1510, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 94.06% (0.6230 => 1.2090, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 94.01% (0.5857 => 1.1363, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.81% (0.5863 => 1.1363, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 93.29% (0.6052 => 1.1698, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 92.66% (0.6660 => 1.2831, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 88.92% (0.6446 => 1.2178, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.65% (0.6194 => 1.1685, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 87.72% (0.6297 => 1.1821, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 84.00% (0.6681 => 1.2293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.99% (0.6667 => 1.2200, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 82.44% (0.7524 => 1.3727, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 81.07% (0.0280 => 0.0507, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 76.43% (0.0717 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 75.68% (0.7339 => 1.2893, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/lpbench: 64.07% (0.0974 => 0.1598, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 64.01% (0.0514 => 0.0843) SingleSource/Regression/C/sumarraymalloc: 61.42% (0.0267 => 0.0431) SingleSource/UnitTests/SignlessTypes/factor: 54.92% (0.0315 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 47.87% (0.1500 => 0.2218, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 46.76% (0.0293 => 0.0430, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 46.08% (0.0599 => 0.0875, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 39.66% (0.1132 => 0.1581, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 39.26% (0.0680 => 0.0947, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.81% (0.0693 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 36.58% (1.6474 => 2.2501, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 35.06% (0.0445 => 0.0601, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.62% (0.0582 => 0.0766, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.82% (2.2587 => 2.9323, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.90% (0.0699 => 0.0894, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.46% (0.0790 => 0.0999, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 26.37% (0.0622 => 0.0786, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 25.76% (0.0621 => 0.0781, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.82% (0.5329 => 0.6545, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.29% (0.1081 => 0.1322, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.01% (0.7021 => 0.8356, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.09% (0.4916 => 0.5707, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 14.47% (0.0864 => 0.0989, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.19% (4.5069 => 5.1466, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 13.36% (0.4515 => 0.5118, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.97% (0.0833 => 0.0941, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 12.51% (0.3357 => 0.3777, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.44% (0.2001 => 0.2250, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.78% (0.2385 => 0.2666, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.70% (1.6364 => 1.8279, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 11.70% (0.1761 => 0.1967, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.45% (3.5339 => 3.9387, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.09% (0.1731 => 0.1871, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 7.89% (1.2515 => 1.3502, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 7.18% (9.2283 => 9.8911, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.11% (0.3319 => 0.3555, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 6.43% (5.0226 => 5.3455, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/ReedSolomon: 6.23% (0.1879 => 0.1996, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.3255 => 0.3447, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.83% (0.3394 => 0.3524, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 3.23% (0.4524 => 0.4670, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 3.15% (0.4861 => 0.5014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (5.4682 => 5.6395, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 3.09% (1.3864 => 1.4292, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.01% (0.4813 => 0.4958, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.92% (1.3722 => 1.4123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.32% (1.4642 => 1.4982, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.20% (0.9557 => 0.9767, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.01% (0.8418 => 0.8587, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.84% (0.7447 => 0.7584, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.81% (22.4056 => 22.8111, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 1.28% (15.5079 => 15.7057, std.dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 1.10% (1.1530 => 1.1657, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.02% (4.8161 => 4.8653, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.56% (31.3723 => 55.7061, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.33% (0.9531 => 1.0230, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.66% (3.1932 => 3.3420, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0994, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3813, std.dev.: 0.1531) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3666, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6551 => 3.7243, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3039, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6094, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (79.7170 => 80.6363, std.dev.: 0.3326) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.30% (0.1281 => 0.1149, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.12% (0.3837 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.7198 => 0.6907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3812 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.87% (0.3848 => 0.3699, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3831 => 0.3683, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3880 => 0.3732, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3884 => 0.3736, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3896 => 0.3749, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.70% (0.3891 => 0.3747, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -3.57% (0.4033 => 0.3889, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.46% (0.9852 => 0.9511, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.20% (0.3658 => 0.3541, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.10% (0.4199 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.02% (20.7746 => 20.1464, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.02% (0.6484 => 0.6288, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -2.94% (2.4924 => 2.4191, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.9542 => 0.9275, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.77% (1.3148 => 1.2784, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -2.73% (0.4280 => 0.4163, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.73% (2.1713 => 2.1120, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -2.52% (17.1032 => 16.6720, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.48% (0.4151 => 0.4048, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.46% (0.6347 => 0.6191, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.35% (0.7919 => 0.7733, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -2.20% (0.6441 => 0.6299, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9252, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.84% (1.2210 => 1.1985, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.82% (1.2221 => 1.1999, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -1.70% (0.7779 => 0.7647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.64% (1.0544 => 1.0371, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -1.64% (4.3330 => 4.2620, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.57% (1.2300 => 1.2107, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (0.7982 => 0.7857, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6726, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -1.40% (16.1920 => 15.9656, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.31% (0.8521 => 0.8409, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -1.18% (2.4021 => 2.3737, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (7.0961 => 7.0147, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: -1.03% (1.5610 => 1.5449, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.27% (1.8100 => 0.7010, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.07% (6.6713 => 3.3975, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0610, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary: -22.59% (0.0757 => 0.0586, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.56% (4.1024 => 3.1768, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4046, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1379, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2795, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1983, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8717, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.94% (1.1594 => 1.0905, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fbench: -4.19% (2.2633 => 2.1684, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0593, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.08% (1.0557 => 1.0232, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.62% (3.7241 => 3.6267, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7749, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.3096 => 1.2848, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4623, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.8776 => 4.8004, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.55% (1.6086 => 1.5837, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.34% (3.7092 => 3.6594, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -1.10% (1.4516 => 1.4357, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 11:53:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 13:53:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107195350.78A042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7392?compare_to=7389&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7392, Order: 171757, Start Time: 2013-01-07 17:39:41, End Time: 2013-01-07 19:53:42 To: 7389, Order: 171734, Start Time: 2013-01-07 14:56:00, End Time: 2013-01-07 17:09:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (220 on baseline) Performance Improvements: 3 (66 on baseline) Added Tests: 2 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (603 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.25% (1.7788 => 1.7565, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.18% (1.5740 => 1.5555, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.06% (1.5651 => 1.5485, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/SmallPT/smallpt Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/SmallPT/smallpt Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.87% (0.0695 => 0.0682, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7471 => 499.8406, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.90% (1.1277 => 499.8406, std.dev.: 0.0066) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.12% (0.5229 => 1.6530, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 20.16% (14.9895 => 18.0113, std.dev.: 0.0167) MultiSource/Applications/kimwitu++/kc: 43.82% (14.1553 => 20.3587, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/gs/gs: 18.39% (4.1105 => 4.8665, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 59.01% (1.1048 => 1.7567, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.88% (7.1582 => 37.7152, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.68% (3.4629 => 6.3952, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.94% (0.6222 => 1.0885, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10218.06% (0.0720 => 7.4290, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 3832600.00% (0.0001 => 3.8327, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11091000.00% (0.0001 => 11.0911, std.dev.: 0.0510) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487300.00% (0.0001 => 5.4874, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 830.06% (1.1194 => 10.4111, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 150.57% (22.1758 => 55.5650, std.dev.: 0.0281) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 116.05% (0.0243 => 0.0525, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.73% (0.0929 => 0.1809, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 87.82% (0.0271 => 0.0509, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.89% (0.1463 => 0.2544, std.dev.: 0.0006) SingleSource/Regression/C/sumarray: 65.80% (0.0231 => 0.0383) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.21% (1.5859 => 2.5566, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.14% (0.0439 => 0.0703, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.81% (2.9384 => 4.6370, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.22% (7.0540 => 10.9494, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.48% (2.2024 => 3.3362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 50.00% (0.0232 => 0.0348, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.15% (0.5105 => 0.7614, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.66% (8.1363 => 12.0137, std.dev.: 0.0086) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: 44.15% (0.0265 => 0.0382, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 41.54% (21.9371 => 31.0497, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.42% (0.6675 => 0.9440, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.85% (0.4615 => 0.6362, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0008) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.12% (4.2646 => 5.8478, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 36.54% (0.3109 => 0.4245, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 36.24% (0.0814 => 0.1109, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 35.71% (0.1655 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.62% (1.5415 => 2.0598, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.98% (0.2271 => 0.3020, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 32.89% (0.4299 => 0.5713, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.27% (0.1906 => 0.2521, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.86% (0.1337 => 0.1763, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.52% (0.0479 => 0.0630, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 30.72% (1.1642 => 1.5218, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.09% (0.1584 => 0.2029, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.53% (0.0730 => 0.0931, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.30% (0.3121 => 0.3973, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.07% (0.1143 => 0.1441, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.8922 => 4.9040, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 25.49% (0.2554 => 0.3205, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.43% (0.1695 => 0.2126, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 25.42% (5.7591 => 7.2230, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 24.82% (1.0722 => 1.3383, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.41% (1.4186 => 1.7649, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 23.72% (9.4845 => 11.7344, std.dev.: 0.0201) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.26% (0.1032 => 0.1272, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.15% (0.2700 => 0.3325, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.57% (0.0842 => 0.1032, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 22.52% (0.7115 => 0.8717, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.44% (1.3050 => 1.5978, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/em3d/em3d: 21.83% (0.1695 => 0.2065, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 21.81% (0.1151 => 0.1402, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 21.75% (0.1163 => 0.1416, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.47% (0.7835 => 0.9517, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.22% (0.0886 => 0.1074, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.85% (4.9449 => 5.9760, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 20.53% (0.3098 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 20.46% (1.1840 => 1.4262, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.00% (5.0018 => 6.0022, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.57% (0.5860 => 0.7007, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.52% (0.8172 => 0.9767, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.48% (0.1940 => 0.2318, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.37% (0.4636 => 0.5534, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 19.06% (3.3354 => 3.9710, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 18.97% (0.6456 => 0.7681, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 18.84% (0.3423 => 0.4068, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.51% (0.5020 => 0.5949, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 18.37% (0.4289 => 0.5077, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.22% (0.2107 => 0.2491, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.17% (0.5569 => 0.6581, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 18.01% (0.2049 => 0.2418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.92% (0.2065 => 0.2435, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 17.77% (0.7433 => 0.8754, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash2: 17.71% (0.4620 => 0.5438, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.69% (0.3307 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.59% (0.9765 => 1.1483, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.08% (3.8723 => 4.5335, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.98% (2.0273 => 2.3715, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.77% (0.5981 => 0.6984, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 16.49% (0.3232 => 0.3765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 16.40% (0.8921 => 1.0384, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.30% (0.3441 => 0.4002, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.6450 => 0.7500, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.23% (0.8101 => 0.9416, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.23% (0.0838 => 0.0974, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.20% (0.3283 => 0.3815, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.13% (2.2969 => 2.6674, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 15.35% (0.3180 => 0.3668, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.70% (1.1861 => 1.3605, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.58% (0.8067 => 0.9243, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.94% (0.3379 => 0.3850, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 13.85% (0.3387 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.09% (0.3865 => 0.4371, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 12.57% (1.5603 => 1.7565, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.26% (0.1330 => 0.1493, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.16% (0.4103 => 0.4602, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 12.04% (0.3282 => 0.3677, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.73% (0.4203 => 0.4696, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.68% (0.3886 => 0.4340, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.51% (0.3092 => 0.3448, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.44% (0.2430 => 0.2708, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 11.44% (0.4048 => 0.4511, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 11.28% (17.1811 => 19.1199, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sieve: 11.19% (0.3603 => 0.4006, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.11% (14.3668 => 15.9627, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.94% (0.3427 => 0.3802, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.90% (0.3422 => 0.3795, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.85% (0.3826 => 0.4241, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 10.80% (0.3684 => 0.4082, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.68% (0.1114 => 0.1233, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.48% (0.4064 => 0.4490, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.94% (0.1892 => 0.2080, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 9.69% (10.3673 => 11.3720, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.67% (0.1438 => 0.1577, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.47% (0.2831 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.13% (0.2871 => 0.3133, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.98% (63.2438 => 68.9261, std.dev.: 0.0510) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1625 => 0.1768, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.76% (2.0665 => 2.2475, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 8.71% (1.2842 => 1.3961, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.56% (2.2022 => 2.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.54% (0.2905 => 0.3153, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.13% (0.2891 => 0.3126, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 8.08% (0.5925 => 0.6404, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.06% (0.2756 => 0.2978, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.05% (0.3650 => 0.3944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.99% (0.2877 => 0.3107, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.84% (0.2793 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.78% (0.3136 => 0.3380, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 7.63% (0.2714 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.60% (0.3935 => 0.4234, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.42% (0.2802 => 0.3010, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.31% (0.3052 => 0.3275, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.11% (0.4879 => 0.5226, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.21% (0.2266 => 0.2384, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.20% (0.3817 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (7.9617 => 8.1727, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2427, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.20% (1.1145 => 1.2950, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6956, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3296, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0597, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4510, std.dev.: 0.0112) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3142, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.78% (3.6395 => 3.7770, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.62% (2.0360 => 2.1098, std.dev.: 0.0081) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.97% (8.6802 => 8.9383, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2447, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 1.14% (1.4460 => 1.4625, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.48% (5.2763 => 1.1880, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.79% (5.3855 => 4.4815, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.24% (5.3526 => 4.4834, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -12.44% (10.4361 => 9.1382, std.dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9211, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.74% (1.7609 => 1.6246, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.59% (1.9577 => 0.6541, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3076, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.42% (1.5373 => 1.0236, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4205, std.dev.: 0.0266) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7803, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0040, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.06% (0.0757 => 0.0590, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.12% (0.6223 => 0.5033, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.28% (2.5528 => 2.1373, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4945, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.26% (0.9540 => 0.8657, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3009, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5794, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8365, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.03% (8.1563 => 7.8277, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1558, std.dev.: 0.0116) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3298, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.48% (3.6994 => 3.6447, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary3: -1.32% (3.7221 => 3.6731, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout/lists: -1.28% (6.2999 => 6.2194, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.77% (0.2116 => 0.0682, std.dev.: 0.0025) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 12:56:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 14:56:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107205603.9647E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7393?compare_to=7391&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7393, Order: 171763, Start Time: 2013-01-07 19:20:30, End Time: 2013-01-07 20:55:48 To: 7391, Order: 171755, Start Time: 2013-01-07 17:21:49, End Time: 2013-01-07 18:57:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 16 (139 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1087 (803 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.07% (1.0225 => 1.0334, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/exceptions-2: -2.72% (0.3683 => 0.3583, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.70% (0.3736 => 0.3635, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -2.57% (0.3889 => 0.3789, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.56% (0.4069 => 0.3965, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.43% (0.4163 => 0.4062, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.40% (0.6299 => 0.6148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.31% (0.6191 => 0.6048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.13% (0.7647 => 0.7484, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.07% (2.1120 => 2.0683, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.77% (33.8668 => 33.2664, std.dev.: 0.0239) MultiSource/Applications/hexxagon/hexxagon: -1.71% (1.2784 => 1.2565, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -1.49% (0.6934 => 0.6831, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: -1.14% (18.2896 => 18.0804, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.09% (0.9767 => 0.9661, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.05% (4.2620 => 4.2172, std.dev.: 0.0168) MultiSource/Applications/hbd/hbd: -1.04% (1.5449 => 1.5288, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.13% (0.5456 => 1.1574, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.83% (0.5567 => 1.1681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.44% (0.5688 => 1.1913, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.42% (0.5575 => 1.1675, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.98% (0.5581 => 1.1663, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.32% (0.5805 => 1.2035, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.19% (0.6395 => 1.3186, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.80% (0.5941 => 1.2167, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.26% (0.5849 => 1.1947, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.18% (0.5859 => 1.1963, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.14% (0.6033 => 1.2316, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.35% (0.6260 => 1.2730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.67% (0.5478 => 1.0883, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.64% (0.6189 => 1.2294, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.54% (0.5570 => 1.1003, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.31% (0.5569 => 1.0988, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.28% (0.6440 => 1.2705, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 97.08% (0.6304 => 1.2424, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.83% (0.5591 => 1.1005, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.58% (0.5705 => 1.1215, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.73% (0.5802 => 1.1356, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.84% (0.6395 => 1.2460, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.26% (0.6676 => 1.2969, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.89% (0.5925 => 1.1429, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.84% (0.6230 => 1.2014, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.68% (0.5863 => 1.1297, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.47% (0.5857 => 1.1273, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.00% (0.6052 => 1.1620, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.65% (0.6660 => 1.2764, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.79% (0.6446 => 1.2105, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.52% (0.6194 => 1.1615, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.37% (0.6297 => 1.1736, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.64% (0.6681 => 1.2202, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.84% (0.7524 => 1.3682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.84% (0.6667 => 1.2123, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.45% (0.0717 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.64% (0.7339 => 1.2817, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.83% (0.0974 => 0.1586, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 60.67% (0.0267 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.87% (0.1500 => 0.2203, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 46.42% (0.0293 => 0.0429) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.91% (0.0599 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 38.96% (0.1132 => 0.1573, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.80% (0.0693 => 0.0948, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.61% (1.6474 => 2.2341, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.16% (0.0445 => 0.0597, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.41% (0.0582 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.82% (2.2587 => 2.9097, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.08% (0.0622 => 0.0778, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.77% (0.5329 => 0.6489, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.28% (0.1081 => 0.1311, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.20% (0.7021 => 0.8299, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.34% (0.4916 => 0.5670, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.29% (1.1450 => 1.3086, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.39% (4.5069 => 5.1105, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 11.62% (0.3357 => 0.3747, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.06% (1.6364 => 1.8174, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.68% (0.1761 => 0.1949, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.50% (3.5339 => 3.9049, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.98% (1.2515 => 1.3388, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 6.70% (9.2283 => 9.8462, std.dev.: 0.0156) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.27% (0.3319 => 0.3527, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.2784 => 1.3577, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.46% (5.0226 => 5.2968, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 3.75% (0.3255 => 0.3377, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.62% (1.3864 => 1.4227, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.28% (1.3722 => 1.4035, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (5.4682 => 5.5838, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.48% (1.4642 => 1.4859, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.43% (0.8418 => 0.8538, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.09% (0.9557 => 0.9661, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (22.4056 => 22.6405, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7007, std.dev.: 0.0248) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.29% (0.9531 => 1.0226, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.41% (3.1932 => 3.3339, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0977, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4821, std.dev.: 0.1290) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3676, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.19% (2.0478 => 2.1132, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6551 => 3.7228, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3031, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6079, std.dev.: 0.0094) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.77% (0.1281 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.95% (0.3194 => 0.2972, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.47% (0.3831 => 0.3583, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.41% (0.3884 => 0.3635, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -6.39% (0.3880 => 0.3632, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -6.31% (0.3896 => 0.3650, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -6.24% (0.3848 => 0.3608, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.12% (0.3891 => 0.3653, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -6.05% (0.4033 => 0.3789, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.84% (0.4176 => 0.3932, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.57% (0.4199 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.04% (0.3016 => 0.2864, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.87% (0.2939 => 0.2796, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.86% (0.3026 => 0.2879, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.74% (2.1713 => 2.0683, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: -4.71% (0.6347 => 0.6048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.55% (0.6441 => 0.6148, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.43% (1.3148 => 1.2565, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: -4.25% (0.2989 => 0.2862, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.20% (0.3142 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.07% (0.3658 => 0.3509, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.05% (0.4151 => 0.3983, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.87% (0.9852 => 0.9471, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.55% (0.6484 => 0.6254, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -3.54% (0.3867 => 0.3730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.52% (0.4321 => 0.4169, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.34% (0.4248 => 0.4106, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.31% (0.9542 => 0.9226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3788 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.25% (0.3849 => 0.3724, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -3.16% (2.4924 => 2.4136, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.04% (0.7919 => 0.7678, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -3.04% (20.7746 => 20.1433, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.82% (0.4083 => 0.3968, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -2.76% (0.7982 => 0.7762, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.73% (17.1032 => 16.6363, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/gs/gs: -2.67% (4.3330 => 4.2172, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.57% (14.2083 => 13.8438, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.49% (1.2221 => 1.1917, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -2.42% (34.0927 => 33.2664, std.dev.: 0.0239) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.41% (1.2210 => 1.1916, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.41% (6.7716 => 6.6086, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.40% (1.0544 => 1.0291, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.39% (1.2300 => 1.2006, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -2.17% (2.4021 => 2.3500, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -2.06% (1.5610 => 1.5288, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -2.03% (16.1920 => 15.8630, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8521 => 0.8352, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -1.76% (7.0961 => 6.9709, std.dev.: 0.0123) MultiSource/Applications/lua/lua: -1.61% (4.0594 => 3.9941, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.41% (8.0126 => 7.9000, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: -1.31% (2.1401 => 2.1120, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9077 => 0.8964, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -1.16% (18.2933 => 18.0804, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: -1.13% (15.2527 => 15.0796, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: -1.11% (0.9179 => 0.9077, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.95% (1.8100 => 0.6887, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.25% (1.3643 => 1.0334, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.57% (4.3504 => 3.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0613, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.15% (5.3397 => 4.1034, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1788, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.24% (4.3779 => 3.4044, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.15% (0.6299 => 0.5030, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1379, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1988, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7815, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8712, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.30% (1.1594 => 1.0979, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.36% (1.0557 => 1.0202, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.63% (7.9763 => 7.7669, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: -2.36% (3.7241 => 3.6361, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.86% (1.6086 => 1.5786, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.66% (1.3096 => 1.2879, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.44% (4.8776 => 4.8075, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -1.19% (1.4516 => 1.4343, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6043, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.06% (1.0443 => 1.0332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 14:37:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 16:37:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130107223758.A2FCC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7394?compare_to=7392&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7394, Order: 171780, Start Time: 2013-01-07 20:24:24, End Time: 2013-01-07 22:37:54 To: 7392, Order: 171757, Start Time: 2013-01-07 17:39:41, End Time: 2013-01-07 19:53:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (610 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.44% (0.6541 => 0.6766, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.59% (55.1292 => 56.5591, std.dev.: 0.0883) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.96% (11.3720 => 11.1488, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1338 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (0.0682 => 0.0698, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8406 => 499.8219, std.dev.: 0.0162) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44222.24% (1.1277 => 499.8219, std.dev.: 0.0162) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.28% (0.5229 => 1.6486, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 19.42% (14.9895 => 17.9006, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 42.93% (14.1553 => 20.2324, std.dev.: 0.0272) MultiSource/Benchmarks/MallocBench/gs/gs: 17.34% (4.1105 => 4.8233, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.04% (1.1048 => 1.7460, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.99% (7.1582 => 37.5084, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.31% (3.4629 => 6.3477, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.28% (0.6222 => 1.0844, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10211.39% (0.0720 => 7.4242, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 3832100.00% (0.0001 => 3.8322, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11082900.00% (0.0001 => 11.0830, std.dev.: 0.0414) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574400.00% (0.0001 => 0.5745, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908200.00% (0.0001 => 9.9083, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487100.00% (0.0001 => 5.4872, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.91% (1.1194 => 10.3758, std.dev.: 0.0124) MultiSource/Applications/ClamAV/clamscan: 149.81% (22.1758 => 55.3984, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0013) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0243 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.76% (0.0929 => 0.1800, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 85.98% (0.0271 => 0.0504, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.73% (0.0296 => 0.0532, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 73.07% (0.1463 => 0.2532, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.44% (1.5859 => 2.5444, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.45% (0.0439 => 0.0700, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 58.44% (0.0231 => 0.0366, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.40% (2.9384 => 4.6251, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.55% (7.0540 => 10.9019, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 50.71% (2.2024 => 3.3193, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.05% (0.5105 => 0.7558, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/distray/distray: 47.44% (0.1056 => 0.1557, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.94% (8.1363 => 11.9554, std.dev.: 0.0144) SingleSource/UnitTests/Vector/multiplies: 45.52% (0.0279 => 0.0406) SingleSource/Benchmarks/Misc/dt: 43.40% (0.0265 => 0.0380, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 42.12% (21.9371 => 31.1774, std.dev.: 0.0224) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.52% (0.6675 => 0.9380, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.20% (0.4615 => 0.6332, std.dev.: 0.0018) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.36% (4.2646 => 5.8151, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 35.90% (0.3109 => 0.4225, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 35.75% (0.0814 => 0.1105, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 35.05% (0.1655 => 0.2235, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.07% (1.5415 => 2.0513, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.14% (0.2271 => 0.3001, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 31.66% (0.4299 => 0.5660, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.64% (0.1906 => 0.2509, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.04% (0.1337 => 0.1752, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 30.13% (1.1642 => 1.5150, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 26.98% (0.0719 => 0.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.56% (0.3121 => 0.3950, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.47% (3.8922 => 4.8834, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.02% (0.1143 => 0.1429, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 24.80% (5.7591 => 7.1871, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 24.63% (0.2554 => 0.3183, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 24.31% (1.0722 => 1.3328, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.25% (0.1695 => 0.2106, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.74% (1.4186 => 1.7554, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 22.98% (9.4845 => 11.6643, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.05% (1.3050 => 1.5928, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 21.90% (0.7115 => 0.8673, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.67% (0.2700 => 0.3285, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.13% (0.0672 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.84% (0.7835 => 0.9468, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 20.68% (0.1151 => 0.1389, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 20.45% (0.0626 => 0.0754, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.27% (0.3098 => 0.3726, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.21% (0.0871 => 0.1047, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.08% (4.9449 => 5.9377, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 19.92% (1.1840 => 1.4198, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.42% (0.5860 => 0.6998, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 19.35% (0.1695 => 0.2023, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.22% (5.0018 => 5.9629, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/mst/mst: 19.17% (0.1163 => 0.1386, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.05% (0.4636 => 0.5519, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.86% (0.8172 => 0.9713, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.76% (0.1940 => 0.2304, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 18.61% (3.3354 => 3.9561, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.47% (0.0953 => 0.1129, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 18.40% (0.6456 => 0.7644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 18.00% (0.4289 => 0.5061, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.95% (0.0886 => 0.1045, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.67% (0.5020 => 0.5907, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 17.45% (0.7433 => 0.8730, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 17.45% (0.4620 => 0.5426, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.40% (0.2758 => 0.3238, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 17.37% (0.2049 => 0.2405, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.36% (0.5569 => 0.6536, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.28% (0.1510 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.14% (0.9765 => 1.1439, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.08% (0.3307 => 0.3872, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 16.80% (0.1268 => 0.1481, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.56% (0.2107 => 0.2456, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 16.49% (3.8723 => 4.5109, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 16.42% (2.0273 => 2.3601, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.22% (0.5981 => 0.6951, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 16.21% (0.3232 => 0.3756, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.99% (0.8101 => 0.9396, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 15.87% (0.3283 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 15.83% (2.2969 => 2.6606, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.61% (0.3441 => 0.3978, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.8921 => 1.0297, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.40% (0.6450 => 0.7443, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 14.43% (0.3180 => 0.3639, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.37% (1.1861 => 1.3565, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.92% (0.8067 => 0.9190, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 13.52% (0.3379 => 0.3836, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.74% (1.5603 => 1.7591, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 12.67% (0.3387 => 0.3816, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.53% (0.4103 => 0.4617, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.45% (0.3865 => 0.4346, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.58% (0.1330 => 0.1484, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.33% (0.4203 => 0.4679, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.07% (0.2430 => 0.2699, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 11.02% (0.4048 => 0.4494, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.95% (17.1811 => 19.0620, std.dev.: 0.0210) SingleSource/Benchmarks/Misc/oourafft: 10.82% (0.3282 => 0.3637, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 10.69% (0.3603 => 0.3988, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.52% (14.3668 => 15.8780, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: 10.46% (0.3422 => 0.3780, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.44% (0.3927 => 0.4337, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 10.38% (0.3092 => 0.3413, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 10.34% (0.3684 => 0.4065, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.25% (0.1268 => 0.1398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.18% (0.3427 => 0.3776, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.06% (0.3886 => 0.4277, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.04% (0.3826 => 0.4210, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.87% (0.4064 => 0.4465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2831 => 0.3103, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.20% (0.1892 => 0.2066, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3561 => 0.3883, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.00% (0.3543 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 8.92% (0.2871 => 0.3127, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3516 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3497 => 0.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.36% (63.2438 => 68.5305, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.33% (2.0665 => 2.2387, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2891 => 0.3128, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 8.18% (1.2842 => 1.3892, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.2905 => 0.3141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.03% (0.2877 => 0.3108, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (0.2756 => 0.2975, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 7.74% (0.2725 => 0.2936, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.70% (0.3650 => 0.3931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.65% (0.3162 => 0.3404, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7326 => 0.7881, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 7.55% (0.2714 => 0.2919, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.54% (10.3673 => 11.1488, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3674, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/Hello: 7.44% (0.5925 => 0.6366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.31% (0.2872 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3935 => 0.4222, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.24% (0.2802 => 0.3005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.14% (0.3052 => 0.3270, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.05% (0.3136 => 0.3357, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.17% (0.4879 => 0.5180, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.15% (7.9617 => 8.1330, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.19% (32.5116 => 59.2332, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (1.1145 => 1.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.96% (4.2280 => 4.4800, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 5.89% (11.6436 => 12.3290, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0597, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (3.1578 => 3.3163, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.03% (3.6395 => 3.7862, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.66% (2.0360 => 2.1105, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9131, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.95% (0.9957 => 1.0151, std.dev.: 0.0024) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 1.60% (1.0785 => 1.0958, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.44% (27.8444 => 28.2440, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.09% (9.1159 => 9.2154, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.61% (5.2763 => 1.1814, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -74.92% (0.8651 => 0.2170, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.93% (5.3855 => 4.4736, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.42% (5.3526 => 4.4739, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -13.22% (10.4361 => 9.0566, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.48% (1.7609 => 1.6116, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -7.57% (54.1659 => 50.0661, std.dev.: 0.2791) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.44% (1.9577 => 0.6766, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.76% (0.6962 => 0.3428, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.88% (0.0628 => 0.0365, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.73% (1.5373 => 1.0188, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4280, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7760, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.66% (3.3453 => 2.5874, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.44% (2.5528 => 2.1332, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7347, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4921, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -11.12% (1.2373 => 1.0997, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.21% (0.9540 => 0.8661, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2903, std.dev.: 0.0092) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5783, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.57% (0.2497 => 0.2358, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.85% (0.4808 => 0.4575, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5103, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8381, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.17% (8.1563 => 7.8160, std.dev.: 0.0156) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.48% (3.7221 => 3.6670, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.90% (0.1485 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.01% (0.2116 => 0.0698, std.dev.: 0.0011) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 14:55:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 16:55:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130107225501.3681B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7395?compare_to=7393&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7395, Order: 171788, Start Time: 2013-01-07 21:19:37, End Time: 2013-01-07 22:54:57 To: 7393, Order: 171763, Start Time: 2013-01-07 19:20:30, End Time: 2013-01-07 20:55:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (105 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1099 (804 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: 1.85% (0.6148 => 0.6262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 1.85% (0.6048 => 0.6160, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.18% (28.6911 => 29.6024, std.dev.: 0.0945) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.92% (79.4635 => 80.9875, std.dev.: 0.3508) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.24% (1.2879 => 1.2719, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.99% (0.5456 => 1.1566, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.61% (0.5567 => 1.1669, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.33% (0.5575 => 1.1670, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.23% (0.5688 => 1.1901, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.94% (0.5581 => 1.1661, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.03% (0.5805 => 1.2018, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.16% (0.6395 => 1.3184, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.65% (0.5941 => 1.2158, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.18% (0.6033 => 1.2318, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.10% (0.5849 => 1.1938, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.05% (0.5859 => 1.1955, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.26% (0.6260 => 1.2724, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.98% (0.5478 => 1.0900, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.50% (0.6189 => 1.2285, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.70% (0.5570 => 1.1012, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.45% (0.6440 => 1.2716, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.36% (0.5569 => 1.0991, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.98% (0.5591 => 1.1013, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.97% (0.6304 => 1.2417, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.53% (0.5705 => 1.1212, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.66% (0.5802 => 1.1352, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.09% (0.6395 => 1.2476, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.49% (0.6676 => 1.2984, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.28% (0.5925 => 1.1452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.00% (0.6230 => 1.2024, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.98% (0.5857 => 1.1303, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.77% (0.5863 => 1.1302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.27% (0.6052 => 1.1636, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.55% (0.6660 => 1.2757, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 88.01% (0.6446 => 1.2119, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.91% (0.6194 => 1.1639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.84% (0.6297 => 1.1765, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.79% (0.6681 => 1.2212, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.96% (0.6667 => 1.2131, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.66% (0.7524 => 1.3668, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.45% (0.0717 => 0.1258) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.89% (0.7339 => 1.2835, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.14% (0.0974 => 0.1589, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 60.30% (0.0267 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.93% (0.1500 => 0.2204, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 46.08% (0.0293 => 0.0428) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 45.08% (0.0599 => 0.0869, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 39.22% (0.1132 => 0.1576, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.53% (0.0680 => 0.0942, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.80% (0.0693 => 0.0948, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.65% (1.6474 => 2.2347, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.38% (0.0445 => 0.0598, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.76% (0.0582 => 0.0761) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.99% (2.2587 => 2.9134, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.92% (0.5329 => 0.6497, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.37% (0.1081 => 0.1312, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.7021 => 0.8298, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.52% (0.4916 => 0.5679, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.32% (1.1450 => 1.3090, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.51% (4.5069 => 5.1158, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 12.69% (0.4515 => 0.5088, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 11.80% (0.3357 => 0.3753, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.2001 => 0.2230, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.15% (1.6364 => 1.8188, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.99% (0.2385 => 0.2647, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.73% (0.1761 => 0.1950, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.48% (3.5339 => 3.9043, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.12% (0.1441 => 0.1558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.22% (0.1731 => 0.1856, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.95% (1.2515 => 1.3385, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.65% (9.2283 => 9.8423, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.39% (0.3319 => 0.3531, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.2784 => 1.3594, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 5.68% (5.0226 => 5.3078, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3255 => 0.3400, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.3864 => 1.4217, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (5.4682 => 5.5991, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.3722 => 1.4050, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.18% (0.4813 => 0.4918, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6750 => 0.6864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.57% (1.4642 => 1.4872, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.56% (0.8418 => 0.8549, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.14% (22.4056 => 22.6601, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.06% (0.9557 => 0.9658, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.60% (31.3723 => 55.7184, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.81% (0.9531 => 1.0180, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 4.64% (3.1932 => 3.3415, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5870, std.dev.: 0.1220) MultiSource/Benchmarks/nbench/nbench: 3.60% (11.6767 => 12.0973, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.33% (5.1955 => 5.3684, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.04% (3.6551 => 3.7297, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3044, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.5320 => 4.6074, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.59% (79.7170 => 80.9875, std.dev.: 0.3508) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.85% (0.1281 => 0.1142, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.69% (0.3812 => 0.3595, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.64% (0.3880 => 0.3661, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: -5.64% (0.3848 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.61% (0.3884 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.60% (0.3896 => 0.3678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.32% (0.4176 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.90% (0.7198 => 0.6845, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3821 => 0.3639, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.51% (0.4280 => 0.4087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.25% (2.1713 => 2.0790, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -4.23% (0.3026 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.08% (0.9852 => 0.9450, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.07% (1.3148 => 1.2613, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.81% (0.2989 => 0.2875, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.77% (0.3658 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.76% (0.4151 => 0.3995, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -3.46% (2.4924 => 2.4062, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.43% (0.3931 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.42% (0.6484 => 0.6262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.10% (0.3867 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1458, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.96% (0.4427 => 0.4296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.95% (0.6347 => 0.6160, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.94% (0.7919 => 0.7686, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.92% (0.4321 => 0.4195, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.88% (17.1032 => 16.6103, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/moments: -2.85% (0.4248 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.83% (0.3849 => 0.3740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.70% (0.7779 => 0.7569, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.69% (0.3788 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.63% (4.3330 => 4.2192, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.55% (1.2221 => 1.1909, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.51% (14.2083 => 13.8514, std.dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: -2.49% (0.7982 => 0.7783, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.47% (1.2210 => 1.1908, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6080, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.27% (1.0544 => 1.0305, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.26% (1.2300 => 1.2022, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -2.08% (16.1920 => 15.8556, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -1.99% (2.4021 => 2.3544, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.90% (0.5999 => 0.5885, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.85% (34.0927 => 33.4635, std.dev.: 0.0130) MultiSource/Applications/JM/ldecod/ldecod: -1.74% (7.0961 => 6.9724, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.71% (0.8521 => 0.8375, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.64% (4.0594 => 3.9929, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.61% (1.5610 => 1.5359, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.34% (8.0126 => 7.9052, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.11% (0.9077 => 0.8976, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: -1.10% (2.1401 => 2.1165, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -1.02% (15.2527 => 15.0978, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.94% (1.8100 => 0.7069, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3100, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7515, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0645, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1804, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4056, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -14.87% (2.5106 => 2.1373, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -13.82% (1.0217 => 0.8805) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6843, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2800, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1975, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8708, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -4.90% (1.1594 => 1.1026, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.8545 => 0.8163, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.15% (2.2633 => 2.1694, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.31% (5.5807 => 5.3961, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.88% (1.3096 => 1.2719, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: -2.59% (3.7241 => 3.6278, std.dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7721, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.72% (1.6086 => 1.5809, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4685, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.8776 => 4.8004, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4353, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.11% (1.0443 => 1.0327, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 15:05:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 17:05:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130107230527.6878B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7396?compare_to=7390&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7396, Order: 171761, Start Time: 2013-01-07 19:29:44, End Time: 2013-01-07 23:05:23 To: 7390, Order: 171734, Start Time: 2013-01-07 14:59:46, End Time: 2013-01-07 18:33:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 2 (194 on baseline) Unchanged Tests: 1099 (712 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.91% (2.4473 => 2.5186, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference-object: 1.50% (0.6999 => 0.7104, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference: 1.46% (0.8380 => 0.8502, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- SingleSource/Benchmarks/SmallPT/smallpt Added Tests - Execution Time ---------------------------- SingleSource/Benchmarks/SmallPT/smallpt ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.68% (0.1063 => 0.1421, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.75% (0.2969 => 0.3793, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.29% (0.4139 => 0.5227, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.65% (0.4253 => 0.5344, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.64% (0.5900 => 0.7413, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.75% (0.1620 => 0.2021, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.51% (0.4994 => 0.6218, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.98% (0.5000 => 0.6199, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 23.93% (1.5932 => 1.9745, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.85% (0.1107 => 0.1360) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.14% (0.0822 => 0.1004, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.82% (0.1604 => 0.1954, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 21.68% (0.1619 => 0.1970, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.63% (0.1549 => 0.1884, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.21% (0.3903 => 0.4731, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 20.89% (0.5826 => 0.7043, std.dev.: 0.0055) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 20.63% (0.5889 => 0.7104, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 19.56% (0.4029 => 0.4817, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.46% (0.2014 => 0.2406, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.23% (0.3890 => 0.4638, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.74% (0.2866 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 18.65% (0.2750 => 0.3263, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 18.56% (0.7171 => 0.8502, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.47% (0.2875 => 0.3406, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 17.94% (0.5546 => 0.6541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.88% (0.3271 => 0.3856, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 17.87% (0.2714 => 0.3199, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.85% (1.3152 => 1.5500, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.72% (1.8794 => 2.2124, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 17.71% (0.2823 => 0.3323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 17.66% (0.2803 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.63% (0.2813 => 0.3309, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (0.2792 => 0.3284, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.61% (0.2725 => 0.3205, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.61% (3.5627 => 4.1902, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.54% (0.4658 => 0.5475, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.52% (0.2911 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.51% (0.3267 => 0.3839, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.47% (0.2811 => 0.3302, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.43% (1.6211 => 1.9036, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.42% (0.2738 => 0.3215, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 17.39% (0.9697 => 1.1383, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.38% (0.1968 => 0.2310, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.37% (0.2729 => 0.3203, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 17.34% (0.3004 => 0.3525, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.25% (0.3258 => 0.3820, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.15% (2.0673 => 2.4219, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.09% (0.3195 => 0.3741, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.98% (0.9909 => 1.1592, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 16.89% (0.3096 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.61% (0.5026 => 0.5861, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.54% (0.3060 => 0.3566, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 16.49% (0.3317 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.42% (0.3124 => 0.3637, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.41% (0.3930 => 0.4575, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.30% (4.4195 => 5.1398, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (0.4361 => 0.5063, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 16.07% (0.3348 => 0.3886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 15.89% (0.3726 => 0.4318, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.85% (0.3362 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.85% (0.3678 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.85% (0.3477 => 0.4028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.78% (0.3282 => 0.3800, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.77% (1.0781 => 1.2481, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 15.67% (23.5202 => 27.2057, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.64% (1.9694 => 2.2775, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.64% (0.3625 => 0.4192, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.57% (2.7292 => 3.1541, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.52% (0.3981 => 0.4599, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.44% (0.4146 => 0.4786, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.42% (4.2109 => 4.8603, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.39% (1.9966 => 2.3039, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: 15.32% (0.3446 => 0.3974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.31% (0.3690 => 0.4255, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 15.16% (0.3469 => 0.3995, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 15.10% (0.4251 => 0.4893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.08% (0.3442 => 0.3961, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.06% (0.3465 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.05% (0.3488 => 0.4013, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 15.03% (0.3460 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.93% (0.3496 => 0.4018, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.93% (0.3845 => 0.4419, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.82% (0.3650 => 0.4191, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 14.63% (0.3724 => 0.4269, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.48% (1.4269 => 1.6335, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 14.45% (0.5012 => 0.5736, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 14.22% (0.2566 => 0.2931, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.86% (0.6435 => 0.7327, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.55% (0.2737 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.49% (0.7875 => 0.8937, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.72% (0.2068 => 0.2331, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.47% (2.1653 => 2.4353, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 12.46% (5.5417 => 6.2324, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 12.08% (4.6177 => 5.1755, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.2075 => 0.2323, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.80% (0.3084 => 0.3448, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 11.75% (2.1013 => 2.3482, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.64% (11.6398 => 12.9951, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 11.15% (0.3498 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.12% (0.5361 => 0.5957, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.03% (0.2103 => 0.2335, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.54% (0.6634 => 0.7333, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.41% (4.6926 => 5.1810, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.25% (0.2040 => 0.2249, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 10.13% (0.4847 => 0.5338, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.06% (0.7426 => 0.8173, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (0.5584 => 0.6051, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 7.90% (0.2391 => 0.2580, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.84% (11.9555 => 12.8926, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (0.1383 => 0.1491, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 7.58% (2.0346 => 2.1889, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: 1.70% (2.4764 => 2.5186, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.72% (29.0505 => 181.4852, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.49% (0.2802 => 0.3040, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 7.96% (0.2122 => 0.2291, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.90% (0.3693 => 0.3948, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6781, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2369, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6836, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3006, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0787, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2091, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4809, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.68% (25.4195 => 16.6041, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.16% (17.2379 => 14.2803, std.dev.: 0.0859) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: -7.58% (0.2402 => 0.2220, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -5.78% (14.0481 => 13.2359, std.dev.: 0.1783) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2167, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std.dev.: 0.0129) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1100, std.dev.: 0.0476) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5783, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2013, std.dev.: 0.0802) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 16:53:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 18:53:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108005350.41EC92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7397?compare_to=7395&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7397, Order: 171805, Start Time: 2013-01-07 23:18:19, End Time: 2013-01-08 00:53:46 To: 7395, Order: 171788, Start Time: 2013-01-07 21:19:37, End Time: 2013-01-07 22:54:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (98 on baseline) Performance Improvements: 3 (143 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1100 (803 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/salsa20: 1.75% (7.4338 => 7.5642, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.77% (0.7569 => 0.7435, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -1.69% (0.6160 => 0.6056, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -1.04% (1.1601 => 1.1480, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.96% (0.5456 => 1.1510, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.36% (0.5575 => 1.1616, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.35% (0.5688 => 1.1851, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.33% (0.5567 => 1.1598, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.90% (0.5581 => 1.1603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.20% (0.5805 => 1.1970, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.14% (0.6395 => 1.3119, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.80% (0.5941 => 1.2108, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.30% (0.5849 => 1.1891, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.03% (0.6033 => 1.2249, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.94% (0.5859 => 1.1890, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.22% (0.6260 => 1.2659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.16% (0.5478 => 1.0855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.46% (0.6189 => 1.2221, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.77% (0.5570 => 1.0960, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.66% (0.5569 => 1.0952, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.24% (0.6440 => 1.2638, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.99% (0.5591 => 1.0958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.95% (0.6304 => 1.2353, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.78% (0.5705 => 1.1169, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.98% (0.5802 => 1.1313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.26% (0.6395 => 1.2423, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.17% (0.6676 => 1.2896, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.20% (0.5925 => 1.1388, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.05% (0.6230 => 1.1965, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.95% (0.5863 => 1.1254, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.92% (0.5857 => 1.1241, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.51% (0.6052 => 1.1590, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.77% (0.6660 => 1.2705, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.89% (0.6194 => 1.1576, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.88% (0.6446 => 1.2046, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.96% (0.6297 => 1.1710, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.93% (0.6681 => 1.2155, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.30% (0.6667 => 1.2087, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.57% (0.7524 => 1.3586, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.96% (0.7339 => 1.2767, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.64% (0.0717 => 0.1245, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.50% (0.0974 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 61.48% (0.0514 => 0.0830, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 53.33% (0.0315 => 0.0483, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398) MultiSource/Benchmarks/FreeBench/neural/neural: 46.33% (0.1500 => 0.2195, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.74% (0.0599 => 0.0861, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.50% (0.0680 => 0.0935, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 35.79% (0.0693 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.34% (0.1132 => 0.1532, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.08% (1.6474 => 2.2253, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 33.71% (0.0445 => 0.0595, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 30.93% (0.0582 => 0.0762, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.42% (2.2587 => 2.9006, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.18% (0.0699 => 0.0882, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.76% (0.0622 => 0.0776, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.35% (0.0621 => 0.0766, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.52% (0.5329 => 0.6476, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.54% (0.1081 => 0.1303, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.38% (0.7021 => 0.8241, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.93% (0.0634 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.71% (0.4916 => 0.5639, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 13.86% (1.1450 => 1.3037, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (4.5069 => 5.0872, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.30% (0.4515 => 0.5025, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 11.14% (0.3357 => 0.3731, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.84% (0.2001 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.62% (1.6364 => 1.8102, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.13% (3.5339 => 3.8918, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 9.88% (0.1761 => 0.1935, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.54% (1.2515 => 1.3333, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.20% (9.2283 => 9.8003, std.dev.: 0.0174) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.31% (1.2784 => 1.3463, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.25% (5.0226 => 5.2863, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 3.81% (0.3255 => 0.3379, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.36% (5.4682 => 5.5973, std.dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (1.3864 => 1.4143, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3722 => 1.3962, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.09% (1.4642 => 1.4802, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.62% (31.3723 => 55.7246, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.21% (0.9531 => 1.0218, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.48% (3.1932 => 3.3362, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.6767 => 12.1275, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5751 => 56.6355, std.dev.: 0.0673) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.33% (5.1955 => 5.3683, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1065, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3973, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6551 => 3.7190, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6088, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.92% (0.3194 => 0.2973, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.69% (0.3812 => 0.3557, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.63% (0.3831 => 0.3577, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-3: -6.63% (0.3848 => 0.3593, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.59% (0.3884 => 0.3628, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: -6.57% (0.3896 => 0.3640, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.30% (0.4176 => 0.3913, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.93% (0.4199 => 0.3950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.58% (0.4280 => 0.4041, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.30% (0.3323 => 0.3147, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.27% (0.2428 => 0.2300, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.90% (0.3059 => 0.2909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.77% (0.3252 => 0.3097, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.76% (0.9852 => 0.9383, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.68% (2.1713 => 2.0697, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: -4.58% (0.6347 => 0.6056, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.58% (1.3148 => 1.2546, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.52% (0.3142 => 0.3000, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: -4.42% (0.7779 => 0.7435, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -4.32% (0.6441 => 0.6163, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.26% (0.3658 => 0.3502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.26% (0.4151 => 0.3974, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.99% (0.3931 => 0.3774, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.93% (0.9542 => 0.9167, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.87% (0.6484 => 0.6233, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.87% (0.3621 => 0.3481, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.59% (0.3867 => 0.3728, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.55% (2.4924 => 2.4040, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.54% (0.4321 => 0.4168, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.47% (0.7919 => 0.7644, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.41% (0.4427 => 0.4276, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -3.27% (0.4248 => 0.4109, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.17% (0.3849 => 0.3727, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.16% (6.7716 => 6.5577, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: -3.12% (0.3788 => 0.3670, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -3.09% (0.7982 => 0.7735, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.08% (0.3406 => 0.3301, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -3.07% (4.3330 => 4.1998, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -3.06% (17.1032 => 16.5806, std.dev.: 0.0159) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1584, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.91% (1.2210 => 1.1855, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.87% (0.4083 => 0.3966, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.83% (1.2221 => 1.1875, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.82% (1.2300 => 1.1953, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.81% (14.2083 => 13.8096, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.67% (1.0544 => 1.0263, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -2.64% (16.1920 => 15.7642, std.dev.: 0.0210) MultiSource/Applications/siod/siod: -2.60% (2.4021 => 2.3396, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -2.28% (34.0927 => 33.3156, std.dev.: 0.0426) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.24% (0.8521 => 0.8330, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -2.14% (4.0594 => 3.9724, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: -2.12% (7.0961 => 6.9457, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -1.91% (0.9179 => 0.9004, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -1.88% (1.5610 => 1.5316, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.87% (8.0126 => 7.8630, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.75% (0.6736 => 0.6618, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.66% (0.9077 => 0.8926, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -1.53% (2.1401 => 2.1073, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -1.50% (15.2527 => 15.0235, std.dev.: 0.0082) MultiSource/Applications/kimwitu++/kc: -1.48% (18.2933 => 18.0234, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6951, std.dev.: 0.0234) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3985, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3087, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.34% (1.3643 => 1.0322, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.54% (4.3504 => 3.3261, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0590, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1045, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9703 => 2.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.50% (4.1024 => 3.1792, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.26% (4.3779 => 3.4034, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.16% (0.6299 => 0.5029, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1382, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.28% (4.2493 => 3.6848, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2797, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1984, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7816, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8719, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.67% (1.1594 => 1.0937, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.88% (1.3096 => 1.2588, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.62% (2.2633 => 2.1814, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7679, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/ary3: -2.50% (3.7241 => 3.6309, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.18% (1.6086 => 1.5735, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8033, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7092 => 3.6633, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -1.16% (1.4516 => 1.4347, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 17:21:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 19:21:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108012144.759972A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7398?compare_to=7394&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7398, Order: 171801, Start Time: 2013-01-07 23:08:26, End Time: 2013-01-08 01:21:41 To: 7394, Order: 171780, Start Time: 2013-01-07 20:24:24, End Time: 2013-01-07 22:37:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (220 on baseline) Performance Improvements: 4 (64 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (605 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/IntMM: 21.60% (0.0486 => 0.0591, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.68% (11.1488 => 10.9612, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: -1.29% (31.1774 => 30.7763, std.dev.: 0.0238) MultiSource/Applications/oggenc/oggenc: -1.15% (7.1871 => 7.1048, std.dev.: 0.0112) MultiSource/Benchmarks/nbench/nbench: -1.08% (1.4198 => 1.4044, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1338 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.72% (0.0698 => 0.0672, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8219 => 499.8046, std.dev.: 0.0301) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.71% (1.1277 => 499.8046, std.dev.: 0.0301) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.59% (0.5229 => 1.6502, std.dev.: 0.0130) MultiSource/Applications/SPASS/SPASS: 19.24% (14.9895 => 17.8731, std.dev.: 0.0145) MultiSource/Applications/kimwitu++/kc: 42.94% (14.1553 => 20.2342, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/gs/gs: 16.90% (4.1105 => 4.8050, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.32% (1.1048 => 1.7381, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.00% (7.1582 => 37.4375, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.39% (3.4629 => 6.3506, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.32% (0.6222 => 1.0846, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10224.17% (0.0720 => 7.4334, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: 3831500.00% (0.0001 => 3.8316, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11077400.00% (0.0001 => 11.0775, std.dev.: 0.0651) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908700.00% (0.0001 => 9.9088, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489000.00% (0.0001 => 5.4891, std.dev.: 0.0116) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 832.43% (1.1194 => 10.4376, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 150.23% (22.1758 => 55.4909, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/lowercase: 123.44% (0.0256 => 0.0572, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 98.35% (0.0243 => 0.0482, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.97% (0.0929 => 0.1802, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 79.39% (0.0296 => 0.0531, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 73.14% (0.1463 => 0.2533, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 69.37% (0.0271 => 0.0459, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.43% (1.5859 => 2.5442, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 59.45% (0.0439 => 0.0700, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.63% (2.9384 => 4.6317, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.37% (7.0540 => 10.8890, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 50.69% (2.2024 => 3.3188, std.dev.: 0.0183) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 49.14% (0.0232 => 0.0346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 47.80% (0.5105 => 0.7545, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 47.16% (0.1056 => 0.1554, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.80% (8.1363 => 11.9442, std.dev.: 0.0134) SingleSource/UnitTests/Vector/multiplies: 45.16% (0.0279 => 0.0405, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 44.11% (0.0730 => 0.1052, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: 43.40% (0.0265 => 0.0380, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.67% (0.6675 => 0.9390, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 40.29% (21.9371 => 30.7763, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/flops: 37.99% (0.1432 => 0.1976, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.75% (0.4615 => 0.6357, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0010) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.27% (4.2646 => 5.8112, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 35.93% (0.3109 => 0.4226, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 35.75% (0.0814 => 0.1105, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 34.92% (0.1655 => 0.2233, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0446, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.70% (0.2271 => 0.2991, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 31.59% (0.4299 => 0.5657, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.53% (0.1906 => 0.2507, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.34% (0.1337 => 0.1756, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623) MultiSource/Applications/Burg/burg: 28.87% (1.1642 => 1.5003, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.15% (0.1584 => 0.2014, std.dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 26.84% (0.0719 => 0.0912, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.72% (0.0408 => 0.0517, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.53% (0.3121 => 0.3949, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Oscar: 26.42% (0.0636 => 0.0804, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.32% (3.8922 => 4.8778, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.79% (0.0730 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.72% (0.0793 => 0.0989, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 24.55% (0.2554 => 0.3181, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.25% (0.1695 => 0.2106, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.13% (1.0722 => 1.3309, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.71% (1.4186 => 1.7549, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 23.37% (5.7591 => 7.1048, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 23.36% (9.4845 => 11.7002, std.dev.: 0.0144) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.95% (0.7115 => 0.8677, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.71% (1.3050 => 1.5883, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.26% (0.2700 => 0.3274, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.98% (0.0672 => 0.0813, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.92% (0.3098 => 0.3746, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.45% (0.0626 => 0.0754) MultiSource/Benchmarks/Olden/em3d/em3d: 20.41% (0.1695 => 0.2041, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.23% (0.1236 => 0.1486, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.09% (0.0871 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.84% (4.9449 => 5.9260, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/messages-2: 19.79% (0.0662 => 0.0793, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.64% (0.7835 => 0.9374, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.41% (0.0675 => 0.0806, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.27% (0.8172 => 0.9747, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.24% (0.4636 => 0.5528, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.12% (0.0842 => 0.1003, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.95% (5.0018 => 5.9496, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 18.87% (0.6456 => 0.7674, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 18.83% (0.1163 => 0.1382, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.76% (0.1029 => 0.1222, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.75% (0.5860 => 0.6959, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 18.68% (0.1151 => 0.1366, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 18.61% (1.1840 => 1.4044, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: 18.61% (0.4289 => 0.5087, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 18.30% (3.3354 => 3.9458, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.26% (0.0953 => 0.1127, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.25% (0.1940 => 0.2294, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 18.08% (0.0614 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.03% (0.3423 => 0.4040, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.97% (0.5020 => 0.5922, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.61% (0.0886 => 0.1042, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 17.60% (0.4620 => 0.5433, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.21% (0.3307 => 0.3876, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.5569 => 0.6525, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 16.96% (0.7433 => 0.8694, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.95% (0.1510 => 0.1766, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.89% (0.9765 => 1.1414, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.82% (0.0648 => 0.0757, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 16.69% (0.2049 => 0.2391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.65% (0.3232 => 0.3770, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 16.64% (0.1268 => 0.1479, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.61% (0.2107 => 0.2457, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.40% (3.8723 => 4.5072, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 16.17% (2.0273 => 2.3552, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.12% (0.5981 => 0.6945, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.11% (0.3283 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.65% (0.0933 => 0.1079, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.60% (0.6450 => 0.7456, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.44% (0.8101 => 0.9352, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.40% (0.3441 => 0.3971, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 15.35% (2.2969 => 2.6494, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1044 => 0.1203, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 14.95% (0.8921 => 1.0255, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 14.18% (0.3180 => 0.3631, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.18% (0.3379 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.09% (1.1861 => 1.3532, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.45% (0.8067 => 0.9152, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.25% (0.2603 => 0.2948, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.89% (0.4103 => 0.4632, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.86% (0.3865 => 0.4362, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.79% (1.5603 => 1.7598, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 12.75% (0.3387 => 0.3819, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.73% (0.4203 => 0.4696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.54% (0.4048 => 0.4515, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.46% (0.3603 => 0.4016, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.43% (0.1330 => 0.1482, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 11.18% (0.3684 => 0.4096, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.03% (0.3826 => 0.4248, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.93% (0.3422 => 0.3796, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 10.86% (17.1811 => 19.0467, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.78% (0.2430 => 0.2692, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 10.66% (0.3282 => 0.3632, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.38% (14.3668 => 15.8587, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.13% (0.3427 => 0.3774, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1892 => 0.2079, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 9.69% (0.3828 => 0.4199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.54% (0.2871 => 0.3145, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: 9.47% (0.2831 => 0.3099, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.32% (0.1438 => 0.1572, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.31% (0.3543 => 0.3873, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 9.30% (0.3473 => 0.3796, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.21% (0.3561 => 0.3889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.21% (0.3497 => 0.3819, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.16% (0.3516 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.04% (2.0665 => 2.2533, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2905 => 0.3162, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.46% (1.2842 => 1.3928, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.42% (0.2756 => 0.2988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.41% (0.2877 => 0.3119, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.28% (63.2438 => 68.4813, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3650 => 0.3951, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2891 => 0.3128, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.07% (0.2714 => 0.2933, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.3162 => 0.3417, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.01% (0.2872 => 0.3102, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3935 => 0.4242, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2802 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.73% (0.3052 => 0.3288, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7326 => 0.7873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.34% (2.2022 => 2.3638, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 5.73% (10.3673 => 10.9612, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.23% (0.3131 => 0.3232, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (7.9617 => 8.1297, std.dev.: 0.0248) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.20% (32.5116 => 59.2374, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.87% (0.2944 => 0.3264, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.33% (1.1396 => 1.2459, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3562, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (4.2280 => 4.4602, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (3.1578 => 3.3146, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.63% (2.0360 => 2.1099, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.63% (3.6395 => 3.7716, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9073, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2418, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.23% (9.1159 => 9.2278, std.dev.: 0.0300) MultiSource/Applications/lemon/lemon: 1.02% (1.4460 => 1.4608, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4514, std.dev.: 0.0129) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.51% (5.2763 => 1.1866, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.29% (5.3855 => 4.4544, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.78% (5.3526 => 4.4545, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -13.31% (10.4361 => 9.0469, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.28% (1.7609 => 1.6151, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.89% (54.1659 => 49.8941, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.40% (1.9577 => 0.6773, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4257, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -25.02% (85.0658 => 63.7815, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0049, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.41% (2.5528 => 2.1339, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4924, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: -11.10% (1.2373 => 1.1000, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2727, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8284, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.04% (8.1563 => 7.8268, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1564, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.47% (3.7221 => 3.6674, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: -1.45% (3.6994 => 3.6457, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0027) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 18:52:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 20:52:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108025236.0B9522A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7399?compare_to=7397&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7399, Order: 171826, Start Time: 2013-01-08 01:17:11, End Time: 2013-01-08 02:52:30 To: 7397, Order: 171805, Start Time: 2013-01-07 23:18:19, End Time: 2013-01-08 00:53:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (103 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1101 (808 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/sgefa/sgefa: 3.97% (0.3731 => 0.3879, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.33% (1.5230 => 1.5433, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.17% (1.0218 => 1.0338, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 110.72% (0.5456 => 1.1497, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 108.48% (0.5575 => 1.1623, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.32% (0.5567 => 1.1597, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.25% (0.5688 => 1.1845, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 107.85% (0.5581 => 1.1600, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.03% (0.5805 => 1.1960, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 104.96% (0.6395 => 1.3107, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.48% (0.5941 => 1.2089, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.16% (0.5849 => 1.1883, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 102.78% (0.6033 => 1.2234, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 102.76% (0.5859 => 1.1880, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.06% (0.6260 => 1.2649, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 97.90% (0.5478 => 1.0841, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.37% (0.6189 => 1.2215, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 96.82% (0.5570 => 1.0963, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 96.59% (0.5569 => 1.0948, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.13% (0.6440 => 1.2631, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 95.70% (0.6304 => 1.2337, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 95.69% (0.5591 => 1.0941, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 95.67% (0.5705 => 1.1163, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 94.79% (0.5802 => 1.1302, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.25% (0.6395 => 1.2422, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.03% (0.6676 => 1.2887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.25% (0.6230 => 1.1977, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.22% (0.5925 => 1.1389, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 91.70% (0.5857 => 1.1228, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 91.69% (0.5863 => 1.1239, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 91.29% (0.6052 => 1.1577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 90.62% (0.6660 => 1.2695, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.84% (0.6446 => 1.2044, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 86.68% (0.6194 => 1.1563, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 85.80% (0.6297 => 1.1700, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 81.92% (0.6681 => 1.2154, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.00% (0.6667 => 1.2067, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 80.46% (0.7524 => 1.3578, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 73.99% (0.7339 => 1.2769, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.91% (0.0974 => 0.1577, std.dev.: 0.0040) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.24% (0.0599 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.36% (0.0693 => 0.0945, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.44% (1.6474 => 2.2313, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.38% (0.0445 => 0.0598, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.65% (2.2587 => 2.9058, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/IntMM: 27.51% (0.0418 => 0.0533, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.90% (0.0699 => 0.0887, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.69% (0.5329 => 0.6485, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 20.91% (0.1081 => 0.1307, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.89% (0.7021 => 0.8277, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.14% (0.1146 => 0.1331, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.55% (0.3357 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.50% (0.4916 => 0.5678, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.43% (1.1450 => 1.3102, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.40% (4.5069 => 5.1106, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.26% (1.6364 => 1.8206, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.82% (0.2385 => 0.2643, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.56% (0.1761 => 0.1947, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.09% (3.5339 => 3.8903, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1441 => 0.1551, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.13% (1.2515 => 1.3407, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.72% (9.2283 => 9.8484, std.dev.: 0.0092) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.39% (0.3319 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.71% (1.2784 => 1.3514, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: 5.51% (5.0226 => 5.2992, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.3255 => 0.3403, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.37% (1.3864 => 1.4192, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.34% (5.4682 => 5.5962, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.3722 => 1.4027, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.08% (0.4813 => 0.4913, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.60% (1.4642 => 1.4876, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.26% (0.8418 => 0.8524, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (22.4056 => 22.6665, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6638, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.47% (0.9531 => 1.0338, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.48% (3.1932 => 3.3363, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.6767 => 12.1268, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5439, std.dev.: 0.1259) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3669, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1050, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.18% (1.5103 => 1.5433, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3969, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.87% (3.6551 => 3.7234, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.72% (4.5320 => 4.6098, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.36% (0.3194 => 0.2991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.04% (0.3812 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.99% (0.3848 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.89% (0.3821 => 0.3634, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.88% (0.3891 => 0.3701, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.88% (0.3896 => 0.3706, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.78% (0.7198 => 0.6854, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -4.69% (0.4176 => 0.3980, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.65% (0.3142 => 0.2996, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.46% (0.2871 => 0.2743, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.28% (0.9852 => 0.9430, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/property: -4.24% (0.4199 => 0.4021, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.22% (2.1713 => 2.0797, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2615, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -3.93% (0.4280 => 0.4112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.78% (0.2989 => 0.2876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.77% (0.3658 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.76% (0.9542 => 0.9183, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.69% (0.4151 => 0.3998, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.49% (0.3931 => 0.3794, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.42% (2.4924 => 2.4072, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -3.35% (0.6441 => 0.6225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.19% (0.7779 => 0.7531, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.14% (0.3849 => 0.3728, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -3.09% (0.3621 => 0.3509, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.08% (0.4321 => 0.4188, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.85% (0.4248 => 0.4127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.82% (0.4427 => 0.4302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.78% (0.7919 => 0.7699, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.66% (17.1032 => 16.6487, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: -2.58% (4.3330 => 4.2213, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.50% (1.2221 => 1.1916, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.2210 => 1.1907, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8568, std.dev.: 0.0148) MultiSource/Applications/lambda-0_1_3/lambda: -2.47% (0.7982 => 0.7785, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2709, std.dev.: 0.0347) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.34% (6.7716 => 6.6132, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -2.15% (16.1920 => 15.8434, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2040, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -2.04% (2.4021 => 2.3531, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.86% (34.0927 => 33.4570, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: -1.82% (7.0961 => 6.9667, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.80% (0.5999 => 0.5891, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.80% (1.5610 => 1.5329, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.57% (0.8521 => 0.8387, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -1.53% (4.0594 => 3.9973, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.18% (0.9077 => 0.8970, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.04% (8.0126 => 7.9292, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.18% (1.8100 => 0.6846, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.01% (1.3643 => 1.0231, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0667, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.52% (4.1024 => 3.1787, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4047, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1383, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6843, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1988, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.40% (1.1594 => 1.0968, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0595, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.69% (7.9763 => 7.7620, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.61% (1.6086 => 1.5827, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.51% (4.8776 => 4.8038, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4745, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6219 => 1.6016, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -1.21% (1.4516 => 1.4340, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.01% (4.4002 => 4.3556, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 19:39:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 21:39:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130108033916.0112B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7400?compare_to=7396&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7400, Order: 171805, Start Time: 2013-01-08 00:03:36, End Time: 2013-01-08 03:39:11 To: 7396, Order: 171761, Start Time: 2013-01-07 19:29:44, End Time: 2013-01-07 23:05:23 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (178 on baseline) Performance Improvements: 5 (21 on baseline) Added Tests: 0 (194 on baseline) Unchanged Tests: 1095 (711 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.44% (112.4126 => 118.5238, std.dev.: 0.0863) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.88% (125.1066 => 131.2103, std.dev.: 0.3662) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.54% (2.0722 => 2.1041, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.02% (54.1774 => 54.7302, std.dev.: 0.0874) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.94% (0.7104 => 0.6966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -1.86% (0.7043 => 0.6912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.73% (0.8502 => 0.8355, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.30% (2.4219 => 2.3904, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -1.22% (1.1592 => 1.1450, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.45% (0.2969 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.37% (0.4253 => 0.5332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.32% (0.4139 => 0.5187, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.07% (0.5900 => 0.7379, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726) MultiSource/Applications/oggenc/oggenc: 23.59% (1.5932 => 1.9691, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.40% (0.1620 => 0.1999, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.08% (0.5000 => 0.6154, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.30% (0.0897 => 0.1097, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.62% (0.0948 => 0.1153) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.03% (0.0642 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.82% (0.1604 => 0.1938, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.65% (0.3903 => 0.4709, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.56% (0.0822 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.38% (0.1619 => 0.1949, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.22% (0.0821 => 0.0987, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.54% (0.0947 => 0.1132, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.1088 => 0.1294, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.64% (0.5826 => 0.6912, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 18.54% (0.4029 => 0.4776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.29% (0.5889 => 0.6966, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 18.21% (0.1505 => 0.1779, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.09% (0.2736 => 0.3231, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.04% (0.2866 => 0.3383, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.49% (0.5546 => 0.6516, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.27% (0.3271 => 0.3836, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.21% (1.8794 => 2.2029, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.15% (1.3152 => 1.5408, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.75% (0.4658 => 0.5438, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.61% (1.6211 => 1.8903, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.59% (0.2875 => 0.3352, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.53% (3.5627 => 4.1517, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 16.51% (0.7171 => 0.8355, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.46% (0.1968 => 0.2292, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: 16.29% (0.9697 => 1.1277, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 16.14% (0.2813 => 0.3267, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 16.08% (0.2823 => 0.3277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.05% (0.2792 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.04% (0.2725 => 0.3162, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.01% (4.4195 => 5.1269, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 15.98% (0.2803 => 0.3251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 15.94% (0.2811 => 0.3259, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.92% (0.2738 => 0.3174, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.84% (0.2911 => 0.3372, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.83% (0.2729 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.80% (0.5026 => 0.5820, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.67% (0.3930 => 0.4546, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.63% (2.0673 => 2.3904, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 15.61% (0.3004 => 0.3473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 15.55% (0.9909 => 1.1450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.44% (23.5202 => 27.1507, std.dev.: 0.0286) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.40% (0.3195 => 0.3687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.30% (0.3267 => 0.3767, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.21% (1.0781 => 1.2421, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.13% (0.3060 => 0.3523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3317 => 0.3812, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.92% (0.3124 => 0.3590, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.81% (1.9694 => 2.2610, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.75% (0.3362 => 0.3858, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.68% (1.9966 => 2.2897, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 14.63% (0.3678 => 0.4216, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.58% (0.3477 => 0.3984, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.57% (0.3726 => 0.4269, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.56% (2.7292 => 3.1267, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 14.55% (4.2109 => 4.8234, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.46% (0.3625 => 0.4149, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.14% (0.3981 => 0.4544, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.12% (0.3690 => 0.4211, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 14.01% (0.4146 => 0.4727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 13.93% (1.4269 => 1.6256, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.62% (0.1028 => 0.1168, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.56% (0.3465 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.56% (0.2566 => 0.2914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.55% (0.3845 => 0.4366, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 13.46% (0.3469 => 0.3936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.44% (0.3460 => 0.3925, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.43% (0.5012 => 0.5685, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.42% (0.3496 => 0.3965, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 13.07% (0.7875 => 0.8904, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.05% (0.3724 => 0.4210, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.93% (0.6435 => 0.7267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.64% (0.2737 => 0.3083, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.03% (2.1653 => 2.4258, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.2075 => 0.2323, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0046) MultiSource/Applications/SPASS/SPASS: 11.70% (5.5417 => 6.1903, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 11.70% (4.6177 => 5.1581, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.61% (0.2068 => 0.2308, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.51% (0.3084 => 0.3439, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.29% (0.5361 => 0.5966, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.23% (11.6398 => 12.9471, std.dev.: 0.0091) MultiSource/Benchmarks/mafft/pairlocalalign: 11.16% (2.1013 => 2.3358, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.2103 => 0.2336, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.24% (4.6926 => 5.1732, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: 10.11% (0.4847 => 0.5337, std.dev.: 0.0054) MultiSource/Applications/siod/siod: 10.10% (0.6634 => 0.7304, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.92% (0.7426 => 0.8163, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.22% (0.2040 => 0.2228, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.17% (0.5584 => 0.6040, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 8.03% (0.2391 => 0.2583, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.58% (2.0346 => 2.1889, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.32% (11.9555 => 12.8308, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: 1.24% (2.4764 => 2.5071, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5165, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (0.3693 => 0.3938, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6790, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2411, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6852, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8881, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2121, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3047, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.19% (4.0317 => 4.0796, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2073, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5916, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4791, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5641, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.37% (17.2379 => 14.4169, std.dev.: 0.0664) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -8.41% (0.2402 => 0.2200, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8048, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.72% (41.7953 => 40.2417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.51% (11.2080 => 10.8143, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -3.30% (14.0481 => 13.5841, std.dev.: 0.1538) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1475, std.dev.: 0.0505) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5001, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2392, std.dev.: 0.0395) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 20:06:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 22:06:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108040614.9C7AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7401?compare_to=7398&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7401, Order: 171830, Start Time: 2013-01-08 01:52:10, End Time: 2013-01-08 04:06:11 To: 7398, Order: 171801, Start Time: 2013-01-07 23:08:26, End Time: 2013-01-08 01:21:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 30 (225 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1070 (598 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 6.30% (10.9612 => 11.6518, std.dev.: 0.0129) MultiSource/Applications/sgefa/sgefa: 4.64% (0.4226 => 0.4422, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.73% (0.9374 => 0.9536, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: 1.64% (3.9458 => 4.0107, std.dev.: 0.0090) SingleSource/UnitTests/ObjC++/Hello: 1.63% (0.6362 => 0.6466, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 1.61% (0.6502 => 0.6607, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 1.39% (4.8050 => 4.8717, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.35% (0.7545 => 0.7647, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.34% (15.8587 => 16.0710, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (37.4375 => 37.9360, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 1.31% (0.7873 => 0.7976, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 1.28% (1.5003 => 1.5195, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.27% (2.0446 => 2.0706, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.26% (17.8731 => 18.0981, std.dev.: 0.0219) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (9.0469 => 9.1591, std.dev.: 0.0245) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (8.1297 => 8.2301, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.22% (5.8112 => 5.8820, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.20% (2.3552 => 2.3835, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.15% (1.5883 => 1.6066, std.dev.: 0.0010) MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.12% (1.3226 => 1.3374, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (5.9496 => 6.0142, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 1.08% (30.7763 => 31.1100, std.dev.: 0.0154) MultiSource/Applications/lemon/lemon: 1.07% (1.3309 => 1.3452, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 1.06% (2.6494 => 2.6776, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.04% (5.9260 => 5.9877, std.dev.: 0.0131) MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.03% (1.3255 => 1.3392, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 1.03% (20.2342 => 20.4423, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.02% (1.7381 => 1.7559, std.dev.: 0.0027) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.01% (49.3517 => 49.8518, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.04% (41.9719 => 42.8295, std.dev.: 0.0664) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.27% (0.0672 => 0.0694, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8046 => 499.8493, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.67% (1.1277 => 499.8493, std.dev.: 0.0061) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.82% (0.5229 => 1.6619, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 20.74% (14.9895 => 18.0981, std.dev.: 0.0219) MultiSource/Applications/kimwitu++/kc: 44.41% (14.1553 => 20.4423, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/gs/gs: 18.52% (4.1105 => 4.8717, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.93% (1.1048 => 1.7559, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.97% (7.1582 => 37.9360, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.80% (3.4629 => 6.3993, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.27% (0.6222 => 1.0905, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10220.83% (0.0720 => 7.4310, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 3832200.00% (0.0001 => 3.8323, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11100500.00% (0.0001 => 11.1006, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908000.00% (0.0001 => 9.9081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0111) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.20% (1.1194 => 10.3343, std.dev.: 0.0118) MultiSource/Applications/ClamAV/clamscan: 150.04% (22.1758 => 55.4480, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577, std.dev.: 0.0015) SingleSource/Regression/C/sumarraymalloc: 100.41% (0.0243 => 0.0487, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.80% (0.0929 => 0.1819, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 80.74% (0.0296 => 0.0535, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 75.32% (0.1463 => 0.2565, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 70.85% (0.0271 => 0.0463, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.60% (1.5859 => 2.5628, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.82% (0.0439 => 0.0706, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 58.01% (0.0231 => 0.0365, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.84% (2.9384 => 4.6380, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.73% (7.0540 => 10.9853, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.54% (2.2024 => 3.3376, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/IntMM: 51.52% (0.0394 => 0.0597) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.79% (0.5105 => 0.7647, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 49.62% (0.1056 => 0.1580, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.18% (8.1363 => 12.0566, std.dev.: 0.0125) SingleSource/UnitTests/Vector/multiplies: 46.59% (0.0279 => 0.0409, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 45.07% (0.0730 => 0.1059) SingleSource/Benchmarks/Misc/dt: 44.91% (0.0265 => 0.0384, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 42.23% (0.3109 => 0.4422, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.89% (0.6675 => 0.9471, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 41.81% (21.9371 => 31.1100, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/flops: 39.87% (0.1432 => 0.2003, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.70% (0.1062 => 0.1473, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.48% (0.4615 => 0.6391, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.93% (4.2646 => 5.8820, std.dev.: 0.0067) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 36.73% (0.0814 => 0.1113, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 36.25% (0.1655 => 0.2255, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.32% (1.5415 => 2.0706, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.29% (0.2271 => 0.3027, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 33.13% (0.1337 => 0.1780, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.63% (0.1906 => 0.2528, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 32.52% (0.4299 => 0.5697, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.52% (0.0479 => 0.0630, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 30.52% (1.1642 => 1.5195, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.16% (0.1584 => 0.2030, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.59% (0.3121 => 0.3982, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.48% (0.0457 => 0.0578, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.42% (3.8922 => 4.9204, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.35% (0.2554 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 26.30% (0.1175 => 0.1484, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.84% (0.1695 => 0.2133, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 25.46% (1.0722 => 1.3452, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.37% (0.1143 => 0.1433, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.34% (0.0730 => 0.0915, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.65% (1.4186 => 1.7683, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.52% (0.1566 => 0.1950, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 24.36% (9.4845 => 11.7951, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 24.30% (5.7591 => 7.1586, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.30% (0.2700 => 0.3329, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.11% (1.3050 => 1.6066, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827) MultiSource/Applications/minisat/minisat: 23.02% (0.7115 => 0.8753, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 22.96% (0.1555 => 0.1912, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 22.58% (0.0660 => 0.0809, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 22.24% (0.1151 => 0.1407, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.71% (0.1695 => 0.2063, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 21.71% (0.7835 => 0.9536, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.09% (4.9449 => 5.9877, std.dev.: 0.0131) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.93% (0.1032 => 0.1248, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 20.81% (0.1163 => 0.1405, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 20.25% (3.3354 => 4.0107, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.24% (5.0018 => 6.0142, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.97% (0.4636 => 0.5562, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.97% (0.8172 => 0.9804, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.97% (0.5860 => 0.7030, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.95% (0.1940 => 0.2327, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 19.85% (1.1840 => 1.4190, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.73% (0.0953 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.36% (0.5020 => 0.5992, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 19.36% (0.6456 => 0.7706, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 18.84% (0.0536 => 0.0637, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 18.77% (0.4289 => 0.5094, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 18.58% (0.3423 => 0.4059, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.41% (0.5569 => 0.6594, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.35% (0.2758 => 0.3264, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 18.25% (0.4620 => 0.5463, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.12% (0.7433 => 0.8780, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.11% (0.3307 => 0.3906, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.03% (0.9765 => 1.1526, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.80% (0.2107 => 0.2482, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 17.76% (0.2049 => 0.2413, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.75% (0.0834 => 0.0982, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 17.57% (2.0273 => 2.3835, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.49% (3.8723 => 4.5496, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.12% (0.5981 => 0.7005, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 16.57% (2.2969 => 2.6776, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.55% (0.8101 => 0.9442, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 16.52% (0.3232 => 0.3766, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.43% (0.6450 => 0.7510, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 16.42% (0.3283 => 0.3822, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.36% (0.3441 => 0.4004, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: 15.85% (0.8921 => 1.0335, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 15.79% (0.3180 => 0.3682, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.23% (1.1861 => 1.3667, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.79% (0.8067 => 0.9260, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.35% (0.0704 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.88% (0.3387 => 0.3857, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary2: 13.85% (0.3379 => 0.3847, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7676, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3865 => 0.4376, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.72% (0.4103 => 0.4625, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.71% (0.1330 => 0.1499, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.48% (0.3886 => 0.4371, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 12.39% (10.3673 => 11.6518, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.10% (0.4048 => 0.4538, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.86% (14.3668 => 16.0710, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 11.82% (17.1811 => 19.2114, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/oourafft: 11.58% (0.3282 => 0.3662, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.52% (0.3603 => 0.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1268 => 0.1414, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.48% (0.2430 => 0.2709, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.40% (0.3543 => 0.3947, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.40% (0.3561 => 0.3967, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.38% (0.3427 => 0.3817, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 11.31% (0.3422 => 0.3809, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.07% (0.3684 => 0.4092, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.97% (0.4064 => 0.4510, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.36% (0.1438 => 0.1587, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.25% (0.1892 => 0.2086, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2871 => 0.3153, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.6030 => 0.6607, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2831 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.22% (2.0665 => 2.2570, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.87% (0.7326 => 0.7976, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 8.80% (1.2842 => 1.3972, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 8.78% (63.2438 => 68.7943, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.58% (0.3650 => 0.3963, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.49% (0.2756 => 0.2990, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.48% (0.2877 => 0.3121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.38% (0.3162 => 0.3427, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2891 => 0.3130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.14% (0.2714 => 0.2935, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.08% (0.2872 => 0.3104, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.88% (0.3935 => 0.4245, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.81% (0.4879 => 0.5260, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 7.77% (0.3052 => 0.3289, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3714, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.42% (0.3177 => 0.3381, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.74% (0.2266 => 0.2396, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.39% (0.3131 => 0.3237, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.37% (7.9617 => 8.2301, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.28% (32.5116 => 59.2632, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3566, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0597, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4538, std.dev.: 0.0062) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (3.1578 => 3.3158, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.84% (3.6395 => 3.7792, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (2.0360 => 2.1102, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.6802 => 8.9278, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2436, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.22% (9.1159 => 9.2273, std.dev.: 0.0398) MultiSource/Applications/lemon/lemon: 1.15% (1.4460 => 1.4627, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1703, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.48% (5.2763 => 1.1882, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.07% (0.8651 => 0.2157, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (5.3855 => 4.4713, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.38% (5.3526 => 4.4756, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: -12.24% (10.4361 => 9.1591, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.84% (1.7609 => 1.6228, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9875, std.dev.: 0.0169) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.53% (1.9577 => 0.6748, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.76% (1.5373 => 1.0183, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4285, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7735, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0904, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.35% (2.5528 => 2.1353, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4235, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7319, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4927, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -11.00% (1.2373 => 1.1012, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4758, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.89% (1.8329 => 1.7067, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5797, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -4.55% (10.2830 => 9.8156, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.07% (8.1563 => 7.8244, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.71% (3.7221 => 3.6583, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2781, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.40% (3.6994 => 3.6476, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout/lists: -1.30% (6.2999 => 6.2180, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8557, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.20% (0.2116 => 0.0694, std.dev.: 0.0016) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 20:51:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 7 Jan 2013 22:51:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108045118.A53B32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7402?compare_to=7399&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7402, Order: 171837, Start Time: 2013-01-08 03:16:01, End Time: 2013-01-08 04:51:14 To: 7399, Order: 171826, Start Time: 2013-01-08 01:17:11, End Time: 2013-01-08 02:52:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 1 (136 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1103 (804 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.42% (1.5433 => 1.5214, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.91% (0.5456 => 1.1562, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.67% (0.5575 => 1.1689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.48% (0.5567 => 1.1662, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.14% (0.5688 => 1.1896, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.94% (0.5581 => 1.1661, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.82% (0.5805 => 1.2006, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.21% (0.6395 => 1.3187, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.53% (0.5941 => 1.2151, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.27% (0.5849 => 1.1948, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.13% (0.6033 => 1.2315, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.03% (0.5859 => 1.1954, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.27% (0.6260 => 1.2725, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.11% (0.5478 => 1.0907, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.58% (0.6189 => 1.2290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.79% (0.5570 => 1.1017, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.68% (0.5569 => 1.1009, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.41% (0.6440 => 1.2713, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.83% (0.5591 => 1.1005, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.68% (0.6304 => 1.2399, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.56% (0.5705 => 1.1214, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.76% (0.5802 => 1.1358, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.39% (0.6395 => 1.2495, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.13% (0.6676 => 1.2960, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.08% (0.5925 => 1.1440, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.01% (0.5863 => 1.1316, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.00% (0.6230 => 1.2024, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.73% (0.5857 => 1.1288, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.37% (0.6052 => 1.1642, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.64% (0.6660 => 1.2763) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.81% (0.6446 => 1.2106, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.78% (0.6194 => 1.1631, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.68% (0.6297 => 1.1755, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.74% (0.6681 => 1.2209, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.73% (0.6667 => 1.2116, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.49% (0.7524 => 1.3655, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.87% (0.7339 => 1.2834, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.11% (0.0974 => 0.1579) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 47.13% (0.1500 => 0.2207, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.58% (1.6474 => 2.2335, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.83% (0.0445 => 0.0600, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.84% (2.2587 => 2.9101, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.90% (0.0699 => 0.0887, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.94% (0.5329 => 0.6498, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.18% (0.1081 => 0.1310, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.7021 => 0.8288, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.09% (0.3357 => 0.3897, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.58% (0.4916 => 0.5682, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.56% (1.1450 => 1.3117, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.58% (4.5069 => 5.1189, std.dev.: 0.0112) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.14% (0.4515 => 0.5063, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.54% (0.2001 => 0.2232, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.34% (1.6364 => 1.8219, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2385 => 0.2644, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 10.79% (0.1761 => 0.1951, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.42% (3.5339 => 3.9020, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1441 => 0.1551, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.18% (1.2515 => 1.3413, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.05% (0.1731 => 0.1853, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.90% (9.2283 => 9.8655, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.60% (0.3319 => 0.3538, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.81% (1.2784 => 1.3527, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 5.79% (5.0226 => 5.3133, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3255 => 0.3397, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.50% (1.3864 => 1.4210, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.37% (1.3722 => 1.4047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 2.28% (0.4524 => 0.4627, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.26% (0.4813 => 0.4922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.19% (5.4682 => 5.5878, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.4642 => 1.4890, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 1.64% (0.6750 => 0.6861, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.16% (22.4056 => 22.6652, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.07% (0.9557 => 0.9659, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6567, std.dev.: 0.0314) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.45% (0.9531 => 1.0146, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 4.29% (3.1932 => 3.3302, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.6767 => 12.1269, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5174, std.dev.: 0.0919) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3673, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3982, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.91% (3.6551 => 3.7249, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6112, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.42% (0.3194 => 0.2989, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.21% (0.3831 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.19% (0.3812 => 0.3576, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.19% (0.3880 => 0.3640, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.18% (0.3884 => 0.3644, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.13% (0.3848 => 0.3612, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -6.08% (0.3896 => 0.3659, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.96% (0.3891 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.85% (0.4033 => 0.3797, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.75% (0.4176 => 0.3936, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/property: -5.53% (0.4199 => 0.3967, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -5.09% (0.4280 => 0.4062, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.2428 => 0.2308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.88% (0.6347 => 0.6037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.54% (0.3016 => 0.2879, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.46% (0.7779 => 0.7432, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -4.46% (0.2849 => 0.2722, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.37% (0.3252 => 0.3110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3142 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.28% (2.1713 => 2.0784, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.26% (0.9852 => 0.9432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.21% (0.3205 => 0.3070, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.89% (1.3148 => 1.2637, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/strcat: -3.71% (0.2989 => 0.2878, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.66% (0.3658 => 0.3524, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.61% (0.9542 => 0.9198, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.39% (2.4924 => 2.4080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.36% (0.3931 => 0.3799, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -3.34% (0.3621 => 0.3500, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.33% (0.4321 => 0.4177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.10% (0.3867 => 0.3747, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.05% (0.4427 => 0.4292, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.96% (0.3849 => 0.3735, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.7919 => 0.7688, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -2.82% (0.4248 => 0.4128, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.70% (17.1032 => 16.6407, std.dev.: 0.0145) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2184, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/gs/gs: -2.59% (4.3330 => 4.2207, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.53% (6.7716 => 6.6000, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.45% (0.4083 => 0.3983, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (1.2221 => 1.1922, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -2.44% (0.7982 => 0.7787, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.44% (1.2210 => 1.1912, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.25% (14.2083 => 13.8887, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.14% (1.2300 => 1.2037, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -2.07% (16.1920 => 15.8563, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -2.06% (2.4021 => 2.3525, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.92% (0.5999 => 0.5884, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.84% (0.8521 => 0.8364, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -1.68% (7.0961 => 6.9766, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -1.59% (4.0594 => 3.9947, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: -1.57% (1.5610 => 1.5365, std.dev.: 0.0035) MultiSource/Benchmarks/Bullet/bullet: -1.55% (34.0927 => 33.5639, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/football/football: -1.47% (0.9179 => 0.9044, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.42% (0.9077 => 0.8948, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -1.27% (18.2933 => 18.0610, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.15% (8.0126 => 7.9204, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.06% (1.8100 => 0.6867, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.05% (6.6713 => 3.3987, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3111, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.13% (1.3643 => 1.0215, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7508, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0611, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.54% (4.1024 => 3.1779, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4057, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2805, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7818, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8711, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.87% (1.1594 => 1.0913, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (1.7753 => 1.6988, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7752, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.30% (1.6086 => 1.5716, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.64% (4.8776 => 4.7974, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4687, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.47% (1.3096 => 1.2903, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4351, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6693, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6049, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 22:50:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 00:50:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108065005.BBE402A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7403?compare_to=7402&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7403, Order: 171841, Start Time: 2013-01-08 05:14:42, End Time: 2013-01-08 06:50:01 To: 7402, Order: 171837, Start Time: 2013-01-08 03:16:01, End Time: 2013-01-08 04:51:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (134 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1103 (806 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.12% (2.7861 => 2.8172, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.88% (0.5456 => 1.1560, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.65% (0.5567 => 1.1671, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.63% (0.5575 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.34% (0.5688 => 1.1907, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.94% (0.5581 => 1.1661, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.99% (0.5805 => 1.2016, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.16% (0.6395 => 1.3184, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.63% (0.5941 => 1.2157, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.38% (0.5849 => 1.1954, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.20% (0.5859 => 1.1964, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 104.09% (0.6033 => 1.2313, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.31% (0.6260 => 1.2727, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.09% (0.5478 => 1.0906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.56% (0.6189 => 1.2289, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.88% (0.5570 => 1.1022, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.72% (0.5569 => 1.1011, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.38% (0.6440 => 1.2711, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.83% (0.5591 => 1.1005, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.78% (0.6304 => 1.2405, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.44% (0.5705 => 1.1207, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.83% (0.5802 => 1.1362, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.45% (0.6395 => 1.2499, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.07% (0.6676 => 1.2956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.25% (0.5925 => 1.1450, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.16% (0.6230 => 1.2034, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.84% (0.5863 => 1.1306, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.78% (0.5857 => 1.1291, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.35% (0.6052 => 1.1641, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.65% (0.6660 => 1.2764, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.85% (0.6446 => 1.2109, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.83% (0.6194 => 1.1634, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.66% (0.6297 => 1.1754, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.73% (0.6681 => 1.2208, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.91% (0.6667 => 1.2128, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.69% (0.7524 => 1.3670, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.89% (0.7339 => 1.2835, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.62% (0.0717 => 0.1252, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 63.23% (0.0514 => 0.0839, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.53% (0.0974 => 0.1583, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.13% (0.1500 => 0.2207, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.53% (0.0680 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.51% (0.0693 => 0.0946, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.69% (1.6474 => 2.2353, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.83% (0.0445 => 0.0600, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 29.00% (2.2587 => 2.9138, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.90% (0.5329 => 0.6496, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.65% (0.1081 => 0.1315, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.05% (0.7021 => 0.8288, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.29% (0.3357 => 0.3904, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.52% (0.4916 => 0.5679, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.58% (1.1450 => 1.3119, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.58% (4.5069 => 5.1189, std.dev.: 0.0173) MultiSource/Benchmarks/McCat/05-eks/eks: 12.40% (0.4515 => 0.5075, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.64% (0.2001 => 0.2234, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.35% (1.6364 => 1.8222, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.94% (0.2385 => 0.2646, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 10.85% (0.1761 => 0.1952, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.38% (3.5339 => 3.9008, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.16% (1.2515 => 1.3411, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.98% (9.2283 => 9.8728, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.72% (0.3319 => 0.3542, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.2784 => 1.3539, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 5.74% (5.0226 => 5.3110, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.3864 => 1.4218, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.41% (1.3722 => 1.4053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (5.4682 => 5.5951, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 2.22% (0.4813 => 0.4920, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.79% (1.4642 => 1.4904, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6750 => 0.6858, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (22.4056 => 22.6808, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.12% (0.9557 => 0.9664, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.63% (31.3723 => 55.7273, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.12% (0.9531 => 1.0210, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 4.46% (3.1932 => 3.3355, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 3.84% (11.6767 => 12.1249, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.74% (54.5751 => 56.6177, std.dev.: 0.1137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3674) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3980, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6551 => 3.7221, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6104, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.44% (3.7435 => 3.7974, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.82% (0.3884 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.69% (0.3831 => 0.3613, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -5.62% (0.3896 => 0.3677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.60% (0.3891 => 0.3673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.76% (0.6347 => 0.6045, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.72% (0.4280 => 0.4078, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.61% (0.3057 => 0.2916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.30% (0.3026 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.27% (0.3205 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.25% (0.9852 => 0.9433, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.20% (0.3142 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.19% (0.2939 => 0.2816, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.17% (2.1713 => 2.0808, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.13% (0.7779 => 0.7458, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.00% (0.3252 => 0.3122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.71% (0.4151 => 0.3997, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.69% (1.3148 => 1.2663, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (0.9542 => 0.9201, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.32% (2.4924 => 2.4096, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.19% (0.4321 => 0.4183, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.12% (0.3621 => 0.3508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.97% (0.3867 => 0.3752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.96% (0.4427 => 0.4296, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.87% (0.7919 => 0.7692, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -2.80% (0.4248 => 0.4129, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: -2.67% (0.3788 => 0.3687, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.62% (17.1032 => 16.6554, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: -2.62% (4.3330 => 4.2196, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2358, std.dev.: 0.0348) MultiSource/Applications/lambda-0_1_3/lambda: -2.52% (0.7982 => 0.7781, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.48% (6.7716 => 6.6036, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.41% (1.2210 => 1.1916, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.35% (1.2221 => 1.1934, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.33% (14.2083 => 13.8768, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (1.2300 => 1.2043, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.09% (1.0544 => 1.0324, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -2.01% (2.4021 => 2.3538, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -1.98% (16.1920 => 15.8715, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.87% (0.5999 => 0.5887, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -1.66% (7.0961 => 6.9782, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: -1.64% (1.5610 => 1.5354, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.51% (34.0927 => 33.5786, std.dev.: 0.0099) MultiSource/Applications/lua/lua: -1.48% (4.0594 => 3.9992, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: -1.32% (0.9179 => 0.9058, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.31% (0.9077 => 0.8958, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -1.21% (18.2933 => 18.0716, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.00% (8.0126 => 7.9322, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.91% (1.8100 => 0.7076, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.18% (1.3643 => 1.0208, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0651, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1790, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4052, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.82% (2.5106 => 2.1385, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2805, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1976, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -9.09% (1.2842 => 1.1675, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7825, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6325, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8717, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.44% (1.1594 => 1.0963, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0594, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0526, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.62% (7.9763 => 7.7670, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/ary3: -1.93% (3.7241 => 3.6521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.60% (1.6086 => 1.5828, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8051, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4350, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6042, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.04% (1.6307 => 1.6138, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 7 22:50:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 00:50:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108065039.3FFBC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7404?compare_to=7401&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7404, Order: 171839, Start Time: 2013-01-08 04:36:55, End Time: 2013-01-08 06:50:36 To: 7401, Order: 171830, Start Time: 2013-01-08 01:52:10, End Time: 2013-01-08 04:06:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (222 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (601 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.16% (11.6518 => 11.5168, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1337 => 0.1336, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.44% (0.0694 => 0.0684, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8493 => 499.8426, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.08% (1.1277 => 499.8426, std.dev.: 0.0051) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.52% (0.5229 => 1.6551, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 20.32% (14.9895 => 18.0353, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 43.95% (14.1553 => 20.3770, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 18.10% (4.1105 => 4.8544, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.25% (1.1048 => 1.7483, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.20% (7.1582 => 37.7383, std.dev.: 0.0159) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.96% (3.4629 => 6.3703, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.14% (0.6222 => 1.0897, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10224.44% (0.0720 => 7.4336, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3831900.00% (0.0001 => 3.8320, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 11066300.00% (0.0001 => 11.0664, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574200.00% (0.0001 => 0.5743, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908600.00% (0.0001 => 9.9087, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486200.00% (0.0001 => 5.4863, std.dev.: 0.0093) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.14% (1.1194 => 10.2441, std.dev.: 0.0143) MultiSource/Applications/ClamAV/clamscan: 148.28% (22.1758 => 55.0580, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 99.59% (0.0243 => 0.0485, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 94.51% (0.0929 => 0.1807, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 74.03% (0.1463 => 0.2546, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.20% (1.5859 => 2.5564, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.59% (0.0439 => 0.0705, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 57.58% (0.0231 => 0.0364, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.27% (2.9384 => 4.6211, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.86% (7.0540 => 10.9235, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.13% (2.2024 => 3.3285, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.89% (0.5105 => 0.7601, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.28% (8.1363 => 11.9830, std.dev.: 0.0072) SingleSource/UnitTests/Vector/multiplies: 46.24% (0.0279 => 0.0408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 41.78% (0.3109 => 0.4408, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.30% (0.6675 => 0.9432, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: 40.70% (21.9371 => 30.8660, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/flops: 39.39% (0.1432 => 0.1996, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.09% (0.4615 => 0.6373, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.04% (0.1062 => 0.1466, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.45% (4.2646 => 5.8617, std.dev.: 0.0124) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 36.24% (0.0814 => 0.1109, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 35.89% (0.1655 => 0.2249, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.69% (1.5415 => 2.0609, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.76% (0.2271 => 0.3015, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.76% (0.1337 => 0.1775, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.42% (0.1906 => 0.2524, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 32.26% (0.4299 => 0.5686, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 30.14% (1.1642 => 1.5151, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 27.85% (0.1555 => 0.1988, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.29% (0.1125 => 0.1432, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.23% (0.3121 => 0.3971, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: 26.74% (0.2554 => 0.3237, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 26.30% (0.1175 => 0.1484, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.20% (0.1584 => 0.1999, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.99% (3.8922 => 4.9037, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.53% (0.0842 => 0.1057, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.25% (0.1695 => 0.2123, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.89% (1.0722 => 1.3391, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.23% (1.4186 => 1.7623, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.11% (0.0730 => 0.0906, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 23.98% (9.4845 => 11.7589, std.dev.: 0.0118) MultiSource/Applications/oggenc/oggenc: 23.76% (5.7591 => 7.1274, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.56% (0.0675 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.14% (0.0886 => 0.1091, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.07% (0.2700 => 0.3323, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 22.88% (0.7115 => 0.8743, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.57% (1.3050 => 1.5995, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1163 => 0.1417, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.66% (0.7835 => 0.9532, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 21.63% (0.3098 => 0.3768, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.62% (4.9449 => 5.9645, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.44% (0.2065 => 0.2487, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.5860 => 0.7031, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.93% (0.4636 => 0.5560, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.73% (5.0018 => 5.9886, std.dev.: 0.0110) MultiSource/Benchmarks/nbench/nbench: 19.55% (1.1840 => 1.4155, std.dev.: 0.0028) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.53% (0.8172 => 0.9768, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 19.48% (3.3354 => 3.9852, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 19.38% (0.6456 => 0.7707, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 19.07% (0.4289 => 0.5107, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 18.55% (0.4620 => 0.5477, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.46% (0.2107 => 0.2496, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.5569 => 0.6591, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 18.32% (0.7433 => 0.8795, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.07% (0.5020 => 0.5927, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/18-imp/imp: 18.05% (0.3423 => 0.4041, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.90% (0.3307 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.88% (0.2758 => 0.3251, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.61% (0.9765 => 1.1485, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 17.26% (0.3232 => 0.3790, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 17.23% (0.2049 => 0.2402, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 17.22% (2.0273 => 2.3765, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 17.11% (3.8723 => 4.5349, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: 16.91% (0.3283 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.72% (0.5981 => 0.6981, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.39% (0.8101 => 0.9429, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 16.28% (2.2969 => 2.6708, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.25% (0.3441 => 0.4000, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.6450 => 0.7492, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.72% (0.8921 => 1.0323, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/09-vor/vor: 15.31% (0.3180 => 0.3667, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.16% (1.1861 => 1.3659, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.89% (0.8067 => 0.9268, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3379 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.79% (0.3387 => 0.3854, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.64% (1.5603 => 1.7732, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.64% (0.2603 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.82% (0.4103 => 0.4629, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.47% (0.4203 => 0.4727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.35% (0.4048 => 0.4548, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.26% (0.1330 => 0.1493, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 11.91% (0.3603 => 0.4032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.75% (0.3422 => 0.3824, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 11.51% (0.3684 => 0.4108, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.41% (14.3668 => 16.0062, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.36% (0.2430 => 0.2706, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3826 => 0.4260, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 11.28% (17.1811 => 19.1198, std.dev.: 0.0163) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.20% (0.4064 => 0.4519, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3427 => 0.3809, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 11.09% (0.3092 => 0.3435, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 11.09% (10.3673 => 11.5168, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 11.00% (0.3282 => 0.3643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 10.61% (0.3561 => 0.3939, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.28% (0.2831 => 0.3122, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 10.17% (0.2871 => 0.3163, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.10% (0.1892 => 0.2083, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.78% (2.0665 => 2.2687, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.74% (0.1438 => 0.1578, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.6030 => 0.6607, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.14% (0.2877 => 0.3140, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.09% (0.7326 => 0.7992, std.dev.: 0.0045) SingleSource/Regression/C++/ofstream_ctor: 9.09% (0.2905 => 0.3169, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.01% (0.3650 => 0.3979, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.99% (0.2725 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.97% (1.2842 => 1.3994, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 8.81% (0.2714 => 0.2953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.79% (0.3162 => 0.3440, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.39% (0.3052 => 0.3308, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.36% (0.3935 => 0.4264, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.3136 => 0.3395, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 7.92% (63.2438 => 68.2527, std.dev.: 0.0349) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.08% (2.2022 => 2.3581, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.07% (7.9617 => 8.2065, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2521, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6958, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.80% (0.2944 => 0.3262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3565, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4514, std.dev.: 0.0076) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (3.1578 => 3.3158, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.86% (3.6395 => 3.7800, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.63% (2.0360 => 2.1100, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9053, std.dev.: 0.0244) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2425, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 1.09% (1.4460 => 1.4617, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.08% (9.1159 => 9.2148, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5787, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.60% (5.2763 => 1.1818, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.48% (0.8651 => 0.2121, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.67% (5.3855 => 4.4338, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.93% (5.3526 => 4.4463, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -12.48% (10.4361 => 9.1332, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.41% (1.7609 => 1.6128, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -7.89% (54.1659 => 49.8908, std.dev.: 0.0293) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.59% (1.9577 => 0.6737, std.dev.: 0.0036) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.42% (1.5373 => 1.0236, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4282, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7737, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0085, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.62% (1.2258 => 0.9608) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.32% (2.5528 => 2.1363, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.61% (1.6925 => 1.4283, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7324, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -11.95% (1.2373 => 1.0895, std.dev.: 0.0273) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4920, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2886, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4759, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.84% (1.8329 => 1.7076, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.98% (1.6805 => 1.5800, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.95% (1.5835 => 1.5051, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.21% (10.2830 => 9.8499, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.96% (8.1563 => 7.8334, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1556) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.6994 => 3.6193, std.dev.: 0.0097) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2221, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0165) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0021) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 00:15:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 02:15:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130108081549.422F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7405?compare_to=7400&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7405, Order: 171839, Start Time: 2013-01-08 04:35:30, End Time: 2013-01-08 08:15:44 To: 7400, Order: 171805, Start Time: 2013-01-08 00:03:36, End Time: 2013-01-08 03:39:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 2 (22 on baseline) Added Tests: 0 (194 on baseline) Unchanged Tests: 1099 (710 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.34% (1.1277 => 1.1428, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.23% (3.1267 => 3.1652, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.09% (4.1517 => 4.1971, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.50% (2.5071 => 2.4444, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -1.01% (1.9691 => 1.9493, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.12% (0.0625 => 0.0882, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.28% (0.2969 => 0.3779, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.00% (0.4139 => 0.5215, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.41% (0.5900 => 0.7399, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.71% (0.4253 => 0.5304, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.38% (0.1620 => 0.2015, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.23% (0.4994 => 0.6204, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.58% (0.5000 => 0.6179, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 22.35% (1.5932 => 1.9493, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 21.62% (0.1619 => 0.1969) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.43% (0.1549 => 0.1881, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.16% (0.3903 => 0.4729, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 19.70% (0.1218 => 0.1458, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.61% (0.2014 => 0.2409, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.24% (0.4029 => 0.4804, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.88% (0.1462 => 0.1738, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.82% (0.3890 => 0.4622, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.79% (0.2736 => 0.3250, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.46% (0.2866 => 0.3395, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.33% (0.5826 => 0.6894, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.10% (0.5546 => 0.6550, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 17.98% (0.5889 => 0.6948, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.98% (0.3271 => 0.3859, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 17.85% (0.9697 => 1.1428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.81% (3.5627 => 4.1971, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.73% (1.8794 => 2.2127, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.71% (1.3152 => 1.5481, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.70% (0.2875 => 0.3384, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 17.49% (0.2813 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.48% (1.6211 => 1.9045, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 17.39% (0.2823 => 0.3314, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.27% (0.2750 => 0.3225, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.26% (0.4658 => 0.5462, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: 17.17% (0.2725 => 0.3193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.13% (0.2738 => 0.3207, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.12% (0.2792 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 17.10% (0.2714 => 0.3178, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.97% (0.2729 => 0.3192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.90% (0.2811 => 0.3286, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.84% (0.3004 => 0.3510, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.76% (0.2780 => 0.3246, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.73% (2.0673 => 2.4131, std.dev.: 0.0621) MultiSource/Applications/hexxagon/hexxagon: 16.59% (0.9909 => 1.1553, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.54% (0.3096 => 0.3608, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.52% (0.7171 => 0.8356, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.47% (4.4195 => 5.1472, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.41% (0.3930 => 0.4575, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.26% (0.5026 => 0.5843, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.24% (0.3060 => 0.3557, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 16.22% (0.3267 => 0.3797, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.11% (0.3258 => 0.3783, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.10% (0.3124 => 0.3627, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (0.4361 => 0.5063, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 16.07% (23.5202 => 27.3001, std.dev.: 0.5956) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.98% (2.7292 => 3.1652, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 15.95% (0.3317 => 0.3846, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.94% (0.3362 => 0.3898, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.85% (1.9694 => 2.2816, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.72% (0.3282 => 0.3798, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.56% (1.9966 => 2.3072, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/sieve: 15.49% (0.3726 => 0.4303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.47% (0.3348 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.47% (0.3678 => 0.4247, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.46% (1.0781 => 1.2448, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 15.33% (0.3477 => 0.4010, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.31% (0.3625 => 0.4180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.93% (0.3690 => 0.4241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.92% (0.3981 => 0.4575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.89% (0.4251 => 0.4884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 14.84% (4.2109 => 4.8358, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 14.77% (0.3460 => 0.3971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.76% (0.4146 => 0.4758, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 14.72% (0.3465 => 0.3975, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 14.67% (0.3496 => 0.4009, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.64% (0.3442 => 0.3946, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.41% (1.4269 => 1.6325, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.30% (0.3845 => 0.4395, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.29% (0.5012 => 0.5728, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.22% (0.3650 => 0.4169, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 14.10% (0.3724 => 0.4249, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.62% (0.1028 => 0.1168, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.47% (0.6435 => 0.7302, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 13.41% (0.7875 => 0.8931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.93% (0.2737 => 0.3091, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.56% (2.1653 => 2.4372, std.dev.: 0.0060) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2330, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 12.34% (4.6177 => 5.1874, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3561, std.dev.: 0.0684) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.2068 => 0.2318, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.2075 => 0.2323, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.61% (0.3084 => 0.3442, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.09% (0.3336 => 0.3706, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.02% (0.5361 => 0.5952, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.89% (0.2103 => 0.2332, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.64% (11.6398 => 12.8777, std.dev.: 0.1721) MultiSource/Applications/siod/siod: 10.55% (0.6634 => 0.7334, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.23% (4.6926 => 5.1725, std.dev.: 0.0083) MultiSource/Benchmarks/PAQ8p/paq8p: 10.09% (0.4847 => 0.5336, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.95% (0.2040 => 0.2243, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.75% (0.7426 => 0.8150, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 8.07% (0.2391 => 0.2584, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.90% (0.5584 => 0.6025, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.74% (0.1383 => 0.1490, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 7.51% (11.9555 => 12.8530, std.dev.: 0.0195) MultiSource/Applications/sqlite3/sqlite3: 7.43% (2.0346 => 2.1857, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.27% (0.3792 => 0.3992, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.91% (29.0505 => 181.5382, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.10% (0.3693 => 0.4029, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6722, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2385, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6751, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8864, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1906, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0800, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4813, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5943, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.29% (2.4764 => 2.4444, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5691, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.47% (17.2379 => 14.3983, std.dev.: 0.0258) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1019, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7885, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2169, std.dev.: 0.2014) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8052, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -3.22% (14.0481 => 13.5951, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1248, std.dev.: 0.1067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.66% (10.7630 => 10.5845, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1802, std.dev.: 0.0267) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 00:53:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 02:53:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108085301.119DF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7406?compare_to=7403&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7406, Order: 171842, Start Time: 2013-01-08 07:13:31, End Time: 2013-01-08 08:52:56 To: 7403, Order: 171841, Start Time: 2013-01-08 05:14:42, End Time: 2013-01-08 06:50:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (112 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1104 (834 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.64% (0.5456 => 1.1547, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.52% (0.5575 => 1.1681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.27% (0.5688 => 1.1903, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.22% (0.5567 => 1.1647, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.89% (0.5581 => 1.1658, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.91% (0.5805 => 1.2011, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.94% (0.6395 => 1.3170, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.39% (0.5941 => 1.2143, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.07% (0.5849 => 1.1936, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.01% (0.5859 => 1.1953, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.86% (0.6033 => 1.2299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.10% (0.6260 => 1.2714, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.00% (0.5478 => 1.0901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.24% (0.6189 => 1.2269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.63% (0.5570 => 1.1008, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.50% (0.5569 => 1.0999, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.17% (0.6440 => 1.2698, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.69% (0.5591 => 1.0997, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.45% (0.6304 => 1.2384, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.42% (0.5705 => 1.1206, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.69% (0.5802 => 1.1354, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.20% (0.6395 => 1.2483, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.89% (0.6676 => 1.2944, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.95% (0.5925 => 1.1432, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.91% (0.6230 => 1.2018, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.68% (0.5863 => 1.1297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.59% (0.5857 => 1.1280, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.07% (0.6052 => 1.1624, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.37% (0.6660 => 1.2745, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.76% (0.6194 => 1.1630, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.71% (0.6446 => 1.2100, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.55% (0.6297 => 1.1747, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.55% (0.6681 => 1.2196, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.69% (0.6667 => 1.2113, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.53% (0.7524 => 1.3658, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.81% (0.7339 => 1.2829, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.11% (0.0974 => 0.1579, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 47.07% (0.1500 => 0.2206, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.74% (0.0599 => 0.0867) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.44% (1.6474 => 2.2313, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.62% (0.0582 => 0.0766, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.74% (2.2587 => 2.9079, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.94% (0.5329 => 0.6498, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.09% (0.1081 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.06% (0.7021 => 0.8289, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 15.94% (0.3357 => 0.3892, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.48% (0.4916 => 0.5677, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 14.49% (1.1450 => 1.3109, std.dev.: 0.0402) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.44% (4.5069 => 5.1126, std.dev.: 0.1391) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.67% (0.4515 => 0.5087, std.dev.: 0.0159) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.64% (0.2001 => 0.2234, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.29% (1.6364 => 1.8211, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.99% (0.2385 => 0.2647, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/chomp: 10.51% (0.1761 => 0.1946, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 10.39% (0.3319 => 0.3664, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.28% (3.5339 => 3.8973, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1441 => 0.1551, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.22% (0.1731 => 0.1856, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.95% (1.2515 => 1.3385, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 6.87% (9.2283 => 9.8621, std.dev.: 0.0102) MultiSource/Applications/oggenc/oggenc: 5.73% (5.0226 => 5.3103, std.dev.: 0.0777) SingleSource/Benchmarks/Shootout-C++/matrix: 4.70% (0.3255 => 0.3408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (5.4682 => 5.5948, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 1.69% (0.6750 => 0.6864, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.47% (0.8418 => 0.8542, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.19% (22.4056 => 22.6725, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.08% (0.9557 => 0.9660, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6748, std.dev.: 0.0825) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.60% (0.9531 => 1.0160, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1932 => 3.3485, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.6767 => 12.1286, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4896, std.dev.: 0.0725) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3673, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1044, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (27.8210 => 28.4001, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.79% (3.6551 => 3.7204, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -6.26% (0.3194 => 0.2994, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.85% (0.3812 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -5.69% (0.3848 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.62% (0.3896 => 0.3677, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.53% (0.4033 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.05% (0.4199 => 0.3987, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: -4.73% (0.6347 => 0.6047, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.67% (0.7198 => 0.6862, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.49% (0.3142 => 0.3001, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.20% (0.3026 => 0.2899, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.13% (2.1713 => 2.0817, std.dev.: 0.0223) SingleSource/UnitTests/ObjC++/property-reference: -4.09% (0.7779 => 0.7461, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -4.03% (0.3025 => 0.2903, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.9542 => 0.9199, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.54% (0.4151 => 0.4004, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (2.4924 => 2.4074, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.26% (0.3931 => 0.3803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.20% (0.3621 => 0.3505, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1441, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.98% (0.4427 => 0.4295, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -2.75% (0.4248 => 0.4131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -2.64% (0.3788 => 0.3688, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.59% (6.7716 => 6.5964, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.43% (14.2083 => 13.8632, std.dev.: 0.0158) MultiSource/Applications/siod/siod: -2.18% (2.4021 => 2.3498, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.89% (1.2221 => 1.1990, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.47% (34.0927 => 33.5899, std.dev.: 0.0910) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.30% (1.8100 => 0.6824, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3128, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0658, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1804, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.24% (4.3779 => 3.4044, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1377, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2800, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1980, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.62% (0.5142 => 0.4596, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7815, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8711, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.51% (1.1594 => 1.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.16% (3.1919 => 3.0590, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.78% (1.3096 => 1.2601, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.67% (7.9763 => 7.7632, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.79% (1.6086 => 1.5798, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: -1.75% (3.7241 => 3.6591, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.50% (3.7092 => 3.6534, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4778, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.8776 => 4.8071, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.41% (2.3169 => 2.2843, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3549, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 04:21:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 06:21:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108122118.1D0E82A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7407?compare_to=7406&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7407, Order: 171845, Start Time: 2013-01-08 10:45:39, End Time: 2013-01-08 12:21:15 To: 7406, Order: 171842, Start Time: 2013-01-08 07:13:31, End Time: 2013-01-08 08:52:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (106 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1102 (805 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.53% (3.7650 => 3.8227, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.20% (1.0160 => 1.0282, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.77% (0.5456 => 1.1554, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.56% (0.5575 => 1.1683, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.43% (0.5567 => 1.1659, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.23% (0.5688 => 1.1901, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.85% (0.5581 => 1.1656, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.77% (0.5805 => 1.2003, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.91% (0.6395 => 1.3168, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.60% (0.5941 => 1.2155, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.07% (0.5849 => 1.1936, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.79% (0.5859 => 1.1940, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.68% (0.6033 => 1.2288, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.00% (0.6260 => 1.2708, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.85% (0.5478 => 1.0893, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.27% (0.6189 => 1.2271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.65% (0.5570 => 1.1009, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.43% (0.5569 => 1.0995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.07% (0.6440 => 1.2691, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.67% (0.5591 => 1.0996, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.54% (0.6304 => 1.2390, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.37% (0.5705 => 1.1203, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.69% (0.5802 => 1.1354, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.14% (0.6395 => 1.2479, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.05% (0.6676 => 1.2955, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.16% (0.5925 => 1.1445, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.92% (0.6230 => 1.2019, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.69% (0.5857 => 1.1286, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.55% (0.5863 => 1.1289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.27% (0.6052 => 1.1636, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.56% (0.6660 => 1.2758, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.74% (0.6446 => 1.2102, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.62% (0.6194 => 1.1621, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.52% (0.6297 => 1.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.52% (0.6681 => 1.2194, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.58% (0.6667 => 1.2106, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.31% (0.7524 => 1.3642, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.62% (0.0717 => 0.1252, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.56% (0.7339 => 1.2811, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.94% (0.0974 => 0.1587, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400) MultiSource/Benchmarks/FreeBench/neural/neural: 47.20% (0.1500 => 0.2208, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.52% (1.6474 => 2.2325, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.83% (0.0445 => 0.0600, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.78% (2.2587 => 2.9088, std.dev.: 0.0116) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 22.07% (0.5329 => 0.6505, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.09% (0.1081 => 0.1309, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.97% (0.7021 => 0.8283, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.00% (0.3357 => 0.3894, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.50% (0.4916 => 0.5678, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 14.58% (1.1450 => 1.3119, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0864 => 0.0985, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.51% (4.5069 => 5.1158, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 12.27% (0.4515 => 0.5069, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.31% (1.6364 => 1.8214, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.99% (0.2385 => 0.2647, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 10.79% (0.1761 => 0.1951, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.40% (3.5339 => 3.9013, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.70% (0.1441 => 0.1552, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.16% (0.1731 => 0.1855, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.11% (1.2515 => 1.3405, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 7.00% (9.2283 => 9.8739, std.dev.: 0.0041) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.45% (0.3319 => 0.3533, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.87% (1.2784 => 1.3535, std.dev.: 0.0074) MultiSource/Applications/oggenc/oggenc: 5.77% (5.0226 => 5.3123, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.53% (1.3864 => 1.4215, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.3722 => 1.4040, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.29% (5.4682 => 5.5932, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 1.70% (0.6750 => 0.6865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.69% (1.4642 => 1.4889, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.31% (0.8418 => 0.8528, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.21% (22.4056 => 22.6776, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.07% (0.9557 => 0.9659, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.60% (31.3723 => 55.7164, std.dev.: 0.0264) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9531 => 1.0282, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 4.22% (3.1932 => 3.3278, std.dev.: 0.0080) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.6767 => 12.1267, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4097, std.dev.: 0.1056) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3674, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1078, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 2.12% (3.7435 => 3.8227, std.dev.: 0.0171) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (27.8210 => 28.3988, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.83% (3.6551 => 3.7221, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6106, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4553, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.82% (0.3812 => 0.3590, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -5.72% (0.3848 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.52% (0.3896 => 0.3681, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: -5.41% (0.4176 => 0.3950, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.12% (0.4199 => 0.3984, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.95% (0.3821 => 0.3632, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.2428 => 0.2308, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -4.74% (0.6347 => 0.6046, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.72% (0.3323 => 0.3166, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4280 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.35% (0.9852 => 0.9423, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: -4.35% (0.2849 => 0.2725, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.24% (0.3205 => 0.3069, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.22% (0.3059 => 0.2930, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.15% (2.1713 => 2.0812, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.06% (0.3252 => 0.3120, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.90% (1.3148 => 1.2635, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.73% (0.4151 => 0.3996, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -3.65% (0.2989 => 0.2880, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.64% (0.3658 => 0.3525, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.62% (0.9542 => 0.9197, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.50% (0.6484 => 0.6257, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -3.44% (2.4924 => 2.4066, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.36% (0.3931 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.24% (0.4321 => 0.4181, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.89% (0.7919 => 0.7690, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.77% (20.7746 => 20.1997, std.dev.: 0.0265) MultiSource/Applications/sqlite3/sqlite3: -2.70% (17.1032 => 16.6406, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.70% (0.3849 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.68% (0.4248 => 0.4134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.67% (0.3788 => 0.3687, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -2.56% (0.7982 => 0.7778, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.46% (6.7716 => 6.6050, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: -2.45% (4.3330 => 4.2268, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.33% (14.2083 => 13.8776, std.dev.: 0.0191) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.31% (1.2210 => 1.1928, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.20% (1.0544 => 1.0312, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (1.2300 => 1.2036, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.14% (1.2221 => 1.1960, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -2.07% (2.4021 => 2.3523, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -2.05% (16.1920 => 15.8603, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: -1.68% (7.0961 => 6.9772, std.dev.: 0.0060) MultiSource/Applications/lua/lua: -1.65% (4.0594 => 3.9923, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: -1.56% (1.5610 => 1.5367, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.49% (34.0927 => 33.5838, std.dev.: 0.0448) MultiSource/Benchmarks/Prolangs-C/football/football: -1.35% (0.9179 => 0.9055, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: -1.22% (18.2933 => 18.0704, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.07% (8.0126 => 7.9269, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.61% (1.8100 => 0.6768, std.dev.: 0.0114) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.37% (1.3643 => 1.0318, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary2: -23.41% (0.0756 => 0.0579, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0612, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.48% (4.1024 => 3.1802, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4046, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.90% (2.5106 => 2.1366, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6843, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2797, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.37% (4.7378 => 4.1989, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8717, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.35% (1.1594 => 1.0974, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.55% (7.9763 => 7.7733, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6432, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.00% (1.6086 => 1.5765, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7092 => 3.6608, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.21% (4.8776 => 4.8186, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: -1.17% (1.4516 => 1.4346, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3550, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 04:47:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 06:47:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130108124705.A31682A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7408?compare_to=7405&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7408, Order: 171842, Start Time: 2013-01-08 09:11:27, End Time: 2013-01-08 12:47:03 To: 7405, Order: 171839, Start Time: 2013-01-08 04:35:30, End Time: 2013-01-08 08:15:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (194 on baseline) Unchanged Tests: 1103 (709 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.98% (125.6069 => 130.6101, std.dev.: 0.4691) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.48% (0.2969 => 0.3785, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.97% (0.5900 => 0.7432, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.80% (0.4139 => 0.5207, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.96% (0.4253 => 0.5272, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.95% (0.4994 => 0.6190, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.70% (0.5000 => 0.6185, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.0948 => 0.1162, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.69% (0.1549 => 0.1885, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 21.62% (1.5932 => 1.9377, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 21.62% (0.1619 => 0.1969, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.29% (0.3903 => 0.4734, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.61% (0.2014 => 0.2409, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.53% (0.4029 => 0.4816, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.2736 => 0.3256, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 18.85% (0.5826 => 0.6924, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.67% (0.2866 => 0.3401, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.53% (1.3152 => 1.5589, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.50% (0.2875 => 0.3407, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: 18.39% (0.5889 => 0.6972, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 18.27% (0.9697 => 1.1469, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.14% (0.5546 => 0.6552, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.12% (0.2792 => 0.3298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 18.04% (0.2750 => 0.3246, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.96% (3.5627 => 4.2025, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 17.90% (1.8794 => 2.2158, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.90% (0.2911 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.90% (0.2738 => 0.3228, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 17.87% (0.2725 => 0.3212, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: 17.84% (0.2803 => 0.3303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.83% (0.2714 => 0.3198, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.82% (0.3271 => 0.3854, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 17.77% (0.2813 => 0.3313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 17.75% (0.2823 => 0.3324, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.64% (1.6211 => 1.9071, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.63% (0.2729 => 0.3210, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.62% (2.0673 => 2.4316, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 17.61% (0.2811 => 0.3306, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.54% (0.3004 => 0.3531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.41% (0.2780 => 0.3264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.35% (0.4658 => 0.5466, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 17.25% (0.9909 => 1.1618, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.25% (0.3195 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 17.22% (0.3096 => 0.3629, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 17.11% (0.3267 => 0.3826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.07% (0.3258 => 0.3814, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.80% (0.3060 => 0.3574, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 16.68% (0.7171 => 0.8367, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.59% (4.4195 => 5.1525, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary2: 16.55% (0.3317 => 0.3866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.55% (0.3124 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.48% (0.3362 => 0.3916, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.41% (0.3930 => 0.4575, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 16.32% (0.3726 => 0.4334, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 16.22% (23.5202 => 27.3363, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/lists1: 16.22% (0.3477 => 0.4041, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.22% (0.3625 => 0.4213, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.18% (0.3282 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 16.16% (0.3348 => 0.3889, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 16.12% (0.3678 => 0.4271, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1690, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.92% (0.5026 => 0.5826, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.87% (1.9694 => 2.2820, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.70% (1.9966 => 2.3101, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.64% (0.3690 => 0.4267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.63% (0.4146 => 0.4794, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.60% (0.3981 => 0.4602, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.54% (1.0781 => 1.2456, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 15.48% (0.4251 => 0.4909, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.14% (0.3845 => 0.4427, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 15.10% (4.2109 => 4.8469, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 14.95% (0.3465 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.94% (0.3488 => 0.4009, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: 14.92% (0.3446 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.82% (0.3469 => 0.3983, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.70% (1.4269 => 1.6366, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 14.62% (0.5012 => 0.5745, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 14.52% (0.3650 => 0.4180, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.37% (0.3724 => 0.4259, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.30% (0.1028 => 0.1175, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.06% (0.6435 => 0.7340, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.70% (0.2737 => 0.3112, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.65% (0.7875 => 0.8950, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.66% (5.5417 => 6.2432, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 12.58% (2.1653 => 2.4378, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.57% (0.2068 => 0.2328, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.55% (0.3084 => 0.3471, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.33% (4.6177 => 5.1869, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: 12.12% (2.1013 => 2.3560, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: 12.04% (0.3498 => 0.3919, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 11.90% (0.2075 => 0.2322, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.66% (0.3336 => 0.3725, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.60% (0.2103 => 0.2347, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.42% (0.5361 => 0.5973, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.30% (11.6398 => 12.9556, std.dev.: 0.0079) MultiSource/Applications/siod/siod: 10.88% (0.6634 => 0.7356, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.74% (4.6926 => 5.1967, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.41% (0.7426 => 0.8199, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.56% (0.2040 => 0.2235, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.36% (0.5584 => 0.6051, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 8.15% (11.9555 => 12.9294, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 7.86% (0.2391 => 0.2579, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (0.1383 => 0.1491, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 7.55% (2.0346 => 2.1882, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.61% (29.0505 => 181.4511, std.dev.: 0.0392) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.53% (0.3693 => 0.4008, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 8.32% (0.2802 => 0.3035, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2445, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 4.99% (12.0509 => 12.6527, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-2: 4.76% (1.8057 => 1.8916, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6792, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5025, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1998, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2978, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2849, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0816, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2091, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4813, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5913, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5688, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.16% (17.2379 => 14.2798, std.dev.: 0.0597) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -8.16% (0.2402 => 0.2206, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8070, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2093, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8058, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -2.32% (14.0481 => 13.7218, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1783, std.dev.: 0.0816) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5815, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4999, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1837, std.dev.: 0.0698) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 05:06:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 07:06:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108130617.09BCF2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7409?compare_to=7404&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7409, Order: 171845, Start Time: 2013-01-08 10:52:25, End Time: 2013-01-08 13:06:13 To: 7404, Order: 171839, Start Time: 2013-01-08 04:36:55, End Time: 2013-01-08 06:50:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (220 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (605 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.36% (3.6193 => 3.6686, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1336 => 0.1336, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.29% (0.0684 => 0.0686, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8426 => 499.8231, std.dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44222.35% (1.1277 => 499.8231, std.dev.: 0.0160) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.21% (0.5229 => 1.6587, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.31% (14.9895 => 18.0342, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 44.07% (14.1553 => 20.3930, std.dev.: 0.0222) MultiSource/Benchmarks/MallocBench/gs/gs: 18.39% (4.1105 => 4.8663, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.83% (1.1048 => 1.7547, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.06% (7.1582 => 37.7999, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.28% (3.4629 => 6.3813, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.51% (0.6222 => 1.0920, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10225.28% (0.0720 => 7.4342, std.dev.: 0.0144) MultiSource/Applications/SIBsim4/SIBsim4: 3832000.00% (0.0001 => 3.8321, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11117700.00% (0.0001 => 11.1178, std.dev.: 0.0229) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908300.00% (0.0001 => 9.9084, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486100.00% (0.0001 => 5.4862, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.03% (1.1194 => 10.2540, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 149.03% (22.1758 => 55.2246, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0243 => 0.0486, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.26% (0.0929 => 0.1814, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 74.64% (0.1463 => 0.2555, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 70.85% (0.0271 => 0.0463, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.42% (1.5859 => 2.5599, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.59% (0.0439 => 0.0705, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 60.17% (0.0231 => 0.0370, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.43% (2.9384 => 4.6260, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.69% (7.0540 => 10.9821, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.29% (2.2024 => 3.3321, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.40% (0.5105 => 0.7627, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.62% (8.1363 => 12.0111, std.dev.: 0.0243) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 45.28% (0.0265 => 0.0385, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 42.10% (0.3109 => 0.4418, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 42.02% (21.9371 => 31.1548, std.dev.: 0.0985) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.51% (0.6675 => 0.9446, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 39.73% (0.1432 => 0.2001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.32% (0.1062 => 0.1469, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.24% (0.4615 => 0.6380, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.64% (4.2646 => 5.8696, std.dev.: 0.0090) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 35.05% (0.1655 => 0.2235, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.69% (1.5415 => 2.0609, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.33% (0.2271 => 0.3028, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.58% (0.1906 => 0.2527, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.46% (0.1337 => 0.1771, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 32.01% (0.4299 => 0.5675, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 30.01% (1.1642 => 1.5136, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.63% (0.0793 => 0.1020, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 27.59% (0.1555 => 0.1984, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.56% (0.1125 => 0.1435, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.40% (0.3121 => 0.3976, std.dev.: 0.0059) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 26.70% (0.2554 => 0.3236, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.48% (0.0457 => 0.0578, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.21% (3.8922 => 4.9124, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.37% (0.1695 => 0.2125, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.97% (1.0722 => 1.3399, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.67% (0.1143 => 0.1425, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.36% (1.4186 => 1.7642, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 24.31% (9.4845 => 11.7902, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 24.08% (5.7591 => 7.1459, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.56% (0.0675 => 0.0834, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.04% (0.0842 => 0.1036, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.89% (0.2700 => 0.3318, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.43% (1.3050 => 1.5977, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 22.42% (0.7115 => 0.8710, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.01% (0.3098 => 0.3780, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.44% (0.0886 => 0.1076, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.02% (0.7835 => 0.9482, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.76% (4.9449 => 5.9714, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.60% (0.1029 => 0.1241, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.51% (0.4636 => 0.5587, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.07% (0.5860 => 0.7036, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.91% (5.0018 => 5.9977, std.dev.: 0.0080) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 19.52% (1.1840 => 1.4151, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.48% (0.1940 => 0.2318, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 19.47% (0.6456 => 0.7713, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.46% (0.8172 => 0.9762, std.dev.: 0.0112) MultiSource/Applications/d/make_dparser: 19.42% (3.3354 => 3.9832, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 18.91% (0.4289 => 0.5100, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 18.70% (0.4620 => 0.5484, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.57% (0.5020 => 0.5952, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/18-imp/imp: 18.40% (0.3423 => 0.4053, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: 18.36% (0.7433 => 0.8798, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.17% (0.3307 => 0.3908, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.13% (0.2758 => 0.3258, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.96% (0.5569 => 0.6569, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.75% (0.9765 => 1.1498, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 17.67% (0.2049 => 0.2411, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 17.42% (0.3232 => 0.3795, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.35% (3.8723 => 4.5443, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary3: 17.30% (0.3283 => 0.3851, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.19% (2.0273 => 2.3757, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.94% (0.5981 => 0.6994, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.65% (0.8101 => 0.9450, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.19% (0.3441 => 0.3998, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 16.13% (2.2969 => 2.6674, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.02% (0.6450 => 0.7483, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 15.88% (0.3180 => 0.3685, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.79% (0.8921 => 1.0330, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.26% (1.1861 => 1.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.06% (0.3379 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.52% (0.8067 => 0.9238, std.dev.: 0.0153) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.86% (1.5603 => 1.7765, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.94% (0.4103 => 0.4634, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.78% (0.4203 => 0.4740, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: 12.75% (0.4048 => 0.4564, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.48% (0.1330 => 0.1496, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 12.35% (0.3603 => 0.4048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 11.99% (0.1268 => 0.1420, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.78% (0.3684 => 0.4118, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.76% (0.3826 => 0.4276, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.57% (10.3673 => 11.5667, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.54% (0.4064 => 0.4533, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: 11.42% (0.3092 => 0.3445, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.35% (14.3668 => 15.9981, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: 11.32% (17.1811 => 19.1260, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3427 => 0.3808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.87% (0.2871 => 0.3183, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.72% (0.3694 => 0.4090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.68% (0.1892 => 0.2094, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.49% (0.2831 => 0.3128, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (2.0665 => 2.2774, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 9.98% (0.6030 => 0.6632, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.81% (0.1438 => 0.1579, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: 9.72% (1.2842 => 1.4090, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.66% (0.2877 => 0.3155, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.60% (0.5925 => 0.6494, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.48% (0.3650 => 0.3996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.47% (0.2756 => 0.3017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.42% (0.7326 => 0.8016, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 9.29% (0.2905 => 0.3175, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2725 => 0.2978, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2793 => 0.3051, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.11% (0.3162 => 0.3450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.10% (0.2714 => 0.2961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.85% (0.2802 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.74% (0.3136 => 0.3410, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.56% (0.3935 => 0.4272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.22% (63.2438 => 68.4395, std.dev.: 0.0672) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.93% (2.2022 => 2.3768, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.22% (7.9617 => 8.2181, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.11% (32.5116 => 59.2071, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.24% (1.1396 => 1.2449, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3567, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4605, std.dev.: 0.0060) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.98% (3.1578 => 3.3152, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.09% (3.6395 => 3.7884, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.66% (2.0360 => 2.1105, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.6802 => 8.9210, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.11% (0.9957 => 1.0167, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2426, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.06% (9.1159 => 9.2129, std.dev.: 0.0234) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.57% (5.2763 => 1.1833, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -75.42% (0.8651 => 0.2126, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.11% (5.3855 => 4.4639, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.44% (5.3526 => 4.4727, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -12.61% (10.4361 => 9.1201, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.15% (1.7609 => 1.6173, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -7.47% (54.1659 => 50.1198, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.73% (1.9577 => 0.6514, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4208, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7748, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0071, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -22.88% (0.0756 => 0.0583, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.62% (1.2258 => 0.9608, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.47% (2.5528 => 2.1323, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -11.67% (1.2373 => 1.0929, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4914, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4258, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.17% (19.9488 => 18.3185, std.dev.: 0.0869) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4756, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5736, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.29% (10.2830 => 9.8415, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.14% (8.1563 => 7.8187, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2301, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.58% (0.2116 => 0.0686, std.dev.: 0.0014) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 06:20:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 08:20:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108142019.931242A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7410?compare_to=7407&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7410, Order: 171846, Start Time: 2013-01-08 12:45:04, End Time: 2013-01-08 14:20:17 To: 7407, Order: 171845, Start Time: 2013-01-08 10:45:39, End Time: 2013-01-08 12:21:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (104 on baseline) Performance Improvements: 0 (138 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1102 (802 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.67% (27.5335 => 29.6457, std.dev.: 0.0240) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.13% (1.2589 => 1.2857, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.64% (0.5456 => 1.1547, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.40% (0.5575 => 1.1674, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.14% (0.5567 => 1.1643, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.09% (0.5688 => 1.1893, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.91% (0.5581 => 1.1659, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.70% (0.5805 => 1.1999, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.00% (0.6395 => 1.3174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.28% (0.5941 => 1.2136, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.07% (0.5849 => 1.1936, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.83% (0.6033 => 1.2297, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.69% (0.5859 => 1.1934, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 102.72% (0.6260 => 1.2690, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.96% (0.5478 => 1.0899, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.22% (0.6189 => 1.2268, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.76% (0.5570 => 1.1015, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.32% (0.5569 => 1.0989, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.13% (0.6440 => 1.2695, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.84% (0.6304 => 1.2409, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.58% (0.5591 => 1.0991, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.30% (0.5705 => 1.1199, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.66% (0.5802 => 1.1352, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.14% (0.6395 => 1.2479, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.02% (0.6676 => 1.2953, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.93% (0.5925 => 1.1431, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.86% (0.6230 => 1.2015, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.73% (0.5863 => 1.1300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.66% (0.5857 => 1.1284, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.02% (0.6052 => 1.1621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.41% (0.6660 => 1.2748, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.64% (0.6446 => 1.2095, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.62% (0.6194 => 1.1621, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.61% (0.6297 => 1.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.40% (0.6681 => 1.2186, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.76% (0.6667 => 1.2118, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.25% (0.7524 => 1.3637, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.90% (0.7339 => 1.2836, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.90% (0.0717 => 0.1254, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.32% (0.0974 => 0.1581, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 47.07% (0.1500 => 0.2206, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.51% (0.0693 => 0.0946, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.67% (1.6474 => 2.2350, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.83% (0.0445 => 0.0600, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.94% (2.2587 => 2.9123, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.40% (0.0622 => 0.0780, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.15% (0.0621 => 0.0771, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.81% (0.5329 => 0.6491, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.28% (0.1081 => 0.1311) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.10% (0.7021 => 0.8292, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.91% (0.3357 => 0.3891, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.44% (0.4916 => 0.5675, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.32% (1.1450 => 1.3090, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.39% (4.5069 => 5.1104, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 12.40% (0.4515 => 0.5075, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.74% (0.2001 => 0.2236, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.18% (1.6364 => 1.8193, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.94% (0.2385 => 0.2646, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 10.56% (0.1761 => 0.1947, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.39% (3.5339 => 3.9012, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.28% (0.1731 => 0.1857, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.01% (1.2515 => 1.3392, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.93% (9.2283 => 9.8676, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.36% (0.3319 => 0.3530, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.68% (5.0226 => 5.3077, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.62% (1.2784 => 1.3503, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.30% (0.3255 => 0.3395, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.57% (1.3864 => 1.4220, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.3722 => 1.4046, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.16% (5.4682 => 5.5863, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 1.60% (0.6750 => 0.6858, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.58% (1.4642 => 1.4874, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.44% (0.8418 => 0.8539, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.09% (22.4056 => 22.6509, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.59% (31.3723 => 55.7142, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.97% (0.9531 => 1.0195, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 4.47% (3.1932 => 3.3359, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 3.84% (11.6767 => 12.1253, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.34% (2.0478 => 2.1161, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.28% (5.1955 => 5.3658, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.5751 => 56.3358, std.dev.: 0.1176) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3977, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6551 => 3.7284, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6079, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4579, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.54% (0.3194 => 0.2985, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.47% (0.3837 => 0.3627, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.27% (0.4176 => 0.3956, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -5.23% (0.4033 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.00% (0.3821 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.95% (0.4199 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.77% (0.2871 => 0.2734, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.74% (0.3057 => 0.2912) SingleSource/UnitTests/ObjC++/Hello: -4.65% (0.6347 => 0.6052, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.58% (0.7198 => 0.6868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.56% (0.2849 => 0.2719, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.51% (0.4280 => 0.4087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.26% (2.1713 => 2.0787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.24% (0.9852 => 0.9434, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -4.18% (0.7779 => 0.7454, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -4.02% (1.3148 => 1.2620, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -3.73% (2.4924 => 2.3994, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.66% (0.4151 => 0.3999, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.9542 => 0.9196, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.49% (0.3931 => 0.3794, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.48% (0.3621 => 0.3495, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.47% (0.6484 => 0.6259, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.40% (0.4321 => 0.4174, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.16% (0.7919 => 0.7669, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.12% (0.4427 => 0.4289, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.11% (20.7746 => 20.1279, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.09% (0.3849 => 0.3730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -2.85% (0.3788 => 0.3680, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.81% (17.1032 => 16.6222, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: -2.76% (4.3330 => 4.2134, std.dev.: 0.0094) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (0.7982 => 0.7771, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.55% (0.4083 => 0.3979, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.55% (1.2210 => 1.1899, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.48% (6.7716 => 6.6035, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.45% (14.2083 => 13.8599, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0302, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1944, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -2.18% (2.4021 => 2.3497, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.15% (1.2300 => 1.2035, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -2.09% (16.1920 => 15.8532, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.89% (0.8521 => 0.8360, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.78% (7.0961 => 6.9697, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -1.62% (4.0594 => 3.9935, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: -1.50% (1.5610 => 1.5376, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -1.39% (34.0927 => 33.6198, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: -1.37% (0.9179 => 0.9053, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -1.23% (18.2933 => 18.0682, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: -1.11% (2.1401 => 2.1164, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.0126 => 7.9257, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: -1.01% (15.2527 => 15.0985, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.25% (1.8100 => 0.6832, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3091, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.65% (1.3643 => 1.0280, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0589, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1789, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4054, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9609) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1382, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2804, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1977, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.34% (1.1594 => 1.0975, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3980, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7748, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: -2.31% (3.7241 => 3.6382, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.82% (1.3096 => 1.2857, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.65% (1.6086 => 1.5820, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8031, std.dev.: 0.0207) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.21% (1.4516 => 1.4340, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.07% (1.0443 => 1.0331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.01% (3.7092 => 3.6718, std.dev.: 0.0115) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 07:50:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 09:50:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108155026.651A72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7411?compare_to=7409&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7411, Order: 171846, Start Time: 2013-01-08 13:36:41, End Time: 2013-01-08 15:50:22 To: 7409, Order: 171845, Start Time: 2013-01-08 10:52:25, End Time: 2013-01-08 13:06:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (226 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (596 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/minisat/minisat: 1.23% (0.8710 => 0.8817, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (11.5667 => 11.3458, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1336 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.44% (0.0686 => 0.0683, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8231 => 499.8310, std.dev.: 0.0138) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.05% (1.1277 => 499.8310, std.dev.: 0.0138) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.95% (0.5229 => 1.6678, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 21.06% (14.9895 => 18.1466, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 44.82% (14.1553 => 20.4991, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 18.60% (4.1105 => 4.8752, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.83% (1.1048 => 1.7547, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.85% (7.1582 => 37.8562, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.34% (3.4629 => 6.4183, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.17% (0.6222 => 1.0961, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10226.11% (0.0720 => 7.4348, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3832100.00% (0.0001 => 3.8322, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11072400.00% (0.0001 => 11.0725, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908300.00% (0.0001 => 9.9084, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485900.00% (0.0001 => 5.4860, std.dev.: 0.0159) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.46% (1.1194 => 10.2477, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 149.01% (22.1758 => 55.2205, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0243 => 0.0486, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.05% (0.0929 => 0.1812, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 75.05% (0.1463 => 0.2561, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.85% (0.0271 => 0.0463) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.78% (1.5859 => 2.5657, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.82% (0.0439 => 0.0706) SingleSource/Regression/C/sumarray: 57.58% (0.0231 => 0.0364, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.04% (2.9384 => 4.6146, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.03% (7.0540 => 10.9356, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.85% (2.2024 => 3.3443, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 50.21% (0.5105 => 0.7668, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.58% (0.1056 => 0.1569, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.62% (8.1363 => 12.0111, std.dev.: 0.0161) SingleSource/UnitTests/Vector/multiplies: 46.24% (0.0279 => 0.0408) SingleSource/Benchmarks/Misc/dt: 44.91% (0.0265 => 0.0384) MultiSource/Applications/sgefa/sgefa: 42.59% (0.3109 => 0.4433, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 42.22% (0.6675 => 0.9493, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 41.52% (21.9371 => 31.0455, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 39.20% (0.4615 => 0.6424, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.70% (0.1062 => 0.1473, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.09% (4.2646 => 5.8889, std.dev.: 0.0094) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 36.86% (0.0814 => 0.1114, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 36.25% (0.1655 => 0.2255, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.66% (1.5415 => 2.0758, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.13% (0.2271 => 0.3046, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.91% (0.1337 => 0.1777, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.63% (0.1906 => 0.2528, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 32.26% (0.4299 => 0.5686, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 30.60% (1.1642 => 1.5205, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.63% (0.0793 => 0.1020, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.90% (0.1584 => 0.2026, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 27.85% (0.1555 => 0.1988, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.84% (0.3121 => 0.3990, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 26.98% (0.2554 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.39% (3.8922 => 4.9195, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.26% (0.0457 => 0.0577, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.02% (0.1695 => 0.2136, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 25.96% (0.1175 => 0.1480) MultiSource/Applications/lemon/lemon: 25.71% (1.0722 => 1.3479, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.37% (0.1143 => 0.1433, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.60% (1.4186 => 1.7676, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.59% (0.0675 => 0.0841, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 24.42% (5.7591 => 7.1653, std.dev.: 0.0082) MultiSource/Benchmarks/mafft/pairlocalalign: 24.41% (9.4845 => 11.7994, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.39% (0.1566 => 0.1948, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 23.92% (0.7115 => 0.8817, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.22% (0.2700 => 0.3327, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.99% (1.3050 => 1.6050, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 22.42% (0.0660 => 0.0808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 22.06% (0.1695 => 0.2069, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.93% (0.1236 => 0.1507, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.69% (0.3098 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.47% (0.0871 => 0.1058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.35% (0.7835 => 0.9508, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.07% (4.9449 => 5.9868, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.92% (0.4636 => 0.5606, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.34% (5.0018 => 6.0190, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 20.12% (3.3354 => 4.0064, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 20.03% (0.4289 => 0.5148, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 20.00% (1.1840 => 1.4208, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.00% (0.1940 => 0.2328, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 19.98% (0.1151 => 0.1381, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.97% (0.5860 => 0.7030, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 19.86% (0.6456 => 0.7738, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.51% (0.8172 => 0.9766, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.32% (0.2107 => 0.2514, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 19.21% (0.7433 => 0.8861, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.16% (0.5020 => 0.5982, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/18-imp/imp: 19.08% (0.3423 => 0.4076, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.94% (0.1510 => 0.1796, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 18.70% (0.4620 => 0.5484, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.35% (0.2758 => 0.3264, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.93% (0.9765 => 1.1516, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 17.93% (3.8723 => 4.5665, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.85% (0.5569 => 0.6563, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 17.72% (0.2049 => 0.2412, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 17.70% (2.0273 => 2.3862, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 17.51% (0.3232 => 0.3798, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.48% (0.2065 => 0.2426, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 17.09% (0.3283 => 0.3844, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.05% (0.1044 => 0.1222, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.94% (2.2969 => 2.6859, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.83% (0.8101 => 0.9464, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.37% (0.6450 => 0.7506, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 15.98% (0.8921 => 1.0347, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.72% (0.3180 => 0.3680, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.38% (1.1861 => 1.3685, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 15.15% (0.3379 => 0.3891, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.90% (0.8067 => 0.9269, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.35% (0.0704 => 0.0805, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 14.14% (1.5603 => 1.7810, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.14% (0.2603 => 0.2971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.02% (0.3865 => 0.4407, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.82% (0.4203 => 0.4742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.67% (0.4048 => 0.4561, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.63% (0.1330 => 0.1498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.16% (0.3603 => 0.4041, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 12.16% (17.1811 => 19.2697, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.13% (0.3092 => 0.3467, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.92% (14.3668 => 16.0799, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/lists1: 11.83% (0.3684 => 0.4120, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.79% (0.3886 => 0.4344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.71% (0.3826 => 0.4274, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.53% (0.3427 => 0.3822, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.44% (0.4064 => 0.4529, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.44% (0.2430 => 0.2708, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.15% (0.3828 => 0.4255, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 10.70% (0.3561 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 10.46% (0.2831 => 0.3127, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 10.24% (0.2871 => 0.3165, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.23% (0.1114 => 0.1228, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.80% (0.2877 => 0.3159, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.78% (2.0665 => 2.2687, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.6030 => 0.6602, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.44% (10.3673 => 11.3458, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 9.43% (1.2842 => 1.4053, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 9.36% (0.2905 => 0.3177, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.33% (0.2756 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2793 => 0.3050, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.16% (0.5925 => 0.6468, std.dev.: 0.0085) SingleSource/UnitTests/ObjC++/property-reference: 9.10% (0.7326 => 0.7993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.06% (0.2725 => 0.2972, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.95% (0.2714 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2891 => 0.3147, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 8.71% (0.2802 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3935 => 0.4271, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.51% (0.3136 => 0.3403, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: 8.23% (63.2438 => 68.4458, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.23% (2.2022 => 2.3614, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.47% (0.2266 => 0.2390, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (7.9617 => 8.2382, std.dev.: 0.0116) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2491, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3565, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.75% (4.2280 => 4.4712, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3144, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.67% (3.6395 => 3.7732, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.58% (2.0360 => 2.1088, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9106, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2430, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.18% (9.1159 => 9.2235, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5812, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: 1.07% (1.4460 => 1.4615, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.59% (5.2763 => 1.1826, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.45% (0.8651 => 0.2124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.80% (0.1622 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.51% (5.3855 => 4.4427, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.86% (5.3526 => 4.4499, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -12.38% (10.4361 => 9.1437, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.15% (1.7609 => 1.6173, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9408, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.82% (1.9577 => 0.6496, std.dev.: 0.0102) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.49% (1.5373 => 1.0224, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4289, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7718, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.32% (2.6546 => 2.0091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5896, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.04% (0.6223 => 0.5038, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.39% (2.5528 => 2.1344, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7325, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -11.93% (1.2373 => 1.0897, std.dev.: 0.0102) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4914, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2861, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4757, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.01% (1.6805 => 1.5795, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5024, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.21% (10.2830 => 9.8498, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.16% (8.1563 => 7.8167, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.12% (1.0554 => 1.0330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.6994 => 3.6247, std.dev.: 0.0178) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6696, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2280, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.72% (0.2116 => 0.0683, std.dev.: 0.0011) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 08:54:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 10:54:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108165407.97B7B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7412?compare_to=7410&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7412, Order: 171853, Start Time: 2013-01-08 15:17:54, End Time: 2013-01-08 16:53:10 To: 7410, Order: 171846, Start Time: 2013-01-08 12:45:04, End Time: 2013-01-08 14:20:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (106 on baseline) Performance Improvements: 0 (140 on baseline) Added Tests: 0 (60 on baseline) Unchanged Tests: 1103 (798 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.08% (0.3645 => 0.3903, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.69% (0.5456 => 1.1550, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.52% (0.5575 => 1.1681, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.30% (0.5567 => 1.1652, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.98% (0.5688 => 1.1887, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.65% (0.5581 => 1.1645, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.75% (0.5805 => 1.2002, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.71% (0.6395 => 1.3155, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.43% (0.5941 => 1.2145, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.92% (0.5849 => 1.1927, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.74% (0.5859 => 1.1937, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.68% (0.6033 => 1.2288, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.10% (0.6260 => 1.2714, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.74% (0.5478 => 1.0887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 97.98% (0.6189 => 1.2253, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.43% (0.5570 => 1.0997, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.34% (0.5569 => 1.0990, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.99% (0.6440 => 1.2686, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.66% (0.5591 => 1.0995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.48% (0.6304 => 1.2386, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.42% (0.5705 => 1.1206, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.59% (0.5802 => 1.1348, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.06% (0.6395 => 1.2474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.59% (0.6676 => 1.2924, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.08% (0.5925 => 1.1440, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.70% (0.6230 => 1.2005, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.68% (0.5857 => 1.1285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.39% (0.5863 => 1.1280, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.17% (0.6052 => 1.1630, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.55% (0.6660 => 1.2757, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.59% (0.6446 => 1.2092, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.44% (0.6194 => 1.1610, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.39% (0.6297 => 1.1737, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.52% (0.6681 => 1.2194, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.76% (0.6667 => 1.2118, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.27% (0.7524 => 1.3639, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.52% (0.7339 => 1.2808, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.48% (0.0717 => 0.1251, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.32% (0.0974 => 0.1581, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.93% (0.1500 => 0.2204, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.53% (0.0680 => 0.0942, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.94% (0.0693 => 0.0949, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.46% (1.6474 => 2.2315, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.96% (0.0582 => 0.0768, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.92% (2.2587 => 2.9120, std.dev.: 0.0094) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.82% (0.5329 => 0.6492, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.00% (0.1081 => 0.1308, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.96% (0.7021 => 0.8282, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.41% (0.0707 => 0.0823, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.88% (0.3357 => 0.3890, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.44% (0.4916 => 0.5675, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 14.32% (1.1450 => 1.3090, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.38% (4.5069 => 5.1097, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 12.25% (0.4515 => 0.5068, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.18% (1.6364 => 1.8194, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 10.62% (0.1761 => 0.1948, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.30% (3.5339 => 3.8980, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1441 => 0.1551, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.22% (0.1731 => 0.1856, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.94% (9.2283 => 9.8690, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 6.90% (1.2515 => 1.3378, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.54% (0.3319 => 0.3536, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 5.67% (5.0226 => 5.3072, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.63% (1.2784 => 1.3504, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.3255 => 0.3393, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.33% (1.3864 => 1.4187, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.3722 => 1.4036, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (5.4682 => 5.5866, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4642 => 1.4878, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 1.54% (0.6750 => 0.6854, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.47% (0.8418 => 0.8542, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (22.4056 => 22.6536, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6685, std.dev.: 0.0338) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.99% (0.9531 => 1.0197, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 4.35% (3.1932 => 3.3320, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.6767 => 12.1274, std.dev.: 0.0049) MultiSource/Benchmarks/llubenchmark/llu: 3.77% (3.7435 => 3.8847, std.dev.: 0.0514) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5207, std.dev.: 0.0721) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.31% (5.1955 => 5.3676, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3978, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6551 => 3.7282, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.5320 => 4.6083, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.42% (79.7170 => 80.8481, std.dev.: 0.4354) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.42% (0.3194 => 0.2989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -5.66% (0.3831 => 0.3614, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.59% (0.3880 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.54% (0.3884 => 0.3669, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -5.52% (0.3896 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.32% (0.4176 => 0.3954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.05% (0.3821 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.98% (0.4199 => 0.3990, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2428 => 0.2309, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.60% (0.4280 => 0.4083, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.3205 => 0.3059, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.43% (0.2933 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.39% (0.3142 => 0.3004, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/random: -4.39% (0.2939 => 0.2810, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.36% (0.7779 => 0.7440, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -4.35% (0.6441 => 0.6161, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.30% (0.3025 => 0.2895, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.29% (0.9852 => 0.9429, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.25% (2.1713 => 2.0790, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.09% (0.3252 => 0.3119, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.01% (1.3148 => 1.2621, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.85% (0.3658 => 0.3517, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.76% (0.4151 => 0.3995, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.75% (2.4924 => 2.3989, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.70% (0.9542 => 0.9189, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.65% (0.2989 => 0.2880, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.51% (0.3931 => 0.3793, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.45% (0.3621 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.38% (0.4321 => 0.4175, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.12% (0.3849 => 0.3729, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.09% (0.4427 => 0.4290, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1560, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/moments: -2.94% (0.4248 => 0.4123, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.86% (17.1032 => 16.6141, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sieve: -2.85% (0.3788 => 0.3680, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.74% (0.7919 => 0.7702, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -2.74% (4.3330 => 4.2144, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.66% (1.2210 => 1.1885, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -2.64% (0.7982 => 0.7771, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.57% (0.4083 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.53% (6.7716 => 6.6002, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (1.2221 => 1.1922, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.43% (14.2083 => 13.8627, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.35% (1.0544 => 1.0296, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.21% (1.2300 => 1.2028, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -2.20% (2.4021 => 2.3493, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8397, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.92% (0.5999 => 0.5884, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8521 => 0.8361, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -1.71% (7.0961 => 6.9748, std.dev.: 0.0108) MultiSource/Applications/lua/lua: -1.55% (4.0594 => 3.9966, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.40% (1.5610 => 1.5391, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: -1.38% (0.9179 => 0.9052, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.35% (34.0927 => 33.6336, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: -1.29% (18.2933 => 18.0566, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.28% (0.9077 => 0.8961, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.12% (8.0126 => 7.9227, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -1.04% (15.2527 => 15.0944, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.12% (1.8100 => 0.6856, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1626, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.02% (8.0445 => 5.3076, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0259, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.57% (4.3504 => 3.3249, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0648, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.17% (5.3397 => 4.1027, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2953, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1799, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4053, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.97% (0.6299 => 0.5041, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.83% (2.5106 => 2.1382, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6847, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2796, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1986, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8715, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.27% (1.1594 => 1.0867, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.23% (1.7753 => 1.7002, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1731, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.71% (1.3096 => 1.2741, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7777, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: -2.37% (3.7241 => 3.6357, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.72% (1.6086 => 1.5809, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.44% (4.8776 => 4.8072, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4354, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.11% (1.0443 => 1.0327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6681, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3551, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.02% (1.6219 => 1.6054, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 09:15:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 11:15:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130108171540.674C32A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7413?compare_to=7408&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7413, Order: 171846, Start Time: 2013-01-08 13:38:58, End Time: 2013-01-08 17:14:29 To: 7408, Order: 171842, Start Time: 2013-01-08 09:11:27, End Time: 2013-01-08 12:47:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (194 on baseline) Unchanged Tests: 1103 (711 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.40% (130.6101 => 128.7786, std.dev.: 0.5293) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.38% (0.2969 => 0.3782, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.08% (0.5900 => 0.7439, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.78% (0.4139 => 0.5206, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.63% (0.1620 => 0.2019, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.53% (0.4994 => 0.6219, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.79% (0.4253 => 0.5265, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 21.86% (1.5932 => 1.9414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.31% (0.1619 => 0.1964, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.30% (0.1549 => 0.1879, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.09% (0.3903 => 0.4726, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.63% (0.2736 => 0.3273, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.61% (0.3890 => 0.4653, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.41% (0.2014 => 0.2405, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.38% (0.4029 => 0.4810, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.69% (0.5826 => 0.6915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.2866 => 0.3397, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.37% (0.2875 => 0.3403, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.32% (0.5889 => 0.6968, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.14% (0.5546 => 0.6552, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 17.91% (0.2714 => 0.3200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 17.87% (0.2803 => 0.3304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.86% (0.2738 => 0.3227, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.84% (0.2792 => 0.3290, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.83% (0.9697 => 1.1426, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.83% (3.5627 => 4.1979, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: 17.82% (1.8794 => 2.2144, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 17.82% (0.2750 => 0.3240, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 17.80% (0.2725 => 0.3210, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.77% (0.2729 => 0.3214, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.67% (0.3271 => 0.3849, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 17.53% (0.2823 => 0.3318, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.53% (1.3152 => 1.5457, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.49% (0.2911 => 0.3420, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.43% (1.6211 => 1.9036, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 17.42% (0.2813 => 0.3303, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 17.36% (0.2811 => 0.3299, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.28% (0.3004 => 0.3523, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.23% (2.0673 => 2.4235, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.20% (0.4658 => 0.5459, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 17.15% (0.3096 => 0.3627, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.05% (0.2780 => 0.3254, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.94% (0.9909 => 1.1588, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.65% (0.3267 => 0.3811, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 16.59% (0.7171 => 0.8361, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 16.51% (0.3258 => 0.3796, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.47% (0.3060 => 0.3564, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.47% (0.1421 => 0.1655, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 16.37% (0.3317 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.36% (4.4195 => 5.1426, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.28% (0.3930 => 0.4570, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.25% (23.5202 => 27.3413, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.24% (0.5026 => 0.5842, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.23% (0.3124 => 0.3631, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 16.13% (0.3477 => 0.4038, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 16.04% (0.3348 => 0.3885, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.03% (0.3362 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 15.96% (0.3678 => 0.4265, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.94% (0.4361 => 0.5056, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.92% (0.3625 => 0.4202, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 15.86% (0.3726 => 0.4317, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.85% (2.7292 => 3.1619, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.85% (0.3690 => 0.4275, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.78% (1.9694 => 2.2801, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.74% (1.9966 => 2.3109, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.72% (0.3282 => 0.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.41% (0.4146 => 0.4785, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 15.39% (1.0781 => 1.2440, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.37% (0.3981 => 0.4593, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 15.24% (0.4251 => 0.4899, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 15.09% (4.2109 => 4.8462, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.08% (0.3845 => 0.4425, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.79% (0.3496 => 0.4013, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.77% (0.3446 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3488 => 0.4003, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 14.75% (0.3465 => 0.3976, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.69% (1.4269 => 1.6365, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3460 => 0.3967, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.53% (0.5012 => 0.5740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.11% (0.1028 => 0.1173, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.85% (0.6435 => 0.7326, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.59% (0.7875 => 0.8945, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.48% (0.2737 => 0.3106, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.58% (5.5417 => 6.2390, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 12.46% (2.1653 => 2.4350, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.25% (4.6177 => 5.1835, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.13% (0.3084 => 0.3458, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 11.95% (2.1013 => 2.3525, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 11.90% (0.2075 => 0.2322, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.75% (0.3498 => 0.3909, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.63% (0.3336 => 0.3724, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.55% (0.2103 => 0.2346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.49% (0.5361 => 0.5977, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.29% (11.6398 => 12.9541, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.86% (4.6926 => 5.2021, std.dev.: 0.0035) MultiSource/Applications/siod/siod: 10.78% (0.6634 => 0.7349, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.50% (0.7426 => 0.8206, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.61% (0.2040 => 0.2236, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.74% (0.5584 => 0.6072, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.14% (11.9555 => 12.9287, std.dev.: 0.0233) MultiSource/Applications/lemon/lemon: 7.95% (0.2391 => 0.2581, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 7.64% (2.0346 => 2.1900, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.1383 => 0.1488, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.22% (0.3792 => 0.3990, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5313, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3693 => 0.4014, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2355, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6689, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6861, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.53% (1.8057 => 1.8875, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2089, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0814, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2080, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5823, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4769, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.41% (2.4764 => 2.4415, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5764, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.95% (17.2379 => 14.3164, std.dev.: 0.0431) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7935, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2311, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8087, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.1978, std.dev.: 0.0638) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.83% (0.6293 => 0.6178, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.81% (10.7630 => 10.5684, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2320, std.dev.: 0.0547) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0489, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 10:34:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 12:34:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108183431.9949B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7414?compare_to=7411&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7414, Order: 171857, Start Time: 2013-01-08 16:20:42, End Time: 2013-01-08 18:34:28 To: 7411, Order: 171846, Start Time: 2013-01-08 13:36:41, End Time: 2013-01-08 15:50:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (227 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (194 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (595 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.18% (0.4025 => 0.4475, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.23% (10.2477 => 10.4758, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.4931 => 56.6059, std.dev.: 0.0421) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.90% (0.0683 => 0.0696, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8310 => 499.8373, std.dev.: 0.0135) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.61% (1.1277 => 499.8373, std.dev.: 0.0135) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.99% (0.5229 => 1.6680, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 21.18% (14.9895 => 18.1637, std.dev.: 0.0218) MultiSource/Applications/kimwitu++/kc: 44.73% (14.1553 => 20.4865, std.dev.: 0.0335) MultiSource/Benchmarks/MallocBench/gs/gs: 18.82% (4.1105 => 4.8841, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 59.41% (1.1048 => 1.7612, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.71% (7.1582 => 37.8462, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.23% (3.4629 => 6.4143, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.25% (0.6222 => 1.0966, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.19% (0.0720 => 7.4399, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 3832400.00% (0.0001 => 3.8325, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11066900.00% (0.0001 => 11.0670, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908500.00% (0.0001 => 9.9086, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487800.00% (0.0001 => 5.4879, std.dev.: 0.0090) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 835.84% (1.1194 => 10.4758, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 151.22% (22.1758 => 55.7098, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 100.41% (0.0243 => 0.0487) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.48% (0.0929 => 0.1816, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 80.74% (0.0296 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 75.05% (0.1463 => 0.2561, std.dev.: 0.0034) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 66.23% (0.0231 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.74% (1.5859 => 2.5651, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.82% (0.0439 => 0.0706, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.12% (2.9384 => 4.6168, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.15% (7.0540 => 10.9443, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.92% (2.2024 => 3.3459, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 51.52% (0.0394 => 0.0597, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 50.26% (0.5105 => 0.7671, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.25% (8.1363 => 12.0619, std.dev.: 0.0103) SingleSource/UnitTests/Vector/multiplies: 46.24% (0.0279 => 0.0408) SingleSource/Benchmarks/Misc/dt: 45.28% (0.0265 => 0.0385) MultiSource/Applications/sgefa/sgefa: 43.07% (0.3109 => 0.4448, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 42.88% (0.0730 => 0.1043, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 42.20% (0.6675 => 0.9492, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 41.76% (21.9371 => 31.0973, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: 39.39% (0.1432 => 0.1996, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 39.24% (0.4615 => 0.6426, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.79% (0.1062 => 0.1474, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.21% (4.2646 => 5.8943, std.dev.: 0.0099) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 36.86% (0.0814 => 0.1114, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 36.31% (0.1655 => 0.2256, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.50% (1.5415 => 2.0733, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.47% (0.2271 => 0.3031, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.69% (0.1906 => 0.2529, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 32.54% (0.4299 => 0.5698, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.46% (0.1337 => 0.1771, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.52% (0.0479 => 0.0630, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.82% (1.1642 => 1.5230, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.00% (0.0793 => 0.1023, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 28.10% (0.1555 => 0.1992, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.82% (0.1125 => 0.1438, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.62% (0.3121 => 0.3983, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/08-main/main: 27.17% (0.2554 => 0.3248, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.77% (0.1584 => 0.2008, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.54% (3.8922 => 4.9251, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.08% (0.1695 => 0.2137, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 26.04% (0.1175 => 0.1481, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.77% (0.0842 => 0.1059, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 25.72% (1.0722 => 1.3480, std.dev.: 0.0156) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.46% (0.1143 => 0.1434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.74% (1.4186 => 1.7696, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 24.59% (9.4845 => 11.8171, std.dev.: 0.0144) MultiSource/Applications/oggenc/oggenc: 24.56% (5.7591 => 7.1734, std.dev.: 0.0125) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.44% (0.0675 => 0.0840, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.15% (0.2700 => 0.3352, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 23.65% (0.7115 => 0.8798, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 23.62% (0.0614 => 0.0759, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.00% (1.3050 => 1.6051, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.92% (0.0672 => 0.0826, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 22.58% (0.0660 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 22.36% (0.1163 => 0.1423, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (0.3098 => 0.3781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.01% (0.1236 => 0.1508, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.76% (0.7835 => 0.9540, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.47% (0.0871 => 0.1058, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.40% (4.9449 => 6.0030, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.86% (0.0834 => 0.1008, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.83% (0.1032 => 0.1247, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.61% (5.0018 => 6.0328, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.49% (0.4636 => 0.5586, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.48% (0.5860 => 0.7060, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 20.47% (0.1695 => 0.2042, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 20.23% (1.1840 => 1.4235, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 20.22% (3.3354 => 4.0097, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 19.93% (0.4289 => 0.5144, std.dev.: 0.0074) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 19.78% (0.7433 => 0.8903, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 19.75% (0.6456 => 0.7731, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.73% (0.0953 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.57% (0.8172 => 0.9771, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.52% (0.5020 => 0.6000, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.51% (0.2758 => 0.3296, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 19.46% (0.3423 => 0.4089, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.98% (0.2107 => 0.2507, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 18.93% (0.1268 => 0.1508, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 18.87% (0.4620 => 0.5492, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.71% (0.1117 => 0.1326, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.68% (0.1510 => 0.1792, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.57% (0.3307 => 0.3921, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.48% (0.5569 => 0.6598, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.12% (0.9765 => 1.1534, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 18.08% (3.8723 => 4.5723, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: 18.07% (2.0273 => 2.3936, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.92% (0.2065 => 0.2435, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 17.67% (0.2049 => 0.2411, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.62% (0.1044 => 0.1228, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 17.36% (0.3232 => 0.3793, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 17.06% (0.3283 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.97% (0.5981 => 0.6996, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 16.90% (2.2969 => 2.6851, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.62% (0.8101 => 0.9447, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.45% (0.6450 => 0.7511, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.33% (0.3441 => 0.4003, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.98% (0.8921 => 1.0347, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: 15.94% (0.3180 => 0.3687, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.64% (1.1861 => 1.3716, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 15.18% (0.3379 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.03% (0.1144 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.88% (0.8067 => 0.9267, std.dev.: 0.0060) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.44% (0.2603 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.26% (0.3865 => 0.4416, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 14.08% (1.5603 => 1.7800, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 13.97% (0.3387 => 0.3860, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.43% (0.4103 => 0.4654, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 12.80% (0.4048 => 0.4566, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.75% (0.4203 => 0.4739, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 12.38% (0.3886 => 0.4367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 12.30% (0.3422 => 0.3843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.26% (0.3826 => 0.4295, std.dev.: 0.0081) MultiSource/Applications/sqlite3/sqlite3: 12.23% (17.1811 => 19.2827, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/sieve: 12.13% (0.3603 => 0.4040, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.00% (14.3668 => 16.0902, std.dev.: 0.0189) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.78% (0.3684 => 0.4118, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 11.59% (0.1268 => 0.1415, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.56% (0.2430 => 0.2711, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 11.52% (0.3473 => 0.3873, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.51% (0.3092 => 0.3448, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.46% (0.3561 => 0.3969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.43% (0.3516 => 0.3918, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.43% (0.3543 => 0.3948, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.40% (0.3543 => 0.3947, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.39% (0.4064 => 0.4527, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.38% (0.3427 => 0.3817, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.57% (0.1892 => 0.2092, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2831 => 0.3126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.34% (0.2871 => 0.3168, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.32% (0.1114 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.94% (0.1438 => 0.1581, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.93% (2.0665 => 2.2717, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 9.80% (0.6030 => 0.6621, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.74% (0.2905 => 0.3188, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.50% (0.5925 => 0.6488, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 9.47% (1.2842 => 1.4058, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 9.42% (10.3673 => 11.3437, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.40% (0.2756 => 0.3015, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7326 => 0.8009, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 9.32% (0.2877 => 0.3145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.23% (0.3650 => 0.3987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.13% (0.2793 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.10% (0.2725 => 0.2973, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.08% (0.3162 => 0.3449, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 8.92% (0.2714 => 0.2956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 8.89% (0.2802 => 0.3051, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.81% (0.2872 => 0.3125, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.70% (63.2438 => 68.7438, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.67% (0.3136 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.61% (0.3935 => 0.4274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.49% (0.3052 => 0.3311, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.48% (2.2022 => 2.3669, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.30% (0.4879 => 0.5235, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2266 => 0.2392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3817 => 0.3970, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.71% (7.9617 => 8.2567, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.18% (32.5116 => 59.2289, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3557, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (4.2280 => 4.4683, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3137, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.01% (3.6395 => 3.7853, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.60% (2.0360 => 2.1092, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.52% (8.6802 => 8.8986, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.27% (1.0313 => 1.0547, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2421, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.13% (9.1159 => 9.2191, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5756, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4517, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1701, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.49% (5.2763 => 1.1876, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.16% (5.3855 => 4.4611, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.52% (5.3526 => 4.4686, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -12.24% (10.4361 => 9.1587, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.00% (1.7609 => 1.6201, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9491, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.78% (1.9577 => 0.6503, std.dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.01% (0.6962 => 0.3411, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3089, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4172, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7708, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.29% (2.6546 => 2.0099, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2953, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.27% (0.2161 => 0.1723, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.57% (2.5528 => 2.1298, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7359, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -11.23% (1.2373 => 1.0984, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.94% (1.5660 => 1.4260) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.44% (19.9488 => 18.2643, std.dev.: 0.0262) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4754, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5794, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8281, std.dev.: 0.0170) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.14% (8.1563 => 7.8185, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3300, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: -1.61% (3.6994 => 3.6398, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/ary3: -1.60% (3.7221 => 3.6625, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.11% (0.2116 => 0.0696, std.dev.: 0.0019) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 10:52:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 12:52:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108185216.D649F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7415?compare_to=7412&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7415, Order: 171865, Start Time: 2013-01-08 17:17:51, End Time: 2013-01-08 18:52:14 To: 7412, Order: 171853, Start Time: 2013-01-08 15:17:54, End Time: 2013-01-08 16:53:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (134 on baseline) Removed Tests: 48 (0 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1056 (853 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Removed Tests - Compile Time ---------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Removed Tests - Execution Time ------------------------------ SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.73% (0.5456 => 1.1552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.33% (0.5575 => 1.1670, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.16% (0.5567 => 1.1644, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.95% (0.5688 => 1.1885, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.58% (0.5581 => 1.1641, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.72% (0.5805 => 1.2000, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.80% (0.6395 => 1.3161, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.36% (0.5941 => 1.2141, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 104.03% (0.5849 => 1.1934, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.79% (0.5859 => 1.1940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.61% (0.6033 => 1.2284, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.19% (0.6260 => 1.2720, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.00% (0.5478 => 1.0901, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.01% (0.6189 => 1.2255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.65% (0.5570 => 1.1009, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.49% (0.5569 => 1.0998, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.16% (0.6440 => 1.2697, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.70% (0.6304 => 1.2400, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.55% (0.5591 => 1.0989, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.35% (0.5705 => 1.1202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.66% (0.5802 => 1.1352, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.15% (0.6395 => 1.2480, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.86% (0.6676 => 1.2942, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.13% (0.5925 => 1.1443, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.87% (0.6230 => 1.2016, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.60% (0.5863 => 1.1292, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.59% (0.5857 => 1.1280, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.17% (0.6052 => 1.1630, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.64% (0.6660 => 1.2763, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.64% (0.6446 => 1.2095, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.42% (0.6194 => 1.1609, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.52% (0.6297 => 1.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.50% (0.6681 => 1.2193, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.78% (0.6667 => 1.2119, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.29% (0.7524 => 1.3640, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.87% (0.0717 => 0.1261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.52% (0.7339 => 1.2808, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.42% (0.0974 => 0.1582, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 47.13% (0.1500 => 0.2207, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.65% (0.0693 => 0.0947) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.61% (1.6474 => 2.2340, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.96% (0.0582 => 0.0768) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.95% (2.2587 => 2.9126, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.82% (0.5329 => 0.6492, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.28% (0.1081 => 0.1311, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.15% (0.7021 => 0.8295, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.85% (0.3357 => 0.3889, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.48% (0.4916 => 0.5677, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 14.41% (1.1450 => 1.3100, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.52% (4.5069 => 5.1163, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 12.23% (0.4515 => 0.5067, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.74% (0.2001 => 0.2236, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.99% (0.2385 => 0.2647, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 10.62% (0.1761 => 0.1948, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.45% (3.5339 => 3.9031, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.77% (0.1441 => 0.1553, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 6.98% (1.2515 => 1.3389, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.95% (9.2283 => 9.8695, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.63% (0.3319 => 0.3539, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 5.78% (5.0226 => 5.3130, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.65% (1.2784 => 1.3506, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 4.33% (0.3255 => 0.3396, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.49% (1.3864 => 1.4209, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.3722 => 1.4041, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (5.4682 => 5.5866, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6750 => 0.6862, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.63% (0.8418 => 0.8555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4642 => 1.4878, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (22.4056 => 22.6592, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.13% (0.9557 => 0.9665, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7020, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.16% (0.9531 => 1.0213, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 4.36% (3.1932 => 3.3324, std.dev.: 0.0084) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.6767 => 12.1264, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.17% (54.5751 => 56.3073, std.dev.: 0.1644) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3978, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.81% (3.6551 => 3.7212, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 1.70% (4.5320 => 4.6091, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.58% (79.7170 => 80.9767, std.dev.: 0.1564) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.42% (0.3194 => 0.2989, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.64% (0.3831 => 0.3615, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.54% (0.3880 => 0.3665, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.45% (0.3891 => 0.3679, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.43% (0.3884 => 0.3673, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: -5.31% (0.4033 => 0.3819, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.20% (0.4176 => 0.3959, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.05% (0.3821 => 0.3628, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.3323 => 0.3165, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.62% (0.6347 => 0.6054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.60% (0.2849 => 0.2718, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.58% (0.2903 => 0.2770, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.54% (0.7198 => 0.6871, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -4.51% (0.4280 => 0.4087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.36% (0.2933 => 0.2805, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.33% (0.6441 => 0.6162, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3142 => 0.3006, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.27% (2.1713 => 2.0785, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.27% (0.9852 => 0.9431, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (0.3025 => 0.2899, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.05% (0.7779 => 0.7464, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -3.95% (1.3148 => 1.2628, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.69% (0.3658 => 0.3523, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.58% (0.9542 => 0.9200, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: -3.45% (0.3621 => 0.3496, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.41% (0.3931 => 0.3797, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.17% (20.7746 => 20.1166, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/lists1: -3.15% (0.3867 => 0.3745, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.12% (0.3849 => 0.3729, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.09% (0.4427 => 0.4290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.85% (0.4248 => 0.4127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -2.77% (0.3788 => 0.3683, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.75% (17.1032 => 16.6333, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -2.63% (4.3330 => 4.2191, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.56% (1.2210 => 1.1897, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.50% (1.2221 => 1.1915, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.49% (6.7716 => 6.6032, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (14.2083 => 13.8678, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -2.27% (0.7982 => 0.7801, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.24% (1.2300 => 1.2024, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -2.10% (16.1920 => 15.8521, std.dev.: 0.0120) MultiSource/Applications/siod/siod: -2.09% (2.4021 => 2.3518, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.84% (0.8521 => 0.8364, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.83% (0.5999 => 0.5889, std.dev.: 0.0042) MultiSource/Applications/JM/ldecod/ldecod: -1.73% (7.0961 => 6.9732, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.65% (4.0594 => 3.9923, std.dev.: 0.0134) MultiSource/Applications/hbd/hbd: -1.65% (1.5610 => 1.5352, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.44% (34.0927 => 33.6003, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/football/football: -1.41% (0.9179 => 0.9050, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.26% (0.9077 => 0.8963, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: -1.21% (18.2933 => 18.0712, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.10% (8.0126 => 7.9247, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.13% (1.8100 => 0.6855, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0646, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -23.28% (0.0756 => 0.0580, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.55% (4.1024 => 3.1772, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.25% (4.3779 => 3.4040, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.49% (1.2237 => 0.9607, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7251, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2807, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1987, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.80% (4.1534 => 3.8710, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.72% (1.1594 => 1.0931, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3830 => 5.1550, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0523, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.67% (3.7241 => 3.6247, std.dev.: 0.0188) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7684, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.12% (1.3096 => 1.2819, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.79% (1.6086 => 1.5798, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4630, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.57% (4.8776 => 4.8012, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.52% (1.6219 => 1.5973, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.29% (3.7092 => 3.6613, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: -1.16% (1.4516 => 1.4348, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.0443 => 1.0328, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 12:50:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 14:50:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108205015.A90362A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7416?compare_to=7415&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7416, Order: 171879, Start Time: 2013-01-08 19:15:44, End Time: 2013-01-08 20:50:07 To: 7415, Order: 171865, Start Time: 2013-01-08 17:17:51, End Time: 2013-01-08 18:52:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (140 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (848 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.33% (0.6855 => 0.7152, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.24% (0.5456 => 1.1525, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.09% (0.5575 => 1.1657, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.89% (0.5567 => 1.1629, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.68% (0.5688 => 1.1870, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.53% (0.5581 => 1.1638, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.82% (0.5805 => 1.2006, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.77% (0.6395 => 1.3159, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.91% (0.5941 => 1.2114, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.78% (0.5849 => 1.1919, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.64% (0.5859 => 1.1931, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.45% (0.6033 => 1.2274, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.02% (0.6260 => 1.2709, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.69% (0.5478 => 1.0884, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.37% (0.6189 => 1.2277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.81% (0.5569 => 1.1016, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.79% (0.5570 => 1.1017, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.94% (0.5591 => 1.1011, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 96.85% (0.6440 => 1.2677, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.38% (0.6304 => 1.2380, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.34% (0.5705 => 1.1201, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.05% (0.5802 => 1.1317, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.90% (0.6395 => 1.2464, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.60% (0.6676 => 1.2925, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.05% (0.5925 => 1.1438, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.00% (0.5857 => 1.1304, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.86% (0.6230 => 1.2015, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.35% (0.6052 => 1.1641, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.07% (0.5863 => 1.1261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.13% (0.6660 => 1.2729, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.15% (0.6194 => 1.1654, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.84% (0.6446 => 1.2044, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.61% (0.6297 => 1.1751, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.31% (0.6681 => 1.2180, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.60% (0.6667 => 1.2107, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.03% (0.7524 => 1.3621, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.76% (0.0717 => 0.1253, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.52% (0.7339 => 1.2808, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.65% (0.0514 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.63% (0.0974 => 0.1584, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 47.20% (0.1500 => 0.2208, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.57% (0.0599 => 0.0866, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.38% (0.0680 => 0.0941, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.51% (0.0693 => 0.0946, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.60% (1.6474 => 2.2338, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.79% (0.0582 => 0.0767, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.76% (2.2587 => 2.9082, std.dev.: 0.0096) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.24% (0.0622 => 0.0779, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.99% (0.0621 => 0.0770) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.97% (0.5329 => 0.6500, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.18% (0.1081 => 0.1310, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.19% (0.7021 => 0.8298, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.88% (0.3357 => 0.3890, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.70% (0.4916 => 0.5688, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 14.38% (1.1450 => 1.3096, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.47% (4.5069 => 5.1138, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 12.49% (0.4515 => 0.5079, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.44% (0.2001 => 0.2230, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.17% (1.6364 => 1.8192, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.03% (0.2385 => 0.2648, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 10.85% (0.1761 => 0.1952, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.34% (3.5339 => 3.8992, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.91% (0.1441 => 0.1555, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.67% (0.3834 => 0.4128, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.34% (0.1731 => 0.1858, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.08% (1.2515 => 1.3401, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.80% (9.2283 => 9.8554, std.dev.: 0.0120) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.30% (0.3319 => 0.3528, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.76% (1.2784 => 1.3520, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 5.25% (5.0226 => 5.2861, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.3255 => 0.3393, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4186, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.31% (5.4682 => 5.5946, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hash: 2.25% (0.4524 => 0.4626, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.3722 => 1.4030, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.56% (1.4642 => 1.4870, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 1.48% (0.8418 => 0.8543, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.30% (22.4056 => 22.6969, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.23% (0.9557 => 0.9675, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.50% (31.3723 => 55.6868, std.dev.: 0.0413) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.64% (0.9531 => 1.0164, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 4.33% (3.1932 => 3.3315, std.dev.: 0.0108) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.6767 => 12.1274, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5751 => 56.4583, std.dev.: 0.1059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1054, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3980, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6551 => 3.7226, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6110, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.83% (0.3194 => 0.2976, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.40% (0.3812 => 0.3568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.34% (0.3831 => 0.3588, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -6.34% (0.3880 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.33% (0.3884 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.24% (0.3896 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.07% (0.3891 => 0.3655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.00% (0.4033 => 0.3791, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -5.89% (0.4176 => 0.3930, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.71% (0.3837 => 0.3618, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.50% (0.4199 => 0.3968, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.11% (0.2428 => 0.2304, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.10% (0.7198 => 0.6831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -5.07% (0.4280 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.49% (0.3142 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.41% (2.1713 => 2.0756, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.34% (0.3252 => 0.3111, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.30% (0.9852 => 0.9428, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.21% (1.3148 => 1.2594, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.01% (0.2989 => 0.2869, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.93% (0.6441 => 0.6188, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.91% (0.3658 => 0.3515, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.4151 => 0.3989, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.68% (0.7779 => 0.7493, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.67% (0.6484 => 0.6246, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.57% (2.4924 => 2.4033, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.56% (0.4321 => 0.4167, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.49% (0.3931 => 0.3794, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.48% (0.3621 => 0.3495, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.9542 => 0.9218, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: -3.21% (0.3867 => 0.3743, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.14% (0.7919 => 0.7670, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.88% (0.3788 => 0.3679, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.81% (17.1032 => 16.6229, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/moments: -2.80% (0.4248 => 0.4129, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -2.73% (0.7982 => 0.7764, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -2.72% (4.3330 => 4.2152, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.65% (1.2210 => 1.1886, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.62% (1.2221 => 1.1901, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.57% (0.4083 => 0.3978, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.55% (14.2083 => 13.8461, std.dev.: 0.0128) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2458, std.dev.: 0.0203) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.44% (6.7716 => 6.6063, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.31% (1.2300 => 1.2016, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.26% (1.0544 => 1.0306, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -2.21% (2.4021 => 2.3491, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8463, std.dev.: 0.0192) MultiSource/Benchmarks/Bullet/bullet: -2.06% (34.0927 => 33.3898, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.00% (0.5999 => 0.5879, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.96% (0.8521 => 0.8354, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -1.76% (7.0961 => 6.9709, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -1.70% (1.5610 => 1.5345, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -1.64% (4.0594 => 3.9929, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.47% (0.9077 => 0.8944, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -1.44% (0.9179 => 0.9047, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.31% (8.0126 => 7.9077, std.dev.: 0.0095) MultiSource/Applications/treecc/treecc: -1.24% (2.1401 => 2.1136, std.dev.: 0.0031) MultiSource/Applications/kimwitu++/kc: -1.15% (18.2933 => 18.0823, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -1.10% (15.2527 => 15.0844, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.49% (1.8100 => 0.7152, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3136, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.52% (1.3643 => 1.0298, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.33% (83.5423 => 64.0517, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.74% (2.9703 => 2.2950, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4046, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -14.85% (2.5106 => 2.1378, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.98% (0.4092 => 0.3520, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2799, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1981, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.78% (4.1534 => 3.8717, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.45% (1.1594 => 1.0846, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1765, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.28% (5.5807 => 5.3978, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3096 => 1.2710, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/ary3: -2.72% (3.7241 => 3.6228, std.dev.: 0.0259) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.54% (7.9763 => 7.7735, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7072, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.63% (1.6086 => 1.5823, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4757, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.31% (4.8776 => 4.8138, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.18% (1.4516 => 1.4344, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6666, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/whetstone: -1.09% (1.0443 => 1.0329, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 13:22:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 15:22:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130108212200.E80592A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7417?compare_to=7414&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7417, Order: 171879, Start Time: 2013-01-08 19:08:56, End Time: 2013-01-08 21:21:58 To: 7414, Order: 171857, Start Time: 2013-01-08 16:20:42, End Time: 2013-01-08 18:34:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 16 (224 on baseline) Performance Improvements: 2 (66 on baseline) Removed Tests: 48 (0 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1034 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.85% (11.3437 => 11.7800, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.37% (1.5066 => 1.5273, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.33% (1.3828 => 1.4012, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.31% (1.5906 => 1.6114, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.28% (1.5101 => 1.5295, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.25% (1.5644 => 1.5840, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.24% (1.6249 => 1.6451, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.23% (1.5800 => 1.5995, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.20% (1.5459 => 1.5644, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.17% (1.5439 => 1.5620, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.17% (1.5527 => 1.5708, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.16% (1.4932 => 1.5105, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.08% (1.3777 => 1.3926, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.03% (1.5508 => 1.5668, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.00% (1.5535 => 1.5691, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.00% (1.4242 => 1.4385, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.74% (10.4758 => 10.2940, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -1.13% (0.8903 => 0.8802, std.dev.: 0.0025) Removed Tests - Compile Time ---------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Removed Tests - Execution Time ------------------------------ SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1337 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0417 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.01% (0.0696 => 0.0682, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8373 => 499.7828, std.dev.: 0.0339) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44218.77% (1.1277 => 499.7828, std.dev.: 0.0339) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.50% (0.5229 => 1.6602, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.74% (14.9895 => 18.0978, std.dev.: 0.0187) MultiSource/Applications/kimwitu++/kc: 44.40% (14.1553 => 20.4406, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: 18.55% (4.1105 => 4.8728, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 59.01% (1.1048 => 1.7567, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.82% (7.1582 => 37.9259, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.60% (3.4629 => 6.4271, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.76% (0.6222 => 1.0936, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.17% (0.0720 => 7.4370, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3832500.00% (0.0001 => 3.8326, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11060300.00% (0.0001 => 11.0604, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908400.00% (0.0001 => 9.9085, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489500.00% (0.0001 => 5.4896, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.60% (1.1194 => 10.2940, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 149.42% (22.1758 => 55.3115, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 100.00% (0.0243 => 0.0486, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.02% (0.0929 => 0.1821, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 74.50% (0.1463 => 0.2553, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 66.23% (0.0231 => 0.0384) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.54% (1.5859 => 2.5618, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.82% (0.0439 => 0.0706) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.35% (2.9384 => 4.6236, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.84% (7.0540 => 10.9931, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.71% (2.2024 => 3.3413, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.34% (0.5105 => 0.7624, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.80% (8.1363 => 12.0256, std.dev.: 0.0124) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: 44.91% (0.0265 => 0.0384) MultiSource/Applications/sgefa/sgefa: 42.65% (0.3109 => 0.4435, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 42.27% (21.9371 => 31.2103, std.dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.84% (0.6675 => 0.9468, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.35% (0.4615 => 0.6385, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.32% (0.1062 => 0.1469, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.96% (4.2646 => 5.8835, std.dev.: 0.0050) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 36.73% (0.0814 => 0.1113, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 36.25% (0.1655 => 0.2255, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.97% (1.5415 => 2.0651, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.89% (0.1906 => 0.2552, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.07% (0.2271 => 0.3022, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.83% (0.1337 => 0.1776, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 32.47% (0.4299 => 0.5695, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.52% (0.0479 => 0.0630, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 30.25% (1.1642 => 1.5164, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.39% (0.3121 => 0.4007, std.dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.82% (0.1125 => 0.1438, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.26% (0.0730 => 0.0929) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.94% (0.0746 => 0.0947, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.77% (0.1584 => 0.2008, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.70% (0.0457 => 0.0579, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 26.51% (0.2554 => 0.3231, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.33% (0.1143 => 0.1444, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.18% (3.8922 => 4.9113, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.78% (0.1695 => 0.2132, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 25.22% (1.0722 => 1.3426, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 24.85% (5.7591 => 7.1905, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.43% (1.4186 => 1.7652, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 24.26% (9.4845 => 11.7853, std.dev.: 0.0093) MultiSource/Applications/minisat/minisat: 23.25% (0.7115 => 0.8769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.64% (0.1555 => 0.1907, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.57% (1.3050 => 1.5995, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.33% (0.2700 => 0.3303, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 22.18% (0.3098 => 0.3785, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.71% (0.7835 => 0.9536, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 21.55% (0.1151 => 0.1399, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 21.42% (0.1695 => 0.2058, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.91% (4.9449 => 5.9787, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.66% (0.4636 => 0.5594, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.13% (5.0018 => 6.0089, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.90% (0.5020 => 0.6019, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.5860 => 0.7023, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 19.76% (1.1840 => 1.4180, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.73% (0.0953 => 0.1141, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 19.70% (0.6456 => 0.7728, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 19.60% (3.3354 => 3.9893, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.32% (0.8172 => 0.9751, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: 19.17% (0.4289 => 0.5111, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 18.87% (0.3423 => 0.4069, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.56% (0.2758 => 0.3270, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 18.51% (0.4620 => 0.5475, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.51% (0.3307 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.49% (0.1044 => 0.1237, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.42% (0.7433 => 0.8802, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.19% (0.5569 => 0.6582, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.87% (0.9765 => 1.1510, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 17.86% (0.2049 => 0.2415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 17.68% (2.0273 => 2.3858, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 17.44% (3.8723 => 4.5475, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary: 17.17% (0.3232 => 0.3787, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.87% (0.5981 => 0.6990, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.84% (0.3283 => 0.3836, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 16.69% (2.2969 => 2.6803, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.25% (0.3441 => 0.4000, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.20% (0.8101 => 0.9413, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.14% (0.6450 => 0.7491, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.87% (0.8921 => 1.0337, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 15.53% (0.3180 => 0.3674, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.14% (1.1861 => 1.3657, std.dev.: 0.0066) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3379 => 0.3880, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.73% (0.8067 => 0.9255, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3865 => 0.4396, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 13.63% (10.3673 => 11.7800, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 13.40% (1.5603 => 1.7694, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 13.37% (0.3387 => 0.3840, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.04% (0.4103 => 0.4638, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.94% (0.3886 => 0.4389, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.49% (0.4203 => 0.4728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.33% (0.4048 => 0.4547, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.32% (0.3603 => 0.4047, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.10% (0.3826 => 0.4289, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 12.01% (0.3497 => 0.3917, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 12.01% (0.3473 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.00% (0.3282 => 0.3676, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.94% (0.3543 => 0.3966, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.93% (0.2430 => 0.2720, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 11.87% (0.3092 => 0.3459, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.75% (0.1268 => 0.1417, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 11.69% (0.3422 => 0.3822, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 11.59% (0.3684 => 0.4111, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 11.49% (17.1811 => 19.1554, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.49% (0.1114 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.32% (0.3427 => 0.3815, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.31% (14.3668 => 15.9919, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.17% (0.4064 => 0.4518, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.36% (0.1892 => 0.2088, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 10.17% (0.2831 => 0.3119, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2871 => 0.3162, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.6030 => 0.6629, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.87% (0.1438 => 0.1580, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.71% (2.0665 => 2.2672, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 9.57% (0.2905 => 0.3183, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2877 => 0.3150, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5925 => 0.6485, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7326 => 0.8014, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.11% (0.3162 => 0.3450, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 9.10% (0.2725 => 0.2973, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.04% (1.2842 => 1.4003, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.96% (0.3136 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.96% (0.2891 => 0.3150, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.78% (0.3052 => 0.3320, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.67% (63.2438 => 68.7245, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.56% (0.3935 => 0.4272, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (2.2022 => 2.3859, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.56% (0.2266 => 0.2392, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3817 => 0.3986, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.3131 => 0.3252, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.52% (7.9617 => 8.2422, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2448, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.15% (1.1145 => 1.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.30% (1.1396 => 1.2456, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3564, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.85% (2.8904 => 3.0594, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.60% (4.2280 => 4.4648, std.dev.: 0.0058) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (3.1578 => 3.3164, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.80% (3.6395 => 3.7777, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.63% (2.0360 => 2.1100, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9123, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.94% (0.9957 => 1.0150, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2409, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.10% (9.1159 => 9.2160, std.dev.: 0.0140) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1699, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.55% (5.2763 => 1.1843, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -75.29% (0.8651 => 0.2138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.77% (5.3855 => 4.4821, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.14% (5.3526 => 4.4889, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -12.49% (10.4361 => 9.1329, std.dev.: 0.0197) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9046, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.81% (1.7609 => 1.6233, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.42% (1.9577 => 0.6574, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4256, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7725, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2951, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9606, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.08% (0.2161 => 0.1727, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.39% (2.5528 => 2.1343, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7332, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4942, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: -11.06% (1.2373 => 1.1004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9124, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2985, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.03% (4.8142 => 4.4757, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.81% (1.8329 => 1.7080, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5733, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.8614 => 0.8160, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.61% (10.2830 => 9.8094, std.dev.: 0.0233) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.32% (1.5835 => 1.5151, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.15% (8.1563 => 7.8176, std.dev.: 0.0056) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.14% (1.0554 => 1.0328, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7221 => 3.6715, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.77% (0.2116 => 0.0682, std.dev.: 0.0018) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 13:49:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 15:49:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130108214955.D792B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7418?compare_to=7413&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7418, Order: 171866, Start Time: 2013-01-08 18:14:22, End Time: 2013-01-08 21:49:53 To: 7413, Order: 171846, Start Time: 2013-01-08 13:38:58, End Time: 2013-01-08 17:14:29 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (22 on baseline) Removed Tests: 48 (0 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1055 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0732 => 2.1213, std.dev.: 0.0079) Removed Tests - Compile Time ---------------------------- SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 Removed Tests - Execution Time ------------------------------ SingleSource/Benchmarks/LivermoreLoops/kernel01 SingleSource/Benchmarks/LivermoreLoops/kernel02 SingleSource/Benchmarks/LivermoreLoops/kernel03 SingleSource/Benchmarks/LivermoreLoops/kernel04 SingleSource/Benchmarks/LivermoreLoops/kernel05 SingleSource/Benchmarks/LivermoreLoops/kernel06 SingleSource/Benchmarks/LivermoreLoops/kernel07 SingleSource/Benchmarks/LivermoreLoops/kernel08 SingleSource/Benchmarks/LivermoreLoops/kernel09 SingleSource/Benchmarks/LivermoreLoops/kernel10 SingleSource/Benchmarks/LivermoreLoops/kernel11 SingleSource/Benchmarks/LivermoreLoops/kernel12 SingleSource/Benchmarks/LivermoreLoops/kernel13 SingleSource/Benchmarks/LivermoreLoops/kernel14 SingleSource/Benchmarks/LivermoreLoops/kernel15 SingleSource/Benchmarks/LivermoreLoops/kernel16 SingleSource/Benchmarks/LivermoreLoops/kernel17 SingleSource/Benchmarks/LivermoreLoops/kernel18 SingleSource/Benchmarks/LivermoreLoops/kernel19 SingleSource/Benchmarks/LivermoreLoops/kernel20 SingleSource/Benchmarks/LivermoreLoops/kernel21 SingleSource/Benchmarks/LivermoreLoops/kernel22 SingleSource/Benchmarks/LivermoreLoops/kernel23 SingleSource/Benchmarks/LivermoreLoops/kernel24 ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.38% (0.2969 => 0.3782, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.76% (0.5900 => 0.7420, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.56% (0.4139 => 0.5197, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.49% (0.1620 => 0.2033, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.81% (0.4253 => 0.5308, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.31% (0.4994 => 0.6208, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 22.27% (1.5932 => 1.9480, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.04% (0.1107 => 0.1351, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.44% (0.1003 => 0.1218, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.30% (0.1549 => 0.1879, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 21.25% (0.1619 => 0.1963, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.88% (0.3903 => 0.4718, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.81% (0.4029 => 0.4827, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.49% (0.1088 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.41% (0.2014 => 0.2405, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.61% (0.5826 => 0.6910, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.60% (0.2736 => 0.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.47% (0.2875 => 0.3406, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.2866 => 0.3392, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 18.25% (0.9697 => 1.1467, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.15% (0.5889 => 0.6958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.98% (0.2714 => 0.3202, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 17.91% (0.2803 => 0.3305, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.90% (0.2738 => 0.3228, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 17.87% (0.5546 => 0.6537, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.85% (0.2729 => 0.3216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.83% (0.2725 => 0.3211, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 17.71% (0.2750 => 0.3237, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.62% (0.2911 => 0.3424, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (0.2792 => 0.3284, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.58% (3.5627 => 4.1889, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.52% (1.3152 => 1.5456, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.52% (0.3271 => 0.3844, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 17.50% (0.2823 => 0.3317, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 17.49% (0.2813 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.40% (1.8794 => 2.2065, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.36% (1.6211 => 1.9026, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.30% (2.0673 => 2.4249, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/except: 17.29% (0.2811 => 0.3297, std.dev.: 0.0080) SingleSource/Regression/C++/ofstream_ctor: 17.28% (0.3004 => 0.3523, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.26% (0.4658 => 0.5462, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: 17.25% (0.3096 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 17.19% (0.2780 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.02% (0.1968 => 0.2303, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.99% (0.9909 => 1.1593, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.90% (0.3195 => 0.3735, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 16.78% (0.7171 => 0.8374, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.68% (0.3267 => 0.3812, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 16.54% (0.3258 => 0.3797, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.51% (4.4195 => 5.1493, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.47% (0.5026 => 0.5854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.44% (0.3060 => 0.3563, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 16.31% (0.3317 => 0.3858, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.20% (0.3124 => 0.3630, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.16% (0.3930 => 0.4565, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 16.13% (0.3477 => 0.4038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.09% (0.3362 => 0.3903, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 16.07% (23.5202 => 27.2998, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/lists: 16.01% (0.3348 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 15.97% (0.3726 => 0.4321, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.89% (0.3625 => 0.4201, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: 15.88% (0.3678 => 0.4262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.80% (2.7292 => 3.1604, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.78% (0.3282 => 0.3800, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.66% (0.3845 => 0.4447, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.65% (1.9694 => 2.2776, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.58% (0.3690 => 0.4265, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 15.58% (0.4146 => 0.4792, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.52% (0.3981 => 0.4599, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.35% (1.9966 => 2.3031, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 15.29% (0.4251 => 0.4901, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 15.24% (1.0781 => 1.2424, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 15.03% (4.2109 => 4.8439, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3488 => 0.3999, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 14.62% (0.3460 => 0.3966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.62% (0.3496 => 0.4007, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.52% (0.3465 => 0.3968, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.51% (0.3446 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 14.45% (0.5012 => 0.5736, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.44% (0.3442 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.41% (0.3469 => 0.3969, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.32% (1.4269 => 1.6312, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: 14.05% (0.3650 => 0.4163, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.83% (0.3643 => 0.4147, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1028 => 0.1170, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.80% (0.6435 => 0.7323, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.61% (0.7875 => 0.8947, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.26% (0.2737 => 0.3100, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.43% (5.5417 => 6.2305, std.dev.: 0.0057) MultiSource/Applications/JM/ldecod/ldecod: 12.39% (2.1653 => 2.4335, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.28% (0.2068 => 0.2322, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.22% (4.6177 => 5.1820, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 12.19% (0.2075 => 0.2328, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 11.95% (2.1013 => 2.3524, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.74% (0.2691 => 0.3007, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.3498 => 0.3907, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.45% (0.3336 => 0.3718, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.29% (0.5361 => 0.5966, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.2103 => 0.2340, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.97% (11.6398 => 12.9164, std.dev.: 0.0168) MultiSource/Applications/siod/siod: 10.85% (0.6634 => 0.7354, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.54% (4.6926 => 5.1870, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 10.09% (0.4847 => 0.5336, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.05% (0.7426 => 0.8172, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.51% (0.2040 => 0.2234, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 7.90% (0.2391 => 0.2580, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.90% (11.9555 => 12.8998, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.66% (0.1383 => 0.1489, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 7.56% (2.0346 => 2.1884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.01% (0.3792 => 0.3982, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5185, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.53% (0.3693 => 0.4082, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6786, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2383, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6791, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8888, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2014, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (2.0820 => 2.1213, std.dev.: 0.0079) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.31% (7.1849 => 7.2792, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 1.22% (4.0317 => 4.0810, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5918, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4791, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.88% (2.4764 => 2.4298, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5570, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.62% (17.2379 => 14.2000, std.dev.: 0.1361) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8018, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.58% (0.2402 => 0.2244, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: -4.76% (1.5554 => 1.4813, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -4.09% (14.0481 => 13.4736, std.dev.: 0.0467) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2110, std.dev.: 0.0185) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8106, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1373, std.dev.: 0.0552) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2000, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 14:48:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 16:48:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130108224803.47AF42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7419?compare_to=7416&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7419, Order: 171894, Start Time: 2013-01-08 21:13:42, End Time: 2013-01-08 22:48:00 To: 7416, Order: 171879, Start Time: 2013-01-08 19:15:44, End Time: 2013-01-08 20:50:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 2 (139 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (849 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (80.1783 => 81.1031, std.dev.: 0.1237) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.63% (0.4128 => 0.3937, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -5.05% (0.7152 => 0.6791, std.dev.: 0.0139) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.46% (0.5456 => 1.1537, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.18% (0.5575 => 1.1662, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 109.05% (0.5567 => 1.1638, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.93% (0.5688 => 1.1884, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.62% (0.5581 => 1.1643, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.94% (0.5805 => 1.2013, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 105.71% (0.6395 => 1.3155, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 103.92% (0.5941 => 1.2115, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.83% (0.5849 => 1.1922, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.79% (0.5859 => 1.1940, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.41% (0.6033 => 1.2272, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.12% (0.6260 => 1.2715, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.90% (0.5478 => 1.0896, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.50% (0.6189 => 1.2285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 98.11% (0.5570 => 1.1035, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.08% (0.5569 => 1.1031, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.08% (0.5591 => 1.1019, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.07% (0.6440 => 1.2691, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.51% (0.5705 => 1.1211, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.45% (0.6304 => 1.2384, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.23% (0.5802 => 1.1327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 95.09% (0.6395 => 1.2476, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.81% (0.6676 => 1.2939, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 93.16% (0.5925 => 1.1445, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.98% (0.5857 => 1.1303, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.97% (0.6230 => 1.2022, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.20% (0.6052 => 1.1632, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.17% (0.5863 => 1.1267, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.32% (0.6660 => 1.2742, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.02% (0.6194 => 1.1646, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.09% (0.6446 => 1.2060, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.72% (0.6297 => 1.1758, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.55% (0.6681 => 1.2196, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.66% (0.6667 => 1.2111, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.33% (0.7524 => 1.3643, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.03% (0.0717 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.81% (0.7339 => 1.2829, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.84% (0.0514 => 0.0837, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.73% (0.0974 => 0.1585, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.91% (0.0599 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.53% (0.0680 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.80% (0.0693 => 0.0948, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.61% (1.6474 => 2.2340, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.96% (0.0582 => 0.0768, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.84% (2.2587 => 2.9100, std.dev.: 0.0133) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.56% (0.0622 => 0.0781) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.88% (0.5329 => 0.6495, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.18% (0.1081 => 0.1310, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.07% (0.7021 => 0.8290, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.76% (0.3357 => 0.3886, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.44% (0.4916 => 0.5675, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 14.33% (1.1450 => 1.3091, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.52% (4.5069 => 5.1161, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.56% (0.4515 => 0.5082, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.64% (0.2001 => 0.2234, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.19% (0.2385 => 0.2652, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.73% (0.1761 => 0.1950, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.41% (3.5339 => 3.9019, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.63% (0.1441 => 0.1551, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.28% (0.1731 => 0.1857, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.18% (1.2515 => 1.3414, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (9.2283 => 9.8598, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.24% (0.3319 => 0.3526, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.69% (1.2784 => 1.3511, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 5.33% (5.0226 => 5.2905, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/matrix: 4.42% (0.3255 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.42% (1.3722 => 1.4054, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 2.41% (0.4524 => 0.4633, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.3864 => 1.4196, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.33% (5.4682 => 5.5957, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.70% (1.4642 => 1.4891, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.37% (0.9557 => 0.9688, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.34% (22.4056 => 22.7056, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.54% (31.3723 => 55.6971, std.dev.: 0.0285) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.84% (0.9531 => 1.0183, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.62% (3.1932 => 3.3406, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 3.86% (11.6767 => 12.1279, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3670, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.5751 => 56.3561, std.dev.: 0.2104) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1046, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.08% (27.8210 => 28.3987, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6551 => 3.7226, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6112, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.74% (79.7170 => 81.1031, std.dev.: 0.1237) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.51% (0.3194 => 0.2986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -5.21% (0.4033 => 0.3823, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.79% (0.4199 => 0.3998, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -4.74% (0.2871 => 0.2735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.65% (0.2903 => 0.2768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.54% (0.3016 => 0.2879, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.52% (0.3142 => 0.3000, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.47% (0.2933 => 0.2802, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.33% (0.9852 => 0.9425, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.33% (2.1713 => 2.0772, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.33% (0.3025 => 0.2894, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.09% (1.3148 => 1.2610, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: -3.91% (0.2989 => 0.2872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.88% (0.3658 => 0.3516, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.78% (0.4151 => 0.3994, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.75% (0.7779 => 0.7487, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.62% (0.6484 => 0.6249, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -3.57% (2.4924 => 2.4033, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.9542 => 0.9211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.37% (0.3621 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.33% (0.3931 => 0.3800, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.31% (0.4321 => 0.4178, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.09% (0.3849 => 0.3730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.05% (0.3867 => 0.3749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.03% (0.4427 => 0.4293, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.02% (0.7919 => 0.7680, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: -2.87% (0.4248 => 0.4126, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.83% (17.1032 => 16.6184, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/sieve: -2.75% (0.3788 => 0.3684, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -2.73% (0.7982 => 0.7764, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: -2.63% (4.3330 => 4.2192, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8498, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.43% (1.2221 => 1.1924, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.42% (1.2210 => 1.1915, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2774, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.22% (6.7716 => 6.6210, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (1.2300 => 1.2038, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -2.08% (16.1920 => 15.8555, std.dev.: 0.0139) MultiSource/Applications/siod/siod: -2.04% (2.4021 => 2.3531, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.85% (0.5999 => 0.5888, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.84% (0.8521 => 0.8364, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -1.70% (7.0961 => 6.9758, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: -1.67% (1.5610 => 1.5349, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.67% (34.0927 => 33.5241, std.dev.: 0.0050) MultiSource/Applications/lua/lua: -1.51% (4.0594 => 3.9982, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: -1.44% (0.9179 => 0.9047, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9077 => 0.8964, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: -1.17% (18.2933 => 18.0793, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.0126 => 7.9262, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.48% (1.8100 => 0.6791, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3985, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7497, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0638, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.18% (5.3397 => 4.1019, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.52% (4.1024 => 3.1786, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4049, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -14.84% (2.5106 => 2.1380, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.83% (4.9100 => 4.2800, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.39% (4.7378 => 4.1983, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7823, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8712, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.38% (1.1594 => 1.0854, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1553, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.16% (3.1919 => 3.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1713, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.85% (1.3096 => 1.2723, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (7.9763 => 7.7558, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/ary3: -2.21% (3.7241 => 3.6419, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.02% (1.6086 => 1.5761, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8029, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6219 => 1.5982, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7092 => 3.6657, std.dev.: 0.0138) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 16:05:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 18:05:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109000538.886BD2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7420?compare_to=7417&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7420, Order: 171896, Start Time: 2013-01-08 21:52:40, End Time: 2013-01-09 00:05:28 To: 7417, Order: 171879, Start Time: 2013-01-08 19:08:56, End Time: 2013-01-08 21:21:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (221 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (650 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.80% (11.7800 => 11.5685, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1336 => 0.1337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0419 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.44% (0.0682 => 0.0685, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7828 => 499.8385, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44223.71% (1.1277 => 499.8385, std.dev.: 0.0085) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.94% (0.5229 => 1.6573, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 20.38% (14.9895 => 18.0442, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 43.87% (14.1553 => 20.3650, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 17.84% (4.1105 => 4.8437, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.54% (1.1048 => 1.7516, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.95% (7.1582 => 37.8630, std.dev.: 0.0317) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.51% (3.4629 => 6.3894, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.36% (0.6222 => 1.0911, std.dev.: 0.0043) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10223.61% (0.0720 => 7.4330, std.dev.: 0.0078) MultiSource/Applications/SIBsim4/SIBsim4: 3832700.00% (0.0001 => 3.8328, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11083800.00% (0.0001 => 11.0839, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908100.00% (0.0001 => 9.9082, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491900.00% (0.0001 => 5.4920, std.dev.: 0.0142) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.54% (1.1194 => 10.3157, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 148.87% (22.1758 => 55.1891, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 99.59% (0.0243 => 0.0485, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.48% (0.0929 => 0.1816, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534) MultiSource/Benchmarks/FreeBench/neural/neural: 74.23% (0.1463 => 0.2549, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462) SingleSource/Regression/C/sumarray: 65.80% (0.0231 => 0.0383, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 60.97% (1.5859 => 2.5528, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.59% (0.0439 => 0.0705, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.27% (2.9384 => 4.6213, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.82% (7.0540 => 10.9210, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.23% (2.2024 => 3.3307, std.dev.: 0.0136) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 48.95% (0.5105 => 0.7604, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.58% (8.1363 => 12.0073, std.dev.: 0.0149) SingleSource/UnitTests/Vector/multiplies: 45.52% (0.0279 => 0.0406, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 41.81% (0.3109 => 0.4409, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.45% (0.6675 => 0.9442, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 41.12% (21.9371 => 30.9573, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.21% (0.1062 => 0.1489, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.03% (0.4615 => 0.6370, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.47% (4.2646 => 5.8625, std.dev.: 0.0177) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 36.24% (0.0814 => 0.1109, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 35.77% (0.1655 => 0.2247, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.56% (1.5415 => 2.0589, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.80% (0.2271 => 0.3016, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.58% (0.1906 => 0.2527, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 32.33% (0.4299 => 0.5689, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.09% (0.1337 => 0.1766, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.69% (0.0479 => 0.0626, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 30.24% (1.1642 => 1.5163, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.23% (0.3121 => 0.4002, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.97% (0.1584 => 0.2027, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.56% (0.1125 => 0.1435, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.26% (0.0457 => 0.0577, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 25.92% (0.2554 => 0.3216, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.89% (3.8922 => 4.9000, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 25.62% (0.1175 => 0.1476, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.25% (0.1695 => 0.2123, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.68% (1.0722 => 1.3368, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 24.31% (5.7591 => 7.1590, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.27% (1.4186 => 1.7629, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 24.02% (9.4845 => 11.7631, std.dev.: 0.0129) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.80% (0.1143 => 0.1415, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 22.57% (0.1555 => 0.1906, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 22.53% (0.7115 => 0.8718, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.30% (1.3050 => 1.5960, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.05% (0.0730 => 0.0891, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.04% (0.2700 => 0.3295, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.42% (0.1695 => 0.2058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.92% (0.7835 => 0.9474, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.65% (4.9449 => 5.9659, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.60% (0.4636 => 0.5591, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.76% (5.0018 => 5.9900, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.68% (0.5860 => 0.7013, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 19.56% (0.4289 => 0.5128, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.53% (0.8172 => 0.9768, std.dev.: 0.0089) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 19.41% (1.1840 => 1.4138, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: 19.38% (0.6456 => 0.7707, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: 19.14% (3.3354 => 3.9738, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.07% (0.1940 => 0.2310, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.82% (0.2758 => 0.3277, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 18.70% (0.3423 => 0.4063, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.59% (0.5020 => 0.5953, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.55% (0.7433 => 0.8812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 18.31% (0.4620 => 0.5466, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.28% (0.5569 => 0.6587, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.08% (0.3307 => 0.3905, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 17.85% (0.0818 => 0.0964, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.77% (0.2065 => 0.2432, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.53% (0.9765 => 1.1477, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 17.37% (0.2049 => 0.2405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.30% (0.3232 => 0.3791, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 17.17% (2.0273 => 2.3754, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 16.93% (3.8723 => 4.5280, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.55% (0.0834 => 0.0972, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.00% (0.8101 => 0.9397, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.97% (0.6450 => 0.7480, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 15.91% (2.2969 => 2.6623, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.90% (0.8921 => 1.0339, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.23% (1.1861 => 1.3668, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.89% (0.3379 => 0.3882, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.21% (0.8067 => 0.9213, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.61% (0.3865 => 0.4391, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.56% (0.2603 => 0.2956, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.26% (1.5603 => 1.7672, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 13.09% (0.3927 => 0.4441, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.92% (0.4103 => 0.4633, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 12.74% (0.3886 => 0.4381, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.47% (0.4203 => 0.4727, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 12.38% (0.4048 => 0.4549, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.26% (0.1330 => 0.1493, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.10% (0.3561 => 0.3992, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.97% (0.3543 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.95% (0.3497 => 0.3915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.93% (0.3603 => 0.4033, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 11.86% (0.3516 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.86% (0.3694 => 0.4132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.69% (0.3422 => 0.3822, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.67% (0.3282 => 0.3665, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 11.59% (10.3673 => 11.5685, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: 11.56% (0.3684 => 0.4110, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.26% (17.1811 => 19.1164, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.24% (0.3826 => 0.4256, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.22% (14.3668 => 15.9793, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.4064 => 0.4512, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.95% (0.2430 => 0.2696, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.91% (0.3427 => 0.3801, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.24% (0.2831 => 0.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.88% (0.1892 => 0.2079, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.87% (0.6030 => 0.6625, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.74% (0.1438 => 0.1578, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.61% (2.0665 => 2.2651, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 9.47% (0.5925 => 0.6486, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 9.43% (0.2905 => 0.3179, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 9.32% (0.7326 => 0.8009, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.25% (0.2756 => 0.3011, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2793 => 0.3047, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.07% (1.2842 => 1.4007, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.03% (0.2725 => 0.2971, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 8.84% (0.2714 => 0.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.79% (0.2891 => 0.3145, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 8.57% (0.2802 => 0.3042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.45% (0.3052 => 0.3310, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.36% (63.2438 => 68.5313, std.dev.: 0.0320) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.28% (0.3935 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.57% (2.2022 => 2.3688, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.4879 => 0.5200, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.34% (0.2266 => 0.2387, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.43% (0.3817 => 0.3986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.3131 => 0.3263, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.27% (7.9617 => 8.2219, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.17% (32.5116 => 59.2253, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.34% (1.1396 => 1.2460, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3557, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.84% (2.8904 => 3.0593, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4637, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3143, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.87% (3.6395 => 3.7804, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (2.0360 => 2.1102, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9098, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.28% (1.0313 => 1.0548, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2206, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.90% (0.9957 => 1.0146, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.78% (0.6533 => 0.6649, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2426, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.19% (9.1159 => 9.2240, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.70% (5.2763 => 1.1768, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.30% (0.8651 => 0.2137, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.17% (0.1622 => 0.0938, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.24% (5.3855 => 4.4573, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.59% (5.3526 => 4.4645, std.dev.: 0.0051) MultiSource/Applications/JM/ldecod/ldecod: -12.71% (10.4361 => 9.1099, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.11% (1.7609 => 1.6181, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -7.85% (54.1659 => 49.9156, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.67% (1.9577 => 0.6329, std.dev.: 0.0193) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.90% (0.6962 => 0.3418, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3065, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -33.59% (1.5373 => 1.0209, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.70% (10.7105 => 7.4229, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7623, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0076, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.70% (2.9695 => 2.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2258 => 0.9605, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.27% (0.2161 => 0.1723, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.34% (2.5528 => 2.1358, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.73% (1.6925 => 1.4262, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: -11.27% (1.2373 => 1.0978, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2740, std.dev.: 0.0185) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.71% (2.7294 => 2.5735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.91% (0.4808 => 0.4572, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.51% (10.2830 => 9.8189, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.09% (8.1563 => 7.8226, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -2.15% (1.0554 => 1.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3303, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784) SingleSource/Benchmarks/Shootout-C++/ary3: -1.40% (3.7221 => 3.6699, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/ary3: -1.19% (3.6994 => 3.6555, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2274, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.63% (0.2116 => 0.0685, std.dev.: 0.0017) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 16:46:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 18:46:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109004638.42A872A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7421?compare_to=7419&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7421, Order: 171908, Start Time: 2013-01-08 23:12:00, End Time: 2013-01-09 00:46:35 To: 7419, Order: 171894, Start Time: 2013-01-08 21:13:42, End Time: 2013-01-08 22:48:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (139 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (850 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.13% (1.0854 => 1.0977, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 111.36% (0.5456 => 1.1532, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 109.18% (0.5575 => 1.1662, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 108.87% (0.5567 => 1.1628, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 108.83% (0.5688 => 1.1878, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 108.71% (0.5581 => 1.1648, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 106.77% (0.5805 => 1.2003, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.04% (0.6395 => 1.3176, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 104.02% (0.5941 => 1.2121, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 103.85% (0.5849 => 1.1923, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 103.57% (0.5859 => 1.1927, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 103.38% (0.6033 => 1.2270, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 103.05% (0.6260 => 1.2711, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 98.76% (0.5478 => 1.0888, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 98.40% (0.6189 => 1.2279, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 97.88% (0.5570 => 1.1022, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 97.70% (0.5569 => 1.1010, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 97.07% (0.6440 => 1.2691, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 96.76% (0.5591 => 1.1001, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 96.41% (0.6304 => 1.2382, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 96.20% (0.5705 => 1.1193, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 95.14% (0.5802 => 1.1322, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 94.78% (0.6395 => 1.2456, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 93.57% (0.6676 => 1.2923, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 92.91% (0.5925 => 1.1430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 92.90% (0.5857 => 1.1298, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 92.55% (0.6230 => 1.1996, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 92.28% (0.6052 => 1.1637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 92.09% (0.5863 => 1.1262, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 91.10% (0.6660 => 1.2727, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 87.79% (0.6194 => 1.1632, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 86.98% (0.6446 => 1.2053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 86.58% (0.6297 => 1.1749, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 82.14% (0.6681 => 1.2169, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 81.40% (0.6667 => 1.2094, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 81.13% (0.7524 => 1.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.75% (0.7339 => 1.2825, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 74.34% (0.0717 => 0.1250, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.26% (0.0514 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.11% (0.0974 => 0.1579, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 53.65% (0.0315 => 0.0484) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 47.27% (0.1500 => 0.2209, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 44.24% (0.0599 => 0.0864, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.09% (0.0680 => 0.0939) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 36.22% (0.0693 => 0.0944, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.69% (0.1132 => 0.1536, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.47% (1.6474 => 2.2318, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.38% (0.0445 => 0.0598) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 31.62% (0.0582 => 0.0766) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28.83% (2.2587 => 2.9098, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 27.51% (0.0418 => 0.0533, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 25.08% (0.0622 => 0.0778, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.83% (0.0621 => 0.0769, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.94% (0.5329 => 0.6498, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.00% (0.1081 => 0.1308, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.23% (0.7021 => 0.8301, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.73% (0.3357 => 0.3885, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.22% (0.4916 => 0.5664, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 14.29% (1.1450 => 1.3086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.44% (4.5069 => 5.1128, std.dev.: 0.0126) SingleSource/Benchmarks/McGill/exptree: 13.08% (0.0864 => 0.0977, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.34% (0.2001 => 0.2228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.21% (1.6364 => 1.8198, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2385 => 0.2644, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 10.56% (0.1761 => 0.1947, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.42% (3.5339 => 3.9023, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.91% (0.1441 => 0.1555, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.34% (0.1731 => 0.1858, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.09% (1.2515 => 1.3402, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 6.84% (9.2283 => 9.8593, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.09% (0.3319 => 0.3521, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.80% (1.2784 => 1.3526, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 5.40% (5.0226 => 5.2938, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.3255 => 0.3387, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.3864 => 1.4207, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.3722 => 1.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.17% (5.4682 => 5.5866, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.61% (1.4642 => 1.4878, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 1.53% (0.6750 => 0.6853, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.49% (0.9557 => 0.9699, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.32% (0.8418 => 0.8529, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.18% (22.4056 => 22.6689, std.dev.: 0.0212) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.55% (31.3723 => 55.7006, std.dev.: 0.0152) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.85% (0.9531 => 1.0184, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 4.56% (3.1932 => 3.3387, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 3.87% (11.6767 => 12.1289, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5373, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.30% (5.1955 => 5.3671) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.20% (2.0478 => 2.1133, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3961, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6551 => 3.7273, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.5320 => 4.6073, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/trivial-interface: -6.77% (0.3812 => 0.3554, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.70% (0.3194 => 0.2980, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.69% (0.3884 => 0.3624, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -6.68% (0.3848 => 0.3591, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -6.62% (0.3896 => 0.3638, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.57% (0.3880 => 0.3625, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -6.53% (0.3831 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.50% (0.3891 => 0.3638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -6.35% (0.4176 => 0.3911, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -6.32% (0.4033 => 0.3778, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.95% (0.4199 => 0.3949, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -5.61% (0.4280 => 0.4040, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.92% (0.3821 => 0.3633, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.70% (0.2939 => 0.2801, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.61% (0.3142 => 0.2997, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.58% (0.6347 => 0.6056, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.53% (2.1713 => 2.0729, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (0.9852 => 0.9410, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.37% (0.3252 => 0.3110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.35% (0.6441 => 0.6161, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.26% (0.7779 => 0.7448, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.12% (1.3148 => 1.2606, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.08% (0.2989 => 0.2867, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.81% (0.4151 => 0.3993, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.72% (0.3658 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.69% (0.6484 => 0.6245, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.66% (0.3931 => 0.3787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.62% (0.3621 => 0.3490, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (0.9542 => 0.9201, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.40% (0.4321 => 0.4174, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.27% (0.3849 => 0.3723, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -3.26% (0.3867 => 0.3741, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.21% (0.4427 => 0.4285, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.18% (2.4924 => 2.4131, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.14% (0.7919 => 0.7670, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -3.01% (0.4248 => 0.4120, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.01% (0.3788 => 0.3674, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.81% (17.1032 => 16.6232, std.dev.: 0.0089) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.63% (6.7716 => 6.5935, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -2.62% (4.3330 => 4.2194, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.52% (0.4083 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.51% (1.2210 => 1.1903, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.51% (1.2221 => 1.1914, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.49% (14.2083 => 13.8548, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.26% (1.0544 => 1.0306, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -2.17% (16.1920 => 15.8411, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2040, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -2.07% (2.4021 => 2.3523, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.97% (0.5999 => 0.5881, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.96% (0.8521 => 0.8354, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -1.80% (20.7746 => 20.4006, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: -1.77% (1.5610 => 1.5333, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -1.75% (7.0961 => 6.9721, std.dev.: 0.0231) MultiSource/Benchmarks/Bullet/bullet: -1.70% (34.0927 => 33.5119, std.dev.: 0.0358) MultiSource/Applications/lua/lua: -1.68% (4.0594 => 3.9910, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/football/football: -1.34% (0.9179 => 0.9056, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.32% (8.0126 => 7.9066, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: -1.29% (18.2933 => 18.0575, std.dev.: 0.0080) MultiSource/Applications/treecc/treecc: -1.21% (2.1401 => 2.1143, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: -1.11% (15.2527 => 15.0841, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.18% (1.8100 => 0.6846, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0282, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.55% (4.3504 => 3.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0573, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1796, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4049, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.47% (1.2237 => 0.9610, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -14.82% (2.5106 => 2.1386, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.82% (4.9100 => 4.2804, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.38% (4.7378 => 4.1985, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.45% (0.5142 => 0.4656, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7822, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: -5.32% (1.1594 => 1.0977, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1552, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.15% (3.1919 => 3.0595, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3986, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7700, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: -1.90% (3.7241 => 3.6535, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.83% (1.6086 => 1.5792, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4703, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.26% (4.8776 => 4.8159, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6015, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -1.14% (1.4516 => 1.4350, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6700, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.04% (4.4002 => 4.3546, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 18:23:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 20:23:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130109022352.533A22A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7422?compare_to=7418&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7422, Order: 171899, Start Time: 2013-01-08 22:49:44, End Time: 2013-01-09 02:23:50 To: 7418, Order: 171866, Start Time: 2013-01-08 18:14:22, End Time: 2013-01-08 21:49:53 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1593 => 54.8730, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/whetstone: 1.12% (2.7865 => 2.8176, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.35% (0.2969 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.56% (0.4253 => 0.5340, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.47% (0.5900 => 0.7403, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.47% (0.4139 => 0.5193, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.15% (0.4994 => 0.6200, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.07% (0.1620 => 0.2010, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.44% (0.5000 => 0.6172, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.41% (0.1021 => 0.1260, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 22.12% (1.5932 => 1.9456, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.41% (0.0822 => 0.0998, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.20% (0.1604 => 0.1944, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.11% (0.1549 => 0.1876, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.98% (0.3903 => 0.4722, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.12% (0.1088 => 0.1296, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.00% (0.3890 => 0.4629, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.86% (0.4029 => 0.4789, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.49% (0.2866 => 0.3396, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.31% (0.5826 => 0.6893, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.90% (0.5889 => 0.6943, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.85% (0.3271 => 0.3855, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 17.72% (0.5546 => 0.6529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.70% (0.2875 => 0.3384, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.66% (1.3152 => 1.5474, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 17.57% (0.9697 => 1.1401, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.57% (1.8794 => 2.2096, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.42% (3.5627 => 4.1832, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.13% (0.4658 => 0.5456, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 17.02% (0.2803 => 0.3280, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.99% (1.6211 => 1.8965, std.dev.: 0.0058) SingleSource/Regression/C++/ofstream_ctor: 16.98% (0.3004 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.95% (0.2725 => 0.3187, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.95% (0.2714 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.82% (0.2729 => 0.3188, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.76% (0.2823 => 0.3296, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 16.73% (0.2750 => 0.3210, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.69% (0.2792 => 0.3258, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 16.57% (0.2813 => 0.3279, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.51% (0.2811 => 0.3275, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.49% (0.2911 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.34% (2.0673 => 2.4052, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 16.34% (0.3096 => 0.3602, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.26% (0.2780 => 0.3232) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.14% (4.4195 => 5.1327, std.dev.: 0.0115) MultiSource/Applications/hexxagon/hexxagon: 16.11% (0.9909 => 1.1505, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 16.11% (0.7171 => 0.8326, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.08% (0.3930 => 0.4562, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.84% (0.4361 => 0.5052, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.57% (1.9694 => 2.2761, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 15.56% (0.3258 => 0.3765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.52% (0.3060 => 0.3535, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.42% (2.7292 => 3.1500, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 15.37% (23.5202 => 27.1357, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.35% (0.3362 => 0.3878, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.28% (0.3317 => 0.3824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.24% (0.3124 => 0.3600, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 15.23% (0.3678 => 0.4238, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.22% (1.0781 => 1.2422, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.16% (0.3726 => 0.4291, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.16% (1.9966 => 2.2993, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.00% (4.2109 => 4.8427, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.96% (0.3282 => 0.3773, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.96% (0.3477 => 0.3997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.88% (0.3690 => 0.4239, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.87% (0.3625 => 0.4164, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.72% (0.3981 => 0.4567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.64% (0.4146 => 0.4753, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 14.49% (0.4251 => 0.4867, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.25% (1.4269 => 1.6302, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.20% (0.3845 => 0.4391, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.05% (0.5012 => 0.5716, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.71% (0.7875 => 0.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.62% (0.1028 => 0.1168, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 13.35% (0.3446 => 0.3906, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.32% (0.6435 => 0.7292, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.22% (0.3496 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.19% (0.3488 => 0.3948, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 13.10% (0.3442 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.09% (0.3469 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.03% (0.3460 => 0.3911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.79% (0.3650 => 0.4117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.71% (0.2737 => 0.3085, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.65% (0.3643 => 0.4104, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.62% (0.3724 => 0.4194, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.41% (2.1653 => 2.4341, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.14% (4.6177 => 5.1782, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 12.09% (5.5417 => 6.2118, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/football/football: 12.05% (0.2075 => 0.2325, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 12.01% (0.3498 => 0.3918, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.99% (0.2068 => 0.2316, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.85% (0.2691 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 11.85% (2.1013 => 2.3503, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.71% (0.3084 => 0.3445, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.15% (0.3336 => 0.3708, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.08% (0.5361 => 0.5955, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.08% (0.6634 => 0.7369, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.2103 => 0.2334, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.77% (11.6398 => 12.8932, std.dev.: 0.0155) MultiSource/Benchmarks/PAQ8p/paq8p: 10.32% (0.4847 => 0.5347, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.20% (4.6926 => 5.1713, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.15% (0.7426 => 0.8180, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.85% (0.2040 => 0.2241, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.33% (0.1383 => 0.1512, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.33% (0.5584 => 0.6049, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 8.07% (0.2391 => 0.2584, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.59% (2.0346 => 2.1891, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8543, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.88% (0.3792 => 0.3939, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5281, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.50% (0.3693 => 0.4044, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6766, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2442, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6919, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8880, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5013, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1969, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.03% (2.0820 => 2.1242, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2906, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3035, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.18% (4.0317 => 4.0791, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4817, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5971, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.05% (3.1722 => 3.2054, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.50% (2.4764 => 2.4144, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5647, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.95% (17.2379 => 14.3155, std.dev.: 0.0534) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7929, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -5.50% (0.2402 => 0.2270, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (41.7953 => 40.2047, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8097, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -3.07% (14.0481 => 13.6172, std.dev.: 0.1481) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1588, std.dev.: 0.0463) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.78% (0.6293 => 0.6181, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1724, std.dev.: 0.0335) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 18:48:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 20:48:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109024854.D7F712A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7423?compare_to=7421&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7423, Order: 171924, Start Time: 2013-01-09 01:10:08, End Time: 2013-01-09 02:48:53 To: 7421, Order: 171908, Start Time: 2013-01-08 23:12:00, End Time: 2013-01-09 00:46:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 15 (111 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1089 (854 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 327.19% (22.6689 => 96.8382, std.dev.: 0.0377) SingleSource/Benchmarks/Misc-C++-EH/spirit: 30.06% (5.5866 => 7.2658, std.dev.: 0.0270) MultiSource/Applications/kimwitu++/kc: 10.98% (18.0575 => 20.0396, std.dev.: 0.0529) MultiSource/Applications/sqlite3/sqlite3: 8.43% (16.6232 => 18.0245, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.09% (2.2318 => 2.3455, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.80% (2.9098 => 3.0203, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 2.51% (5.2938 => 5.4266, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 2.39% (2.3523 => 2.4085, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.14% (3.9023 => 3.9860, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 1.81% (15.5793 => 15.8617, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.56% (0.9699 => 0.9850, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.41% (0.8301 => 0.8418, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.22% (33.5119 => 33.9209, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: 1.13% (2.4131 => 2.4403, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 1.05% (1.3086 => 1.3223, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 332.21% (22.4056 => 96.8382, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 112.99% (0.5456 => 1.1621, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 110.29% (0.5567 => 1.1707, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 110.03% (0.5581 => 1.1722, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 110.03% (0.5575 => 1.1709, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 109.55% (0.5688 => 1.1919, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 107.48% (0.5805 => 1.2044, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 106.22% (0.6395 => 1.3188, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 105.32% (0.5941 => 1.2198, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 105.13% (0.5849 => 1.1998, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 105.07% (0.6033 => 1.2372, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 104.51% (0.5859 => 1.1982, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 104.31% (0.6260 => 1.2790, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 99.85% (0.5478 => 1.0948, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 99.34% (0.6189 => 1.2337, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 98.51% (0.6440 => 1.2784, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 98.49% (0.5570 => 1.1056, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 98.47% (0.5569 => 1.1053, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 97.93% (0.5591 => 1.1066, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 97.43% (0.6304 => 1.2446, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 97.30% (0.5705 => 1.1256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 96.78% (0.5802 => 1.1417, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 96.00% (0.6395 => 1.2534, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 94.31% (0.5925 => 1.1513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 94.17% (0.6676 => 1.2963, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 93.87% (0.6052 => 1.1733, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 93.80% (0.6230 => 1.2074, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 93.80% (0.5857 => 1.1351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 93.02% (0.5863 => 1.1317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 92.34% (0.6660 => 1.2810, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 88.55% (0.6194 => 1.1679, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 87.84% (0.6446 => 1.2108, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 87.39% (0.6297 => 1.1800, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 83.15% (0.6681 => 1.2236, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 82.59% (0.6667 => 1.2173, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 82.31% (0.7524 => 1.3717, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 75.17% (0.0717 => 0.1256, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 74.96% (0.7339 => 1.2840, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 63.23% (0.0514 => 0.0839, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.14% (0.0974 => 0.1589, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486) SingleSource/Regression/C/sumarraymalloc: 50.19% (0.0267 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 47.53% (0.1500 => 0.2213, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 45.24% (0.0599 => 0.0870, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 42.38% (1.6474 => 2.3455, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.68% (0.0680 => 0.0943, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 37.23% (0.0693 => 0.0951, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 34.61% (0.0445 => 0.0599, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.72% (2.2587 => 3.0203, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 32.87% (5.4682 => 7.2658, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 32.30% (0.0582 => 0.0770, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.33% (0.0790 => 0.0998, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 26.05% (0.0622 => 0.0784, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.64% (0.0621 => 0.0774, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.06% (0.5329 => 0.6558, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.65% (0.1081 => 0.1315, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 19.90% (0.7021 => 0.8418, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 16.56% (0.0604 => 0.0704) MultiSource/Applications/sgefa/sgefa: 16.38% (0.3357 => 0.3907, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.76% (0.4916 => 0.5691, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 15.48% (1.1450 => 1.3223, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.88% (4.5069 => 5.1326, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/exptree: 13.77% (0.0864 => 0.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.79% (3.5339 => 3.9860, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 12.74% (0.4515 => 0.5090, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.73% (0.0833 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.95% (1.6364 => 1.8319, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.89% (0.2001 => 0.2239, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 11.19% (0.1761 => 0.1958, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.15% (0.2385 => 0.2651, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 9.55% (18.2933 => 20.0396, std.dev.: 0.0529) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.49% (0.1731 => 0.1878, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.19% (0.1441 => 0.1559, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 8.04% (5.0226 => 5.4266, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.75% (1.2515 => 1.3485, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 7.44% (9.2283 => 9.9145, std.dev.: 0.0125) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.72% (0.3319 => 0.3542, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.2784 => 1.3576, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 5.39% (17.1032 => 18.0245, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.07% (0.9557 => 0.9850, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 2.90% (1.3864 => 1.4266, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.6750 => 0.6930, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.55% (1.3722 => 1.4072, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 2.41% (0.4861 => 0.4978, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.38% (0.7447 => 0.7624, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 2.37% (0.4524 => 0.4631, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.28% (15.5079 => 15.8617, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (1.4642 => 1.4940, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.84% (0.8418 => 0.8573, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.62% (31.3723 => 55.7249, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.58% (0.9531 => 1.0158, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 4.34% (3.1932 => 3.3318, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 3.85% (11.6767 => 12.1262, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6132, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.29% (5.1955 => 5.3666, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 2.07% (27.8210 => 28.3976, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6551 => 3.7271, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6102, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: -6.36% (0.3194 => 0.2991, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.06% (0.3831 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.00% (0.3848 => 0.3617, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.98% (0.3812 => 0.3584, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.98% (0.3880 => 0.3648, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.92% (0.3884 => 0.3654, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.68% (0.4176 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -5.10% (0.4199 => 0.3985, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.86% (0.7198 => 0.6848, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.74% (0.2428 => 0.2313, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.71% (0.3821 => 0.3641, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4280 => 0.4081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.28% (0.3059 => 0.2928, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: -4.20% (0.3026 => 0.2899, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.07% (2.1713 => 2.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.80% (0.9852 => 0.9478, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.69% (0.6347 => 0.6113, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.56% (1.3148 => 1.2680, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.51% (0.9542 => 0.9207, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -3.14% (0.7779 => 0.7535, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -2.98% (0.3621 => 0.3513, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.91% (0.3849 => 0.3737, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.82% (0.3931 => 0.3820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.66% (0.4248 => 0.4135, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -2.61% (0.3867 => 0.3766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.58% (0.4427 => 0.4313, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2427, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.54% (0.7919 => 0.7718, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.50% (0.4321 => 0.4213, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.29% (6.7716 => 6.6166, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8900, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: -2.23% (4.3330 => 4.2363, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.17% (1.2221 => 1.1956, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (2.4924 => 2.4403, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.08% (1.2210 => 1.1956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.88% (1.0544 => 1.0346, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.85% (1.2300 => 1.2072, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.74% (16.1920 => 15.9103, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (0.7982 => 0.7862, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: -1.40% (7.0961 => 6.9968, std.dev.: 0.0092) MultiSource/Applications/hbd/hbd: -1.27% (1.5610 => 1.5412, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.86% (1.8100 => 0.6904, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.05% (6.6713 => 3.3988, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/dt: -43.17% (2.0459 => 1.1627, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.52% (1.3643 => 1.0298, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.56% (4.3504 => 3.3256, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7485, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: -23.32% (83.5423 => 64.0597, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.72% (2.9703 => 2.2954, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.53% (4.1024 => 3.1782, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4056, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.48% (1.2237 => 0.9608, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -14.89% (2.5106 => 2.1367, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.30% (4.2493 => 3.6842, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.84% (4.9100 => 4.2798, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -11.40% (4.7378 => 4.1979, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7822, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.79% (4.1534 => 3.8713, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.75% (1.1594 => 1.0927, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1551, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.14% (3.1919 => 3.0597, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0523, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.54% (7.9763 => 7.7738, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: -2.49% (3.7241 => 3.6313, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.02% (1.3096 => 1.2831, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.49% (1.6086 => 1.5847, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8083, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -1.24% (1.4516 => 1.4336, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.24% (1.6219 => 1.6018, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6661, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.08% (1.0443 => 1.0330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 18:49:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 20:49:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109024919.E60B72A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7424?compare_to=7420&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7424, Order: 171920, Start Time: 2013-01-09 00:36:12, End Time: 2013-01-09 02:49:17 To: 7420, Order: 171896, Start Time: 2013-01-08 21:52:40, End Time: 2013-01-09 00:05:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (223 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (649 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.61% (1.2885 => 1.3092, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.94% (0.0685 => 0.0658, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8385 => 499.8420, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.02% (1.1277 => 499.8420, std.dev.: 0.0064) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.33% (0.5229 => 1.6593, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 20.70% (14.9895 => 18.0920, std.dev.: 0.0160) MultiSource/Applications/kimwitu++/kc: 44.62% (14.1553 => 20.4716, std.dev.: 0.0108) MultiSource/Benchmarks/MallocBench/gs/gs: 18.60% (4.1105 => 4.8752, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.80% (1.1048 => 1.7544, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.27% (7.1582 => 38.0293, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.57% (3.4629 => 6.4262, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.00% (0.6222 => 1.0951, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.44% (0.0720 => 7.4372, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 3831900.00% (0.0001 => 3.8320, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11063300.00% (0.0001 => 11.0634, std.dev.: 0.0632) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9908000.00% (0.0001 => 9.9081, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0475) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.66% (1.1194 => 10.2499, std.dev.: 0.0065) MultiSource/Applications/ClamAV/clamscan: 148.76% (22.1758 => 55.1639, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Regression/C/sumarraymalloc: 100.41% (0.0243 => 0.0487, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 95.59% (0.0929 => 0.1817, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 80.41% (0.0296 => 0.0534) MultiSource/Benchmarks/FreeBench/neural/neural: 74.44% (0.1463 => 0.2552, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 66.23% (0.0231 => 0.0384, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 61.81% (1.5859 => 2.5662, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 60.82% (0.0439 => 0.0706, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.16% (2.9384 => 4.6180, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.19% (7.0540 => 10.9473, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 51.68% (2.2024 => 3.3406, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 50.43% (0.0232 => 0.0349, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 49.46% (0.5105 => 0.7630, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.64% (8.1363 => 12.0126, std.dev.: 0.0036) SingleSource/UnitTests/Vector/multiplies: 45.88% (0.0279 => 0.0407, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: 44.53% (0.0265 => 0.0383, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 42.94% (0.3109 => 0.4444, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 41.93% (0.6675 => 0.9474, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 41.72% (21.9371 => 31.0899, std.dev.: 0.0151) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 38.92% (0.4615 => 0.6411, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.42% (0.1062 => 0.1470, std.dev.: 0.0002) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.67% (4.2646 => 5.8709, std.dev.: 0.0123) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 36.37% (0.1655 => 0.2257, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.06% (1.5415 => 2.0665, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.38% (0.2271 => 0.3029, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 32.69% (0.1906 => 0.2529, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 32.66% (0.4299 => 0.5703, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.54% (0.1337 => 0.1772, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.73% (0.0479 => 0.0631, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 30.35% (1.1642 => 1.5175, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.88% (0.0793 => 0.1022, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.62% (0.3121 => 0.3983, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.93% (0.1125 => 0.1428, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.70% (0.0457 => 0.0579, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.28% (3.8922 => 4.9150, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.25% (0.1143 => 0.1443, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 26.16% (0.2554 => 0.3222, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 25.96% (0.1175 => 0.1480, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.80% (0.1566 => 0.1970, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.60% (0.1695 => 0.2129, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 25.37% (1.0722 => 1.3442, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 24.43% (5.7591 => 7.1663, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.22% (1.4186 => 1.7622, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 24.19% (9.4845 => 11.7788, std.dev.: 0.0142) MultiSource/Applications/viterbi/viterbi: 24.18% (0.1555 => 0.1931, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.70% (0.0730 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.92% (0.0672 => 0.0826, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.80% (0.7115 => 0.8737, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.64% (1.3050 => 1.6004, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.60% (0.3098 => 0.3798, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.37% (0.2700 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.01% (0.1236 => 0.1508, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.51% (0.7835 => 0.9520, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.97% (4.9449 => 5.9816, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.92% (0.4636 => 0.5606, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.99% (5.0018 => 6.0016, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 19.91% (0.4289 => 0.5143, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 19.89% (0.6456 => 0.7740, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.5860 => 0.7021, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.71% (0.8172 => 0.9783, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 19.53% (1.1840 => 1.4152, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 19.43% (3.3354 => 3.9834, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.98% (0.5020 => 0.5973, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 18.84% (0.3423 => 0.4068, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 18.83% (0.4620 => 0.5490, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.83% (0.0770 => 0.0915, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 18.82% (0.7433 => 0.8832, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.45% (0.2065 => 0.2446, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 17.96% (0.2049 => 0.2417, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.94% (0.9765 => 1.1517, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 17.91% (3.8723 => 4.5657, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: 17.70% (0.3232 => 0.3804, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.63% (0.5569 => 0.6551, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 17.49% (2.0273 => 2.3818, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 17.24% (0.3283 => 0.3849, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.75% (0.5981 => 0.6983, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.63% (0.8101 => 0.9448, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 16.59% (2.2969 => 2.6780, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.47% (0.6450 => 0.7512, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.89% (0.0818 => 0.0948, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.86% (0.8921 => 1.0336, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.60% (0.3180 => 0.3676, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 15.18% (0.3379 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.15% (1.1861 => 1.3658, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.74% (0.8067 => 0.9256, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.26% (0.3865 => 0.4416, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 13.61% (1.5603 => 1.7726, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.26% (0.4103 => 0.4647, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.87% (0.4203 => 0.4744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.75% (0.4048 => 0.4564, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.48% (0.1330 => 0.1496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.30% (0.3603 => 0.4046, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 12.08% (0.3684 => 0.4129, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (10.3673 => 11.6185, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.94% (0.3826 => 0.4283, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.57% (0.3543 => 0.3953, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.55% (0.3282 => 0.3661, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.49% (0.4064 => 0.4531, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.43% (17.1811 => 19.1446, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.40% (14.3668 => 16.0050, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 11.29% (0.3092 => 0.3441, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3427 => 0.3809, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 11.02% (0.2831 => 0.3143, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.62% (0.1892 => 0.2093, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 10.55% (0.2871 => 0.3174, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.08% (0.1438 => 0.1583, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.05% (0.1114 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.97% (2.0665 => 2.2726, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 9.85% (0.2905 => 0.3191, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.62% (0.3650 => 0.4001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.58% (0.2756 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.52% (0.2877 => 0.3151, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.48% (1.2842 => 1.4059, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.36% (0.3162 => 0.3458, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2725 => 0.2980, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2793 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.21% (0.2714 => 0.2964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.17% (0.2891 => 0.3156, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2802 => 0.3053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.88% (0.2872 => 0.3127, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.74% (0.3136 => 0.3410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7326 => 0.7959, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.61% (0.3935 => 0.4274, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.32% (63.2438 => 68.5030, std.dev.: 0.0335) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.35% (2.2022 => 2.3640, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.43% (0.2266 => 0.2389, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.38% (7.9617 => 8.2309, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2385, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.12% (11.6436 => 12.3563, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.86% (2.8904 => 3.0598, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.80% (4.2280 => 4.4733, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3133, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (3.6395 => 3.7753, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.66% (2.0360 => 2.1106, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.6802 => 8.8975, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.42% (0.9957 => 1.0198, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2405, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.37% (9.1159 => 9.2404, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 1.01% (1.4460 => 1.4606, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4504, std.dev.: 0.0178) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.48% (5.2763 => 1.1880, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.45% (0.8651 => 0.2124, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (5.3855 => 4.4441, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.95% (5.3526 => 4.4456, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: -12.35% (10.4361 => 9.1474, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.98% (1.7609 => 1.6204, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -7.91% (54.1659 => 49.8836, std.dev.: 0.0312) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.05% (1.9577 => 0.6646, std.dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -43.04% (2.0460 => 1.1654) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0221, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4241, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -25.03% (85.0658 => 63.7745, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.71% (2.9695 => 2.2952, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2258 => 0.9607, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -16.36% (2.5528 => 2.1351, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4937, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: -11.19% (1.2373 => 1.0989, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.95% (1.5660 => 1.4259, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2950, std.dev.: 0.0487) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -7.04% (4.8142 => 4.4755, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5797, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.72% (2.7294 => 2.5734, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -4.50% (10.2830 => 9.8201, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.11% (8.1563 => 7.8214, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.13% (1.0554 => 1.0329, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6563, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2333, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8577, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0021) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 20:50:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 22:50:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109045016.58B792A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7425?compare_to=7423&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7425, Order: 171942, Start Time: 2013-01-09 03:12:20, End Time: 2013-01-09 04:50:14 To: 7423, Order: 171924, Start Time: 2013-01-09 01:10:08, End Time: 2013-01-09 02:48:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 8 (113 on baseline) Performance Improvements: 50 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1046 (853 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.37% (0.1926 => 0.2299, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.01% (0.3773 => 0.4226, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.58% (1.4940 => 1.5475, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 2.18% (0.4631 => 0.4732, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6930 => 0.7045, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 6.90% (1.0927 => 1.1681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.3666 => 5.4424, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.12% (80.0406 => 80.9343, std.dev.: 0.1795) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.46% (1.0948 => 0.8270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -24.17% (1.1053 => 0.8381, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -24.08% (1.1056 => 0.8394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -24.03% (1.1066 => 0.8407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.74% (1.1256 => 0.8584, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -23.64% (1.1351 => 0.8668, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -23.53% (1.1621 => 0.8887, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -23.49% (1.1733 => 0.8977, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -23.46% (1.1417 => 0.8739, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -23.37% (1.1317 => 0.8672, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -23.32% (1.1513 => 0.8828, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -23.22% (1.1709 => 0.8990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -23.18% (1.1722 => 0.9005, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -23.17% (1.1707 => 0.8994, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -22.73% (1.1679 => 0.9024, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -22.64% (1.1800 => 0.9129, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -22.62% (1.1919 => 0.9223, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -22.52% (1.1998 => 0.9296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -22.45% (1.2372 => 0.9595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -22.42% (1.1982 => 0.9296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.30% (1.2074 => 0.9382, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -22.22% (1.2044 => 0.9368, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (1.2108 => 0.9419, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -22.20% (1.2198 => 0.9490, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -22.00% (1.2173 => 0.9495, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -21.89% (1.2337 => 0.9637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -21.73% (1.2446 => 0.9741, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -21.51% (1.2534 => 0.9838, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -21.50% (1.2784 => 1.0036, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -21.40% (1.2236 => 0.9617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -21.22% (1.2790 => 1.0076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -21.11% (1.2810 => 1.0106, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -20.77% (1.2963 => 1.0270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -20.68% (1.2840 => 1.0185, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -20.37% (1.3188 => 1.0501, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -19.81% (1.3717 => 1.0999, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -8.71% (0.6558 => 0.5987, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.27% (3.0203 => 2.8610, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.94% (0.8418 => 0.8002, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.85% (2.3455 => 2.2317, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.41% (0.4934 => 0.4815, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -2.27% (5.4266 => 5.3035, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.21% (0.5691 => 0.5565, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.70% (5.1326 => 5.0456, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.09% (1.4072 => 1.3918, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/dt: -12.51% (1.1627 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.63% (3.3256 => 3.2383, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.19% (4.1979 => 4.1059, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.3318 => 3.2815, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.11% (7.7738 => 7.6873, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 331.81% (22.4056 => 96.7503, std.dev.: 0.0732) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.78% (0.0717 => 0.1246, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 64.21% (0.6395 => 1.0501, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 62.88% (0.5456 => 0.8887, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 62.15% (0.5688 => 0.9223, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 61.56% (0.5567 => 0.8994, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.40% (0.0974 => 0.1572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 61.38% (0.5805 => 0.9368, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 61.35% (0.5581 => 0.9005, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 61.26% (0.5575 => 0.8990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 60.96% (0.6260 => 1.0076, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 59.74% (0.5941 => 0.9490, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.53% (0.0514 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 59.04% (0.6033 => 0.9595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 58.93% (0.5849 => 0.9296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 58.66% (0.5859 => 0.9296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 55.84% (0.6440 => 1.0036, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 55.71% (0.6189 => 0.9637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.52% (0.6304 => 0.9741, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 53.97% (0.0315 => 0.0485, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 53.84% (0.6395 => 0.9838, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.83% (0.6676 => 1.0270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.74% (0.6660 => 1.0106, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 50.97% (0.5478 => 0.8270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 50.70% (0.5570 => 0.8394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 50.62% (0.5802 => 0.8739, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 50.59% (0.6230 => 0.9382, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.49% (0.5569 => 0.8381, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.46% (0.5705 => 0.8584, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 50.37% (0.5591 => 0.8407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 49.00% (0.5925 => 0.8828, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 48.33% (0.6052 => 0.8977, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 47.99% (0.5857 => 0.8668, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 47.91% (0.5863 => 0.8672, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 46.19% (0.7524 => 1.0999, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 46.12% (0.6446 => 0.9419, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 45.69% (0.6194 => 0.9024, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.97% (0.6297 => 0.9129, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 43.95% (0.6681 => 0.9617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 42.42% (0.6667 => 0.9495, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.57% (0.0599 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 38.78% (0.7339 => 1.0185, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.84% (0.1132 => 0.1549, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.47% (1.6474 => 2.2317, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 33.18% (5.4682 => 7.2827, std.dev.: 0.0319) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.19% (0.0699 => 0.0917, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 28.28% (0.0693 => 0.0889, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.09% (0.0680 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.67% (2.2587 => 2.8610, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.20% (0.0790 => 0.0997, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.64% (0.0621 => 0.0774, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.57% (0.0582 => 0.0725, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.04% (0.0445 => 0.0552, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.96% (0.1081 => 0.1286, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.99% (0.1982 => 0.2299, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.34% (1.1450 => 1.3206, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.89% (0.3357 => 0.3857, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.97% (0.7021 => 0.8002, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.20% (0.4916 => 0.5565, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.96% (3.5339 => 3.9920, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 12.91% (0.4515 => 0.5098, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.35% (0.5329 => 0.5987, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.95% (4.5069 => 5.0456, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8248, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 10.32% (18.2933 => 20.1817, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.22% (0.3834 => 0.4226, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.85% (0.2001 => 0.2198, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.18% (0.2385 => 0.2604, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.21% (0.1230 => 0.1331, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.43% (0.1441 => 0.1548, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.10% (1.2515 => 1.3403, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 6.82% (9.2283 => 9.8579, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.36% (1.2784 => 1.3597, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 5.99% (17.1032 => 18.1271, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: 5.91% (0.1761 => 0.1865, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.69% (1.4642 => 1.5475, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.59% (5.0226 => 5.3035, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.3319 => 0.3483, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 4.60% (0.4524 => 0.4732, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.37% (0.6750 => 0.7045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.36% (0.4861 => 0.5073, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.3255 => 0.3393, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.26% (0.9557 => 0.9869, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.3864 => 1.4235, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 2.19% (0.7447 => 0.7610, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.18% (15.5079 => 15.8458, std.dev.: 0.0269) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.43% (1.3722 => 1.3918, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6775, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.66% (0.9531 => 1.0166, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4424, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 3.64% (11.6767 => 12.1023, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.17% (54.5751 => 56.3067, std.dev.: 0.1740) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.77% (3.1932 => 3.2815, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (0.6469 => 0.6630) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6551 => 3.7244, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3253, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6018, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.53% (79.7170 => 80.9343, std.dev.: 0.1795) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.76% (0.3194 => 0.2978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.09% (0.3831 => 0.3636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.04% (0.3848 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.92% (0.3821 => 0.3633, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.88% (0.3891 => 0.3701, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.79% (0.4176 => 0.3976, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.78% (0.7198 => 0.6854, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.62% (0.2903 => 0.2769, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.53% (2.1713 => 2.0729, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -4.53% (0.3025 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.22% (0.4199 => 0.4022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.21% (0.3252 => 0.3115, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.05% (0.6441 => 0.6180, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.88% (0.3142 => 0.3020, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -3.86% (1.3148 => 1.2641, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -3.86% (0.4280 => 0.4115, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.79% (0.9852 => 0.9479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.64% (0.4151 => 0.4000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.34% (0.3621 => 0.3500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.32% (0.7779 => 0.7521, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.20% (0.3849 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (0.9542 => 0.9246, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3931 => 0.3811, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.02% (0.6484 => 0.6288, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.82% (0.4427 => 0.4302, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.80% (0.4321 => 0.4200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.77% (0.3788 => 0.3683, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2595, std.dev.: 0.0419) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.23% (6.7716 => 6.6204, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (2.4924 => 2.4393, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.08% (14.2083 => 13.9131, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.00% (1.2210 => 1.1966, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.98% (1.2221 => 1.1979, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: -1.89% (4.3330 => 4.2511, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.79% (1.0544 => 1.0355, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.70% (1.2300 => 1.2091, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.64% (16.1920 => 15.9268, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: -1.62% (7.0961 => 6.9810, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -1.44% (0.7982 => 0.7867, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.29% (0.8521 => 0.8411, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9305, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.94% (1.8100 => 0.6888, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -37.05% (0.1622 => 0.1021, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2383, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.73% (1.3643 => 1.0269, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7568, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0767, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.60% (2.9703 => 2.2989) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1796, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.47% (2.5106 => 2.1223, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1059, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.95% (4.9100 => 4.2740, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7813, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.27% (4.1534 => 3.8929, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1556, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.13% (3.1919 => 3.0602, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.62% (7.9763 => 7.6873, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.38% (1.0557 => 1.0200, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (1.3096 => 1.2784, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/ary3: -1.93% (3.7241 => 3.6522, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8024, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6004, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: -1.18% (1.4516 => 1.4345, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (3.7092 => 3.6669, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3550, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 21:36:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 8 Jan 2013 23:36:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109053634.852152A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7426?compare_to=7424&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7426, Order: 171942, Start Time: 2013-01-09 03:20:11, End Time: 2013-01-09 05:36:32 To: 7424, Order: 171920, Start Time: 2013-01-09 00:36:12, End Time: 2013-01-09 02:49:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 16 (225 on baseline) Performance Improvements: 51 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1033 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 177.33% (38.0293 => 105.4653, std.dev.: 0.0890) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.04% (0.2093 => 0.2659, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.04% (6.4262 => 8.1636, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 9.73% (20.4716 => 22.4634, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: 8.08% (19.1446 => 20.6921, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash: 3.34% (0.5143 => 0.5315, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 3.26% (0.5490 => 0.5669, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.7740 => 0.7945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.91% (0.9256 => 0.9433, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 1.80% (2.6780 => 2.7261, std.dev.: 0.0084) MultiSource/Applications/hbd/hbd: 1.58% (1.7726 => 1.8006, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.39% (4.9150 => 4.9833, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 1.03% (18.0920 => 18.2788, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 5.78% (1.0989 => 1.1624, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.27% (5.7766 => 5.8497, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.10% (3.0598 => 3.0934, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.85% (1.3311 => 1.0136, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -23.53% (1.3500 => 1.0324, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -23.53% (1.3449 => 1.0285, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -23.49% (1.3460 => 1.0298, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.20% (1.3877 => 1.0657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -23.15% (1.3838 => 1.0635, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -23.07% (1.3908 => 1.0699, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -22.96% (1.4262 => 1.0987, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -22.82% (1.3916 => 1.0740, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -22.57% (1.4050 => 1.0879, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -22.41% (1.4194 => 1.1013, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -22.08% (1.4282 => 1.1129, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -21.83% (1.4680 => 1.1476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (1.4624 => 1.1434, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -21.46% (1.4989 => 1.1772, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -21.46% (1.4821 => 1.1641, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -21.05% (1.5167 => 1.1974, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -20.73% (1.5039 => 1.1922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -20.67% (1.5568 => 1.2350, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -20.62% (1.5178 => 1.2048, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -20.51% (1.5161 => 1.2052, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -20.43% (1.5198 => 1.2093, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -20.15% (1.5518 => 1.2391, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -20.02% (1.5967 => 1.2770, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -19.97% (1.5545 => 1.2440, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -19.90% (1.5604 => 1.2499, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -19.85% (1.5615 => 1.2515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -19.79% (1.5734 => 1.2620, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -19.59% (1.5905 => 1.2790, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -19.42% (1.6006 => 1.2898, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -19.10% (1.6436 => 1.3297, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -18.93% (1.6367 => 1.3269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -18.73% (1.6505 => 1.3414, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -18.45% (1.6690 => 1.3611, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -18.43% (1.6915 => 1.3798, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -18.30% (0.1246 => 0.1018, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -17.71% (1.7509 => 1.4408, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.43% (0.7630 => 0.7216, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -4.96% (0.2257 => 0.2145, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.08% (0.9474 => 0.9087, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.26% (0.5606 => 0.5423, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.40% (3.3406 => 3.2603, std.dev.: 0.0189) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.23% (0.6411 => 0.6268, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.64% (5.8709 => 5.7748, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.33% (2.5662 => 2.5321, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.06% (1.6004 => 1.5834, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/dt: -12.71% (1.1654 => 1.0173) SingleSource/Benchmarks/Shootout-C++/hash2: -4.62% (3.3133 => 3.1601, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.63% (3.3264 => 3.2388, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.18% (4.2014 => 4.1099, std.dev.: 0.0002) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.10% (4.5804 => 4.4843, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (0.0658 => 0.0676, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8420 => 499.8448, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.27% (1.1277 => 499.8448, std.dev.: 0.0022) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.06% (0.5229 => 1.6579, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 21.94% (14.9895 => 18.2788, std.dev.: 0.0056) MultiSource/Applications/kimwitu++/kc: 58.69% (14.1553 => 22.4634, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 18.67% (4.1105 => 4.8778, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.93% (1.1048 => 1.7559, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1373.35% (7.1582 => 105.4653, std.dev.: 0.0890) SingleSource/Benchmarks/Misc-C++-EH/spirit: 135.74% (3.4629 => 8.1636, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 79.62% (0.6222 => 1.1176, std.dev.: 0.0175) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10246.94% (0.0720 => 7.4498, std.dev.: 0.0098) MultiSource/Applications/SIBsim4/SIBsim4: 3832200.00% (0.0001 => 3.8323, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11082200.00% (0.0001 => 11.0823, std.dev.: 0.0468) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 66400.00% (0.0001 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9885300.00% (0.0001 => 9.8854, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5506500.00% (0.0001 => 5.5066, std.dev.: 0.0140) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.26% (1.1194 => 10.3014, std.dev.: 0.0431) MultiSource/Applications/ClamAV/clamscan: 149.18% (22.1758 => 55.2571, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.90% (0.0929 => 0.1792, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 81.42% (0.0296 => 0.0537, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 73.75% (0.1463 => 0.2542, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0011) SingleSource/Regression/C/sumarray: 63.20% (0.0231 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.66% (1.5859 => 2.5321, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.93% (2.9384 => 4.6405, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.67% (7.0540 => 10.9807, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/IntMM: 51.78% (0.0394 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 48.03% (2.2024 => 3.2603, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.97% (8.1363 => 12.0389, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 47.38% (0.0439 => 0.0647, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 41.35% (0.5105 => 0.7216, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 41.22% (21.9371 => 30.9800, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.54% (0.1892 => 0.2659, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 40.21% (0.3109 => 0.4359, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 39.18% (0.1432 => 0.1993, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.89% (0.1062 => 0.1475, std.dev.: 0.0012) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 36.13% (0.6675 => 0.9087, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.82% (0.4615 => 0.6268, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.41% (4.2646 => 5.7748, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.03% (1.5415 => 2.0661, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/exptree: 33.42% (0.0814 => 0.1086, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.78% (0.0479 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 31.94% (0.4299 => 0.5672, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.89% (0.1337 => 0.1750, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.47% (0.2271 => 0.2963, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 29.80% (1.1642 => 1.5111, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 29.61% (0.1655 => 0.2145, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.26% (0.0793 => 0.1025, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.70% (0.1906 => 0.2453, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.22% (0.1584 => 0.2031, std.dev.: 0.0048) SingleSource/Benchmarks/Stanford/Oscar: 28.14% (0.0636 => 0.0815, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.03% (3.8922 => 4.9833, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.73% (0.1125 => 0.1437, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 27.37% (0.2554 => 0.3253, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.12% (0.1143 => 0.1453, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.94% (0.0746 => 0.0947, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.91% (0.0457 => 0.0580, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 26.82% (0.1555 => 0.1972, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 26.21% (0.1175 => 0.1483, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.74% (0.0408 => 0.0513, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.72% (0.1695 => 0.2131, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.61% (0.1566 => 0.1967, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 25.28% (1.0722 => 1.3432, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.18% (0.3121 => 0.3907, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.04% (0.0886 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.00% (0.0675 => 0.0837, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 23.98% (0.7115 => 0.8821, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 23.92% (0.4289 => 0.5315, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.84% (0.0730 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 23.73% (9.4845 => 11.7350, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.54% (1.4186 => 1.7525, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 23.47% (5.7591 => 7.1110, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.11% (0.2700 => 0.3324, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 23.06% (0.6456 => 0.7945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.92% (0.0672 => 0.0826, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 22.71% (0.4620 => 0.5669, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.56% (0.3098 => 0.3797, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 22.51% (0.0662 => 0.0811, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.01% (0.1236 => 0.1508, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1163 => 0.1417, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.77% (0.1695 => 0.2064, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 21.70% (0.7835 => 0.9535, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.33% (1.3050 => 1.5834, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.08% (4.9449 => 5.9873, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.74% (0.1032 => 0.1246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.59% (0.1151 => 0.1388, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 20.44% (17.1811 => 20.6921, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.31% (0.5860 => 0.7050, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 20.06% (3.3354 => 4.0046, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.91% (0.8172 => 0.9799, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.87% (0.1117 => 0.1339, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 19.85% (1.1840 => 1.4190, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.83% (0.0953 => 0.1142, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.81% (5.0018 => 5.9928, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.41% (0.3307 => 0.3949, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 19.37% (0.7433 => 0.8873, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.27% (0.2065 => 0.2463, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.26% (0.5020 => 0.5987, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.25% (0.2758 => 0.3289, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 18.69% (2.2969 => 2.7261, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.61% (0.1510 => 0.1791, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.58% (0.3423 => 0.4059, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.57% (0.5569 => 0.6603, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 18.44% (0.3232 => 0.3828, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 18.35% (3.8723 => 4.5829, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/ary3: 18.31% (0.3283 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 17.91% (2.0273 => 2.3904, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.2107 => 0.2484, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.82% (0.9765 => 1.1505, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 17.42% (0.2049 => 0.2406, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.12% (0.5981 => 0.7005, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.98% (0.4636 => 0.5423, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.93% (0.8067 => 0.9433, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.88% (0.3441 => 0.4022, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.87% (0.8101 => 0.9468, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 16.45% (0.3379 => 0.3935, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 16.38% (0.3180 => 0.3701, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.34% (0.6450 => 0.7504, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.86% (0.8921 => 1.0336, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.40% (1.5603 => 1.8006, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.30% (1.1861 => 1.3676, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.28% (0.0759 => 0.0875, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.93% (0.3865 => 0.4442, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.06% (0.3927 => 0.4479, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.94% (0.4103 => 0.4675, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.81% (0.4048 => 0.4607, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.72% (0.3886 => 0.4419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.63% (0.4203 => 0.4776, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.3387 => 0.3843, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/sieve: 13.35% (0.3603 => 0.4084, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 13.09% (0.3828 => 0.4329, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.96% (0.3543 => 0.4002, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.90% (0.3473 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.86% (0.3561 => 0.4019, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 12.84% (0.3684 => 0.4157, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 12.83% (0.3422 => 0.3861, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.81% (0.3543 => 0.3997, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.78% (0.3694 => 0.4166, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.75% (0.3497 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.71% (0.3516 => 0.3963, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.36% (0.3826 => 0.4299, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 12.19% (0.3282 => 0.3682, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.18% (0.4064 => 0.4559, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.00% (0.3092 => 0.3463, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/Puzzle: 11.75% (0.1268 => 0.1417, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.63% (10.3673 => 11.5728, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.58% (14.3668 => 16.0300, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.48% (0.2430 => 0.2709, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.47% (0.3427 => 0.3820, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 11.37% (0.2831 => 0.3153, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 11.35% (0.2871 => 0.3197, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.61% (2.0665 => 2.2857, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.56% (0.2756 => 0.3047, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 10.54% (1.2842 => 1.4196, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 10.53% (0.2905 => 0.3211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.53% (0.2725 => 0.3012, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2877 => 0.3172, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2793 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2891 => 0.3185, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 10.10% (0.2714 => 0.2988, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.09% (0.3162 => 0.3481, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 10.03% (0.6030 => 0.6635, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3650 => 0.4012, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.85% (0.1330 => 0.1461, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2802 => 0.3077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.74% (0.5925 => 0.6502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.67% (0.3052 => 0.3347, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.65% (0.7326 => 0.8033, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.64% (0.2872 => 0.3149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.34% (0.3136 => 0.3429, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.33% (0.3935 => 0.4302, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.17% (63.2438 => 69.0438, std.dev.: 0.0336) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.84% (2.2022 => 2.3749, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.52% (0.3177 => 0.3384, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.25% (0.2266 => 0.2385, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.24% (0.3817 => 0.4017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (0.3131 => 0.3291, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.99% (7.9617 => 8.2792, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.15% (32.5116 => 59.2194, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.90% (0.2944 => 0.3265, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.02% (2.8904 => 3.0934, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.49% (11.6436 => 12.3993, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.73% (4.2280 => 4.4702, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.68% (3.6395 => 3.7734, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.3316 => 0.3427, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9090, std.dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.40% (0.9957 => 1.0196, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.98% (0.8333 => 0.8498, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.76% (9.1159 => 9.2764, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2759, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4554, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5751, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.01% (26.0924 => 26.3551, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.51% (5.2763 => 1.1869, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.33% (0.8651 => 0.2134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.86% (0.1622 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.94% (5.3855 => 4.4734, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.36% (5.3526 => 4.4771, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -12.43% (10.4361 => 9.1386, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9110, std.dev.: 0.0928) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.76% (1.7609 => 1.6242, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.37% (1.9577 => 0.6584, std.dev.: 0.0121) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3069, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4231, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -24.97% (85.0658 => 63.8222, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2980, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.80% (0.0757 => 0.0592, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.53% (2.5528 => 2.1307, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4905, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2988, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.05% (1.2373 => 1.1624, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5039, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.76% (8.1563 => 7.7681, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8249, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3302, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0020) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 22:51:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 00:51:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109065156.4B8312A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7427?compare_to=7425&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7427, Order: 171949, Start Time: 2013-01-09 05:13:45, End Time: 2013-01-09 06:51:54 To: 7425, Order: 171942, Start Time: 2013-01-09 03:12:20, End Time: 2013-01-09 04:50:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 331.73% (22.4056 => 96.7320, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/lowercase: 80.71% (0.0280 => 0.0506, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.78% (0.0717 => 0.1246, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 63.55% (0.6395 => 1.0459, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 62.24% (0.5456 => 0.8852, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 61.59% (0.5688 => 0.9191, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.09% (0.0974 => 0.1569, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 61.07% (0.5567 => 0.8967, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 60.91% (0.5805 => 0.9341, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 60.80% (0.5581 => 0.8974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.56% (0.5575 => 0.8951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 60.40% (0.6260 => 1.0041, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.73% (0.0514 => 0.0821) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 59.17% (0.5941 => 0.9456, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 58.46% (0.6033 => 0.9560, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 58.28% (0.5849 => 0.9258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 58.12% (0.5859 => 0.9264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 55.26% (0.6440 => 0.9999, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 55.24% (0.6189 => 0.9608, std.dev.: 0.0092) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.00% (0.6304 => 0.9708, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 53.65% (0.6395 => 0.9826, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.39% (0.6676 => 1.0240, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.14% (0.6660 => 1.0066, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 50.88% (0.5478 => 0.8265, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 50.59% (0.5570 => 0.8388, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 50.43% (0.6230 => 0.9372, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.37% (0.5569 => 0.8374, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 50.22% (0.5802 => 0.8716, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.22% (0.5705 => 0.8570, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 49.88% (0.5591 => 0.8380, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 48.74% (0.5925 => 0.8813, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 48.07% (0.6052 => 0.8961, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 47.94% (0.5857 => 0.8665, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 47.59% (0.5863 => 0.8653, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 46.03% (0.6446 => 0.9413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.71% (0.7524 => 1.0963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 45.51% (0.6194 => 0.9013, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.89% (0.6297 => 0.9124, std.dev.: 0.0051) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 43.87% (0.6681 => 0.9612, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 42.28% (0.6667 => 0.9486, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.73% (0.0599 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 38.49% (0.7339 => 1.0164, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.50% (1.6474 => 2.2323, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 33.59% (5.4682 => 7.3047, std.dev.: 0.0251) SingleSource/Benchmarks/Stanford/IntMM: 28.95% (0.0418 => 0.0539, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.38% (0.0680 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 28.14% (0.0693 => 0.0888, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.65% (2.2587 => 2.8606, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.33% (0.0790 => 0.0998, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.91% (0.0582 => 0.0727, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.80% (0.0621 => 0.0775, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 19.15% (0.1081 => 0.1288, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.15% (0.1982 => 0.2302, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 15.23% (1.1450 => 1.3194, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.83% (0.3357 => 0.3855, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.04% (0.7021 => 0.8007, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.55% (0.4916 => 0.5582, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: 12.98% (0.4515 => 0.5101, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.78% (3.5339 => 3.9854, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.35% (4.5069 => 5.0637, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.29% (0.5329 => 0.5984, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.71% (1.6364 => 1.8280, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.14% (0.2001 => 0.2204) MultiSource/Applications/kimwitu++/kc: 9.82% (18.2933 => 20.0901, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.2385 => 0.2611, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.31% (0.3834 => 0.4191, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.29% (0.1441 => 0.1546, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.17% (1.2515 => 1.3412, std.dev.: 0.0080) MultiSource/Benchmarks/mafft/pairlocalalign: 6.78% (9.2283 => 9.8538, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.53% (1.2784 => 1.3619, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 6.08% (0.1761 => 0.1868, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 5.95% (17.1032 => 18.1200, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (1.4642 => 1.5491, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 5.59% (5.0226 => 5.3033, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash: 5.08% (0.4524 => 0.4754, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 4.51% (0.4861 => 0.5080, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.47% (0.6750 => 0.7052, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3255 => 0.3397, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.46% (0.9557 => 0.9888, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.3864 => 1.4229, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 2.39% (0.7447 => 0.7625, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.37% (15.5079 => 15.8747, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 2.04% (0.8418 => 0.8590, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3722 => 1.3930, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.12% (3.5154 => 3.5546, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6747, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.55% (0.9531 => 1.0155, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (5.1955 => 5.4403, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.64% (11.6767 => 12.1016, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5228, std.dev.: 0.1358) SingleSource/Benchmarks/Shootout-C++/hash2: 3.06% (3.1932 => 3.2908, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6551 => 3.7229, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3246, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6075, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.26% (0.3837 => 0.3635, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.88% (0.3323 => 0.3161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.58% (0.3059 => 0.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.53% (0.3026 => 0.2889, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.51% (0.3812 => 0.3640, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.49% (0.3831 => 0.3659, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -4.48% (0.3880 => 0.3706, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.47% (0.3848 => 0.3676, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.45% (0.3821 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.42% (0.3891 => 0.3719, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.27% (0.3252 => 0.3113, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.27% (2.1713 => 2.0786, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.4033 => 0.3863, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.91% (0.3884 => 0.3732, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.87% (0.9852 => 0.9471, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -3.76% (1.3148 => 1.2653, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: -3.76% (0.4199 => 0.4041, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.76% (0.3142 => 0.3024, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -3.64% (0.7779 => 0.7496, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: -3.63% (0.6441 => 0.6207, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.44% (0.4151 => 0.4008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.29% (0.4280 => 0.4139, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.9542 => 0.9234, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (0.3849 => 0.3733, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.00% (0.3931 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.93% (0.3658 => 0.3551, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -2.92% (0.3867 => 0.3754, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.6484 => 0.6306, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -2.68% (0.4248 => 0.4134, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.64% (0.4321 => 0.4207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2403, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.12% (0.7919 => 0.7751, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9087, std.dev.: 0.0274) MultiSource/Benchmarks/PAQ8p/paq8p: -2.08% (2.4924 => 2.4406, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.04% (1.2210 => 1.1961, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.00% (1.2221 => 1.1977, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.91% (6.7716 => 6.6421, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.72% (1.0544 => 1.0363, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -1.70% (4.3330 => 4.2592, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -1.62% (16.1920 => 15.9304, std.dev.: 0.0227) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.54% (1.2300 => 1.2110, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -1.46% (7.0961 => 6.9926, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: -1.10% (1.5610 => 1.5438, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.48% (1.8100 => 0.6791, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3097, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2385, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0777, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.20% (5.3397 => 4.1008, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1790, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4056, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.46% (2.5106 => 2.1224, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1060, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.96% (4.9100 => 4.2735, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7811, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.26% (4.1534 => 3.8934, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1556, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0603, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.61% (7.9763 => 7.6885, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.66% (1.3096 => 1.2747, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/ary3: -2.15% (3.7241 => 3.6441, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8082, std.dev.: 0.0142) MultiSource/Applications/lemon/lemon: -1.20% (1.4516 => 1.4342, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.19% (1.6219 => 1.6026, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7092 => 3.6714, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 8 23:17:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 01:17:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130109071744.5A1802A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7428?compare_to=7422&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7428, Order: 171942, Start Time: 2013-01-09 03:43:22, End Time: 2013-01-09 07:17:43 To: 7422, Order: 171899, Start Time: 2013-01-08 22:49:44, End Time: 2013-01-09 02:23:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 83.66% (12.8932 => 23.6794, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.09% (0.5955 => 0.8759, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.38% (0.8180 => 0.9765, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.84% (5.1713 => 5.5765, std.dev.: 0.0026) MultiSource/Applications/kimwitu++/kc: 2.74% (12.8543 => 13.2066, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 2.49% (2.1891 => 2.2435, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.18% (1.9456 => 1.9686, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.54% (124.2044 => 131.0895, std.dev.: 0.3967) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 103.43% (11.6398 => 23.6794, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 63.38% (0.5361 => 0.8759, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.48% (0.0625 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.50% (0.7426 => 0.9765, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.42% (0.2969 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.71% (0.4139 => 0.5203, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.44% (0.5900 => 0.7401, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.21% (0.4994 => 0.6253, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.57% (0.4253 => 0.5298, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.64% (0.1620 => 0.2003, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.56% (1.5932 => 1.9686, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.48% (0.5000 => 0.6174, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.44% (0.1003 => 0.1218, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.26% (0.1604 => 0.1945, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.17% (0.1549 => 0.1877, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.88% (0.3903 => 0.4718, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.51% (0.4029 => 0.4815, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 19.46% (0.1218 => 0.1455, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.07% (0.3890 => 0.4632, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.84% (4.6926 => 5.5765, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.57% (0.2736 => 0.3244, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.2866 => 0.3397, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/09-vor/vor: 18.41% (0.1505 => 0.1782, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.22% (0.3271 => 0.3867, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.97% (0.5826 => 0.6873, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 17.89% (0.5546 => 0.6538, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: 17.66% (0.5889 => 0.6929, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 17.54% (1.8794 => 2.2090, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (0.4658 => 0.5474, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.34% (1.3152 => 1.5432, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.12% (3.5627 => 4.1728, std.dev.: 0.0033) MultiSource/Applications/hbd/hbd: 17.11% (0.9697 => 1.1356, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.98% (1.6211 => 1.8964, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.97% (0.1968 => 0.2302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.87% (0.2738 => 0.3200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 16.61% (0.7171 => 0.8362, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.37% (0.5026 => 0.5849, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.16% (4.4195 => 5.1338, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 16.15% (0.2725 => 0.3165, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.15% (0.2750 => 0.3194, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.11% (0.3930 => 0.4563, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 16.09% (0.2803 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 16.05% (0.2823 => 0.3276, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.03% (0.2813 => 0.3264, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.01% (0.2792 => 0.3239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.01% (0.2811 => 0.3261, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.01% (0.2911 => 0.3377, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 15.91% (0.3004 => 0.3482, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.78% (2.0673 => 2.3936, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.68% (0.9909 => 1.1463, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.66% (0.1028 => 0.1189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 15.65% (0.2780 => 0.3215, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.62% (0.3195 => 0.3694, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.58% (1.0781 => 1.2461, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.51% (1.9694 => 2.2748, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 15.50% (23.5202 => 27.1650, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.30% (0.3267 => 0.3767, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 15.25% (0.3258 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.25% (1.9966 => 2.3011, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.03% (2.7292 => 3.1393, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.02% (0.3362 => 0.3867, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 14.98% (4.2109 => 4.8418, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.92% (0.3124 => 0.3590, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.90% (0.3726 => 0.4281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.89% (0.3317 => 0.3811, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.85% (0.3678 => 0.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.75% (0.3477 => 0.3990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3348 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.66% (0.3282 => 0.3763, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.54% (0.3625 => 0.4152, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.50% (0.3690 => 0.4225, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.45% (1.4269 => 1.6331, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 14.42% (0.2566 => 0.2936, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: 14.40% (0.4146 => 0.4743, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.37% (0.3981 => 0.4553, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.26% (0.4251 => 0.4857, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.99% (0.6435 => 0.7335, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.93% (0.3488 => 0.3974, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.82% (0.3460 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.78% (0.3469 => 0.3947, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.77% (0.5012 => 0.5702, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 13.73% (0.3496 => 0.3976, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.56% (0.7875 => 0.8943, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.52% (0.3845 => 0.4365, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.23% (0.2737 => 0.3099, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.10% (0.3084 => 0.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.77% (0.2068 => 0.2332, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.70% (2.1653 => 2.4404, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 12.66% (5.5417 => 6.2434, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: 12.16% (4.6177 => 5.1792, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 12.14% (0.2075 => 0.2327, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 11.75% (2.1013 => 2.3481, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 11.63% (0.2691 => 0.3004, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.25% (0.6634 => 0.7380, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 10.91% (0.4847 => 0.5376, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 10.46% (11.9555 => 13.2066, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 10.27% (2.0346 => 2.2435, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.05% (0.2040 => 0.2245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.49% (0.5584 => 0.6114, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.36% (0.2391 => 0.2591, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.59% (0.1383 => 0.1488, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3792 => 0.3963, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5225, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.61% (0.3693 => 0.4085, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 8.89% (0.2802 => 0.3051, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 5.47% (0.2122 => 0.2238, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2389, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6701, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6923, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 4.51% (1.8057 => 1.8872, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 2.96% (0.6276 => 0.6462, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1935, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.75% (2.0820 => 2.1185, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3067, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2842, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0801, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2085, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.09% (10.3705 => 10.4840, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.09% (3.6465 => 3.6862, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6005, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5645, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.21% (17.2379 => 14.2720, std.dev.: 0.1818) SingleSource/UnitTests/Vector/multiplies: -11.33% (2.3713 => 2.1026, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7845, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2332, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7978, std.dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -3.12% (14.0481 => 13.6093, std.dev.: 0.0531) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.64% (0.6293 => 0.6127, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1250, std.dev.: 0.0972) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.30% (5.7935 => 5.7182, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1477, std.dev.: 0.0923) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 00:25:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 02:25:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109082509.94B892A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7429?compare_to=7426&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7429, Order: 171954, Start Time: 2013-01-09 06:08:44, End Time: 2013-01-09 08:25:07 To: 7426, Order: 171942, Start Time: 2013-01-09 03:20:11, End Time: 2013-01-09 05:36:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (223 on baseline) Performance Improvements: 6 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.87% (0.4426 => 0.4166, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -2.28% (11.5728 => 11.3090, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.95% (0.9433 => 0.9249, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -1.33% (1.4196 => 1.4007, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.29% (1.8006 => 1.7773, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.05% (5.9873 => 5.9244, std.dev.: 0.0188) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1337 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.25% (0.0676 => 0.0654, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.41% (499.8448 => 482.7955, std.dev.: 8.0398) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 42712.41% (1.1277 => 482.7955, std.dev.: 8.0398) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.52% (0.5229 => 1.6551, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 21.40% (14.9895 => 18.1971, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 58.09% (14.1553 => 22.3788, std.dev.: 0.0156) MultiSource/Benchmarks/MallocBench/gs/gs: 18.37% (4.1105 => 4.8655, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.50% (1.1048 => 1.7511, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1378.48% (7.1582 => 105.8322, std.dev.: 0.0299) SingleSource/Benchmarks/Misc-C++-EH/spirit: 135.71% (3.4629 => 8.1623, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.56% (0.6222 => 1.1110, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.53% (0.0720 => 7.4459, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 3832600.00% (0.0001 => 3.8327, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: 11076100.00% (0.0001 => 11.0762, std.dev.: 0.0441) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66500.00% (0.0001 => 0.0666, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884500.00% (0.0001 => 9.8846, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5504500.00% (0.0001 => 5.5046, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.99% (1.1194 => 10.2872, std.dev.: 0.0459) MultiSource/Applications/ClamAV/clamscan: 148.20% (22.1758 => 55.0401, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.68% (0.0929 => 0.1790, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 73.48% (0.1463 => 0.2538, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 62.34% (0.0231 => 0.0375) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.08% (1.5859 => 2.5229, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.60% (2.9384 => 4.6309, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.00% (7.0540 => 11.0041, std.dev.: 0.0151) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.51% (8.1363 => 12.0015, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.35% (2.2024 => 3.2452, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 46.92% (0.0439 => 0.0645, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 41.35% (21.9371 => 31.0075, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.43% (0.1892 => 0.2657, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 40.02% (0.5105 => 0.7148, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.04% (0.1062 => 0.1466, std.dev.: 0.0069) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 35.40% (0.6675 => 0.9038, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.71% (0.4615 => 0.6217, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.65% (4.2646 => 5.7421, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.14% (1.5415 => 2.0523, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/exptree: 32.80% (0.0814 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 32.03% (0.4299 => 0.5676, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.73% (0.0479 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.44% (0.1337 => 0.1744, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.94% (0.2271 => 0.2951, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 29.14% (1.1642 => 1.5035, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 28.46% (0.1655 => 0.2126, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.07% (0.1906 => 0.2441, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.90% (0.1584 => 0.2026, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.70% (3.8922 => 4.9704, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.64% (0.1125 => 0.1436, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.42% (0.1143 => 0.1445, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.31% (0.2554 => 0.3226, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/tsp/tsp: 26.30% (0.1175 => 0.1484, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.10% (0.0793 => 0.1000, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.02% (0.3121 => 0.3933, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 24.90% (1.0722 => 1.3392, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.84% (0.1695 => 0.2116, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.39% (5.7591 => 7.1061, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 23.35% (9.4845 => 11.6987, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.99% (1.4186 => 1.7447, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 22.92% (0.4289 => 0.5272, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 22.88% (0.7115 => 0.8743, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 22.63% (0.6456 => 0.7917, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.48% (0.2700 => 0.3307, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (0.3098 => 0.3782, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.86% (0.4620 => 0.5630, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 21.82% (0.0614 => 0.0748, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 21.47% (0.1695 => 0.2059, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.44% (0.1236 => 0.1501, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.25% (1.3050 => 1.5823, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.00% (0.7835 => 0.9480, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 20.48% (1.1840 => 1.4265, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.48% (0.5860 => 0.7060, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 20.18% (17.1811 => 20.6474, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.81% (4.9449 => 5.9244, std.dev.: 0.0188) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.57% (3.3354 => 3.9880, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.39% (5.0018 => 5.9718, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.99% (0.3307 => 0.3935, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.94% (0.5020 => 0.5971, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.93% (0.2758 => 0.3280, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.89% (0.8172 => 0.9716, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.59% (0.0640 => 0.0759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.46% (0.5569 => 0.6597, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 18.14% (0.7433 => 0.8781, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 18.08% (2.2969 => 2.7122, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.05% (0.9765 => 1.1528, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.92% (0.2065 => 0.2435, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.3423 => 0.4025, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary3: 17.48% (0.3283 => 0.3857, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 17.44% (3.8723 => 4.5478, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary: 17.26% (0.3232 => 0.3790, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.2107 => 0.2470, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 17.23% (0.2049 => 0.2402, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.18% (2.0273 => 2.3755, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 16.39% (0.8921 => 1.0383, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.33% (0.4636 => 0.5393, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.24% (0.8101 => 0.9417, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.16% (0.3441 => 0.3997, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary2: 15.89% (0.3379 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.88% (0.6450 => 0.7474, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.34% (1.1861 => 1.3680, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 15.13% (0.3180 => 0.3661, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.65% (0.8067 => 0.9249, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3865 => 0.4412, std.dev.: 0.0082) MultiSource/Applications/hbd/hbd: 13.91% (1.5603 => 1.7773, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.77% (0.4103 => 0.4668, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.25% (0.4203 => 0.4760, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 12.74% (0.3603 => 0.4062, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.40% (0.4048 => 0.4550, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 12.25% (0.3886 => 0.4362, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 12.06% (0.3092 => 0.3465, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists1: 12.02% (0.3684 => 0.4127, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.60% (0.3828 => 0.4272, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.54% (0.4064 => 0.4533, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.52% (0.3543 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.37% (0.3826 => 0.4261, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.29% (14.3668 => 15.9886, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.2430 => 0.2701, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.96% (0.1268 => 0.1407, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.80% (0.2871 => 0.3181, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2831 => 0.3131, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.98% (2.0665 => 2.2727, std.dev.: 0.0104) SingleSource/Regression/C++/ofstream_ctor: 9.78% (0.2905 => 0.3189, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.73% (0.3650 => 0.4005, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.62% (0.1330 => 0.1458, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 9.60% (0.6030 => 0.6609, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (0.2756 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.34% (0.2793 => 0.3054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.32% (0.2877 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2725 => 0.2977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.13% (0.2891 => 0.3155, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.08% (10.3673 => 11.3090, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 9.07% (1.2842 => 1.4007, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 9.06% (0.2714 => 0.2960, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: 9.04% (0.7326 => 0.7988, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/random: 8.92% (0.2802 => 0.3052, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.87% (63.2438 => 68.8546, std.dev.: 0.0762) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.69% (0.3935 => 0.4277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.3136 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.88% (2.2022 => 2.3757, std.dev.: 0.0126) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.70% (0.3177 => 0.3390, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.22% (0.1625 => 0.1726, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.81% (0.2266 => 0.2375, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.17% (7.9617 => 8.2144, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.16% (32.5116 => 59.2234, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6961, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.02% (2.8904 => 3.0934, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.51% (11.6436 => 12.4012, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.05% (4.2280 => 4.4414, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.82% (3.6395 => 3.7787, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.52% (2.0360 => 2.1077, std.dev.: 0.0235) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.3316 => 0.3427, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.93% (0.9957 => 1.0249, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9182, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.09% (9.1159 => 9.3060, std.dev.: 0.0220) MultiSource/Benchmarks/Olden/bisort/bisort: 2.08% (0.8333 => 0.8506, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (0.6533 => 0.6660, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2769, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.14% (10.3460 => 10.4636, std.dev.: 0.0277) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5815, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3745, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.55% (5.2763 => 1.1846, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.41% (0.8651 => 0.2127, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.23% (0.1622 => 0.0937, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.76% (5.3855 => 4.4830, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.24% (5.3526 => 4.4835, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -12.81% (10.4361 => 9.0997, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.09% (1.7609 => 1.6185, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -7.90% (54.1659 => 49.8865, std.dev.: 0.0335) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.07% (1.9577 => 0.6643, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -50.27% (2.0460 => 1.0174) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.88% (0.0628 => 0.0365, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3083, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.67% (1.5373 => 1.0197, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.85% (10.7105 => 7.4068, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -24.98% (85.0658 => 63.8195, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0060, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2981, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.93% (0.0757 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -16.66% (2.5528 => 2.1275, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4252, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7325, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4923, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2954, std.dev.: 0.0704) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.74% (1.2373 => 1.1663, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.21% (8.1563 => 7.7311, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8330, std.dev.: 0.0124) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.37% (0.4808 => 0.4598, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3301, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2336, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0024) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 00:57:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 02:57:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109085734.6AB792A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7430?compare_to=7427&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7430, Order: 171954, Start Time: 2013-01-09 07:15:25, End Time: 2013-01-09 08:57:32 To: 7427, Order: 171949, Start Time: 2013-01-09 05:13:45, End Time: 2013-01-09 06:51:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (106 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.95% (0.7496 => 0.7642, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 333.54% (22.4056 => 97.1383, std.dev.: 0.0697) SingleSource/Benchmarks/Misc/lowercase: 80.71% (0.0280 => 0.0506, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 76.15% (0.0717 => 0.1263, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 63.24% (0.6395 => 1.0439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.88% (0.5456 => 0.8832, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 61.27% (0.5688 => 0.9173, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 60.82% (0.5567 => 0.8953, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.68% (0.0974 => 0.1565, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 60.57% (0.5805 => 0.9321, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 60.37% (0.5581 => 0.8950, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 60.21% (0.6260 => 1.0029, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.09% (0.5575 => 0.8925, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.53% (0.0514 => 0.0820, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 58.66% (0.5941 => 0.9426, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 58.06% (0.6033 => 0.9536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.98% (0.5849 => 0.9240, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 57.72% (0.5859 => 0.9241, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.91% (0.6440 => 0.9976, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.87% (0.6189 => 0.9585, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 53.74% (0.6304 => 0.9692, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 53.43% (0.6395 => 0.9812, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.00% (0.6676 => 1.0214, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.81% (0.6660 => 1.0044, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 50.73% (0.5478 => 0.8257, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.18% (0.5705 => 0.8568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 50.17% (0.5802 => 0.8713, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.10% (0.5569 => 0.8359, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 50.08% (0.6230 => 0.9350, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.96% (0.5570 => 0.8353, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 49.69% (0.5591 => 0.8369, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 48.54% (0.5925 => 0.8801, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 47.75% (0.6052 => 0.8942, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 47.70% (0.5857 => 0.8651, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 47.45% (0.5863 => 0.8645, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/neural/neural: 46.47% (0.1500 => 0.2197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 45.67% (0.6446 => 0.9390, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.37% (0.7524 => 1.0938, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 45.27% (0.6194 => 0.8998, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.47% (0.6297 => 0.9097, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 43.65% (0.6681 => 0.9597, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 41.83% (0.6667 => 0.9456, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.73% (0.0599 => 0.0843, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 38.33% (0.7339 => 1.0152, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.24% (1.6474 => 2.2280, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 33.68% (5.4682 => 7.3099, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 28.43% (0.0693 => 0.0890, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.38% (0.0680 => 0.0873, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.66% (2.2587 => 2.8608, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.20% (0.0790 => 0.0997, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.09% (0.0582 => 0.0728, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.96% (0.0621 => 0.0776) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 19.15% (0.1081 => 0.1288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 17.40% (0.0707 => 0.0830, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.04% (0.1982 => 0.2300, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: 15.19% (1.1450 => 1.3189, std.dev.: 0.0345) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.22% (0.4916 => 0.5615, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.11% (0.7021 => 0.8012, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.78% (0.4515 => 0.5092, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.67% (3.5339 => 3.9816, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.14% (0.5329 => 0.5976, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.10% (4.5069 => 5.0524, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.46% (1.6364 => 1.8240, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.73% (0.2385 => 0.2641, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.19% (0.2001 => 0.2205, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 10.10% (18.2933 => 20.1411, std.dev.: 0.5244) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.29% (0.1441 => 0.1546, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.76% (9.2283 => 9.8523, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.53% (1.2784 => 1.3619, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4524 => 0.4787, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.80% (1.4642 => 1.5491, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: 5.54% (5.0226 => 5.3010, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4861 => 0.5117, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 4.89% (0.6750 => 0.7080, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3446 => 0.3551, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3959, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.52% (31.3723 => 55.6933, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.62% (0.9531 => 1.0162, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0994, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4672, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/Shootout-C++/hash2: 2.76% (3.1932 => 3.2812, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6551 => 3.7293, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.83% (27.8210 => 28.3291, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.00% (4.4335 => 4.4780, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.62% (0.1281 => 0.1145, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.48% (0.3837 => 0.3665, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.20% (0.2428 => 0.2326, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.7198 => 0.6906, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.06% (0.3057 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.05% (0.9852 => 0.9453, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: -3.90% (0.2871 => 0.2759, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.86% (0.2903 => 0.2791, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.79% (0.2849 => 0.2741, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.66% (0.3142 => 0.3027, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.54% (0.2939 => 0.2835, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.50% (0.3026 => 0.2920, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.48% (0.2933 => 0.2831, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -3.40% (0.3848 => 0.3717, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.37% (0.3831 => 0.3702, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3896 => 0.3765, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.36% (2.1713 => 2.0983, std.dev.: 0.0160) SingleSource/UnitTests/ObjC/trivial-interface: -3.36% (0.3812 => 0.3684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3880 => 0.3751, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.23% (0.9542 => 0.9234, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.21% (0.3891 => 0.3766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.20% (0.4033 => 0.3904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.18% (0.4176 => 0.4043, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.98% (0.3658 => 0.3549, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.95% (0.6484 => 0.6293, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.83% (0.3884 => 0.3774, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.77% (0.4151 => 0.4036, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -2.67% (0.4199 => 0.4087, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.62% (0.6347 => 0.6181, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2350, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: -2.38% (0.6441 => 0.6288, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -2.34% (2.4924 => 2.4342, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9084, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.88% (1.2221 => 1.1991, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.83% (1.0544 => 1.0351, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.83% (6.7716 => 6.6478, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.82% (1.2210 => 1.1988, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: -1.76% (0.7779 => 0.7642, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.60% (0.7919 => 0.7792, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -1.54% (4.3330 => 4.2661, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.05% (1.8100 => 0.6869, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3087, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2386, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0279, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0711, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.59% (0.0757 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.50% (4.1024 => 3.1793, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4052, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.94% (0.6299 => 0.5043, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1060, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.96% (4.9100 => 4.2738, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7817, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.26% (4.1534 => 3.8935, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1556, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0604, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1715, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.67% (7.9763 => 7.6839, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.30% (1.3096 => 1.2664, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7092 => 3.6659, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3547, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 03:00:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 05:00:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109110050.37C232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7431?compare_to=7430&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7431, Order: 171959, Start Time: 2013-01-09 09:21:24, End Time: 2013-01-09 10:59:31 To: 7430, Order: 171954, Start Time: 2013-01-09 07:15:25, End Time: 2013-01-09 08:57:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (108 on baseline) Performance Improvements: 0 (115 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (869 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.38% (1.2664 => 1.2839, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 333.82% (22.4056 => 97.1991, std.dev.: 0.0647) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.50% (0.0717 => 0.1244) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 63.44% (0.6395 => 1.0452, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.82% (0.5456 => 0.8829, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 61.32% (0.5688 => 0.9176, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.09% (0.0974 => 0.1569, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 60.86% (0.5567 => 0.8955, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 60.43% (0.5805 => 0.9313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 60.37% (0.5581 => 0.8950, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.23% (0.5575 => 0.8933, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 60.16% (0.6260 => 1.0026, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.73% (0.0514 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 58.79% (0.5941 => 0.9434, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 58.20% (0.6033 => 0.9544, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 58.06% (0.5849 => 0.9245, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 57.77% (0.5859 => 0.9244, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 55.00% (0.6440 => 0.9982, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.82% (0.6189 => 0.9582, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 53.54% (0.6304 => 0.9679, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 53.42% (0.6395 => 0.9811, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.03% (0.6676 => 1.0216, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.86% (0.6660 => 1.0047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 50.53% (0.5478 => 0.8246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 50.19% (0.6230 => 0.9357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 50.00% (0.5570 => 0.8355, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 49.99% (0.5705 => 0.8557, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 49.97% (0.5802 => 0.8701, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 49.96% (0.5569 => 0.8351, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 49.72% (0.5591 => 0.8371, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 48.62% (0.5925 => 0.8806, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 47.85% (0.6052 => 0.8948, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 47.47% (0.5863 => 0.8646, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 47.45% (0.5857 => 0.8636, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 45.66% (0.6446 => 0.9389, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.41% (0.7524 => 1.0941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 45.24% (0.6194 => 0.8996, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.47% (0.6297 => 0.9097, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 43.53% (0.6681 => 0.9589, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 42.01% (0.6667 => 0.9468, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.73% (0.0599 => 0.0843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 38.19% (0.7339 => 1.0142, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 35.34% (1.6474 => 2.2296, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 33.95% (5.4682 => 7.3246, std.dev.: 0.0225) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.38% (0.0680 => 0.0873, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 28.28% (0.0693 => 0.0889, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.04% (0.0699 => 0.0895, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 26.68% (2.2587 => 2.8614, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.20% (0.0790 => 0.0997, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.26% (0.0582 => 0.0729, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.96% (0.0621 => 0.0776, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 19.06% (0.1081 => 0.1287, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.15% (0.1982 => 0.2302) MultiSource/Applications/lemon/lemon: 15.12% (1.1450 => 1.3181, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.13% (0.7021 => 0.8013, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.49% (0.4916 => 0.5579, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/05-eks/eks: 12.85% (0.4515 => 0.5095, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.66% (3.5339 => 3.9812, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.14% (0.5329 => 0.5976, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.08% (4.5069 => 5.0514, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8248, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.49% (0.2001 => 0.2211, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 9.98% (18.2933 => 20.1195, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.60% (0.2385 => 0.2614, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.49% (0.1441 => 0.1549, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.15% (1.2515 => 1.3410, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 6.66% (9.2283 => 9.8425, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.2784 => 1.3584, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 5.87% (17.1032 => 18.1073, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.85% (1.4642 => 1.5499, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 5.85% (0.1761 => 0.1864, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 5.61% (0.4524 => 0.4778, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 5.42% (5.0226 => 5.2950, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3255 => 0.3428, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4861 => 0.5117, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 4.99% (0.6750 => 0.7087, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.3319 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.63% (0.9557 => 0.9904, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.61% (1.3864 => 1.4226, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 2.33% (15.5079 => 15.8689, std.dev.: 0.0240) MultiSource/Applications/minisat/minisat: 2.26% (0.7447 => 0.7615, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 2.04% (0.8418 => 0.8590, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6698, std.dev.: 0.0266) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.99% (0.9531 => 1.0197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6125, std.dev.: 0.0946) MultiSource/Benchmarks/nbench/nbench: 3.61% (11.6767 => 12.0988, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.12% (2.0478 => 2.1117, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (3.1932 => 3.2803, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (0.6469 => 0.6630, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (27.8210 => 28.3287, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6551 => 3.7189, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6048, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.28% (0.2428 => 0.2324, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.04% (0.9852 => 0.9454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.96% (0.3057 => 0.2936, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.95% (0.3142 => 0.3018, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.94% (0.3323 => 0.3192, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.94% (0.2871 => 0.2758, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.71% (0.3205 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.60% (0.3026 => 0.2917, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.53% (0.3059 => 0.2951, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.50% (0.2939 => 0.2836, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.9542 => 0.9211, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -3.37% (0.3025 => 0.2923, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.37% (1.3148 => 1.2705, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3896 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.35% (0.3884 => 0.3754, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.34% (2.1713 => 2.0988, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: -3.33% (0.3848 => 0.3720, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.28% (0.3812 => 0.3687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.26% (0.3891 => 0.3764, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.26% (0.3831 => 0.3706, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.25% (0.3880 => 0.3754, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.18% (0.4176 => 0.4043, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.10% (0.4033 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.87% (0.3658 => 0.3553, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.84% (0.6484 => 0.6300, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: -2.83% (0.7779 => 0.7559, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1981, std.dev.: 0.0324) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.77% (0.4151 => 0.4036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.63% (0.6347 => 0.6180, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -2.60% (0.4199 => 0.4090, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.33% (0.6441 => 0.6291, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.29% (2.4924 => 2.4352, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.11% (0.7919 => 0.7752, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9144, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.90% (1.2210 => 1.1978, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.82% (1.2221 => 1.1998, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.69% (1.0544 => 1.0366, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -1.68% (16.1920 => 15.9200, std.dev.: 0.0139) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (6.7716 => 6.6594, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: -1.62% (7.0961 => 6.9808, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.53% (1.2300 => 1.2112, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.43% (4.3330 => 4.2711, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.33% (0.7982 => 0.7876, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.12% (0.9179 => 0.9076, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.61% (1.8100 => 0.6949, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.27% (2.0459 => 1.0174, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3982, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2383, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0245, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0692, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2987) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.46% (4.1024 => 3.1810, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.20% (4.3779 => 3.4058, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.96% (4.9100 => 4.2736, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7815, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.25% (4.1534 => 3.8940, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.8545 => 0.8163, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1556, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.13% (3.1919 => 3.0600, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.63% (7.9763 => 7.6871, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.28% (3.7241 => 3.6393, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.96% (1.3096 => 1.2839, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.77% (6.5735 => 6.4569, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7071, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8028, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6581, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: -1.18% (1.4516 => 1.4345, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5908, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.10% (1.6307 => 1.6128, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3548, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 03:11:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 05:11:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109111145.2C1992A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7432?compare_to=7429&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7432, Order: 171957, Start Time: 2013-01-09 08:55:54, End Time: 2013-01-09 11:11:42 To: 7429, Order: 171954, Start Time: 2013-01-09 06:08:44, End Time: 2013-01-09 08:25:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7063 => 3.6684, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1337 => 0.1336, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0654 => 0.0652, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 3.53% (482.7955 => 499.8565, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44225.31% (1.1277 => 499.8565, std.dev.: 0.0070) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.68% (0.5229 => 1.6507, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 21.29% (14.9895 => 18.1811, std.dev.: 0.0374) MultiSource/Applications/kimwitu++/kc: 58.05% (14.1553 => 22.3721, std.dev.: 0.0327) MultiSource/Benchmarks/MallocBench/gs/gs: 17.72% (4.1105 => 4.8390, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.14% (1.1048 => 1.7471, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1378.04% (7.1582 => 105.8014, std.dev.: 0.0541) SingleSource/Benchmarks/Misc-C++-EH/spirit: 135.42% (3.4629 => 8.1522, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: 78.09% (0.6222 => 1.1081, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.89% (0.0720 => 7.4404, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 3834400.00% (0.0001 => 3.8345, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11082600.00% (0.0001 => 11.0827, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884000.00% (0.0001 => 9.8841, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5502000.00% (0.0001 => 5.5021, std.dev.: 0.0085) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.18% (1.1194 => 10.2781, std.dev.: 0.0241) MultiSource/Applications/ClamAV/clamscan: 148.17% (22.1758 => 55.0327, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.68% (0.0929 => 0.1790, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 73.14% (0.1463 => 0.2533, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 59.18% (1.5859 => 2.5244, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.45% (2.9384 => 4.6265, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.95% (7.0540 => 11.0005, std.dev.: 0.0257) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.43% (2.2024 => 3.2471, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.20% (8.1363 => 11.9768, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.82% (0.0439 => 0.0627, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 41.31% (21.9371 => 30.9985, std.dev.: 0.0507) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.64% (0.1892 => 0.2661, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 40.08% (0.5105 => 0.7151, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.14% (0.1062 => 0.1467, std.dev.: 0.0009) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 35.24% (0.6675 => 0.9027, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.54% (0.4615 => 0.6209, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.52% (4.2646 => 5.7366, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.18% (1.5415 => 2.0529, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 31.38% (0.4299 => 0.5648, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.44% (0.1337 => 0.1744, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.90% (0.2271 => 0.2950, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 29.23% (1.1642 => 1.5045, std.dev.: 0.0094) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.97% (0.0479 => 0.0613, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.91% (0.1906 => 0.2438, std.dev.: 0.0041) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.65% (3.8922 => 4.9685, std.dev.: 0.0145) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.02% (0.1584 => 0.2012, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 26.23% (0.2554 => 0.3224, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 25.70% (0.1175 => 0.1477, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.49% (0.0408 => 0.0512, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.85% (1.0722 => 1.3386, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.45% (0.3121 => 0.3884, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.54% (0.1695 => 0.2094, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 23.45% (5.7591 => 7.1097, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 23.34% (9.4845 => 11.6979, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.15% (0.0730 => 0.0899, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 23.06% (0.7115 => 0.8756, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.87% (1.4186 => 1.7430, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 22.55% (0.6456 => 0.7912, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.44% (0.2700 => 0.3306, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 22.17% (0.4289 => 0.5240, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 22.05% (0.0662 => 0.0808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.98% (0.3098 => 0.3779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 21.84% (0.4620 => 0.5629, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.60% (0.1236 => 0.1503, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.90% (1.3050 => 1.5777, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 20.49% (0.7835 => 0.9440, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 20.24% (17.1811 => 20.6587, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.88% (4.9449 => 5.9277, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 19.67% (3.3354 => 3.9916, std.dev.: 0.0117) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.57% (0.5860 => 0.7007, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 19.48% (1.1840 => 1.4146, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.22% (0.8172 => 0.9743, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.18% (0.1940 => 0.2312, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.15% (5.0018 => 5.9595, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.90% (0.3307 => 0.3932, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.43% (0.5020 => 0.5945, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 18.32% (0.7433 => 0.8795, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 18.11% (2.2969 => 2.7128, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.54% (0.9765 => 1.1478, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 17.51% (0.1268 => 0.1490, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 17.45% (0.3283 => 0.3856, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.41% (0.3423 => 0.4019, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.5569 => 0.6537, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 17.33% (3.8723 => 4.5434, std.dev.: 0.0165) MultiSource/Applications/treecc/treecc: 17.27% (2.0273 => 2.3775, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 17.26% (0.3232 => 0.3790, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.50% (0.5981 => 0.6968, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.11% (0.8101 => 0.9406, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.4636 => 0.5375, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.86% (0.6450 => 0.7473, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.67% (0.8921 => 1.0319, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.28% (0.3180 => 0.3666, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.24% (0.3379 => 0.3894, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.80% (1.1861 => 1.3617, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.39% (0.8067 => 0.9228, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.98% (1.5603 => 1.7785, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.92% (0.3865 => 0.4403, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.43% (0.4103 => 0.4654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.16% (0.4203 => 0.4756, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 12.66% (0.3603 => 0.4059, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 12.40% (0.4048 => 0.4550, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 12.36% (0.3422 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.00% (0.3282 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.81% (0.3684 => 0.4119, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.45% (0.3092 => 0.3446, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3826 => 0.4263, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.25% (14.3668 => 15.9831, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.4064 => 0.4513, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.00% (0.3473 => 0.3855, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.46% (0.2831 => 0.3127, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2871 => 0.3158, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.85% (0.1330 => 0.1461, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.70% (2.0665 => 2.2669, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 9.62% (0.6030 => 0.6610, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.37% (0.3650 => 0.3992, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.20% (0.3162 => 0.3453, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.19% (0.2872 => 0.3136, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.18% (1.2842 => 1.4021, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: 9.11% (0.5925 => 0.6465, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.08% (10.3673 => 11.3089, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.98% (0.2905 => 0.3166, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.85% (63.2438 => 68.8432, std.dev.: 0.0508) SingleSource/Benchmarks/Shootout-C++/fibo: 8.84% (0.2725 => 0.2966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.59% (0.3935 => 0.4273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.2793 => 0.3028, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.21% (0.1438 => 0.1556, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3752, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.52% (0.4879 => 0.5197, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.05% (7.9617 => 8.2045, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.14% (32.5116 => 59.2180, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.02% (2.8904 => 3.0934, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.50% (11.6436 => 12.4001, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.55% (4.2280 => 4.4625, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (3.6395 => 3.7767, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.3316 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (8.6802 => 8.9133, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.08% (0.9957 => 1.0164, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (0.6533 => 0.6660, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.75% (9.1159 => 9.2751, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2763, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.10% (26.0924 => 26.3795, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.10% (10.3460 => 10.4596, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5744, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.51% (5.2763 => 1.1867, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.64% (0.8651 => 0.2107, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.74% (5.3855 => 4.4837, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.20% (5.3526 => 4.4856, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -12.88% (10.4361 => 9.0918, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.13% (1.7609 => 1.6177, std.dev.: 0.0039) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9238, std.dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.84% (1.9577 => 0.6687, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3069, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.37% (1.5373 => 1.0243, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.94% (10.7105 => 7.3962, std.dev.: 0.0232) MultiSource/Benchmarks/PAQ8p/paq8p: -24.98% (85.0658 => 63.8126, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.29% (2.6546 => 2.0097, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -22.62% (0.0756 => 0.0585) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2981, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5896, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -21.66% (0.0757 => 0.0593, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.64% (2.5528 => 2.1280, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4204, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7310, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4913, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2908, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.64% (1.2373 => 1.1551, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.78% (2.7294 => 2.5717, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (0.2497 => 0.2356, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.94% (8.1563 => 7.7532, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8353, std.dev.: 0.0098) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -1.63% (3.6994 => 3.6392, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7221 => 3.6684, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.31% (6.2999 => 6.2173, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0020) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 03:57:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 05:57:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130109115759.A00A12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7433?compare_to=7428&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7433, Order: 171957, Start Time: 2013-01-09 08:20:49, End Time: 2013-01-09 11:57:57 To: 7428, Order: 171942, Start Time: 2013-01-09 03:43:22, End Time: 2013-01-09 07:17:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 37.34% (0.3972 => 0.5455, std.dev.: 0.0423) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.71% (2.1185 => 2.0822, std.dev.: 0.0087) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 104.26% (11.6398 => 23.7750, std.dev.: 0.0548) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 63.35% (0.5361 => 0.8757, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.72% (0.0625 => 0.0892, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 31.55% (0.7426 => 0.9769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.21% (0.2969 => 0.3777, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.91% (0.0822 => 0.1035, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.80% (0.4139 => 0.5207, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.64% (0.5900 => 0.7413, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.32% (0.1106 => 0.1386, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.08% (0.0642 => 0.0803, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.06% (0.1620 => 0.2026, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.43% (0.4994 => 0.6214, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.15% (0.4253 => 0.5280, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.01% (1.5932 => 1.9758, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.60% (0.5000 => 0.6180, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 21.94% (0.0948 => 0.1156, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.40% (0.1103 => 0.1339, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.38% (0.1604 => 0.1947, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.01% (0.0495 => 0.0599, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 21.00% (0.1619 => 0.1959, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.88% (0.3903 => 0.4718, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.41% (0.5826 => 0.6957, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.2736 => 0.3266, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 19.09% (0.5889 => 0.7013, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.05% (0.2866 => 0.3412, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.02% (0.1462 => 0.1740, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 18.94% (0.4029 => 0.4792, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.92% (4.6926 => 5.5806, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.74% (0.3890 => 0.4619, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 18.54% (0.1505 => 0.1784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.34% (0.3271 => 0.3871, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.11% (1.3152 => 1.5534, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: 17.98% (0.9697 => 1.1441, std.dev.: 0.0090) MultiSource/Applications/Burg/burg: 17.90% (0.5546 => 0.6539, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 17.77% (0.7171 => 0.8445, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.70% (0.2875 => 0.3384, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 17.63% (1.8794 => 2.2107, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.41% (0.4658 => 0.5469, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 17.38% (0.2813 => 0.3302, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 17.36% (0.2823 => 0.3313, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.31% (0.2750 => 0.3226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 17.30% (0.2803 => 0.3288) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.25% (3.5627 => 4.1772, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 17.24% (0.3004 => 0.3522, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.22% (1.6211 => 1.9002, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.17% (0.1968 => 0.2306, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.17% (0.2738 => 0.3208, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.12% (0.2792 => 0.3270, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 17.06% (0.2725 => 0.3190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.00% (0.2729 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.90% (0.2811 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.82% (2.0673 => 2.4151, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 16.77% (0.9909 => 1.1571, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.76% (0.3060 => 0.3573, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.62% (0.3195 => 0.3726, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 16.38% (0.3096 => 0.3603, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: 16.31% (0.3267 => 0.3800, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.24% (0.3362 => 0.3908, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.22% (0.5026 => 0.5841, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: 16.18% (23.5202 => 27.3252, std.dev.: 0.0305) SingleSource/Benchmarks/Shootout-C++/ary: 16.18% (0.3258 => 0.3785, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 16.07% (0.3317 => 0.3850, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.05% (0.1421 => 0.1649, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.97% (0.3124 => 0.3623, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 15.94% (0.2566 => 0.2975, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.93% (4.4195 => 5.1235, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: 15.89% (0.3348 => 0.3880, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 15.80% (0.3678 => 0.4259, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 15.78% (1.0781 => 1.2482, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.66% (0.4361 => 0.5044, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 15.65% (0.3726 => 0.4309, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 15.50% (0.3477 => 0.4016, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.45% (0.3625 => 0.4185, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.34% (1.9694 => 2.2715, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.20% (0.3981 => 0.4586, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.19% (2.7292 => 3.1438, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.18% (0.3690 => 0.4250, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 15.14% (4.2109 => 4.8483, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.10% (1.9966 => 2.2981, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.08% (0.3845 => 0.4425, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 15.07% (0.4146 => 0.4771, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 15.01% (0.4251 => 0.4889, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 14.55% (0.5012 => 0.5741, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.39% (0.6435 => 0.7361, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 14.38% (1.4269 => 1.6321, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.30% (0.1028 => 0.1175, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: 13.73% (0.3446 => 0.3919, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 13.68% (0.3442 => 0.3913, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.68% (0.3488 => 0.3965, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/synchronized: 13.64% (0.3469 => 0.3942, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 13.62% (0.3650 => 0.4147, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-3: 13.61% (0.3460 => 0.3931, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.2737 => 0.3107, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.39% (0.3084 => 0.3497, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: 13.31% (0.7875 => 0.8923, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.18% (0.0804 => 0.0910, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 12.92% (0.2075 => 0.2343, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.62% (0.2068 => 0.2329, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.43% (5.5417 => 6.2303, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 12.34% (0.2691 => 0.3023, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 12.28% (2.1653 => 2.4312, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 12.28% (4.6177 => 5.1846, std.dev.: 0.0078) MultiSource/Applications/lambda-0_1_3/lambda: 12.12% (0.3498 => 0.3922, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 11.99% (0.3336 => 0.3736, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.98% (0.2103 => 0.2355, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 11.52% (2.1013 => 2.3434, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 11.08% (0.4847 => 0.5384, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.93% (0.6634 => 0.7359, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 10.81% (11.9555 => 13.2479, std.dev.: 0.0322) MultiSource/Applications/sqlite3/sqlite3: 9.88% (2.0346 => 2.2356, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.71% (0.2040 => 0.2238, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.40% (0.5584 => 0.6109, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.75% (0.1383 => 0.1504, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.11% (0.2391 => 0.2585, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.73% (29.0505 => 181.4877, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.59% (0.3693 => 0.4084, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 10.10% (0.2802 => 0.3085, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2383, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6663, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.80% (1.8057 => 1.8923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6882, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 2.84% (0.6276 => 0.6454, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1917, std.dev.: 0.0099) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3013, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2809, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0815, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.05% (3.1722 => 3.2056, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5825, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5731, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.28% (17.2379 => 14.2596, std.dev.: 0.0844) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1019, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9779, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7874, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (41.7953 => 40.2048, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0695) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -2.70% (14.0481 => 13.6684, std.dev.: 0.0584) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.19% (0.6293 => 0.6155, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1736, std.dev.: 0.0273) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1607, std.dev.: 0.0581) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0436, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 04:58:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 06:58:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109125822.531FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7434?compare_to=7431&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7434, Order: 171966, Start Time: 2013-01-09 11:24:30, End Time: 2013-01-09 12:58:21 To: 7431, Order: 171959, Start Time: 2013-01-09 09:21:24, End Time: 2013-01-09 10:59:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 14 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1090 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -76.72% (97.1991 => 22.6231, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++-EH/spirit: -23.01% (7.3246 => 5.6392, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: -9.61% (20.1195 => 18.1862, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: -7.77% (18.1073 => 16.7010, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.83% (2.2296 => 2.1220, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.69% (2.8614 => 2.7557, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -2.00% (2.4158 => 2.3676, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.96% (0.9904 => 0.9710, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (2.4352 => 2.3893, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.87% (3.9812 => 3.9069, std.dev.: 0.0135) MultiSource/Applications/SPASS/SPASS: -1.66% (15.8689 => 15.6058, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.55% (0.8013 => 0.7889, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -1.54% (5.2950 => 5.2133, std.dev.: 0.0085) MultiSource/Benchmarks/Bullet/bullet: -1.11% (33.9985 => 33.6220, std.dev.: 0.0119) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.36% (0.0717 => 0.1243, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 62.66% (0.6395 => 1.0402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.16% (0.5456 => 0.8793, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.47% (0.0974 => 0.1563, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 60.43% (0.5688 => 0.9125, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 60.12% (0.5567 => 0.8914, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 59.72% (0.5581 => 0.8914, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 59.71% (0.5805 => 0.9271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 59.68% (0.5575 => 0.8902, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 59.22% (0.6260 => 0.9967, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.14% (0.0514 => 0.0818, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 57.84% (0.5941 => 0.9377, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 57.22% (0.6033 => 0.9485, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.14% (0.5849 => 0.9191, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.60% (0.5859 => 0.9175, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 54.60% (0.0315 => 0.0487) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.38% (0.6440 => 0.9942, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.11% (0.6189 => 0.9538, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 53.01% (0.6304 => 0.9646, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.56% (0.6676 => 1.0185, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.18% (0.6395 => 0.9732, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.27% (0.6660 => 1.0008, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.43% (0.5478 => 0.8186, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.20% (0.6230 => 0.9295, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 48.90% (0.5705 => 0.8495, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 48.90% (0.5802 => 0.8639, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 48.82% (0.5569 => 0.8288, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.67% (0.5570 => 0.8281, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.47% (0.5591 => 0.8301, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.22% (0.5925 => 0.8723, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.51% (0.6052 => 0.8867, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.32% (0.5857 => 0.8570, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 46.27% (0.1500 => 0.2194, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.14% (0.5863 => 0.8568, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 44.74% (0.7524 => 1.0890, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.63% (0.6446 => 0.9323, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 44.03% (0.6194 => 0.8921, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.43% (0.6297 => 0.9032, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.45% (0.6681 => 0.9517, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 41.07% (0.6667 => 0.9405, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.90% (0.0599 => 0.0838, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.20% (0.7339 => 1.0069, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.81% (1.6474 => 2.1220, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.24% (0.0680 => 0.0872, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.71% (0.0693 => 0.0885, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.74% (0.0582 => 0.0726, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.64% (0.0621 => 0.0774, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.00% (2.2587 => 2.7557, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.78% (0.1081 => 0.1284) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.04% (0.1982 => 0.2300, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 14.08% (1.1450 => 1.3062, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.12% (0.4916 => 0.5561, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 12.49% (0.4515 => 0.5079, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.36% (0.7021 => 0.7889, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.86% (4.5069 => 5.0416, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.09% (0.5329 => 0.5920, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.55% (3.5339 => 3.9069, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.14% (0.2001 => 0.2204, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.08% (0.1441 => 0.1543, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.66% (1.2515 => 1.3348, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 6.25% (9.2283 => 9.8051, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.92% (1.2784 => 1.3541, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.53% (1.4642 => 1.5452, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.3255 => 0.3420, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 4.86% (0.4524 => 0.4744, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 4.38% (0.4861 => 0.5074, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 3.85% (0.6750 => 0.7010, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.80% (5.0226 => 5.2133, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (5.4682 => 5.6392, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 2.28% (1.3864 => 1.4180, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.9557 => 0.9710, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3722 => 1.3919, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6554, std.dev.: 0.0105) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.64% (0.9531 => 1.0164, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4418, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5607, std.dev.: 0.0978) MultiSource/Benchmarks/nbench/nbench: 3.62% (11.6767 => 12.0996, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 2.65% (3.1932 => 3.2777, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.84% (3.6551 => 3.7222, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3256, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.40% (0.9852 => 0.9419, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.14% (2.4924 => 2.3893, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.98% (0.3016 => 0.2896, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.77% (0.3026 => 0.2912, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (0.3025 => 0.2913) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.69% (0.3252 => 0.3132, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.68% (2.1713 => 2.0913, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.67% (1.3148 => 1.2666, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: -3.63% (0.3880 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.9542 => 0.9199, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.58% (0.3884 => 0.3745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3896 => 0.3759, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3848 => 0.3714, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.45% (0.4033 => 0.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.38% (0.2989 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.16% (0.4151 => 0.4020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.14% (0.7779 => 0.7535, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.98% (0.4199 => 0.4074, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.95% (0.6347 => 0.6160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -2.87% (0.3621 => 0.3517, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.85% (0.3931 => 0.3819, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.82% (0.3867 => 0.3758, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -2.64% (0.4280 => 0.4167, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.62% (0.4427 => 0.4311, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.55% (0.6441 => 0.6277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.50% (0.4321 => 0.4213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2744, std.dev.: 0.0324) SingleSource/Benchmarks/Shootout-C++/moments: -2.35% (0.4248 => 0.4148, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7010, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.34% (14.2083 => 13.8760, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (1.2210 => 1.1949, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: -2.12% (0.7982 => 0.7813, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -2.09% (4.3330 => 4.2426, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.2221 => 1.1972, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8731, std.dev.: 0.0101) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.92% (6.7716 => 6.6414, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.91% (1.0544 => 1.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.88% (1.2300 => 1.2069, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -1.80% (7.0961 => 6.9687, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8521 => 0.8398, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.44% (2.4021 => 2.3676, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.38% (34.0927 => 33.6220, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: -1.35% (0.9179 => 0.9055, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -1.29% (1.5610 => 1.5409, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -1.15% (4.0594 => 4.0128, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.12% (1.8100 => 0.6857, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3111, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.54% (4.3504 => 3.2391, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -24.81% (1.3643 => 1.0258, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7584, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0769, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.99% (0.0757 => 0.0583, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.50% (4.1024 => 3.1792, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4052, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.04% (1.2237 => 0.9662, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1329, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.35% (4.7378 => 4.1055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.28% (4.2493 => 3.6849, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.97% (4.9100 => 4.2734, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7820, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.27% (4.1534 => 3.8931, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1555, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0605, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1715, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.64% (1.3096 => 1.2619, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.62% (7.9763 => 7.6878, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.90% (3.7241 => 3.6534, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4716, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.38% (4.8776 => 4.8105, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: -1.29% (3.7092 => 3.6613, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.17% (1.6307 => 1.6117, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6219 => 1.6041, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.07% (1.6086 => 1.5914, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 05:53:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 07:53:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109135327.A49F02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7435?compare_to=7432&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7435, Order: 171966, Start Time: 2013-01-09 11:42:13, End Time: 2013-01-09 13:53:25 To: 7432, Order: 171957, Start Time: 2013-01-09 08:55:54, End Time: 2013-01-09 11:11:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (218 on baseline) Performance Improvements: 12 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1088 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -64.16% (105.8014 => 37.9223, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -21.43% (8.1522 => 6.4053, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: -9.14% (22.3721 => 20.3280, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: -6.94% (20.6587 => 19.2250, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.15% (2.5244 => 2.4196, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.20% (3.2471 => 3.1431, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -1.90% (2.7128 => 2.6613, std.dev.: 0.0128) MultiSource/Benchmarks/PAQ8p/paq8p: -1.77% (11.3089 => 11.1087, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.52% (4.9685 => 4.8930, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: -1.40% (18.1811 => 17.9263, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.29% (1.1081 => 1.0938, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -1.16% (7.1097 => 7.0275, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1336 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8565 => 499.8492, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44224.66% (1.1277 => 499.8492, std.dev.: 0.0042) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.89% (0.5229 => 1.6518, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 19.59% (14.9895 => 17.9263, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 43.61% (14.1553 => 20.3280, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 17.70% (4.1105 => 4.8379, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.00% (1.1048 => 1.7456, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.77% (7.1582 => 37.9223, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.97% (3.4629 => 6.4053, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.80% (0.6222 => 1.0938, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.44% (0.0720 => 7.4408, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 3831900.00% (0.0001 => 3.8320, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 11066200.00% (0.0001 => 11.0663, std.dev.: 0.0843) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884600.00% (0.0001 => 9.8847, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5505800.00% (0.0001 => 5.5059, std.dev.: 0.0169) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.57% (1.1194 => 10.2713, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 147.99% (22.1758 => 54.9933, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.79% (0.0929 => 0.1791, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.27% (0.1463 => 0.2535, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.61% (2.9384 => 4.6312, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.16% (7.0540 => 11.0156, std.dev.: 0.0054) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.57% (1.5859 => 2.4196, std.dev.: 0.0024) SingleSource/Benchmarks/Stanford/IntMM: 51.02% (0.0394 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.37% (8.1363 => 11.9903, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.82% (0.0439 => 0.0627, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.71% (2.2024 => 3.1431, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 41.24% (21.9371 => 30.9841, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.27% (0.1892 => 0.2654, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.85% (0.3109 => 0.4348, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 39.49% (0.5105 => 0.7121, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.95% (0.1062 => 0.1465, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.54% (0.4615 => 0.6209, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.36% (4.2646 => 5.7298, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.01% (0.6675 => 0.8945, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.08% (1.5415 => 2.0515, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 32.92% (0.0814 => 0.1082, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 31.43% (0.4299 => 0.5650, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.52% (0.1337 => 0.1745, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.85% (0.2271 => 0.2949, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 28.69% (1.1642 => 1.4982, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.96% (0.1906 => 0.2439, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 27.19% (0.1655 => 0.2105, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.71% (3.8922 => 4.8930, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.53% (0.2554 => 0.3206, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.48% (0.3121 => 0.3885, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 23.88% (1.0722 => 1.3282, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 23.14% (9.4845 => 11.6794, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.07% (0.1695 => 0.2086, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.63% (1.4186 => 1.7397, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.09% (0.7115 => 0.8687, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 22.08% (0.3098 => 0.3782, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 22.02% (5.7591 => 7.0275, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 22.01% (0.4289 => 0.5233, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.93% (0.2700 => 0.3292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 21.59% (0.6456 => 0.7850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.30% (0.4620 => 0.5604, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.00% (1.3050 => 1.5791, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.40% (0.7835 => 0.9433, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.93% (4.9449 => 5.9302, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.39% (0.5860 => 0.6996, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 19.31% (3.3354 => 3.9793, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.19% (5.0018 => 5.9614, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.12% (0.1940 => 0.2311, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 19.11% (1.1840 => 1.4103, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.05% (0.8172 => 0.9729, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.29% (0.5020 => 0.5938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.99% (0.3307 => 0.3902, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.58% (0.7433 => 0.8740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 17.58% (0.3283 => 0.3860, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.50% (0.3423 => 0.4022, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.46% (0.9765 => 1.1470, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 17.36% (0.3232 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.31% (0.5569 => 0.6533, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.94% (3.8723 => 4.5284, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 16.71% (2.0273 => 2.3660, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.65% (0.5981 => 0.6977, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.01% (0.8101 => 0.9398, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 15.86% (2.2969 => 2.6613, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.77% (0.6450 => 0.7467, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.72% (0.4636 => 0.5365, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.44% (0.8921 => 1.0298, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3379 => 0.3883, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.51% (1.1861 => 1.3582, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.19% (0.8067 => 0.9212, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.82% (1.5603 => 1.7759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.79% (0.3865 => 0.4398, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.14% (0.3387 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.09% (0.4103 => 0.4640, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.85% (0.4203 => 0.4743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.46% (0.3603 => 0.4052, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/moments: 12.20% (0.4048 => 0.4542, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.91% (0.3282 => 0.3673, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.90% (17.1811 => 19.2250, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 11.75% (0.3422 => 0.3824, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.73% (0.3886 => 0.4342, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.70% (0.3684 => 0.4115, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.37% (0.3826 => 0.4261, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.03% (14.3668 => 15.9512, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/bh/bh: 10.96% (0.3092 => 0.3431, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.77% (0.3694 => 0.4092, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.72% (0.3516 => 0.3893, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.4064 => 0.4499, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.56% (0.3427 => 0.3789, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2831 => 0.3130, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.73% (2.0665 => 2.2676, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.68% (0.6030 => 0.6614, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.40% (0.1330 => 0.1455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 9.20% (0.5925 => 0.6470, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.17% (0.2891 => 0.3156, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.08% (1.2842 => 1.4008, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.01% (0.3650 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.01% (0.7326 => 0.7986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.89% (0.2802 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.85% (0.2756 => 0.3000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.73% (0.2725 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.3052 => 0.3317, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 8.42% (63.2438 => 68.5704, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.81% (2.2022 => 2.3741, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 7.15% (10.3673 => 11.1087, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.41% (0.3817 => 0.3947, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.14% (7.9617 => 8.2115, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.14% (32.5116 => 59.2170, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.01% (2.8904 => 3.0930, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.50% (11.6436 => 12.4007, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4543, std.dev.: 0.0111) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.05% (3.6395 => 3.7868, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0119) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.32% (0.3316 => 0.3426, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.62% (0.9957 => 1.0218, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9009, std.dev.: 0.0250) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2874, std.dev.: 0.0346) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2751, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3460 => 10.4632, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3704, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.52% (5.2763 => 1.1862, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.59% (0.8651 => 0.2112, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.81% (5.3855 => 4.4804, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.20% (5.3526 => 4.4857, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -13.03% (10.4361 => 9.0765, std.dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.8964, std.dev.: 0.0799) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.88% (1.7609 => 1.6222, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.85% (1.9577 => 0.6686, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/dt: -50.27% (2.0460 => 1.0174, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3045, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.42% (1.5373 => 1.0236, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.85% (10.7105 => 7.4059, std.dev.: 0.0238) MultiSource/Benchmarks/PAQ8p/paq8p: -24.97% (85.0658 => 63.8215, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0048, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.60% (2.9695 => 2.2983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.93% (2.6778 => 2.0906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -18.99% (0.6223 => 0.5041, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.54% (2.5528 => 2.1305, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7319, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4925, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2705, std.dev.: 0.0229) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.12% (1.2373 => 1.1616, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.12% (8.1563 => 7.7386, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8402, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.6994 => 3.6245, std.dev.: 0.0241) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6704, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: -1.24% (6.2999 => 6.2216, std.dev.: 0.0149) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0016) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 06:55:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 08:55:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109145543.8E5532A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7436?compare_to=7434&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7436, Order: 171969, Start Time: 2013-01-09 13:21:43, End Time: 2013-01-09 14:55:42 To: 7434, Order: 171966, Start Time: 2013-01-09 11:24:30, End Time: 2013-01-09 12:58:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.14% (0.3773 => 0.3967, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.36% (0.0717 => 0.1243, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 62.30% (0.6395 => 1.0379, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 60.94% (0.5456 => 0.8781, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.37% (0.0974 => 0.1562, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 60.28% (0.5688 => 0.9117, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 59.94% (0.5567 => 0.8904, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 59.76% (0.5581 => 0.8916, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 59.71% (0.5805 => 0.9271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 59.55% (0.5575 => 0.8895, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 59.30% (0.6260 => 0.9972, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.14% (0.0514 => 0.0818, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 57.58% (0.5941 => 0.9362, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 57.14% (0.6033 => 0.9480, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.02% (0.5849 => 0.9184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.46% (0.5859 => 0.9167, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.21% (0.6440 => 0.9931, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.06% (0.6189 => 0.9535, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 52.79% (0.6304 => 0.9632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.41% (0.6676 => 1.0175, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.21% (0.6395 => 0.9734, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.23% (0.6660 => 1.0005, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.16% (0.5478 => 0.8171, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.15% (0.6230 => 0.9292, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 48.81% (0.5802 => 0.8634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.74% (0.5570 => 0.8285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 48.70% (0.5569 => 0.8281, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 48.57% (0.5705 => 0.8476, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.29% (0.5591 => 0.8291, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.16% (0.5925 => 0.8719, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.43% (0.6052 => 0.8862, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.17% (0.5857 => 0.8561, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.12% (0.5863 => 0.8567, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 44.43% (0.7524 => 1.0867, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.28% (0.6446 => 0.9300, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 43.75% (0.6194 => 0.8904, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.29% (0.6297 => 0.9023, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.31% (0.6681 => 0.9508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 40.92% (0.6667 => 0.9395, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.07% (0.0599 => 0.0839, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.23% (0.7339 => 1.0071, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.50% (1.6474 => 2.1169, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.09% (0.0680 => 0.0871, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.85% (0.0693 => 0.0886, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.74% (0.0582 => 0.0726, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.64% (0.0621 => 0.0774) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.85% (2.2587 => 2.7523, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.50% (0.1081 => 0.1281, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.79% (0.1982 => 0.2295, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3357 => 0.3840, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.06% (1.1450 => 1.3060, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.96% (0.4916 => 0.5553, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/05-eks/eks: 12.56% (0.4515 => 0.5082, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.25% (0.7021 => 0.7881, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.67% (4.5069 => 5.0328, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.15% (1.6364 => 1.8188, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.03% (0.5329 => 0.5917, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.54% (3.5339 => 3.9062, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.04% (0.2001 => 0.2202, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.97% (0.2385 => 0.2599, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.01% (0.1441 => 0.1542, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.55% (1.2515 => 1.3335, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.16% (9.2283 => 9.7967, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.89% (1.2784 => 1.3537, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.46% (1.4642 => 1.5442, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 5.15% (0.4524 => 0.4757, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3319 => 0.3472, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 4.26% (0.4861 => 0.5068, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.72% (0.6750 => 0.7001, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.61% (5.0226 => 5.2040, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.47% (0.3834 => 0.3967, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.07% (5.4682 => 5.6362, std.dev.: 0.0081) MultiSource/Applications/SIBsim4/SIBsim4: 2.21% (1.3864 => 1.4170, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 1.54% (0.8418 => 0.8548, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.52% (0.9557 => 0.9702, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3722 => 1.3895, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6710, std.dev.: 0.0249) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.88% (0.9531 => 1.0187, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4419, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1010, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5015, std.dev.: 0.1008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1067, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 2.72% (3.1932 => 3.2802, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.46% (0.6469 => 0.6628, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6551 => 3.7288, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (27.8210 => 28.3261, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.46% (0.9852 => 0.9413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.29% (0.7198 => 0.6889, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -4.20% (2.4924 => 2.3876, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.81% (0.3831 => 0.3685, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.80% (1.3148 => 1.2648, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.77% (0.3848 => 0.3703, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.9542 => 0.9188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.70% (0.3896 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -3.60% (0.4033 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.58% (0.2989 => 0.2882, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.40% (0.4151 => 0.4010, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.34% (0.7779 => 0.7519, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.22% (0.3884 => 0.3759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (0.3621 => 0.3507, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.14% (0.4199 => 0.4067, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.13% (0.6484 => 0.6281, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.01% (0.6347 => 0.6156, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.81% (0.6441 => 0.6260, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.80% (0.4427 => 0.4303, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.80% (0.4321 => 0.4200, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -2.71% (0.4280 => 0.4164, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.65% (0.3849 => 0.3747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.55% (0.7919 => 0.7717, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.49% (14.2083 => 13.8544, std.dev.: 0.0284) MultiSource/Applications/sqlite3/sqlite3: -2.40% (17.1032 => 16.6929, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2884, std.dev.: 0.0515) MultiSource/Applications/lambda-0_1_3/lambda: -2.19% (0.7982 => 0.7807, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.14% (1.2221 => 1.1959, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: -2.13% (4.3330 => 4.2406, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.13% (6.7716 => 6.6274, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: -2.07% (16.1920 => 15.8566, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.03% (1.0544 => 1.0330, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (1.2300 => 1.2056, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -1.93% (7.0961 => 6.9589, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.86% (1.2210 => 1.1983, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.69% (34.0927 => 33.5161, std.dev.: 0.0196) MultiSource/Applications/siod/siod: -1.57% (2.4021 => 2.3644, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -1.44% (1.5610 => 1.5385, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -1.39% (0.9179 => 0.9051, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.23% (4.0594 => 4.0094, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.90% (1.8100 => 0.6716, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0172, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3096, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2384, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.26% (1.3643 => 1.0333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7495, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0784, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1049, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.60% (2.9703 => 2.2989, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.47% (4.1024 => 3.1807, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -22.46% (0.0757 => 0.0587, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4055, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.33% (4.7378 => 4.1061, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.97% (4.9100 => 4.2732, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7814, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.27% (4.1534 => 3.8930, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1554, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.13% (3.1919 => 3.0602, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.70% (7.9763 => 7.6813, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2633 => 2.1804, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.99% (1.3096 => 1.2704, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -2.64% (3.7241 => 3.6258, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.68% (1.6086 => 1.5815, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7072, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4691, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8034, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.44% (1.6219 => 1.5985, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7092 => 3.6619, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4354, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3552, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 08:25:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 10:25:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130109162504.C33C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7437?compare_to=7433&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7437, Order: 171966, Start Time: 2013-01-09 12:50:22, End Time: 2013-01-09 16:25:03 To: 7433, Order: 171957, Start Time: 2013-01-09 08:20:49, End Time: 2013-01-09 11:57:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 7 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -46.04% (23.7750 => 12.8296, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -32.50% (0.8757 => 0.5911, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -16.85% (0.9769 => 0.8123, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.60% (5.5806 => 5.1562, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: -2.95% (13.2479 => 12.8565, std.dev.: 0.0189) MultiSource/Applications/sqlite3/sqlite3: -2.47% (2.2356 => 2.1804, std.dev.: 0.0199) MultiSource/Applications/oggenc/oggenc: -1.70% (1.9758 => 1.9423, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.32% (0.0625 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.15% (0.0714 => 0.0915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.45% (0.2969 => 0.3784, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.85% (0.4139 => 0.5209, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.75% (0.5900 => 0.7419, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.30% (0.4253 => 0.5329, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.87% (0.4994 => 0.6236, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.40% (0.0541 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.94% (0.5000 => 0.6197, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.89% (0.1620 => 0.2007, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.39% (0.1103 => 0.1350, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 21.94% (0.0948 => 0.1156, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 21.91% (1.5932 => 1.9423, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.43% (0.1619 => 0.1966, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.29% (0.0822 => 0.0997, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.20% (0.1604 => 0.1944, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.98% (0.1549 => 0.1874, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.55% (0.3903 => 0.4705, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 19.29% (0.4029 => 0.4806, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 19.05% (0.1218 => 0.1450, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.95% (0.2866 => 0.3409, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.79% (0.3890 => 0.4621, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.54% (0.5826 => 0.6906, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.35% (0.2736 => 0.3238, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.32% (1.3152 => 1.5561, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.14% (0.1968 => 0.2325, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.10% (0.5889 => 0.6955, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 17.98% (0.5546 => 0.6543, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 17.80% (0.9697 => 1.1423, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.73% (0.5026 => 0.5917, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.67% (0.3271 => 0.3849, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.67% (0.2875 => 0.3383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.56% (0.4658 => 0.5476, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 17.50% (1.8794 => 2.2083, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 17.39% (0.7171 => 0.8418, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.32% (3.5627 => 4.1798, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.17% (1.6211 => 1.8994, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 17.16% (0.9909 => 1.1609, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.95% (0.2714 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.91% (0.2803 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.91% (0.2738 => 0.3201, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.88% (0.2725 => 0.3185, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 16.86% (0.2823 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.85% (0.2813 => 0.3287, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.84% (2.0673 => 2.4154, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.75% (0.2729 => 0.3186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 16.65% (0.2811 => 0.3279, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 16.64% (0.3004 => 0.3504, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 16.58% (0.2780 => 0.3241, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 16.25% (0.3096 => 0.3599, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.24% (4.4195 => 5.1374, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary: 16.11% (0.3258 => 0.3783, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 16.04% (0.3267 => 0.3791, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.91% (0.3362 => 0.3897, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.85% (0.3060 => 0.3545, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.75% (0.3124 => 0.3616, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 15.68% (0.3317 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.64% (0.4361 => 0.5043, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 15.62% (23.5202 => 27.1937, std.dev.: 0.0223) MultiSource/Applications/d/make_dparser: 15.48% (1.0781 => 1.2450, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.38% (1.9694 => 2.2723, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.37% (2.7292 => 3.1487, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists1: 15.36% (0.3477 => 0.4011, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.35% (1.9966 => 2.3031, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 15.32% (0.3726 => 0.4297, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 15.31% (0.3678 => 0.4241, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.28% (0.2566 => 0.2958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.26% (0.3348 => 0.3859, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.26% (0.3625 => 0.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.17% (0.4146 => 0.4775, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 15.01% (4.2109 => 4.8430, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.99% (0.3488 => 0.4011, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.88% (0.1028 => 0.1181, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.87% (0.4251 => 0.4883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.77% (0.3981 => 0.4569, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.66% (0.3690 => 0.4231, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: 14.29% (0.3442 => 0.3934, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.25% (0.3460 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.20% (0.3845 => 0.4391, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 14.17% (0.3465 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.05% (1.4269 => 1.6274, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 13.95% (0.5012 => 0.5711, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.85% (0.1090 => 0.1241, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.56% (0.3643 => 0.4137, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.45% (0.7875 => 0.8934, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.27% (0.6435 => 0.7289, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.64% (0.2737 => 0.3083, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.22% (2.1653 => 2.4300, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: 12.09% (4.6177 => 5.1762, std.dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 11.82% (5.5417 => 6.1965, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.2075 => 0.2319, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.70% (0.2068 => 0.2310, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 11.52% (2.1013 => 2.3434, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 11.45% (0.2691 => 0.2999, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.28% (0.3084 => 0.3432, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.79% (0.3336 => 0.3696, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.48% (0.6634 => 0.7329, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.26% (0.5361 => 0.5911, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.22% (11.6398 => 12.8296, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.88% (4.6926 => 5.1562, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 9.80% (0.4847 => 0.5322, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.56% (0.2040 => 0.2235, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.39% (0.7426 => 0.8123, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.26% (0.1383 => 0.1511, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.86% (0.5584 => 0.6023, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.54% (11.9555 => 12.8565, std.dev.: 0.0189) MultiSource/Applications/lemon/lemon: 7.44% (0.2391 => 0.2569, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.17% (2.0346 => 2.1804, std.dev.: 0.0199) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5277, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.13% (0.3693 => 0.4104, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 7.87% (0.2122 => 0.2289, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6783, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2376, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6847, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8895, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1977, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.22% (4.0317 => 4.0810, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2103, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5810, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4777, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.08% (2.4764 => 2.4497, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5719, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.70% (17.2379 => 14.3589, std.dev.: 0.0695) SingleSource/UnitTests/Vector/multiplies: -11.34% (2.3713 => 2.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -9.12% (0.2402 => 0.2183, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8001, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -4.81% (14.0481 => 13.3725, std.dev.: 0.2286) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2092, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8051, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1735, std.dev.: 0.0525) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5748, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (105.3826 => 104.1110, std.dev.: 0.0901) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0412, std.dev.: 0.0036) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 08:35:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 10:35:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109163514.7E9EE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7438?compare_to=7435&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7438, Order: 171972, Start Time: 2013-01-09 14:23:43, End Time: 2013-01-09 16:35:12 To: 7435, Order: 171966, Start Time: 2013-01-09 11:42:13, End Time: 2013-01-09 13:53:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (222 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (11.1087 => 11.3538, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1336 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8492 => 499.8520, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.91% (1.1277 => 499.8520, std.dev.: 0.0050) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.43% (0.5229 => 1.6546, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 19.97% (14.9895 => 17.9824, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 43.87% (14.1553 => 20.3654, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 17.68% (4.1105 => 4.8372, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.39% (1.1048 => 1.7499, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.29% (7.1582 => 37.8877, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.50% (3.4629 => 6.4237, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.17% (0.6222 => 1.0961, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.81% (0.0720 => 7.4461, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3832500.00% (0.0001 => 3.8326, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11077100.00% (0.0001 => 11.0772, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884500.00% (0.0001 => 9.8846, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5509900.00% (0.0001 => 5.5100, std.dev.: 0.0041) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.90% (1.1194 => 10.2974, std.dev.: 0.0591) MultiSource/Applications/ClamAV/clamscan: 148.18% (22.1758 => 55.0358, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 93.33% (0.0929 => 0.1796, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 73.62% (0.1463 => 0.2540, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.33% (2.9384 => 4.6525, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.18% (7.0540 => 11.0172, std.dev.: 0.0100) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.75% (1.5859 => 2.4225, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.73% (8.1363 => 12.0197, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.05% (0.0439 => 0.0628, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.86% (2.2024 => 3.1464, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.86% (0.1892 => 0.2665, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: 40.79% (21.9371 => 30.8863, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 40.37% (0.3109 => 0.4364, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 39.75% (0.5105 => 0.7134, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 39.73% (0.1432 => 0.2001, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.32% (0.1062 => 0.1469, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.06% (0.4615 => 0.6233, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.71% (4.2646 => 5.7447, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.20% (0.6675 => 0.8958, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.55% (1.5415 => 2.0586, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 33.17% (0.0814 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 32.22% (0.4299 => 0.5684, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.96% (0.1337 => 0.1751, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.03% (0.2271 => 0.2953, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 28.98% (1.1642 => 1.5016, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.44% (0.1906 => 0.2448, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 27.73% (0.1655 => 0.2114, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.94% (0.0746 => 0.0947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.8922 => 4.9041, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 25.96% (0.2554 => 0.3217, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.49% (0.0408 => 0.0512, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.51% (0.3121 => 0.3886, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.39% (0.1566 => 0.1948, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 24.10% (1.0722 => 1.3306, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.06% (0.1143 => 0.1418, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 23.39% (9.4845 => 11.7025, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.30% (0.1695 => 0.2090, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.85% (1.4186 => 1.7428, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 22.79% (0.3098 => 0.3804, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash: 22.43% (0.4289 => 0.5251, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 22.36% (5.7591 => 7.0471, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.12% (0.7115 => 0.8689, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 22.03% (0.6456 => 0.7878, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.96% (0.2700 => 0.3293, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 21.90% (0.4620 => 0.5632, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.19% (1.3050 => 1.5815, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 20.49% (0.7835 => 0.9440, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.26% (4.9449 => 5.9469, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.64% (0.5860 => 0.7011, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.45% (3.3354 => 3.9840, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 19.44% (1.1840 => 1.4142, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.43% (5.0018 => 5.9737, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0886 => 0.1058, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.18% (0.8172 => 0.9739, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.47% (0.5020 => 0.5947, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.21% (0.1510 => 0.1785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.08% (0.3307 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 18.06% (0.3283 => 0.3876, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 17.91% (0.3232 => 0.3811, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 17.85% (0.7433 => 0.8760, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2758 => 0.3249, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.73% (0.9765 => 1.1496, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 17.47% (0.3423 => 0.4021, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.42% (0.5569 => 0.6539, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 16.96% (3.8723 => 4.5289, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 16.95% (2.0273 => 2.3709, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.89% (0.5981 => 0.6991, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.50% (0.2049 => 0.2387, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.22% (0.3441 => 0.3999, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.17% (0.6450 => 0.7493, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 16.17% (2.2969 => 2.6682, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.15% (0.8101 => 0.9409, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.09% (0.4636 => 0.5382, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3379 => 0.3912, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.75% (0.8921 => 1.0326, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.09% (0.3180 => 0.3660, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.84% (1.1861 => 1.3621, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.35% (0.0704 => 0.0805, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 14.30% (1.5603 => 1.7834, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.14% (0.8067 => 0.9208, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.05% (0.3865 => 0.4408, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.87% (0.2603 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.38% (0.4103 => 0.4652, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.28% (0.4203 => 0.4761, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.20% (0.3387 => 0.3834, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/sieve: 13.10% (0.3603 => 0.4075, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 12.72% (0.4048 => 0.4563, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.54% (0.3422 => 0.3851, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.46% (0.1268 => 0.1426, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.19% (0.3684 => 0.4133, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.79% (17.1811 => 19.2075, std.dev.: 0.0227) SingleSource/UnitTests/ObjC/exceptions: 11.76% (0.3828 => 0.4278, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.74% (0.3826 => 0.4275, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 11.52% (0.3497 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 11.35% (0.3092 => 0.3443, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.35% (0.3516 => 0.3915, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 11.35% (0.3561 => 0.3965, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.34% (0.3694 => 0.4113, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.32% (0.4064 => 0.4524, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 11.06% (0.2831 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.01% (14.3668 => 15.9489, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 10.66% (0.2871 => 0.3177, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.28% (2.0665 => 2.2790, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 10.07% (0.6030 => 0.6637, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.87% (0.2877 => 0.3161, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.82% (0.2872 => 0.3154, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.72% (0.5925 => 0.6501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.67% (0.3650 => 0.4003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.65% (0.2891 => 0.3170, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.2905 => 0.3185, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.62% (0.1330 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.61% (0.3162 => 0.3466, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.55% (1.2842 => 1.4069, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 9.52% (10.3673 => 11.3538, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.46% (0.2802 => 0.3067, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.43% (0.7326 => 0.8017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.33% (0.2756 => 0.3013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.21% (0.3052 => 0.3333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2725 => 0.2975, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.15% (0.3935 => 0.4295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.92% (0.2714 => 0.2956, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.83% (63.2438 => 68.8266, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.77% (0.3136 => 0.3411, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.89% (2.2022 => 2.3759, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3817 => 0.3968, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.34% (7.9617 => 8.2279, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.14% (32.5116 => 59.2166, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.02% (2.8904 => 3.0933, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.49% (11.6436 => 12.3994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.78% (4.2280 => 4.4723, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.90% (3.6395 => 3.7814, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.3316 => 0.3425, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.6802 => 8.9206, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.50% (0.9957 => 1.0206, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.04% (9.1159 => 9.3018, std.dev.: 0.0327) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (0.6533 => 0.6660) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2762, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.20% (6.5088 => 6.5870, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.10% (10.3460 => 10.4602, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 1.02% (26.0924 => 26.3576, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1708, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.46% (5.2763 => 1.1892, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.81% (5.3855 => 4.4801, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.17% (5.3526 => 4.4872, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -12.90% (10.4361 => 9.0894, std.dev.: 0.0142) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9324, std.dev.: 0.0552) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.29% (1.7609 => 1.6326, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.99% (1.9577 => 0.6658, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3042, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.39% (1.5373 => 1.0240, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.88% (10.7105 => 7.4026, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -24.97% (85.0658 => 63.8253, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0048, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: -22.75% (0.0756 => 0.0584, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.53% (0.0757 => 0.0594, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0015) SingleSource/UnitTests/Vector/multiplies: -16.57% (2.5528 => 2.1299, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4182, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4909, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2878, std.dev.: 0.0643) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2373 => 1.1645, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5718, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.61% (0.2497 => 0.2357) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.27% (8.1563 => 7.7265, std.dev.: 0.0253) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8394, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0071) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: -1.81% (3.6994 => 3.6323, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (12.5348 => 12.3312, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: -1.60% (3.7221 => 3.6625, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2283, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0009) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 08:52:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 10:52:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109165258.663D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7439?compare_to=7436&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7439, Order: 171972, Start Time: 2013-01-09 15:19:06, End Time: 2013-01-09 16:52:56 To: 7436, Order: 171969, Start Time: 2013-01-09 13:21:43, End Time: 2013-01-09 14:55:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (854 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.54% (0.6716 => 0.6954, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.08% (0.0717 => 0.1241, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 62.39% (0.6395 => 1.0385, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 60.91% (0.5456 => 0.8779, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 60.25% (0.5688 => 0.9115, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.06% (0.0974 => 0.1559) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 59.84% (0.5575 => 0.8911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 59.82% (0.5567 => 0.8897, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 59.70% (0.5581 => 0.8913, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 59.53% (0.5805 => 0.9261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 59.11% (0.6260 => 0.9960, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 58.95% (0.0514 => 0.0817, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 57.70% (0.5941 => 0.9369, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 57.28% (0.6033 => 0.9489, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.76% (0.5849 => 0.9169, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.55% (0.5859 => 0.9172, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.22% (0.6440 => 0.9932, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 53.89% (0.6189 => 0.9524, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 52.87% (0.6304 => 0.9637, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.37% (0.6676 => 1.0172, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.21% (0.6395 => 0.9734, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.02% (0.6660 => 0.9991, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.31% (0.5478 => 0.8179, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.12% (0.6230 => 0.9290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 48.85% (0.5802 => 0.8636, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 48.84% (0.5569 => 0.8289, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 48.71% (0.5705 => 0.8484, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.64% (0.5570 => 0.8279, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.45% (0.5591 => 0.8300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.24% (0.5925 => 0.8724, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.51% (0.6052 => 0.8867, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.42% (0.5857 => 0.8576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.19% (0.5863 => 0.8571, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 44.48% (0.7524 => 1.0871, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.45% (0.6446 => 0.9311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 44.03% (0.6194 => 0.8921, std.dev.: 0.0015) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.31% (0.6297 => 0.9024, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.30% (0.6681 => 0.9507, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 40.92% (0.6667 => 0.9395, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.90% (0.0599 => 0.0838, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.21% (0.7339 => 1.0070, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.60% (1.6474 => 2.1185, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 27.94% (0.0680 => 0.0870, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.56% (0.0693 => 0.0884, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.57% (0.0582 => 0.0725, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.82% (0.0445 => 0.0551, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.73% (2.2587 => 2.7495, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.32% (0.1081 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.89% (0.1982 => 0.2297, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3357 => 0.3856, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 13.80% (1.1450 => 1.3030, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.84% (0.4916 => 0.5547, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.29% (0.7021 => 0.7884, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.14% (0.4515 => 0.5063, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.49% (4.5069 => 5.0248, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.87% (1.6364 => 1.8142, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.85% (0.5329 => 0.5907, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.45% (3.5339 => 3.9032, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.80% (0.2001 => 0.2197, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.46% (1.2515 => 1.3323, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (9.2283 => 9.7803, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.78% (1.2784 => 1.3523, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 5.28% (0.4524 => 0.4763, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.24% (1.4642 => 1.5409, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.3255 => 0.3416, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.3319 => 0.3467, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.40% (0.4861 => 0.5075, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.67% (0.6750 => 0.6998, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.67% (5.0226 => 5.2069, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (5.4682 => 5.6251, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.82% (0.3834 => 0.3942, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.3864 => 1.4131, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.9557 => 0.9703, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.28% (0.8418 => 0.8526, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.3722 => 1.3861, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6751, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.60% (0.9531 => 1.0160, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4422, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 3.64% (11.6767 => 12.1019, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (54.5751 => 56.3670, std.dev.: 0.0897) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 2.73% (3.1932 => 3.2805, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6551 => 3.7320, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.82% (27.8210 => 28.3263, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6079, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.53% (0.9852 => 0.9406, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.7198 => 0.6873, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.41% (0.3812 => 0.3644, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3831 => 0.3664, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.34% (0.3896 => 0.3727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.31% (2.4924 => 2.3849, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.30% (0.3880 => 0.3713, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.29% (0.3848 => 0.3683, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.12% (0.4176 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.11% (0.3891 => 0.3731, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.07% (0.4033 => 0.3869, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.85% (0.3016 => 0.2900, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.80% (0.9542 => 0.9179, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.78% (0.3884 => 0.3737, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.75% (1.3148 => 1.2655, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.74% (2.1713 => 2.0902, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.70% (0.3025 => 0.2913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.64% (0.3026 => 0.2916, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.50% (0.4199 => 0.4052, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.42% (0.4151 => 0.4009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.35% (0.2989 => 0.2889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.34% (0.4280 => 0.4137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.11% (0.7779 => 0.7537, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.07% (0.3621 => 0.3510, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.00% (0.3931 => 0.3813, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.79% (0.3867 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.77% (0.7919 => 0.7700, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.70% (0.3849 => 0.3745, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.67% (0.6441 => 0.6269, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8396, std.dev.: 0.0097) MultiSource/Applications/sqlite3/sqlite3: -2.58% (17.1032 => 16.6626, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.58% (0.4427 => 0.4313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.50% (0.4321 => 0.4213, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -2.40% (0.4248 => 0.4146, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -2.36% (0.7982 => 0.7794, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.30% (6.7716 => 6.6159, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -2.26% (4.3330 => 4.2351, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3122, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.20% (1.2210 => 1.1941, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8385, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0321, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -2.08% (7.0961 => 6.9483, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.2221 => 1.1972, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (1.2300 => 1.2057, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -1.62% (2.4021 => 2.3632, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.60% (0.9179 => 0.9032, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.60% (0.8521 => 0.8385, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.60% (34.0927 => 33.5486, std.dev.: 0.0185) MultiSource/Applications/lua/lua: -1.46% (4.0594 => 4.0002, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -1.40% (1.5610 => 1.5392, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: -1.19% (15.2527 => 15.0712, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.18% (8.0126 => 7.9182, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.58% (1.8100 => 0.6954, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0172, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2385) SingleSource/Benchmarks/Misc/mandel-2: -24.13% (1.3643 => 1.0351, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7597, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0751, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary2: -23.15% (0.0756 => 0.0581, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1051, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.85% (0.0757 => 0.0584, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.50% (4.1024 => 3.1792, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4053, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0038) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6844, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.96% (4.9100 => 4.2738, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.28% (0.5142 => 0.4562, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.09% (5.2027 => 4.7816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.26% (4.1534 => 3.8933, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1556, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0603, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.67% (7.9763 => 7.6833, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.63% (1.3096 => 1.2752, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout/ary3: -2.49% (3.7241 => 3.6312, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7071, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8092, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.31% (1.6086 => 1.5876, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6014, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.07% (1.4516 => 1.4360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7092 => 3.6713, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 10:50:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 12:50:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109185024.323662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7440?compare_to=7439&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7440, Order: 171978, Start Time: 2013-01-09 17:16:32, End Time: 2013-01-09 18:50:23 To: 7439, Order: 171972, Start Time: 2013-01-09 15:19:06, End Time: 2013-01-09 16:52:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.08% (0.0717 => 0.1241, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 62.63% (0.6395 => 1.0400, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.40% (0.5456 => 0.8806, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 60.71% (0.5688 => 0.9141, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.37% (0.0974 => 0.1562, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 60.21% (0.5567 => 0.8919, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 59.98% (0.5575 => 0.8919, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 59.90% (0.5805 => 0.9282, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 59.88% (0.5581 => 0.8923, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 59.42% (0.6260 => 0.9980, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 58.75% (0.0514 => 0.0816, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 57.94% (0.5941 => 0.9383, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 57.62% (0.6033 => 0.9509, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.16% (0.5849 => 0.9192, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.85% (0.5859 => 0.9190, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.53% (0.6440 => 0.9952, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.27% (0.6189 => 0.9548, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 53.17% (0.6304 => 0.9656, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.70% (0.6676 => 1.0194, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.45% (0.6395 => 0.9749, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.41% (0.6660 => 1.0017, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.62% (0.5478 => 0.8196, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.29% (0.6230 => 0.9301, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 48.97% (0.5705 => 0.8499, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 48.97% (0.5569 => 0.8296, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 48.97% (0.5802 => 0.8643, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.96% (0.5570 => 0.8297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.45% (0.5591 => 0.8300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.68% (0.5925 => 0.8750, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.70% (0.6052 => 0.8878, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.65% (0.5857 => 0.8589, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.09% (0.5863 => 0.8565, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.74% (0.6446 => 0.9330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 44.71% (0.7524 => 1.0888, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 44.24% (0.6194 => 0.8934, std.dev.: 0.0061) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.47% (0.6297 => 0.9034, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.88% (0.6681 => 0.9546, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 41.22% (0.6667 => 0.9415, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.90% (0.0599 => 0.0838) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.33% (0.7339 => 1.0079, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.78% (1.6474 => 2.1215, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 27.94% (0.0680 => 0.0870, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.71% (0.0693 => 0.0885, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.40% (0.0582 => 0.0724, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.32% (0.0621 => 0.0772) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.04% (0.0445 => 0.0552, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.02% (2.2587 => 2.7561, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.50% (0.1081 => 0.1281, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 16.25% (0.1982 => 0.2304, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 13.87% (1.1450 => 1.3038, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.94% (0.4916 => 0.5552, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.12% (0.7021 => 0.7872, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.55% (4.5069 => 5.0274, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.96% (0.5329 => 0.5913, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.91% (1.6364 => 1.8150, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.67% (3.5339 => 3.9110, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.85% (0.2001 => 0.2198, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2385 => 0.2593, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.15% (0.1441 => 0.1544, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 6.42% (1.2515 => 1.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.1731 => 0.1841, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.10% (9.2283 => 9.7910, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.87% (1.2784 => 1.3535, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.38% (1.4642 => 1.5430, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 4.62% (0.4524 => 0.4733, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3319 => 0.3470, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4861 => 0.5062, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.76% (5.0226 => 5.2112, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/bigfib: 3.38% (0.6750 => 0.6978, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.71% (5.4682 => 5.6166, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.3864 => 1.4149, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.63% (0.8418 => 0.8555, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (0.9557 => 0.9687, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.08% (1.3722 => 1.3870, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6739, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.49% (0.9531 => 1.0150, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.46% (5.1955 => 5.4273, std.dev.: 0.0071) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1005, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5314, std.dev.: 0.0756) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.08% (2.0478 => 2.1109, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 2.79% (3.1932 => 3.2822, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6551 => 3.7241, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3258, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6068, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.29% (0.3194 => 0.2993, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.14% (0.7198 => 0.6828, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (0.3821 => 0.3637, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.68% (0.3057 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.54% (0.3812 => 0.3639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.46% (0.3831 => 0.3660, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.42% (0.2849 => 0.2723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.42% (0.3848 => 0.3678, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.41% (0.3896 => 0.3724, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.36% (0.9852 => 0.9422, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.25% (0.2939 => 0.2814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.24% (0.3891 => 0.3726, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.20% (0.3142 => 0.3010, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3880 => 0.3717, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.14% (0.4176 => 0.4003, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -4.10% (2.4924 => 2.3903, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.08% (0.3016 => 0.2893, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.03% (2.1713 => 2.0837, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: -4.03% (0.3025 => 0.2903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.03% (0.3252 => 0.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.93% (1.3148 => 1.2631, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3884 => 0.3733, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.68% (0.9542 => 0.9191, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.64% (0.4151 => 0.4000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.39% (0.3658 => 0.3534, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.36% (0.6347 => 0.6134, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.34% (0.4280 => 0.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.29% (0.3621 => 0.3502, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.14% (0.7779 => 0.7535, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.12% (0.6441 => 0.6240, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.08% (0.3931 => 0.3810, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.03% (0.3867 => 0.3750, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.89% (0.4321 => 0.4196, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (14.2083 => 13.8261, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.65% (0.7919 => 0.7709, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.56% (17.1032 => 16.6648, std.dev.: 0.0227) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.43% (6.7716 => 6.6070, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2827, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.35% (1.2210 => 1.1923, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -2.30% (4.3330 => 4.2333, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1943, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.22% (1.2300 => 1.2027, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -2.20% (16.1920 => 15.8365, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0321, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -2.10% (0.7982 => 0.7814, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -2.05% (7.0961 => 6.9505, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.87% (34.0927 => 33.4562, std.dev.: 0.0091) MultiSource/Applications/hbd/hbd: -1.69% (1.5610 => 1.5346, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.68% (0.5999 => 0.5898, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.64% (0.8521 => 0.8381, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -1.62% (2.4021 => 2.3631, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -1.48% (4.0594 => 3.9992, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.25% (8.0126 => 7.9123, std.dev.: 0.0058) MultiSource/Applications/ClamAV/clamscan: -1.14% (15.2527 => 15.0781, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.02% (1.8100 => 0.6875, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.27% (2.0459 => 1.0174) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.55% (4.3504 => 3.2390, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0805, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.12% (5.3397 => 4.1050, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.75% (0.0756 => 0.0584, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2987, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.49% (4.1024 => 3.1798, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.23% (4.3779 => 3.4046, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.06% (1.2237 => 0.9660, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.34% (4.7378 => 4.1056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.97% (4.9100 => 4.2734, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7814, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0061) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.26% (4.1534 => 3.8934, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6999, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3830 => 5.1555, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0604, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.59% (7.9763 => 7.6896, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.15% (1.0557 => 1.0224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (2.1154 => 2.0525, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.94% (1.3096 => 1.2711, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/ary3: -2.59% (3.7241 => 3.6275, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.78% (1.6086 => 1.5799, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.50% (4.8776 => 4.8044, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6219 => 1.6017, std.dev.: 0.0070) MultiSource/Applications/lemon/lemon: -1.15% (1.4516 => 1.4349, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.03% (4.4002 => 4.3550, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 11:17:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 13:17:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109191710.99DA92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7441?compare_to=7438&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7441, Order: 171976, Start Time: 2013-01-09 17:05:39, End Time: 2013-01-09 19:17:08 To: 7438, Order: 171972, Start Time: 2013-01-09 14:23:43, End Time: 2013-01-09 16:35:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (219 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.86% (0.6658 => 0.6782, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.82% (1.3139 => 1.2900, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1336 => 0.1337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8520 => 499.8290, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.87% (1.1277 => 499.8290, std.dev.: 0.0136) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.10% (0.5229 => 1.6529, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 19.95% (14.9895 => 17.9792, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 43.95% (14.1553 => 20.3772, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/gs/gs: 17.76% (4.1105 => 4.8404, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.31% (1.1048 => 1.7490, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.74% (7.1582 => 37.8482, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.43% (3.4629 => 6.4213, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.50% (0.6222 => 1.0982, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.31% (0.0720 => 7.4443, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3832300.00% (0.0001 => 3.8324, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 11080600.00% (0.0001 => 11.0807, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884400.00% (0.0001 => 9.8845, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503800.00% (0.0001 => 5.5039, std.dev.: 0.0063) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.63% (1.1194 => 10.3167, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: 148.22% (22.1758 => 55.0442, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.90% (0.0929 => 0.1792, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464) SingleSource/UnitTests/SignlessTypes/factor: 80.07% (0.0296 => 0.0533, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.41% (0.1463 => 0.2537, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.00% (2.9384 => 4.6426, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.18% (7.0540 => 11.0166, std.dev.: 0.0116) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.83% (1.5859 => 2.4237, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/IntMM: 51.52% (0.0394 => 0.0597, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.57% (8.1363 => 12.0066, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.87% (2.2024 => 3.1466, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.60% (0.0439 => 0.0626, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 40.68% (21.9371 => 30.8616, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.59% (0.1892 => 0.2660, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 40.08% (0.3109 => 0.4355, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 39.82% (0.5105 => 0.7138, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 39.39% (0.1432 => 0.1996, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.23% (0.1062 => 0.1468, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.76% (0.4615 => 0.6219, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.73% (4.2646 => 5.7458, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.02% (0.6675 => 0.8946, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.41% (1.5415 => 2.0565, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 32.12% (0.4299 => 0.5680, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.82% (0.1337 => 0.1749, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.90% (0.2271 => 0.2950, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 29.01% (1.1642 => 1.5019, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.54% (0.1906 => 0.2450, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.00% (0.1125 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.55% (0.1655 => 0.2111, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.84% (3.8922 => 4.8979, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.69% (0.2554 => 0.3210, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.74% (0.3121 => 0.3893, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.41% (0.1143 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.11% (1.0722 => 1.3307, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.36% (0.1695 => 0.2091, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 23.23% (9.4845 => 11.6882, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/matrix: 22.89% (0.3098 => 0.3807, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.88% (0.0730 => 0.0897) SingleSource/Benchmarks/Shootout-C++/hash: 22.85% (0.4289 => 0.5269, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.81% (1.4186 => 1.7422, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 22.22% (0.7115 => 0.8696, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 22.10% (0.4620 => 0.5641, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 22.04% (5.7591 => 7.0286, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 22.04% (0.6456 => 0.7879, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.2700 => 0.3290, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.1236 => 0.1499, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.04% (1.3050 => 1.5796, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.52% (0.7835 => 0.9443, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 20.24% (0.1695 => 0.2038, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.10% (4.9449 => 5.9390, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.69% (0.5860 => 0.7014, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.44% (5.0018 => 5.9739, std.dev.: 0.0081) MultiSource/Benchmarks/nbench/nbench: 19.33% (1.1840 => 1.4129, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 19.32% (3.3354 => 3.9797, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.30% (0.8172 => 0.9749, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.67% (0.5020 => 0.5957, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.32% (0.3307 => 0.3913, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.17% (0.1117 => 0.1320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 18.12% (0.3283 => 0.3878, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.92% (0.7433 => 0.8765, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 17.88% (0.3232 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.67% (0.3423 => 0.4028, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.64% (0.9765 => 1.1488, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.42% (0.5569 => 0.6539, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 17.00% (3.8723 => 4.5307, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.90% (0.5981 => 0.6992, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 16.85% (2.0273 => 2.3690, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 16.30% (0.2049 => 0.2383, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.25% (0.6450 => 0.7498, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.22% (0.4636 => 0.5388, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.08% (2.2969 => 2.6662, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.05% (0.8101 => 0.9401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3379 => 0.3912, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.69% (0.8921 => 1.0321, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.06% (0.3180 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.80% (1.1861 => 1.3616, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.35% (0.0704 => 0.0805, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.31% (0.3865 => 0.4418, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 14.25% (1.5603 => 1.7827, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.07% (0.8067 => 0.9202, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.95% (0.2603 => 0.2966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.67% (0.4103 => 0.4664, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.40% (0.4203 => 0.4766, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 13.16% (0.3603 => 0.4077, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.14% (0.3387 => 0.3832, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.83% (0.3927 => 0.4431, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 12.80% (0.4048 => 0.4566, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 12.51% (0.3422 => 0.3850) SingleSource/UnitTests/ObjC/property: 12.33% (0.3886 => 0.4365, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.30% (0.3684 => 0.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.91% (0.1268 => 0.1419, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.89% (0.3828 => 0.4283, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.82% (17.1811 => 19.2126, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.76% (0.3826 => 0.4276, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.75% (0.3473 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.51% (0.3694 => 0.4119, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions-2: 11.47% (0.3497 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.41% (0.3516 => 0.3917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 11.16% (0.2831 => 0.3147, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 11.04% (0.2871 => 0.3188) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.99% (14.3668 => 15.9459, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.91% (0.3427 => 0.3801, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.57% (10.3673 => 11.4628, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.38% (2.0665 => 2.2809, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 10.27% (0.6030 => 0.6649, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.01% (0.2877 => 0.3165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.96% (0.2872 => 0.3158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.86% (0.2891 => 0.3176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.82% (0.5925 => 0.6507, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.67% (0.2905 => 0.3186, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.65% (0.3162 => 0.3467, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.64% (0.7326 => 0.8032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.64% (0.2802 => 0.3072, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 9.62% (1.2842 => 1.4078, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.62% (0.1330 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.62% (0.3650 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.58% (0.2756 => 0.3020, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 9.44% (0.3052 => 0.3340, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2725 => 0.2979, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.20% (0.2793 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.12% (0.3935 => 0.4294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.06% (0.2714 => 0.2960, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.83% (0.3136 => 0.3413, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.60% (63.2438 => 68.6797, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (2.2022 => 2.3697, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.55% (0.3177 => 0.3385, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.90% (0.2266 => 0.2377, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.03% (0.3817 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (7.9617 => 8.2265, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.13% (32.5116 => 59.2143, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.01% (2.8904 => 3.0930, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.50% (11.6436 => 12.4002, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4514, std.dev.: 0.0152) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (3.6395 => 3.7768, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (2.0360 => 2.1075, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.35% (0.3316 => 0.3427, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.6802 => 8.9253, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.07% (0.9957 => 1.0163, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.05% (9.1159 => 9.3025, std.dev.: 0.0443) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2766, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.09% (26.0924 => 26.3760, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1701, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.51% (5.2763 => 1.1864, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.53% (0.8651 => 0.2117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.02% (5.3855 => 4.4688, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.37% (5.3526 => 4.4765, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -13.02% (10.4361 => 9.0773, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0218, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.51% (1.7609 => 1.6287, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.36% (1.9577 => 0.6782, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.88% (10.7105 => 7.4030, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -24.97% (85.0658 => 63.8251, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0033, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.53% (0.0757 => 0.0594, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4907, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2924, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7058, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.30% (1.2373 => 1.1593, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (0.2497 => 0.2356, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.07% (8.1563 => 7.7427, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.74% (0.4808 => 0.4580, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8341, std.dev.: 0.0084) MultiSource/Applications/siod/siod: -3.86% (3.2827 => 3.1559, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.6994 => 3.6376, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3306, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0014) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 12:47:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 14:47:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109204744.3A0D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7442?compare_to=7440&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7442, Order: 171986, Start Time: 2013-01-09 19:13:59, End Time: 2013-01-09 20:47:41 To: 7440, Order: 171978, Start Time: 2013-01-09 17:16:32, End Time: 2013-01-09 18:50:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (102 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.31% (0.8296 => 0.8405, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.95% (0.6875 => 0.7009, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.36% (0.0717 => 0.1243, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 62.69% (0.6395 => 1.0404, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.47% (0.5456 => 0.8810, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 60.71% (0.5688 => 0.9141, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 60.41% (0.5567 => 0.8930, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 60.24% (0.5581 => 0.8943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.16% (0.0974 => 0.1560, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.04% (0.5575 => 0.8922, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 59.95% (0.5805 => 0.9285, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 59.70% (0.6260 => 0.9997, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 58.95% (0.0514 => 0.0817) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 58.07% (0.5941 => 0.9391, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 57.73% (0.6033 => 0.9516, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.39% (0.5849 => 0.9206, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.80% (0.5859 => 0.9187, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 54.77% (0.6440 => 0.9967, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 54.39% (0.6189 => 0.9555, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/factor: 54.29% (0.0315 => 0.0486, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 53.35% (0.6304 => 0.9667, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.82% (0.6676 => 1.0202, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.48% (0.6395 => 0.9751, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.92% (0.5569 => 0.8405, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.69% (0.6660 => 1.0036, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.67% (0.5478 => 0.8199, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.44% (0.6230 => 0.9310, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.17% (0.5570 => 0.8309, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 49.02% (0.5802 => 0.8646, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 48.96% (0.5705 => 0.8498, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.54% (0.5591 => 0.8305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.61% (0.5925 => 0.8746, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.86% (0.6052 => 0.8888, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.56% (0.5857 => 0.8584, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.21% (0.5863 => 0.8572, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.77% (0.6446 => 0.9332, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 44.71% (0.7524 => 1.0888, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 44.27% (0.6194 => 0.8936, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.85% (0.6297 => 0.9058, std.dev.: 0.0039) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.64% (0.6681 => 0.9530, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 41.25% (0.6667 => 0.9417, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.90% (0.0599 => 0.0838, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.32% (0.7339 => 1.0078, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.64% (1.6474 => 2.1192, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.09% (0.0680 => 0.0871, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.71% (0.0693 => 0.0885, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.82% (0.0790 => 0.0994, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.57% (0.0582 => 0.0725, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.48% (0.0621 => 0.0773, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.04% (0.0445 => 0.0552, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.87% (2.2587 => 2.7526, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.59% (0.1081 => 0.1282, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.79% (0.1982 => 0.2295, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.04% (0.3357 => 0.3862, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.10% (1.1450 => 1.3064, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.06% (0.4916 => 0.5558, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 12.20% (0.4515 => 0.5066, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.11% (0.7021 => 0.7871, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.68% (4.5069 => 5.0332, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.08% (1.6364 => 1.8177, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.98% (0.5329 => 0.5914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.61% (3.5339 => 3.9087, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.85% (0.2001 => 0.2198, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.68% (0.2385 => 0.2592, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.63% (1.2515 => 1.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.59% (0.1731 => 0.1845, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (9.2283 => 9.7999, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.89% (1.2784 => 1.3537, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.48% (1.4642 => 1.5445, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 4.62% (0.4524 => 0.4733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3319 => 0.3470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.11% (0.4861 => 0.5061, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.57% (5.0226 => 5.2018, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 3.45% (0.6750 => 0.6983, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.02% (5.4682 => 5.6332, std.dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: 2.27% (1.3864 => 1.4179, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.81% (0.8418 => 0.8570, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (0.9557 => 0.9700, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3722 => 1.3893, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6596, std.dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.59% (0.9531 => 1.0159, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4409, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5602, std.dev.: 0.0544) MultiSource/Benchmarks/nbench/nbench: 3.63% (11.6767 => 12.1011, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 2.91% (3.1932 => 3.2862, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1074, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.47% (0.6469 => 0.6629, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3249, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.70% (3.6551 => 3.7173, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6052, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.11% (1.5103 => 1.5271, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.65% (0.3891 => 0.3710, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.57% (0.3323 => 0.3171, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.54% (0.4033 => 0.3850, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.48% (0.4176 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.36% (0.9852 => 0.9422, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: -4.34% (0.3205 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.22% (0.7198 => 0.6894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.15% (0.3884 => 0.3723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.10% (0.4199 => 0.4027, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.06% (2.4924 => 2.3913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.05% (0.2939 => 0.2820, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.03% (0.3025 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.00% (0.3252 => 0.3122, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.98% (2.1713 => 2.0849, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.95% (1.3148 => 1.2629, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (0.9542 => 0.9176, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.71% (0.4280 => 0.4121, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.52% (0.4151 => 0.4005, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.37% (0.6347 => 0.6133, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.28% (0.7779 => 0.7524, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -3.23% (0.3621 => 0.3504, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.23% (0.3658 => 0.3540, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.17% (0.6441 => 0.6237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -2.97% (0.3867 => 0.3752, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.93% (0.3931 => 0.3816, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -2.67% (0.3788 => 0.3687, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.65% (0.3849 => 0.3747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.55% (0.7919 => 0.7717, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -2.47% (17.1032 => 16.6813, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.39% (14.2083 => 13.8689, std.dev.: 0.0161) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2912, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (1.2210 => 1.1938, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.19% (1.2221 => 1.1953, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.17% (6.7716 => 6.6247, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0322, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -2.02% (4.3330 => 4.2456, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8729, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.95% (1.2300 => 1.2060, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.89% (0.7982 => 0.7831, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.87% (7.0961 => 6.9632, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: -1.61% (34.0927 => 33.5439, std.dev.: 0.0431) MultiSource/Applications/hbd/hbd: -1.48% (1.5610 => 1.5379, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.38% (0.9179 => 0.9052, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.37% (0.8521 => 0.8404, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -1.33% (2.4021 => 2.3701, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.30% (4.0594 => 4.0067, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.01% (8.0126 => 7.9316, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.28% (1.8100 => 0.7009, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3087, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2384, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.03% (1.3643 => 1.0228, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0737, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -22.88% (0.0756 => 0.0583, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2986, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.51% (4.1024 => 3.1791, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.22% (4.3779 => 3.4052, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1299, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.33% (4.7378 => 4.1061, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7253, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.97% (4.9100 => 4.2731, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.08% (5.2027 => 4.7824, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6339, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.25% (4.1534 => 3.8937, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1557, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.12% (3.1919 => 3.0604, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.61% (7.9763 => 7.6884, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.96% (2.1154 => 2.0527, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.69% (1.3096 => 1.2744, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.64% (2.7523 => 2.7072, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7092 => 3.6540, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.49% (1.6219 => 1.5978, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.8776 => 4.8069, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5891, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.16% (1.4516 => 1.4347, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3551, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 12:53:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 14:53:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130109205347.EF4DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7443?compare_to=7437&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7443, Order: 171975, Start Time: 2013-01-09 17:19:26, End Time: 2013-01-09 20:53:44 To: 7437, Order: 171966, Start Time: 2013-01-09 12:50:22, End Time: 2013-01-09 16:25:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (180 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.17% (1.9423 => 1.9651, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.09% (52.7262 => 54.3562, std.dev.: 0.2779) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.69% (0.6103 => 0.6206, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 1.32% (2.7901 => 2.8269, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.03% (1.1609 => 1.1490, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: -5.50% (0.2289 => 0.2163, std.dev.: 0.0044) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.69% (0.2969 => 0.3791, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.12% (0.4139 => 0.5220, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.08% (0.5900 => 0.7439, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.95% (0.1106 => 0.1393, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.30% (0.4253 => 0.5329, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.73% (0.4994 => 0.6229, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.38% (0.1620 => 0.2015, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.92% (0.5000 => 0.6196, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.34% (1.5932 => 1.9651, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.21% (0.1103 => 0.1359, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.37% (0.1549 => 0.1880, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.34% (0.3903 => 0.4736, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 21.29% (0.0808 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.25% (0.1619 => 0.1963, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.27% (0.0947 => 0.1139, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 19.58% (0.4029 => 0.4818, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.49% (0.1088 => 0.1300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.47% (0.2866 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.41% (0.2736 => 0.3267, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.27% (0.2014 => 0.2402, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.1160 => 0.1383, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.20% (0.3890 => 0.4637, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 18.97% (0.5826 => 0.6931, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 18.48% (0.5889 => 0.6977, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.27% (0.5546 => 0.6559, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.14% (1.3152 => 1.5538, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 17.93% (1.8794 => 2.2163, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.92% (0.3271 => 0.3857, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 17.61% (0.7171 => 0.8434, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.53% (3.5627 => 4.1874, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.44% (1.6211 => 1.9039, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.33% (0.1968 => 0.2309, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 17.04% (0.9697 => 1.1349, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.03% (0.5026 => 0.5882, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.90% (0.2875 => 0.3361, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.67% (0.3930 => 0.4585, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 16.44% (0.2750 => 0.3202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.40% (0.2792 => 0.3250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.40% (0.2823 => 0.3286, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.40% (4.4195 => 5.1443, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/except: 16.36% (0.2811 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.35% (0.2813 => 0.3273, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.32% (0.2911 => 0.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.29% (0.2738 => 0.3184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.29% (0.2714 => 0.3156, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.27% (0.2803 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.24% (2.0673 => 2.4031, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.05% (0.2729 => 0.3167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 16.01% (0.2780 => 0.3225, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 15.96% (0.9909 => 1.1490, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 15.85% (1.0781 => 1.2490, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.77% (0.3195 => 0.3699, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.70% (23.5202 => 27.2138, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.68% (0.3362 => 0.3889, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 15.63% (0.3096 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.55% (0.3267 => 0.3775, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.55% (1.9694 => 2.2756, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.49% (0.3060 => 0.3534, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.47% (1.9966 => 2.3054, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 15.44% (0.3258 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.39% (2.7292 => 3.1493, std.dev.: 0.0052) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8548, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/hash: 15.27% (0.4146 => 0.4779, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 15.19% (0.3317 => 0.3821, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.08% (0.3124 => 0.3595, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 14.95% (0.3726 => 0.4283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.93% (0.3678 => 0.4227, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.78% (0.3348 => 0.3843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.78% (0.3282 => 0.3767, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.69% (0.3845 => 0.4410, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.68% (0.3625 => 0.4157, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 14.53% (1.4269 => 1.6342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.49% (0.4251 => 0.4867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.42% (0.3981 => 0.4555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.40% (0.1090 => 0.1247, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.25% (0.3690 => 0.4216, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 14.03% (0.7875 => 0.8980, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3465 => 0.3950, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.91% (0.1028 => 0.1171, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 13.83% (0.5012 => 0.5705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 13.79% (0.3460 => 0.3937, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.40% (0.3650 => 0.4139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.12% (0.6435 => 0.7279, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.79% (2.1653 => 2.4422, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.56% (0.0804 => 0.0905, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1918, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 12.24% (0.2075 => 0.2329, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 12.23% (5.5417 => 6.2196, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3562, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.80% (0.2068 => 0.2312, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.61% (0.3084 => 0.3442, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.28% (0.6634 => 0.7382, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.22% (0.2103 => 0.2339, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.09% (0.3336 => 0.3706, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.97% (0.5361 => 0.5949, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.75% (11.6398 => 12.8913, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 10.65% (0.4847 => 0.5363, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.59% (0.2040 => 0.2256, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.52% (4.6926 => 5.1861, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.32% (0.7426 => 0.8192, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (0.5584 => 0.6058, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.95% (0.2391 => 0.2581, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.85% (11.9555 => 12.8939, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 7.75% (2.0346 => 2.1923, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.46% (0.3792 => 0.3961, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.89% (29.0505 => 181.5339, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6530, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (0.3693 => 0.4072, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6129, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6802, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2399, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6860, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8873, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.12% (15.8721 => 16.2079, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3085, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.42% (1.0927 => 1.1082, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0109) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4829, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5883, std.dev.: 0.0159) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.04% (3.1722 => 3.2052, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2451 => 1.2578, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.10% (2.4764 => 2.4492, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5927, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.10% (17.2379 => 14.2894, std.dev.: 0.1142) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -8.33% (0.2402 => 0.2202, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7975, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9600, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -4.42% (14.0481 => 13.4278, std.dev.: 0.2249) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2237, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1950, std.dev.: 0.0283) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4998, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.29% (5.7935 => 5.7185, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1656, std.dev.: 0.0425) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0489, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 13:58:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 15:58:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130109215851.B0D9B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7444?compare_to=7441&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7444, Order: 171987, Start Time: 2013-01-09 19:47:23, End Time: 2013-01-09 21:58:48 To: 7441, Order: 171976, Start Time: 2013-01-09 17:05:39, End Time: 2013-01-09 19:17:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (222 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (649 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.72% (10.3167 => 10.4943, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.71% (1.2900 => 1.3249, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.88% (11.4628 => 11.2468, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1337 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8290 => 499.8394, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44223.79% (1.1277 => 499.8394, std.dev.: 0.0066) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.59% (0.5229 => 1.6502, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 19.66% (14.9895 => 17.9365, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 43.55% (14.1553 => 20.3199, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 17.50% (4.1105 => 4.8297, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.89% (1.1048 => 1.7444, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.86% (7.1582 => 37.5705, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.56% (3.4629 => 6.3911, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.67% (0.6222 => 1.0930, std.dev.: 0.0104) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.50% (0.0720 => 7.4430, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3832000.00% (0.0001 => 3.8321, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11083500.00% (0.0001 => 11.0836, std.dev.: 0.0177) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884200.00% (0.0001 => 9.8843, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503600.00% (0.0001 => 5.5037, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 837.49% (1.1194 => 10.4943, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 149.66% (22.1758 => 55.3638, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.68% (0.0929 => 0.1790, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 79.73% (0.0296 => 0.0532, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.86% (0.1463 => 0.2529, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.90% (2.9384 => 4.6398, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.33% (7.0540 => 10.9573, std.dev.: 0.0035) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.53% (1.5859 => 2.4189, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.49% (8.1363 => 12.0001, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.60% (0.0439 => 0.0626, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.50% (2.2024 => 3.1385, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.91% (0.1892 => 0.2666, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 40.42% (21.9371 => 30.8050, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 39.82% (0.3109 => 0.4347, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 39.55% (0.5105 => 0.7124, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.39% (0.4615 => 0.6202, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.22% (4.2646 => 5.7238, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.05% (0.6675 => 0.8948, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.81% (1.5415 => 2.0472, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 31.80% (0.4299 => 0.5666, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.82% (0.1337 => 0.1749, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.59% (0.2271 => 0.2943, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4949, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.02% (0.1906 => 0.2440, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 27.49% (0.1655 => 0.2110, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.86% (3.8922 => 4.8988, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 25.36% (0.1175 => 0.1473, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.33% (0.1125 => 0.1410, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 25.29% (0.2554 => 0.3200, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.58% (0.1143 => 0.1424, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.32% (0.3121 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 23.87% (1.0722 => 1.3281, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 23.09% (9.4845 => 11.6741, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.89% (0.1695 => 0.2083, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.51% (1.4186 => 1.7379, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 22.17% (0.4289 => 0.5240, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (0.3098 => 0.3784, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 21.98% (5.7591 => 7.0249, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.81% (0.7115 => 0.8667, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 21.79% (0.6456 => 0.7863, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.70% (0.2700 => 0.3286, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.52% (0.4620 => 0.5614, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.74% (1.3050 => 1.5757, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.31% (0.7835 => 0.9426, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.82% (4.9449 => 5.9251, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.71% (0.0842 => 0.1008, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.1695 => 0.2024, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 19.16% (3.3354 => 3.9745, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.10% (5.0018 => 5.9572, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.08% (0.5860 => 0.6978, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 19.07% (1.1840 => 1.4098, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.77% (0.8172 => 0.9706, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 18.57% (0.0614 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.17% (0.0886 => 0.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.07% (0.5020 => 0.5927, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.72% (0.3307 => 0.3893, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 17.70% (0.7433 => 0.8749, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 17.58% (0.3283 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 17.36% (0.3232 => 0.3793, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.33% (0.2758 => 0.3236, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.28% (0.9765 => 1.1452, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.97% (0.5569 => 0.6514, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.82% (2.0273 => 2.3683, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 16.70% (3.8723 => 4.5188, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.50% (0.5981 => 0.6968, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 16.45% (0.2049 => 0.2386, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.98% (0.4636 => 0.5377, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 15.85% (2.2969 => 2.6609, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.74% (0.8101 => 0.9376, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.72% (0.6450 => 0.7464, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.63% (0.3441 => 0.3979, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.40% (0.8921 => 1.0295, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.24% (0.3379 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.65% (0.3180 => 0.3646, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.32% (1.1861 => 1.3559, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 14.05% (1.5603 => 1.7796, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.87% (0.3865 => 0.4401, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.78% (0.8067 => 0.9179, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.14% (0.4103 => 0.4642, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.97% (0.4203 => 0.4748, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/sieve: 12.60% (0.3603 => 0.4057, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 12.38% (0.1268 => 0.1425, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 12.30% (0.4048 => 0.4546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 12.22% (0.3282 => 0.3683, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.92% (0.3422 => 0.3830, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.89% (0.3684 => 0.4122, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.65% (17.1811 => 19.1826, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/parameter-passing: 11.36% (0.3927 => 0.4373, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.03% (0.2430 => 0.2698, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.95% (0.4064 => 0.4509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.76% (14.3668 => 15.9126, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/bh/bh: 10.64% (0.3092 => 0.3421, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.59% (0.3427 => 0.3790, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2831 => 0.3130, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.14% (0.2871 => 0.3162, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.08% (0.3543 => 0.3900, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.82% (2.0665 => 2.2694, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 9.72% (0.6030 => 0.6616, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.47% (0.1330 => 0.1456, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2877 => 0.3149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.44% (0.2891 => 0.3164, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.42% (0.3650 => 0.3994, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2872 => 0.3138, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.23% (0.2905 => 0.3173, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 9.19% (1.2842 => 1.4022, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7326 => 0.7999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2756 => 0.3007, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: 9.10% (0.2802 => 0.3057, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.08% (0.3052 => 0.3329, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 8.96% (63.2438 => 68.9087, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.77% (0.2793 => 0.3038, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.74% (0.3935 => 0.4279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.58% (0.3136 => 0.3405, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.48% (10.3673 => 11.2468, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (2.2022 => 2.3771, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.04% (7.9617 => 8.2040, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.11% (32.5116 => 59.2066, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6979, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.01% (2.8904 => 3.0930, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.49% (11.6436 => 12.3995, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4437, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.95% (3.6395 => 3.7834, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.53% (2.0360 => 2.1078, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.3316 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9120, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.06% (0.9957 => 1.0162, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.94% (0.6533 => 0.6660, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2914, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (1.7254 => 1.7561, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2813, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.56% (1.3045 => 1.3249, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3460 => 10.4628, std.dev.: 0.0185) MultiSource/Applications/lua/lua: 1.08% (26.0924 => 26.3747, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.38% (5.2763 => 1.1933, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.91% (5.3855 => 4.4749, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.35% (5.3526 => 4.4775, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -13.03% (10.4361 => 9.0763, std.dev.: 0.0055) SingleSource/UnitTests/Vector/constpool: -7.58% (54.1659 => 50.0581, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.25% (1.7609 => 1.6333, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.11% (1.9577 => 0.6439, std.dev.: 0.0162) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3090, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.40% (1.5373 => 1.0239, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4233, std.dev.: 0.0715) MultiSource/Benchmarks/PAQ8p/paq8p: -24.96% (85.0658 => 63.8294, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0086, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9695 => 2.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.35% (0.0756 => 0.0587) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.53% (0.0757 => 0.0594, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.41% (2.5528 => 2.1340, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.14% (9.5636 => 8.4979, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4244, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2957, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.30% (1.2373 => 1.1594, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (0.2497 => 0.2356, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.16% (8.1563 => 7.7355, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-5: -4.54% (1.5835 => 1.5116, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.48% (10.2830 => 9.8219, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.85% (3.6994 => 3.6309, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3306, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0009) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 14:45:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 16:45:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130109224533.AF2452A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7445?compare_to=7442&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7445, Order: 171996, Start Time: 2013-01-09 21:11:06, End Time: 2013-01-09 22:45:32 To: 7442, Order: 171986, Start Time: 2013-01-09 19:13:59, End Time: 2013-01-09 20:47:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (108 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (856 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (79.9316 => 81.2126, std.dev.: 0.2587) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.92% (0.0717 => 0.1247, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 63.64% (0.6395 => 1.0465, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 62.30% (0.5456 => 0.8855, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 61.55% (0.5688 => 0.9189, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 61.03% (0.5581 => 0.8987, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 61.00% (0.5567 => 0.8963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.86% (0.5575 => 0.8968, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 60.74% (0.5805 => 0.9331, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.47% (0.0974 => 0.1563, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 60.24% (0.6260 => 1.0031, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 59.53% (0.0514 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 58.83% (0.5941 => 0.9436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 58.51% (0.6033 => 0.9563, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 58.04% (0.5849 => 0.9244, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 57.65% (0.5859 => 0.9237, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 55.37% (0.6440 => 1.0006, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/factor: 55.24% (0.0315 => 0.0489) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 55.23% (0.6189 => 0.9607, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.05% (0.6304 => 0.9711, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.55% (0.6676 => 1.0251, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 52.73% (0.6395 => 0.9767, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.23% (0.6660 => 1.0072, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 50.00% (0.5478 => 0.8217, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.76% (0.6230 => 0.9330, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 49.49% (0.5569 => 0.8325, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 49.48% (0.5705 => 0.8528, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 49.47% (0.5802 => 0.8672, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.39% (0.5570 => 0.8321, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.94% (0.5591 => 0.8327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 47.78% (0.5925 => 0.8756, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 47.04% (0.6052 => 0.8899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 46.88% (0.5857 => 0.8603, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 46.68% (0.5863 => 0.8600, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.36% (0.7524 => 1.0937, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 45.07% (0.6446 => 0.9351, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 44.49% (0.6194 => 0.8950, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 43.80% (0.6297 => 0.9055, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 42.72% (0.6681 => 0.9535, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 41.50% (0.6667 => 0.9434, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.57% (0.0599 => 0.0842) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.70% (0.7339 => 1.0106, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.58% (1.6474 => 2.1182, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.53% (0.0680 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 28.28% (0.0693 => 0.0889, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 26.08% (0.0790 => 0.0996, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.43% (0.0582 => 0.0730, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 24.80% (0.0621 => 0.0775) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.49% (0.0445 => 0.0554, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.89% (2.2587 => 2.7532, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.87% (0.1081 => 0.1285, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 15.34% (0.1982 => 0.2286, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 14.04% (1.1450 => 1.3058, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.20% (0.4916 => 0.5565, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.56% (0.7021 => 0.7903, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.43% (0.4515 => 0.5076, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.85% (4.5069 => 5.0409, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.22% (1.6364 => 1.8200, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.17% (0.5329 => 0.5924, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.66% (3.5339 => 3.9106, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.29% (0.2001 => 0.2207, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.10% (0.2385 => 0.2602, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.64% (0.1731 => 0.1846, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.55% (9.2283 => 9.8323, std.dev.: 0.0105) MultiSource/Applications/Burg/burg: 6.48% (1.2515 => 1.3326, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.07% (1.2784 => 1.3560, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.61% (1.4642 => 1.5464, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 5.50% (0.4524 => 0.4773, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 4.55% (0.4861 => 0.5082, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.31% (5.0226 => 5.1888, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3446 => 0.3553, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (5.4682 => 5.6180, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 2.29% (1.3864 => 1.4182, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.88% (0.8418 => 0.8576, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.9557 => 0.9727, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.34% (0.7447 => 0.7547, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (22.4056 => 22.6418, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.49% (31.3723 => 55.6823, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.62% (0.9531 => 1.0162, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (5.1955 => 5.4401, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.50% (0.2380 => 0.2487, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 3.65% (11.6767 => 12.1027, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5751 => 56.4385, std.dev.: 0.1799) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1101, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 3.02% (3.1932 => 3.2897, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.49% (0.6469 => 0.6630, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (79.7170 => 81.2126, std.dev.: 0.2587) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.82% (3.6551 => 3.7217, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (27.8210 => 28.3250, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6057, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.04% (4.4335 => 4.4794, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.13% (0.9852 => 0.9445, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -3.94% (0.2871 => 0.2758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.86% (0.3057 => 0.2939, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.85% (0.3016 => 0.2900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.82% (0.7198 => 0.6923, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.77% (0.3821 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.76% (0.3142 => 0.3024, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -3.75% (2.4924 => 2.3990, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.71% (0.3205 => 0.3086, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.65% (0.2933 => 0.2826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.64% (2.1713 => 2.0923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.64% (0.3026 => 0.2916, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: -3.62% (0.3812 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.60% (0.3831 => 0.3693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.59% (0.3896 => 0.3756, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.59% (0.3848 => 0.3710, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.58% (0.3880 => 0.3741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.57% (0.3025 => 0.2917, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.52% (1.3148 => 1.2685, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.50% (0.2939 => 0.2836, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.50% (0.3059 => 0.2952, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.4176 => 0.4031, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.47% (0.3891 => 0.3756, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.9542 => 0.9214, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.42% (0.4033 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.25% (0.3658 => 0.3539, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.15% (0.6484 => 0.6280, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.02% (0.4199 => 0.4072, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.94% (0.4151 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.72% (0.3931 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.69% (0.6347 => 0.6176, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.64% (0.4280 => 0.4167, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.61% (0.3867 => 0.3766, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.60% (0.3849 => 0.3749, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.57% (0.7779 => 0.7579, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.57% (0.4321 => 0.4210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.55% (0.4427 => 0.4314, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8594, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.45% (0.7919 => 0.7725, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6987, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2839, std.dev.: 0.0254) MultiSource/Benchmarks/MallocBench/gs/gs: -2.18% (4.3330 => 4.2385, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.06% (1.2221 => 1.1969, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.04% (6.7716 => 6.6332, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.04% (1.2210 => 1.1961, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -2.03% (0.7982 => 0.7820, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.94% (1.0544 => 1.0339, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (1.2300 => 1.2061, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -1.93% (16.1920 => 15.8789, std.dev.: 0.0117) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.0961 => 6.9691, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -1.50% (2.4021 => 2.3660, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.48% (34.0927 => 33.5896, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.41% (0.8521 => 0.8401, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.38% (0.9179 => 0.9052, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -1.37% (4.0594 => 4.0036, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -1.28% (1.5610 => 1.5410, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.18% (1.8100 => 0.6845, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0459 => 1.0173, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.06% (6.6713 => 3.3983, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.56% (4.3504 => 3.2385, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.45% (1.3643 => 1.0307, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0798, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -23.13% (5.3397 => 4.1044, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -22.75% (0.0756 => 0.0584, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.74% (0.2274 => 0.1757, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.72% (0.0757 => 0.0585, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.61% (2.9703 => 2.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.46% (4.1024 => 3.1808, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.21% (4.3779 => 3.4054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.05% (1.2237 => 0.9661, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.39% (2.5106 => 2.1242, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.19% (1.0217 => 0.8767) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.35% (4.7378 => 4.1052, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.29% (4.2493 => 3.6846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.96% (4.9100 => 4.2736, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.10% (5.2027 => 4.7814, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.28% (4.1534 => 3.8926, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.22% (5.3830 => 5.1559, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -4.13% (3.1919 => 3.0601, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.69% (7.9763 => 7.6816, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.98% (2.1154 => 2.0524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.41% (3.7241 => 3.6342, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (1.3096 => 1.2784, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.56% (4.8776 => 4.8015, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4751, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -1.24% (1.4516 => 1.4336, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5887, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6691, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.02% (4.4002 => 4.3553, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.02% (1.6307 => 1.6141, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 16:40:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 18:40:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110004038.88EE72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7446?compare_to=7444&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7446, Order: 172005, Start Time: 2013-01-09 22:29:13, End Time: 2013-01-10 00:40:36 To: 7444, Order: 171987, Start Time: 2013-01-09 19:47:23, End Time: 2013-01-09 21:58:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 6 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1093 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.70% (0.6439 => 0.6677, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.54% (11.2468 => 10.9613, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.32% (1.1933 => 1.1775, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.26% (10.4943 => 10.3621, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.14% (1.6333 => 1.6146, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -1.08% (1.7796 => 1.7604, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.11% (1.3249 => 1.2970, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1336 => 0.1337) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.30% (0.0652 => 0.0667, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8394 => 499.7971, std.dev.: 0.0303) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.04% (1.1277 => 499.7971, std.dev.: 0.0303) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.08% (0.5229 => 1.6423, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 19.06% (14.9895 => 17.8464, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 42.83% (14.1553 => 20.2177, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: 17.17% (4.1105 => 4.8164, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.96% (1.1048 => 1.7341, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.53% (7.1582 => 37.3320, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.09% (3.4629 => 6.3749, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.94% (0.6222 => 1.0885, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.47% (0.0720 => 7.4437, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: 3832700.00% (0.0001 => 3.8328, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11060900.00% (0.0001 => 11.0610, std.dev.: 0.0500) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9884900.00% (0.0001 => 9.8850, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5506200.00% (0.0001 => 5.5063, std.dev.: 0.0132) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.68% (1.1194 => 10.3621, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: 148.47% (22.1758 => 55.1004, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.60% (0.0929 => 0.1780, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 89.30% (0.0243 => 0.0460, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 79.05% (0.0296 => 0.0530, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.18% (0.1463 => 0.2519, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.02% (2.9384 => 4.6140, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.73% (7.0540 => 10.9148, std.dev.: 0.0006) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.95% (1.5859 => 2.4098, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.06% (0.1056 => 0.1553, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.03% (8.1363 => 11.9631, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.20% (2.2024 => 3.1319, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.91% (0.0439 => 0.0623, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 39.99% (21.9371 => 30.7101, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.53% (0.1892 => 0.2640, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 39.43% (0.3109 => 0.4335, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 38.71% (0.5105 => 0.7081, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops: 37.57% (0.1432 => 0.1970, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.85% (0.4615 => 0.6177, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.56% (4.2646 => 5.6960, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.24% (0.6675 => 0.8894, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.23% (1.5415 => 2.0384, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 30.94% (0.4299 => 0.5629, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.32% (0.1337 => 0.1729, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.97% (0.2271 => 0.2929, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 27.86% (1.1642 => 1.4886, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.54% (0.1906 => 0.2431, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.12% (0.0719 => 0.0914, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 26.71% (0.1655 => 0.2097, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.76% (0.1584 => 0.1992, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.24% (3.8922 => 4.8747, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.07% (0.1125 => 0.1407, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 25.02% (0.1175 => 0.1469, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 24.90% (0.2554 => 0.3190, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.84% (0.0793 => 0.0990, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.90% (0.3121 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.44% (0.1566 => 0.1933, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 23.22% (1.0722 => 1.3212, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 22.39% (9.4845 => 11.6078, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 22.01% (1.4186 => 1.7309, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.92% (0.0730 => 0.0890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 21.75% (0.4289 => 0.5222, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 21.53% (0.7115 => 0.8647, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 21.36% (0.4620 => 0.5607, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.24% (0.3098 => 0.3756, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 21.23% (5.7591 => 6.9815, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 21.21% (0.6456 => 0.7825, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.19% (0.2700 => 0.3272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.58% (0.1555 => 0.1875, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.31% (0.1236 => 0.1487, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.24% (1.3050 => 1.5691, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.21% (0.0871 => 0.1047, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 20.15% (0.0660 => 0.0793, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 19.94% (0.0662 => 0.0794, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.70% (0.0675 => 0.0808, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.62% (0.7835 => 0.9372, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.36% (0.0842 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.32% (4.9449 => 5.9003, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.28% (0.1032 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.23% (0.1695 => 0.2021, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.05% (0.1029 => 0.1225, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.0953 => 0.1132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.77% (0.5860 => 0.6960, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 18.77% (0.1151 => 0.1367, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.73% (0.8172 => 0.9703, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.60% (5.0018 => 5.9321, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.55% (3.3354 => 3.9542, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.51% (0.1940 => 0.2299, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 18.48% (1.1840 => 1.4028, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/bisort/bisort: 18.24% (0.0614 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 17.83% (0.0886 => 0.1044, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.53% (0.5020 => 0.5900, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.45% (0.3307 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.26% (0.2758 => 0.3234, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.09% (0.1510 => 0.1768, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 17.06% (0.3283 => 0.3843, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/health/health: 17.03% (0.1268 => 0.1484, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.01% (0.7433 => 0.8697, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.90% (0.9765 => 1.1415, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 16.83% (0.3232 => 0.3776, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.68% (0.5569 => 0.6498, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.59% (0.3423 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.47% (0.2107 => 0.2454, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.37% (0.2065 => 0.2403, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 16.28% (3.8723 => 4.5028, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.22% (0.5981 => 0.6951, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 16.01% (2.0273 => 2.3518, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.65% (0.0933 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.53% (0.8101 => 0.9359, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 15.47% (0.2049 => 0.2366, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 15.45% (2.2969 => 2.6518, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.31% (0.4636 => 0.5346, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.24% (0.6450 => 0.7433, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.14% (0.3441 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.13% (0.1044 => 0.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.80% (0.3379 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.77% (0.8921 => 1.0239, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 14.28% (0.3180 => 0.3634, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.01% (1.1861 => 1.3523, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.60% (0.0838 => 0.0952, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.38% (0.3865 => 0.4382, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.24% (0.8067 => 0.9135, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.10% (0.2603 => 0.2944, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7604, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.45% (0.4103 => 0.4614, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 12.37% (0.3387 => 0.3806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.16% (0.4203 => 0.4714, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 11.88% (0.4048 => 0.4529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.63% (0.3603 => 0.4022, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 11.54% (0.3422 => 0.3817, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.48% (0.3684 => 0.4107, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.30% (0.3282 => 0.3653, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.16% (17.1811 => 19.0981, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.45% (0.3092 => 0.3415, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.4064 => 0.4485, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.33% (0.3427 => 0.3781, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.30% (14.3668 => 15.8471, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/strcat: 10.17% (0.2831 => 0.3119, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.24% (2.0665 => 2.2574, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.96% (0.2891 => 0.3150, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.87% (0.1330 => 0.1448, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 8.74% (0.2905 => 0.3159, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.73% (1.2842 => 1.3963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.2756 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2802 => 0.3041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.49% (0.6030 => 0.6542, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2872 => 0.3113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3935 => 0.4252, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.04% (0.7326 => 0.7915, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.02% (63.2438 => 68.3191, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.26% (2.2022 => 2.3620, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.94% (0.4879 => 0.5169, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 5.73% (10.3673 => 10.9613, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.3131 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (7.9617 => 8.1596, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.11% (32.5116 => 59.2083, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 7.01% (2.8904 => 3.0931, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.50% (11.6436 => 12.3999, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4473, std.dev.: 0.0121) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.74% (3.6395 => 3.7757, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (2.0360 => 2.1070, std.dev.: 0.0113) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.38% (0.3316 => 0.3428, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.6802 => 8.9153, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.22% (0.9957 => 1.0178, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.93% (0.6533 => 0.6659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2890, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2801, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.30% (1.4460 => 1.4648, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.25% (10.3460 => 10.4750, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 1.07% (26.0924 => 26.3705, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1775, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.26% (0.8651 => 0.2140, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.30% (5.3855 => 4.4540, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.67% (5.3526 => 4.4604, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: -13.57% (10.4361 => 9.0204, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.31% (1.7609 => 1.6146, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.9003, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.89% (1.9577 => 0.6677, std.dev.: 0.0040) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -50.28% (2.0460 => 1.0173, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.09% (4.5009 => 2.5616, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.49% (1.5373 => 1.0224, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.89% (10.7105 => 7.4019, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -24.97% (85.0658 => 63.8234, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.60% (2.6546 => 2.0017, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -22.60% (2.9695 => 2.2984, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.53% (0.0757 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.15% (1.2258 => 0.9666, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.44% (2.5528 => 2.1332, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4915, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.09% (0.9540 => 0.8673, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.04% (1.5660 => 1.4245, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2944, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.93% (1.2373 => 1.1639, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.77% (2.7294 => 2.5719, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.65% (0.2497 => 0.2356, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.36% (8.1563 => 7.7192, std.dev.: 0.0176) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -4.49% (10.2830 => 9.8211, std.dev.: 0.0124) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.34% (3.6994 => 3.6500, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8568, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.97% (0.1485 => 0.1337) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0012) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 16:42:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 18:42:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110004246.199862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7447?compare_to=7445&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7447, Order: 172011, Start Time: 2013-01-09 23:08:58, End Time: 2013-01-10 00:42:44 To: 7445, Order: 171996, Start Time: 2013-01-09 21:11:06, End Time: 2013-01-09 22:45:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 10 (93 on baseline) Performance Improvements: 52 (136 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1042 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.05% (0.4076 => 0.4567, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: 6.23% (4.4864 => 4.7658, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: 3.30% (1.0173 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.90% (3.0601 => 3.1183, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.68% (4.1044 => 4.1732, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.60% (2.0524 => 2.0853, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.54% (4.2736 => 4.3392, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.52% (1.0162 => 1.0316, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 1.28% (1.4336 => 1.4519, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.15% (2.2986 => 2.3251, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -18.59% (0.8855 => 0.7209, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -18.52% (0.8963 => 0.7303, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -18.45% (0.8987 => 0.7329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -18.40% (0.8968 => 0.7318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -18.29% (0.9189 => 0.7508, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -17.97% (0.9331 => 0.7654, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -17.91% (0.9237 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -17.77% (0.9563 => 0.7864, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -17.71% (0.9244 => 0.7607, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -17.61% (0.9436 => 0.7774, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -17.40% (0.9607 => 0.7935, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -17.25% (0.9711 => 0.8036, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -16.85% (1.0031 => 0.8341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -16.68% (1.0006 => 0.8337, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -16.60% (1.0072 => 0.8400, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -16.57% (1.0251 => 0.8552, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -16.25% (1.0465 => 0.8764, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -15.33% (1.0937 => 0.9260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -13.39% (0.8325 => 0.7210, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.35% (0.8217 => 0.7120, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -13.33% (0.8321 => 0.7212, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -13.32% (0.8327 => 0.7218, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.13% (0.8528 => 0.7408, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.87% (0.8672 => 0.7556, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -12.83% (0.8600 => 0.7497, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -12.78% (0.8899 => 0.7762, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -12.77% (0.8603 => 0.7504, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -12.76% (0.8756 => 0.7639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.50% (0.8950 => 0.7831, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -12.21% (0.9055 => 0.7949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -12.18% (0.9330 => 0.8194, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -12.01% (0.9351 => 0.8228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -11.89% (0.9434 => 0.8312, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.67% (0.0874 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -11.47% (0.9767 => 0.8647, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -11.36% (0.9535 => 0.8452, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -11.25% (1.0106 => 0.8969, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.44% (0.7903 => 0.7552, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.24% (0.5924 => 0.5673, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.44% (0.4836 => 0.4718, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.01% (0.5565 => 0.5453, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -1.76% (5.1888 => 5.0974, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.75% (2.7532 => 2.7051, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.32% (2.1182 => 2.0903, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -1.31% (2.3990 => 2.3676, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.09% (5.0409 => 4.9859, std.dev.: 0.0120) MultiSource/Benchmarks/nbench/nbench: -1.07% (1.1546 => 1.1422, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: -3.15% (3.2897 => 3.1861, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.92% (0.8767 => 0.8599) SingleSource/Benchmarks/Linpack/linpack-pc: -1.74% (77.6902 => 76.3408, std.dev.: 0.0219) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.2926 => 7.1928, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.02% (3.7217 => 3.6837, std.dev.: 0.0011) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.85% (0.0717 => 0.1182, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.83% (0.0974 => 0.1547, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798) MultiSource/Benchmarks/FreeBench/neural/neural: 44.27% (0.1500 => 0.2164, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.04% (0.6395 => 0.8764, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.60% (0.1132 => 0.1535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.22% (0.6395 => 0.8647, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.24% (0.6260 => 0.8341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.00% (0.5688 => 0.7508, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.85% (0.5805 => 0.7654, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.52% (0.6230 => 0.8194, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.32% (0.5581 => 0.7329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.18% (0.5567 => 0.7303, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.85% (0.5941 => 0.7774, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.23% (0.5802 => 0.7556, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.06% (0.5849 => 0.7607, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.97% (0.5478 => 0.7120, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.85% (0.5705 => 0.7408, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.48% (0.5570 => 0.7212, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.47% (0.5569 => 0.7210, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.46% (0.6440 => 0.8337, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.42% (0.5859 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.10% (0.5591 => 0.7218, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.93% (0.5925 => 0.7639, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.21% (0.6189 => 0.7935, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.12% (0.5857 => 0.7504, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.10% (0.6676 => 0.8552, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.87% (0.5863 => 0.7497, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.65% (0.6446 => 0.8228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.88% (1.6474 => 2.0903, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.51% (0.6681 => 0.8452, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.43% (0.6194 => 0.7831, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.23% (0.6297 => 0.7949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.67% (0.6667 => 0.8312, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.21% (0.7339 => 0.8969, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.76% (2.2587 => 2.7051, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: 19.12% (0.3834 => 0.4567, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.55% (1.1450 => 1.3116, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 13.85% (0.3357 => 0.3822, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1081 => 0.1222, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.65% (0.1982 => 0.2213, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.6364 => 1.8163, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4916 => 0.5453, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.63% (4.5069 => 4.9859, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 10.52% (0.4515 => 0.4990, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.89% (3.5339 => 3.8835, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.7021 => 0.7552, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.05% (0.4524 => 0.4843, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: 6.66% (1.2515 => 1.3348, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5329 => 0.5673, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 5.90% (0.4861 => 0.5148, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (1.4642 => 1.5503, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 5.73% (9.2283 => 9.7570, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.2784 => 1.3507, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.70% (0.3255 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.3319 => 0.3443, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (5.4682 => 5.6211, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 1.49% (5.0226 => 5.0974, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.38% (0.8418 => 0.8534, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6633, std.dev.: 0.0173) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.24% (0.9531 => 1.0316, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4411, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1697, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.92% (54.5751 => 56.7171, std.dev.: 0.0858) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.0478 => 2.1101, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3136, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6018, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.13% (0.1281 => 0.1100, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.01% (2.4924 => 2.3676, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: -4.98% (0.3812 => 0.3622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.90% (0.3837 => 0.3649, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/exceptions-4: -4.87% (0.3880 => 0.3691, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.82% (0.9852 => 0.9377, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (0.3821 => 0.3637, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.79% (0.7198 => 0.6853, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.33% (0.3884 => 0.3716, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3142 => 0.3009, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.19% (0.4199 => 0.4023, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.18% (0.3016 => 0.2890, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.95% (0.4280 => 0.4111, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.90% (2.1713 => 2.0866, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.87% (0.3252 => 0.3126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.83% (0.3025 => 0.2909, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.83% (1.3148 => 1.2645, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.81% (0.9542 => 0.9178, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.75% (0.3658 => 0.3521, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -3.23% (0.6347 => 0.6142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.13% (0.4151 => 0.4021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.07% (0.3621 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.03% (0.3931 => 0.3812, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.01% (0.6441 => 0.6247, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.7919 => 0.7688, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.86% (0.3849 => 0.3739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.79% (20.7746 => 20.1947, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.75% (0.4321 => 0.4202, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.64% (17.1032 => 16.6517, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.48% (1.2210 => 1.1907, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: -2.47% (4.3330 => 4.2261, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8585, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6079, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: -2.31% (0.7779 => 0.7599, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -2.31% (16.1920 => 15.8179, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.31% (1.2221 => 1.1939, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -2.17% (7.0961 => 6.9423, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -2.06% (2.4021 => 2.3527, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.97% (0.8521 => 0.8353, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.94% (1.2300 => 1.2061, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -1.93% (0.9179 => 0.9002, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.85% (0.5999 => 0.5888, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.80% (34.0927 => 33.4788, std.dev.: 0.0250) MultiSource/Applications/lua/lua: -1.76% (4.0594 => 3.9881, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -1.63% (1.5610 => 1.5356, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -1.31% (15.2527 => 15.0523, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.28% (8.0126 => 7.9104, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -1.05% (2.1401 => 2.1176, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.82% (1.8100 => 0.6910, std.dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.76% (0.6962 => 0.3428, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -24.41% (1.3643 => 1.0313, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9944, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7561, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1260, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8044, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8970, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (7.9763 => 7.7258, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.53% (3.7241 => 3.6299, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.28% (1.3096 => 1.2798, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1928, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6580, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.8776 => 4.8141, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 17:26:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 19:26:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130110012628.BB7432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7448?compare_to=7443&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7448, Order: 171996, Start Time: 2013-01-09 21:51:37, End Time: 2013-01-10 01:26:26 To: 7443, Order: 171975, Start Time: 2013-01-09 17:19:26, End Time: 2013-01-09 20:53:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (181 on baseline) Performance Improvements: 1 (19 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.29% (2.8269 => 2.7904, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.53% (0.0475 => 0.0620, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.79% (0.2969 => 0.3794, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.61% (0.0714 => 0.0904, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.41% (0.4994 => 0.6313, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.93% (0.4253 => 0.5356, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.92% (0.4139 => 0.5212, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.83% (0.5900 => 0.7424, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.83% (0.1620 => 0.2006, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.48% (0.5000 => 0.6174, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 22.99% (1.5932 => 1.9594, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 21.94% (0.0948 => 0.1156, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.82% (0.1604 => 0.1954, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.06% (0.3903 => 0.4725, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654) MultiSource/Applications/viterbi/viterbi: 19.85% (0.0947 => 0.1135, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.49% (0.1088 => 0.1300, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.04% (0.4029 => 0.4796, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.90% (0.2736 => 0.3253, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.63% (0.2866 => 0.3400, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 18.09% (0.5546 => 0.6549, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.07% (0.3271 => 0.3862, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 18.02% (0.5826 => 0.6876, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.02% (1.3152 => 1.5522, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 17.94% (1.8794 => 2.2166, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.63% (0.4658 => 0.5479, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 17.61% (0.5889 => 0.6926, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.46% (3.5627 => 4.1847, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.39% (0.5026 => 0.5900, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.33% (0.1968 => 0.2309, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.25% (1.6211 => 1.9008, std.dev.: 0.0058) MultiSource/Applications/hbd/hbd: 17.16% (0.9697 => 1.1361, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 17.01% (0.7171 => 0.8391, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 17.01% (0.3004 => 0.3515, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 16.88% (0.2714 => 0.3172, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.73% (0.2725 => 0.3181, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.73% (0.2750 => 0.3210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.73% (0.2792 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.71% (0.2813 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.70% (0.2803 => 0.3271, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.69% (0.2738 => 0.3195, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 16.68% (0.2823 => 0.3294, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.58% (0.2811 => 0.3277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.57% (2.0673 => 2.4098, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.54% (4.4195 => 5.1503, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.49% (0.2729 => 0.3179, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.45% (0.2911 => 0.3390, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.38% (0.9909 => 1.1532, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.31% (0.3060 => 0.3559, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/matrix: 16.19% (0.2780 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (0.3930 => 0.4561, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.03% (0.3195 => 0.3707, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 15.99% (0.3096 => 0.3591, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.96% (0.4361 => 0.5057, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.89% (0.3845 => 0.4456, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.78% (0.3258 => 0.3772, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.76% (0.3267 => 0.3782, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.68% (0.3362 => 0.3889, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 15.57% (1.0781 => 1.2460, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.56% (1.9694 => 2.2758, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.46% (0.3124 => 0.3607, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.32% (23.5202 => 27.1241, std.dev.: 0.0277) MultiSource/Applications/ClamAV/clamscan: 15.25% (4.2109 => 4.8530, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.16% (1.9966 => 2.2993, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 15.15% (0.4146 => 0.4774, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 15.14% (0.3726 => 0.4290, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.09% (2.7292 => 3.1411, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 15.09% (0.3678 => 0.4233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 15.08% (0.3348 => 0.3853, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 15.07% (0.3477 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.99% (0.3282 => 0.3774, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.92% (0.3625 => 0.4166, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.66% (0.3690 => 0.4231, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.64% (0.3981 => 0.4564, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.56% (0.4251 => 0.4870, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.38% (1.4269 => 1.6321, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 14.30% (0.2566 => 0.2933, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 14.03% (0.5012 => 0.5715, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1028 => 0.1170, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 13.80% (0.3465 => 0.3943, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.78% (0.3446 => 0.3921, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.77% (0.3442 => 0.3916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.71% (0.6435 => 0.7317, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.67% (0.3460 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.64% (0.3496 => 0.3973, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.42% (0.3650 => 0.4140, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.40% (0.7875 => 0.8930, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3724 => 0.4218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.23% (0.3643 => 0.4125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.12% (0.2737 => 0.3096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 12.57% (5.5417 => 6.2383, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 12.50% (2.1653 => 2.4359, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 12.24% (0.2075 => 0.2329, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 12.16% (4.6177 => 5.1790, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 12.04% (2.1013 => 2.3543, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 11.85% (0.2691 => 0.3010, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.77% (0.3084 => 0.3447, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.49% (0.3498 => 0.3900, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 11.36% (0.3336 => 0.3715, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.36% (0.5361 => 0.5970, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.2103 => 0.2340, std.dev.: 0.0052) MultiSource/Applications/siod/siod: 11.18% (0.6634 => 0.7376, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.04% (11.6398 => 12.9250, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.62% (4.6926 => 5.1910, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 10.48% (0.4847 => 0.5355, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.30% (0.7426 => 0.8191, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.15% (0.2040 => 0.2247, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.40% (0.1383 => 0.1513, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.72% (0.5584 => 0.6071, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 8.11% (0.2391 => 0.2585, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 8.03% (2.0346 => 2.1980, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.90% (11.9555 => 12.9001, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5275, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 9.03% (0.2802 => 0.3055, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.61% (0.3693 => 0.3974, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 6.13% (0.2122 => 0.2252, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2426, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6832, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.95% (0.6276 => 0.6461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1968, std.dev.: 0.0415) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (2.0820 => 2.1216, std.dev.: 0.0128) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2094, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5400, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.10% (10.3705 => 10.4841, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5947, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5488, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.70% (17.2379 => 14.3600, std.dev.: 0.0815) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9770, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8046, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.45% (0.2402 => 0.2247, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2155, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7988, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1588, std.dev.: 0.0392) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4979, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1999, std.dev.: 0.0645) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0410, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 18:39:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 20:39:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110023948.A96882A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7449?compare_to=7447&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7449, Order: 172023, Start Time: 2013-01-10 01:06:16, End Time: 2013-01-10 02:39:47 To: 7447, Order: 172011, Start Time: 2013-01-09 23:08:58, End Time: 2013-01-10 00:42:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (93 on baseline) Performance Improvements: 1 (139 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.07% (0.6910 => 0.7122, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -14.04% (0.4567 => 0.3926, std.dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.57% (0.0717 => 0.1180, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.62% (0.0974 => 0.1545, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.00% (0.1500 => 0.2160, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.79% (0.6395 => 0.8748, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.26% (0.6395 => 0.8650, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.07% (0.1132 => 0.1529, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.19% (0.6260 => 0.8338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.82% (0.5456 => 0.7192, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.65% (0.5688 => 0.7488, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.59% (0.5805 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.56% (0.6230 => 0.8196, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.15% (0.5567 => 0.7301, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.01% (0.5575 => 0.7304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.00% (0.5581 => 0.7311, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.90% (0.5941 => 0.7777, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.05% (0.6033 => 0.7846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.99% (0.5802 => 0.7542, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.96% (0.5705 => 0.7414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.87% (0.5849 => 0.7596, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.77% (0.5478 => 0.7109, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.55% (0.5570 => 0.7216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.44% (0.6440 => 0.8336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.34% (0.5569 => 0.7203, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.19% (0.5591 => 0.7223, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.15% (0.5859 => 0.7567, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.73% (0.5925 => 0.7627, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.20% (0.6189 => 0.7934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.16% (0.6052 => 0.7756, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.07% (0.6676 => 0.8550, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.86% (0.5857 => 0.7489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.75% (0.6446 => 0.8235, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.63% (0.6304 => 0.8046, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.53% (0.5863 => 0.7477, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.71% (1.6474 => 2.0875, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.60% (0.6681 => 0.8458, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.35% (0.6194 => 0.7826, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.20% (0.6297 => 0.7947, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.81% (0.6660 => 0.8379, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.40% (0.6667 => 0.8294, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.93% (0.7524 => 0.9249, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.98% (0.7339 => 0.8952, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.62% (2.2587 => 2.7018, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.75% (0.1146 => 0.1315, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.20% (1.1450 => 1.3076, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 13.58% (0.3357 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.77% (0.1081 => 0.1219, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.91% (0.1982 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.66% (1.6364 => 1.8109, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.56% (0.4916 => 0.5435, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.46% (4.5069 => 4.9783, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 10.17% (0.4515 => 0.4974, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.81% (3.5339 => 3.8804, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.34% (0.2385 => 0.2584, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.35% (0.7021 => 0.7537, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4524 => 0.4827, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5329 => 0.5673, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.28% (1.2515 => 1.3301, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4861 => 0.5140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.55% (1.4642 => 1.5454, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 5.52% (9.2283 => 9.7376, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.41% (1.2784 => 1.3475, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.45% (0.3255 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3319 => 0.3434, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (5.4682 => 5.6151, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6750 => 0.6899, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.3864 => 1.4149, std.dev.: 0.0080) MultiSource/Applications/oggenc/oggenc: 1.80% (5.0226 => 5.1129, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.56% (31.3723 => 55.7047, std.dev.: 0.0224) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.59% (0.9531 => 1.0350, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4417, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1689, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5333, std.dev.: 0.0927) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1044, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.57% (0.6469 => 0.6635) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (27.8210 => 28.3119, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6058, std.dev.: 0.0108) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.29% (0.1281 => 0.1098, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.54% (0.3194 => 0.2985, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -5.75% (0.3812 => 0.3593, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.60% (0.3896 => 0.3678, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.58% (0.3891 => 0.3674, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.36% (0.4176 => 0.3952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -5.26% (2.4924 => 2.3613, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.11% (0.2428 => 0.2304, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.07% (0.3884 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.96% (0.9852 => 0.9363, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.81% (0.3323 => 0.3163, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.71% (0.3057 => 0.2913, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.67% (0.7198 => 0.6862, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.51% (0.3016 => 0.2880, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.46% (0.3142 => 0.3002, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.33% (0.3025 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.33% (0.2933 => 0.2806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.32% (0.2939 => 0.2812, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.25% (0.2849 => 0.2728, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.18% (2.1713 => 2.0805, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.07% (0.3658 => 0.3509, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.03% (1.3148 => 1.2618, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.97% (0.9542 => 0.9163, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.70% (0.6441 => 0.6203, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.64% (0.4151 => 0.4000, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.58% (0.6484 => 0.6252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.45% (0.3621 => 0.3496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.36% (0.3931 => 0.3799, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.23% (0.7779 => 0.7528, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.13% (0.7919 => 0.7671, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.04% (0.3849 => 0.3732, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -2.98% (4.3330 => 4.2039, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.84% (14.2083 => 13.8041, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/sieve: -2.82% (0.3788 => 0.3681, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.81% (6.7716 => 6.5814, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -2.77% (20.7746 => 20.1992, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -2.77% (17.1032 => 16.6300, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: -2.68% (0.4248 => 0.4134, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.55% (1.2210 => 1.1899, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -2.49% (7.0961 => 6.9196, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.47% (0.4083 => 0.3982, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7933, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.42% (1.2300 => 1.2002, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.41% (1.2221 => 1.1927, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.39% (1.0544 => 1.0292, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -2.37% (2.4021 => 2.3452, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -2.22% (0.9179 => 0.8975, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -2.20% (0.7982 => 0.7806, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.18% (0.4813 => 0.4708, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8521 => 0.8352, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -1.97% (4.0594 => 3.9796, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.92% (34.0927 => 33.4390, std.dev.: 0.0142) MultiSource/Applications/hbd/hbd: -1.77% (1.5610 => 1.5334, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.58% (8.0126 => 7.8863, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.45% (0.9077 => 0.8945, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: -1.37% (15.2527 => 15.0437, std.dev.: 0.0158) MultiSource/Benchmarks/nbench/nbench: -1.18% (1.1530 => 1.1394, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -1.14% (18.2933 => 18.0844, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.06% (4.8802 => 4.8287, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.65% (1.8100 => 0.7122, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.07% (1.3643 => 1.0223, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9931, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.77% (4.1024 => 3.2093, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.33% (2.5106 => 2.1258, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1702, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8974, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.10% (2.2633 => 2.1706, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (7.9763 => 7.7295, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.71% (3.7241 => 3.6230, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1924, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4760, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.44% (4.8776 => 4.8073, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6307 => 1.6097, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6025, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (3.7092 => 3.6671, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 19:21:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 21:21:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110032135.9AE1C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7450?compare_to=7446&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7450, Order: 172023, Start Time: 2013-01-10 01:11:05, End Time: 2013-01-10 03:21:33 To: 7446, Order: 172005, Start Time: 2013-01-09 22:29:13, End Time: 2013-01-10 00:40:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 15 (216 on baseline) Performance Improvements: 46 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1039 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (10.9613 => 11.2202, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 1.85% (0.5607 => 0.5711, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 1.07% (1.3212 => 1.3353, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.02% (1.7309 => 1.7486, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (3.1599 => 3.3116, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: 3.31% (1.0173 => 1.0510) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.36% (4.3111 => 4.4127, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.05% (4.1967 => 4.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.85% (1.0178 => 1.0366, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.80% (3.0931 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.61% (4.1059 => 4.1718, std.dev.: 0.0010) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.55% (4.4842 => 4.5539, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.54% (2.0518 => 2.0834, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.14% (2.2984 => 2.3245, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 1.01% (11.0610 => 11.1729, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -30.59% (1.1860 => 0.8232, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -30.25% (1.2029 => 0.8390, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -30.22% (1.0094 => 0.7044, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -30.19% (1.2000 => 0.8377, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -30.17% (1.1983 => 0.8368, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -29.75% (1.0221 => 0.7180, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -29.65% (1.2387 => 0.8714, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -29.58% (1.0210 => 0.7190, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -29.54% (1.0235 => 0.7212, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -29.48% (1.2415 => 0.8755, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -29.38% (1.2333 => 0.8709, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -29.18% (1.2429 => 0.8802, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -29.16% (1.2711 => 0.9004, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -28.96% (1.2549 => 0.8915, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -28.69% (1.0663 => 0.7604, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -28.67% (1.2733 => 0.9082, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -28.62% (1.0588 => 0.7558, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -28.58% (1.0548 => 0.7533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -28.56% (1.0621 => 0.7588, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -28.30% (1.2839 => 0.9205, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -28.30% (1.0900 => 0.7815, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -28.15% (1.0805 => 0.7763, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -27.92% (1.0959 => 0.7899, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -27.60% (1.3203 => 0.9559, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -27.59% (1.1062 => 0.8010, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -27.58% (1.3186 => 0.9549, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -27.33% (1.3347 => 0.9699, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -26.99% (1.3516 => 0.9868, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -26.85% (1.3740 => 1.0051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -26.76% (1.1351 => 0.8313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -26.50% (1.1387 => 0.8370, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -26.32% (1.1549 => 0.8509, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -26.11% (1.1700 => 0.8645, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -25.53% (1.4296 => 1.0646, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -25.46% (1.1896 => 0.8867, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -24.74% (1.2262 => 0.9228, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -13.03% (0.1005 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -8.60% (0.7081 => 0.6472, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.70% (0.2640 => 0.2463, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.76% (0.8894 => 0.8560, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.08% (0.5346 => 0.5235, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -1.10% (1.4028 => 1.3873, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: -2.93% (77.8404 => 75.5585, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -1.93% (1.4648 => 1.4366, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.35% (3.7757 => 3.7249, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.21% (0.8673 => 0.8568, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.22% (0.1337 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.80% (0.0667 => 0.0655, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7971 => 499.8480, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.55% (1.1277 => 499.8480, std.dev.: 0.0046) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.36% (0.5229 => 1.6438, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 19.40% (14.9895 => 17.8977, std.dev.: 0.0076) MultiSource/Applications/kimwitu++/kc: 43.49% (14.1553 => 20.3111, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 17.33% (4.1105 => 4.8230, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.56% (1.1048 => 1.7407, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.08% (7.1582 => 37.5866, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.02% (3.4629 => 6.4069, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.38% (0.6222 => 1.0850, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10252.64% (0.0720 => 7.4539, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11172800.00% (0.0001 => 11.1729, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490500.00% (0.0001 => 5.4906, std.dev.: 0.0157) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.92% (1.1194 => 10.2864, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 147.41% (22.1758 => 54.8645, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.64% (0.0929 => 0.1771, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.47% (0.1463 => 0.2494, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.46% (2.9384 => 4.6267, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.37% (7.0540 => 10.9596, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.67% (1.5859 => 2.3895, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 47.97% (0.0296 => 0.0438, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.93% (8.1363 => 11.9548, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/almabench: 41.23% (0.0730 => 0.1031, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.79% (2.2024 => 3.1008, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 40.20% (21.9371 => 30.7564, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 39.18% (0.3109 => 0.4327, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0022) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.12% (1.5415 => 2.0520, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.07% (4.2646 => 5.6748, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.20% (0.4615 => 0.6101, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.18% (0.1892 => 0.2463, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.59% (0.4299 => 0.5571, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.2271 => 0.2939, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 28.64% (1.1642 => 1.4976, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.24% (0.6675 => 0.8560, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.78% (0.5105 => 0.6472, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.46% (3.8922 => 4.8833, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 25.36% (0.1175 => 0.1473, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.28% (0.1143 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.18% (0.2554 => 0.3197, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.07% (0.1125 => 0.1407, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.54% (1.0722 => 1.3353, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 24.06% (0.4289 => 0.5321, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.71% (0.3121 => 0.3861, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 23.61% (0.4620 => 0.5711, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.26% (1.4186 => 1.7486, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.26% (0.1337 => 0.1648, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.61% (9.4845 => 11.6290, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.42% (0.1695 => 0.2075, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 21.69% (0.3098 => 0.3770, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.63% (0.2700 => 0.3284, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.52% (0.7115 => 0.8646, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.31% (0.6456 => 0.7767, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.31% (1.3050 => 1.5700, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.31% (5.7591 => 6.9285, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.20% (0.7835 => 0.9418, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.60% (0.1163 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.59% (4.9449 => 5.9134, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 19.20% (0.1151 => 0.1372, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.11% (0.8172 => 0.9734, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.07% (0.1940 => 0.2310, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 18.75% (3.3354 => 3.9607, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.73% (5.0018 => 5.9386, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.79% (0.5020 => 0.5913, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.57% (0.3307 => 0.3888, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.55% (0.2758 => 0.3242, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.46% (0.7433 => 0.8731, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.20% (0.9765 => 1.1445, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.17% (1.1840 => 1.3873, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.02% (0.5569 => 0.6517, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.3423 => 0.4001, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.63% (3.8723 => 4.5161, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.52% (0.5981 => 0.6969, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 16.46% (2.0273 => 2.3610, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 16.43% (0.3232 => 0.3763, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.76% (0.8101 => 0.9378, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.63% (0.3441 => 0.3979, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 15.63% (2.2969 => 2.6559, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.47% (0.6450 => 0.7448, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942) MultiSource/Benchmarks/McCat/09-vor/vor: 14.84% (0.3180 => 0.3652, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 14.69% (0.2049 => 0.2350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.64% (0.8921 => 1.0227, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.48% (1.1861 => 1.3579, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3379 => 0.3860, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.71% (0.8067 => 0.9173, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3865 => 0.4394, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.61% (1.5603 => 1.7727, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.41% (0.2603 => 0.2952, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.01% (0.4103 => 0.4637, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.92% (0.4636 => 0.5235, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 12.78% (0.3387 => 0.3820, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3927 => 0.4407, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.03% (0.4048 => 0.4535, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.96% (0.3603 => 0.4034, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.72% (0.3422 => 0.3823, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.70% (0.3282 => 0.3666, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.64% (0.3684 => 0.4113, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1268 => 0.1414, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.32% (17.1811 => 19.1257, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 11.15% (0.3516 => 0.3908, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.64% (14.3668 => 15.8957, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.58% (0.4064 => 0.4494, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.36% (0.3427 => 0.3782, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.64% (2.0665 => 2.2657, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.42% (0.2877 => 0.3148, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.6030 => 0.6597, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2891 => 0.3159, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.10% (0.2802 => 0.3057, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: 9.08% (0.3052 => 0.3329, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5925 => 0.6461, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.01% (1.2842 => 1.3999, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2756 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.98% (0.3162 => 0.3446, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.88% (0.3650 => 0.3974, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2905 => 0.3162, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7326 => 0.7974, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 8.84% (0.2725 => 0.2966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.77% (0.2793 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.39% (0.3935 => 0.4265, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 8.23% (10.3673 => 11.2202, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.10% (0.3136 => 0.3390, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.10% (63.2438 => 68.3638, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3722, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.3131 => 0.3263, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.63% (7.9617 => 8.1714, std.dev.: 0.0184) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.27% (32.5116 => 59.2581, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/oourafft: 15.77% (6.6465 => 7.6949, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4258, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4542, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.11% (0.9957 => 1.0366, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9160, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.35% (3.6395 => 3.7249, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.77% (9.1159 => 9.2771, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (0.6533 => 0.6644, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1616, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.64% (5.2763 => 1.1796, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.64% (0.8651 => 0.2107, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.25% (5.3855 => 4.4564, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.63% (5.3526 => 4.4624, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -13.63% (10.4361 => 9.0132, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.22% (1.7609 => 1.6161, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9636, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.20% (1.9577 => 0.6617, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.12% (8.0499 => 5.3035, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.30% (1.1492 => 0.7665, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4249, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7534, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0047, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.69% (1.6925 => 1.4269, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7332, std.dev.: 0.0031) MultiSource/Benchmarks/NPB-serial/is/is: -10.95% (9.5636 => 8.5160, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2747, std.dev.: 0.0226) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2373 => 1.1659, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.65% (8.1563 => 7.7769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8331, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.35% (0.4808 => 0.4599, std.dev.: 0.0019) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.91% (3.7221 => 3.6509, std.dev.: 0.0157) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2345, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0002) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 20:37:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 22:37:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110043705.3C08B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7451?compare_to=7449&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7451, Order: 172037, Start Time: 2013-01-10 03:03:25, End Time: 2013-01-10 04:37:04 To: 7449, Order: 172023, Start Time: 2013-01-10 01:06:16, End Time: 2013-01-10 02:39:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (94 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (871 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.67% (78.0489 => 80.1360, std.dev.: 0.5482) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.30% (0.0717 => 0.1178, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.62% (0.0974 => 0.1545, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796) MultiSource/Benchmarks/FreeBench/neural/neural: 44.00% (0.1500 => 0.2160, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.65% (0.6395 => 0.8739, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.42% (0.1132 => 0.1533, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.84% (0.6395 => 0.8623, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.73% (0.6260 => 0.8309, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.49% (0.5688 => 0.7479, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.37% (0.5805 => 0.7626, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.14% (0.6230 => 0.8170, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.81% (0.5567 => 0.7282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.73% (0.5581 => 0.7296, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.69% (0.5575 => 0.7286, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.50% (0.5941 => 0.7753, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.75% (0.6033 => 0.7828, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.63% (0.5802 => 0.7521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.48% (0.5849 => 0.7573, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.47% (0.5705 => 0.7386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.45% (0.5478 => 0.7091, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.30% (0.5570 => 0.7202, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.10% (0.5859 => 0.7564, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.02% (0.5569 => 0.7185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.98% (0.6440 => 0.8306, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.81% (0.5591 => 0.7202, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.51% (0.5925 => 0.7614, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.92% (0.5857 => 0.7492, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.81% (0.6189 => 0.7910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.66% (0.6052 => 0.7726, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.64% (0.6676 => 0.8521, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.51% (0.0418 => 0.0533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.27% (0.6446 => 0.8204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.20% (0.6304 => 0.8019, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.19% (0.5863 => 0.7457, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.74% (1.6474 => 2.0879, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.30% (0.6681 => 0.8438, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.14% (0.6194 => 0.7813, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.44% (0.6297 => 0.7899, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.38% (0.6660 => 0.8350, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.00% (0.6667 => 0.8267, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.59% (0.7524 => 0.9224, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.94% (0.7339 => 0.8949, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.54% (2.2587 => 2.7001, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.28% (1.1450 => 1.3085, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 13.35% (0.3357 => 0.3805, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.91% (0.1982 => 0.2218, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.13% (0.4916 => 0.5463, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.88% (1.6364 => 1.8145, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 10.65% (0.4515 => 0.4996, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.64% (0.3834 => 0.4242, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.36% (4.5069 => 4.9738, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.81% (3.5339 => 3.8806, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2385 => 0.2588, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.7021 => 0.7544, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.87% (0.4524 => 0.4835, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.32% (0.5329 => 0.5666, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.29% (1.2515 => 1.3302, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: 6.23% (0.4861 => 0.5164, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.62% (1.4642 => 1.5465, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 5.59% (9.2283 => 9.7441, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/matrix: 5.44% (0.3255 => 0.3432, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.35% (1.2784 => 1.3468, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.34% (0.3319 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (5.4682 => 5.6168, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.6750 => 0.6930, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.82% (1.3864 => 1.4116, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.60% (5.0226 => 5.1029, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.37% (31.3723 => 55.6462, std.dev.: 0.0475) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4407, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1696, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4520, std.dev.: 0.1262) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (27.8210 => 28.3120, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6047, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3489 => 10.4598, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.13% (0.1281 => 0.1100, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.44% (2.4924 => 2.3569, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: -5.25% (0.3812 => 0.3612, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3821 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.11% (0.9852 => 0.9349, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.03% (0.3896 => 0.3700, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.91% (0.4176 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.84% (0.4033 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.61% (0.3142 => 0.2997, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.52% (0.4199 => 0.4009, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.27% (0.7198 => 0.6891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.21% (0.4280 => 0.4100, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.16% (0.9542 => 0.9145, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.05% (0.3658 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.51% (0.3016 => 0.2910, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -3.47% (1.3148 => 1.2692, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.42% (0.6484 => 0.6262, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.40% (0.3057 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.39% (2.1713 => 2.0978, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -3.34% (0.3025 => 0.2924, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -3.31% (0.3205 => 0.3099, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.26% (0.3252 => 0.3146, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.21% (0.6347 => 0.6143, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.04% (0.7919 => 0.7678, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -3.00% (0.6441 => 0.6248, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.96% (0.4151 => 0.4028, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -2.80% (4.3330 => 4.2115, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: -2.77% (17.1032 => 16.6302, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.60% (14.2083 => 13.8382, std.dev.: 0.0179) MultiSource/Applications/lambda-0_1_3/lambda: -2.58% (0.7982 => 0.7776, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.57% (1.2210 => 1.1896, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.56% (6.7716 => 6.5985, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.55% (1.2221 => 1.1909, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -2.44% (7.0961 => 6.9233, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: -2.42% (16.1920 => 15.8004, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: -2.40% (0.7779 => 0.7592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.40% (1.0544 => 1.0291, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.38% (1.2300 => 1.2007, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2804, std.dev.: 0.0367) MultiSource/Applications/siod/siod: -2.34% (2.4021 => 2.3460, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.26% (0.4427 => 0.4327, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.05% (0.5999 => 0.5876, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -2.05% (0.9179 => 0.8991, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -2.02% (4.0594 => 3.9776, std.dev.: 0.0119) MultiSource/Benchmarks/Bullet/bullet: -1.86% (34.0927 => 33.4574, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.78% (0.8521 => 0.8369, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.52% (1.5610 => 1.5372, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.37% (8.0126 => 7.9027, std.dev.: 0.0044) MultiSource/Applications/ClamAV/clamscan: -1.33% (15.2527 => 15.0498, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: -1.29% (2.1401 => 2.1124, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.26% (0.9077 => 0.8963, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: -1.15% (1.1530 => 1.1397, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -1.13% (18.2933 => 18.0872, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.00% (4.8802 => 4.8313, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.17% (1.8100 => 0.6848, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9931, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.36% (2.5106 => 2.1250, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1032, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3398, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8974, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (7.9763 => 7.7272, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.58% (3.7241 => 3.6279, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.48% (4.8776 => 4.8053, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1965, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6010, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6114, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6655, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 21:59:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 9 Jan 2013 23:59:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130110055901.DD1E92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7452?compare_to=7448&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7452, Order: 172027, Start Time: 2013-01-10 02:23:18, End Time: 2013-01-10 05:58:59 To: 7448, Order: 171996, Start Time: 2013-01-09 21:51:37, End Time: 2013-01-10 01:26:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.23% (0.8391 => 0.8494, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 1.15% (27.1241 => 27.4352, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.59% (0.3974 => 0.4077, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.42% (0.0452 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.92% (0.2969 => 0.3798, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.89% (0.4253 => 0.5439, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.39% (0.4994 => 0.6312, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.24% (0.4139 => 0.5225, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.93% (0.5900 => 0.7430, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.77% (0.0714 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.07% (0.1620 => 0.2010, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.62% (0.5000 => 0.6181, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.24% (1.5932 => 1.9635, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 22.05% (0.0948 => 0.1157, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.45% (0.3903 => 0.4740, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.37% (0.1549 => 0.1880, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.32% (0.1604 => 0.1946, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 21.06% (0.1619 => 0.1960, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 19.72% (0.5826 => 0.6975, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.70% (0.1462 => 0.1750, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 19.51% (0.4029 => 0.4815, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.36% (0.2866 => 0.3421, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.1088 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.18% (0.3890 => 0.4636, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 19.17% (0.5889 => 0.7018, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.76% (1.3152 => 1.5619, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.67% (0.1505 => 0.1786, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 18.45% (0.7171 => 0.8494, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.36% (0.5546 => 0.6564, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 18.09% (1.8794 => 2.2194, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.93% (0.2738 => 0.3229, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.91% (0.2875 => 0.3390, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.89% (0.5026 => 0.5925, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 17.75% (0.9697 => 1.1418, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 17.74% (0.3004 => 0.3537, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.73% (0.3271 => 0.3851, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.48% (1.6211 => 1.9044, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.46% (3.5627 => 4.1849, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.43% (0.4658 => 0.5470, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.38% (0.2911 => 0.3417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 17.37% (0.2803 => 0.3290, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 17.36% (0.2823 => 0.3313, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.33% (0.1968 => 0.2309, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.30% (0.2792 => 0.3275, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.30% (0.2729 => 0.3201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.25% (0.2725 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2813 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.22% (0.2811 => 0.3295, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 17.21% (0.9909 => 1.1614, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.08% (2.0673 => 2.4204, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.82% (4.4195 => 5.1627, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.71% (0.3195 => 0.3729, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.69% (0.3362 => 0.3923, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 16.65% (23.5202 => 27.4352, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wc: 16.63% (0.3096 => 0.3611, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.41% (0.3267 => 0.3803, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.41% (0.3060 => 0.3562, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 16.39% (0.3258 => 0.3792, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 16.33% (0.1421 => 0.1653, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.28% (0.3845 => 0.4471, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.23% (0.4361 => 0.5069, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 16.13% (0.3317 => 0.3852, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.10% (0.3124 => 0.3627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.82% (0.3678 => 0.4260, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: 15.79% (1.0781 => 1.2483, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 15.78% (0.3726 => 0.4314, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.77% (0.3348 => 0.3876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.61% (0.4146 => 0.4793, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.60% (1.9694 => 2.2767, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.60% (0.3282 => 0.3794, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 15.56% (0.3477 => 0.4018, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.55% (1.9966 => 2.3071, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.52% (2.7292 => 3.1529, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.42% (0.3625 => 0.4184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.27% (0.3981 => 0.4589, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.25% (4.2109 => 4.8531, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.23% (0.3690 => 0.4252, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash2: 14.94% (0.4251 => 0.4886, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 14.68% (0.5012 => 0.5748, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 14.63% (1.4269 => 1.6356, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 14.30% (0.2566 => 0.2933, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.23% (0.3465 => 0.3958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.22% (0.3488 => 0.3984, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.13% (0.3496 => 0.3990, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 14.10% (0.3469 => 0.3958, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.05% (0.6435 => 0.7339, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/exceptions: 13.78% (0.3643 => 0.4145, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.75% (0.3650 => 0.4152, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.51% (0.7875 => 0.8939, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.45% (0.2737 => 0.3105, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 12.48% (0.2075 => 0.2334, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2328, std.dev.: 0.0135) MultiSource/Applications/JM/ldecod/ldecod: 12.46% (2.1653 => 2.4351, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 12.34% (4.6177 => 5.1876, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 12.11% (0.2691 => 0.3017, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.3084 => 0.3456, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.02% (2.1013 => 2.3538, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.81% (0.3498 => 0.3911, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 11.33% (0.3336 => 0.3714, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.2103 => 0.2340, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.03% (0.6634 => 0.7366, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.99% (0.5361 => 0.5950, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.68% (11.6398 => 12.8833, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.59% (0.2040 => 0.2256, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.43% (4.6926 => 5.1819, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.92% (0.7426 => 0.8163, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.27% (0.5584 => 0.6046, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.20% (0.2391 => 0.2587, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.06% (11.9555 => 12.9188, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 7.84% (2.0346 => 2.1942, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.88% (0.3792 => 0.3977, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5249, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (0.3693 => 0.4077, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.21% (0.2802 => 0.3060, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.55% (0.2122 => 0.2261, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2398, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6690, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6862, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1941, std.dev.: 0.0614) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2902, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3079, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.36% (1.0142 => 1.0280, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.19% (3.1722 => 3.2098, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4826, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5760, std.dev.: 0.0162) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.13% (17.2379 => 14.2843, std.dev.: 0.0324) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7847, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: -6.83% (0.2402 => 0.2238, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -4.53% (14.0481 => 13.4117, std.dev.: 0.0598) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2153, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8006, std.dev.: 0.0133) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.70% (0.6293 => 0.6123, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1637, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1526, std.dev.: 0.0550) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0458, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 22:02:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 00:02:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110060238.81F1B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7453?compare_to=7450&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7453, Order: 172037, Start Time: 2013-01-10 03:52:00, End Time: 2013-01-10 06:02:37 To: 7450, Order: 172023, Start Time: 2013-01-10 01:11:05, End Time: 2013-01-10 03:21:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (218 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ClamAV/clamscan: 1.21% (54.8645 => 55.5265, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: 1.16% (11.2202 => 11.3503, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.12% (3.6259 => 3.6664, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1340 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0655 => 0.0654, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8480 => 499.8167, std.dev.: 0.0216) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44221.78% (1.1277 => 499.8167, std.dev.: 0.0216) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.70% (0.5229 => 1.6508, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 19.70% (14.9895 => 17.9425, std.dev.: 0.0192) MultiSource/Applications/kimwitu++/kc: 43.78% (14.1553 => 20.3522, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 17.49% (4.1105 => 4.8296, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.07% (1.1048 => 1.7464, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.29% (7.1582 => 37.6012, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.95% (3.4629 => 6.4047, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.41% (0.6222 => 1.0852, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10253.75% (0.0720 => 7.4547, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11177900.00% (0.0001 => 11.1780, std.dev.: 0.0413) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484600.00% (0.0001 => 5.4847, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.16% (1.1194 => 10.3339, std.dev.: 0.0393) MultiSource/Applications/ClamAV/clamscan: 150.39% (22.1758 => 55.5265, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.17% (0.0929 => 0.1776, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0243 => 0.0459) MultiSource/Benchmarks/FreeBench/neural/neural: 71.22% (0.1463 => 0.2505, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.89% (2.9384 => 4.6393, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.44% (7.0540 => 10.9650, std.dev.: 0.0079) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.68% (1.5859 => 2.3897, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 47.97% (0.0296 => 0.0438, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.24% (8.1363 => 11.9802, std.dev.: 0.0084) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.99% (2.2024 => 3.1051, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 40.18% (21.9371 => 30.7506, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/flops: 40.15% (0.1432 => 0.2007, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.56% (0.3109 => 0.4339, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.77% (1.5415 => 2.0621, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.28% (4.2646 => 5.6839, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.24% (0.4615 => 0.6103, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1892 => 0.2474, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.59% (0.2271 => 0.2943, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 29.43% (0.4299 => 0.5564, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 28.84% (1.1642 => 1.4999, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.46% (0.6675 => 0.8575, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.91% (0.5105 => 0.6479, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 26.70% (0.0719 => 0.0911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.82% (3.8922 => 4.8972, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 25.74% (0.1655 => 0.2081, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 25.61% (0.2554 => 0.3208, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409) MultiSource/Applications/lemon/lemon: 24.77% (1.0722 => 1.3378, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.01% (0.1337 => 0.1658, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 23.94% (0.4289 => 0.5316, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.66% (1.4186 => 1.7543, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.49% (0.3121 => 0.3854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.29% (0.4620 => 0.5696, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.89% (0.2700 => 0.3318, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 22.86% (9.4845 => 11.6531, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.54% (0.1695 => 0.2077, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.73% (0.7115 => 0.8661, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.26% (0.0842 => 0.1021, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.66% (5.7591 => 6.9492, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.41% (1.3050 => 1.5714, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 20.28% (0.7835 => 0.9424, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 20.18% (0.6456 => 0.7759, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.61% (4.9449 => 5.9144, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.5860 => 0.7008, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.44% (0.8172 => 0.9761, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0886 => 0.1058, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 19.39% (3.3354 => 3.9820, std.dev.: 0.0148) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.02% (0.1940 => 0.2309, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.81% (5.0018 => 5.9427, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.15% (0.5020 => 0.5931, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.93% (0.7433 => 0.8766, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.81% (0.3307 => 0.3896, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.59% (0.2758 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.48% (1.1840 => 1.3910, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.43% (0.9765 => 1.1467, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.3423 => 0.4013, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.09% (0.5569 => 0.6521, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.90% (3.8723 => 4.5268, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.79% (2.0273 => 2.3676, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.70% (0.5981 => 0.6980, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.33% (0.3283 => 0.3819, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.04% (2.2969 => 2.6654, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.00% (0.8101 => 0.9397, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 15.93% (0.3232 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.74% (0.6450 => 0.7465, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.31% (0.3180 => 0.3667, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 14.98% (0.2049 => 0.2356, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.93% (0.8921 => 1.0253, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.65% (1.1861 => 1.3599, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.03% (0.3379 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.96% (0.8067 => 0.9193, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.35% (0.3865 => 0.4381, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.16% (1.5603 => 1.7656, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 12.93% (0.3387 => 0.3825, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.83% (0.4636 => 0.5231, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.70% (0.4103 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.30% (0.4203 => 0.4720, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 11.87% (0.3927 => 0.4393, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.81% (0.4048 => 0.4526, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.74% (0.3603 => 0.4026, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.65% (17.1811 => 19.1821, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/lists1: 11.51% (0.3684 => 0.4108, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: 11.46% (0.3422 => 0.3814, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.13% (0.3826 => 0.4252, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.10% (14.3668 => 15.9611, std.dev.: 0.0109) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.45% (0.3473 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.4064 => 0.4485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (2.0665 => 2.2637, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 9.48% (10.3673 => 11.3503, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/except: 9.33% (0.2871 => 0.3139, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.30% (0.6030 => 0.6591, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.08% (0.5925 => 0.6463, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7326 => 0.7987, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.01% (0.3650 => 0.3979, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.88% (0.2905 => 0.3163, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.73% (1.2842 => 1.3963, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.57% (0.3162 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.42% (0.2756 => 0.2988, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (0.3935 => 0.4257, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 8.04% (63.2438 => 68.3279, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.04% (0.3136 => 0.3388, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.60% (2.2022 => 2.3695, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.41% (0.2266 => 0.2366, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.3131 => 0.3251, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.86% (7.9617 => 8.1895, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2496, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.14% (1.1396 => 1.2438, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4543, std.dev.: 0.0086) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9187, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.08% (9.1159 => 9.3051, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7146, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (27.8444 => 28.1598, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4588, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5742, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.50% (5.2763 => 1.1874, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.76% (5.3855 => 4.4831, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.69% (5.3526 => 4.4593, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -13.32% (10.4361 => 9.0462, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.82% (1.7609 => 1.6232, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.70% (54.1659 => 49.9953, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.67% (1.9577 => 0.6525, std.dev.: 0.0083) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4350, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7534, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0038, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -10.92% (9.5636 => 8.5193, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.60% (19.9488 => 18.2339, std.dev.: 0.0336) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.82% (1.2373 => 1.1653, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.19% (8.1563 => 7.7332, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8173, std.dev.: 0.0204) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.84% (5.0483 => 4.9556, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -1.59% (3.7221 => 3.6630, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0011) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 9 23:29:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 01:29:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110072932.9446A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7454?compare_to=7451&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7454, Order: 172044, Start Time: 2013-01-10 05:55:42, End Time: 2013-01-10 07:29:31 To: 7451, Order: 172037, Start Time: 2013-01-10 03:03:25, End Time: 2013-01-10 04:37:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (121 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.57% (0.0717 => 0.1180, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.52% (0.0974 => 0.1544, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.07% (0.1500 => 0.2161) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.67% (0.6395 => 0.8740, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.34% (0.1132 => 0.1532, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.81% (0.6395 => 0.8621, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.78% (0.6260 => 0.8312, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.47% (0.5688 => 0.7478, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.24% (0.6230 => 0.8176, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.21% (0.5805 => 0.7617, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.75% (0.5581 => 0.7297, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.73% (0.5575 => 0.7288, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.72% (0.5567 => 0.7277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.50% (0.5941 => 0.7753, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.65% (0.6033 => 0.7822, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.63% (0.5802 => 0.7521, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.61% (0.5705 => 0.7394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.48% (0.5849 => 0.7573, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.37% (0.5478 => 0.7087, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.28% (0.5570 => 0.7201, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.03% (0.5591 => 0.7214, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.02% (0.5569 => 0.7185, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.01% (0.6440 => 0.8308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.98% (0.5859 => 0.7557, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.68% (0.5925 => 0.7624, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.74% (0.6189 => 0.7906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.61% (0.5857 => 0.7474, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.59% (0.6052 => 0.7722, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.52% (0.6676 => 0.8513, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.47% (0.6446 => 0.8217, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.20% (0.6304 => 0.8019, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.20% (0.5863 => 0.7458, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.70% (1.6474 => 2.0872, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.13% (0.6681 => 0.8427, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.94% (0.6194 => 0.7801, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.74% (0.6660 => 0.8374, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.47% (0.6297 => 0.7901, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.91% (0.6667 => 0.8261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.69% (0.7524 => 0.9231, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.88% (0.7339 => 0.8945, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.51% (2.2587 => 2.6994, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.13% (0.0622 => 0.0741, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.20% (1.1450 => 1.3076, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3357 => 0.3833, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.44% (0.3834 => 0.4311, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.91% (0.1982 => 0.2218, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.11% (0.4916 => 0.5462, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.88% (1.6364 => 1.8145, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.32% (4.5069 => 4.9719, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 10.12% (0.4515 => 0.4972, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.76% (3.5339 => 3.8789, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2385 => 0.2588, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.7021 => 0.7542, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.85% (0.2001 => 0.2138, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.76% (0.4524 => 0.4830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.32% (0.4861 => 0.5168, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.5329 => 0.5664, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 6.10% (1.2515 => 1.3279, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.69% (1.4642 => 1.5475, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.55% (9.2283 => 9.7407, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 5.38% (0.3255 => 0.3430, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.37% (1.2784 => 1.3470, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.34% (0.3319 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (5.4682 => 5.6210, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 1.74% (1.3864 => 1.4105, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 1.57% (5.0226 => 5.1016, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.27% (0.8418 => 0.8525, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.35% (31.3723 => 55.6394, std.dev.: 0.0283) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9531 => 1.0272, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4409, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1680, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5011, std.dev.: 0.0776) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.81% (2.0478 => 2.1053, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3128, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.21% (0.1281 => 0.1099, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.47% (2.4924 => 2.3560, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.25% (0.3812 => 0.3612, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.23% (0.9852 => 0.9337, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3821 => 0.3623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.15% (0.3880 => 0.3680, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.07% (0.3848 => 0.3653, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.06% (0.3896 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.96% (0.3891 => 0.3698, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.84% (0.4176 => 0.3974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.58% (0.3142 => 0.2998, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -4.50% (0.4199 => 0.4010, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.39% (0.7198 => 0.6882, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.16% (0.9542 => 0.9145, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -4.16% (0.4280 => 0.4102, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.97% (0.3323 => 0.3191, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.94% (0.3658 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.52% (0.6484 => 0.6256, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -3.45% (1.3148 => 1.2694, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.40% (0.3057 => 0.2953, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.33% (2.1713 => 2.0990, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.29% (0.3252 => 0.3145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.27% (0.7919 => 0.7660, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -3.27% (0.3059 => 0.2959, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.21% (0.6347 => 0.6143, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.98% (0.6441 => 0.6249, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.96% (0.4151 => 0.4028, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.80% (17.1032 => 16.6250, std.dev.: 0.0181) MultiSource/Applications/lambda-0_1_3/lambda: -2.78% (0.7982 => 0.7760, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -2.73% (4.3330 => 4.2149, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.68% (6.7716 => 6.5902, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.67% (0.3931 => 0.3826, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.65% (1.2210 => 1.1886, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.64% (14.2083 => 13.8334, std.dev.: 0.0149) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2496, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.50% (1.2221 => 1.1916, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7937, std.dev.: 0.0175) SingleSource/UnitTests/ObjC++/property-reference: -2.42% (0.7779 => 0.7591, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.41% (1.0544 => 1.0290, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -2.41% (7.0961 => 6.9252, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.37% (1.2300 => 1.2009, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -2.35% (2.4021 => 2.3457, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -2.11% (0.9179 => 0.8985, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.08% (0.5999 => 0.5874, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -2.03% (4.0594 => 3.9768, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.90% (0.8521 => 0.8359, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.81% (34.0927 => 33.4765, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -1.42% (15.2527 => 15.0357, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: -1.41% (1.5610 => 1.5390, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.38% (8.0126 => 7.9022, std.dev.: 0.0063) MultiSource/Applications/treecc/treecc: -1.26% (2.1401 => 2.1131, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -1.23% (18.2933 => 18.0687, std.dev.: 0.0073) MultiSource/Benchmarks/nbench/nbench: -1.14% (1.1530 => 1.1399, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.70% (1.8100 => 0.6752, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0259, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7507, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.39% (83.5423 => 64.0040, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.84% (4.1024 => 3.2064, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1303, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.91% (0.4092 => 0.3523, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3398, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.21% (0.5142 => 0.4617, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8973, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1753, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (7.9763 => 7.7258, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4647, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1940, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6663, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 00:46:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 02:46:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110084622.BCD942A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7455?compare_to=7453&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7455, Order: 172044, Start Time: 2013-01-10 06:32:57, End Time: 2013-01-10 08:46:22 To: 7453, Order: 172037, Start Time: 2013-01-10 03:52:00, End Time: 2013-01-10 06:02:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (208 on baseline) Performance Improvements: 0 (62 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (667 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.15% (1.2852 => 1.3128, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0654 => 0.0654, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8167 => 499.7627, std.dev.: 0.0432) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44216.99% (1.1277 => 499.7627, std.dev.: 0.0432) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.09% (0.5229 => 1.6476, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 19.83% (14.9895 => 17.9625, std.dev.: 0.0205) MultiSource/Applications/kimwitu++/kc: 43.72% (14.1553 => 20.3439, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: 17.50% (4.1105 => 4.8297, std.dev.: 0.0231) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.10% (1.1048 => 1.7467, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.44% (7.1582 => 37.6120, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.98% (3.4629 => 6.4057, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.53% (0.6222 => 1.0859, std.dev.: 0.0021) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10252.36% (0.0720 => 7.4537, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11172800.00% (0.0001 => 11.1729, std.dev.: 0.0491) MultiSource/Applications/kimwitu++/kc: 50600.00% (0.0001 => 0.0507, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9852700.00% (0.0001 => 9.8528, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483100.00% (0.0001 => 5.4832, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.13% (1.1194 => 10.3335, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 150.58% (22.1758 => 55.5692, std.dev.: 0.0454) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0027) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.80% (2.9384 => 4.6369, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.48% (7.0540 => 10.9678, std.dev.: 0.0197) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.79% (1.5859 => 2.3913, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/factor: 47.97% (0.0296 => 0.0438, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.22% (8.1363 => 11.9779, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.99% (2.2024 => 3.1051, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: 40.25% (21.9371 => 30.7672, std.dev.: 0.0414) SingleSource/Benchmarks/Misc/flops: 40.15% (0.1432 => 0.2007, std.dev.: 0.0046) MultiSource/Applications/sgefa/sgefa: 39.37% (0.3109 => 0.4333, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.75% (1.5415 => 2.0618, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.31% (4.2646 => 5.6850, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.24% (0.4615 => 0.6103, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.60% (0.1892 => 0.2471, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.50% (0.2271 => 0.2941, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 29.38% (0.4299 => 0.5562, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 28.86% (1.1642 => 1.5002, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.33% (0.6675 => 0.8566, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.99% (0.5105 => 0.6483, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.21% (3.8922 => 4.9124, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.1655 => 0.2083, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 25.49% (0.2554 => 0.3205, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.45% (0.1175 => 0.1474, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 24.90% (0.4289 => 0.5357, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: 24.83% (1.0722 => 1.3384, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.39% (0.1566 => 0.1948, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.24% (0.1906 => 0.2368, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.51% (1.4186 => 1.7521, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.45% (0.3121 => 0.3853, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 23.29% (0.4620 => 0.5696, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.88% (0.0730 => 0.0897, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 22.86% (9.4845 => 11.6529, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.30% (0.1695 => 0.2073, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.00% (0.2700 => 0.3294, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 21.74% (0.7115 => 0.8662, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 21.06% (0.7835 => 0.9485, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 20.70% (5.7591 => 6.9510, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.37% (1.3050 => 1.5708, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 20.26% (0.6456 => 0.7764, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.62% (4.9449 => 5.9153, std.dev.: 0.0237) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.44% (0.5860 => 0.6999, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.38% (0.1940 => 0.2316, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.33% (0.8172 => 0.9752, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: 19.26% (3.3354 => 3.9778, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.03% (0.2107 => 0.2508, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.81% (5.0018 => 5.9425, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.09% (0.5020 => 0.5928, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.93% (0.3307 => 0.3900, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 17.69% (0.7433 => 0.8748, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 17.47% (1.1840 => 1.3909, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.43% (0.9765 => 1.1467, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.3423 => 0.4018, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.22% (0.5569 => 0.6528, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 17.06% (3.8723 => 4.5329, std.dev.: 0.0238) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0105) MultiSource/Applications/treecc/treecc: 16.80% (2.0273 => 2.3678, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.65% (0.5981 => 0.6977, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 16.33% (0.3283 => 0.3819, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.23% (2.2969 => 2.6697, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.16% (0.3441 => 0.3997, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.10% (0.8101 => 0.9405, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 16.00% (0.3232 => 0.3749, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.89% (0.6450 => 0.7475, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 15.08% (0.2049 => 0.2358, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 14.94% (0.3180 => 0.3655, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 14.86% (0.8921 => 1.0247, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.71% (1.1861 => 1.3606, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.93% (0.8067 => 0.9191, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: 13.91% (0.3379 => 0.3849, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.56% (0.2603 => 0.2956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.35% (0.3865 => 0.4381, std.dev.: 0.0110) MultiSource/Applications/hbd/hbd: 13.14% (1.5603 => 1.7654, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.96% (0.4636 => 0.5237, std.dev.: 0.0164) MultiSource/Benchmarks/sim/sim: 12.87% (0.3387 => 0.3823, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.82% (0.4103 => 0.4629, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 12.38% (0.1268 => 0.1425, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.37% (0.4203 => 0.4723, std.dev.: 0.0128) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 11.80% (0.3603 => 0.4028, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/oourafft: 11.79% (0.3282 => 0.3669, std.dev.: 0.0090) MultiSource/Applications/sqlite3/sqlite3: 11.74% (17.1811 => 19.1980, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/property: 11.61% (0.3886 => 0.4337, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.16% (0.3826 => 0.4253, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.04% (14.3668 => 15.9528, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/bh/bh: 10.87% (0.3092 => 0.3428, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.4064 => 0.4485, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.55% (2.0665 => 2.2639, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: 9.52% (10.3673 => 11.3539, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 9.49% (0.6030 => 0.6602, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.40% (0.2871 => 0.3141, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 9.13% (0.5925 => 0.6466, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 9.11% (0.2877 => 0.3139, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.07% (0.3650 => 0.3981, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7326 => 0.7987, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.78% (1.2842 => 1.3969, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wc: 8.29% (0.3052 => 0.3305, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (0.3935 => 0.4257, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 8.07% (63.2438 => 68.3503, std.dev.: 0.0793) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (2.2022 => 2.3707, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.93% (0.4879 => 0.5217, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (7.9617 => 8.1903, std.dev.: 0.0170) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0561) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0313) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2497, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0159) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2453, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4259, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (4.2280 => 4.4622, std.dev.: 0.0135) SingleSource/Regression/C/uint64_to_float: 5.06% (0.5413 => 0.5687, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3131, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.37% (0.9957 => 1.0293, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9076, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.09% (3.6395 => 3.7154, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.94% (9.1159 => 9.2925, std.dev.: 0.0140) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1613, std.dev.: 0.0299) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.49% (5.2763 => 1.1875, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.77% (5.3855 => 4.4824, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.68% (5.3526 => 4.4600, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: -13.34% (10.4361 => 9.0440, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.88% (1.7609 => 1.6222, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -7.68% (54.1659 => 50.0070, std.dev.: 0.7878) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.04% (1.9577 => 0.6648, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3057, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4353, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7529, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.72% (3.3453 => 2.5851, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5174, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2786, std.dev.: 0.1408) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (0.2497 => 0.2351) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.88% (8.1563 => 7.7583, std.dev.: 0.0106) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8310, std.dev.: 0.0310) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -2.94% (6.2999 => 6.1147, std.dev.: 0.0584) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3297, std.dev.: 0.0507) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0031) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 01:30:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 03:30:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110093004.2898C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7456?compare_to=7454&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7456, Order: 172046, Start Time: 2013-01-10 07:53:02, End Time: 2013-01-10 09:30:02 To: 7454, Order: 172044, Start Time: 2013-01-10 05:55:42, End Time: 2013-01-10 07:29:31 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (92 on baseline) Performance Improvements: 0 (115 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.44% (0.0717 => 0.1179, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.62% (0.0974 => 0.1545, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/neural/neural: 44.07% (0.1500 => 0.2161, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.72% (0.6395 => 0.8743, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.71% (0.6395 => 0.8615, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.80% (0.6260 => 0.8313, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.69% (0.5456 => 0.7185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.66% (0.5688 => 0.7489, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.27% (0.5805 => 0.7620, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.11% (0.6230 => 0.8168, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.82% (0.5581 => 0.7301, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.80% (0.5575 => 0.7292, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.61% (0.5567 => 0.7271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.37% (0.5941 => 0.7745, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.87% (0.5802 => 0.7535, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.72% (0.6033 => 0.7826, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.70% (0.5849 => 0.7586, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.55% (0.5705 => 0.7391, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.54% (0.5478 => 0.7096, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.33% (0.0699 => 0.0904, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.21% (0.5570 => 0.7197, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.11% (0.5569 => 0.7190, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.98% (0.6440 => 0.8306, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.96% (0.5859 => 0.7556, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.71% (0.5925 => 0.7626, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.67% (0.5591 => 0.7194, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.83% (0.5857 => 0.7487, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.81% (0.6189 => 0.7910, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.76% (0.6052 => 0.7732, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.67% (0.6676 => 0.8523, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 27.51% (0.0418 => 0.0533, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.35% (0.6446 => 0.8209, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.32% (0.5863 => 0.7465, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.22% (0.6304 => 0.8020, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.97% (0.6681 => 0.8483, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.75% (1.6474 => 2.0880, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.17% (0.6194 => 0.7815, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.66% (0.6660 => 0.8369, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.57% (0.6297 => 0.7907, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.01% (0.6667 => 0.8268, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.78% (0.7524 => 0.9238, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.98% (0.7339 => 0.8952, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.62% (2.2587 => 2.7019, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.33% (1.1450 => 1.3091, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 13.55% (0.3357 => 0.3812, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.37% (0.1982 => 0.2247, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.04% (0.1081 => 0.1222, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.05% (1.6364 => 1.8172, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4916 => 0.5437, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.46% (4.5069 => 4.9783, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 10.14% (0.4515 => 0.4973, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.95% (3.5339 => 3.8855, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.55% (0.2385 => 0.2589, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.7021 => 0.7550, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4524 => 0.4838, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 6.52% (1.2515 => 1.3331, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.32% (0.5329 => 0.5666, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.25% (0.4861 => 0.5165, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.88% (1.2784 => 1.3536, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.83% (1.4642 => 1.5496, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (9.2283 => 9.7554, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 5.44% (0.3255 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (5.4682 => 5.6245, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 2.22% (1.3864 => 1.4172, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.08% (0.8418 => 0.8593, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 1.64% (5.0226 => 5.1050, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.38% (31.3723 => 55.6479, std.dev.: 0.0381) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9531 => 1.0296, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4398, std.dev.: 0.0055) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1676, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.01% (54.5751 => 56.7611, std.dev.: 0.6049) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3138, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6060, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9563, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.26% (10.3489 => 10.4791, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4782, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.97% (0.1431 => 0.1317, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -5.40% (2.4924 => 2.3579, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3821 => 0.3623, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -5.17% (0.3812 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.15% (0.9852 => 0.9345, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.12% (0.3831 => 0.3635, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions-4: -5.08% (0.3880 => 0.3683, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.06% (0.3896 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3848 => 0.3655, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.96% (0.3891 => 0.3698, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.91% (0.4033 => 0.3835, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -4.84% (0.4176 => 0.3974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.72% (0.3837 => 0.3656, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.38% (0.7198 => 0.6883, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -4.36% (0.4199 => 0.4016, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.11% (0.4280 => 0.4104, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.97% (0.9542 => 0.9163, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.94% (0.3658 => 0.3514, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.45% (0.3016 => 0.2912, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.27% (0.3057 => 0.2957, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.27% (0.3059 => 0.2959, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.18% (0.6347 => 0.6145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.06% (2.1713 => 2.1048, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -3.01% (0.6441 => 0.6247, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.91% (0.4151 => 0.4030, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -2.67% (17.1032 => 16.6467, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.64% (14.2083 => 13.8331, std.dev.: 0.0194) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2295, std.dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.59% (0.3931 => 0.3829, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -2.58% (4.3330 => 4.2212, std.dev.: 0.0271) SingleSource/UnitTests/ObjC++/property-reference: -2.57% (0.7779 => 0.7579, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.54% (6.7716 => 6.5993, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.45% (1.2221 => 1.1921, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.39% (1.0544 => 1.0292, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.34% (7.0961 => 6.9299, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.30% (0.7919 => 0.7737, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: -2.29% (16.1920 => 15.8205, std.dev.: 0.0224) MultiSource/Applications/siod/siod: -2.20% (2.4021 => 2.3493, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.2210 => 1.1942, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -2.05% (0.9179 => 0.8991, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.00% (0.7982 => 0.7822, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.98% (1.2300 => 1.2056, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -1.75% (4.0594 => 3.9885, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.72% (0.5999 => 0.5896, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.62% (34.0927 => 33.5397, std.dev.: 0.0793) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.34% (8.0126 => 7.9053, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: -1.20% (15.2527 => 15.0691, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: -1.04% (18.2933 => 18.1027, std.dev.: 0.0131) MultiSource/Applications/treecc/treecc: -1.01% (2.1401 => 2.1185, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.11% (1.8100 => 0.6858, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3143, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.68% (1.3643 => 1.0276, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9957, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.73% (4.3779 => 3.3830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.13% (2.5106 => 2.1308, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.19% (4.1534 => 3.8965, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (7.9763 => 7.7206, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.47% (1.3096 => 1.2772, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.73% (3.7241 => 3.6598, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1965, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4776, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.00% (3.7092 => 3.6721, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 02:44:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 04:44:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130110104458.EB5962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7457?compare_to=7452&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7457, Order: 172044, Start Time: 2013-01-10 06:59:21, End Time: 2013-01-10 10:44:56 To: 7452, Order: 172027, Start Time: 2013-01-10 02:23:18, End Time: 2013-01-10 05:58:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.81% (124.7761 => 128.2773, std.dev.: 1.3100) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.72% (0.0625 => 0.0892, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1063 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.59% (0.2969 => 0.3788, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.50% (0.4139 => 0.5236, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.22% (0.5900 => 0.7447, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.86% (0.1620 => 0.2039, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.65% (0.4253 => 0.5344, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.05% (0.4994 => 0.6245, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.22% (0.5000 => 0.6211, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.13% (0.1003 => 0.1235, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.04% (0.1107 => 0.1362, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 22.96% (1.5932 => 1.9590, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 22.68% (0.0948 => 0.1163, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.82% (0.1549 => 0.1887, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0572 => 0.0694, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.22% (0.0947 => 0.1148, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.19% (0.3903 => 0.4730, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.86% (0.1462 => 0.1767, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.76% (0.2014 => 0.2412, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 19.61% (0.4029 => 0.4819, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.2736 => 0.3262, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.05% (0.2866 => 0.3412, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 18.94% (0.1505 => 0.1790, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 18.88% (0.5826 => 0.6926, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.61% (1.3152 => 1.5600, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: 18.55% (0.5546 => 0.6575, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: 18.51% (0.5889 => 0.6979, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: 18.42% (1.8794 => 2.2255, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.22% (0.3271 => 0.3867, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.03% (0.4658 => 0.5498, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.98% (3.5627 => 4.2033, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference: 17.75% (0.7171 => 0.8444, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.69% (1.6211 => 1.9078, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.55% (0.5026 => 0.5908, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.43% (0.2875 => 0.3376, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.28% (0.2738 => 0.3211, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.23% (0.3930 => 0.4607, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 17.11% (0.9697 => 1.1356, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 16.91% (0.2750 => 0.3215, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.87% (0.2792 => 0.3263, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.83% (0.2811 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 16.80% (0.2803 => 0.3274, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.79% (2.0673 => 2.4145, std.dev.: 0.0541) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 16.78% (0.3004 => 0.3508, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/fibo: 16.77% (0.2725 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.76% (0.2714 => 0.3169, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.76% (4.4195 => 5.1603, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.75% (0.2729 => 0.3186, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.70% (0.2911 => 0.3397, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/objinst: 16.68% (0.2823 => 0.3294, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.54% (0.3060 => 0.3566, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 16.51% (0.2780 => 0.3239, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.51% (0.3096 => 0.3607, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 16.45% (0.9909 => 1.1539, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.31% (0.3195 => 0.3716, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.30% (2.7292 => 3.1741, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.11% (1.9694 => 2.2867, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.10% (0.4361 => 0.5063, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 15.98% (0.3267 => 0.3789, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 15.90% (23.5202 => 27.2592, std.dev.: 0.5119) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.87% (1.9966 => 2.3135, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.82% (0.3362 => 0.3894, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-2: 15.82% (0.3446 => 0.3991, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 15.78% (1.0781 => 1.2482, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 15.77% (0.3678 => 0.4258, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3465 => 0.4006, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists1: 15.59% (0.3477 => 0.4019, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.58% (0.3460 => 0.3999, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.57% (0.3488 => 0.4031, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/for-in: 15.56% (0.3496 => 0.4040, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.56% (0.3124 => 0.3610, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.54% (0.3282 => 0.3792, std.dev.: 0.0061) MultiSource/Applications/ClamAV/clamscan: 15.50% (4.2109 => 4.8638, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/trivial-interface: 15.49% (0.3442 => 0.3975, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/synchronized: 15.48% (0.3469 => 0.4006, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.39% (0.3625 => 0.4183, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 15.35% (0.3317 => 0.3826, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 15.32% (0.4146 => 0.4781, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 15.30% (0.3726 => 0.4296, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.28% (0.2566 => 0.2958, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/property: 15.23% (0.3650 => 0.4206, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.19% (0.3845 => 0.4429, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 15.06% (0.3724 => 0.4285, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists: 15.05% (0.3348 => 0.3852, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.05% (0.3981 => 0.4580, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 14.99% (1.4269 => 1.6408, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 14.96% (0.3643 => 0.4188, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.88% (0.3690 => 0.4239, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 14.56% (0.4251 => 0.4870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 14.19% (0.5012 => 0.5723, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.92% (0.7875 => 0.8971, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.72% (0.6435 => 0.7318, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 13.14% (2.1653 => 2.4499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.04% (0.2737 => 0.3094, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (0.2691 => 0.3040, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 12.85% (4.6177 => 5.2112, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 12.71% (0.3336 => 0.3760, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3669, std.dev.: 0.0674) MultiSource/Applications/SPASS/SPASS: 12.58% (5.5417 => 6.2389, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.48% (0.2068 => 0.2326, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 12.29% (0.2075 => 0.2330, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.00% (0.3084 => 0.3454, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 11.35% (0.6634 => 0.7387, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 11.29% (0.3498 => 0.3893, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.2103 => 0.2340, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.19% (0.5361 => 0.5961, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.98% (11.6398 => 12.9181, std.dev.: 0.1652) MultiSource/Benchmarks/PAQ8p/paq8p: 10.67% (0.4847 => 0.5364, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.66% (4.6926 => 5.1929, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.29% (0.2040 => 0.2250, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.19% (0.7426 => 0.8183, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.47% (0.1383 => 0.1514, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.47% (0.5584 => 0.6057, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 8.11% (0.2391 => 0.2585, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 7.99% (11.9555 => 12.9110, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 7.88% (2.0346 => 2.1950, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.07% (0.3792 => 0.4022, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5213, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0264) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.31% (0.2802 => 0.3091, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.02% (0.3693 => 0.4063, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2374, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6676, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 4.90% (1.8057 => 1.8941, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6784, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.43% (1.0142 => 1.0287, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2824, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6052, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4817, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5729, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.76% (17.2379 => 14.1768, std.dev.: 0.1656) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1018, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: -10.53% (0.2402 => 0.2149, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9778, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8035, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -5.74% (14.0481 => 13.2414, std.dev.: 0.2267) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2095, std.dev.: 0.2651) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.41% (11.2080 => 10.8257, std.dev.: 0.0961) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1167, std.dev.: 0.0917) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1864, std.dev.: 0.0449) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 03:27:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 05:27:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110112747.6BABD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7458?compare_to=7456&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7458, Order: 172047, Start Time: 2013-01-10 09:54:05, End Time: 2013-01-10 11:27:46 To: 7456, Order: 172046, Start Time: 2013-01-10 07:53:02, End Time: 2013-01-10 09:30:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (95 on baseline) Performance Improvements: 0 (119 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.31% (75.3740 => 76.3619, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.1007 => 2.1275, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.22% (79.6056 => 80.5787, std.dev.: 0.3309) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.02% (0.0717 => 0.1176, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.11% (0.0974 => 0.1540, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 43.93% (0.1500 => 0.2159, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.36% (0.6395 => 0.8720, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.16% (0.1132 => 0.1530, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.64% (0.6395 => 0.8610, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.49% (0.5456 => 0.7174, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.40% (0.5688 => 0.7474, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.23% (0.5805 => 0.7618, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.96% (0.6230 => 0.8159, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.66% (0.5581 => 0.7292, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.57% (0.5575 => 0.7279, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.39% (0.5567 => 0.7259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.59% (0.6033 => 0.7818, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.41% (0.5849 => 0.7569, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.39% (0.5802 => 0.7507, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.30% (0.5478 => 0.7083, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.24% (0.5705 => 0.7373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.99% (0.5570 => 0.7185, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.80% (0.6440 => 0.8295, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.80% (0.5569 => 0.7173, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.46% (0.5591 => 0.7182, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.32% (0.5925 => 0.7603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.64% (0.5857 => 0.7476, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.48% (0.6189 => 0.7890, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.41% (0.6052 => 0.7711, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.35% (0.6676 => 0.8502, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.09% (0.6446 => 0.8192, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.03% (0.5863 => 0.7448, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.03% (0.6304 => 0.8008, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.51% (1.6474 => 2.0842, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.82% (0.6681 => 0.8406, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.82% (0.6194 => 0.7793, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.35% (0.6297 => 0.7893, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.24% (0.6660 => 0.8341, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.77% (0.6667 => 0.8252, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.55% (0.7524 => 0.9221, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.79% (0.7339 => 0.8938, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.42% (2.2587 => 2.6973, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.97% (0.0622 => 0.0740, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.08% (1.1450 => 1.3062, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 13.14% (0.3357 => 0.3798, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.65% (0.1982 => 0.2213, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.62% (0.4916 => 0.5438, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.24% (4.5069 => 4.9682, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 9.92% (0.4515 => 0.4963, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.75% (3.5339 => 3.8783, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2385 => 0.2590, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.41% (0.7021 => 0.7541, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.01% (0.4524 => 0.4841, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.44% (0.4861 => 0.5174, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.13% (1.2515 => 1.3282, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.12% (0.5329 => 0.5655, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.68% (1.2784 => 1.3510, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 5.53% (0.3255 => 0.3435, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.46% (1.4642 => 1.5441, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 5.45% (9.2283 => 9.7314, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3319 => 0.3432, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (5.4682 => 5.6182, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6750 => 0.6924, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 1.93% (1.3864 => 1.4132, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 1.36% (5.0226 => 5.0908, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.35% (0.8418 => 0.8532, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.28% (31.3723 => 55.6181, std.dev.: 0.0471) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9531 => 1.0273, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.17% (1.2783 => 1.3700, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (5.1955 => 5.4401, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1693, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.89% (2.0478 => 2.1275, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5242, std.dev.: 0.0833) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3127, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6042, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.08% (79.7170 => 80.5787, std.dev.: 0.3309) MultiSource/Applications/viterbi/viterbi: 1.07% (4.4335 => 4.4810, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.36% (0.1281 => 0.1097, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.63% (0.1584 => 0.1479, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -5.63% (2.4924 => 2.3522, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.36% (0.9852 => 0.9324, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.29% (0.3821 => 0.3619, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.19% (0.3812 => 0.3614, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -5.08% (0.3880 => 0.3683, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.07% (0.3194 => 0.3032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.06% (0.3831 => 0.3637, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.02% (0.3884 => 0.3689, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/synchronized: -4.98% (0.3896 => 0.3702, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.84% (0.4033 => 0.3838, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.83% (0.3891 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.71% (0.3142 => 0.2994, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.43% (0.4199 => 0.4013, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.27% (0.9542 => 0.9135, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -4.23% (0.4280 => 0.4099, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.22% (0.7198 => 0.6894, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.96% (0.3658 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.58% (0.6484 => 0.6252, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.30% (0.3057 => 0.2956, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.22% (1.3148 => 1.2724, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.11% (2.1713 => 2.1038, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -3.02% (4.3330 => 4.2020, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.01% (0.7919 => 0.7681, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.88% (17.1032 => 16.6103, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.79% (0.4151 => 0.4035, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.77% (1.2221 => 1.1883, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.73% (6.7716 => 6.5868, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: -2.71% (0.6347 => 0.6175, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.66% (14.2083 => 13.8304, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.60% (1.2210 => 1.1893, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2459, std.dev.: 0.0641) MultiSource/Applications/JM/ldecod/ldecod: -2.53% (7.0961 => 6.9164, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7940, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/property-reference-object: -2.44% (0.6441 => 0.6284, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -2.43% (0.7982 => 0.7788, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -2.41% (2.4021 => 2.3443, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.38% (0.4321 => 0.4218, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -2.32% (0.9179 => 0.8966, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (1.2300 => 1.2023, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.25% (0.5999 => 0.5864, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.14% (0.8521 => 0.8339, std.dev.: 0.0057) MultiSource/Applications/lua/lua: -2.02% (4.0594 => 3.9776, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.99% (34.0927 => 33.4139, std.dev.: 0.0381) SingleSource/UnitTests/ObjC++/property-reference: -1.94% (0.7779 => 0.7628, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.41% (8.0126 => 7.8993, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.37% (1.5610 => 1.5396, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: -1.34% (15.2527 => 15.0479, std.dev.: 0.0224) MultiSource/Applications/treecc/treecc: -1.26% (2.1401 => 2.1132, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: -1.19% (18.2933 => 18.0764, std.dev.: 0.0187) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.08% (4.8802 => 4.8273, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.45% (1.8100 => 0.6977, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -23.96% (1.3643 => 1.0374, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -23.41% (83.5423 => 63.9863, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2078, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1270, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6676, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.25% (0.5142 => 0.4615, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.18% (4.1534 => 3.8967, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.3096 => 1.2688, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (7.9763 => 7.7317, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6425, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.57% (4.8776 => 4.8011, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3040 => 7.2004, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 03:28:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 05:28:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110112816.69B2A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7459?compare_to=7455&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7459, Order: 172046, Start Time: 2013-01-10 09:17:05, End Time: 2013-01-10 11:28:15 To: 7455, Order: 172044, Start Time: 2013-01-10 06:32:57, End Time: 2013-01-10 08:46:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.95% (6.1147 => 6.2341, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3128 => 1.2901, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1339 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0654 => 0.0655, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.7627 => 499.7415, std.dev.: 0.0524) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 44215.11% (1.1277 => 499.7415, std.dev.: 0.0524) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.90% (0.5229 => 1.6466, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 19.77% (14.9895 => 17.9528, std.dev.: 0.0254) MultiSource/Applications/kimwitu++/kc: 43.80% (14.1553 => 20.3547, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 17.44% (4.1105 => 4.8273, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.18% (1.1048 => 1.7476, std.dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.51% (7.1582 => 37.6171, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.07% (3.4629 => 6.4087, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.51% (0.6222 => 1.0858, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10256.53% (0.0720 => 7.4567, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11149700.00% (0.0001 => 11.1498, std.dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489600.00% (0.0001 => 5.4897, std.dev.: 0.0351) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.62% (1.1194 => 10.3390, std.dev.: 0.0158) MultiSource/Applications/ClamAV/clamscan: 150.24% (22.1758 => 55.4937, std.dev.: 0.0560) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.22% (0.1463 => 0.2505, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.82% (2.9384 => 4.6375, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.49% (7.0540 => 10.9684, std.dev.: 0.0261) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.03% (1.5859 => 2.3952, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 47.97% (0.0296 => 0.0438, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.31% (8.1363 => 11.9852, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.09% (2.2024 => 3.1073, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 40.33% (21.9371 => 30.7847, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/flops: 40.08% (0.1432 => 0.2006, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 39.43% (0.3109 => 0.4335, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0008) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.43% (4.2646 => 5.6902, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.41% (1.5415 => 2.0565, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.26% (0.4615 => 0.6104, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.66% (0.1892 => 0.2472, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.68% (0.2271 => 0.2945, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 29.43% (0.4299 => 0.5564, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 29.15% (1.1642 => 1.5036, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.40% (0.6675 => 0.8571, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.15% (0.5105 => 0.6491, std.dev.: 0.0113) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 25.92% (0.1655 => 0.2084, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.88% (3.8922 => 4.8994, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 24.81% (1.0722 => 1.3382, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.45% (0.3121 => 0.3884, std.dev.: 0.0088) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 24.15% (0.4289 => 0.5325, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.93% (0.1337 => 0.1657, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.73% (1.4186 => 1.7552, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 23.33% (0.4620 => 0.5698, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 22.89% (9.4845 => 11.6558, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.00% (0.2700 => 0.3294, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 21.69% (0.7115 => 0.8658, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.03% (0.1555 => 0.1882, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.78% (0.7835 => 0.9463, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 20.74% (5.7591 => 6.9537, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.49% (1.3050 => 1.5724, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 20.37% (0.6456 => 0.7771, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.71% (4.9449 => 5.9193, std.dev.: 0.0170) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.66% (0.5860 => 0.7012, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1940 => 0.2319, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 19.28% (3.3354 => 3.9783, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.22% (0.8172 => 0.9743, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.86% (5.0018 => 5.9450, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.33% (0.5020 => 0.5940, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.02% (0.3307 => 0.3903, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.5569 => 0.6562, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: 17.79% (0.7433 => 0.8755, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.56% (0.9765 => 1.1480, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 17.48% (1.1840 => 1.3910, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 17.12% (0.3423 => 0.4009, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.82% (0.5981 => 0.6987, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 16.82% (2.0273 => 2.3682, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 16.81% (3.8723 => 4.5234, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.51% (0.0933 => 0.1087, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.39% (0.3283 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.02% (0.6450 => 0.7483, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 15.97% (0.3232 => 0.3748, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 15.94% (2.2969 => 2.6631, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 15.62% (0.2049 => 0.2369, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.10% (0.8921 => 1.0268, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.3180 => 0.3657, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.72% (1.1861 => 1.3607, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.15% (0.3379 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.98% (0.8067 => 0.9195, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.32% (0.3865 => 0.4380, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 13.14% (1.5603 => 1.7653, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 12.93% (0.3387 => 0.3825, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.81% (0.4636 => 0.5230, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.62% (0.4103 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.42% (0.4203 => 0.4725, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.93% (0.3603 => 0.4033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.88% (0.4048 => 0.4529, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.74% (0.3927 => 0.4388, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.63% (17.1811 => 19.1788, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout-C++/lists: 11.46% (0.3422 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: 11.26% (0.3684 => 0.4099, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.11% (14.3668 => 15.9624, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.08% (0.3826 => 0.4250, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.80% (0.3092 => 0.3426, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.4064 => 0.4484, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 10.00% (0.2831 => 0.3114, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 9.53% (10.3673 => 11.3548, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: 9.40% (0.2871 => 0.3141, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 9.37% (0.6030 => 0.6595, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.36% (2.0665 => 2.2600, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7326 => 0.8002, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 9.05% (0.5925 => 0.6461, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2905 => 0.3165, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2877 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3162 => 0.3437, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.68% (1.2842 => 1.3957, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (0.2756 => 0.2985, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 8.22% (0.3052 => 0.3303, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.13% (0.3935 => 0.4255, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.09% (0.2793 => 0.3019, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.08% (63.2438 => 68.3531, std.dev.: 0.0827) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.57% (2.2022 => 2.3689, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.68% (0.2266 => 0.2372, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.87% (7.9617 => 8.1899, std.dev.: 0.0202) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.27% (32.5116 => 59.2577, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4558, std.dev.: 0.0095) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.34% (2.0360 => 2.1041, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.05% (0.9957 => 1.0261, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9131, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7183, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2873, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1606, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5810, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4583, std.dev.: 0.0398) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.47% (5.2763 => 1.1885, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.17% (0.8651 => 0.2148, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.77% (5.3855 => 4.4825, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.67% (5.3526 => 4.4602, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: -13.46% (10.4361 => 9.0316, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.83% (1.7609 => 1.6230, std.dev.: 0.0083) SingleSource/UnitTests/Vector/constpool: -7.66% (54.1659 => 50.0151, std.dev.: 0.0258) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.41% (1.9577 => 0.6771, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3042, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4311, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7542, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1267, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7348, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5175, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3135, std.dev.: 0.0784) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.49% (1.2373 => 1.1570, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.98% (8.1563 => 7.7498, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8145, std.dev.: 0.0139) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.93% (3.6994 => 3.6280, std.dev.: 0.0245) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7221 => 3.6707, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2341, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0043) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 05:24:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 07:24:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110132454.17E742A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7460?compare_to=7458&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7460, Order: 172056, Start Time: 2013-01-10 11:51:25, End Time: 2013-01-10 13:24:51 To: 7458, Order: 172047, Start Time: 2013-01-10 09:54:05, End Time: 2013-01-10 11:27:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (93 on baseline) Performance Improvements: 1 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (873 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -1.25% (2.1275 => 2.1008, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.16% (0.0717 => 0.1177, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.11% (0.0974 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 43.73% (0.1500 => 0.2156, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.39% (0.6395 => 0.8722, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.25% (0.1132 => 0.1531, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.53% (0.6395 => 0.8603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.60% (0.6260 => 0.8301, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.52% (0.5456 => 0.7176, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.35% (0.5688 => 0.7471, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.06% (0.5805 => 0.7608, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.91% (0.6230 => 0.8156, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.69% (0.5581 => 0.7294, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.49% (0.5575 => 0.7275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.47% (0.5941 => 0.7751, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.45% (0.5567 => 0.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.60% (0.6033 => 0.7819, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.56% (0.5802 => 0.7517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.34% (0.5849 => 0.7565, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.26% (0.5705 => 0.7374, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.23% (0.5478 => 0.7079, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.92% (0.5570 => 0.7181, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.86% (0.5569 => 0.7176, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.80% (0.6440 => 0.8295, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.73% (0.5859 => 0.7542, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.58% (0.5591 => 0.7189, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.46% (0.5925 => 0.7611, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.69% (0.5857 => 0.7479, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.48% (0.6052 => 0.7715, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.43% (0.6676 => 0.8507, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.40% (0.6189 => 0.7885, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.12% (0.6446 => 0.8194, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.10% (0.5863 => 0.7452, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.89% (0.6304 => 0.7999, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.75% (0.0699 => 0.0886, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.67% (1.6474 => 2.0867, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.79% (0.6681 => 0.8404, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.77% (0.6194 => 0.7790, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.36% (0.6297 => 0.7894) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.35% (0.6660 => 0.8348, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.80% (0.6667 => 0.8254, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.45% (0.7524 => 0.9213, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.69% (0.7339 => 0.8931, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.37% (2.2587 => 2.6961, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.34% (0.0693 => 0.0827, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.97% (0.0622 => 0.0740, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 14.09% (1.1450 => 1.3063, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: 13.23% (0.3357 => 0.3801, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.77% (0.1081 => 0.1219, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (0.1982 => 0.2211, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.77% (1.6364 => 1.8126, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.48% (0.4916 => 0.5431, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.29% (4.5069 => 4.9708, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 9.90% (0.4515 => 0.4962, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.69% (3.5339 => 3.8764, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.30% (0.2385 => 0.2583, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.46% (0.7021 => 0.7545, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.75% (0.2001 => 0.2136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.74% (0.4524 => 0.4829, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.34% (0.4861 => 0.5169, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.25% (0.5329 => 0.5662, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: 6.12% (1.2515 => 1.3281, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (1.4642 => 1.5459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.44% (0.3255 => 0.3432, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 5.34% (9.2283 => 9.7209, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.33% (1.2784 => 1.3465, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.25% (0.3319 => 0.3427, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (5.4682 => 5.6120, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6750 => 0.6927, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 1.64% (1.3864 => 1.4092, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.38% (5.0226 => 5.0921, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.31% (31.3723 => 55.6258, std.dev.: 0.0432) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.06% (0.9531 => 1.0299, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.93% (1.2783 => 1.3669, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1687, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5352, std.dev.: 0.1561) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (27.8210 => 28.3120, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6041, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.14% (10.3489 => 10.4669, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4789, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.21% (0.1281 => 0.1099, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.11% (0.1431 => 0.1315, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -5.63% (2.4924 => 2.3521, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/trivial-interface: -5.35% (0.3812 => 0.3608, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.31% (0.9852 => 0.9329, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.28% (0.3884 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.26% (0.3821 => 0.3620, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.25% (0.3848 => 0.3646, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.23% (0.3880 => 0.3677, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.16% (0.3896 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.11% (0.3891 => 0.3692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.98% (0.4033 => 0.3832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.98% (0.4176 => 0.3968, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.62% (0.4199 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.52% (0.3142 => 0.3000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.35% (0.9542 => 0.9127, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.32% (0.7198 => 0.6887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.28% (0.4280 => 0.4097, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.10% (0.3658 => 0.3508, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.69% (0.6484 => 0.6245, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.63% (0.3057 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.52% (1.3148 => 1.2685, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wc: -3.43% (0.3205 => 0.3095, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.32% (0.7919 => 0.7656, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.24% (2.1713 => 2.1009, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.86% (0.6441 => 0.6257, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.84% (1.2221 => 1.1874, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.83% (17.1032 => 16.6193, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.83% (1.2210 => 1.1865, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: -2.80% (4.3330 => 4.2118, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.74% (6.7716 => 6.5862, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.70% (14.2083 => 13.8243, std.dev.: 0.0145) MultiSource/Applications/lambda-0_1_3/lambda: -2.63% (0.7982 => 0.7772, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -2.53% (16.1920 => 15.7821, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.44% (1.0544 => 1.0287, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: -2.39% (7.0961 => 6.9262, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -2.39% (2.4021 => 2.3447, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.35% (20.7746 => 20.2862, std.dev.: 0.0427) MultiSource/Benchmarks/Prolangs-C/football/football: -2.34% (0.9179 => 0.8964, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.26% (0.4427 => 0.4327, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.20% (0.7779 => 0.7608, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.15% (0.5999 => 0.5870, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.13% (1.2300 => 1.2038, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -2.07% (4.0594 => 3.9755, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -2.03% (34.0927 => 33.3992, std.dev.: 0.0392) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.00% (0.8521 => 0.8351, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.48% (8.0126 => 7.8944, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -1.45% (15.2527 => 15.0313, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.37% (0.9077 => 0.8953, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: -1.33% (1.1530 => 1.1377, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: -1.28% (2.1401 => 2.1127, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: -1.24% (18.2933 => 18.0665, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.15% (4.8802 => 4.8241, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.34% (1.8100 => 0.7179, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.37% (1.3643 => 1.0318, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9943, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7595, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1305, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1035, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8974, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.14% (2.2633 => 2.1695, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.29% (1.3096 => 1.2665, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4007, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (7.9763 => 7.7237, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/ary3: -2.37% (3.7241 => 3.6358, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4623, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1960, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8095, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.30% (1.6086 => 1.5877, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7092 => 3.6635, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6114, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6033, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 06:09:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 08:09:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110140945.019D92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7461?compare_to=7459&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7461, Order: 172056, Start Time: 2013-01-10 11:58:49, End Time: 2013-01-10 14:09:44 To: 7459, Order: 172046, Start Time: 2013-01-10 09:17:05, End Time: 2013-01-10 11:28:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.18% (3.1310 => 3.1678, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1340 => 0.1340) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0655 => 0.0654, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7415 => 499.8372, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.60% (1.1277 => 499.8372, std.dev.: 0.0063) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.01% (0.5229 => 1.6472, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 19.89% (14.9895 => 17.9704, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: 43.73% (14.1553 => 20.3456, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 17.59% (4.1105 => 4.8334, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.10% (1.1048 => 1.7467, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.45% (7.1582 => 37.6127, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.26% (3.4629 => 6.4153, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.57% (0.6222 => 1.0862, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10250.14% (0.0720 => 7.4521, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11161300.00% (0.0001 => 11.1614, std.dev.: 0.0313) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483500.00% (0.0001 => 5.4836, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.10% (1.1194 => 10.2996, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 149.28% (22.1758 => 55.2799, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.17% (0.0929 => 0.1776, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.70% (2.9384 => 4.6338, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.28% (7.0540 => 10.9535, std.dev.: 0.0094) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.87% (1.5859 => 2.3927, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 48.31% (0.0296 => 0.0439, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.09% (8.1363 => 11.9678, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.12% (2.2024 => 3.1081, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 40.17% (21.9371 => 30.7485, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops: 39.87% (0.1432 => 0.2003, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 39.21% (0.3109 => 0.4328, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.57% (1.5415 => 2.0590, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.29% (4.2646 => 5.6842, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.33% (0.4615 => 0.6107, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.81% (0.1892 => 0.2475, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.85% (0.2271 => 0.2949, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.73% (0.4299 => 0.5577, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 28.90% (1.1642 => 1.5007, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.54% (0.6675 => 0.8580, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.05% (0.5105 => 0.6486, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.87% (3.8922 => 4.8990, std.dev.: 0.0114) SingleSource/Benchmarks/McGill/chomp: 25.86% (0.1655 => 0.2083, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 25.45% (0.1175 => 0.1474, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.33% (0.1125 => 0.1410, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.74% (1.0722 => 1.3375, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.16% (0.1337 => 0.1660, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 23.94% (0.4289 => 0.5316, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.81% (0.3121 => 0.3864, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.73% (1.4186 => 1.7553, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 23.48% (0.4620 => 0.5705, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.85% (9.4845 => 11.6513, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.30% (0.1695 => 0.2073, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.19% (0.0730 => 0.0892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.2700 => 0.3290, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 21.83% (0.7115 => 0.8668, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 21.59% (0.3098 => 0.3767, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.57% (0.7835 => 0.9447, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.48% (1.3050 => 1.5723, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.42% (5.7591 => 6.9351, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.29% (0.6456 => 0.7766, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.67% (4.9449 => 5.9174, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.57% (0.5860 => 0.7007, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.34% (3.3354 => 3.9804, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.22% (0.8172 => 0.9743, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.91% (5.0018 => 5.9475, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.21% (0.5020 => 0.5934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.02% (0.3307 => 0.3903, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.88% (0.2758 => 0.3251, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.73% (0.7433 => 0.8751, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.5569 => 0.6550, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.51% (0.9765 => 1.1475, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 17.45% (1.1840 => 1.3906, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.19% (0.1117 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.2107 => 0.2469, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.10% (3.8723 => 4.5345, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 16.83% (2.0273 => 2.3685, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.67% (0.5981 => 0.6978, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 16.45% (0.3283 => 0.3823, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 16.12% (0.3232 => 0.3753, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211) MultiSource/Applications/siod/siod: 15.90% (2.2969 => 2.6620, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.81% (0.6450 => 0.7470, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 14.91% (0.8921 => 1.0251, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.78% (1.1861 => 1.3614, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.22% (0.8067 => 0.9214, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.03% (0.3379 => 0.3853, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.51% (0.3865 => 0.4387, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 13.09% (1.5603 => 1.7645, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.94% (0.4636 => 0.5236, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 12.84% (0.3387 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.55% (0.4103 => 0.4618, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.54% (0.4203 => 0.4730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.50% (0.3927 => 0.4418, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.15% (0.3886 => 0.4358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.96% (0.4048 => 0.4532, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: 11.75% (17.1811 => 19.2005, std.dev.: 0.0186) SingleSource/UnitTests/ObjC/exceptions: 11.70% (0.3828 => 0.4276, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.58% (0.3282 => 0.3662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.48% (0.3422 => 0.3815, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: 11.48% (0.3684 => 0.4107, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.41% (0.3497 => 0.3896, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.35% (0.3543 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3826 => 0.4260, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.32% (0.3473 => 0.3866, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.32% (0.3694 => 0.4112, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.29% (0.3543 => 0.3943, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.23% (0.3516 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.10% (14.3668 => 15.9617, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.97% (0.3427 => 0.3803, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.71% (0.3092 => 0.3423, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.4064 => 0.4489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.28% (0.2831 => 0.3122, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.67% (0.6030 => 0.6613, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.58% (2.0665 => 2.2645, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 9.44% (10.3673 => 11.3455, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3650 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7326 => 0.8001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.11% (0.2877 => 0.3139, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.83% (1.2842 => 1.3976, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.67% (0.3162 => 0.3436, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.52% (0.3052 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.49% (0.2756 => 0.2990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2793 => 0.3024, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.74% (63.2438 => 68.1401, std.dev.: 0.0216) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.27% (2.2022 => 2.3623, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.85% (0.3817 => 0.3964, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.88% (7.9617 => 8.1907, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.28% (32.5116 => 59.2617, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4569, std.dev.: 0.0083) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0136) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (0.9957 => 1.0283, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.55% (8.6802 => 8.9013, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7227, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.10% (1.0313 => 1.0530, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2918, std.dev.: 0.0141) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1606, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4498, std.dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.63% (5.2763 => 1.1804, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.55% (0.8651 => 0.2115, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.95% (5.3855 => 4.4725, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.82% (5.3526 => 4.4523, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -13.42% (10.4361 => 9.0354, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.07% (1.7609 => 1.6188, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -7.63% (54.1659 => 50.0306, std.dev.: 0.0087) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.57% (1.9577 => 0.6545, std.dev.: 0.0129) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.81% (1.5373 => 1.0176, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4337, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7543, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0061, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1246, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.15% (1.6925 => 1.4192, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5169, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.26% (19.9488 => 18.3018, std.dev.: 0.0559) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.19% (1.2373 => 1.1607, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.88% (8.1563 => 7.7580, std.dev.: 0.0059) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.83% (0.4808 => 0.4576, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -4.25% (10.2830 => 9.8456, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.79% (3.6994 => 3.6330, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8550, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0020) Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 07:13:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 09:13:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130110151305.E1BD52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7462?compare_to=7457&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7462, Order: 172051, Start Time: 2013-01-10 11:38:29, End Time: 2013-01-10 15:13:04 To: 7457, Order: 172044, Start Time: 2013-01-10 06:59:21, End Time: 2013-01-10 10:44:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 5.87% (0.2079 => 0.2201, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/fldry: 1.14% (14.1768 => 14.3378, std.dev.: 0.0536) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.87% (0.1063 => 0.1423, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.37% (0.0475 => 0.0624, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.65% (0.2969 => 0.3790, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.49% (0.1106 => 0.1410) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.26% (0.4139 => 0.5226, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.92% (0.5900 => 0.7429, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.46% (0.4253 => 0.5336, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.43% (0.0633 => 0.0794, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.75% (0.1620 => 0.2021, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.21% (0.4994 => 0.6203, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.72% (0.5000 => 0.6186, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.37% (1.5932 => 1.9656, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.92% (0.1549 => 0.1904, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.67% (0.1107 => 0.1358, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 22.61% (0.1619 => 0.1985, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.98% (0.3903 => 0.4722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.66% (0.1462 => 0.1764, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 19.62% (0.1218 => 0.1457, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.57% (0.1160 => 0.1387, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.54% (0.2866 => 0.3426, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.49% (0.1088 => 0.1300, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 19.43% (0.4029 => 0.4812, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.41% (0.2014 => 0.2405, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.20% (0.3890 => 0.4637, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 19.12% (0.5826 => 0.6940, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 18.78% (0.5889 => 0.6995, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.66% (1.3152 => 1.5606, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.47% (0.3271 => 0.3875, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 18.27% (0.5546 => 0.6559, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 18.18% (1.8794 => 2.2210, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.86% (0.4658 => 0.5490, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 17.84% (0.7171 => 0.8450, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.61% (3.5627 => 4.1902, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.54% (1.6211 => 1.9054, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.43% (0.2875 => 0.3376, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.09% (0.5026 => 0.5885, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.94% (0.2792 => 0.3265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.91% (0.2750 => 0.3215, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.81% (0.3004 => 0.3509, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 16.80% (0.9697 => 1.1326, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.73% (0.2911 => 0.3398, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.70% (2.0673 => 2.4125, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/objinst: 16.65% (0.2823 => 0.3293, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.62% (0.2725 => 0.3178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.62% (0.2738 => 0.3193, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 16.58% (0.2811 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.55% (0.2803 => 0.3267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.54% (0.2714 => 0.3163, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 16.54% (0.1421 => 0.1656) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.49% (0.3930 => 0.4578, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 16.44% (0.9909 => 1.1538, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.37% (4.4195 => 5.1430, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.37% (0.3195 => 0.3718, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.33% (0.2780 => 0.3234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.07% (0.4361 => 0.5062, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.06% (0.3362 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.05% (0.3096 => 0.3593, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.03% (2.7292 => 3.1666, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 16.01% (0.3267 => 0.3790, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.94% (1.0781 => 1.2499, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.92% (0.3060 => 0.3547, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.86% (1.9694 => 2.2817, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 15.84% (0.3258 => 0.3774, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 15.82% (23.5202 => 27.2410, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/lists1: 15.79% (0.3477 => 0.4026, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 15.66% (0.3678 => 0.4254, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.59% (1.9966 => 2.3079, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.59% (0.3625 => 0.4190, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.56% (0.3124 => 0.3610, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 15.34% (4.2109 => 4.8567, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: 15.32% (0.3317 => 0.3825, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 15.30% (0.3726 => 0.4296, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.27% (0.3845 => 0.4432, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 15.20% (0.4146 => 0.4776, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 15.07% (0.3496 => 0.4023, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.06% (0.3465 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.06% (0.3446 => 0.3965, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.03% (0.3460 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.02% (0.3442 => 0.3959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.99% (0.3348 => 0.3850, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.99% (0.3282 => 0.3774, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.99% (0.3469 => 0.3989, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.90% (0.3981 => 0.4574, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.72% (0.3690 => 0.4233, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 14.63% (0.4251 => 0.4873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.53% (0.3724 => 0.4265, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.51% (1.4269 => 1.6340, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.30% (0.1028 => 0.1175, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 14.15% (0.5012 => 0.5721, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 13.99% (0.7875 => 0.8977, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.57% (0.6435 => 0.7308, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.12% (0.2737 => 0.3096, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.02% (2.1653 => 2.4472, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: 12.58% (0.2075 => 0.2336, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.56% (0.0804 => 0.0905, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.52% (0.2068 => 0.2327, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1915, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 12.35% (5.5417 => 6.2260, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3561, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.00% (0.3084 => 0.3454, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.93% (0.2691 => 0.3012, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 11.51% (0.3336 => 0.3720, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.35% (0.6634 => 0.7387, std.dev.: 0.0052) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.03% (0.2103 => 0.2335) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.95% (0.5361 => 0.5948, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.81% (11.6398 => 12.8979, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.55% (4.6926 => 5.1878, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.29% (0.2040 => 0.2250, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 10.21% (0.4847 => 0.5342, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.78% (0.7426 => 0.8152, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.47% (0.1383 => 0.1514, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.35% (0.5584 => 0.6050, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.99% (0.2391 => 0.2582, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.87% (2.0346 => 2.1947, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 7.82% (11.9555 => 12.8902, std.dev.: 0.0079) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.62% (0.3792 => 0.4005, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5137, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.62% (0.5917 => 0.6723, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.86% (0.3693 => 0.4057, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2419, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6739, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8907, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6787, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2099, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0826, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.21% (3.1722 => 3.2107, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5936, std.dev.: 0.0178) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4768, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5786, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.82% (17.2379 => 14.3378, std.dev.: 0.0536) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8102, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2138, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8024, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1488, std.dev.: 0.0657) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.99% (0.6293 => 0.6168, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5787, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2594, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 07:22:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 09:22:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110152204.432772A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7463?compare_to=7460&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7463, Order: 172065, Start Time: 2013-01-10 13:48:21, End Time: 2013-01-10 15:22:04 To: 7460, Order: 172056, Start Time: 2013-01-10 11:51:25, End Time: 2013-01-10 13:24:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (93 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.94% (1.2665 => 1.2911, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.20% (0.7179 => 0.6949, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.02% (0.0717 => 0.1176, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.32% (0.0974 => 0.1542, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 43.80% (0.1500 => 0.2157, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.50% (0.6395 => 0.8729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.25% (0.1132 => 0.1531, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.71% (0.6395 => 0.8615, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.76% (0.6260 => 0.8311, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.40% (0.5456 => 0.7169, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.26% (0.5688 => 0.7466, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.25% (0.5805 => 0.7619, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.16% (0.6230 => 0.8171, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.62% (0.5581 => 0.7290, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.57% (0.5567 => 0.7269, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.55% (0.5575 => 0.7278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.50% (0.6033 => 0.7813, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.46% (0.5802 => 0.7511, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.41% (0.5705 => 0.7383, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.36% (0.5849 => 0.7566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.21% (0.5478 => 0.7078, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.98% (0.5570 => 0.7184, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.86% (0.5859 => 0.7550, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.84% (0.5569 => 0.7175, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.76% (0.6440 => 0.8292, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.58% (0.5591 => 0.7189, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.57% (0.5925 => 0.7618, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.61% (0.6189 => 0.7898, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.51% (0.5857 => 0.7468, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.50% (0.6052 => 0.7716, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.28% (0.6676 => 0.8497, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.27% (0.6446 => 0.8204, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.05% (0.6304 => 0.8009, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.98% (0.5863 => 0.7445, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.50% (1.6474 => 2.0839, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.03% (0.6681 => 0.8420, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.85% (0.6194 => 0.7795, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.30% (0.6297 => 0.7890, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.29% (0.6660 => 0.8344, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.77% (0.6667 => 0.8252, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.49% (0.7524 => 0.9216, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.81% (0.7339 => 0.8940, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.47% (2.2587 => 2.6985, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.34% (0.0693 => 0.0827, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.13% (0.0622 => 0.0741, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 14.17% (1.1450 => 1.3072, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 13.26% (0.3357 => 0.3802, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (0.1982 => 0.2211, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.73% (1.6364 => 1.8120, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.58% (0.4916 => 0.5436, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.32% (4.5069 => 4.9719, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 9.97% (0.4515 => 0.4965, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.67% (3.5339 => 3.8756, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.43% (0.2385 => 0.2586, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.7021 => 0.7542, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.85% (0.2001 => 0.2138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4524 => 0.4819, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.18% (1.2515 => 1.3289, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.08% (0.5329 => 0.5653, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4861 => 0.5154, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.65% (1.4642 => 1.5470, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.37% (9.2283 => 9.7239, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.25% (1.2784 => 1.3455, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (0.3319 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.77% (5.4682 => 5.6196, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.47% (0.6750 => 0.6917, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.91% (1.3864 => 1.4129, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 1.50% (5.0226 => 5.0981, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.24% (0.8418 => 0.8522, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.25% (31.3723 => 55.6084, std.dev.: 0.0508) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.51% (0.9531 => 1.0342, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1690, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4500, std.dev.: 0.1194) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3136, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6034, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.30% (79.7170 => 80.7541, std.dev.: 0.2894) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.44% (0.1281 => 0.1096, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -5.54% (2.4924 => 2.3544, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.46% (0.3812 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.44% (0.3896 => 0.3684, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3848 => 0.3640, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.36% (0.3880 => 0.3672, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-2: -5.30% (0.3831 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.28% (0.3884 => 0.3679, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.27% (0.3891 => 0.3686, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.26% (0.9852 => 0.9334, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.24% (0.4176 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.19% (0.2428 => 0.2302, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.16% (0.3821 => 0.3624, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.81% (0.4199 => 0.3997, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.61% (0.3142 => 0.2997, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.54% (0.7198 => 0.6871, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4280 => 0.4091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.33% (0.9542 => 0.9129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.02% (0.3658 => 0.3511, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.93% (0.3057 => 0.2937, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -3.83% (0.2871 => 0.2761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.72% (0.6484 => 0.6243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.68% (0.3205 => 0.3087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.65% (0.2903 => 0.2797, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -3.65% (0.2849 => 0.2745, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.57% (0.3026 => 0.2918, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.52% (2.1713 => 2.0949, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.50% (0.3059 => 0.2952, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.49% (1.3148 => 1.2689, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.28% (0.6347 => 0.6139, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.20% (0.3252 => 0.3148, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.11% (0.6441 => 0.6241, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.01% (0.4151 => 0.4026, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.85% (0.7919 => 0.7693, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.76% (14.2083 => 13.8158, std.dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: -2.76% (17.1032 => 16.6320, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.75% (6.7716 => 6.5855, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.74% (1.2210 => 1.1876, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -2.73% (4.3330 => 4.2146, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.65% (0.3931 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.62% (1.2221 => 1.1901, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2471, std.dev.: 0.0205) SingleSource/UnitTests/ObjC++/property-reference: -2.53% (0.7779 => 0.7582, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (1.2300 => 1.1998, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -2.45% (16.1920 => 15.7946, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.45% (0.4321 => 0.4215, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.44% (7.0961 => 6.9233, std.dev.: 0.0121) MultiSource/Applications/siod/siod: -2.38% (2.4021 => 2.3449, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (1.0544 => 1.0297, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -2.24% (0.7982 => 0.7803, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -2.18% (0.9179 => 0.8979, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.13% (0.5999 => 0.5871, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.11% (0.8521 => 0.8341, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.98% (34.0927 => 33.4168, std.dev.: 0.0170) MultiSource/Applications/lua/lua: -1.87% (4.0594 => 3.9835, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -1.61% (1.5610 => 1.5359, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.42% (8.0126 => 7.8989, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: -1.39% (15.2527 => 15.0406, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: -1.28% (1.1530 => 1.1382, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -1.21% (2.1401 => 2.1143, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -1.14% (18.2933 => 18.0845, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.12% (4.8802 => 4.8257, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.61% (1.8100 => 0.6949, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3124, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -24.56% (1.3643 => 1.0292, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -23.39% (83.5423 => 64.0003, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1303, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8975, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.98% (7.9763 => 7.7388, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -2.45% (3.7241 => 3.6330, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8026, std.dev.: 0.0110) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1941, std.dev.: 0.0273) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.43% (3.7092 => 3.6560, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (1.3096 => 1.2911, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5990, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6088, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5900, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 08:50:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 10:50:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110165041.6D2C82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7464?compare_to=7461&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7464, Order: 172067, Start Time: 2013-01-10 14:39:53, End Time: 2013-01-10 16:50:41 To: 7461, Order: 172056, Start Time: 2013-01-10 11:58:49, End Time: 2013-01-10 14:09:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (79.9420 => 81.0480, std.dev.: 0.2384) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1340 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.72% (0.0415 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0654 => 0.0655, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8372 => 499.8517, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 44224.88% (1.1277 => 499.8517, std.dev.: 0.0060) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.96% (0.5229 => 1.6469, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 19.94% (14.9895 => 17.9781, std.dev.: 0.0176) MultiSource/Applications/kimwitu++/kc: 43.71% (14.1553 => 20.3429, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/gs/gs: 17.53% (4.1105 => 4.8311, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.02% (1.1048 => 1.7458, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.47% (7.1582 => 37.6144, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.96% (3.4629 => 6.4051, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.37% (0.6222 => 1.0849, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10252.22% (0.0720 => 7.4536, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11150900.00% (0.0001 => 11.1510, std.dev.: 0.0521) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849100.00% (0.0001 => 9.8492, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482700.00% (0.0001 => 5.4828, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.80% (1.1194 => 10.3298, std.dev.: 0.0201) MultiSource/Applications/ClamAV/clamscan: 150.19% (22.1758 => 55.4827, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0243 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.49% (2.9384 => 4.6276, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.99% (7.0540 => 10.9332, std.dev.: 0.0105) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.10% (1.5859 => 2.3963, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 48.31% (0.0296 => 0.0439) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.34% (8.1363 => 11.9884, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.33% (2.2024 => 3.1126, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 40.18% (21.9371 => 30.7514, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops: 40.08% (0.1432 => 0.2006, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.11% (0.3109 => 0.4325, std.dev.: 0.0006) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.62% (1.5415 => 2.0597, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.47% (4.2646 => 5.6919, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.65% (0.4615 => 0.6122, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.39% (0.1892 => 0.2467, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.90% (0.2271 => 0.2950, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.59% (0.4299 => 0.5571, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 29.01% (1.1642 => 1.5019, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.66% (0.6675 => 0.8588, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.99% (0.5105 => 0.6483, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.8922 => 4.9041, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/08-main/main: 25.80% (0.2554 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 24.85% (1.0722 => 1.3386, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.76% (0.1906 => 0.2378, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.76% (0.1337 => 0.1668, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 23.90% (0.4289 => 0.5314, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.82% (1.4186 => 1.7565, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.68% (0.3121 => 0.3860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.35% (0.4620 => 0.5699, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: 22.83% (9.4845 => 11.6496, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.19% (0.2700 => 0.3299, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 21.80% (0.7115 => 0.8666, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.34% (0.3098 => 0.3759, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.91% (0.7835 => 0.9473, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.64% (1.3050 => 1.5743, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.38% (5.7591 => 6.9326, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 20.24% (0.6456 => 0.7763, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.87% (4.9449 => 5.9276, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.62% (0.5860 => 0.7010, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.37% (0.8172 => 0.9755, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.31% (3.3354 => 3.9793, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.07% (5.0018 => 5.9555, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.23% (0.5020 => 0.5935, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.84% (0.3307 => 0.3897, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.73% (0.7433 => 0.8751, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.64% (0.9765 => 1.1488, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.53% (1.1840 => 1.3915, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.44% (0.5569 => 0.6540, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.15% (0.3423 => 0.4010, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 17.08% (2.0273 => 2.3735, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 16.97% (3.8723 => 4.5296, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.87% (0.5981 => 0.6990, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.33% (0.3441 => 0.4003, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.21% (0.8101 => 0.9414, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.18% (2.2969 => 2.6686, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: 16.17% (0.3283 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.05% (0.6450 => 0.7485, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211) SingleSource/Benchmarks/Shootout-C++/ary: 15.87% (0.3232 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.09% (0.3180 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.00% (0.8921 => 1.0259, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.73% (1.1861 => 1.3608, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.07% (0.8067 => 0.9202, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 13.76% (0.3379 => 0.3844, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.52% (0.4636 => 0.5263, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.52% (0.2603 => 0.2955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.30% (0.3865 => 0.4379, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.18% (1.5603 => 1.7660, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3927 => 0.4432, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.56% (0.3886 => 0.4374, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.45% (0.4103 => 0.4614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.25% (0.4203 => 0.4718, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.12% (0.3828 => 0.4292, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.83% (0.3543 => 0.3962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 11.81% (0.4048 => 0.4526, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.76% (17.1811 => 19.2020, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.67% (0.3694 => 0.4125, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.52% (0.3603 => 0.4018, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.49% (0.3282 => 0.3659, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.46% (0.3422 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.24% (0.3826 => 0.4256, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.24% (0.3684 => 0.4098, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.15% (14.3668 => 15.9687, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.09% (0.3427 => 0.3807, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.03% (0.2430 => 0.2698, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.36% (0.4064 => 0.4485, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 10.13% (0.6030 => 0.6641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.81% (2.0665 => 2.2692, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/Hello: 9.69% (0.5925 => 0.6499, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.45% (0.7326 => 0.8018, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.23% (0.2871 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.83% (0.2877 => 0.3131, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.63% (1.2842 => 1.3950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.51% (0.2891 => 0.3137, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2872 => 0.3113, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.39% (10.3673 => 11.2368, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.24% (0.2756 => 0.2983, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.13% (0.3052 => 0.3300, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.98% (63.2438 => 68.2932, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (0.3935 => 0.4249, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 7.96% (0.2725 => 0.2942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.43% (2.2022 => 2.3658, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3817 => 0.3978, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (7.9617 => 8.1958, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.27% (32.5116 => 59.2598, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.74% (11.6436 => 12.4279, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (4.2280 => 4.4655, std.dev.: 0.0074) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.46% (0.9957 => 1.0302, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9099, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.00% (9.1159 => 9.2982, std.dev.: 0.0137) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.89% (3.6395 => 3.7083, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.73% (0.6533 => 0.6646, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (27.8444 => 28.1604, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4588, std.dev.: 0.0316) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1779, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.89% (5.3855 => 4.4761, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.72% (5.3526 => 4.4577, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -13.43% (10.4361 => 9.0350, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.06% (1.7609 => 1.6189, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9841, std.dev.: 0.0178) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.20% (1.9577 => 0.6618, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.72% (1.5373 => 1.0189, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4355, std.dev.: 0.0184) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7548, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0053, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -10.93% (9.5636 => 8.5187, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9126, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3058, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.82% (1.2373 => 1.1529, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.17% (8.1563 => 7.7345, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8411, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -2.28% (3.6994 => 3.6149, std.dev.: 0.0236) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 09:19:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 11:19:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110171916.122A82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7465?compare_to=7463&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7465, Order: 172071, Start Time: 2013-01-10 15:45:32, End Time: 2013-01-10 17:19:14 To: 7463, Order: 172065, Start Time: 2013-01-10 13:48:21, End Time: 2013-01-10 15:22:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.02% (0.0717 => 0.1176, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.32% (0.0974 => 0.1542, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 43.73% (0.1500 => 0.2156, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.37% (0.6395 => 0.8721, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.16% (0.1132 => 0.1530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.54% (0.6395 => 0.8604, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.72% (0.6260 => 0.8308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.45% (0.5456 => 0.7172, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.31% (0.5688 => 0.7469, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.13% (0.5805 => 0.7612, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.03% (0.6230 => 0.8163, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.55% (0.5581 => 0.7286, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.45% (0.5567 => 0.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.42% (0.5575 => 0.7271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.28% (0.5941 => 0.7740, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.66% (0.5802 => 0.7523, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.49% (0.6033 => 0.7812, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.41% (0.5849 => 0.7569, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.33% (0.5705 => 0.7378, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.28% (0.5478 => 0.7082, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.96% (0.5570 => 0.7183, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.89% (0.5569 => 0.7178, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.85% (0.6440 => 0.8298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.83% (0.5859 => 0.7548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.53% (0.5591 => 0.7186, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.47% (0.5925 => 0.7612, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.54% (0.6052 => 0.7719, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.52% (0.6189 => 0.7892, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.44% (0.5857 => 0.7464, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 27.27% (0.0418 => 0.0532, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.26% (0.6676 => 0.8496, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.24% (0.6446 => 0.8202, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.22% (0.6304 => 0.8020, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.10% (0.5863 => 0.7452, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.69% (1.6474 => 2.0871, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.88% (0.6194 => 0.7797, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.85% (0.6681 => 0.8408, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.35% (0.6297 => 0.7893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.32% (0.6660 => 0.8346, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.67% (0.6667 => 0.8245, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.49% (0.7524 => 0.9216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.68% (0.7339 => 0.8930, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.58% (2.2587 => 2.7010, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.97% (0.0622 => 0.0740, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.24% (1.1450 => 1.3081, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 13.94% (0.3357 => 0.3825, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.65% (0.1982 => 0.2213, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.81% (1.6364 => 1.8133, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.66% (0.4916 => 0.5440, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.31% (4.5069 => 4.9714, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.28% (0.3834 => 0.4228, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 10.10% (0.4515 => 0.4971, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.65% (3.5339 => 3.8749, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.39% (0.2385 => 0.2585, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.41% (0.7021 => 0.7541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.4524 => 0.4848, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.80% (0.2001 => 0.2137, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.38% (1.2515 => 1.3313, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.25% (0.5329 => 0.5662, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4861 => 0.5162, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.58% (1.4642 => 1.5459, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 5.38% (9.2283 => 9.7245, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.29% (1.2784 => 1.3460, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.31% (0.3319 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (5.4682 => 5.6209, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6750 => 0.6920, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (1.3864 => 1.4122, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 1.49% (5.0226 => 5.0975, std.dev.: 0.0131) MultiSource/Applications/spiff/spiff: 1.21% (0.8418 => 0.8520, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.39% (31.3723 => 55.6524, std.dev.: 0.0400) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9531 => 1.0305, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4419, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4401, std.dev.: 0.1150) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3127, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0103) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3489 => 10.4611, std.dev.: 0.0166) MultiSource/Applications/viterbi/viterbi: 1.00% (4.4335 => 4.4779, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.36% (0.1281 => 0.1097, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.04% (0.1431 => 0.1316, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.56% (2.4924 => 2.3537, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.44% (0.3880 => 0.3669, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.43% (0.3848 => 0.3639, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -5.36% (0.3896 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.35% (0.3831 => 0.3626, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.29% (0.9852 => 0.9331, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.18% (0.3821 => 0.3623, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.15% (0.4176 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.15% (0.2428 => 0.2303, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.97% (0.3884 => 0.3691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.58% (0.3142 => 0.2998, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.54% (0.7198 => 0.6871, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.46% (0.4280 => 0.4089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.41% (0.9542 => 0.9121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.96% (0.3658 => 0.3513, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.73% (0.6484 => 0.6242, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.68% (0.3205 => 0.3087, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -3.58% (0.2849 => 0.2747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.50% (0.3026 => 0.2920, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.49% (2.1713 => 2.0955, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.47% (0.3059 => 0.2953, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.45% (1.3148 => 1.2694, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.29% (0.6347 => 0.6138, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.27% (0.7919 => 0.7660, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.04% (0.6441 => 0.6245, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.94% (0.4151 => 0.4029, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.84% (17.1032 => 16.6178, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.74% (1.2210 => 1.1875, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -2.70% (4.3330 => 4.2160, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.66% (14.2083 => 13.8302, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.66% (1.2221 => 1.1896, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.64% (6.7716 => 6.5927, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: -2.59% (0.3867 => 0.3767, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.56% (16.1920 => 15.7773, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.54% (0.3931 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2473, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.46% (1.0544 => 1.0285, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -2.44% (0.7779 => 0.7589, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.44% (7.0961 => 6.9232, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (1.2300 => 1.2005, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.34% (0.4321 => 0.4220, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -2.31% (2.4021 => 2.3466, std.dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: -2.27% (0.7982 => 0.7801, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/football/football: -2.20% (0.9179 => 0.8977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.15% (0.5999 => 0.5870, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.98% (0.8521 => 0.8352, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.92% (34.0927 => 33.4366, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -1.83% (4.0594 => 3.9850, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: -1.60% (1.5610 => 1.5361, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.43% (8.0126 => 7.8981, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -1.35% (15.2527 => 15.0465, std.dev.: 0.0116) MultiSource/Benchmarks/nbench/nbench: -1.32% (1.1530 => 1.1378, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -1.25% (2.1401 => 2.1134, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: -1.19% (18.2933 => 18.0764, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.12% (4.8802 => 4.8257, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.50% (1.8100 => 0.6787, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3970) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.98% (1.3643 => 1.0235, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7474, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9954, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2076, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1309, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8972, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4009, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.01% (7.9763 => 7.7359, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.7241 => 3.6526, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.71% (1.3096 => 1.2872, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4689, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.55% (1.6307 => 1.6054, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1923, std.dev.: 0.0271) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8084, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.6086 => 1.5919, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.02% (1.6219 => 1.6054, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 11:16:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 13:16:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110191604.F1CBF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7466?compare_to=7465&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7466, Order: 172077, Start Time: 2013-01-10 17:42:31, End Time: 2013-01-10 19:16:03 To: 7465, Order: 172071, Start Time: 2013-01-10 15:45:32, End Time: 2013-01-10 17:19:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (140 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 63.74% (0.0717 => 0.1174, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 57.91% (0.0974 => 0.1538, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.47% (0.0514 => 0.0794, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 43.73% (0.1500 => 0.2156, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.23% (0.0599 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.33% (0.6395 => 0.8718, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.07% (0.1132 => 0.1529, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.57% (0.6395 => 0.8606, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.30% (0.5456 => 0.7164, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.29% (0.5688 => 0.7468, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.09% (0.5805 => 0.7610, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.95% (0.6230 => 0.8158, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.53% (0.5581 => 0.7285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.40% (0.5575 => 0.7270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.34% (0.5567 => 0.7256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.08% (0.5941 => 0.7728, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.32% (0.5802 => 0.7503, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.25% (0.5849 => 0.7560, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.22% (0.5705 => 0.7372, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.08% (0.5478 => 0.7071, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.85% (0.5570 => 0.7177, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.78% (0.5569 => 0.7172, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.67% (0.5859 => 0.7539, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.65% (0.6440 => 0.8285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.37% (0.5591 => 0.7177, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.33% (0.0699 => 0.0897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.07% (0.5925 => 0.7588, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.47% (0.5857 => 0.7466, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.29% (0.6189 => 0.7878, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.26% (0.6052 => 0.7702, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.26% (0.6676 => 0.8496, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.04% (0.6446 => 0.8189, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 27.03% (0.0418 => 0.0531, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.97% (0.6304 => 0.8004, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.86% (0.5863 => 0.7438, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.42% (1.6474 => 2.0826, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.92% (0.6681 => 0.8413, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.61% (0.6194 => 0.7780, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.15% (0.6660 => 0.8335, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.14% (0.6297 => 0.7880, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.62% (0.6667 => 0.8242, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.41% (0.0790 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.32% (0.7524 => 0.9203, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.60% (0.7339 => 0.8924, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.28% (2.2587 => 2.6942, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.05% (0.0693 => 0.0825, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.65% (0.0622 => 0.0738, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.66% (0.1146 => 0.1314, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.07% (1.1450 => 1.3061, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 13.73% (0.3357 => 0.3818, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.67% (0.1081 => 0.1218) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.69% (1.6364 => 1.8113, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.48% (0.4916 => 0.5431, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.17% (4.5069 => 4.9654, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 9.81% (0.4515 => 0.4958, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.67% (3.5339 => 3.8758, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.22% (0.2385 => 0.2581, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.90% (0.3834 => 0.4137, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.32% (0.7021 => 0.7535, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.60% (0.2001 => 0.2133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4524 => 0.4803, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.02% (0.5329 => 0.5650, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 5.97% (1.2515 => 1.3262, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 5.84% (0.4861 => 0.5145, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.42% (1.4642 => 1.5436, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 5.24% (9.2283 => 9.7123, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.24% (1.2784 => 1.3454, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.55% (0.3255 => 0.3403, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.16% (0.3319 => 0.3424, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (5.4682 => 5.6113, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6750 => 0.6900, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 1.80% (1.3864 => 1.4113, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.25% (5.0226 => 5.0855, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6606, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.74% (0.9531 => 1.0269, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4421, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.5751 => 56.3979, std.dev.: 0.1286) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 2.35% (3.7435 => 3.8314, std.dev.: 0.0304) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3126, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (79.7170 => 80.8850, std.dev.: 0.3373) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3489 => 10.4608, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.44% (0.1281 => 0.1096, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -8.18% (0.1431 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.82% (0.1584 => 0.1476, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.20% (0.3194 => 0.2996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.88% (0.3880 => 0.3652, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -5.85% (0.3896 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.85% (0.3812 => 0.3589, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.46% (0.9852 => 0.9314, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.43% (2.4924 => 2.3570, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.40% (0.2428 => 0.2297, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.30% (0.3884 => 0.3678, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.22% (0.4199 => 0.3980, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.21% (0.3821 => 0.3622, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: -4.95% (0.4280 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.68% (0.3142 => 0.2995, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.42% (0.9542 => 0.9120, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.17% (0.2903 => 0.2782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.07% (0.3658 => 0.3509, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.97% (2.1713 => 2.0851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -3.83% (1.3148 => 1.2644) SingleSource/Benchmarks/Shootout-C++/random: -3.81% (0.2939 => 0.2827, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.78% (0.6484 => 0.6239, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.64% (0.6347 => 0.6116, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.63% (0.3252 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.48% (0.2989 => 0.2885, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.48% (0.6441 => 0.6217, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.43% (0.7919 => 0.7647, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -3.29% (0.7779 => 0.7523, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.26% (0.3621 => 0.3503, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -3.10% (4.3330 => 4.1986, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/lists1: -2.97% (0.3867 => 0.3752, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.95% (6.7716 => 6.5717, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.90% (1.2221 => 1.1867, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.89% (0.4321 => 0.4196, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.89% (17.1032 => 16.6086, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.89% (0.4427 => 0.4299, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.86% (14.2083 => 13.8019, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.86% (0.3849 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.81% (1.2210 => 1.1867, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -2.70% (16.1920 => 15.7547, std.dev.: 0.0189) MultiSource/Applications/JM/ldecod/ldecod: -2.62% (7.0961 => 6.9099, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.57% (1.0544 => 1.0273, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.54% (1.2300 => 1.1988, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -2.46% (2.4021 => 2.3431, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -2.42% (0.4248 => 0.4145, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.40% (0.5999 => 0.5855, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -2.39% (0.7982 => 0.7791, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: -2.36% (0.9179 => 0.8962, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2836, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: -2.21% (34.0927 => 33.3403, std.dev.: 0.0204) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.08% (0.8521 => 0.8344, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.96% (4.0594 => 3.9798, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.78% (1.5610 => 1.5332, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.57% (8.0126 => 7.8867, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.49% (0.9077 => 0.8942, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: -1.48% (2.1401 => 2.1084, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -1.45% (15.2527 => 15.0312, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -1.43% (18.2933 => 18.0313, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: -1.41% (1.1530 => 1.1368, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.21% (4.8802 => 4.8210, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.18% (1.8100 => 0.6845, std.dev.: 0.0282) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3110, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.48% (1.3643 => 1.0303, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9936, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.95% (2.5106 => 2.1352, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8970, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (7.9763 => 7.7278, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.3096 => 1.2796, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6407, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.51% (4.8776 => 4.8039, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1984, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7092 => 3.6586, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 11:31:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 13:31:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110193132.892DD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7467?compare_to=7464&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7467, Order: 172076, Start Time: 2013-01-10 17:20:34, End Time: 2013-01-10 19:31:28 To: 7464, Order: 172067, Start Time: 2013-01-10 14:39:53, End Time: 2013-01-10 16:50:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.13% (1.2989 => 1.3136, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.18% (3.8055 => 3.7607, std.dev.: 0.0109) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1339 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0655 => 0.0655, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8517 => 499.8001, std.dev.: 0.0270) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44220.31% (1.1277 => 499.8001, std.dev.: 0.0270) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.01% (0.5229 => 1.6472, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 19.93% (14.9895 => 17.9770, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 43.81% (14.1553 => 20.3574, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 17.66% (4.1105 => 4.8365, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.09% (1.1048 => 1.7466, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.10% (7.1582 => 37.5875, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.98% (3.4629 => 6.4056, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.37% (0.6222 => 1.0849, std.dev.: 0.0154) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10250.97% (0.0720 => 7.4527, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 3835700.00% (0.0001 => 3.8358, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 11170600.00% (0.0001 => 11.1707, std.dev.: 0.0471) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5480500.00% (0.0001 => 5.4806, std.dev.: 0.0087) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.90% (1.1194 => 10.3309, std.dev.: 0.0193) MultiSource/Applications/ClamAV/clamscan: 150.18% (22.1758 => 55.4788, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0243 => 0.0459, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.43% (0.1463 => 0.2508, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.69% (2.9384 => 4.6335, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.98% (7.0540 => 10.9324, std.dev.: 0.0043) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.89% (1.5859 => 2.3930, std.dev.: 0.0193) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/factor: 48.31% (0.0296 => 0.0439, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.44% (8.1363 => 11.9958, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.23% (2.2024 => 3.1105, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 40.24% (21.9371 => 30.7655, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 40.08% (0.1432 => 0.2006, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.18% (0.3109 => 0.4327, std.dev.: 0.0002) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.71% (1.5415 => 2.0611, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.47% (4.2646 => 5.6919, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (0.4615 => 0.6112, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.39% (0.1892 => 0.2467, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 29.47% (0.4299 => 0.5566, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 29.06% (1.1642 => 1.5025, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.46% (0.6675 => 0.8575, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.95% (0.5105 => 0.6481, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 26.56% (0.0719 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.10% (0.1655 => 0.2087, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.87% (3.8922 => 4.8993, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/tsp/tsp: 25.70% (0.1175 => 0.1477, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 25.69% (0.2554 => 0.3210, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.88% (1.0722 => 1.3390, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.71% (0.1906 => 0.2377, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 23.88% (0.4289 => 0.5313, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.81% (0.3121 => 0.3864, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.64% (1.4186 => 1.7540, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 23.07% (0.4620 => 0.5686, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.87% (9.4845 => 11.6533, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.60% (0.1695 => 0.2078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.2700 => 0.3298, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.86% (0.7115 => 0.8670, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.88% (0.7835 => 0.9471, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.64% (1.3050 => 1.5744, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.39% (5.7591 => 6.9335, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 20.29% (0.6456 => 0.7766, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.86% (4.9449 => 5.9268, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 19.72% (0.1151 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.68% (0.5860 => 0.7013, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.52% (0.8172 => 0.9767, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 19.26% (3.3354 => 3.9777, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.06% (5.0018 => 5.9549, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.09% (0.5020 => 0.5928, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.96% (0.3307 => 0.3901, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.91% (0.7433 => 0.8764, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.60% (0.9765 => 1.1484, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 17.57% (1.1840 => 1.3920, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.44% (0.5569 => 0.6540, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 17.15% (0.3423 => 0.4010, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 17.04% (2.0273 => 2.3727, std.dev.: 0.0085) MultiSource/Applications/lua/lua: 17.02% (3.8723 => 4.5314, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.23% (0.8101 => 0.9416, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.22% (0.3441 => 0.3999, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.17% (0.3283 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 15.98% (2.2969 => 2.6639, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.94% (0.6450 => 0.7478, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 15.78% (0.3232 => 0.3742, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.03% (0.2049 => 0.2357, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.99% (0.8921 => 1.0258, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.82% (1.1861 => 1.3619, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.29% (0.8067 => 0.9220, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 13.70% (0.3379 => 0.3842, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.64% (0.2603 => 0.2958, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.30% (0.3865 => 0.4379, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.27% (1.5603 => 1.7673, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.22% (0.4636 => 0.5249, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3927 => 0.4432, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.64% (0.3886 => 0.4377, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.53% (0.4103 => 0.4617, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.81% (0.4048 => 0.4526, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.75% (0.3473 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.70% (17.1811 => 19.1921, std.dev.: 0.0292) SingleSource/UnitTests/ObjC/exceptions-4: 11.69% (0.3543 => 0.3957, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.67% (0.3497 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.61% (0.3694 => 0.4123, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.57% (0.3603 => 0.4020, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.24% (0.3684 => 0.4098, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.19% (0.3826 => 0.4254, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.16% (14.3668 => 15.9696, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 10.83% (0.3092 => 0.3427, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.15% (0.6030 => 0.6642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.45% (0.7326 => 0.8018, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.31% (2.0665 => 2.2588, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.83% (0.2877 => 0.3131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2905 => 0.3157, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.63% (1.2842 => 1.3950, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.58% (0.2891 => 0.3139, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.57% (0.3162 => 0.3433, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 8.39% (10.3673 => 11.2373, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.25% (0.2872 => 0.3109, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.13% (0.3052 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.03% (63.2438 => 68.3196, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.01% (0.3935 => 0.4250, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.00% (0.2725 => 0.2943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.81% (0.2714 => 0.2926, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.41% (2.2022 => 2.3653, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.68% (0.4879 => 0.5205, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.24% (0.3817 => 0.3979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.3131 => 0.3250, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.93% (7.9617 => 8.1946, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.29% (32.5116 => 59.2666, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.07% (1.1396 => 1.2430, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4644, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.01% (0.9957 => 1.0257, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9233, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7179, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2918, std.dev.: 0.0333) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1614, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4549, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1778, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.88% (5.3855 => 4.4765, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.74% (5.3526 => 4.4568, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -13.42% (10.4361 => 9.0354, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.04% (1.7609 => 1.6193, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9428, std.dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.82% (1.9577 => 0.6495, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3074, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.20% (1.5373 => 1.0269, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4345, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7521, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0043, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -10.95% (9.5636 => 8.5161, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2925, std.dev.: 0.0553) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -6.60% (1.2373 => 1.1556, std.dev.: 0.0120) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.29% (8.1563 => 7.7250, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8310, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: -1.64% (3.6994 => 3.6386, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6668, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2294, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8548, std.dev.: 0.0114) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.83% (0.1485 => 0.1339, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0009) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 11:49:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 13:49:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130110194901.DBFC32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7468?compare_to=7462&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7468, Order: 172071, Start Time: 2013-01-10 16:14:46, End Time: 2013-01-10 19:48:55 To: 7462, Order: 172051, Start Time: 2013-01-10 11:38:29, End Time: 2013-01-10 15:13:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.59% (0.2969 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.88% (0.4253 => 0.5396, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.17% (0.4139 => 0.5222, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.66% (0.5900 => 0.7414, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.53% (0.4994 => 0.6219, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.97% (0.0897 => 0.1103, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 22.75% (1.5932 => 1.9556, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.0948 => 0.1162, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.14% (0.0822 => 0.1004, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.82% (0.1549 => 0.1887, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.51% (0.1604 => 0.1949, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.29% (0.3903 => 0.4734, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.27% (0.0947 => 0.1139, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.2736 => 0.3279, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 19.83% (0.4029 => 0.4828, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 19.62% (0.1218 => 0.1457, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.56% (0.1462 => 0.1748, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.46% (0.2014 => 0.2406, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.39% (0.1088 => 0.1299, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.18% (0.3890 => 0.4636, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.67% (0.2866 => 0.3401, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.65% (1.3152 => 1.5605, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 18.57% (0.5826 => 0.6908, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 18.45% (0.5546 => 0.6569, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 18.07% (0.5889 => 0.6953, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 18.02% (1.8794 => 2.2181, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.01% (0.3271 => 0.3860, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.91% (0.5026 => 0.5926, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.67% (3.5627 => 4.1922, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.54% (1.6211 => 1.9055, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 17.47% (0.7171 => 0.8424, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.35% (0.4658 => 0.5466, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.22% (4.4195 => 5.1805, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 17.16% (0.9697 => 1.1361, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 16.98% (0.1284 => 0.1502, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.77% (0.2875 => 0.3357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.56% (0.3930 => 0.4581, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 16.38% (0.3004 => 0.3496, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.22% (0.2792 => 0.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.21% (0.2813 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.15% (0.2911 => 0.3381, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.14% (0.4361 => 0.5065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 16.14% (0.2714 => 0.3152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.08% (2.0673 => 2.3998, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.94% (1.9694 => 2.2833, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 15.94% (0.2780 => 0.3223, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.88% (0.9909 => 1.1483, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 15.87% (1.0781 => 1.2492, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: 15.86% (0.3096 => 0.3587, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.85% (1.9966 => 2.3130, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.73% (2.7292 => 3.1586, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 15.70% (0.3267 => 0.3780, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.62% (0.3195 => 0.3694, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.52% (0.3060 => 0.3535, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3258 => 0.3763, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 15.49% (4.2109 => 4.8632, std.dev.: 0.0120) MultiSource/Benchmarks/Bullet/bullet: 15.49% (23.5202 => 27.1635, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/moments: 15.44% (0.3678 => 0.4246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.27% (0.3477 => 0.4008, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.09% (0.3625 => 0.4172, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.08% (0.3124 => 0.3595, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.96% (0.3348 => 0.3849, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.87% (0.3282 => 0.3770, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 14.87% (0.3726 => 0.4280, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.77% (0.3460 => 0.3971, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 14.76% (1.4269 => 1.6375, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 14.76% (0.3442 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.73% (0.3469 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 14.61% (0.2566 => 0.2941, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.1090 => 0.1249, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.44% (0.3650 => 0.4177, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.36% (0.3690 => 0.4220, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.35% (0.4146 => 0.4741, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 14.35% (0.4251 => 0.4861, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.34% (0.3981 => 0.4552, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.25% (0.3845 => 0.4393, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 14.18% (0.7875 => 0.8992, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.5012 => 0.5706, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.41% (0.6435 => 0.7298, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.16% (2.1653 => 2.4502, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.97% (0.2737 => 0.3092, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 12.71% (5.5417 => 6.2459, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 12.66% (4.6177 => 5.2024, std.dev.: 0.0135) MultiSource/Benchmarks/mafft/pairlocalalign: 12.52% (2.1013 => 2.3644, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 12.48% (0.2075 => 0.2334, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 12.19% (0.2691 => 0.3019, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.14% (0.2068 => 0.2319, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 12.11% (0.3336 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.59% (0.6634 => 0.7403, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.46% (0.2103 => 0.2344, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.23% (0.5361 => 0.5963, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.08% (11.6398 => 12.9294, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.68% (4.6926 => 5.1939, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 10.52% (0.4847 => 0.5357, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.44% (0.2040 => 0.2253, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.29% (0.7426 => 0.8190, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.69% (0.1383 => 0.1517, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.56% (0.5584 => 0.6062, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 8.16% (2.0346 => 2.2007, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 7.72% (11.9555 => 12.8780, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.51% (0.3792 => 0.4001, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.65% (29.0505 => 181.4643, std.dev.: 0.0349) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0208) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.69% (0.5917 => 0.6727, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.99% (0.3693 => 0.4025, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 8.71% (0.2802 => 0.3046, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 7.02% (0.2122 => 0.2271, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6812, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2371, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6828, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5024, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263) MultiSource/Applications/spiff/spiff: 1.16% (4.0317 => 4.0785, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2083, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5880, std.dev.: 0.0290) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.01% (10.3705 => 10.4753, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5691, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.28% (17.2379 => 14.2590, std.dev.: 0.0725) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1017, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8052, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -6.79% (0.2402 => 0.2239, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2197, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8018, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1230, std.dev.: 0.0380) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1525, std.dev.: 0.0940) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0467, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 13:13:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 15:13:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110211301.3886A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7469?compare_to=7466&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7469, Order: 172091, Start Time: 2013-01-10 19:39:23, End Time: 2013-01-10 21:13:00 To: 7466, Order: 172077, Start Time: 2013-01-10 17:42:31, End Time: 2013-01-10 19:16:03 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 11 (101 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1093 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.99% (0.4137 => 0.4302, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.41% (0.7539 => 0.7645, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.38% (0.7438 => 0.7541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.36% (0.7372 => 0.7472, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.22% (0.9203 => 0.9315, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (3.9992 => 4.0453, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.08% (0.9314 => 0.9415, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 1.08% (1.3262 => 1.3405, std.dev.: 0.0024) MultiSource/Applications/siod/siod: 1.03% (2.3431 => 2.3673, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 1.02% (4.1986 => 4.2414, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.07% (1.1526 => 1.1649, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.75% (0.0974 => 0.1556, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.72% (0.6395 => 0.8807, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.22% (0.1132 => 0.1542, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.97% (0.6395 => 0.8695, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.83% (0.6260 => 0.8378, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.81% (0.5688 => 0.7554, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.78% (0.5805 => 0.7708, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.53% (0.5456 => 0.7231, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.13% (0.6230 => 0.8232, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.84% (0.5581 => 0.7358, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.76% (0.5567 => 0.7335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.75% (0.5575 => 0.7345, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.68% (0.5941 => 0.7823, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.02% (0.5802 => 0.7602, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.98% (0.6033 => 0.7902, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.97% (0.5705 => 0.7472, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.48% (0.5849 => 0.7632, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.48% (0.5859 => 0.7645, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.43% (0.5478 => 0.7145, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.01% (0.5569 => 0.7240, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.86% (0.6440 => 0.8363, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.62% (0.5925 => 0.7680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.57% (0.5591 => 0.7244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.97% (0.6052 => 0.7805, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.68% (0.6189 => 0.7964, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.65% (0.5857 => 0.7535, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.62% (0.5863 => 0.7541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.48% (0.6676 => 0.8577, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.34% (0.6446 => 0.8273, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.22% (0.6304 => 0.8083, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.63% (1.6474 => 2.1026, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.06% (0.6681 => 0.8489, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.86% (0.6194 => 0.7858, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.58% (0.6297 => 0.7971, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.41% (0.6660 => 0.8419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.82% (0.6667 => 0.8322, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.80% (0.7524 => 0.9315, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.78% (0.7339 => 0.9011, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.34% (2.2587 => 2.7181, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.94% (1.1450 => 1.3161, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 14.33% (0.3357 => 0.3838, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.21% (0.3834 => 0.4302, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.59% (1.6364 => 1.8260, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.41% (0.4916 => 0.5477, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.27% (0.4515 => 0.5024, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.20% (4.5069 => 5.0116, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.48% (3.5339 => 3.9043, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2385 => 0.2605, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.32% (0.7021 => 0.7605, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.11% (1.2515 => 1.3405, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.92% (0.5329 => 0.5698, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.37% (0.4524 => 0.4812, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.1731 => 0.1841, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.31% (1.4642 => 1.5566, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.12% (9.2283 => 9.7933, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (1.2784 => 1.3562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4861 => 0.5150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (5.4682 => 5.6546, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.67% (0.6750 => 0.6930, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.3864 => 1.4219, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 2.13% (5.0226 => 5.1296, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: 2.00% (0.8418 => 0.8586, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.3722 => 1.3885, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.15% (22.4056 => 22.6634, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.13% (0.9557 => 0.9665, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.28% (31.3723 => 55.6179, std.dev.: 0.0681) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9531 => 1.0310, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3672, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4417, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1685, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (54.5751 => 56.7005, std.dev.: 0.0654) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1036, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3124, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6056, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.04% (4.4335 => 4.4796, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4565, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.17% (0.3194 => 0.2997, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.03% (0.3837 => 0.3644, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.62% (2.4924 => 2.3772, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.44% (0.9852 => 0.9415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.43% (0.7198 => 0.6879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.42% (0.3057 => 0.2922, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.4033 => 0.3855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.27% (0.3891 => 0.3725, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.12% (0.3059 => 0.2933, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -4.07% (0.4176 => 0.4006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.05% (2.1713 => 2.0834, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.94% (0.3884 => 0.3731, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.91% (1.3148 => 1.2634, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.69% (0.3252 => 0.3132, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.57% (0.4199 => 0.4049, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.57% (0.4151 => 0.4003, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.55% (0.9542 => 0.9203, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.43% (0.4280 => 0.4133, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.39% (0.3658 => 0.3534, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.18% (0.6484 => 0.6278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.18% (0.3621 => 0.3506, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.15% (0.3931 => 0.3807, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.93% (0.7779 => 0.7551, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.89% (0.4321 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.88% (0.3849 => 0.3738, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.82% (0.4427 => 0.4302, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.82% (0.3867 => 0.3758, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -2.66% (0.4248 => 0.4135, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.22% (1.2221 => 1.1950, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -2.20% (17.1032 => 16.7268, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.12% (1.2210 => 1.1951, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -2.11% (4.3330 => 4.2414, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.10% (6.7716 => 6.6296, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.09% (20.7746 => 20.3408, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.07% (1.0544 => 1.0326, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.97% (14.2083 => 13.9291, std.dev.: 0.0173) MultiSource/Applications/JM/lencod/lencod: -1.81% (16.1920 => 15.8991, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: -1.80% (7.0961 => 6.9684, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.77% (34.0927 => 33.4890, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.63% (1.2300 => 1.2100, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -1.60% (0.9179 => 0.9032, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.58% (0.8521 => 0.8386, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.51% (1.5610 => 1.5374, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -1.45% (2.4021 => 2.3673, std.dev.: 0.0059) MultiSource/Applications/lua/lua: -1.02% (4.0594 => 4.0180, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.00% (1.8100 => 0.6878, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3146, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9960, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1259, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.31% (0.5142 => 0.4612, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.18% (4.1534 => 3.8968, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2633 => 2.1804, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (7.9763 => 7.7223, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.96% (1.3096 => 1.2708, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6473, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4644, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1929, std.dev.: 0.0256) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.44% (4.8776 => 4.8072, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6089, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.22% (1.6086 => 1.5889, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6654, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.17% (1.6219 => 1.6030, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 14:12:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 16:12:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130110221241.E2D852A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7470?compare_to=7467&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7470, Order: 172093, Start Time: 2013-01-10 20:01:48, End Time: 2013-01-10 22:12:41 To: 7467, Order: 172076, Start Time: 2013-01-10 17:20:34, End Time: 2013-01-10 19:31:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.39% (0.6495 => 0.6650, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.07% (0.1339 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0655 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8001 => 499.7424, std.dev.: 0.0582) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44215.19% (1.1277 => 499.7424, std.dev.: 0.0582) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.92% (0.5229 => 1.6415, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 19.47% (14.9895 => 17.9080, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: 43.81% (14.1553 => 20.3568, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 17.53% (4.1105 => 4.8309, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.52% (1.1048 => 1.7403, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.54% (7.1582 => 37.5479, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.21% (3.4629 => 6.4136, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.33% (0.6222 => 1.0847, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10257.92% (0.0720 => 7.4577, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11157400.00% (0.0001 => 11.1575, std.dev.: 0.0596) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848500.00% (0.0001 => 9.8486, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482300.00% (0.0001 => 5.4824, std.dev.: 0.0114) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.32% (1.1194 => 10.3468, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 149.91% (22.1758 => 55.4192, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.53% (0.0929 => 0.1770, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.39% (2.9384 => 4.5955, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.50% (7.0540 => 10.8281, std.dev.: 0.0029) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.82% (1.5859 => 2.3918, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 48.31% (0.0296 => 0.0439, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.25% (8.1363 => 11.8994, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/almabench: 41.23% (0.0730 => 0.1031, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.07% (2.2024 => 3.1069, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: 39.81% (21.9371 => 30.6697, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: 39.05% (0.3109 => 0.4323, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0002) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.97% (1.5415 => 2.0497, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.96% (4.2646 => 5.6700, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.96% (0.4615 => 0.6090, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.34% (0.1892 => 0.2466, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.2271 => 0.2939, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 29.03% (0.4299 => 0.5547, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 28.58% (1.1642 => 1.4969, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.30% (0.6675 => 0.8564, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.78% (0.5105 => 0.6472, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 26.16% (0.1655 => 0.2088, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.67% (3.8922 => 4.8915, std.dev.: 0.0056) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.63% (0.1143 => 0.1436, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 25.28% (0.1175 => 0.1472, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 25.14% (0.2554 => 0.3196, std.dev.: 0.0062) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 24.59% (1.0722 => 1.3359, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.87% (0.1906 => 0.2361, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 23.60% (0.4289 => 0.5301, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.52% (0.3121 => 0.3855, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.40% (1.4186 => 1.7505, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.01% (0.0730 => 0.0898, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 22.92% (0.4620 => 0.5679, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.60% (0.1695 => 0.2078, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.34% (9.4845 => 11.6036, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.70% (0.2700 => 0.3286, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 21.69% (0.7115 => 0.8658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.88% (0.3098 => 0.3745, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.58% (0.1555 => 0.1875, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 20.49% (5.7591 => 6.9390, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.28% (0.7835 => 0.9424, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.22% (1.3050 => 1.5689, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.89% (0.6456 => 0.7740, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.53% (0.1695 => 0.2026, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 19.43% (0.1163 => 0.1389, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.40% (4.9449 => 5.9044, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.14% (0.1029 => 0.1226, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.13% (0.5860 => 0.6981, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.07% (3.3354 => 3.9716, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.66% (0.8172 => 0.9697, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.62% (5.0018 => 5.9332, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.93% (0.5020 => 0.5920, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.78% (0.3307 => 0.3895, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: 17.64% (0.7433 => 0.8744, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.59% (0.2758 => 0.3243, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.15% (0.9765 => 1.1440, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 17.14% (1.1840 => 1.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.93% (0.5569 => 0.6512, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.3423 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.80% (0.2107 => 0.2461, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.79% (3.8723 => 4.5223, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.72% (2.0273 => 2.3662, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.35% (0.5981 => 0.6959, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 15.90% (0.3283 => 0.3805, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 15.84% (2.2969 => 2.6607, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.81% (0.3441 => 0.3985, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.80% (0.8101 => 0.9381, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3232 => 0.3740, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.52% (0.6450 => 0.7451, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 14.91% (0.3180 => 0.3654, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.57% (0.8921 => 1.0221, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.49% (1.1861 => 1.3580, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 14.40% (0.2049 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.78% (0.8067 => 0.9179, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.50% (0.3379 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.4636 => 0.5250, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3865 => 0.4369, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 12.78% (0.3387 => 0.3820, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.48% (1.5603 => 1.7550, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.16% (0.4103 => 0.4602, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 11.64% (0.4048 => 0.4519, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.46% (0.3603 => 0.4016, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.43% (0.3886 => 0.4330, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.37% (17.1811 => 19.1354, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/oourafft: 11.30% (0.3282 => 0.3653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.13% (0.3422 => 0.3803, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.89% (0.3828 => 0.4245, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.82% (0.2430 => 0.2693, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.77% (0.3826 => 0.4238, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.63% (14.3668 => 15.8938, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/for-in: 10.61% (0.3694 => 0.4086, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.53% (0.3427 => 0.3788, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.47% (0.3561 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 10.02% (0.6030 => 0.6634, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.94% (0.4064 => 0.4468, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1268 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 9.49% (0.5925 => 0.6487, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.40% (0.2831 => 0.3097, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 9.23% (0.7326 => 0.8002, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.03% (2.0665 => 2.2531, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 8.72% (0.2877 => 0.3128, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.63% (0.3162 => 0.3435, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 8.43% (1.2842 => 1.3924, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 8.36% (0.2905 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.36% (0.3650 => 0.3955, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.11% (63.2438 => 68.3727, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.06% (0.2891 => 0.3124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.03% (0.3052 => 0.3297, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.97% (0.2872 => 0.3101, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.88% (0.3935 => 0.4245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.87% (0.2756 => 0.2973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.74% (0.2802 => 0.3019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.67% (0.2725 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.67% (10.3673 => 11.1621, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.56% (0.3136 => 0.3373, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.52% (0.2793 => 0.3003, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.44% (0.2714 => 0.2916, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3598, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 3.19% (0.3131 => 0.3231, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.42% (7.9617 => 8.1546, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2521, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.89% (4.2280 => 4.4771, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.92% (0.9957 => 1.0248, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9073, std.dev.: 0.0238) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.14% (3.6395 => 3.7175, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2901, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645) MultiSource/Benchmarks/Olden/tsp/tsp: 1.62% (1.0785 => 1.0960, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1610, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.82% (5.2763 => 1.1705, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.34% (5.3855 => 4.4516, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.06% (5.3526 => 4.4396, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0185, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.65% (1.7609 => 1.6085, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.89% (54.1659 => 49.8898, std.dev.: 0.0216) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.03% (1.9577 => 0.6650, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -33.52% (1.5373 => 1.0220, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4334, std.dev.: 0.0240) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7507, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0066, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -10.95% (9.5636 => 8.5164, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.21% (0.9540 => 0.8566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2978, std.dev.: 0.0927) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228) SingleSource/Benchmarks/McGill/chomp: -6.39% (1.2373 => 1.1582, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.91% (8.1563 => 7.7557, std.dev.: 0.0105) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8364, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.27% (3.7221 => 3.6748, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0001) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 14:47:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 16:47:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130110224712.BBB982A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7471?baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 To: (none) Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 40 (0 on baseline) Added Tests: 938 (0 on baseline) Existing Failures: 0 (40 on baseline) Unchanged Tests: 126 (1064 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lemon/lemon MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/aha/aha MultiSource/Applications/d/make_dparser MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lambda-0_1_3/lambda MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/sgefa/sgefa MultiSource/Applications/siod/siod MultiSource/Applications/spiff/spiff MultiSource/Applications/sqlite3/sqlite3 MultiSource/Applications/treecc/treecc MultiSource/Applications/viterbi/viterbi MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk MultiSource/Benchmarks/BitBench/drop3/drop3 MultiSource/Benchmarks/BitBench/five11/five11 MultiSource/Benchmarks/BitBench/uudecode/uudecode MultiSource/Benchmarks/BitBench/uuencode/uuencode MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1 MultiSource/Benchmarks/Fhourstones/fhourstones MultiSource/Benchmarks/FreeBench/analyzer/analyzer MultiSource/Benchmarks/FreeBench/distray/distray MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/FreeBench/neural/neural MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2 MultiSource/Benchmarks/FreeBench/pifft/pifft MultiSource/Benchmarks/MallocBench/cfrac/cfrac MultiSource/Benchmarks/MallocBench/espresso/espresso MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/01-qbsort/qbsort MultiSource/Benchmarks/McCat/03-testtrie/testtrie MultiSource/Benchmarks/McCat/04-bisect/bisect MultiSource/Benchmarks/McCat/05-eks/eks MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/McCat/09-vor/vor MultiSource/Benchmarks/McCat/15-trie/trie MultiSource/Benchmarks/McCat/17-bintr/bintr MultiSource/Benchmarks/McCat/18-imp/imp MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra MultiSource/Benchmarks/MiBench/network-patricia/network-patricia MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/NPB-serial/is/is MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/bisort/bisort MultiSource/Benchmarks/Olden/em3d/em3d MultiSource/Benchmarks/Olden/health/health MultiSource/Benchmarks/Olden/mst/mst MultiSource/Benchmarks/Olden/perimeter/perimeter MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/Olden/treeadd/treeadd MultiSource/Benchmarks/Olden/tsp/tsp MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/NP/np MultiSource/Benchmarks/Prolangs-C++/city/city MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1 MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2 MultiSource/Benchmarks/Prolangs-C++/employ/employ MultiSource/Benchmarks/Prolangs-C++/family/family MultiSource/Benchmarks/Prolangs-C++/fsm/fsm MultiSource/Benchmarks/Prolangs-C++/garage/garage MultiSource/Benchmarks/Prolangs-C++/life/life MultiSource/Benchmarks/Prolangs-C++/objects/objects MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Prolangs-C++/office/office MultiSource/Benchmarks/Prolangs-C++/primes/primes MultiSource/Benchmarks/Prolangs-C++/shapes/shapes MultiSource/Benchmarks/Prolangs-C++/simul/simul MultiSource/Benchmarks/Prolangs-C++/trees/trees MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc MultiSource/Benchmarks/Prolangs-C/agrep/agrep MultiSource/Benchmarks/Prolangs-C/allroots/allroots MultiSource/Benchmarks/Prolangs-C/archie-client/archie MultiSource/Benchmarks/Prolangs-C/assembler/assembler MultiSource/Benchmarks/Prolangs-C/bison/mybison MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl MultiSource/Benchmarks/Prolangs-C/compiler/compiler MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput MultiSource/Benchmarks/Prolangs-C/football/football MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo MultiSource/Benchmarks/Prolangs-C/loader/loader MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig MultiSource/Benchmarks/Prolangs-C/simulator/simulator MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/Ptrdist/ft/ft MultiSource/Benchmarks/Ptrdist/ks/ks MultiSource/Benchmarks/Ptrdist/yacr2/yacr2 MultiSource/Benchmarks/SciMark2-C/scimark2 MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5 MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1 MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4 MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url MultiSource/Benchmarks/VersaBench/beamformer/beamformer MultiSource/Benchmarks/VersaBench/bmm/bmm MultiSource/Benchmarks/VersaBench/dbms/dbms MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes MultiSource/Benchmarks/llubenchmark/llu MultiSource/Benchmarks/mafft/pairlocalalign MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/sim/sim MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/BenchmarkGame/Large/fasta SingleSource/Benchmarks/BenchmarkGame/fannkuch SingleSource/Benchmarks/BenchmarkGame/n-body SingleSource/Benchmarks/BenchmarkGame/nsieve-bits SingleSource/Benchmarks/BenchmarkGame/partialsums SingleSource/Benchmarks/BenchmarkGame/recursive SingleSource/Benchmarks/BenchmarkGame/spectral-norm SingleSource/Benchmarks/CoyoteBench/almabench SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/CoyoteBench/huffbench SingleSource/Benchmarks/CoyoteBench/lpbench SingleSource/Benchmarks/Dhrystone/dry SingleSource/Benchmarks/Dhrystone/fldry SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/McGill/chomp SingleSource/Benchmarks/McGill/exptree SingleSource/Benchmarks/McGill/misr SingleSource/Benchmarks/McGill/queens SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/mandel-text SingleSource/Benchmarks/Misc-C++/oopack_v1p8 SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc-C++/stepanov_v1p2 SingleSource/Benchmarks/Misc/ReedSolomon SingleSource/Benchmarks/Misc/dt SingleSource/Benchmarks/Misc/fbench SingleSource/Benchmarks/Misc/ffbench SingleSource/Benchmarks/Misc/flops SingleSource/Benchmarks/Misc/flops-1 SingleSource/Benchmarks/Misc/flops-2 SingleSource/Benchmarks/Misc/flops-3 SingleSource/Benchmarks/Misc/flops-4 SingleSource/Benchmarks/Misc/flops-5 SingleSource/Benchmarks/Misc/flops-6 SingleSource/Benchmarks/Misc/flops-7 SingleSource/Benchmarks/Misc/flops-8 SingleSource/Benchmarks/Misc/fp-convert SingleSource/Benchmarks/Misc/himenobmtxpa SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Misc/mandel SingleSource/Benchmarks/Misc/mandel-2 SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Misc/oourafft SingleSource/Benchmarks/Misc/perlin SingleSource/Benchmarks/Misc/pi SingleSource/Benchmarks/Misc/richards_benchmark SingleSource/Benchmarks/Misc/salsa20 SingleSource/Benchmarks/Misc/whetstone SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/Shootout-C++/ackermann SingleSource/Benchmarks/Shootout-C++/ary SingleSource/Benchmarks/Shootout-C++/ary2 SingleSource/Benchmarks/Shootout-C++/ary3 SingleSource/Benchmarks/Shootout-C++/except SingleSource/Benchmarks/Shootout-C++/fibo SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/heapsort SingleSource/Benchmarks/Shootout-C++/hello SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/matrix SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/nestedloop SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/random SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/strcat SingleSource/Benchmarks/Shootout-C++/sumcol SingleSource/Benchmarks/Shootout-C++/wc SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/Shootout/ackermann SingleSource/Benchmarks/Shootout/ary3 SingleSource/Benchmarks/Shootout/fib2 SingleSource/Benchmarks/Shootout/hash SingleSource/Benchmarks/Shootout/heapsort SingleSource/Benchmarks/Shootout/hello SingleSource/Benchmarks/Shootout/lists SingleSource/Benchmarks/Shootout/matrix SingleSource/Benchmarks/Shootout/methcall SingleSource/Benchmarks/Shootout/nestedloop SingleSource/Benchmarks/Shootout/objinst SingleSource/Benchmarks/Shootout/random SingleSource/Benchmarks/Shootout/sieve SingleSource/Benchmarks/Shootout/strcat SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Benchmarks/Stanford/Bubblesort SingleSource/Benchmarks/Stanford/FloatMM SingleSource/Benchmarks/Stanford/IntMM SingleSource/Benchmarks/Stanford/Oscar SingleSource/Benchmarks/Stanford/Perm SingleSource/Benchmarks/Stanford/Puzzle SingleSource/Benchmarks/Stanford/Queens SingleSource/Benchmarks/Stanford/Quicksort SingleSource/Benchmarks/Stanford/RealMM SingleSource/Benchmarks/Stanford/Towers SingleSource/Benchmarks/Stanford/Treesort SingleSource/Regression/C++/2003-05-14-array-init SingleSource/Regression/C++/2003-05-14-expr_stmt SingleSource/Regression/C++/2003-06-08-BaseType SingleSource/Regression/C++/2003-06-08-VirtualFunctions SingleSource/Regression/C++/2003-06-13-Crasher SingleSource/Regression/C++/2003-08-20-EnumSizeProblem SingleSource/Regression/C++/2003-09-29-NonPODsByValue SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn SingleSource/Regression/C++/2011-03-28-Bitfield SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/ctor_dtor_count SingleSource/Regression/C++/EH/ctor_dtor_count-2 SingleSource/Regression/C++/EH/dead_try_block SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/EH/function_try_block SingleSource/Regression/C++/EH/inlined_cleanup SingleSource/Regression/C++/EH/simple_rethrow SingleSource/Regression/C++/EH/simple_throw SingleSource/Regression/C++/EH/throw_rethrow_test SingleSource/Regression/C++/fixups SingleSource/Regression/C++/global_ctor SingleSource/Regression/C++/global_type SingleSource/Regression/C++/ofstream_ctor SingleSource/Regression/C++/pointer_member SingleSource/Regression/C++/pointer_method SingleSource/Regression/C++/pointer_method2 SingleSource/Regression/C++/short_circuit_dtor SingleSource/Regression/C/2003-05-14-initialize-string SingleSource/Regression/C/2003-05-21-BitfieldHandling SingleSource/Regression/C/2003-05-22-LocalTypeTest SingleSource/Regression/C/2003-05-22-VarSizeArray SingleSource/Regression/C/2003-05-23-TransparentUnion SingleSource/Regression/C/2003-06-16-InvalidInitializer SingleSource/Regression/C/2003-06-16-VolatileError SingleSource/Regression/C/2003-10-12-GlobalVarInitializers SingleSource/Regression/C/2004-02-03-AggregateCopy SingleSource/Regression/C/2004-03-15-IndirectGoto SingleSource/Regression/C/2004-08-12-InlinerAndAllocas SingleSource/Regression/C/2005-05-06-LongLongSignedShift SingleSource/Regression/C/2008-01-07-LongDouble SingleSource/Regression/C/ConstructorDestructorAttributes SingleSource/Regression/C/DuffsDevice SingleSource/Regression/C/PR1386 SingleSource/Regression/C/PR491 SingleSource/Regression/C/PR640 SingleSource/Regression/C/badidx SingleSource/Regression/C/bigstack SingleSource/Regression/C/callargs SingleSource/Regression/C/casts SingleSource/Regression/C/compare SingleSource/Regression/C/globalrefs SingleSource/Regression/C/matrixTranspose SingleSource/Regression/C/pointer_arithmetic SingleSource/Regression/C/sumarray SingleSource/Regression/C/sumarray2d SingleSource/Regression/C/sumarraymalloc SingleSource/Regression/C/test_indvars SingleSource/Regression/C/testtrace SingleSource/Regression/C/uint64_to_float SingleSource/UnitTests/2002-04-17-PrintfChar SingleSource/UnitTests/2002-05-02-ArgumentTest SingleSource/UnitTests/2002-05-02-CastTest SingleSource/UnitTests/2002-05-02-CastTest1 SingleSource/UnitTests/2002-05-02-CastTest2 SingleSource/UnitTests/2002-05-02-CastTest3 SingleSource/UnitTests/2002-05-02-ManyArguments SingleSource/UnitTests/2002-05-03-NotTest SingleSource/UnitTests/2002-05-19-DivTest SingleSource/UnitTests/2002-08-02-CastTest SingleSource/UnitTests/2002-08-02-CastTest2 SingleSource/UnitTests/2002-08-19-CodegenBug SingleSource/UnitTests/2002-10-09-ArrayResolution SingleSource/UnitTests/2002-10-12-StructureArgs SingleSource/UnitTests/2002-10-12-StructureArgsSimple SingleSource/UnitTests/2002-10-13-BadLoad SingleSource/UnitTests/2002-12-13-MishaTest SingleSource/UnitTests/2003-04-22-Switch SingleSource/UnitTests/2003-05-02-DependentPHI SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-12-MinIntProblem SingleSource/UnitTests/2003-05-14-AtExit SingleSource/UnitTests/2003-05-26-Shorts SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-05-31-LongShifts SingleSource/UnitTests/2003-07-06-IntOverflow SingleSource/UnitTests/2003-07-08-BitOpsTest SingleSource/UnitTests/2003-07-09-LoadShorts SingleSource/UnitTests/2003-07-09-SignedArgs SingleSource/UnitTests/2003-08-05-CastFPToUint SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/2003-08-20-FoldBug SingleSource/UnitTests/2003-09-18-BitFieldTest SingleSource/UnitTests/2003-10-13-SwitchTest SingleSource/UnitTests/2003-10-29-ScalarReplBug SingleSource/UnitTests/2004-02-02-NegativeZero SingleSource/UnitTests/2004-06-20-StaticBitfieldInit SingleSource/UnitTests/2004-11-28-GlobalBoolLayout SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls SingleSource/UnitTests/2005-05-12-Int64ToFP SingleSource/UnitTests/2005-05-13-SDivTwo SingleSource/UnitTests/2005-07-17-INT-To-FP SingleSource/UnitTests/2005-11-29-LongSwitch SingleSource/UnitTests/2006-01-29-SimpleIndirectCall SingleSource/UnitTests/2006-02-04-DivRem SingleSource/UnitTests/2006-12-01-float_varg SingleSource/UnitTests/2006-12-04-DynAllocAndRestore SingleSource/UnitTests/2006-12-07-Compare64BitConstant SingleSource/UnitTests/2006-12-11-LoadConstants SingleSource/UnitTests/2007-01-04-KNR-Args SingleSource/UnitTests/2007-03-02-VaCopy SingleSource/UnitTests/2007-04-25-weak SingleSource/UnitTests/2008-04-18-LoopBug SingleSource/UnitTests/2008-04-20-LoopBug2 SingleSource/UnitTests/2008-07-13-InlineSetjmp SingleSource/UnitTests/2009-04-16-BitfieldInitialization SingleSource/UnitTests/2009-12-07-StructReturn SingleSource/UnitTests/2010-05-24-BitfieldTest SingleSource/UnitTests/AtomicOps SingleSource/UnitTests/DefaultInitDynArrays SingleSource/UnitTests/FloatPrecision SingleSource/UnitTests/SignlessTypes/cast-bug SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/SignlessTypes/div SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/rem SingleSource/UnitTests/SignlessTypes/shr SingleSource/UnitTests/StructModifyTest SingleSource/UnitTests/TestLoop SingleSource/UnitTests/Threads/2010-12-08-tls SingleSource/UnitTests/Threads/tls SingleSource/UnitTests/Vector/build SingleSource/UnitTests/Vector/build2 SingleSource/UnitTests/Vector/constpool SingleSource/UnitTests/Vector/divides SingleSource/UnitTests/Vector/multiplies SingleSource/UnitTests/Vector/simple SingleSource/UnitTests/Vector/sumarray SingleSource/UnitTests/Vector/sumarray-dbl SingleSource/UnitTests/block-byref-cxxobj-test SingleSource/UnitTests/block-byref-test SingleSource/UnitTests/block-call-r7674133 SingleSource/UnitTests/block-copied-in-cxxobj SingleSource/UnitTests/block-copied-in-cxxobj-1 SingleSource/UnitTests/blockstret SingleSource/UnitTests/byval-alignment SingleSource/UnitTests/conditional-gnu-ext SingleSource/UnitTests/conditional-gnu-ext-cxx SingleSource/UnitTests/initp1 SingleSource/UnitTests/member-function-pointers SingleSource/UnitTests/printargs SingleSource/UnitTests/stmtexpr SingleSource/UnitTests/vla ================================ Run-Over-Baseline Changes Detail ================================ Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: - (1.2047 => 1.2047, std.dev.: 0.1312) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0233 => 0.0233, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0451 => 0.0451, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0394 => 0.0394, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0328 => 0.0328, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0445 => 0.0445, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0227 => 0.0227, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0255 => 0.0255, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: - (0.1530 => 0.1530, std.dev.: 0.0159) MultiSource/Applications/lemon/lemon: - (1.9293 => 1.9293, std.dev.: 0.0438) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.4049 => 0.4049, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1510 => 0.1510, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0978 => 0.0978, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0590 => 0.0590, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1617 => 1.1617, std.dev.: 0.0613) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0032 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0268 => 0.0268, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7437 => 0.7437, std.dev.: 0.0059) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0092 => 0.0092, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: - (12.7781 => 12.7781, std.dev.: 0.1998) Report Time: 0.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 15:10:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 17:10:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130110231046.DBEAD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7472?compare_to=7469&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7472, Order: 172105, Start Time: 2013-01-10 21:36:27, End Time: 2013-01-10 23:10:11 To: 7469, Order: 172091, Start Time: 2013-01-10 19:39:23, End Time: 2013-01-10 21:13:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 1 (122 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (871 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (2.0834 => 2.1071, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -11.27% (0.4302 => 0.3817, std.dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.55% (0.0974 => 0.1554, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.62% (0.6395 => 0.8801, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.72% (0.6395 => 0.8679, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.71% (0.6260 => 0.8370, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.67% (0.5688 => 0.7546, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.58% (0.5805 => 0.7696, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.01% (0.6230 => 0.8224, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.64% (0.5575 => 0.7339, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.61% (0.5567 => 0.7327, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.52% (0.5581 => 0.7340, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.43% (0.5941 => 0.7808, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.73% (0.5802 => 0.7585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.67% (0.5705 => 0.7455, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.66% (0.6033 => 0.7883, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.40% (0.5859 => 0.7640, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.36% (0.5478 => 0.7141, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.16% (0.5849 => 0.7613, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.05% (0.5570 => 0.7244, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.83% (0.6440 => 0.8361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.68% (0.5569 => 0.7222, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.49% (0.5591 => 0.7240, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.49% (0.5925 => 0.7672, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.57% (0.6052 => 0.7781, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.49% (0.6189 => 0.7952, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.36% (0.5857 => 0.7518, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.28% (0.5863 => 0.7521, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.17% (0.6446 => 0.8262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.89% (0.6304 => 0.8062, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.47% (1.6474 => 2.1000, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.82% (0.6681 => 0.8473, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.77% (0.6194 => 0.7852, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.31% (0.6297 => 0.7954, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.28% (0.6660 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.57% (0.6667 => 0.8305, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.51% (0.7524 => 0.9293, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.55% (0.7339 => 0.8994, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.29% (2.2587 => 2.7170, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 15.00% (1.1450 => 1.3167, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.83% (0.3357 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.64% (1.6364 => 1.8269, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 11.16% (0.4515 => 0.5019, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.15% (0.4916 => 0.5464, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (4.5069 => 5.0027, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.44% (3.5339 => 3.9030, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.29% (0.7021 => 0.7603, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.54% (0.4524 => 0.4865, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5329 => 0.5706, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.98% (1.2515 => 1.3388, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 6.64% (0.4861 => 0.5184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.19% (1.4642 => 1.5548, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (9.2283 => 9.7852, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.98% (1.2784 => 1.3549, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.3255 => 0.3434, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.49% (5.4682 => 5.6591, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6750 => 0.6961, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.61% (5.0226 => 5.1536, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 2.41% (1.3864 => 1.4198, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.88% (0.8418 => 0.8576, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.9557 => 0.9696, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.11% (22.4056 => 22.6552, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.08% (1.3722 => 1.3870, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.64% (31.3723 => 55.7298, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.56% (0.9531 => 1.0252, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1692, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6304, std.dev.: 0.0576) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1059, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3123, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5320 => 4.5983, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 1.04% (4.4335 => 4.4797, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.83% (0.3812 => 0.3628, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.68% (0.3821 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.56% (0.4033 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.56% (2.4924 => 2.3788, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.54% (0.9852 => 0.9405, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.53% (0.3837 => 0.3663, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.41% (0.4176 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.95% (0.4199 => 0.4033, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.95% (0.3142 => 0.3018, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.79% (0.3323 => 0.3197, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.9542 => 0.9188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.69% (0.4280 => 0.4122, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.67% (0.7198 => 0.6934, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -3.59% (0.2871 => 0.2768, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.51% (0.6347 => 0.6124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.40% (0.3059 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.21% (0.3205 => 0.3102, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.19% (0.6484 => 0.6277, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.14% (0.6441 => 0.6239, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -3.12% (1.3148 => 1.2738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.96% (2.1713 => 2.1071, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.78% (0.7779 => 0.7563, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.62% (0.3931 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.53% (0.7919 => 0.7719, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2887, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.31% (0.4321 => 0.4221, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: -2.23% (17.1032 => 16.7222, std.dev.: 0.0273) MultiSource/Benchmarks/MallocBench/gs/gs: -2.19% (4.3330 => 4.2379, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.19% (6.7716 => 6.6234, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (1.2210 => 1.1948, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.14% (1.2221 => 1.1960, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.00% (14.2083 => 13.9236, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9610, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -1.83% (16.1920 => 15.8959, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.66% (1.2300 => 1.2096, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (0.7982 => 0.7852, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -1.49% (2.4021 => 2.3664, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -1.13% (1.5610 => 1.5434, std.dev.: 0.0009) MultiSource/Applications/lua/lua: -1.10% (4.0594 => 4.0148, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -1.07% (34.0927 => 33.7269, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.56% (1.8100 => 0.6957, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3150, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.98% (1.3643 => 1.0235, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7508, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: -23.39% (83.5423 => 64.0016, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1287, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.15% (4.1534 => 3.8978, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6999, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.20% (2.2633 => 2.1683, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7349, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.66% (1.3096 => 1.2747, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.22% (3.7241 => 3.6415, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.59% (4.8776 => 4.8001, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.55% (1.6307 => 1.6055, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.47% (1.6086 => 1.5849, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3040 => 7.1987, std.dev.: 0.0317) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6015, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6667, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 16:23:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 18:23:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130111002332.B30F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7473?compare_to=7468&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7473, Order: 172096, Start Time: 2013-01-10 20:47:05, End Time: 2013-01-11 00:23:30 To: 7468, Order: 172071, Start Time: 2013-01-10 16:14:46, End Time: 2013-01-10 19:48:55 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 10 (182 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1094 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.76% (27.1635 => 27.6419, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.75% (2.3998 => 2.4417, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 1.71% (1.1361 => 1.1555, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 1.70% (1.1483 => 1.1678, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.05% (3.1586 => 3.1918, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (12.9294 => 13.0649, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 1.02% (2.2007 => 2.2231, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 20.81% (0.0663 => 0.0801, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 9.26% (118.0799 => 129.0135, std.dev.: 1.3262) SingleSource/Benchmarks/Dhrystone/dry: 1.77% (13.5160 => 13.7556, std.dev.: 0.0266) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.46% (0.1063 => 0.1408, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.92% (0.4253 => 0.5483, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.33% (0.2969 => 0.3810, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.95% (0.0475 => 0.0603, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.78% (0.5900 => 0.7480, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.38% (0.4139 => 0.5231, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.31% (0.1106 => 0.1397, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.05% (0.1620 => 0.2042, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.47% (0.4994 => 0.6266, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.03% (0.1103 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.02% (0.5000 => 0.6201, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.46% (0.0584 => 0.0721, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.44% (1.5932 => 1.9666, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 23.35% (0.1619 => 0.1997, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.94% (0.1107 => 0.1361, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.53% (0.1003 => 0.1229, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 22.19% (0.0604 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.14% (0.1549 => 0.1892, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.14% (0.0822 => 0.1004, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.07% (0.1604 => 0.1958, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.88% (0.3903 => 0.4757, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.55% (0.1462 => 0.1777, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 20.61% (0.1218 => 0.1469, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.50% (0.1088 => 0.1311, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.21% (0.2736 => 0.3289, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.21% (0.3271 => 0.3932, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.16% (0.2014 => 0.2420, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 20.15% (0.4029 => 0.4841, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.97% (0.3890 => 0.4667, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 19.87% (0.1505 => 0.1804, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 19.58% (0.5826 => 0.6967, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.43% (0.2866 => 0.3423, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 19.29% (0.5889 => 0.7025, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 19.16% (0.9697 => 1.1555, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.08% (1.3152 => 1.5662, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 18.91% (0.5546 => 0.6595, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.89% (0.2911 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.89% (0.2875 => 0.3418, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 18.79% (1.8794 => 2.2326, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 18.72% (0.2714 => 0.3222, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.47% (3.5627 => 4.2207, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/random: 18.44% (0.2803 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.44% (0.2738 => 0.3243, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 18.44% (0.2750 => 0.3257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 18.42% (0.2823 => 0.3343, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.37% (0.2792 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.34% (0.5026 => 0.5948, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 18.34% (0.2813 => 0.3329, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 18.30% (0.7171 => 0.8483, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.29% (0.4658 => 0.5510, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.25% (1.6211 => 1.9169, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 18.18% (0.2811 => 0.3322, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.11% (2.0673 => 2.4417, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.10% (0.2729 => 0.3223, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 18.08% (0.3004 => 0.3547, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 18.02% (0.2780 => 0.3281, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.90% (4.4195 => 5.2104, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 17.85% (0.9909 => 1.1678, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wc: 17.76% (0.3096 => 0.3646, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.68% (0.3195 => 0.3760, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.58% (0.3060 => 0.3598, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 17.54% (0.3267 => 0.3840, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 17.52% (23.5202 => 27.6419, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/ary: 17.43% (0.3258 => 0.3826, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 17.38% (0.2566 => 0.3012, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.35% (0.3930 => 0.4612, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.16% (0.3124 => 0.3660, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 17.15% (0.3317 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.10% (0.3362 => 0.3937, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.08% (0.4361 => 0.5106, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 16.96% (1.0781 => 1.2609, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.95% (2.7292 => 3.1918, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: 16.85% (0.3726 => 0.4354, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 16.83% (0.3678 => 0.4297, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.76% (0.3282 => 0.3832, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.69% (0.3625 => 0.4230, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 16.64% (0.3348 => 0.3905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 16.59% (0.3477 => 0.4054, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.58% (1.9694 => 2.2959, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 16.47% (0.4251 => 0.4951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 16.45% (0.4146 => 0.4828, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 16.40% (4.2109 => 4.9016, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.40% (1.9966 => 2.3240, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.23% (0.3981 => 0.4627, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.15% (0.3690 => 0.4286, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 15.82% (1.4269 => 1.6527, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 15.70% (0.5012 => 0.5799, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.63% (0.3845 => 0.4446, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 15.58% (0.3465 => 0.4005, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 15.38% (0.3446 => 0.3976, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.34% (0.3488 => 0.4023, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 15.31% (0.3469 => 0.4000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.26% (0.3460 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.25% (0.3442 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 15.11% (0.7875 => 0.9065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.99% (0.3650 => 0.4197, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions: 14.96% (0.3643 => 0.4188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.80% (0.3724 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.50% (0.6435 => 0.7368, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: 13.80% (2.1653 => 2.4642, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 13.73% (5.5417 => 6.3025, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 13.56% (0.2691 => 0.3056, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 13.54% (0.2075 => 0.2356, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.2737 => 0.3107, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.48% (2.1013 => 2.3846, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: 13.47% (4.6177 => 5.2398, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.98% (0.3498 => 0.3952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.67% (0.2068 => 0.2330, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.65% (0.3084 => 0.3474, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 12.47% (0.3336 => 0.3752, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.24% (11.6398 => 13.0649, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.24% (0.5361 => 0.6017, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 12.21% (0.6634 => 0.7444, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.2103 => 0.2359, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.91% (0.2040 => 0.2283, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (0.4847 => 0.5420, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.64% (4.6926 => 5.2389, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.39% (0.7426 => 0.8272, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.80% (0.5584 => 0.6131, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 9.66% (0.2391 => 0.2622, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 9.26% (2.0346 => 2.2231, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 8.58% (11.9555 => 12.9809, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.88% (0.3792 => 0.4015, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.60% (29.0505 => 181.4487, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.59% (0.3693 => 0.4084, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2371, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 4.85% (1.8057 => 1.8932, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6838, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 3.00% (0.6276 => 0.6464, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1983, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3019, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.40% (1.0927 => 1.1080, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2832, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2090, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4796, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5889, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5552, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.05% (17.2379 => 14.2982, std.dev.: 0.0417) SingleSource/UnitTests/Vector/multiplies: -11.34% (2.3713 => 2.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9799, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2249, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8002, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -2.93% (6.9842 => 6.7793, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1506, std.dev.: 0.0251) SingleSource/Benchmarks/Dhrystone/dry: -2.08% (14.0481 => 13.7556, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5702, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2365, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 16:57:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 18:57:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111005750.3D8A52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7474?compare_to=7471&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7474, Order: 172134, Start Time: 2013-01-10 23:14:22, End Time: 2013-01-11 00:57:52 To: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== Performance Regressions: 4 (4 on baseline) Performance Improvements: 31 (31 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1029 (1029 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 8.03% (33.2440 => 35.9124, std.dev.: 0.5579) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.60% (23.5861 => 25.1419, std.dev.: 0.5075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 3.84% (7.2040 => 7.4807, std.dev.: 0.1049) SingleSource/Benchmarks/Misc/pi: 2.86% (2.1390 => 2.2001, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.10% (0.0808 => 0.0484, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.29% (0.0727 => 0.0485, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.77% (0.0692 => 0.0486, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -27.01% (0.1888 => 0.1378, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.86% (0.1684 => 0.1299, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.64% (0.1009 => 0.0831, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.47% (1.0986 => 0.9286, std.dev.: 0.0287) MultiSource/Applications/spiff/spiff: -15.01% (1.0220 => 0.8686, std.dev.: 0.0203) MultiSource/Applications/Burg/burg: -13.08% (1.5979 => 1.3889, std.dev.: 0.0729) MultiSource/Applications/aha/aha: -12.70% (0.1378 => 0.1203, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: -12.08% (2.4719 => 2.1734, std.dev.: 0.0396) MultiSource/Applications/hexxagon/hexxagon: -11.44% (1.1433 => 1.0125, std.dev.: 0.0317) MultiSource/Applications/sgefa/sgefa: -10.34% (0.3598 => 0.3226, std.dev.: 0.0096) MultiSource/Applications/siod/siod: -9.39% (2.6437 => 2.3954, std.dev.: 0.0762) MultiSource/Applications/ClamAV/clamscan: -9.17% (17.4365 => 15.8374, std.dev.: 0.5903) MultiSource/Applications/lambda-0_1_3/lambda: -8.81% (0.8653 => 0.7891, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.85% (0.9124 => 0.8499, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.51% (0.9550 => 0.8928, std.dev.: 0.0196) MultiSource/Applications/SPASS/SPASS: -4.19% (16.4479 => 15.7586, std.dev.: 0.1862) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4689 => 0.4545, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -18.83% (4.4739 => 3.6315, std.dev.: 0.1399) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.09% (0.1164 => 0.1000, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: -9.15% (4.5259 => 4.1120, std.dev.: 0.0473) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.12% (0.4081 => 0.3709, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.12% (0.3217 => 0.2988, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.64% (1.4588 => 1.3619, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -3.50% (3.5443 => 3.4202, std.dev.: 0.0428) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.34% (40.4729 => 39.1209, std.dev.: 0.4072) MultiSource/Applications/spiff/spiff: -1.90% (2.8571 => 2.8027, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/mandel-2: -1.51% (0.8521 => 0.8392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3168, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.47% (1.2047 => 1.1147, std.dev.: 0.1623) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0192) MultiSource/Applications/lemon/lemon: -39.55% (1.9293 => 1.1663, std.dev.: 0.1908) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.14% (0.4049 => 0.4176, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.39% (0.1510 => 0.1489, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.51% (0.0978 => 0.0973, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0590 => 0.0574, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1617 => 1.1534, std.dev.: 0.0879) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.12% (0.0268 => 0.0265, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7437 => 0.7434, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7488, std.dev.: 0.2324) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 8.03% (33.2440 => 35.9124, std.dev.: 0.5579) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.60% (23.5861 => 25.1419, std.dev.: 0.5075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 3.84% (7.2040 => 7.4807, std.dev.: 0.1049) SingleSource/Benchmarks/Misc/pi: 2.86% (2.1390 => 2.2001, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.10% (0.0808 => 0.0484, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.29% (0.0727 => 0.0485, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.77% (0.0692 => 0.0486, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -27.01% (0.1888 => 0.1378, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.86% (0.1684 => 0.1299, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.64% (0.1009 => 0.0831, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.47% (1.0986 => 0.9286, std.dev.: 0.0287) MultiSource/Applications/spiff/spiff: -15.01% (1.0220 => 0.8686, std.dev.: 0.0203) MultiSource/Applications/Burg/burg: -13.08% (1.5979 => 1.3889, std.dev.: 0.0729) MultiSource/Applications/aha/aha: -12.70% (0.1378 => 0.1203, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: -12.08% (2.4719 => 2.1734, std.dev.: 0.0396) MultiSource/Applications/hexxagon/hexxagon: -11.44% (1.1433 => 1.0125, std.dev.: 0.0317) MultiSource/Applications/sgefa/sgefa: -10.34% (0.3598 => 0.3226, std.dev.: 0.0096) MultiSource/Applications/siod/siod: -9.39% (2.6437 => 2.3954, std.dev.: 0.0762) MultiSource/Applications/ClamAV/clamscan: -9.17% (17.4365 => 15.8374, std.dev.: 0.5903) MultiSource/Applications/lambda-0_1_3/lambda: -8.81% (0.8653 => 0.7891, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.85% (0.9124 => 0.8499, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.51% (0.9550 => 0.8928, std.dev.: 0.0196) MultiSource/Applications/SPASS/SPASS: -4.19% (16.4479 => 15.7586, std.dev.: 0.1862) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4689 => 0.4545, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -18.83% (4.4739 => 3.6315, std.dev.: 0.1399) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.09% (0.1164 => 0.1000, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: -9.15% (4.5259 => 4.1120, std.dev.: 0.0473) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.12% (0.4081 => 0.3709, std.dev.: 0.0100) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.12% (0.3217 => 0.2988, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.64% (1.4588 => 1.3619, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -3.50% (3.5443 => 3.4202, std.dev.: 0.0428) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.34% (40.4729 => 39.1209, std.dev.: 0.4072) MultiSource/Applications/spiff/spiff: -1.90% (2.8571 => 2.8027, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/mandel-2: -1.51% (0.8521 => 0.8392, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3168, std.dev.: 0.0136) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.47% (1.2047 => 1.1147, std.dev.: 0.1623) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0073) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0192) MultiSource/Applications/lemon/lemon: -39.55% (1.9293 => 1.1663, std.dev.: 0.1908) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.14% (0.4049 => 0.4176, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.39% (0.1510 => 0.1489, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.51% (0.0978 => 0.0973, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0590 => 0.0574, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1617 => 1.1534, std.dev.: 0.0879) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.12% (0.0268 => 0.0265, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7437 => 0.7434, std.dev.: 0.0035) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7488, std.dev.: 0.2324) Report Time: 0.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 17:01:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 19:01:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111010127.C4E102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7475?compare_to=7470&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7475, Order: 172124, Start Time: 2013-01-10 22:50:45, End Time: 2013-01-11 01:01:27 To: 7470, Order: 172093, Start Time: 2013-01-10 20:01:48, End Time: 2013-01-10 22:12:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (11.1621 => 11.0346, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.45% (0.1340 => 0.1334, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0653 => 0.0655, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7424 => 499.8371, std.dev.: 0.0130) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.59% (1.1277 => 499.8371, std.dev.: 0.0130) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.50% (0.5229 => 1.6393, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 19.50% (14.9895 => 17.9126, std.dev.: 0.0110) MultiSource/Applications/kimwitu++/kc: 43.31% (14.1553 => 20.2858, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: 17.16% (4.1105 => 4.8160, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.43% (1.1048 => 1.7393, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.77% (7.1582 => 37.5644, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.13% (3.4629 => 6.4109, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.67% (0.6222 => 1.0868, std.dev.: 0.0031) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10253.61% (0.0720 => 7.4546, std.dev.: 0.0183) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11193900.00% (0.0001 => 11.1940, std.dev.: 0.0432) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495000.00% (0.0001 => 5.4951, std.dev.: 0.0215) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.32% (1.1194 => 10.2685, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 148.90% (22.1758 => 55.1953, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.61% (0.1463 => 0.2496, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.85% (2.9384 => 4.6090, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.23% (7.0540 => 10.8795, std.dev.: 0.0011) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.59% (1.5859 => 2.3882, std.dev.: 0.0171) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.54% (0.1056 => 0.1558, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.17% (8.1363 => 11.8926, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.72% (2.2024 => 3.0992, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 40.14% (21.9371 => 30.7417, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 38.66% (0.3109 => 0.4311, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.27% (0.0439 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.08% (1.5415 => 2.0514, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.80% (4.2646 => 5.6635, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.98% (0.4615 => 0.6091, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 31.08% (0.0814 => 0.1067, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.44% (0.1892 => 0.2449, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.2271 => 0.2939, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 28.98% (0.4299 => 0.5545, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 28.37% (1.1642 => 1.4945, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.36% (0.6675 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.66% (0.5105 => 0.6466, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 26.01% (0.0719 => 0.0906, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.46% (3.8922 => 4.8832, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 24.94% (0.2554 => 0.3191, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 24.32% (1.0722 => 1.3330, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 23.99% (0.4289 => 0.5318, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.92% (0.1906 => 0.2362, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.46% (0.4620 => 0.5704, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.26% (0.3121 => 0.3847, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.17% (1.4186 => 1.7473, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.01% (0.1143 => 0.1406, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.89% (0.1337 => 0.1643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.36% (0.1695 => 0.2074, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.34% (9.4845 => 11.6029, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 21.62% (0.7115 => 0.8653, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.33% (0.2700 => 0.3276) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.45% (0.0626 => 0.0754, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.29% (0.7835 => 0.9425, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.22% (1.3050 => 1.5689, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 20.21% (0.6456 => 0.7761, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.21% (0.0871 => 0.1047, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.20% (5.7591 => 6.9224, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.31% (4.9449 => 5.8998, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.06% (0.5860 => 0.6977, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.93% (0.8172 => 0.9719, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0036) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 18.79% (3.3354 => 3.9621, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.65% (5.0018 => 5.9348, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.96% (0.3307 => 0.3901, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.65% (0.5020 => 0.5906, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.51% (0.2758 => 0.3241, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.33% (0.7433 => 0.8721, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.22% (0.1510 => 0.1770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.02% (0.5569 => 0.6517, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 16.97% (1.1840 => 1.3849, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 16.91% (0.3423 => 0.4002, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.84% (0.3283 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.75% (0.2107 => 0.2460, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 16.39% (3.8723 => 4.5071, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary: 16.37% (0.3232 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.35% (0.5981 => 0.6959, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 16.32% (2.0273 => 2.3581, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.95% (0.0834 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.73% (0.8101 => 0.9375, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.69% (0.3441 => 0.3981, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 15.39% (2.2969 => 2.6505, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.30% (0.6450 => 0.7437, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1044 => 0.1203, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.65% (0.3180 => 0.3646, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 14.56% (0.8921 => 1.0220, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.33% (1.1861 => 1.3561, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.3379 => 0.3861, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 14.25% (0.2049 => 0.2341, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.4636 => 0.5286, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3865 => 0.4396, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.57% (0.8067 => 0.9162, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.21% (1.5603 => 1.7664, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.80% (0.4103 => 0.4628, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.44% (0.4203 => 0.4726, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: 12.15% (0.4048 => 0.4540, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3603 => 0.4039, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.86% (0.3422 => 0.3828, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.43% (0.3684 => 0.4105, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.36% (17.1811 => 19.1322, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.19% (0.3826 => 0.4254, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.78% (0.3543 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.76% (14.3668 => 15.9122, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 10.71% (0.3473 => 0.3845, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.62% (0.2430 => 0.2688, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.61% (0.4064 => 0.4495, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.77% (2.0665 => 2.2683, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 9.72% (0.2871 => 0.3150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.20% (0.3162 => 0.3453, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.07% (0.3935 => 0.4292, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 8.88% (1.2842 => 1.3982, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2891 => 0.3147, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.56% (0.7326 => 0.7953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/fibo: 8.48% (0.2725 => 0.2956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.84% (63.2438 => 68.2011, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3599, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 6.44% (10.3673 => 11.0346, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1560, std.dev.: 0.0111) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2541, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.75% (4.2280 => 4.4710, std.dev.: 0.0072) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1067, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (0.9957 => 1.0300, std.dev.: 0.0083) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.42% (8.6802 => 8.8905, std.dev.: 0.0267) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.28% (1.0313 => 1.0548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.14% (3.6395 => 3.7175, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2901, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7570, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1612, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4553, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1683, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.74% (5.2763 => 1.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.66% (0.8651 => 0.2106, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.60% (5.3855 => 4.4374, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.19% (5.3526 => 4.4327, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: -13.77% (10.4361 => 8.9992, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.70% (1.7609 => 1.6077, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -8.02% (54.1659 => 49.8241, std.dev.: 0.0128) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.65% (1.9577 => 0.6528, std.dev.: 0.0133) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4298, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7486, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.59% (2.6546 => 2.0019, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5175, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2901, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.62% (1.2373 => 1.1554, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (8.1563 => 7.7360, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8139, std.dev.: 0.0085) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.94% (3.6994 => 3.6277, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.65% (3.7221 => 3.6606, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.17% (0.1485 => 0.1334, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0011) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 17:10:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 19:10:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111011034.67BF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7476?compare_to=7472&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7476, Order: 172139, Start Time: 2013-01-10 23:36:57, End Time: 2013-01-11 01:10:34 To: 7472, Order: 172105, Start Time: 2013-01-10 21:36:27, End Time: 2013-01-10 23:10:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.42% (78.3714 => 80.2701, std.dev.: 0.4178) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.07% (2.1071 => 2.0845, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.85% (0.0717 => 0.1182, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.93% (0.0974 => 0.1548, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.33% (0.1500 => 0.2165, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.31% (0.6395 => 0.8781, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.40% (0.6395 => 0.8659, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.47% (0.6260 => 0.8355, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.49% (0.5688 => 0.7536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.24% (0.5456 => 0.7215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.23% (0.5805 => 0.7676, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.67% (0.6230 => 0.8203, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.30% (0.5575 => 0.7320, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.11% (0.5941 => 0.7789, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.61% (0.5802 => 0.7578, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.48% (0.6033 => 0.7872, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.32% (0.5705 => 0.7435, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.97% (0.5849 => 0.7602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.94% (0.5478 => 0.7118, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.66% (0.6440 => 0.8350, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.61% (0.5570 => 0.7219, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.50% (0.5569 => 0.7212, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.40% (0.5925 => 0.7667, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.26% (0.5591 => 0.7227, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.40% (0.6052 => 0.7771, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.28% (0.6189 => 0.7939, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.23% (0.5863 => 0.7518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.19% (0.5857 => 0.7508, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.04% (0.6676 => 0.8548, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.80% (0.6446 => 0.8238, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.32% (1.6474 => 2.0974, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.57% (0.6194 => 0.7840, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.49% (0.6681 => 0.8451, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.17% (0.6660 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.04% (0.6297 => 0.7937, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.44% (0.7524 => 0.9288, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.58% (0.7339 => 0.8996, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.04% (2.2587 => 2.7113, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3151, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.15% (1.6364 => 1.8188, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.03% (0.4916 => 0.5458, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.90% (0.4515 => 0.5007, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.90% (4.5069 => 4.9980, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.61% (3.5339 => 3.9088, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.20% (0.7021 => 0.7597, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4524 => 0.4837, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.90% (1.2515 => 1.3379, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.85% (0.5329 => 0.5694, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 6.07% (0.4861 => 0.5156, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.93% (1.4642 => 1.5510, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 5.90% (9.2283 => 9.7731, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.2784 => 1.3508, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (5.4682 => 5.6527, std.dev.: 0.0201) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6750 => 0.6929, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.36% (1.3864 => 1.4191, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.89% (0.8418 => 0.8577, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.88% (5.0226 => 5.1172, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.06% (0.9557 => 0.9658, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6595, std.dev.: 0.0272) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1698, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (54.5751 => 56.6467, std.dev.: 0.0677) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3132, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6033, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.09% (4.4335 => 4.4819, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: -5.98% (0.3831 => 0.3602, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.90% (0.3880 => 0.3651, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.73% (0.4033 => 0.3802, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.95% (0.4199 => 0.3991, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.87% (0.3821 => 0.3635, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -4.78% (2.4924 => 2.3733, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -4.74% (0.4280 => 0.4077, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.70% (0.9852 => 0.9389, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.48% (0.3057 => 0.2920, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -4.42% (0.2871 => 0.2744, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.35% (0.3059 => 0.2926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.24% (0.3205 => 0.3069, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.07% (0.7198 => 0.6905, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: -4.06% (0.3026 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.00% (2.1713 => 2.0845, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.89% (0.6347 => 0.6100, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.74% (0.9542 => 0.9185, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -3.73% (1.3148 => 1.2658, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.65% (0.6441 => 0.6206, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.58% (0.2989 => 0.2882, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.38% (0.6484 => 0.6265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.10% (0.3931 => 0.3809, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -3.09% (0.3621 => 0.3509, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.97% (0.7779 => 0.7548, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.86% (0.3849 => 0.3739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.78% (0.4427 => 0.4304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.68% (0.4321 => 0.4205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.63% (0.7919 => 0.7711, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.53% (6.7716 => 6.6002, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.49% (1.2221 => 1.1917, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.46% (1.2210 => 1.1910, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -2.42% (17.1032 => 16.6897, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.38% (14.2083 => 13.8699, std.dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2808, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0301, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -2.29% (4.3330 => 4.2338, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -2.19% (16.1920 => 15.8371, std.dev.: 0.0079) MultiSource/Applications/JM/ldecod/ldecod: -2.19% (7.0961 => 6.9407, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.88% (0.9179 => 0.9006, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.85% (0.5999 => 0.5888, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.84% (0.7982 => 0.7835, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.80% (1.2300 => 1.2078, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.72% (2.4021 => 2.3609, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (0.8521 => 0.8378, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -1.61% (1.5610 => 1.5359, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.49% (34.0927 => 33.5837, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.21% (8.0126 => 7.9153, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.19% (0.9077 => 0.8969, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.14% (4.0594 => 4.0130, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -1.06% (15.2527 => 15.0910, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.42% (1.8100 => 0.6983, std.dev.: 0.0197) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3152, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.69% (1.3643 => 1.0274, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9923, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.84% (4.1024 => 3.2066, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1048) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3390, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8974, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (7.9763 => 7.7239, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4675, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1963, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.8776 => 4.8064, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6219 => 1.6027, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.10% (1.6307 => 1.6127, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 19:01:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 21:01:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111030157.E7AD82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7477?compare_to=7474&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7477, Order: 172153, Start Time: 2013-01-11 01:17:39, End Time: 2013-01-11 03:02:00 To: 7474, Order: 172134, Start Time: 2013-01-10 23:14:22, End Time: 2013-01-11 00:57:52 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== Performance Regressions: 19 (10 on baseline) Performance Improvements: 3 (18 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1042 (1036 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 25.96% (0.3162 => 0.3983, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.52% (0.2257 => 0.2833, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 19.62% (0.1539 => 0.1841, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.20% (0.3649 => 0.4240, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.68% (4.7939 => 5.4978, std.dev.: 0.0855) MultiSource/Applications/lemon/lemon: 5.37% (1.3131 => 1.3836, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.23% (5.7578 => 6.0587, std.dev.: 0.1167) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.07% (0.8953 => 0.9317, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.77% (4.7977 => 4.9787, std.dev.: 0.0594) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.18% (0.7319 => 0.7552, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 25.00% (6.1917 => 7.7397, std.dev.: 0.2517) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.91% (0.1968 => 0.2163, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.77% (43.2970 => 47.5254, std.dev.: 1.2589) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.13% (2.9616 => 3.2024, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.66% (4.2429 => 4.5680, std.dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.63% (1.2459 => 1.3036, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.87% (0.5838 => 0.6064, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.56% (3.7495 => 3.8453, std.dev.: 0.0199) SingleSource/Benchmarks/Dhrystone/fldry: 2.26% (0.6607 => 0.6756, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -6.98% (35.9124 => 33.4060, std.dev.: 0.9607) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -3.90% (7.4807 => 7.1892, std.dev.: 0.0976) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.71% (7.1796 => 6.9131, std.dev.: 0.0754) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.48% (1.1147 => 1.1423, std.dev.: 0.2713) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0433 => 0.0434, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.29% (0.0339 => 0.0340, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0320 => 0.0320, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.42% (0.0432 => 0.0477, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0221 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.56% (0.0253 => 0.0244, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 5.92% (0.1453 => 0.1539, std.dev.: 0.0118) MultiSource/Applications/lemon/lemon: 13.33% (1.1663 => 1.3218, std.dev.: 0.2701) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.20% (0.4176 => 0.4226, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.28% (0.1489 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.92% (0.0973 => 0.0982, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.51% (0.0266 => 0.0278, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.67% (0.0574 => 0.0618, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1534 => 1.1540, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 65.00% (0.0020 => 0.0033, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.38% (0.0026 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.81% (0.0614 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.70% (0.0265 => 0.0234, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.65% (0.7434 => 0.7557, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.69% (0.0078 => 0.0084, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7488 => 12.7411, std.dev.: 0.1270) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 21.69% (0.3273 => 0.3983, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.53% (0.3702 => 0.4240, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.19% (0.2481 => 0.2833, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 13.50% (0.1622 => 0.1841, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.96% (4.9104 => 5.4978, std.dev.: 0.0855) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.62% (4.2843 => 4.5680, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.46% (3.0082 => 3.2024, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2160, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.83% (0.5897 => 0.6064, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.10% (3.7662 => 3.8453, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.16% (0.0808 => 0.0532, std.dev.: 0.0072) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -10.61% (1.1433 => 1.0220, std.dev.: 0.0400) SingleSource/Benchmarks/Shootout-C++/hello: -6.17% (0.1928 => 0.1809, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.68% (6.4235 => 6.0587, std.dev.: 0.1167) SingleSource/Benchmarks/Shootout-C++/ary: -5.02% (0.2551 => 0.2423, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.84% (1.3220 => 1.2580, std.dev.: 0.0226) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.83% (0.7693 => 0.7552, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -27.20% (0.9372 => 0.6823, std.dev.: 0.0886) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -8.09% (0.6628 => 0.6092, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.23% (1.4588 => 1.3534, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.65% (0.3217 => 0.3003, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.90% (0.3349 => 0.3185, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.97% (1.1825 => 1.1356, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: -3.25% (17.2182 => 16.6582, std.dev.: 0.1890) SingleSource/Benchmarks/Shootout-C++/methcall: -1.01% (8.7416 => 8.6534, std.dev.: 0.0177) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.18% (1.2047 => 1.1423, std.dev.: 0.2713) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.19% (0.0445 => 0.0477, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.31% (0.0255 => 0.0244, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.59% (0.1530 => 0.1539, std.dev.: 0.0118) MultiSource/Applications/lemon/lemon: -31.49% (1.9293 => 1.3218, std.dev.: 0.2701) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.37% (0.4049 => 0.4226, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.86% (0.1510 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.41% (0.0978 => 0.0982, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.75% (0.0590 => 0.0618, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.66% (1.1617 => 1.1540, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.12% (0.0032 => 0.0033, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.69% (0.0268 => 0.0234, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.61% (0.7437 => 0.7557, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -37.50% (0.0008 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.70% (0.0092 => 0.0084, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.29% (12.7781 => 12.7411, std.dev.: 0.1270) Report Time: 0.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 19:10:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 21:10:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111031030.065F92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7478?compare_to=7476&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7478, Order: 172155, Start Time: 2013-01-11 01:36:21, End Time: 2013-01-11 03:10:28 To: 7476, Order: 172139, Start Time: 2013-01-10 23:36:57, End Time: 2013-01-11 01:10:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (868 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.14% (0.0974 => 0.1550, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801) MultiSource/Benchmarks/FreeBench/neural/neural: 44.40% (0.1500 => 0.2166, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.29% (0.6395 => 0.8780, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.45% (0.6395 => 0.8662, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.48% (0.6260 => 0.8356, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.37% (0.5688 => 0.7529, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.33% (0.5456 => 0.7220, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.33% (0.5567 => 0.7311, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.23% (0.5581 => 0.7324, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.17% (0.5941 => 0.7793, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.63% (0.5802 => 0.7579, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.31% (0.5705 => 0.7434, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.02% (0.5849 => 0.7605, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.86% (0.5478 => 0.7114, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.83% (0.5859 => 0.7607, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.78% (0.5570 => 0.7229, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.54% (0.5569 => 0.7214, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.37% (0.5925 => 0.7665, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.28% (0.5591 => 0.7228, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.49% (0.6189 => 0.7952, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.34% (0.6052 => 0.7767, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.27% (0.5857 => 0.7513, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.14% (0.5863 => 0.7513, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.06% (0.6676 => 0.8549, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.86% (0.6446 => 0.8242, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.30% (1.6474 => 2.0972, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.61% (0.6681 => 0.8459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.54% (0.6194 => 0.7838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.28% (0.6660 => 0.8410, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.01% (0.6297 => 0.7935, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.51% (0.6667 => 0.8301, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.48% (0.7524 => 0.9291, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.54% (0.7339 => 0.8993, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.97% (2.2587 => 2.7098, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0153) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.41% (1.6364 => 1.8231, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.13% (0.4916 => 0.5463, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.95% (4.5069 => 5.0002, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.37% (3.5339 => 3.9003, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2385 => 0.2595, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.99% (0.7021 => 0.7582, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.40% (0.2001 => 0.2149, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 7.38% (1.2515 => 1.3438, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.5329 => 0.5696, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 6.85% (0.4524 => 0.4834, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.08% (1.4642 => 1.5532, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 6.07% (0.4861 => 0.5156, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.01% (9.2283 => 9.7826, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.2784 => 1.3540, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.15% (5.4682 => 5.6407, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 2.52% (0.6750 => 0.6920, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.45% (1.3864 => 1.4203, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.07% (5.0226 => 5.1267, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.03% (0.8418 => 0.8589, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.34% (31.3723 => 55.6365, std.dev.: 0.0380) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4398, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1673, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5995, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1038, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.57% (0.6469 => 0.6635, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3130, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5320 => 4.6002, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.74% (0.1281 => 0.1105, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.20% (0.3194 => 0.2996, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3831 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.74% (2.4924 => 2.3742, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3896 => 0.3717, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.54% (0.9852 => 0.9405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.46% (0.2871 => 0.2743, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.41% (0.4033 => 0.3855, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3142 => 0.3009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.21% (0.2849 => 0.2729, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: -4.18% (0.3205 => 0.3071, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.13% (0.7198 => 0.6901, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.13% (0.2933 => 0.2812, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.00% (0.3026 => 0.2905, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.98% (0.4199 => 0.4032, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.97% (2.1713 => 2.0851, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.95% (0.2939 => 0.2823, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.87% (0.3025 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (0.9542 => 0.9176, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.78% (0.3252 => 0.3129, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4280 => 0.4126) SingleSource/Benchmarks/Shootout-C++/strcat: -3.55% (0.2989 => 0.2883, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.54% (1.3148 => 1.2683, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.52% (0.4151 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.51% (0.6347 => 0.6124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -3.29% (0.6441 => 0.6229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.15% (0.6484 => 0.6280, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.10% (0.3931 => 0.3809, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.05% (0.7779 => 0.7542, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -3.04% (0.3621 => 0.3511, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.73% (0.7919 => 0.7703, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.70% (0.3849 => 0.3745, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.66% (0.4321 => 0.4206, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: -2.57% (0.4248 => 0.4139, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2785, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7011, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.25% (1.2221 => 1.1946, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -2.23% (4.3330 => 4.2362, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.21% (1.2210 => 1.1940, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -2.11% (16.1920 => 15.8505, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.08% (1.0544 => 1.0325, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9140, std.dev.: 0.0056) MultiSource/Applications/JM/ldecod/ldecod: -1.97% (7.0961 => 6.9561, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.97% (6.7716 => 6.6381, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: -1.78% (0.9179 => 0.9016, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: -1.75% (0.7982 => 0.7842, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (1.2300 => 1.2092, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.61% (1.5610 => 1.5359, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -1.55% (2.4021 => 2.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.25% (34.0927 => 33.6666, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -1.00% (4.0594 => 4.0188, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.05% (1.8100 => 0.7050, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3127, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.31% (1.3643 => 1.0326, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7508, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -23.39% (83.5423 => 64.0041, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2090, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1289, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.16% (4.1534 => 3.8974, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1719, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.27% (7.9763 => 7.7158, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.15% (1.0557 => 1.0224, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.60% (3.7241 => 3.6274, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.43% (1.3096 => 1.2778, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1908, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8084, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.30% (1.6219 => 1.6008, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6654, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.09% (1.6086 => 1.5911, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 19:42:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 21:42:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111034205.D89F22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7479?compare_to=7475&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7479, Order: 172153, Start Time: 2013-01-11 01:31:27, End Time: 2013-01-11 03:42:05 To: 7475, Order: 172124, Start Time: 2013-01-10 22:50:45, End Time: 2013-01-11 01:01:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1334 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0655 => 0.0654, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8371 => 499.8409, std.dev.: 0.0114) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.92% (1.1277 => 499.8409, std.dev.: 0.0114) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.83% (0.5229 => 1.6410, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 19.40% (14.9895 => 17.8972, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 43.11% (14.1553 => 20.2571, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 17.08% (4.1105 => 4.8124, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.57% (1.1048 => 1.7408, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.99% (7.1582 => 37.5795, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.06% (3.4629 => 6.4083, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.54% (0.6222 => 1.0860, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10257.08% (0.0720 => 7.4571, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11177500.00% (0.0001 => 11.1776, std.dev.: 0.0378) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484100.00% (0.0001 => 5.4842, std.dev.: 0.0191) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.92% (1.1194 => 10.2864, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 148.99% (22.1758 => 55.2160, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 70.81% (0.1463 => 0.2499, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.69% (2.9384 => 4.6041, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.78% (7.0540 => 10.8477, std.dev.: 0.0141) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.38% (1.5859 => 2.3848, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) MultiSource/Benchmarks/FreeBench/distray/distray: 47.25% (0.1056 => 0.1555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.15% (8.1363 => 11.8912, std.dev.: 0.0110) SingleSource/Benchmarks/CoyoteBench/almabench: 41.23% (0.0730 => 0.1031, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.79% (2.2024 => 3.1007, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 40.39% (21.9371 => 30.7968, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 38.63% (0.3109 => 0.4310, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.84% (1.5415 => 2.0477, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.78% (4.2646 => 5.6624, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.90% (0.4615 => 0.6087, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.55% (0.1892 => 0.2451, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.50% (0.2271 => 0.2941, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 29.05% (0.4299 => 0.5548, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.31% (0.6675 => 0.8565, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 28.24% (1.1642 => 1.4930, std.dev.: 0.0096) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.62% (0.5105 => 0.6464, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 26.01% (0.0719 => 0.0906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.68% (0.0479 => 0.0602, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.49% (3.8922 => 4.8842, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 25.02% (0.1175 => 0.1469, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 24.82% (0.2554 => 0.3188, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.38% (1.0722 => 1.3336, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.46% (0.4620 => 0.5704, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.45% (0.3121 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.37% (0.1566 => 0.1932, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.36% (0.1143 => 0.1410, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.11% (1.4186 => 1.7465, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.44% (0.1337 => 0.1637, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.42% (9.4845 => 11.6108, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.50% (0.7115 => 0.8645, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 21.37% (0.3098 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.26% (0.2700 => 0.3274, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.23% (0.6456 => 0.7762, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.11% (1.3050 => 1.5674, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 19.94% (0.0662 => 0.0794, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 19.87% (5.7591 => 6.9036, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 19.86% (0.7835 => 0.9391, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/em3d/em3d: 19.53% (0.1695 => 0.2026, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.35% (4.9449 => 5.9016, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0082) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 18.84% (3.3354 => 3.9639, std.dev.: 0.0138) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.80% (0.8172 => 0.9708, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.66% (0.1940 => 0.2302, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.58% (5.0018 => 5.9311, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.17% (0.0886 => 0.1047, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.91% (0.5020 => 0.5919, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.87% (0.3307 => 0.3898, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 17.35% (0.1268 => 0.1488, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.34% (0.7433 => 0.8722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.22% (0.2758 => 0.3233, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.22% (0.1510 => 0.1770, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 16.98% (1.1840 => 1.3850, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.94% (0.9765 => 1.1419, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.81% (0.5569 => 0.6505, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899) MultiSource/Benchmarks/McCat/18-imp/imp: 16.74% (0.3423 => 0.3996, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 16.72% (0.3283 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.56% (0.2107 => 0.2456, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 16.53% (3.8723 => 4.5125, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.51% (0.2065 => 0.2406, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.27% (2.0273 => 2.3571, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 16.24% (0.3232 => 0.3757, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.12% (0.5981 => 0.6945, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.49% (0.8101 => 0.9356, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 15.47% (2.2969 => 2.6522, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.46% (0.6450 => 0.7447, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 14.62% (0.3180 => 0.3645, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.45% (0.8921 => 1.0210, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3379 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.27% (1.1861 => 1.3553, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 14.25% (0.2049 => 0.2341, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.72% (0.4636 => 0.5272, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.64% (0.3865 => 0.4392, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.60% (0.0838 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.52% (0.2603 => 0.2955, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.34% (0.8067 => 0.9143, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7603, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 12.58% (0.3387 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.56% (0.4203 => 0.4731, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3603 => 0.4039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.06% (0.4048 => 0.4536, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.04% (0.3927 => 0.4400, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.89% (0.3422 => 0.3829, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.56% (0.3684 => 0.4110, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.38% (17.1811 => 19.1362, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.16% (0.3826 => 0.4253, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 11.03% (0.3473 => 0.3856, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.90% (0.4064 => 0.4507, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.87% (0.3497 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.64% (14.3668 => 15.8952, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.49% (0.2430 => 0.2685, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.41% (0.3092 => 0.3414, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 10.21% (0.2831 => 0.3120, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.15% (0.3427 => 0.3775, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.73% (0.2877 => 0.3157, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (2.0665 => 2.2654, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.57% (0.6030 => 0.6607, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 9.46% (0.1268 => 0.1388, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.22% (0.5925 => 0.6471, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7326 => 0.7999, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.13% (0.2891 => 0.3155, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.12% (0.3650 => 0.3983, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2756 => 0.3004, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2905 => 0.3165, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.92% (0.3162 => 0.3444, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.85% (1.2842 => 1.3978, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.84% (0.3935 => 0.4283, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.3052 => 0.3317, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2802 => 0.3045, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 8.44% (0.2714 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.10% (0.3136 => 0.3390, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.81% (63.2438 => 68.1837, std.dev.: 0.0134) MultiSource/Benchmarks/PAQ8p/paq8p: 7.47% (10.3673 => 11.1419, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3652, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.98% (0.4879 => 0.5171, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.56% (0.3817 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (7.9617 => 8.1603, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2519, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6961, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.53% (4.2280 => 4.4618, std.dev.: 0.0088) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3135, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.62% (0.3316 => 0.3436, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.54% (0.9957 => 1.0309, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9092, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7162, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2913, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.71% (0.6533 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (27.8444 => 28.1604, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4582, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1683, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.84% (5.2763 => 1.1694, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.61% (0.8651 => 0.2110, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.77% (0.1622 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.46% (5.3855 => 4.4454, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.13% (5.3526 => 4.4358, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -13.77% (10.4361 => 8.9993, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.71% (1.7609 => 1.6075, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9266, std.dev.: 0.0411) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.50% (1.9577 => 0.6559, std.dev.: 0.0133) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0208, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4269, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7521, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9695 => 2.3247, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1252, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -16.22% (1.6925 => 1.4179, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7355, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -10.96% (9.5636 => 8.5155, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3170, std.dev.: 0.1094) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.08% (1.2373 => 1.1621, std.dev.: 0.0184) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.29% (8.1563 => 7.7249, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8356, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6666, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/ary3: -1.13% (3.6994 => 3.6577, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.03% (0.1485 => 0.1336, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0011) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 21:05:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 23:05:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111050547.2D45D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7480?compare_to=7477&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7480, Order: 172166, Start Time: 2013-01-11 03:23:27, End Time: 2013-01-11 05:05:49 To: 7477, Order: 172153, Start Time: 2013-01-11 01:17:39, End Time: 2013-01-11 03:02:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== Performance Regressions: 16 (10 on baseline) Performance Improvements: 19 (41 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1029 (1013 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 62.40% (0.0750 => 0.1218, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 51.69% (0.0296 => 0.0449, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 6.13% (0.4471 => 0.4745, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 3.92% (0.4794 => 0.4982, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 45.04% (3.1389 => 4.5528, std.dev.: 0.0298) SingleSource/Benchmarks/Stanford/Puzzle: 27.79% (0.1763 => 0.2253, std.dev.: 0.0140) SingleSource/Benchmarks/Stanford/Treesort: 26.28% (0.0723 => 0.0913, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 23.94% (3.1681 => 3.9267, std.dev.: 0.0549) MultiSource/Benchmarks/nbench/nbench: 14.88% (19.2419 => 22.1056, std.dev.: 0.4053) SingleSource/Benchmarks/Shootout/hash: 10.40% (4.0846 => 4.5096, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.56% (4.1584 => 4.3480, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: 3.82% (1.0101 => 1.0487, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.52% (0.4042 => 0.4144, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.84% (16.5280 => 16.8321, std.dev.: 0.0606) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.70% (2.5550 => 2.5985, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.10% (4.9850 => 5.0399, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -24.46% (0.0932 => 0.0704, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -20.72% (0.2833 => 0.2246, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: -18.56% (1.7333 => 1.4116, std.dev.: 0.0863) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.31% (0.0656 => 0.0549, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.74% (0.0756 => 0.0637, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.85% (0.1841 => 0.1586, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -12.21% (5.4978 => 4.8266, std.dev.: 0.0516) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.16% (0.1211 => 0.1088, std.dev.: 0.0026) MultiSource/Applications/siod/siod: -8.37% (2.6291 => 2.4091, std.dev.: 0.0692) MultiSource/Applications/sgefa/sgefa: -8.17% (0.3550 => 0.3260, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.4186 => 0.4001, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.31% (0.9542 => 0.9131, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.23% (1.4449 => 1.3838, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.56% (0.9485 => 0.9147, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: -3.56% (1.3015 => 1.2552, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.42% (1.2918 => 1.2606, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/sgefa/sgefa: -13.02% (0.4071 => 0.3541, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.48% (4.5680 => 4.2722, std.dev.: 0.0728) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.94% (0.2688 => 0.2582, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.83% (1.1423 => 1.1100, std.dev.: 0.1299) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.58% (0.0221 => 0.0149, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0434 => 0.0436, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0340 => 0.0338, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0320 => 0.0320, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.90% (0.0477 => 0.0425, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -21.36% (0.0220 => 0.0173, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.28% (0.0244 => 0.0236, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1539 => 0.1482, std.dev.: 0.0173) MultiSource/Applications/lemon/lemon: -8.05% (1.3218 => 1.2154, std.dev.: 0.3058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.37% (0.4226 => 0.3999, std.dev.: 0.0919) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.77% (0.1523 => 0.1496, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.21% (0.0982 => 0.0921, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.96% (0.0278 => 0.0267, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.90% (0.0618 => 0.0563, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1540 => 1.1566, std.dev.: 0.0354) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.09% (0.0033 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 188.89% (0.0009 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0609 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.43% (0.0234 => 0.0235, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.22% (0.7557 => 0.7465, std.dev.: 0.1136) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0084 => 0.0063, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.42% (12.7411 => 12.7952, std.dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 52.06% (0.0801 => 0.1218, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-1: 41.19% (0.0318 => 0.0449, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 32.69% (0.1698 => 0.2253, std.dev.: 0.0140) SingleSource/Benchmarks/Stanford/Treesort: 27.51% (0.0716 => 0.0913, std.dev.: 0.0069) MultiSource/Benchmarks/nbench/nbench: 7.77% (20.5117 => 22.1056, std.dev.: 0.4053) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.35% (4.1668 => 4.3480, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/heapsort: 1.76% (4.4739 => 4.5528, std.dev.: 0.0298) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (63.1520 => 64.1987, std.dev.: 0.0775) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.20% (4.9799 => 5.0399, std.dev.: 0.0135) MultiSource/Applications/siod/siod: 1.05% (3.5910 => 3.6286, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.56% (0.0727 => 0.0483, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -27.01% (0.1888 => 0.1378, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.52% (0.1684 => 0.1288, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.03% (0.1009 => 0.0817, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.79% (0.0676 => 0.0549, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.73% (1.0960 => 0.9346, std.dev.: 0.0243) MultiSource/Applications/aha/aha: -11.32% (0.1378 => 0.1222, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: -11.28% (2.4719 => 2.1930, std.dev.: 0.1005) MultiSource/Applications/hexxagon/hexxagon: -11.00% (1.1433 => 1.0175, std.dev.: 0.0368) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.62% (0.2372 => 0.2120, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.49% (1.3924 => 1.2464, std.dev.: 0.0537) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.08% (0.1210 => 0.1088, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.47% (0.2481 => 0.2246, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: -9.39% (0.3598 => 0.3260, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -8.87% (2.6437 => 2.4091, std.dev.: 0.0692) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.35% (0.1317 => 0.1207, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.53% (0.9422 => 0.8901, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.29% (1.3310 => 1.2606, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.85% (0.8990 => 0.8554, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.33% (0.9091 => 0.8697, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.01% (0.9512 => 0.9131, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.59% (0.9488 => 0.9147, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash2: -2.96% (0.5134 => 0.4982, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.91% (0.4121 => 0.4001, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.90% (0.0845 => 0.0736, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.68% (0.4081 => 0.3686, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.51% (2.8778 => 2.6041, std.dev.: 0.0454) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.35% (1.4588 => 1.3224, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/lists1: -7.77% (0.6628 => 0.6113, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.46% (0.3217 => 0.2977, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -6.60% (4.2042 => 3.9267, std.dev.: 0.0549) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.97% (23.3986 => 22.2355, std.dev.: 0.1216) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.40% (1.1825 => 1.1423, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: -2.59% (17.2182 => 16.7731, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.96% (0.5826 => 0.5712, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.74% (4.4730 => 4.3951, std.dev.: 0.0198) SingleSource/Benchmarks/SmallPT/smallpt: -1.56% (14.9448 => 14.7111, std.dev.: 0.0849) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.49% (3.1921 => 3.1444, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.13% (3.3596 => 3.3215, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.86% (1.2047 => 1.1100, std.dev.: 0.1299) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.05% (0.0233 => 0.0149, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.49% (0.0445 => 0.0425, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -23.79% (0.0227 => 0.0173, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.45% (0.0255 => 0.0236, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.14% (0.1530 => 0.1482, std.dev.: 0.0173) MultiSource/Applications/lemon/lemon: -37.00% (1.9293 => 1.2154, std.dev.: 0.3058) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.4049 => 0.3999, std.dev.: 0.0919) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.93% (0.1510 => 0.1496, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.83% (0.0978 => 0.0921, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.58% (0.0590 => 0.0563, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.44% (1.1617 => 1.1566, std.dev.: 0.0354) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.31% (0.0268 => 0.0235, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.38% (0.7437 => 0.7465, std.dev.: 0.1136) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.52% (0.0092 => 0.0063, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.13% (12.7781 => 12.7952, std.dev.: 0.0096) Report Time: 0.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 21:07:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 23:07:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111050740.D30102A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7481?compare_to=7478&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7481, Order: 172166, Start Time: 2013-01-11 03:33:52, End Time: 2013-01-11 05:07:41 To: 7478, Order: 172155, Start Time: 2013-01-11 01:36:21, End Time: 2013-01-11 03:10:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (868 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.14% (0.0974 => 0.1550, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.51% (0.6395 => 0.8794, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.84% (0.6395 => 0.8687, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.69% (0.6260 => 0.8369, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.40% (0.5688 => 0.7531, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.22% (0.5456 => 0.7214, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.93% (0.6230 => 0.8219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.51% (0.5567 => 0.7321, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.41% (0.5581 => 0.7334, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.30% (0.5575 => 0.7320, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.27% (0.5941 => 0.7799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.67% (0.5705 => 0.7455, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.56% (0.5802 => 0.7575, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.42% (0.6033 => 0.7868, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.10% (0.5478 => 0.7127, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.04% (0.5849 => 0.7606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.80% (0.5570 => 0.7230, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.66% (0.6440 => 0.8350, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.57% (0.5569 => 0.7216, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.47% (0.5925 => 0.7671, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.39% (0.5591 => 0.7234, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.50% (0.6189 => 0.7953, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.38% (0.5857 => 0.7519, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.34% (0.6052 => 0.7767, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.13% (0.5863 => 0.7512, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.08% (0.6446 => 0.8256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.06% (0.6676 => 0.8549, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.86% (0.6304 => 0.8060, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.33% (1.6474 => 2.0976, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.72% (0.6681 => 0.8466, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.64% (0.6194 => 0.7844, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.32% (0.6660 => 0.8413, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.08% (0.6297 => 0.7939, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.66% (0.6667 => 0.8311, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.59% (0.7524 => 0.9299, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.65% (0.7339 => 0.9001, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.05% (2.2587 => 2.7115, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.98% (1.1450 => 1.3165, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (0.1982 => 0.2211, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.40% (1.6364 => 1.8230, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.31% (0.4916 => 0.5472, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.02% (4.5069 => 5.0037, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 10.99% (0.4515 => 0.5011, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.41% (3.5339 => 3.9017, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2385 => 0.2597, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.06% (0.7021 => 0.7587, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.45% (0.2001 => 0.2150, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.02% (1.2515 => 1.3394, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.90% (0.4524 => 0.4836, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.79% (0.5329 => 0.5691, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (0.4861 => 0.5159, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.10% (9.2283 => 9.7914, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.4642 => 1.5534, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.92% (1.2784 => 1.3541, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.32% (5.4682 => 5.6497, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.29% (0.3834 => 0.3960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6750 => 0.6924, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.45% (1.3864 => 1.4204, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.25% (0.8418 => 0.8607, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 1.89% (5.0226 => 5.1174, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3874, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.05% (0.9557 => 0.9657, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6565, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4421, std.dev.: 0.0058) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1687, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.5751 => 56.4489, std.dev.: 0.2204) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.26% (2.0478 => 2.1145, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.55% (0.6469 => 0.6634, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3129, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6041, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (2.4924 => 2.3754, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.58% (0.9852 => 0.9401, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3831 => 0.3661, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.35% (0.3884 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.26% (0.4033 => 0.3861, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.20% (0.2903 => 0.2781, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.13% (0.2933 => 0.2812, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.12% (0.4176 => 0.4004, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.11% (0.3016 => 0.2892, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.03% (0.3891 => 0.3734, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -4.02% (0.3059 => 0.2936, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0864, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -3.88% (0.2939 => 0.2825, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.78% (0.3252 => 0.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (0.3025 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.9542 => 0.9193, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -3.60% (1.3148 => 1.2675, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.60% (0.4199 => 0.4048, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.58% (0.2989 => 0.2882, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.52% (0.4151 => 0.4005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.47% (0.3658 => 0.3531, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.45% (0.6484 => 0.6260, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4280 => 0.4138, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.29% (0.6441 => 0.6229, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.09% (0.3621 => 0.3509, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.95% (0.3931 => 0.3815, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.82% (0.3867 => 0.3758, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.80% (0.4321 => 0.4200, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.67% (0.7779 => 0.7571, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.51% (0.7919 => 0.7720, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2608, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/moments: -2.40% (0.4248 => 0.4146, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6987, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.28% (1.2221 => 1.1942, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.26% (14.2083 => 13.8873, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: -2.24% (4.3330 => 4.2359, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.24% (1.2210 => 1.1937, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.15% (1.0544 => 1.0317, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.03% (6.7716 => 6.6340, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.98% (16.1920 => 15.8712, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -1.98% (7.0961 => 6.9559, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.76% (0.9179 => 0.9017, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.57% (1.5610 => 1.5365, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.54% (2.4021 => 2.3652, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.42% (34.0927 => 33.6074, std.dev.: 0.0152) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.29% (1.8100 => 0.7006, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.57% (1.3643 => 1.0291, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -23.39% (83.5423 => 63.9999, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.88% (5.3397 => 4.1715, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2072, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.98% (0.4092 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.11% (1.2842 => 1.1672, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8970, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (7.9763 => 7.7301, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.77% (3.7241 => 3.6211, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.3096 => 1.2761, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.63% (4.8776 => 4.7982, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4745, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.43% (3.7092 => 3.6563, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.39% (7.3040 => 7.2023, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6083, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.07% (1.6219 => 1.6046, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 21:14:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 10 Jan 2013 23:14:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130111051408.5B61B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7482?compare_to=7473&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7482, Order: 172151, Start Time: 2013-01-11 01:33:30, End Time: 2013-01-11 05:14:08 To: 7473, Order: 172096, Start Time: 2013-01-10 20:47:05, End Time: 2013-01-11 00:23:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 11 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1093 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.70% (0.5483 => 0.5335, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.54% (27.6419 => 27.2165, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: -1.51% (2.3846 => 2.3487, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (3.1918 => 3.1473, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.38% (2.4417 => 2.4080, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: -1.33% (1.1555 => 1.1401, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.15% (5.2104 => 5.1507, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: -1.11% (6.3025 => 6.2325, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -1.09% (1.1678 => 1.1551, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (4.2207 => 4.1765, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.09% (0.4084 => 0.3958, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.68% (0.1063 => 0.1421, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.16% (0.0547 => 0.0712) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.99% (0.2969 => 0.3800, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.57% (0.0584 => 0.0745, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.17% (0.4139 => 0.5222, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.61% (0.5900 => 0.7411, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.44% (0.4253 => 0.5335, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.42% (0.0897 => 0.1125, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.23% (0.0642 => 0.0804, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.12% (0.1620 => 0.2027, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.89% (0.4994 => 0.6237, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.44% (0.5000 => 0.6222, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 24.37% (0.0948 => 0.1179, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.17% (1.5932 => 1.9782, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.03% (0.1003 => 0.1244, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.76% (0.1107 => 0.1370, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.41% (0.1021 => 0.1260, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 22.39% (0.0947 => 0.1159, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.32% (0.1604 => 0.1962, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.76% (0.1103 => 0.1343, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.70% (0.3903 => 0.4750, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.41% (0.0822 => 0.0998, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.30% (0.2014 => 0.2443, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.24% (0.1549 => 0.1878, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 21.00% (0.1619 => 0.1959, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.08% (0.4029 => 0.4838, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.39% (0.1088 => 0.1299, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.13% (0.3890 => 0.4634, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.05% (0.3271 => 0.3894, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.79% (0.2736 => 0.3250, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.77% (0.2866 => 0.3404, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 18.21% (0.5826 => 0.6887, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.14% (0.1968 => 0.2325, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 18.09% (0.5546 => 0.6549, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.96% (1.8794 => 2.2169, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.90% (0.4658 => 0.5492, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.83% (1.3152 => 1.5497, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 17.78% (0.5889 => 0.6936, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.61% (0.3004 => 0.3533, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 17.57% (0.9697 => 1.1401, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.53% (0.5026 => 0.5907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.46% (0.2875 => 0.3377, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.23% (3.5627 => 4.1765, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.12% (1.6211 => 1.8986, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 17.02% (0.2803 => 0.3280, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 17.01% (0.7171 => 0.8391, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.94% (0.2911 => 0.3404) SingleSource/Benchmarks/Shootout-C++/strcat: 16.87% (0.2750 => 0.3214, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.84% (0.2738 => 0.3199, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 16.82% (0.1284 => 0.1500, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.76% (0.2792 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.72% (0.2823 => 0.3295, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.67% (0.3060 => 0.3570, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.65% (0.2811 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.64% (0.2729 => 0.3183, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.60% (0.4361 => 0.5085, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: 16.57% (0.9909 => 1.1551, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.54% (4.4195 => 5.1507, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.48% (2.0673 => 2.4080, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.38% (0.3096 => 0.3603, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 16.35% (1.0781 => 1.2544, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.21% (0.3930 => 0.4567, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.15% (0.3195 => 0.3711, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.01% (0.3267 => 0.3790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.93% (0.3258 => 0.3777, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.82% (0.3362 => 0.3894, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.76% (1.9694 => 2.2797, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.75% (0.3124 => 0.3616, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.72% (23.5202 => 27.2165, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 15.71% (0.3317 => 0.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.63% (0.4146 => 0.4794, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.59% (1.9966 => 2.3078, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: 15.46% (4.2109 => 4.8618, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/moments: 15.42% (0.3678 => 0.4245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 15.41% (0.3726 => 0.4300, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.39% (0.3477 => 0.4012, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.32% (2.7292 => 3.1473, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: 15.26% (0.3348 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.14% (0.1090 => 0.1255, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.08% (0.2566 => 0.2953, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.06% (0.3625 => 0.4171, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 15.01% (0.4251 => 0.4889, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 14.98% (1.4269 => 1.6406, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.93% (0.3690 => 0.4241, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.80% (0.3981 => 0.4570) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.72% (0.3845 => 0.4411, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 14.21% (0.5012 => 0.5724, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3465 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.91% (0.1028 => 0.1171, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.82% (0.3488 => 0.3970, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 13.82% (0.3496 => 0.3979, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: 13.81% (0.3469 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.74% (0.3442 => 0.3915, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.66% (0.7875 => 0.8951, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: 13.56% (0.3650 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.49% (0.2075 => 0.2355, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 13.40% (0.3643 => 0.4131, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.29% (0.3724 => 0.4219, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.27% (0.6435 => 0.7289, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.06% (2.1653 => 2.4481, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.71% (0.2737 => 0.3085, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.48% (0.2068 => 0.2326, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 12.47% (5.5417 => 6.2325, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 12.45% (0.2691 => 0.3026, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 12.38% (4.6177 => 5.1894, std.dev.: 0.0237) MultiSource/Applications/lambda-0_1_3/lambda: 11.89% (0.3498 => 0.3914, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 11.77% (2.1013 => 2.3487, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.71% (0.3084 => 0.3445, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 11.36% (0.3336 => 0.3715, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.22% (0.2103 => 0.2339, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.14% (0.5361 => 0.5958, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.12% (11.6398 => 12.9344, std.dev.: 0.0165) MultiSource/Applications/siod/siod: 11.03% (0.6634 => 0.7366, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.62% (4.6926 => 5.1911, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (0.4847 => 0.5359, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.30% (0.7426 => 0.8191, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.05% (0.2040 => 0.2245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.43% (0.5584 => 0.6055, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 8.41% (0.2391 => 0.2592, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 8.24% (2.0346 => 2.2023, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.11% (11.9555 => 12.9248, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.81% (0.1383 => 0.1491, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3792 => 0.3962, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5106, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.99% (0.2802 => 0.3110, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.18% (0.3693 => 0.3958, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6124, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6762, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2380, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6775, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 4.64% (1.8057 => 1.8894, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2014, std.dev.: 0.0578) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3133, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2826, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2095, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.10% (10.3705 => 10.4847, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5913, std.dev.: 0.0223) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5633, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: -16.82% (17.2379 => 14.3390, std.dev.: 0.0813) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8060, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -6.00% (0.2402 => 0.2258, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2226, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -3.65% (14.0481 => 13.5350, std.dev.: 0.1506) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8009, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7730, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.83% (0.6293 => 0.6115, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1873, std.dev.: 0.0518) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5810, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2352, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0462, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 22:22:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 00:22:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111062259.62E762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7483?compare_to=7479&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7483, Order: 172166, Start Time: 2013-01-11 04:12:04, End Time: 2013-01-11 06:22:57 To: 7479, Order: 172153, Start Time: 2013-01-11 01:31:27, End Time: 2013-01-11 03:42:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1336 => 0.1335, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0654 => 0.0654, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8409 => 499.7671, std.dev.: 0.0467) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44217.38% (1.1277 => 499.7671, std.dev.: 0.0467) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.42% (0.5229 => 1.6441, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 19.55% (14.9895 => 17.9205, std.dev.: 0.0169) MultiSource/Applications/kimwitu++/kc: 43.44% (14.1553 => 20.3045, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 17.47% (4.1105 => 4.8286, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.50% (1.1048 => 1.7401, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.26% (7.1582 => 37.6711, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.08% (3.4629 => 6.4093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.64% (0.6222 => 1.0866, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10254.72% (0.0720 => 7.4554, std.dev.: 0.0134) MultiSource/Applications/SIBsim4/SIBsim4: 3835400.00% (0.0001 => 3.8355, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11199300.00% (0.0001 => 11.1994, std.dev.: 0.0263) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488500.00% (0.0001 => 5.4886, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.05% (1.1194 => 10.2879, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 149.20% (22.1758 => 55.2616, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.19% (2.9384 => 4.6189, std.dev.: 0.0015) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.55% (7.0540 => 10.8312, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.82% (1.5859 => 2.3918, std.dev.: 0.0168) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/factor: 47.64% (0.0296 => 0.0437, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 47.63% (0.1056 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.21% (8.1363 => 11.8963, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.94% (2.2024 => 3.1040, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: 40.54% (21.9371 => 30.8305, std.dev.: 0.0109) MultiSource/Applications/sgefa/sgefa: 38.79% (0.3109 => 0.4315, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608) SingleSource/Benchmarks/Misc/flops: 38.41% (0.1432 => 0.1982, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.96% (4.2646 => 5.6700, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.85% (1.5415 => 2.0479, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.98% (0.4615 => 0.6091, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.65% (0.1892 => 0.2453, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.55% (0.2271 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 28.37% (1.1642 => 1.4945, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.33% (0.6675 => 0.8566, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.52% (0.5105 => 0.6459, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.38% (3.8922 => 4.8801, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 25.37% (0.2554 => 0.3202, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.28% (0.1143 => 0.1432, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.45% (1.0722 => 1.3344, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 24.20% (0.4289 => 0.5327, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.55% (0.4620 => 0.5708, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.36% (0.3121 => 0.3850, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.21% (1.4186 => 1.7479, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.54% (9.4845 => 11.6226, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.51% (0.1337 => 0.1638, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818) MultiSource/Applications/minisat/minisat: 21.62% (0.7115 => 0.8653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.44% (0.2700 => 0.3279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.28% (0.6456 => 0.7765, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.20% (1.3050 => 1.5686, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 19.97% (5.7591 => 6.9094, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.94% (0.7835 => 0.9397, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 19.65% (0.1695 => 0.2028, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.42% (4.9449 => 5.9050, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.34% (0.1029 => 0.1228, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 19.11% (0.1151 => 0.1371, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.85% (3.3354 => 3.9640, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.83% (0.8172 => 0.9711, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.76% (0.1940 => 0.2304, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.66% (5.0018 => 5.9349, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.99% (0.3307 => 0.3902, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.97% (0.5020 => 0.5922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.5569 => 0.6550, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.54% (0.7433 => 0.8737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.28% (0.1510 => 0.1771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.11% (0.9765 => 1.1436, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 17.00% (0.3423 => 0.4005, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 17.00% (1.1840 => 1.3853, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.75% (0.2107 => 0.2460, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.62% (3.8723 => 4.5158, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.61% (0.2065 => 0.2408, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 16.44% (2.0273 => 2.3606, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.40% (0.5981 => 0.6962, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 16.37% (0.3232 => 0.3761, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.74% (2.2969 => 2.6584, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.72% (0.3441 => 0.3982, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.63% (0.8101 => 0.9367, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.61% (0.1044 => 0.1207, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.61% (0.6450 => 0.7457, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 14.84% (0.3180 => 0.3652, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.47% (0.8921 => 1.0212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.41% (0.3379 => 0.3866, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 14.40% (0.2049 => 0.2344, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.33% (1.1861 => 1.3561, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.85% (0.8067 => 0.9184, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.48% (0.2603 => 0.2954, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.36% (0.4103 => 0.4651, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.05% (0.4636 => 0.5241, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 13.05% (1.5603 => 1.7639, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 12.78% (0.3387 => 0.3820, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.78% (0.4203 => 0.4740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.25% (0.4048 => 0.4544, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3927 => 0.4407, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 12.16% (0.3603 => 0.4041, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.94% (0.3886 => 0.4350, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.92% (0.3422 => 0.3830, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.64% (17.1811 => 19.1810, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 11.62% (0.3684 => 0.4112, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.33% (0.3282 => 0.3654, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.4064 => 0.4513, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.65% (14.3668 => 15.8975, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2430 => 0.2686, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.51% (0.3092 => 0.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.35% (0.2831 => 0.3124, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.24% (0.3427 => 0.3778, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.80% (0.2877 => 0.3159, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.70% (2.0665 => 2.2669, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: 9.50% (0.6030 => 0.6603, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.19% (0.2905 => 0.3172, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.19% (0.7326 => 0.7999, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.11% (0.3162 => 0.3450, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.07% (0.1114 => 0.1215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.06% (0.2891 => 0.3153, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.05% (0.2872 => 0.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2756 => 0.3004, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.97% (0.3935 => 0.4288, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 8.97% (1.2842 => 1.3994, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 8.89% (0.2802 => 0.3051, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.70% (0.2725 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2714 => 0.2946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.02% (63.2438 => 68.3142, std.dev.: 0.0249) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.08% (2.2022 => 2.3582, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 6.63% (10.3673 => 11.0549, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.4879 => 0.5181, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.54% (0.3817 => 0.3952, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.56% (7.9617 => 8.1657, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.27% (32.5116 => 59.2596, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4499, std.dev.: 0.0163) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.39% (0.9957 => 1.0394, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.6802 => 8.9256, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.27% (3.6395 => 3.7222, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2894, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.85% (1.7254 => 1.7573, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.70% (0.6533 => 0.6644, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1623, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5797, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4554, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.80% (5.2763 => 1.1712, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.62% (0.8651 => 0.2109, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.77% (0.1622 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.40% (5.3855 => 4.4486, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.10% (5.3526 => 4.4374, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -13.63% (10.4361 => 9.0134, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.63% (1.7609 => 1.6090, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9610, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.95% (1.9577 => 0.6665, std.dev.: 0.0100) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3052, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4296, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7506, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0084, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1247, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7318, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5169, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2686, std.dev.: 0.0306) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.64% (1.2373 => 1.1551, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (8.1563 => 7.7402, std.dev.: 0.0134) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.83% (0.4808 => 0.4576, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -4.51% (10.2830 => 9.8194, std.dev.: 0.0195) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.54% (3.6994 => 3.6424, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.51% (3.7221 => 3.6659, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.11% (6.2999 => 6.2301, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.10% (0.1485 => 0.1335, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0012) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 23:00:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 01:00:20 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111070020.A42BD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7484?compare_to=7480&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7484, Order: 172172, Start Time: 2013-01-11 05:22:58, End Time: 2013-01-11 07:00:22 To: 7480, Order: 172166, Start Time: 2013-01-11 03:23:27, End Time: 2013-01-11 05:05:49 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== Performance Regressions: 5 (2 on baseline) Performance Improvements: 37 (178 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1022 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.07% (0.5177 => 0.5284, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.51% (4.7553 => 4.8273, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/except: 3.40% (0.4918 => 0.5085, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: 3.17% (49.2490 => 50.8088, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/pi: 2.61% (2.1530 => 2.2091, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -38.51% (0.1218 => 0.0749, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-1: -33.63% (0.0449 => 0.0298, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: -6.21% (0.1963 => 0.1841, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: -5.95% (0.2319 => 0.2181, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2023 => 0.1917, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.19% (0.7666 => 0.7268, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: -4.87% (0.2096 => 0.1994, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: -4.81% (0.6757 => 0.6432, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: -4.62% (0.4745 => 0.4526, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -4.33% (0.2586 => 0.2474, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -4.31% (0.2692 => 0.2576, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.84% (1.7608 => 1.6931, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.68% (2.4766 => 2.3854, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: -3.26% (0.3500 => 0.3386, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -3.21% (0.4982 => 0.4822, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.07% (0.5083 => 0.4927, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.84% (3.4972 => 3.4328, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.79% (5.8233 => 5.7190, std.dev.: 0.0152) MultiSource/Applications/kimwitu++/kc: -1.27% (18.4945 => 18.2595, std.dev.: 0.0636) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: -26.07% (0.0913 => 0.0675, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/heapsort: -25.73% (4.5528 => 3.3812, std.dev.: 0.0890) SingleSource/Benchmarks/Stanford/Puzzle: -24.10% (0.2253 => 0.1710, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/heapsort: -18.62% (3.9267 => 3.1957, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout/hash: -8.64% (4.5096 => 4.1200, std.dev.: 0.0935) SingleSource/Benchmarks/Shootout-C++/ary3: -8.32% (1.8910 => 1.7337, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.39% (16.8321 => 15.5878, std.dev.: 0.4222) SingleSource/Benchmarks/Misc-C++/stepanov_container: -6.30% (4.8492 => 4.5438, std.dev.: 0.0401) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.61% (43.3257 => 40.8947, std.dev.: 0.4726) SingleSource/Benchmarks/CoyoteBench/lpbench: -4.43% (4.2809 => 4.0914, std.dev.: 0.0583) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.57% (61.4618 => 59.8832, std.dev.: 0.1327) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.30% (4.1128 => 4.0184, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.07% (2.4443 => 2.3937, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.86% (2.5985 => 2.5501, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: -1.46% (3.8348 => 3.7790, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/FloatMM: -1.33% (0.8318 => 0.8207, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.27% (5.0399 => 4.9761, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.16% (1.4611 => 1.4442, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.16% (1.1100 => 1.0971, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.74% (0.0149 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0436 => 0.0434, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.54% (0.0338 => 0.0299, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0320 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.65% (0.0425 => 0.0418, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -1.73% (0.0173 => 0.0170, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.41% (0.0236 => 0.0202, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.89% (0.1482 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -5.24% (1.2154 => 1.1517, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.08% (0.3999 => 0.4002, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.81% (0.1496 => 0.1454, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.65% (0.0921 => 0.0927, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -16.10% (0.0267 => 0.0224, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.62% (0.0563 => 0.0537, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.77% (1.1566 => 1.1477, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0030 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.06% (0.0607 => 0.0552, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.43% (0.0235 => 0.0187, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.10% (0.7465 => 0.7383, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.10% (0.0063 => 0.0039, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.21% (12.7952 => 12.8224, std.dev.: 0.0725) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 3.28% (2.1390 => 2.2091, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (63.1520 => 64.1182, std.dev.: 0.2128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.99% (0.0808 => 0.0493, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.29% (0.0727 => 0.0485, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -31.79% (0.0692 => 0.0472, std.dev.: 0.0015) SingleSource/Benchmarks/SmallPT/smallpt: -26.48% (0.1888 => 0.1388, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.46% (0.1684 => 0.1289, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -23.08% (0.1079 => 0.0830, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.82% (0.1009 => 0.0809, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -19.58% (1.8964 => 1.5250, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.38% (0.0676 => 0.0545, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.59% (0.7686 => 0.6334, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.55% (1.0960 => 0.9036, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.57% (1.0986 => 0.9275, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -14.98% (0.0681 => 0.0579, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -13.94% (9.8875 => 8.5090, std.dev.: 0.0929) MultiSource/Applications/spiff/spiff: -13.41% (1.0220 => 0.8849, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.21% (0.4074 => 0.3536, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.28% (0.0847 => 0.0743, std.dev.: 0.0037) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.20% (1.2154 => 1.0671, std.dev.: 0.0201) MultiSource/Applications/hexxagon/hexxagon: -12.16% (1.1433 => 1.0043, std.dev.: 0.0103) MultiSource/Applications/Burg/burg: -11.64% (1.5979 => 1.4119, std.dev.: 0.0113) MultiSource/Applications/aha/aha: -11.39% (0.1378 => 0.1221, std.dev.: 0.0041) MultiSource/Applications/lua/lua: -11.10% (4.6406 => 4.1257, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.03% (1.3924 => 1.2388, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.97% (6.4235 => 5.7190, std.dev.: 0.0152) MultiSource/Applications/treecc/treecc: -10.81% (2.4719 => 2.2048, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.35% (10.2703 => 9.2076, std.dev.: 0.1306) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.95% (0.2372 => 0.2136, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.80% (1.5131 => 1.3648, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.75% (0.1210 => 0.1092, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.56% (0.9124 => 0.8252, std.dev.: 0.0147) MultiSource/Applications/sgefa/sgefa: -9.51% (0.3598 => 0.3256, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.32% (0.7693 => 0.6976, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -9.31% (2.6437 => 2.3976, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.30% (1.1498 => 1.0429, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.14% (0.6885 => 0.6256, std.dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: -9.01% (0.8653 => 0.7873, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.81% (0.1317 => 0.1201, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -8.71% (17.5634 => 16.0340, std.dev.: 0.1814) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.63% (1.6874 => 1.5417, std.dev.: 0.0188) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.52% (1.1731 => 1.0731, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: -8.45% (17.4365 => 15.9633, std.dev.: 0.0355) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.23% (0.3560 => 0.3267, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.16% (0.9588 => 0.8806, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/health/health: -7.64% (0.1610 => 0.1487, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -7.13% (0.2006 => 0.1863, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -7.07% (0.4002 => 0.3719, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.89% (0.5746 => 0.5350, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.82% (1.0017 => 0.9334, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.62% (0.1587 => 0.1482, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.60% (1.8127 => 1.6931, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.45% (1.3310 => 1.2452, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.42% (0.2618 => 0.2450, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: -6.41% (0.1824 => 0.1707, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.37% (0.2481 => 0.2323, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.29% (0.2100 => 0.1968, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.27% (0.2615 => 0.2451, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -6.22% (1.3979 => 1.3110, std.dev.: 0.0053) MultiSource/Applications/d/make_dparser: -6.15% (3.7840 => 3.5511, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/matrix: -6.12% (0.2385 => 0.2239, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -6.08% (0.5134 => 0.4822, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.94% (0.9550 => 0.8983, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.83% (0.1955 => 0.1841, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.69% (0.2283 => 0.2153, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.3665 => 0.3457, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.60% (0.9422 => 0.8894, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.57% (0.3462 => 0.3269, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (0.7693 => 0.7268, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: -5.51% (0.2305 => 0.2178, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.46% (1.0234 => 0.9675, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: -5.43% (0.2725 => 0.2577, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.42% (3.6295 => 3.4328, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hello: -5.39% (0.1928 => 0.1824, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2884 => 0.2730, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.08% (0.9512 => 0.9029, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.04% (0.9507 => 0.9028, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.97% (0.9788 => 0.9302, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.96% (0.9091 => 0.8640, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.95% (0.3093 => 0.2940, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.91% (0.2709 => 0.2576, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.91% (0.8990 => 0.8549, std.dev.: 0.0072) MultiSource/Benchmarks/sim/sim: -4.90% (0.3715 => 0.3533, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.86% (0.9127 => 0.8683, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.77% (1.0052 => 0.9573, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -4.73% (0.2135 => 0.2034, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.67% (1.3220 => 1.2602, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/except: -4.65% (0.2172 => 0.2071, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.60% (0.3981 => 0.3798, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.58% (0.6135 => 0.5854, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.54% (0.9405 => 0.8978, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.27% (1.2680 => 1.2139, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: -4.24% (1.4392 => 1.3782, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.23% (0.9403 => 0.9005, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: -4.23% (0.7776 => 0.7447, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6711 => 0.6432, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.12% (5.0381 => 4.8303, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/ary: -4.00% (0.2551 => 0.2449, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.78% (0.6934 => 0.6672, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.68% (0.3394 => 0.3269, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: -3.62% (0.3206 => 0.3090, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.59% (0.9214 => 0.8883, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -3.58% (18.9377 => 18.2595, std.dev.: 0.0636) SingleSource/Benchmarks/Shootout-C++/hash: -3.48% (0.4689 => 0.4526, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -3.45% (16.4479 => 15.8797, std.dev.: 0.1461) MultiSource/Benchmarks/Olden/bh/bh: -3.45% (0.3273 => 0.3160, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -3.37% (4.5936 => 4.4388, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.35% (1.0119 => 0.9780, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.33% (0.9488 => 0.9172, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.12% (4.6579 => 4.5125, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.10% (0.9061 => 0.8780, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.07% (0.4762 => 0.4616, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.96% (0.4121 => 0.3999, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.71% (2.4519 => 2.3854, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.70% (0.8893 => 0.8653, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.67% (0.8926 => 0.8688, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.61% (0.5059 => 0.4927, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.53% (0.8732 => 0.8511, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.43% (0.9612 => 0.9378, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.39% (14.9757 => 14.6171, std.dev.: 0.0965) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.39% (0.9381 => 0.9157, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -2.28% (7.3529 => 7.1849, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.20% (1.8651 => 1.8241, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/05-eks/eks: -2.18% (0.4776 => 0.4672, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.91% (0.9998 => 0.9807, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.89% (7.2721 => 7.1350, std.dev.: 0.0342) MultiSource/Applications/JM/lencod/lencod: -1.78% (16.7012 => 16.4046, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.60% (0.9564 => 0.9411, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.55% (0.8846 => 0.8709, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.53% (0.9759 => 0.9610, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.45% (0.9120 => 0.8988, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.29% (4.8904 => 4.8273, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.09% (1.0867 => 1.0749, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.93% (0.9372 => 0.6473, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/heapsort: -24.42% (4.4739 => 3.3812, std.dev.: 0.0890) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.99% (4.2042 => 3.1957, std.dev.: 0.0316) MultiSource/Applications/minisat/minisat: -22.16% (7.9891 => 6.2188, std.dev.: 0.0825) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.39% (1.5623 => 1.2593, std.dev.: 0.0333) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.38% (1.0816 => 0.8720, std.dev.: 0.0328) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.59% (2.8778 => 2.3428, std.dev.: 0.1383) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.87% (0.1164 => 0.0956, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.27% (0.0845 => 0.0716, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.16% (1.4235 => 1.2647, std.dev.: 0.0203) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.88% (5.0421 => 4.5438, std.dev.: 0.0401) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.69% (1.4588 => 1.3174, std.dev.: 0.0275) MultiSource/Applications/SPASS/SPASS: -9.09% (9.0650 => 8.2414, std.dev.: 0.2754) SingleSource/Benchmarks/Shootout/hash: -8.97% (4.5259 => 4.1200, std.dev.: 0.0935) SingleSource/Benchmarks/Shootout-C++/lists1: -8.65% (0.6628 => 0.6055, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.14% (4.4540 => 4.0914, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout/nestedloop: -8.09% (0.2200 => 0.2022, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: -7.04% (0.1704 => 0.1584, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.54% (16.6791 => 15.5878, std.dev.: 0.4222) MultiSource/Benchmarks/Olden/health/health: -6.43% (0.3654 => 0.3419, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.17% (23.3986 => 21.9547, std.dev.: 0.2918) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.45% (46.0987 => 43.5867, std.dev.: 0.8253) SingleSource/Benchmarks/Shootout/ary3: -5.35% (2.2304 => 2.1110, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.23% (0.3349 => 0.3174, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.34% (1.8123 => 1.7337, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -3.48% (17.2182 => 16.6194, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.44% (1.1825 => 1.1418, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -3.40% (4.4730 => 4.3209, std.dev.: 0.0347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.37% (42.3194 => 40.8947, std.dev.: 0.4726) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.32% (1.4446 => 1.3966, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.19% (0.3201 => 0.3099, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.78% (0.5826 => 0.5664, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.77% (2.5170 => 2.4474, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.32% (3.0082 => 2.9385, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.29% (2.4498 => 2.3937, std.dev.: 0.0064) MultiSource/Applications/spiff/spiff: -2.19% (2.8571 => 2.7945, std.dev.: 0.0129) MultiSource/Applications/lua/lua: -2.07% (29.0327 => 28.4305, std.dev.: 0.1300) SingleSource/Benchmarks/Misc/mandel-2: -1.91% (0.8521 => 0.8358, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.89% (61.0379 => 59.8832, std.dev.: 0.1327) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.57% (3.3596 => 3.3067, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.2040 => 7.0970, std.dev.: 0.0100) SingleSource/Benchmarks/Stanford/FloatMM: -1.45% (0.8328 => 0.8207, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.34% (3.7662 => 3.7159, std.dev.: 0.0183) SingleSource/Benchmarks/SmallPT/smallpt: -1.29% (14.9448 => 14.7521, std.dev.: 0.0194) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.93% (1.2047 => 1.0971, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.18% (0.0233 => 0.0165, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.11% (0.0394 => 0.0299, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.07% (0.0445 => 0.0418, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -25.11% (0.0227 => 0.0170, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.78% (0.0255 => 0.0202, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.97% (0.1530 => 0.1454, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -40.30% (1.9293 => 1.1517, std.dev.: 0.0308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.16% (0.4049 => 0.4002, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.71% (0.1510 => 0.1454, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.21% (0.0978 => 0.0927, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.84% (0.0276 => 0.0224, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.98% (0.0590 => 0.0537, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1477, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.12% (0.0032 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.51% (0.0610 => 0.0552, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.22% (0.0268 => 0.0187, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.73% (0.7437 => 0.7383, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.61% (0.0092 => 0.0039, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.35% (12.7781 => 12.8224, std.dev.: 0.0725) Report Time: 0.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 10 23:04:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 01:04:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111070433.8E59E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7485?compare_to=7481&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7485, Order: 172172, Start Time: 2013-01-11 05:31:07, End Time: 2013-01-11 07:04:34 To: 7481, Order: 172166, Start Time: 2013-01-11 03:33:52, End Time: 2013-01-11 05:07:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.42% (0.6395 => 0.8788, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.64% (0.6395 => 0.8674, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.48% (0.6260 => 0.8356, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.31% (0.5688 => 0.7526, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.41% (0.5575 => 0.7326, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.37% (0.5581 => 0.7332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.36% (0.5567 => 0.7313, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.07% (0.5941 => 0.7787, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.70% (0.5802 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.60% (0.5705 => 0.7451, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.04% (0.5849 => 0.7606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.04% (0.5859 => 0.7619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.99% (0.5478 => 0.7121, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.71% (0.5570 => 0.7225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.50% (0.5569 => 0.7212, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.35% (0.5925 => 0.7664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.33% (0.6440 => 0.8329, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.26% (0.5591 => 0.7227, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 28.95% (0.0418 => 0.0539, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.33% (0.5863 => 0.7524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.29% (0.6052 => 0.7764, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.19% (0.5857 => 0.7508, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.05% (0.6446 => 0.8254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.00% (0.6676 => 0.8545, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.84% (0.6304 => 0.8059, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.21% (1.6474 => 2.0957, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.64% (0.6681 => 0.8461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.46% (0.6194 => 0.7833, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.23% (0.6660 => 0.8407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.95% (0.6297 => 0.7931, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.52% (0.7524 => 0.9294, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.56% (0.7339 => 0.8995, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.99% (2.2587 => 2.7103, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3159, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.43% (1.6364 => 1.8235, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.39% (0.4916 => 0.5476, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.30% (0.4515 => 0.5025, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.07% (4.5069 => 5.0058, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.29% (3.5339 => 3.8977, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.95% (0.7021 => 0.7579, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.98% (1.2515 => 1.3388, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.77% (0.5329 => 0.5690, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4524 => 0.4825, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.12% (1.4642 => 1.5538, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (9.2283 => 9.7906, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 5.88% (0.4861 => 0.5147, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.86% (1.2784 => 1.3533, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.22% (5.4682 => 5.6443, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.58% (0.6750 => 0.6924, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.40% (1.3864 => 1.4197, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.03% (0.8418 => 0.8589, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 1.96% (5.0226 => 5.1210, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.3722 => 1.3866, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6641, std.dev.: 0.0365) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9531 => 1.0287, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1682, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4015, std.dev.: 0.0885) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.54% (0.6469 => 0.6633, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3128, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6026, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.03% (79.7170 => 80.5357, std.dev.: 0.2690) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.10% (0.3821 => 0.3626, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (2.4924 => 2.3738, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.73% (0.9852 => 0.9386, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (0.2903 => 0.2775, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3142 => 0.3006, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.14% (0.7198 => 0.6900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.06% (2.1713 => 2.0831, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.91% (0.3252 => 0.3125, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.90% (1.3148 => 1.2635, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.77% (0.9542 => 0.9182, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.67% (0.3812 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.60% (0.4033 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.59% (0.3896 => 0.3756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.54% (0.4151 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3884 => 0.3747, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.39% (0.3658 => 0.3534, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.4176 => 0.4036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.24% (0.6441 => 0.6232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.24% (0.3891 => 0.3765, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -3.23% (0.3621 => 0.3504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.10% (0.3931 => 0.3809, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.99% (0.3849 => 0.3734, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.98% (0.4199 => 0.4074, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.94% (0.4427 => 0.4297, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1970, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.73% (0.4321 => 0.4203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.69% (0.3788 => 0.3686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.65% (0.7779 => 0.7573, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4280 => 0.4172, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.51% (0.7919 => 0.7720, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.44% (17.1032 => 16.6857, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.30% (1.2210 => 1.1929, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.29% (1.0544 => 1.0303, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.28% (1.2221 => 1.1942, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (14.2083 => 13.8860, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: -2.25% (4.3330 => 4.2354, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: -2.04% (16.1920 => 15.8614, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: -1.98% (0.7982 => 0.7824, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.98% (6.7716 => 6.6377, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: -1.93% (7.0961 => 6.9588, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.81% (34.0927 => 33.4760, std.dev.: 0.0172) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.71% (0.8521 => 0.8375, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.61% (1.2300 => 1.2102, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -1.53% (1.5610 => 1.5371, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -1.43% (2.4021 => 2.3677, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.45% (1.8100 => 0.6797, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.81% (1.3643 => 1.0258, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9967, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2075, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.17% (4.1534 => 3.8970, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (7.9763 => 7.7234, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.76% (1.3096 => 1.2735, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.26% (3.7241 => 3.6399, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.65% (1.6307 => 1.6038, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8026, std.dev.: 0.0101) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1933, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.44% (1.6219 => 1.5986, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5887, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 01:05:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 03:05:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111090549.8AD0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7486?compare_to=7483&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7486, Order: 172172, Start Time: 2013-01-11 06:53:00, End Time: 2013-01-11 09:05:48 To: 7483, Order: 172166, Start Time: 2013-01-11 04:12:04, End Time: 2013-01-11 06:22:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (211 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (661 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1335 => 0.1335, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.38% (0.0654 => 0.0663, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -1.26% (499.7671 => 493.4519, std.dev.: 3.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 43657.37% (1.1277 => 493.4519, std.dev.: 3.0033) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.71% (0.5229 => 1.6456, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 19.50% (14.9895 => 17.9124, std.dev.: 0.0413) MultiSource/Applications/kimwitu++/kc: 43.39% (14.1553 => 20.2979, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 17.51% (4.1105 => 4.8302, std.dev.: 0.1687) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.75% (1.1048 => 1.7428, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.48% (7.1582 => 37.6867, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.46% (3.4629 => 6.4223, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.48% (0.6222 => 1.0856, std.dev.: 0.0077) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10250.83% (0.0720 => 7.4526, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11133200.00% (0.0001 => 11.1333, std.dev.: 0.0324) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64700.00% (0.0001 => 0.0648, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485300.00% (0.0001 => 5.4854, std.dev.: 0.0043) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.83% (1.1194 => 10.3190, std.dev.: 0.0186) MultiSource/Applications/ClamAV/clamscan: 149.66% (22.1758 => 55.3639, std.dev.: 0.0503) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0040) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.93% (2.9384 => 4.6113, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.04% (7.0540 => 10.8660, std.dev.: 0.0222) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.37% (1.5859 => 2.3847, std.dev.: 0.0130) SingleSource/UnitTests/SignlessTypes/factor: 47.97% (0.0296 => 0.0438, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.53% (8.1363 => 11.9225, std.dev.: 0.2481) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.86% (2.2024 => 3.1022, std.dev.: 0.0203) MultiSource/Applications/JM/lencod/lencod: 40.39% (21.9371 => 30.7973, std.dev.: 0.0379) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 38.69% (0.3109 => 0.4312, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0009) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.09% (1.5415 => 2.0516, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.92% (4.2646 => 5.6683, std.dev.: 0.1495) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.46% (0.4615 => 0.6113, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 31.33% (0.0814 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.03% (0.2271 => 0.2953, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.44% (0.1892 => 0.2449, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 29.12% (0.4299 => 0.5551, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4949, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.36% (0.6675 => 0.8568, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.62% (0.5105 => 0.6464, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 26.15% (0.0719 => 0.0907, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 25.56% (0.1655 => 0.2078, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.39% (3.8922 => 4.8803, std.dev.: 0.0200) MultiSource/Benchmarks/McCat/08-main/main: 25.22% (0.2554 => 0.3198, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.09% (0.0793 => 0.0992, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 24.36% (1.0722 => 1.3334, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: 23.83% (0.4289 => 0.5311, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.73% (1.4186 => 1.7553, std.dev.: 0.0424) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.29% (0.3121 => 0.3848, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 23.20% (0.4620 => 0.5692, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 22.53% (9.4845 => 11.6217, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.51% (0.1337 => 0.1638, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817) MultiSource/Applications/minisat/minisat: 21.49% (0.7115 => 0.8644, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.48% (0.2700 => 0.3280, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/matrix: 21.14% (0.3098 => 0.3753, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.32% (0.7835 => 0.9427, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.28% (1.3050 => 1.5697, std.dev.: 0.0416) SingleSource/Benchmarks/Misc-C++/bigfib: 20.24% (0.6456 => 0.7763, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 20.20% (0.0614 => 0.0738, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 19.96% (5.7591 => 6.9085, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/messages-2: 19.94% (0.0662 => 0.0794, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/em3d/em3d: 19.65% (0.1695 => 0.2028, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.59% (4.9449 => 5.9137, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.32% (0.5860 => 0.6992, std.dev.: 0.0209) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.24% (0.8172 => 0.9744, std.dev.: 0.0174) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 19.20% (0.1151 => 0.1372, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 18.83% (3.3354 => 3.9633, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.79% (5.0018 => 5.9417, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.31% (0.2758 => 0.3263, std.dev.: 0.0164) MultiSource/Benchmarks/nbench/nbench: 18.06% (1.1840 => 1.3978, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.02% (0.3307 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.93% (0.5020 => 0.5920, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.44% (0.5569 => 0.6540, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0059) MultiSource/Applications/lambda-0_1_3/lambda: 17.27% (0.7433 => 0.8717, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.18% (0.9765 => 1.1443, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/18-imp/imp: 16.86% (0.3423 => 0.4000, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 16.74% (3.8723 => 4.5205, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.64% (0.6450 => 0.7523, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.55% (0.5981 => 0.6971, std.dev.: 0.0204) MultiSource/Applications/treecc/treecc: 16.39% (2.0273 => 2.3596, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.21% (0.8101 => 0.9414, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.72% (0.3441 => 0.3982, std.dev.: 0.0116) MultiSource/Applications/siod/siod: 15.57% (2.2969 => 2.6545, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.78% (0.3180 => 0.3650, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.75% (1.1861 => 1.3611, std.dev.: 0.0371) MultiSource/Benchmarks/Prolangs-C/football/football: 14.49% (0.8921 => 1.0214, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/ReedSolomon: 14.45% (0.2049 => 0.2345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307) SingleSource/Benchmarks/Shootout-C++/ary2: 14.00% (0.3379 => 0.3852, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.86% (0.8067 => 0.9185, std.dev.: 0.0327) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.56% (0.2603 => 0.2956, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.56% (0.3865 => 0.4389, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.11% (0.4636 => 0.5244, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 12.75% (0.3387 => 0.3819, std.dev.: 0.0068) MultiSource/Applications/hbd/hbd: 12.67% (1.5603 => 1.7580, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.50% (0.4103 => 0.4616, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.30% (0.4203 => 0.4720, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3927 => 0.4407, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 11.96% (0.4048 => 0.4532) SingleSource/UnitTests/ObjC/property: 11.91% (0.3886 => 0.4349, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 11.57% (0.3422 => 0.3818, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.55% (17.1811 => 19.1647, std.dev.: 0.0168) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.48% (0.2430 => 0.2709, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.40% (0.3282 => 0.3656, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.26% (0.3684 => 0.4099, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.94% (14.3668 => 15.9380, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.79% (0.3826 => 0.4239, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 10.51% (0.3092 => 0.3417, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.33% (0.3427 => 0.3781, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.6030 => 0.6624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.59% (0.5925 => 0.6493, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.51% (0.7326 => 0.8023, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.36% (2.0665 => 2.2599, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.79% (0.2891 => 0.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.77% (0.2725 => 0.2964, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.76% (0.3162 => 0.3439, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 8.74% (1.2842 => 1.3965, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.72% (0.3935 => 0.4278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0072) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.63% (0.3650 => 0.3965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.53% (0.2872 => 0.3117, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.53% (0.2756 => 0.2991, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.25% (63.2438 => 68.4613, std.dev.: 0.0964) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.23% (0.2793 => 0.3023, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 8.14% (0.2714 => 0.2935, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.21% (2.2022 => 2.3609, std.dev.: 0.0345) MultiSource/Benchmarks/PAQ8p/paq8p: 6.53% (10.3673 => 11.0444, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.37% (0.4879 => 0.5190, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.3131 => 0.3246, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.67% (7.9617 => 8.1746, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2524, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: 9.36% (1.1396 => 1.2463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.75% (4.2280 => 4.4713, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3125, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.15% (0.9957 => 1.0271, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9004, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (3.6395 => 3.7225, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2873, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.76% (0.6533 => 0.6648, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.21% (6.5088 => 6.5875, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (27.8444 => 28.1619, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3460 => 10.4631, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.78% (5.2763 => 1.1725, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -75.53% (0.8651 => 0.2117, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.77% (0.1622 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4671, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.64% (5.3526 => 4.4618, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0187, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.55% (1.7609 => 1.6103, std.dev.: 0.0050) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9493, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.85% (1.9577 => 0.6490, std.dev.: 0.0151) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0207, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.55% (10.7105 => 7.4388, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7592, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0074, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: -13.13% (3.1443 => 2.7313, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -10.94% (9.5636 => 8.5175, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3021, std.dev.: 0.0297) MultiSource/Benchmarks/FreeBench/distray/distray: -7.73% (0.1592 => 0.1469, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -6.60% (1.2373 => 1.1557, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (0.2497 => 0.2351, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.20% (8.1563 => 7.7320, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.28% (10.2830 => 9.8429, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0079) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.74% (3.7221 => 3.6575, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3282, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.10% (0.1485 => 0.1335, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.67% (0.2116 => 0.0663, std.dev.: 0.0030) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 01:13:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 03:13:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111091333.AC15B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7487?compare_to=7484&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7487, Order: 172177, Start Time: 2013-01-11 07:33:52, End Time: 2013-01-11 09:13:35 To: 7484, Order: 172172, Start Time: 2013-01-11 05:22:58, End Time: 2013-01-11 07:00:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== Performance Regressions: 11 (3 on baseline) Performance Improvements: 0 (94 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1053 (967 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.30% (2.3428 => 2.5842, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.83% (0.3284 => 0.3541, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 6.75% (21.5478 => 23.0019, std.dev.: 0.4860) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.44% (15.5878 => 16.5916, std.dev.: 0.1248) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.23% (1.3174 => 1.3599, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.34% (5.5281 => 5.6576, std.dev.: 0.0344) MultiSource/Applications/SPASS/SPASS: 2.27% (8.2414 => 8.4283, std.dev.: 0.0346) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (4.2740 => 4.3707, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/matrix: 1.48% (2.8726 => 2.9152, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/FloatMM: 1.27% (0.8207 => 0.8311, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: 1.02% (0.9760 => 0.9860, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.13% (1.0971 => 1.1095, std.dev.: 0.0904) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.55% (0.0165 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0434 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.38% (0.0299 => 0.0339, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0318 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.87% (0.0418 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 7.65% (0.0170 => 0.0183, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 24.75% (0.0202 => 0.0252, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.10% (0.1454 => 0.1470, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 1.37% (1.1517 => 1.1675, std.dev.: 0.1719) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.80% (0.4002 => 0.3890, std.dev.: 0.1291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.34% (0.1454 => 0.1449, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.48% (0.0927 => 0.0904, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.32% (0.0224 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.68% (0.0537 => 0.0546, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.85% (1.1477 => 1.1575, std.dev.: 0.0300) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 100.00% (0.0015 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.07% (0.0552 => 0.0580, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.50% (0.0187 => 0.0259, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7383 => 0.7438, std.dev.: 0.0206) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 15.38% (0.0039 => 0.0045, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.40% (12.8224 => 12.7711, std.dev.: 0.1291) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.14% (20.5117 => 23.0019, std.dev.: 0.4860) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.89% (4.1668 => 4.3707, std.dev.: 0.0271) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (63.1520 => 64.1191, std.dev.: 0.1205) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.48% (0.0808 => 0.0489, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.46% (0.0727 => 0.0491, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.63% (0.1684 => 0.1286, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -20.92% (1.8964 => 1.4996, std.dev.: 0.1027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.29% (0.7686 => 0.6357, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.00% (1.0960 => 0.9097, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.13% (0.1079 => 0.0905, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.27% (1.0986 => 0.9308, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -13.29% (1.0220 => 0.8862, std.dev.: 0.0235) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.96% (0.4074 => 0.3546, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -11.64% (1.1433 => 1.0102, std.dev.: 0.0470) MultiSource/Applications/treecc/treecc: -11.21% (2.4719 => 2.1947, std.dev.: 0.0122) MultiSource/Applications/lua/lua: -11.20% (4.6406 => 4.1209, std.dev.: 0.0981) SingleSource/UnitTests/Vector/constpool: -11.17% (9.8875 => 8.7828, std.dev.: 0.1995) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.05% (0.7693 => 0.6843, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.98% (1.5131 => 1.3469, std.dev.: 0.0529) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.62% (0.2372 => 0.2120, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.55% (6.4235 => 5.7458, std.dev.: 0.2514) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.52% (1.3924 => 1.2459, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.28% (10.2703 => 9.2147, std.dev.: 0.0863) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.95% (0.1317 => 0.1186, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -9.72% (2.6437 => 2.3867, std.dev.: 0.0940) MultiSource/Applications/ClamAV/clamscan: -9.27% (17.4365 => 15.8195, std.dev.: 0.6109) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.14% (1.6874 => 1.5331, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.13% (0.3560 => 0.3235, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.09% (1.1498 => 1.0453, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.07% (0.9124 => 0.8296, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.86% (0.6885 => 0.6275, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.09% (1.0017 => 0.9307, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.82% (0.5746 => 0.5354, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.20% (0.2709 => 0.2541, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.18% (0.9550 => 0.8960, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.93% (0.2481 => 0.2334, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.68% (0.9507 => 0.8967, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.48% (0.9127 => 0.8627, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.45% (0.6934 => 0.6556, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.44% (1.8127 => 1.7141, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/methcall: -5.43% (0.2135 => 0.2019, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.41% (0.9422 => 0.8912, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.29% (1.3220 => 1.2521, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.16% (0.9512 => 0.9021, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: -4.88% (4.5936 => 4.3695, std.dev.: 0.0812) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.77% (0.9788 => 0.9321, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.76% (0.8990 => 0.8562, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.73% (0.9405 => 0.8960, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.72% (0.2884 => 0.2748, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.72% (1.0052 => 0.9578, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.60% (0.9403 => 0.8970, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.59% (0.2615 => 0.2495, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.56% (0.9091 => 0.8676, std.dev.: 0.0090) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (1.4392 => 1.3758, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.16% (0.9993 => 0.9577, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.92% (4.6579 => 4.4755, std.dev.: 0.0413) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.86% (0.4121 => 0.3962, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.74% (1.0119 => 0.9741, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.68% (0.9488 => 0.9139, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.63% (0.4762 => 0.4589, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.63% (0.5369 => 0.5174, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.22% (0.9685 => 0.9373, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.19% (1.0860 => 1.0514, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.15% (14.9757 => 14.5046, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.00% (0.9855 => 0.9559, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.97% (1.0088 => 0.9788, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.83% (1.8651 => 1.8124, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.77% (0.8926 => 0.8679, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.74% (0.8893 => 0.8649, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.46% (0.9612 => 0.9376, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.39% (0.9381 => 0.9157, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: -2.34% (0.9759 => 0.9531, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.30% (0.8732 => 0.8531, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.17% (0.8846 => 0.8654, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.93% (0.9998 => 0.9805, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.60% (0.9564 => 0.9411, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.41% (1.0867 => 1.0714, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.29% (0.8736 => 0.8623, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.03% (0.9867 => 0.9765, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.05% (0.9372 => 0.6462, std.dev.: 0.1039) SingleSource/Benchmarks/Shootout/heapsort: -24.88% (4.4739 => 3.3609, std.dev.: 0.3536) MultiSource/Applications/minisat/minisat: -22.24% (7.9891 => 6.2123, std.dev.: 0.5970) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.58% (0.1164 => 0.0971, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.20% (2.8778 => 2.5842, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout/nestedloop: -8.55% (0.2200 => 0.2012, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/treeadd/treeadd: -7.77% (0.4081 => 0.3764, std.dev.: 0.0117) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -7.02% (9.0650 => 8.4283, std.dev.: 0.0346) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.78% (1.4588 => 1.3599, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.88% (23.3986 => 22.0236, std.dev.: 0.4175) SingleSource/Benchmarks/Shootout-C++/lists: -3.30% (17.2182 => 16.6503, std.dev.: 0.1224) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.18% (1.1825 => 1.1449, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.08% (0.5826 => 0.5705, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.2040 => 7.1102, std.dev.: 0.0122) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.90% (1.2047 => 1.1095, std.dev.: 0.0904) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -19.38% (0.0227 => 0.0183, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.92% (0.1530 => 0.1470, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -39.49% (1.9293 => 1.1675, std.dev.: 0.1719) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.93% (0.4049 => 0.3890, std.dev.: 0.1291) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.04% (0.1510 => 0.1449, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.57% (0.0978 => 0.0904, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0590 => 0.0546, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.36% (1.1617 => 1.1575, std.dev.: 0.0300) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.92% (0.0610 => 0.0580, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.36% (0.0268 => 0.0259, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7437 => 0.7438, std.dev.: 0.0206) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.09% (0.0092 => 0.0045, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.05% (12.7781 => 12.7711, std.dev.: 0.1291) Report Time: 0.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 01:14:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 03:14:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111091416.CBB912A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7488?compare_to=7485&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7488, Order: 172177, Start Time: 2013-01-11 07:37:29, End Time: 2013-01-11 09:14:16 To: 7485, Order: 172172, Start Time: 2013-01-11 05:31:07, End Time: 2013-01-11 07:04:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (118 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 1.08% (2.1015 => 2.1242, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.50% (0.6395 => 0.8793, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.73% (0.6395 => 0.8680, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.34% (0.6260 => 0.8347, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.73% (0.5805 => 0.7705, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.15% (0.5456 => 0.7210, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.10% (0.6230 => 0.8230, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.36% (0.5567 => 0.7313, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.23% (0.5581 => 0.7324, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.11% (0.5941 => 0.7789, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.56% (0.5802 => 0.7575, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.43% (0.5705 => 0.7441, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.33% (0.6033 => 0.7863, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.14% (0.5849 => 0.7612, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.94% (0.5859 => 0.7613, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.86% (0.5478 => 0.7114, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.80% (0.5570 => 0.7230, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.50% (0.5925 => 0.7673, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.47% (0.5569 => 0.7210, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.40% (0.5591 => 0.7235, std.dev.: 0.0125) SingleSource/Benchmarks/Stanford/IntMM: 28.95% (0.0418 => 0.0539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.91% (0.6189 => 0.7978, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.44% (0.6446 => 0.8279, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.28% (0.5863 => 0.7521, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.14% (0.5857 => 0.7505, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.13% (0.6676 => 0.8554, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.66% (0.6304 => 0.8048, std.dev.: 0.0180) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.29% (1.6474 => 2.0969, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.06% (0.6681 => 0.8489, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.62% (0.6194 => 0.7843, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.04% (0.6297 => 0.7937, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.98% (0.6660 => 0.8390, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.57% (0.6667 => 0.8305, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.59% (0.7524 => 0.9299, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.69% (0.7339 => 0.9004, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.14% (2.2587 => 2.7135, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.88% (1.1450 => 1.3154, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 14.39% (0.3357 => 0.3840, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.39% (0.4916 => 0.5525, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.06% (0.1982 => 0.2221, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4515 => 0.5040, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.45% (1.6364 => 1.8237, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.13% (4.5069 => 5.0086, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.28% (3.5339 => 3.8973, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.80% (0.2001 => 0.2197, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.18% (0.2385 => 0.2604, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.7021 => 0.7575, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 7.06% (1.2515 => 1.3398, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.74% (0.5329 => 0.5688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.50% (0.4524 => 0.4818, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.19% (1.4642 => 1.5548, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 6.13% (9.2283 => 9.7943, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (0.4861 => 0.5149, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.79% (1.2784 => 1.3524, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3319 => 0.3470, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.27% (5.4682 => 5.6470, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 2.47% (0.6750 => 0.6917, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.33% (0.8418 => 0.8614, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 1.96% (5.0226 => 5.1210, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.3722 => 1.3866, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.52% (31.3723 => 55.6925, std.dev.: 0.0281) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3713, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4418, std.dev.: 0.0133) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.73% (2.0478 => 2.1242, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5758, std.dev.: 0.0370) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.57% (0.6469 => 0.6635, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8210 => 28.3148, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4335 => 4.4800, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.17% (0.3194 => 0.2997, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.08% (0.3821 => 0.3627, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.76% (0.9852 => 0.9383, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/fibo: -4.56% (0.2871 => 0.2740, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.48% (0.3057 => 0.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.08% (0.2939 => 0.2819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.06% (0.3026 => 0.2903, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.03% (0.7198 => 0.6908, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -3.70% (1.3148 => 1.2662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.69% (0.9542 => 0.9190, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.67% (0.3323 => 0.3201, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.64% (0.4151 => 0.4000, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -3.61% (0.3880 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.58% (0.3884 => 0.3745, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.58% (0.3831 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.55% (0.4033 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.45% (0.6347 => 0.6128, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.44% (0.3658 => 0.3532, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.4176 => 0.4034, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.37% (0.3891 => 0.3760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.29% (0.3621 => 0.3502, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference-object: -3.20% (0.6441 => 0.6235, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.05% (0.4199 => 0.4071, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.04% (0.6484 => 0.6287, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.94% (0.3849 => 0.3736, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.87% (0.3867 => 0.3756, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.76% (0.4427 => 0.4305, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -2.74% (0.7779 => 0.7566, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -2.69% (0.4280 => 0.4165, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.64% (0.3788 => 0.3688, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2310, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/moments: -2.61% (0.4248 => 0.4137, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6971, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.26% (1.0544 => 1.0306, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8902, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.10% (1.2210 => 1.1953, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.2221 => 1.1972, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -2.01% (4.3330 => 4.2461, std.dev.: 0.0116) MultiSource/Applications/JM/lencod/lencod: -1.92% (16.1920 => 15.8812, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: -1.89% (0.7982 => 0.7831, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.85% (6.7716 => 6.6462, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/football/football: -1.80% (0.9179 => 0.9014, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -1.70% (7.0961 => 6.9753, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.64% (1.2300 => 1.2098, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -1.51% (2.4021 => 2.3659, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.33% (1.8100 => 0.6999, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/mandel-2: -24.62% (1.3643 => 1.0284, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -23.40% (83.5423 => 63.9900, std.dev.: 0.5459) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7572, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.77% (4.1024 => 3.2094, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1303, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0354) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0486) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -9.09% (1.2842 => 1.1675, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0428) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.18% (4.1534 => 3.8967, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0269) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.24% (7.9763 => 7.7182, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.01% (3.7241 => 3.6491, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.49% (1.6219 => 1.5977, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.8776 => 4.8064, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.30% (1.6086 => 1.5877, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.23% (1.6307 => 1.6107, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6695, std.dev.: 0.0154) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 03:12:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 05:12:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111111226.AD4722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7489?compare_to=7488&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7489, Order: 172185, Start Time: 2013-01-11 09:38:16, End Time: 2013-01-11 11:12:26 To: 7488, Order: 172177, Start Time: 2013-01-11 07:37:29, End Time: 2013-01-11 09:14:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (98 on baseline) Performance Improvements: 3 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1098 (867 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 130.75% (0.0400 => 0.0923, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 3.22% (75.2537 => 77.6794, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (1.2641 => 1.2868, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -5.51% (4.7657 => 4.5033, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/fldry: -3.57% (0.6999 => 0.6749, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.07% (2.1242 => 2.1014, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 193.02% (0.0315 => 0.0923, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.57% (0.6395 => 0.8670, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.48% (0.6260 => 0.8356, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.40% (0.5688 => 0.7531, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.23% (0.5805 => 0.7676, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.6230 => 0.8205, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.45% (0.5581 => 0.7336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.31% (0.5567 => 0.7310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.30% (0.5575 => 0.7320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.06% (0.5941 => 0.7786, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.71% (0.5802 => 0.7584, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.47% (0.6033 => 0.7871, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.32% (0.5705 => 0.7435, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.05% (0.5478 => 0.7124, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.04% (0.5859 => 0.7619, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.01% (0.5849 => 0.7604, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.69% (0.5570 => 0.7224, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.57% (0.5569 => 0.7216, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.47% (0.6440 => 0.8338, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.38% (0.5925 => 0.7666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.37% (0.5591 => 0.7233, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.49% (0.6052 => 0.7776, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.24% (0.5857 => 0.7511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.20% (0.6189 => 0.7934, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.16% (0.5863 => 0.7514, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.13% (0.6676 => 0.8554, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.92% (0.6446 => 0.8246, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.81% (0.6304 => 0.8057, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.27% (1.6474 => 2.0966, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.67% (0.6194 => 0.7846, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.10% (0.6660 => 0.8398, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.00% (0.6297 => 0.7934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.92% (0.6681 => 0.8413, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.45% (0.6667 => 0.8297, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.42% (0.7524 => 0.9286, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.59% (0.7339 => 0.8997, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.04% (2.2587 => 2.7114, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.87% (1.1450 => 1.3153, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.44% (1.6364 => 1.8236, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.41% (4.5069 => 5.0210, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.33% (0.4916 => 0.5473, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.37% (3.5339 => 3.9005, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.52% (0.2385 => 0.2612, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.7021 => 0.7580, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 7.04% (1.2515 => 1.3396, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5329 => 0.5689, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4524 => 0.4806, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.18% (9.2283 => 9.7986, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.4642 => 1.5533, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4861 => 0.5150, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.93% (1.2784 => 1.3542, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.25% (5.4682 => 5.6460, std.dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: 2.52% (1.3864 => 1.4214, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.6750 => 0.6918, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.33% (0.8418 => 0.8614, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 2.26% (5.0226 => 5.1361, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.16% (1.3722 => 1.3881, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6681, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.65% (5.1955 => 5.4373, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5964, std.dev.: 0.0477) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0084) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3822, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6015, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.07% (4.4335 => 4.4811, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -6.36% (0.3194 => 0.2991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.21% (0.3837 => 0.3637, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (2.4924 => 2.3737, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (0.9852 => 0.9391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.44% (0.2903 => 0.2774, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.34% (0.3016 => 0.2885, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.25% (0.7198 => 0.6892, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.08% (2.1713 => 2.0827, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.94% (0.3252 => 0.3124, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -3.75% (1.3148 => 1.2655, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.71% (0.9542 => 0.9188, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.66% (0.3884 => 0.3742, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.61% (0.4151 => 0.4001, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.52% (0.4033 => 0.3891, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.48% (0.7779 => 0.7508, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.39% (0.3891 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.33% (0.4176 => 0.4037, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.32% (0.6484 => 0.6269, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: -3.24% (0.6441 => 0.6232, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.20% (0.3621 => 0.3505) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.15% (0.3931 => 0.3807) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.96% (0.3849 => 0.3735, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.71% (0.4427 => 0.4307, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2311, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: -2.57% (0.4280 => 0.4170, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.54% (0.7919 => 0.7718, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.45% (0.4083 => 0.3983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -2.42% (0.4248 => 0.4145, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -2.33% (17.1032 => 16.7055, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.30% (14.2083 => 13.8820, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.24% (0.4813 => 0.4705, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.21% (1.2221 => 1.1951, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: -2.20% (4.3330 => 4.2378, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.19% (1.0544 => 1.0313, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (1.2210 => 1.1947, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.99% (16.1920 => 15.8703, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.93% (6.7716 => 6.6410, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: -1.80% (7.0961 => 6.9687, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: -1.77% (34.0927 => 33.4892, std.dev.: 0.0477) MultiSource/Applications/lambda-0_1_3/lambda: -1.72% (0.7982 => 0.7845, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -1.64% (2.4021 => 2.3628, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.59% (1.2300 => 1.2104, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -1.54% (1.5610 => 1.5369, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.71% (1.8100 => 0.6749, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3109, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.78% (1.3643 => 1.0262, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0328, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.75% (0.0756 => 0.0584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3833, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -16.85% (0.3418 => 0.2842, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1311, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.56% (2.2633 => 2.1827, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (7.9763 => 7.7311, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6472, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.74% (1.3096 => 1.2868, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4685, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.55% (1.6086 => 1.5836, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.49% (1.6307 => 1.6064, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1983, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8089, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.39% (1.6219 => 1.5994, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 03:31:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 05:31:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111113130.C81302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7490?compare_to=7487&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7490, Order: 172185, Start Time: 2013-01-11 09:31:03, End Time: 2013-01-11 11:31:33 To: 7487, Order: 172177, Start Time: 2013-01-11 07:33:52, End Time: 2013-01-11 09:13:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 12 (9 on baseline) Performance Improvements: 2 (69 on baseline) Existing Failures: 40 (40 on baseline) Unchanged Tests: 1049 (985 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (88.5172 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.59% (0.0337 => 0.0494, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.39% (1.3642 => 1.4377, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.55% (1.2455 => 1.2772, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 2.21% (0.4619 => 0.4721, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.18% (0.8531 => 0.8632, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 2561700.00% (0.0001 => 2.5618, std.dev.: 0.0696) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 113.01% (1.1449 => 2.4387, std.dev.: 0.0858) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.75% (0.2561 => 0.2862, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/pi: 6.86% (2.0088 => 2.1467, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.43% (5.6576 => 5.7951, std.dev.: 0.0489) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (9.1290 => 9.3470, std.dev.: 0.0555) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.03% (1.3897 => 1.4040, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/18-imp/imp: -7.50% (0.1467 => 0.1357, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.51% (4.3707 => 4.1297, std.dev.: 0.0655) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.30% (1.1095 => 1.1239, std.dev.: 0.0151) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.47% (0.0222 => 0.0181, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0431 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0339 => 0.0339, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.25% (0.0321 => 0.0317, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0430 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -1.45% (0.0207 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 21.86% (0.0183 => 0.0223, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.89% (0.0252 => 0.0217, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -0.61% (0.1470 => 0.1461, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -1.58% (1.1675 => 1.1491, std.dev.: 0.0667) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.05% (0.3890 => 0.3931, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.62% (0.1449 => 0.1458, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.96% (0.0904 => 0.0976, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.50% (0.0274 => 0.0237, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.64% (0.0546 => 0.0615, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.73% (1.1575 => 1.1490, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.31% (0.0580 => 0.0605, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.97% (0.0259 => 0.0290, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.7438 => 0.7404, std.dev.: 0.0366) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.33% (0.0045 => 0.0078, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.30% (12.7711 => 12.7334, std.dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.02% (0.0336 => 0.0494, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320125.00% (0.0008 => 2.5618, std.dev.: 0.0696) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.23% (1.1825 => 2.4387, std.dev.: 0.0858) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.71% (0.2562 => 0.2862, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.85% (3.7074 => 3.9985, std.dev.: 0.1127) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.76% (9.0082 => 9.3470, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.42% (5.6033 => 5.7951, std.dev.: 0.0489) MultiSource/Applications/siod/siod: 1.27% (3.5910 => 3.6365, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 1.02% (63.1520 => 63.7944, std.dev.: 0.2476) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0061) SingleSource/Benchmarks/SmallPT/smallpt: -27.97% (0.1888 => 0.1360, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.74% (0.1684 => 0.1301, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -19.95% (1.8964 => 1.5181, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.03% (0.1009 => 0.0817, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.93% (0.0676 => 0.0548, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.63% (0.1079 => 0.0878, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.89% (0.7686 => 0.6388, std.dev.: 0.0096) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.92% (0.4074 => 0.3507, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -13.81% (1.0220 => 0.8809, std.dev.: 0.0474) SingleSource/UnitTests/Vector/constpool: -12.94% (9.8875 => 8.6085, std.dev.: 0.3922) MultiSource/Applications/Burg/burg: -12.47% (1.5979 => 1.3987, std.dev.: 0.0260) MultiSource/Applications/aha/aha: -11.61% (0.1378 => 0.1218, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.33% (1.2154 => 1.0777, std.dev.: 0.0136) MultiSource/Applications/lua/lua: -10.97% (4.6406 => 4.1316, std.dev.: 0.0643) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.70% (6.4235 => 5.7359, std.dev.: 0.1314) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.67% (1.5131 => 1.3516, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.65% (0.9124 => 0.8152, std.dev.: 0.0189) MultiSource/Applications/hexxagon/hexxagon: -10.36% (1.1433 => 1.0249, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.97% (10.2703 => 9.2466, std.dev.: 0.0610) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.93% (0.7693 => 0.6929, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -9.47% (17.5634 => 15.8996, std.dev.: 0.5543) MultiSource/Applications/sgefa/sgefa: -9.31% (0.3598 => 0.3263, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.31% (1.6874 => 1.5303, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.82% (0.3560 => 0.3246, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -8.77% (0.8653 => 0.7894, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.60% (1.1498 => 1.0509, std.dev.: 0.0159) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.41% (1.1731 => 1.0745, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.35% (0.2372 => 0.2174, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.21% (0.5746 => 0.5274, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.16% (0.6885 => 0.6323, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2481 => 0.2303, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.67% (1.0017 => 0.9349, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: -6.49% (1.3979 => 1.3072, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: -6.38% (3.7840 => 3.5425, std.dev.: 0.0788) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2709 => 0.2556, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: -5.11% (0.2172 => 0.2061, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.96% (1.3220 => 1.2564, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.93% (0.7693 => 0.7314, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.68% (0.9403 => 0.8963, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.68% (1.0052 => 0.9582, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: -4.57% (4.5936 => 4.3839, std.dev.: 0.0591) SingleSource/Benchmarks/Shootout-C++/lists1: -4.55% (0.3206 => 0.3060, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.42% (0.6135 => 0.5864, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: -4.12% (0.7776 => 0.7456, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.04% (1.3310 => 1.2772, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.93% (0.8990 => 0.8637, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.46% (0.4762 => 0.4597, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.24% (0.8926 => 0.8726, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.15% (0.8732 => 0.8632, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -21.66% (7.9891 => 6.2584, std.dev.: 0.5354) SingleSource/Benchmarks/Shootout/nestedloop: -10.95% (0.2200 => 0.1959, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists1: -9.49% (0.6628 => 0.5999, std.dev.: 0.0090) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.90% (0.3217 => 0.2995, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: -5.87% (0.1704 => 0.1604, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.33% (23.3986 => 22.3865, std.dev.: 0.2051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.31% (46.0987 => 44.1131, std.dev.: 0.7463) SingleSource/Benchmarks/Shootout-C++/lists: -3.46% (17.2182 => 16.6227, std.dev.: 0.1108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.81% (1.4446 => 1.4040, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -2.66% (4.4730 => 4.3540, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.32% (0.5826 => 0.5691, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.2040 => 7.0974, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/mandel-2: -1.44% (0.8521 => 0.8398, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -1.32% (14.9448 => 14.7480, std.dev.: 0.0559) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3155, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: -1.13% (8.7416 => 8.6426, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.08% (3.1921 => 3.1577, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.71% (1.2047 => 1.1239, std.dev.: 0.0151) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -22.32% (0.0233 => 0.0181, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.90% (0.0255 => 0.0217, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -93.33% (0.0015 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -40.44% (1.9293 => 1.1491, std.dev.: 0.0667) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.91% (0.4049 => 0.3931, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.44% (0.1510 => 0.1458, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.13% (0.0276 => 0.0237, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0590 => 0.0615, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.09% (1.1617 => 1.1490, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0610 => 0.0605, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.21% (0.0268 => 0.0290, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.7437 => 0.7404, std.dev.: 0.0366) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.35% (12.7781 => 12.7334, std.dev.: 0.0164) Report Time: 0.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 03:47:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 05:47:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111114737.9CF8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7491?compare_to=7486&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7491, Order: 172185, Start Time: 2013-01-11 09:36:14, End Time: 2013-01-11 11:47:38 To: 7486, Order: 172172, Start Time: 2013-01-11 06:53:00, End Time: 2013-01-11 09:05:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (216 on baseline) Performance Improvements: 3 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 132.65% (0.0438 => 0.1019, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.87% (0.6490 => 0.6741, std.dev.: 0.0061) SingleSource/Benchmarks/Linpack/linpack-pc: 3.02% (75.5118 => 77.7930, std.dev.: 0.0338) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.59% (4.2820 => 4.1711, std.dev.: 0.0007) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.22% (4.5537 => 4.4982, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: -1.05% (3.8040 => 3.7642, std.dev.: 0.0119) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.22% (0.1335 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.66% (0.0663 => 0.0674, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 1.30% (493.4519 => 499.8461, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44224.39% (1.1277 => 499.8461, std.dev.: 0.0072) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.29% (0.5229 => 1.6434, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 19.82% (14.9895 => 17.9606, std.dev.: 0.0044) MultiSource/Applications/kimwitu++/kc: 43.11% (14.1553 => 20.2574, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: 17.39% (4.1105 => 4.8252, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.78% (1.1048 => 1.7432, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.38% (7.1582 => 37.6791, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.30% (3.4629 => 6.4169, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.61% (0.6222 => 1.0864, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.92% (0.0720 => 7.4469, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11156600.00% (0.0001 => 11.1567, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488000.00% (0.0001 => 5.4881, std.dev.: 0.0256) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.98% (1.1194 => 10.3206, std.dev.: 0.0309) SingleSource/UnitTests/SignlessTypes/factor: 244.26% (0.0296 => 0.1019, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.57% (22.1758 => 55.3446, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.88% (0.1463 => 0.2500, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.94% (2.9384 => 4.6115, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.06% (7.0540 => 10.8673, std.dev.: 0.0075) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.48% (1.5859 => 2.3864, std.dev.: 0.0154) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.52% (8.1363 => 11.9213, std.dev.: 0.0146) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.97% (2.2024 => 3.1048, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 40.34% (21.9371 => 30.7873, std.dev.: 0.0207) MultiSource/Applications/sgefa/sgefa: 38.92% (0.3109 => 0.4319, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.77% (4.2646 => 5.7047, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.09% (1.5415 => 2.0516, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.91% (0.4615 => 0.6134, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 31.45% (0.0814 => 0.1070) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.60% (0.1892 => 0.2452, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.59% (0.2271 => 0.2943, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 29.24% (0.4299 => 0.5556, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 28.48% (1.1642 => 1.4958, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.36% (0.6675 => 0.8568, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.72% (0.5105 => 0.6469, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.43% (3.8922 => 4.8819, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.34% (0.1906 => 0.2389, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 25.28% (0.1175 => 0.1472, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 25.22% (0.2554 => 0.3198, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.09% (0.0793 => 0.0992, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.52% (0.0730 => 0.0909, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 24.39% (1.0722 => 1.3337, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 23.99% (0.4289 => 0.5318, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.84% (0.3121 => 0.3865, std.dev.: 0.0031) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.37% (0.1566 => 0.1932, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.25% (1.4186 => 1.7484, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 23.23% (0.4620 => 0.5693, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 22.74% (9.4845 => 11.6416, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.51% (0.1337 => 0.1638, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.42% (0.1695 => 0.2075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818) MultiSource/Applications/minisat/minisat: 21.57% (0.7115 => 0.8650, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.56% (0.2700 => 0.3282, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 21.05% (0.3098 => 0.3750, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.47% (0.1236 => 0.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.32% (0.6456 => 0.7768, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.27% (5.7591 => 6.9263, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 20.15% (0.7835 => 0.9414, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.15% (1.3050 => 1.5679, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.56% (4.9449 => 5.9122, std.dev.: 0.0179) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.53% (0.8172 => 0.9768, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.20% (0.5860 => 0.6985, std.dev.: 0.0125) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.07% (3.3354 => 3.9713, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 19.03% (0.1151 => 0.1370, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.99% (5.0018 => 5.9518, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.76% (0.1940 => 0.2304, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.74% (0.2065 => 0.2452, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.64% (0.2758 => 0.3272, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.99% (0.3307 => 0.3902, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.99% (0.5020 => 0.5923, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 17.37% (0.7433 => 0.8724, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.24% (0.1044 => 0.1224, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.19% (0.1117 => 0.1309, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.10% (0.9765 => 1.1435, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.06% (0.5569 => 0.6519, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.04% (0.2107 => 0.2466, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 17.04% (1.1840 => 1.3857, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.3423 => 0.4006, std.dev.: 0.0052) MultiSource/Applications/lua/lua: 16.74% (3.8723 => 4.5205, std.dev.: 0.0218) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.57% (0.3283 => 0.3827, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.52% (2.0273 => 2.3622, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.30% (0.5981 => 0.6956, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 16.09% (0.3232 => 0.3752, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.06% (0.8101 => 0.9402, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 15.84% (2.2969 => 2.6607, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.81% (0.3441 => 0.3985, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.57% (0.6450 => 0.7454, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 15.32% (0.2049 => 0.2363, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.87% (0.3180 => 0.3653, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.68% (0.8921 => 1.0231, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.54% (1.1861 => 1.3586, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 14.00% (0.3379 => 0.3852, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.60% (0.8067 => 0.9164, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.48% (0.3865 => 0.4386, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.41% (0.2603 => 0.2952, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.07% (0.4636 => 0.5242, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 12.70% (0.3387 => 0.3817, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.67% (1.5603 => 1.7580, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.28% (0.4203 => 0.4719, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.3603 => 0.4031, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.73% (0.4048 => 0.4523, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.51% (0.3422 => 0.3816, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 11.48% (17.1811 => 19.1539, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/lists1: 11.48% (0.3684 => 0.4107, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.43% (0.3282 => 0.3657, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.34% (0.3826 => 0.4260, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/for-in: 11.10% (0.3694 => 0.4104, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.09% (0.3543 => 0.3936, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.79% (14.3668 => 15.9168, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.70% (0.2430 => 0.2690, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 10.48% (0.3092 => 0.3416, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.43% (0.4064 => 0.4488, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.25% (0.1268 => 0.1398, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.18% (0.3427 => 0.3776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.07% (0.2831 => 0.3116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.6030 => 0.6629) SingleSource/UnitTests/ObjC++/Hello: 9.81% (0.5925 => 0.6506, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7326 => 0.8020, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2871 => 0.3135, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.19% (2.0665 => 2.2565, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 9.14% (0.2877 => 0.3140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.07% (0.1114 => 0.1215, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 8.68% (1.2842 => 1.3957, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.64% (0.2756 => 0.2994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.60% (0.3162 => 0.3434, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.59% (0.3935 => 0.4273, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.42% (0.3052 => 0.3309, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 8.30% (63.2438 => 68.4908, std.dev.: 0.0605) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2793 => 0.3024, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.11% (0.2714 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.88% (0.1625 => 0.1753, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (2.2022 => 2.3601, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 6.56% (10.3673 => 11.0470, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.90% (7.9617 => 8.1927, std.dev.: 0.0087) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2514, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.77% (6.6465 => 7.6948, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.66% (4.2280 => 4.4671, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (2.0360 => 2.1065, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.39% (0.9957 => 1.0295, std.dev.: 0.0061) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9195, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7111, std.dev.: 0.0109) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2835, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.49% (1.0785 => 1.0946, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8444 => 28.2329, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4523, std.dev.: 0.0168) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.75% (5.2763 => 1.1738, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.54% (0.8651 => 0.2116, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.12% (5.3855 => 4.4636, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.69% (5.3526 => 4.4590, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: -13.42% (10.4361 => 9.0357, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.53% (1.7609 => 1.6107, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9448, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.57% (1.9577 => 0.6741, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3041, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0212, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4328, std.dev.: 0.0185) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8601, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0066, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5892, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4911, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2758, std.dev.: 0.1072) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.97% (1.2373 => 1.1634, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.85% (0.2497 => 0.2351, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5053, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.82% (8.1563 => 7.7633, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/salsa20: -4.64% (10.2830 => 9.8057, std.dev.: 0.0178) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Shootout-C++/ary3: -2.11% (3.7221 => 3.6437, std.dev.: 0.0289) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.65% (3.6994 => 3.6384, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2786, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2320, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0022) Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 04:03:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 06:03:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130111120331.A649F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7492?compare_to=7482&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7492, Order: 172177, Start Time: 2013-01-11 08:23:26, End Time: 2013-01-11 12:03:32 To: 7482, Order: 172151, Start Time: 2013-01-11 01:33:30, End Time: 2013-01-11 05:14:08 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (1.5497 => 1.5694, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 243.77% (2.8840 => 9.9142, std.dev.: 0.0496) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.98% (0.3958 => 0.4076, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.02% (0.1063 => 0.1414, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.26% (0.2969 => 0.3808, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.21% (0.1106 => 0.1418, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.15% (0.0582 => 0.0740, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.38% (0.4139 => 0.5231, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.37% (0.5900 => 0.7456, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.17% (0.1620 => 0.2044, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.43% (0.0822 => 0.1031, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.06% (0.4253 => 0.5319, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.57% (0.4994 => 0.6221, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1021 => 0.1268, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.14% (0.5000 => 0.6207, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 24.05% (1.5932 => 1.9764, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.41% (0.0897 => 0.1107, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.79% (0.1549 => 0.1902, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.76% (0.1107 => 0.1359, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.21% (0.1103 => 0.1348, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.13% (0.1003 => 0.1225, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 21.62% (0.1619 => 0.1969, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.60% (0.3903 => 0.4746, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.49% (0.0947 => 0.1141, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 20.05% (0.4029 => 0.4837, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.81% (0.2014 => 0.2413, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/08-main/main: 19.79% (0.1218 => 0.1459, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.66% (0.2736 => 0.3274, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.63% (0.1462 => 0.1749, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.60% (0.3271 => 0.3912, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.46% (0.3890 => 0.4647, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.33% (1.3152 => 1.5694, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.30% (0.2866 => 0.3419, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 19.20% (0.1505 => 0.1794, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 18.78% (0.5826 => 0.6920, std.dev.: 0.0144) MultiSource/Applications/Burg/burg: 18.52% (0.5546 => 0.6573, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 18.42% (0.5889 => 0.6974, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 18.36% (1.8794 => 2.2244, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.19% (3.5627 => 4.2108, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.96% (0.3930 => 0.4636, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.83% (1.6211 => 1.9101, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.80% (0.1090 => 0.1284, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 17.78% (0.9697 => 1.1421, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.67% (0.1160 => 0.1365, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 17.56% (0.2813 => 0.3307, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.54% (0.7171 => 0.8429, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.53% (0.2738 => 0.3218, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 17.50% (0.2823 => 0.3317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.50% (0.2875 => 0.3378, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.45% (0.5026 => 0.5903, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.39% (0.4658 => 0.5468, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 17.13% (0.1284 => 0.1504, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.04% (0.2911 => 0.3407, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 17.02% (0.2803 => 0.3280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.01% (0.2792 => 0.3267, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.97% (4.4195 => 5.1693, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.93% (0.9909 => 1.1587, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 16.88% (0.2714 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.79% (0.2811 => 0.3283, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.62% (2.0673 => 2.4108, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 16.58% (0.2780 => 0.3241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.56% (0.2729 => 0.3181, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.47% (0.3060 => 0.3564, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.39% (0.3362 => 0.3913, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.36% (2.7292 => 3.1756, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/wc: 16.34% (0.3096 => 0.3602, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.33% (1.9694 => 2.2911, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.28% (0.4361 => 0.5071, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.19% (0.3267 => 0.3796, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.09% (1.0781 => 1.2516, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.96% (1.9966 => 2.3152, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 15.88% (23.5202 => 27.2544, std.dev.: 0.0341) MultiSource/Applications/ClamAV/clamscan: 15.83% (4.2109 => 4.8775, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.78% (0.3124 => 0.3617, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 15.53% (0.3317 => 0.3832, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.51% (0.4146 => 0.4789, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 15.43% (0.3726 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.37% (0.1028 => 0.1186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.36% (0.3282 => 0.3786, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 15.25% (0.3678 => 0.4239, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.20% (0.3625 => 0.4176, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.13% (0.3477 => 0.4003, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.05% (1.4269 => 1.6417, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.03% (0.3845 => 0.4423, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.92% (0.3981 => 0.4575, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 14.73% (0.4251 => 0.4877, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 14.50% (0.2566 => 0.2938, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 14.41% (0.3469 => 0.3969, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/trivial-interface: 14.38% (0.3442 => 0.3937, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 14.36% (0.3496 => 0.3998, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-2: 14.34% (0.3446 => 0.3940, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 14.19% (0.3460 => 0.3951, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 14.12% (0.7875 => 0.8987, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 14.09% (0.5012 => 0.5718, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 14.00% (0.3650 => 0.4161, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: 13.88% (0.3724 => 0.4241, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 13.81% (0.3643 => 0.4146, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/football/football: 13.73% (0.2075 => 0.2360, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.46% (0.6435 => 0.7301, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 13.45% (0.2691 => 0.3053, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: 13.14% (2.1653 => 2.4499, std.dev.: 0.0119) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (2.1013 => 2.3735, std.dev.: 0.0096) MultiSource/Applications/JM/lencod/lencod: 12.84% (4.6177 => 5.2105, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.71% (0.2737 => 0.3085, std.dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 12.25% (5.5417 => 6.2206, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.2068 => 0.2318, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.71% (0.3084 => 0.3445, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 11.39% (0.3336 => 0.3716, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.28% (0.6634 => 0.7382, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.22% (0.2103 => 0.2339, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.02% (0.5361 => 0.5952, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.88% (11.6398 => 12.9062, std.dev.: 0.0110) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.69% (0.2040 => 0.2258, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.67% (0.4847 => 0.5364, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.40% (4.6926 => 5.1807, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.05% (0.1383 => 0.1522, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.92% (0.7426 => 0.8163, std.dev.: 0.0161) MultiSource/Applications/lemon/lemon: 8.66% (0.2391 => 0.2598, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 8.24% (2.0346 => 2.2023, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.18% (0.5584 => 0.6041, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 7.99% (11.9555 => 12.9104, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.04% (0.3792 => 0.3983, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5183, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 10.42% (0.2802 => 0.3094, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.37% (0.3693 => 0.4076, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6779, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2411, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6842, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8891, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0081) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3022, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2855, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2103, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5975, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4766, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5708, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.84% (17.2379 => 14.3358, std.dev.: 0.1333) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/ary2: -10.37% (0.2402 => 0.2153, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9757, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8107, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.80% (14.0481 => 13.3732, std.dev.: 0.0985) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2151, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.52% (11.2080 => 10.8134, std.dev.: 0.1244) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.35% (0.6293 => 0.6145, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1274, std.dev.: 0.0641) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5806, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1314, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 05:10:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 07:10:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111131015.120422A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7493?compare_to=7489&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7493, Order: 172189, Start Time: 2013-01-11 11:36:02, End Time: 2013-01-11 13:10:15 To: 7489, Order: 172185, Start Time: 2013-01-11 09:38:16, End Time: 2013-01-11 11:12:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (105 on baseline) Performance Improvements: 0 (122 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.52% (0.3788 => 0.4035, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.26% (1.1552 => 1.1698, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 193.33% (0.0315 => 0.0924, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.79% (0.0280 => 0.0523, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.69% (0.0717 => 0.1188, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.78% (0.0974 => 0.1566, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.61% (0.0514 => 0.0805, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.73% (0.1500 => 0.2171, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.42% (0.6395 => 0.8788, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.59% (0.6395 => 0.8671, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.58% (0.6260 => 0.8362, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.49% (0.5688 => 0.7536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.6230 => 0.8205, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.33% (0.5567 => 0.7311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.32% (0.5575 => 0.7321, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.11% (0.5941 => 0.7789, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.66% (0.5802 => 0.7581, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.60% (0.6033 => 0.7879, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.41% (0.5705 => 0.7440, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.11% (0.5849 => 0.7610, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.11% (0.5859 => 0.7623, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.07% (0.5478 => 0.7125, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.74% (0.5569 => 0.7225, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.71% (0.5570 => 0.7225, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.30% (0.5925 => 0.7661, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.26% (0.5591 => 0.7227, std.dev.: 0.0172) SingleSource/Benchmarks/Stanford/IntMM: 29.19% (0.0418 => 0.0540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.55% (0.6052 => 0.7780, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.43% (0.5857 => 0.7522, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.29% (0.6189 => 0.7940, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.18% (0.6676 => 0.8557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.16% (0.5863 => 0.7514, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.02% (0.6446 => 0.8252, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.37% (1.6474 => 2.0983, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.59% (0.6194 => 0.7841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.23% (0.6297 => 0.7949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.17% (0.6660 => 0.8403, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.92% (0.6681 => 0.8413, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.17% (0.0445 => 0.0557, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.49% (0.6667 => 0.8300, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.54% (0.7524 => 0.9295, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.61% (0.7339 => 0.8998, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.99% (0.0582 => 0.0710, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.58% (0.0622 => 0.0750, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.20% (2.2587 => 2.7149, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.43% (0.0621 => 0.0723) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.07% (1.1450 => 1.3176, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 14.21% (0.3357 => 0.3834, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.73% (0.0833 => 0.0939, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.72% (4.5069 => 5.0353, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.63% (1.6364 => 1.8267, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.57% (0.4916 => 0.5485, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.47% (0.4515 => 0.5033, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.36% (3.5339 => 3.9000, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.43% (0.2385 => 0.2610, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.2001 => 0.2162, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.03% (0.7021 => 0.7585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.44% (1.2515 => 1.3446, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.18% (0.4524 => 0.4849, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.79% (0.5329 => 0.5691, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (9.2283 => 9.8158, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.4642 => 1.5563, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 6.28% (0.1879 => 0.1997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.27% (0.4861 => 0.5166, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.02% (1.2784 => 1.3554, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.24% (0.3834 => 0.4035, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 5.10% (0.3255 => 0.3421, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3319 => 0.3471, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (5.4682 => 5.6527, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.60% (0.8418 => 0.8637, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.3864 => 1.4219, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.25% (5.0226 => 5.1356, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.3722 => 1.3886, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.12% (0.9557 => 0.9664, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6657, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.31% (0.9531 => 1.0323, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4415, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.64% (54.5751 => 56.0139, std.dev.: 0.2613) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3810, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6015, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3489 => 10.4651, std.dev.: 0.0206) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4787, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.43% (0.1281 => 0.1109, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.87% (0.3837 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.58% (0.3821 => 0.3646, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -4.51% (2.4924 => 2.3799, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (0.9852 => 0.9410, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.11% (0.2871 => 0.2753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.06% (0.3057 => 0.2933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.90% (0.3205 => 0.3080, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.88% (0.7198 => 0.6919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.65% (2.1713 => 2.0921, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: -3.63% (0.3059 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.44% (0.3026 => 0.2922, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -3.43% (1.3148 => 1.2697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.9542 => 0.9225, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/Hello: -3.14% (0.6347 => 0.6148, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.10% (0.6484 => 0.6283, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.93% (0.6441 => 0.6252, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -2.85% (0.3831 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.83% (0.3848 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.78% (0.3884 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1976, std.dev.: 0.0338) SingleSource/UnitTests/ObjC/for-in: -2.78% (0.4033 => 0.3921, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -2.77% (0.3896 => 0.3788, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -2.76% (0.3880 => 0.3773, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -2.75% (0.3812 => 0.3707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.72% (0.4151 => 0.4038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.68% (0.4176 => 0.4064, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.67% (0.3891 => 0.3787, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.67% (0.3931 => 0.3826, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6972, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.34% (0.4321 => 0.4220, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.28% (0.7779 => 0.7602, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.26% (0.7919 => 0.7740, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.05% (14.2083 => 13.9170, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.05% (1.0544 => 1.0328, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.01% (4.3330 => 4.2461, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (1.2210 => 1.1981, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -1.74% (16.1920 => 15.9098, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.73% (1.2221 => 1.2009, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.52% (6.7716 => 6.6685, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: -1.50% (7.0961 => 6.9896, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.41% (1.2300 => 1.2126, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.39% (34.0927 => 33.6173, std.dev.: 0.0289) MultiSource/Applications/siod/siod: -1.37% (2.4021 => 2.3693, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (0.8521 => 0.8405, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -1.33% (1.5610 => 1.5402, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.60% (1.8100 => 0.6769, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3146, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0244, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0375, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1274, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7252, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.25% (0.5142 => 0.4615, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8588, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (7.9763 => 7.7229, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2713, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/ary3: -2.33% (3.7241 => 3.6373, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.57% (4.8776 => 4.8009, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1923, std.dev.: 0.0209) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6105, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6023, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5899, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6675, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 05:49:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 07:49:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111134943.2B8942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7494?compare_to=7490&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7494, Order: 172189, Start Time: 2013-01-11 11:49:34, End Time: 2013-01-11 13:49:46 To: 7490, Order: 172185, Start Time: 2013-01-11 09:31:03, End Time: 2013-01-11 11:31:33 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 5 (5 on baseline) Performance Improvements: 1 (73 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1057 (985 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: 5.56% (0.1959 => 0.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (4.1297 => 4.2767, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/random: 2.91% (2.4007 => 2.4705, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.20% (2.7461 => 2.7791, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.17% (3.5076 => 3.5488, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -2.02% (1.0249 => 1.0042, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.04% (1.1239 => 1.1243, std.dev.: 0.0966) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.55% (0.0181 => 0.0220, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0431 => 0.0429, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.35% (0.0339 => 0.0270, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0317 => 0.0317, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.18% (0.0428 => 0.0393, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -31.84% (0.0223 => 0.0152, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 12.44% (0.0217 => 0.0244, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.30% (0.1461 => 0.1442, std.dev.: 0.0353) MultiSource/Applications/lemon/lemon: 0.02% (1.1491 => 1.1493, std.dev.: 0.3386) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.49% (0.3931 => 0.4068, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.04% (0.1458 => 0.1546, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0976 => 0.0976, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.19% (0.0237 => 0.0273, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.67% (0.0615 => 0.0574, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1490 => 1.1499, std.dev.: 0.1037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.32% (0.0605 => 0.0613, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.59% (0.0290 => 0.0312, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7404 => 0.7377, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 75.00% (0.0004 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.49% (0.0078 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7334 => 12.7447, std.dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320350.00% (0.0008 => 2.5636, std.dev.: 0.0527) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 107.53% (1.1825 => 2.4541, std.dev.: 0.0146) MultiSource/Applications/JM/lencod/lencod: 3.20% (6.8159 => 7.0338, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.64% (4.1668 => 4.2767, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.31% (2.7432 => 2.7791, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.75% (0.0692 => 0.0500, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -27.01% (0.1888 => 0.1378, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.51% (0.1684 => 0.1305, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -20.71% (1.8964 => 1.5036, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.63% (0.0862 => 0.0710, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.78% (1.0986 => 0.9252, std.dev.: 0.0237) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.24% (1.0960 => 0.9399, std.dev.: 0.0223) MultiSource/Applications/aha/aha: -14.01% (0.1378 => 0.1185, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -13.99% (1.0220 => 0.8790, std.dev.: 0.0079) MultiSource/Applications/Burg/burg: -13.16% (1.5979 => 1.3876, std.dev.: 0.0102) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.40% (0.4074 => 0.3569, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: -12.24% (2.4719 => 2.1694, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: -12.17% (1.1433 => 1.0042, std.dev.: 0.0073) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.99% (1.2154 => 1.0697, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.98% (6.4235 => 5.7185, std.dev.: 0.2508) MultiSource/Applications/lua/lua: -10.87% (4.6406 => 4.1362, std.dev.: 0.0339) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.16% (0.9124 => 0.8197, std.dev.: 0.0135) MultiSource/Applications/lambda-0_1_3/lambda: -9.97% (0.8653 => 0.7790, std.dev.: 0.0135) MultiSource/Applications/siod/siod: -9.79% (2.6437 => 2.3848, std.dev.: 0.0110) MultiSource/Applications/sgefa/sgefa: -9.51% (0.3598 => 0.3256, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.93% (1.3924 => 1.2680, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -8.80% (17.4365 => 15.9013, std.dev.: 0.1955) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.62% (1.1731 => 1.0720, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.38% (1.1498 => 1.0534, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.09% (0.2372 => 0.2180, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.02% (0.6885 => 0.6333, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.21% (1.0017 => 0.9295, std.dev.: 0.0103) MultiSource/Applications/d/make_dparser: -7.04% (3.7840 => 3.5175, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/fibo: -6.83% (0.2006 => 0.1869, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.05% (0.2100 => 0.1973, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.01% (0.3462 => 0.3254, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.00% (0.9550 => 0.8977, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/moments: -5.80% (0.4002 => 0.3770, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -5.12% (0.4689 => 0.4449, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.05% (0.3981 => 0.3780, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.04% (0.9127 => 0.8667, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/wc: -4.95% (0.2305 => 0.2191, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -4.86% (1.4392 => 1.3693, std.dev.: 0.0182) MultiSource/Applications/minisat/minisat: -4.85% (0.7776 => 0.7399, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.73% (0.9788 => 0.9325, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.53% (0.3093 => 0.2953, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.45% (0.3665 => 0.3502, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -4.37% (0.2564 => 0.2452, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: -4.30% (16.4479 => 15.7401, std.dev.: 0.0701) SingleSource/Benchmarks/Shootout-C++/lists: -4.11% (0.2725 => 0.2613, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: -3.00% (5.3553 => 5.1945, std.dev.: 0.0257) MultiSource/Applications/JM/ldecod/ldecod: -2.71% (7.3529 => 7.1533, std.dev.: 0.0103) MultiSource/Applications/JM/lencod/lencod: -1.83% (16.7012 => 16.3956, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.78% (0.8732 => 0.8577, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.27% (7.9891 => 6.2097, std.dev.: 0.5149) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.46% (0.1164 => 0.0984, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -10.63% (9.0650 => 8.1016, std.dev.: 0.0999) SingleSource/Benchmarks/Shootout/hash: -10.55% (4.5259 => 4.0485, std.dev.: 0.1503) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.26% (1.4588 => 1.3237, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/lists1: -9.07% (0.6628 => 0.6027, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.03% (0.3609 => 0.3283, std.dev.: 0.0116) MultiSource/Applications/oggenc/oggenc: -7.63% (0.1704 => 0.1574, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.32% (4.4540 => 4.1279, std.dev.: 0.0488) SingleSource/Benchmarks/Shootout/nestedloop: -6.00% (0.2200 => 0.2068, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.74% (23.3986 => 22.0544, std.dev.: 0.2183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.30% (46.0987 => 43.6572, std.dev.: 0.7317) MultiSource/Applications/SIBsim4/SIBsim4: -3.48% (3.5443 => 3.4208, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (17.2182 => 16.6475, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -2.69% (4.4730 => 4.3528, std.dev.: 0.0442) MultiSource/Applications/spiff/spiff: -2.49% (2.8571 => 2.7860, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.16% (0.5826 => 0.5700, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.48% (3.3596 => 3.3098, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (0.8521 => 0.8402, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.19% (3.1921 => 3.1540, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.18% (7.2040 => 7.1191, std.dev.: 0.0293) SingleSource/Benchmarks/SmallPT/smallpt: -1.15% (14.9448 => 14.7730, std.dev.: 0.0328) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.14% (2.5334 => 2.5044, std.dev.: 0.0095) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.67% (1.2047 => 1.1243, std.dev.: 0.0966) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -31.47% (0.0394 => 0.0270, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.69% (0.0445 => 0.0393, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -33.04% (0.0227 => 0.0152, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.31% (0.0255 => 0.0244, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0353) MultiSource/Applications/lemon/lemon: -40.43% (1.9293 => 1.1493, std.dev.: 0.3386) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.47% (0.4049 => 0.4068, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.38% (0.1510 => 0.1546, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0590 => 0.0574, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.02% (1.1617 => 1.1499, std.dev.: 0.1037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.42% (0.0268 => 0.0312, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.81% (0.7437 => 0.7377, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.22% (0.0092 => 0.0055, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7781 => 12.7447, std.dev.: 0.0181) Report Time: 0.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 06:28:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 08:28:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111142835.296FE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7495?compare_to=7491&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7495, Order: 172196, Start Time: 2013-01-11 12:17:42, End Time: 2013-01-11 14:28:34 To: 7491, Order: 172185, Start Time: 2013-01-11 09:36:14, End Time: 2013-01-11 11:47:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.40% (11.0470 => 10.8923, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.97% (0.6741 => 0.6541, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0674 => 0.0651, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8461 => 499.8350, std.dev.: 0.0131) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.40% (1.1277 => 499.8350, std.dev.: 0.0131) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.20% (0.5229 => 1.6377, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 19.16% (14.9895 => 17.8610, std.dev.: 0.0197) MultiSource/Applications/kimwitu++/kc: 43.15% (14.1553 => 20.2632, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: 17.48% (4.1105 => 4.8291, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.27% (1.1048 => 1.7375, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.73% (7.1582 => 37.5615, std.dev.: 0.0235) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.67% (3.4629 => 6.3951, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.48% (0.6222 => 1.0856, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.06% (0.0720 => 7.4434, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11169200.00% (0.0001 => 11.1693, std.dev.: 0.0474) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849100.00% (0.0001 => 9.8492, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485400.00% (0.0001 => 5.4855, std.dev.: 0.0052) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.02% (1.1194 => 10.2987, std.dev.: 0.0065) SingleSource/UnitTests/SignlessTypes/factor: 244.59% (0.0296 => 0.1020, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.48% (22.1758 => 55.3236, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 70.47% (0.1463 => 0.2494, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.94% (2.9384 => 4.6114, std.dev.: 0.0012) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.59% (7.0540 => 10.8345, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.15% (1.5859 => 2.3812, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 47.44% (0.1056 => 0.1557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.27% (8.1363 => 11.9008, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/almabench: 41.23% (0.0730 => 0.1031, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.52% (2.2024 => 3.0949, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 39.88% (21.9371 => 30.6861, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608) MultiSource/Applications/sgefa/sgefa: 38.47% (0.3109 => 0.4305, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.39% (4.2646 => 5.6887, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.66% (1.5415 => 2.0450, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.98% (0.4615 => 0.6091, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.50% (0.2271 => 0.2941, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.12% (0.1892 => 0.2443, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 28.98% (0.4299 => 0.5545, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 28.35% (1.1642 => 1.4943, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.10% (0.6675 => 0.8551, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.35% (0.5105 => 0.6450, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.82% (0.1584 => 0.1993, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.62% (0.0730 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.19% (3.8922 => 4.8727, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 25.18% (0.2554 => 0.3197, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.14% (0.1655 => 0.2071, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.93% (0.1143 => 0.1428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.71% (0.1125 => 0.1403, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 24.11% (1.0722 => 1.3307, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 23.97% (0.4289 => 0.5317, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.59% (1.4186 => 1.7532, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.49% (0.3121 => 0.3854, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.35% (0.4620 => 0.5699, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 22.30% (9.4845 => 11.6000, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.56% (0.3098 => 0.3766, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.41% (0.2700 => 0.3278, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 21.38% (0.7115 => 0.8636, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 20.76% (0.1151 => 0.1390, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.45% (0.7835 => 0.9437, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.07% (0.6456 => 0.7752, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.05% (1.3050 => 1.5667, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 19.79% (5.7591 => 6.8989, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 19.76% (0.1695 => 0.2030, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.28% (4.9449 => 5.8981, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.10% (0.5860 => 0.6979, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.92% (0.8172 => 0.9718, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 18.74% (3.3354 => 3.9604, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.44% (5.0018 => 5.9239, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.08% (0.3307 => 0.3905, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.61% (0.5020 => 0.5904, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.49% (0.7433 => 0.8733, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.47% (0.5569 => 0.6542, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.28% (0.1510 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.24% (0.1044 => 0.1224, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.92% (0.9765 => 1.1417, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.80% (0.2107 => 0.2461, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.74% (0.3423 => 0.3996, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 16.73% (1.1840 => 1.3821, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.59% (3.8723 => 4.5147, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 16.34% (0.3232 => 0.3760, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.33% (2.0273 => 2.3583, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.23% (0.5981 => 0.6952, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.71% (2.2969 => 2.6578, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.55% (0.8101 => 0.9361, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.52% (0.3441 => 0.3975, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.36% (0.6450 => 0.7441, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 15.08% (0.2049 => 0.2358, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 14.69% (0.3180 => 0.3647, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.29% (1.1861 => 1.3556, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.8921 => 1.0194, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 14.26% (0.3379 => 0.3861, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.65% (0.4103 => 0.4663, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.60% (0.0838 => 0.0952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.54% (0.8067 => 0.9159, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.35% (0.4636 => 0.5255, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 13.27% (1.5603 => 1.7674, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.18% (0.2603 => 0.2946, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.40% (0.3387 => 0.3807, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.37% (0.4203 => 0.4723, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 12.07% (0.3603 => 0.4038, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.01% (0.4048 => 0.4534, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.89% (0.3826 => 0.4281, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.56% (0.3684 => 0.4110, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.29% (0.3828 => 0.4260, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0087) MultiSource/Applications/sqlite3/sqlite3: 10.94% (17.1811 => 19.0600, std.dev.: 0.0198) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.61% (0.4064 => 0.4495, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.54% (0.3092 => 0.3418, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.49% (0.2430 => 0.2685, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.48% (14.3668 => 15.8722, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/strcat: 10.35% (0.2831 => 0.3124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.18% (0.3162 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.07% (0.3427 => 0.3772, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.79% (2.0665 => 2.2688, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 9.75% (0.2871 => 0.3151, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.35% (0.6030 => 0.6594, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0028) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.06% (0.3136 => 0.3420, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.02% (0.2872 => 0.3131, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.97% (0.3935 => 0.4288, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.93% (0.7326 => 0.7980, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.91% (1.2842 => 1.3986, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.82% (0.2756 => 0.2999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.71% (0.2802 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.52% (0.2793 => 0.3031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.18% (0.1625 => 0.1758, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 8.04% (63.2438 => 68.3276, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.08% (2.2022 => 2.3581, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.92% (0.4879 => 0.5168, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.73% (0.3177 => 0.3359, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 5.06% (10.3673 => 10.8923, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 4.02% (0.3131 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.9617 => 8.1490, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2466, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4275, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.77% (4.2280 => 4.4720, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3128, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1063, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.36% (0.9957 => 1.0292, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.6802 => 8.9025, std.dev.: 0.0241) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.25% (1.0313 => 1.0545, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7128, std.dev.: 0.0091) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2863, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2364, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.10% (10.3460 => 10.4598, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1748, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -75.55% (0.8651 => 0.2115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.36% (5.3855 => 4.4505, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.06% (5.3526 => 4.4394, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: -13.75% (10.4361 => 9.0015, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.82% (1.7609 => 1.6056, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.92% (54.1659 => 49.8784, std.dev.: 0.0265) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.59% (1.9577 => 0.6541, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3054, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -33.67% (1.5373 => 1.0197, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4333, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8654, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0086, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0907, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7328, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4915, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2919, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.30% (1.2373 => 1.1594, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.23% (8.1563 => 7.7297, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.44% (10.2830 => 9.8264, std.dev.: 0.0132) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.96% (3.7221 => 3.6491, std.dev.: 0.0261) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3280, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.25% (3.6994 => 3.6530, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0007) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 07:07:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 09:07:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111150741.E5FDF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7496?compare_to=7493&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7496, Order: 172196, Start Time: 2013-01-11 13:33:39, End Time: 2013-01-11 15:07:43 To: 7493, Order: 172189, Start Time: 2013-01-11 11:36:02, End Time: 2013-01-11 13:10:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (99 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.30% (1.2713 => 1.3006, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/fldry: 2.07% (0.6769 => 0.6909, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.06% (56.0139 => 56.6058, std.dev.: 0.0533) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 193.33% (0.0315 => 0.0924, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.69% (0.0717 => 0.1188, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.42% (0.0514 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.73% (0.1500 => 0.2171, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.53% (0.6395 => 0.8667, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.45% (0.6260 => 0.8354, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.49% (0.5805 => 0.7691, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.37% (0.5688 => 0.7529, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.04% (0.6230 => 0.8226, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.37% (0.5581 => 0.7332, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.27% (0.5941 => 0.7799, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.82% (0.5802 => 0.7590, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.48% (0.6033 => 0.7872, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.41% (0.5705 => 0.7440, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.12% (0.5859 => 0.7624, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.01% (0.5478 => 0.7122, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.99% (0.5849 => 0.7603, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.73% (0.5570 => 0.7226, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.65% (0.5569 => 0.7220, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.55% (0.5925 => 0.7676, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.35% (0.5591 => 0.7232, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 28.95% (0.0418 => 0.0539, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.41% (0.6189 => 0.7947, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.34% (0.5857 => 0.7517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.18% (0.5863 => 0.7515, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.04% (0.6676 => 0.8548, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.89% (0.6446 => 0.8244, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.35% (1.6474 => 2.0979, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.65% (0.6194 => 0.7845, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.30% (0.6681 => 0.8438, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.08% (0.6297 => 0.7939, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.61% (0.6667 => 0.8308, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.58% (0.7524 => 0.9298, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.69% (0.7339 => 0.9004, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.99% (0.0582 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.14% (2.2587 => 2.7136, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.43% (0.0621 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 15.01% (1.1450 => 1.3169, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.97% (0.0833 => 0.0941, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.06% (0.1982 => 0.2221, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.74% (4.5069 => 5.0358, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.64% (0.4916 => 0.5488, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.60% (1.6364 => 1.8262, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.4515 => 0.5035, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.36% (3.5339 => 3.9001, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2385 => 0.2605, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.12% (0.7021 => 0.7591, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.2001 => 0.2162, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.40% (0.4524 => 0.4859, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.23% (1.2515 => 1.3420, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.5329 => 0.5696, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.49% (9.2283 => 9.8275, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.4642 => 1.5589, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4861 => 0.5160, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.00% (1.2784 => 1.3551, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 5.04% (0.3255 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3319 => 0.3470, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.41% (5.4682 => 5.6547, std.dev.: 0.0164) SingleSource/Benchmarks/Misc-C++/bigfib: 2.84% (0.6750 => 0.6942, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.63% (0.8418 => 0.8639, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.3864 => 1.4221, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.21% (5.0226 => 5.1337, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3722 => 1.3897, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.17% (0.9557 => 0.9669, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.39% (31.3723 => 55.6519, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3672, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6058, std.dev.: 0.0533) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1052, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3815, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.51% (0.1281 => 0.1108, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.54% (0.9852 => 0.9405, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -4.53% (2.4924 => 2.3795, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3821 => 0.3648, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.20% (0.3142 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.09% (0.3323 => 0.3187, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.99% (0.3057 => 0.2935, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.87% (0.3205 => 0.3081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.86% (0.2849 => 0.2739, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.83% (0.7198 => 0.6922, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.82% (0.2933 => 0.2821, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.81% (0.3016 => 0.2901, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -3.76% (0.3059 => 0.2944, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.62% (2.1713 => 2.0928, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -3.60% (0.3026 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.47% (0.3252 => 0.3139, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.9542 => 0.9211, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -3.38% (1.3148 => 1.2703, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.25% (0.3658 => 0.3539, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.04% (0.6347 => 0.6154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.99% (0.6484 => 0.6290, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -2.91% (0.3812 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.90% (0.6441 => 0.6254, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: -2.88% (0.3848 => 0.3737, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -2.84% (0.3880 => 0.3770, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.79% (20.7746 => 20.1942, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/exceptions-2: -2.79% (0.3831 => 0.3724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.4176 => 0.4060, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.72% (0.3891 => 0.3785, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.70% (0.4033 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.60% (0.7779 => 0.7577, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6976, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.34% (0.4321 => 0.4220, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.30% (0.4427 => 0.4325, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.26% (0.7919 => 0.7740, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.09% (1.0544 => 1.0324, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.05% (14.2083 => 13.9166, std.dev.: 0.0132) MultiSource/Benchmarks/MallocBench/gs/gs: -1.94% (4.3330 => 4.2488, std.dev.: 0.0288) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.84% (1.2221 => 1.1996, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.2210 => 1.1986, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/football/football: -1.74% (0.9179 => 0.9019, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -1.70% (16.1920 => 15.9167, std.dev.: 0.0172) MultiSource/Applications/JM/ldecod/ldecod: -1.53% (7.0961 => 6.9872, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -1.53% (0.7982 => 0.7860, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (6.7716 => 6.6701, std.dev.: 0.0134) MultiSource/Applications/siod/siod: -1.40% (2.4021 => 2.3684, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.40% (34.0927 => 33.6158, std.dev.: 0.0487) MultiSource/Applications/hbd/hbd: -1.32% (1.5610 => 1.5404, std.dev.: 0.0070) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.83% (1.8100 => 0.6909, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.62% (0.1622 => 0.1028, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0291, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1296, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8585, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7310, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.7241 => 3.6431, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4658, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1943, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.37% (1.6086 => 1.5866, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6002, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.33% (4.8776 => 4.8126, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 08:07:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 10:07:49 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111160749.4325F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7497?compare_to=7494&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7497, Order: 172199, Start Time: 2013-01-11 14:06:45, End Time: 2013-01-11 16:07:51 To: 7494, Order: 172189, Start Time: 2013-01-11 11:49:34, End Time: 2013-01-11 13:49:46 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 5 (9 on baseline) Performance Improvements: 8 (58 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1050 (996 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.62% (0.9295 => 0.9446, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.80% (4.7256 => 4.9997, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.45% (0.3283 => 0.3462, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 3.74% (4.8091 => 4.9891, std.dev.: 0.0455) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.27% (4.3418 => 4.3968, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.18% (0.4485 => 0.4163, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: -6.20% (4.2610 => 3.9968, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.90% (2.4541 => 2.3583, std.dev.: 0.0257) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.28% (2.4977 => 2.4159, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/mason/mason: -2.05% (0.5563 => 0.5449, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.45% (4.2767 => 4.2145, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.37% (2.7791 => 2.7409, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.21% (1.8700 => 1.8473, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.01% (1.1243 => 1.1130, std.dev.: 0.1348) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.44% (0.0270 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.58% (0.0317 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 8.91% (0.0393 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 44.08% (0.0152 => 0.0219, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (0.0244 => 0.0252, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.04% (0.1442 => 0.1427, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 8.65% (1.1493 => 1.2487, std.dev.: 0.2815) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.96% (0.4068 => 0.4107, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.85% (0.1546 => 0.1471, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.41% (0.0976 => 0.0980, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -32.97% (0.0273 => 0.0183, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.35% (0.0574 => 0.0572, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1499 => 1.1518, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.28% (0.0613 => 0.0599, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.54% (0.0312 => 0.0276, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.64% (0.7377 => 0.7424, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.73% (0.0055 => 0.0037, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.30% (12.7447 => 12.7834, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.21% (0.0336 => 0.0498, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319762.50% (0.0008 => 2.5589, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.43% (1.1825 => 2.3583, std.dev.: 0.0257) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.51% (0.2562 => 0.2857, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.80% (4.7254 => 4.9997, std.dev.: 0.0178) SingleSource/Benchmarks/Misc/pi: 3.63% (2.1390 => 2.2167, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 3.22% (6.8159 => 7.0353, std.dev.: 0.0654) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.25% (0.8800 => 0.8998, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (4.1668 => 4.2145, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.24% (0.0808 => 0.0499, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0089) SingleSource/Benchmarks/SmallPT/smallpt: -26.22% (0.1888 => 0.1393, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.22% (0.1684 => 0.1293, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -19.38% (1.8964 => 1.5289, std.dev.: 0.1118) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.38% (0.0676 => 0.0545, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.03% (0.1009 => 0.0817, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.42% (0.1079 => 0.0891, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.68% (1.0986 => 0.9263, std.dev.: 0.0355) SingleSource/UnitTests/Vector/constpool: -14.73% (9.8875 => 8.4308, std.dev.: 0.1295) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.81% (0.4074 => 0.3593, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.23% (1.5131 => 1.3583, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.83% (0.7693 => 0.6937, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.54% (10.2703 => 9.2902, std.dev.: 0.0250) MultiSource/Applications/sqlite3/sqlite3: -9.21% (17.5634 => 15.9455, std.dev.: 0.4927) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.13% (1.6874 => 1.5334, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.98% (1.1498 => 1.0465, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.90% (0.2372 => 0.2161, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.63% (0.9124 => 0.8337, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.31% (0.3560 => 0.3264, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.94% (0.6885 => 0.6338, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.62% (0.9588 => 0.8857, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: -7.37% (0.3598 => 0.3333, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/fibo: -7.33% (0.2006 => 0.1859, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: -7.15% (0.5134 => 0.4767, std.dev.: 0.0107) MultiSource/Applications/lambda-0_1_3/lambda: -6.83% (0.8653 => 0.8062, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.48% (0.2100 => 0.1964, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.11% (0.2618 => 0.2458, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (1.0017 => 0.9446, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.28% (1.0234 => 0.9694, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.26% (0.7693 => 0.7288, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: -5.22% (0.4002 => 0.3793, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.13% (0.5746 => 0.5451, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: -4.87% (1.3979 => 1.3298, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.79% (3.6295 => 3.4555, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wc: -4.73% (0.2305 => 0.2196, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.56% (5.0381 => 4.8084, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.38% (0.6135 => 0.5866, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.35% (1.3220 => 1.2645, std.dev.: 0.0162) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.33% (7.2721 => 7.1029, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.05% (1.8651 => 1.8269, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.97% (2.4519 => 2.4035, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.92% (0.9372 => 0.6474, std.dev.: 0.1043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.19% (0.0845 => 0.0742, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.50% (1.4588 => 1.3202, std.dev.: 0.0190) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.14% (4.4540 => 4.0914, std.dev.: 0.0900) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.48% (0.3349 => 0.3199, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.02% (2.5170 => 2.4159, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/lists: -3.21% (17.2182 => 16.6652, std.dev.: 0.1426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.14% (1.4446 => 1.3992, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.03% (1.0995 => 1.0662, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: -2.23% (4.4730 => 4.3732, std.dev.: 0.0326) SingleSource/Benchmarks/Misc/mandel-2: -2.08% (0.8521 => 0.8344, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.84% (0.5826 => 0.5719, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.16% (3.1921 => 3.1550, std.dev.: 0.0051) SingleSource/Benchmarks/SmallPT/smallpt: -1.10% (14.9448 => 14.7811, std.dev.: 0.0635) SingleSource/Benchmarks/Shootout-C++/matrix: -1.05% (2.9083 => 2.8777, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.61% (1.2047 => 1.1130, std.dev.: 0.1348) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.73% (0.1530 => 0.1427, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -35.28% (1.9293 => 1.2487, std.dev.: 0.2815) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.43% (0.4049 => 0.4107, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.58% (0.1510 => 0.1471, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.20% (0.0978 => 0.0980, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.70% (0.0276 => 0.0183, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.05% (0.0590 => 0.0572, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.85% (1.1617 => 1.1518, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.80% (0.0610 => 0.0599, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.99% (0.0268 => 0.0276, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7437 => 0.7424, std.dev.: 0.0039) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.78% (0.0092 => 0.0037, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7834, std.dev.: 0.0024) Report Time: 0.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 08:42:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 10:42:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130111164200.A8E312A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7498?compare_to=7492&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7498, Order: 172196, Start Time: 2013-01-11 13:06:41, End Time: 2013-01-11 16:42:01 To: 7492, Order: 172177, Start Time: 2013-01-11 08:23:26, End Time: 2013-01-11 12:03:32 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (178 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.93% (99.2358 => 114.0496, std.dev.: 2.1197) SingleSource/Benchmarks/Shootout-C++/ary: 5.59% (0.2130 => 0.2249, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: 4.83% (0.2153 => 0.2257, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (54.1593 => 54.8089, std.dev.: 0.0934) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.31% (2.3735 => 2.3423, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.89% (0.0475 => 0.0617, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.85% (0.2969 => 0.3796, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.95% (0.4139 => 0.5213, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.86% (0.1106 => 0.1392, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.81% (0.5900 => 0.7423, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.79% (0.0822 => 0.1034, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.25% (0.4253 => 0.5327, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.49% (0.4994 => 0.6217, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.21% (0.0541 => 0.0672, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.83% (0.1620 => 0.2006, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.50% (0.5000 => 0.6175, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.14% (1.5932 => 1.9618, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.51% (0.1604 => 0.1949, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.11% (0.1549 => 0.1876, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.93% (0.3903 => 0.4720, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 20.88% (0.1619 => 0.1957, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.2736 => 0.3272, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.29% (0.4029 => 0.4806, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 19.05% (0.1218 => 0.1450, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.1088 => 0.1294, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.81% (0.1462 => 0.1737, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.67% (0.5826 => 0.6914, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.48% (0.3890 => 0.4609, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.38% (1.3152 => 1.5569, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 18.22% (0.5889 => 0.6962, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.16% (0.3271 => 0.3865, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.16% (0.2875 => 0.3397, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.14% (0.2866 => 0.3386, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 18.06% (0.2813 => 0.3321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 18.00% (0.2823 => 0.3331, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.96% (0.2750 => 0.3244, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.68% (0.2738 => 0.3222, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 17.62% (0.2803 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (0.2792 => 0.3284, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 17.62% (0.5546 => 0.6523, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.60% (0.4658 => 0.5478, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 17.57% (1.8794 => 2.2096, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 17.54% (0.2714 => 0.3190, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 17.52% (0.9697 => 1.1396, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 17.49% (0.7171 => 0.8425, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 17.44% (0.3004 => 0.3528, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 17.43% (0.2725 => 0.3200, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.35% (0.2911 => 0.3416, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.33% (0.2729 => 0.3202, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 17.32% (0.2811 => 0.3298, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 17.27% (0.2780 => 0.3260, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.18% (3.5627 => 4.1748, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.17% (2.0673 => 2.4223, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.99% (0.3096 => 0.3622, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.91% (1.6211 => 1.8953, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.77% (0.1968 => 0.2298, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 16.76% (0.9909 => 1.1570, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.59% (0.5026 => 0.5860, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 16.57% (0.3258 => 0.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.56% (0.3267 => 0.3808, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 16.51% (0.1284 => 0.1496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.36% (4.4195 => 5.1427, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.31% (0.3060 => 0.3559, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 16.28% (0.3317 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.21% (0.3362 => 0.3907, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.20% (0.3124 => 0.3630, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.90% (0.3930 => 0.4555, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 15.81% (0.3726 => 0.4315, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 15.79% (0.3477 => 0.4026, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.72% (0.3678 => 0.4256, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.64% (0.4361 => 0.5043, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.63% (1.9694 => 2.2773, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.53% (0.3625 => 0.4188, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.41% (2.7292 => 3.1498, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 15.40% (23.5202 => 27.1414, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.21% (1.9966 => 2.3003, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 15.20% (0.4146 => 0.4776, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 15.10% (0.4251 => 0.4893, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.10% (0.3981 => 0.4582, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.07% (0.3690 => 0.4246, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.04% (1.0781 => 1.2402, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 14.80% (4.2109 => 4.8340, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.69% (0.3845 => 0.4410, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 14.37% (0.5012 => 0.5732, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 14.23% (1.4269 => 1.6299, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.19% (0.3488 => 0.3983, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.10% (0.3460 => 0.3948, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.07% (0.3446 => 0.3931, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.05% (0.3465 => 0.3952, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 14.01% (0.3469 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.95% (0.3442 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.85% (0.1090 => 0.1241, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.51% (0.3643 => 0.4135, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.46% (0.7875 => 0.8935, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.15% (0.6435 => 0.7281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 12.52% (2.1653 => 2.4364, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.20% (0.2737 => 0.3071, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 11.87% (4.6177 => 5.1658, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 11.86% (0.2075 => 0.2321, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.55% (0.3498 => 0.3902, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 11.47% (2.1013 => 2.3423, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.46% (0.2068 => 0.2305, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.42% (5.5417 => 6.1748, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.06% (0.3084 => 0.3425, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: 10.73% (0.3336 => 0.3694, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.41% (0.2103 => 0.2322, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.28% (0.5361 => 0.5912, std.dev.: 0.0120) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.18% (11.6398 => 12.8251, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: 10.09% (0.4847 => 0.5336, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 9.87% (0.6634 => 0.7289, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.82% (4.6926 => 5.1533, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.76% (0.1383 => 0.1518, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.46% (0.2040 => 0.2233, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.10% (0.7426 => 0.8102, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.82% (0.2391 => 0.2578, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.38% (0.5584 => 0.5996, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 7.37% (11.9555 => 12.8372, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 7.35% (2.0346 => 2.1842, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3792 => 0.3970, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5189, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.15% (0.3693 => 0.4031, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2414, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6755, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2019, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Applications/spiff/spiff: 1.18% (4.0317 => 4.0794, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2083, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6045, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5772, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.25% (17.2379 => 14.2651, std.dev.: 0.0448) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7866, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: -7.16% (2.1113 => 1.9601, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -6.04% (0.2402 => 0.2257, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -5.10% (14.0481 => 13.3322, std.dev.: 0.0722) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2204, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8044, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7767, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1740, std.dev.: 0.0347) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5826, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2063, std.dev.: 0.0527) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0460, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 09:05:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 11:05:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111170518.9DD842A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7499?compare_to=7496&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7499, Order: 172201, Start Time: 2013-01-11 15:31:12, End Time: 2013-01-11 17:05:19 To: 7496, Order: 172196, Start Time: 2013-01-11 13:33:39, End Time: 2013-01-11 15:07:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 192.38% (0.0315 => 0.0921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.27% (0.0717 => 0.1185, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.51% (0.6395 => 0.8666, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.42% (0.6260 => 0.8352, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.52% (0.5688 => 0.7538) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.49% (0.5805 => 0.7691, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.04% (0.5456 => 0.7204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.64% (0.6230 => 0.8201, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.06% (0.5941 => 0.7786, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.59% (0.5802 => 0.7577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.38% (0.6033 => 0.7866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.27% (0.5705 => 0.7432, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.02% (0.5859 => 0.7618, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.01% (0.5478 => 0.7122, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.99% (0.5849 => 0.7603, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.68% (0.5570 => 0.7223, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.61% (0.5569 => 0.7218, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.41% (0.6440 => 0.8334, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.27% (0.5925 => 0.7659, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.12% (0.5591 => 0.7219, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.40% (0.6052 => 0.7771, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.21% (0.5857 => 0.7509, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.15% (0.6189 => 0.7931, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.11% (0.5863 => 0.7511, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.10% (0.6676 => 0.8552, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.92% (0.6446 => 0.8246, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.68% (0.6304 => 0.8049, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.19% (1.6474 => 2.0954, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.49% (0.6194 => 0.7835, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.08% (0.6297 => 0.7939, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.01% (0.6660 => 0.8392, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.98% (0.6681 => 0.8417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.43% (0.6667 => 0.8296, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.55% (0.7339 => 0.8994, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.01% (2.2587 => 2.7106, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.89% (1.1450 => 1.3155, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.09% (0.3357 => 0.3830, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.91% (0.1982 => 0.2218, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.47% (4.5069 => 5.0237, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.41% (1.6364 => 1.8231, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.35% (0.4916 => 0.5474, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 11.07% (0.4515 => 0.5015, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.29% (3.5339 => 3.8974, std.dev.: 0.0212) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.7021 => 0.7576, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.20% (1.2515 => 1.3416, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.74% (0.5329 => 0.5688, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.22% (9.2283 => 9.8021, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.4642 => 1.5533, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.02% (1.2784 => 1.3553, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4861 => 0.5143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.31% (0.3319 => 0.3462, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (5.4682 => 5.6392, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.6750 => 0.6921, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 2.29% (1.3864 => 1.4181, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.28% (5.0226 => 5.1370, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 2.14% (0.8418 => 0.8598, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.3722 => 1.3860, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6655, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.26% (0.9531 => 1.0318, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4420, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1689, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.5751 => 56.6726, std.dev.: 0.0436) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3801, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5320 => 4.6024, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.20% (79.7170 => 80.6716, std.dev.: 0.1459) MultiSource/Applications/viterbi/viterbi: 1.06% (4.4335 => 4.4803, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.68% (0.3821 => 0.3642, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -4.63% (2.4924 => 2.3769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.60% (0.3323 => 0.3170, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.55% (0.3057 => 0.2918, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.43% (0.9852 => 0.9416, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.38% (0.3059 => 0.2925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.37% (0.3205 => 0.3065, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -4.12% (0.2939 => 0.2818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.08% (2.1713 => 2.0828, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.95% (1.3148 => 1.2628, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.93% (0.7198 => 0.6915, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.85% (0.3848 => 0.3700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3812 => 0.3667, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3831 => 0.3686, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.78% (0.3252 => 0.3129, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3896 => 0.3749, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.75% (0.2989 => 0.2877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.4033 => 0.3884, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.66% (0.4151 => 0.3999, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.65% (0.6441 => 0.6206, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.64% (0.4176 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.54% (0.9542 => 0.9204, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.45% (0.6484 => 0.6260, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -3.36% (0.7779 => 0.7518, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.32% (0.3884 => 0.3755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.12% (0.4199 => 0.4068, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.03% (0.3931 => 0.3812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (0.3849 => 0.3733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.82% (0.4321 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.76% (0.4280 => 0.4162, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.75% (20.7746 => 20.2023, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/moments: -2.71% (0.4248 => 0.4133, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.50% (0.7919 => 0.7721, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -2.40% (17.1032 => 16.6932, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.25% (1.0544 => 1.0307, std.dev.: 0.0072) MultiSource/Applications/lambda-0_1_3/lambda: -2.23% (0.7982 => 0.7804, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (14.2083 => 13.8945, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.10% (1.2210 => 1.1953, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: -2.10% (4.3330 => 4.2421, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.08% (0.4813 => 0.4713, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.92% (1.2221 => 1.1986, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.85% (16.1920 => 15.8930, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/football/football: -1.81% (0.9179 => 0.9013, std.dev.: 0.0064) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.79% (6.7716 => 6.6501, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.70% (34.0927 => 33.5141, std.dev.: 0.0215) MultiSource/Applications/JM/ldecod/ldecod: -1.69% (7.0961 => 6.9762, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.66% (1.2300 => 1.2096, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -1.63% (2.4021 => 2.3630, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8521 => 0.8399, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -1.36% (1.5610 => 1.5398, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.67% (1.8100 => 0.6937, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.50% (1.3643 => 1.0301, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0342, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1284, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8588, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (7.9763 => 7.7194, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.89% (1.3096 => 1.2848, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1937, std.dev.: 0.0290) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8094, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.31% (1.6086 => 1.5876, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.25% (1.6307 => 1.6103, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7092 => 3.6712, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 09:09:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 11:09:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111170955.D71A02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7500?compare_to=7495&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7500, Order: 172200, Start Time: 2013-01-11 14:58:52, End Time: 2013-01-11 17:09:56 To: 7495, Order: 172196, Start Time: 2013-01-11 12:17:42, End Time: 2013-01-11 14:28:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.20% (0.6541 => 0.6685, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8350 => 499.8525, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.95% (1.1277 => 499.8525, std.dev.: 0.0006) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.14% (0.5229 => 1.6374, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 19.12% (14.9895 => 17.8557, std.dev.: 0.0148) MultiSource/Applications/kimwitu++/kc: 43.18% (14.1553 => 20.2669, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 17.17% (4.1105 => 4.8161, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.31% (1.1048 => 1.7380, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.72% (7.1582 => 37.5605, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.63% (3.4629 => 6.3937, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.49% (0.6222 => 1.0857, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.50% (0.0720 => 7.4394, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11178900.00% (0.0001 => 11.1790, std.dev.: 0.0484) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484200.00% (0.0001 => 5.4843, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.61% (1.1194 => 10.3053, std.dev.: 0.0070) SingleSource/UnitTests/SignlessTypes/factor: 244.59% (0.0296 => 0.1020, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.47% (22.1758 => 55.3209, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.10% (0.0929 => 0.1766, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.54% (0.1463 => 0.2495, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6160, std.dev.: 0.0146) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.46% (7.0540 => 10.8250, std.dev.: 0.0139) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.24% (1.5859 => 2.3826, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 47.54% (0.1056 => 0.1558, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.27% (8.1363 => 11.9008, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/almabench: 41.10% (0.0730 => 0.1030, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.51% (2.2024 => 3.0946, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 39.78% (21.9371 => 30.6636, std.dev.: 0.0116) MultiSource/Applications/sgefa/sgefa: 38.44% (0.3109 => 0.4304, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.27% (0.0439 => 0.0607, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.45% (4.2646 => 5.6913, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0447, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.92% (0.4615 => 0.6088, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.2271 => 0.2939, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.12% (0.1892 => 0.2443, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 28.94% (0.4299 => 0.5543, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 28.35% (1.1642 => 1.4943, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.19% (0.6675 => 0.8557, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 27.12% (0.0719 => 0.0914, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.33% (0.5105 => 0.6449, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.82% (0.1584 => 0.1993, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.62% (0.0730 => 0.0917, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.29% (3.8922 => 4.8764, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 25.10% (0.2554 => 0.3195, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.93% (0.1143 => 0.1428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 24.06% (1.0722 => 1.3302, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 24.01% (0.4289 => 0.5319, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.61% (0.3121 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.29% (0.4620 => 0.5696, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.17% (1.4186 => 1.7473, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.89% (0.1337 => 0.1643, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 22.28% (9.4845 => 11.5981, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.06% (0.1695 => 0.2069, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.67% (0.2700 => 0.3285, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 21.41% (0.7115 => 0.8638) SingleSource/Benchmarks/Shootout-C++/matrix: 21.40% (0.3098 => 0.3761, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.84% (0.1555 => 0.1879, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 20.76% (0.1151 => 0.1390, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.20% (0.7835 => 0.9418, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 20.06% (0.6456 => 0.7751, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.05% (1.3050 => 1.5667, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 19.71% (5.7591 => 6.8944, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.25% (4.9449 => 5.8966, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.10% (0.8172 => 0.9733, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.57% (3.3354 => 3.9547, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.48% (5.0018 => 5.9259, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.81% (0.3307 => 0.3896, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.65% (0.5020 => 0.5906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.59% (0.2758 => 0.3243, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.48% (0.7433 => 0.8732, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.24% (0.1044 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.23% (0.2107 => 0.2470, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.97% (0.5569 => 0.6514, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.89% (0.9765 => 1.1414, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.86% (0.3423 => 0.4000, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.74% (1.1840 => 1.3822, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.41% (3.8723 => 4.5077, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: 16.29% (2.0273 => 2.3576, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.27% (0.5981 => 0.6954, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.68% (0.8101 => 0.9371, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 15.51% (2.2969 => 2.6531, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.32% (0.6450 => 0.7438, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 14.75% (0.3180 => 0.3649, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0818 => 0.0937, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.29% (0.8921 => 1.0196, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.21% (1.1861 => 1.3547, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary2: 14.18% (0.3379 => 0.3858, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.58% (0.3865 => 0.4390, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.52% (0.8067 => 0.9158, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: 13.27% (1.5603 => 1.7673, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.25% (0.2603 => 0.2948, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.20% (0.4636 => 0.5248, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.75% (0.4103 => 0.4626, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 12.49% (0.3387 => 0.3810, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.25% (0.4203 => 0.4718, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.99% (0.3603 => 0.4035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.96% (0.4048 => 0.4532, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.94% (0.3826 => 0.4283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.67% (0.1114 => 0.1244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.66% (0.3422 => 0.3821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 11.51% (0.3684 => 0.4108, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.91% (0.3282 => 0.3640, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.88% (17.1811 => 19.0500, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.82% (0.2430 => 0.2693, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.51% (0.4064 => 0.4491, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.46% (14.3668 => 15.8695, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 10.24% (0.2831 => 0.3121, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.01% (0.3427 => 0.3770, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.76% (2.0665 => 2.2682, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 9.68% (0.2871 => 0.3149) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.6030 => 0.6598, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.32% (0.2877 => 0.3145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.30% (0.3162 => 0.3456, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.02% (0.2905 => 0.3167, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.99% (0.3136 => 0.3418, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.96% (0.3650 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.91% (0.7326 => 0.7979, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.85% (1.2842 => 1.3978, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2756 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.72% (0.3935 => 0.4278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.52% (0.3052 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.25% (0.2714 => 0.2938, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.02% (63.2438 => 68.3141, std.dev.: 0.0398) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.94% (0.1625 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (2.2022 => 2.3602, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.05% (0.4879 => 0.5174, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 5.07% (10.3673 => 10.8934, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.3131 => 0.3254, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3817 => 0.3959, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.34% (7.9617 => 8.1484, std.dev.: 0.0105) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2551, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4500, std.dev.: 0.0153) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (3.1578 => 3.3100, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.35% (2.0360 => 2.1042, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.10% (0.9957 => 1.0266, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.53% (8.6802 => 8.8998, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7183, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2922, std.dev.: 0.0077) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8444 => 28.2319, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4502, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1752, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.56% (0.8651 => 0.2114, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.42% (5.3855 => 4.4474, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.04% (5.3526 => 4.4407, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -13.74% (10.4361 => 9.0020, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.80% (1.7609 => 1.6060, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9287, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.85% (1.9577 => 0.6685, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -33.69% (1.5373 => 1.0194, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4346, std.dev.: 0.0258) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8607, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0042, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.62% (0.2161 => 0.1737, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7335, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4939, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2960, std.dev.: 0.0383) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/McGill/chomp: -7.18% (1.2373 => 1.1485, std.dev.: 0.0158) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.26% (8.1563 => 7.7274, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -4.57% (10.2830 => 9.8127, std.dev.: 0.0154) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7221 => 3.6694, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/ary3: -1.20% (3.6994 => 3.6550, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0000) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 10:32:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 12:32:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111183223.0E83A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7501?compare_to=7497&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7501, Order: 172211, Start Time: 2013-01-11 16:27:37, End Time: 2013-01-11 18:32:25 To: 7497, Order: 172199, Start Time: 2013-01-11 14:06:45, End Time: 2013-01-11 16:07:51 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (8 on baseline) Performance Improvements: 1 (30 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1053 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.76% (0.2489 => 0.2707, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.05% (3.4555 => 3.6646, std.dev.: 0.0430) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.17% (44.1401 => 48.1858, std.dev.: 0.7852) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.12% (2.2379 => 2.4197, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.33% (0.3462 => 0.3612, std.dev.: 0.0012) SingleSource/Benchmarks/Linpack/linpack-pc: 3.47% (51.1635 => 52.9403, std.dev.: 0.0677) MultiSource/Applications/lua/lua: 2.82% (28.4925 => 29.2962, std.dev.: 0.1257) MultiSource/Applications/SIBsim4/SIBsim4: 2.01% (3.4372 => 3.5064, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/whetstone: 1.10% (1.6125 => 1.6302, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (4.9997 => 4.7254, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.43% (1.1130 => 1.1082, std.dev.: 0.0945) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.02% (0.0431 => 0.0418, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.52% (0.0336 => 0.0304, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0322 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0428 => 0.0430, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0204 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: 3.20% (0.0219 => 0.0226, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.98% (0.1427 => 0.1498, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -3.16% (1.2487 => 1.2092, std.dev.: 0.3799) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.90% (0.4107 => 0.4029, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.24% (0.1471 => 0.1504, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.71% (0.0980 => 0.0987, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 51.37% (0.0183 => 0.0277, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.64% (0.0572 => 0.0534, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1518 => 1.1486, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.34% (0.0599 => 0.0607, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.04% (0.0276 => 0.0312, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.09% (0.7424 => 0.7505, std.dev.: 0.0068) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.70% (0.0037 => 0.0075, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.03% (12.7834 => 12.7801, std.dev.: 0.0749) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324312.50% (0.0008 => 2.5953, std.dev.: 0.0460) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 96.88% (1.1825 => 2.3281, std.dev.: 0.0451) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.55% (2.2499 => 2.4197, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.53% (46.0987 => 48.1858, std.dev.: 0.7852) MultiSource/Applications/JM/lencod/lencod: 4.35% (6.8159 => 7.1123, std.dev.: 0.0749) SingleSource/Benchmarks/Linpack/linpack-pc: 4.02% (50.8945 => 52.9403, std.dev.: 0.0677) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.19% (0.8800 => 0.8993, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.01% (0.0676 => 0.0534, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -20.84% (0.1684 => 0.1333, std.dev.: 0.0090) MultiSource/Applications/hbd/hbd: -19.61% (1.8964 => 1.5246, std.dev.: 0.0680) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.13% (0.0862 => 0.0723, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (0.2006 => 0.1871, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.10% (0.2100 => 0.1972, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: -5.75% (0.5134 => 0.4839, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/matrix: -5.37% (0.2385 => 0.2257, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.23% (1.0234 => 0.9699, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.14% (0.9091 => 0.8624, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.13% (0.8990 => 0.8529, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.03% (0.9788 => 0.9296, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/methcall: -4.92% (0.2135 => 0.2030, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.2551 => 0.2430, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.73% (0.9403 => 0.8958, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.3665 => 0.3499, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.80% (1.3220 => 1.2718, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.49% (1.0119 => 0.9766, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.39% (4.6579 => 4.4999, std.dev.: 0.0497) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.29% (0.9855 => 0.9531, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.92% (0.9061 => 0.8796, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.77% (0.8893 => 0.8647, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.84% (7.2721 => 7.1384, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.79% (0.9564 => 0.9393, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.51% (0.9372 => 0.6606, std.dev.: 0.1006) SingleSource/Benchmarks/Shootout/hash: -10.39% (4.5259 => 4.0558, std.dev.: 0.1419) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.57% (1.4588 => 1.3483, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.43% (23.3986 => 22.1273, std.dev.: 0.4048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (3.1921 => 3.1412, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.01% (1.2047 => 1.1082, std.dev.: 0.0945) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.32% (0.0451 => 0.0418, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.84% (0.0394 => 0.0304, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/test1: -0.44% (0.0227 => 0.0226, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.09% (0.1530 => 0.1498, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -37.32% (1.9293 => 1.2092, std.dev.: 0.3799) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.49% (0.4049 => 0.4029, std.dev.: 0.0588) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1510 => 0.1504, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.92% (0.0978 => 0.0987, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.49% (0.0590 => 0.0534, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.13% (1.1617 => 1.1486, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.42% (0.0268 => 0.0312, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.91% (0.7437 => 0.7505, std.dev.: 0.0068) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.48% (0.0092 => 0.0075, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7781 => 12.7801, std.dev.: 0.0749) Report Time: 0.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 11:03:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 13:03:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111190301.1C4CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7502?compare_to=7499&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7502, Order: 172214, Start Time: 2013-01-11 17:28:48, End Time: 2013-01-11 19:03:01 To: 7499, Order: 172201, Start Time: 2013-01-11 15:31:12, End Time: 2013-01-11 17:05:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 193.02% (0.0315 => 0.0923, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.51% (0.6395 => 0.8794, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.81% (0.6395 => 0.8685, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.58% (0.6260 => 0.8362, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.61% (0.5688 => 0.7543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.39% (0.5805 => 0.7685, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.35% (0.5456 => 0.7221, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.80% (0.6230 => 0.8211, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.57% (0.5575 => 0.7335, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.53% (0.5567 => 0.7322, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.52% (0.5581 => 0.7340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.27% (0.5941 => 0.7799, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.89% (0.5802 => 0.7594, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.57% (0.6033 => 0.7877, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.50% (0.5705 => 0.7445, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.21% (0.5849 => 0.7616, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.21% (0.5859 => 0.7629, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.07% (0.5478 => 0.7125, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.78% (0.5570 => 0.7229, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.74% (0.6440 => 0.8355, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.63% (0.5569 => 0.7219, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.55% (0.5925 => 0.7676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.44% (0.5591 => 0.7237, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 29.19% (0.0418 => 0.0540, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.47% (0.6052 => 0.7775, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.41% (0.5857 => 0.7521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.38% (0.5863 => 0.7527, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.27% (0.6676 => 0.8563, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.96% (0.6446 => 0.8248, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.87% (0.6304 => 0.8061, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.32% (1.6474 => 2.0974, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.74% (0.6194 => 0.7850, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.34% (0.6660 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.19% (0.6297 => 0.7946, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.04% (0.6681 => 0.8421, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (0.6667 => 0.8307, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.63% (0.7524 => 0.9302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.59% (0.7339 => 0.8997, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.23% (2.2587 => 2.7156, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.26% (0.0621 => 0.0722) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.80% (1.1450 => 1.3145, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 14.72% (0.3357 => 0.3851, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.97% (0.1081 => 0.1232, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.51% (0.1982 => 0.2230, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 12.27% (0.4515 => 0.5069, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.52% (4.5069 => 5.0259, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8248, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.49% (0.4916 => 0.5481, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.38% (3.5339 => 3.9007, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2385 => 0.2613, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.20% (0.7021 => 0.7597, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.90% (0.2001 => 0.2159, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 7.31% (1.2515 => 1.3430, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash: 7.18% (0.4524 => 0.4849, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.17% (0.5329 => 0.5711, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1731 => 0.1848, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (9.2283 => 9.8124, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.4642 => 1.5546, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/hash2: 6.11% (0.4861 => 0.5158, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.08% (1.2784 => 1.3561, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3319 => 0.3461, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.66% (5.4682 => 5.6684, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 2.74% (0.6750 => 0.6935, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (1.3864 => 1.4221, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 2.53% (5.0226 => 5.1495, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 2.26% (0.8418 => 0.8608, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.9557 => 0.9670, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.16% (1.3722 => 1.3881, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.10% (22.4056 => 22.6523, std.dev.: 0.0180) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6780, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9531 => 1.0293, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4418, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1690, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5575, std.dev.: 0.0666) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.19% (2.0478 => 2.1132, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3814, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.62% (2.4924 => 2.3773, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.42% (0.3057 => 0.2922, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.40% (0.9852 => 0.9419, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.95% (0.2939 => 0.2823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.85% (0.3016 => 0.2900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.83% (0.3025 => 0.2909, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.79% (0.7198 => 0.6925, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.72% (2.1713 => 2.0905, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -3.64% (1.3148 => 1.2669, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.63% (0.3252 => 0.3134, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.9542 => 0.9205, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3880 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3812 => 0.3682, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.40% (0.4151 => 0.4010, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.39% (0.3658 => 0.3534, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.38% (0.2989 => 0.2888, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -3.37% (0.6347 => 0.6133, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.37% (0.3831 => 0.3702, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3896 => 0.3765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.35% (0.3848 => 0.3719, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.32% (0.4033 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.23% (0.4176 => 0.4041, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.21% (0.6484 => 0.6276, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: -3.14% (0.6441 => 0.6239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3931 => 0.3811, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.01% (0.3891 => 0.3774, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -2.95% (0.3621 => 0.3514, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1931, std.dev.: 0.0304) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.78% (0.4321 => 0.4201, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.76% (0.4199 => 0.4083, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.72% (0.3867 => 0.3762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.71% (0.4427 => 0.4307, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.65% (0.7779 => 0.7573, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -2.52% (0.4248 => 0.4141, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.45% (0.4280 => 0.4175, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.44% (0.7919 => 0.7726, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -2.40% (17.1032 => 16.6919, std.dev.: 0.0215) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.21% (1.0544 => 1.0311, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.20% (14.2083 => 13.8956, std.dev.: 0.0199) MultiSource/Benchmarks/MallocBench/gs/gs: -2.09% (4.3330 => 4.2424, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.85% (1.2210 => 1.1984, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.80% (0.7982 => 0.7838, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -1.78% (16.1920 => 15.9035, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/football/football: -1.68% (0.9179 => 0.9025, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -1.63% (7.0961 => 6.9803, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.62% (1.2300 => 1.2101, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.61% (1.2221 => 1.2024, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (6.7716 => 6.6627, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.48% (34.0927 => 33.5874, std.dev.: 0.0533) MultiSource/Applications/siod/siod: -1.43% (2.4021 => 2.3677, std.dev.: 0.0127) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5420, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6942, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.09% (0.1983 => 0.1426, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel-2: -24.31% (1.3643 => 1.0326, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0300, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1282, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.70% (0.5142 => 0.4643, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8592, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (7.9763 => 7.7300, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.68% (3.7241 => 3.6243, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.97% (1.6307 => 1.5986, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8034, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1981, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.44% (6.5735 => 6.4787, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6010, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6709, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 11:50:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 13:50:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111195059.74BEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7503?compare_to=7500&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7503, Order: 172214, Start Time: 2013-01-11 17:40:05, End Time: 2013-01-11 19:51:00 To: 7500, Order: 172200, Start Time: 2013-01-11 14:58:52, End Time: 2013-01-11 17:09:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.86% (3.8209 => 3.8921, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/chomp: 1.14% (1.1485 => 1.1616, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8525 => 499.8486, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.61% (1.1277 => 499.8486, std.dev.: 0.0085) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.81% (0.5229 => 1.6409, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 19.24% (14.9895 => 17.8734, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 43.06% (14.1553 => 20.2499, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 17.09% (4.1105 => 4.8130, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.64% (1.1048 => 1.7416, std.dev.: 0.0108) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.93% (7.1582 => 37.5042, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.59% (3.4629 => 6.3921, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.57% (0.6222 => 1.0862, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10248.06% (0.0720 => 7.4506, std.dev.: 0.0097) MultiSource/Applications/SIBsim4/SIBsim4: 3835300.00% (0.0001 => 3.8354, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11208300.00% (0.0001 => 11.2084, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848800.00% (0.0001 => 9.8489, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0093) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.79% (1.1194 => 10.2737, std.dev.: 0.0055) SingleSource/UnitTests/SignlessTypes/factor: 245.27% (0.0296 => 0.1022, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 149.15% (22.1758 => 55.2519, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.20% (0.0929 => 0.1767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.61% (0.1463 => 0.2496, std.dev.: 0.0068) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.44% (2.9384 => 4.6263, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.04% (7.0540 => 10.8658, std.dev.: 0.0060) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.27% (1.5859 => 2.3832, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.82% (0.1056 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.26% (8.1363 => 11.8998, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.67% (2.2024 => 3.0981, std.dev.: 0.0159) MultiSource/Applications/JM/lencod/lencod: 40.22% (21.9371 => 30.7611, std.dev.: 0.0138) MultiSource/Applications/sgefa/sgefa: 38.79% (0.3109 => 0.4315, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.53% (4.2646 => 5.6946, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.04% (1.5415 => 2.0508, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.09% (0.4615 => 0.6096, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.68% (0.2271 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.55% (0.1892 => 0.2451, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.12% (0.4299 => 0.5551, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4950, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.13% (0.6675 => 0.8553, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.46% (0.5105 => 0.6456, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 25.28% (0.1175 => 0.1472, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.18% (0.2554 => 0.3197, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.16% (3.8922 => 4.8716, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.07% (0.1125 => 0.1407, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 24.27% (1.0722 => 1.3324, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.59% (0.4620 => 0.5710, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.52% (0.3121 => 0.3855, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.45% (0.1143 => 0.1411, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.23% (1.4186 => 1.7482, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.80% (0.0842 => 0.1034, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 22.56% (9.4845 => 11.6243, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/matrix: 21.92% (0.3098 => 0.3777, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.89% (0.1695 => 0.2066, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.52% (0.2700 => 0.3281, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.32% (0.7115 => 0.8632, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636) MultiSource/Applications/spiff/spiff: 20.63% (0.7835 => 0.9451, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.29% (1.3050 => 1.5698, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.21% (0.6456 => 0.7761, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 20.09% (5.7591 => 6.9162, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.42% (4.9449 => 5.9052, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.5860 => 0.6987, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.15% (0.8172 => 0.9737, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 18.94% (0.1151 => 0.1369, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.78% (3.3354 => 3.9618, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.63% (5.0018 => 5.9337, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 18.32% (0.7433 => 0.8795, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.87% (0.3307 => 0.3898, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.63% (0.5020 => 0.5905, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.28% (0.1510 => 0.1771, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.22% (0.5569 => 0.6528, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.11% (0.9765 => 1.1436, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 17.09% (0.3283 => 0.3844, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 16.93% (1.1840 => 1.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.68% (0.3232 => 0.3771, std.dev.: 0.0047) MultiSource/Applications/treecc/treecc: 16.52% (2.0273 => 2.3623, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 16.50% (3.8723 => 4.5112, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.44% (0.5981 => 0.6964, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.73% (0.8101 => 0.9375, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 15.50% (2.2969 => 2.6529, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1044 => 0.1203, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.22% (0.6450 => 0.7432, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 15.18% (0.2049 => 0.2360, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.97% (0.3180 => 0.3656, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.60% (1.1861 => 1.3593, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 14.53% (0.8921 => 1.0217, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3865 => 0.4396, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.73% (0.8067 => 0.9175, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.46% (0.4636 => 0.5260, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.40% (1.5603 => 1.7694, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.29% (0.2603 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.01% (0.4103 => 0.4637, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.61% (0.4203 => 0.4733, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.61% (0.3387 => 0.3814, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.27% (0.3927 => 0.4409, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.25% (0.4048 => 0.4544, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 12.24% (0.3603 => 0.4044, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 12.10% (0.3422 => 0.3836, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.07% (0.3886 => 0.4355, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.75% (0.3684 => 0.4117, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.45% (0.3826 => 0.4264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.23% (0.3543 => 0.3941, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/synchronized: 11.20% (0.3561 => 0.3960, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 11.07% (0.3497 => 0.3884, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.01% (17.1811 => 19.0731, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/strcat: 10.67% (0.2831 => 0.3133, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.66% (14.3668 => 15.8988, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 10.51% (0.3092 => 0.3417, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.27% (0.3427 => 0.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.17% (2.0665 => 2.2767, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 9.70% (0.2877 => 0.3156, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.64% (0.2905 => 0.3185) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.61% (0.3162 => 0.3466, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.6030 => 0.6605, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.34% (0.2891 => 0.3161, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.29% (0.3650 => 0.3989, std.dev.: 0.0122) SingleSource/UnitTests/ObjC++/property-reference: 9.24% (0.7326 => 0.8003, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.18% (1.2842 => 1.4021, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.17% (0.3052 => 0.3332, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2725 => 0.2975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.15% (0.5925 => 0.6467, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.10% (0.2802 => 0.3057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.92% (0.2793 => 0.3042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.72% (0.3935 => 0.4278, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.58% (0.3136 => 0.3405, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.97% (63.2438 => 68.2825, std.dev.: 0.0273) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.11% (2.2022 => 2.3587, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 5.07% (10.3673 => 10.8933, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.77% (0.3817 => 0.3961, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (7.9617 => 8.1687, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2567, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (4.2280 => 4.4452, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3131, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (0.9957 => 1.0323, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 3.02% (3.7781 => 3.8921, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9071, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (3.6395 => 3.7149, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2206, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2847, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8444 => 28.2319, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.62% (5.2763 => 1.1807, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.61% (0.8651 => 0.2110, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.77% (0.1622 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.24% (5.3855 => 4.4568, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.96% (5.3526 => 4.4446, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: -13.39% (10.4361 => 9.0385, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.55% (1.7609 => 1.6103, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -7.94% (54.1659 => 49.8669, std.dev.: 0.0127) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.56% (1.9577 => 0.6546, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5624) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.40% (0.0628 => 0.0368, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3086, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0221, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4301, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8635, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.54% (2.6546 => 2.0032, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.84% (1.6925 => 1.4244, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4934, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3037, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.12% (1.2373 => 1.1616, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.97% (0.4808 => 0.4569, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.91% (8.1563 => 7.7559, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8290, std.dev.: 0.0087) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1557, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: -1.84% (3.6994 => 3.6312, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2786, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2212, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std.dev.: 0.0099) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0015) Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 12:58:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 14:58:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111205838.A01AF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7504?compare_to=7501&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7504, Order: 172229, Start Time: 2013-01-11 18:50:58, End Time: 2013-01-11 20:58:41 To: 7501, Order: 172211, Start Time: 2013-01-11 16:27:37, End Time: 2013-01-11 18:32:25 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 53 (40 on baseline) Performance Improvements: 2 (21 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1008 (1002 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 184.13% (0.0063 => 0.0179, std.dev.: 0.0016) SingleSource/UnitTests/2003-10-13-SwitchTest: 156.25% (0.0096 => 0.0246, std.dev.: 0.0005) SingleSource/UnitTests/2003-07-10-SignConversions: 79.25% (0.0159 => 0.0285, std.dev.: 0.0006) SingleSource/Regression/C++/short_circuit_dtor: 73.84% (0.0172 => 0.0299, std.dev.: 0.0024) SingleSource/UnitTests/vla: 72.49% (0.0458 => 0.0790, std.dev.: 0.0025) SingleSource/Regression/C++/pointer_method2: 72.40% (0.0250 => 0.0431, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 71.91% (0.0502 => 0.0863, std.dev.: 0.0008) SingleSource/UnitTests/2002-10-12-StructureArgs: 70.48% (0.0166 => 0.0283, std.dev.: 0.0012) SingleSource/Regression/C/matrixTranspose: 70.16% (0.0258 => 0.0439, std.dev.: 0.0016) SingleSource/Regression/C++/EH/simple_rethrow: 69.38% (0.0209 => 0.0354, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 69.29% (0.0280 => 0.0474, std.dev.: 0.0008) SingleSource/Regression/C/2003-05-21-BitfieldHandling: 67.86% (0.0168 => 0.0282, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-31-CastToBool: 65.90% (0.0261 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/2002-05-02-CastTest2: 63.50% (0.0200 => 0.0327, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 62.40% (0.0508 => 0.0825, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/div: 61.34% (0.0313 => 0.0505, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/rem: 54.07% (0.1156 => 0.1781, std.dev.: 0.0045) SingleSource/UnitTests/Threads/tls: 51.83% (0.0218 => 0.0331, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Queens: 50.71% (0.0420 => 0.0633, std.dev.: 0.0056) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 50.00% (0.0232 => 0.0348, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 49.74% (0.1333 => 0.1996, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 49.29% (0.0702 => 0.1048, std.dev.: 0.0062) SingleSource/UnitTests/2003-07-09-SignedArgs: 39.64% (0.0275 => 0.0384, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 39.04% (0.0707 => 0.0983, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.37% (1.2764 => 1.7023, std.dev.: 0.1265) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.07% (4.7998 => 5.6189, std.dev.: 0.2359) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 15.54% (4.4999 => 5.1993, std.dev.: 0.2433) MultiSource/Applications/Burg/burg: 14.61% (1.4288 => 1.6375, std.dev.: 0.0424) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.37% (14.7132 => 16.5328, std.dev.: 0.5128) MultiSource/Applications/hexxagon/hexxagon: 11.28% (1.0143 => 1.1287, std.dev.: 0.0337) MultiSource/Benchmarks/Bullet/bullet: 8.71% (34.1350 => 37.1067, std.dev.: 0.9535) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.58% (0.9556 => 1.0185, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.69% (0.8647 => 0.9139, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: 5.37% (2.5569 => 2.6942, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.31% (0.9020 => 0.9499, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.98% (0.9296 => 0.9759, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.03% (0.3748 => 0.3899, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.68% (1.2181 => 1.2507, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.67% (0.8942 => 0.9091, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/d/make_dparser: 52.59% (0.0386 => 0.0589, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 38.42% (3.2053 => 4.4367, std.dev.: 0.3327) SingleSource/Benchmarks/Shootout/heapsort: 37.29% (3.4440 => 4.7283, std.dev.: 0.1574) SingleSource/Benchmarks/CoyoteBench/fftbench: 30.84% (1.5878 => 2.0774, std.dev.: 0.0583) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.12% (2.4586 => 3.0025, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/pi: 22.09% (1.7456 => 2.1312, std.dev.: 0.0406) SingleSource/Benchmarks/CoyoteBench/lpbench: 19.75% (4.1745 => 4.9991, std.dev.: 0.1033) SingleSource/Benchmarks/Shootout/hash: 8.25% (4.0558 => 4.3905, std.dev.: 0.0541) SingleSource/Benchmarks/Shootout/ary3: 6.37% (2.0923 => 2.2255, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.59% (22.1273 => 22.9208, std.dev.: 0.0148) SingleSource/Benchmarks/McGill/chomp: 2.94% (1.0096 => 1.0393, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.10% (3.1412 => 3.2072, std.dev.: 0.0158) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.69% (39.2554 => 39.9199, std.dev.: 0.1752) SingleSource/Benchmarks/Misc/flops-1: 1.22% (2.2831 => 2.3110, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: -3.77% (52.9403 => 50.9430, std.dev.: 0.1464) MultiSource/Applications/lua/lua: -1.46% (29.2962 => 28.8679, std.dev.: 0.0727) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.13% (1.1082 => 1.1207, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 24.09% (0.0220 => 0.0273, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.78% (0.0418 => 0.0438, std.dev.: 0.0195) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.18% (0.0304 => 0.0338, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0320 => 0.0323, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.09% (0.0430 => 0.0439, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: 3.43% (0.0204 => 0.0211, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -1.33% (0.0226 => 0.0223, std.dev.: 0.0095) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.70% (0.0253 => 0.0231, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1498 => 0.1491, std.dev.: 0.0132) MultiSource/Applications/lemon/lemon: 8.10% (1.2092 => 1.3071, std.dev.: 0.3719) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.34% (0.4029 => 0.3975, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.21% (0.1504 => 0.1808, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 35.36% (0.0987 => 0.1336, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.69% (0.0277 => 0.0228, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 29.78% (0.0534 => 0.0693, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.32% (1.1486 => 1.1523, std.dev.: 0.0305) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.65% (0.0607 => 0.0617, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.88% (0.0312 => 0.0303, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7505 => 0.7627, std.dev.: 0.1060) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 800.00% (0.0001 => 0.0009, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 900.00% (0.0001 => 0.0010) SingleSource/UnitTests/SignlessTypes/Large/cast: 65.33% (0.0075 => 0.0124, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7801 => 12.7745, std.dev.: 0.3229) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-02-02-NegativeZero: 233.33% (0.0060 => 0.0200, std.dev.: 0.0003) SingleSource/UnitTests/printargs: 155.43% (0.0092 => 0.0235, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 145.54% (0.0336 => 0.0825, std.dev.: 0.0016) SingleSource/Regression/C/2003-05-21-BitfieldHandling: 84.31% (0.0153 => 0.0282, std.dev.: 0.0003) SingleSource/Regression/C++/pointer_method2: 74.49% (0.0247 => 0.0431, std.dev.: 0.0011) SingleSource/UnitTests/2003-10-29-ScalarReplBug: 74.31% (0.0144 => 0.0251, std.dev.: 0.0011) SingleSource/UnitTests/vla: 72.49% (0.0458 => 0.0790, std.dev.: 0.0025) SingleSource/Regression/C++/EH/simple_rethrow: 71.01% (0.0207 => 0.0354, std.dev.: 0.0010) SingleSource/UnitTests/2003-07-10-SignConversions: 70.66% (0.0167 => 0.0285, std.dev.: 0.0006) SingleSource/UnitTests/2002-10-12-StructureArgs: 68.45% (0.0168 => 0.0283, std.dev.: 0.0012) SingleSource/Regression/C/matrixTranspose: 68.20% (0.0261 => 0.0439, std.dev.: 0.0016) SingleSource/UnitTests/2003-08-20-FoldBug: 68.18% (0.0154 => 0.0259, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-31-CastToBool: 66.54% (0.0260 => 0.0433, std.dev.: 0.0012) SingleSource/Regression/C++/short_circuit_dtor: 66.11% (0.0180 => 0.0299, std.dev.: 0.0024) SingleSource/UnitTests/2002-05-02-CastTest2: 63.50% (0.0200 => 0.0327, std.dev.: 0.0025) SingleSource/UnitTests/AtomicOps: 61.82% (0.0165 => 0.0267, std.dev.: 0.0022) SingleSource/Regression/C/sumarraymalloc: 61.77% (0.0293 => 0.0474, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/div: 57.81% (0.0320 => 0.0505, std.dev.: 0.0017) SingleSource/UnitTests/Threads/tls: 53.95% (0.0215 => 0.0331, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: 53.14% (0.1163 => 0.1781, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Queens: 45.18% (0.0436 => 0.0633, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 43.56% (0.0730 => 0.1048, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 41.03% (0.0697 => 0.0983, std.dev.: 0.0048) SingleSource/UnitTests/2003-07-09-SignedArgs: 39.64% (0.0275 => 0.0384, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 18.71% (0.0727 => 0.0863, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.53% (0.1684 => 0.1996, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.90% (4.8904 => 5.6189, std.dev.: 0.2359) MultiSource/Benchmarks/Bullet/bullet: 11.62% (33.2440 => 37.1067, std.dev.: 0.9535) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (14.9757 => 16.5328, std.dev.: 0.5128) MultiSource/Benchmarks/PAQ8p/paq8p: 4.54% (2.5772 => 2.6942, std.dev.: 0.0373) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321525.00% (0.0008 => 2.5730, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.32% (1.1825 => 2.4043, std.dev.: 0.0338) MultiSource/Applications/d/make_dparser: 53.79% (0.0383 => 0.0589, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.55% (1.6547 => 2.0774, std.dev.: 0.0583) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.29% (2.5170 => 3.0025, std.dev.: 0.0374) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 13.01% (2.2499 => 2.5425, std.dev.: 0.0618) MultiSource/Benchmarks/7zip/7zip-benchmark: 12.97% (9.0082 => 10.1766, std.dev.: 0.4352) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.24% (4.4540 => 4.9991, std.dev.: 0.1033) MultiSource/Applications/JM/lencod/lencod: 3.73% (6.8159 => 7.0698, std.dev.: 0.0725) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.66% (0.5897 => 0.6054, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.15% (0.1009 => 0.0836, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.86% (1.0986 => 0.9463, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.99% (0.0862 => 0.0750, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -8.98% (4.6406 => 4.2240, std.dev.: 0.1324) MultiSource/Applications/treecc/treecc: -7.42% (2.4719 => 2.2884, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.66% (6.4235 => 5.9958, std.dev.: 0.1267) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.69% (0.9550 => 0.9007, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/matrix: -4.91% (0.2385 => 0.2268, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.51% (0.2618 => 0.2500, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -23.67% (0.9372 => 0.7154, std.dev.: 0.0453) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.09% (0.1164 => 0.1000, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.10% (1.4588 => 1.3407, std.dev.: 0.0348) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.34% (0.3217 => 0.2981, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: -6.29% (0.3654 => 0.3424, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.00% (0.3349 => 0.3148, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: -3.07% (17.2182 => 16.6890, std.dev.: 0.1421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.04% (23.3986 => 22.9208, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: -1.62% (3.5443 => 3.4869, std.dev.: 0.0218) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.37% (40.4729 => 39.9199, std.dev.: 0.1752) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.97% (1.2047 => 1.1207, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 17.17% (0.0233 => 0.0273, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0195) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.35% (0.0445 => 0.0439, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/casts: -0.94% (0.0213 => 0.0211, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0095) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.55% (0.1530 => 0.1491, std.dev.: 0.0132) MultiSource/Applications/lemon/lemon: -32.25% (1.9293 => 1.3071, std.dev.: 0.3719) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4049 => 0.3975, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.74% (0.1510 => 0.1808, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 36.61% (0.0978 => 0.1336, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.39% (0.0276 => 0.0228, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.46% (0.0590 => 0.0693, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.81% (1.1617 => 1.1523, std.dev.: 0.0305) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0610 => 0.0617, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.06% (0.0268 => 0.0303, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.55% (0.7437 => 0.7627, std.dev.: 0.1060) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 800.00% (0.0001 => 0.0009, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 25.00% (0.0008 => 0.0010) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.78% (0.0092 => 0.0124, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.03% (12.7781 => 12.7745, std.dev.: 0.3229) Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 13:00:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 15:00:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111210058.975872A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7505?compare_to=7502&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7505, Order: 172235, Start Time: 2013-01-11 19:26:48, End Time: 2013-01-11 21:00:59 To: 7502, Order: 172214, Start Time: 2013-01-11 17:28:48, End Time: 2013-01-11 19:03:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (125 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.33% (1.2737 => 1.2907, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 192.70% (0.0315 => 0.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.79% (0.0280 => 0.0523, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.70% (0.0974 => 0.1575, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.48% (0.6395 => 0.8792, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.64% (0.6395 => 0.8674, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.58% (0.6260 => 0.8362, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.56% (0.5688 => 0.7540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.91% (0.6230 => 0.8218, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.66% (0.5581 => 0.7348, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.52% (0.5575 => 0.7332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.29% (0.5941 => 0.7800, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.73% (0.5802 => 0.7585, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.65% (0.6033 => 0.7882, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.57% (0.5705 => 0.7449, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.28% (0.5859 => 0.7633, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.14% (0.5849 => 0.7612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.12% (0.5478 => 0.7128, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.91% (0.5570 => 0.7236, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.69% (0.6440 => 0.8352, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.68% (0.5569 => 0.7222, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.55% (0.5591 => 0.7243, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.47% (0.5925 => 0.7671, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.59% (0.6052 => 0.7782, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.44% (0.6189 => 0.7949, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.42% (0.5863 => 0.7529, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.39% (0.5857 => 0.7520, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.28% (0.6446 => 0.8269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.25% (0.6676 => 0.8562, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.82% (0.6304 => 0.8058, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.35% (1.6474 => 2.0979, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.75% (0.6194 => 0.7851, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.25% (0.6660 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.20% (0.6297 => 0.7947, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.12% (0.6681 => 0.8426, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.64% (0.6667 => 0.8310, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.55% (0.7524 => 0.9296, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.73% (0.7339 => 0.9007, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.20% (2.2587 => 2.7150, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.26% (0.0621 => 0.0722, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.91% (1.1450 => 1.3157, std.dev.: 0.0145) MultiSource/Applications/sgefa/sgefa: 14.33% (0.3357 => 0.3838, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.21% (0.1982 => 0.2224, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.60% (4.5069 => 5.0298, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.47% (0.4916 => 0.5480, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.42% (1.6364 => 1.8232, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.16% (0.4515 => 0.5019, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.33% (3.5339 => 3.8991, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.75% (0.2001 => 0.2176, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.7021 => 0.7580, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.36% (0.4524 => 0.4857, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.34% (0.1731 => 0.1858, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.20% (1.2515 => 1.3416, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.72% (0.5329 => 0.5687, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.4642 => 1.5595, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (9.2283 => 9.8080, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/ReedSolomon: 6.28% (0.1879 => 0.1997, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4861 => 0.5162, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.2784 => 1.3557, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (5.4682 => 5.6374, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.64% (5.0226 => 5.1552, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6750 => 0.6927, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.3864 => 1.4175, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.98% (0.8418 => 0.8585, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.18% (1.3722 => 1.3884, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.09% (0.9557 => 0.9661, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6774, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.32% (0.9531 => 1.0324, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4411, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1691, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5520, std.dev.: 0.3534) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.19% (2.0478 => 2.1131, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.3328 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3819, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6042, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.06% (4.4335 => 4.4805, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.73% (2.4924 => 2.3745, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.49% (0.7198 => 0.6875, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (0.9852 => 0.9410, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.39% (0.3142 => 0.3004, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3812 => 0.3648, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.16% (0.3848 => 0.3688, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.09% (0.3884 => 0.3725, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.07% (0.3880 => 0.3722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3831 => 0.3676, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.4033 => 0.3870, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.00% (0.3026 => 0.2905, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.96% (0.3891 => 0.3737, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.93% (2.1713 => 2.0860, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.4176 => 0.4014, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.88% (0.2939 => 0.2825, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.76% (0.3059 => 0.2944, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.67% (1.3148 => 1.2666, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.9542 => 0.9193, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.51% (0.3016 => 0.2910, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.43% (0.4199 => 0.4055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.34% (0.6441 => 0.6226, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.16% (0.6484 => 0.6279, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3931 => 0.3811, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: -3.01% (0.3621 => 0.3512, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.84% (0.4151 => 0.4033, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.82% (0.7779 => 0.7560, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.78% (0.4427 => 0.4304, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.78% (0.4321 => 0.4201, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.75% (0.3849 => 0.3743, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2590, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.48% (0.7919 => 0.7723, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -2.38% (0.4248 => 0.4147, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.34% (14.2083 => 13.8762, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -2.28% (17.1032 => 16.7135, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.13% (1.2221 => 1.1961, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.12% (1.2210 => 1.1951, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: -2.08% (4.3330 => 4.2428, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.08% (1.0544 => 1.0325, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.94% (6.7716 => 6.6405, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: -1.91% (16.1920 => 15.8831, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: -1.77% (7.0961 => 6.9707, std.dev.: 0.0180) MultiSource/Benchmarks/Bullet/bullet: -1.72% (34.0927 => 33.5071, std.dev.: 0.0317) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.70% (2.4021 => 2.3613, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -1.66% (0.9179 => 0.9027, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -1.56% (1.5610 => 1.5366, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8521 => 0.8398, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.16% (1.8100 => 0.6849, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3095, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0308, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1301, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6677, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1048, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3397, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8587, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3980, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (7.9763 => 7.7242, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -2.23% (3.7241 => 3.6411, std.dev.: 0.0105) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3040 => 7.1952, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.44% (1.3096 => 1.2907, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.44% (4.8776 => 4.8074, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.34% (1.6086 => 1.5870, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6004, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6110, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 14:31:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 16:31:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130111223159.081722A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7506?compare_to=7503&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7506, Order: 172243, Start Time: 2013-01-11 20:21:02, End Time: 2013-01-11 22:31:59 To: 7503, Order: 172214, Start Time: 2013-01-11 17:40:05, End Time: 2013-01-11 19:51:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.66% (10.8933 => 11.1833, std.dev.: 0.0126) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8486 => 499.8518, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44224.89% (1.1277 => 499.8518, std.dev.: 0.0019) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.58% (0.5229 => 1.6397, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 19.36% (14.9895 => 17.8917, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 43.16% (14.1553 => 20.2652, std.dev.: 0.0167) MultiSource/Benchmarks/MallocBench/gs/gs: 17.27% (4.1105 => 4.8205, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.59% (1.1048 => 1.7410, std.dev.: 0.0090) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.61% (7.1582 => 37.3381, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.04% (3.4629 => 6.3730, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.11% (0.6222 => 1.0833, std.dev.: 0.0026) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.00% (0.0720 => 7.4412, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11153500.00% (0.0001 => 11.1536, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848900.00% (0.0001 => 9.8490, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488800.00% (0.0001 => 5.4889, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.65% (1.1194 => 10.3282, std.dev.: 0.0140) SingleSource/UnitTests/SignlessTypes/factor: 244.59% (0.0296 => 0.1020, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.48% (22.1758 => 55.3240, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.10% (0.0929 => 0.1766, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 70.54% (0.1463 => 0.2495, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6159, std.dev.: 0.0051) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.08% (7.0540 => 10.7980, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.20% (1.5859 => 2.3821, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/distray/distray: 48.01% (0.1056 => 0.1563) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.15% (8.1363 => 11.8916, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.43% (2.2024 => 3.0928, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 40.13% (21.9371 => 30.7404, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 38.60% (0.3109 => 0.4309, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.64% (4.2646 => 5.6992, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.69% (1.5415 => 2.0454, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.09% (0.4615 => 0.6096, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.55% (0.2271 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.33% (0.1892 => 0.2447, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.10% (0.4299 => 0.5550, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 28.49% (1.1642 => 1.4959, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.04% (0.6675 => 0.8547, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.44% (0.5105 => 0.6455, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.13% (3.8922 => 4.8705, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.10% (0.2554 => 0.3195, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 24.83% (0.1655 => 0.2066, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.17% (1.0722 => 1.3313, std.dev.: 0.0151) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.71% (0.1143 => 0.1414, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.69% (0.1566 => 0.1937, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 23.60% (0.4289 => 0.5301, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.45% (0.3121 => 0.3853, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.28% (1.4186 => 1.7489, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 23.10% (0.4620 => 0.5687, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.66% (0.1337 => 0.1640, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.30% (0.1695 => 0.2073, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.26% (9.4845 => 11.5957, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.19% (0.0730 => 0.0892, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.26% (0.7115 => 0.8628, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.19% (0.2700 => 0.3272, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.03% (0.1555 => 0.1882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 20.92% (0.3098 => 0.3746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.66% (0.7835 => 0.9454, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.15% (1.3050 => 1.5680, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 19.97% (5.7591 => 6.9091, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 19.75% (0.6456 => 0.7731, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.65% (0.1695 => 0.2028, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.40% (4.9449 => 5.9044, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.20% (0.8172 => 0.9741, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 19.11% (0.1151 => 0.1371, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.07% (0.1940 => 0.2310, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 18.61% (3.3354 => 3.9562, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.60% (5.0018 => 5.9320, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.99% (0.5020 => 0.5923, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.78% (0.3307 => 0.3895, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.59% (0.2758 => 0.3243, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.19% (0.2065 => 0.2420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.5569 => 0.6525, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 17.10% (0.7433 => 0.8704, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.04% (0.9765 => 1.1429, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.99% (0.2107 => 0.2465, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 16.88% (1.1840 => 1.3839, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.83% (0.3423 => 0.3999, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 16.55% (2.0273 => 2.3629, std.dev.: 0.0115) MultiSource/Applications/lua/lua: 16.53% (3.8723 => 4.5124, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.45% (0.5981 => 0.6965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.08% (0.3283 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.91% (0.8101 => 0.9390, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.72% (0.3441 => 0.3982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3232 => 0.3740, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.65% (0.0933 => 0.1079, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.52% (2.2969 => 2.6534, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.52% (0.1044 => 0.1206, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.29% (0.6450 => 0.7436, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.94% (0.3180 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 14.43% (0.0818 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.40% (0.8921 => 1.0206, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.37% (1.1861 => 1.3565, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 13.99% (0.1144 => 0.1304, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.91% (0.3379 => 0.3849, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.62% (0.8067 => 0.9166, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.41% (0.2603 => 0.2952, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.27% (0.3865 => 0.4378, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.66% (0.4636 => 0.5223, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.61% (1.5603 => 1.7571, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.55% (0.4103 => 0.4618, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 12.49% (0.3387 => 0.3810, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.30% (0.3886 => 0.4364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.02% (0.4203 => 0.4708, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.91% (0.4048 => 0.4530, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.83% (0.3828 => 0.4281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.66% (0.3603 => 0.4023, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.54% (0.3543 => 0.3952, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 11.46% (0.3473 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.37% (0.3543 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.32% (0.3497 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.32% (0.3516 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.32% (0.3561 => 0.3964, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 10.91% (17.1811 => 19.0558, std.dev.: 0.0196) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.78% (0.2430 => 0.2692, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.78% (14.3668 => 15.9157, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.72% (0.3826 => 0.4236, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.53% (0.3427 => 0.3788, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.16% (0.4064 => 0.4477, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 9.67% (0.6030 => 0.6613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.16% (0.2871 => 0.3134, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.16% (2.0665 => 2.2557, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7326 => 0.7996, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 9.07% (0.2877 => 0.3138, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.57% (0.3162 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.53% (1.2842 => 1.3937, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.46% (0.2872 => 0.3115, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.3052 => 0.3298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.98% (0.2793 => 0.3016, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.89% (0.2725 => 0.2940, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 7.87% (10.3673 => 11.1833, std.dev.: 0.0126) MultiSource/Benchmarks/Bullet/bullet: 7.69% (63.2438 => 68.1051, std.dev.: 0.0162) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.53% (2.2022 => 2.3461, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.4879 => 0.5185, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.96% (0.3817 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.52% (7.9617 => 8.1622, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2567, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4272, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.64% (4.2280 => 4.4665, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.01% (0.9957 => 1.0356, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.6802 => 8.9240, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.52% (3.6395 => 3.7312, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.86% (9.1159 => 9.2852, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8444 => 28.2340, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5782, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1790, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.52% (0.8651 => 0.2118) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.67% (5.3855 => 4.4340, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.24% (5.3526 => 4.4296, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: -13.56% (10.4361 => 9.0214, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.69% (1.7609 => 1.6079, std.dev.: 0.0100) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 50.0012, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.84% (1.9577 => 0.6688, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3076, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4305, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8601, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0071, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -20.08% (0.2161 => 0.1727, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.76% (2.5528 => 2.1250, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2814, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.87% (1.2373 => 1.1523, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.10% (8.1563 => 7.7405, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8324, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2273, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0002) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 14:58:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 16:58:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130111225827.58B1D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7507?compare_to=7505&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7507, Order: 172249, Start Time: 2013-01-11 21:24:34, End Time: 2013-01-11 22:58:27 To: 7505, Order: 172235, Start Time: 2013-01-11 19:26:48, End Time: 2013-01-11 21:00:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.2907 => 1.2558, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 192.38% (0.0315 => 0.0921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.71% (0.0717 => 0.1181, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.93% (0.0974 => 0.1548, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 43.80% (0.1500 => 0.2157, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.70% (0.6395 => 0.8742, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.60% (0.1132 => 0.1535, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.89% (0.6395 => 0.8626, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.96% (0.6260 => 0.8323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.00% (0.5688 => 0.7508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.85% (0.5805 => 0.7654, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.80% (0.5456 => 0.7191, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.27% (0.6230 => 0.8178, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.94% (0.5575 => 0.7300, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.91% (0.5581 => 0.7306, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.72% (0.5567 => 0.7277, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.57% (0.5941 => 0.7757, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.33% (0.5802 => 0.7562, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.12% (0.6033 => 0.7850, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.82% (0.5705 => 0.7406, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.66% (0.5478 => 0.7103, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.65% (0.5849 => 0.7583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.54% (0.5859 => 0.7590, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.26% (0.5570 => 0.7200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.13% (0.5569 => 0.7191, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.96% (0.6440 => 0.8305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.89% (0.5925 => 0.7637, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.67% (0.5591 => 0.7194, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.04% (0.6052 => 0.7749, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.92% (0.5857 => 0.7492, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.75% (0.5863 => 0.7490, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.61% (0.6189 => 0.7898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.51% (0.6446 => 0.8219, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.22% (0.6304 => 0.8020, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.85% (1.6474 => 2.0897, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.98% (0.6194 => 0.7803, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.71% (0.6297 => 0.7916, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.68% (0.6660 => 0.8370, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.52% (0.6681 => 0.8386, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.94% (0.6667 => 0.8263, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.99% (0.7524 => 0.9254, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.01% (0.7339 => 0.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.60% (2.2587 => 2.7013, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.46% (1.1450 => 1.3106, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 13.64% (0.3357 => 0.3815, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.01% (0.1982 => 0.2220, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.00% (1.6364 => 1.8164, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.89% (4.5069 => 4.9979, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.84% (0.4916 => 0.5449, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 10.65% (0.4515 => 0.4996, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.20% (3.5339 => 3.8944, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.2385 => 0.2591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.42% (0.7021 => 0.7542, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 6.56% (1.2515 => 1.3336, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 6.34% (0.4524 => 0.4811, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.21% (0.5329 => 0.5660, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (9.2283 => 9.7805, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.81% (1.4642 => 1.5492, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.51% (1.2784 => 1.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.33% (0.4861 => 0.5120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.39% (0.3255 => 0.3398, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.86% (0.3319 => 0.3447, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.37% (5.4682 => 5.5979, std.dev.: 0.0130) MultiSource/Applications/oggenc/oggenc: 2.14% (5.0226 => 5.1302, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6750 => 0.6892, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 1.89% (1.3864 => 1.4126, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6799, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.12% (0.9531 => 1.0305, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.47% (5.1955 => 5.4277, std.dev.: 0.0067) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4691, std.dev.: 0.0870) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2865, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6007, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 1.09% (4.4335 => 4.4818, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.05% (0.1281 => 0.1101, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.76% (0.3194 => 0.2978, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.63% (0.1584 => 0.1479, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.39% (2.4924 => 2.3580, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.11% (0.2428 => 0.2304, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.94% (0.9852 => 0.9365, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (0.2871 => 0.2732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.84% (0.3057 => 0.2909, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3880 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.71% (0.3142 => 0.2994, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -4.69% (0.4033 => 0.3844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.68% (0.2903 => 0.2767, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.67% (0.7198 => 0.6862, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.47% (2.1713 => 2.0743, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.33% (0.3025 => 0.2894, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -4.24% (1.3148 => 1.2590, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.16% (0.6347 => 0.6083, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.15% (0.2939 => 0.2817, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.05% (0.2989 => 0.2868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -4.02% (0.6441 => 0.6182, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.95% (0.9542 => 0.9165, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.88% (0.4151 => 0.3990, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4280 => 0.4123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.62% (0.3621 => 0.3490, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.61% (0.6484 => 0.6250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.54% (0.7779 => 0.7504, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists1: -3.36% (0.3867 => 0.3737, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.31% (0.3931 => 0.3801, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.07% (0.4427 => 0.4291, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1453, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/moments: -2.99% (0.4248 => 0.4121, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.94% (0.7919 => 0.7686, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: -2.82% (0.3788 => 0.3681, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.69% (17.1032 => 16.6430, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.67% (0.4083 => 0.3974, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8399, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.53% (1.0544 => 1.0277, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -2.46% (0.7982 => 0.7786, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.41% (1.2210 => 1.1916, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.41% (6.7716 => 6.6087, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: -2.38% (4.3330 => 4.2300, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: -2.36% (16.1920 => 15.8099, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: -2.24% (7.0961 => 6.9372, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: -2.23% (0.9179 => 0.8974, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -2.16% (34.0927 => 33.3580, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.13% (1.2221 => 1.1961, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.07% (1.2300 => 1.2045, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -1.98% (2.4021 => 2.3545, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -1.47% (1.5610 => 1.5381, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.44% (4.0594 => 4.0010, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.22% (8.0126 => 7.9147, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: -1.20% (15.2527 => 15.0702, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: -1.00% (18.2933 => 18.1096, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.27% (1.8100 => 0.6829, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0255, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0373, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2077, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8592, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.11% (1.3096 => 1.2558, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7344, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.74% (3.7241 => 3.6219, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3040 => 7.1914, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8028, std.dev.: 0.0168) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7092 => 3.6541, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5996, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.17% (1.6307 => 1.6117, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 15:24:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 17:24:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130111232442.BA5352A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7508?compare_to=7504&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7508, Order: 172249, Start Time: 2013-01-11 21:18:27, End Time: 2013-01-11 23:24:46 To: 7504, Order: 172229, Start Time: 2013-01-11 18:50:58, End Time: 2013-01-11 20:58:41 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 17 (30 on baseline) Performance Improvements: 20 (19 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1026 (1014 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 57.50% (0.0200 => 0.0315, std.dev.: 0.0016) SingleSource/Regression/C/callargs: 57.00% (0.0207 => 0.0325, std.dev.: 0.0015) SingleSource/Regression/C/badidx: 54.10% (0.0244 => 0.0376, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 38.23% (0.0824 => 0.1139, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.52% (0.2059 => 0.2502, std.dev.: 0.0086) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.72% (0.4548 => 0.4808, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 5.06% (0.3481 => 0.3657, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.86% (0.8868 => 0.9299, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.02% (0.9499 => 0.9786, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.01% (0.9742 => 1.0035, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.75% (4.8740 => 5.6418, std.dev.: 0.2184) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.06% (2.6501 => 2.9963, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/ary3: 8.16% (1.7956 => 1.9422, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.55% (4.3815 => 4.4933, std.dev.: 0.0240) MultiSource/Applications/lua/lua: 1.60% (28.8679 => 29.3305, std.dev.: 0.1581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.22% (5.8679 => 5.9392, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.02% (42.4185 => 42.8529, std.dev.: 0.1216) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/sumarraymalloc: -38.61% (0.0474 => 0.0291, std.dev.: 0.0035) SingleSource/UnitTests/vla: -37.85% (0.0790 => 0.0491, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -35.12% (0.1996 => 0.1295, std.dev.: 0.0099) SingleSource/UnitTests/SignlessTypes/rem: -34.87% (0.1781 => 0.1160, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Queens: -31.12% (0.0633 => 0.0436, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -28.72% (0.1048 => 0.0747, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -28.18% (0.0983 => 0.0706, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.99% (0.1622 => 0.1168, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -14.29% (0.0868 => 0.0744, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -10.00% (1.0376 => 0.9338, std.dev.: 0.0202) MultiSource/Applications/hbd/hbd: -8.30% (1.7069 => 1.5653, std.dev.: 0.0535) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.55% (0.9369 => 0.8662, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.34% (2.5234 => 2.4140, std.dev.: 0.0236) MultiSource/Applications/lemon/lemon: -2.84% (1.3803 => 1.3411, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: -1.91% (17.0068 => 16.6820, std.dev.: 0.0755) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/d/make_dparser: -34.80% (0.0589 => 0.0384, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.27% (2.8064 => 2.7427, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.50% (1.0651 => 1.0491, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-1: -1.12% (2.3110 => 2.2852, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.10% (2.6645 => 2.6352, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.61% (1.1207 => 1.1499, std.dev.: 0.0195) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.65% (0.0273 => 0.0233, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.14% (0.0438 => 0.0443, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.07% (0.0338 => 0.0345, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.55% (0.0323 => 0.0328, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.21% (0.0439 => 0.0497, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: 0.95% (0.0211 => 0.0213, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/test1: 14.35% (0.0223 => 0.0255, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.09% (0.0231 => 0.0252, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1491 => 0.1461, std.dev.: 0.0159) MultiSource/Applications/lemon/lemon: -8.62% (1.3071 => 1.1944, std.dev.: 0.0426) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.28% (0.3975 => 0.3964, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.96% (0.1808 => 0.1628, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -27.10% (0.1336 => 0.0974, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 21.49% (0.0228 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -20.78% (0.0693 => 0.0549, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.72% (1.1523 => 1.1721, std.dev.: 0.0288) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.97% (0.0617 => 0.0611, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.94% (0.0303 => 0.0321, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.48% (0.7627 => 0.7514, std.dev.: 0.0265) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -90.00% (0.0010 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.81% (0.0124 => 0.0123, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.51% (12.7745 => 12.8391, std.dev.: 0.0580) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/pointer_arithmetic: 237.74% (0.0053 => 0.0179, std.dev.: 0.0007) SingleSource/Regression/C/badidx: 63.48% (0.0230 => 0.0376, std.dev.: 0.0012) SingleSource/Regression/C/callargs: 58.54% (0.0205 => 0.0325, std.dev.: 0.0015) SingleSource/UnitTests/2003-05-31-CastToBool: 58.08% (0.0260 => 0.0411, std.dev.: 0.0017) SingleSource/UnitTests/2003-05-14-AtExit: 56.72% (0.0201 => 0.0315, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 55.39% (0.0733 => 0.1139, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: 45.06% (0.0253 => 0.0367, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 42.30% (0.0331 => 0.0471, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 16.70% (0.2144 => 0.2502, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/em3d/em3d: 5.76% (0.1927 => 0.2038, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 4.90% (1.4805 => 1.5530, std.dev.: 0.0112) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.61% (0.4596 => 0.4808, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.40% (0.9612 => 1.0035, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.18% (0.8926 => 0.9299, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.88% (0.9512 => 0.9786, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322725.00% (0.0008 => 2.5826, std.dev.: 0.0378) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 2100.00% (0.0006 => 0.0132, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.50% (1.1825 => 2.4182, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.86% (1.6547 => 2.0826, std.dev.: 0.1106) SingleSource/Benchmarks/CoyoteBench/lpbench: 15.20% (4.4540 => 5.1311, std.dev.: 0.0967) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.89% (5.0421 => 5.6418, std.dev.: 0.2184) SingleSource/Benchmarks/Shootout-C++/ary3: 7.17% (1.8123 => 1.9422, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.77% (3.0082 => 3.1818, std.dev.: 0.0529) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.34% (46.0987 => 48.5606, std.dev.: 0.8628) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.88% (4.2843 => 4.4933, std.dev.: 0.0240) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.12% (2.8778 => 2.9963, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.52% (2.5705 => 2.6352, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.07% (4.9799 => 5.0832, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.01% (1.5595 => 1.5909, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.26% (42.3194 => 42.8529, std.dev.: 0.1216) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.13% (0.0808 => 0.0508, std.dev.: 0.0019) SingleSource/Benchmarks/SmallPT/smallpt: -23.20% (0.1888 => 0.1450, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.10% (0.1684 => 0.1295, std.dev.: 0.0099) MultiSource/Applications/hbd/hbd: -17.46% (1.8964 => 1.5653, std.dev.: 0.0535) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -9.82% (0.1079 => 0.0973, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -9.66% (2.4719 => 2.2330, std.dev.: 0.0871) MultiSource/Applications/hexxagon/hexxagon: -9.17% (1.1433 => 1.0385, std.dev.: 0.0375) MultiSource/Applications/spiff/spiff: -8.63% (1.0220 => 0.9338, std.dev.: 0.0202) MultiSource/Applications/lua/lua: -7.65% (4.6406 => 4.2855, std.dev.: 0.1318) MultiSource/Applications/lambda-0_1_3/lambda: -6.56% (0.8653 => 0.8085, std.dev.: 0.0191) MultiSource/Applications/sqlite3/sqlite3: -5.02% (17.5634 => 16.6820, std.dev.: 0.0755) MultiSource/Applications/lemon/lemon: -4.06% (1.3979 => 1.3411, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.47% (0.7693 => 0.7426, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.79% (0.6135 => 0.5964, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.69% (1.4588 => 1.3175, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.48% (0.4081 => 0.3694, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.47% (23.3986 => 22.1182, std.dev.: 0.3642) SingleSource/Benchmarks/Misc/ffbench: -2.84% (1.4244 => 1.3839, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/lists: -2.02% (17.2182 => 16.8712, std.dev.: 0.1206) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.55% (1.2047 => 1.1499, std.dev.: 0.0195) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0233 => 0.0233, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.77% (0.0451 => 0.0443, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.44% (0.0394 => 0.0345, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0328 => 0.0328, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 11.69% (0.0445 => 0.0497, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/test1: 12.33% (0.0227 => 0.0255, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0159) MultiSource/Applications/lemon/lemon: -38.09% (1.9293 => 1.1944, std.dev.: 0.0426) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.10% (0.4049 => 0.3964, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.81% (0.1510 => 0.1628, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.41% (0.0978 => 0.0974, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.95% (0.0590 => 0.0549, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.90% (1.1617 => 1.1721, std.dev.: 0.0288) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.78% (0.0268 => 0.0321, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.04% (0.7437 => 0.7514, std.dev.: 0.0265) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.48% (12.7781 => 12.8391, std.dev.: 0.0580) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 16:56:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 18:56:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112005616.F30DF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7509?compare_to=7507&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7509, Order: 172263, Start Time: 2013-01-11 23:22:09, End Time: 2013-01-12 00:56:18 To: 7507, Order: 172249, Start Time: 2013-01-11 21:24:34, End Time: 2013-01-11 22:58:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (98 on baseline) Performance Improvements: 0 (136 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.21% (1.2558 => 1.2710, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 192.38% (0.0315 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 86.07% (0.0280 => 0.0521, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.09% (0.0974 => 0.1569, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.40% (0.1500 => 0.2166, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.06% (0.6395 => 0.8765, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.51% (0.1132 => 0.1534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.14% (0.6395 => 0.8642, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.37% (0.6260 => 0.8349, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.31% (0.5688 => 0.7526, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.20% (0.5805 => 0.7674, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.18% (0.5456 => 0.7212, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.43% (0.6230 => 0.8188, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.11% (0.5567 => 0.7299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.92% (0.5941 => 0.7778, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.47% (0.5802 => 0.7570, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.31% (0.5705 => 0.7434, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.25% (0.6033 => 0.7858, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.92% (0.5478 => 0.7117, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.92% (0.5849 => 0.7599, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.89% (0.5859 => 0.7610, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.59% (0.5570 => 0.7218, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.38% (0.5569 => 0.7205, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.29% (0.6440 => 0.8326, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.16% (0.5925 => 0.7653, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.10% (0.5591 => 0.7218, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.12% (0.5857 => 0.7504, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.11% (0.5863 => 0.7511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.11% (0.6052 => 0.7753, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.07% (0.6189 => 0.7926, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.04% (0.6676 => 0.8548, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.68% (0.6446 => 0.8230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.20% (1.6474 => 2.0955, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.25% (0.6194 => 0.7820, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.04% (0.6660 => 0.8394, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.85% (0.6297 => 0.7925, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.68% (0.6681 => 0.8397, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.94% (0.0445 => 0.0556, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.36% (0.6667 => 0.8291, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.23% (0.7524 => 0.9272, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.36% (0.7339 => 0.8980, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.95% (2.2587 => 2.7094, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3151, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 13.82% (0.3357 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.91% (0.1982 => 0.2218, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.26% (1.6364 => 1.8206, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.05% (4.5069 => 5.0047, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.00% (0.4916 => 0.5457, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 10.59% (0.4515 => 0.4993, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.21% (3.5339 => 3.8948, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.68% (0.2385 => 0.2592, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.78% (0.7021 => 0.7567, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.99% (0.1731 => 0.1852, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.70% (1.2515 => 1.3353, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.49% (0.5329 => 0.5675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.19% (0.4524 => 0.4804, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.05% (9.2283 => 9.7869, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.89% (1.4642 => 1.5505, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.74% (1.2784 => 1.3518, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (0.4861 => 0.5122, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.89% (0.3319 => 0.3448, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 3.87% (0.3255 => 0.3381, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.69% (5.4682 => 5.6153, std.dev.: 0.0136) MultiSource/Applications/oggenc/oggenc: 2.33% (5.0226 => 5.1398, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 2.10% (0.6750 => 0.6892, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 2.10% (1.3864 => 1.4155, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 1.66% (0.8418 => 0.8558, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6677, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.03% (0.9531 => 1.0296, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4399, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.83% (2.0478 => 2.1058, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8210 => 28.2872, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0065) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.08% (4.4335 => 4.4814, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -6.89% (0.3194 => 0.2974, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.94% (0.3837 => 0.3609, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.59% (0.3812 => 0.3599, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.56% (0.3831 => 0.3618, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -5.38% (0.3848 => 0.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.31% (0.4033 => 0.3819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.30% (0.2903 => 0.2749, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -5.15% (0.3205 => 0.3040, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.02% (2.1713 => 2.0624, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.98% (0.4176 => 0.3968, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: -4.97% (0.2939 => 0.2793, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.88% (2.4924 => 2.3707, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.74% (0.9852 => 0.9385, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.67% (0.4199 => 0.4003, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.66% (0.3821 => 0.3643, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.53% (1.3148 => 1.2552, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.43% (0.2933 => 0.2803, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.42% (0.3142 => 0.3003, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.39% (0.4280 => 0.4092, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.38% (0.2989 => 0.2858, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.17% (0.3025 => 0.2899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: -4.05% (0.6347 => 0.6090, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference: -3.93% (0.7779 => 0.7473, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.79% (0.9542 => 0.9180, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.71% (0.4151 => 0.3997, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.69% (0.3931 => 0.3786, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (0.3621 => 0.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.62% (0.3867 => 0.3727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.61% (0.3849 => 0.3710, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.59% (0.4321 => 0.4166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.42% (0.6484 => 0.6262, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.33% (0.3788 => 0.3662, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.27% (0.4248 => 0.4109, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.16% (0.4813 => 0.4661, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1601, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.91% (0.4083 => 0.3964, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.79% (0.7919 => 0.7698, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/gs/gs: -2.48% (4.3330 => 4.2256, std.dev.: 0.0134) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.47% (6.7716 => 6.6042, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.44% (1.0544 => 1.0287, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.36% (14.2083 => 13.8734, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7013, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.33% (1.2221 => 1.1936, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.29% (1.2210 => 1.1930, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -2.27% (34.0927 => 33.3187, std.dev.: 0.0064) MultiSource/Applications/lambda-0_1_3/lambda: -2.20% (0.7982 => 0.7806, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -2.11% (16.1920 => 15.8507, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (1.2300 => 1.2058, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: -1.95% (0.9179 => 0.9000, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.94% (7.0961 => 6.9583, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.88% (0.5999 => 0.5886, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -1.72% (2.4021 => 2.3608, std.dev.: 0.0147) MultiSource/Applications/lua/lua: -1.35% (4.0594 => 4.0048, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.28% (8.0126 => 7.9100, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9077 => 0.8964, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.32% (1.8100 => 0.6820, std.dev.: 0.0219) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -24.81% (1.3643 => 1.0258, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0335, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3391, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8592, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1764, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7284, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.95% (1.3096 => 1.2710, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: -2.30% (3.7241 => 3.6384, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.62% (1.6086 => 1.5826, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1942, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.8776 => 4.8069, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.40% (1.6307 => 1.6079, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.00% (1.6219 => 1.6056, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 17:13:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 19:13:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130112011331.234C02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7510?compare_to=7506&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7510, Order: 172259, Start Time: 2013-01-11 23:02:22, End Time: 2013-01-12 01:13:30 To: 7506, Order: 172243, Start Time: 2013-01-11 20:21:02, End Time: 2013-01-11 22:31:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (219 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.85% (11.1833 => 11.5019, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 1.83% (0.8704 => 0.8863, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.26% (30.7404 => 31.1283, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.6397 => 1.6567, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0650 => 0.0653, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8518 => 499.7401, std.dev.: 0.0564) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44214.99% (1.1277 => 499.7401, std.dev.: 0.0564) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.83% (0.5229 => 1.6567, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 20.32% (14.9895 => 18.0349, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 44.32% (14.1553 => 20.4293, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 18.38% (4.1105 => 4.8661, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.64% (1.1048 => 1.7526, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.95% (7.1582 => 37.5769, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.55% (3.4629 => 6.4255, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.15% (0.6222 => 1.0898, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.61% (0.0720 => 7.4474, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11160900.00% (0.0001 => 11.1610, std.dev.: 0.0366) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848800.00% (0.0001 => 9.8489, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486100.00% (0.0001 => 5.4862, std.dev.: 0.0266) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.46% (1.1194 => 10.3484, std.dev.: 0.0209) SingleSource/UnitTests/SignlessTypes/factor: 244.59% (0.0296 => 0.1020, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 150.92% (22.1758 => 55.6438, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.36% (0.0929 => 0.1787, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.29% (2.9384 => 4.6218, std.dev.: 0.0025) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.28% (7.0540 => 10.8832, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.40% (1.5859 => 2.4010, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/IntMM: 51.27% (0.0394 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.36% (8.1363 => 11.9894, std.dev.: 0.0062) MultiSource/Applications/JM/lencod/lencod: 41.90% (21.9371 => 31.1283, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.63% (2.2024 => 3.1192, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 39.56% (0.3109 => 0.4339, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 39.32% (0.1432 => 0.1995, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.66% (4.2646 => 5.7425, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.76% (1.5415 => 2.0619, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.07% (0.4615 => 0.6141, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.07% (0.1892 => 0.2461, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.80% (0.4299 => 0.5580, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 29.69% (1.1642 => 1.5099, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.14% (0.6675 => 0.8620, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.44% (0.5105 => 0.6506, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.28% (0.1655 => 0.2090, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.25% (0.1143 => 0.1443, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.08% (0.2554 => 0.3220, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.94% (3.8922 => 4.9020, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 25.14% (1.0722 => 1.3418, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.87% (0.1906 => 0.2380, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.49% (1.4186 => 1.7660, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.35% (0.3121 => 0.3881, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 24.11% (0.4289 => 0.5323, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.75% (0.0842 => 0.1042, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.70% (0.0730 => 0.0903, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.59% (0.4620 => 0.5710, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.24% (0.1695 => 0.2089, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 23.21% (9.4845 => 11.6863, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.85% (0.2700 => 0.3317, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 22.79% (0.1163 => 0.1428, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.22% (0.7115 => 0.8696, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.74% (0.1555 => 0.1893) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.56% (0.0886 => 0.1077, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.52% (0.7835 => 0.9521, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 21.34% (0.3098 => 0.3759, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.07% (1.3050 => 1.5799, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.03% (0.1940 => 0.2348, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.70% (0.1029 => 0.1242, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.60% (5.7591 => 6.9456, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 20.55% (0.6456 => 0.7783, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.53% (0.1695 => 0.2043, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.27% (4.9449 => 5.9472, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.19% (0.8172 => 0.9822, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 20.16% (0.1151 => 0.1383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.07% (0.5860 => 0.7036, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.46% (3.3354 => 3.9844, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.44% (5.0018 => 5.9740, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 19.24% (0.7433 => 0.8863, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.89% (0.2107 => 0.2505, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.67% (0.5020 => 0.5957, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 18.46% (0.3423 => 0.4055, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.41% (0.1510 => 0.1788, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.37% (0.5569 => 0.6592, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.29% (0.3307 => 0.3912, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.08% (0.1117 => 0.1319) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.89% (0.9765 => 1.1512, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.73% (1.1840 => 1.3939, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.72% (0.2065 => 0.2431, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 17.43% (2.0273 => 2.3806, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.29% (3.8723 => 4.5420, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.15% (0.5981 => 0.7007, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.58% (2.2969 => 2.6777, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 16.54% (0.3283 => 0.3826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.54% (0.3441 => 0.4010, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.6450 => 0.7500, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.17% (0.8101 => 0.9411, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.50% (0.8921 => 1.0304, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.27% (1.1861 => 1.3672, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.75% (0.8067 => 0.9257, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3379 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.65% (0.4636 => 0.5269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.58% (0.3865 => 0.4390, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.40% (0.4103 => 0.4653, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7677, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.84% (0.3886 => 0.4385, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.71% (0.4203 => 0.4737, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.33% (0.3828 => 0.4300, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.02% (0.3603 => 0.4036, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.98% (0.3473 => 0.3889, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.91% (0.3561 => 0.3985, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/exceptions-4: 11.85% (0.3543 => 0.3963, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 11.81% (0.3497 => 0.3910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 11.81% (0.3422 => 0.3826, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 11.66% (17.1811 => 19.1841, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists1: 11.62% (0.3684 => 0.4112, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.58% (0.3282 => 0.3662, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.56% (0.2430 => 0.2711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.38% (14.3668 => 16.0016, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/bh/bh: 11.32% (0.3092 => 0.3442, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3427 => 0.3810, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.11% (0.3826 => 0.4251, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 10.94% (10.3673 => 11.5019, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.4064 => 0.4497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.14% (0.1114 => 0.1227, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.82% (0.6030 => 0.6622, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.63% (2.0665 => 2.2656, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.38% (0.7326 => 0.8013, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 9.33% (0.5925 => 0.6478, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.20% (0.3162 => 0.3453, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 9.00% (1.2842 => 1.3998, std.dev.: 0.0087) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2905 => 0.3164, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3935 => 0.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.49% (0.2756 => 0.2990, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.40% (63.2438 => 68.5576, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.32% (0.3052 => 0.3306, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.20% (0.2793 => 0.3022, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.11% (0.2714 => 0.2934, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.03% (2.2022 => 2.3570, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.4879 => 0.5196, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.48% (0.3817 => 0.3988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.3131 => 0.3251, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.18% (7.9617 => 8.2149, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2463, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4607, std.dev.: 0.0112) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3128, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.3316 => 0.3430, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (2.0360 => 2.1038, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.08% (0.9957 => 1.0264, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9103, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (3.6395 => 3.7351, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2908, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2780, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4564, std.dev.: 0.0138) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1770, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.21% (0.8651 => 0.2145, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.16% (5.3855 => 4.4616, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.76% (5.3526 => 4.4553, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -13.19% (10.4361 => 9.0597, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.97% (1.7609 => 1.6205, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9218, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.54% (1.9577 => 0.6550, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3091, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4257, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8588, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0085, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7325, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.23% (9.5636 => 8.4893, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2797, std.dev.: 0.0715) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.86% (1.2373 => 1.1524, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.27% (8.1563 => 7.7264, std.dev.: 0.0196) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.54% (10.2830 => 9.8157, std.dev.: 0.0154) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.96% (3.6994 => 3.6268, std.dev.: 0.0160) MultiSource/Benchmarks/sim/sim: -1.82% (5.0483 => 4.9566, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6561, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0028) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 17:51:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 19:51:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112015135.4C7392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7511?compare_to=7508&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7511, Order: 172273, Start Time: 2013-01-11 23:44:40, End Time: 2013-01-12 01:51:37 To: 7508, Order: 172249, Start Time: 2013-01-11 21:18:27, End Time: 2013-01-11 23:24:46 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 23 (18 on baseline) Performance Improvements: 18 (13 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1022 (1032 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-3: 63.36% (0.0232 => 0.0379, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 42.37% (0.0321 => 0.0457, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/dt: 37.21% (0.0344 => 0.0472, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.88% (0.6681 => 0.7809, std.dev.: 0.0325) MultiSource/Benchmarks/MallocBench/gs/gs: 15.25% (4.5277 => 5.2183, std.dev.: 0.2041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.76% (0.7014 => 0.8049, std.dev.: 0.0197) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.64% (45.0691 => 50.3155, std.dev.: 1.5524) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.88% (2.4140 => 2.6767, std.dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.25% (24.1576 => 26.3933, std.dev.: 0.2782) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.27% (1.6084 => 1.7254, std.dev.: 0.0176) MultiSource/Applications/kimwitu++/kc: 5.51% (18.5282 => 19.5500, std.dev.: 0.2464) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (4.9063 => 5.1759, std.dev.: 0.0643) SingleSource/Benchmarks/Misc/oourafft: 4.70% (0.2191 => 0.2294, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 4.13% (16.2477 => 16.9184, std.dev.: 0.0936) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.28% (0.3354 => 0.3464, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 26.36% (3.7740 => 4.7690, std.dev.: 0.0940) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.81% (3.6709 => 4.2878, std.dev.: 0.1930) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.86% (5.6418 => 6.1416, std.dev.: 0.1066) MultiSource/Benchmarks/Bullet/bullet: 6.55% (7.1914 => 7.6624, std.dev.: 0.1460) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.35% (1.0906 => 1.1271, std.dev.: 0.0136) MultiSource/Applications/JM/lencod/lencod: 2.37% (6.9585 => 7.1235, std.dev.: 0.0499) SingleSource/Benchmarks/Misc/oourafft: 1.34% (3.7804 => 3.8312, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout/sieve: 1.24% (6.6452 => 6.7277, std.dev.: 0.0312) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/badidx: -38.83% (0.0376 => 0.0230, std.dev.: 0.0045) SingleSource/UnitTests/2003-05-14-AtExit: -37.78% (0.0315 => 0.0196, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-31-CastToBool: -35.28% (0.0411 => 0.0266, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -33.27% (0.1139 => 0.0760, std.dev.: 0.0009) SingleSource/Regression/C/casts: -29.41% (0.0425 => 0.0300, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: -29.16% (0.0367 => 0.0260, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.17% (1.0519 => 0.9449, std.dev.: 0.0187) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.18% (7.7104 => 7.2336, std.dev.: 0.1656) SingleSource/Benchmarks/Shootout-C++/fibo: -5.77% (0.1993 => 0.1878, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.93% (1.5084 => 1.4340, std.dev.: 0.0206) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.70% (5.1482 => 4.9064, std.dev.: 0.0908) MultiSource/Benchmarks/nbench/nbench: -2.02% (1.2940 => 1.2679, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -17.68% (0.1114 => 0.0917, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -12.23% (0.5983 => 0.5251, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.94% (2.9963 => 2.6684, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.30% (2.6352 => 2.5746, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.58% (5.0832 => 5.0031, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.38% (5.9741 => 5.8919, std.dev.: 0.0163) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.10% (1.1499 => 1.1510, std.dev.: 0.2954) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.35% (0.0443 => 0.0437, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.74% (0.0345 => 0.0339, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.08% (0.0497 => 0.0432, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -12.55% (0.0255 => 0.0223, std.dev.: 0.0081) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.14% (0.0252 => 0.0234, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 23.08% (0.0013 => 0.0016, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.46% (0.1461 => 0.1497, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 5.02% (1.1944 => 1.2543, std.dev.: 0.1784) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.56% (0.3964 => 0.4343, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.28% (0.1628 => 0.1542, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0974 => 0.0974, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.89% (0.0277 => 0.0269, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.10% (0.0549 => 0.0566, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.08% (1.1721 => 1.1477, std.dev.: 0.0267) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0611 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.98% (0.0321 => 0.0305, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7514 => 0.7491, std.dev.: 0.0663) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.65% (0.0123 => 0.0073, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.47% (12.8391 => 12.7789, std.dev.: 0.0422) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.02% (0.0336 => 0.0494, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: 30.20% (0.0351 => 0.0457, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.08% (0.6934 => 0.8049, std.dev.: 0.0197) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.96% (44.1538 => 50.3155, std.dev.: 1.5524) MultiSource/Benchmarks/MallocBench/gs/gs: 13.60% (4.5936 => 5.2183, std.dev.: 0.2041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.90% (23.5861 => 26.3933, std.dev.: 0.2782) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.17% (2.4519 => 2.6767, std.dev.: 0.0169) MultiSource/Applications/SPASS/SPASS: 2.86% (16.4479 => 16.9184, std.dev.: 0.0936) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.01% (0.9214 => 0.9399, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 325625.00% (0.0008 => 2.6058, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.08% (1.1825 => 2.3068, std.dev.: 0.0434) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.81% (5.0421 => 6.1416, std.dev.: 0.1066) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.66% (3.7074 => 4.2878, std.dev.: 0.1930) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.43% (4.2042 => 4.7690, std.dev.: 0.0940) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.30% (0.2562 => 0.2877, std.dev.: 0.0085) MultiSource/Benchmarks/nbench/nbench: 10.51% (20.5117 => 22.6670, std.dev.: 0.8168) MultiSource/Benchmarks/Bullet/bullet: 6.36% (7.2040 => 7.6624, std.dev.: 0.1460) MultiSource/Applications/JM/lencod/lencod: 4.51% (6.8159 => 7.1235, std.dev.: 0.0499) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0808 => 0.0505, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.02% (0.0727 => 0.0516, std.dev.: 0.0025) SingleSource/Benchmarks/SmallPT/smallpt: -25.48% (0.1888 => 0.1407, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.03% (0.1684 => 0.1313, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.05% (1.0986 => 0.9442, std.dev.: 0.0204) MultiSource/Benchmarks/VersaBench/dbms/dbms: -13.79% (1.0960 => 0.9449, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.53% (1.3924 => 1.2876, std.dev.: 0.0391) SingleSource/Benchmarks/Shootout-C++/fibo: -6.38% (0.2006 => 0.1878, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.80% (0.1164 => 0.1015, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.75% (1.4588 => 1.3312, std.dev.: 0.0308) MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.28% (2.8778 => 2.6684, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.03% (3.1921 => 3.1593, std.dev.: 0.0072) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.46% (1.2047 => 1.1510, std.dev.: 0.2954) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0451 => 0.0437, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0081) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.24% (0.0255 => 0.0234, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.16% (0.1530 => 0.1497, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: -34.99% (1.9293 => 1.2543, std.dev.: 0.1784) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.26% (0.4049 => 0.4343, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.12% (0.1510 => 0.1542, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.41% (0.0978 => 0.0974, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.07% (0.0590 => 0.0566, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1477, std.dev.: 0.0267) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.81% (0.0268 => 0.0305, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.73% (0.7437 => 0.7491, std.dev.: 0.0663) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.65% (0.0092 => 0.0073, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (12.7781 => 12.7789, std.dev.: 0.0422) Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 17:57:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 19:57:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130112015728.D3F862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7512?compare_to=7498&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7512, Order: 172253, Start Time: 2013-01-11 22:23:13, End Time: 2013-01-12 01:57:30 To: 7498, Order: 172196, Start Time: 2013-01-11 13:06:41, End Time: 2013-01-11 16:42:01 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (114.0496 => 118.6095, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.21% (0.1106 => 0.1418, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.15% (0.2969 => 0.3775, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.49% (0.5900 => 0.7463, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.59% (0.4139 => 0.5198, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.55% (0.0642 => 0.0806, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.09% (0.4253 => 0.5320, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.03% (0.4994 => 0.6244, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.45% (0.0822 => 0.1023, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.77% (0.1620 => 0.2005, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.12% (0.5000 => 0.6156, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 22.95% (1.5932 => 1.9589, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.59% (0.1107 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.45% (0.1604 => 0.1948, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.11% (0.1549 => 0.1876, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730) MultiSource/Benchmarks/McCat/05-eks/eks: 20.75% (0.1619 => 0.1955, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 20.71% (0.0821 => 0.0991, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.52% (0.3903 => 0.4704, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 19.38% (0.4029 => 0.4810, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.12% (0.2736 => 0.3259, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.97% (0.5826 => 0.6931, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.2014 => 0.2395, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.77% (0.3890 => 0.4620, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.76% (1.3152 => 1.5619, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 18.49% (0.5889 => 0.6978, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.41% (0.1505 => 0.1782, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.28% (0.3271 => 0.3869, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.18% (0.2866 => 0.3387, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.56% (0.5546 => 0.6520, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/property-reference: 17.53% (0.7171 => 0.8428, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 17.51% (0.9697 => 1.1395, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.36% (1.8794 => 2.2057, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.29% (0.2875 => 0.3372, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.19% (0.5026 => 0.5890, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.11% (3.5627 => 4.1723, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.00% (0.4658 => 0.5450, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.91% (0.2792 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.87% (0.2803 => 0.3276) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.85% (1.6211 => 1.8943, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.76% (4.4195 => 5.1603, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 16.73% (0.2714 => 0.3168, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.73% (0.2738 => 0.3196, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.72% (0.1160 => 0.1354, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 16.71% (0.3004 => 0.3506, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.61% (0.9909 => 1.1555, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: 16.60% (0.2813 => 0.3280, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 16.54% (0.2823 => 0.3290, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.51% (0.1968 => 0.2293, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 16.51% (0.2811 => 0.3275, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.46% (0.3930 => 0.4577, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.39% (2.0673 => 2.4062, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.27% (0.3060 => 0.3558, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 16.21% (0.3096 => 0.3598, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.19% (0.2780 => 0.3230, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.76% (0.3362 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.64% (0.4361 => 0.5043, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 15.55% (0.3678 => 0.4250, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.48% (2.7292 => 3.1518, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.46% (1.9966 => 2.3052, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.45% (1.9694 => 2.2737, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.36% (0.3124 => 0.3604, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.36% (0.3282 => 0.3786, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.34% (0.3845 => 0.4435, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 15.29% (1.0781 => 1.2429, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 15.28% (23.5202 => 27.1143, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/sieve: 15.16% (0.3726 => 0.4291, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.11% (0.3348 => 0.3854, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 15.07% (0.3477 => 0.4001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.00% (0.4146 => 0.4768, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.70% (0.3625 => 0.4158, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 14.68% (4.2109 => 4.8289, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.62% (0.3981 => 0.4563, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.47% (0.3690 => 0.4224, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.40% (0.4251 => 0.4863, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3465 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.96% (0.3446 => 0.3927, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.95% (0.5012 => 0.5711, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.95% (1.4269 => 1.6259, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 13.95% (0.3442 => 0.3922, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.92% (0.3469 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.87% (0.3460 => 0.3940, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.76% (0.1090 => 0.1240, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 13.64% (0.2566 => 0.2916, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: 13.40% (0.3724 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.31% (0.3643 => 0.4128, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.22% (0.7875 => 0.8916, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.90% (0.6435 => 0.7265, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.84% (0.1028 => 0.1160, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.31% (2.1653 => 2.4319, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.09% (0.2737 => 0.3068, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 11.89% (2.1013 => 2.3511, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 11.87% (4.6177 => 5.1659, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.2075 => 0.2319, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 11.62% (5.5417 => 6.1854, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.41% (0.2068 => 0.2304, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.3498 => 0.3895, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.89% (0.3084 => 0.3420, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 10.49% (0.3336 => 0.3686, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.37% (0.2103 => 0.2321, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.14% (11.6398 => 12.8196, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.92% (0.5361 => 0.5893, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.92% (0.6634 => 0.7292, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 9.80% (0.4847 => 0.5322, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.55% (4.6926 => 5.1407, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.17% (0.2040 => 0.2227, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.00% (0.7426 => 0.8094, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.82% (0.1383 => 0.1505, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 7.95% (0.2391 => 0.2581, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (0.5584 => 0.6018, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 7.43% (2.0346 => 2.1857, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 7.20% (11.9555 => 12.8166, std.dev.: 0.0158) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.56% (0.3792 => 0.3965, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5236, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.13% (0.3693 => 0.4104, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.85% (0.2802 => 0.3078, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2381, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.67% (79.9355 => 83.6717, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5024, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 3.01% (0.6276 => 0.6465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1970, std.dev.: 0.0068) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3032, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2840, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2083, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.11% (50.0626 => 50.6169, std.dev.: 0.0171) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4815, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5680, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.75% (17.2379 => 14.3512, std.dev.: 0.0096) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8014, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.17% (14.0481 => 13.4623, std.dev.: 0.1252) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2293, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7753, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1440, std.dev.: 0.0389) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5703, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.73% (0.6293 => 0.6184, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5003, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.2008, std.dev.: 0.0567) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 18:54:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 20:54:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112025405.0B3B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7513?compare_to=7509&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7513, Order: 172278, Start Time: 2013-01-12 01:19:55, End Time: 2013-01-12 02:54:06 To: 7509, Order: 172263, Start Time: 2013-01-11 23:22:09, End Time: 2013-01-12 00:56:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 1 (1 on baseline) Performance Regressions: 1 (99 on baseline) Performance Improvements: 1 (134 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.89% (55.2978 => 56.3419, std.dev.: 0.1580) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: -23.56% (0.0921 => 0.0704, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.27% (0.0717 => 0.1185, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.03% (0.0974 => 0.1549, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.28% (0.6395 => 0.8779, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.36% (0.6395 => 0.8656, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.39% (0.6260 => 0.8350, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.35% (0.5688 => 0.7528, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.14% (0.5805 => 0.7671, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.67% (0.6230 => 0.8203, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.12% (0.5581 => 0.7318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.09% (0.5567 => 0.7298, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.09% (0.5575 => 0.7308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.02% (0.5941 => 0.7784, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.54% (0.5802 => 0.7574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.38% (0.6033 => 0.7866, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.31% (0.5705 => 0.7434, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.99% (0.5849 => 0.7603, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.87% (0.5859 => 0.7609, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.80% (0.5570 => 0.7230, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.79% (0.5478 => 0.7110, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.35% (0.6440 => 0.8330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.29% (0.5569 => 0.7200, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.21% (0.5591 => 0.7224, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.13% (0.5925 => 0.7651, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.10% (0.5857 => 0.7503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.08% (0.6189 => 0.7927, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.06% (0.5863 => 0.7508, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.06% (0.6676 => 0.8549, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.96% (0.6446 => 0.8248, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.29% (1.6474 => 2.0970, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.40% (0.6194 => 0.7829, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.05% (0.6660 => 0.8395, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.01% (0.6297 => 0.7935, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.97% (0.6681 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.39% (0.6667 => 0.8293, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.26% (0.7524 => 0.9274, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.99% (0.0622 => 0.0765, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.32% (0.7339 => 0.8977, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.09% (2.2587 => 2.7125, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.02% (1.1450 => 1.3170, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.45% (1.6364 => 1.8238, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.34% (4.5069 => 5.0181, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4916 => 0.5467, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.03% (0.4515 => 0.5013, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.35% (3.5339 => 3.8996, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.81% (0.2385 => 0.2595, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.85% (0.7021 => 0.7572, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.83% (1.2515 => 1.3370, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.62% (0.5329 => 0.5682, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (9.2283 => 9.8125, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.22% (1.4642 => 1.5553, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.92% (0.4524 => 0.4792, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.91% (1.2784 => 1.3539, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.47% (0.4861 => 0.5127, std.dev.: 0.0044) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 3.90% (0.3255 => 0.3382, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (5.4682 => 5.6138, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.60% (5.0226 => 5.1531, std.dev.: 0.0188) MultiSource/Applications/SIBsim4/SIBsim4: 2.41% (1.3864 => 1.4198, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6750 => 0.6895, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.92% (0.8418 => 0.8580, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.3722 => 1.3871, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6688, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (5.1955 => 5.4401, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1693, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.24% (54.5751 => 56.3419, std.dev.: 0.1580) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2866, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6033, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.00% (4.4335 => 4.4779, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.86% (0.3194 => 0.2975, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.27% (0.3323 => 0.3148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2903 => 0.2755, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.02% (0.3205 => 0.3044, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.92% (0.3821 => 0.3633, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.84% (0.3016 => 0.2870, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0687, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.64% (0.9852 => 0.9395, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.55% (2.4924 => 2.3789, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.52% (0.3142 => 0.3000, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -4.34% (1.3148 => 1.2578, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: -4.25% (0.2989 => 0.2862, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.24% (0.3252 => 0.3114, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3812 => 0.3651, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.20% (0.3831 => 0.3670, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3880 => 0.3717, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.18% (0.3848 => 0.3687, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3896 => 0.3733, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.4033 => 0.3870, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.02% (0.3884 => 0.3728, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.01% (0.3891 => 0.3735, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.90% (0.4176 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.74% (0.9542 => 0.9185, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.69% (0.4151 => 0.3998, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.54% (0.6441 => 0.6213, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.48% (0.6347 => 0.6126, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.48% (0.3849 => 0.3715, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -3.48% (0.4199 => 0.4053, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.46% (0.4427 => 0.4274, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -3.44% (0.3867 => 0.3734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.33% (0.3931 => 0.3800, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3788 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.29% (0.6484 => 0.6271, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -3.15% (0.4248 => 0.4114, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.12% (0.4321 => 0.4186, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.11% (0.7779 => 0.7537, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.01% (0.4083 => 0.3960, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.72% (0.4813 => 0.4682, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2619, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.24% (0.7919 => 0.7742, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8915, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.23% (1.2221 => 1.1949, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.17% (17.1032 => 16.7328, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.16% (1.0544 => 1.0316, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (1.2210 => 1.1948, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -2.13% (0.7982 => 0.7812, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (4.3330 => 4.2431, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.99% (6.7716 => 6.6371, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8731, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.0961 => 6.9694, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.76% (34.0927 => 33.4943, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/football/football: -1.69% (0.9179 => 0.9024, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.68% (1.5610 => 1.5348, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -1.54% (2.4021 => 2.3650, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8521 => 0.8398, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.23% (1.8100 => 0.7017, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3124, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0269, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1314, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3405, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8584, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.27% (1.0557 => 1.0212, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (7.9763 => 7.7278, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.45% (1.3096 => 1.2775, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1186, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -2.13% (3.7241 => 3.6447, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1924, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.46% (4.8776 => 4.8064, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.44% (1.6219 => 1.5985, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6093, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -1.27% (3.7092 => 3.6622, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 19:56:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 21:56:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130112035638.5B0CD2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7514?compare_to=7510&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7514, Order: 172285, Start Time: 2013-01-12 01:45:31, End Time: 2013-01-12 03:56:39 To: 7510, Order: 172259, Start Time: 2013-01-11 23:02:22, End Time: 2013-01-12 01:13:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 1 (3 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (216 on baseline) Performance Improvements: 7 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1089 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.35% (1.2924 => 1.3228, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (80.0971 => 81.7151, std.dev.: 0.2325) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.21% (1.3202 => 1.3362, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: -23.33% (0.1020 => 0.0782, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.73% (11.5019 => 11.0727, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.06% (6.4255 => 6.3573, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.02% (1.0304 => 1.0199, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.01% (3.1192 => 3.0878, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.00% (1.7660 => 1.7483, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.07% (3.8843 => 3.7649, std.dev.: 0.0220) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0653 => 0.0651, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7401 => 499.8374, std.dev.: 0.0157) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/UnitTests/SignlessTypes/factor MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.61% (1.1277 => 499.8374, std.dev.: 0.0157) SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.01% (0.5229 => 1.6472, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 19.33% (14.9895 => 17.8863, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: 43.12% (14.1553 => 20.2595, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 17.25% (4.1105 => 4.8195, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.31% (1.1048 => 1.7380, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.27% (7.1582 => 37.3138, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.58% (3.4629 => 6.3573, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.71% (0.6222 => 1.0808, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.36% (0.0720 => 7.4429, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11136000.00% (0.0001 => 11.1361, std.dev.: 0.0185) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848300.00% (0.0001 => 9.8484, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485100.00% (0.0001 => 5.4852, std.dev.: 0.0160) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.47% (1.1194 => 10.2814, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.47% (22.1758 => 55.3218, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.10% (0.0929 => 0.1766, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 70.54% (0.1463 => 0.2495, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.39% (2.9384 => 4.6248, std.dev.: 0.0079) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.32% (7.0540 => 10.8154, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.03% (1.5859 => 2.3794, std.dev.: 0.0168) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.63% (8.1363 => 11.9303, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 40.82% (21.9371 => 30.8917, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.20% (2.2024 => 3.0878, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 38.66% (0.3109 => 0.4311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.59% (4.2646 => 5.6970, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.91% (1.5415 => 2.0488, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.07% (0.4615 => 0.6095, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.59% (0.2271 => 0.2943, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.28% (0.1892 => 0.2446, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.24% (0.4299 => 0.5556, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 28.41% (1.1642 => 1.4950, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.85% (0.6675 => 0.8534, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.11% (0.1125 => 0.1430, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.07% (0.5105 => 0.6436, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.82% (0.1584 => 0.1993, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 25.36% (0.1175 => 0.1473, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.22% (0.2554 => 0.3198, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.03% (3.8922 => 4.8664, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.16% (1.0722 => 1.3312, std.dev.: 0.0076) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 23.53% (0.4289 => 0.5298, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.45% (0.3121 => 0.3853, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.24% (1.4186 => 1.7483, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.01% (0.1143 => 0.1406, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 22.99% (0.4620 => 0.5682, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 22.40% (9.4845 => 11.6087, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.59% (0.1695 => 0.2061, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.33% (0.2700 => 0.3276, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.22% (0.7115 => 0.8625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 20.88% (0.3098 => 0.3745, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.68% (0.7835 => 0.9455, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.31% (0.1236 => 0.1487, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.22% (1.3050 => 1.5689, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 19.73% (5.7591 => 6.8956, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/em3d/em3d: 19.71% (0.1695 => 0.2029, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 19.59% (0.6456 => 0.7721, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.53% (4.9449 => 5.9108, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.35% (0.8172 => 0.9753, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.5860 => 0.6991, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.94% (5.0018 => 5.9489, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.81% (0.1940 => 0.2305, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 18.77% (0.1151 => 0.1367, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.65% (3.3354 => 3.9576, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.99% (0.7433 => 0.8770, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.72% (0.3307 => 0.3893, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.69% (0.2758 => 0.3246, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.67% (0.5020 => 0.5907, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.28% (0.1510 => 0.1771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.5569 => 0.6529, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.94% (0.3423 => 0.4003, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.76% (1.1840 => 1.3824, std.dev.: 0.0112) MultiSource/Applications/lua/lua: 16.47% (3.8723 => 4.5101, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.44% (0.5981 => 0.6964, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.41% (2.0273 => 2.3599, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: 16.14% (0.3283 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.71% (0.0834 => 0.0965, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 15.69% (0.3232 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.61% (0.3441 => 0.3978, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.57% (0.8101 => 0.9362, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 15.46% (2.2969 => 2.6519, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.43% (0.0933 => 0.1077, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.32% (0.6450 => 0.7438, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 15.13% (0.2049 => 0.2359, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.84% (0.3180 => 0.3652, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.75% (0.1044 => 0.1198, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 14.67% (0.0818 => 0.0938, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.39% (1.1861 => 1.3568, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.33% (0.8921 => 1.0199, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.64% (0.3379 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.62% (0.8067 => 0.9166, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.33% (0.4636 => 0.5254, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.32% (0.3865 => 0.4380, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.18% (0.2603 => 0.2946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.05% (0.3886 => 0.4393, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.70% (0.3387 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 12.55% (0.3473 => 0.3909, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 12.54% (0.3828 => 0.4308, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.52% (1.5603 => 1.7557, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.33% (0.3561 => 0.4000, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 12.27% (0.3497 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 12.26% (0.3694 => 0.4147, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: 12.26% (0.3516 => 0.3947, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.16% (0.4103 => 0.4602, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.94% (0.4203 => 0.4705, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.4048 => 0.4520, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 11.41% (0.3603 => 0.4014, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.19% (0.3422 => 0.3805, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.07% (17.1811 => 19.0829, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/lists1: 10.99% (0.3684 => 0.4089, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.89% (14.3668 => 15.9312, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.85% (0.3826 => 0.4241, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.70% (0.2430 => 0.2690, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.54% (0.3282 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.24% (0.3427 => 0.3778, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.06% (0.4064 => 0.4473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.94% (0.7326 => 0.8054, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 9.85% (0.6030 => 0.6624, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.82% (0.2831 => 0.3109, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.25% (2.0665 => 2.2577, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 9.09% (0.2871 => 0.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3952, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 8.64% (0.2905 => 0.3156, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.38% (0.2756 => 0.2987, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 8.22% (0.3052 => 0.3303, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.03% (0.3935 => 0.4251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7.77% (63.2438 => 68.1563, std.dev.: 0.0244) MultiSource/Benchmarks/PAQ8p/paq8p: 6.80% (10.3673 => 11.0727, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.49% (2.2022 => 2.3451, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.4879 => 0.5185, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.85% (0.3817 => 0.4002, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.3131 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (7.9617 => 8.1748, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.28% (32.5116 => 59.2617, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4274, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.68% (4.2280 => 4.4683, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (3.1578 => 3.3146, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9181, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.48% (3.6395 => 3.7299, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.11% (9.1159 => 9.3086, std.dev.: 0.0225) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2794, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.40% (1.3045 => 1.3228, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5778, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0124) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.56% (5.2763 => 1.1839, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -75.60% (0.8651 => 0.2111, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.51% (5.3855 => 4.4423, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.12% (5.3526 => 4.4365, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -13.61% (10.4361 => 9.0156, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.40% (1.7609 => 1.6129, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9238, std.dev.: 0.0131) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.23% (1.9577 => 0.6612, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4282, std.dev.: 0.0147) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8576, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.30% (2.6546 => 2.0095, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4215, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2615, std.dev.: 0.0855) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.24% (1.2373 => 1.1601, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.99% (8.1563 => 7.7490, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/flops-5: -4.97% (1.5835 => 1.5048, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8309, std.dev.: 0.0160) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3307, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6695, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/ary3: -1.40% (3.6994 => 3.6475, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2188, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8558, std.dev.: 0.0118) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0016) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 20:44:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 22:44:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112044455.DE0D62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7515?compare_to=7511&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7515, Order: 172295, Start Time: 2013-01-12 02:44:49, End Time: 2013-01-12 04:44:58 To: 7511, Order: 172273, Start Time: 2013-01-11 23:44:40, End Time: 2013-01-12 01:51:37 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 4 (8 on baseline) Performance Improvements: 67 (84 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 992 (971 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/sim/sim: 6.34% (4.0143 => 4.2688, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/pi: 3.94% (2.1195 => 2.2031, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 2.44% (0.4508 => 0.4618, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (2.4618 => 2.4940, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/dt: -24.58% (0.0472 => 0.0356, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -19.96% (0.7809 => 0.6250, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -18.71% (0.8049 => 0.6543, std.dev.: 0.0143) SingleSource/Benchmarks/Stanford/Towers: -18.64% (0.0590 => 0.0480, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -16.20% (5.2183 => 4.3728, std.dev.: 0.2232) MultiSource/Applications/lua/lua: -12.88% (4.7017 => 4.0959, std.dev.: 0.1314) SingleSource/Benchmarks/Shootout-C++/strcat: -12.84% (0.2328 => 0.2029, std.dev.: 0.0021) MultiSource/Benchmarks/7zip/7zip-benchmark: -12.32% (50.3155 => 44.1161, std.dev.: 1.3687) MultiSource/Benchmarks/Bullet/bullet: -11.52% (37.5351 => 33.2111, std.dev.: 1.1358) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -11.47% (0.1011 => 0.0895, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.44% (0.7717 => 0.6834, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -11.30% (0.5927 => 0.5257, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -10.99% (26.3933 => 23.4914, std.dev.: 0.9975) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.91% (1.7254 => 1.5371, std.dev.: 0.0453) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.36% (0.9308 => 0.8344, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -10.35% (0.3557 => 0.3189, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.27% (1.1758 => 1.0551, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.69% (10.3053 => 9.3066, std.dev.: 0.0543) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.39% (0.6972 => 0.6317, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -9.06% (0.3961 => 0.3602, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.85% (0.3572 => 0.3256, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.41% (1.8550 => 1.6990, std.dev.: 0.0499) MultiSource/Benchmarks/MallocBench/espresso/espresso: -8.00% (5.1759 => 4.7620, std.dev.: 0.0755) MultiSource/Benchmarks/Prolangs-C/football/football: -7.97% (1.0439 => 0.9607, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.69% (0.3678 => 0.3395, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -7.40% (3.7530 => 3.4753, std.dev.: 0.1016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.37% (1.4550 => 1.3477, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.37% (1.0454 => 0.9684, std.dev.: 0.0137) MultiSource/Applications/Burg/burg: -7.29% (1.5007 => 1.3913, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2742 => 0.2564, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.01% (0.9320 => 0.8760, std.dev.: 0.0197) MultiSource/Benchmarks/mafft/pairlocalalign: -5.97% (10.1211 => 9.5164, std.dev.: 0.0775) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.25% (0.2246 => 0.2128, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.46% (0.9449 => 0.9028, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/hash: -4.43% (0.4722 => 0.4513, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -4.40% (0.5087 => 0.4863, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.40% (0.9350 => 0.8939, std.dev.: 0.0105) MultiSource/Applications/siod/siod: -4.34% (2.5204 => 2.4111, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.18% (4.9678 => 4.7600, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.00% (0.4828 => 0.4635, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.95% (0.9002 => 0.8646, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.85% (0.3944 => 0.3792, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.77% (0.3396 => 0.3268, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.13% (0.9197 => 0.8909, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.42% (4.5966 => 4.4853, std.dev.: 0.0146) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.26% (7.2336 => 7.0702, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.99% (0.9442 => 0.9254, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.84% (1.2876 => 1.2639, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.74% (1.9135 => 1.8802, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.47% (14.8181 => 14.6007, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -33.12% (4.7690 => 3.1897, std.dev.: 0.4487) MultiSource/Benchmarks/VersaBench/dbms/dbms: -12.30% (2.6684 => 2.3403, std.dev.: 0.1131) MultiSource/Benchmarks/nbench/nbench: -9.81% (22.6670 => 20.4441, std.dev.: 0.8112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.22% (47.4746 => 43.0959, std.dev.: 1.1796) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.70% (0.3560 => 0.3286, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.06% (0.1884 => 0.1751, std.dev.: 0.0023) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.78% (9.7008 => 9.1400, std.dev.: 0.1789) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -4.65% (3.0734 => 2.9305, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout/hash: -4.53% (4.2462 => 4.0537, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.6215 => 0.5996, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/lists: -3.38% (17.2224 => 16.6395, std.dev.: 0.1340) SingleSource/Benchmarks/Shootout/ary3: -3.05% (2.1574 => 2.0916, std.dev.: 0.0243) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.47% (40.3443 => 39.3482, std.dev.: 0.2855) SingleSource/Benchmarks/Stanford/FloatMM: -1.27% (0.8363 => 0.8257, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: -1.06% (1.7603 => 1.7416, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -1.05% (14.1505 => 14.0022, std.dev.: 0.0308) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.03% (1.9642 => 1.9439, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.11% (1.1510 => 1.1037, std.dev.: 0.1868) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0222 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.16% (0.0437 => 0.0362, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0339 => 0.0338, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.13% (0.0319 => 0.0309, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -14.15% (0.0205 => 0.0176, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0223 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.12% (0.0234 => 0.0253, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: -18.75% (0.0016 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.94% (0.1497 => 0.1468, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: -9.12% (1.2543 => 1.1399, std.dev.: 0.1953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.18% (0.4343 => 0.4031, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.29% (0.1542 => 0.1445, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.23% (0.0974 => 0.0986, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.60% (0.0269 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.59% (0.0566 => 0.0540, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1477 => 1.1467, std.dev.: 0.1998) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -26.67% (0.0030 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.59% (0.0604 => 0.0534, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.98% (0.0305 => 0.0302, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.13% (0.7491 => 0.7406, std.dev.: 0.0537) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 68.49% (0.0073 => 0.0123, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.13% (12.7789 => 12.7956, std.dev.: 0.0234) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321150.00% (0.0008 => 2.5700, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.73% (1.1825 => 2.3381, std.dev.: 0.1434) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.90% (0.2562 => 0.2867, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 6.62% (4.0036 => 4.2688, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/pi: 3.00% (2.1390 => 2.2031, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.37% (4.1668 => 4.2656, std.dev.: 0.0379) MultiSource/Benchmarks/mafft/pairlocalalign: 1.64% (63.1520 => 64.1854, std.dev.: 0.3304) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.57% (4.3851 => 4.4539, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -47.77% (0.0808 => 0.0422, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.43% (0.0727 => 0.0484, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0004) SingleSource/Benchmarks/SmallPT/smallpt: -26.11% (0.1888 => 0.1395, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.86% (0.1684 => 0.1299, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -20.54% (1.8964 => 1.5069, std.dev.: 0.0472) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.08% (0.0676 => 0.0547, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.68% (0.7686 => 0.6250, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.14% (0.1009 => 0.0826, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.63% (1.0960 => 0.9028, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.05% (0.1079 => 0.0895, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: -16.67% (0.4074 => 0.3395, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.77% (1.0986 => 0.9254, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: -13.61% (1.0220 => 0.8829, std.dev.: 0.0143) MultiSource/Applications/Burg/burg: -12.93% (1.5979 => 1.3913, std.dev.: 0.0118) MultiSource/Applications/aha/aha: -12.41% (0.1378 => 0.1207, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -12.24% (1.1433 => 1.0034, std.dev.: 0.0257) MultiSource/Applications/lua/lua: -11.74% (4.6406 => 4.0959, std.dev.: 0.1314) MultiSource/Applications/treecc/treecc: -11.73% (2.4719 => 2.1819, std.dev.: 0.0835) MultiSource/Applications/sgefa/sgefa: -11.37% (0.3598 => 0.3189, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.17% (0.7693 => 0.6834, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.93% (1.5131 => 1.3477, std.dev.: 0.0146) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.29% (0.2372 => 0.2128, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.38% (10.2703 => 9.3066, std.dev.: 0.0543) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.26% (0.1317 => 0.1195, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.23% (1.3924 => 1.2639, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.91% (1.6874 => 1.5371, std.dev.: 0.0453) MultiSource/Applications/siod/siod: -8.80% (2.6437 => 2.4111, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.64% (0.9588 => 0.8760, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.55% (0.9124 => 0.8344, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.54% (0.3560 => 0.3256, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.51% (0.5746 => 0.5257, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.25% (0.6885 => 0.6317, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.24% (1.1498 => 1.0551, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -8.08% (0.2006 => 0.1844, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.35% (0.2709 => 0.2510, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.71% (0.9550 => 0.8909, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: -6.23% (3.7840 => 3.5481, std.dev.: 0.0820) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.77% (0.2615 => 0.2464, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.76% (0.2100 => 0.1979, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.64% (0.6934 => 0.6543, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.48% (5.0381 => 4.7620, std.dev.: 0.0755) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.37% (1.0234 => 0.9684, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.1928 => 0.1825, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -5.28% (0.5134 => 0.4863, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.27% (0.9127 => 0.8646, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.09% (0.8990 => 0.8532, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.05% (0.3665 => 0.3480, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.95% (0.9405 => 0.8939, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.80% (0.9091 => 0.8655, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.79% (0.9788 => 0.9319, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/methcall: -4.78% (0.2135 => 0.2033, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.75% (0.3981 => 0.3792, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.72% (1.3220 => 1.2596, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3206 => 0.3056, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.30% (0.9993 => 0.9563, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ary: -3.96% (0.2551 => 0.2450, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: -3.75% (0.4689 => 0.4513, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.71% (0.3394 => 0.3268, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.71% (4.6579 => 4.4853, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.58% (1.0860 => 1.0471, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.78% (7.2721 => 7.0702, std.dev.: 0.0321) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.67% (4.8904 => 4.7600, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.50% (14.9757 => 14.6007, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: -1.56% (0.9759 => 0.9607, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.02% (0.9372 => 0.6465, std.dev.: 0.0730) SingleSource/Benchmarks/Shootout/heapsort: -29.81% (4.4739 => 3.1401, std.dev.: 0.3350) MultiSource/Applications/minisat/minisat: -22.45% (7.9891 => 6.1955, std.dev.: 0.6799) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.73% (0.1164 => 0.0946, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.68% (2.8778 => 2.3403, std.dev.: 0.1131) SingleSource/Benchmarks/Shootout/hash: -10.43% (4.5259 => 4.0537, std.dev.: 0.0380) SingleSource/Benchmarks/Shootout/nestedloop: -10.18% (0.2200 => 0.1976, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists1: -9.54% (0.6628 => 0.5996, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.95% (0.3609 => 0.3286, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.02% (23.3986 => 21.5217, std.dev.: 0.4528) MultiSource/Applications/oggenc/oggenc: -6.69% (0.1704 => 0.1590, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -6.22% (2.2304 => 2.0916, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/lists: -3.36% (17.2182 => 16.6395, std.dev.: 0.1340) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (40.4729 => 39.3482, std.dev.: 0.2855) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.58% (3.0082 => 2.9305, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.35% (0.5826 => 0.5689, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.35% (3.1921 => 3.1491, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3168, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.38% (1.2047 => 1.1037, std.dev.: 0.1868) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.73% (0.0451 => 0.0362, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.79% (0.0328 => 0.0309, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -17.37% (0.0213 => 0.0176, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0062) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.05% (0.1530 => 0.1468, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: -40.92% (1.9293 => 1.1399, std.dev.: 0.1953) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.44% (0.4049 => 0.4031, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.30% (0.1510 => 0.1445, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0978 => 0.0986, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.47% (0.0590 => 0.0540, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.29% (1.1617 => 1.1467, std.dev.: 0.1998) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0032 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.46% (0.0610 => 0.0534, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.69% (0.0268 => 0.0302, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0537) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7781 => 12.7956, std.dev.: 0.0234) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 20:51:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 11 Jan 2013 22:51:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112045141.CA1562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7516?compare_to=7513&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7516, Order: 172296, Start Time: 2013-01-12 03:17:43, End Time: 2013-01-12 04:51:43 To: 7513, Order: 172278, Start Time: 2013-01-12 01:19:55, End Time: 2013-01-12 02:54:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (12 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1103 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.71% (0.0717 => 0.1181, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.96% (0.0974 => 0.1558, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 44.13% (0.1500 => 0.2162, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.15% (0.6395 => 0.8771, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.51% (0.1132 => 0.1534, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.43% (0.6395 => 0.8661, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.27% (0.6260 => 0.8343, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.10% (0.5688 => 0.7514, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.09% (0.5805 => 0.7668, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.85% (0.5456 => 0.7194, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.6230 => 0.8205, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.19% (0.5575 => 0.7314, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.07% (0.5581 => 0.7315, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.00% (0.5567 => 0.7293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.42% (0.5802 => 0.7567, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.17% (0.5705 => 0.7426, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.90% (0.5478 => 0.7116, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.78% (0.5849 => 0.7591, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.75% (0.5859 => 0.7602, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.71% (0.5570 => 0.7225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.39% (0.5569 => 0.7206, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.27% (0.5925 => 0.7659, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.19% (0.6440 => 0.8320, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.94% (0.5591 => 0.7209, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.12% (0.5857 => 0.7504, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.99% (0.6189 => 0.7921, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.97% (0.5863 => 0.7503, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.85% (0.6446 => 0.8241, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.57% (0.6304 => 0.8042, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.23% (1.6474 => 2.0960, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.33% (0.6194 => 0.7825, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.92% (0.6297 => 0.7929, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.89% (0.6681 => 0.8411, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.72% (0.6660 => 0.8373, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.30% (0.6667 => 0.8287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.36% (0.7339 => 0.8980, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.91% (2.2587 => 2.7085, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.57% (1.1450 => 1.3118, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 13.97% (0.3357 => 0.3826, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.65% (0.1982 => 0.2213, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.15% (4.5069 => 5.0092, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.13% (1.6364 => 1.8185, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4916 => 0.5453, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.39% (0.4515 => 0.4984, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.23% (3.5339 => 3.8953, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.60% (0.2385 => 0.2590, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.79% (0.7021 => 0.7568, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.71% (1.2515 => 1.3355, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4524 => 0.4825, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.42% (0.5329 => 0.5671, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.4642 => 1.5534, std.dev.: 0.0065) MultiSource/Benchmarks/mafft/pairlocalalign: 6.03% (9.2283 => 9.7848, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.2784 => 1.3508, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4861 => 0.5136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.36% (0.3255 => 0.3397, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.51% (5.4682 => 5.6056, std.dev.: 0.0226) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4186, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 2.25% (0.6750 => 0.6902, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 2.14% (5.0226 => 5.1299, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.71% (0.8418 => 0.8562, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6810, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.20% (1.2783 => 1.3703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4411, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1687, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4151, std.dev.: 0.1391) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1042, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2854, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5320 => 4.6000, std.dev.: 0.0055) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4781, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.13% (0.1281 => 0.1100, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318) SingleSource/Benchmarks/Shootout-C++/objinst: -6.61% (0.3194 => 0.2983, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.21% (2.4924 => 2.3626, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.87% (0.9852 => 0.9372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.85% (0.3323 => 0.3162, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.77% (0.3142 => 0.2992, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.53% (0.2871 => 0.2741, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.51% (0.3057 => 0.2919, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.48% (0.3016 => 0.2881, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3026 => 0.2895, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.32% (2.1713 => 2.0775, std.dev.: 0.0051) SingleSource/Regression/C++/ofstream_ctor: -4.32% (0.3059 => 0.2927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (0.3025 => 0.2896, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -4.07% (0.3812 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.02% (0.3880 => 0.3724, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.02% (0.3831 => 0.3677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.00% (0.3896 => 0.3740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: -3.92% (0.4033 => 0.3875, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.85% (0.2989 => 0.2874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.83% (0.4176 => 0.4016, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.83% (1.3148 => 1.2645, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.80% (0.9542 => 0.9179, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.80% (0.3891 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.66% (0.3658 => 0.3524, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.45% (0.6484 => 0.6260, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3884 => 0.3751, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (0.3621 => 0.3498, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.38% (0.4199 => 0.4057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.21% (0.6347 => 0.6143, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.21% (0.3867 => 0.3743, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.16% (0.4427 => 0.4287, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.94% (0.7779 => 0.7550, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.94% (0.4321 => 0.4194, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -2.92% (0.4280 => 0.4155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -2.82% (0.3788 => 0.3681, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.77% (0.7919 => 0.7700, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.51% (1.2210 => 1.1903, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -2.49% (17.1032 => 16.6773, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.47% (0.4083 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.42% (6.7716 => 6.6076, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.38% (14.2083 => 13.8699, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.38% (1.2221 => 1.1930, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2804, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: -2.32% (4.3330 => 4.2324, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.31% (1.0544 => 1.0300, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: -2.28% (16.1920 => 15.8231, std.dev.: 0.0104) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.12% (0.4813 => 0.4711, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -2.08% (7.0961 => 6.9483, std.dev.: 0.0199) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.2300 => 1.2054, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.97% (34.0927 => 33.4207, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.78% (0.8521 => 0.8369, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -1.47% (1.5610 => 1.5380, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.47% (0.7982 => 0.7865, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.26% (8.0126 => 7.9119, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -1.22% (4.0594 => 4.0099, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: -1.03% (15.2527 => 15.0958, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -37.05% (0.1622 => 0.1021, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0259, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7570, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0349, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.00% (0.3418 => 0.2837, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1318, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3390, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (7.9763 => 7.7226, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2742, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.08% (3.7241 => 3.6465, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3040 => 7.1994, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.38% (4.8776 => 4.8103, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5887, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3472, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 11 23:16:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 01:16:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130112071626.8DA0A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7517?compare_to=7512&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7517, Order: 172296, Start Time: 2013-01-12 03:38:27, End Time: 2013-01-12 07:16:28 To: 7512, Order: 172253, Start Time: 2013-01-11 22:23:13, End Time: 2013-01-12 01:57:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (178 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.15% (54.1674 => 54.7889, std.dev.: 0.0412) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.56% (0.6931 => 0.6823, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.33% (1.5619 => 1.5412, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 39.36% (0.0625 => 0.0871, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.33% (0.1063 => 0.1396, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.11% (0.2969 => 0.3774, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.59% (0.0547 => 0.0687, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.17% (0.5900 => 0.7385, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.04% (0.4253 => 0.5318, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.01% (0.4139 => 0.5174, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 24.86% (0.1106 => 0.1381, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.63% (0.0475 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.67% (0.0714 => 0.0883, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.55% (0.4994 => 0.6170, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.21% (0.1620 => 0.1996, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.96% (0.5000 => 0.6148, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 22.92% (0.1021 => 0.1255, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 21.76% (1.5932 => 1.9399, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 21.52% (0.0948 => 0.1152, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.41% (0.1107 => 0.1344, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 21.19% (0.1619 => 0.1962, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.03% (0.1103 => 0.1335, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.95% (0.2014 => 0.2436, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.95% (0.1604 => 0.1940, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.81% (0.0495 => 0.0598, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.42% (0.3903 => 0.4700, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 19.43% (0.0947 => 0.1131, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 19.09% (0.4029 => 0.4798, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 18.77% (0.0698 => 0.0829, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.64% (0.2736 => 0.3246, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 18.64% (0.1218 => 0.1445, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.40% (0.1462 => 0.1731, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.34% (0.3271 => 0.3871, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.10% (0.3890 => 0.4594, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.04% (0.2866 => 0.3383, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 17.38% (0.9697 => 1.1382, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 17.20% (0.5546 => 0.6500, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.18% (1.3152 => 1.5412, std.dev.: 0.0074) SingleSource/UnitTests/ObjC++/Hello: 17.11% (0.5826 => 0.6823, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 17.05% (1.8794 => 2.1999, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/property-reference-object: 16.81% (0.5889 => 0.6879, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 16.74% (0.1284 => 0.1499, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.72% (3.5627 => 4.1583, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.63% (0.2911 => 0.3395, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.53% (0.4658 => 0.5428, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.32% (1.6211 => 1.8856, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.30% (0.3362 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.1968 => 0.2288, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 16.18% (0.7171 => 0.8331, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.16% (0.2803 => 0.3256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.08% (0.2792 => 0.3241, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.90% (0.5026 => 0.5825, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: 15.85% (0.2750 => 0.3186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (0.2738 => 0.3170, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 15.77% (0.2714 => 0.3142, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: 15.75% (0.2813 => 0.3256, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.74% (0.9909 => 1.1469, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 15.74% (0.2725 => 0.3154, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 15.66% (0.2823 => 0.3265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.63% (4.4195 => 5.1103, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/except: 15.62% (0.2811 => 0.3250, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.61% (0.2729 => 0.3155, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.58% (0.3004 => 0.3472, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.57% (2.0673 => 2.3892, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 15.54% (0.3096 => 0.3577, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: 15.43% (0.2780 => 0.3209, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.37% (0.3930 => 0.4534, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.23% (0.4361 => 0.5025, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.10% (0.3060 => 0.3522, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.05% (0.3195 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.96% (2.7292 => 3.1374, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 14.96% (23.5202 => 27.0378, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 14.88% (0.3267 => 0.3753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.80% (0.0804 => 0.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3258 => 0.3740, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.65% (1.9694 => 2.2580, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 14.62% (0.3317 => 0.3802, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.47% (0.3124 => 0.3576, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 14.46% (1.0781 => 1.2340, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.44% (1.9966 => 2.2850, std.dev.: 0.0153) MultiSource/Applications/ClamAV/clamscan: 14.33% (4.2109 => 4.8143, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.30% (0.1028 => 0.1175, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.23% (0.3845 => 0.4392, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.22% (0.3348 => 0.3824, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.17% (0.3726 => 0.4254, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.17% (0.3282 => 0.3747, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 14.09% (0.3477 => 0.3967, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.99% (0.3625 => 0.4132, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 13.97% (0.3678 => 0.4192, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 13.83% (1.4269 => 1.6243, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 13.76% (0.2566 => 0.2919, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.74% (0.3690 => 0.4197, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.66% (0.3981 => 0.4525, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.64% (0.4251 => 0.4831, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 13.63% (0.4146 => 0.4711, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.39% (0.1090 => 0.1236, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.09% (0.5012 => 0.5668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.84% (0.3488 => 0.3936, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.80% (0.3446 => 0.3887, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 12.77% (0.7875 => 0.8881, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-4: 12.76% (0.3465 => 0.3907, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 12.71% (0.3469 => 0.3910, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 12.70% (0.3496 => 0.3940, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.70% (0.3442 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 12.69% (0.3460 => 0.3899, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.41% (0.3650 => 0.4103, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3643 => 0.4091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3724 => 0.4179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.07% (0.6435 => 0.7212, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: 11.59% (2.1653 => 2.4163, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 11.37% (0.2075 => 0.2311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.36% (0.2737 => 0.3048, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 11.25% (2.1013 => 2.3378, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 11.22% (0.2691 => 0.2993, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: 11.14% (4.6177 => 5.1320, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: 11.12% (5.5417 => 6.1580, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 10.81% (0.3498 => 0.3876, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.74% (0.2068 => 0.2290, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.38% (0.3084 => 0.3404, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.25% (0.3336 => 0.3678, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.89% (0.2103 => 0.2311, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.89% (0.5361 => 0.5891, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.46% (11.6398 => 12.7415, std.dev.: 0.0191) MultiSource/Benchmarks/PAQ8p/paq8p: 9.43% (0.4847 => 0.5304, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.36% (0.2040 => 0.2231, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 9.35% (0.6634 => 0.7254, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.06% (0.7426 => 0.8099, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.04% (4.6926 => 5.1166, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.24% (0.1383 => 0.1497, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 7.53% (0.2391 => 0.2571, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.20% (0.5584 => 0.5986, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 6.90% (2.0346 => 2.1749, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 6.60% (11.9555 => 12.7451, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.53% (0.3792 => 0.3926) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5272, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 8.21% (0.2802 => 0.3032, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.99% (0.3693 => 0.3988, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6119, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6735, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2370, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6741, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 2.93% (0.6276 => 0.6460, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2121, std.dev.: 0.0486) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2991, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2844, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.18% (4.0317 => 4.0794, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2089, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5995, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4789, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5446, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.77% (17.2379 => 14.3478, std.dev.: 0.0197) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9786, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7973, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.92% (14.0481 => 13.4976, std.dev.: 0.0891) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2126, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7929, std.dev.: 0.0109) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.40% (0.6293 => 0.6142, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1949, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1341, std.dev.: 0.0861) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 08:29:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 10:29:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112162920.0C0302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7518?compare_to=7516&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7518, Order: 172313, Start Time: 2013-01-12 14:54:52, End Time: 2013-01-12 16:29:21 To: 7516, Order: 172296, Start Time: 2013-01-12 03:17:43, End Time: 2013-01-12 04:51:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 0 (96 on baseline) Performance Improvements: 1 (135 on baseline) Added Tests: 0 (12 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1102 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.7550 => 0.7449, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.17% (0.0315 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.44% (0.6395 => 0.8789, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.56% (0.6395 => 0.8669, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.85% (0.6260 => 0.8379, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.64% (0.5805 => 0.7700, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.63% (0.5688 => 0.7544, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.46% (0.5456 => 0.7227, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.93% (0.6230 => 0.8219, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.61% (0.5581 => 0.7345, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.61% (0.5575 => 0.7337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.44% (0.5567 => 0.7317, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.43% (0.5941 => 0.7808, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.85% (0.5802 => 0.7592, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.76% (0.6033 => 0.7889, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.71% (0.5705 => 0.7457, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.41% (0.5478 => 0.7144, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.40% (0.5859 => 0.7640, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.24% (0.5849 => 0.7618, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.98% (0.5570 => 0.7240, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.86% (0.5569 => 0.7232, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.83% (0.6440 => 0.8361, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.62% (0.5925 => 0.7680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.53% (0.5591 => 0.7242, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.63% (0.5857 => 0.7534, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.62% (0.6052 => 0.7784, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.52% (0.6189 => 0.7954, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.35% (0.5863 => 0.7525, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.00% (0.6446 => 0.8251, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.90% (0.6304 => 0.8063, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.16% (1.6474 => 2.0948, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.91% (0.6194 => 0.7861, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.75% (0.0699 => 0.0886, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.36% (0.6297 => 0.7957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.34% (0.6660 => 0.8414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.09% (0.6681 => 0.8424, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.57% (0.6667 => 0.8305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.69% (0.7339 => 0.9004, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.06% (2.2587 => 2.7118, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3159, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.27% (0.3357 => 0.3836, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.36% (0.1982 => 0.2227, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.16% (4.5069 => 5.0097, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.98% (0.4916 => 0.5456, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 10.74% (0.4515 => 0.5000, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.20% (3.5339 => 3.8944, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.97% (0.2385 => 0.2599, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.10% (0.7021 => 0.7590, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.76% (0.5329 => 0.5689, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.74% (1.2515 => 1.3358, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 6.21% (0.4524 => 0.4805, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (9.2283 => 9.7904, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.05% (1.4642 => 1.5528, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.95% (1.2784 => 1.3545, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4861 => 0.5135, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.15% (0.3255 => 0.3390, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.58% (5.4682 => 5.6093, std.dev.: 0.0300) MultiSource/Applications/oggenc/oggenc: 2.47% (5.0226 => 5.1469, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.3864 => 1.4177, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.69% (0.8418 => 0.8560, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6770, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.72% (0.9531 => 1.0362, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4405, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.58% (54.5751 => 56.5283, std.dev.: 0.1715) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2856, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6033, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (79.7170 => 80.9069, std.dev.: 0.2304) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -6.70% (0.3194 => 0.2980, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.66% (0.3837 => 0.3620, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.33% (0.3812 => 0.3609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.27% (0.3831 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.25% (0.3848 => 0.3646, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.23% (0.3880 => 0.3677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.18% (0.3896 => 0.3694, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.15% (0.3884 => 0.3684, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -5.08% (0.4033 => 0.3828, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.91% (0.4176 => 0.3971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.77% (0.3205 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.71% (0.9852 => 0.9388, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (2.4924 => 2.3754, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.68% (0.3016 => 0.2875, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.55% (2.1713 => 2.0726, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.52% (0.3252 => 0.3105, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.49% (0.3026 => 0.2890, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.43% (0.3025 => 0.2891, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.24% (0.7779 => 0.7449, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -4.19% (1.3148 => 1.2597, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.07% (0.4280 => 0.4106, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.93% (0.7198 => 0.6915, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -3.90% (0.6441 => 0.6190, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.78% (0.4151 => 0.3994, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.68% (0.9542 => 0.9191, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.49% (0.3931 => 0.3794, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.29% (0.3621 => 0.3502, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.24% (0.4321 => 0.4181, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -2.99% (0.4248 => 0.4121, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -2.88% (0.3788 => 0.3679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.84% (0.3867 => 0.3757, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.81% (20.7746 => 20.1904, std.dev.: 0.0162) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.78% (0.4813 => 0.4679, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.72% (0.4083 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.46% (6.7716 => 6.6050, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.35% (14.2083 => 13.8745, std.dev.: 0.0178) MultiSource/Applications/sqlite3/sqlite3: -2.34% (17.1032 => 16.7029, std.dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: -2.29% (0.7982 => 0.7799, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1943, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.27% (1.2210 => 1.1933, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: -2.22% (4.3330 => 4.2367, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: -2.22% (16.1920 => 15.8326, std.dev.: 0.0227) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.90% (1.2300 => 1.2066, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9614, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/football/football: -1.90% (0.9179 => 0.9005, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -1.72% (2.4021 => 2.3608, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.63% (34.0927 => 33.5362, std.dev.: 0.1119) MultiSource/Applications/hbd/hbd: -1.51% (1.5610 => 1.5374, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -1.29% (4.0594 => 4.0071, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.22% (8.0126 => 7.9150, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.47% (1.8100 => 0.6974, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3154, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.34% (1.3643 => 1.0322, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7489, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0403, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1273, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8592, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.60% (1.3096 => 1.2624, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.28% (1.0557 => 1.0211, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (7.9763 => 7.7270, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: -2.57% (3.7241 => 3.6285, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.28% (3.1919 => 3.1190, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.71% (4.8776 => 4.7941, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3040 => 7.1993, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.39% (1.6219 => 1.5993, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6089, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.32% (1.6086 => 1.5874, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6663, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 08:52:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 10:52:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112165219.60E952A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7519?compare_to=7515&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7519, Order: 172313, Start Time: 2013-01-12 14:50:51, End Time: 2013-01-12 16:52:23 To: 7515, Order: 172295, Start Time: 2013-01-12 02:44:49, End Time: 2013-01-12 04:44:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 8 (7 on baseline) Performance Improvements: 4 (72 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1051 (984 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.29% (1.4593 => 1.8721, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 23.84% (7.1553 => 8.8608, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.60% (0.3286 => 0.3503, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.62% (2.6250 => 2.7724, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 5.34% (4.7366 => 4.9897, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.87% (2.3381 => 2.4520, std.dev.: 0.0221) SingleSource/Benchmarks/Dhrystone/fldry: 2.86% (0.6599 => 0.6788, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.12% (1.5578 => 1.5753, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.30% (2.4940 => 2.4117, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -2.32% (0.4618 => 0.4511, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: -2.08% (0.5533 => 0.5418, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.64% (0.6298 => 0.6195, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.21% (1.1037 => 1.1281, std.dev.: 0.0571) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.52% (0.0221 => 0.0231, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 22.38% (0.0362 => 0.0443, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.14% (0.0338 => 0.0352, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.80% (0.0309 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.39% (0.0431 => 0.0369, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 25.00% (0.0176 => 0.0220, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 3.57% (0.0224 => 0.0232, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.29% (0.1468 => 0.1449, std.dev.: 0.0273) MultiSource/Applications/lemon/lemon: 0.12% (1.1399 => 1.1413, std.dev.: 0.4158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.34% (0.4031 => 0.3977, std.dev.: 0.1420) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.77% (0.1445 => 0.1485, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0986 => 0.0991, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.48% (0.0540 => 0.0575, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.33% (1.1467 => 1.3340, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 4.55% (0.0022 => 0.0023, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.98% (0.0534 => 0.0614, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.64% (0.0302 => 0.0313, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7406 => 0.7409, std.dev.: 0.0083) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -1.63% (0.0123 => 0.0121, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.28% (12.7956 => 12.7599, std.dev.: 0.0308) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 52.68% (0.0336 => 0.0513, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323350.00% (0.0008 => 2.5876, std.dev.: 0.0772) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 107.36% (1.1825 => 2.4520, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.90% (0.2562 => 0.2867, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/pi: 3.29% (2.1390 => 2.2093, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.06% (2.7432 => 2.7724, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.01% (1.5595 => 1.5753, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.47% (0.0808 => 0.0481, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/random: -31.62% (0.0370 => 0.0253, std.dev.: 0.0034) SingleSource/Benchmarks/SmallPT/smallpt: -26.80% (0.1888 => 0.1382, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.10% (0.0862 => 0.0706, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.37% (0.7686 => 0.6505, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.05% (1.0986 => 0.9333, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.18% (0.1079 => 0.0926, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.52% (0.2372 => 0.2075, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.04% (0.0889 => 0.0782, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.68% (6.4235 => 5.6734, std.dev.: 0.2385) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.36% (1.5131 => 1.3563, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.03% (1.3924 => 1.2528, std.dev.: 0.0147) MultiSource/Applications/siod/siod: -9.04% (2.6437 => 2.4046, std.dev.: 0.0742) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.87% (1.6874 => 1.5377, std.dev.: 0.0287) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.87% (0.2618 => 0.2412, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -7.58% (0.2006 => 0.1854, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -7.37% (0.1928 => 0.1786, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -6.99% (0.5134 => 0.4775, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -6.92% (0.2385 => 0.2220, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.83% (1.0017 => 0.9333, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.81% (0.2615 => 0.2437, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -6.55% (0.4002 => 0.3740, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary: -6.15% (0.2551 => 0.2394, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.98% (0.3665 => 0.3446, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.90% (0.3981 => 0.3746, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -5.57% (0.2135 => 0.2016, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.2725 => 0.2578, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.37% (0.7693 => 0.7280, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/except: -5.34% (0.2172 => 0.2056, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: -5.27% (0.4689 => 0.4442, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.26% (0.9422 => 0.8926, std.dev.: 0.0127) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.24% (0.2709 => 0.2567, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.24% (0.2577 => 0.2442, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.19% (5.0381 => 4.7765, std.dev.: 0.0703) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.10% (0.9512 => 0.9027, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary2: -4.92% (0.2665 => 0.2534, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.77% (0.8990 => 0.8561, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -4.68% (0.2564 => 0.2444, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.56% (0.6135 => 0.5855, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.52% (1.3220 => 1.2622, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -4.34% (0.3206 => 0.3067, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.16% (0.9403 => 0.9012, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.86% (4.6579 => 4.4782, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: -3.73% (4.5936 => 4.4224, std.dev.: 0.0589) MultiSource/Benchmarks/sim/sim: -3.58% (0.3715 => 0.3582, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.41% (1.0119 => 0.9774, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.07% (0.3847 => 0.3729, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.97% (0.9061 => 0.8792, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.85% (4.8904 => 4.7508, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.70% (0.8893 => 0.8653, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.53% (14.9757 => 14.5962, std.dev.: 0.1204) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.48% (0.8926 => 0.8705, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.46% (0.9381 => 0.9150, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -28.84% (1.0816 => 0.7697, std.dev.: 0.1162) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.75% (0.1164 => 0.1004, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: -10.14% (4.5259 => 4.0671, std.dev.: 0.1708) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.59% (1.4588 => 1.3335, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists1: -8.37% (0.6628 => 0.6073, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.75% (23.3986 => 21.8198, std.dev.: 0.1711) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.18% (2.5170 => 2.4117, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.74% (1.4446 => 1.3906, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: -3.52% (3.5443 => 3.4197, std.dev.: 0.0467) SingleSource/Benchmarks/Shootout-C++/lists: -3.10% (17.2182 => 16.6848, std.dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.87% (0.5826 => 0.5659, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: -2.46% (1.4244 => 1.3893, std.dev.: 0.0119) MultiSource/Applications/spiff/spiff: -2.05% (2.8571 => 2.7984, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.05% (2.4498 => 2.3995, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.84% (61.0379 => 59.9151, std.dev.: 0.3842) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.68% (3.0082 => 2.9577, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: -1.31% (8.7416 => 8.6270, std.dev.: 0.0296) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3596 => 3.3166, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: -1.11% (2.9083 => 2.8760, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.36% (1.2047 => 1.1281, std.dev.: 0.0571) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.86% (0.0233 => 0.0231, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.77% (0.0451 => 0.0443, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.66% (0.0394 => 0.0352, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.61% (0.0328 => 0.0330, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.08% (0.0445 => 0.0369, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 3.29% (0.0213 => 0.0220, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 2.20% (0.0227 => 0.0232, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.29% (0.1530 => 0.1449, std.dev.: 0.0273) MultiSource/Applications/lemon/lemon: -40.84% (1.9293 => 1.1413, std.dev.: 0.4158) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.78% (0.4049 => 0.3977, std.dev.: 0.1420) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1510 => 0.1485, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.33% (0.0978 => 0.0991, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.54% (0.0590 => 0.0575, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.83% (1.1617 => 1.3340, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -28.13% (0.0032 => 0.0023, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.79% (0.0268 => 0.0313, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0083) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.52% (0.0092 => 0.0121, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (12.7781 => 12.7599, std.dev.: 0.0308) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 09:10:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 11:10:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130112171035.3D9392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7520?compare_to=7514&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7520, Order: 172313, Start Time: 2013-01-12 14:59:19, End Time: 2013-01-12 17:10:35 To: 7514, Order: 172285, Start Time: 2013-01-12 01:45:31, End Time: 2013-01-12 03:56:39 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (213 on baseline) Performance Improvements: 3 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 5 (2 on baseline) Unchanged Tests: 1095 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.36% (11.0727 => 11.2238, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.48% (0.8054 => 0.7935, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.36% (2.2577 => 2.2269, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.69% (1.3228 => 1.2872, std.dev.: 0.0118) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/UnitTests/SignlessTypes/factor MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8374 => 499.7967, std.dev.: 0.0347) SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/UnitTests/SignlessTypes/factor MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44220.01% (1.1277 => 499.7967, std.dev.: 0.0347) SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.57% (0.5229 => 1.6449, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 19.81% (14.9895 => 17.9582, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: 43.45% (14.1553 => 20.3051, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/gs/gs: 17.81% (4.1105 => 4.8426, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.87% (1.1048 => 1.7441, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.45% (7.1582 => 37.6844, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.64% (3.4629 => 6.3939, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.74% (0.6222 => 1.0810, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.58% (0.0720 => 7.4409, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 11165200.00% (0.0001 => 11.1653, std.dev.: 0.0205) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484700.00% (0.0001 => 5.4848, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.80% (1.1194 => 10.3074, std.dev.: 0.0507) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.54% (22.1758 => 55.3377, std.dev.: 0.0739) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.22% (0.1463 => 0.2505, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.79% (0.0271 => 0.0452, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.79% (2.9384 => 4.6072, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.73% (7.0540 => 10.8442, std.dev.: 0.0191) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.90% (1.5859 => 2.3931, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.48% (0.1056 => 0.1568, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.64% (8.1363 => 11.9312, std.dev.: 0.0202) MultiSource/Applications/JM/lencod/lencod: 42.01% (21.9371 => 31.1539, std.dev.: 0.0395) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.21% (2.2024 => 3.1099, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: 39.14% (0.3109 => 0.4326, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 37.99% (0.1432 => 0.1976, std.dev.: 0.0004) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.77% (4.2646 => 5.7046, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.20% (1.5415 => 2.0533, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.74% (0.4615 => 0.6126, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.81% (0.2271 => 0.2948, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.65% (0.1892 => 0.2453, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 29.09% (1.1642 => 1.5029, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/05-eks/eks: 28.91% (0.4299 => 0.5542, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.42% (0.6675 => 0.8572, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.11% (0.5105 => 0.6489, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.60% (0.1143 => 0.1447, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 25.70% (0.1175 => 0.1477, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.70% (3.8922 => 4.8924, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 24.86% (1.0722 => 1.3388, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.73% (1.4186 => 1.7553, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 22.76% (9.4845 => 11.6430, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/hash: 22.76% (0.4289 => 0.5265, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.71% (0.1695 => 0.2080, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 22.21% (0.4620 => 0.5646, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.2700 => 0.3298, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 21.76% (0.7115 => 0.8663, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.51% (1.3050 => 1.5726, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 20.50% (5.7591 => 6.9399, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 20.47% (0.7835 => 0.9439, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 20.24% (0.1695 => 0.2038, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.80% (0.5860 => 0.7020, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.77% (4.9449 => 5.9226, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/bigfib: 19.64% (0.6456 => 0.7724, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 19.59% (0.3098 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.42% (0.8172 => 0.9759, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.13% (3.3354 => 3.9734, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.00% (5.0018 => 5.9522, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/health/health: 18.45% (0.1268 => 0.1502, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.20% (0.2758 => 0.3260, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.87% (0.5020 => 0.5917, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.63% (0.5569 => 0.6551, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 17.56% (0.3423 => 0.4024, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 17.54% (0.7433 => 0.8737, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.37% (0.9765 => 1.1461, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.33% (0.3307 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 17.28% (1.1840 => 1.3886, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.28% (0.2107 => 0.2471, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.19% (0.2065 => 0.2420, std.dev.: 0.0109) MultiSource/Applications/lua/lua: 17.01% (3.8723 => 4.5310, std.dev.: 0.0191) MultiSource/Applications/treecc/treecc: 16.94% (2.0273 => 2.3708, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.82% (0.5981 => 0.6987, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.26% (2.2969 => 2.6703, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.83% (0.0834 => 0.0966, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.64% (0.6450 => 0.7459, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 15.57% (0.2049 => 0.2368, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.16% (0.3180 => 0.3662, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.02% (0.3283 => 0.3776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.75% (0.8921 => 1.0237, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.69% (1.1861 => 1.3603, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/ary: 14.57% (0.3232 => 0.3703, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.24% (0.8067 => 0.9216, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 12.64% (0.3379 => 0.3806, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.40% (1.5603 => 1.7537, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.26% (0.3865 => 0.4339, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.14% (0.4103 => 0.4601, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.78% (0.4636 => 0.5182, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.31% (17.1811 => 19.1245, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 11.25% (0.3092 => 0.3440, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.11% (0.4203 => 0.4670, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.92% (14.3668 => 15.9354, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.91% (0.3427 => 0.3801, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 10.91% (0.3282 => 0.3640, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 10.70% (0.4048 => 0.4481, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.61% (0.3516 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 10.50% (0.3543 => 0.3915, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.41% (0.3497 => 0.3861, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.35% (0.3603 => 0.3976, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3422 => 0.3771, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.96% (0.3684 => 0.4051, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.85% (0.3826 => 0.4203, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.20% (0.4064 => 0.4438, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.6030 => 0.6567, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.37% (0.2831 => 0.3068, std.dev.: 0.0084) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 8.26% (10.3673 => 11.2238, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 8.08% (63.2438 => 68.3534, std.dev.: 0.0859) SingleSource/Benchmarks/Shootout-C++/except: 7.94% (0.2871 => 0.3099, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.76% (2.0665 => 2.2269, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 7.61% (1.2842 => 1.3819, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.51% (0.2877 => 0.3093, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3935 => 0.4222, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.16% (0.2891 => 0.3098, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.13% (0.2905 => 0.3112, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.00% (0.2756 => 0.2949, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.82% (0.2872 => 0.3068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.78% (2.2022 => 2.3514, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 6.75% (0.3052 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.68% (0.2725 => 0.2907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.55% (0.2793 => 0.2976, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.41% (0.2714 => 0.2888, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.33% (0.4879 => 0.5188, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.20% (0.3817 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (7.9617 => 8.1967, std.dev.: 0.0211) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2504, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.30% (1.1396 => 1.2456, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (4.2280 => 4.4747, std.dev.: 0.0056) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (3.1578 => 3.3105, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.40% (0.9957 => 1.0296, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.6802 => 8.8970, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.41% (3.6395 => 3.7271, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.14% (9.1159 => 9.3111, std.dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2791, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.62% (5.2763 => 1.1806, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.22% (5.3855 => 4.4580, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.77% (5.3526 => 4.4548, std.dev.: 0.0081) MultiSource/Applications/JM/ldecod/ldecod: -13.38% (10.4361 => 9.0400, std.dev.: 0.0322) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.79% (1.7609 => 1.6061, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.8973, std.dev.: 0.0545) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.83% (1.9577 => 0.6690, std.dev.: 0.0062) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0221, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4329, std.dev.: 0.0170) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8560, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.66% (2.6546 => 2.0001, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1270, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.16% (9.5636 => 8.4961, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2948, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.54% (1.2373 => 1.1564, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.17% (8.1563 => 7.7346, std.dev.: 0.0218) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.87% (0.4808 => 0.4574, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.78% (1.5835 => 1.5078, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8361, std.dev.: 0.0124) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0074) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.75% (3.6994 => 3.6346, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7221 => 3.6758, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0039) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 10:26:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 12:26:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112182619.30A292A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7521?compare_to=7518&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7521, Order: 172319, Start Time: 2013-01-12 16:52:45, End Time: 2013-01-12 18:26:21 To: 7518, Order: 172313, Start Time: 2013-01-12 14:54:52, End Time: 2013-01-12 16:29:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 0 (100 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1103 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.72% (0.6395 => 0.8807, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.72% (0.6395 => 0.8679, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.80% (0.6260 => 0.8376, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.75% (0.5805 => 0.7706, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.68% (0.5688 => 0.7547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.59% (0.5456 => 0.7234, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.99% (0.6230 => 0.8223, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.76% (0.5567 => 0.7335, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.63% (0.5581 => 0.7346, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.62% (0.5575 => 0.7338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.38% (0.5941 => 0.7805, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.09% (0.5802 => 0.7606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.81% (0.6033 => 0.7892, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.66% (0.5705 => 0.7454, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.31% (0.5849 => 0.7622, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.28% (0.5478 => 0.7137, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.28% (0.5859 => 0.7633, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.11% (0.5570 => 0.7247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.91% (0.6440 => 0.8366, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.72% (0.5569 => 0.7224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.69% (0.5925 => 0.7684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.57% (0.5591 => 0.7244, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.67% (0.6052 => 0.7787, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.60% (0.5857 => 0.7532, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.59% (0.5863 => 0.7539, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.57% (0.6189 => 0.7957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.45% (0.6676 => 0.8575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.16% (0.6446 => 0.8261, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.00% (0.6304 => 0.8069, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.33% (1.6474 => 2.0977, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.98% (0.6194 => 0.7865, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.27% (0.6297 => 0.7951, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.19% (0.6681 => 0.8431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.79% (0.6667 => 0.8320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.63% (0.7524 => 0.9302, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.76% (0.7339 => 0.9009, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.09% (2.2587 => 2.7124, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.97% (1.1450 => 1.3164, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.03% (0.3357 => 0.3828, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.56% (0.1982 => 0.2231, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.39% (1.6364 => 1.8228, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.29% (4.5069 => 5.0158, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.15% (0.4916 => 0.5464, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: 10.81% (0.4515 => 0.5003, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.31% (3.5339 => 3.8983, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.10% (0.7021 => 0.7590, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.84% (1.2515 => 1.3371, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.77% (0.5329 => 0.5690, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4524 => 0.4827, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.1731 => 0.1841, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (9.2283 => 9.7962, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (0.4861 => 0.5159, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.11% (1.4642 => 1.5537, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.90% (1.2784 => 1.3538, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.70% (0.3255 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.6750 => 0.6936, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.70% (5.0226 => 5.1583, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.64% (5.4682 => 5.6128, std.dev.: 0.0136) MultiSource/Applications/SIBsim4/SIBsim4: 2.29% (1.3864 => 1.4182, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.65% (0.8418 => 0.8557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.17% (0.9557 => 0.9669, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.3722 => 1.3863, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.00% (22.4056 => 22.6306, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6785, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.45% (0.9531 => 1.0336, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4411, std.dev.: 0.0034) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1692, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4009, std.dev.: 0.0932) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8210 => 28.2896, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6059, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.63% (79.7170 => 81.0158, std.dev.: 0.3129) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.12% (4.4335 => 4.4830, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.19% (0.3837 => 0.3638, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3812 => 0.3632, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.71% (0.3821 => 0.3641, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3880 => 0.3698, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.65% (0.3848 => 0.3669, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.62% (2.4924 => 2.3772, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.61% (0.9852 => 0.9398, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.54% (0.3896 => 0.3719, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.48% (0.4176 => 0.3989, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.47% (0.3891 => 0.3717, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.44% (0.4033 => 0.3854, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.24% (0.2903 => 0.2780, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.08% (0.3016 => 0.2893, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.06% (0.3057 => 0.2933, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.99% (0.2933 => 0.2816, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.98% (2.1713 => 2.0848, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/property: -3.98% (0.4199 => 0.4032, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.95% (0.2939 => 0.2823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -3.93% (0.3025 => 0.2906, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -3.74% (1.3148 => 1.2656, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.65% (0.7779 => 0.7495, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.9542 => 0.9199, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.56% (0.7198 => 0.6942, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -3.55% (0.2989 => 0.2883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.53% (0.3658 => 0.3529, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.51% (0.6347 => 0.6124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.35% (0.4151 => 0.4012, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.23% (0.6441 => 0.6233, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.18% (0.6484 => 0.6278, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.15% (0.3931 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.86% (20.7746 => 20.1809, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.85% (0.4321 => 0.4198, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.79% (0.7919 => 0.7698, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -2.79% (0.3621 => 0.3520, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.60% (0.4427 => 0.4312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.34% (4.3330 => 4.2317, std.dev.: 0.0113) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.31% (6.7716 => 6.6151, std.dev.: 0.0125) MultiSource/Applications/lambda-0_1_3/lambda: -2.28% (0.7982 => 0.7800, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.26% (14.2083 => 13.8873, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -2.25% (17.1032 => 16.7178, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.2210 => 1.1942, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.14% (1.2221 => 1.1959, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.12% (1.0544 => 1.0320, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -2.05% (16.1920 => 15.8602, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -1.89% (7.0961 => 6.9619, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.80% (1.2300 => 1.2078, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -1.72% (2.4021 => 2.3608, std.dev.: 0.0150) MultiSource/Benchmarks/Bullet/bullet: -1.40% (34.0927 => 33.6156, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.36% (0.8521 => 0.8405, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -1.30% (1.5610 => 1.5407, std.dev.: 0.0036) MultiSource/Applications/lua/lua: -1.24% (4.0594 => 4.0089, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.03% (8.0126 => 7.9303, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.38% (1.8100 => 0.6809, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3146, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.07% (1.3643 => 1.0223, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0308, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.69% (4.3779 => 3.3844, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: -3.29% (5.5807 => 5.3970, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (7.9763 => 7.7232, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.58% (3.7241 => 3.6281, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1933, std.dev.: 0.0085) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4749, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8051, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.19% (1.6307 => 1.6113, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.19% (1.6086 => 1.5895, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 11:08:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 13:08:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112190834.C90BC2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7522?compare_to=7519&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7522, Order: 172319, Start Time: 2013-01-12 17:10:02, End Time: 2013-01-12 19:08:38 To: 7519, Order: 172313, Start Time: 2013-01-12 14:50:51, End Time: 2013-01-12 16:52:23 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (7 on baseline) Performance Improvements: 2 (91 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1052 (965 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.66% (23.4100 => 23.7981, std.dev.: 0.0431) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.22% (43.9321 => 44.4692, std.dev.: 0.0631) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 7.50% (20.5700 => 22.1126, std.dev.: 0.0693) MultiSource/Applications/SPASS/SPASS: 2.93% (8.1942 => 8.4340, std.dev.: 0.0695) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.39% (9.0789 => 9.2958, std.dev.: 0.0201) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.06% (59.9151 => 61.1484, std.dev.: 0.1225) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.02% (1.3335 => 1.3604, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.33% (1.3906 => 1.4091, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.01% (7.1088 => 7.1807, std.dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.74% (5.7793 => 5.3322, std.dev.: 0.1292) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.33% (1.5753 => 1.5543, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.27% (1.1281 => 1.1251, std.dev.: 0.0755) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.33% (0.0231 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.48% (0.0443 => 0.0432, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.26% (0.0352 => 0.0337, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.73% (0.0330 => 0.0321, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.25% (0.0369 => 0.0357, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -33.64% (0.0220 => 0.0146, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -8.19% (0.0232 => 0.0213, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1449 => 0.1447, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -0.90% (1.1413 => 1.1310, std.dev.: 0.2544) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.98% (0.3977 => 0.3938, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.35% (0.1485 => 0.1465, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.31% (0.0991 => 0.0978, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0277 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.57% (0.0575 => 0.0543, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.33% (1.3340 => 1.1562, std.dev.: 0.0458) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 30.43% (0.0023 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.65% (0.0614 => 0.0618, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.60% (0.0313 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.58% (0.7409 => 0.7452, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -65.29% (0.0121 => 0.0042, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7599 => 12.7552, std.dev.: 0.0278) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 41.96% (0.0336 => 0.0477, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.15% (1.8651 => 1.8866, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321187.50% (0.0008 => 2.5703, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.15% (1.1825 => 2.4141, std.dev.: 0.0209) MultiSource/Benchmarks/nbench/nbench: 7.80% (20.5117 => 22.1126, std.dev.: 0.0693) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.19% (9.0082 => 9.2958, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/pi: 3.08% (2.1390 => 2.2049, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.47% (0.0808 => 0.0481, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.91% (0.0692 => 0.0485, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -27.22% (0.1888 => 0.1374, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.51% (0.1009 => 0.0792, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -21.27% (1.8964 => 1.4930, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.91% (0.0862 => 0.0699, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.86% (1.0986 => 0.9244, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.74% (0.1079 => 0.0920, std.dev.: 0.0007) MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.14% (1.2154 => 1.0435, std.dev.: 0.0352) MultiSource/Applications/spiff/spiff: -13.41% (1.0220 => 0.8850, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -13.16% (1.1433 => 0.9928, std.dev.: 0.0243) MultiSource/Applications/Burg/burg: -12.81% (1.5979 => 1.3932, std.dev.: 0.0092) MultiSource/Applications/aha/aha: -12.34% (0.1378 => 0.1208, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -11.96% (2.4719 => 2.1763, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.51% (6.4235 => 5.6840, std.dev.: 0.2426) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.11% (0.0918 => 0.0816, std.dev.: 0.0032) MultiSource/Applications/lua/lua: -10.85% (4.6406 => 4.1371, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.11% (1.3924 => 1.2516, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.78% (1.6874 => 1.5223, std.dev.: 0.0315) MultiSource/Applications/siod/siod: -9.70% (2.6437 => 2.3872, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.66% (1.5131 => 1.3669, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.56% (10.2703 => 9.2884, std.dev.: 0.1668) MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.28% (1.1731 => 1.0642, std.dev.: 0.0153) MultiSource/Applications/sgefa/sgefa: -9.03% (0.3598 => 0.3273, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: -8.90% (17.5634 => 16.0011, std.dev.: 0.4974) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.77% (0.2372 => 0.2164, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -8.44% (17.4365 => 15.9656, std.dev.: 0.2386) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.12% (0.1317 => 0.1210, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -7.44% (0.5134 => 0.4752, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.19% (1.0017 => 0.9297, std.dev.: 0.0247) MultiSource/Applications/d/make_dparser: -6.91% (3.7840 => 3.5227, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: -6.70% (0.4002 => 0.3734, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: -6.68% (1.3979 => 1.3045, std.dev.: 0.0295) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.29% (0.2100 => 0.1968, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.12% (0.2615 => 0.2455, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -6.07% (0.1928 => 0.1811, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -5.96% (0.2551 => 0.2399, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.87% (0.9550 => 0.8989, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.59% (0.9422 => 0.8895, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/except: -5.43% (0.2172 => 0.2054, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.25% (0.9127 => 0.8648, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -4.87% (0.3206 => 0.3050, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.2564 => 0.2442, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.70% (0.9405 => 0.8963, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.64% (0.9788 => 0.9334, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.62% (4.6579 => 4.4428, std.dev.: 0.0628) SingleSource/Benchmarks/Shootout-C++/hash: -4.61% (0.4689 => 0.4473, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: -4.57% (1.4392 => 1.3735, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.2305 => 0.2200, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.45% (1.3220 => 1.2632, std.dev.: 0.0066) MultiSource/Benchmarks/sim/sim: -4.33% (0.3715 => 0.3554, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: -4.26% (0.2725 => 0.2609, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.19% (0.9993 => 0.9574, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: -3.92% (16.4479 => 15.8036, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.56% (0.9488 => 0.9150, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.30% (0.5369 => 0.5192, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.20% (1.0860 => 1.0513, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.18% (14.9757 => 14.4996, std.dev.: 0.1826) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.02% (4.8904 => 4.7429, std.dev.: 0.0286) MultiSource/Applications/JM/ldecod/ldecod: -2.92% (7.3529 => 7.1379, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.90% (0.8893 => 0.8635, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.62% (0.4762 => 0.4637, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.25% (0.9685 => 0.9467, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: -2.13% (5.3553 => 5.2411, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.68% (0.8912 => 0.8762, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -24.43% (4.2042 => 3.1772, std.dev.: 0.2573) MultiSource/Applications/minisat/minisat: -21.32% (7.9891 => 6.2861, std.dev.: 0.1464) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.78% (0.1164 => 0.0992, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -10.24% (4.5259 => 4.0623, std.dev.: 0.0940) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.17% (0.4081 => 0.3666, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.62% (0.3609 => 0.3298, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists1: -8.22% (0.6628 => 0.6083, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.21% (23.3986 => 21.4775, std.dev.: 0.4025) MultiSource/Applications/oggenc/oggenc: -8.16% (0.1704 => 0.1565, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.02% (0.3217 => 0.2959, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.91% (16.6791 => 15.3606, std.dev.: 0.4901) MultiSource/Applications/SPASS/SPASS: -6.96% (9.0650 => 8.4340, std.dev.: 0.0695) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.75% (1.4588 => 1.3604, std.dev.: 0.0068) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.12% (2.5170 => 2.4132, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/lists: -3.11% (17.2182 => 16.6834, std.dev.: 0.0619) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.76% (40.4729 => 39.3563, std.dev.: 0.3676) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.75% (0.5826 => 0.5666, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: -2.53% (4.4730 => 4.3597, std.dev.: 0.0377) MultiSource/Applications/spiff/spiff: -2.46% (2.8571 => 2.7867, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.46% (1.4446 => 1.4091, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.37% (3.1921 => 3.1165, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/ffbench: -2.16% (1.4244 => 1.3937, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.96% (3.7662 => 3.6923, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3596 => 3.3189, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.61% (1.2047 => 1.1251, std.dev.: 0.0755) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -19.78% (0.0445 => 0.0357, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/casts: -31.46% (0.0213 => 0.0146, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -6.17% (0.0227 => 0.0213, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.42% (0.1530 => 0.1447, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -41.38% (1.9293 => 1.1310, std.dev.: 0.2544) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.74% (0.4049 => 0.3938, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.98% (0.1510 => 0.1465, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0978 => 0.0978, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.97% (0.0590 => 0.0543, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.47% (1.1617 => 1.1562, std.dev.: 0.0458) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.31% (0.0610 => 0.0618, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.7437 => 0.7452, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7552, std.dev.: 0.0278) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 11:51:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 13:51:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130112195136.B264F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7523?compare_to=7520&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7523, Order: 172320, Start Time: 2013-01-12 17:40:55, End Time: 2013-01-12 19:51:38 To: 7520, Order: 172313, Start Time: 2013-01-12 14:59:19, End Time: 2013-01-12 17:10:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (3 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 5 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power SingleSource/UnitTests/SignlessTypes/factor MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7967 => 499.8581, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power SingleSource/UnitTests/SignlessTypes/factor MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 44225.45% (1.1277 => 499.8581, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.17% (0.5229 => 1.6428, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 19.70% (14.9895 => 17.9425, std.dev.: 0.0115) MultiSource/Applications/kimwitu++/kc: 43.45% (14.1553 => 20.3056, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 17.84% (4.1105 => 4.8437, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.71% (1.1048 => 1.7424, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.52% (7.1582 => 37.6180, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.54% (3.4629 => 6.3905, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.93% (0.6222 => 1.0822, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.22% (0.0720 => 7.4392, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11144300.00% (0.0001 => 11.1444, std.dev.: 0.0765) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488300.00% (0.0001 => 5.4884, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.73% (1.1194 => 10.3738, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.32% (22.1758 => 55.5101, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 70.88% (0.1463 => 0.2500, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.60% (2.9384 => 4.6015, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.70% (7.0540 => 10.8418, std.dev.: 0.0071) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 51.02% (0.0394 => 0.0595, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.80% (1.5859 => 2.3915, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.75% (8.1363 => 11.9399, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 41.72% (21.9371 => 31.0894, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.01% (2.2024 => 3.1056, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 38.95% (0.3109 => 0.4320, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0004) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.68% (4.2646 => 5.7011, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.07% (1.5415 => 2.0512, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.55% (0.4615 => 0.6117, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.81% (0.1892 => 0.2456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.63% (0.2271 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.08% (0.4299 => 0.5549, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 28.96% (1.1642 => 1.5014, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.27% (0.6675 => 0.8562, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.86% (0.1143 => 0.1450, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.80% (0.5105 => 0.6473, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.61% (0.0793 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.20% (0.1584 => 0.1999, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 25.80% (0.2554 => 0.3213, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.52% (3.8922 => 4.8853, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.33% (0.1125 => 0.1410, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.75% (1.0722 => 1.3376, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.78% (0.1337 => 0.1655, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.65% (1.4186 => 1.7541, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 22.94% (0.4289 => 0.5273, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.67% (9.4845 => 11.6349, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 22.58% (0.4620 => 0.5663, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.2700 => 0.3298, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.41% (0.7115 => 0.8638, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.51% (1.3050 => 1.5726, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 20.43% (5.7591 => 6.9357, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.38% (0.7835 => 0.9432, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 19.95% (0.3098 => 0.3716, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.83% (4.9449 => 5.9255, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 19.78% (0.6456 => 0.7733, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.49% (0.5860 => 0.7002, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.41% (0.8172 => 0.9758, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 18.95% (3.3354 => 3.9676, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.95% (5.0018 => 5.9495, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.17% (0.2758 => 0.3259, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.81% (0.5020 => 0.5914, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.53% (0.5569 => 0.6545, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 17.49% (0.7433 => 0.8733, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.41% (0.9765 => 1.1465, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.39% (0.3307 => 0.3882, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.3423 => 0.4013, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3871, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 16.91% (3.8723 => 4.5272, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 16.81% (2.0273 => 2.3680, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.77% (0.5981 => 0.6984, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.22% (0.3441 => 0.3999, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.17% (2.2969 => 2.6684, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.08% (0.8101 => 0.9404, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.61% (0.6450 => 0.7457, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 15.32% (0.2049 => 0.2363, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.28% (0.3180 => 0.3666, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 15.26% (0.3283 => 0.3784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.82% (0.3232 => 0.3711, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.61% (0.8921 => 1.0224, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.54% (1.1861 => 1.3585, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.26% (0.8067 => 0.9217, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 13.05% (0.3379 => 0.3820, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.39% (0.3865 => 0.4344, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.34% (1.5603 => 1.7529, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.04% (0.3886 => 0.4354, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.01% (0.4636 => 0.5193, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.97% (0.4103 => 0.4594, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.44% (0.4203 => 0.4684, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.26% (17.1811 => 19.1150, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/bh/bh: 11.16% (0.3092 => 0.3437, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.07% (0.2430 => 0.2699, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.97% (0.4048 => 0.4492, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 10.85% (0.3603 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.80% (0.3694 => 0.4093, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.78% (14.3668 => 15.9152, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.55% (0.3422 => 0.3783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.29% (0.3684 => 0.4063, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.45% (0.4064 => 0.4448, std.dev.: 0.0120) SingleSource/Benchmarks/Stanford/Puzzle: 9.23% (0.1268 => 0.1385, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.79% (0.6030 => 0.6560) SingleSource/Benchmarks/Shootout-C++/strcat: 8.65% (0.2831 => 0.3076, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.25% (63.2438 => 68.4626, std.dev.: 0.0233) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7326 => 0.7930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 8.12% (0.2871 => 0.3104, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.09% (2.0665 => 2.2337, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 7.85% (1.2842 => 1.3850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.79% (0.2877 => 0.3101, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.73% (0.3650 => 0.3932, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.59% (0.3162 => 0.3402, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3935 => 0.4232, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.54% (0.2905 => 0.3124, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.44% (0.2891 => 0.3106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.38% (0.2872 => 0.3084, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: 7.37% (10.3673 => 11.1317, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.22% (0.2756 => 0.2955, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.3052 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.10% (0.2802 => 0.3001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.98% (0.2793 => 0.2988, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.97% (0.2725 => 0.2915, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.76% (0.3136 => 0.3348, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.73% (2.2022 => 2.3503, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.46% (0.4879 => 0.5194, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.89% (0.3177 => 0.3364, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.91% (7.9617 => 8.1935, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2509, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (4.2280 => 4.4553, std.dev.: 0.0099) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.37% (0.9957 => 1.0293, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9190, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.06% (9.1159 => 9.3034, std.dev.: 0.0207) MultiSource/Benchmarks/Olden/bisort/bisort: 2.05% (0.8333 => 0.8504, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7117, std.dev.: 0.0113) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2790, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.36% (1.0785 => 1.0932, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4559, std.dev.: 0.0306) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.60% (5.2763 => 1.1818, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.21% (0.8651 => 0.2145, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.10% (5.3855 => 4.4647, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.66% (5.3526 => 4.4607, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -13.60% (10.4361 => 9.0171, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.79% (1.7609 => 1.6062, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.85% (54.1659 => 49.9135, std.dev.: 0.0336) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.64% (1.9577 => 0.6726, std.dev.: 0.0033) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.83% (10.7105 => 7.4086, std.dev.: 0.0353) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8574, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0055, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7317, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4904, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2985, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.64% (1.2373 => 1.1551, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.95% (8.1563 => 7.7526, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8145, std.dev.: 0.0097) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0071) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.51% (3.6994 => 3.6434, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0018) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 12:23:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 14:23:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112202308.7DE6B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7524?compare_to=7521&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7524, Order: 172320, Start Time: 2013-01-12 18:49:33, End Time: 2013-01-12 20:23:10 To: 7521, Order: 172319, Start Time: 2013-01-12 16:52:45, End Time: 2013-01-12 18:26:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (134 on baseline) Added Tests: 0 (12 on baseline) Existing Failures: 1 (0 on baseline) Unchanged Tests: 1102 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.16% (42.0084 => 42.9178, std.dev.: 0.0970) Existing Failures - Execution Time ---------------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.17% (0.0315 => 0.0703, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.65% (0.6395 => 0.8803, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.62% (0.6395 => 0.8673, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.85% (0.6260 => 0.8379, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.78% (0.5805 => 0.7708, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.59% (0.5688 => 0.7542, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.42% (0.5456 => 0.7225, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.89% (0.6230 => 0.8217, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.73% (0.5575 => 0.7344, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.52% (0.5581 => 0.7340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.51% (0.5567 => 0.7321, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.38% (0.5941 => 0.7805, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.06% (0.5802 => 0.7604, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.71% (0.5705 => 0.7457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.68% (0.6033 => 0.7884, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.33% (0.5859 => 0.7636, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.30% (0.5849 => 0.7621, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.19% (0.5478 => 0.7132, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.07% (0.5570 => 0.7245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.86% (0.5569 => 0.7232, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.78% (0.6440 => 0.8358, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.69% (0.5925 => 0.7684, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.57% (0.5591 => 0.7244, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.73% (0.6052 => 0.7791, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.56% (0.5857 => 0.7530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.52% (0.6189 => 0.7954, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.36% (0.5863 => 0.7526, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.14% (0.6446 => 0.8260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.03% (0.6304 => 0.8071, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.27% (1.6474 => 2.0966, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.82% (0.6194 => 0.7855, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.35% (0.6297 => 0.7956, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.06% (0.6681 => 0.8422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.81% (0.6667 => 0.8321, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.58% (0.7524 => 0.9298, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.81% (0.7339 => 0.9013, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.01% (2.2587 => 2.7107, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.88% (1.1450 => 1.3154, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.06% (0.3357 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.29% (1.6364 => 1.8212, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.19% (4.5069 => 5.0112, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.17% (0.4916 => 0.5465, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 10.74% (0.4515 => 0.5000, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.25% (3.5339 => 3.8962, std.dev.: 0.0122) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2385 => 0.2598, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.03% (0.7021 => 0.7585, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.45% (0.2001 => 0.2150, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.96% (0.5329 => 0.5700, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.90% (1.2515 => 1.3379, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4524 => 0.4827, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4861 => 0.5163, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.16% (9.2283 => 9.7966, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.4642 => 1.5530, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.92% (1.2784 => 1.3541, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3319 => 0.3451, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.68% (0.6750 => 0.6931, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.67% (5.0226 => 5.1565, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.63% (5.4682 => 5.6118, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4186, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.58% (0.8418 => 0.8551, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.3722 => 1.3872, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6693, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9531 => 1.0289, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.47% (5.1955 => 5.4276, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1691, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.46% (54.5751 => 56.4616, std.dev.: 0.1000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.86% (5.9709 => 6.1414) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1055, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2859, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6019, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.19% (10.3489 => 10.4720, std.dev.: 0.0169) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4335 => 4.4801, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.74% (0.1281 => 0.1105, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.08% (0.3837 => 0.3642, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.70% (0.3831 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3880 => 0.3698, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.65% (0.9852 => 0.9394, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.58% (0.3821 => 0.3646, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.52% (0.3891 => 0.3715, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.51% (2.4924 => 2.3801, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.34% (0.4033 => 0.3858, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.14% (0.2849 => 0.2731, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.09% (0.3059 => 0.2934, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.08% (0.3016 => 0.2893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.03% (0.2903 => 0.2786, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -3.80% (0.3025 => 0.2910, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.77% (0.3026 => 0.2912, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.73% (1.3148 => 1.2658, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.71% (0.7198 => 0.6931, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4280 => 0.4123, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.66% (0.9542 => 0.9193, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.52% (0.7779 => 0.7505, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.45% (0.2989 => 0.2886, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.30% (0.6484 => 0.6270, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.21% (0.6441 => 0.6234, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.08% (0.3931 => 0.3810, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -2.84% (0.3621 => 0.3518, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.61% (0.7919 => 0.7712, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2337, std.dev.: 0.0829) SingleSource/Benchmarks/Shootout-C++/moments: -2.47% (0.4248 => 0.4143, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7017, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (14.2083 => 13.8857, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1944, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.25% (6.7716 => 6.6192, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -2.22% (0.7982 => 0.7805, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.18% (1.2210 => 1.1944, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -2.17% (4.3330 => 4.2390, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: -2.12% (16.1920 => 15.8491, std.dev.: 0.0160) MultiSource/Applications/JM/ldecod/ldecod: -1.91% (7.0961 => 6.9609, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.84% (1.2300 => 1.2074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.80% (0.9179 => 0.9014, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -1.66% (2.4021 => 2.3623, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.48% (0.8521 => 0.8395, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.38% (34.0927 => 33.6209, std.dev.: 0.0084) MultiSource/Applications/lua/lua: -1.30% (4.0594 => 4.0065, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -1.24% (1.5610 => 1.5417, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (8.0126 => 7.9286, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.03% (1.8100 => 0.6873, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0300, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.74% (4.3779 => 3.3822, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1314, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1050, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6341, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.07% (4.1534 => 3.8596, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4009, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (7.9763 => 7.7267, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.38% (1.3096 => 1.2784, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.89% (3.7241 => 3.6537, std.dev.: 0.0080) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4637, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.63% (4.8776 => 4.7982, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.61% (1.6307 => 1.6045, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3040 => 7.1954, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.36% (1.6086 => 1.5867, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6009, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7092 => 3.6627, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 13:30:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 15:30:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112213018.261152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7525?compare_to=7522&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7525, Order: 172321, Start Time: 2013-01-12 19:28:16, End Time: 2013-01-12 21:30:22 To: 7522, Order: 172319, Start Time: 2013-01-12 17:10:02, End Time: 2013-01-12 19:08:38 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 20 (7 on baseline) Performance Improvements: 1 (79 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (977 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 5.28% (0.2442 => 0.2571, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.86% (0.8665 => 0.9086, std.dev.: 0.0041) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.19% (1.0435 => 1.0872, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/gs/gs: 2.90% (4.3990 => 4.5267, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.29% (0.6686 => 0.6839, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.71% (1.6938 => 1.7227, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.65% (0.6966 => 0.7081, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 1.57% (0.7881 => 0.8005, std.dev.: 0.0010) MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.23% (1.0642 => 1.0773, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.3669 => 1.3818, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.87% (0.2040 => 0.2221, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.49% (0.3298 => 0.3578, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.36% (15.3606 => 16.6455, std.dev.: 0.3520) SingleSource/Benchmarks/Shootout/ary3: 5.02% (2.1033 => 2.2089, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.60% (21.4775 => 22.4654, std.dev.: 0.0332) SingleSource/Benchmarks/Shootout-C++/except: 3.09% (0.4948 => 0.5101, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 2.41% (0.8418 => 0.8621, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.00% (1.2202 => 1.2446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.23% (3.1165 => 3.1549, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.17% (1.8602 => 1.8819, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.97% (1.4091 => 1.3813, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.57% (1.1251 => 1.1315, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 55.20% (0.0221 => 0.0343, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.70% (0.0432 => 0.0448, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.34% (0.0337 => 0.0355, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.30% (0.0321 => 0.0338, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 55.46% (0.0357 => 0.0555, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/casts: 52.74% (0.0146 => 0.0223, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 8.92% (0.0213 => 0.0232, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.59% (0.1447 => 0.1424, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 5.14% (1.1310 => 1.1891, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.43% (0.3938 => 0.3955, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.71% (0.1465 => 0.1490, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.72% (0.0978 => 0.0985, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.82% (0.0274 => 0.0269, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.79% (0.0543 => 0.0607, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1562 => 1.1476, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -26.67% (0.0030 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0618 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.31% (0.0318 => 0.0319, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7452 => 0.7415, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 111.90% (0.0042 => 0.0089, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7552 => 12.7729, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 63.39% (0.0336 => 0.0549, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321737.50% (0.0008 => 2.5747, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.07% (1.1825 => 2.3540, std.dev.: 0.0423) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.29% (0.2070 => 0.2221, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2160, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/except: 2.22% (0.4990 => 0.5101, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.20% (1.2298 => 1.2446, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.13% (0.0808 => 0.0508, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.01% (0.0727 => 0.0487, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -26.69% (0.1888 => 0.1384, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.20% (0.1009 => 0.0785, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.01% (0.0676 => 0.0534, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -19.41% (1.8964 => 1.5283, std.dev.: 0.1347) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.40% (0.1079 => 0.0902, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.37% (1.0960 => 0.9166, std.dev.: 0.0512) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.42% (0.7686 => 0.6501, std.dev.: 0.0095) MultiSource/Applications/hexxagon/hexxagon: -11.60% (1.1433 => 1.0107, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.59% (6.4235 => 5.6788, std.dev.: 0.2796) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.55% (1.2154 => 1.0872, std.dev.: 0.0084) MultiSource/Applications/lua/lua: -10.21% (4.6406 => 4.1670, std.dev.: 0.0167) MultiSource/Applications/siod/siod: -9.30% (2.6437 => 2.3978, std.dev.: 0.0899) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.68% (1.5131 => 1.3818, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.55% (10.2703 => 9.3920, std.dev.: 0.2265) MultiSource/Applications/sqlite3/sqlite3: -8.51% (17.5634 => 16.0695, std.dev.: 0.2205) MultiSource/Applications/ClamAV/clamscan: -8.25% (17.4365 => 15.9986, std.dev.: 0.0826) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.17% (1.1731 => 1.0773, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.96% (0.7693 => 0.7081, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.88% (1.6874 => 1.5545, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.52% (0.2100 => 0.1942, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -7.49% (0.8653 => 0.8005, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.16% (1.0017 => 0.9300, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.92% (0.2283 => 0.2125, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.83% (0.2709 => 0.2524, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -6.73% (1.3979 => 1.3038, std.dev.: 0.0080) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.57% (0.2618 => 0.2446, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -6.42% (0.4002 => 0.3745, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.29% (0.9550 => 0.8949, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/fibo: -6.18% (0.2006 => 0.1882, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: -5.94% (0.1716 => 0.1614, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.89% (0.7693 => 0.7240, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: -5.61% (0.5134 => 0.4846, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hello: -5.50% (0.1928 => 0.1822, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.2725 => 0.2578, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -5.25% (0.7776 => 0.7368, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.24% (0.3665 => 0.3473, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.24% (0.9588 => 0.9086, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.19% (0.9127 => 0.8653, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.96% (1.8127 => 1.7227, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.87% (0.9403 => 0.8945, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -4.82% (1.4392 => 1.3699, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.71% (0.9091 => 0.8663, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.70% (0.9788 => 0.9328, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.66% (1.0234 => 0.9757, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.60% (0.9507 => 0.9070, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.48% (1.0052 => 0.9602, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.47% (0.8990 => 0.8588, std.dev.: 0.0057) MultiSource/Benchmarks/sim/sim: -3.90% (0.3715 => 0.3570, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.85% (0.2884 => 0.2773, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.32% (0.4762 => 0.4604, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.30% (1.0860 => 1.0502, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.29% (0.9993 => 0.9664, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.93% (0.6996 => 0.6791, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.80% (0.8926 => 0.8676, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.59% (0.5369 => 0.5230, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.42% (0.9612 => 0.9379, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.28% (0.8893 => 0.8690, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.11% (1.0088 => 0.9875, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.04% (0.9998 => 0.9794, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/football/football: -1.95% (0.9759 => 0.9569, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.80% (0.9120 => 0.8956, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: -1.46% (4.5936 => 4.5267, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.35% (0.9564 => 0.9435, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.12% (0.9372 => 0.6455, std.dev.: 0.1096) MultiSource/Applications/minisat/minisat: -22.30% (7.9891 => 6.2075, std.dev.: 0.1766) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.29% (1.0816 => 0.8621, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.26% (0.1164 => 0.0998, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.75% (1.4235 => 1.2563, std.dev.: 0.0607) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/health/health: -6.65% (0.3654 => 0.3411, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.38% (1.4446 => 1.3813, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.99% (23.3986 => 22.4654, std.dev.: 0.0332) MultiSource/Applications/SIBsim4/SIBsim4: -3.30% (3.5443 => 3.4272, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.89% (0.5826 => 0.5716, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.17% (3.1921 => 3.1549, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.08% (1.2047 => 1.1315, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.21% (0.0233 => 0.0343, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.67% (0.0451 => 0.0448, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.90% (0.0394 => 0.0355, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.05% (0.0328 => 0.0338, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 24.72% (0.0445 => 0.0555, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/casts: 4.69% (0.0213 => 0.0223, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 2.20% (0.0227 => 0.0232, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -6.93% (0.1530 => 0.1424, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -38.37% (1.9293 => 1.1891, std.dev.: 0.0396) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.32% (0.4049 => 0.3955, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.32% (0.1510 => 0.1490, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.72% (0.0978 => 0.0985, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.88% (0.0590 => 0.0607, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1476, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0032 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.30% (0.7437 => 0.7415, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.26% (0.0092 => 0.0089, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7781 => 12.7729, std.dev.: 0.0108) Report Time: 0.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 13:32:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 15:32:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130112213257.D124B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7526?compare_to=7517&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7526, Order: 172320, Start Time: 2013-01-12 17:58:00, End Time: 2013-01-12 21:32:59 To: 7517, Order: 172296, Start Time: 2013-01-12 03:38:27, End Time: 2013-01-12 07:16:28 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (179 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.20% (0.5318 => 0.5435, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 1.75% (0.7254 => 0.7381, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 1.48% (0.6879 => 0.6981, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 1.28% (1.2340 => 1.2498, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 1.28% (1.9399 => 1.9647, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.15% (2.2850 => 2.3112, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.09% (2.2580 => 2.2825, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.76% (0.3988 => 0.4098, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.95% (0.0475 => 0.0622, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.92% (0.2969 => 0.3798, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.79% (0.4253 => 0.5435, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.67% (0.1106 => 0.1412, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.26% (0.4139 => 0.5226, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.25% (0.5900 => 0.7449, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.35% (0.4994 => 0.6260, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.31% (0.1620 => 0.2030, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 24.26% (0.0948 => 0.1178, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 23.32% (1.5932 => 1.9647, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.60% (0.1549 => 0.1899, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.13% (0.1003 => 0.1225, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.04% (0.1107 => 0.1351, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.29% (0.3903 => 0.4734, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.49% (0.1462 => 0.1747, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.16% (0.4029 => 0.4801, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.03% (0.1088 => 0.1295, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.87% (0.3890 => 0.4624, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 18.81% (0.5826 => 0.6922, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.63% (0.2866 => 0.3400, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.62% (0.3271 => 0.3880, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.57% (0.2736 => 0.3244, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 18.54% (0.5889 => 0.6981, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 18.49% (0.9697 => 1.1490, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.29% (1.3152 => 1.5557, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 17.90% (0.5546 => 0.6539, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 17.75% (1.8794 => 2.2130, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.69% (0.4658 => 0.5482, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 17.46% (0.7171 => 0.8423, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.28% (3.5627 => 4.1784, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.08% (0.2875 => 0.3366, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.98% (0.1160 => 0.1357, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 16.91% (0.2750 => 0.3215, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.87% (1.6211 => 1.8946, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.73% (0.5026 => 0.5867, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 16.60% (0.2813 => 0.3280, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 16.59% (0.2803 => 0.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (0.2725 => 0.3177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 16.51% (0.2823 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.48% (0.2792 => 0.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 16.43% (0.1284 => 0.1495, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.40% (2.0673 => 2.4064, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 16.38% (0.3004 => 0.3496, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 16.32% (0.9909 => 1.1526, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.32% (0.2911 => 0.3386, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172) SingleSource/Benchmarks/Shootout-C++/matrix: 16.19% (0.2780 => 0.3230, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.00% (4.4195 => 5.1265, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 15.99% (0.3096 => 0.3591, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.95% (23.5202 => 27.2727, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/ary3: 15.95% (0.3267 => 0.3788, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.93% (1.0781 => 1.2498, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.90% (1.9694 => 2.2825, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.76% (1.9966 => 2.3112, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.73% (0.4361 => 0.5047, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3258 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.43% (2.7292 => 3.1504, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 15.43% (0.2566 => 0.2962, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.39% (0.3060 => 0.3531, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.38% (0.3362 => 0.3879, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary2: 15.38% (0.3317 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.25% (0.3678 => 0.4239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.24% (0.3124 => 0.3600, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.19% (4.2109 => 4.8505, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 15.03% (0.3726 => 0.4286, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.87% (0.3282 => 0.3770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.84% (0.3348 => 0.3845, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 14.78% (1.4269 => 1.6378, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.73% (0.3625 => 0.4159, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.68% (0.3446 => 0.3952, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 14.66% (0.4146 => 0.4754, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.58% (0.3690 => 0.4228, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-4: 14.57% (0.3465 => 0.3970, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.56% (0.3469 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.53% (0.3496 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.50% (0.3442 => 0.3941, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.46% (0.3845 => 0.4401, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 14.28% (0.4251 => 0.4858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.27% (0.3981 => 0.4549, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.25% (0.3650 => 0.4170, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.85% (0.1090 => 0.1241, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.83% (0.5012 => 0.5705, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 13.80% (0.7875 => 0.8962, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.57% (0.6435 => 0.7244, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: 12.43% (2.1653 => 2.4344, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.06% (0.2737 => 0.3067, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.04% (5.5417 => 6.2088, std.dev.: 0.0199) MultiSource/Applications/SIBsim4/SIBsim4: 11.97% (0.2691 => 0.3013, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 11.86% (0.2075 => 0.2321, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 11.83% (2.1013 => 2.3498, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 11.75% (4.6177 => 5.1603, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 11.33% (0.3336 => 0.3714, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.09% (0.3084 => 0.3426, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.03% (0.2068 => 0.2296, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.46% (0.2103 => 0.2323, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.30% (0.5361 => 0.5913, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.01% (11.6398 => 12.8052, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (0.4847 => 0.5328, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.75% (0.2040 => 0.2239, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.40% (0.1383 => 0.1513, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.20% (0.7426 => 0.8109, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.09% (4.6926 => 5.1192, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.82% (0.2391 => 0.2578, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 7.70% (2.0346 => 2.1912, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.56% (0.5584 => 0.6006, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 7.08% (11.9555 => 12.8020, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.20% (0.3792 => 0.3989, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5378, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.97% (0.3693 => 0.4098, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.2802 => 0.3053, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2387, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6811, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8900, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1976, std.dev.: 0.0141) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3132, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0042) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0821, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2074, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.10% (10.3705 => 10.4850, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5818, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5699, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.13% (17.2379 => 14.2844, std.dev.: 0.0561) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -7.91% (0.2402 => 0.2212, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8036, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2313, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7987, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1278, std.dev.: 0.0796) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5790, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1734, std.dev.: 0.0345) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0427, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 14:19:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 16:19:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130112221951.CBC7C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7527?compare_to=7524&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7527, Order: 172325, Start Time: 2013-01-12 20:46:22, End Time: 2013-01-12 22:19:54 To: 7524, Order: 172320, Start Time: 2013-01-12 18:49:33, End Time: 2013-01-12 20:23:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== New Passes: 1 (0 on baseline) Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (134 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.38% (0.3651 => 0.3811, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.61% (0.6395 => 0.8800, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.76% (0.6395 => 0.8682, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.72% (0.6260 => 0.8371, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.77% (0.5688 => 0.7552, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.70% (0.5805 => 0.7703, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.66% (0.5456 => 0.7238, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.07% (0.6230 => 0.8228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.64% (0.5575 => 0.7339, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.54% (0.5941 => 0.7815, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.54% (0.5581 => 0.7341, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.53% (0.5567 => 0.7322, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.01% (0.5802 => 0.7601, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.70% (0.6033 => 0.7885, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.67% (0.5705 => 0.7455, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.47% (0.5849 => 0.7631, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.21% (0.5478 => 0.7133, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.09% (0.5570 => 0.7246, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.88% (0.6440 => 0.8364, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.79% (0.5569 => 0.7228, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.65% (0.5591 => 0.7249, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.60% (0.5925 => 0.7679, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.75% (0.6052 => 0.7792, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.57% (0.6189 => 0.7957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.55% (0.5863 => 0.7537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.51% (0.5857 => 0.7527, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.22% (0.6446 => 0.8265, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.08% (0.6304 => 0.8074, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.45% (1.6474 => 2.0996, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.88% (0.6194 => 0.7859, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.35% (0.6297 => 0.7956, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.31% (0.6660 => 0.8412, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.27% (0.6681 => 0.8436, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.76% (0.6667 => 0.8318, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.58% (0.7524 => 0.9298, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.62% (0.7339 => 0.8999, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.17% (2.2587 => 2.7142, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.99% (1.1450 => 1.3166, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.03% (0.3357 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.38% (1.6364 => 1.8226, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.26% (4.5069 => 5.0142, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.07% (0.4916 => 0.5460, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.76% (0.4515 => 0.5001, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.32% (3.5339 => 3.8985, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.97% (0.2385 => 0.2599, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.26% (0.7021 => 0.7601, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.50% (0.2001 => 0.2151, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.92% (0.5329 => 0.5698, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.75% (1.2515 => 1.3360, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 6.70% (0.4524 => 0.4827, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.53% (0.1731 => 0.1844, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4861 => 0.5162, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (9.2283 => 9.7961, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.08% (1.4642 => 1.5532, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.93% (1.2784 => 1.3542, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.66% (5.0226 => 5.1562, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.59% (5.4682 => 5.6100, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.3864 => 1.4178, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.69% (0.8418 => 0.8560, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.9557 => 0.9670, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (22.4056 => 22.6482, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.3722 => 1.3864, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6708, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9531 => 1.0278, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1676, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6312, std.dev.: 0.0387) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1079, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2853, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6011, std.dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4781, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.24% (0.3837 => 0.3636, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.76% (0.3821 => 0.3639, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3812 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (0.9852 => 0.9400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.59% (0.3880 => 0.3702, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.57% (0.3896 => 0.3718, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.56% (2.4924 => 2.3787) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.51% (0.3323 => 0.3173, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.4033 => 0.3852, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.47% (0.3891 => 0.3717, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.45% (0.4176 => 0.3990, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.27% (0.2903 => 0.2779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.21% (0.2849 => 0.2729, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.14% (0.3016 => 0.2891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.12% (0.3205 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.02% (0.2933 => 0.2815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.99% (2.1713 => 2.0846, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.95% (0.4199 => 0.4033, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.95% (0.2939 => 0.2823, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.84% (1.3148 => 1.2643, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -3.80% (0.3025 => 0.2910, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.70% (0.7198 => 0.6932, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4280 => 0.4123, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (0.9542 => 0.9196, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/strcat: -3.51% (0.2989 => 0.2884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.37% (0.4151 => 0.4011, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: -3.29% (0.6441 => 0.6229, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.15% (0.3931 => 0.3807, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.91% (20.7746 => 20.1702, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.87% (0.4321 => 0.4197, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.83% (0.3849 => 0.3740, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.83% (0.7779 => 0.7559, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.75% (0.7919 => 0.7701, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.62% (0.4427 => 0.4311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.47% (0.4248 => 0.4143, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.34% (4.3330 => 4.2318, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.32% (6.7716 => 6.6143, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.26% (1.2221 => 1.1945, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -2.24% (0.7982 => 0.7803, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.24% (17.1032 => 16.7208, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8907, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (1.2210 => 1.1949, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.10% (1.0544 => 1.0323, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: -2.06% (16.1920 => 15.8581, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9613, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.87% (1.2300 => 1.2070, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -1.74% (2.4021 => 2.3603, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.46% (34.0927 => 33.5947, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: -1.42% (1.5610 => 1.5388, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -1.20% (4.0594 => 4.0107, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.03% (8.0126 => 7.9301, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.85% (1.8100 => 0.6724, std.dev.: 0.0275) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.88% (1.3643 => 1.0248, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7568, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0370, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.37% (2.5106 => 2.1246, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (7.9763 => 7.7262, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.76% (1.3096 => 1.2735, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/ary3: -2.33% (3.7241 => 3.6374, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4675, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.48% (4.8776 => 4.8053, std.dev.: 0.0071) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1981, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.15% (1.6307 => 1.6120, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6680, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 14:32:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 16:32:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130112223224.9A5152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7528?compare_to=7523&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7528, Order: 172323, Start Time: 2013-01-12 20:21:35, End Time: 2013-01-12 22:32:26 To: 7523, Order: 172320, Start Time: 2013-01-12 17:40:55, End Time: 2013-01-12 19:51:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 1 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/UnitTests/SignlessTypes/factor SingleSource/UnitTests/SignlessTypes/factor: - (0.0002 => 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.47% (81.2719 => 80.0789, std.dev.: 0.3750) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8581 => 499.8398, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 44223.83% (1.1277 => 499.8398, std.dev.: 0.0084) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.44% (0.5229 => 1.6442, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 19.72% (14.9895 => 17.9460, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 43.36% (14.1553 => 20.2937, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: 17.76% (4.1105 => 4.8404, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.73% (1.1048 => 1.7426, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.53% (7.1582 => 37.6186, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.62% (3.4629 => 6.3931, std.dev.: 0.0123) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.03% (0.6222 => 1.0828, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10230.14% (0.0720 => 7.4377, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3835100.00% (0.0001 => 3.8352, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11171700.00% (0.0001 => 11.1718, std.dev.: 0.0415) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0346) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.06% (1.1194 => 10.3551, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787) MultiSource/Applications/ClamAV/clamscan: 150.36% (22.1758 => 55.5186, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.20% (0.0929 => 0.1767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.92% (2.9384 => 4.6110, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.73% (7.0540 => 10.8440, std.dev.: 0.0024) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.85% (1.5859 => 2.3924, std.dev.: 0.0095) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.79% (8.1363 => 11.9430, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 41.80% (21.9371 => 31.1063, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.14% (2.2024 => 3.1085, std.dev.: 0.0311) MultiSource/Applications/sgefa/sgefa: 38.95% (0.3109 => 0.4320, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.69% (4.2646 => 5.7014, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.25% (1.5415 => 2.0541, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.50% (0.4615 => 0.6115, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.92% (0.1892 => 0.2458, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.68% (0.2271 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.19% (0.4299 => 0.5554, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 28.91% (1.1642 => 1.5008, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.51% (0.6675 => 0.8578, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.86% (0.1143 => 0.1450, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.80% (0.5105 => 0.6473, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 25.92% (0.2554 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 25.87% (0.1175 => 0.1479, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.52% (3.8922 => 4.8855, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409) MultiSource/Applications/lemon/lemon: 24.74% (1.0722 => 1.3375, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.71% (1.4186 => 1.7549, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 22.92% (0.4289 => 0.5272, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.67% (9.4845 => 11.6345, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash2: 22.64% (0.4620 => 0.5666, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.60% (0.1695 => 0.2078, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.07% (0.2700 => 0.3296, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 21.64% (0.7115 => 0.8655, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.90% (0.0842 => 0.1018, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.55% (0.7835 => 0.9445, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 20.48% (5.7591 => 6.9387, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.42% (1.3050 => 1.5715, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.24% (0.1695 => 0.2038, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.15% (0.1940 => 0.2331, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 19.82% (0.3098 => 0.3712, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 19.81% (0.6456 => 0.7735, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.73% (4.9449 => 5.9207, std.dev.: 0.0040) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.57% (0.5860 => 0.7007, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.52% (0.0953 => 0.1139, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.42% (0.8172 => 0.9759, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.96% (3.3354 => 3.9679, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.93% (5.0018 => 5.9487, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.13% (0.2758 => 0.3258, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.87% (0.5020 => 0.5917, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 17.57% (0.7433 => 0.8739, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.5569 => 0.6541, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.42% (0.3307 => 0.3883, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.41% (0.9765 => 1.1465, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.28% (0.2107 => 0.2471, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.17% (1.1840 => 1.3873, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 16.96% (3.8723 => 4.5291, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 16.85% (2.0273 => 2.3690, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.77% (0.5981 => 0.6984, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.31% (0.0834 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.08% (2.2969 => 2.6663, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.04% (0.8101 => 0.9400, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.60% (0.6450 => 0.7456, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 15.37% (0.2049 => 0.2364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.32% (0.3283 => 0.3786, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 15.28% (0.3180 => 0.3666, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.79% (0.3232 => 0.3710, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.67% (0.8921 => 1.0230, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.67% (1.1861 => 1.3601, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.21% (0.8067 => 0.9213, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 13.02% (0.3379 => 0.3819, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 12.99% (0.3387 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.63% (0.3865 => 0.4353, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.45% (1.5603 => 1.7546, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 12.25% (0.3927 => 0.4408, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.97% (0.3886 => 0.4351, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.89% (0.4103 => 0.4591, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.82% (0.4636 => 0.5184, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 11.34% (0.3828 => 0.4262, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.25% (0.4203 => 0.4676, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.20% (17.1811 => 19.1047, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/bh/bh: 11.16% (0.3092 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: 10.97% (0.4048 => 0.4492, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.90% (0.3561 => 0.3949, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.77% (14.3668 => 15.9148, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.74% (0.3427 => 0.3795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.71% (0.3603 => 0.3989, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.64% (0.3422 => 0.3786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.23% (0.3684 => 0.4061, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.35% (0.4064 => 0.4444, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 9.23% (0.1268 => 0.1385, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.76% (0.2831 => 0.3079, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.71% (0.6030 => 0.6555, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference: 8.29% (0.7326 => 0.7933, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 8.24% (63.2438 => 68.4547, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.12% (2.0665 => 2.2343, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 8.05% (0.2871 => 0.3102, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.93% (1.2842 => 1.3860, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2877 => 0.3102, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.62% (0.3935 => 0.4235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.54% (0.2891 => 0.3109, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.54% (0.2905 => 0.3124, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.53% (0.3162 => 0.3400, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 7.36% (10.3673 => 11.1301, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.28% (0.2872 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.18% (0.2756 => 0.2954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.18% (0.3052 => 0.3271, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.07% (0.2802 => 0.3000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.91% (0.2793 => 0.2986, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.82% (0.3136 => 0.3350, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.82% (0.2714 => 0.2899, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.67% (2.2022 => 2.3491, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.33% (0.4879 => 0.5188, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3817 => 0.3950, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (7.9617 => 8.1959, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2509, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4523, std.dev.: 0.0130) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0189) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.25% (0.9957 => 1.0281, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.67% (3.6395 => 3.7366, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.49% (8.6802 => 8.8967, std.dev.: 0.0186) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2916, std.dev.: 0.0033) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2792, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4517, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.62% (5.2763 => 1.1810, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.19% (0.8651 => 0.2146, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (5.3855 => 4.4664, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.69% (5.3526 => 4.4591, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -13.60% (10.4361 => 9.0169, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.78% (1.7609 => 1.6063, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9028, std.dev.: 0.0480) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.71% (1.9577 => 0.6712, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.12% (8.0499 => 5.3034, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4247, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8637, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.13% (3.1443 => 2.7316, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4925, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2915, std.dev.: 0.0303) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7027, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: -6.95% (1.2373 => 1.1513, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.83% (8.1563 => 7.7624, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.25% (10.2830 => 9.8462, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: -1.63% (3.6994 => 3.6391, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.45% (3.7221 => 3.6682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.27% (6.2999 => 6.2202, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8597, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 15:48:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 17:48:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130112234836.B27552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7529?compare_to=7525&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7529, Order: 172326, Start Time: 2013-01-12 21:47:57, End Time: 2013-01-12 23:48:36 To: 7525, Order: 172321, Start Time: 2013-01-12 19:28:16, End Time: 2013-01-12 21:30:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 2 (6 on baseline) Performance Improvements: 6 (56 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1055 (1001 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 4.84% (4.1471 => 4.3478, std.dev.: 0.0505) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.37% (2.6479 => 2.7637, std.dev.: 0.0303) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -12.17% (0.1183 => 0.1039, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -4.60% (0.2305 => 0.2199, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -1.00% (2.1883 => 2.1664, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -3.68% (8.4256 => 8.1155, std.dev.: 0.0757) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.33% (5.8994 => 5.8210, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.16% (4.4094 => 4.3582, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.53% (1.1315 => 1.1255, std.dev.: 0.0245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.69% (0.0343 => 0.0224, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.90% (0.0448 => 0.0435, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.51% (0.0355 => 0.0339, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.33% (0.0338 => 0.0320, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -22.16% (0.0555 => 0.0432, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/casts: -4.93% (0.0223 => 0.0212, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -4.31% (0.0232 => 0.0222, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.32% (0.1424 => 0.1457, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -4.75% (1.1891 => 1.1326, std.dev.: 0.0260) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.02% (0.3955 => 0.4193, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.07% (0.1490 => 0.1474, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.34% (0.0985 => 0.1008, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.97% (0.0269 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.32% (0.0607 => 0.0615, std.dev.: 0.0131) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1476 => 1.1504, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 36.36% (0.0022 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.81% (0.0615 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.51% (0.0319 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.15% (0.7415 => 0.7330, std.dev.: 0.0118) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.20% (0.0089 => 0.0123, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7729 => 12.7633, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 44.94% (0.0336 => 0.0487, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322137.50% (0.0008 => 2.5779, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.54% (1.1825 => 2.3832, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.94% (0.2562 => 0.2868, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.34% (4.1668 => 4.3478, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/pi: 3.57% (2.1390 => 2.2153, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.75% (0.0808 => 0.0503, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0067) SingleSource/Benchmarks/SmallPT/smallpt: -26.64% (0.1888 => 0.1385, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0135) MultiSource/Applications/hbd/hbd: -19.91% (1.8964 => 1.5188, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.53% (0.1009 => 0.0822, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.46% (0.0676 => 0.0558, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -13.82% (1.0220 => 0.8808, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: -13.66% (1.5979 => 1.3796, std.dev.: 0.0074) MultiSource/Applications/treecc/treecc: -12.36% (2.4719 => 2.1664, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -12.34% (0.1378 => 0.1208, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -12.18% (1.1433 => 1.0041, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.79% (6.4235 => 5.6662, std.dev.: 0.2591) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.28% (1.2154 => 1.0783, std.dev.: 0.0179) MultiSource/Applications/lua/lua: -10.67% (4.6406 => 4.1453, std.dev.: 0.0507) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.72% (1.5131 => 1.3661, std.dev.: 0.0443) MultiSource/Applications/sqlite3/sqlite3: -9.70% (17.5634 => 15.8591, std.dev.: 0.6396) MultiSource/Applications/sgefa/sgefa: -9.59% (0.3598 => 0.3253, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -9.54% (2.6437 => 2.3915, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: -8.82% (17.4365 => 15.8988, std.dev.: 0.1894) MultiSource/Applications/lambda-0_1_3/lambda: -8.70% (0.8653 => 0.7900, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.52% (0.2372 => 0.2170, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.06% (0.6885 => 0.6330, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/fibo: -7.73% (0.2006 => 0.1851, std.dev.: 0.0037) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.55% (1.1731 => 1.0845, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.21% (0.2481 => 0.2302, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.14% (1.0017 => 0.9302, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout-C++/moments: -6.95% (0.4002 => 0.3724, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: -6.80% (0.1824 => 0.1700, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -6.79% (3.7840 => 3.5271, std.dev.: 0.0117) MultiSource/Applications/lemon/lemon: -6.40% (1.3979 => 1.3085, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.33% (0.3462 => 0.3243, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/lists: -5.98% (0.2725 => 0.2562, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: -5.68% (0.2551 => 0.2406, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.48% (0.3665 => 0.3464, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.46% (1.3310 => 1.2583, std.dev.: 0.0266) MultiSource/Applications/SIBsim4/SIBsim4: -5.05% (1.4392 => 1.3665, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.64% (1.3220 => 1.2607, std.dev.: 0.0225) MultiSource/Applications/SPASS/SPASS: -4.44% (16.4479 => 15.7173, std.dev.: 0.0307) MultiSource/Applications/oggenc/oggenc: -2.80% (5.3553 => 5.2055, std.dev.: 0.0233) MultiSource/Applications/JM/ldecod/ldecod: -2.59% (7.3529 => 7.1628, std.dev.: 0.0261) MultiSource/Applications/JM/lencod/lencod: -1.80% (16.7012 => 16.4001, std.dev.: 0.0211) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.26% (7.9891 => 6.2111, std.dev.: 0.6768) SingleSource/Benchmarks/Shootout/hash: -11.01% (4.5259 => 4.0278, std.dev.: 0.1463) MultiSource/Applications/SPASS/SPASS: -10.47% (9.0650 => 8.1155, std.dev.: 0.0757) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.19% (1.4588 => 1.3102, std.dev.: 0.0231) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.96% (0.3217 => 0.2961, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: -5.99% (1.4244 => 1.3391, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.41% (23.3986 => 22.1333, std.dev.: 0.3568) MultiSource/Applications/SIBsim4/SIBsim4: -3.50% (3.5443 => 3.4202, std.dev.: 0.0200) SingleSource/Benchmarks/McGill/chomp: -3.44% (1.0425 => 1.0066, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: -3.38% (17.2182 => 16.6370, std.dev.: 0.0521) MultiSource/Applications/sqlite3/sqlite3: -2.74% (4.4730 => 4.3503, std.dev.: 0.0378) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.0082 => 2.9561, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: -1.47% (0.8521 => 0.8396, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.44% (5.9063 => 5.8210, std.dev.: 0.0301) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.57% (1.2047 => 1.1255, std.dev.: 0.0245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/casts: -0.47% (0.0213 => 0.0212, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.77% (0.1530 => 0.1457, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -41.29% (1.9293 => 1.1326, std.dev.: 0.0260) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.56% (0.4049 => 0.4193, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.38% (0.1510 => 0.1474, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.07% (0.0978 => 0.1008, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0590 => 0.0615, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.97% (1.1617 => 1.1504, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.44% (0.7437 => 0.7330, std.dev.: 0.0118) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7633, std.dev.: 0.0063) Report Time: 2.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 16:16:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 18:16:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113001637.E50442A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7530?compare_to=7527&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7530, Order: 172331, Start Time: 2013-01-12 22:43:05, End Time: 2013-01-13 00:16:34 To: 7527, Order: 172325, Start Time: 2013-01-12 20:46:22, End Time: 2013-01-12 22:19:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (96 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.49% (0.3811 => 0.3982, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.69% (0.6724 => 0.6905, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.57% (0.0717 => 0.1180, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.73% (0.0974 => 0.1546, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 44.33% (0.1500 => 0.2165, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.19% (0.6395 => 0.8773, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.69% (0.1132 => 0.1536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.22% (0.6395 => 0.8647, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.34% (0.6260 => 0.8347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.23% (0.5805 => 0.7676, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.21% (0.5688 => 0.7520, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.02% (0.5456 => 0.7203, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.57% (0.6230 => 0.8197, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.16% (0.5581 => 0.7320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.13% (0.5567 => 0.7300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.12% (0.5575 => 0.7310, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.40% (0.5802 => 0.7566, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.28% (0.6033 => 0.7860, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.18% (0.5705 => 0.7427, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.02% (0.5849 => 0.7605, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.85% (0.5859 => 0.7608, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.77% (0.5478 => 0.7109, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.64% (0.5570 => 0.7221, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.38% (0.6440 => 0.8332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.25% (0.5569 => 0.7198, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.05% (0.5591 => 0.7215, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.16% (0.6052 => 0.7756, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.14% (0.5857 => 0.7505, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.11% (0.5863 => 0.7511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.02% (0.6189 => 0.7923, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.95% (0.6676 => 0.8542, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.66% (0.6446 => 0.8229, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.52% (0.6304 => 0.8039, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.92% (1.6474 => 2.0909, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.28% (0.6194 => 0.7822, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.95% (0.6660 => 0.8388, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.82% (0.6297 => 0.7923, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.82% (0.6681 => 0.8406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.21% (0.6667 => 0.8281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.17% (0.7524 => 0.9267, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.35% (0.7339 => 0.8979, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.68% (2.2587 => 2.7032, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.59% (1.1450 => 1.3121, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 13.82% (0.3357 => 0.3821, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.01% (0.1982 => 0.2220, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.23% (1.6364 => 1.8201, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.02% (4.5069 => 5.0034, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4916 => 0.5453, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.52% (0.4515 => 0.4990, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.91% (3.5339 => 3.8840, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2385 => 0.2597, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.79% (0.7021 => 0.7568, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.72% (0.4524 => 0.4828, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 6.66% (1.2515 => 1.3349, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.51% (0.5329 => 0.5676, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (9.2283 => 9.7895, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4861 => 0.5154, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.4642 => 1.5485, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.69% (1.2784 => 1.3512, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.86% (0.3834 => 0.3982, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.86% (0.3319 => 0.3447, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6750 => 0.6923, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.21% (5.4682 => 5.5891, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 2.11% (5.0226 => 5.1287, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: 1.60% (0.8418 => 0.8553, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6679, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4408, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5640, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1093, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2856, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6054, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.37% (10.3489 => 10.4911, std.dev.: 0.0452) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4788, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.98% (0.2428 => 0.2307, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.91% (0.9852 => 0.9368, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.89% (0.3821 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.81% (2.4924 => 2.3725, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.49% (0.3142 => 0.3001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.19% (0.3057 => 0.2929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.07% (0.7198 => 0.6905, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.98% (0.3016 => 0.2896, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3831 => 0.3680, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: -3.93% (0.3812 => 0.3662, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.90% (0.2849 => 0.2738, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.87% (0.3848 => 0.3699, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: -3.87% (0.3205 => 0.3081, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.87% (0.3880 => 0.3730, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.85% (0.2933 => 0.2820, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (0.9542 => 0.9176, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.83% (0.3658 => 0.3518, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.81% (0.2939 => 0.2827, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.80% (1.3148 => 1.2649, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/for-in: -3.79% (0.4033 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.78% (2.1713 => 2.0893, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.76% (0.3059 => 0.2944, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.76% (0.3884 => 0.3738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.73% (0.3026 => 0.2913, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.70% (0.3891 => 0.3747, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.69% (0.4176 => 0.4022, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.42% (0.4151 => 0.4009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.33% (0.4199 => 0.4059, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.21% (0.3931 => 0.3805, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.01% (0.4280 => 0.4151, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.94% (0.7919 => 0.7686, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -2.94% (20.7746 => 20.1641, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.81% (0.3849 => 0.3741, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.69% (0.4427 => 0.4308, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -2.64% (4.3330 => 4.2187, std.dev.: 0.0044) MultiSource/Applications/lambda-0_1_3/lambda: -2.49% (0.7982 => 0.7783, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.45% (14.2083 => 13.8595, std.dev.: 0.0149) MultiSource/Applications/sqlite3/sqlite3: -2.45% (17.1032 => 16.6837, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/Hello: -2.39% (0.6347 => 0.6195, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.38% (1.0544 => 1.0293, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.38% (6.7716 => 6.6106, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.34% (1.2210 => 1.1924, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.34% (1.2221 => 1.1935, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: -2.30% (0.6441 => 0.6293, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -2.20% (16.1920 => 15.8362, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: -2.16% (0.7779 => 0.7611, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2041, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -2.09% (0.9179 => 0.8987, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -2.09% (7.0961 => 6.9478, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.03% (2.4021 => 2.3533, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.72% (0.5999 => 0.5896, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -1.46% (4.0594 => 4.0002, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: -1.46% (34.0927 => 33.5956, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: -1.07% (18.2933 => 18.0968, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.06% (8.0126 => 7.9276, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: -1.01% (15.2527 => 15.0987, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.85% (1.8100 => 0.6905, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3112, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2411, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0307, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2077, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1295, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3391, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4009, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7285, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.42% (1.3096 => 1.2779, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/ary3: -2.37% (3.7241 => 3.6359, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6060, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1935, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.47% (4.8776 => 4.8061, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5884, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 17:13:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 19:13:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113011308.C4AD52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7531?compare_to=7528&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7531, Order: 172331, Start Time: 2013-01-12 23:02:25, End Time: 2013-01-13 01:13:06 To: 7528, Order: 172323, Start Time: 2013-01-12 20:21:35, End Time: 2013-01-12 22:32:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.54% (1.2893 => 1.3091, std.dev.: 0.0049) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8398 => 499.8341, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.32% (1.1277 => 499.8341, std.dev.: 0.0102) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.50% (0.5229 => 1.6445, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 19.72% (14.9895 => 17.9447, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 43.34% (14.1553 => 20.2902, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: 17.67% (4.1105 => 4.8367, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.65% (1.1048 => 1.7417, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.05% (7.1582 => 37.5122, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.75% (3.4629 => 6.3978, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.16% (0.6222 => 1.0836, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.78% (0.0720 => 7.4396, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 11158900.00% (0.0001 => 11.1590, std.dev.: 0.0071) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486000.00% (0.0001 => 5.4861, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.11% (1.1194 => 10.3781, std.dev.: 0.0069) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.45% (22.1758 => 55.5403, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.42% (0.0929 => 0.1769, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 70.68% (0.1463 => 0.2497, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.63% (2.9384 => 4.6025, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.68% (7.0540 => 10.8407, std.dev.: 0.0062) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.84% (1.5859 => 2.3921, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.61% (8.1363 => 11.9283, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 41.25% (21.9371 => 30.9869, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.15% (2.2024 => 3.1086, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 39.11% (0.3109 => 0.4325, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0002) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.63% (4.2646 => 5.6988, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.28% (1.5415 => 2.0545, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.55% (0.4615 => 0.6117, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.63% (0.2271 => 0.2944, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.39% (0.1892 => 0.2448, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.12% (0.4299 => 0.5551, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 28.83% (1.1642 => 1.4998, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.39% (0.6675 => 0.8570, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.03% (0.1143 => 0.1452, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.80% (0.5105 => 0.6473, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.65% (0.2554 => 0.3209, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 25.62% (0.1175 => 0.1476, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.43% (3.8922 => 4.8819, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.07% (0.1125 => 0.1407, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.57% (1.0722 => 1.3356, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.09% (0.3121 => 0.3873, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.59% (1.4186 => 1.7532, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 23.11% (0.4289 => 0.5280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 22.77% (0.4620 => 0.5672, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.63% (9.4845 => 11.6305, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.42% (0.1695 => 0.2075, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.89% (0.2700 => 0.3291, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.59% (0.7115 => 0.8651, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.1236 => 0.1499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.16% (0.1555 => 0.1884, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.40% (1.3050 => 1.5712, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 20.36% (0.7835 => 0.9430, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.28% (5.7591 => 6.9269, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 20.17% (0.3098 => 0.3723, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.98% (0.1151 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.76% (4.9449 => 5.9221, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: 19.70% (0.6456 => 0.7728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.40% (0.5860 => 0.6997, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.25% (0.8172 => 0.9745, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9436, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 18.81% (3.3354 => 3.9627, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.93% (0.5020 => 0.5920, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.71% (0.5569 => 0.6555, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 17.54% (0.7433 => 0.8737, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.45% (0.3307 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.41% (0.9765 => 1.1465, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.3423 => 0.4018, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.2107 => 0.2469, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.10% (1.1840 => 1.3865, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.88% (3.8723 => 4.5258, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 16.75% (2.0273 => 2.3669, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.11% (0.8101 => 0.9406, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.09% (0.1044 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.07% (0.3441 => 0.3994, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 15.93% (2.2969 => 2.6627, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.69% (0.6450 => 0.7462, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.50% (0.3283 => 0.3792, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 15.23% (0.2049 => 0.2361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3232 => 0.3717, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.48% (1.1861 => 1.3579, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.8921 => 1.0211, std.dev.: 0.0055) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.01% (0.8067 => 0.9197, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 13.20% (0.3379 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.63% (0.3865 => 0.4353, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.57% (1.5603 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.26% (0.4103 => 0.4606, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.14% (0.4636 => 0.5199, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.49% (0.4203 => 0.4686, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.34% (0.3473 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.26% (0.3543 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.21% (0.3497 => 0.3889, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 11.21% (0.3543 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.18% (0.3561 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.13% (0.3694 => 0.4105, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.12% (17.1811 => 19.0924, std.dev.: 0.0187) SingleSource/UnitTests/ObjC/exceptions-3: 11.12% (0.3516 => 0.3907, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 11.09% (0.4048 => 0.4497, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.96% (0.3603 => 0.3998, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.88% (0.3282 => 0.3639, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 10.70% (0.3422 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.57% (14.3668 => 15.8851, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/lists1: 10.53% (0.3684 => 0.4072, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.42% (0.3427 => 0.3784, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3826 => 0.4218, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.70% (0.1268 => 0.1391, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.62% (0.4064 => 0.4455, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 8.94% (0.2831 => 0.3084, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.37% (2.0665 => 2.2395, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 8.32% (0.2871 => 0.3110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7326 => 0.7934, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 8.17% (0.2877 => 0.3112, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.08% (0.3650 => 0.3945, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.07% (63.2438 => 68.3484, std.dev.: 0.0118) MultiSource/Applications/hexxagon/hexxagon: 7.99% (1.2842 => 1.3868, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.87% (0.3162 => 0.3411, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.85% (0.3935 => 0.4244, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.71% (0.2905 => 0.3129, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.64% (0.2891 => 0.3112, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2872 => 0.3087, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.40% (0.2756 => 0.2960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 7.37% (0.3052 => 0.3277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.32% (0.2802 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.16% (0.2793 => 0.2993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.07% (0.2714 => 0.2906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.95% (0.3136 => 0.3354, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 6.95% (10.3673 => 11.0877, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.62% (2.2022 => 2.3479, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3817 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.92% (7.9617 => 8.1944, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2490, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4471, std.dev.: 0.0114) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3112, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.40% (0.9957 => 1.0296, std.dev.: 0.0087) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9077, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (3.6395 => 3.7241, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.97% (9.1159 => 9.2951, std.dev.: 0.0250) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.80% (0.8333 => 0.8483, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2784, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.64% (5.2763 => 1.1796, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -75.21% (0.8651 => 0.2145, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.28% (5.3855 => 4.4550, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.99% (5.3526 => 4.4434, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -13.77% (10.4361 => 8.9987, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.68% (1.7609 => 1.6080, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9178, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.38% (1.9577 => 0.6778, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5624, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.66% (1.5373 => 1.0198, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4310, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8607, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.30% (2.6546 => 2.0095, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4916, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2804, std.dev.: 0.0930) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.02% (1.2373 => 1.1628, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.22% (8.1563 => 7.7305, std.dev.: 0.0138) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.01% (0.4808 => 0.4567, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5071, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/salsa20: -4.64% (10.2830 => 9.8059, std.dev.: 0.0159) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0115) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.82% (3.6994 => 3.6319, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3303, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.51% (3.7221 => 3.6660, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0021) Report Time: 4.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 18:04:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 20:04:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130113020415.67FFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7532?compare_to=7526&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7532, Order: 172326, Start Time: 2013-01-12 22:28:28, End Time: 2013-01-13 02:04:10 To: 7526, Order: 172320, Start Time: 2013-01-12 17:58:00, End Time: 2013-01-12 21:32:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (179 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.55% (0.0714 => 0.0925, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.86% (0.5900 => 0.7485, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.26% (0.4139 => 0.5226, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.24% (0.4253 => 0.5369, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.22% (0.1106 => 0.1396, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.80% (0.1620 => 0.2038, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.79% (0.4994 => 0.6282, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.43% (0.0822 => 0.1031, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 24.26% (0.0948 => 0.1178, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.54% (0.5000 => 0.6177, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.21% (0.1103 => 0.1359, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 23.14% (1.5932 => 1.9619, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.97% (0.0897 => 0.1103, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.69% (0.1604 => 0.1968, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.37% (0.1549 => 0.1880, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.11% (0.3903 => 0.4727, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 21.06% (0.1619 => 0.1960, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.28% (0.3890 => 0.4640, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 19.24% (0.4029 => 0.4804, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.1160 => 0.1383, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 19.13% (0.1218 => 0.1451, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.12% (0.1088 => 0.1296, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.69% (0.0808 => 0.0959, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.55% (1.3152 => 1.5592, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 18.54% (0.5826 => 0.6906, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.2866 => 0.3397, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.46% (0.2736 => 0.3241, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 18.31% (0.9697 => 1.1473, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 18.29% (0.5889 => 0.6966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.10% (0.3271 => 0.3863, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.93% (0.5026 => 0.5927, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 17.86% (1.8794 => 2.2150, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 17.85% (0.5546 => 0.6536, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.84% (0.2875 => 0.3388, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.65% (0.4658 => 0.5480, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: 17.39% (0.2714 => 0.3186, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.35% (0.2738 => 0.3213, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/fibo: 17.25% (0.2725 => 0.3195, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 17.24% (0.2813 => 0.3298, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.23% (3.5627 => 4.1766, std.dev.: 0.0114) SingleSource/Regression/C++/ofstream_ctor: 17.21% (0.3004 => 0.3521, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: 17.17% (0.7171 => 0.8402, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.07% (0.1968 => 0.2304, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.04% (0.2729 => 0.3194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.94% (0.2792 => 0.3265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.90% (0.2823 => 0.3300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.87% (0.2911 => 0.3402, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.84% (0.9909 => 1.1578, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.77% (1.6211 => 1.8929, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.61% (2.0673 => 2.4107, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: 16.60% (0.3096 => 0.3610, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.41% (4.4195 => 5.1446, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 16.41% (0.3267 => 0.3803, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 16.27% (0.3258 => 0.3788, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.26% (0.1421 => 0.1652, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.15% (0.3362 => 0.3905, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3195 => 0.3708, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.88% (0.3930 => 0.4554, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.87% (1.9694 => 2.2819, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.82% (0.3060 => 0.3544, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 15.69% (1.0781 => 1.2473, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.58% (1.9966 => 2.3076, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.56% (0.3124 => 0.3610, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.54% (23.5202 => 27.1761, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.53% (0.3845 => 0.4442, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.41% (2.7292 => 3.1499, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 15.39% (0.3678 => 0.4244, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 15.24% (0.3726 => 0.4294, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.19% (4.2109 => 4.8504, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.04% (0.3477 => 0.4000, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.02% (0.3348 => 0.3851, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.87% (0.3625 => 0.4164, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.80% (0.3690 => 0.4236, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 14.69% (0.4146 => 0.4755, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.57% (0.3981 => 0.4561, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 14.44% (0.4251 => 0.4865, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 14.43% (1.4269 => 1.6328, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.02% (0.3446 => 0.3929, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 13.98% (0.7875 => 0.8976, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.96% (0.3460 => 0.3943, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3465 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.90% (0.3488 => 0.3973, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 13.89% (0.3469 => 0.3951, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.84% (0.3496 => 0.3980, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 13.73% (0.5012 => 0.5700, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 13.45% (0.3650 => 0.4141, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.42% (0.3643 => 0.4132, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.32% (0.3724 => 0.4220, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 12.59% (2.1653 => 2.4380, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.57% (0.6435 => 0.7244, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.55% (0.1028 => 0.1157, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.05% (4.6177 => 5.1742, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 11.86% (2.1013 => 2.3506, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/football/football: 11.81% (0.2075 => 0.2320, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.73% (0.2737 => 0.3058, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11.72% (5.5417 => 6.1914, std.dev.: 0.0055) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.3498 => 0.3901, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.12% (0.2068 => 0.2298, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.85% (0.6634 => 0.7354, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.83% (0.3084 => 0.3418, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 10.43% (0.3336 => 0.3684, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.08% (0.2103 => 0.2315, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.92% (0.5361 => 0.5893, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.90% (0.2040 => 0.2242, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 9.84% (0.4847 => 0.5324, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.66% (11.6398 => 12.7646, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.40% (0.1383 => 0.1513, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.92% (4.6926 => 5.1113, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.91% (0.7426 => 0.8088, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.82% (0.2391 => 0.2578, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.67% (2.0346 => 2.1907, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.98% (0.5584 => 0.5974, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 6.82% (11.9555 => 12.7708, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.54% (0.3792 => 0.3964, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5185, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.18% (0.3693 => 0.4069, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2393, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6894, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1954, std.dev.: 0.0048) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.44% (1.0927 => 1.1084, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2870, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.36% (1.0142 => 1.0280, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.09% (3.1722 => 3.2069, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5950, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5560, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.36% (17.2379 => 14.2453, std.dev.: 0.0464) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7946, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -5.37% (0.2402 => 0.2273, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -5.26% (14.0481 => 13.3085, std.dev.: 0.2575) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2103, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8094, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.00% (0.6293 => 0.6104, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.0984, std.dev.: 0.0442) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5692, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (105.3826 => 104.1108, std.dev.: 0.1083) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 18:13:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 20:13:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113021325.0367B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7533?compare_to=7530&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7533, Order: 172337, Start Time: 2013-01-13 00:39:55, End Time: 2013-01-13 02:13:21 To: 7530, Order: 172331, Start Time: 2013-01-12 22:43:05, End Time: 2013-01-13 00:16:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 1 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (870 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.19% (0.3982 => 0.3855, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.71% (0.0717 => 0.1181, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.62% (0.0974 => 0.1545, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.33% (0.1500 => 0.2165, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.03% (0.6395 => 0.8763, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.23% (0.6395 => 0.8648, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.18% (0.6260 => 0.8337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.26% (0.5688 => 0.7523, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.18% (0.5456 => 0.7212, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.14% (0.5805 => 0.7671, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.54% (0.6230 => 0.8195, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.15% (0.5567 => 0.7301, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.12% (0.5581 => 0.7318, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.12% (0.5941 => 0.7790, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.47% (0.5802 => 0.7570, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.42% (0.6033 => 0.7868, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.13% (0.5705 => 0.7424, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.94% (0.5849 => 0.7600, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.90% (0.5478 => 0.7116, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.68% (0.5859 => 0.7598, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.57% (0.5570 => 0.7217, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.44% (0.6440 => 0.8336, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.31% (0.5569 => 0.7201, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.24% (0.5591 => 0.7226, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.22% (0.5925 => 0.7656, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.23% (0.6189 => 0.7936, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.21% (0.5863 => 0.7517, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.21% (0.6052 => 0.7759, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.02% (0.5857 => 0.7498, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.91% (0.6676 => 0.8539, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.82% (0.6446 => 0.8239, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.59% (0.6304 => 0.8043, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.86% (1.6474 => 2.0899, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.43% (0.6194 => 0.7831, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.05% (0.6660 => 0.8395, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.89% (0.6297 => 0.7927, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.71% (0.6681 => 0.8399, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.34% (0.6667 => 0.8290, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.14% (0.7524 => 0.9265, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.25% (0.7339 => 0.8972, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.68% (2.2587 => 2.7031, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.61% (1.1450 => 1.3123, std.dev.: 0.0060) MultiSource/Applications/sgefa/sgefa: 13.82% (0.3357 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.16% (1.6364 => 1.8190, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.00% (4.5069 => 5.0027, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.98% (0.4916 => 0.5456, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 10.63% (0.4515 => 0.4995, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.91% (3.5339 => 3.8840, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2385 => 0.2597, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.7021 => 0.7576, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.63% (0.4524 => 0.4824, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 6.62% (1.2515 => 1.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.42% (0.5329 => 0.5671, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4861 => 0.5161, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.94% (9.2283 => 9.7768, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.91% (1.4642 => 1.5508, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.66% (1.2784 => 1.3507, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.89% (0.3319 => 0.3448, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.6750 => 0.6928, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.20% (5.4682 => 5.5886, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 2.10% (5.0226 => 5.1279, std.dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 2.08% (1.3864 => 1.4152, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.45% (0.8418 => 0.8540, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6710, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.34% (0.9531 => 1.0326, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.48% (5.1955 => 5.4280, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1680, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5918, std.dev.: 0.0625) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8210 => 28.2881, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6069, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.90% (0.1431 => 0.1318, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.02% (0.2428 => 0.2306, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.98% (0.9852 => 0.9361, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.97% (0.3821 => 0.3631, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -4.79% (2.4924 => 2.3729, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.42% (0.3142 => 0.3003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.15% (0.3057 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.14% (0.7198 => 0.6900, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.06% (0.2903 => 0.2785, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: -3.93% (0.3812 => 0.3662, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hello: -3.93% (0.2849 => 0.2737, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3884 => 0.3733, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3831 => 0.3683, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.86% (0.9542 => 0.9174, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.83% (0.3025 => 0.2909, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3896 => 0.3747, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -3.82% (0.3848 => 0.3701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.81% (2.1713 => 2.0885, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wc: -3.78% (0.3205 => 0.3084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.73% (0.3891 => 0.3746, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.71% (0.4176 => 0.4021, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.69% (0.4033 => 0.3884, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.68% (1.3148 => 1.2664, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.66% (0.3658 => 0.3524, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.65% (0.3016 => 0.2906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.61% (0.2933 => 0.2827, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.47% (0.4151 => 0.4007, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -3.36% (0.4199 => 0.4058, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.11% (0.4280 => 0.4147, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.01% (0.7919 => 0.7681, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.93% (20.7746 => 20.1657, std.dev.: 0.0269) MultiSource/Benchmarks/MallocBench/gs/gs: -2.68% (4.3330 => 4.2168, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.60% (0.4427 => 0.4312, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: -2.47% (0.7982 => 0.7785, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8580, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/moments: -2.45% (0.4248 => 0.4144, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.44% (0.6347 => 0.6192, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -2.43% (17.1032 => 16.6868, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.40% (1.2221 => 1.1928, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.39% (1.0544 => 1.0292, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.35% (6.7716 => 6.6122, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.34% (1.2210 => 1.1924, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -2.25% (16.1920 => 15.8274, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: -2.25% (0.6441 => 0.6296, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.22% (0.7779 => 0.7606, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: -2.20% (0.9179 => 0.8977, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -2.17% (2.4021 => 2.3500, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -2.11% (7.0961 => 6.9464, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2041, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.80% (0.5999 => 0.5891, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.75% (0.8521 => 0.8372, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.49% (4.0594 => 3.9991, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.47% (34.0927 => 33.5922, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.09% (8.0126 => 7.9252, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: -1.07% (18.2933 => 18.0970, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.03% (1.8100 => 0.6692, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3125, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.69% (1.3643 => 1.0274, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0337, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3833, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2077, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1309, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1036, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.25% (0.5142 => 0.4615, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8588, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.00% (1.3096 => 1.2703, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.99% (7.9763 => 7.7382, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4649, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.61% (4.8776 => 4.7991, std.dev.: 0.0218) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3040 => 7.1913, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6084, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.34% (1.6086 => 1.5871, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: -1.33% (3.7092 => 3.6599, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3473, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 18:25:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 20:25:32 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113022532.55BE42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7534?compare_to=7529&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7534, Order: 172335, Start Time: 2013-01-13 00:09:27, End Time: 2013-01-13 02:25:31 To: 7529, Order: 172326, Start Time: 2013-01-12 21:47:57, End Time: 2013-01-12 23:48:36 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 11 (10 on baseline) Performance Improvements: 6 (141 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (912 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.87% (0.6412 => 0.6532, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.51% (1.4614 => 1.8780, std.dev.: 0.0049) SingleSource/Benchmarks/Linpack/linpack-pc: 7.02% (47.4872 => 50.8205, std.dev.: 0.9149) MultiSource/Benchmarks/nbench/nbench: 5.43% (20.5193 => 21.6339, std.dev.: 0.2992) SingleSource/Benchmarks/Misc/ffbench: 3.29% (1.3391 => 1.3832, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.55% (8.5127 => 8.7295, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 2.47% (3.5425 => 3.6301, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.20% (5.0438 => 5.1548, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.6442 => 0.6563, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.20% (63.5320 => 64.2970, std.dev.: 0.1007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.12% (5.8210 => 5.8861, std.dev.: 0.0249) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.94% (0.9127 => 0.8859, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.31% (0.8749 => 0.8634, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -2.55% (2.4486 => 2.3861, std.dev.: 0.0056) SingleSource/Benchmarks/Dhrystone/fldry: -1.66% (0.6855 => 0.6741, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (2.4637 => 2.4237, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.18% (2.5889 => 2.5584, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.42% (1.1255 => 1.1095, std.dev.: 0.0820) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.34% (0.0224 => 0.0221, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0435 => 0.0433, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0339 => 0.0338, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0320 => 0.0320, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -2.36% (0.0212 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0222 => 0.0224, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.30% (0.0253 => 0.0232, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.03% (0.1457 => 0.1442, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 0.91% (1.1326 => 1.1429, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.01% (0.4193 => 0.3941, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.41% (0.1474 => 0.1480, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.37% (0.1008 => 0.0974, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.94% (0.0277 => 0.0183, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.31% (0.0615 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1504 => 1.1538, std.dev.: 0.0980) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -63.33% (0.0030 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.84% (0.0610 => 0.0550, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.93% (0.0311 => 0.0317, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.38% (0.7330 => 0.7431, std.dev.: 0.0047) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -69.11% (0.0123 => 0.0038, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.07% (12.7633 => 12.7545, std.dev.: 0.0273) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.89% (0.0336 => 0.0507, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320550.00% (0.0008 => 2.5652, std.dev.: 0.0230) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.82% (1.1825 => 2.3865, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.10% (0.2562 => 0.2872, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 5.47% (20.5117 => 21.6339, std.dev.: 0.2992) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.41% (9.0082 => 9.3153, std.dev.: 0.0575) SingleSource/Benchmarks/Misc/pi: 3.05% (2.1390 => 2.2042, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (63.1520 => 64.2970, std.dev.: 0.1007) MultiSource/Applications/JM/lencod/lencod: 1.58% (6.8159 => 6.9234, std.dev.: 0.0102) MultiSource/Applications/siod/siod: 1.09% (3.5910 => 3.6301, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.47% (0.0808 => 0.0481, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.64% (0.0727 => 0.0497, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -26.91% (0.1888 => 0.1380, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.98% (0.1684 => 0.1297, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.15% (0.0676 => 0.0533, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -21.06% (1.8964 => 1.4970, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.72% (0.1009 => 0.0810, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.48% (1.0960 => 0.9154, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.66% (0.1079 => 0.0910, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.11% (1.0986 => 0.9326, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.01% (0.7686 => 0.6532, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -14.05% (0.0847 => 0.0728, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.04% (0.4074 => 0.3502, std.dev.: 0.0036) MultiSource/Applications/aha/aha: -13.93% (0.1378 => 0.1186, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -12.76% (1.0220 => 0.8916, std.dev.: 0.0335) MultiSource/Applications/hexxagon/hexxagon: -12.58% (1.1433 => 0.9995, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -11.94% (4.6406 => 4.0864, std.dev.: 0.1684) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.42% (0.2372 => 0.2101, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: -11.16% (2.4719 => 2.1960, std.dev.: 0.0796) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -10.70% (0.6885 => 0.6148, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.62% (6.4235 => 5.7414, std.dev.: 0.1627) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.29% (1.5131 => 1.3574, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.99% (10.2703 => 9.2438, std.dev.: 0.0782) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.80% (0.7693 => 0.6939, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -9.20% (0.8653 => 0.7857, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.98% (1.3924 => 1.2674, std.dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: -8.96% (17.5634 => 15.9902, std.dev.: 0.2719) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.93% (1.1498 => 1.0471, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.87% (0.9124 => 0.8315, std.dev.: 0.0120) MultiSource/Applications/sgefa/sgefa: -8.87% (0.3598 => 0.3279, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.84% (1.6874 => 1.5383, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -8.52% (17.4365 => 15.9502, std.dev.: 0.0406) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.20% (0.1317 => 0.1209, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -8.18% (0.2006 => 0.1842, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -7.95% (0.1610 => 0.1482, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.79% (0.2618 => 0.2414, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.70% (0.2481 => 0.2290, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.60% (0.9588 => 0.8859, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.21% (1.0017 => 0.9295, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -7.11% (0.1928 => 0.1791, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -6.85% (0.4002 => 0.3728, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.81% (0.2100 => 0.1957, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.67% (0.3462 => 0.3231, std.dev.: 0.0080) MultiSource/Applications/viterbi/viterbi: -6.63% (0.1824 => 0.1703, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.48% (0.2283 => 0.2135, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.44% (0.6135 => 0.5740, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.42% (1.8127 => 1.6963, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.35% (0.3560 => 0.3334, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.09% (0.9550 => 0.8968, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/except: -5.99% (0.2172 => 0.2042, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.67% (1.3310 => 1.2555, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: -5.66% (1.4392 => 1.3577, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/wc: -5.64% (0.2305 => 0.2175, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -5.57% (0.2135 => 0.2016, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.53% (0.5746 => 0.5428, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.49% (1.0234 => 0.9672, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.46% (0.9507 => 0.8988, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.38% (5.0381 => 4.7670, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.36% (0.9127 => 0.8638, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.32% (0.3665 => 0.3470, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.32% (0.7693 => 0.7284, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.25% (0.9422 => 0.8927, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.04% (0.3394 => 0.3223, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.03% (0.9091 => 0.8634, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: -4.93% (0.7776 => 0.7393, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: -4.91% (0.4689 => 0.4459, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.85% (0.9512 => 0.9051, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/lists1: -4.83% (0.3206 => 0.3051, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.82% (1.0052 => 0.9567, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.65% (0.8990 => 0.8572, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.9405 => 0.8971, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.58% (0.2577 => 0.2459, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.51% (0.9403 => 0.8979, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: -4.46% (0.6711 => 0.6412, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.37% (0.9788 => 0.9360, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: -4.37% (0.2564 => 0.2452, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.35% (0.9993 => 0.9558, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.25% (1.2680 => 1.2141, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.15% (0.9488 => 0.9094, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.10% (0.2709 => 0.2598, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -4.01% (4.5936 => 4.4095, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.96% (1.3220 => 1.2696, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.85% (0.3715 => 0.3572, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.85% (0.2884 => 0.2773, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.45% (4.6579 => 4.4970, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.40% (1.0860 => 1.0491, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.28% (1.0119 => 0.9787, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.22% (0.9855 => 0.9538, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.17% (0.9685 => 0.9378, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.02% (0.5369 => 0.5207, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.82% (1.0088 => 0.9804, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.81% (0.8926 => 0.8675, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.66% (7.2721 => 7.0786, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.58% (0.9061 => 0.8827, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.54% (0.8893 => 0.8667, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.9757 => 14.5983, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.44% (0.6996 => 0.6825, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.42% (0.9381 => 0.9154, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.39% (0.8846 => 0.8635, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.34% (0.9612 => 0.9387, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.98% (0.7225 => 0.7082, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.90% (0.9998 => 0.9808, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: -1.88% (1.2708 => 1.2469, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.63% (0.9120 => 0.8971, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.56% (4.8904 => 4.8140, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.47% (0.8912 => 0.8781, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.44% (0.9564 => 0.9426, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (0.9010 => 0.8882, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.32% (1.4805 => 1.4610, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.07% (0.9588 => 0.9485, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.97% (0.9372 => 0.6563, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.51% (1.0816 => 0.7732, std.dev.: 0.0409) MultiSource/Applications/minisat/minisat: -21.47% (7.9891 => 6.2741, std.dev.: 0.0913) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.10% (0.1164 => 0.0930, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.65% (2.8778 => 2.3698, std.dev.: 0.1199) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.43% (1.4235 => 1.2608, std.dev.: 0.0438) SingleSource/Benchmarks/Shootout/hash: -10.23% (4.5259 => 4.0631, std.dev.: 0.1584) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.60% (1.4588 => 1.3334, std.dev.: 0.0214) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.48% (0.4081 => 0.3735, std.dev.: 0.0092) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.11% (0.3217 => 0.2956, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: -7.57% (0.1704 => 0.1575, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.3654 => 0.3420, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.52% (23.3986 => 22.1066, std.dev.: 0.2720) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.39% (0.3349 => 0.3202, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.97% (1.4446 => 1.3873, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.71% (2.5170 => 2.4237, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.38% (40.4729 => 39.1054, std.dev.: 0.2301) MultiSource/Applications/SIBsim4/SIBsim4: -3.36% (3.5443 => 3.4253, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/lists: -3.23% (17.2182 => 16.6612, std.dev.: 0.0703) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.60% (2.4498 => 2.3861, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.19% (42.3194 => 41.3934, std.dev.: 0.1176) MultiSource/Applications/spiff/spiff: -2.06% (2.8571 => 2.7983, std.dev.: 0.0069) MultiSource/Benchmarks/llubenchmark/llu: -1.97% (2.0298 => 1.9899, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.93% (1.0995 => 1.0783, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.77% (0.5826 => 0.5723, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -1.73% (0.8521 => 0.8374, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.54% (3.1921 => 3.1429, std.dev.: 0.0068) SingleSource/Benchmarks/SmallPT/smallpt: -1.34% (14.9448 => 14.7442, std.dev.: 0.0357) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3596 => 3.3159, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.90% (1.2047 => 1.1095, std.dev.: 0.0820) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -40.76% (1.9293 => 1.1429, std.dev.: 0.0356) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.67% (0.4049 => 0.3941, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.99% (0.1510 => 0.1480, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.41% (0.0978 => 0.0974, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.70% (0.0276 => 0.0183, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.68% (0.0590 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1617 => 1.1538, std.dev.: 0.0980) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -65.63% (0.0032 => 0.0011, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.84% (0.0610 => 0.0550, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.28% (0.0268 => 0.0317, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7437 => 0.7431, std.dev.: 0.0047) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -58.70% (0.0092 => 0.0038, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7545, std.dev.: 0.0273) Report Time: 2.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 19:53:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 21:53:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113035356.11A762A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7535?compare_to=7531&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7535, Order: 172337, Start Time: 2013-01-13 01:43:01, End Time: 2013-01-13 03:53:50 To: 7531, Order: 172331, Start Time: 2013-01-12 23:02:25, End Time: 2013-01-13 01:13:06 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (214 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.25% (11.0877 => 11.2259, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.67% (41.6782 => 42.7911, std.dev.: 0.1009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1331 => 0.1333, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0651 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8341 => 499.8553, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.20% (1.1277 => 499.8553, std.dev.: 0.0097) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.79% (0.5229 => 1.6408, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 19.46% (14.9895 => 17.9062, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 43.23% (14.1553 => 20.2740, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/gs/gs: 17.67% (4.1105 => 4.8367, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.55% (1.1048 => 1.7406, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.54% (7.1582 => 37.5479, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.34% (3.4629 => 6.3836, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.74% (0.6222 => 1.0810, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10248.47% (0.0720 => 7.4509, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11186300.00% (0.0001 => 11.1864, std.dev.: 0.0513) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487800.00% (0.0001 => 5.4879, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.73% (1.1194 => 10.3626, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.22% (22.1758 => 55.4880, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.99% (0.0929 => 0.1765, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.47% (0.1463 => 0.2494, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.78% (2.9384 => 4.6069, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.67% (7.0540 => 10.9104, std.dev.: 0.0063) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.50% (1.5859 => 2.3868, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.47% (8.1363 => 11.9170, std.dev.: 0.0132) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.90% (2.2024 => 3.1032, std.dev.: 0.0195) MultiSource/Applications/JM/lencod/lencod: 40.80% (21.9371 => 30.8875, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 38.73% (0.3109 => 0.4313, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.48% (4.2646 => 5.6925, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.79% (1.5415 => 2.0469, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.11% (0.4615 => 0.6097, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.46% (0.2271 => 0.2940, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.28% (0.1892 => 0.2446, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 28.87% (0.4299 => 0.5540, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 28.60% (1.1642 => 1.4972, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.13% (0.6675 => 0.8553, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.68% (0.5105 => 0.6467, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.76% (0.1584 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 25.53% (0.1175 => 0.1475, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 25.41% (0.2554 => 0.3203, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.21% (3.8922 => 4.8736, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.07% (0.1125 => 0.1407, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.35% (1.0722 => 1.3333, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.32% (1.4186 => 1.7494, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 23.04% (0.4289 => 0.5277, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.44% (9.4845 => 11.6126, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: 22.36% (0.4620 => 0.5653, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.30% (0.1695 => 0.2073, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.74% (0.2700 => 0.3287, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 21.42% (0.7115 => 0.8639, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.03% (0.1555 => 0.1882, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.13% (0.7835 => 0.9412, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.08% (1.3050 => 1.5671, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 20.07% (5.7591 => 6.9151, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 20.05% (0.3098 => 0.3719, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 19.64% (0.6456 => 0.7724, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.48% (4.9449 => 5.9081, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.33% (0.5860 => 0.6993, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.62% (3.3354 => 3.9565, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.62% (5.0018 => 5.9329, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.55% (0.5020 => 0.5901, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.33% (0.5569 => 0.6534, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.33% (0.3307 => 0.3880, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: 17.31% (0.7433 => 0.8720, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.27% (0.9765 => 1.1451, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 17.14% (1.1840 => 1.3869, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.05% (0.2065 => 0.2417, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.04% (0.2107 => 0.2466, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 16.91% (0.3423 => 0.4002, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.69% (3.8723 => 4.5187, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 16.60% (2.0273 => 2.3638, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.55% (0.5981 => 0.6971, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.01% (0.3441 => 0.3992, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 15.79% (2.2969 => 2.6596, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.71% (0.8101 => 0.9374, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.66% (0.6450 => 0.7460, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 15.60% (0.3283 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.3180 => 0.3657, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 14.98% (0.3232 => 0.3716, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 14.93% (0.2049 => 0.2355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.46% (1.1861 => 1.3576, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.35% (0.8921 => 1.0201, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.72% (0.8067 => 0.9174, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.60% (0.0838 => 0.0952, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.33% (0.2603 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 12.99% (0.3379 => 0.3818, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.55% (0.3387 => 0.3812, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.45% (0.3865 => 0.4346, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.44% (1.5603 => 1.7544, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.26% (0.4103 => 0.4606, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.01% (0.4636 => 0.5193, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.33% (0.4203 => 0.4679, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 11.24% (0.4048 => 0.4503, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.13% (0.3092 => 0.3436, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.02% (0.3694 => 0.4101, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.01% (0.3543 => 0.3933, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.99% (17.1811 => 19.0697, std.dev.: 0.0204) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.94% (0.3603 => 0.3997, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 10.55% (0.3422 => 0.3783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.50% (0.3684 => 0.4071, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 10.42% (0.3282 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (14.3668 => 15.8590, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.36% (0.3427 => 0.3782, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.25% (0.3826 => 0.4218, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.67% (0.4064 => 0.4457, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 9.46% (0.1268 => 0.1388, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.83% (0.2831 => 0.3081, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.52% (0.5925 => 0.6430, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.28% (10.3673 => 11.2259, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.27% (2.0665 => 2.2373, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 8.22% (0.2871 => 0.3107, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.13% (0.2877 => 0.3111, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.09% (63.2438 => 68.3589, std.dev.: 0.0074) MultiSource/Applications/hexxagon/hexxagon: 7.93% (1.2842 => 1.3860, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.90% (0.3935 => 0.4246, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.86% (0.3650 => 0.3937, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.71% (0.2905 => 0.3129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.69% (0.3162 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.49% (0.2872 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.47% (0.2891 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.40% (0.2756 => 0.2960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.21% (0.2802 => 0.3004, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 7.21% (0.3052 => 0.3272, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.12% (0.2793 => 0.2992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.05% (0.2725 => 0.2917, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.89% (0.2714 => 0.2901, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.82% (0.3136 => 0.3350, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.43% (2.2022 => 2.3438, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.07% (0.4879 => 0.5175, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (7.9617 => 8.1813, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2522, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (1.1145 => 1.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4574, std.dev.: 0.0066) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.79% (3.1578 => 3.3092, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 4.08% (0.9505 => 0.9893, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.05% (0.9957 => 1.0261, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9230, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.39% (3.6395 => 3.7264, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2865, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7570, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2771, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5807, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1782, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -75.23% (0.8651 => 0.2143, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.23% (5.3855 => 4.4577, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.87% (5.3526 => 4.4498, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -13.90% (10.4361 => 8.9857, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.86% (1.7609 => 1.6049, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9212, std.dev.: 0.0199) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.54% (1.9577 => 0.6551, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3047, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.38% (1.5373 => 1.0242, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4285, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8601, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9695 => 2.3247, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -20.04% (0.2161 => 0.1728, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4218, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7319, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4927, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.40% (19.9488 => 18.2736, std.dev.: 0.0200) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.36% (1.2373 => 1.1586, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.22% (8.1563 => 7.7306, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8378, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3276, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6668, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.33% (0.2116 => 0.0649, std.dev.: 0.0011) Report Time: 5.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 20:13:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 22:13:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113041336.8413E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7536?compare_to=7533&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7536, Order: 172340, Start Time: 2013-01-13 02:40:08, End Time: 2013-01-13 04:13:33 To: 7533, Order: 172337, Start Time: 2013-01-13 00:39:55, End Time: 2013-01-13 02:13:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 2 (143 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (854 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.97% (0.6692 => 0.6891, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference-object: -1.62% (0.6296 => 0.6194, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (2.0885 => 2.0675, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.16% (0.0717 => 0.1177, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.21% (0.0974 => 0.1541, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 44.20% (0.1500 => 0.2163, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.11% (0.6395 => 0.8768, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.51% (0.1132 => 0.1534, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.20% (0.6395 => 0.8646, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.12% (0.6260 => 0.8333, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.21% (0.5688 => 0.7520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.04% (0.5456 => 0.7204, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.99% (0.5805 => 0.7662, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.51% (0.6230 => 0.8193, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.96% (0.5575 => 0.7301, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.91% (0.5581 => 0.7306, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.86% (0.5567 => 0.7285, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.75% (0.5941 => 0.7768, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.44% (0.5802 => 0.7568, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.18% (0.6033 => 0.7854, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.10% (0.5705 => 0.7422, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.83% (0.5849 => 0.7594, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.65% (0.5478 => 0.7102, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.62% (0.5570 => 0.7220, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.58% (0.5859 => 0.7592, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.21% (0.6440 => 0.8321, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.16% (0.5569 => 0.7193, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.05% (0.5925 => 0.7646, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.98% (0.5591 => 0.7211, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.10% (0.6189 => 0.7928, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.06% (0.5863 => 0.7508, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.02% (0.6052 => 0.7748, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.97% (0.5857 => 0.7495, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.91% (0.6676 => 0.8539, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.44% (0.6304 => 0.8034, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.90% (1.6474 => 2.0905, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.15% (0.6194 => 0.7814, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.80% (0.6681 => 0.8405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.77% (0.6660 => 0.8376, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.74% (0.6297 => 0.7918, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.07% (0.6667 => 0.8272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.03% (0.7524 => 0.9257, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.05% (0.7339 => 0.8957, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.66% (2.2587 => 2.7027, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.34% (0.0693 => 0.0827, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.97% (0.0622 => 0.0740, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.09% (0.0634 => 0.0736, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317) MultiSource/Applications/lemon/lemon: 14.53% (1.1450 => 1.3114, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 13.70% (0.3357 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.95% (1.6364 => 1.8156, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.74% (4.5069 => 4.9909, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.54% (0.4916 => 0.5434, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 10.17% (0.4515 => 0.4974, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.92% (3.5339 => 3.8844, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.51% (0.2385 => 0.2588, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.7021 => 0.7559, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.34% (0.5329 => 0.5667, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 6.30% (1.2515 => 1.3303, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4524 => 0.4790, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.74% (1.4642 => 1.5483, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 5.74% (9.2283 => 9.7578, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.51% (1.2784 => 1.3489, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4861 => 0.5119, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.3255 => 0.3387, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.59% (0.3319 => 0.3438, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.20% (5.0226 => 5.1331, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6750 => 0.6885, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.99% (5.4682 => 5.5771, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 1.90% (1.3864 => 1.4127, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.37% (0.8418 => 0.8533, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6736, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4407, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1692, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4832, std.dev.: 0.0528) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1059, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2847, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6053, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.02% (79.7170 => 80.5335, std.dev.: 0.2262) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.21% (0.1281 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.97% (0.1431 => 0.1317, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.94% (0.1584 => 0.1474, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.83% (0.3194 => 0.2976, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.46% (0.3884 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.36% (0.3880 => 0.3672, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.24% (0.4176 => 0.3957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.14% (0.3057 => 0.2900, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.11% (0.9852 => 0.9349, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.07% (0.2428 => 0.2305, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.93% (2.4924 => 2.3696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.81% (0.4199 => 0.3997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.81% (0.3016 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.7198 => 0.6852, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.78% (2.1713 => 2.0675, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -4.74% (0.3205 => 0.3053, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.74% (0.3059 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.67% (0.3252 => 0.3100, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.51% (0.4280 => 0.4087, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.49% (0.3142 => 0.3001, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.43% (1.3148 => 1.2566, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.19% (0.4151 => 0.3977, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.05% (0.2989 => 0.2868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.00% (0.6347 => 0.6093, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.98% (0.9542 => 0.9162, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.94% (0.3931 => 0.3776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.91% (0.3658 => 0.3515, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.40% (0.3849 => 0.3718, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.32% (0.4427 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.25% (0.4248 => 0.4110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.23% (0.7779 => 0.7528, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists1: -3.21% (0.3867 => 0.3743, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.18% (0.7919 => 0.7667, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: -3.14% (0.3788 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.03% (0.4321 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.94% (0.4083 => 0.3963, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -2.91% (4.3330 => 4.2068, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.89% (6.7716 => 6.5758, std.dev.: 0.0069) SingleSource/UnitTests/Vector/constpool: -2.87% (20.7746 => 20.1793, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.64% (1.0544 => 1.0266, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.55% (14.2083 => 13.8459, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: -2.48% (17.1032 => 16.6793, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.47% (1.2210 => 1.1908, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7941, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.41% (1.2221 => 1.1927, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.31% (0.4813 => 0.4702, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.28% (2.4021 => 2.3474, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.26% (1.2300 => 1.2022, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -2.18% (7.0961 => 6.9414, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -2.17% (0.9179 => 0.8980, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -2.04% (34.0927 => 33.3958, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.02% (0.5999 => 0.5878, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.88% (0.8521 => 0.8361, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -1.53% (4.0594 => 3.9971, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: -1.48% (18.2933 => 18.0228, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.47% (8.0126 => 7.8947, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9077 => 0.8964, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5420, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -1.16% (15.2527 => 15.0761, std.dev.: 0.0169) MultiSource/Applications/treecc/treecc: -1.15% (2.1401 => 2.1155, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: -1.01% (1.1530 => 1.1414, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.93% (1.8100 => 0.6891, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.62% (0.1622 => 0.1028) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3107, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2405, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -24.71% (1.3643 => 1.0272, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0265, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3833, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1292, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.76% (0.5142 => 0.4640, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8589, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1794, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (7.9763 => 7.7191, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.15% (1.3096 => 1.2684, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.33% (3.1919 => 3.1176, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -2.27% (3.7241 => 3.6395, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1922, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8086, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6088, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.30% (1.6086 => 1.5877, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 20:44:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 12 Jan 2013 22:44:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113044425.6C1652A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7537?compare_to=7534&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7537, Order: 172340, Start Time: 2013-01-13 02:44:41, End Time: 2013-01-13 04:44:24 To: 7534, Order: 172335, Start Time: 2013-01-13 00:09:27, End Time: 2013-01-13 02:25:31 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (7 on baseline) Performance Improvements: 2 (103 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1054 (953 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.65% (0.6148 => 0.6311, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 13.46% (0.7732 => 0.8773, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.77% (2.3698 => 2.5777, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.69% (2.3091 => 2.3713, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/flops: 2.65% (8.6273 => 8.8558, std.dev.: 0.0329) MultiSource/Benchmarks/llubenchmark/llu: 1.24% (1.9899 => 2.0145, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.18% (2.3861 => 2.4142, std.dev.: 0.0097) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.95% (0.5428 => 0.5268, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.20% (14.5983 => 14.4236, std.dev.: 0.0457) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.02% (1.1095 => 1.1097, std.dev.: 0.0296) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.89% (0.0338 => 0.0341, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0320 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0430 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0207 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.89% (0.0224 => 0.0222, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0232 => 0.0231, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: - (0.1442 => 0.1442, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 1.53% (1.1429 => 1.1604, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.27% (0.3941 => 0.3891, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.69% (0.1480 => 0.1455, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0974 => 0.0971, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 49.18% (0.0183 => 0.0273, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.06% (0.0527 => 0.0580, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.06% (1.1538 => 1.1416, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 163.64% (0.0011 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.73% (0.0550 => 0.0609, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.34% (0.0317 => 0.0224, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.7431 => 0.7406, std.dev.: 0.0114) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: -50.00% (0.0008 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.63% (0.0038 => 0.0077, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (12.7545 => 12.7621, std.dev.: 0.1280) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320987.50% (0.0008 => 2.5687, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.03% (1.1825 => 2.4008, std.dev.: 0.0277) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.06% (0.2562 => 0.2871, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (3.7074 => 3.9657, std.dev.: 0.0667) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.40% (2.2499 => 2.3713, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/pi: 2.51% (2.1390 => 2.1927, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.08% (0.0808 => 0.0468, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.20% (0.0692 => 0.0483, std.dev.: 0.0004) SingleSource/Benchmarks/SmallPT/smallpt: -27.54% (0.1888 => 0.1368, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.11% (0.1684 => 0.1278, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.30% (0.0676 => 0.0532, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -20.55% (1.8964 => 1.5067, std.dev.: 0.0166) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.32% (0.1009 => 0.0804, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.03% (0.0862 => 0.0698, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.38% (1.0960 => 0.8946, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.68% (0.7686 => 0.6404, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.79% (1.0986 => 0.9251, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.83% (0.1079 => 0.0919, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -13.73% (1.0220 => 0.8817, std.dev.: 0.0246) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.06% (0.4074 => 0.3542, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -12.93% (1.1433 => 0.9955, std.dev.: 0.0076) MultiSource/Applications/Burg/burg: -12.58% (1.5979 => 1.3969, std.dev.: 0.0525) MultiSource/Applications/treecc/treecc: -12.37% (2.4719 => 2.1662, std.dev.: 0.0750) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.69% (6.4235 => 5.6723, std.dev.: 0.2567) MultiSource/Applications/lua/lua: -11.38% (4.6406 => 4.1127, std.dev.: 0.0901) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.98% (1.5131 => 1.3470, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.41% (0.1210 => 0.1084, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -10.12% (9.8875 => 8.8872, std.dev.: 0.1266) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.02% (0.7693 => 0.6922, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -9.79% (17.5634 => 15.8447, std.dev.: 0.3411) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.69% (10.2703 => 9.2753, std.dev.: 0.0511) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.63% (1.3924 => 1.2583, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: -9.63% (0.1610 => 0.1455, std.dev.: 0.0018) MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.56% (1.1731 => 1.0610, std.dev.: 0.0248) MultiSource/Applications/siod/siod: -9.54% (2.6437 => 2.3915, std.dev.: 0.0912) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.33% (1.6874 => 1.5299, std.dev.: 0.0109) MultiSource/Applications/lambda-0_1_3/lambda: -9.30% (0.8653 => 0.7848, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.28% (0.9124 => 0.8277, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: -9.04% (17.4365 => 15.8594, std.dev.: 0.1373) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.04% (0.1317 => 0.1198, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.91% (1.1498 => 1.0474, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.85% (0.9588 => 0.8739, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.82% (0.2618 => 0.2387, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.67% (0.2481 => 0.2266, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -8.51% (0.1798 => 0.1645, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.35% (0.2372 => 0.2174, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.34% (0.6885 => 0.6311, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.32% (0.5746 => 0.5268, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.28% (0.2283 => 0.2094, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.95% (0.3560 => 0.3277, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -7.37% (0.4002 => 0.3707, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.09% (0.2709 => 0.2517, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: -6.97% (3.7840 => 3.5204, std.dev.: 0.0980) MultiSource/Applications/lemon/lemon: -6.92% (1.3979 => 1.3011, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: -6.25% (0.5134 => 0.4813, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.24% (0.2100 => 0.1969, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.20% (1.3310 => 1.2485, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.75% (5.0381 => 4.7484, std.dev.: 0.0201) MultiSource/Applications/viterbi/viterbi: -5.70% (0.1824 => 0.1720, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.67% (0.2577 => 0.2431, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.66% (0.9127 => 0.8610, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.62% (0.2615 => 0.2468, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: -5.13% (1.4392 => 1.3654, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -5.11% (0.2135 => 0.2026, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.97% (1.0234 => 0.9725, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.95% (0.3394 => 0.3226, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.88% (1.2680 => 1.2061, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.72% (0.6934 => 0.6607, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.57% (0.3981 => 0.3799, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: -4.56% (4.5936 => 4.3840, std.dev.: 0.0439) MultiSource/Benchmarks/sim/sim: -4.33% (0.3715 => 0.3554, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.30% (1.3220 => 1.2652, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.16% (4.6579 => 4.4640, std.dev.: 0.0240) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.10% (0.5369 => 0.5149, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.96% (1.0860 => 1.0430, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash: -3.95% (0.4689 => 0.4504, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.94% (7.2721 => 6.9853, std.dev.: 0.0611) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.69% (14.9757 => 14.4236, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.60% (1.0088 => 0.9725, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.41% (0.2993 => 0.2891, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.90% (4.9104 => 4.7682, std.dev.: 0.0430) MultiSource/Benchmarks/nbench/nbench: -2.48% (1.2708 => 1.2393, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.7225 => 0.7073, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.92% (4.8904 => 4.7966, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.22% (0.9372 => 0.6446, std.dev.: 0.0167) MultiSource/Benchmarks/Ptrdist/ft/ft: -18.89% (1.0816 => 0.8773, std.dev.: 0.0095) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.22% (1.5623 => 1.2776, std.dev.: 0.0242) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.89% (0.1164 => 0.0979, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.91% (1.4235 => 1.2682, std.dev.: 0.0182) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.43% (2.8778 => 2.5777, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.34% (1.4588 => 1.3080, std.dev.: 0.0342) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.07% (0.4081 => 0.3670, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.74% (0.3217 => 0.2968, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -5.99% (0.3654 => 0.3435, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.94% (23.3986 => 22.0077, std.dev.: 0.2496) MultiSource/Applications/oggenc/oggenc: -5.87% (0.1704 => 0.1604, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.70% (1.4446 => 1.3911, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (17.2182 => 16.6097, std.dev.: 0.1804) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.27% (2.5170 => 2.4347, std.dev.: 0.0222) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -3.02% (3.5443 => 3.4374, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -2.85% (4.4730 => 4.3453, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.12% (3.5669 => 3.4912, std.dev.: 0.0259) MultiSource/Applications/spiff/spiff: -1.89% (2.8571 => 2.8030, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: -1.82% (0.8521 => 0.8366, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.47% (3.1921 => 3.1451, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.45% (2.4498 => 2.4142, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.23% (3.3596 => 3.3182, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.89% (1.2047 => 1.1097, std.dev.: 0.0296) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -39.85% (1.9293 => 1.1604, std.dev.: 0.0241) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.90% (0.4049 => 0.3891, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.64% (0.1510 => 0.1455, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.72% (0.0978 => 0.0971, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.69% (0.0590 => 0.0580, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.73% (1.1617 => 1.1416, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.42% (0.0268 => 0.0224, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0114) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.30% (0.0092 => 0.0077, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7781 => 12.7621, std.dev.: 0.1280) Report Time: 4.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 22:10:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 00:10:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113061030.CB6D22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7538?compare_to=7536&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7538, Order: 172344, Start Time: 2013-01-13 04:36:56, End Time: 2013-01-13 06:10:27 To: 7536, Order: 172340, Start Time: 2013-01-13 02:40:08, End Time: 2013-01-13 04:13:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/siod/siod: 1.07% (2.3474 => 2.3726, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 44.47% (0.1500 => 0.2167, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.59% (0.6395 => 0.8799, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.73% (0.6395 => 0.8680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.99% (0.6260 => 0.8388, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.61% (0.5688 => 0.7543, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.49% (0.5805 => 0.7691, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.44% (0.5456 => 0.7226, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.97% (0.6230 => 0.8222, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.43% (0.5575 => 0.7327, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.39% (0.5941 => 0.7806, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.38% (0.5567 => 0.7314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.11% (0.5802 => 0.7607, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.75% (0.6033 => 0.7888, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.48% (0.5705 => 0.7444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.41% (0.5859 => 0.7641, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.16% (0.5849 => 0.7613, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.92% (0.5478 => 0.7117, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.86% (0.6440 => 0.8363, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.86% (0.5570 => 0.7233, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.65% (0.5925 => 0.7682, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.57% (0.5569 => 0.7216, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.42% (0.5591 => 0.7236, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.52% (0.6052 => 0.7778, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.50% (0.6189 => 0.7953, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.36% (0.5857 => 0.7518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.35% (0.5863 => 0.7525, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.31% (0.6446 => 0.8271, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.95% (0.6304 => 0.8066, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.56% (1.6474 => 2.1015, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.78% (0.6194 => 0.7853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.47% (0.6660 => 0.8423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.35% (0.6297 => 0.7956, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.19% (0.6681 => 0.8431, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (0.6667 => 0.8307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.58% (0.7524 => 0.9298, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.76% (0.7339 => 0.9009, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.28% (2.2587 => 2.7168, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 15.12% (1.1450 => 1.3181, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3357 => 0.3832, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.06% (0.1982 => 0.2221, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.60% (4.5069 => 5.0297, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.58% (1.6364 => 1.8259, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4916 => 0.5467, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 10.76% (0.4515 => 0.5001, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.36% (3.5339 => 3.8999, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.95% (0.7021 => 0.7579, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.06% (1.2515 => 1.3398, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.81% (0.5329 => 0.5692, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 6.81% (0.4524 => 0.4832, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1731 => 0.1848, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.26% (1.4642 => 1.5558, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.24% (9.2283 => 9.8040, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.02% (1.2784 => 1.3553, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4861 => 0.5139, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.27% (0.3255 => 0.3394, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (5.4682 => 5.6117, std.dev.: 0.0146) MultiSource/Applications/oggenc/oggenc: 2.55% (5.0226 => 5.1506, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 2.44% (0.6750 => 0.6915, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.3864 => 1.4188, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.54% (0.8418 => 0.8548, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.06% (1.3722 => 1.3868, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6601, std.dev.: 0.0171) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4425, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5451, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1046, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2870, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6013, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.15% (10.3489 => 10.4682, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.45% (0.3194 => 0.2988, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.15% (0.3884 => 0.3684, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3896 => 0.3696, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3880 => 0.3681, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.12% (0.3831 => 0.3635, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.96% (0.3891 => 0.3698, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.91% (0.3848 => 0.3659, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -4.74% (2.4924 => 2.3742, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions: -4.74% (0.4176 => 0.3978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.55% (2.1713 => 2.0724, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.51% (0.9852 => 0.9408, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.40% (0.3026 => 0.2893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.14% (0.4199 => 0.4025, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.05% (0.6347 => 0.6090, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2616, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4280 => 0.4110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -3.79% (0.6441 => 0.6197, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.70% (0.7198 => 0.6932, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.57% (0.4151 => 0.4003, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.9542 => 0.9205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.43% (0.3931 => 0.3796, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.37% (0.3621 => 0.3499, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.25% (0.6484 => 0.6273, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.23% (0.3658 => 0.3540, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.07% (0.4427 => 0.4291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -3.00% (20.7746 => 20.1514, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.94% (0.4321 => 0.4194, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.90% (0.3788 => 0.3678, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.60% (0.4083 => 0.3977, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.50% (0.7919 => 0.7721, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.27% (1.2210 => 1.1933, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -2.25% (17.1032 => 16.7181, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.16% (14.2083 => 13.9009, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.13% (6.7716 => 6.6277, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.08% (0.4813 => 0.4713, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.02% (1.0544 => 1.0331, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8731, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.96% (1.2221 => 1.1982, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -1.95% (4.3330 => 4.2486, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -1.92% (0.7982 => 0.7829, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.82% (7.0961 => 6.9671, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (1.2300 => 1.2092, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.41% (1.5610 => 1.5390, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.40% (0.8521 => 0.8402, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -1.31% (34.0927 => 33.6466, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -1.23% (2.4021 => 2.3726, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.0126 => 7.9259, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.96% (1.8100 => 0.6886, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0244, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7469, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0306, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.64% (4.9100 => 4.3385, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8593, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.19% (1.0557 => 1.0220, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (7.9763 => 7.7267, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/ary3: -2.72% (3.7241 => 3.6228, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.42% (1.3096 => 1.2779, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.81% (4.8776 => 4.7893, std.dev.: 0.0233) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4663, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1968, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.40% (1.6307 => 1.6078, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6679, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 22:34:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 00:34:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113063432.23C622A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7539?compare_to=7535&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7539, Order: 172343, Start Time: 2013-01-13 04:23:49, End Time: 2013-01-13 06:34:26 To: 7535, Order: 172337, Start Time: 2013-01-13 01:43:01, End Time: 2013-01-13 03:53:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (80.0038 => 81.1789, std.dev.: 0.1269) MultiSource/Benchmarks/llubenchmark/llu: 1.11% (3.7785 => 3.8206, std.dev.: 0.0124) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.85% (0.0649 => 0.0674, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8553 => 499.8256, std.dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.57% (1.1277 => 499.8256, std.dev.: 0.0160) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.82% (0.5229 => 1.6462, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 19.77% (14.9895 => 17.9528, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 43.42% (14.1553 => 20.3012, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/gs/gs: 17.70% (4.1105 => 4.8380, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 58.02% (1.1048 => 1.7458, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.92% (7.1582 => 37.6465, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.20% (3.4629 => 6.3787, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.53% (0.6222 => 1.0797, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.78% (0.0720 => 7.4432, std.dev.: 0.0120) MultiSource/Applications/SIBsim4/SIBsim4: 3835100.00% (0.0001 => 3.8352, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11190500.00% (0.0001 => 11.1906, std.dev.: 0.0329) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9851000.00% (0.0001 => 9.8511, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492800.00% (0.0001 => 5.4929, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.67% (1.1194 => 10.3731, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.47% (22.1758 => 55.5429, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.81% (2.9384 => 4.6076, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.26% (7.0540 => 10.8818, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.77% (1.5859 => 2.3910, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.69% (8.1363 => 11.9350, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.05% (2.2024 => 3.1065, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 40.97% (21.9371 => 30.9250, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: 39.18% (0.1432 => 0.1993, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 39.14% (0.3109 => 0.4326, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.69% (4.2646 => 5.7014, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.27% (1.5415 => 2.0544, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.24% (0.4615 => 0.6103, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.02% (0.1892 => 0.2460, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.37% (0.2271 => 0.2938, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 28.94% (0.4299 => 0.5543, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 28.87% (1.1642 => 1.5003, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.28% (0.6675 => 0.8563, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.70% (0.5105 => 0.6468, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.33% (0.1143 => 0.1444, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 25.92% (0.2554 => 0.3216, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 25.62% (0.1175 => 0.1476, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.57% (3.8922 => 4.8873, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.78% (1.0722 => 1.3379, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.92% (0.1906 => 0.2362, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.64% (1.4186 => 1.7539, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.61% (0.3121 => 0.3858, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.01% (0.0730 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.78% (9.4845 => 11.6453, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/hash: 22.59% (0.4289 => 0.5258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 22.10% (0.4620 => 0.5641, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.04% (0.2700 => 0.3295, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.67% (0.7115 => 0.8657, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.84% (5.7591 => 6.9595, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.33% (1.3050 => 1.5703, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.13% (0.7835 => 0.9412, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.68% (4.9449 => 5.9182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 19.59% (0.3098 => 0.3705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.47% (0.5860 => 0.7001, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.33% (0.6456 => 0.7704, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.15% (3.3354 => 3.9742, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.95% (0.8172 => 0.9721, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.93% (5.0018 => 5.9485, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.80% (0.7433 => 0.8756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.67% (0.5020 => 0.5907, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.45% (1.1840 => 1.3906, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.31% (0.9765 => 1.1455, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.5569 => 0.6525, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 17.12% (0.3423 => 0.4009, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.05% (0.3307 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.96% (3.8723 => 4.5291, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.68% (2.0273 => 2.3655, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.45% (0.5981 => 0.6965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.13% (2.2969 => 2.6673, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.98% (0.3441 => 0.3991, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.92% (0.8101 => 0.9391, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.77% (0.6450 => 0.7467, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 15.42% (0.2049 => 0.2365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.16% (0.3180 => 0.3662, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 14.96% (0.3283 => 0.3774, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.78% (1.1861 => 1.3614, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 14.64% (0.8921 => 1.0227, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.45% (0.3232 => 0.3699, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.06% (0.8067 => 0.9201, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.20% (0.3387 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 12.73% (0.3379 => 0.3809, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.48% (1.5603 => 1.7551, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.93% (0.2430 => 0.2720, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.91% (0.4636 => 0.5188, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.52% (17.1811 => 19.1602, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.38% (0.4103 => 0.4570, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.09% (0.4203 => 0.4669, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.03% (0.3282 => 0.3644, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.93% (14.3668 => 15.9372, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236) SingleSource/Benchmarks/Shootout-C++/moments: 10.52% (0.4048 => 0.4474, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 10.27% (0.3603 => 0.3973, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 10.04% (0.3684 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.93% (0.3826 => 0.4206, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.91% (0.3543 => 0.3894, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.03% (0.4064 => 0.4431, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.41% (0.2831 => 0.3069, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.34% (63.2438 => 68.5161, std.dev.: 0.0189) SingleSource/UnitTests/ObjC++/property-reference: 8.26% (0.7326 => 0.7931, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.92% (2.0665 => 2.2302, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: 7.86% (10.3673 => 11.1819, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 7.79% (1.2842 => 1.3842, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 7.59% (0.2871 => 0.3089, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.51% (0.2877 => 0.3093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.33% (0.2905 => 0.3118, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.71% (2.2022 => 2.3500, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.54% (0.3136 => 0.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.79% (7.9617 => 8.1835, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2543, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4504, std.dev.: 0.0086) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3104, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.00% (0.9957 => 1.0256, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9197, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.45% (3.6395 => 3.7285, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.94% (9.1159 => 9.2931, std.dev.: 0.0067) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.58% (1.0785 => 1.0955, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2795, std.dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 1.12% (3.7781 => 3.8206, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4498, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.70% (5.2763 => 1.1764, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.21% (0.8651 => 0.2145, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.24% (5.3855 => 4.4573, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.80% (5.3526 => 4.4533, std.dev.: 0.0085) MultiSource/Applications/JM/ldecod/ldecod: -13.53% (10.4361 => 9.0243, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.58% (1.7609 => 1.6098, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9605, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.46% (1.9577 => 0.6567, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.69% (1.5373 => 1.0194, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4167, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8610, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.56% (2.6546 => 2.0025, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.70% (1.6925 => 1.4267, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7341, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4952, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2976, std.dev.: 0.0636) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.07% (1.2373 => 1.1622, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.92% (8.1563 => 7.7547, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8296, std.dev.: 0.0080) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.31% (0.4808 => 0.4601, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0035) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2781, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.05% (3.6994 => 3.6604, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0064) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0000) Report Time: 4.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 22:37:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 00:37:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130113063739.B5C2E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7540?compare_to=7532&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7540, Order: 172337, Start Time: 2013-01-13 03:01:26, End Time: 2013-01-13 06:37:36 To: 7532, Order: 172326, Start Time: 2013-01-12 22:28:28, End Time: 2013-01-13 02:04:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (181 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.64% (0.6282 => 0.6385, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.02% (3.1499 => 3.1820, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.92% (115.2050 => 118.5656, std.dev.: 0.0760) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: -5.24% (0.2273 => 0.2154, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.92% (0.0625 => 0.0887, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.26% (0.2969 => 0.3808, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 28.15% (0.1620 => 0.2076, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.85% (0.4994 => 0.6385, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.43% (0.0452 => 0.0576, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.30% (0.4253 => 0.5414, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.93% (0.5900 => 0.7489, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.43% (0.4139 => 0.5233, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.78% (0.1021 => 0.1274, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.08% (0.5000 => 0.6204, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.54% (1.5932 => 1.9682, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.29% (0.0584 => 0.0720, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.22% (0.1107 => 0.1364, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.19% (0.0897 => 0.1105, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.53% (0.1003 => 0.1229, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.32% (0.1604 => 0.1962, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.14% (0.0822 => 0.1004, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.92% (0.0821 => 0.1001, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.81% (0.0541 => 0.0659, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 21.80% (0.1619 => 0.1972, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.62% (0.3903 => 0.4747, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.51% (0.0581 => 0.0706, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.05% (0.4029 => 0.4877, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 20.80% (0.0947 => 0.1144, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.66% (0.2014 => 0.2430, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.55% (0.2866 => 0.3455, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.88% (0.2736 => 0.3280, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 19.76% (0.5826 => 0.6977, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.62% (1.3152 => 1.5733, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 19.53% (0.5889 => 0.7039, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.44% (0.3271 => 0.3907, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.15% (0.3890 => 0.4635, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 19.10% (0.9697 => 1.1549, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 18.94% (0.0808 => 0.0961, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 18.59% (0.5546 => 0.6577, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.55% (0.1968 => 0.2333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.43% (0.2875 => 0.3405, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 18.31% (0.7171 => 0.8484, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.26% (0.2738 => 0.3238, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.23% (0.5026 => 0.5942, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.18% (0.4658 => 0.5505, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 18.09% (1.8794 => 2.2194, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/random: 18.02% (0.2803 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.92% (3.5627 => 4.2010, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 17.87% (0.2725 => 0.3212, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 17.83% (0.2714 => 0.3198, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/strcat: 17.78% (0.2750 => 0.3239, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.70% (1.6211 => 1.9080, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.66% (0.2729 => 0.3211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (0.2792 => 0.3284, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 17.61% (0.2823 => 0.3320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.60% (0.2813 => 0.3308, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/except: 17.50% (0.2811 => 0.3303, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.45% (0.2911 => 0.3419, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 17.44% (0.3004 => 0.3528, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 17.42% (0.9909 => 1.1635, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 17.34% (0.3096 => 0.3633, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.34% (0.2780 => 0.3262, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.31% (2.0673 => 2.4251, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/bh/bh: 17.21% (0.1284 => 0.1505, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.02% (4.4195 => 5.1719, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.01% (0.3362 => 0.3934, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.88% (1.9694 => 2.3019, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.76% (0.3258 => 0.3804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.71% (0.3267 => 0.3813, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.69% (0.3930 => 0.4586, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.67% (0.3060 => 0.3570, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.59% (2.7292 => 3.1820, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.46% (0.4361 => 0.5079, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.31% (1.9966 => 2.3223, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 16.31% (0.3317 => 0.3858, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 16.23% (0.3678 => 0.4275, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.20% (0.3124 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.14% (23.5202 => 27.3156, std.dev.: 0.0131) MultiSource/Applications/d/make_dparser: 16.08% (1.0781 => 1.2515, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 15.98% (0.3348 => 0.3883, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.93% (4.2109 => 4.8819, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.78% (0.3282 => 0.3800, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 15.75% (0.3726 => 0.4313, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 15.65% (0.3477 => 0.4021, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 15.50% (0.3465 => 0.4002, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3446 => 0.3979, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.45% (0.3625 => 0.4185, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.43% (0.3442 => 0.3973, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.42% (0.3496 => 0.4035, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.39% (0.3690 => 0.4258, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 15.38% (0.3460 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.36% (0.3469 => 0.4002, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.34% (0.3845 => 0.4435, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.34% (0.3488 => 0.4023, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 15.29% (0.4146 => 0.4780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.12% (0.3981 => 0.4583, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 15.06% (1.4269 => 1.6418, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 15.03% (0.4251 => 0.4890, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.88% (0.3650 => 0.4193, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.85% (0.3643 => 0.4184, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.66% (0.3724 => 0.4270, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 14.46% (0.2566 => 0.2937, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 14.37% (0.5012 => 0.5732, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 14.32% (0.7875 => 0.9003, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 13.13% (2.1653 => 2.4496, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.04% (0.6435 => 0.7274, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.94% (0.1028 => 0.1161, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.92% (2.1013 => 2.3728, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.77% (0.2068 => 0.2332, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.62% (4.6177 => 5.2006, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.2691 => 0.3022, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 12.29% (5.5417 => 6.2229, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.20% (0.2737 => 0.3071, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 12.00% (0.2075 => 0.2324, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.15% (0.3084 => 0.3428, std.dev.: 0.0048) MultiSource/Applications/minisat/minisat: 10.58% (0.3336 => 0.3689, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 10.33% (0.6634 => 0.7319, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 10.17% (0.4847 => 0.5340, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.10% (0.2040 => 0.2246, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.96% (0.5361 => 0.5895, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.91% (11.6398 => 12.7938, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.76% (0.1383 => 0.1518, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.08% (0.7426 => 0.8100, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (4.6926 => 5.1107, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: 8.49% (0.2391 => 0.2594, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.82% (2.0346 => 2.1938, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.41% (0.5584 => 0.5998, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 7.33% (11.9555 => 12.8319, std.dev.: 0.0134) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5231, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.78% (0.3693 => 0.4054, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 8.60% (0.2802 => 0.3043, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2422, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6844, std.dev.: 0.0062) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2043, std.dev.: 0.0394) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3112, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2831, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0823, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1050, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2070, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5811, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5557, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.95% (17.2379 => 14.3160, std.dev.: 0.1056) SingleSource/UnitTests/Vector/multiplies: -11.35% (2.3713 => 2.1021, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -10.32% (0.2402 => 0.2154, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8019, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.97% (14.0481 => 13.4906, std.dev.: 0.1548) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2240, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8012, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1015, std.dev.: 0.0589) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5813, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1571, std.dev.: 0.0612) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 12 23:00:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 01:00:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113070042.551342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7541?compare_to=7537&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7541, Order: 172345, Start Time: 2013-01-13 05:03:35, End Time: 2013-01-13 07:00:41 To: 7537, Order: 172340, Start Time: 2013-01-13 02:44:41, End Time: 2013-01-13 04:44:24 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 3 (7 on baseline) Performance Improvements: 6 (189 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1054 (867 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.62% (0.8946 => 0.9180, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 3.47% (0.4097 => 0.4239, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.59% (8.1408 => 8.3517, std.dev.: 0.0677) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.56% (8.8872 => 8.5704, std.dev.: 0.1135) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.25% (2.4302 => 2.3998, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -17.26% (3.7986 => 3.1431, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.74% (5.6382 => 5.3146, std.dev.: 0.0811) SingleSource/Benchmarks/Shootout/hash: -4.29% (4.2435 => 4.0615, std.dev.: 0.0220) MultiSource/Benchmarks/BitBench/five11/five11: -1.03% (5.6483 => 5.5900, std.dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.60% (1.1097 => 1.0919, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.86% (0.0221 => 0.0197, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.80% (0.0435 => 0.0388, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.23% (0.0341 => 0.0272, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.16% (0.0430 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0231 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1442 => 0.1449, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -1.58% (1.1604 => 1.1421, std.dev.: 0.0332) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.95% (0.3891 => 0.3967, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.78% (0.1455 => 0.1510, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.02% (0.0971 => 0.0932, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.19% (0.0273 => 0.0237, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.17% (0.0580 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.89% (1.1416 => 1.1518, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -27.59% (0.0029 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.99% (0.0609 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.89% (0.0224 => 0.0282, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7406 => 0.7409, std.dev.: 0.0197) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -75.00% (0.0004 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.86% (0.0077 => 0.0044, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7621 => 12.7460, std.dev.: 0.4913) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.54% (0.0336 => 0.0489, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320325.00% (0.0008 => 2.5634, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.24% (1.1825 => 2.4270, std.dev.: 0.0990) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.48% (0.2562 => 0.2805, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/pi: 3.17% (2.1390 => 2.2068, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (63.1520 => 64.2339, std.dev.: 0.2137) MultiSource/Applications/JM/lencod/lencod: 1.65% (6.8159 => 6.9286, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -47.28% (0.0808 => 0.0426, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -35.49% (0.0727 => 0.0469, std.dev.: 0.0023) SingleSource/Benchmarks/SmallPT/smallpt: -30.72% (0.1888 => 0.1308, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.94% (0.1684 => 0.1264, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.04% (0.0676 => 0.0527, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.91% (0.1009 => 0.0798, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -20.50% (1.8964 => 1.5077, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.61% (0.0862 => 0.0693, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -19.22% (0.0588 => 0.0475, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.35% (0.7686 => 0.6429, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.24% (1.0960 => 0.9180, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.13% (0.1079 => 0.0905, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -15.55% (1.0220 => 0.8631, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.39% (1.0986 => 0.9295, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.37% (0.4074 => 0.3448, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -14.49% (1.5979 => 1.3664, std.dev.: 0.0160) SingleSource/UnitTests/Vector/constpool: -13.32% (9.8875 => 8.5704, std.dev.: 0.1135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.28% (0.0783 => 0.0679, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -12.92% (0.1378 => 0.1200, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.87% (0.0847 => 0.0738, std.dev.: 0.0002) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.18% (1.2154 => 1.0674, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: -12.18% (2.4719 => 2.1709, std.dev.: 0.0116) MultiSource/Applications/hexxagon/hexxagon: -12.17% (1.1433 => 1.0042, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.81% (0.2481 => 0.2188, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.72% (1.3924 => 1.2292, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.72% (0.2372 => 0.2094, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.00% (0.7693 => 0.6847, std.dev.: 0.0141) MultiSource/Applications/sgefa/sgefa: -10.84% (0.3598 => 0.3208, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.83% (6.4235 => 5.7276, std.dev.: 0.0227) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -10.77% (0.1356 => 0.1210, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.74% (0.1210 => 0.1080, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.69% (1.5131 => 1.3514, std.dev.: 0.0127) MultiSource/Applications/lua/lua: -10.65% (4.6406 => 4.1465, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/loader/loader: -10.65% (0.3560 => 0.3181, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -10.50% (0.1610 => 0.1441, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.49% (10.2703 => 9.1929, std.dev.: 0.1039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.44% (0.1025 => 0.0918, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -10.03% (0.8653 => 0.7785, std.dev.: 0.0092) MultiSource/Applications/siod/siod: -9.70% (2.6437 => 2.3873, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.64% (0.1058 => 0.0956, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -9.43% (17.5634 => 15.9072, std.dev.: 0.0475) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.38% (1.6874 => 1.5292, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.16% (0.9124 => 0.8288, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.03% (1.1498 => 1.0460, std.dev.: 0.0081) MultiSource/Applications/ClamAV/clamscan: -8.84% (17.4365 => 15.8943, std.dev.: 0.0853) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.66% (0.9588 => 0.8758, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.44% (0.2618 => 0.2397, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.41% (0.2283 => 0.2091, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.24% (0.6885 => 0.6318, std.dev.: 0.0017) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.15% (1.1731 => 1.0775, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.05% (0.1317 => 0.1211, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.96% (1.3310 => 1.2250, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.88% (0.2577 => 0.2374, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.52% (0.5746 => 0.5314, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.37% (0.2144 => 0.1986, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.15% (1.0017 => 0.9301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -7.13% (0.5134 => 0.4768, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.10% (0.2100 => 0.1951, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: -7.02% (0.4002 => 0.3721, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -6.88% (3.7840 => 3.5235, std.dev.: 0.0132) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.84% (0.1798 => 0.1675, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.83% (0.2709 => 0.2524, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -6.75% (1.3979 => 1.3035, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hello: -6.69% (0.1928 => 0.1799, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.66% (0.9550 => 0.8914, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: -6.54% (0.2385 => 0.2229, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: -6.52% (0.1824 => 0.1705, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: -6.39% (0.2551 => 0.2388, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -6.14% (0.2135 => 0.2004, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.12% (0.3462 => 0.3250, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.09% (0.6934 => 0.6512, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.05% (0.9507 => 0.8932, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wc: -5.99% (0.2305 => 0.2167, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.97% (1.8127 => 1.7045, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.2725 => 0.2566, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.80% (0.9127 => 0.8598, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.76% (0.9422 => 0.8879, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.3665 => 0.3454, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.65% (0.3981 => 0.3756, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.55% (0.2993 => 0.2827, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.54% (0.9405 => 0.8884, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/except: -5.52% (0.2172 => 0.2052, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.46% (0.7693 => 0.7273, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.29% (0.8990 => 0.8514, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (0.9512 => 0.9009, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: -5.26% (0.7776 => 0.7367, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: -5.19% (1.4392 => 1.3645, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.08% (3.6295 => 3.4450, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.06% (5.0381 => 4.7834, std.dev.: 0.0368) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.95% (1.0234 => 0.9727, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.89% (0.9403 => 0.8943, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists1: -4.87% (0.3206 => 0.3050, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.84% (0.6135 => 0.5838, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.83% (1.0052 => 0.9566, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.82% (0.2615 => 0.2489, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.78% (0.9091 => 0.8656, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -4.64% (0.2564 => 0.2445, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.64% (0.5369 => 0.5120, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.60% (0.9788 => 0.9338, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: -4.59% (16.4479 => 15.6930, std.dev.: 0.0685) SingleSource/Benchmarks/Shootout-C++/ary2: -4.43% (0.2665 => 0.2547, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: -4.39% (0.3715 => 0.3552, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -4.37% (18.9377 => 18.1106, std.dev.: 0.0446) MultiSource/Benchmarks/MallocBench/gs/gs: -4.35% (4.5936 => 4.3940, std.dev.: 0.0303) MultiSource/Benchmarks/McCat/08-main/main: -4.32% (0.2915 => 0.2789, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.20% (1.2680 => 1.2147, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.04% (0.9993 => 0.9589, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -4.03% (0.4762 => 0.4570, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.01% (1.3220 => 1.2690, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.70% (4.6579 => 4.4857, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.68% (4.9104 => 4.7296, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.64% (1.0119 => 0.9751, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sieve: -3.57% (0.2913 => 0.2809, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.51% (0.9488 => 0.9155, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: -3.46% (0.6711 => 0.6479, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.42% (7.2721 => 7.0235, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.40% (0.6996 => 0.6758, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.40% (14.9757 => 14.4671, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.30% (1.0860 => 1.0502, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.22% (0.9855 => 0.9538, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.16% (0.8926 => 0.8644, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.14% (0.9214 => 0.8925, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.09% (0.3394 => 0.3289, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.04% (0.3847 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.00% (0.9061 => 0.8789, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -2.99% (7.3529 => 7.1328, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.93% (1.0088 => 0.9792, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.89% (0.9685 => 0.9405, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.77% (0.8893 => 0.8647, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: -2.76% (5.3553 => 5.2077, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.69% (0.9381 => 0.9129, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.66% (0.9612 => 0.9356, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.63% (0.8846 => 0.8613, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: -2.53% (0.4776 => 0.4655, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.53% (0.8732 => 0.8511, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.37% (4.8904 => 4.7743, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.27% (0.9998 => 0.9771, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: -2.15% (1.2708 => 1.2435, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.13% (0.9120 => 0.8926, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.12% (2.4519 => 2.3998, std.dev.: 0.0079) MultiSource/Applications/JM/lencod/lencod: -1.99% (16.7012 => 16.3692, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.84% (0.8912 => 0.8748, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.80% (0.9564 => 0.9392, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.79% (1.4805 => 1.4540, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.64% (0.9010 => 0.8862, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.34% (1.0867 => 1.0721, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.22% (0.9588 => 0.9471, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -1.18% (2.5772 => 2.5468, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.14% (0.9867 => 0.9755, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.03% (0.9372 => 0.6464, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/heapsort: -30.68% (4.4739 => 3.1012, std.dev.: 0.1427) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.24% (4.2042 => 3.1431, std.dev.: 0.0397) MultiSource/Applications/minisat/minisat: -22.41% (7.9891 => 6.1991, std.dev.: 0.0120) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.88% (0.1164 => 0.0921, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.09% (1.0816 => 0.8643, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.49% (1.5623 => 1.2734, std.dev.: 0.0259) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.87% (1.4235 => 1.2545, std.dev.: 0.0106) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.67% (1.6547 => 1.4781, std.dev.: 0.0412) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.62% (2.8778 => 2.5722, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: -10.26% (4.5259 => 4.0615, std.dev.: 0.0220) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.02% (0.4081 => 0.3672, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.53% (5.0421 => 4.6118, std.dev.: 0.0694) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.12% (4.4540 => 4.0923, std.dev.: 0.0564) SingleSource/Benchmarks/Shootout-C++/lists1: -8.12% (0.6628 => 0.6090, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.05% (0.3217 => 0.2958, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -7.87% (9.0650 => 8.3517, std.dev.: 0.0677) MultiSource/Benchmarks/Olden/mst/mst: -7.58% (0.1491 => 0.1378, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.94% (46.0987 => 42.9003, std.dev.: 0.6128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.40% (23.3986 => 21.9005, std.dev.: 0.1541) SingleSource/Benchmarks/Shootout/ary3: -5.70% (2.2304 => 2.1032, std.dev.: 0.0239) MultiSource/Benchmarks/Olden/health/health: -5.45% (0.3654 => 0.3455, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.15% (5.6033 => 5.3146, std.dev.: 0.0811) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.12% (1.4446 => 1.3706, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.93% (0.3349 => 0.3184, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.00% (42.3194 => 40.6281, std.dev.: 0.6468) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.98% (2.5170 => 2.4167, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/lists: -3.28% (17.2182 => 16.6534, std.dev.: 0.1307) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.66% (4.4730 => 4.3538, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.49% (1.0995 => 1.0721, std.dev.: 0.0081) MultiSource/Applications/lua/lua: -2.05% (29.0327 => 28.4375, std.dev.: 0.0460) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.00% (3.0082 => 2.9479, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/five11/five11: -1.97% (5.7021 => 5.5900, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.65% (3.7662 => 3.7041, std.dev.: 0.0199) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.2040 => 7.0935, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (3.1921 => 3.1449, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: -1.03% (1.5017 => 1.4863, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -9.36% (1.2047 => 1.0919, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.45% (0.0233 => 0.0197, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.97% (0.0451 => 0.0388, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -30.96% (0.0394 => 0.0272, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.49% (0.0445 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -93.33% (0.0015 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -5.29% (0.1530 => 0.1449, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -40.80% (1.9293 => 1.1421, std.dev.: 0.0332) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.03% (0.4049 => 0.3967, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1510 => 0.1510, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.0978 => 0.0932, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.13% (0.0276 => 0.0237, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.78% (0.0590 => 0.0550, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.85% (1.1617 => 1.1518, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -34.38% (0.0032 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.22% (0.0268 => 0.0282, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0197) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.17% (0.0092 => 0.0044, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7781 => 12.7460, std.dev.: 0.4913) Report Time: 2.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 00:09:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 02:09:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113080923.E567A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7542?compare_to=7538&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7542, Order: 172345, Start Time: 2013-01-13 06:33:41, End Time: 2013-01-13 08:09:20 To: 7538, Order: 172344, Start Time: 2013-01-13 04:36:56, End Time: 2013-01-13 06:10:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (98 on baseline) Performance Improvements: 0 (123 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (871 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.00% (0.3872 => 0.4027, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.03% (0.0974 => 0.1549, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.56% (0.6395 => 0.8797, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.87% (0.6395 => 0.8689, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.93% (0.6260 => 0.8384, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.68% (0.5805 => 0.7702, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.58% (0.5688 => 0.7541, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.42% (0.5456 => 0.7225, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.12% (0.6230 => 0.8231, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.60% (0.5567 => 0.7326, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.50% (0.5581 => 0.7339, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.48% (0.5575 => 0.7330, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.39% (0.5941 => 0.7806, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.83% (0.5802 => 0.7591, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.78% (0.5705 => 0.7461, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.65% (0.6033 => 0.7882, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.33% (0.5859 => 0.7636, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.14% (0.5849 => 0.7612, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.09% (0.5570 => 0.7246, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.05% (0.5478 => 0.7124, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.88% (0.6440 => 0.8364, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.79% (0.5569 => 0.7228, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.45% (0.5925 => 0.7670, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.40% (0.5591 => 0.7235, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.68% (0.6189 => 0.7964, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.60% (0.6052 => 0.7783, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.46% (0.5857 => 0.7524, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.33% (0.6676 => 0.8567, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.30% (0.6446 => 0.8270, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.26% (0.5863 => 0.7520, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.11% (0.6304 => 0.8076, std.dev.: 0.0201) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.67% (1.6474 => 2.1033, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.77% (0.6194 => 0.7852, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.55% (0.6660 => 0.8428, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.35% (0.6297 => 0.7956, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.34% (0.6681 => 0.8441, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.81% (0.6667 => 0.8321, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.60% (0.7524 => 0.9300, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.76% (0.7339 => 0.9009, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.38% (2.2587 => 2.7190, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325) MultiSource/Applications/lemon/lemon: 15.18% (1.1450 => 1.3188, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.33% (0.3357 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.43% (1.6364 => 1.8235, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.40% (4.5069 => 5.0208, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4916 => 0.5467, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 10.72% (0.4515 => 0.4999, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.45% (3.5339 => 3.9033, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.7021 => 0.7586, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.06% (1.2515 => 1.3399, std.dev.: 0.0177) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.01% (0.4524 => 0.4841, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.41% (1.4642 => 1.5581, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.25% (9.2283 => 9.8050, std.dev.: 0.1770) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.96% (1.2784 => 1.3546, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 5.55% (0.4861 => 0.5131, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.03% (0.3834 => 0.4027, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.31% (0.3319 => 0.3462, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.24% (0.3255 => 0.3393, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.71% (5.4682 => 5.6166, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 2.59% (5.0226 => 5.1526, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6750 => 0.6916, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4185, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.62% (0.8418 => 0.8554, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.3722 => 1.3885, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6739, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.30% (0.9531 => 1.0322, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4417, std.dev.: 0.0223) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1695, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5879, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2857, std.dev.: 0.0764) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6027, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4789, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.64% (0.3194 => 0.2982, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.14% (0.3812 => 0.3616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.05% (0.3880 => 0.3684, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.03% (0.3896 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.01% (0.4033 => 0.3831, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.97% (0.3057 => 0.2905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.83% (0.3891 => 0.3703, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.77% (0.4176 => 0.3977, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -4.73% (2.4924 => 2.3746, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/wc: -4.68% (0.3205 => 0.3055, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.64% (0.3016 => 0.2876, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.56% (0.2939 => 0.2805, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.36% (0.9852 => 0.9422, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: -4.36% (0.3026 => 0.2894, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.36% (0.4199 => 0.4016, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.24% (0.2428 => 0.2325, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3142 => 0.3009, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -4.07% (1.3148 => 1.2613, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -4.03% (0.6347 => 0.6091, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4280 => 0.4113, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.78% (0.4151 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.7198 => 0.6929, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.9542 => 0.9208, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.31% (0.3621 => 0.3501, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.21% (0.7779 => 0.7529, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.19% (0.6484 => 0.6277, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.08% (0.3867 => 0.3748, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -3.00% (20.7746 => 20.1515, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/moments: -2.97% (0.4248 => 0.4122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -2.90% (0.3788 => 0.3678, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.90% (0.3658 => 0.3552, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.35% (0.7919 => 0.7733, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.2210 => 1.1942, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (14.2083 => 13.8997, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.13% (6.7716 => 6.6271, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.07% (1.2221 => 1.1968, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -2.03% (17.1032 => 16.7557, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.00% (1.0544 => 1.0333, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -1.92% (16.1920 => 15.8815, std.dev.: 0.0095) MultiSource/Applications/lambda-0_1_3/lambda: -1.79% (0.7982 => 0.7839, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -1.74% (7.0961 => 6.9726, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: -1.71% (4.3330 => 4.2590, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (1.2300 => 1.2092, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.60% (0.9179 => 0.9032, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.42% (0.8521 => 0.8400, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.38% (1.5610 => 1.5394, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.05% (8.0126 => 7.9288, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.31% (1.8100 => 0.6822, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3154, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/mandel-2: -24.62% (1.3643 => 1.0284, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0398, std.dev.: 0.5282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.97% (2.5106 => 2.1348, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0349) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (7.9763 => 7.7242, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -2.64% (3.7241 => 3.6259, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.99% (1.3096 => 1.2835, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.55% (4.8776 => 4.8021, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6001, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6307 => 1.6096, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5886, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (3.7092 => 3.6669, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 01:18:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 03:18:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113091836.D3ABE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7543?compare_to=7539&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7543, Order: 172345, Start Time: 2013-01-13 07:04:22, End Time: 2013-01-13 09:18:33 To: 7539, Order: 172343, Start Time: 2013-01-13 04:23:49, End Time: 2013-01-13 06:34:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (213 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (659 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.11% (81.1789 => 80.2784, std.dev.: 0.1381) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0041) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0674 => 0.0651, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8256 => 499.8337, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.29% (1.1277 => 499.8337, std.dev.: 0.0109) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.84% (0.5229 => 1.6463, std.dev.: 0.0338) MultiSource/Applications/SPASS/SPASS: 19.96% (14.9895 => 17.9807, std.dev.: 0.4008) MultiSource/Applications/kimwitu++/kc: 43.44% (14.1553 => 20.3037, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 18.01% (4.1105 => 4.8509, std.dev.: 0.0229) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.97% (1.1048 => 1.7452, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.26% (7.1582 => 37.6704, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.55% (3.4629 => 6.3907, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.71% (0.6222 => 1.0808, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.53% (0.0720 => 7.4459, std.dev.: 0.1198) MultiSource/Applications/SIBsim4/SIBsim4: 3835500.00% (0.0001 => 3.8356, std.dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: 11154600.00% (0.0001 => 11.1547, std.dev.: 1.0578) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482800.00% (0.0001 => 5.4829, std.dev.: 0.0075) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.61% (1.1194 => 10.3725, std.dev.: 0.0070) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 150.94% (22.1758 => 55.6476, std.dev.: 0.8312) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 66.42% (0.0271 => 0.0451, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.62% (2.9384 => 4.6021, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.30% (7.0540 => 10.8840, std.dev.: 0.0200) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.79% (1.5859 => 2.3914, std.dev.: 0.0148) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.70% (8.1363 => 11.9357, std.dev.: 0.0133) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 41.09% (21.9371 => 30.9513, std.dev.: 0.4944) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.96% (2.2024 => 3.1044, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 39.08% (0.3109 => 0.4324, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0008) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.81% (4.2646 => 5.7064, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.33% (1.5415 => 2.0553, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.37% (0.4615 => 0.6109, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.92% (0.1892 => 0.2458, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.46% (0.2271 => 0.2940, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 29.43% (0.4299 => 0.5564, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 29.07% (1.1642 => 1.5026, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.33% (0.6675 => 0.8566, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.65% (0.1584 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.03% (0.5105 => 0.6485, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 26.70% (0.2554 => 0.3236, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.42% (0.1143 => 0.1445, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 25.68% (0.1655 => 0.2080, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.60% (3.8922 => 4.8886, std.dev.: 0.0155) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 24.78% (1.0722 => 1.3379, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.05% (1.4186 => 1.7598, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.15% (0.0730 => 0.0899, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.13% (0.1695 => 0.2087, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 23.03% (9.4845 => 11.6692, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash: 22.52% (0.4289 => 0.5255, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.41% (0.2700 => 0.3305, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 22.26% (0.7835 => 0.9579, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 21.99% (0.4620 => 0.5636, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.70% (0.7115 => 0.8659, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 20.95% (5.7591 => 6.9655, std.dev.: 0.1253) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.63% (0.1236 => 0.1491, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.31% (1.3050 => 1.5701, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.80% (4.9449 => 5.9239, std.dev.: 0.0350) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.64% (0.5860 => 0.7011, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 19.56% (0.3098 => 0.3704, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 19.48% (3.3354 => 3.9850, std.dev.: 0.0936) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.47% (0.8172 => 0.9763, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/bigfib: 19.42% (0.6456 => 0.7710, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.18% (0.1940 => 0.2312, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.92% (5.0018 => 5.9481, std.dev.: 0.0256) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.10% (0.5569 => 0.6577, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.89% (0.5020 => 0.5918, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 17.77% (0.7433 => 0.8754, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.69% (0.2758 => 0.3246, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 17.40% (1.1840 => 1.3900, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.31% (0.9765 => 1.1455, std.dev.: 0.0054) MultiSource/Applications/lua/lua: 17.27% (3.8723 => 4.5412, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.18% (0.3307 => 0.3875, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.15% (0.3423 => 0.4010, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 16.74% (2.0273 => 2.3666, std.dev.: 0.0583) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.45% (0.5981 => 0.6965, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 16.40% (2.2969 => 2.6737, std.dev.: 0.0818) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.09% (0.1044 => 0.1212, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.00% (0.6450 => 0.7482, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.87% (0.3441 => 0.3987, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.84% (0.8101 => 0.9384, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 15.47% (0.2049 => 0.2366, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.16% (0.3180 => 0.3662, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 14.89% (0.3283 => 0.3772, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.82% (0.8921 => 1.0243, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.70% (1.1861 => 1.3605, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3232 => 0.3696, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.08% (0.8067 => 0.9203, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 13.20% (0.3387 => 0.3834, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 12.67% (0.3379 => 0.3807, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 12.46% (1.5603 => 1.7547, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.32% (0.3865 => 0.4341, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.95% (0.4636 => 0.5190, std.dev.: 0.0078) MultiSource/Applications/sqlite3/sqlite3: 11.56% (17.1811 => 19.1677, std.dev.: 0.0218) SingleSource/UnitTests/ObjC/parameter-passing: 11.56% (0.3927 => 0.4381, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.4103 => 0.4569, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.07% (0.2430 => 0.2699, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.99% (0.4203 => 0.4665, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.93% (14.3668 => 15.9378, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.4048 => 0.4473, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399) SingleSource/Benchmarks/Shootout-C++/sieve: 10.32% (0.3603 => 0.3975, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.12% (0.3826 => 0.4213, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 10.02% (0.3684 => 0.4053, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.10% (0.4064 => 0.4434, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.82% (0.6030 => 0.6562, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.41% (0.5925 => 0.6423, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.37% (63.2438 => 68.5357, std.dev.: 0.0741) SingleSource/Benchmarks/Shootout-C++/strcat: 8.34% (0.2831 => 0.3067, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: 7.99% (1.2842 => 1.3868, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 7.82% (10.3673 => 11.1777, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.74% (2.0665 => 2.2264, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.67% (0.3650 => 0.3930, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.52% (0.2871 => 0.3087, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 7.44% (0.2877 => 0.3091, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.27% (0.3162 => 0.3392, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.09% (0.2891 => 0.3096, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.96% (0.2872 => 0.3072, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.94% (0.3935 => 0.4208, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.79% (0.2756 => 0.2943, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (2.2022 => 2.3508, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3052 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/random: 6.60% (0.2802 => 0.2987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.59% (0.2793 => 0.2977, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.44% (0.3136 => 0.3338, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.85% (7.9617 => 8.1883, std.dev.: 0.0310) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2507, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.93% (4.2280 => 4.4789, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.3316 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.05% (0.9957 => 1.0261, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9122, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.0313 => 1.0564, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.17% (3.6395 => 3.7185, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2898, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2792, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4563, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1770, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.28% (5.3855 => 4.4547, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.84% (5.3526 => 4.4512, std.dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: -13.52% (10.4361 => 9.0255, std.dev.: 0.1607) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.54% (1.7609 => 1.6105, std.dev.: 0.0045) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9735, std.dev.: 0.0220) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.84% (1.9577 => 0.6688, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3058, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4298, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8644, std.dev.: 0.1298) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0068, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: -16.66% (2.5528 => 2.1275, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4211, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7329, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4958, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9124, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.07% (19.9488 => 18.3389, std.dev.: 0.0222) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.30% (1.2373 => 1.1593, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.15% (8.1563 => 7.7366, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8014, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.92% (3.2827 => 3.1541, std.dev.: 0.0426) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.83% (5.0483 => 4.9558, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.6994 => 3.6378, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.62% (3.7221 => 3.6619, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0033) Report Time: 5.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 01:28:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 03:28:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113092847.A5DAE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7544?compare_to=7541&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7544, Order: 172346, Start Time: 2013-01-13 07:27:28, End Time: 2013-01-13 09:28:46 To: 7541, Order: 172345, Start Time: 2013-01-13 05:03:35, End Time: 2013-01-13 07:00:41 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (7 on baseline) Performance Improvements: 2 (75 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1052 (981 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.75% (0.2827 => 0.2933, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 2.26% (0.7785 => 0.7961, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.09% (1.2292 => 1.2549, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (0.8758 => 0.8895, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 40.44% (1.4781 => 2.0759, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.22% (0.3288 => 0.3591, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 2.38% (8.6505 => 8.8563, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.26% (2.6599 => 2.7201, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.78% (3.9515 => 4.0218, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -3.77% (0.4239 => 0.4079, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -1.27% (4.3670 => 4.3114, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.50% (1.0919 => 1.1192, std.dev.: 0.0785) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.20% (0.0197 => 0.0223, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.60% (0.0388 => 0.0433, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 24.63% (0.0272 => 0.0339, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.31% (0.0319 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.94% (0.0425 => 0.0429, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0221 => 0.0222, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.43% (0.0230 => 0.0231, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.38% (0.1449 => 0.1498, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -0.61% (1.1421 => 1.1351, std.dev.: 0.0286) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.61% (0.3967 => 0.4150, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.90% (0.1510 => 0.1436, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.65% (0.0932 => 0.0966, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.19% (0.0237 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.09% (0.0550 => 0.0567, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1518 => 1.1574, std.dev.: 0.0933) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 38.10% (0.0021 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.30% (0.0615 => 0.0607, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.71% (0.0282 => 0.0284, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.11% (0.7409 => 0.7401, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 68.18% (0.0044 => 0.0074, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.46% (12.7460 => 12.8042, std.dev.: 0.1010) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 54.76% (0.0336 => 0.0520, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320087.50% (0.0008 => 2.5615, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.96% (1.1825 => 2.4355, std.dev.: 0.0854) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.45% (1.6547 => 2.0759, std.dev.: 0.0531) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.87% (0.2562 => 0.2866, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 3.44% (2.1390 => 2.2125, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (63.1520 => 64.1412, std.dev.: 0.3054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -38.38% (0.0727 => 0.0448, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.92% (0.0692 => 0.0478, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: -26.75% (0.1888 => 0.1383, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.40% (0.1684 => 0.1290, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -20.29% (1.8964 => 1.5116, std.dev.: 0.1267) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.03% (0.0862 => 0.0698, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.64% (0.7686 => 0.6407, std.dev.: 0.0273) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.73% (0.4074 => 0.3433, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.51% (1.0986 => 0.9282, std.dev.: 0.0156) MultiSource/Applications/spiff/spiff: -14.47% (1.0220 => 0.8741, std.dev.: 0.0325) MultiSource/Applications/Burg/burg: -12.70% (1.5979 => 1.3950, std.dev.: 0.0216) MultiSource/Applications/hexxagon/hexxagon: -11.98% (1.1433 => 1.0063, std.dev.: 0.0064) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.87% (1.2154 => 1.0711, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: -11.75% (2.4719 => 2.1815, std.dev.: 0.0298) MultiSource/Applications/aha/aha: -11.54% (0.1378 => 0.1219, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.85% (6.4235 => 5.7268, std.dev.: 0.0062) MultiSource/Applications/lua/lua: -10.60% (4.6406 => 4.1486, std.dev.: 0.0609) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.48% (0.7693 => 0.6887, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.99% (10.2703 => 9.2448, std.dev.: 0.3705) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.88% (1.3924 => 1.2549, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.78% (0.2372 => 0.2140, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: -9.20% (0.3598 => 0.3267, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -9.15% (2.6437 => 2.4017, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: -8.61% (17.5634 => 16.0512, std.dev.: 0.3113) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.15% (1.1731 => 1.0775, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -8.00% (0.8653 => 0.7961, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.45% (0.2618 => 0.2423, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.23% (0.9588 => 0.8895, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.95% (0.2144 => 0.1995, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: -6.78% (0.2006 => 0.1870, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -6.64% (0.5134 => 0.4793, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: -6.25% (1.3979 => 1.3106, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/matrix: -5.95% (0.2385 => 0.2243, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.91% (0.7693 => 0.7238, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.90% (0.3981 => 0.3746, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/moments: -5.72% (0.4002 => 0.3773, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.09% (3.6295 => 3.4447, std.dev.: 0.0612) SingleSource/Benchmarks/Shootout-C++/methcall: -5.01% (0.2135 => 0.2028, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.01% (0.2615 => 0.2484, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.93% (0.9127 => 0.8677, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.86% (5.0381 => 4.7933, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.83% (0.9405 => 0.8951, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: -4.73% (0.2725 => 0.2596, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.62% (1.0234 => 0.9761, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.47% (0.5369 => 0.5129, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists1: -4.43% (0.3206 => 0.3064, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.12% (0.3394 => 0.3254, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.08% (4.6579 => 4.4680, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: -4.08% (16.4479 => 15.7775, std.dev.: 0.1064) SingleSource/Benchmarks/Shootout-C++/ary: -4.04% (0.2551 => 0.2448, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.01% (0.3093 => 0.2969, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.96% (0.6135 => 0.5892, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.77% (1.3220 => 1.2722, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.13% (7.2721 => 7.0445, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.10% (1.0088 => 0.9775, std.dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: -1.71% (5.3553 => 5.2639, std.dev.: 0.0297) MultiSource/Benchmarks/nbench/nbench: -1.33% (1.2708 => 1.2539, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.70% (0.9372 => 0.6495, std.dev.: 0.1007) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.30% (4.2042 => 3.2248, std.dev.: 0.3247) MultiSource/Applications/minisat/minisat: -22.32% (7.9891 => 6.2056, std.dev.: 0.5906) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.14% (0.1164 => 0.1011, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: -11.74% (0.1090 => 0.0962, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/hash: -10.56% (4.5259 => 4.0481, std.dev.: 0.1642) MultiSource/Applications/SPASS/SPASS: -9.99% (9.0650 => 8.1596, std.dev.: 0.2266) SingleSource/Benchmarks/Shootout-C++/lists1: -9.70% (0.6628 => 0.5985, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.24% (0.4081 => 0.3704, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.06% (0.3217 => 0.2990, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.58% (1.4446 => 1.3784, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/lists: -3.35% (17.2182 => 16.6421, std.dev.: 0.0746) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.28% (2.5170 => 2.4344, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.90% (0.5826 => 0.5657, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/chomp: -2.80% (1.0425 => 1.0133, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.25% (1.0995 => 1.0748, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/mandel-2: -2.24% (0.8521 => 0.8330, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -2.17% (4.4730 => 4.3760, std.dev.: 0.0237) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.10% (1.2047 => 1.1192, std.dev.: 0.0785) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.09% (0.1530 => 0.1498, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -41.17% (1.9293 => 1.1351, std.dev.: 0.0286) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.49% (0.4049 => 0.4150, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.90% (0.1510 => 0.1436, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.23% (0.0978 => 0.0966, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.90% (0.0590 => 0.0567, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1617 => 1.1574, std.dev.: 0.0933) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (0.0268 => 0.0284, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0041) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.20% (12.7781 => 12.8042, std.dev.: 0.1010) Report Time: 4.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 02:07:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 04:07:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113100717.2C3042A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7545?compare_to=7542&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7545, Order: 172349, Start Time: 2013-01-13 08:33:13, End Time: 2013-01-13 10:07:14 To: 7542, Order: 172345, Start Time: 2013-01-13 06:33:41, End Time: 2013-01-13 08:09:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 1 (134 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.15% (3.7665 => 3.8097, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/siod/siod: -1.00% (2.3775 => 2.3537, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.14% (0.0974 => 0.1550, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.20% (0.1500 => 0.2163, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.09% (0.6395 => 0.8767, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.23% (0.6395 => 0.8648, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.47% (0.6260 => 0.8355, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.30% (0.5688 => 0.7525, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.16% (0.5805 => 0.7672, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.44% (0.6230 => 0.8189, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.09% (0.5567 => 0.7298, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.00% (0.5941 => 0.7783, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.61% (0.5802 => 0.7578, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.06% (0.5705 => 0.7420, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.92% (0.5849 => 0.7599, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.90% (0.5859 => 0.7611, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.55% (0.5478 => 0.7097, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.34% (0.5570 => 0.7204, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.29% (0.5569 => 0.7200, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.13% (0.5925 => 0.7651, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.05% (0.5591 => 0.7215, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.20% (0.6189 => 0.7934, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.19% (0.5857 => 0.7508, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.12% (0.6052 => 0.7754, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.04% (0.6676 => 0.8548, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.89% (0.5863 => 0.7498, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.59% (0.6304 => 0.8043, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.01% (1.6474 => 2.0924, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.48% (0.6194 => 0.7834, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.98% (0.6681 => 0.8417, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.98% (0.6297 => 0.7933, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.27% (0.6667 => 0.8285, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.35% (0.7524 => 0.9281, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.35% (0.7339 => 0.8979, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.84% (2.2587 => 2.7068, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.72% (1.1450 => 1.3136, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.87% (0.1982 => 0.2237, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.11% (0.4916 => 0.5462, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.09% (1.6364 => 1.8179, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.94% (4.5069 => 5.0001, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 10.83% (0.4515 => 0.5004, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.14% (3.5339 => 3.8923, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.2385 => 0.2591, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.7021 => 0.7555, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.40% (0.2001 => 0.2149, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 6.93% (1.2515 => 1.3382, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.32% (0.5329 => 0.5666, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.21% (9.2283 => 9.8017, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash: 5.86% (0.4524 => 0.4789, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.76% (1.4642 => 1.5486, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.72% (1.2784 => 1.3515, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 5.37% (0.4861 => 0.5122, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.3255 => 0.3387, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.66% (5.0226 => 5.1563, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.3864 => 1.4196, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6750 => 0.6894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.09% (5.4682 => 5.5826, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 1.59% (0.8418 => 0.8552, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6791, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.17% (1.2783 => 1.3700, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.70% (5.1955 => 5.4398, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1677, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5251, std.dev.: 0.0874) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1045, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 1.77% (3.7435 => 3.8097, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2819, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6056, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.06% (4.4335 => 4.4805, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.13% (0.1281 => 0.1100, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.1431 => 0.1326, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -6.89% (0.3194 => 0.2974, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.57% (0.1584 => 0.1480, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.79% (0.3837 => 0.3615, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.56% (0.3812 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3848 => 0.3640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.39% (0.3880 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.36% (0.3896 => 0.3687, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.26% (0.4033 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.22% (0.3891 => 0.3688, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.09% (0.2871 => 0.2725, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.90% (2.4924 => 2.3702, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.81% (0.2933 => 0.2792, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.74% (2.1713 => 2.0684, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.71% (0.3821 => 0.3641, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.69% (0.4199 => 0.4002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.66% (0.3025 => 0.2884, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.48% (0.3059 => 0.2922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (0.9852 => 0.9418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.39% (0.3142 => 0.3004, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -4.37% (0.4280 => 0.4093, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.14% (1.3148 => 1.2604, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.12% (0.4151 => 0.3980, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.85% (0.7198 => 0.6921, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.3931 => 0.3780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.63% (0.4321 => 0.4164, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -3.59% (0.3621 => 0.3491, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.55% (0.7779 => 0.7503, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.40% (0.3849 => 0.3718, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.39% (0.9542 => 0.9219, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.37% (0.4427 => 0.4278, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists1: -3.34% (0.3867 => 0.3738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -3.20% (0.4248 => 0.4112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.12% (0.3788 => 0.3670, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.87% (0.7919 => 0.7692, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.87% (0.4083 => 0.3966, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.66% (0.4813 => 0.4685, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2445, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.44% (1.0544 => 1.0287, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.38% (1.2221 => 1.1930, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7005, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.34% (14.2083 => 13.8754, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: -2.34% (4.3330 => 4.2316, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.32% (1.2210 => 1.1927, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.24% (6.7716 => 6.6199, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: -2.14% (16.1920 => 15.8460, std.dev.: 0.0194) MultiSource/Applications/siod/siod: -2.01% (2.4021 => 2.3537, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -1.98% (0.7982 => 0.7824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -1.91% (0.9179 => 0.9004, std.dev.: 0.0040) MultiSource/Applications/hbd/hbd: -1.84% (1.5610 => 1.5323, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: -1.78% (7.0961 => 6.9700, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: -1.59% (34.0927 => 33.5505, std.dev.: 0.0902) MultiSource/Applications/lua/lua: -1.39% (4.0594 => 4.0030, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.24% (8.0126 => 7.9130, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -1.11% (18.2933 => 18.0897, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.19% (1.8100 => 0.6843, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.19% (0.1983 => 0.1424, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.06% (1.3643 => 1.0224, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0403, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.69% (4.3779 => 3.3844, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2075, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1330, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.65% (5.2027 => 4.8046, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8594, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (7.9763 => 7.7314, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.8776 => 4.8005, std.dev.: 0.0216) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3040 => 7.1951, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6104, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 4.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 03:27:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 05:27:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130113112716.B0CF82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7546?compare_to=7540&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7546, Order: 172345, Start Time: 2013-01-13 07:39:40, End Time: 2013-01-13 11:27:10 To: 7540, Order: 172337, Start Time: 2013-01-13 03:01:26, End Time: 2013-01-13 06:37:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (176 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (761 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (2.4251 => 2.3997, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.35% (0.0547 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.65% (0.2969 => 0.3790, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.31% (0.1106 => 0.1408, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 26.72% (0.0947 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.60% (0.4139 => 0.5240, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.45% (0.4253 => 0.5378, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.25% (0.5900 => 0.7449, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.67% (0.0822 => 0.1033, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.91% (0.4994 => 0.6238, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.53% (0.1003 => 0.1249, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.06% (0.5000 => 0.6203, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 22.83% (1.5932 => 1.9570, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.22% (0.1107 => 0.1353, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.70% (0.1604 => 0.1952, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.56% (0.1549 => 0.1883, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.04% (0.3903 => 0.4724, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.00% (0.4029 => 0.4835, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.1088 => 0.1298, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 18.90% (0.5826 => 0.6927, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.87% (0.3890 => 0.4624, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.68% (0.2736 => 0.3247, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.60% (0.2866 => 0.3399, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 18.48% (0.5546 => 0.6571, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.46% (1.3152 => 1.5580, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 18.41% (0.5889 => 0.6973, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.40% (0.3271 => 0.3873, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.39% (0.1968 => 0.2330, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 17.94% (0.9697 => 1.1437, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 17.84% (1.8794 => 2.2147, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.60% (0.4658 => 0.5478, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.43% (3.5627 => 4.1836, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.18% (1.6211 => 1.8996, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.15% (0.2875 => 0.3368, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 17.11% (0.7171 => 0.8398, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: 16.90% (0.1284 => 0.1501, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 16.66% (0.9909 => 1.1560, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.59% (0.2911 => 0.3394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.58% (0.2750 => 0.3206, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.58% (0.3004 => 0.3502, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.55% (0.2792 => 0.3254, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: 16.53% (0.2813 => 0.3278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.52% (0.2803 => 0.3266, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.51% (0.2738 => 0.3190, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 16.44% (0.2823 => 0.3287, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: 16.40% (0.2780 => 0.3236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 16.40% (0.2811 => 0.3272, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 16.40% (0.2714 => 0.3159, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.35% (1.9694 => 2.2914, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (0.2725 => 0.3170, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.31% (0.2729 => 0.3174, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.23% (0.3488 => 0.4054, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.21% (1.9966 => 2.3202, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.16% (0.3930 => 0.4565, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.08% (2.0673 => 2.3997, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.01% (4.4195 => 5.1270, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/wc: 15.89% (0.3096 => 0.3588, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.89% (0.4361 => 0.5054, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.81% (0.3195 => 0.3700, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/ary3: 15.67% (0.3267 => 0.3779, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 15.63% (1.0781 => 1.2466, std.dev.: 0.0312) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.62% (2.7292 => 3.1554, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.61% (4.2109 => 4.8681, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 15.59% (0.3258 => 0.3766, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 15.59% (0.3496 => 0.4041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.47% (0.3465 => 0.4001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.46% (0.3060 => 0.3533, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.46% (0.3442 => 0.3974, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.44% (0.3446 => 0.3978, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.40% (23.5202 => 27.1417, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary2: 15.32% (0.3317 => 0.3825, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.24% (0.3124 => 0.3600, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.10% (0.3650 => 0.4201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.09% (0.3678 => 0.4233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.99% (0.3282 => 0.3774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.98% (0.4146 => 0.4767, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.96% (0.3348 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.93% (0.3643 => 0.4187, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.92% (0.3726 => 0.4282, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.90% (0.3362 => 0.3863, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.81% (0.3625 => 0.4162, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/lists1: 14.81% (0.3477 => 0.3992, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.77% (1.4269 => 1.6377, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 14.74% (0.3724 => 0.4273, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.56% (0.4251 => 0.4870, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 14.29% (0.7875 => 0.9000, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.23% (0.3690 => 0.4215, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 14.22% (0.2566 => 0.2931, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.22% (0.3981 => 0.4547, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.04% (0.3845 => 0.4385, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.1090 => 0.1243, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.63% (0.5012 => 0.5695, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 13.30% (0.2691 => 0.3049, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 13.10% (2.1653 => 2.4490, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.65% (0.6435 => 0.7249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 12.34% (0.2075 => 0.2331, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 12.33% (4.6177 => 5.1871, std.dev.: 0.0050) MultiSource/Applications/SPASS/SPASS: 12.32% (5.5417 => 6.2247, std.dev.: 0.0516) MultiSource/Benchmarks/mafft/pairlocalalign: 11.92% (2.1013 => 2.3517, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.2737 => 0.3059, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.26% (0.3498 => 0.3892, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.60% (0.5361 => 0.5929, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 10.46% (0.3336 => 0.3685, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.32% (0.2103 => 0.2320, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.09% (11.6398 => 12.8146, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 10.05% (0.4847 => 0.5334, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.95% (0.2040 => 0.2243, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.47% (0.7426 => 0.8129, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.20% (4.6926 => 5.1242, std.dev.: 0.0101) MultiSource/Applications/lemon/lemon: 8.20% (0.2391 => 0.2587, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 8.13% (2.0346 => 2.2000, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.03% (0.1383 => 0.1494, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.61% (0.5584 => 0.6009, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: 7.09% (11.9555 => 12.8034, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5217, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.26% (0.0734 => 0.0868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 11.17% (0.2802 => 0.3115, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.43% (0.3693 => 0.4078, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2375, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6697, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8938, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6909, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.92% (0.6276 => 0.6459, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2109, std.dev.: 0.0079) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3057, std.dev.: 0.0143) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.39% (1.0142 => 1.0283, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0830, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6860, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.08% (3.1722 => 3.2064, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4796, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5850, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.98% (25.4195 => 16.5275, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.12% (17.2379 => 14.2868, std.dev.: 0.1246) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8002, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -4.12% (14.0481 => 13.4700, std.dev.: 0.1335) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2056, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8067, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2260, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5805, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.4998, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2183, std.dev.: 0.3846) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.02% (16.2163 => 16.0505, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 5.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 03:43:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 05:43:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113114301.1CD472A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7547?compare_to=7544&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7547, Order: 172351, Start Time: 2013-01-13 09:45:50, End Time: 2013-01-13 11:43:00 To: 7544, Order: 172346, Start Time: 2013-01-13 07:27:28, End Time: 2013-01-13 09:28:46 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (6 on baseline) Performance Improvements: 10 (178 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.45% (0.6551 => 0.6777, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.34% (0.8741 => 0.8858, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.31% (1.4620 => 1.8612, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.20% (0.7748 => 0.8693, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.50% (0.4079 => 0.4181, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.47% (1.0748 => 1.0906, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.30% (11.4876 => 11.6375, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -20.48% (0.0703 => 0.0559, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.22% (0.0629 => 0.0527, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.14% (0.2120 => 0.2011, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.36% (0.3864 => 0.3734, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.86% (0.9086 => 0.8917, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -26.27% (2.0759 => 1.5305, std.dev.: 0.0900) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.07% (4.3074 => 4.0889, std.dev.: 0.0695) SingleSource/Benchmarks/Shootout/matrix: -4.51% (1.6362 => 1.5624, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -2.90% (1.7851 => 1.7334, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.66% (2.9943 => 2.9445, std.dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.07% (1.1192 => 1.1184, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0223 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.40% (0.0433 => 0.0349, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.60% (0.0339 => 0.0259, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.87% (0.0320 => 0.0250, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -36.71% (0.0207 => 0.0131, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -28.83% (0.0222 => 0.0158, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.09% (0.0231 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -3.60% (0.1498 => 0.1444, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 0.67% (1.1351 => 1.1427, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.96% (0.4150 => 0.3944, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.06% (0.1436 => 0.1480, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.38% (0.0966 => 0.0989, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.44% (0.0273 => 0.0209, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0567 => 0.0570, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.70% (1.1574 => 1.1493, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.85% (0.0026 => 0.0025, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.87% (0.0607 => 0.0541, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.97% (0.0284 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.80% (0.7401 => 0.7342, std.dev.: 0.0058) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.86% (0.0074 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.41% (12.8042 => 12.7517, std.dev.: 0.0304) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.30% (0.0336 => 0.0505, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321175.00% (0.0008 => 2.5702, std.dev.: 0.0649) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.78% (1.1825 => 2.4334, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.01% (0.2562 => 0.2844, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.59% (6.8159 => 6.9243, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 1.09% (3.5910 => 3.6300, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.59% (0.0808 => 0.0480, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.40% (0.0727 => 0.0506, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.06% (0.0692 => 0.0484, std.dev.: 0.0004) SingleSource/Benchmarks/SmallPT/smallpt: -28.02% (0.1888 => 0.1359, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -26.37% (0.1684 => 0.1240, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.90% (0.0862 => 0.0656, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.60% (0.1009 => 0.0781, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -21.00% (1.8964 => 1.4982, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.05% (0.0676 => 0.0554, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.80% (1.0960 => 0.9009, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.21% (0.7686 => 0.6440, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.31% (1.0986 => 0.9304, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.92% (0.4074 => 0.3507, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -13.33% (1.0220 => 0.8858, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -13.15% (1.5979 => 1.3878, std.dev.: 0.0057) SingleSource/UnitTests/Vector/constpool: -13.14% (9.8875 => 8.5878, std.dev.: 0.2410) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.63% (0.0847 => 0.0740, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -12.60% (1.1433 => 0.9993, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.26% (0.0889 => 0.0780, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.93% (1.2154 => 1.0704, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: -11.59% (2.4719 => 2.1855, std.dev.: 0.0048) MultiSource/Applications/aha/aha: -11.54% (0.1378 => 0.1219, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.50% (6.4235 => 5.6850, std.dev.: 0.0051) MultiSource/Applications/lua/lua: -11.10% (4.6406 => 4.1254, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.84% (1.3924 => 1.2414, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.56% (1.5131 => 1.3533, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.23% (0.7693 => 0.6906, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -10.08% (0.5746 => 0.5167, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/health/health: -10.06% (0.1610 => 0.1448, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.87% (10.2703 => 9.2569, std.dev.: 0.0519) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.56% (0.6885 => 0.6227, std.dev.: 0.0087) MultiSource/Applications/lambda-0_1_3/lambda: -9.49% (0.8653 => 0.7832, std.dev.: 0.0158) MultiSource/Applications/siod/siod: -9.46% (2.6437 => 2.3937, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -9.17% (17.5634 => 15.9526, std.dev.: 0.1207) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.15% (1.6874 => 1.5330, std.dev.: 0.0089) MultiSource/Applications/sgefa/sgefa: -9.14% (0.3598 => 0.3269, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.11% (1.1498 => 1.0451, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.07% (0.3560 => 0.3237, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.97% (0.9588 => 0.8728, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.91% (0.2481 => 0.2260, std.dev.: 0.0036) MultiSource/Applications/ClamAV/clamscan: -8.47% (17.4365 => 15.9598, std.dev.: 0.0204) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.46% (1.1731 => 1.0738, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.00% (0.1587 => 0.1460, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.88% (0.9124 => 0.8405, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -7.63% (0.2006 => 0.1853, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.62% (0.2283 => 0.2109, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: -7.62% (0.1824 => 0.1685, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.53% (0.2615 => 0.2418, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.38% (0.2372 => 0.2197, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.37% (1.0017 => 0.9279, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.19% (1.3310 => 1.2353, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/hash2: -6.84% (0.5134 => 0.4783, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.80% (1.8127 => 1.6895, std.dev.: 0.0163) MultiSource/Applications/d/make_dparser: -6.66% (3.7840 => 3.5320, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: -6.60% (0.4002 => 0.3738, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.48% (0.2100 => 0.1964, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.44% (0.9550 => 0.8935, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -6.42% (1.3979 => 1.3081, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.42% (0.2709 => 0.2535, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.27% (0.3462 => 0.3245, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.98% (0.3394 => 0.3191, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.88% (0.3981 => 0.3747, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (0.2135 => 0.2010, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.76% (0.3665 => 0.3454, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.2305 => 0.2174, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -5.61% (0.2725 => 0.2572, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.58% (0.2884 => 0.2723, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.56% (0.7693 => 0.7265, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.46% (3.6295 => 3.4313, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.45% (0.9507 => 0.8989, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hello: -5.39% (0.1928 => 0.1824, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.9422 => 0.8917, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.11% (0.9127 => 0.8661, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (1.4392 => 1.3659, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.09% (5.0381 => 4.7819, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/except: -4.97% (0.2172 => 0.2064, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.89% (0.9788 => 0.9309, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.89% (0.2577 => 0.2451, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.89% (0.9512 => 0.9047, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: -4.86% (0.7776 => 0.7398, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.81% (0.9091 => 0.8654, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.76% (0.8990 => 0.8562, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: -4.75% (4.5936 => 4.3752, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/lists1: -4.74% (0.3206 => 0.3054, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (1.0234 => 0.9755, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.67% (0.9405 => 0.8966, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.63% (1.0052 => 0.9587, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -4.63% (0.2551 => 0.2433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: -4.61% (0.4689 => 0.4473, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.54% (0.9403 => 0.8976, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.43% (0.3093 => 0.2956, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.43% (4.6579 => 4.4516, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.40% (0.6135 => 0.5865, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: -4.40% (0.6711 => 0.6416, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.26% (1.2680 => 1.2140, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: -4.23% (0.3715 => 0.3558, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -4.13% (0.2665 => 0.2555, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.10% (0.9993 => 0.9583, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.09% (1.3220 => 1.2679, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: -4.09% (18.9377 => 18.1628, std.dev.: 0.0388) MultiSource/Benchmarks/McCat/08-main/main: -4.01% (0.2915 => 0.2798, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: -4.00% (16.4479 => 15.7896, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.76% (0.9214 => 0.8868, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.71% (0.9488 => 0.9136, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.2913 => 0.2807, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.41% (0.9855 => 0.9519, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.41% (1.0860 => 1.0490, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.32% (0.5369 => 0.5191, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.23% (0.6996 => 0.6770, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.16% (14.9757 => 14.5022, std.dev.: 0.0513) MultiSource/Benchmarks/McCat/05-eks/eks: -3.14% (0.4776 => 0.4626, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.06% (1.0119 => 0.9809, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.96% (0.9685 => 0.9398, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.96% (0.4762 => 0.4621, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.94% (0.3847 => 0.3734, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.86% (0.8926 => 0.8671, std.dev.: 0.0061) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.82% (7.2721 => 7.0667, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.76% (0.9612 => 0.9347, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.67% (0.9061 => 0.8819, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.67% (0.8893 => 0.8656, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.66% (0.8846 => 0.8611, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: -2.65% (7.3529 => 7.1577, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.61% (2.4519 => 2.3878, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.36% (0.8732 => 0.8526, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: -2.35% (5.3553 => 5.2294, std.dev.: 0.0343) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.26% (0.6934 => 0.6777, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.26% (0.9381 => 0.9169, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.16% (4.8904 => 4.7850, std.dev.: 0.0284) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.02% (0.5059 => 0.4957, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: -2.01% (1.2708 => 1.2453, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.84% (0.9120 => 0.8952, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.79% (16.7012 => 16.4025, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.69% (0.9998 => 0.9829, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.62% (0.8912 => 0.8768, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.39% (0.9010 => 0.8885, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.38% (1.0867 => 1.0717, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.20% (0.9372 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -30.22% (4.4739 => 3.1217, std.dev.: 0.3567) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.07% (4.2042 => 3.1502, std.dev.: 0.0696) MultiSource/Applications/minisat/minisat: -22.53% (7.9891 => 6.1889, std.dev.: 0.0459) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.85% (0.1164 => 0.0933, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.63% (1.0816 => 0.8693, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.24% (1.5623 => 1.2617, std.dev.: 0.0651) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.84% (1.4235 => 1.2550, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.71% (2.8778 => 2.5696, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.51% (0.4081 => 0.3652, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.17% (5.0421 => 4.5291, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout-C++/lists1: -10.00% (0.6628 => 0.5965, std.dev.: 0.0111) MultiSource/Applications/SPASS/SPASS: -9.61% (9.0650 => 8.1939, std.dev.: 0.1222) SingleSource/Benchmarks/Shootout/nestedloop: -8.73% (0.2200 => 0.2008, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.67% (1.4588 => 1.3323, std.dev.: 0.0211) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -6.81% (0.1704 => 0.1588, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: -6.57% (0.3654 => 0.3414, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -6.25% (2.2304 => 2.0910, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.13% (46.0987 => 43.2749, std.dev.: 0.2125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.50% (23.3986 => 22.1109, std.dev.: 0.1823) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.72% (0.3349 => 0.3191, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.58% (2.5170 => 2.4018, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/ary3: -4.35% (1.8123 => 1.7334, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.64% (1.4446 => 1.3920, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.61% (40.4729 => 39.0132, std.dev.: 0.1510) SingleSource/Benchmarks/Shootout-C++/lists: -3.55% (17.2182 => 16.6062, std.dev.: 0.0972) MultiSource/Applications/SIBsim4/SIBsim4: -3.55% (3.5443 => 3.4184, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.97% (0.3406 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.88% (0.3609 => 0.3505, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.76% (0.5826 => 0.5665, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -2.58% (4.4730 => 4.3574, std.dev.: 0.0362) SingleSource/Benchmarks/Misc/mandel-2: -2.14% (0.8521 => 0.8339, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.12% (3.0082 => 2.9445, std.dev.: 0.0167) MultiSource/Applications/lua/lua: -2.04% (29.0327 => 28.4417, std.dev.: 0.1665) MultiSource/Benchmarks/BitBench/five11/five11: -1.57% (5.7021 => 5.6126, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.40% (3.3596 => 3.3125, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -1.27% (1.5825 => 1.5624, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1539, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.07% (2.5334 => 2.5062, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.01% (2.4120 => 2.3876, std.dev.: 0.0006) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.16% (1.2047 => 1.1184, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -22.62% (0.0451 => 0.0349, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -34.26% (0.0394 => 0.0259, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.78% (0.0328 => 0.0250, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -38.50% (0.0213 => 0.0131, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -30.40% (0.0227 => 0.0158, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.62% (0.1530 => 0.1444, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -40.77% (1.9293 => 1.1427, std.dev.: 0.0137) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.59% (0.4049 => 0.3944, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.99% (0.1510 => 0.1480, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.12% (0.0978 => 0.0989, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.28% (0.0276 => 0.0209, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.39% (0.0590 => 0.0570, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.07% (1.1617 => 1.1493, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.41% (0.0027 => 0.0025, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.31% (0.0610 => 0.0541, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.28% (0.7437 => 0.7342, std.dev.: 0.0058) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.21% (12.7781 => 12.7517, std.dev.: 0.0304) Report Time: 2.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 04:00:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 06:00:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113120000.EF90E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7548?compare_to=7543&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7548, Order: 172351, Start Time: 2013-01-13 09:48:57, End Time: 2013-01-13 12:00:02 To: 7543, Order: 172345, Start Time: 2013-01-13 07:04:22, End Time: 2013-01-13 09:18:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (213 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (660 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.40% (11.1777 => 11.3341, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.94% (0.9579 => 0.9393, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8337 => 499.8383, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.69% (1.1277 => 499.8383, std.dev.: 0.0132) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.08% (0.5229 => 1.6423, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 19.35% (14.9895 => 17.8896, std.dev.: 0.0298) MultiSource/Applications/kimwitu++/kc: 42.38% (14.1553 => 20.1550, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: 17.03% (4.1105 => 4.8105, std.dev.: 0.0183) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.53% (1.1048 => 1.7404, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.96% (7.1582 => 37.3626, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.17% (3.4629 => 6.3429, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 72.79% (0.6222 => 1.0751, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.69% (0.0720 => 7.4417, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11148400.00% (0.0001 => 11.1485, std.dev.: 0.0488) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484900.00% (0.0001 => 5.4850, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.40% (1.1194 => 10.3589, std.dev.: 0.0565) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785) MultiSource/Applications/ClamAV/clamscan: 150.57% (22.1758 => 55.5662, std.dev.: 0.0590) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454) MultiSource/Benchmarks/FreeBench/neural/neural: 70.88% (0.1463 => 0.2500, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.60% (2.9384 => 4.6014, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.40% (7.0540 => 10.8205, std.dev.: 0.0069) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.47% (1.5859 => 2.3863, std.dev.: 0.0079) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 47.73% (0.1056 => 0.1560, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.57% (8.1363 => 11.9255, std.dev.: 0.0076) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 41.41% (21.9371 => 31.0217, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.78% (2.2024 => 3.1006, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 38.76% (0.3109 => 0.4314, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.27% (0.0439 => 0.0607, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.52% (4.2646 => 5.6940, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.01% (1.5415 => 2.0503, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.03% (0.4615 => 0.6093, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 31.33% (0.0814 => 0.1069, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.46% (0.2271 => 0.2940, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 29.19% (0.4299 => 0.5554, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.12% (0.1892 => 0.2443, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 28.46% (1.1642 => 1.4955, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.72% (0.6675 => 0.8525, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.23% (0.5105 => 0.6444, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.88% (0.1584 => 0.1994, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.61% (0.2554 => 0.3208, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 25.45% (0.1175 => 0.1474, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.44% (3.8922 => 4.8823, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.31% (1.0722 => 1.3328, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.36% (0.3121 => 0.3850, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.33% (1.4186 => 1.7495, std.dev.: 0.0128) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 22.44% (9.4845 => 11.6124, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash: 22.29% (0.4289 => 0.5245, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 21.65% (0.4620 => 0.5620, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.37% (0.0730 => 0.0886, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.25% (0.7115 => 0.8627, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.15% (0.2700 => 0.3271, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.71% (0.1555 => 0.1877, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.08% (5.7591 => 6.9156, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.08% (1.3050 => 1.5670, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.06% (0.1236 => 0.1484, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.89% (0.7835 => 0.9393, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.83% (0.0842 => 0.1009, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.49% (4.9449 => 5.9087, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.1695 => 0.2024, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/matrix: 19.14% (0.3098 => 0.3691, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 19.01% (0.6456 => 0.7683, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.0953 => 0.1132, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 18.77% (0.1151 => 0.1367, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.67% (5.0018 => 5.9356, std.dev.: 0.0142) MultiSource/Applications/d/make_dparser: 18.59% (3.3354 => 3.9553, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bisort/bisort: 18.57% (0.0614 => 0.0728, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.56% (0.1940 => 0.2300, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.40% (0.2758 => 0.3238, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 17.35% (0.1268 => 0.1488, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.27% (0.5020 => 0.5887, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.18% (0.9765 => 1.1443, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 17.03% (1.1840 => 1.3856, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 16.99% (0.7433 => 0.8696, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.92% (0.5569 => 0.6511, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.2107 => 0.2463, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 16.71% (0.3423 => 0.3995, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.69% (0.3307 => 0.3859, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.42% (0.5981 => 0.6963, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 16.41% (3.8723 => 4.5076, std.dev.: 0.0166) MultiSource/Applications/treecc/treecc: 16.37% (2.0273 => 2.3592, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.87% (0.3441 => 0.3987, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.62% (0.8101 => 0.9366, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 15.60% (2.2969 => 2.6553, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.47% (0.0834 => 0.0963, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.44% (0.6450 => 0.7446, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.32% (0.2049 => 0.2363, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.96% (0.3283 => 0.3774, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 14.62% (0.3180 => 0.3645, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.52% (0.8921 => 1.0216, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.40% (1.1861 => 1.3569, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 14.39% (0.3232 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.56% (0.8067 => 0.9161, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 12.52% (0.3379 => 0.3802, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.21% (1.5603 => 1.7508, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.67% (0.3865 => 0.4316, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.60% (0.4636 => 0.5174, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.22% (17.1811 => 19.1089, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.4103 => 0.4547, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.77% (0.3092 => 0.3425, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.64% (0.4203 => 0.4650, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.58% (0.2430 => 0.2687, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.56% (14.3668 => 15.8834, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/oourafft: 10.54% (0.3282 => 0.3628, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.30% (0.3427 => 0.3780, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.13% (0.4048 => 0.4458, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.11% (0.3422 => 0.3768, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.74% (0.3684 => 0.4043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.74% (0.3603 => 0.3954, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.41% (0.3826 => 0.4186, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.33% (10.3673 => 11.3341, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.66% (0.4064 => 0.4416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.34% (0.2831 => 0.3067, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.14% (0.6030 => 0.6521, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 7.86% (63.2438 => 68.2173, std.dev.: 0.0858) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.47% (2.0665 => 2.2208, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 7.31% (1.2842 => 1.3781, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: 7.26% (0.2877 => 0.3086, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.99% (0.3935 => 0.4210, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 6.92% (0.2905 => 0.3106, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.87% (0.4879 => 0.5214, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.66% (2.2022 => 2.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.46% (0.2756 => 0.2934, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.27% (0.2793 => 0.2968, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.17% (0.2725 => 0.2893, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.12% (0.2714 => 0.2880, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.48% (0.3177 => 0.3351, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.41% (7.9617 => 8.1532, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2460, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.98% (4.2280 => 4.4807, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.89% (0.9957 => 1.0344, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.87% (8.6802 => 8.9292, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.72% (3.6395 => 3.7385, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.86% (9.1159 => 9.2853, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2789, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4512, std.dev.: 0.0243) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1762, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.77% (0.1622 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.23% (5.3855 => 4.4577, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.91% (5.3526 => 4.4477, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -13.71% (10.4361 => 9.0058, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.39% (1.7609 => 1.6131, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -7.81% (54.1659 => 49.9349, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.75% (1.9577 => 0.6705, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.77% (1.5373 => 1.0182, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4246, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8588, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0064, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4949, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.18% (19.9488 => 18.3174, std.dev.: 0.0483) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2373 => 1.1542, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.02% (8.1563 => 7.7471, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8372, std.dev.: 0.0122) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.65% (3.6994 => 3.6383, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2315, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0029) Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 04:04:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 06:04:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113120410.5C2372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7549?compare_to=7545&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7549, Order: 172351, Start Time: 2013-01-13 10:30:38, End Time: 2013-01-13 12:04:12 To: 7545, Order: 172349, Start Time: 2013-01-13 08:33:13, End Time: 2013-01-13 10:07:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 0 (137 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.07% (0.0280 => 0.0521, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.85% (0.0717 => 0.1182, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.29% (0.0974 => 0.1571, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797) MultiSource/Benchmarks/FreeBench/neural/neural: 44.27% (0.1500 => 0.2164, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.01% (0.6395 => 0.8762, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.01% (0.6395 => 0.8634, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.48% (0.6260 => 0.8356, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.26% (0.5688 => 0.7523, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.21% (0.5805 => 0.7675, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.07% (0.5456 => 0.7206, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.52% (0.6230 => 0.8194, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.20% (0.5581 => 0.7322, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.14% (0.5575 => 0.7311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.08% (0.5567 => 0.7297, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.90% (0.5941 => 0.7777, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.42% (0.6033 => 0.7868, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.33% (0.5802 => 0.7562, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.08% (0.5705 => 0.7421, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.87% (0.5859 => 0.7609, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.73% (0.5849 => 0.7588, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.57% (0.5478 => 0.7098, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.46% (0.6440 => 0.8337, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.44% (0.5570 => 0.7210, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.29% (0.5569 => 0.7200, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.89% (0.5591 => 0.7206, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.24% (0.6052 => 0.7761, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.13% (0.6189 => 0.7930, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.07% (0.6676 => 0.8550, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.98% (0.5857 => 0.7496, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.84% (0.5863 => 0.7495, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.83% (0.6446 => 0.8240, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.51% (0.6304 => 0.8038, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.02% (1.6474 => 2.0926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.30% (0.6194 => 0.7823, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.05% (0.6660 => 0.8395, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.90% (0.6297 => 0.7928, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.57% (0.6681 => 0.8389, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.72% (0.0445 => 0.0555, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.19% (0.6667 => 0.8280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.35% (0.7524 => 0.9281, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.24% (0.7339 => 0.8971, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.87% (2.2587 => 2.7076, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 14.71% (0.0707 => 0.0811, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.68% (1.1450 => 1.3131, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.14% (0.1081 => 0.1223, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.56% (0.1982 => 0.2231, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.12% (1.6364 => 1.8183, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.07% (0.4916 => 0.5460, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.02% (4.5069 => 5.0036, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 10.90% (0.4515 => 0.5007, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.45% (3.5339 => 3.9033, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.7021 => 0.7554, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.83% (1.2515 => 1.3370, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.34% (0.5329 => 0.5667, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (9.2283 => 9.8080, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 6.03% (0.4524 => 0.4797, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.01% (1.4642 => 1.5522, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.84% (1.2784 => 1.3530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.39% (0.4861 => 0.5123, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.12% (0.3255 => 0.3389, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.92% (0.3319 => 0.3449, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.64% (5.0226 => 5.1554, std.dev.: 0.0181) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.3864 => 1.4175, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 2.19% (0.8418 => 0.8602, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/bigfib: 2.16% (0.6750 => 0.6896, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.11% (5.4682 => 5.5837, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6640, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.2380 => 0.2486, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.5751 => 56.3984, std.dev.: 0.1290) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.15% (2.0478 => 2.1124, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2864, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6077, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9569, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.83% (0.3194 => 0.2976, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.68% (0.3837 => 0.3619, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -5.36% (2.4924 => 2.3587, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -5.36% (0.3880 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.36% (0.3884 => 0.3676, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.30% (0.3848 => 0.3644, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.22% (0.3891 => 0.3688, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.18% (0.3896 => 0.3694, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.11% (0.4033 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.09% (0.3323 => 0.3154, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: -5.05% (0.4176 => 0.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.89% (0.2903 => 0.2761, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.80% (0.3205 => 0.3051, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.71% (0.3821 => 0.3641, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.64% (0.4199 => 0.4004, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.63% (0.2939 => 0.2803, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.56% (0.3026 => 0.2888, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.47% (2.1713 => 2.0742, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.46% (0.9852 => 0.9413, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3142 => 0.3006, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.32% (0.4280 => 0.4095, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.25% (0.6347 => 0.6077, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.24% (0.3016 => 0.2888, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.21% (1.3148 => 1.2595, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.97% (0.3025 => 0.2905, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.89% (0.7198 => 0.6918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.79% (0.3931 => 0.3782, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.64% (0.3658 => 0.3525, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.57% (0.4151 => 0.4003, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.56% (0.6484 => 0.6253, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.48% (0.7779 => 0.7508, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (0.3621 => 0.3497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.9542 => 0.9222) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.30% (0.4427 => 0.4281, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.18% (0.3867 => 0.3744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.13% (0.4248 => 0.4115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.04% (0.3788 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.92% (0.4321 => 0.4195, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.89% (0.7919 => 0.7690, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.79% (0.4083 => 0.3969, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.68% (0.4813 => 0.4684, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -2.61% (0.7982 => 0.7774, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2406, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8586, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: -2.46% (4.3330 => 4.2265, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.41% (1.0544 => 1.0290, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6977, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.37% (1.2210 => 1.1921, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.30% (6.7716 => 6.6160, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1944, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -2.03% (16.1920 => 15.8625, std.dev.: 0.0891) MultiSource/Applications/siod/siod: -1.98% (2.4021 => 2.3546, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.96% (1.2300 => 1.2059, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9612, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.75% (0.5999 => 0.5894, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -1.72% (1.5610 => 1.5342, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.57% (34.0927 => 33.5560, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.54% (0.8521 => 0.8390, std.dev.: 0.0024) MultiSource/Applications/lua/lua: -1.43% (4.0594 => 4.0015, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.24% (8.0126 => 7.9136, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: -1.11% (18.2933 => 18.0898, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.28% (1.8100 => 0.6828, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0289, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0314, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.01% (2.5106 => 2.1338, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7308, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.45% (3.7241 => 3.6329, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4640, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.51% (1.6086 => 1.5843, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1962, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.43% (4.8776 => 4.8079, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.6307 => 1.6111, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 06:01:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 08:01:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113140116.19BFA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7550?compare_to=7549&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7550, Order: 172354, Start Time: 2013-01-13 12:27:33, End Time: 2013-01-13 14:01:19 To: 7549, Order: 172351, Start Time: 2013-01-13 10:30:38, End Time: 2013-01-13 12:04:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.07% (1.1533 => 1.1656, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 44.40% (0.1500 => 0.2166, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.25% (0.6395 => 0.8777, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.40% (0.6395 => 0.8659, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.64% (0.6260 => 0.8366, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.51% (0.5688 => 0.7537, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.26% (0.5456 => 0.7216, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.78% (0.6230 => 0.8210, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.50% (0.5575 => 0.7331, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.37% (0.5581 => 0.7332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.35% (0.5567 => 0.7312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.22% (0.5941 => 0.7796, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.73% (0.6033 => 0.7887, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.71% (0.5802 => 0.7584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.29% (0.5705 => 0.7433, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.14% (0.5859 => 0.7625, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.07% (0.5849 => 0.7608, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.94% (0.5478 => 0.7118, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.86% (0.6440 => 0.8363, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.75% (0.5570 => 0.7227, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.47% (0.5569 => 0.7210, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.25% (0.5925 => 0.7658, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.21% (0.5591 => 0.7224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.52% (0.6189 => 0.7954, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.33% (0.5857 => 0.7516, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.22% (0.6676 => 0.8560, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.11% (0.5863 => 0.7511, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.94% (0.6446 => 0.8247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.26% (1.6474 => 2.0964, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.49% (0.6194 => 0.7835, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.29% (0.6660 => 0.8411, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.12% (0.6297 => 0.7942, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.04% (0.6681 => 0.8421, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.28% (0.6667 => 0.8286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.48% (0.7524 => 0.9291, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.58% (0.7339 => 0.8996, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.91% (2.2587 => 2.7084, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.89% (1.1450 => 1.3155, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.09% (0.3357 => 0.3830, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.24% (4.5069 => 5.0135, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.18% (1.6364 => 1.8193, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.05% (0.4916 => 0.5459, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 10.81% (0.4515 => 0.5003, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.42% (3.5339 => 3.9023, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.68% (0.2385 => 0.2592, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.92% (0.7021 => 0.7577, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.92% (1.2515 => 1.3381, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.68% (0.5329 => 0.5685, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.37% (9.2283 => 9.8165, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/hash: 6.26% (0.4524 => 0.4807, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.09% (1.4642 => 1.5534, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.99% (1.2784 => 1.3550, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4861 => 0.5144, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.89% (0.3319 => 0.3448, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.85% (5.0226 => 5.1656, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.67% (5.4682 => 5.6142, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 2.43% (0.6750 => 0.6914, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.3864 => 1.4196, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.52% (0.8418 => 0.8546, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.04% (1.3722 => 1.3865, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6595, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.2380 => 0.2486, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5089, std.dev.: 0.1558) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2856, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.57% (79.7170 => 80.9664, std.dev.: 0.2513) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5320 => 4.5980, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.48% (0.3194 => 0.2987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: -5.87% (0.3831 => 0.3606, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.82% (0.3880 => 0.3654, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/for-in: -5.70% (0.4033 => 0.3803, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.93% (2.4924 => 2.3695, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.88% (0.4199 => 0.3994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.88% (0.2871 => 0.2731, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.68% (0.6347 => 0.6050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.49% (0.4280 => 0.4088, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.46% (0.2939 => 0.2808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.41% (0.3016 => 0.2883, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.32% (2.1713 => 2.0776, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.16% (0.9852 => 0.9442, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.12% (0.3252 => 0.3118, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.10% (0.3025 => 0.2901, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: -4.06% (0.3026 => 0.2903, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2616, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -3.96% (0.7779 => 0.7471, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.73% (0.4151 => 0.3996, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.53% (0.3658 => 0.3529, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (0.3621 => 0.3494, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.45% (0.6484 => 0.6260, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.9542 => 0.9220, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.23% (0.3931 => 0.3804, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.18% (0.3867 => 0.3744, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.08% (0.4321 => 0.4188, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.99% (0.3849 => 0.3734, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -2.80% (0.4248 => 0.4129, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.55% (0.4083 => 0.3979, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -2.51% (20.7746 => 20.2523, std.dev.: 0.0454) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.36% (1.2221 => 1.1932, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.33% (1.2210 => 1.1926, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0301, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8919, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7237, std.dev.: 0.0258) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.14% (6.7716 => 6.6268, std.dev.: 0.0112) MultiSource/Applications/lambda-0_1_3/lambda: -1.97% (0.7982 => 0.7825, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.96% (16.1920 => 15.8742, std.dev.: 0.0193) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.95% (1.2300 => 1.2060, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: -1.92% (4.3330 => 4.2498, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.0961 => 6.9688, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -1.58% (2.4021 => 2.3641, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: -1.58% (0.9179 => 0.9034, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.29% (34.0927 => 33.6526, std.dev.: 0.0113) MultiSource/Applications/hbd/hbd: -1.27% (1.5610 => 1.5412, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -1.23% (4.0594 => 4.0096, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.22% (8.0126 => 7.9148, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.31% (1.8100 => 0.6821, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.91% (8.0445 => 5.3164, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -24.84% (1.3643 => 1.0254, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7486, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0294, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.83% (5.3397 => 4.1739, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1304, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.07% (4.1534 => 3.8596, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1777, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.06% (7.9763 => 7.7320, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6388, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.28% (1.3096 => 1.2798, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4760, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1967, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8094, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.34% (1.6086 => 1.5870, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.32% (3.7092 => 3.6601, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6105, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 06:01:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 08:01:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113140153.CDA942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7551?compare_to=7547&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7551, Order: 172353, Start Time: 2013-01-13 12:03:46, End Time: 2013-01-13 14:01:58 To: 7547, Order: 172351, Start Time: 2013-01-13 09:45:50, End Time: 2013-01-13 11:43:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (7 on baseline) Performance Improvements: 0 (152 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1054 (904 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.14% (0.5167 => 0.5329, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: 1.66% (1.4982 => 1.5230, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.33% (5.3285 => 6.1451, std.dev.: 0.0471) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.56% (4.7523 => 4.9689, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.47% (6.8526 => 7.0905, std.dev.: 0.0633) SingleSource/Benchmarks/Misc/flops: 2.88% (8.6108 => 8.8588, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.56% (3.9224 => 4.0228, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.6448 => 0.6561, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.13% (2.4112 => 2.4384, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.13% (1.1184 => 1.1170, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.07% (0.0221 => 0.0212, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.21% (0.0349 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.57% (0.0259 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 27.20% (0.0250 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.22% (0.0428 => 0.0350, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: 58.02% (0.0131 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 40.51% (0.0158 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1444 => 0.1445, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -0.03% (1.1427 => 1.1424, std.dev.: 0.0266) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.79% (0.3944 => 0.3975, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.32% (0.1480 => 0.1416, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.06% (0.0989 => 0.0939, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.26% (0.0209 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.56% (0.0570 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.20% (1.1493 => 1.1470, std.dev.: 0.1044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.00% (0.0025 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.74% (0.0541 => 0.0545, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0318 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.39% (0.7342 => 0.7444, std.dev.: 0.0181) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.56% (0.0122 => 0.0053, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7517 => 12.7583, std.dev.: 0.1698) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.89% (0.0336 => 0.0507, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319125.00% (0.0008 => 2.5538, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.05% (1.1825 => 2.4365, std.dev.: 0.0860) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.90% (0.2562 => 0.2867, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.67% (5.6033 => 6.1451, std.dev.: 0.0471) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (63.1520 => 64.2665, std.dev.: 0.1602) MultiSource/Applications/JM/lencod/lencod: 1.50% (6.8159 => 6.9184, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.43% (0.0808 => 0.0449, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.43% (0.0727 => 0.0484, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -27.91% (0.1888 => 0.1361, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.42% (0.1684 => 0.1256, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.82% (0.1009 => 0.0809, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -19.69% (1.8964 => 1.5230, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.03% (0.0862 => 0.0698, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.49% (1.0960 => 0.8933, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.42% (0.7686 => 0.6347, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.05% (0.1079 => 0.0895, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.66% (1.0986 => 0.9266, std.dev.: 0.0041) MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.96% (1.2154 => 1.0457, std.dev.: 0.0189) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.55% (0.4074 => 0.3522, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -12.69% (1.5979 => 1.3951, std.dev.: 0.0130) MultiSource/Applications/spiff/spiff: -12.69% (1.0220 => 0.8923, std.dev.: 0.0073) MultiSource/Applications/hexxagon/hexxagon: -11.76% (1.1433 => 1.0089, std.dev.: 0.0024) MultiSource/Applications/aha/aha: -11.39% (0.1378 => 0.1221, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -11.16% (1.5131 => 1.3443, std.dev.: 0.0109) MultiSource/Applications/treecc/treecc: -10.78% (2.4719 => 2.2055, std.dev.: 0.0126) MultiSource/Applications/lua/lua: -10.77% (4.6406 => 4.1407, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.60% (0.2481 => 0.2218, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.48% (0.9588 => 0.8583, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.41% (0.2372 => 0.2125, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.17% (0.7693 => 0.6911, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.04% (1.3924 => 1.2526, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.93% (10.2703 => 9.2504, std.dev.: 0.0637) MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.84% (1.1731 => 1.0577, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: -9.36% (17.5634 => 15.9191, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.35% (0.3560 => 0.3227, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.11% (1.1498 => 1.0451, std.dev.: 0.0171) MultiSource/Applications/lambda-0_1_3/lambda: -9.08% (0.8653 => 0.7867, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.08% (1.6874 => 1.5342, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.96% (0.6885 => 0.6268, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.87% (0.9124 => 0.8315, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.63% (0.2283 => 0.2086, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -8.59% (2.6437 => 2.4167, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.50% (0.1317 => 0.1205, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -8.42% (17.4365 => 15.9692, std.dev.: 0.0647) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.35% (0.1305 => 0.1196, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -8.20% (0.3598 => 0.3303, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -8.18% (0.2006 => 0.1842, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: -8.01% (0.1610 => 0.1481, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: -7.83% (0.1928 => 0.1777, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/except: -7.64% (0.2172 => 0.2006, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.62% (0.1587 => 0.1466, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: -7.34% (0.2385 => 0.2210, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.26% (0.5746 => 0.5329, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.96% (1.0017 => 0.9320, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.76% (1.8127 => 1.6901, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.67% (0.9550 => 0.8913, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -6.54% (1.3979 => 1.3065, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.53% (0.2709 => 0.2532, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -6.51% (0.2551 => 0.2385, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.29% (0.2100 => 0.1968, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: -6.20% (3.7840 => 3.5494, std.dev.: 0.0305) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.99% (1.3310 => 1.2513, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -5.90% (0.2135 => 0.2009, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7693 => 0.7247, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.78% (0.2144 => 0.2020, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.75% (0.3981 => 0.3752, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.68% (0.6934 => 0.6540, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.68% (0.9507 => 0.8967, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.39% (0.2618 => 0.2477, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -5.39% (4.5936 => 4.3462, std.dev.: 0.0870) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.28% (5.0381 => 4.7723, std.dev.: 0.0315) SingleSource/Benchmarks/Shootout-C++/lists: -5.25% (0.2725 => 0.2582, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.23% (0.9422 => 0.8929, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.17% (0.9127 => 0.8655, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -4.99% (1.4392 => 1.3674, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.89% (0.9405 => 0.8945, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: -4.89% (0.7776 => 0.7396, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.81% (0.9512 => 0.9054, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.78% (0.8990 => 0.8560, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.73% (0.9788 => 0.9325, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.65% (1.0234 => 0.9758, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.54% (3.6295 => 3.4647, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.54% (1.0052 => 0.9596, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.40% (0.9403 => 0.8989, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.40% (0.9091 => 0.8691, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.30% (0.5369 => 0.5138, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -4.21% (16.4479 => 15.7556, std.dev.: 0.0815) MultiSource/Applications/kimwitu++/kc: -4.19% (18.9377 => 18.1437, std.dev.: 0.0401) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.19% (0.2577 => 0.2469, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.15% (1.2680 => 1.2154, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.92% (0.2884 => 0.2771, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.87% (0.9488 => 0.9121, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.86% (0.9993 => 0.9607, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.75% (7.2721 => 6.9995, std.dev.: 0.0345) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.74% (1.3220 => 1.2726, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.71% (4.6579 => 4.4851, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.69% (1.0860 => 1.0459, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -3.58% (0.3715 => 0.3582, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: -3.41% (0.4776 => 0.4613, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.38% (1.0088 => 0.9747, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.37% (0.2993 => 0.2892, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.16% (0.9685 => 0.9379, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.15% (0.3394 => 0.3287, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.15% (0.3847 => 0.3726, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.90% (14.9757 => 14.5421, std.dev.: 0.0899) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.79% (0.4762 => 0.4629, std.dev.: 0.0050) MultiSource/Applications/JM/ldecod/ldecod: -2.76% (7.3529 => 7.1496, std.dev.: 0.0442) MultiSource/Applications/oggenc/oggenc: -2.63% (5.3553 => 5.2142, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.63% (0.8926 => 0.8691, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.56% (4.8904 => 4.7650, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.56% (0.9061 => 0.8829, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.54% (0.8846 => 0.8621, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.49% (0.8893 => 0.8672, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.46% (0.9612 => 0.9376, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.35% (0.8732 => 0.8527, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.32% (0.9998 => 0.9766, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.23% (0.9381 => 0.9172, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.17% (1.0119 => 0.9899, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -2.04% (16.7012 => 16.3599, std.dev.: 0.0901) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.02% (4.9104 => 4.8112, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/football/football: -1.94% (0.9759 => 0.9570, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.92% (2.4519 => 2.4048, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.85% (0.9120 => 0.8951, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: -1.31% (1.2708 => 1.2541, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.24% (1.4805 => 1.4622, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.99% (0.9372 => 0.6561, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: -21.78% (7.9891 => 6.2490, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.32% (1.0816 => 0.8510, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.64% (1.5623 => 1.2555, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.33% (2.8778 => 2.3504, std.dev.: 0.1051) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.10% (0.1164 => 0.0965, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.32% (1.4235 => 1.2623, std.dev.: 0.0574) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0115) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.43% (1.6547 => 1.4987, std.dev.: 0.0569) MultiSource/Applications/SPASS/SPASS: -9.32% (9.0650 => 8.2201, std.dev.: 0.1956) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.23% (0.3609 => 0.3276, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists1: -8.58% (0.6628 => 0.6059, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/health/health: -6.05% (0.3654 => 0.3433, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.87% (23.3986 => 22.0247, std.dev.: 0.1323) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.71% (46.0987 => 43.4661, std.dev.: 0.2466) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.81% (0.3349 => 0.3188, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.99% (2.5170 => 2.4166, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: -3.68% (17.2182 => 16.5846, std.dev.: 0.1056) MultiSource/Applications/SIBsim4/SIBsim4: -3.32% (3.5443 => 3.4268, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.08% (0.3406 => 0.3301, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -2.77% (4.4730 => 4.3491, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.56% (0.5826 => 0.5677, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -2.30% (2.8571 => 2.7913, std.dev.: 0.0171) SingleSource/Benchmarks/Misc/mandel-2: -1.87% (0.8521 => 0.8362, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6211 => 0.6101, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.2040 => 7.0790, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.70% (3.0082 => 2.9570, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.33% (3.7662 => 3.7160, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.33% (8.6447 => 8.5299, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.19% (3.1921 => 3.1541, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -1.17% (8.7416 => 8.6395, std.dev.: 0.0275) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.28% (1.2047 => 1.1170, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.01% (0.0233 => 0.0212, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -21.35% (0.0445 => 0.0350, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.56% (0.1530 => 0.1445, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -40.79% (1.9293 => 1.1424, std.dev.: 0.0266) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4049 => 0.3975, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.23% (0.1510 => 0.1416, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.99% (0.0978 => 0.0939, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.29% (0.0276 => 0.0220, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.80% (0.0590 => 0.0544, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.1617 => 1.1470, std.dev.: 0.1044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.66% (0.0610 => 0.0545, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.09% (0.7437 => 0.7444, std.dev.: 0.0181) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.39% (0.0092 => 0.0053, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7781 => 12.7583, std.dev.: 0.1698) Report Time: 0.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 06:40:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 08:40:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113144043.811812A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7552?compare_to=7548&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7552, Order: 172354, Start Time: 2013-01-13 12:30:04, End Time: 2013-01-13 14:40:46 To: 7548, Order: 172351, Start Time: 2013-01-13 09:48:57, End Time: 2013-01-13 12:00:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (211 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (660 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.40% (0.6705 => 0.6477, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1333 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8383 => 499.8374, std.dev.: 0.0110) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.61% (1.1277 => 499.8374, std.dev.: 0.0110) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.88% (0.5229 => 1.6465, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 19.46% (14.9895 => 17.9063, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 42.43% (14.1553 => 20.1620, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 17.14% (4.1105 => 4.8150, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.82% (1.1048 => 1.7436, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.68% (7.1582 => 37.4860, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.29% (3.4629 => 6.3473, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 72.85% (0.6222 => 1.0755, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.75% (0.0720 => 7.4403, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 3834700.00% (0.0001 => 3.8348, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11160100.00% (0.0001 => 11.1602, std.dev.: 0.0098) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484100.00% (0.0001 => 5.4842, std.dev.: 0.0653) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.50% (1.1194 => 10.3377, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 149.90% (22.1758 => 55.4171, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.64% (0.0929 => 0.1771, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 65.68% (0.0271 => 0.0449, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.80% (2.9384 => 4.6073, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.19% (7.0540 => 10.8766, std.dev.: 0.0018) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.65% (1.5859 => 2.3892, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.01% (0.1056 => 0.1563) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.55% (8.1363 => 11.9237, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 41.67% (21.9371 => 31.0791, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.80% (2.2024 => 3.1009, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 38.95% (0.3109 => 0.4320, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.60% (4.2646 => 5.6977, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.10% (1.5415 => 2.0517, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.90% (0.4615 => 0.6087, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 31.33% (0.0814 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.60% (0.1892 => 0.2452, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.33% (0.2271 => 0.2937, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 29.19% (0.4299 => 0.5554, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 28.48% (1.1642 => 1.4958, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.09% (0.6675 => 0.8550, std.dev.: 0.0091) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.44% (0.5105 => 0.6455, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.49% (3.8922 => 4.8842, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.02% (0.2554 => 0.3193, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.84% (0.0793 => 0.0990, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 24.55% (1.0722 => 1.3354, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.58% (0.3121 => 0.3857, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.50% (0.1566 => 0.1934, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.37% (1.4186 => 1.7501, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.80% (9.4845 => 11.6468, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.59% (0.1337 => 0.1639, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 22.06% (0.4289 => 0.5235, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.78% (0.2700 => 0.3288, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 21.52% (0.4620 => 0.5614, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.37% (0.0730 => 0.0886, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.24% (0.7115 => 0.8626, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.47% (5.7591 => 6.9378, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.21% (1.3050 => 1.5688, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.06% (0.1236 => 0.1484, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 19.91% (0.7835 => 0.9395, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.70% (0.0675 => 0.0808, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.56% (4.9449 => 5.9120, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.35% (0.1695 => 0.2023, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 19.26% (0.1163 => 0.1387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 19.17% (0.3098 => 0.3692, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.17% (3.3354 => 3.9748, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.13% (0.5860 => 0.6981, std.dev.: 0.0026) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.79% (5.0018 => 5.9418, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 18.74% (0.6456 => 0.7666, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.69% (0.8172 => 0.9699, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.68% (0.0953 => 0.1131, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.61% (0.1940 => 0.2301, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 18.40% (0.0614 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.17% (0.0886 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.37% (0.2758 => 0.3237, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.35% (0.5020 => 0.5891, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 17.19% (0.1268 => 0.1486, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3871, std.dev.: 0.0091) MultiSource/Applications/lambda-0_1_3/lambda: 17.10% (0.7433 => 0.8704, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.93% (0.5569 => 0.6512, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 16.83% (0.3423 => 0.3999, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.80% (0.2107 => 0.2461, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.55% (3.8723 => 4.5131, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.54% (0.3307 => 0.3854, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.32% (2.0273 => 2.3581, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.22% (0.5981 => 0.6951, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.60% (0.8101 => 0.9365, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.58% (0.3441 => 0.3977, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 15.50% (2.2969 => 2.6530, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 15.47% (0.2049 => 0.2366, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.24% (0.6450 => 0.7433, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1044 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.71% (0.3283 => 0.3766, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/football/football: 14.54% (0.8921 => 1.0218, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 14.53% (0.3180 => 0.3642, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.43% (1.1861 => 1.3572, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3232 => 0.3696, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.59% (0.8067 => 0.9163, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.25% (0.2603 => 0.2948, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.26% (1.5603 => 1.7516, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 12.25% (0.3379 => 0.3793, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.57% (0.3865 => 0.4312, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: 11.40% (17.1811 => 19.1403, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.24% (0.4636 => 0.5157, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.93% (14.3668 => 15.9365, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/parameter-passing: 10.90% (0.3927 => 0.4355, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.82% (0.2430 => 0.2693, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.4103 => 0.4544, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.49% (0.4203 => 0.4644, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.48% (0.3427 => 0.3786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.4048 => 0.4456, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 9.82% (0.3422 => 0.3758, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1268 => 0.1392, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3473 => 0.3810, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.69% (0.3603 => 0.3952, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.58% (0.3684 => 0.4037, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.46% (0.3826 => 0.4188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3543 => 0.3878, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.32% (0.3497 => 0.3823, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.01% (10.3673 => 11.3015, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.59% (0.4064 => 0.4413, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 7.94% (63.2438 => 68.2630, std.dev.: 0.0189) SingleSource/UnitTests/ObjC++/property-reference: 7.85% (0.7326 => 0.7901, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (2.0665 => 2.2167, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 7.24% (1.2842 => 1.3772, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/except: 7.18% (0.2871 => 0.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.81% (0.3935 => 0.4203, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (2.2022 => 2.3511, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.35% (0.4879 => 0.5189, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.13% (0.2725 => 0.2892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.12% (0.2793 => 0.2964, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.09% (0.3136 => 0.3327, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.90% (0.2714 => 0.2874, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.57% (7.9617 => 8.1660, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2478, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4542, std.dev.: 0.0038) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9188, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6395 => 3.7135, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2809, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2785, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4512, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.54% (0.8651 => 0.2116, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.20% (5.3855 => 4.4593, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.80% (5.3526 => 4.4532, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -13.43% (10.4361 => 9.0341, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.29% (1.7609 => 1.6149, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9415, std.dev.: 0.0197) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.92% (1.9577 => 0.6477, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3057, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -33.65% (1.5373 => 1.0200, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4249, std.dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8576, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0043, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -13.18% (3.1443 => 2.7298, std.dev.: 0.0029) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4926, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2610, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.80% (1.2373 => 1.1655, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.91% (8.1563 => 7.7560, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8174, std.dev.: 0.0145) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -2.06% (3.7221 => 3.6456, std.dev.: 0.0179) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.47% (3.6994 => 3.6451, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/lists: -1.30% (6.2999 => 6.2177, std.dev.: 0.0088) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0016) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 08:12:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 10:12:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130113161234.99CF62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7553?compare_to=7546&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7553, Order: 172351, Start Time: 2013-01-13 12:35:59, End Time: 2013-01-13 16:12:37 To: 7546, Order: 172345, Start Time: 2013-01-13 07:39:40, End Time: 2013-01-13 11:27:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (179 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 18.26% (0.3526 => 0.4170, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 6.47% (0.2132 => 0.2270, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.55% (2.0829 => 2.1360, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.66% (1.1560 => 1.1368, std.dev.: 0.0044) MultiSource/Applications/hbd/hbd: -1.53% (1.1437 => 1.1262, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.05% (2.3997 => 2.3744, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.17% (0.1063 => 0.1405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.15% (0.2969 => 0.3775, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.04% (0.1106 => 0.1394, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.61% (0.4139 => 0.5199, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.42% (0.4253 => 0.5334, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.36% (0.5900 => 0.7396, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.23% (0.0642 => 0.0804, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.34% (0.0415 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.0714 => 0.0887, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.13% (0.4994 => 0.6199, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.46% (0.1620 => 0.2000, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.38% (0.5000 => 0.6169, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 22.62% (1.5932 => 1.9536, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/em3d/em3d: 21.94% (0.0948 => 0.1156, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.50% (0.1107 => 0.1345, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.38% (0.1604 => 0.1947, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.78% (0.3903 => 0.4714, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 20.69% (0.1619 => 0.1954, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.96% (0.2014 => 0.2416, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.55% (0.2736 => 0.3271, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 19.09% (0.4029 => 0.4798, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.03% (0.1088 => 0.1295, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.80% (0.1218 => 0.1447, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.67% (0.1462 => 0.1735, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.33% (0.3890 => 0.4603, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 18.32% (0.0808 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.2866 => 0.3388, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.10% (1.3152 => 1.5533, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 17.92% (0.5826 => 0.6870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 17.44% (0.5546 => 0.6513, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 17.28% (1.8794 => 2.2041, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.27% (0.3271 => 0.3836, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.80% (3.5627 => 4.1613, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.75% (0.5026 => 0.5868, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.70% (1.6211 => 1.8918, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.57% (0.4658 => 0.5430, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 16.52% (0.7171 => 0.8356, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.21% (0.3930 => 0.4567, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 16.14% (0.9697 => 1.1262, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.00% (0.2875 => 0.3335, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.74% (1.9694 => 2.2794, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: 15.63% (0.2725 => 0.3151, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.57% (4.4195 => 5.1078, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/random: 15.55% (0.2803 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.52% (0.4361 => 0.5038, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: 15.44% (0.2714 => 0.3133, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.38% (0.2738 => 0.3159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 15.31% (0.2750 => 0.3171, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.26% (0.2792 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.23% (1.9966 => 2.3007, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.18% (0.2911 => 0.3353, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.15% (2.7292 => 3.1427, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/methcall: 15.14% (0.2813 => 0.3239, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 15.12% (0.2811 => 0.3236, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 15.09% (0.2823 => 0.3249) MultiSource/Applications/ClamAV/clamscan: 15.01% (4.2109 => 4.8428, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.93% (0.3060 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 14.93% (0.2780 => 0.3195, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 14.87% (1.0781 => 1.2384, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.86% (2.0673 => 2.3744, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 14.85% (0.3004 => 0.3450, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 14.76% (0.3096 => 0.3553, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 14.72% (0.9909 => 1.1368, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 14.72% (0.3267 => 0.3748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3496 => 0.4010, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 14.69% (23.5202 => 26.9757, std.dev.: 0.0159) SingleSource/UnitTests/ObjC/exceptions-4: 14.57% (0.3465 => 0.3970, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 14.57% (0.3446 => 0.3948, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.54% (0.3362 => 0.3851, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-3: 14.51% (0.3460 => 0.3962, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.50% (0.3442 => 0.3941, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.49% (0.3195 => 0.3658, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3317 => 0.3797, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 14.36% (0.3258 => 0.3726, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 14.25% (0.3650 => 0.4170, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.19% (0.3643 => 0.4160, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.05% (0.3124 => 0.3563, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 13.90% (1.4269 => 1.6253, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3726 => 0.4241, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 13.68% (0.2566 => 0.2917, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.62% (0.3678 => 0.4179, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.56% (0.3282 => 0.3727, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 13.52% (0.3477 => 0.3947, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.47% (0.3690 => 0.4187, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.43% (0.3625 => 0.4112, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 13.41% (0.4251 => 0.4821, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.39% (0.1090 => 0.1236, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 13.34% (0.4146 => 0.4699, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 13.28% (0.7875 => 0.8921, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.19% (0.3981 => 0.4506, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.67% (0.3845 => 0.4332, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 12.63% (0.5012 => 0.5645, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.55% (0.1028 => 0.1157, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 12.13% (2.1653 => 2.4280, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.94% (0.2068 => 0.2315, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 11.88% (4.6177 => 5.1663, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.2075 => 0.2319, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 11.75% (2.1013 => 2.3481, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.61% (0.6435 => 0.7182, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.59% (0.2691 => 0.3003, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 11.58% (5.5417 => 6.1832, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (0.3498 => 0.3877, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 10.63% (0.6634 => 0.7339, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.57% (0.3084 => 0.3410, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 10.37% (0.3336 => 0.3682, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.18% (0.2103 => 0.2317, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.15% (0.5361 => 0.5905, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.69% (0.1383 => 0.1517, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.68% (11.6398 => 12.7665, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.66% (0.2040 => 0.2237, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 9.66% (0.4847 => 0.5315, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.01% (0.7426 => 0.8095, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.89% (4.6926 => 5.1099, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 7.78% (0.2391 => 0.2577, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 7.67% (2.0346 => 2.1907, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.50% (0.5584 => 0.6003, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.40% (11.9555 => 12.7207, std.dev.: 0.0137) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.25% (0.3792 => 0.3991, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5205, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 92.88% (0.2162 => 0.4170, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.18% (0.3693 => 0.4106, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 6.97% (0.2122 => 0.2270, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2363, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6679, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6883, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8887, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 2.84% (0.6276 => 0.6454, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.59% (2.0820 => 2.1360, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1934, std.dev.: 0.0127) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3081, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2846, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.18% (4.0317 => 4.0792, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2086, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5986, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4792, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5839, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.98% (17.2379 => 14.3106, std.dev.: 0.0620) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9758, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7910, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -7.04% (0.2402 => 0.2233, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2190, std.dev.: 0.0059) SingleSource/UnitTests/Vector/build2: -3.73% (11.2080 => 10.7904, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.22% (197.4719 => 193.0959, std.dev.: 0.0611) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5805, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1696, std.dev.: 0.0732) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 08:18:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 10:18:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113161819.B7FEF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7554?compare_to=7551&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7554, Order: 172354, Start Time: 2013-01-13 14:18:58, End Time: 2013-01-13 16:18:25 To: 7551, Order: 172353, Start Time: 2013-01-13 12:03:46, End Time: 2013-01-13 14:01:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 10 (7 on baseline) Performance Improvements: 1 (130 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1052 (926 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 1.82% (4.3462 => 4.4254, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.54% (0.9441 => 0.9586, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3443 => 1.3636, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.06% (0.9758 => 0.9861, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 3.95% (21.8414 => 22.7052, std.dev.: 0.3126) MultiSource/Applications/siod/siod: 3.66% (3.4934 => 3.6212, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ks/ks: 2.00% (1.1526 => 1.1757, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.99% (1.3796 => 1.4070, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/pi: 1.76% (2.1681 => 2.2062, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.60% (2.4656 => 2.5050, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/sgefa/sgefa: -3.63% (0.3303 => 0.3183, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.89% (1.1170 => 1.1071, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.25% (0.0212 => 0.0221, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0430 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0333 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -20.75% (0.0318 => 0.0252, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.57% (0.0350 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -16.43% (0.0207 => 0.0173, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -9.46% (0.0222 => 0.0201, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.46% (0.0253 => 0.0224, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.04% (0.1445 => 0.1430, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 0.74% (1.1424 => 1.1509, std.dev.: 0.0362) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.95% (0.3975 => 0.4132, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.70% (0.1416 => 0.1525, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.96% (0.0939 => 0.0883, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.82% (0.0220 => 0.0257, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.02% (0.0544 => 0.0533, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.65% (1.1470 => 1.1659, std.dev.: 0.1511) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0001 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.67% (0.0545 => 0.0525, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.72% (0.0318 => 0.0268, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.51% (0.7444 => 0.7406, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -80.00% (0.0005 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.55% (0.0053 => 0.0049, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (12.7583 => 12.7470, std.dev.: 0.0937) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 44.64% (0.0336 => 0.0486, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319237.50% (0.0008 => 2.5547, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.63% (1.1825 => 2.4197, std.dev.: 0.0260) MultiSource/Benchmarks/nbench/nbench: 10.69% (20.5117 => 22.7052, std.dev.: 0.3126) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.03% (0.2562 => 0.2819, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/pi: 3.14% (2.1390 => 2.2062, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.20% (2.4753 => 2.5050, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -42.33% (0.0808 => 0.0466, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -27.60% (0.1888 => 0.1367, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.61% (0.1009 => 0.0791, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -20.79% (1.8964 => 1.5021, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.27% (0.0676 => 0.0539, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.56% (0.0862 => 0.0702, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.89% (0.1079 => 0.0886, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.30% (0.7686 => 0.6356, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.31% (1.0986 => 0.9414, std.dev.: 0.0307) MultiSource/Applications/Burg/burg: -13.72% (1.5979 => 1.3787, std.dev.: 0.0165) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.67% (0.4074 => 0.3517, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -13.42% (1.0220 => 0.8848, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -12.78% (0.1369 => 0.1194, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.63% (0.0847 => 0.0740, std.dev.: 0.0003) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.60% (1.2154 => 1.0623, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: -11.73% (2.4719 => 2.1819, std.dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: -11.67% (1.1433 => 1.0099, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.62% (0.7693 => 0.6799, std.dev.: 0.0105) MultiSource/Applications/sgefa/sgefa: -11.53% (0.3598 => 0.3183, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.47% (6.4235 => 5.6868, std.dev.: 0.0492) MultiSource/Applications/aha/aha: -11.47% (0.1378 => 0.1220, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -10.97% (4.6406 => 4.1315, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -10.65% (9.8875 => 8.8344, std.dev.: 0.0979) MultiSource/Benchmarks/Prolangs-C/loader/loader: -10.53% (0.3560 => 0.3185, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.24% (0.9124 => 0.8190, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.16% (0.2372 => 0.2131, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.96% (0.2481 => 0.2234, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.88% (1.5131 => 1.3636, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.69% (0.6885 => 0.6218, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.66% (10.2703 => 9.2785, std.dev.: 0.0425) MultiSource/Benchmarks/Olden/health/health: -9.57% (0.1610 => 0.1456, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.56% (1.1498 => 1.0399, std.dev.: 0.0230) MultiSource/Applications/sqlite3/sqlite3: -9.46% (17.5634 => 15.9022, std.dev.: 0.5734) MultiSource/Applications/siod/siod: -9.32% (2.6437 => 2.3972, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.24% (0.5746 => 0.5215, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.22% (0.9588 => 0.8704, std.dev.: 0.0161) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.89% (1.1731 => 1.0688, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: -8.83% (0.8653 => 0.7889, std.dev.: 0.0210) MultiSource/Applications/ClamAV/clamscan: -8.81% (17.4365 => 15.9004, std.dev.: 0.2965) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.48% (1.6874 => 1.5443, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.88% (0.2283 => 0.2103, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: -7.08% (0.2006 => 0.1864, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -6.84% (0.5134 => 0.4783, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/moments: -6.82% (0.4002 => 0.3729, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -6.57% (1.3979 => 1.3060, std.dev.: 0.0176) MultiSource/Applications/d/make_dparser: -6.57% (3.7840 => 3.5355, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.43% (1.8127 => 1.6962, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.1928 => 0.1807, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.23% (0.2618 => 0.2455, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -6.00% (0.2385 => 0.2242, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.95% (0.1798 => 0.1691, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: -5.86% (0.2305 => 0.2170, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7693 => 0.7246, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -5.80% (0.2725 => 0.2567, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -5.71% (0.2135 => 0.2013, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.60% (0.6934 => 0.6546, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.57% (0.3462 => 0.3269, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.50% (0.3981 => 0.3762, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -5.45% (0.2551 => 0.2412, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.44% (3.6295 => 3.4321, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: -5.35% (0.7776 => 0.7360, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.2172 => 0.2058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.3665 => 0.3481, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.01% (0.3093 => 0.2938, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.82% (5.0381 => 4.7953, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: -4.81% (1.4392 => 1.3700, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/lists1: -4.68% (0.3206 => 0.3056, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.63% (0.6135 => 0.5851, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: -4.54% (0.4689 => 0.4476, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: -4.46% (0.6711 => 0.6412, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: -4.33% (16.4479 => 15.7364, std.dev.: 0.0745) MultiSource/Benchmarks/McCat/08-main/main: -4.29% (0.2915 => 0.2790, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.26% (1.3220 => 1.2657, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/ary3: -4.21% (0.2564 => 0.2456, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: -4.12% (0.3715 => 0.3562, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.11% (0.2577 => 0.2471, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.04% (4.6579 => 4.4695, std.dev.: 0.0202) MultiSource/Applications/kimwitu++/kc: -4.01% (18.9377 => 18.1777, std.dev.: 0.1449) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.69% (0.6996 => 0.6738, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.68% (1.2680 => 1.2214, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: -3.66% (4.5936 => 4.4254, std.dev.: 0.0247) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.64% (1.0234 => 0.9861, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.64% (0.9214 => 0.8879, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.54% (0.3847 => 0.3711, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -3.27% (0.3273 => 0.3166, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.11% (7.2721 => 7.0463, std.dev.: 0.0416) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.00% (0.4762 => 0.4619, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.78% (7.3529 => 7.1485, std.dev.: 0.0514) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.60% (2.4519 => 2.3882, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: -2.30% (5.3553 => 5.2320, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/football/football: -1.71% (0.9759 => 0.9592, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.56% (0.9372 => 0.6508, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.53% (1.0816 => 0.7730, std.dev.: 0.0787) MultiSource/Applications/minisat/minisat: -22.68% (7.9891 => 6.1775, std.dev.: 0.1734) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.84% (1.5623 => 1.2836, std.dev.: 0.0121) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.54% (0.0845 => 0.0739, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.78% (1.4235 => 1.2558, std.dev.: 0.0294) SingleSource/Benchmarks/Shootout/hash: -10.61% (4.5259 => 4.0455, std.dev.: 0.1586) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.83% (5.0421 => 4.5463, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.56% (0.4081 => 0.3691, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/lists1: -9.17% (0.6628 => 0.6020, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: -9.01% (9.0650 => 8.2482, std.dev.: 0.0283) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.19% (23.3986 => 21.4827, std.dev.: 0.4975) MultiSource/Applications/oggenc/oggenc: -7.92% (0.1704 => 0.1569, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.33% (1.4588 => 1.3519, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.30% (46.0987 => 43.6552, std.dev.: 0.2460) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.08% (0.3349 => 0.3179, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -4.37% (0.2427 => 0.2321, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -3.36% (17.2182 => 16.6393, std.dev.: 0.0177) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.02% (2.5170 => 2.4411, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.01% (2.4498 => 2.3761, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.87% (61.0379 => 59.2838, std.dev.: 0.3744) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.60% (1.4446 => 1.4070, std.dev.: 0.0097) SingleSource/Benchmarks/McGill/chomp: -2.55% (1.0425 => 1.0159, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/ffbench: -2.55% (1.4244 => 1.3881, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: -2.55% (0.8521 => 0.8304, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.35% (0.5826 => 0.5689, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -2.29% (2.8571 => 2.7918, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.75% (3.0082 => 2.9555, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.55% (3.7662 => 3.7078, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.51% (5.9063 => 5.8172, std.dev.: 0.0242) SingleSource/Benchmarks/Stanford/FloatMM: -1.40% (0.8328 => 0.8211, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.36% (3.3596 => 3.3138, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: -1.29% (14.9448 => 14.7513, std.dev.: 0.0290) MultiSource/Applications/aha/aha: -1.19% (3.5321 => 3.4901, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -1.18% (1.5825 => 1.5639, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/dt: -1.10% (0.9870 => 0.9761, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -1.04% (2.9083 => 2.8781, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.10% (1.2047 => 1.1071, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.17% (0.0328 => 0.0252, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -18.78% (0.0213 => 0.0173, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -11.45% (0.0227 => 0.0201, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.16% (0.0255 => 0.0224, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.54% (0.1530 => 0.1430, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -40.35% (1.9293 => 1.1509, std.dev.: 0.0362) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.05% (0.4049 => 0.4132, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.99% (0.1510 => 0.1525, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.71% (0.0978 => 0.0883, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.88% (0.0276 => 0.0257, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.66% (0.0590 => 0.0533, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.36% (1.1617 => 1.1659, std.dev.: 0.1511) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.93% (0.0610 => 0.0525, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0268 => 0.0268, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.74% (0.0092 => 0.0049, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.24% (12.7781 => 12.7470, std.dev.: 0.0937) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 08:40:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 10:40:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113164020.1613B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7555?compare_to=7550&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7555, Order: 172355, Start Time: 2013-01-13 15:06:15, End Time: 2013-01-13 16:40:23 To: 7550, Order: 172354, Start Time: 2013-01-13 12:27:33, End Time: 2013-01-13 14:01:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.64% (0.0717 => 0.1202, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 44.47% (0.1500 => 0.2167, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.34% (0.6395 => 0.8783, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.54% (0.6395 => 0.8668, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.80% (0.6260 => 0.8376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.51% (0.5688 => 0.7537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.30% (0.5805 => 0.7680, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.75% (0.6230 => 0.8208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.20% (0.5567 => 0.7304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.11% (0.5941 => 0.7789, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.70% (0.5802 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.68% (0.6033 => 0.7884, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.20% (0.5705 => 0.7428, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.18% (0.5849 => 0.7614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.76% (0.5478 => 0.7108, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.67% (0.6440 => 0.8351, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.61% (0.5570 => 0.7219, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.41% (0.5569 => 0.7207, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.38% (0.5925 => 0.7666, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.28% (0.5591 => 0.7228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.30% (0.6052 => 0.7765, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.30% (0.6676 => 0.8565, std.dev.: 0.0093) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.16% (0.5863 => 0.7514, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.16% (0.6446 => 0.8261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.05% (0.5857 => 0.7500, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.78% (0.6304 => 0.8055, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.20% (1.6474 => 2.0955, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.57% (0.6194 => 0.7840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.31% (0.6660 => 0.8412, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.06% (0.6297 => 0.7938, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.92% (0.6681 => 0.8413, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.33% (0.6667 => 0.8289, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.46% (0.7524 => 0.9289, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.67% (0.0622 => 0.0763, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.36% (0.7339 => 0.8980, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.15% (2.2587 => 2.7139, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.08% (0.0566 => 0.0674, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.92% (1.1450 => 1.3158, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 14.06% (0.3357 => 0.3829, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.17% (1.6364 => 1.8192, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.13% (0.4916 => 0.5463, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.08% (4.5069 => 5.0064, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4515 => 0.4998, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.29% (3.5339 => 3.8975, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.2385 => 0.2591, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.30% (0.2001 => 0.2167, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.7021 => 0.7569, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 6.95% (1.2515 => 1.3385, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.62% (0.5329 => 0.5682, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.40% (9.2283 => 9.8185, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.29% (1.4642 => 1.5563, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.12% (0.4524 => 0.4801, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.87% (1.2784 => 1.3534, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 5.70% (0.4861 => 0.5138, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.00% (5.0226 => 5.1732, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.42% (5.4682 => 5.6006, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.3864 => 1.4188, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.32% (0.8418 => 0.8529, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.02% (1.3722 => 1.3862, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6734, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.14% (0.9531 => 1.0307, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.65% (5.1955 => 5.4370, std.dev.: 0.0042) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1668, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.32% (54.5751 => 56.3868, std.dev.: 0.1655) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2845, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5320 => 4.6003, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.51% (0.3194 => 0.2986, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.98% (0.3812 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.85% (0.3880 => 0.3653, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.85% (0.3848 => 0.3623, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.85% (0.3831 => 0.3607, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -5.78% (0.3896 => 0.3671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.77% (0.3884 => 0.3660, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.65% (0.4033 => 0.3805, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.39% (0.3837 => 0.3630, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.98% (0.2871 => 0.2728, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -4.93% (2.4924 => 2.3695, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: -4.88% (0.4199 => 0.3994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.74% (0.2428 => 0.2313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.70% (0.6347 => 0.6049, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.66% (0.3323 => 0.3168, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.53% (0.7779 => 0.7427, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -4.52% (0.6441 => 0.6150, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.49% (0.2939 => 0.2807, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.24% (0.9852 => 0.9434, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.17% (2.1713 => 2.0807, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.15% (0.3252 => 0.3117, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2616, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.55% (0.6484 => 0.6254, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (0.3621 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.44% (0.3658 => 0.3532, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.9542 => 0.9224, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.31% (0.3931 => 0.3801, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.20% (0.3849 => 0.3726, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.13% (0.3867 => 0.3746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.05% (0.4321 => 0.4189, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.91% (0.4427 => 0.4298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.69% (0.4083 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.69% (0.3788 => 0.3686, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.62% (0.4813 => 0.4687, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2740, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.38% (1.2210 => 1.1919, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.36% (1.0544 => 1.0295, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -2.33% (17.1032 => 16.7041, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.30% (1.2221 => 1.1940, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (14.2083 => 13.8856, std.dev.: 0.0294) MultiSource/Benchmarks/MallocBench/gs/gs: -2.21% (4.3330 => 4.2372, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.16% (6.7716 => 6.6250, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: -2.02% (0.7982 => 0.7821, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -1.98% (16.1920 => 15.8718, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.88% (1.2300 => 1.2069, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.88% (7.0961 => 6.9629, std.dev.: 0.0073) MultiSource/Applications/siod/siod: -1.68% (2.4021 => 2.3618, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.67% (0.9179 => 0.9026, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.54% (0.8521 => 0.8390, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.29% (8.0126 => 7.9092, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.29% (34.0927 => 33.6529, std.dev.: 0.0163) MultiSource/Applications/hbd/hbd: -1.21% (1.5610 => 1.5421, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.20% (0.9077 => 0.8968, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -1.20% (4.0594 => 4.0108, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.93% (1.8100 => 0.6890, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3107, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0290, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -23.52% (7.5137 => 5.7463, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0351, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.96% (0.6299 => 0.5042, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1309, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.93% (0.4092 => 0.3522, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1035, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7253, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1734, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.12% (7.9763 => 7.7278, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.58% (3.7241 => 3.6279, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.51% (1.3096 => 1.2767, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1928, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8093, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7092 => 3.6607, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.17% (1.6307 => 1.6117, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 09:23:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 11:23:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113172324.011632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7556?compare_to=7552&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7556, Order: 172355, Start Time: 2013-01-13 15:12:39, End Time: 2013-01-13 17:23:27 To: 7552, Order: 172354, Start Time: 2013-01-13 12:30:04, End Time: 2013-01-13 14:40:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (210 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (660 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8374 => 499.8446, std.dev.: 0.0074) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.25% (1.1277 => 499.8446, std.dev.: 0.0074) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.28% (0.5229 => 1.6486, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 19.39% (14.9895 => 17.8966, std.dev.: 0.0227) MultiSource/Applications/kimwitu++/kc: 42.30% (14.1553 => 20.1430, std.dev.: 0.0110) MultiSource/Benchmarks/MallocBench/gs/gs: 17.27% (4.1105 => 4.8204, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.86% (1.1048 => 1.7440, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.87% (7.1582 => 37.4998, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.23% (3.4629 => 6.3451, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 72.66% (0.6222 => 1.0743, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.03% (0.0720 => 7.4441, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11168100.00% (0.0001 => 11.1682, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850900.00% (0.0001 => 9.8510, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5480000.00% (0.0001 => 5.4801, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.87% (1.1194 => 10.3306, std.dev.: 0.0064) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.99% (22.1758 => 55.4367, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.64% (0.0929 => 0.1771, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.68% (2.9384 => 4.6040, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.20% (7.0540 => 10.8774, std.dev.: 0.0060) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.65% (1.5859 => 2.3892, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.56% (8.1363 => 11.9243, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: 41.69% (21.9371 => 31.0835, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.72% (2.2024 => 3.0993, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: 39.08% (0.3109 => 0.4324, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.63% (4.2646 => 5.6989, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.98% (1.5415 => 2.0499, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.98% (0.4615 => 0.6091, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 31.20% (0.0814 => 0.1068, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.60% (0.1892 => 0.2452, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.37% (0.2271 => 0.2938, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.10% (0.4299 => 0.5550, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 28.65% (1.1642 => 1.4978, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.04% (0.6675 => 0.8547, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.37% (0.5105 => 0.6451, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.01% (0.1584 => 0.1996, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.58% (3.8922 => 4.8877, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.45% (0.1175 => 0.1474, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.26% (0.1655 => 0.2073, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 24.98% (0.2554 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.84% (0.0793 => 0.0990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 24.54% (1.0722 => 1.3353, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.35% (1.4186 => 1.7498, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.29% (0.3121 => 0.3848, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.78% (9.4845 => 11.6447, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.59% (0.1337 => 0.1639, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 22.08% (0.4289 => 0.5236, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.81% (0.2700 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.59% (0.1695 => 0.2061, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.47% (0.4620 => 0.5612, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 21.35% (0.7115 => 0.8634, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.45% (5.7591 => 6.9368, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.19% (1.3050 => 1.5685, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.15% (0.1236 => 0.1485, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 19.86% (0.7835 => 0.9391, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.85% (0.0675 => 0.0809, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.60% (4.9449 => 5.9143, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.48% (0.0842 => 0.1006, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 19.34% (0.3098 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.29% (0.1695 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.11% (0.5860 => 0.6980, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 19.01% (3.3354 => 3.9695, std.dev.: 0.0078) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.79% (5.0018 => 5.9416, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 18.79% (0.6456 => 0.7669, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.0953 => 0.1132, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.66% (0.1940 => 0.2302, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.64% (0.8172 => 0.9695, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 18.40% (0.0614 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.06% (0.0886 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.84% (0.2758 => 0.3250, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.51% (0.5020 => 0.5899, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.12% (1.1840 => 1.3867, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1268 => 0.1485, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.09% (0.7433 => 0.8703, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.91% (0.3423 => 0.4002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.84% (0.5569 => 0.6507, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 16.63% (3.8723 => 4.5161, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.57% (0.3307 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 16.32% (2.0273 => 2.3582, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.17% (0.5981 => 0.6948, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.62% (0.2049 => 0.2369, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.55% (2.2969 => 2.6540, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.52% (0.3441 => 0.3975, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.52% (0.8101 => 0.9358, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.32% (0.6450 => 0.7438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 14.96% (0.3283 => 0.3774, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.62% (0.3180 => 0.3645, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/football/football: 14.49% (0.8921 => 1.0214, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.34% (1.1861 => 1.3562, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.29% (0.3232 => 0.3694, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.50% (0.8067 => 0.9156, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.48% (0.2603 => 0.2954, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.33% (1.5603 => 1.7527, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary2: 12.25% (0.3379 => 0.3793, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.52% (17.1811 => 19.1601, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.49% (0.3865 => 0.4309, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.24% (0.4636 => 0.5157, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 10.91% (0.3282 => 0.3640, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.81% (14.3668 => 15.9199, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.74% (0.2430 => 0.2691, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.70% (0.4103 => 0.4542, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.64% (0.4203 => 0.4650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.53% (0.3427 => 0.3788, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.51% (0.3092 => 0.3417, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 10.20% (0.4048 => 0.4461, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.08% (0.3828 => 0.4214, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Puzzle: 9.86% (0.1268 => 0.1393, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.85% (0.3422 => 0.3759, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.74% (0.3603 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.64% (0.3826 => 0.4195, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3543 => 0.3878, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3694 => 0.4043, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.45% (0.3684 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.41% (0.3561 => 0.3896, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.38% (0.3497 => 0.3825, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.83% (10.3673 => 11.2824, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.71% (0.4064 => 0.4418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.33% (0.6030 => 0.6532, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.08% (0.5925 => 0.6404, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 7.92% (63.2438 => 68.2545, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/property-reference: 7.75% (0.7326 => 0.7894, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.27% (2.0665 => 2.2167, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 7.18% (1.2842 => 1.3764, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.08% (2.2022 => 2.3582, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 7.07% (0.2871 => 0.3074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.91% (0.3935 => 0.4207, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.52% (0.4879 => 0.5197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (7.9617 => 8.1675, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2539, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.07% (1.1396 => 1.2430, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (4.2280 => 4.4466, std.dev.: 0.0141) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.52% (0.9957 => 1.0307, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.6802 => 8.8971, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.44% (3.6395 => 3.7284, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.77% (9.1159 => 9.2776, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2787, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1686, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.53% (0.8651 => 0.2117, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.90% (0.1622 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4671, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.78% (5.3526 => 4.4545, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -13.42% (10.4361 => 9.0351, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.30% (1.7609 => 1.6148, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9430, std.dev.: 0.0165) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.21% (1.9577 => 0.6419, std.dev.: 0.0216) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -33.50% (1.5373 => 1.0223, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4284, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8574, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.34% (2.6546 => 2.0086, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4939, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2979, std.dev.: 0.0243) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2373 => 1.1603, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.98% (1.6805 => 1.5800, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (8.1563 => 7.7484, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-5: -4.83% (1.5835 => 1.5070, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.50% (10.2830 => 9.8200, std.dev.: 0.0205) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7221 => 3.6763, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/ary3: -1.11% (3.6994 => 3.6585, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0001) Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 10:37:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 12:37:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113183733.966662A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7557?compare_to=7555&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7557, Order: 172361, Start Time: 2013-01-13 17:03:49, End Time: 2013-01-13 18:37:37 To: 7555, Order: 172355, Start Time: 2013-01-13 15:06:15, End Time: 2013-01-13 16:40:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398) MultiSource/Benchmarks/FreeBench/neural/neural: 44.33% (0.1500 => 0.2165, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.43% (0.6395 => 0.8661, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.88% (0.6260 => 0.8381, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.44% (0.5805 => 0.7688, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.42% (0.5688 => 0.7532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.26% (0.5456 => 0.7216, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.83% (0.6230 => 0.8213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.44% (0.5567 => 0.7317, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.30% (0.5575 => 0.7320, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.26% (0.5941 => 0.7798, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.52% (0.5802 => 0.7573, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.52% (0.6033 => 0.7874, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.25% (0.5705 => 0.7431, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.04% (0.5849 => 0.7606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.78% (0.6440 => 0.8358, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.72% (0.5478 => 0.7106, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.71% (0.5570 => 0.7225, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.61% (0.5569 => 0.7218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.23% (0.5925 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.21% (0.5591 => 0.7224, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.42% (0.6189 => 0.7948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.22% (0.6676 => 0.8560, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.21% (0.5857 => 0.7509, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.06% (0.5863 => 0.7508, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.96% (0.6446 => 0.8248, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.79% (0.6304 => 0.8056, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.25% (1.6474 => 2.0963, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.62% (0.6194 => 0.7843, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.22% (0.6660 => 0.8406, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.20% (0.6297 => 0.7947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.86% (0.6681 => 0.8409, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.34% (0.6667 => 0.8290, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.46% (0.7524 => 0.9289, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.47% (0.7339 => 0.8988, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.04% (2.2587 => 2.7114, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.85% (1.1450 => 1.3150, std.dev.: 0.0067) MultiSource/Applications/sgefa/sgefa: 14.06% (0.3357 => 0.3829, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.73% (0.0864 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.20% (1.6364 => 1.8197, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.96% (0.4916 => 0.5455, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.96% (4.5069 => 5.0010, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 10.74% (0.4515 => 0.5000, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.26% (3.5339 => 3.8964, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.64% (0.2385 => 0.2591, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.7021 => 0.7576, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 6.78% (1.2515 => 1.3364, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.64% (0.5329 => 0.5683, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 6.36% (9.2283 => 9.8152, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 6.10% (0.4524 => 0.4800, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.01% (0.1731 => 0.1835, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.87% (1.4642 => 1.5501, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.81% (1.2784 => 1.3527, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 5.74% (0.4861 => 0.5140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3319 => 0.3451, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.83% (5.0226 => 5.1648, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.38% (5.4682 => 5.5982, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4185, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.65% (0.8418 => 0.8557, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6734, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9531 => 1.0271, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4407, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.2380 => 0.2486, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1680, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5568, std.dev.: 0.1686) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.35% (2.0478 => 2.1165, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 2.36% (3.7435 => 3.8318, std.dev.: 0.0281) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8210 => 28.2871, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6008, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.45% (0.3194 => 0.2988, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.93% (0.3812 => 0.3586, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.85% (0.3848 => 0.3623, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.82% (0.3831 => 0.3608, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.80% (0.3880 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.72% (0.3896 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.63% (0.3891 => 0.3672, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.37% (0.3837 => 0.3631, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.95% (0.4199 => 0.3991, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.93% (2.4924 => 2.3696, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.87% (0.3057 => 0.2908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.74% (0.6347 => 0.6046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: -4.61% (0.6441 => 0.6144, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.58% (0.4280 => 0.4084, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.34% (2.1713 => 2.0771, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.24% (0.3016 => 0.2888, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.24% (0.9852 => 0.9434, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.23% (0.3025 => 0.2897, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.16% (0.3026 => 0.2900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.03% (0.7198 => 0.6908, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -4.02% (1.3148 => 1.2620, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -3.91% (0.2989 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.81% (0.4151 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.78% (0.7779 => 0.7485, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.53% (0.3658 => 0.3529, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.48% (0.3621 => 0.3495, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.44% (0.9542 => 0.9214, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.41% (0.3931 => 0.3797, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.41% (0.6484 => 0.6263, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.14% (0.3849 => 0.3728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.08% (0.3867 => 0.3748, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.01% (0.4321 => 0.4191, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -2.97% (0.4248 => 0.4122, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.91% (0.4427 => 0.4298, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -2.75% (0.3788 => 0.3684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.69% (0.4083 => 0.3973, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.62% (0.4813 => 0.4687, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.56% (0.7919 => 0.7716, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2448, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.40% (1.2210 => 1.1917, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.38% (1.0544 => 1.0293, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1943, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -2.27% (4.3330 => 4.2346, std.dev.: 0.0242) MultiSource/Applications/sqlite3/sqlite3: -2.26% (17.1032 => 16.7162, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.19% (14.2083 => 13.8978, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: -2.12% (0.7982 => 0.7813, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.06% (6.7716 => 6.6321, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: -2.06% (16.1920 => 15.8589, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.80% (0.5999 => 0.5891, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -1.78% (7.0961 => 6.9697, std.dev.: 0.0252) MultiSource/Applications/siod/siod: -1.71% (2.4021 => 2.3611, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.64% (0.8521 => 0.8381, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.60% (1.2300 => 1.2103, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.33% (34.0927 => 33.6407, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.32% (8.0126 => 7.9071, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.30% (1.5610 => 1.5407, std.dev.: 0.0015) MultiSource/Applications/lua/lua: -1.26% (4.0594 => 4.0082, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.12% (0.9077 => 0.8975, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.41% (1.8100 => 0.6985, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2406, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.89% (1.3643 => 1.0247, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0370, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1332, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7253, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3403, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.27% (0.5142 => 0.4614, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.11% (4.1534 => 3.8583, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7280, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.45% (3.7241 => 3.6327, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8025, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1948, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5860, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.05% (1.6307 => 1.6135, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 10:38:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 12:38:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113183825.288E82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7558?compare_to=7554&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7558, Order: 172361, Start Time: 2013-01-13 16:38:21, End Time: 2013-01-13 18:38:30 To: 7554, Order: 172354, Start Time: 2013-01-13 14:18:58, End Time: 2013-01-13 16:18:25 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 6 (7 on baseline) Performance Improvements: 2 (67 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1055 (989 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.91% (0.6218 => 0.6399, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.38% (0.9612 => 0.9745, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.11% (1.4655 => 1.8335, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.35% (2.3761 => 2.4557, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.01% (4.3687 => 4.4566, std.dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (63.4602 => 64.4496, std.dev.: 0.0221) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -9.12% (22.7052 => 20.6335, std.dev.: 0.6731) MultiSource/Benchmarks/7zip/7zip-benchmark: -4.78% (9.5460 => 9.0893, std.dev.: 0.1272) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.13% (1.1071 => 1.1057, std.dev.: 0.2805) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.36% (0.0221 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0430 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.10% (0.0334 => 0.0341, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.19% (0.0252 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0429 => 0.0429, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 19.65% (0.0173 => 0.0207, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 9.45% (0.0201 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 12.95% (0.0224 => 0.0253, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 2.87% (0.1430 => 0.1471, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 1.46% (1.1509 => 1.1677, std.dev.: 0.4301) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.30% (0.4132 => 0.4227, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.85% (0.1525 => 0.1512, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.89% (0.0883 => 0.0988, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.28% (0.0257 => 0.0268, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.31% (0.0533 => 0.0540, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1659 => 1.1650, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.67% (0.0525 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7406 => 0.7423, std.dev.: 0.0047) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 151.02% (0.0049 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.08% (12.7470 => 12.7571, std.dev.: 0.0316) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 317962.50% (0.0008 => 2.5445, std.dev.: 0.0267) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.96% (1.1825 => 2.4118, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.98% (0.2562 => 0.2869, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/pi: 3.20% (2.1390 => 2.2074, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (63.1520 => 64.4496, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.63% (4.3851 => 4.4566, std.dev.: 0.0202) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.62% (0.1684 => 0.1303, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.23% (0.0676 => 0.0546, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.49% (1.0986 => 0.9284, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.74% (0.1079 => 0.0920, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.22% (0.7686 => 0.6593, std.dev.: 0.0198) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.51% (0.0847 => 0.0741, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.38% (6.4235 => 5.6925, std.dev.: 0.1306) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.57% (10.2703 => 9.2877, std.dev.: 0.2510) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.44% (1.5131 => 1.3703, std.dev.: 0.0280) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.19% (0.1317 => 0.1196, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.19% (0.9124 => 0.8377, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.06% (0.2481 => 0.2281, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: -7.13% (0.2006 => 0.1863, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.06% (0.6885 => 0.6399, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -6.99% (0.5134 => 0.4775, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.91% (1.0017 => 0.9325, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.52% (0.2100 => 0.1963, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -6.18% (0.2135 => 0.2003, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -6.16% (0.2385 => 0.2238, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -6.07% (0.1928 => 0.1811, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -6.02% (0.4002 => 0.3761, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.87% (0.3665 => 0.3450, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.80% (0.7693 => 0.7247, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.61% (0.2709 => 0.2557, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.58% (0.3981 => 0.3759, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.48% (0.9507 => 0.8986, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/wc: -5.08% (0.2305 => 0.2188, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.06% (1.3310 => 1.2637, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: -4.98% (0.2551 => 0.2424, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -4.97% (0.4689 => 0.4456, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.83% (0.9422 => 0.8967, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -4.69% (0.2665 => 0.2540, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: -4.62% (0.3206 => 0.3058, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.3462 => 0.3305, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.44% (0.8990 => 0.8591, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.34% (0.9091 => 0.8696, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.05% (1.0052 => 0.9745, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.99% (0.3847 => 0.3732, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.84% (1.0119 => 0.9832, std.dev.: 0.0051) MultiSource/Benchmarks/nbench/nbench: -2.35% (1.2708 => 1.2409, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.96% (0.9998 => 0.9802, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.80% (0.9381 => 0.9212, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.25% (4.9104 => 4.8490, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.61% (0.9372 => 0.6503, std.dev.: 0.0946) SingleSource/Benchmarks/Shootout/heapsort: -30.25% (4.4739 => 3.1205, std.dev.: 0.0792) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.52% (4.2042 => 3.1314, std.dev.: 0.0190) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.83% (0.1164 => 0.1003, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: -10.84% (4.5259 => 4.0353, std.dev.: 0.0350) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.58% (1.6547 => 1.4797, std.dev.: 0.0311) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.33% (1.4588 => 1.3373, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/lists1: -8.03% (0.6628 => 0.6096, std.dev.: 0.0081) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.02% (4.4540 => 4.0968, std.dev.: 0.0224) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/nestedloop: -7.18% (0.2200 => 0.2042, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -6.35% (2.2304 => 2.0888, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: -3.60% (1.0425 => 1.0050, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: -3.49% (17.2182 => 16.6171, std.dev.: 0.0611) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.05% (1.4446 => 1.4006, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (40.4729 => 39.2691, std.dev.: 0.4172) SingleSource/Benchmarks/Misc/mandel-2: -2.36% (0.8521 => 0.8320, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: -1.93% (0.6254 => 0.6133, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.85% (7.2040 => 7.0706, std.dev.: 0.0491) SingleSource/Benchmarks/Misc/ffbench: -1.68% (1.4244 => 1.4004, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.36% (3.1921 => 3.1487, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3596 => 3.3176, std.dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.22% (1.2047 => 1.1057, std.dev.: 0.2805) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -3.86% (0.1530 => 0.1471, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -39.48% (1.9293 => 1.1677, std.dev.: 0.4301) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.40% (0.4049 => 0.4227, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.13% (0.1510 => 0.1512, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.02% (0.0978 => 0.0988, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.90% (0.0276 => 0.0268, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.47% (0.0590 => 0.0540, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.28% (1.1617 => 1.1650, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.20% (0.0610 => 0.0560, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7437 => 0.7423, std.dev.: 0.0047) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.16% (12.7781 => 12.7571, std.dev.: 0.0316) Report Time: 0.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 12:04:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 14:04:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113200417.5D2FB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7559?compare_to=7556&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7559, Order: 172362, Start Time: 2013-01-13 17:53:27, End Time: 2013-01-13 20:04:20 To: 7556, Order: 172355, Start Time: 2013-01-13 15:12:39, End Time: 2013-01-13 17:23:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (212 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (660 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.27% (11.2824 => 11.1394, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8446 => 499.7522, std.dev.: 0.0520) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44216.06% (1.1277 => 499.7522, std.dev.: 0.0520) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.90% (0.5229 => 1.6466, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 19.42% (14.9895 => 17.9007, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: 42.70% (14.1553 => 20.2002, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 17.22% (4.1105 => 4.8185, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.78% (1.1048 => 1.7431, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.02% (7.1582 => 37.5101, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.69% (3.4629 => 6.3610, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 72.95% (0.6222 => 1.0761, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.86% (0.0720 => 7.4411, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 3834900.00% (0.0001 => 3.8350, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11158200.00% (0.0001 => 11.1583, std.dev.: 0.0457) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848900.00% (0.0001 => 9.8490, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483600.00% (0.0001 => 5.4837, std.dev.: 0.0336) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.75% (1.1194 => 10.3069, std.dev.: 0.0091) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.64% (22.1758 => 55.3606, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.64% (0.0929 => 0.1771, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 66.05% (0.0271 => 0.0450, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.59% (2.9384 => 4.6013, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.54% (7.0540 => 10.8304, std.dev.: 0.0016) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.74% (1.5859 => 2.3906, std.dev.: 0.0058) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/distray/distray: 47.82% (0.1056 => 0.1561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.39% (8.1363 => 11.9106, std.dev.: 0.0101) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.95% (2.2024 => 3.1043, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 40.71% (21.9371 => 30.8675, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 38.95% (0.3109 => 0.4320, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.58% (4.2646 => 5.6966, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.99% (1.5415 => 2.0501, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.85% (0.4615 => 0.6085, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.33% (0.0814 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.41% (0.2271 => 0.2939, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.12% (0.1892 => 0.2443, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 28.98% (0.4299 => 0.5545, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 28.53% (1.1642 => 1.4963, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.06% (0.6675 => 0.8548, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.52% (0.5105 => 0.6459, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.56% (3.8922 => 4.8872, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 25.29% (0.2554 => 0.3200, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.19% (0.1175 => 0.1471, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.09% (0.0793 => 0.0992, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 24.64% (1.0722 => 1.3364, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.82% (0.1906 => 0.2360, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.60% (1.4186 => 1.7534, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.45% (0.1143 => 0.1411, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.20% (0.3121 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.65% (9.4845 => 11.6324, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.59% (0.1337 => 0.1639, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 22.50% (0.4289 => 0.5254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.89% (0.1695 => 0.2066, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 21.60% (0.4620 => 0.5618, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.43% (0.7115 => 0.8640, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.30% (0.2700 => 0.3275, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.23% (0.1236 => 0.1486, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.18% (5.7591 => 6.9214, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.15% (1.3050 => 1.5679, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.85% (0.0675 => 0.0809, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 19.80% (0.7835 => 0.9386, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.46% (4.9449 => 5.9072, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.41% (0.1695 => 0.2024, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 19.21% (0.3098 => 0.3693, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.04% (0.5860 => 0.6976, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 19.03% (0.1151 => 0.1370, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 18.97% (0.6456 => 0.7681, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 18.85% (3.3354 => 3.9641, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.78% (5.0018 => 5.9410, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.68% (0.0953 => 0.1131, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.66% (0.1940 => 0.2302, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.50% (0.8172 => 0.9684, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 18.40% (0.0614 => 0.0727, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.17% (0.0886 => 0.1047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.43% (0.5020 => 0.5895, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904) MultiSource/Applications/lambda-0_1_3/lambda: 17.36% (0.7433 => 0.8723, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 17.27% (0.1268 => 0.1487, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.26% (0.2758 => 0.3234, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3871, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.13% (0.0648 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.09% (0.9765 => 1.1434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.95% (0.5569 => 0.6513, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.3423 => 0.4001, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.80% (0.2107 => 0.2461, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.75% (0.3307 => 0.3861, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.73% (3.8723 => 4.5201, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 16.44% (2.0273 => 2.3606, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.23% (0.5981 => 0.6952, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.22% (0.2065 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.05% (0.8101 => 0.9401, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 15.77% (2.2969 => 2.6592, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.63% (0.3441 => 0.3979, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.52% (0.1044 => 0.1206, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.50% (0.6450 => 0.7450, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 15.37% (0.2049 => 0.2364, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.35% (0.0834 => 0.0962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 14.80% (0.3283 => 0.3769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.69% (0.3180 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.61% (0.8921 => 1.0224, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.48% (1.1861 => 1.3579, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 14.42% (0.3232 => 0.3698, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.67% (0.8067 => 0.9170, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.56% (0.2603 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.43% (1.5603 => 1.7543, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 12.28% (0.3379 => 0.3794, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.69% (0.3865 => 0.4317, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.37% (0.4636 => 0.5163, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 11.36% (17.1811 => 19.1324, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.95% (0.2430 => 0.2696, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.87% (0.4103 => 0.4549, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.85% (14.3668 => 15.9259, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/oourafft: 10.69% (0.3282 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 10.59% (0.3927 => 0.4343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.54% (0.4203 => 0.4646, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.51% (0.3092 => 0.3417, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.45% (0.3427 => 0.3785, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.4048 => 0.4456, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 9.99% (0.3684 => 0.4052, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3422 => 0.3763, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.86% (0.1268 => 0.1393, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.80% (0.3826 => 0.4201, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 9.80% (0.3603 => 0.3956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3694 => 0.4036, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.21% (0.3561 => 0.3889, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.13% (0.3473 => 0.3790, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3543 => 0.3866, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.67% (63.2438 => 68.0955, std.dev.: 0.0109) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7326 => 0.7881, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (10.3673 => 11.1394, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.38% (1.2842 => 1.3790, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.28% (2.0665 => 2.2170, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: 7.14% (0.2871 => 0.3076, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.84% (0.3935 => 0.4204, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.61% (0.2891 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.51% (0.2872 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.46% (0.2725 => 0.2901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.42% (0.2756 => 0.2933, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.40% (2.2022 => 2.3431, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.19% (0.3052 => 0.3241, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.15% (0.4879 => 0.5179, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.03% (0.3136 => 0.3325, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.97% (0.2714 => 0.2876, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (7.9617 => 8.1574, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2532, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4500, std.dev.: 0.0111) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3109, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.52% (0.9957 => 1.0307, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.6802 => 8.9175, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7109, std.dev.: 0.0071) MultiSource/Applications/minisat/minisat: 1.94% (9.1159 => 9.2931, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2788, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5825, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.77% (5.2763 => 1.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.55% (0.8651 => 0.2115, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.83% (0.1622 => 0.0911) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.73% (5.3855 => 4.4309, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.33% (5.3526 => 4.4250, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: -13.60% (10.4361 => 9.0169, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.49% (1.7609 => 1.6114, std.dev.: 0.0097) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 50.0006, std.dev.: 0.0191) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.82% (1.9577 => 0.6495, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4273, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8565, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0061, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.66% (2.5528 => 2.1276, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7312, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2624, std.dev.: 0.0291) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.16% (1.2373 => 1.1611, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.06% (8.1563 => 7.7434, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8251, std.dev.: 0.0144) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -1.87% (3.6994 => 3.6301, std.dev.: 0.0207) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7221 => 3.6714, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0000) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 12:34:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 14:34:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113203450.182942A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7560?compare_to=7557&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7560, Order: 172363, Start Time: 2013-01-13 19:00:55, End Time: 2013-01-13 20:34:52 To: 7557, Order: 172361, Start Time: 2013-01-13 17:03:49, End Time: 2013-01-13 18:37:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 18 (108 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1086 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/lencod/lencod: 3.35% (15.8589 => 16.3900, std.dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (6.9697 => 7.1539, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 2.55% (9.8152 => 10.0658, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.32% (6.6321 => 6.7857, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.03% (0.6908 => 0.7048, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.98% (7.9071 => 8.0637, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (22.5541 => 22.9983, std.dev.: 0.0115) MultiSource/Applications/d/make_dparser: 1.95% (3.5346 => 3.6034, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: 1.87% (1.3150 => 1.3396, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.78% (16.7162 => 17.0145, std.dev.: 0.0152) MultiSource/Applications/Burg/burg: 1.59% (1.3364 => 1.3576, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.24% (15.5730 => 15.7663, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.19% (4.8089 => 4.8663, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.14% (1.5501 => 1.5678, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 1.12% (2.3696 => 2.3961, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 1.11% (1.4185 => 1.4343, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (4.8581 => 4.9112, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 1.01% (4.0082 => 4.0488, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 87.50% (0.0280 => 0.0525, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.40% (0.0974 => 0.1572, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 52.81% (0.0267 => 0.0408) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.54% (0.6395 => 0.8668, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.71% (0.6260 => 0.8370, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.33% (0.5805 => 0.7682, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.24% (0.5688 => 0.7522, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.15% (0.5456 => 0.7210, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.81% (0.6230 => 0.8212, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.31% (0.5941 => 0.7801, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.20% (0.5567 => 0.7304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.17% (0.5575 => 0.7313, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.11% (0.5581 => 0.7317, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.46% (0.5802 => 0.7569, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.39% (0.5705 => 0.7439, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.90% (0.5849 => 0.7598, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.84% (0.5570 => 0.7232, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.83% (0.5859 => 0.7607, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.70% (0.5478 => 0.7105, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.53% (0.6440 => 0.8342, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.48% (0.5591 => 0.7239, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.39% (0.5569 => 0.7206, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.32% (0.5925 => 0.7662, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 29.19% (0.0418 => 0.0540, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.36% (0.6189 => 0.7944, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.14% (0.5857 => 0.7505, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.06% (0.6446 => 0.8255, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.02% (0.5863 => 0.7506, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.89% (0.6304 => 0.8062, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.32% (1.6474 => 2.0974, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.65% (0.6194 => 0.7845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.32% (0.6660 => 0.8413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.29% (0.0445 => 0.0562, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.03% (0.6297 => 0.7936, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.98% (0.6681 => 0.8417, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.45% (0.6667 => 0.8297, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.34% (0.7524 => 0.9280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.51% (0.7339 => 0.8991, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.06% (2.2587 => 2.7119, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 17.00% (1.1450 => 1.3396, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8425, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.51% (0.1982 => 0.2230, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.79% (4.5069 => 5.0382, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.68% (0.4916 => 0.5490, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.23% (0.4515 => 0.5022, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.30% (3.5339 => 3.8980, std.dev.: 0.0135) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.18% (0.2385 => 0.2604, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.08% (9.2283 => 10.0658, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7021 => 0.7646, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.48% (1.2515 => 1.3576, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.5329 => 0.5716, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.08% (1.4642 => 1.5678, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.67% (1.2784 => 1.3637, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 6.12% (0.4524 => 0.4801, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 5.91% (0.1761 => 0.1865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.66% (0.4861 => 0.5136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.3255 => 0.3434, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.22% (0.3319 => 0.3459, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.45% (1.3864 => 1.4343, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.30% (5.0226 => 5.1883, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.65% (22.4056 => 22.9983, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.64% (5.4682 => 5.6128, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.50% (3.5154 => 3.6034, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 2.41% (0.6750 => 0.6913, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 2.11% (0.8418 => 0.8596, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 1.69% (0.7447 => 0.7573, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7663, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3722 => 1.3893, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.22% (16.1920 => 16.3900, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.9557 => 0.9670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.04% (4.8161 => 4.8663, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6658, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4417, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1685, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5236, std.dev.: 0.1223) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0095) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2853, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6063, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4784, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.76% (0.3194 => 0.2978, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.33% (0.3812 => 0.3609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.28% (0.3848 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.23% (0.3880 => 0.3677, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.21% (0.3896 => 0.3693, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.13% (0.4033 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.09% (0.3891 => 0.3693, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.97% (0.3323 => 0.3158, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.96% (0.4176 => 0.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.87% (0.3821 => 0.3635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.82% (0.2903 => 0.2763, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.71% (0.3205 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.63% (0.2871 => 0.2738, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.59% (2.1713 => 2.0716, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.53% (0.2939 => 0.2806, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.48% (0.9852 => 0.9411, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.46% (0.3252 => 0.3107, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.45% (0.3059 => 0.2923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.43% (0.4199 => 0.4013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.40% (0.2933 => 0.2804, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.31% (0.3016 => 0.2886, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.22% (0.2989 => 0.2863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.14% (0.4280 => 0.4103, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.05% (1.3148 => 1.2616, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.93% (0.6441 => 0.6188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3961, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.73% (0.6347 => 0.6110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.59% (0.3621 => 0.3491, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.41% (0.3931 => 0.3797, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.40% (0.4151 => 0.4010, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.9542 => 0.9232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.21% (0.3867 => 0.3743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.15% (0.4248 => 0.4114, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.01% (0.4321 => 0.4191, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.99% (0.3849 => 0.3734, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -2.98% (0.3788 => 0.3675, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.88% (0.7779 => 0.7555, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.74% (0.4813 => 0.4681, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2301, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.7198 => 0.7048, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.84% (1.2210 => 1.1985, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.78% (1.2221 => 1.2003, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -1.59% (4.3330 => 4.2639, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (0.7982 => 0.7863, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.35% (14.2083 => 14.0167, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -1.14% (2.4021 => 2.3748, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.13% (1.5610 => 1.5434, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.11% (1.2300 => 1.2163, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.81% (1.8100 => 0.6913, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3111, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.81% (1.3643 => 1.0258, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0243, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.83% (4.1024 => 3.2068, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1273, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3402, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8588, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (7.9763 => 7.7242, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.89% (1.3096 => 1.2717, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.29% (3.1919 => 3.1187, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.7241 => 3.6430, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.73% (4.8776 => 4.7930, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3040 => 7.1987, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5996, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7092 => 3.6616, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 12:53:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 14:53:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130113205312.E8CF42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7561?compare_to=7553&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7561, Order: 172358, Start Time: 2013-01-13 17:14:13, End Time: 2013-01-13 20:53:16 To: 7553, Order: 172351, Start Time: 2013-01-13 12:35:59, End Time: 2013-01-13 16:12:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (179 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.47% (1.1262 => 1.1428, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 1.44% (1.1368 => 1.1532, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.36% (2.3744 => 2.4066, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: 1.29% (2.4556 => 2.4874, std.dev.: 0.0116) MultiSource/Benchmarks/Bullet/bullet: 1.09% (26.9757 => 27.2698, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.23% (0.0714 => 0.0937) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.74% (0.0475 => 0.0621, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.65% (0.0452 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.45% (0.2969 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.33% (0.4253 => 0.5373, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.17% (0.5900 => 0.7444, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.09% (0.4994 => 0.6297, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.04% (0.4139 => 0.5217, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.56% (0.1620 => 0.2034, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.66% (0.1107 => 0.1380, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.53% (0.1003 => 0.1249, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.16% (0.5000 => 0.6208, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.13% (0.1604 => 0.1991, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 22.95% (1.5932 => 1.9589, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.92% (0.1549 => 0.1904, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.29% (0.0822 => 0.0997, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.16% (0.3903 => 0.4729, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 21.06% (0.1619 => 0.1960, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.80% (0.2014 => 0.2433, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.36% (0.2736 => 0.3293, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.06% (0.2866 => 0.3441, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 19.91% (0.4029 => 0.4831, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 19.26% (0.5826 => 0.6948, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.08% (0.1462 => 0.1741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.92% (0.3271 => 0.3890, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 18.92% (0.5889 => 0.7003, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.84% (0.3890 => 0.4623, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 18.41% (0.5546 => 0.6567, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.29% (1.3152 => 1.5558, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 18.12% (1.8794 => 2.2200, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 17.85% (0.9697 => 1.1428, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.71% (0.5026 => 0.5916, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 17.60% (0.7171 => 0.8433, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.58% (0.4658 => 0.5477, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.19% (3.5627 => 4.1752, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.09% (1.6211 => 1.8982, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 16.89% (0.2813 => 0.3288, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: 16.77% (0.2803 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.69% (0.2738 => 0.3195, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 16.65% (0.2823 => 0.3293, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.56% (0.2911 => 0.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.55% (0.2792 => 0.3254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.55% (0.2750 => 0.3205, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.54% (0.3004 => 0.3501, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.54% (0.3930 => 0.4580, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.49% (0.2729 => 0.3179, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.48% (0.2725 => 0.3174, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 16.47% (0.2811 => 0.3274, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.41% (2.0673 => 2.4066, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.39% (0.3362 => 0.3913, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: 16.38% (0.9909 => 1.1532, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 16.38% (0.3096 => 0.3603, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.31% (0.3060 => 0.3559, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.25% (1.9694 => 2.2895, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.18% (0.3195 => 0.3712, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 16.17% (0.2566 => 0.2981, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.14% (4.4195 => 5.1329, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: 15.94% (23.5202 => 27.2698, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.88% (1.9966 => 2.3136, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: 15.79% (0.3267 => 0.3783, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.66% (0.4361 => 0.5044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 15.65% (0.3258 => 0.3768, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.57% (2.7292 => 3.1541, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 15.47% (1.0781 => 1.2449, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.27% (0.3124 => 0.3601, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.15% (0.3465 => 0.3990, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 15.13% (0.3469 => 0.3994, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.11% (0.3282 => 0.3778, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 15.09% (4.2109 => 4.8464, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/exceptions-3: 15.06% (0.3460 => 0.3981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.05% (0.3348 => 0.3852, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 15.05% (0.3442 => 0.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.98% (0.3726 => 0.4284, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: 14.93% (0.3678 => 0.4227, std.dev.: 0.0112) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.80% (0.3845 => 0.4414, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: 14.78% (0.3477 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.70% (0.3625 => 0.4158, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 14.70% (1.4269 => 1.6367, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.66% (0.3690 => 0.4231, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 14.66% (0.3643 => 0.4177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.55% (0.3724 => 0.4266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.52% (0.4146 => 0.4748, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 14.49% (0.4251 => 0.4867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.47% (0.3981 => 0.4557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 14.05% (0.5012 => 0.5716, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 13.84% (0.7875 => 0.8965, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.01% (0.6435 => 0.7272, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 12.71% (2.1653 => 2.4405, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 12.22% (5.5417 => 6.2190, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.17% (0.2737 => 0.3070, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 12.00% (0.2691 => 0.3014, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 11.99% (4.6177 => 5.1715, std.dev.: 0.0097) MultiSource/Benchmarks/mafft/pairlocalalign: 11.90% (2.1013 => 2.3514, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.2075 => 0.2319, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.51% (0.2068 => 0.2306, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.12% (0.3084 => 0.3427, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.89% (0.5361 => 0.5945, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.88% (0.3336 => 0.3699, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.84% (0.2103 => 0.2331, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 10.61% (0.6634 => 0.7338, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.38% (11.6398 => 12.8482, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.75% (0.2040 => 0.2239, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.62% (0.1383 => 0.1516, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.53% (0.7426 => 0.8134, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.40% (4.6926 => 5.1337, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 7.99% (0.2391 => 0.2582, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 7.85% (2.0346 => 2.1943, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (0.5584 => 0.6021, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.20% (11.9555 => 12.8162, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5172, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.72% (0.3693 => 0.4089, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 9.64% (0.2802 => 0.3072, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 5.61% (0.2122 => 0.2241, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6774, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2409, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8944, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6938, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1959, std.dev.: 0.0134) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3045, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2874, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2103, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0789, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5937, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5824, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.93% (17.2379 => 14.1477, std.dev.: 0.1344) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8083, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2147, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0075) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1186, std.dev.: 0.0586) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.75% (0.6293 => 0.6183, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5779, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1567, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 12:55:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 14:55:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113205511.06EE12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7562?compare_to=7558&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7562, Order: 172363, Start Time: 2013-01-13 18:55:36, End Time: 2013-01-13 20:55:16 To: 7558, Order: 172361, Start Time: 2013-01-13 16:38:21, End Time: 2013-01-13 18:38:30 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (8 on baseline) Performance Improvements: 1 (87 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1055 (968 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 3.49% (9.4900 => 9.8212, std.dev.: 0.0875) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.44% (0.7247 => 0.7424, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.32% (1.2483 => 1.2772, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.86% (0.5865 => 0.5974, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 40.63% (36.1470 => 50.8334, std.dev.: 1.0416) SingleSource/Benchmarks/Shootout-C++/except: 3.73% (0.4986 => 0.5172, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.66% (0.4053 => 0.4161, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.58% (4.4566 => 4.3864, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.96% (1.1057 => 1.1163, std.dev.: 0.1745) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.34% (0.0224 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0431 => 0.0431, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.13% (0.0341 => 0.0286, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.46% (0.0318 => 0.0307, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0429 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -38.65% (0.0207 => 0.0127, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -31.82% (0.0220 => 0.0150, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.30% (0.0253 => 0.0232, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.90% (0.1471 => 0.1443, std.dev.: 0.0384) MultiSource/Applications/lemon/lemon: -1.16% (1.1677 => 1.1542, std.dev.: 0.3947) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.68% (0.4227 => 0.3987, std.dev.: 0.0715) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.1512 => 0.1439, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.21% (0.0988 => 0.0976, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.84% (0.0268 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.96% (0.0540 => 0.0524, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.57% (1.1650 => 1.1467, std.dev.: 0.0283) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.71% (0.0560 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.83% (0.0311 => 0.0268, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (0.7423 => 0.7405, std.dev.: 0.0352) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 300.00% (0.0001 => 0.0004, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -58.54% (0.0123 => 0.0051, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7571 => 12.7635, std.dev.: 0.4645) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 3.16% (9.5202 => 9.8212, std.dev.: 0.0875) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320237.50% (0.0008 => 2.5627, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.56% (1.1825 => 2.3598, std.dev.: 0.0353) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.75% (0.2562 => 0.2863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 3.65% (0.4990 => 0.5172, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/pi: 3.08% (2.1390 => 2.2049, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 1.69% (63.1520 => 64.2170, std.dev.: 0.2524) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.94% (0.0727 => 0.0473, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -27.70% (0.1888 => 0.1365, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -24.11% (0.0676 => 0.0513, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.04% (0.1684 => 0.1296, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -20.53% (0.0862 => 0.0685, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.08% (0.7686 => 0.6373, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.77% (0.1079 => 0.0898, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.71% (1.0960 => 0.9129, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.43% (1.0986 => 0.9291, std.dev.: 0.0290) MultiSource/Applications/spiff/spiff: -13.71% (1.0220 => 0.8819, std.dev.: 0.0237) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.51% (0.0847 => 0.0741, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: -12.04% (2.4719 => 2.1743, std.dev.: 0.0497) MultiSource/Applications/Burg/burg: -11.68% (1.5979 => 1.4112, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.55% (6.4235 => 5.6817, std.dev.: 0.0567) SingleSource/UnitTests/Vector/constpool: -11.35% (9.8875 => 8.7649, std.dev.: 0.0851) MultiSource/Applications/aha/aha: -10.74% (0.1378 => 0.1230, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.35% (1.5131 => 1.3565, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.76% (0.7693 => 0.6942, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.38% (0.9124 => 0.8268, std.dev.: 0.0220) MultiSource/Applications/siod/siod: -9.35% (2.6437 => 2.3966, std.dev.: 0.0318) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.15% (0.2372 => 0.2155, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.27% (1.3924 => 1.2772, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -8.25% (0.3598 => 0.3301, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.20% (1.6874 => 1.5490, std.dev.: 0.0364) MultiSource/Benchmarks/Olden/health/health: -8.20% (0.1610 => 0.1478, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.87% (0.3560 => 0.3280, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.47% (1.0017 => 0.9269, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.38% (0.5746 => 0.5322, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/fibo: -7.38% (0.2006 => 0.1858, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.90% (0.2100 => 0.1955, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.67% (0.4002 => 0.3735, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.61% (0.3462 => 0.3233, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.55% (0.9550 => 0.8924, std.dev.: 0.0192) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.53% (1.8127 => 1.6944, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: -6.43% (0.1928 => 0.1804, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.00% (0.3665 => 0.3445, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.70% (0.3981 => 0.3754, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -5.65% (0.5134 => 0.4844, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.57% (0.2709 => 0.2558, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -5.49% (0.2385 => 0.2254, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.41% (3.6295 => 3.4331, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.24% (0.9512 => 0.9014, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/methcall: -5.20% (0.2135 => 0.2024, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: -5.08% (0.4689 => 0.4451, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.76% (0.9993 => 0.9517, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/wc: -4.73% (0.2305 => 0.2196, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: -4.70% (0.2551 => 0.2431, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.61% (0.9488 => 0.9051, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.33% (0.3093 => 0.2959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.29% (0.2725 => 0.2608, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -4.20% (0.6711 => 0.6429, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -4.19% (3.7840 => 3.6253, std.dev.: 0.0454) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.50% (0.7693 => 0.7424, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.40% (0.9855 => 0.9520, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists1: -3.37% (0.3206 => 0.3098, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.25% (0.9214 => 0.8915, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.93% (2.4519 => 2.3800, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.71% (0.8893 => 0.8652, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.62% (0.6135 => 0.5974, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -30.22% (4.4739 => 3.1221, std.dev.: 0.0890) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.55% (4.2042 => 3.1300, std.dev.: 0.1085) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.92% (0.1164 => 0.0967, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.81% (1.4588 => 1.3011, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.26% (5.0421 => 4.5247, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout/hash: -9.90% (4.5259 => 4.0777, std.dev.: 0.0652) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.87% (2.8778 => 2.5937, std.dev.: 0.0638) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.75% (1.6547 => 1.4934, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/lists1: -9.46% (0.6628 => 0.6001, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.58% (0.3217 => 0.2973, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: -6.18% (2.2304 => 2.0925, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.43% (23.3986 => 22.1273, std.dev.: 0.1568) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.38% (46.0987 => 43.6184, std.dev.: 0.3831) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.80% (1.4446 => 1.3897, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: -3.21% (17.2182 => 16.6655, std.dev.: 0.1146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.81% (0.5826 => 0.5662, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.69% (3.0082 => 2.9273, std.dev.: 0.0143) SingleSource/Benchmarks/McGill/chomp: -2.67% (1.0425 => 1.0147, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/mandel-2: -2.52% (0.8521 => 0.8306, std.dev.: 0.0056) MultiSource/Applications/spiff/spiff: -2.44% (2.8571 => 2.7873, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: -2.02% (1.4244 => 1.3956, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.78% (3.7662 => 3.6991, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: -1.77% (0.6254 => 0.6143, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.64% (7.2040 => 7.0860, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/ReedSolomon: -1.32% (8.6447 => 8.5305, std.dev.: 0.0443) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3162, std.dev.: 0.0003) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.34% (1.2047 => 1.1163, std.dev.: 0.1745) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.41% (0.0394 => 0.0286, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.40% (0.0328 => 0.0307, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -40.38% (0.0213 => 0.0127, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -33.92% (0.0227 => 0.0150, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.69% (0.1530 => 0.1443, std.dev.: 0.0384) MultiSource/Applications/lemon/lemon: -40.18% (1.9293 => 1.1542, std.dev.: 0.3947) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.53% (0.4049 => 0.3987, std.dev.: 0.0715) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.70% (0.1510 => 0.1439, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.51% (0.0276 => 0.0247, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.19% (0.0590 => 0.0524, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.29% (1.1617 => 1.1467, std.dev.: 0.0283) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.54% (0.0610 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0268 => 0.0268, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.43% (0.7437 => 0.7405, std.dev.: 0.0352) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0008 => 0.0004, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.57% (0.0092 => 0.0051, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7635, std.dev.: 0.4645) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 14:31:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 16:31:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130113223154.010962A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7563?compare_to=7560&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7563, Order: 172364, Start Time: 2013-01-13 20:58:04, End Time: 2013-01-13 22:31:57 To: 7560, Order: 172363, Start Time: 2013-01-13 19:00:55, End Time: 2013-01-13 20:34:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.71% (3.7688 => 3.8331, std.dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 87.14% (0.0280 => 0.0524, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.60% (0.0974 => 0.1574, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 52.06% (0.0267 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.19% (0.6395 => 0.8773, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.45% (0.6395 => 0.8662, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.63% (0.6260 => 0.8365, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.25% (0.5805 => 0.7677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.18% (0.5456 => 0.7212, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.72% (0.6230 => 0.8206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.24% (0.5567 => 0.7306, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.19% (0.5941 => 0.7794, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.16% (0.5575 => 0.7312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.46% (0.5802 => 0.7569, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.31% (0.5705 => 0.7434, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.97% (0.5859 => 0.7615, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.78% (0.5849 => 0.7591, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.61% (0.5478 => 0.7100, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.59% (0.5570 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.55% (0.6440 => 0.8343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.36% (0.5569 => 0.7204, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.35% (0.5591 => 0.7232, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.16% (0.5925 => 0.7653, std.dev.: 0.0060) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.29% (0.6189 => 0.7940, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.29% (0.5857 => 0.7514, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.05% (0.6446 => 0.8254, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.99% (0.5863 => 0.7504, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.34% (1.6474 => 2.0978, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.62% (0.6194 => 0.7843, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.29% (0.0445 => 0.0562, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.06% (0.6297 => 0.7938, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.89% (0.6681 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.27% (0.6667 => 0.8285, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.26% (0.7524 => 0.9274, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.37% (0.7339 => 0.8981, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.04% (2.2587 => 2.7113, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.08% (1.1450 => 1.3406, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.66% (0.3357 => 0.3849, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.47% (1.6364 => 1.8404, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.94% (4.5069 => 5.0451, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.80% (0.4916 => 0.5496, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.32% (3.5339 => 3.8987, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 9.16% (9.2283 => 10.0735, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7021 => 0.7646, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.39% (1.2515 => 1.3565, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.40% (0.2001 => 0.2149, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.28% (0.5329 => 0.5717, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.25% (0.3834 => 0.4112, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.4642 => 1.5686, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.77% (1.2784 => 1.3650, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 6.52% (0.4524 => 0.4819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4861 => 0.5143, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.74% (0.1761 => 0.1862, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.53% (0.3255 => 0.3435, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.29% (1.3864 => 1.4320, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.21% (5.0226 => 5.1840, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (5.4682 => 5.6131, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.59% (0.6750 => 0.6925, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (22.4056 => 22.9690, std.dev.: 0.0272) MultiSource/Applications/d/make_dparser: 2.47% (3.5154 => 3.6021, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: 1.73% (0.8418 => 0.8564, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.70% (15.5079 => 15.7712, std.dev.: 0.0109) MultiSource/Applications/minisat/minisat: 1.67% (0.7447 => 0.7571, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3722 => 1.3900, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.25% (16.1920 => 16.3948, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (4.8161 => 4.8669, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6773, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.19% (0.9531 => 1.0312, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4416, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1686, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4519, std.dev.: 0.1287) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0047) MultiSource/Benchmarks/llubenchmark/llu: 2.39% (3.7435 => 3.8331, std.dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2864, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6077, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) MultiSource/Applications/viterbi/viterbi: 1.10% (4.4335 => 4.4822, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4577, std.dev.: 0.0266) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325) SingleSource/Benchmarks/Shootout-C++/objinst: -6.83% (0.3194 => 0.2976, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.53% (0.3837 => 0.3625, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.21% (0.3896 => 0.3693, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.21% (0.3880 => 0.3678, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.20% (0.3884 => 0.3682, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -5.11% (0.4033 => 0.3827, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -4.81% (0.4176 => 0.3975, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.75% (0.2903 => 0.2765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.62% (0.3205 => 0.3057, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (0.9852 => 0.9402, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.56% (2.1713 => 2.0723, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.46% (0.2939 => 0.2808, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.41% (0.4199 => 0.4014, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.26% (0.3142 => 0.3008, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.21% (0.3252 => 0.3115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.09% (0.4280 => 0.4105, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.08% (1.3148 => 1.2611, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.98% (0.3016 => 0.2896, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.93% (0.6441 => 0.6188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.89% (0.2933 => 0.2819, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3963, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -3.64% (0.3026 => 0.2916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.56% (0.3621 => 0.3492, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.42% (0.4151 => 0.4009, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.41% (0.3931 => 0.3797, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.28% (0.7779 => 0.7524, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.9542 => 0.9232, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.24% (0.4321 => 0.4181, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.24% (0.6484 => 0.6274, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.23% (0.3867 => 0.3742, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.14% (0.3849 => 0.3728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.14% (0.4427 => 0.4288, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.06% (0.4248 => 0.4118, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: -2.96% (0.3788 => 0.3676, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.70% (0.4813 => 0.4683, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2163, std.dev.: 0.0433) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.52% (0.4083 => 0.3980, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.44% (0.7919 => 0.7726, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.13% (1.0544 => 1.0319, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.13% (0.7198 => 0.7045, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.85% (0.7982 => 0.7834, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (1.2210 => 1.2000, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.69% (4.3330 => 4.2597, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (1.2221 => 1.2020, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.33% (14.2083 => 14.0189, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -1.19% (2.4021 => 2.3734, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (0.8521 => 0.8420, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.11% (1.5610 => 1.5436, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.87% (1.8100 => 0.6901, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3136, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0356, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2084, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1292, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8587, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (7.9763 => 7.7263, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.49% (3.7241 => 3.6312, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4703, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1982, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.34% (4.8776 => 4.8123, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6219 => 1.6040, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.09% (1.6307 => 1.6130, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 14:45:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 16:45:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130113224524.742242A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7564?compare_to=7559&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7564, Order: 172364, Start Time: 2013-01-13 20:34:17, End Time: 2013-01-13 22:45:27 To: 7559, Order: 172362, Start Time: 2013-01-13 17:53:27, End Time: 2013-01-13 20:04:20 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 23 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1077 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/lencod/lencod: 16.59% (30.8675 => 35.9870, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: 10.93% (11.1394 => 12.3565, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.30% (0.3275 => 0.3514, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (8.1574 => 8.5234, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 3.44% (11.6324 => 12.0323, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 2.92% (9.0169 => 9.2801, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.59% (37.5101 => 38.4826, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.55% (10.8304 => 11.1061, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.44% (1.7431 => 1.7857, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (1.1730 => 1.2006, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 2.12% (3.9641 => 4.0481, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.00% (11.9106 => 12.1494, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.99% (5.9072 => 6.0250, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: 1.93% (19.1324 => 19.5011, std.dev.: 0.0162) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.90% (5.9410 => 6.0536, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 1.87% (6.9214 => 7.0509, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.82% (15.9259 => 16.2156, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: 1.65% (17.9007 => 18.1963, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.55% (0.9170 => 0.9312, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 1.40% (1.6466 => 1.6696, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 1.38% (1.4963 => 1.5169, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.36% (2.0501 => 2.0780, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 1.18% (68.0955 => 68.9010, std.dev.: 0.0127) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7522 => 499.8442, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.22% (1.1277 => 499.8442, std.dev.: 0.0037) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.30% (0.5229 => 1.6696, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 21.39% (14.9895 => 18.1963, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 43.30% (14.1553 => 20.2849, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8501, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.63% (1.1048 => 1.7857, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.60% (7.1582 => 38.4826, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.78% (3.4629 => 6.3986, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.20% (0.6222 => 1.0839, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.19% (0.0720 => 7.4471, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11172800.00% (0.0001 => 11.1729, std.dev.: 0.0551) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5481100.00% (0.0001 => 5.4812, std.dev.: 0.0191) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.51% (1.1194 => 10.3042, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.52% (22.1758 => 55.5557, std.dev.: 0.0523) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.11% (0.1463 => 0.2518, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.05% (21.9371 => 35.9870, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.44% (7.0540 => 11.1061, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.67% (2.9384 => 4.6036, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.77% (1.5859 => 2.3910, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 50.66% (0.1056 => 0.1591, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.32% (8.1363 => 12.1494, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.92% (2.2024 => 3.1036, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.80% (1.5415 => 2.0780, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.60% (4.2646 => 5.7403, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.81% (0.4615 => 0.6129, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 30.30% (1.1642 => 1.5169, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.15% (0.2700 => 0.3514, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 30.13% (0.1175 => 0.1529, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.03% (0.2271 => 0.2953, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.81% (0.1892 => 0.2456, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.35% (0.6675 => 0.8634, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.44% (0.5105 => 0.6506, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 26.86% (9.4845 => 12.0323, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/08-main/main: 26.55% (0.2554 => 0.3232, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: 26.18% (1.0722 => 1.3529, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 26.04% (0.1655 => 0.2086, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.65% (3.8922 => 4.8906, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.42% (0.1125 => 0.1411, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.67% (1.4186 => 1.7685, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.58% (0.3121 => 0.3857, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 22.78% (0.4289 => 0.5266, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.75% (0.1143 => 0.1403, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 22.45% (0.7115 => 0.8712, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 22.43% (5.7591 => 7.0509, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.36% (0.1695 => 0.2074, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 22.34% (0.4620 => 0.5652, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.84% (4.9449 => 6.0250, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 21.37% (3.3354 => 4.0481, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.03% (5.0018 => 6.0536, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 20.98% (0.3098 => 0.3748, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.69% (1.3050 => 1.5750, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.47% (0.1695 => 0.2042, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.42% (0.7835 => 0.9435, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.83% (0.0842 => 0.1009, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 19.66% (0.6456 => 0.7725, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.20% (0.0953 => 0.1136, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 19.19% (10.3673 => 12.3565, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.15% (0.8172 => 0.9737, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 18.94% (0.1151 => 0.1369, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.68% (0.1510 => 0.1792, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.11% (0.5020 => 0.5929, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 18.08% (0.3423 => 0.4042, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.83% (0.7433 => 0.8758, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 17.74% (3.8723 => 4.5594, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.62% (0.2758 => 0.3244, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 17.62% (1.1840 => 1.3926, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.43% (0.9765 => 1.1467, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.28% (0.2107 => 0.2471, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.21% (0.3307 => 0.3876, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.18% (0.5569 => 0.6526, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 17.14% (2.0273 => 2.3747, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.6450 => 0.7522, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.57% (0.5981 => 0.6972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 16.50% (0.0818 => 0.0953, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.46% (0.2065 => 0.2405, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.44% (2.2969 => 2.6745, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 16.26% (0.3180 => 0.3697, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 15.94% (0.3387 => 0.3927, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.84% (0.3441 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.46% (1.1861 => 1.3695, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.43% (0.8067 => 0.9312, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 14.82% (0.8921 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.80% (0.3283 => 0.3769, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.39% (0.3232 => 0.3697, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 13.50% (17.1811 => 19.5011, std.dev.: 0.0162) MultiSource/Applications/hbd/hbd: 13.41% (1.5603 => 1.7696, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 13.02% (0.3379 => 0.3819, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.87% (14.3668 => 16.2156, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 12.10% (0.3092 => 0.3466, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.86% (0.4636 => 0.5186, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3427 => 0.3829, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.37% (0.3282 => 0.3655, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.16% (0.4103 => 0.4561, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.16% (0.4203 => 0.4672, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.03% (0.2430 => 0.2698, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.72% (0.4048 => 0.4482, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 10.64% (0.3422 => 0.3786, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.30% (0.3603 => 0.3974, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.23% (0.3684 => 0.4061, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.93% (0.3826 => 0.4206, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.55% (0.3561 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.48% (0.3543 => 0.3879, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/for-in: 9.47% (0.3694 => 0.4044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.43% (0.3543 => 0.3877, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.35% (0.3497 => 0.3824, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.28% (0.4064 => 0.4441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.95% (63.2438 => 68.9010, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5925 => 0.6388, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.78% (0.7326 => 0.7896, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.74% (2.0665 => 2.2264, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/except: 7.59% (0.2871 => 0.3089, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 7.58% (1.2842 => 1.3816, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.58% (0.4879 => 0.5249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.53% (0.3650 => 0.3925, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.52% (0.3935 => 0.4231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.40% (0.2877 => 0.3090, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.31% (0.3162 => 0.3393, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 7.23% (0.2905 => 0.3115, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.06% (7.9617 => 8.5234, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.00% (0.2872 => 0.3073, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.75% (2.2022 => 2.3508, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.71% (0.2756 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.51% (0.3136 => 0.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 6.39% (0.2725 => 0.2899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2519, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 5.10% (0.5413 => 0.5689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.07% (4.2280 => 4.4423, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (0.9957 => 1.0300, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0190) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9053, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.29% (1.0313 => 1.0549, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7163, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2895, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2788, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4531, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.25% (5.2763 => 1.2006, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/salsa20: -75.49% (0.8651 => 0.2120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.20% (5.3855 => 4.4590, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.87% (5.3526 => 4.4497, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -11.08% (10.4361 => 9.2801, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.19% (1.7609 => 1.6166, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9880, std.dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.79% (1.9577 => 0.6698, std.dev.: 0.0080) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.12% (8.0499 => 5.3035, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.59% (1.5373 => 1.0209, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.74% (10.7105 => 7.4182, std.dev.: 0.0088) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8583, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0064, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7325, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2748, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/McGill/chomp: -5.79% (1.2373 => 1.1656, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.92% (8.1563 => 7.7554, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8339, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0029) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3135 => 2.2787, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.45% (3.7221 => 3.6681, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2361, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0002) Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 15:14:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 17:14:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130113231430.87C372A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7565?compare_to=7562&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7565, Order: 172367, Start Time: 2013-01-13 21:14:48, End Time: 2013-01-13 23:14:35 To: 7562, Order: 172363, Start Time: 2013-01-13 18:55:36, End Time: 2013-01-13 20:55:16 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (5 on baseline) Performance Improvements: 1 (82 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1055 (976 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.18% (0.2417 => 0.2518, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 1.64% (0.7811 => 0.7939, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: 12.49% (8.5305 => 9.5956, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 11.92% (1.7325 => 1.9391, std.dev.: 0.0499) SingleSource/Benchmarks/Shootout/hash: 3.92% (4.0777 => 4.2375, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.25% (5.2814 => 5.4001, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 1.50% (4.3121 => 4.3768, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.74% (0.3594 => 0.3280, std.dev.: 0.0119) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.82% (1.1163 => 1.1255, std.dev.: 0.1096) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.01% (0.0221 => 0.0137, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.94% (0.0431 => 0.0358, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 18.53% (0.0286 => 0.0339, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.91% (0.0307 => 0.0319, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.89% (0.0429 => 0.0378, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/casts: 62.99% (0.0127 => 0.0207, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 48.67% (0.0150 => 0.0223, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.05% (0.0232 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1443 => 0.1456, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -0.34% (1.1542 => 1.1503, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.51% (0.3987 => 0.4167, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.91% (0.1439 => 0.1524, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.51% (0.0976 => 0.0971, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.62% (0.0247 => 0.0243, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.48% (0.0524 => 0.0537, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.1467 => 1.1469, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0564 => 0.0564, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7405 => 0.7460, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -25.00% (0.0004 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.61% (0.0051 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7635 => 12.7628, std.dev.: 0.0421) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320975.00% (0.0008 => 2.5686, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.35% (1.1825 => 2.4401, std.dev.: 0.0886) SingleSource/Benchmarks/Misc/ReedSolomon: 11.00% (8.6447 => 9.5956, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.81% (0.2562 => 0.2839, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -35.08% (0.0727 => 0.0472, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0006) SingleSource/Benchmarks/SmallPT/smallpt: -26.96% (0.1888 => 0.1379, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.41% (0.1684 => 0.1273, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -20.02% (1.8964 => 1.5167, std.dev.: 0.0748) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.93% (0.0676 => 0.0548, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.49% (0.7686 => 0.6342, std.dev.: 0.0079) MultiSource/Benchmarks/SciMark2-C/scimark2: -16.81% (0.4074 => 0.3389, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: -16.12% (1.0220 => 0.8573, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.92% (1.0960 => 0.9215, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.77% (1.0986 => 0.9254, std.dev.: 0.0111) MultiSource/Applications/aha/aha: -15.67% (0.1378 => 0.1162, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -11.91% (2.4719 => 2.1774, std.dev.: 0.0557) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.17% (1.2154 => 1.0796, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.06% (6.4235 => 5.7128, std.dev.: 0.2689) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.22% (0.7693 => 0.6907, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.77% (1.5131 => 1.3653, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: -9.23% (0.3598 => 0.3266, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.16% (1.3924 => 1.2649, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.06% (0.2372 => 0.2157, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.84% (1.1498 => 1.0482, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.28% (1.6874 => 1.5477, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -8.25% (0.8653 => 0.7939, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.02% (10.2703 => 9.4469, std.dev.: 0.0482) MultiSource/Applications/ClamAV/clamscan: -8.00% (17.4365 => 16.0422, std.dev.: 0.4756) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.62% (0.2144 => 0.2002, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -6.56% (0.5134 => 0.4797, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.42% (0.2615 => 0.2447, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.24% (0.9550 => 0.8954, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.65% (0.3981 => 0.3756, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.63% (0.3394 => 0.3203, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -5.34% (0.2135 => 0.2021, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.2172 => 0.2057, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.77% (0.9788 => 0.9321, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary: -4.74% (0.2551 => 0.2430, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.72% (0.2709 => 0.2581, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -4.66% (3.7840 => 3.6075, std.dev.: 0.0527) MultiSource/Applications/lemon/lemon: -4.55% (1.3979 => 1.3343, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.12% (1.3220 => 1.2675, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: -4.05% (0.2665 => 0.2557, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.99% (5.0381 => 4.8370, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.85% (0.9488 => 0.9123, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/gs/gs: -3.49% (4.5936 => 4.4335, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.47% (0.3665 => 0.3538, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash: -3.39% (0.4689 => 0.4530, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.36% (0.4762 => 0.4602, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.30% (0.7693 => 0.7439, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.12% (4.6579 => 4.5127, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.00% (0.5369 => 0.5208, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.89% (4.8904 => 4.7978, std.dev.: 0.0339) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.79% (14.9757 => 14.7077, std.dev.: 0.0625) MultiSource/Benchmarks/nbench/nbench: -1.33% (1.2708 => 1.2539, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.01% (0.9372 => 0.6466, std.dev.: 0.1046) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.46% (2.8778 => 2.3467, std.dev.: 0.1080) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.69% (0.1164 => 0.0993, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.58% (16.6791 => 14.7473, std.dev.: 0.6914) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.46% (0.4081 => 0.3654, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists1: -9.43% (0.6628 => 0.6003, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.12% (0.3609 => 0.3280, std.dev.: 0.0119) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.46% (4.4540 => 4.0771, std.dev.: 0.1340) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: -6.37% (4.5259 => 4.2375, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.32% (46.0987 => 43.6481, std.dev.: 0.3609) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.88% (23.3986 => 22.2568, std.dev.: 0.1082) SingleSource/Benchmarks/Shootout/ary3: -4.81% (2.2304 => 2.1231, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.75% (1.4446 => 1.3760, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.36% (2.5170 => 2.4072, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.80% (40.4729 => 38.9348, std.dev.: 0.0760) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.94% (0.5826 => 0.5655, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: -2.48% (4.4730 => 4.3621, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -2.42% (1.0425 => 1.0173, std.dev.: 0.0064) MultiSource/Applications/spiff/spiff: -2.05% (2.8571 => 2.7986, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/mandel-2: -1.83% (0.8521 => 0.8365, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.79% (3.0082 => 2.9544, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.55% (3.5669 => 3.5116, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3596 => 3.3189, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1538, std.dev.: 0.0053) SingleSource/Benchmarks/SmallPT/smallpt: -1.07% (14.9448 => 14.7848, std.dev.: 0.0458) MultiSource/Applications/aha/aha: -1.07% (3.5321 => 3.4943, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.57% (1.2047 => 1.1255, std.dev.: 0.1096) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -41.20% (0.0233 => 0.0137, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.62% (0.0451 => 0.0358, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.06% (0.0445 => 0.0378, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0014) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -40.38% (1.9293 => 1.1503, std.dev.: 0.0264) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.91% (0.4049 => 0.4167, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.93% (0.1510 => 0.1524, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.72% (0.0978 => 0.0971, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.96% (0.0276 => 0.0243, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.98% (0.0590 => 0.0537, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.1617 => 1.1469, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.54% (0.0610 => 0.0564, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7437 => 0.7460, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.70% (0.0092 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7628, std.dev.: 0.0421) Report Time: 0.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 16:29:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 18:29:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114002906.59D632A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7566?compare_to=7563&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7566, Order: 172369, Start Time: 2013-01-13 22:55:14, End Time: 2013-01-14 00:29:10 To: 7563, Order: 172364, Start Time: 2013-01-13 20:58:04, End Time: 2013-01-13 22:31:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 1 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.52% (0.6901 => 0.7006, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7524 => 0.7395, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.14% (0.0974 => 0.1550, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.08% (0.6395 => 0.8766, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.39% (0.6395 => 0.8658, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.55% (0.6260 => 0.8360, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.37% (0.5688 => 0.7529, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.21% (0.5805 => 0.7675, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.51% (0.6230 => 0.8193, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.28% (0.5575 => 0.7319, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.27% (0.5581 => 0.7326, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.99% (0.5567 => 0.7292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.94% (0.5941 => 0.7779, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.46% (0.5802 => 0.7569, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.42% (0.6033 => 0.7868, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.15% (0.5705 => 0.7425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.94% (0.5849 => 0.7600, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.70% (0.5478 => 0.7105, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.52% (0.5570 => 0.7214, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.47% (0.6440 => 0.8338, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.43% (0.5569 => 0.7208, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.14% (0.5591 => 0.7220, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.19% (0.5857 => 0.7508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.15% (0.6189 => 0.7931, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.01% (0.5863 => 0.7505, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.80% (0.6446 => 0.8238, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.52% (0.6304 => 0.8039, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.17% (1.6474 => 2.0950, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.49% (0.6194 => 0.7835, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.04% (0.6297 => 0.7937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.71% (0.6681 => 0.8399, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.36% (0.6667 => 0.8291, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.30% (0.7524 => 0.9277, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.47% (0.7339 => 0.8988, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.18% (2.2587 => 2.7145, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 16.93% (1.1450 => 1.3388, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.6364 => 1.8436, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.66% (4.5069 => 5.0322, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.25% (0.4916 => 0.5469, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 10.92% (0.4515 => 0.5008, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.26% (3.5339 => 3.8964, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 9.02% (9.2283 => 10.0610, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2385 => 0.2598, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.69% (0.7021 => 0.7631, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.95% (1.2515 => 1.3510, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.13% (0.5329 => 0.5709, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.05% (0.2001 => 0.2142, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.85% (1.4642 => 1.5645, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.2784 => 1.3626, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.01% (0.1731 => 0.1835, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 5.44% (0.4524 => 0.4770, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.16% (0.4861 => 0.5112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.09% (0.3834 => 0.3991, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 3.25% (1.3864 => 1.4315, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 3.16% (5.0226 => 5.1811, std.dev.: 0.0132) MultiSource/Applications/d/make_dparser: 2.42% (3.5154 => 3.6005, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.35% (5.4682 => 5.5967, std.dev.: 0.0092) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (22.4056 => 22.9301, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6750 => 0.6885, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.63% (0.8418 => 0.8555, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.56% (0.7447 => 0.7563, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.45% (15.5079 => 15.7327, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3875, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.10% (16.1920 => 16.3707, std.dev.: 0.0163) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6580, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.28% (0.9531 => 1.0320, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.94% (1.2783 => 1.3670, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.48% (5.1955 => 5.4284, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1693, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5064, std.dev.: 0.1207) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2857, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6019, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 1.13% (4.4335 => 4.4835, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -7.33% (0.3194 => 0.2960, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -6.50% (0.3831 => 0.3582, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.45% (0.3812 => 0.3566, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.44% (0.3880 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.34% (0.3896 => 0.3649, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.33% (0.3884 => 0.3638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.27% (0.3891 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -6.25% (0.4033 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -6.08% (0.4176 => 0.3922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.50% (0.3016 => 0.2850, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.46% (0.3059 => 0.2892, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -5.23% (0.4280 => 0.4056, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.21% (2.1713 => 2.0581, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: -5.21% (0.3205 => 0.3038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -5.04% (0.6347 => 0.6027, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.99% (0.3025 => 0.2874, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.94% (0.7779 => 0.7395, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -4.91% (0.6441 => 0.6125, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.73% (0.9852 => 0.9386, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.69% (1.3148 => 1.2531, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.46% (0.4151 => 0.3966, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -4.20% (0.3621 => 0.3469, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.12% (0.3931 => 0.3769, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.75% (0.4427 => 0.4261, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -3.72% (0.3867 => 0.3723, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.70% (0.4248 => 0.4091, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.55% (0.3658 => 0.3528, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.52% (2.4924 => 2.4046, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.9542 => 0.9218, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.33% (0.3849 => 0.3721, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.11% (0.4083 => 0.3956, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1458, std.dev.: 0.0292) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.99% (0.4813 => 0.4669, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.74% (0.7919 => 0.7702, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (1.0544 => 1.0297, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.7198 => 0.7039, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -1.99% (4.3330 => 4.2469, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.88% (1.2221 => 1.1991, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.84% (1.2210 => 1.1985, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: -1.79% (0.9179 => 0.9015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.72% (0.5999 => 0.5896, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -1.58% (2.4021 => 2.3641, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (0.8521 => 0.8392, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -1.35% (1.5610 => 1.5400, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: -1.34% (34.0927 => 33.6347, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (1.2300 => 1.2137, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.18% (0.9077 => 0.8970, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -1.13% (18.2933 => 18.0871, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.29% (1.8100 => 0.7006, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.55% (1.3643 => 1.0294, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0278, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1330, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1723, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.26% (7.9763 => 7.7160, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2721, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.98% (3.7241 => 3.6504, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1962, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.43% (1.6219 => 1.5987, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8090, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7092 => 3.6578, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.19% (1.6086 => 1.5895, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 17:26:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 19:26:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114012642.D7E432A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7567?compare_to=7564&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7567, Order: 172369, Start Time: 2013-01-13 23:15:30, End Time: 2013-01-14 01:26:46 To: 7564, Order: 172364, Start Time: 2013-01-13 20:34:17, End Time: 2013-01-13 22:45:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8442 => 499.8453, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.31% (1.1277 => 499.8453, std.dev.: 0.0046) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.92% (0.5229 => 1.6624, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 20.69% (14.9895 => 18.0903, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 42.83% (14.1553 => 20.2175, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 17.69% (4.1105 => 4.8378, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.09% (1.1048 => 1.7797, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.63% (7.1582 => 38.4131, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.45% (3.4629 => 6.3526, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.11% (0.6222 => 1.0771, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.47% (0.0720 => 7.4401, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11161600.00% (0.0001 => 11.1617, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493700.00% (0.0001 => 5.4938, std.dev.: 0.0410) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.23% (1.1194 => 10.3458, std.dev.: 0.0440) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.24% (22.1758 => 55.4924, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.12% (0.0243 => 0.0462) MultiSource/Benchmarks/FreeBench/neural/neural: 71.57% (0.1463 => 0.2510, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 63.51% (21.9371 => 35.8688, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.31% (7.0540 => 11.0963, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.76% (2.9384 => 4.6063, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.30% (1.5859 => 2.3836, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 50.19% (0.1056 => 0.1586, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 48.89% (8.1363 => 12.1140, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341) SingleSource/Benchmarks/CoyoteBench/almabench: 41.23% (0.0730 => 0.1031, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.51% (2.2024 => 3.0947, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.14% (0.3109 => 0.4326, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 37.85% (0.1432 => 0.1974, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.32% (4.2646 => 5.7280, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.25% (1.5415 => 2.0694, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.39% (0.4615 => 0.6110, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.07% (0.2700 => 0.3512, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 29.84% (1.1642 => 1.5116, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.63% (0.2271 => 0.2944, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 29.62% (0.1175 => 0.1523, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.33% (0.1892 => 0.2447, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.10% (0.4299 => 0.5550, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.75% (0.6675 => 0.8594, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: 27.12% (0.0719 => 0.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.88% (0.5105 => 0.6477, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 26.62% (9.4845 => 12.0090, std.dev.: 0.0169) SingleSource/Benchmarks/Stanford/Oscar: 26.42% (0.0636 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.31% (0.2554 => 0.3226, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.88% (0.1584 => 0.1994, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 25.79% (1.0722 => 1.3487, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.68% (0.1655 => 0.2080, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.37% (3.8922 => 4.8795, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.20% (0.0746 => 0.0934, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.84% (0.0793 => 0.0990, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.71% (0.1125 => 0.1403, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.38% (1.4186 => 1.7645, std.dev.: 0.0136) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.71% (0.1906 => 0.2358, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.56% (0.1566 => 0.1935, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.36% (0.3121 => 0.3850, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.92% (0.1143 => 0.1405, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.74% (0.1337 => 0.1641, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 22.00% (5.7591 => 7.0262, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 21.95% (0.7115 => 0.8677, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 21.78% (0.4289 => 0.5223, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.65% (4.9449 => 6.0154, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.59% (0.1695 => 0.2061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.47% (0.4620 => 0.5612, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 20.93% (3.3354 => 4.0334, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.73% (5.0018 => 6.0387, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.34% (1.3050 => 1.5704, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 20.16% (10.3673 => 12.4574, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 20.13% (0.7835 => 0.9412, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.90% (0.1236 => 0.1482, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.85% (0.0675 => 0.0809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 19.75% (0.3098 => 0.3710, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.51% (0.5860 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.36% (0.0842 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 18.84% (0.6456 => 0.7672, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.67% (0.8172 => 0.9698, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 18.59% (0.1151 => 0.1365, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.47% (0.0953 => 0.1129, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.17% (0.0886 => 0.1047, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.79% (0.3423 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.51% (0.5020 => 0.5899, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.44% (0.7433 => 0.8729, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.33% (0.2758 => 0.3236, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.27% (3.8723 => 4.5412, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 17.20% (1.1840 => 1.3877, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.97% (0.5569 => 0.6514, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.94% (0.9765 => 1.1419, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 16.60% (2.0273 => 2.3639, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.54% (0.3307 => 0.3854, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.23% (0.6450 => 0.7497, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.17% (0.2065 => 0.2399, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.13% (2.2969 => 2.6674, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.12% (0.5981 => 0.6945, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.94% (0.3180 => 0.3687, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.91% (0.2049 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 15.85% (0.3387 => 0.3924, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.79% (0.8101 => 0.9380, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.52% (0.3441 => 0.3975, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.11% (0.8067 => 0.9286, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.07% (1.1861 => 1.3648, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.42% (0.8921 => 1.0207, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.97% (0.0759 => 0.0865, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 13.92% (0.3283 => 0.3740, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 13.46% (0.3232 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.33% (0.2603 => 0.2950, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.07% (17.1811 => 19.4275, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: 12.79% (1.5603 => 1.7598, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.57% (14.3668 => 16.1732, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary2: 12.16% (0.3379 => 0.3790, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.33% (0.3865 => 0.4303, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.32% (0.3427 => 0.3815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.04% (0.4636 => 0.5148, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.86% (0.2430 => 0.2694) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.38% (0.4103 => 0.4529, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.28% (0.4203 => 0.4635, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.14% (0.3828 => 0.4216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.93% (0.4048 => 0.4450, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3473 => 0.3810, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.68% (0.3543 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3543 => 0.3883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.56% (0.3422 => 0.3749, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3497 => 0.3830, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.24% (0.3603 => 0.3936, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.12% (0.3826 => 0.4175, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.12% (0.3684 => 0.4020, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.78% (63.2438 => 68.7947, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.48% (0.1438 => 0.1560, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.32% (0.4064 => 0.4402, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.91% (0.6030 => 0.6507, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 7.59% (0.5925 => 0.6375, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.47% (0.7326 => 0.7873, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 7.24% (0.2831 => 0.3036, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.17% (0.4879 => 0.5229, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.08% (2.0665 => 2.2128, std.dev.: 0.0034) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.85% (7.9617 => 8.5073, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 6.85% (1.2842 => 1.3722, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.71% (0.3650 => 0.3895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.58% (0.3935 => 0.4194, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.55% (0.2871 => 0.3059, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.50% (2.2022 => 2.3453, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.20% (0.2905 => 0.3085, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.06% (0.2872 => 0.3046, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.91% (0.2266 => 0.2400, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.81% (0.2756 => 0.2916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 5.77% (0.3052 => 0.3228, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.55% (0.2793 => 0.2948, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.55% (0.3136 => 0.3310, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 5.54% (0.2725 => 0.2876, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.53% (0.2714 => 0.2864, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.41% (0.3177 => 0.3349, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2539, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4257, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4456, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (3.1578 => 3.3086, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.95% (0.9957 => 1.0350, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9104, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.38% (9.1159 => 9.3329, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (3.6395 => 3.7140, std.dev.: 0.0063) MultiSource/Applications/aha/aha: 1.94% (3.1595 => 3.2208, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2785, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.15% (6.5088 => 6.5839, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4580, std.dev.: 0.0254) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.33% (5.2763 => 1.1964, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.55% (0.8651 => 0.2115) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.17% (5.3855 => 4.4610, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.83% (5.3526 => 4.4517, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -11.28% (10.4361 => 9.2585, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.40% (1.7609 => 1.6129, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9897, std.dev.: 0.0407) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.93% (1.9577 => 0.6669, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0233, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.78% (10.7105 => 7.4141, std.dev.: 0.0124) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8589, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0065, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1252, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7353, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9124, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.23% (19.9488 => 18.3078, std.dev.: 0.0433) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.96% (1.2373 => 1.1636, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -5.10% (1.5835 => 1.5028, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.07% (8.1563 => 7.7429, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.76% (0.4808 => 0.4579, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8306, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1575, std.dev.: 0.0068) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3300, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: -1.50% (3.6994 => 3.6439, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7221 => 3.6763, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 17:31:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 19:31:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114013127.309C72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7568?compare_to=7565&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7568, Order: 172369, Start Time: 2013-01-13 23:31:30, End Time: 2013-01-14 01:31:32 To: 7565, Order: 172367, Start Time: 2013-01-13 21:14:48, End Time: 2013-01-13 23:14:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 20 (8 on baseline) Performance Improvements: 5 (82 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1038 (973 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.77% (0.2076 => 0.2258, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 3.35% (0.5251 => 0.5427, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.46% (0.9215 => 0.9442, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (0.8868 => 0.9052, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.04% (4.7978 => 4.8958, std.dev.: 0.0364) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.02% (0.8217 => 0.8383, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.91% (0.6907 => 0.7039, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.31% (1.5477 => 1.5680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.06% (0.9763 => 0.9866, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.77% (1.4597 => 1.8505, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.46% (14.7473 => 16.7319, std.dev.: 0.1737) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.05% (2.3467 => 2.5825, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.99% (0.3280 => 0.3542, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.82% (1.2458 => 1.3059, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.39% (4.7510 => 4.9596, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/pi: 4.14% (2.1244 => 2.2123, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.58% (4.0928 => 4.2393, std.dev.: 0.0148) SingleSource/Benchmarks/Dhrystone/fldry: 3.32% (0.6598 => 0.6817, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 2.28% (8.6622 => 8.8596, std.dev.: 0.0253) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.00% (2.4081 => 2.4562, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ReedSolomon: -11.12% (9.5956 => 8.5285, std.dev.: 0.1937) SingleSource/Benchmarks/Shootout/hash: -4.39% (4.2375 => 4.0514, std.dev.: 0.0542) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.82% (7.1490 => 6.8756, std.dev.: 0.0981) MultiSource/Applications/JM/lencod/lencod: -2.79% (7.1290 => 6.9302, std.dev.: 0.0645) SingleSource/Benchmarks/Misc/fp-convert: -1.15% (15.8086 => 15.6261, std.dev.: 0.0320) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.55% (1.1255 => 1.1193, std.dev.: 0.0559) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 54.01% (0.0137 => 0.0211, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 20.95% (0.0358 => 0.0433, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0339 => 0.0339, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.31% (0.0319 => 0.0320, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.49% (0.0378 => 0.0429, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: 0.48% (0.0207 => 0.0208, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0223 => 0.0223, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0253 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1456 => 0.1447, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -1.50% (1.1503 => 1.1330, std.dev.: 0.2922) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.73% (0.4167 => 0.3970, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.66% (0.1524 => 0.1453, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.81% (0.0971 => 0.0934, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 13.99% (0.0243 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.75% (0.0537 => 0.0584, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1469 => 1.1495, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.56% (0.0564 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -15.72% (0.0318 => 0.0268, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7460 => 0.7461, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.31% (0.0061 => 0.0048, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (12.7628 => 12.7638, std.dev.: 0.0230) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.70% (0.0336 => 0.0503, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.77% (1.8651 => 1.9168, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.7225 => 0.7360, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322837.50% (0.0008 => 2.5835, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.24% (1.1825 => 2.4033, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.80% (0.2562 => 0.2813, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/pi: 3.43% (2.1390 => 2.2123, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.74% (4.1668 => 4.2393, std.dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.92% (0.0692 => 0.0478, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.67% (0.0727 => 0.0504, std.dev.: 0.0004) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.28% (0.1684 => 0.1292, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.34% (0.0676 => 0.0552, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.74% (0.1009 => 0.0830, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.22% (0.7686 => 0.6439, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.06% (1.0986 => 0.9332, std.dev.: 0.0273) MultiSource/Benchmarks/VersaBench/dbms/dbms: -13.85% (1.0960 => 0.9442, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -13.43% (1.0220 => 0.8847, std.dev.: 0.0489) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.04% (0.0847 => 0.0745, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -11.43% (1.5979 => 1.4152, std.dev.: 0.0158) MultiSource/Applications/aha/aha: -11.39% (0.1378 => 0.1221, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.75% (0.2372 => 0.2117, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.31% (6.4235 => 5.7613, std.dev.: 0.2380) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.67% (0.1210 => 0.1093, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.30% (1.5131 => 1.3724, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.99% (0.2481 => 0.2258, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -8.78% (2.6437 => 2.4117, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.71% (0.3560 => 0.3250, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.51% (1.3924 => 1.2739, std.dev.: 0.0124) MultiSource/Applications/sgefa/sgefa: -8.50% (0.3598 => 0.3292, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.50% (0.7693 => 0.7039, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.12% (0.9124 => 0.8383, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.66% (1.1498 => 1.0617, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.48% (10.2703 => 9.5022, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.39% (0.6885 => 0.6376, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.08% (1.6874 => 1.5680, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -6.89% (0.1610 => 0.1499, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.86% (0.2100 => 0.1956, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: -6.79% (0.2385 => 0.2223, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -6.27% (0.5134 => 0.4812, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.22% (0.2283 => 0.2141, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.08% (0.9550 => 0.8969, std.dev.: 0.0162) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.59% (0.9588 => 0.9052, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.55% (0.5746 => 0.5427, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.31% (0.3462 => 0.3278, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: -5.21% (0.2551 => 0.2418, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.20% (0.2709 => 0.2568, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.03% (0.2305 => 0.2189, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.00% (0.2618 => 0.2487, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.99% (1.3310 => 1.2646, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.65% (1.0234 => 0.9758, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.64% (0.8990 => 0.8573, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.2615 => 0.2499, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.22% (0.9788 => 0.9375, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash: -4.20% (0.4689 => 0.4492, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.81% (1.3220 => 1.2716, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.66% (0.9405 => 0.9061, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.30% (0.3394 => 0.3282, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.20% (1.0088 => 0.9866, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.14% (0.4762 => 0.4660, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.00% (4.6579 => 4.5648, std.dev.: 0.0288) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -31.12% (4.4739 => 3.0814, std.dev.: 0.3610) MultiSource/Benchmarks/Olden/bisort/bisort: -31.08% (0.9372 => 0.6459, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.56% (4.2042 => 3.2135, std.dev.: 0.3740) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.09% (1.0816 => 0.8535, std.dev.: 0.0145) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.31% (1.5623 => 1.2762, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.03% (0.1164 => 0.0989, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.61% (0.0845 => 0.0730, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.46% (1.4235 => 1.2603, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.76% (0.4081 => 0.3642, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/hash: -10.48% (4.5259 => 4.0514, std.dev.: 0.0542) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.26% (2.8778 => 2.5825, std.dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.29% (1.4588 => 1.3378, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists1: -8.07% (0.6628 => 0.6093, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.52% (0.3217 => 0.2975, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.36% (23.3986 => 21.9106, std.dev.: 0.2446) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.88% (2.5170 => 2.4194, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/lists: -3.43% (17.2182 => 16.6283, std.dev.: 0.1965) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.35% (40.4729 => 39.1155, std.dev.: 0.2039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.96% (1.4446 => 1.4019, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel-2: -2.41% (0.8521 => 0.8316, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -2.38% (2.8571 => 2.7891, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.37% (0.5826 => 0.5688, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: -1.92% (0.6254 => 0.6134, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.36% (5.9063 => 5.8261, std.dev.: 0.0256) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3596 => 3.3174, std.dev.: 0.0085) SingleSource/Benchmarks/SmallPT/smallpt: -1.02% (14.9448 => 14.7919, std.dev.: 0.0189) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.09% (1.2047 => 1.1193, std.dev.: 0.0559) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.44% (0.0233 => 0.0211, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.42% (0.1530 => 0.1447, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -41.27% (1.9293 => 1.1330, std.dev.: 0.2922) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.95% (0.4049 => 0.3970, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.77% (0.1510 => 0.1453, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.0978 => 0.0934, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.02% (0.0590 => 0.0584, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.05% (1.1617 => 1.1495, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.61% (0.0610 => 0.0527, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0268 => 0.0268, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.32% (0.7437 => 0.7461, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.83% (0.0092 => 0.0048, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7638, std.dev.: 0.0230) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 17:39:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 19:39:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130114013929.AF0412A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7569?compare_to=7561&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7569, Order: 172367, Start Time: 2013-01-13 21:58:42, End Time: 2013-01-14 01:39:33 To: 7561, Order: 172358, Start Time: 2013-01-13 17:14:13, End Time: 2013-01-13 20:53:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (180 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.58% (112.2831 => 118.5540, std.dev.: 0.0757) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.39% (128.7717 => 130.5577, std.dev.: 0.5964) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.18% (54.1570 => 54.7950, std.dev.: 0.1030) SingleSource/Benchmarks/Dhrystone/dry: 1.13% (13.4996 => 13.6515, std.dev.: 0.0427) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.17% (2.4066 => 2.3785, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -1.02% (1.1532 => 1.1414, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.44% (0.0625 => 0.0884, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.74% (0.1063 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 31.37% (0.0714 => 0.0938, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 30.09% (0.0452 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.68% (0.0475 => 0.0616, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.69% (0.2969 => 0.3791, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.53% (0.1620 => 0.2066, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.24% (0.4139 => 0.5225, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.12% (0.5900 => 0.7441, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.59% (0.1106 => 0.1389, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.47% (0.4994 => 0.6266, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.58% (0.0541 => 0.0674, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.04% (0.5000 => 0.6202, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.37% (0.1549 => 0.1911, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.00% (0.1604 => 0.1973, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 22.80% (1.5932 => 1.9565, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.0948 => 0.1162, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.49% (0.1107 => 0.1356, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.76% (0.1103 => 0.1343, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.68% (0.3903 => 0.4749, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.06% (0.1619 => 0.1960, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 20.08% (0.4029 => 0.4838, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.36% (0.2866 => 0.3421, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 19.21% (0.1218 => 0.1452, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.21% (0.1088 => 0.1297, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 19.06% (0.0808 => 0.0962, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.84% (0.3890 => 0.4623, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.74% (0.5826 => 0.6918, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.63% (0.4658 => 0.5526, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.49% (0.2736 => 0.3242, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.31% (1.3152 => 1.5560, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/property-reference-object: 18.25% (0.5889 => 0.6964, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.03% (0.5546 => 0.6546, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.82% (1.8794 => 2.2144, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.67% (0.1160 => 0.1365, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.55% (0.5026 => 0.5908, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.55% (0.3271 => 0.3845, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.42% (3.5627 => 4.1835, std.dev.: 0.0174) MultiSource/Applications/hbd/hbd: 17.41% (0.9697 => 1.1385, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 17.36% (0.7171 => 0.8416, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.99% (1.6211 => 1.8965, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.92% (0.1968 => 0.2301, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.16% (0.3930 => 0.4565, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.96% (4.4195 => 5.1247, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.93% (0.2875 => 0.3333, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.90% (1.9694 => 2.2826, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.87% (0.4361 => 0.5053, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/random: 15.63% (0.2803 => 0.3241, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: 15.54% (0.2813 => 0.3250, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.53% (0.2911 => 0.3363, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 15.52% (0.2823 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.50% (1.9966 => 2.3061, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/strcat: 15.49% (0.2750 => 0.3176, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.44% (0.2811 => 0.3245, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.44% (2.7292 => 3.1505, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 15.43% (1.0781 => 1.2445, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.41% (0.2738 => 0.3160, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 15.36% (0.2714 => 0.3131, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.33% (0.2792 => 0.3220, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 15.30% (0.2725 => 0.3142, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8549, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.24% (0.2729 => 0.3145, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.23% (0.3060 => 0.3526, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.21% (0.3004 => 0.3461, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 15.19% (0.9909 => 1.1414, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 15.07% (23.5202 => 27.0652, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.05% (2.0673 => 2.3785, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.05% (0.3362 => 0.3868, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: 14.92% (0.3096 => 0.3558, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.90% (0.3195 => 0.3671, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 14.59% (1.4269 => 1.6351, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.55% (0.3465 => 0.3969, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.53% (0.3124 => 0.3578, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3317 => 0.3798, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 14.45% (0.3496 => 0.4001, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-2: 14.42% (0.3446 => 0.3943, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.28% (0.3460 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.24% (0.3469 => 0.3963, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.24% (0.3442 => 0.3932, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.14% (0.3726 => 0.4253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.14% (0.3678 => 0.4198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.11% (0.3282 => 0.3745, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 14.00% (0.3650 => 0.4161, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 13.98% (0.3348 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.94% (0.1090 => 0.1242, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 13.86% (0.3477 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.86% (0.3643 => 0.4148, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 13.85% (0.7875 => 0.8966, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.82% (0.3625 => 0.4126, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 13.82% (0.4146 => 0.4719, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 13.69% (0.3724 => 0.4234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 13.60% (0.4251 => 0.4829, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.50% (0.3690 => 0.4188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.49% (0.3981 => 0.4518, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.23% (0.1028 => 0.1164, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 13.07% (0.5012 => 0.5667, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.03% (0.3845 => 0.4346, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 12.42% (2.1653 => 2.4343, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: 12.18% (4.6177 => 5.1801, std.dev.: 0.0079) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3565, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.12% (0.6435 => 0.7215, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 12.10% (5.5417 => 6.2121, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: 11.89% (0.2691 => 0.3011, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 11.71% (0.2075 => 0.2318, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.58% (0.2737 => 0.3054, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.32% (0.3498 => 0.3894, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.32% (0.2068 => 0.2302, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 11.28% (0.6634 => 0.7382, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.86% (0.3084 => 0.3419, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.61% (0.5361 => 0.5930, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.31% (0.3336 => 0.3680, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.06% (11.6398 => 12.8104, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.00% (0.2040 => 0.2244, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (0.4847 => 0.5328, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.48% (0.7426 => 0.8130, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.33% (0.1383 => 0.1512, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.18% (4.6926 => 5.1234, std.dev.: 0.0105) MultiSource/Applications/lemon/lemon: 7.95% (0.2391 => 0.2581, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 7.72% (2.0346 => 2.1917, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.50% (0.5584 => 0.6003, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.77% (11.9555 => 12.7645, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.96% (0.3792 => 0.3980, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5155, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 9.31% (0.2802 => 0.3063, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.37% (0.3693 => 0.4002, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2389, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6698, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6782, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/flops-2: 4.31% (1.8057 => 1.8835, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2009, std.dev.: 0.0108) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.34% (7.1849 => 7.2811, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0828, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2103, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4820, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5925, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5771, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -18.55% (17.2379 => 14.0401, std.dev.: 0.1794) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7954, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2298, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8022, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -2.82% (14.0481 => 13.6515, std.dev.: 0.0427) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1941, std.dev.: 0.0758) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2519, std.dev.: 0.0454) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0464, std.dev.: 0.0046) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 18:30:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 20:30:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114023000.1EFC82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7570?compare_to=7566&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7570, Order: 172370, Start Time: 2013-01-14 00:56:03, End Time: 2013-01-14 02:30:01 To: 7566, Order: 172369, Start Time: 2013-01-13 22:55:14, End Time: 2013-01-14 00:29:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.94% (3.8363 => 3.7619, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.12% (0.6395 => 0.8769, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.32% (0.6395 => 0.8654, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.53% (0.6260 => 0.8359, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.21% (0.5688 => 0.7520, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.16% (0.5805 => 0.7672, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.00% (0.5456 => 0.7202, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.54% (0.6230 => 0.8195, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.08% (0.5567 => 0.7297, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.07% (0.5941 => 0.7787, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.07% (0.5581 => 0.7315, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.05% (0.5575 => 0.7306, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.54% (0.5802 => 0.7574, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.25% (0.5705 => 0.7431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.23% (0.6033 => 0.7857, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.95% (0.5849 => 0.7601, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.80% (0.5859 => 0.7605, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.55% (0.5570 => 0.7216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.46% (0.5478 => 0.7092, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.44% (0.6440 => 0.8336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.22% (0.5569 => 0.7196, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.18% (0.5925 => 0.7654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.10% (0.5591 => 0.7218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.23% (0.6189 => 0.7936, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.06% (0.5863 => 0.7508, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.01% (0.6052 => 0.7747, std.dev.: 0.0056) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.97% (0.5857 => 0.7495, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.88% (0.6446 => 0.8243, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.62% (0.6304 => 0.8045, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.03% (1.6474 => 2.0927, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.48% (0.6194 => 0.7834, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.92% (0.6297 => 0.7929, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.80% (0.6681 => 0.8405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.27% (0.6667 => 0.8285, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.22% (0.7524 => 0.9271, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.28% (0.7339 => 0.8974, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.98% (2.2587 => 2.7099, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.34% (0.0693 => 0.0827, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 16.75% (1.1450 => 1.3368, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.36% (0.3357 => 0.3839, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.14% (0.1081 => 0.1223, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.55% (1.6364 => 1.8417, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.21% (0.1982 => 0.2224, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.59% (0.4916 => 0.5486, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.58% (4.5069 => 5.0287, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 10.85% (0.4515 => 0.5005, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.17% (3.5339 => 3.8932, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.89% (9.2283 => 10.0489, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.63% (0.7021 => 0.7627, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.97% (1.2515 => 1.3512, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.32% (0.5329 => 0.5719, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.85% (0.2001 => 0.2138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.82% (1.4642 => 1.5641, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.89% (0.1731 => 0.1833, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.42% (0.4524 => 0.4769, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 5.23% (0.4861 => 0.5115, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.74% (0.3319 => 0.3443, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3.22% (1.3864 => 1.4311, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 3.10% (5.0226 => 5.1783, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.34% (5.4682 => 5.5962, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 2.34% (3.5154 => 3.5975, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (22.4056 => 22.9276, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: 1.96% (0.6750 => 0.6882, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 1.81% (0.8418 => 0.8570, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.46% (0.7447 => 0.7556, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 1.40% (15.5079 => 15.7255, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 1.13% (16.1920 => 16.3753, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.3722 => 1.3863, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6774, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3671, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4416, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5657, std.dev.: 0.0619) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6087, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2847, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.00% (4.4335 => 4.4779, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -7.26% (0.3194 => 0.2962, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -6.50% (0.3831 => 0.3582, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.48% (0.3812 => 0.3565, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: -6.47% (0.3848 => 0.3599, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.42% (0.3880 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.41% (0.3884 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.30% (0.3891 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.27% (0.4033 => 0.3780, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.18% (0.3837 => 0.3600, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: -6.03% (0.4176 => 0.3924, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.74% (0.4199 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.54% (0.3323 => 0.3139, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.46% (0.3057 => 0.2890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -5.44% (0.4280 => 0.4047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.43% (0.3059 => 0.2893, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -5.25% (0.3026 => 0.2867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.25% (0.2933 => 0.2779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -5.10% (0.6347 => 0.6023, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.95% (0.6441 => 0.6122, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.2428 => 0.2308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.94% (0.7779 => 0.7395, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: -4.85% (0.2989 => 0.2844) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.78% (0.9852 => 0.9381, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.53% (1.3148 => 1.2552, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.46% (0.4151 => 0.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.22% (0.3931 => 0.3765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.20% (0.3621 => 0.3469, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -4.00% (0.4321 => 0.4148, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.79% (0.4427 => 0.4259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.72% (0.3788 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.72% (0.3658 => 0.3522, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.70% (0.4248 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.67% (0.3867 => 0.3725, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4028, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.43% (0.9542 => 0.9215, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.21% (0.4083 => 0.3952, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.17% (0.3849 => 0.3727, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.94% (20.7746 => 20.1648, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.85% (0.7919 => 0.7693, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.78% (0.4813 => 0.4679) MultiSource/Applications/lambda-0_1_3/lambda: -2.38% (0.7982 => 0.7792, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.36% (1.0544 => 1.0295, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.7198 => 0.7041, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -2.04% (4.3330 => 4.2445, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.96% (1.2210 => 1.1971, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.93% (1.2221 => 1.1985, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -1.71% (2.4021 => 2.3611, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.48% (34.0927 => 33.5874, std.dev.: 0.0153) MultiSource/Applications/hbd/hbd: -1.38% (1.5610 => 1.5394, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.37% (1.2300 => 1.2132, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.34% (14.2083 => 14.0185, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: -1.24% (18.2933 => 18.0669, std.dev.: 0.0309) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (0.8521 => 0.8420, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.86% (1.8100 => 0.6903, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0192) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3145, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0216, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2082, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.28% (0.5142 => 0.4665, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8587, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4007, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.16% (7.9763 => 7.7239, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.33% (3.7241 => 3.6372, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.53% (4.8776 => 4.8028, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1957, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.17% (1.6219 => 1.6030, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 19:48:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 21:48:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114034822.41EFB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7571?compare_to=7568&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7571, Order: 172373, Start Time: 2013-01-14 01:48:26, End Time: 2013-01-14 03:48:27 To: 7568, Order: 172369, Start Time: 2013-01-13 23:31:30, End Time: 2013-01-14 01:31:32 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 2 (7 on baseline) Performance Improvements: 2 (80 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1059 (976 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.58% (0.9758 => 0.9912, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/random: 2.47% (2.4172 => 2.4770, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -2.42% (3.2135 => 3.1358, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.51% (5.0855 => 5.0085, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.99% (1.1193 => 1.1082, std.dev.: 0.0729) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.21% (0.0211 => 0.0222, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0339 => 0.0338, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0223 => 0.0222, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.46% (0.0253 => 0.0224, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.07% (0.1447 => 0.1477, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 0.13% (1.1330 => 1.1345, std.dev.: 0.0302) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.02% (0.3970 => 0.4090, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.75% (0.1453 => 0.1413, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.60% (0.0934 => 0.0977, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.53% (0.0584 => 0.0540, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1495 => 1.1478, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.0527 => 0.0551, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.10% (0.0268 => 0.0257, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.16% (0.7461 => 0.7449, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 60.42% (0.0048 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7638 => 12.7621, std.dev.: 0.4882) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.21% (0.0336 => 0.0498, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.40% (1.8651 => 1.9285, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.30% (0.7225 => 0.7391, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321025.00% (0.0008 => 2.5690, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.08% (1.1825 => 2.4132, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.01% (0.2562 => 0.2844, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 2.81% (2.1390 => 2.1992, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.89% (0.1009 => 0.0768, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.52% (0.1684 => 0.1288, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.53% (0.0676 => 0.0544, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -18.70% (1.8964 => 1.5417, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.38% (0.7686 => 0.6427, std.dev.: 0.0474) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.31% (0.1079 => 0.0903, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.42% (1.0986 => 0.9292, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -13.06% (0.1378 => 0.1198, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -12.57% (9.8875 => 8.6442, std.dev.: 0.1573) MultiSource/Applications/hexxagon/hexxagon: -11.97% (1.1433 => 1.0065, std.dev.: 0.0166) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.76% (1.2154 => 1.0725, std.dev.: 0.0188) MultiSource/Applications/treecc/treecc: -11.49% (2.4719 => 2.1879, std.dev.: 0.0499) MultiSource/Applications/Burg/burg: -11.27% (1.5979 => 1.4178, std.dev.: 0.0270) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -11.02% (0.1025 => 0.0912, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.00% (6.4235 => 5.7166, std.dev.: 0.1868) MultiSource/Applications/lua/lua: -10.58% (4.6406 => 4.1498, std.dev.: 0.0777) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.41% (1.3924 => 1.2475, std.dev.: 0.0484) MultiSource/Applications/sgefa/sgefa: -9.64% (0.3598 => 0.3251, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.11% (0.2372 => 0.2156, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.95% (0.2481 => 0.2259, std.dev.: 0.0027) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.93% (1.1731 => 1.0684, std.dev.: 0.0219) MultiSource/Applications/siod/siod: -8.77% (2.6437 => 2.4118, std.dev.: 0.0740) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.83% (1.6874 => 1.5552, std.dev.: 0.0350) MultiSource/Applications/lambda-0_1_3/lambda: -7.77% (0.8653 => 0.7981, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.50% (10.2703 => 9.4998, std.dev.: 0.2782) MultiSource/Applications/ClamAV/clamscan: -7.37% (17.4365 => 16.1507, std.dev.: 0.4297) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.37% (0.9588 => 0.8881, std.dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: -7.24% (17.5634 => 16.2910, std.dev.: 0.3959) SingleSource/Benchmarks/Shootout-C++/matrix: -6.83% (0.2385 => 0.2222, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (0.2006 => 0.1876, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -6.22% (0.4002 => 0.3753, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.22% (0.9550 => 0.8956, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -6.21% (0.5134 => 0.4815, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.11% (1.8127 => 1.7020, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (1.3310 => 1.2573, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.08% (0.3665 => 0.3479, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -4.73% (0.2135 => 0.2034, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: -4.70% (0.2551 => 0.2431, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.69% (0.9405 => 0.8964, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/lists: -4.66% (0.2725 => 0.2598, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.2305 => 0.2200, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: -4.52% (0.4689 => 0.4477, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.40% (0.3981 => 0.3806, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: -3.83% (0.2665 => 0.2563, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -3.19% (0.7776 => 0.7528, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.15% (1.0234 => 0.9912, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.97% (0.9685 => 0.9397, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.95% (1.0860 => 1.0540, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.10% (0.9372 => 0.6457, std.dev.: 0.0900) SingleSource/Benchmarks/Shootout/heapsort: -29.87% (4.4739 => 3.1374, std.dev.: 0.0318) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.41% (4.2042 => 3.1358, std.dev.: 0.0216) MultiSource/Applications/minisat/minisat: -21.60% (7.9891 => 6.2638, std.dev.: 0.5251) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.79% (0.1164 => 0.0922, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -15.36% (1.4235 => 1.2049, std.dev.: 0.0846) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.70% (1.6547 => 1.4611, std.dev.: 0.0507) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.17% (0.4081 => 0.3666, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.43% (1.4588 => 1.3212, std.dev.: 0.0174) MultiSource/Applications/SPASS/SPASS: -9.24% (9.0650 => 8.2276, std.dev.: 0.2354) SingleSource/Benchmarks/Shootout-C++/lists1: -8.90% (0.6628 => 0.6038, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.20% (4.4540 => 4.0888, std.dev.: 0.0413) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.74% (0.3217 => 0.2968, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: -7.10% (0.1704 => 0.1583, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: -6.11% (2.2304 => 2.0941, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/ary3: -4.33% (1.8123 => 1.7339, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/lists: -3.36% (17.2182 => 16.6394, std.dev.: 0.0546) MultiSource/Applications/sqlite3/sqlite3: -2.55% (4.4730 => 4.3591, std.dev.: 0.0323) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.46% (40.4729 => 39.4772, std.dev.: 0.1910) SingleSource/Benchmarks/Misc/mandel-2: -2.14% (0.8521 => 0.8339, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.09% (1.0995 => 1.0765, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/ffbench: -1.84% (1.4244 => 1.3982, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: -1.52% (2.8571 => 2.8138, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -1.43% (1.5825 => 1.5599, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.29% (2.5334 => 2.5007, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3163, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.12% (3.1921 => 3.1564, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/dt: -1.09% (0.9870 => 0.9762, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.01% (1.2047 => 1.1082, std.dev.: 0.0729) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.16% (0.0255 => 0.0224, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.46% (0.1530 => 0.1477, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -41.20% (1.9293 => 1.1345, std.dev.: 0.0302) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.01% (0.4049 => 0.4090, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.42% (0.1510 => 0.1413, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.10% (0.0978 => 0.0977, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.47% (0.0590 => 0.0540, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.20% (1.1617 => 1.1478, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.67% (0.0610 => 0.0551, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.10% (0.0268 => 0.0257, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7437 => 0.7449, std.dev.: 0.0014) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.30% (0.0092 => 0.0077, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7781 => 12.7621, std.dev.: 0.4882) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 20:07:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 22:07:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114040758.9252C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7572?compare_to=7567&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7572, Order: 172373, Start Time: 2013-01-14 01:56:49, End Time: 2013-01-14 04:08:00 To: 7567, Order: 172369, Start Time: 2013-01-13 23:15:30, End Time: 2013-01-14 01:26:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.34% (0.6669 => 0.6825, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8453 => 499.8424, std.dev.: 0.0100) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.06% (1.1277 => 499.8424, std.dev.: 0.0100) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.00% (0.5229 => 1.6628, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 20.74% (14.9895 => 18.0988, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 42.86% (14.1553 => 20.2218, std.dev.: 0.0176) MultiSource/Benchmarks/MallocBench/gs/gs: 17.76% (4.1105 => 4.8404, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.27% (1.1048 => 1.7817, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 436.76% (7.1582 => 38.4227, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.36% (3.4629 => 6.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.24% (0.6222 => 1.0779, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.03% (0.0720 => 7.4405, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11158500.00% (0.0001 => 11.1586, std.dev.: 0.0311) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486000.00% (0.0001 => 5.4861, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 831.28% (1.1194 => 10.4248, std.dev.: 0.0176) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 151.21% (22.1758 => 55.7071, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.42% (0.0929 => 0.1769, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 63.36% (21.9371 => 35.8373, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.23% (7.0540 => 11.0913, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.85% (2.9384 => 4.6090, std.dev.: 0.0169) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 50.76% (0.1056 => 0.1592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.52% (1.5859 => 2.3871, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.41% (8.1363 => 12.1564, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) SingleSource/Benchmarks/CoyoteBench/almabench: 42.60% (0.0730 => 0.1041, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.68% (2.2024 => 3.0983, std.dev.: 0.0185) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 39.34% (0.3109 => 0.4332, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.41% (4.2646 => 5.7319, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.39% (1.5415 => 2.0716, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.61% (0.4615 => 0.6120, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.93% (0.2700 => 0.3508, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 29.84% (1.1642 => 1.5116, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 29.79% (0.1175 => 0.1525, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.72% (0.2271 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.65% (0.1892 => 0.2453, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.22% (0.4299 => 0.5555, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.82% (0.6675 => 0.8599, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.99% (0.5105 => 0.6483, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 26.73% (0.0636 => 0.0806, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 26.69% (9.4845 => 12.0155, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/08-main/main: 26.39% (0.2554 => 0.3228, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 25.94% (1.0722 => 1.3503, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.68% (0.0479 => 0.0602, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.55% (3.8922 => 4.8867, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.28% (1.4186 => 1.7631, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.87% (0.1906 => 0.2361, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.39% (0.3121 => 0.3851, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.57% (0.1143 => 0.1401) MultiSource/Applications/oggenc/oggenc: 22.20% (5.7591 => 7.0379, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 22.12% (0.7115 => 0.8689, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 21.78% (0.4289 => 0.5223, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.77% (0.1695 => 0.2064, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.74% (4.9449 => 6.0197, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 21.54% (0.4620 => 0.5615, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 21.04% (3.3354 => 4.0373, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054) MultiSource/Applications/viterbi/viterbi: 20.96% (0.1555 => 0.1881, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.92% (5.0018 => 6.0483, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.57% (1.3050 => 1.5735, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 20.29% (0.1695 => 0.2039, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.06% (0.1236 => 0.1484, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.96% (0.7835 => 0.9399, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 19.79% (0.3098 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.71% (0.0842 => 0.1008, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 19.65% (10.3673 => 12.4046, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.5860 => 0.7008, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.05% (0.8172 => 0.9729, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 18.85% (0.1151 => 0.1368, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 18.79% (0.6456 => 0.7669, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.47% (0.0953 => 0.1129, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/18-imp/imp: 17.79% (0.3423 => 0.4032, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.59% (0.5020 => 0.5903, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.51% (0.2758 => 0.3241, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.38% (3.8723 => 4.5454, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 17.30% (1.1840 => 1.3888, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.26% (0.7433 => 0.8716, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.10% (0.9765 => 1.1435, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.04% (0.5569 => 0.6518, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 16.74% (2.0273 => 2.3667, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.74% (0.1117 => 0.1304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.63% (0.3307 => 0.3857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.34% (0.5981 => 0.6958, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.22% (0.6450 => 0.7496, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.10% (2.2969 => 2.6666, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.09% (0.1044 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.07% (0.3180 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.91% (0.8101 => 0.9390, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 15.71% (0.3387 => 0.3919, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.59% (0.0834 => 0.0964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.46% (0.3441 => 0.3973, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.21% (0.8067 => 0.9294, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.19% (1.1861 => 1.3663, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.55% (0.8921 => 1.0219, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 13.98% (0.3283 => 0.3742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.52% (0.3232 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.41% (0.2603 => 0.2952, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 13.15% (17.1811 => 19.4401, std.dev.: 0.0190) MultiSource/Applications/hbd/hbd: 13.02% (1.5603 => 1.7634, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.63% (14.3668 => 16.1813, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 12.28% (0.3379 => 0.3794, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.58% (0.3427 => 0.3824, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.41% (0.3865 => 0.4306, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 11.21% (0.3282 => 0.3650, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.13% (0.4636 => 0.5152, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.99% (0.2430 => 0.2697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.60% (0.3886 => 0.4298, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.55% (0.4103 => 0.4536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.40% (0.4203 => 0.4640, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.19% (0.3828 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.83% (0.4048 => 0.4446, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3543 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.61% (0.3422 => 0.3751, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.35% (0.3603 => 0.3940, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.31% (0.3684 => 0.4027, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.20% (0.3826 => 0.4178, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 9.03% (63.2438 => 68.9569, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.32% (0.4064 => 0.4402, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 7.81% (0.6030 => 0.6501, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.63% (0.5925 => 0.6377, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.4879 => 0.5241, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: 7.40% (0.7326 => 0.7868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.35% (0.2831 => 0.3039, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.20% (2.0665 => 2.2153, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 7.09% (1.2842 => 1.3753, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.05% (7.9617 => 8.5228, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.79% (0.3650 => 0.3898, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.73% (2.2022 => 2.3503, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.61% (0.3935 => 0.4195, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 6.50% (0.2877 => 0.3064, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.48% (0.3162 => 0.3367, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.40% (0.2905 => 0.3091, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.09% (0.2266 => 0.2404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 5.85% (0.2802 => 0.2966, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 5.83% (0.3052 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.80% (0.2793 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.68% (0.3136 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.27% (32.5116 => 59.2578, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6977, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4576, std.dev.: 0.0125) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3121, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.80% (0.9957 => 1.0335, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.6802 => 8.9148, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.68% (3.6395 => 3.7371, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.01% (9.1159 => 9.2988, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2771, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.23% (6.5088 => 6.5890, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4514, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.27% (5.2763 => 1.1992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.19% (0.8651 => 0.2146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.76% (5.3855 => 4.4829, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.44% (5.3526 => 4.4729, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -11.16% (10.4361 => 9.2710, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.06% (1.7609 => 1.6190, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0221, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.14% (1.9577 => 0.6825, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.50% (1.5373 => 1.0223, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.76% (10.7105 => 7.4164, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8608, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0045, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7318, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2702, std.dev.: 0.0394) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.33% (1.2373 => 1.1590, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.07% (1.5835 => 1.5032, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.95% (0.4808 => 0.4570, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.90% (8.1563 => 7.7570, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/salsa20: -4.27% (10.2830 => 9.8444, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.81% (3.6994 => 3.6326, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.40% (3.7221 => 3.6700, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2291, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0180) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0028) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 20:26:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 13 Jan 2013 22:26:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114042658.1C3232A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7573?compare_to=7570&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7573, Order: 172375, Start Time: 2013-01-14 02:53:21, End Time: 2013-01-14 04:27:01 To: 7570, Order: 172370, Start Time: 2013-01-14 00:56:03, End Time: 2013-01-14 02:30:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (106 on baseline) Performance Improvements: 0 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (853 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.19% (1.2710 => 1.2861, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.12% (0.6395 => 0.8769, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.57% (0.1132 => 0.1546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.39% (0.6395 => 0.8658, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.61% (0.6260 => 0.8364, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.30% (0.5805 => 0.7680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.24% (0.5456 => 0.7215, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.75% (0.6230 => 0.8208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.19% (0.5941 => 0.7794, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.16% (0.5581 => 0.7320, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.15% (0.5567 => 0.7301, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.68% (0.5802 => 0.7582, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.45% (0.6033 => 0.7870, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.27% (0.5705 => 0.7432, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.99% (0.5849 => 0.7603, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.94% (0.5859 => 0.7613, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.76% (0.5478 => 0.7108, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.54% (0.5569 => 0.7214, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.53% (0.5570 => 0.7215, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.42% (0.5591 => 0.7236, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.25% (0.5925 => 0.7658, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.31% (0.6189 => 0.7941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.21% (0.5857 => 0.7509, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.19% (0.5863 => 0.7516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.07% (0.6676 => 0.8550, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.94% (0.6446 => 0.8247, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.66% (0.6304 => 0.8048, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.24% (1.6474 => 2.0961, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.70% (0.6194 => 0.7848, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.22% (0.6660 => 0.8406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.08% (0.6297 => 0.7939, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.04% (0.6681 => 0.8421, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.42% (0.6667 => 0.8295, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.37% (0.7524 => 0.9282, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.51% (0.7339 => 0.8991, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.13% (2.2587 => 2.7133, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743) MultiSource/Applications/lemon/lemon: 17.14% (1.1450 => 1.3413, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.6364 => 1.8460, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.76% (4.5069 => 5.0371, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.39% (0.4916 => 0.5476, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.34% (0.4515 => 0.5027, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.39% (3.5339 => 3.9011, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.19% (9.2283 => 10.0765, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.7021 => 0.7638, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.57% (1.2515 => 1.3588, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.34% (0.5329 => 0.5720, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.03% (1.4642 => 1.5672, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.77% (1.2784 => 1.3649, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.89% (0.1731 => 0.1833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.88% (0.4524 => 0.4790, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4861 => 0.5139, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.16% (0.3255 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.83% (0.3319 => 0.3446, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.51% (1.3864 => 1.4350, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.28% (5.0226 => 5.1874, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.16% (0.3834 => 0.3955, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.57% (3.5154 => 3.6059, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.55% (5.4682 => 5.6078, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.44% (22.4056 => 22.9530, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/bigfib: 2.33% (0.6750 => 0.6907, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.83% (0.9557 => 0.9732, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.73% (0.7447 => 0.7576, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 1.65% (15.5079 => 15.7639, std.dev.: 0.0122) MultiSource/Applications/spiff/spiff: 1.60% (0.8418 => 0.8553, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3722 => 1.3915, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.25% (16.1920 => 16.3941, std.dev.: 0.0112) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.38% (31.3723 => 55.6481, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9531 => 1.0280, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1674, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5556, std.dev.: 0.0289) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2852, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5320 => 4.6023, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3489 => 10.4617, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.03% (4.4335 => 4.4792, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.95% (0.3194 => 0.2972, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.25% (0.3812 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.20% (0.3848 => 0.3648, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.17% (0.3057 => 0.2899, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.15% (0.3884 => 0.3684, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -5.08% (0.3896 => 0.3698, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.06% (0.3891 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.05% (0.3880 => 0.3684, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.94% (0.3323 => 0.3159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.91% (0.4176 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.89% (0.3821 => 0.3634, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.79% (2.1713 => 2.0672, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -4.76% (0.3026 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.74% (0.2428 => 0.2313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.65% (0.9852 => 0.9394, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.64% (0.3059 => 0.2917, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.53% (0.2933 => 0.2800, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.52% (0.4199 => 0.4009, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: -4.42% (0.2989 => 0.2857, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.35% (1.3148 => 1.2576, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -4.29% (0.6347 => 0.6075, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.21% (0.4280 => 0.4100, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.17% (0.4151 => 0.3978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.05% (0.6441 => 0.6180, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.86% (0.4321 => 0.4154, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.77% (0.7779 => 0.7486, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (0.3621 => 0.3488, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.55% (2.4924 => 2.4038, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.53% (0.3658 => 0.3529, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.38% (0.6484 => 0.6265, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -3.31% (0.3867 => 0.3739, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.30% (0.4427 => 0.4281, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.25% (0.4248 => 0.4110, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.22% (0.3788 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.18% (0.9542 => 0.9239, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.12% (0.3849 => 0.3729, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.89% (0.4083 => 0.3965, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0034) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2252, std.dev.: 0.0366) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.49% (0.4813 => 0.4693, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -2.34% (0.7982 => 0.7795, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.23% (1.0544 => 1.0309, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.00% (0.7198 => 0.7054, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -1.93% (4.3330 => 4.2492, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.80% (1.2210 => 1.1990, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.77% (1.2221 => 1.2005, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.68% (0.5999 => 0.5898, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -1.57% (2.4021 => 2.3644, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.55% (0.8521 => 0.8389, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.28% (34.0927 => 33.6560, std.dev.: 0.0172) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.26% (1.2300 => 1.2145, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.20% (1.5610 => 1.5422, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.13% (14.2083 => 14.0484, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: -1.03% (18.2933 => 18.1043, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.46% (1.8100 => 0.6614, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.42% (1.3643 => 1.0312, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0322, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3842, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.13% (2.5106 => 2.1308, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (7.9763 => 7.7297, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.7241 => 3.6438, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.79% (1.3096 => 1.2861, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: -1.78% (3.7092 => 3.6430, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1973, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.20% (4.8776 => 4.8190, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.04% (1.6219 => 1.6050, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 22:02:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 00:02:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114060259.B68552A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7574?compare_to=7571&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7574, Order: 172375, Start Time: 2013-01-14 04:05:25, End Time: 2013-01-14 06:03:05 To: 7571, Order: 172373, Start Time: 2013-01-14 01:48:26, End Time: 2013-01-14 03:48:27 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 12 (14 on baseline) Performance Improvements: 9 (151 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (898 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.71% (0.8208 => 0.8348, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 1.03% (2.1879 => 2.2105, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 1.03% (3.6036 => 3.6407, std.dev.: 0.0100) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.94% (14.4695 => 16.4865, std.dev.: 0.4482) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.37% (0.7744 => 0.8702, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.78% (1.2463 => 1.3059, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.10% (1.2049 => 1.2543, std.dev.: 0.0054) MultiSource/Benchmarks/llubenchmark/llu: 2.40% (1.9858 => 2.0334, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.09% (21.5402 => 21.9903, std.dev.: 0.1114) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.84% (2.4654 => 2.5108, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.63% (4.3705 => 4.4417, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 1.18% (2.3104 => 2.3377, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -6.98% (0.3425 => 0.3186, std.dev.: 0.0089) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.22% (0.3567 => 0.3345, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.92% (4.5947 => 4.5065, std.dev.: 0.0318) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.60% (0.9912 => 0.9753, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: -1.43% (1.5417 => 1.5196, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: -1.10% (1.4026 => 1.3872, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -1.74% (1.3982 => 1.3739, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.71% (41.8567 => 41.1421, std.dev.: 0.1079) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.31% (4.5944 => 4.5341, std.dev.: 0.0084) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.33% (1.1082 => 1.1045, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.91% (0.0222 => 0.0200, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0338 => 0.0335, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0319 => 0.0317, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.85% (0.0431 => 0.0367, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -4.83% (0.0207 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -0.90% (0.0222 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.27% (0.0224 => 0.0201, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.90% (0.1477 => 0.1449, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -0.21% (1.1345 => 1.1321, std.dev.: 0.0034) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.96% (0.4090 => 0.3969, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.01% (0.1413 => 0.1512, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.24% (0.0977 => 0.0877, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.78% (0.0540 => 0.0582, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1478 => 1.1497, std.dev.: 0.1040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -44.83% (0.0029 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.73% (0.0551 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.12% (0.0257 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.77% (0.7449 => 0.7392, std.dev.: 0.0012) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 58.44% (0.0077 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.17% (12.7621 => 12.7835, std.dev.: 0.5347) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.62% (0.0336 => 0.0496, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.8651 => 1.9256, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 2.09% (16.7012 => 17.0502, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.80% (0.7225 => 0.7355, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.46% (1.4110 => 1.4316, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322000.00% (0.0008 => 2.5768, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.68% (1.1825 => 2.4085, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.51% (0.2562 => 0.2780, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 4.48% (20.5117 => 21.4298, std.dev.: 0.2644) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.90% (2.2499 => 2.3377, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/pi: 3.22% (2.1390 => 2.2078, std.dev.: 0.0035) MultiSource/Applications/JM/lencod/lencod: 1.62% (6.8159 => 6.9261, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 1.51% (63.1520 => 64.1034, std.dev.: 0.3203) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4753 => 2.5108, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -49.13% (0.0808 => 0.0411, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.70% (0.0727 => 0.0482, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -26.56% (0.1009 => 0.0741, std.dev.: 0.0042) SingleSource/Benchmarks/SmallPT/smallpt: -26.43% (0.1888 => 0.1389, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.63% (0.1684 => 0.1286, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -21.93% (0.0862 => 0.0673, std.dev.: 0.0061) MultiSource/Applications/hbd/hbd: -19.87% (1.8964 => 1.5196, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -19.28% (0.1079 => 0.0871, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.50% (0.7686 => 0.6264, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -17.89% (0.4074 => 0.3345, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: -13.85% (1.0220 => 0.8805, std.dev.: 0.0127) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.28% (1.2154 => 1.0661, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -12.18% (1.1433 => 1.0040, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -12.01% (0.7693 => 0.6769, std.dev.: 0.0103) MultiSource/Applications/aha/aha: -11.61% (0.1378 => 0.1218, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -11.24% (9.8875 => 8.7762, std.dev.: 0.1374) MultiSource/Applications/Burg/burg: -11.04% (1.5979 => 1.4215, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.02% (6.4235 => 5.7159, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.95% (1.5131 => 1.3474, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.92% (1.3924 => 1.2403, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.70% (1.1498 => 1.0268, std.dev.: 0.0251) MultiSource/Applications/treecc/treecc: -10.57% (2.4719 => 2.2105, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.44% (0.1025 => 0.0918, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.87% (0.5746 => 0.5179, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.83% (0.2481 => 0.2237, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.83% (0.3560 => 0.3210, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -9.80% (4.6406 => 4.1857, std.dev.: 0.0045) MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.54% (1.1731 => 1.0612, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/health/health: -9.50% (0.1610 => 0.1457, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: -9.48% (0.1824 => 0.1651, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.24% (0.6885 => 0.6249, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.19% (0.2372 => 0.2154, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -9.12% (0.8653 => 0.7864, std.dev.: 0.0053) MultiSource/Applications/sgefa/sgefa: -8.84% (0.3598 => 0.3280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: -8.52% (0.2006 => 0.1835, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.52% (0.9588 => 0.8771, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.51% (0.9124 => 0.8348, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.43% (0.1210 => 0.1108, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -8.31% (2.6437 => 2.4241, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.00% (10.2703 => 9.4483, std.dev.: 0.0399) SingleSource/Benchmarks/Shootout-C++/hello: -7.68% (0.1928 => 0.1780, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.58% (1.6874 => 1.5595, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.53% (0.6934 => 0.6412, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.50% (0.1587 => 0.1468, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -7.46% (17.4365 => 16.1358, std.dev.: 0.0342) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.46% (0.2615 => 0.2420, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -7.25% (17.5634 => 16.2903, std.dev.: 0.1814) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.99% (0.2618 => 0.2435, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.96% (0.2283 => 0.2124, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: -6.86% (0.5134 => 0.4782, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -6.62% (0.4002 => 0.3737, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -6.58% (0.2385 => 0.2228, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.51% (1.3310 => 1.2443, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary: -6.31% (0.2551 => 0.2390, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.29% (0.2100 => 0.1968, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.22% (1.8127 => 1.6999, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.12% (0.3462 => 0.3250, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -6.07% (0.2305 => 0.2165, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -5.83% (0.2725 => 0.2566, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -5.66% (0.2172 => 0.2049, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.65% (0.3981 => 0.3756, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -5.62% (0.2135 => 0.2015, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.53% (0.9550 => 0.9022, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.46% (0.3665 => 0.3465, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3206 => 0.3032, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -5.38% (0.2564 => 0.2426, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -4.84% (0.4689 => 0.4462, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.72% (0.3093 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.70% (1.0234 => 0.9753, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/bigfib: -4.68% (0.6711 => 0.6397, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.56% (1.0052 => 0.9594, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.51% (0.9403 => 0.8979, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.47% (3.6295 => 3.4671, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.44% (5.0381 => 4.8143, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/ary2: -4.43% (0.2665 => 0.2547, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -4.07% (4.5936 => 4.4065, std.dev.: 0.0178) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.99% (0.2709 => 0.2601, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.92% (0.2577 => 0.2476, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.85% (0.2884 => 0.2773, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: -3.79% (3.7840 => 3.6407, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.69% (1.2680 => 1.2212, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -3.68% (1.3979 => 1.3465, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -3.64% (0.7776 => 0.7493, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: -3.61% (1.4392 => 1.3872, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sieve: -3.54% (0.2913 => 0.2810, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.46% (0.8990 => 0.8679, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.29% (1.0119 => 0.9786, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (1.3220 => 1.2788, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.25% (4.6579 => 4.5065, std.dev.: 0.0318) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.15% (0.7693 => 0.7451, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -3.06% (18.9377 => 18.3588, std.dev.: 0.0303) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.02% (0.3847 => 0.3731, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.87% (0.9214 => 0.8950, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -2.67% (16.4479 => 16.0081, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.59% (0.6135 => 0.5976, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.56% (2.4519 => 2.3892, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.51% (0.8893 => 0.8670, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.04% (0.6996 => 0.6853, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: -1.68% (5.3553 => 5.2654, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/football/football: -1.56% (0.9759 => 0.9607, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.14% (0.9372 => 0.6454, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/heapsort: -29.90% (4.4739 => 3.1360, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.42% (4.2042 => 3.1357, std.dev.: 0.0880) MultiSource/Applications/minisat/minisat: -22.53% (7.9891 => 6.1892, std.dev.: 0.0536) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.55% (1.0816 => 0.8702, std.dev.: 0.0066) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.04% (1.5623 => 1.2649, std.dev.: 0.0033) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.38% (0.1164 => 0.0950, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.89% (1.4235 => 1.2543, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.83% (0.4081 => 0.3639, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -10.62% (4.5259 => 4.0452, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.16% (1.6547 => 1.4865, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.08% (5.0421 => 4.5341, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/nestedloop: -9.91% (0.2200 => 0.1982, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -9.10% (0.6628 => 0.6025, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -8.45% (9.0650 => 8.2991, std.dev.: 0.0252) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.33% (4.4540 => 4.0831, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.08% (0.3217 => 0.2957, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: -8.04% (0.1704 => 0.1567, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.72% (1.4588 => 1.3462, std.dev.: 0.0254) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.67% (46.0987 => 43.0259, std.dev.: 0.5686) MultiSource/Benchmarks/Olden/health/health: -6.49% (0.3654 => 0.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: -6.26% (2.2304 => 2.0907, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.02% (23.3986 => 21.9903, std.dev.: 0.1114) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.23% (0.3349 => 0.3174, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.68% (1.4446 => 1.3770, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout-C++/ary3: -4.34% (1.8123 => 1.7337, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.62% (1.0995 => 1.0597, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: -3.55% (3.5443 => 3.4185, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/ffbench: -3.55% (1.4244 => 1.3739, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: -3.48% (1.0425 => 1.0062, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6322, std.dev.: 0.0690) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.78% (42.3194 => 41.1421, std.dev.: 0.1079) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.4730 => 4.3508, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.61% (0.5826 => 0.5674, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel-2: -2.51% (0.8521 => 0.8307, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.43% (3.0082 => 2.9350, std.dev.: 0.0146) MultiSource/Applications/spiff/spiff: -2.30% (2.8571 => 2.7914, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/hash: -2.08% (0.6254 => 0.6124, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -1.96% (29.0327 => 28.4651, std.dev.: 0.0574) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.65% (3.7662 => 3.7039, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/matrix: -1.53% (1.5825 => 1.5583, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.45% (8.6447 => 8.5190, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.43% (5.9063 => 5.8218, std.dev.: 0.0270) SingleSource/Benchmarks/Stanford/FloatMM: -1.40% (0.8328 => 0.8211, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/five11/five11: -1.39% (5.7021 => 5.6227, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/flops-6: -1.07% (2.4234 => 2.3974, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.05% (2.4120 => 2.3867, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.03% (1.5476 => 1.5317, std.dev.: 0.0047) MultiSource/Applications/aha/aha: -1.01% (3.5321 => 3.4965, std.dev.: 0.0098) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.32% (1.2047 => 1.1045, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.16% (0.0233 => 0.0200, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.53% (0.0445 => 0.0367, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -7.51% (0.0213 => 0.0197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.18% (0.0255 => 0.0201, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.29% (0.1530 => 0.1449, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -41.32% (1.9293 => 1.1321, std.dev.: 0.0034) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.98% (0.4049 => 0.3969, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.13% (0.1510 => 0.1512, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.33% (0.0978 => 0.0877, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.36% (0.0590 => 0.0582, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.03% (1.1617 => 1.1497, std.dev.: 0.1040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0032 => 0.0016, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.02% (0.0610 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.61% (0.7437 => 0.7392, std.dev.: 0.0012) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7835, std.dev.: 0.5347) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 22:35:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 00:35:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130114063518.15C462A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7575?compare_to=7569&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7575, Order: 172373, Start Time: 2013-01-14 03:00:04, End Time: 2013-01-14 06:35:21 To: 7569, Order: 172367, Start Time: 2013-01-13 21:58:42, End Time: 2013-01-14 01:39:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (179 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.44% (14.0401 => 14.3820, std.dev.: 0.0565) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.81% (2.0661 => 2.1035, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -1.96% (13.6515 => 13.3840, std.dev.: 0.0720) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.93% (0.1063 => 0.1413, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.92% (0.2969 => 0.3798, std.dev.: 0.0060) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.12% (0.5900 => 0.7441, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.97% (0.4139 => 0.5214, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.50% (0.1549 => 0.1944, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.51% (0.0714 => 0.0889, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.38% (0.4253 => 0.5290, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.32% (0.1620 => 0.2014, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.31% (0.4994 => 0.6208, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.96% (0.5000 => 0.6198, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 22.79% (0.1619 => 0.1988, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.58% (0.1107 => 0.1357, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 22.20% (1.5932 => 1.9469, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.05% (0.0948 => 0.1157, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.32% (0.1604 => 0.1946, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.14% (0.3903 => 0.4728, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.07% (0.0541 => 0.0655, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.31% (0.1462 => 0.1759, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.07% (0.2736 => 0.3285, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.68% (0.2866 => 0.3430, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 19.16% (0.4029 => 0.4801, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: 19.13% (0.1218 => 0.1451, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.93% (0.1088 => 0.1294, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.74% (0.5826 => 0.6918, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.66% (0.3890 => 0.4616, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 18.56% (0.0808 => 0.0958, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/09-vor/vor: 18.54% (0.1505 => 0.1784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.36% (1.3152 => 1.5567, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.36% (0.4658 => 0.5513, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 18.27% (0.5889 => 0.6965, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.17% (0.1090 => 0.1288, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 18.16% (0.5546 => 0.6553, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.95% (0.3271 => 0.3858, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675) MultiSource/Benchmarks/MallocBench/gs/gs: 17.65% (1.8794 => 2.2112, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: 17.27% (0.9697 => 1.1372, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.16% (3.5627 => 4.1741, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.92% (0.7171 => 0.8384, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.80% (1.6211 => 1.8934, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 16.67% (0.1284 => 0.1498, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.26% (0.5026 => 0.5843, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 16.17% (0.2566 => 0.2981, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.17% (1.9694 => 2.2878, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.08% (1.9966 => 2.3177, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (4.4195 => 5.1224, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.85% (0.3930 => 0.4553, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.62% (0.4361 => 0.5042, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.58% (0.2875 => 0.3323, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.52% (2.7292 => 3.1529, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.39% (0.2911 => 0.3359, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 15.13% (0.2750 => 0.3166, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.11% (0.2792 => 0.3214, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/random: 15.09% (0.2803 => 0.3226, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 15.08% (1.0781 => 1.2407, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 15.07% (0.2813 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 15.05% (0.2811 => 0.3234, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.02% (0.2823 => 0.3247, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.01% (0.3004 => 0.3455, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: 15.01% (0.2725 => 0.3134, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 14.98% (4.2109 => 4.8416, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ackermann: 14.94% (0.2738 => 0.3147, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.93% (0.3496 => 0.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 14.92% (0.2714 => 0.3119, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 14.77% (2.0673 => 2.3727, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-2: 14.77% (0.3446 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.77% (0.3460 => 0.3971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 14.77% (0.2729 => 0.3132, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.70% (0.3442 => 0.3948, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 14.68% (0.2780 => 0.3188, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 14.60% (0.9909 => 1.1356, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.55% (0.3195 => 0.3660, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.41% (23.5202 => 26.9102, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/wc: 14.41% (0.3096 => 0.3542, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.38% (0.3650 => 0.4175, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.35% (1.4269 => 1.6316, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.15% (0.3060 => 0.3493, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 14.11% (0.3267 => 0.3728, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.3258 => 0.3716, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.96% (0.3724 => 0.4244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.84% (0.3317 => 0.3776, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.80% (0.3124 => 0.3555, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.68% (0.3282 => 0.3731, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 13.57% (0.3678 => 0.4177, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.47% (0.3726 => 0.4228, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 13.46% (0.7875 => 0.8935, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.41% (0.3625 => 0.4111, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 13.38% (0.3348 => 0.3796, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 13.27% (0.4146 => 0.4696, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 13.26% (0.3477 => 0.3938, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 13.01% (0.4251 => 0.4804, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.98% (0.3690 => 0.4169, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.91% (0.3981 => 0.4495, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 12.35% (0.5012 => 0.5631, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.31% (2.1653 => 2.4319, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.06% (0.1028 => 0.1152, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 11.81% (4.6177 => 5.1632, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 11.76% (0.2075 => 0.2319, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 11.71% (0.2691 => 0.3006, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11.52% (5.5417 => 6.1802, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 11.46% (2.1013 => 2.3421, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.28% (0.6435 => 0.7161, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.85% (0.2737 => 0.3034, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.40% (0.2068 => 0.2283, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.12% (0.3084 => 0.3396, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 9.98% (0.6634 => 0.7296, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 9.74% (0.3336 => 0.3661, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.49% (0.5361 => 0.5870, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.46% (0.2103 => 0.2302, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.43% (0.4847 => 0.5304, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.36% (0.2040 => 0.2231, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.26% (0.1383 => 0.1511, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.21% (11.6398 => 12.7124, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.40% (4.6926 => 5.0868, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.39% (0.7426 => 0.8049, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 7.61% (0.2391 => 0.2573, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 7.20% (2.0346 => 2.1811, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.73% (0.5584 => 0.5960, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.23% (11.9555 => 12.7004, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.46% (0.3792 => 0.3999, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5373, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.12% (0.0734 => 0.0867, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (0.3693 => 0.4072, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.51% (0.2122 => 0.2239, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2393, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.11% (12.0509 => 12.6670, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-2: 4.93% (1.8057 => 1.8947, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6788, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.06% (3.3991 => 3.5030, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2071, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3063, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2847, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0817, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2087, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4800, std.dev.: 0.0032) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5836, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5608, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/fldry: -16.57% (17.2379 => 14.3820, std.dev.: 0.0565) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -8.62% (0.2402 => 0.2195, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.65% (35.5013 => 32.7861, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.73% (14.0481 => 13.3840, std.dev.: 0.0720) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2083, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/power/power: -3.69% (3.3665 => 3.2424, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8124, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.2028, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5773, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1357, std.dev.: 0.0776) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0480, std.dev.: 0.0021) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 22:49:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 00:49:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114064915.B3C8B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7576?compare_to=7572&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7576, Order: 172375, Start Time: 2013-01-14 04:37:58, End Time: 2013-01-14 06:49:18 To: 7572, Order: 172373, Start Time: 2013-01-14 01:56:49, End Time: 2013-01-14 04:08:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.32% (0.6825 => 0.6667, std.dev.: 0.0059) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8424 => 499.8430, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.11% (1.1277 => 499.8430, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.19% (0.5229 => 1.6638, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 21.09% (14.9895 => 18.1509, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 43.46% (14.1553 => 20.3069, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/gs/gs: 18.19% (4.1105 => 4.8583, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.50% (1.1048 => 1.7843, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.67% (7.1582 => 38.5590, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.40% (3.4629 => 6.3857, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.80% (0.6222 => 1.0814, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10231.53% (0.0720 => 7.4387, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11157400.00% (0.0001 => 11.1575, std.dev.: 0.0695) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848400.00% (0.0001 => 9.8485, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482800.00% (0.0001 => 5.4829, std.dev.: 0.0044) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.31% (1.1194 => 10.3691, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.49% (22.1758 => 55.7701, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 72.25% (0.1463 => 0.2520, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 63.50% (21.9371 => 35.8670, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.17% (7.0540 => 11.0865, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.05% (2.9384 => 4.6149, std.dev.: 0.0048) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.08% (1.5859 => 2.3959, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 50.85% (0.1056 => 0.1593, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.77% (8.1363 => 12.1860, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 44.25% (0.0730 => 0.1053, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.22% (2.2024 => 3.1102, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 40.01% (0.3109 => 0.4353, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 39.39% (0.1432 => 0.1996, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.70% (4.2646 => 5.7445, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.66% (1.5415 => 2.0758, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.94% (0.4615 => 0.6135, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.69% (0.0479 => 0.0626, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.66% (0.1892 => 0.2472, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.39% (1.1642 => 1.5180, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.03% (0.2271 => 0.2953, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 29.96% (0.1175 => 0.1527, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.93% (0.2700 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.70% (0.4299 => 0.5576, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.35% (0.6675 => 0.8634, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.48% (0.5105 => 0.6508, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.02% (0.1125 => 0.1429, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 26.90% (9.4845 => 12.0362, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/08-main/main: 26.82% (0.2554 => 0.3239, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 26.43% (1.0722 => 1.3556, std.dev.: 0.0127) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.02% (3.8922 => 4.9048, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.73% (1.4186 => 1.7694, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.58% (0.1143 => 0.1424, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.92% (0.1906 => 0.2362, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.81% (0.3121 => 0.3864, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 22.54% (5.7591 => 7.0570, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.36% (0.7115 => 0.8706, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 21.89% (0.4289 => 0.5228, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.86% (4.9449 => 6.0260, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 21.86% (0.4620 => 0.5630, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 21.34% (3.3354 => 4.0471, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.14% (5.0018 => 6.0593, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.76% (1.3050 => 1.5759, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.65% (0.1695 => 0.2045, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 20.51% (0.7835 => 0.9442, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.10% (0.5860 => 0.7038, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 19.98% (0.3098 => 0.3717, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 19.07% (0.0818 => 0.0974, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.05% (0.6456 => 0.7686, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.93% (0.8172 => 0.9719, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 18.87% (10.3673 => 12.3231, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.61% (0.1510 => 0.1791, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 18.11% (0.3423 => 0.4043, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.11% (0.5020 => 0.5929, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.89% (0.7433 => 0.8763, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.84% (0.2758 => 0.3250, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 17.78% (3.8723 => 4.5608, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 17.59% (1.1840 => 1.3923, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.42% (0.5569 => 0.6539, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.37% (0.2107 => 0.2473, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.36% (0.9765 => 1.1460, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.08% (2.0273 => 2.3736, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.95% (0.1044 => 0.1221, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.84% (0.3307 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.74% (2.2969 => 2.6815, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.62% (0.6450 => 0.7522, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.55% (0.5981 => 0.6971, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 16.35% (0.3180 => 0.3700, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.33% (0.8101 => 0.9424, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 16.20% (0.2049 => 0.2381, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 16.06% (0.3387 => 0.3931, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.81% (0.3441 => 0.3985, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.66% (0.8067 => 0.9330, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.46% (1.1861 => 1.3695, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/football/football: 14.90% (0.8921 => 1.0250, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958) SingleSource/Benchmarks/Shootout-C++/ary3: 13.98% (0.3283 => 0.3742, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.52% (0.3232 => 0.3669, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 13.47% (17.1811 => 19.4949, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 13.10% (1.5603 => 1.7647, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.69% (14.3668 => 16.1893, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: 12.26% (0.3092 => 0.3471, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 12.16% (0.3379 => 0.3790, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.76% (0.3427 => 0.3830, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.38% (0.3865 => 0.4305, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.30% (0.4636 => 0.5160, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.72% (0.4103 => 0.4543, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.57% (0.3927 => 0.4342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.54% (0.4203 => 0.4646, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 9.76% (0.4048 => 0.4443, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.56% (0.3422 => 0.3749, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 9.49% (0.3603 => 0.3945, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3826 => 0.4183, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 9.23% (63.2438 => 69.0839, std.dev.: 0.0192) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.14% (0.3543 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.10% (0.3561 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.03% (0.3543 => 0.3863, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3473 => 0.3785, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 8.90% (0.3516 => 0.3829, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 8.86% (0.3497 => 0.3807, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.49% (0.4064 => 0.4409, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.68% (0.6030 => 0.6493, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.44% (0.5925 => 0.6366, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.37% (0.7326 => 0.7866, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (2.2022 => 2.3602, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.07% (7.9617 => 8.5243, std.dev.: 0.0066) MultiSource/Applications/hexxagon/hexxagon: 7.02% (1.2842 => 1.3744, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.91% (2.0665 => 2.2092, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.88% (0.3650 => 0.3901, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.62% (0.2871 => 0.3061, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.61% (0.3935 => 0.4195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.53% (0.2877 => 0.3065, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.31% (0.2266 => 0.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.27% (0.2872 => 0.3052, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.13% (0.2905 => 0.3083, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.12% (0.2891 => 0.3068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.84% (0.3136 => 0.3319, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.77% (0.2756 => 0.2915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 5.67% (0.2802 => 0.2961, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.67% (0.3177 => 0.3357, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.51% (0.2793 => 0.2947, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 5.47% (0.2725 => 0.2874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 5.23% (0.2714 => 0.2856, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2472, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.38% (4.2280 => 4.4555, std.dev.: 0.0110) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3131, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.63% (0.9957 => 1.0418, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9056, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.20% (3.6395 => 3.7197, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2900, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2776, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.50% (1.0785 => 1.0947, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.25% (5.2763 => 1.2002, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.18% (0.8651 => 0.2147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -42.91% (0.1622 => 0.0926, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.92% (5.3855 => 4.4744, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.60% (5.3526 => 4.4641, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -11.15% (10.4361 => 9.2722, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6197, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0232, std.dev.: 0.0474) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.94% (1.9577 => 0.6667, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3091, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4209, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8689, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0058, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7347, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2713, std.dev.: 0.1378) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.33% (1.2373 => 1.1590, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.18% (8.1563 => 7.7342, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8257, std.dev.: 0.0071) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.38% (3.6994 => 3.6485, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2243, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0022) Report Time: 1.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 13 23:40:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 01:40:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114074000.3EBD42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7577?compare_to=7573&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7577, Order: 172376, Start Time: 2013-01-14 06:06:11, End Time: 2013-01-14 07:40:02 To: 7573, Order: 172375, Start Time: 2013-01-14 02:53:21, End Time: 2013-01-14 04:27:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 6.68% (0.6614 => 0.7056, std.dev.: 0.0104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 87.50% (0.0280 => 0.0525) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.27% (0.0717 => 0.1185, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.40% (0.0974 => 0.1572, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 51.69% (0.0267 => 0.0405) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.22% (0.6395 => 0.8775, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.32% (0.6395 => 0.8654, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.47% (0.6260 => 0.8355, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.42% (0.5688 => 0.7532, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.18% (0.5805 => 0.7673, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.15% (0.5456 => 0.7210, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.59% (0.6230 => 0.8198, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.20% (0.5581 => 0.7322, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.18% (0.5567 => 0.7303, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.11% (0.5941 => 0.7789, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.54% (0.5802 => 0.7574, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.43% (0.6033 => 0.7869, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.20% (0.5705 => 0.7428, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.94% (0.5859 => 0.7613, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.90% (0.5849 => 0.7598, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.90% (0.5478 => 0.7116, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.59% (0.5570 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.56% (0.5569 => 0.7215, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.25% (0.5925 => 0.7658, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.24% (0.5591 => 0.7226, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.27% (0.5857 => 0.7513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.18% (0.5863 => 0.7515, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.88% (0.6446 => 0.8243, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.57% (0.6304 => 0.8042, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.17% (1.6474 => 2.0950, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.56% (0.6194 => 0.7839, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.17% (0.6297 => 0.7945, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.17% (0.6660 => 0.8403, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.86% (0.6681 => 0.8409, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.84% (0.0445 => 0.0560, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.30% (0.6667 => 0.8287, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.39% (0.7524 => 0.9284, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.40% (0.7339 => 0.8983, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.96% (2.2587 => 2.7096, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.10% (1.1450 => 1.3408, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.63% (0.3357 => 0.3848, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.19% (0.0864 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.72% (1.6364 => 1.8445, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.78% (4.5069 => 5.0376, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.41% (0.4916 => 0.5477, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 11.21% (0.4515 => 0.5021, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.19% (3.5339 => 3.8941, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.18% (0.2385 => 0.2604, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.14% (9.2283 => 10.0720, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.75% (0.7021 => 0.7635, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.02% (1.2515 => 1.3519, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.5329 => 0.5715, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.96% (1.4642 => 1.5661, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.71% (1.2784 => 1.3642, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 5.84% (0.4524 => 0.4788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (0.4861 => 0.5143, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.01% (0.3255 => 0.3418, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.89% (0.3319 => 0.3448, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.53% (1.3864 => 1.4353, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.27% (5.0226 => 5.1869, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 2.66% (3.5154 => 3.6089, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (5.4682 => 5.6133, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.48% (22.4056 => 22.9610, std.dev.: 0.0180) MultiSource/Applications/spiff/spiff: 1.88% (0.8418 => 0.8576, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.68% (0.7447 => 0.7572, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.62% (15.5079 => 15.7596, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.40% (1.3722 => 1.3914, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 1.36% (16.1920 => 16.4124, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.9557 => 0.9670, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6591, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (0.9531 => 1.0295, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1677, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4080, std.dev.: 0.1733) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.26% (2.0478 => 2.1145, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2856, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6064, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.69% (0.1431 => 0.1321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.04% (0.3194 => 0.2969, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.48% (0.3848 => 0.3637, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.40% (0.3057 => 0.2892, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.39% (0.3880 => 0.3671, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.36% (0.2871 => 0.2717, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.24% (0.2903 => 0.2751, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.21% (0.4033 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.19% (0.3891 => 0.3689, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.12% (0.3205 => 0.3041, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.10% (0.4176 => 0.3963, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -5.00% (0.3059 => 0.2906, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2428 => 0.2309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.87% (2.1713 => 2.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.87% (0.3821 => 0.3635, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -4.86% (0.3026 => 0.2879, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.83% (0.2939 => 0.2797, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.70% (0.3252 => 0.3099, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.66% (0.9852 => 0.9393, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.44% (0.4280 => 0.4090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.39% (0.2849 => 0.2724, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.38% (0.3016 => 0.2884, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.26% (0.2933 => 0.2808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.23% (0.3025 => 0.2897, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.23% (1.3148 => 1.2592, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.15% (0.7779 => 0.7456, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.84% (0.4321 => 0.4155, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -3.84% (0.3621 => 0.3482, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.78% (0.4151 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4029, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.44% (0.3867 => 0.3734, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.37% (0.4248 => 0.4105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.34% (0.4427 => 0.4279, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: -3.30% (0.3788 => 0.3663, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.9542 => 0.9237, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.99% (0.4813 => 0.4669, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.84% (0.4083 => 0.3967, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.79% (0.7919 => 0.7698, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2325, std.dev.: 0.0313) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.21% (1.0544 => 1.0311, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -2.19% (0.7982 => 0.7807, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -1.89% (4.3330 => 4.2512, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (1.2210 => 1.1981, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.76% (1.2221 => 1.2006, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.74% (0.7198 => 0.7073, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -1.65% (0.9179 => 0.9028, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.40% (0.8521 => 0.8402, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.29% (34.0927 => 33.6518, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.20% (1.2300 => 1.2153, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.10% (1.5610 => 1.5439, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.06% (14.2083 => 14.0576, std.dev.: 0.0137) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.02% (1.8100 => 0.7056, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.77% (1.3643 => 1.0263, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7581, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0297, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2082, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.97% (0.6299 => 0.5041, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1305, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8592, std.dev.: 0.0116) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.04% (7.9763 => 7.7339, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.47% (3.7241 => 3.6321, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.67% (4.8776 => 4.7961, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0064) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1946, std.dev.: 0.0225) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4771, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.37% (1.6086 => 1.5865, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.12% (1.6307 => 1.6124, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6043, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 00:23:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 02:23:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114082345.6CA3F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7578?compare_to=7574&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7578, Order: 172377, Start Time: 2013-01-14 06:22:26, End Time: 2013-01-14 08:23:50 To: 7574, Order: 172375, Start Time: 2013-01-14 04:05:25, End Time: 2013-01-14 06:03:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 6 (5 on baseline) Performance Improvements: 1 (66 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1056 (992 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: 7.50% (0.3186 => 0.3425, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 6.30% (0.1651 => 0.1755, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.15% (0.1691 => 0.1795, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/distray/distray: 4.74% (0.2321 => 0.2431, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 3.54% (3.4871 => 3.6106, std.dev.: 0.0179) MultiSource/Applications/aha/aha: 1.62% (3.4965 => 3.5532, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.66% (64.1034 => 63.0369, std.dev.: 0.2841) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.02% (1.1045 => 1.1379, std.dev.: 0.3284) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.00% (0.0200 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.15% (0.0335 => 0.0301, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0317 => 0.0316, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.53% (0.0367 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -18.27% (0.0197 => 0.0161, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 25.87% (0.0201 => 0.0253, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.69% (0.1449 => 0.1459, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 6.32% (1.1321 => 1.2036, std.dev.: 0.4147) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.48% (0.3969 => 0.3950, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.66% (0.1512 => 0.1502, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.40% (0.0877 => 0.0977, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.74% (0.0272 => 0.0274, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.11% (0.0582 => 0.0529, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.16% (1.1497 => 1.1630, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.25% (0.0016 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.19% (0.0555 => 0.0606, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (0.0319 => 0.0312, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7392 => 0.7423, std.dev.: 0.0271) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.07% (0.0122 => 0.0078, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (12.7835 => 12.7848, std.dev.: 0.2587) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320775.00% (0.0008 => 2.5670, std.dev.: 0.0151) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.29% (1.1825 => 2.3684, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.63% (0.2562 => 0.2860, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 3.62% (2.1390 => 2.2165, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.21% (0.0808 => 0.0475, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.56% (0.0676 => 0.0537, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.26% (0.0862 => 0.0696, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.94% (0.1009 => 0.0828, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -16.05% (1.0986 => 0.9223, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.42% (0.7686 => 0.6501, std.dev.: 0.0132) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.55% (0.4074 => 0.3522, std.dev.: 0.0120) MultiSource/Applications/aha/aha: -13.35% (0.1378 => 0.1194, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.97% (0.1079 => 0.0939, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.87% (0.0847 => 0.0738, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -10.84% (9.8875 => 8.8158, std.dev.: 0.3889) MultiSource/Applications/hexxagon/hexxagon: -10.13% (1.1433 => 1.0275, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.50% (1.5131 => 1.3694, std.dev.: 0.0468) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.41% (0.3560 => 0.3225, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.18% (0.6885 => 0.6253, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.58% (1.3924 => 1.2729, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.52% (1.1498 => 1.0518, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.37% (0.9124 => 0.8360, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.01% (0.5746 => 0.5286, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/health/health: -7.89% (0.1610 => 0.1483, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -7.28% (0.2006 => 0.1860, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.26% (1.0017 => 0.9290, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.14% (0.7693 => 0.7144, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.60% (1.6874 => 1.5761, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/hash2: -6.43% (0.5134 => 0.4804, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.38% (0.2100 => 0.1966, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -6.25% (0.2385 => 0.2236, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.16% (0.2615 => 0.2454, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4002 => 0.3762, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.39% (0.9507 => 0.8995, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.97% (0.9091 => 0.8639, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.97% (0.3665 => 0.3483, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: -4.95% (0.2305 => 0.2191, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -4.88% (0.2725 => 0.2592, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.83% (1.0052 => 0.9566, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: -4.70% (0.2551 => 0.2431, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.49% (0.9403 => 0.8981, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.30% (1.3220 => 1.2651, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.20% (0.2618 => 0.2508, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -4.10% (0.2564 => 0.2459, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.39% (1.0119 => 0.9776, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.09% (0.8926 => 0.8650, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.05% (0.9061 => 0.8785, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.81% (5.0381 => 4.8967, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.64% (0.9381 => 0.9133, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.53% (0.9612 => 0.9369, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.79% (0.9120 => 0.8957, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.79% (0.9372 => 0.6580, std.dev.: 0.0830) MultiSource/Benchmarks/Olden/treeadd/treeadd: -11.08% (0.4081 => 0.3629, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.88% (0.1164 => 0.1049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -9.64% (4.5259 => 4.0897, std.dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.36% (1.4588 => 1.3222, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/lists1: -7.77% (0.6628 => 0.6113, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/nestedloop: -6.77% (0.2200 => 0.2051, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.01% (46.0987 => 43.3267, std.dev.: 0.9657) MultiSource/Benchmarks/Olden/health/health: -5.64% (0.3654 => 0.3448, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.62% (1.4446 => 1.3779, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.39% (0.3349 => 0.3202, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -4.35% (1.8123 => 1.7334, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: -3.47% (17.2182 => 16.6206, std.dev.: 0.0911) MultiSource/Applications/SIBsim4/SIBsim4: -3.36% (3.5443 => 3.4251, std.dev.: 0.0234) MultiSource/Applications/spiff/spiff: -1.96% (2.8571 => 2.8012, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.45% (3.1921 => 3.1457, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (0.8521 => 0.8402, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.36% (5.9063 => 5.8259, std.dev.: 0.0278) SingleSource/Benchmarks/Shootout-C++/matrix: -1.05% (2.9083 => 2.8778, std.dev.: 0.0112) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.54% (1.2047 => 1.1379, std.dev.: 0.3284) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.32% (0.0451 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.60% (0.0394 => 0.0301, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.66% (0.0328 => 0.0316, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.72% (0.0445 => 0.0424, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -24.41% (0.0213 => 0.0161, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0066) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1530 => 0.1459, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: -37.61% (1.9293 => 1.2036, std.dev.: 0.4147) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.45% (0.4049 => 0.3950, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.53% (0.1510 => 0.1502, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.10% (0.0978 => 0.0977, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.34% (0.0590 => 0.0529, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1617 => 1.1630, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.42% (0.0268 => 0.0312, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7437 => 0.7423, std.dev.: 0.0271) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7781 => 12.7848, std.dev.: 0.2587) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 01:34:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 03:34:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114093440.260A72A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7579?compare_to=7576&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7579, Order: 172377, Start Time: 2013-01-14 07:19:18, End Time: 2013-01-14 09:34:43 To: 7576, Order: 172375, Start Time: 2013-01-14 04:37:58, End Time: 2013-01-14 06:49:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (217 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.38% (0.9330 => 0.9459, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 1.16% (1.3744 => 1.3904, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (1.2913 => 1.3131, std.dev.: 0.0079) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (0.0650 => 0.0674, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8430 => 499.7595, std.dev.: 0.0447) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44216.71% (1.1277 => 499.7595, std.dev.: 0.0447) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.72% (0.5229 => 1.6666, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 21.40% (14.9895 => 18.1967, std.dev.: 0.0215) MultiSource/Applications/kimwitu++/kc: 44.06% (14.1553 => 20.3924, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 18.58% (4.1105 => 4.8741, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.85% (1.1048 => 1.7881, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.40% (7.1582 => 38.5398, std.dev.: 0.0308) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.76% (3.4629 => 6.3979, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.40% (0.6222 => 1.0851, std.dev.: 0.0075) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10233.75% (0.0720 => 7.4403, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 11161000.00% (0.0001 => 11.1611, std.dev.: 0.0530) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 66000.00% (0.0001 => 0.0661, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493400.00% (0.0001 => 5.4935, std.dev.: 0.0134) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 828.15% (1.1194 => 10.3897, std.dev.: 0.0207) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 151.66% (22.1758 => 55.8072, std.dev.: 0.0372) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0087) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 72.11% (0.1463 => 0.2518, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 64.85% (21.9371 => 36.1635, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.15% (7.0540 => 11.1560, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.76% (2.9384 => 4.6063, std.dev.: 0.0028) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.14% (1.5859 => 2.3970, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/distray/distray: 51.04% (0.1056 => 0.1595, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 50.76% (0.0394 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.71% (8.1363 => 12.1805, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.28% (2.2024 => 3.1115, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 40.56% (0.3109 => 0.4370, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0008) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.10% (1.5415 => 2.0825, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.82% (4.2646 => 5.7496, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.00% (0.4615 => 0.6184, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 32.92% (0.0814 => 0.1082, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.90% (0.0479 => 0.0627, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 30.85% (1.1642 => 1.5234, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.44% (0.2700 => 0.3522, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.34% (0.1892 => 0.2466, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 30.21% (0.1175 => 0.1530, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 29.80% (0.4299 => 0.5580, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.60% (0.6675 => 0.8651, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.82% (0.5105 => 0.6525, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.65% (0.1584 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.39% (0.1906 => 0.2428, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 27.24% (9.4845 => 12.0681, std.dev.: 0.2306) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.20% (0.1125 => 0.1431, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/08-main/main: 26.82% (0.2554 => 0.3239, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 26.44% (1.0722 => 1.3557, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.08% (3.8922 => 4.9071, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.48% (0.1566 => 0.1965, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.04% (1.4186 => 1.7738, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.58% (0.1143 => 0.1424, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.90% (0.3121 => 0.3867, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.41% (0.1337 => 0.1650, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: 23.19% (0.7115 => 0.8765, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 23.13% (0.4289 => 0.5281, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.88% (0.0730 => 0.0897, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 22.77% (0.1555 => 0.1909, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 22.65% (5.7591 => 7.0634, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 22.60% (0.4620 => 0.5664, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.51% (4.9449 => 6.0581, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.36% (0.1695 => 0.2074, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 22.24% (0.1695 => 0.2072, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 21.94% (3.3354 => 4.0673, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.33% (5.0018 => 6.0688, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 20.97% (0.7835 => 0.9478, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 20.88% (0.3098 => 0.3745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.83% (1.3050 => 1.5768, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.5860 => 0.7031, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 19.61% (0.6456 => 0.7722, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.60% (0.8172 => 0.9774, std.dev.: 0.0163) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 19.45% (10.3673 => 12.3840, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.02% (0.5020 => 0.5975, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.94% (0.1510 => 0.1796, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 18.75% (0.7433 => 0.8827, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 18.40% (0.3423 => 0.4053, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 18.21% (3.8723 => 4.5776, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 17.80% (1.1840 => 1.3947, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.51% (0.3307 => 0.3886, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.51% (2.0273 => 2.3822, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.47% (0.9765 => 1.1471, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.5569 => 0.6537, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.26% (0.8067 => 0.9459, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 16.99% (0.0818 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.95% (0.1044 => 0.1221, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 16.94% (2.2969 => 2.6860, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.85% (0.6450 => 0.7537, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.82% (0.5981 => 0.6987, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.74% (0.3441 => 0.4017, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/09-vor/vor: 16.45% (0.3180 => 0.3703, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.43% (0.0834 => 0.0971, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 16.30% (0.3387 => 0.3939, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.26% (0.8101 => 0.9418, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.82% (1.1861 => 1.3737, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.95% (0.8921 => 1.0255, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 14.93% (0.3283 => 0.3773, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 14.33% (0.3232 => 0.3695, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 14.00% (1.5603 => 1.7788, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.64% (17.1811 => 19.5239, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: 13.26% (0.3379 => 0.3827, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.89% (14.3668 => 16.2188, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/bh/bh: 12.55% (0.3092 => 0.3480, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.11% (0.3427 => 0.3842, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.11% (0.3865 => 0.4333, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.09% (0.4103 => 0.4599, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.78% (0.4636 => 0.5182, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/oourafft: 11.70% (0.3282 => 0.3666, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.47% (0.4203 => 0.4685, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/moments: 10.62% (0.4048 => 0.4478, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 10.46% (0.3422 => 0.3780, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3826 => 0.4226, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 10.35% (0.3603 => 0.3976, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.26% (0.3684 => 0.4062, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.67% (0.3497 => 0.3835, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 9.57% (63.2438 => 69.2985, std.dev.: 1.1569) SingleSource/UnitTests/ObjC/for-in: 9.56% (0.3694 => 0.4047, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.10% (0.4064 => 0.4434, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 8.90% (0.7326 => 0.7978, std.dev.: 0.0182) SingleSource/UnitTests/ObjC++/Hello: 8.78% (0.5925 => 0.6445, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/except: 8.57% (0.2871 => 0.3117, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 8.41% (0.2831 => 0.3069, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.27% (1.2842 => 1.3904, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 7.82% (0.2877 => 0.3102, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.81% (0.4879 => 0.5260, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.78% (2.0665 => 2.2273, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.59% (0.3650 => 0.3927, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.55% (0.3935 => 0.4232, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.37% (0.3162 => 0.3395, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.28% (2.2022 => 2.3625, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.21% (7.9617 => 8.5356, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.10% (0.2872 => 0.3076, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.82% (0.3136 => 0.3350, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 6.71% (0.2802 => 0.2990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.62% (0.3052 => 0.3254, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 6.50% (0.2725 => 0.2902, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.44% (0.2793 => 0.2973, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.44% (0.2266 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 6.34% (0.2714 => 0.2886, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2514, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4258, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.12% (4.2280 => 4.4446, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: 4.79% (3.1578 => 3.3092, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.12% (0.9957 => 1.0367, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0246) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9201, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (3.6395 => 3.7239, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.98% (9.1159 => 9.2961, std.dev.: 0.0277) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2787, std.dev.: 0.0909) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5776, std.dev.: 0.0079) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.17% (5.2763 => 1.2048, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.60% (5.3855 => 4.4914, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.28% (5.3526 => 4.4811, std.dev.: 0.0106) MultiSource/Applications/JM/ldecod/ldecod: -10.70% (10.4361 => 9.3195, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.10% (1.7609 => 1.6183, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 50.0026, std.dev.: 1.0735) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.52% (1.9577 => 0.6751, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3047, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4215, std.dev.: 0.2000) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8600, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0077, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4206, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -12.95% (3.1443 => 2.7371, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4941, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2880, std.dev.: 0.1439) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.76% (0.3463 => 0.3229, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5796, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2373 => 1.1646, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.02% (8.1563 => 7.7468, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.74% (0.4808 => 0.4580, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -4.52% (10.2830 => 9.8183, std.dev.: 0.0096) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7221 => 3.6707, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2323, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0032) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 01:42:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 03:42:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114094212.0D3222A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7580?compare_to=7577&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7580, Order: 172378, Start Time: 2013-01-14 08:05:43, End Time: 2013-01-14 09:42:14 To: 7577, Order: 172376, Start Time: 2013-01-14 06:06:11, End Time: 2013-01-14 07:40:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (106 on baseline) Performance Improvements: 0 (122 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.39% (79.8871 => 80.9947, std.dev.: 0.1974) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.17% (0.6395 => 0.8772, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.57% (0.6395 => 0.8670, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.63% (0.6260 => 0.8365, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.35% (0.5688 => 0.7528, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.25% (0.5805 => 0.7677, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.26% (0.5567 => 0.7307, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.24% (0.5941 => 0.7797, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.03% (0.5581 => 0.7313, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.70% (0.5802 => 0.7583, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.27% (0.6033 => 0.7859, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.24% (0.5705 => 0.7430, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.07% (0.5849 => 0.7608, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.83% (0.5859 => 0.7607, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.78% (0.5570 => 0.7229, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.74% (0.5478 => 0.7107, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.63% (0.6440 => 0.8348, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.43% (0.5569 => 0.7208, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.37% (0.5591 => 0.7233, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.33% (0.5925 => 0.7663, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.47% (0.6189 => 0.7951, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.22% (0.6052 => 0.7760, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.14% (0.5857 => 0.7505, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.11% (0.6446 => 0.8258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.11% (0.5863 => 0.7511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.09% (0.6676 => 0.8551, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.29% (1.6474 => 2.0970, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.74% (0.6194 => 0.7850, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.29% (0.6660 => 0.8411, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.11% (0.6297 => 0.7941, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.00% (0.6681 => 0.8418, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.36% (0.6667 => 0.8291, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.35% (0.7524 => 0.9281, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.40% (0.7339 => 0.8983, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.14% (2.2587 => 2.7136, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 17.14% (1.1450 => 1.3413, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 14.66% (0.3357 => 0.3849, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.74% (1.6364 => 1.8448, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.61% (0.1982 => 0.2232, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.76% (4.5069 => 5.0369, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.35% (0.4916 => 0.5474, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/05-eks/eks: 11.32% (0.4515 => 0.5026, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.23% (3.5339 => 3.8954, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.17% (9.2283 => 10.0742, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2385 => 0.2603, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 8.34% (1.2515 => 1.3559, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.39% (0.5329 => 0.5723, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.4642 => 1.5692, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.05% (0.2001 => 0.2142, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.78% (1.2784 => 1.3651, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 6.28% (0.4524 => 0.4808, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.64% (0.4861 => 0.5135, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/matrix: 5.07% (0.3255 => 0.3420, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3.65% (1.3864 => 1.4370, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 3.24% (5.0226 => 5.1854, std.dev.: 0.0186) MultiSource/Applications/d/make_dparser: 2.69% (3.5154 => 3.6100, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.64% (5.4682 => 5.6123, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.53% (22.4056 => 22.9721, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 2.11% (0.8418 => 0.8596, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 1.75% (15.5079 => 15.7789, std.dev.: 0.0131) MultiSource/Applications/minisat/minisat: 1.69% (0.7447 => 0.7573, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.3722 => 1.3923, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.39% (16.1920 => 16.4167, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.16% (0.9557 => 0.9668, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.00% (4.8161 => 4.8645, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6660, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9531 => 1.0273, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.16% (1.2783 => 1.3698, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1690, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5751 => 56.6364, std.dev.: 0.0669) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1022, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8210 => 28.2871, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (79.7170 => 80.9947, std.dev.: 0.1974) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.03% (4.4335 => 4.4792, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.98% (0.3194 => 0.2971, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614) SingleSource/UnitTests/ObjC/trivial-interface: -5.54% (0.3812 => 0.3601, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/for-in: -5.23% (0.4033 => 0.3822, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: -5.18% (0.3205 => 0.3039, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.11% (0.3891 => 0.3692, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.01% (0.3016 => 0.2865, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/exceptions: -4.93% (0.4176 => 0.3970, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.93% (2.1713 => 2.0642, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hello: -4.91% (0.2849 => 0.2709, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/random: -4.90% (0.2939 => 0.2795, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -4.86% (0.3025 => 0.2878, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.3026 => 0.2881, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (0.9852 => 0.9402, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -4.33% (1.3148 => 1.2579, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/parameter-passing: -4.30% (0.4280 => 0.4096, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.24% (0.4151 => 0.3975, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.94% (0.3931 => 0.3776, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4028, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -3.54% (0.3867 => 0.3730, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.44% (0.3658 => 0.3532, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.42% (0.6484 => 0.6262, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -3.39% (0.4248 => 0.4104, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.34% (0.4427 => 0.4279, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: -3.22% (0.3788 => 0.3666, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.9542 => 0.9237, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.17% (0.3849 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.15% (0.4321 => 0.4185, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.87% (0.4083 => 0.3966, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.34% (0.7919 => 0.7734, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -2.27% (0.7982 => 0.7801, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1997, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: -1.72% (4.3330 => 4.2583, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.65% (0.7198 => 0.7079, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.54% (1.2221 => 1.2033, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -1.45% (2.4021 => 2.3672, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/football/football: -1.42% (0.9179 => 0.9049, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.15% (34.0927 => 33.6996, std.dev.: 0.1011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.11% (1.2300 => 1.2163, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.09% (14.2083 => 14.0533, std.dev.: 0.0219) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3139, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2406, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0266, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0355, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7595, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2078, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.99% (2.5106 => 2.1343, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8587, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.14% (7.9763 => 7.7255, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2793, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1181, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.51% (4.8776 => 4.8038, std.dev.: 0.0155) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1960, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.6086 => 1.5881, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6049, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 02:40:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 04:40:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114104013.850A92A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7581?compare_to=7578&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7581, Order: 172384, Start Time: 2013-01-14 08:41:46, End Time: 2013-01-14 10:40:19 To: 7578, Order: 172377, Start Time: 2013-01-14 06:22:26, End Time: 2013-01-14 08:23:50 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 5 (10 on baseline) Performance Improvements: 12 (128 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (925 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.07% (1.9093 => 1.9298, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.42% (1.0502 => 1.0861, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 2.24% (63.0369 => 64.4497, std.dev.: 0.0908) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.03% (2.6907 => 2.7453, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 1.48% (1.6240 => 1.6481, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.91% (1.0275 => 1.0079, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.5393 => 7.4046, std.dev.: 0.0129) MultiSource/Applications/treecc/treecc: -1.57% (2.2096 => 2.1749, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: -1.53% (9.9750 => 9.8227, std.dev.: 0.0432) MultiSource/Applications/sqlite3/sqlite3: -1.36% (16.5074 => 16.2824, std.dev.: 0.0311) MultiSource/Applications/oggenc/oggenc: -1.22% (5.3194 => 5.2546, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: -1.10% (16.2307 => 16.0520, std.dev.: 0.0566) MultiSource/Applications/SIBsim4/SIBsim4: -1.03% (1.4027 => 1.3883, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -8.71% (0.1562 => 0.1426, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -2.05% (6.3056 => 6.1764, std.dev.: 0.0221) MultiSource/Benchmarks/Olden/tsp/tsp: -1.92% (1.5214 => 1.4922, std.dev.: 0.0101) MultiSource/Applications/aha/aha: -1.31% (3.5532 => 3.5065, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.35% (1.1379 => 1.1112, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -35.00% (0.0220 => 0.0143, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0427 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.30% (0.0301 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.24% (0.0424 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 26.09% (0.0161 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -15.91% (0.0220 => 0.0185, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0253 => 0.0253) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1459 => 0.1450, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -5.24% (1.2036 => 1.1405, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.24% (0.3950 => 0.3999, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.40% (0.1502 => 0.1481, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.07% (0.0977 => 0.0947, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0274 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.59% (0.0529 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.33% (1.1630 => 1.1475, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 47.06% (0.0017 => 0.0025, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.47% (0.0606 => 0.0585, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (0.0312 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.23% (0.7423 => 0.7406, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: -5.13% (0.0078 => 0.0074, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.21% (12.7848 => 12.7582, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.73% (0.0336 => 0.0493, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.47% (1.8651 => 1.9298, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (9.5202 => 9.8227, std.dev.: 0.0432) MultiSource/Applications/JM/lencod/lencod: 2.40% (16.7012 => 17.1020, std.dev.: 0.0350) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323300.00% (0.0008 => 2.5872, std.dev.: 0.0528) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.14% (1.1825 => 2.4258, std.dev.: 0.1050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.79% (0.2562 => 0.2864, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 2.05% (63.1520 => 64.4497, std.dev.: 0.0908) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.58% (0.8800 => 0.8939, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: 1.42% (1.6251 => 1.6481, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.59% (0.0808 => 0.0480, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.53% (0.0727 => 0.0476, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0008) SingleSource/Benchmarks/SmallPT/smallpt: -27.70% (0.1888 => 0.1365, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.29% (0.1684 => 0.1275, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -23.37% (0.0676 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.41% (0.1009 => 0.0793, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -20.77% (0.0862 => 0.0683, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -19.46% (1.8964 => 1.5274, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.63% (0.1079 => 0.0878, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.65% (0.7686 => 0.6406, std.dev.: 0.0170) MultiSource/Applications/spiff/spiff: -13.49% (1.0220 => 0.8841, std.dev.: 0.0048) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.23% (0.4074 => 0.3535, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.75% (0.0847 => 0.0739, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.71% (0.0889 => 0.0776, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -12.71% (9.8875 => 8.6311, std.dev.: 0.2560) MultiSource/Applications/aha/aha: -12.34% (0.1378 => 0.1208, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -12.02% (2.4719 => 2.1749, std.dev.: 0.0101) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.88% (1.2154 => 1.0710, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: -11.84% (1.1433 => 1.0079, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.35% (6.4235 => 5.6947, std.dev.: 0.0377) MultiSource/Applications/Burg/burg: -11.23% (1.5979 => 1.4184, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -11.12% (1.1498 => 1.0219, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -10.95% (0.5746 => 0.5117, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.36% (0.2481 => 0.2224, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -10.09% (4.6406 => 4.1722, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/health/health: -9.81% (0.1610 => 0.1452, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.80% (1.5131 => 1.3648, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.61% (0.9124 => 0.8247, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.44% (0.7693 => 0.6967, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.31% (0.9588 => 0.8695, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.22% (0.6885 => 0.6250, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.12% (10.2703 => 9.3333, std.dev.: 0.1345) MultiSource/Applications/sgefa/sgefa: -9.09% (0.3598 => 0.3271, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.07% (0.3560 => 0.3237, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -9.03% (2.6437 => 2.4051, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.97% (1.3924 => 1.2675, std.dev.: 0.0198) MultiSource/Applications/lambda-0_1_3/lambda: -8.18% (0.8653 => 0.7945, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.94% (17.4365 => 16.0520, std.dev.: 0.0566) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -7.66% (0.1305 => 0.1205, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.62% (1.6874 => 1.5589, std.dev.: 0.0211) MultiSource/Applications/viterbi/viterbi: -7.46% (0.1824 => 0.1688, std.dev.: 0.0016) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.32% (1.1731 => 1.0872, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -7.29% (17.5634 => 16.2824, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/ary3: -7.10% (0.2564 => 0.2382, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.01% (0.2283 => 0.2123, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (0.2006 => 0.1871, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -6.69% (0.1928 => 0.1799, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.65% (1.8127 => 1.6921, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.62% (0.1587 => 0.1482, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.43% (0.2100 => 0.1965, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/moments: -6.35% (0.4002 => 0.3748, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.92% (0.3462 => 0.3257, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -5.92% (0.2551 => 0.2400, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.89% (0.2615 => 0.2461, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.88% (0.3981 => 0.3747, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.81% (0.9422 => 0.8875, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -5.74% (0.2385 => 0.2248, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -5.74% (0.3206 => 0.3022, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: -5.68% (0.2305 => 0.2174, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: -5.57% (0.2172 => 0.2051, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -5.48% (0.2135 => 0.2018, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.35% (3.6295 => 3.4355, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.32% (0.3665 => 0.3470, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.15% (0.9512 => 0.9022, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.97% (1.3310 => 1.2648, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: -4.95% (0.4689 => 0.4457, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.61% (0.2993 => 0.2855, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: -4.59% (0.7776 => 0.7419, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: -4.40% (0.2725 => 0.2605, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -4.36% (1.3979 => 1.3370, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -4.17% (3.7840 => 3.6261, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.10% (5.0381 => 4.8314, std.dev.: 0.0447) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.95% (4.6579 => 4.4741, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.93% (1.3220 => 1.2700, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.85% (0.3093 => 0.2974, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: -3.80% (0.6711 => 0.6456, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: -3.75% (18.9377 => 18.2267, std.dev.: 0.1699) MultiSource/Applications/SIBsim4/SIBsim4: -3.54% (1.4392 => 1.3883, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.50% (0.7693 => 0.7424, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.25% (0.9214 => 0.8915, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.04% (1.2680 => 1.2294, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.02% (0.9061 => 0.8787, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: -2.71% (16.4479 => 16.0027, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.67% (0.8846 => 0.8610, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.66% (0.6135 => 0.5972, std.dev.: 0.0018) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.31% (0.4596 => 0.4490, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: -1.90% (1.2708 => 1.2466, std.dev.: 0.0077) MultiSource/Applications/oggenc/oggenc: -1.88% (5.3553 => 5.2546, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.84% (2.4519 => 2.4067, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.36% (1.4805 => 1.4604, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.96% (0.9372 => 0.6470, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/heapsort: -29.40% (4.4739 => 3.1584, std.dev.: 0.3632) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.69% (4.2042 => 3.1663, std.dev.: 0.0710) MultiSource/Applications/minisat/minisat: -22.69% (7.9891 => 6.1764, std.dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.23% (1.0816 => 0.8628, std.dev.: 0.0361) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.22% (1.5623 => 1.2620, std.dev.: 0.0690) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.84% (1.4235 => 1.2550, std.dev.: 0.0150) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.60% (1.6547 => 1.4628, std.dev.: 0.0729) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.10% (0.4081 => 0.3669, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: -9.75% (4.5259 => 4.0844, std.dev.: 0.0186) MultiSource/Applications/SPASS/SPASS: -9.61% (9.0650 => 8.1939, std.dev.: 0.2446) SingleSource/Benchmarks/Shootout-C++/lists1: -9.43% (0.6628 => 0.6003, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.97% (4.4540 => 4.0543, std.dev.: 0.0345) SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.69% (5.0421 => 4.6039, std.dev.: 0.1062) SingleSource/Benchmarks/Shootout/nestedloop: -6.91% (0.2200 => 0.2048, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -6.22% (2.2304 => 2.0917, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.83% (23.3986 => 22.0354, std.dev.: 0.1400) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.76% (46.0987 => 43.4435, std.dev.: 0.3145) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.51% (0.3349 => 0.3198, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.42% (1.4446 => 1.3807, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/ary3: -4.32% (1.8123 => 1.7340, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.68% (61.0379 => 58.7888, std.dev.: 0.5484) MultiSource/Applications/SIBsim4/SIBsim4: -3.54% (3.5443 => 3.4188, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists: -3.39% (17.2182 => 16.6349, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/chomp: -3.35% (1.0425 => 1.0076, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ffbench: -2.73% (1.4244 => 1.3855, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -2.73% (4.4730 => 4.3510, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.21% (0.5826 => 0.5697, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: -2.00% (2.8571 => 2.8000, std.dev.: 0.0076) MultiSource/Applications/lua/lua: -1.91% (29.0327 => 28.4772, std.dev.: 0.0673) SingleSource/Benchmarks/Shootout/matrix: -1.58% (1.5825 => 1.5575, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.32% (5.9063 => 5.8281, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.15% (3.1921 => 3.1553, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.10% (4.2843 => 4.2370, std.dev.: 0.0149) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.76% (1.2047 => 1.1112, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.63% (0.0233 => 0.0143, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.54% (0.0451 => 0.0426, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.74% (0.0394 => 0.0332, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.94% (0.0445 => 0.0423, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -4.69% (0.0213 => 0.0203, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -18.50% (0.0227 => 0.0185, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.23% (0.1530 => 0.1450, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -40.89% (1.9293 => 1.1405, std.dev.: 0.0250) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.4049 => 0.3999, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.92% (0.1510 => 0.1481, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.0978 => 0.0947, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.12% (0.0590 => 0.0548, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.22% (1.1617 => 1.1475, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.88% (0.0032 => 0.0025, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.10% (0.0610 => 0.0585, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.16% (12.7781 => 12.7582, std.dev.: 0.0091) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 03:40:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 05:40:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114114027.5AB512A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7582?compare_to=7580&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7582, Order: 172391, Start Time: 2013-01-14 10:06:10, End Time: 2013-01-14 11:40:30 To: 7580, Order: 172378, Start Time: 2013-01-14 08:05:43, End Time: 2013-01-14 09:42:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.25% (6.1575 => 6.2347, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 83.57% (0.0280 => 0.0514, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.57% (0.0717 => 0.1180, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.52% (0.0974 => 0.1544, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.00% (0.6395 => 0.8761, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.22% (0.1132 => 0.1542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.23% (0.6395 => 0.8648, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.16% (0.6260 => 0.8336, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.17% (0.5688 => 0.7518, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.96% (0.5456 => 0.7200, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.92% (0.5805 => 0.7658, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.52% (0.6230 => 0.8194, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.00% (0.5941 => 0.7783, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.92% (0.5575 => 0.7299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.88% (0.5567 => 0.7286, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.82% (0.5581 => 0.7301, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.27% (0.5802 => 0.7558, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.20% (0.6033 => 0.7855, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.99% (0.5705 => 0.7416, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.80% (0.5849 => 0.7592, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.53% (0.5859 => 0.7589, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.50% (0.5570 => 0.7213, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.37% (0.5478 => 0.7087, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.29% (0.6440 => 0.8326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.05% (0.5569 => 0.7187, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.01% (0.5591 => 0.7213, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.95% (0.5925 => 0.7640, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.18% (0.6189 => 0.7933, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.17% (0.6052 => 0.7757, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.90% (0.5857 => 0.7491, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.86% (0.6446 => 0.8242, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.86% (0.6676 => 0.8536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.85% (0.5863 => 0.7496, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.21% (1.6474 => 2.0957, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.33% (0.6194 => 0.7825, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.19% (0.6681 => 0.8431, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.99% (0.6660 => 0.8391, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.84% (0.0445 => 0.0560) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.81% (0.6297 => 0.7922, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.12% (0.6667 => 0.8275, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.11% (0.7524 => 0.9263, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.20% (0.7339 => 0.8968, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.89% (2.2587 => 2.7079, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 17.18% (1.1450 => 1.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.19% (0.0864 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.56% (0.1982 => 0.2231, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.45% (1.6364 => 1.8402, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.66% (4.5069 => 5.0325, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.35% (0.4916 => 0.5474, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4515 => 0.4998, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.10% (3.5339 => 3.8910, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 8.97% (9.2283 => 10.0557, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.2385 => 0.2594, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.72% (0.7021 => 0.7633, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.38% (1.2515 => 1.3564, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.94% (1.4642 => 1.5658, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1731 => 0.1849, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.70% (0.2001 => 0.2135, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 6.55% (0.1879 => 0.2002, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (1.2784 => 1.3612, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4524 => 0.4803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.14% (0.4861 => 0.5111, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.73% (0.3255 => 0.3409, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.3864 => 1.4309, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.18% (5.0226 => 5.1822, std.dev.: 0.0048) MultiSource/Applications/d/make_dparser: 2.63% (3.5154 => 3.6077, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.57% (5.4682 => 5.6088, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.36% (22.4056 => 22.9341, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/bigfib: 2.07% (0.6750 => 0.6890, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.81% (0.8418 => 0.8570, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.72% (0.7447 => 0.7575, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 1.72% (15.5079 => 15.7743, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.3722 => 1.3887, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: 1.17% (16.1920 => 16.3817, std.dev.: 0.0238) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6531, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.61% (0.9531 => 1.0352, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3690, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.76% (5.1955 => 5.4429, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1689, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5751 => 56.3682, std.dev.: 0.3613) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.73% (2.0478 => 2.1037, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2848, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6034, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 1.10% (4.4335 => 4.4824, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.51% (0.1281 => 0.1108, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -7.29% (0.3194 => 0.2961, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.03% (0.3812 => 0.3582, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.93% (0.3831 => 0.3604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.90% (0.3896 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.88% (0.3880 => 0.3652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.81% (0.3891 => 0.3665, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -5.63% (0.4176 => 0.3941, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.21% (0.3323 => 0.3150, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.17% (0.3059 => 0.2901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.12% (0.4199 => 0.3984, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.79% (0.2903 => 0.2764, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.75% (0.9852 => 0.9384, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -4.72% (0.2989 => 0.2848, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.71% (0.3016 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.64% (2.1713 => 2.0706, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -4.49% (1.3148 => 1.2558, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.36% (0.3025 => 0.2893, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.02% (0.6347 => 0.6092, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.93% (0.4151 => 0.3988, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.90% (0.7779 => 0.7476, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists1: -3.80% (0.3867 => 0.3720, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.71% (2.4924 => 2.4000, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.57% (0.4427 => 0.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.56% (0.3788 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.56% (0.3931 => 0.3791, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.51% (0.4248 => 0.4099, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.50% (0.3142 => 0.3032, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.50% (0.9542 => 0.9208, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.49% (0.6484 => 0.6258, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.44% (0.3658 => 0.3532, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.36% (0.4321 => 0.4176, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.35% (0.3849 => 0.3720, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.58% (0.4813 => 0.4689, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2420, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.27% (0.7919 => 0.7739, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0322, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.96% (1.2221 => 1.1982, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.2210 => 1.1986, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/gs/gs: -1.78% (4.3330 => 4.2559, std.dev.: 0.0120) MultiSource/Applications/lambda-0_1_3/lambda: -1.72% (0.7982 => 0.7845, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.68% (0.5999 => 0.5898, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.7198 => 0.7078, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.28% (1.2300 => 1.2143, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.18% (14.2083 => 14.0410, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -1.14% (2.4021 => 2.3747, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.14% (34.0927 => 33.7048, std.dev.: 0.0182) MultiSource/Applications/hbd/hbd: -1.02% (1.5610 => 1.5451, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.82% (1.8100 => 0.6910, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3123, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0259, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0353, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1757, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (7.9763 => 7.7291, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.10% (3.7241 => 3.6458, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.87% (1.3096 => 1.2851, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4688, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.50% (1.6307 => 1.6063, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.49% (7.3040 => 7.1951, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8051, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.38% (1.6219 => 1.5995, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5892, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6700, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 04:17:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 06:17:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114121719.4F68D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7583?compare_to=7579&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7583, Order: 172391, Start Time: 2013-01-14 10:05:15, End Time: 2013-01-14 12:17:22 To: 7579, Order: 172377, Start Time: 2013-01-14 07:19:18, End Time: 2013-01-14 09:34:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 5 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.15% (3.1319 => 3.1680, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.76% (0.8827 => 0.8672, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -1.25% (2.6860 => 2.6523, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -1.09% (4.5776 => 4.5279, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (4.4914 => 4.4457, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -1.01% (4.0673 => 4.0263, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0415 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0674 => 0.0675, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7595 => 499.7854, std.dev.: 0.0291) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44219.00% (1.1277 => 499.7854, std.dev.: 0.0291) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.75% (0.5229 => 1.6563, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 20.56% (14.9895 => 18.0717, std.dev.: 0.0258) MultiSource/Applications/kimwitu++/kc: 42.96% (14.1553 => 20.2360, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/gs/gs: 17.50% (4.1105 => 4.8299, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.90% (1.1048 => 1.7776, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.47% (7.1582 => 38.3297, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.02% (3.4629 => 6.3379, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.48% (0.6222 => 1.0794, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.64% (0.0720 => 7.4395, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11145300.00% (0.0001 => 11.1454, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485900.00% (0.0001 => 5.4860, std.dev.: 0.0054) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.93% (1.1194 => 10.3089, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783) MultiSource/Applications/ClamAV/clamscan: 149.86% (22.1758 => 55.4092, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 92.18% (0.0243 => 0.0467, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 65.56% (21.9371 => 36.3195, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.75% (7.0540 => 11.0570, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.72% (2.9384 => 4.6051, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 50.47% (0.1056 => 0.1589, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 49.97% (1.5859 => 2.3783, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/IntMM: 49.49% (0.0394 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.08% (8.1363 => 12.1293, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.27% (2.2024 => 3.0894, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 38.79% (0.3109 => 0.4315, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.32% (1.5415 => 2.0705, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.00% (4.2646 => 5.7145, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.55% (0.4615 => 0.6117, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.71% (0.1892 => 0.2473, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.77% (0.2271 => 0.2947, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 29.40% (1.1642 => 1.5065, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/tsp/tsp: 29.28% (0.1175 => 0.1519, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.07% (0.2700 => 0.3485, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 29.03% (0.4299 => 0.5547, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.52% (0.6675 => 0.8579, std.dev.: 0.0056) MultiSource/Benchmarks/NPB-serial/is/is: 27.12% (0.0719 => 0.0914, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.83% (0.1584 => 0.2009, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.66% (0.5105 => 0.6466, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 26.34% (9.4845 => 11.9831, std.dev.: 0.0098) SingleSource/Benchmarks/Stanford/Oscar: 25.94% (0.0636 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 25.54% (1.0722 => 1.3460, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.93% (0.0746 => 0.0932, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.90% (3.8922 => 4.8614, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.21% (0.0793 => 0.0985, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.09% (1.4186 => 1.7603, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.01% (0.0479 => 0.0594, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.82% (0.1906 => 0.2360, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.20% (0.3121 => 0.3845, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.15% (0.0730 => 0.0899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 23.04% (0.4289 => 0.5277, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.74% (0.1337 => 0.1641, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.60% (0.1695 => 0.2078, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 21.82% (0.0614 => 0.0748, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 21.81% (0.7115 => 0.8667, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 21.76% (5.7591 => 7.0125, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash2: 21.69% (0.4620 => 0.5622, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.47% (0.1695 => 0.2059, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.35% (4.9449 => 6.0004, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.13% (0.0672 => 0.0814, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 20.71% (3.3354 => 4.0263, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.51% (5.0018 => 6.0279, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/matrix: 20.43% (0.3098 => 0.3731, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 20.43% (10.3673 => 12.4853, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.19% (1.3050 => 1.5685, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 19.94% (0.7835 => 0.9397, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.70% (0.0675 => 0.0808, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.66% (0.1236 => 0.1479, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.60% (0.1163 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.53% (0.8172 => 0.9768, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.36% (0.0842 => 0.1005, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.28% (0.5860 => 0.6990, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.25% (0.1143 => 0.1363, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 19.18% (0.0662 => 0.0789, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 19.01% (0.6456 => 0.7683, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.28% (0.0886 => 0.1048, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 18.16% (0.1151 => 0.1360, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.60% (0.5569 => 0.6549, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 17.53% (0.3423 => 0.4023, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.49% (0.5020 => 0.5898, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 17.10% (1.1840 => 1.3865, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.93% (3.8723 => 4.5279, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.2107 => 0.2463, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.86% (0.9765 => 1.1411, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 16.67% (0.7433 => 0.8672, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.51% (0.2065 => 0.2406, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 16.49% (2.0273 => 2.3616, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.17% (0.5981 => 0.6948, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.12% (0.6450 => 0.7490, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.01% (0.8101 => 0.9398, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 15.71% (0.2049 => 0.2371, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.71% (0.1044 => 0.1208, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 15.50% (0.3180 => 0.3673, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 15.47% (2.2969 => 2.6523, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 15.47% (0.3387 => 0.3911, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.46% (0.3441 => 0.3973, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.31% (0.8067 => 0.9302, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.23% (0.0834 => 0.0961, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.86% (1.1861 => 1.3624, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 14.77% (0.3283 => 0.3768, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.8921 => 1.0194, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 14.11% (0.3232 => 0.3688, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.70% (0.0759 => 0.0863, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.22% (0.2603 => 0.2947, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.00% (1.5603 => 1.7632, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: 12.77% (17.1811 => 19.3744, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary2: 12.73% (0.3379 => 0.3809, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.32% (14.3668 => 16.1364, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 12.29% (0.3092 => 0.3472, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.12% (0.3927 => 0.4403, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.75% (0.3865 => 0.4319, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3427 => 0.3829, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.71% (0.4636 => 0.5179, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.95% (0.3543 => 0.3931, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.86% (0.3516 => 0.3898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.78% (0.4203 => 0.4656, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.75% (0.4103 => 0.4544, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.62% (0.2430 => 0.2688, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 10.45% (0.4048 => 0.4471, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3826 => 0.4211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.05% (0.3422 => 0.3766, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3603 => 0.3963, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.83% (0.3684 => 0.4046, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 9.62% (0.1268 => 0.1390, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.01% (0.4064 => 0.4430, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.63% (63.2438 => 68.7042, std.dev.: 0.0908) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 8.09% (0.2831 => 0.3060, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.81% (0.4879 => 0.5260, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.62% (2.0665 => 2.2240, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 7.41% (1.2842 => 1.3793, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.26% (0.1625 => 0.1743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.2877 => 0.3084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.18% (0.3650 => 0.3912, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.12% (0.3162 => 0.3387, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (7.9617 => 8.5132, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.62% (0.2872 => 0.3062, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.59% (2.2022 => 2.3474, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.53% (0.2756 => 0.2936, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.39% (0.3052 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.39% (0.2802 => 0.2981, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.38% (0.3136 => 0.3336, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.23% (0.2714 => 0.2883, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.78% (0.2266 => 0.2397, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.32% (0.3177 => 0.3346, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2546, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.98% (1.1145 => 1.2926, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4539, std.dev.: 0.0174) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.62% (0.3316 => 0.3436, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0101) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9159, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7108, std.dev.: 0.0078) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2918, std.dev.: 0.0110) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2791, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4507, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.35% (5.2763 => 1.1951, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.59% (0.8651 => 0.2112, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.45% (5.3855 => 4.4457, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.86% (5.3526 => 4.4501, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -11.38% (10.4361 => 9.2485, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.40% (1.7609 => 1.6129, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9673, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.40% (1.9577 => 0.6773, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.53% (1.5373 => 1.0218, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.76% (10.7105 => 7.4164, std.dev.: 0.0330) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8612, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0070, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7341, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2903, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.54% (1.2373 => 1.1564, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (8.1563 => 7.7446, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.44% (10.2830 => 9.8267, std.dev.: 0.0122) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.6994 => 3.6195, std.dev.: 0.0152) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3281, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6667, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2319, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0024) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 05:02:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 07:02:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114130247.D871B2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7584?compare_to=7581&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7584, Order: 172391, Start Time: 2013-01-14 11:01:47, End Time: 2013-01-14 13:02:54 To: 7581, Order: 172384, Start Time: 2013-01-14 08:41:46, End Time: 2013-01-14 10:40:19 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 28 (10 on baseline) Performance Improvements: 1 (82 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1034 (971 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 41.50% (0.0441 => 0.0624, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.66% (5.6947 => 6.2446, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/objinst: 8.75% (0.2068 => 0.2249, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 6.53% (0.2051 => 0.2185, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 5.60% (0.6567 => 0.6935, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/strcat: 5.59% (0.1985 => 0.2096, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.35% (0.8915 => 0.9303, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.07% (0.7424 => 0.7726, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.97% (0.4968 => 0.5165, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 3.47% (0.4779 => 0.4945, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: 3.18% (4.4659 => 4.6081, std.dev.: 0.0286) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.10% (0.3747 => 0.3863, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 2.11% (4.1722 => 4.2603, std.dev.: 0.0172) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 30.49% (3.1663 => 4.1317, std.dev.: 0.3168) SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.46% (4.6039 => 5.9604, std.dev.: 0.0608) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.42% (1.4594 => 1.8595, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.42% (2.3524 => 2.5740, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.10% (1.2443 => 1.3077, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.94% (2.2607 => 2.3724, std.dev.: 0.0318) SingleSource/Benchmarks/McGill/chomp: 4.52% (1.0076 => 1.0531, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/distray/distray: 4.42% (0.2310 => 0.2412, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: 3.68% (0.6598 => 0.6841, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.39% (2.4312 => 2.5135, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/lpbench: 3.21% (4.0543 => 4.1845, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.72% (1.3807 => 1.4182, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 2.53% (8.6585 => 8.8772, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.59% (1.5444 => 1.5690, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.07% (4.0186 => 4.0614, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.51% (0.8939 => 0.8715, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.24% (1.1112 => 1.1139, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.85% (0.0143 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0315 => 0.0314, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.09% (0.0423 => 0.0393, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0203 => 0.0204, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: 1.62% (0.0185 => 0.0188, std.dev.: 0.0093) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0253 => 0.0254, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.45% (0.1450 => 0.1429, std.dev.: 0.0134) MultiSource/Applications/lemon/lemon: 6.21% (1.1405 => 1.2113, std.dev.: 0.1545) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.63% (0.3999 => 0.3974, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.51% (0.1481 => 0.1429, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.42% (0.0947 => 0.0951, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.46% (0.0548 => 0.0556, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.1475 => 1.1524, std.dev.: 0.0709) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 16.00% (0.0025 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.44% (0.0585 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.66% (0.0319 => 0.0285, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7406 => 0.7401, std.dev.: 0.0110) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.27% (0.0074 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.21% (12.7582 => 12.7844, std.dev.: 0.4673) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.60% (0.0336 => 0.0506, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Queens: 43.12% (0.0436 => 0.0624, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 1.78% (2.5772 => 2.6230, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321000.00% (0.0008 => 2.5688, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.65% (1.1825 => 2.4082, std.dev.: 0.0173) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.21% (5.0421 => 5.9604, std.dev.: 0.0608) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.87% (0.2562 => 0.2866, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.44% (2.2499 => 2.3724, std.dev.: 0.0318) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.53% (9.0082 => 9.3258, std.dev.: 0.0833) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.4498 => 2.5135, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.35% (0.0808 => 0.0482, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -35.76% (0.0727 => 0.0467, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.35% (0.0692 => 0.0482, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -26.11% (0.1888 => 0.1395, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.70% (0.1684 => 0.1268, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -24.56% (0.0676 => 0.0510, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.33% (0.1009 => 0.0814, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.46% (1.0960 => 0.9046, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: -16.61% (1.8964 => 1.5814, std.dev.: 0.0339) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.01% (0.0862 => 0.0724, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.85% (0.7686 => 0.6468, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.77% (1.0986 => 0.9254, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: -10.84% (1.1433 => 1.0194, std.dev.: 0.0391) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.58% (0.1210 => 0.1082, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.50% (0.2372 => 0.2123, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -10.24% (1.5979 => 1.4342, std.dev.: 0.0408) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.90% (1.2154 => 1.0951, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.11% (1.5131 => 1.3752, std.dev.: 0.0411) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.05% (1.3924 => 1.2664, std.dev.: 0.0062) MultiSource/Applications/aha/aha: -8.78% (0.1378 => 0.1257, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.71% (0.2481 => 0.2265, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -8.20% (4.6406 => 4.2603, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.84% (0.6885 => 0.6345, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/fibo: -7.78% (0.2006 => 0.1850, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.13% (1.0017 => 0.9303, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.82% (0.9550 => 0.8899, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.68% (0.9422 => 0.8793, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: -6.50% (0.2385 => 0.2230, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.42% (0.2709 => 0.2535, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.69% (0.2144 => 0.2022, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.69% (0.9127 => 0.8608, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.64% (0.9507 => 0.8971, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.46% (0.3462 => 0.3273, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.28% (0.9512 => 0.9010, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.24% (0.3665 => 0.3473, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.22% (0.9405 => 0.8914, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.15% (0.9788 => 0.9284, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.93% (0.9091 => 0.8643, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.91% (0.8990 => 0.8549, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.90% (1.0052 => 0.9559, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.89% (1.3310 => 1.2659, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.74% (0.9993 => 0.9519, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.69% (0.9403 => 0.8962, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.35% (1.3220 => 1.2645, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.03% (0.9488 => 0.9106, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.69% (1.0860 => 1.0459, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -3.68% (0.5134 => 0.4945, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.57% (0.9685 => 0.9339, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.56% (1.0088 => 0.9729, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.55% (1.0119 => 0.9760, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.38% (0.9855 => 0.9522, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.32% (0.5369 => 0.5191, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.18% (0.8926 => 0.8642, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.13% (4.6579 => 4.5123, std.dev.: 0.0274) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.96% (0.3981 => 0.3863, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.89% (0.9061 => 0.8799, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.81% (0.8893 => 0.8643, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.79% (6.4235 => 6.2446, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.64% (0.9612 => 0.9358, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.58% (0.9381 => 0.9139, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.53% (0.8846 => 0.8622, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.49% (0.8732 => 0.8515, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: -2.39% (18.9377 => 18.4851, std.dev.: 0.1611) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.35% (0.9998 => 0.9763, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.29% (0.9120 => 0.8911, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.82% (14.9757 => 14.7035, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.78% (0.9010 => 0.8850, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.73% (1.0867 => 1.0679, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.65% (1.4805 => 1.4560, std.dev.: 0.0070) MultiSource/Benchmarks/nbench/nbench: -1.56% (1.2708 => 1.2510, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.39% (0.9867 => 0.9730, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.92% (0.1164 => 0.1002, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.95% (0.4081 => 0.3634, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.56% (2.8778 => 2.5740, std.dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.08% (1.4588 => 1.3263, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/lpbench: -6.05% (4.4540 => 4.1845, std.dev.: 0.0302) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.65% (2.5170 => 2.4251, std.dev.: 0.0154) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.31% (40.4729 => 39.1317, std.dev.: 0.1885) SingleSource/Benchmarks/Shootout-C++/lists: -3.14% (17.2182 => 16.6779, std.dev.: 0.1330) MultiSource/Applications/sqlite3/sqlite3: -2.49% (4.4730 => 4.3616, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.83% (1.4446 => 1.4182, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: -1.75% (2.8571 => 2.8070, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.54% (1.2047 => 1.1139, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.32% (0.0451 => 0.0427, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.27% (0.0328 => 0.0314, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.69% (0.0445 => 0.0393, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: -17.18% (0.0227 => 0.0188, std.dev.: 0.0093) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.39% (0.0255 => 0.0254, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -93.33% (0.0015 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -6.60% (0.1530 => 0.1429, std.dev.: 0.0134) MultiSource/Applications/lemon/lemon: -37.22% (1.9293 => 1.2113, std.dev.: 0.1545) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.85% (0.4049 => 0.3974, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.36% (0.1510 => 0.1429, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.76% (0.0978 => 0.0951, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.76% (0.0590 => 0.0556, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.80% (1.1617 => 1.1524, std.dev.: 0.0709) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0110) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.87% (0.0092 => 0.0059, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7781 => 12.7844, std.dev.: 0.4673) Report Time: 0.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 05:38:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 07:38:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114133800.151342A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7585?compare_to=7582&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7585, Order: 172399, Start Time: 2013-01-14 12:04:00, End Time: 2013-01-14 13:38:04 To: 7582, Order: 172391, Start Time: 2013-01-14 10:06:10, End Time: 2013-01-14 11:40:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.36% (0.0717 => 0.1200, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.47% (0.0974 => 0.1563, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 51.31% (0.0267 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.20% (0.1500 => 0.2178, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.89% (0.6395 => 0.8754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.04% (0.6395 => 0.8636, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.18% (0.6260 => 0.8337, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.94% (0.5688 => 0.7505, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.94% (0.5805 => 0.7659, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.76% (0.5456 => 0.7189, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.38% (0.6230 => 0.8185, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.88% (0.5567 => 0.7286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.87% (0.5581 => 0.7304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.87% (0.5575 => 0.7296, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.16% (0.5802 => 0.7552, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.05% (0.6033 => 0.7846, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.04% (0.5705 => 0.7419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.53% (0.5849 => 0.7576, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.51% (0.5859 => 0.7588, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.32% (0.5570 => 0.7203, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.28% (0.5478 => 0.7082, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.24% (0.6440 => 0.8323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.05% (0.5569 => 0.7187, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.89% (0.5591 => 0.7206, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.86% (0.5925 => 0.7635, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.07% (0.6189 => 0.7926, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.91% (0.6052 => 0.7741, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.78% (0.5857 => 0.7484, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.77% (0.5863 => 0.7491, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.64% (0.6676 => 0.8521, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.35% (0.6304 => 0.8028, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.15% (1.6474 => 2.0946, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.12% (0.6194 => 0.7812, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.89% (0.6660 => 0.8384, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.71% (0.6297 => 0.7916, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.58% (0.6681 => 0.8390, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.04% (0.6667 => 0.8270, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.05% (0.7524 => 0.9258, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.19% (0.0622 => 0.0760, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.06% (0.7339 => 0.8958, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.81% (2.2587 => 2.7062, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.90% (0.0566 => 0.0673, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 17.07% (1.1450 => 1.3404, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316) MultiSource/Applications/sgefa/sgefa: 14.33% (0.3357 => 0.3838, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8424, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.47% (4.5069 => 5.0239, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.23% (0.4916 => 0.5468, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 10.56% (0.4515 => 0.4992, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.05% (3.5339 => 3.8891, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 8.87% (9.2283 => 10.0472, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.68% (0.2385 => 0.2592, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.50% (0.7021 => 0.7618, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.24% (1.2515 => 1.3546, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.94% (0.5329 => 0.5699, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.89% (1.4642 => 1.5651, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1731 => 0.1848, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.55% (0.2001 => 0.2132, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.51% (1.2784 => 1.3616, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 6.49% (0.1879 => 0.2001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.92% (0.4524 => 0.4792, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.14% (0.4861 => 0.5111, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.68% (0.3319 => 0.3441, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.17% (5.0226 => 5.1818, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 3.14% (1.3864 => 1.4300, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.50% (5.4682 => 5.6049, std.dev.: 0.0036) MultiSource/Applications/d/make_dparser: 2.47% (3.5154 => 3.6021, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (22.4056 => 22.9236, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 2.00% (0.6750 => 0.6885, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.65% (0.8418 => 0.8557, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.54% (0.7447 => 0.7562, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.51% (15.5079 => 15.7428, std.dev.: 0.0082) MultiSource/Applications/JM/lencod/lencod: 1.13% (16.1920 => 16.3756, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6775, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9531 => 1.0291, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.65% (5.1955 => 5.4373, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1682, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4551, std.dev.: 0.1855) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.00% (2.0478 => 2.1092, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2854, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6038, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4783, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.94% (0.1281 => 0.1128, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -7.23% (0.3194 => 0.2963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -6.06% (0.3812 => 0.3581, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.95% (0.3848 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.93% (0.3896 => 0.3665, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.93% (0.3880 => 0.3650, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.84% (0.3837 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.95% (0.3821 => 0.3632, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.94% (2.1713 => 2.0641, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.86% (0.9852 => 0.9373, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4280 => 0.4079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.68% (0.3016 => 0.2875, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.64% (0.2933 => 0.2797, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.58% (0.3252 => 0.3103, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.45% (1.3148 => 1.2563, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.94% (0.6347 => 0.6097, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.93% (0.4151 => 0.3988, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.78% (2.4924 => 2.3981, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -3.72% (0.3867 => 0.3723, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.70% (0.6441 => 0.6203, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.69% (0.3931 => 0.3786, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.66% (0.4321 => 0.4163, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.56% (0.6484 => 0.6253, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -3.55% (0.4248 => 0.4097, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.55% (0.7779 => 0.7503, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.52% (0.9542 => 0.9206, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.05% (0.4813 => 0.4666, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2787, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.29% (1.0544 => 1.0303, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.03% (1.2210 => 1.1962, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.00% (1.2221 => 1.1976, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -1.93% (0.9179 => 0.9002, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.90% (0.7982 => 0.7830, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.80% (0.5999 => 0.5891, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.73% (4.3330 => 4.2580, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.60% (0.7198 => 0.7083, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.60% (0.8521 => 0.8385, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.36% (14.2083 => 14.0157, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.31% (1.2300 => 1.2139, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.29% (1.5610 => 1.5409, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.26% (34.0927 => 33.6622, std.dev.: 0.0262) MultiSource/Applications/siod/siod: -1.22% (2.4021 => 2.3729, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.18% (0.9077 => 0.8970, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.59% (0.1983 => 0.1416, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.37% (1.3643 => 1.0318, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0357, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2087, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1270, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1040, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.64% (4.9100 => 4.3386, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3986, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.17% (7.9763 => 7.7238, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) SingleSource/Benchmarks/Shootout/ary3: -2.60% (3.7241 => 3.6273, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.45% (1.3096 => 1.2775, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.77% (1.6307 => 1.6019, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1967, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8092, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.00% (1.6086 => 1.5925, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 06:59:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 08:59:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114145920.18E282A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7586?compare_to=7583&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7586, Order: 172399, Start Time: 2013-01-14 12:47:39, End Time: 2013-01-14 14:59:23 To: 7583, Order: 172391, Start Time: 2013-01-14 10:05:15, End Time: 2013-01-14 12:17:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.16% (3.1680 => 3.1312, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.95% (0.1332 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0675 => 0.0675, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7854 => 499.8313, std.dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.07% (1.1277 => 499.8313, std.dev.: 0.0149) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.59% (0.5229 => 1.6607, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 20.64% (14.9895 => 18.0827, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 42.41% (14.1553 => 20.1581, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 17.38% (4.1105 => 4.8251, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.93% (1.1048 => 1.7779, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.56% (7.1582 => 38.3362, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.21% (3.4629 => 6.3443, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.50% (0.6222 => 1.0795, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.53% (0.0720 => 7.4459, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11190000.00% (0.0001 => 11.1901, std.dev.: 0.0400) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487200.00% (0.0001 => 5.4873, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.79% (1.1194 => 10.2961, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.92% (22.1758 => 55.4221, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 65.64% (21.9371 => 36.3356, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.69% (7.0540 => 11.0526, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.68% (2.9384 => 4.6038, std.dev.: 0.0062) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 50.76% (0.1056 => 0.1592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.31% (1.5859 => 2.3837, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/IntMM: 49.49% (0.0394 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.09% (8.1363 => 12.1308, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 40.96% (0.0730 => 0.1029, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.64% (2.2024 => 3.0974, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 38.82% (0.3109 => 0.4316, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0001) SingleSource/UnitTests/vla: 35.77% (0.0355 => 0.0482, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.62% (1.5415 => 2.0752, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.12% (4.2646 => 5.7197, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.20% (0.4615 => 0.6147, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 31.45% (0.0814 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 31.15% (0.1175 => 0.1541, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.68% (0.2271 => 0.2945, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 29.51% (1.1642 => 1.5077, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/05-eks/eks: 29.45% (0.4299 => 0.5565, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.33% (0.1892 => 0.2447, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.26% (0.2700 => 0.3490, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.57% (0.6675 => 0.8582, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 26.98% (0.0719 => 0.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.82% (0.5105 => 0.6474, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.59% (0.2554 => 0.3233, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 26.32% (9.4845 => 11.9810, std.dev.: 0.0076) SingleSource/Benchmarks/Stanford/Oscar: 26.10% (0.0636 => 0.0802, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.51% (0.1584 => 0.1988, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 25.43% (1.0722 => 1.3449, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.07% (0.0746 => 0.0933) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.02% (3.8922 => 4.8659, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.22% (0.0479 => 0.0595, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.13% (1.4186 => 1.7609, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.92% (0.1906 => 0.2362, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 23.29% (0.4289 => 0.5288, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.24% (0.1566 => 0.1930, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.94% (0.3121 => 0.3837, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 22.38% (0.1555 => 0.1903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.88% (0.4620 => 0.5631, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.77% (0.1695 => 0.2064, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 21.71% (0.7115 => 0.8660, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 21.65% (5.7591 => 7.0061, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.38% (4.9449 => 6.0022, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.98% (0.0672 => 0.0813, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.74% (0.7835 => 0.9460, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 20.66% (3.3354 => 4.0244, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.57% (5.0018 => 6.0305, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.51% (1.3050 => 1.5726, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 20.50% (0.3098 => 0.3733, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 20.43% (10.3673 => 12.4855, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.41% (0.1940 => 0.2336, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.66% (0.1236 => 0.1479, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.59% (0.0730 => 0.0873, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.45% (0.5860 => 0.7000, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.44% (0.1029 => 0.1229, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.43% (0.1163 => 0.1389, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.41% (0.0675 => 0.0806, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.24% (0.8172 => 0.9744, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/messages-2: 19.18% (0.0662 => 0.0789, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.16% (0.1143 => 0.1362, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.04% (0.6456 => 0.7685, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 18.07% (0.1151 => 0.1359, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.65% (0.3423 => 0.4027, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.63% (0.5020 => 0.5905, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 17.37% (3.8723 => 4.5449, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.22% (0.2758 => 0.3233, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 17.09% (1.1840 => 1.3863, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.05% (0.3307 => 0.3871, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.5569 => 0.6515, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.83% (0.9765 => 1.1408, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 16.68% (0.7433 => 0.8673, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0017) MultiSource/Applications/treecc/treecc: 16.53% (2.0273 => 2.3624, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.30% (0.5981 => 0.6956, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.6450 => 0.7492, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 16.14% (0.0818 => 0.0950, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.00% (0.8101 => 0.9397, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 15.75% (0.3180 => 0.3681, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.53% (2.2969 => 2.6537, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 15.50% (0.3387 => 0.3912, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.29% (0.3441 => 0.3967, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.06% (0.8067 => 0.9282, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.04% (0.1044 => 0.1201, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 14.99% (0.0834 => 0.0959, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.97% (1.1861 => 1.3636, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 14.68% (0.3283 => 0.3765, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.8921 => 1.0198, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.26% (0.3232 => 0.3693, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.70% (0.0759 => 0.0863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.38% (0.3379 => 0.3831, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.22% (1.5603 => 1.7665, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.18% (0.2603 => 0.2946, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 12.85% (17.1811 => 19.3882, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.32% (0.4636 => 0.5207, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.31% (14.3668 => 16.1349, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/parameter-passing: 12.12% (0.3927 => 0.4403, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.82% (0.3865 => 0.4322, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 11.58% (0.3092 => 0.3450, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.42% (0.3828 => 0.4265, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3427 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.12% (0.3543 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4203 => 0.4653, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.62% (0.2430 => 0.2688, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.60% (0.4103 => 0.4538, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.38% (0.4048 => 0.4468, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 10.29% (0.3422 => 0.3774, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.99% (0.3603 => 0.3963, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1268 => 0.1392, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3826 => 0.4198, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.72% (0.3684 => 0.4042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.74% (0.4064 => 0.4419, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.68% (63.2438 => 68.7310, std.dev.: 0.0196) SingleSource/UnitTests/ObjC++/Hello: 8.68% (0.5925 => 0.6439, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7326 => 0.7937, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 8.08% (0.2871 => 0.3103, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.82% (2.0665 => 2.2281, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 7.41% (1.2842 => 1.3793, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.34% (0.3650 => 0.3918, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.29% (0.2756 => 0.2957, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.19% (0.3935 => 0.4218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 7.16% (0.2905 => 0.3113, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 7.08% (0.2725 => 0.2918, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 6.85% (0.2714 => 0.2900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.85% (0.2891 => 0.3089, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.73% (7.9617 => 8.4974, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.63% (2.2022 => 2.3482, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 6.53% (0.2802 => 0.2985, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.52% (0.3052 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.41% (0.3136 => 0.3337, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.34% (0.2793 => 0.2970, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.69% (0.2266 => 0.2395, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.60% (0.3177 => 0.3355, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2395, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.92% (2.8904 => 3.1483, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4645, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3143, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.84% (0.9957 => 1.0339, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9228, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.36% (3.6395 => 3.7255, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.01% (9.1159 => 9.2993, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2773, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4569, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.35% (5.2763 => 1.1952, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.60% (0.8651 => 0.2111, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.59% (0.1622 => 0.0915, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.39% (5.3855 => 4.4489, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.97% (5.3526 => 4.4440, std.dev.: 0.0043) MultiSource/Applications/JM/ldecod/ldecod: -11.38% (10.4361 => 9.2489, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.52% (1.7609 => 1.6109, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -7.66% (54.1659 => 50.0141, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.81% (1.9577 => 0.6694, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.77% (1.5373 => 1.0182, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.78% (10.7105 => 7.4142, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8622, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7347, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4945, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2847, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.16% (1.2373 => 1.1611, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.13% (8.1563 => 7.7382, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.24% (10.2830 => 9.8475, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.84% (3.6994 => 3.6315, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.66% (3.7221 => 3.6602, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2346, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.55% (0.1485 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0010) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 07:23:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 09:23:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114152324.4F7722A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7587?compare_to=7584&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7587, Order: 172400, Start Time: 2013-01-14 13:20:54, End Time: 2013-01-14 15:23:30 To: 7584, Order: 172391, Start Time: 2013-01-14 11:01:47, End Time: 2013-01-14 13:02:54 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (8 on baseline) Performance Improvements: 12 (50 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (1005 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.29% (0.8914 => 1.0188, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.98% (0.9534 => 1.0009, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.91% (0.8638 => 0.8976, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.88% (4.8010 => 4.9872, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.80% (1.0459 => 1.0856, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.69% (14.7035 => 15.2462, std.dev.: 0.1149) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.65% (0.8748 => 0.9067, std.dev.: 0.0123) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 9.91% (1.7404 => 1.9128, std.dev.: 0.0276) SingleSource/Benchmarks/Linpack/linpack-pc: 6.92% (47.5689 => 50.8615, std.dev.: 1.0978) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Queens: -33.33% (0.0624 => 0.0416, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -13.53% (0.2224 => 0.1923, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: -11.65% (0.0910 => 0.0804, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Puzzle: -11.15% (0.1211 => 0.1076, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: -6.85% (0.2249 => 0.2095, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/oourafft: -4.39% (0.2302 => 0.2201, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.37% (0.9335 => 0.8927, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/bigfib: -1.67% (0.6518 => 0.6409, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: -25.91% (0.0413 => 0.0306, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.77% (5.9604 => 4.6033, std.dev.: 0.3218) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.95% (1.1266 => 1.0708, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.74% (3.6241 => 3.5610, std.dev.: 0.0201) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.06% (1.1139 => 1.1132, std.dev.: 0.2491) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0314 => 0.0314, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.89% (0.0393 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0204 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 16.49% (0.0188 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0254 => 0.0252, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: 1300.00% (0.0001 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1429 => 0.1428, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -0.24% (1.2113 => 1.2084, std.dev.: 0.2750) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.05% (0.3974 => 0.3972, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.77% (0.1429 => 0.1418, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.10% (0.0951 => 0.0990, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.80% (0.0556 => 0.0566, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.26% (1.1524 => 1.1494, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -27.59% (0.0029 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0611 => 0.0609, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.77% (0.0285 => 0.0310, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7401 => 0.7400, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 106.78% (0.0059 => 0.0122, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.30% (12.7844 => 12.7462, std.dev.: 0.0891) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.39% (0.9588 => 1.0009, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.75% (0.8736 => 0.8976, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.98% (4.8904 => 4.9872, std.dev.: 0.0328) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322012.50% (0.0008 => 2.5769, std.dev.: 0.0582) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.05% (1.1825 => 2.4247, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.87% (0.2562 => 0.2866, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 5.55% (1.8123 => 1.9128, std.dev.: 0.0276) MultiSource/Applications/JM/lencod/lencod: 3.44% (6.8159 => 7.0505, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.87% (0.0808 => 0.0502, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: -25.85% (0.1888 => 0.1400, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.56% (0.0862 => 0.0702, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.34% (0.1009 => 0.0834, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -17.10% (1.8964 => 1.5721, std.dev.: 0.0853) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.96% (0.7686 => 0.6459, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.07% (1.0986 => 0.9330, std.dev.: 0.0342) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.27% (0.1079 => 0.0925, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.63% (0.0847 => 0.0740, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -12.24% (1.1433 => 1.0034, std.dev.: 0.0503) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.98% (0.4074 => 0.3586, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.36% (0.0889 => 0.0788, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.33% (6.4235 => 5.6956, std.dev.: 0.2563) MultiSource/Applications/Burg/burg: -9.91% (1.5979 => 1.4395, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.64% (1.5131 => 1.3672, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.61% (0.7693 => 0.6954, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.79% (0.6885 => 0.6280, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.38% (1.1498 => 1.0534, std.dev.: 0.0226) MultiSource/Applications/treecc/treecc: -8.30% (2.4719 => 2.2667, std.dev.: 0.0633) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.82% (10.2703 => 9.4671, std.dev.: 0.2820) MultiSource/Applications/sgefa/sgefa: -7.37% (0.3598 => 0.3333, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.29% (1.6874 => 1.5644, std.dev.: 0.0312) SingleSource/Benchmarks/Shootout-C++/hello: -7.16% (0.1928 => 0.1790, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/moments: -6.97% (0.4002 => 0.3723, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.89% (0.9588 => 0.8927, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/matrix: -6.42% (0.2385 => 0.2232, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -6.30% (17.4365 => 16.3388, std.dev.: 0.2509) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.14% (0.2100 => 0.1971, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.13% (0.2283 => 0.2143, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: -5.64% (0.2551 => 0.2407, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.02% (1.0234 => 0.9720, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/methcall: -4.78% (0.2135 => 0.2033, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: -4.50% (0.6711 => 0.6409, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.12% (5.0381 => 4.8305, std.dev.: 0.0434) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.04% (1.2680 => 1.2294, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.03% (1.3220 => 1.2819, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.90% (0.9372 => 0.6570, std.dev.: 0.0699) MultiSource/Benchmarks/Ptrdist/ft/ft: -18.77% (1.0816 => 0.8786, std.dev.: 0.0215) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: -8.76% (4.5259 => 4.1295, std.dev.: 0.1350) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.56% (1.4588 => 1.3339, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/health/health: -6.13% (0.3654 => 0.3430, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.01% (23.3986 => 21.9920, std.dev.: 0.2396) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.81% (0.3349 => 0.3188, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.07% (1.4446 => 1.3858, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists: -2.63% (17.2182 => 16.7654, std.dev.: 0.0678) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.40% (0.5826 => 0.5686, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: -2.25% (2.8571 => 2.7929, std.dev.: 0.0234) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.59% (61.0379 => 60.0650, std.dev.: 0.3256) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0012) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.60% (1.2047 => 1.1132, std.dev.: 0.2491) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.76% (0.0451 => 0.0425, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.99% (0.0394 => 0.0331, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.27% (0.0328 => 0.0314, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.72% (0.0445 => 0.0424, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.67% (0.1530 => 0.1428, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -37.37% (1.9293 => 1.2084, std.dev.: 0.2750) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.90% (0.4049 => 0.3972, std.dev.: 0.0298) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.09% (0.1510 => 0.1418, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.23% (0.0978 => 0.0990, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.07% (0.0590 => 0.0566, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.06% (1.1617 => 1.1494, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -34.38% (0.0032 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.67% (0.0268 => 0.0310, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7437 => 0.7400, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7781 => 12.7462, std.dev.: 0.0891) Report Time: 0.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 07:35:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 09:35:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114153542.616D42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7588?compare_to=7585&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7588, Order: 172404, Start Time: 2013-01-14 14:01:37, End Time: 2013-01-14 15:35:46 To: 7585, Order: 172399, Start Time: 2013-01-14 12:04:00, End Time: 2013-01-14 13:38:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.75% (0.6800 => 0.7123, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.99% (0.0717 => 0.1183, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.62% (0.0974 => 0.1545, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.20% (0.1500 => 0.2178, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.89% (0.6395 => 0.8754, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.15% (0.6395 => 0.8643, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.13% (0.6260 => 0.8334, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.12% (0.5688 => 0.7515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.91% (0.5456 => 0.7197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.85% (0.5805 => 0.7654, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.30% (0.6230 => 0.8180, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.07% (0.5575 => 0.7307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.98% (0.5581 => 0.7310, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.70% (0.5567 => 0.7276, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.35% (0.5802 => 0.7563, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.10% (0.6033 => 0.7849, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.90% (0.5705 => 0.7411, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.77% (0.5859 => 0.7603, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.68% (0.5849 => 0.7585, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.55% (0.5478 => 0.7097, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.34% (0.5570 => 0.7204, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.30% (0.6440 => 0.8327, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.27% (0.5569 => 0.7199, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.11% (0.5925 => 0.7650, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.90% (0.5591 => 0.7207, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.02% (0.6052 => 0.7748, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.95% (0.6189 => 0.7919, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.95% (0.5857 => 0.7494, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.85% (0.5863 => 0.7496, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.71% (0.6676 => 0.8526, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.63% (0.6446 => 0.8227, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.32% (0.6304 => 0.8026, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.31% (1.6474 => 2.0973, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.07% (0.6194 => 0.7809, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.87% (0.6660 => 0.8383, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.82% (0.6297 => 0.7923, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.61% (0.6681 => 0.8392, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.01% (0.6667 => 0.8268, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.03% (0.7524 => 0.9257, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.16% (0.7339 => 0.8965, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.75% (2.2587 => 2.7048, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.13% (0.0622 => 0.0741, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 17.07% (1.1450 => 1.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.27% (0.3357 => 0.3836, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.42% (1.6364 => 1.8396, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.31% (0.1982 => 0.2226, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.55% (4.5069 => 5.0273, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (0.4916 => 0.5475, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 10.59% (0.4515 => 0.4993, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.07% (3.5339 => 3.8897, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 9.03% (9.2283 => 10.0615, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.68% (0.2385 => 0.2592, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.63% (0.7021 => 0.7627, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.21% (1.2515 => 1.3543, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.98% (1.4642 => 1.5664, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.96% (0.5329 => 0.5700, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.65% (0.2001 => 0.2134, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.2784 => 1.3626, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 5.84% (0.4524 => 0.4788, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.14% (0.4861 => 0.5111, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.23% (5.0226 => 5.1850, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.3864 => 1.4304, std.dev.: 0.0058) MultiSource/Applications/d/make_dparser: 2.55% (3.5154 => 3.6051, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (5.4682 => 5.6042, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.32% (22.4056 => 22.9260, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/bigfib: 2.15% (0.6750 => 0.6895, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.73% (0.8418 => 0.8564, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.69% (0.7447 => 0.7573, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 1.56% (15.5079 => 15.7505, std.dev.: 0.0210) MultiSource/Applications/JM/lencod/lencod: 1.22% (16.1920 => 16.3895, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3874, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6779, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4416, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.23% (11.6767 => 12.1701, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.5751 => 56.6657, std.dev.: 0.0450) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.71% (0.6469 => 0.6644, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2861, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6046, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.83% (0.1431 => 0.1319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.23% (0.3194 => 0.2963, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -6.09% (0.3812 => 0.3580, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -6.00% (0.3831 => 0.3601, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -5.98% (0.3848 => 0.3618, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -5.93% (0.3880 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/exceptions: -5.58% (0.4176 => 0.3943, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.48% (0.3884 => 0.3671, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.45% (0.3323 => 0.3142, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -5.07% (0.4199 => 0.3986, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.81% (0.4280 => 0.4074, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.73% (0.9852 => 0.9386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.65% (0.2989 => 0.2850, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.61% (0.3252 => 0.3102, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.61% (1.3148 => 1.2542, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.60% (2.1713 => 2.0715, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.32% (0.2428 => 0.2323, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.4151 => 0.3981, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.95% (0.3621 => 0.3478, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.86% (0.7779 => 0.7479, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.72% (0.3867 => 0.3723, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.68% (2.4924 => 2.4007, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.64% (0.3931 => 0.3788, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -3.58% (0.4248 => 0.4096, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.55% (0.9542 => 0.9203, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.54% (0.4321 => 0.4168, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.52% (0.4427 => 0.4271, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.46% (0.3849 => 0.3716, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.13% (0.4083 => 0.3955, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.05% (0.4813 => 0.4666, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2672, std.dev.: 0.0220) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (1.0544 => 1.0297, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.29% (0.7919 => 0.7738, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.96% (1.2210 => 1.1971, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: -1.94% (0.9179 => 0.9001, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: -1.84% (0.7982 => 0.7835, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.82% (4.3330 => 4.2542, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.82% (1.2221 => 1.1999, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.65% (0.7198 => 0.7079, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.34% (14.2083 => 14.0176, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (1.2300 => 1.2136, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.25% (34.0927 => 33.6665, std.dev.: 0.0297) MultiSource/Applications/siod/siod: -1.22% (2.4021 => 2.3729, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -1.20% (1.5610 => 1.5423, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.65% (1.8100 => 0.7123, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3134, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0259, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7490, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0340, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1313, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7283, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.7241 => 3.6436, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4632, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3040 => 7.1912, std.dev.: 0.0258) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.40% (4.8776 => 4.8094, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.32% (1.6219 => 1.6005, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6104, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0443 => 1.0334, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 08:22:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 10:22:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130114162259.23AD42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7589?compare_to=7575&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7589, Order: 172399, Start Time: 2013-01-14 12:43:58, End Time: 2013-01-14 16:23:02 To: 7575, Order: 172373, Start Time: 2013-01-14 03:00:04, End Time: 2013-01-14 06:35:21 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (178 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.66% (2.3727 => 2.4122, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 1.46% (1.1356 => 1.1522, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.45% (0.7161 => 0.7265, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.23% (12.7124 => 12.8688, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 1.07% (26.9102 => 27.1975, std.dev.: 0.0308) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.63% (116.1894 => 126.2148, std.dev.: 1.9104) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.21% (0.1063 => 0.1416, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.65% (0.2969 => 0.3790, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.94% (0.1106 => 0.1404, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.73% (0.5900 => 0.7477, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.33% (0.4139 => 0.5229, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.56% (0.1620 => 0.2034, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.39% (0.4253 => 0.5333, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.01% (0.4994 => 0.6243, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1021 => 0.1269, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.82% (0.5000 => 0.6191, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 23.54% (0.0599 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.94% (0.1107 => 0.1361, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.79% (0.1549 => 0.1902, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.0948 => 0.1162, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 22.48% (1.5932 => 1.9513, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.60% (0.3903 => 0.4746, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 21.19% (0.0604 => 0.0732, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 20.27% (0.0947 => 0.1139, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 19.46% (0.1218 => 0.1455, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.43% (0.4029 => 0.4812, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.36% (0.1462 => 0.1745, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 19.33% (0.5826 => 0.6952, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.12% (0.1088 => 0.1296, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 19.09% (0.5889 => 0.7013, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.05% (0.3890 => 0.4631, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.68% (0.2736 => 0.3247, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.67% (0.2866 => 0.3401, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.53% (1.3152 => 1.5589, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 18.14% (0.5546 => 0.6552, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.10% (0.3271 => 0.3863, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 18.02% (0.9697 => 1.1444, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 17.99% (0.7171 => 0.8461, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 17.82% (1.8794 => 2.2144, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.69% (0.4658 => 0.5482, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.23% (3.5627 => 4.1765, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.22% (0.2875 => 0.3370, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.12% (0.1968 => 0.2305, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.04% (1.6211 => 1.8974, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.04% (0.2911 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.87% (0.2738 => 0.3200, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 16.76% (0.2823 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.73% (0.2750 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 16.70% (0.2803 => 0.3271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.68% (0.2811 => 0.3280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.68% (2.0673 => 2.4122, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 16.67% (0.2813 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.62% (0.2725 => 0.3178, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.62% (0.2792 => 0.3256, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 16.59% (0.1284 => 0.1497, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hello: 16.58% (0.2714 => 0.3164, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.57% (0.3060 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.56% (0.2729 => 0.3181, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.46% (0.3195 => 0.3721, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.44% (0.3004 => 0.3498, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.41% (0.5026 => 0.5851, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 16.33% (0.2780 => 0.3234, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.28% (0.9909 => 1.1522, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.23% (0.4361 => 0.5069, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.20% (4.4195 => 5.1354, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.16% (1.9694 => 2.2877, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/wc: 16.09% (0.3096 => 0.3594, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.00% (1.0781 => 1.2506, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.98% (0.3930 => 0.4558, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 15.98% (0.3267 => 0.3789, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.93% (0.3258 => 0.3777, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.92% (0.3317 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.79% (1.9966 => 2.3119, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 15.63% (23.5202 => 27.1975, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.52% (0.3124 => 0.3609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.48% (0.3488 => 0.4028, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.47% (0.3362 => 0.3882, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.30% (2.7292 => 3.1468, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.20% (0.3282 => 0.3781, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 15.20% (0.3348 => 0.3857, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: 15.19% (0.3477 => 0.4005, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 15.14% (0.3678 => 0.4235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.12% (0.4146 => 0.4773, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.11% (0.3845 => 0.4426, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 15.11% (0.3726 => 0.4289, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 15.09% (4.2109 => 4.8462, std.dev.: 0.0130) SingleSource/UnitTests/ObjC/exceptions-3: 14.86% (0.3460 => 0.3974, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.82% (0.3442 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.82% (0.3496 => 0.4014, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.79% (0.3625 => 0.4161, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.71% (0.3446 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.58% (0.4251 => 0.4871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.55% (0.3690 => 0.4227, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 14.52% (1.4269 => 1.6341, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.52% (0.3981 => 0.4559, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.25% (0.3643 => 0.4162, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.19% (0.2566 => 0.2930, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.13% (0.1090 => 0.1244, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.02% (0.3724 => 0.4246, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.85% (0.7875 => 0.8966, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 13.85% (0.5012 => 0.5706, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.90% (0.6435 => 0.7265, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 12.52% (2.1653 => 2.4365, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: 12.23% (5.5417 => 6.2195, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 12.19% (0.2691 => 0.3019, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 12.10% (4.6177 => 5.1763, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.06% (0.2737 => 0.3067, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 11.94% (2.1013 => 2.3521, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: 11.66% (0.2075 => 0.2317, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.56% (0.2068 => 0.2307, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.32% (0.3084 => 0.3433, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.76% (0.5361 => 0.5938, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 10.70% (0.6634 => 0.7344, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.70% (0.2103 => 0.2328, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 10.61% (0.3336 => 0.3690, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.56% (11.6398 => 12.8688, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 10.01% (0.4847 => 0.5332, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.67% (0.7426 => 0.8144, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.46% (0.2040 => 0.2233, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.33% (0.1383 => 0.1512, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.32% (4.6926 => 5.1301, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 7.99% (0.2391 => 0.2582, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.84% (0.5584 => 0.6022, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 7.62% (2.0346 => 2.1896, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 7.07% (11.9555 => 12.8005, std.dev.: 0.0266) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5202, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3693 => 0.4092, std.dev.: 0.0076) MultiSource/Applications/ClamAV/clamscan: 8.85% (0.2802 => 0.3050, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2414, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6866, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8883, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2072, std.dev.: 0.0523) MultiSource/Applications/viterbi/viterbi: 1.49% (46.6247 => 47.3197, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.40% (1.0142 => 1.0284, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0806, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2085, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4805, std.dev.: 0.0041) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5913, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5592, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.42% (17.2379 => 14.2352, std.dev.: 0.1015) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9759, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7944, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/tsp/tsp: -7.16% (2.1113 => 1.9601, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -5.23% (14.0481 => 13.3127, std.dev.: 0.1910) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.81% (41.7953 => 40.2038, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.52% (11.2080 => 10.8136, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1670, std.dev.: 0.0483) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5765, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1683, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 09:33:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 11:33:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114173330.7D4BF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7590?compare_to=7588&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7590, Order: 172420, Start Time: 2013-01-14 15:59:15, End Time: 2013-01-14 17:33:34 To: 7588, Order: 172404, Start Time: 2013-01-14 14:01:37, End Time: 2013-01-14 15:35:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 64.85% (0.0717 => 0.1182, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.73% (0.0974 => 0.1546, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.97% (0.6395 => 0.8759, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.14% (0.6395 => 0.8642, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.23% (0.6260 => 0.8340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.14% (0.5805 => 0.7671, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.03% (0.5688 => 0.7510, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.89% (0.5456 => 0.7196, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.30% (0.6230 => 0.8180, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.00% (0.5575 => 0.7303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.98% (0.5581 => 0.7310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.93% (0.5567 => 0.7289, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.21% (0.5802 => 0.7555, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.02% (0.6033 => 0.7844, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.94% (0.5705 => 0.7413, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.80% (0.5859 => 0.7605, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.65% (0.5478 => 0.7102, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.58% (0.5849 => 0.7579, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.37% (0.5570 => 0.7206, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.30% (0.6440 => 0.8327, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.13% (0.5569 => 0.7191, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.91% (0.5925 => 0.7638, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.89% (0.5591 => 0.7206, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.12% (0.6052 => 0.7754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.03% (0.6189 => 0.7924, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.94% (0.5863 => 0.7501, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.90% (0.5857 => 0.7491, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.74% (0.6446 => 0.8234, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.38% (0.6304 => 0.8030, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.14% (1.6474 => 2.0945, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.22% (0.6194 => 0.7818, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.93% (0.6297 => 0.7930, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.89% (0.6660 => 0.8384, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.59% (0.6681 => 0.8391, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.12% (0.6667 => 0.8275, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.15% (0.7524 => 0.9266, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.94% (0.0693 => 0.0852, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.26% (0.7339 => 0.8973, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.92% (2.2587 => 2.7087, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 17.05% (1.1450 => 1.3402, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3357 => 0.3844, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.82% (0.1982 => 0.2236, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.55% (1.6364 => 1.8417, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.01% (4.5069 => 5.0481, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.57% (0.4916 => 0.5485, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 10.92% (0.4515 => 0.5008, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.22% (3.5339 => 3.8950, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (9.2283 => 10.0556, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2385 => 0.2597, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.72% (0.7021 => 0.7633, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: 8.40% (1.2515 => 1.3566, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.01% (1.4642 => 1.5668, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.00% (0.5329 => 0.5702, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.85% (0.2001 => 0.2138, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.65% (1.2784 => 1.3634, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 6.34% (0.4524 => 0.4811, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4861 => 0.5125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.01% (0.3255 => 0.3418, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 3.23% (5.0226 => 5.1849, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.3864 => 1.4305, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 2.58% (3.5154 => 3.6060, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.40% (5.4682 => 5.5993, std.dev.: 0.0052) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (22.4056 => 22.9279, std.dev.: 0.0163) SingleSource/Benchmarks/Misc-C++/bigfib: 2.21% (0.6750 => 0.6899, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.95% (0.8418 => 0.8582, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 1.58% (0.7447 => 0.7565, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.57% (15.5079 => 15.7517, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3722 => 1.3891, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.13% (16.1920 => 16.3748, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6604, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4424, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5926, std.dev.: 0.0716) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2854, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6035, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -7.04% (0.3194 => 0.2969, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.30% (0.3057 => 0.2895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.29% (0.2871 => 0.2719, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.18% (0.3323 => 0.3151, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hello: -5.12% (0.2849 => 0.2703, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -5.12% (0.3812 => 0.3617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.07% (0.3848 => 0.3653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.06% (0.2903 => 0.2756, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.04% (0.3831 => 0.3638, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.03% (0.3059 => 0.2905, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.02% (0.3821 => 0.3629, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.02% (0.3205 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.01% (0.2933 => 0.2786, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.97% (0.3880 => 0.3687, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.89% (0.3026 => 0.2878, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.88% (0.3891 => 0.3701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.88% (0.3896 => 0.3706, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.87% (0.9852 => 0.9372, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.80% (0.2939 => 0.2798, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/exceptions: -4.74% (0.4176 => 0.3978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.65% (2.1713 => 2.0703, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.55% (0.2989 => 0.2853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.48% (0.3884 => 0.3710, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.43% (0.3252 => 0.3108, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.33% (1.3148 => 1.2579, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.24% (0.4199 => 0.4021, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.4151 => 0.3981, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -3.99% (0.6347 => 0.6094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4280 => 0.4110, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.68% (2.4924 => 2.4006, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.62% (0.6441 => 0.6208, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: -3.57% (0.3867 => 0.3729, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.56% (0.7779 => 0.7502, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.52% (0.9542 => 0.9206, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.46% (0.4427 => 0.4274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.41% (0.3931 => 0.3797, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sieve: -3.41% (0.3788 => 0.3659, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.40% (0.4321 => 0.4174, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.30% (0.4248 => 0.4108, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.29% (0.6484 => 0.6271, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.22% (0.3849 => 0.3725, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.99% (0.4083 => 0.3961, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.64% (0.4813 => 0.4686, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.61% (0.7919 => 0.7712, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2481, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.24% (0.7198 => 0.7037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.15% (1.0544 => 1.0317, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -1.90% (0.7982 => 0.7830, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: -1.85% (4.3330 => 4.2530, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/football/football: -1.83% (0.9179 => 0.9011, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.2210 => 1.1987, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.81% (1.2221 => 1.2000, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.36% (14.2083 => 14.0151, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -1.27% (2.4021 => 2.3715, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.24% (0.8521 => 0.8415, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.18% (1.5610 => 1.5426, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.09% (34.0927 => 33.7203, std.dev.: 0.0176) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.55% (1.8100 => 0.6779, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0360, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.06% (2.5106 => 2.1325, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8591, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3986, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.18% (7.9763 => 7.7226, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.71% (3.7241 => 3.6232, std.dev.: 0.0309) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1973, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.8776 => 4.8086, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 09:41:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 11:41:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114174127.299B02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7591?compare_to=7586&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7591, Order: 172413, Start Time: 2013-01-14 15:29:31, End Time: 2013-01-14 17:41:29 To: 7586, Order: 172399, Start Time: 2013-01-14 12:47:39, End Time: 2013-01-14 14:59:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.11% (10.2961 => 10.4100, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.22% (12.4855 => 12.2078, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.91% (0.1358 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.56% (0.0675 => 0.0651, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8313 => 499.8363, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.52% (1.1277 => 499.8363, std.dev.: 0.0051) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.44% (0.5229 => 1.6599, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 20.56% (14.9895 => 18.0714, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 42.24% (14.1553 => 20.1352, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 17.51% (4.1105 => 4.8303, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.81% (1.1048 => 1.7766, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.84% (7.1582 => 38.3563, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.00% (3.4629 => 6.3372, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.38% (0.6222 => 1.0788, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.61% (0.0720 => 7.4438, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11183300.00% (0.0001 => 11.1834, std.dev.: 0.0400) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850400.00% (0.0001 => 9.8505, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487600.00% (0.0001 => 5.4877, std.dev.: 0.0006) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 829.96% (1.1194 => 10.4100, std.dev.: 0.0066) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.25% (22.1758 => 55.7166, std.dev.: 0.0613) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 89.71% (0.0243 => 0.0461, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453) MultiSource/Applications/JM/lencod/lencod: 64.28% (21.9371 => 36.0385, std.dev.: 0.0114) SingleSource/Regression/C/sumarray: 62.77% (0.0231 => 0.0376, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.13% (7.0540 => 11.0839, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.54% (2.9384 => 4.5998, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/distray/distray: 50.47% (0.1056 => 0.1589, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.33% (1.5859 => 2.3841, std.dev.: 0.0066) SingleSource/Benchmarks/Stanford/IntMM: 49.49% (0.0394 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.30% (8.1363 => 12.1473, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/ary3: 46.55% (0.0232 => 0.0340, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 41.37% (0.0730 => 0.1032, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.51% (2.2024 => 3.0947, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.05% (0.3109 => 0.4323, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.35% (0.1062 => 0.1448, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.80% (1.5415 => 2.0780, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.00% (4.2646 => 5.7146, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.04% (0.4615 => 0.6140, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 31.33% (0.0814 => 0.1069, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.92% (0.1892 => 0.2458, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.55% (0.2271 => 0.2942, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 29.45% (0.1175 => 0.1521, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 29.45% (1.1642 => 1.5070, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.41% (0.2700 => 0.3494, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 28.87% (0.4299 => 0.5540, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.51% (0.6675 => 0.8578, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.48% (0.5105 => 0.6508, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 26.98% (0.0719 => 0.0913) MultiSource/Benchmarks/McCat/08-main/main: 26.62% (0.2554 => 0.3234, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 26.22% (9.4845 => 11.9717, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.20% (0.1584 => 0.1999, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 25.94% (0.0636 => 0.0801, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 25.52% (1.0722 => 1.3458, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.28% (3.8922 => 4.8763, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.80% (0.1125 => 0.1404, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 24.80% (0.0746 => 0.0931) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.72% (0.0793 => 0.0989, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.22% (0.0479 => 0.0595, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.09% (1.4186 => 1.7604, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.02% (0.0886 => 0.1090, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.97% (0.3121 => 0.3838, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.83% (0.1695 => 0.2082, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.81% (0.0675 => 0.0829, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.74% (0.1337 => 0.1641, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 22.31% (0.4289 => 0.5246, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 22.06% (5.7591 => 7.0296, std.dev.: 0.0103) MultiSource/Applications/minisat/minisat: 21.78% (0.7115 => 0.8665, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 21.62% (0.4620 => 0.5619, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.62% (0.0842 => 0.1024, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.42% (4.9449 => 6.0042, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.90% (0.1555 => 0.1880, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.83% (0.0672 => 0.0812, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 20.83% (3.3354 => 4.0301, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.63% (0.7835 => 0.9451, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.54% (5.0018 => 6.0291, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.50% (1.3050 => 1.5725, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 20.30% (0.0660 => 0.0794, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 20.17% (0.3098 => 0.3723, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 19.92% (0.0527 => 0.0632, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.66% (0.1236 => 0.1479, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 19.60% (0.1143 => 0.1367, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.5860 => 0.7008, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.59% (0.0730 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.26% (0.1163 => 0.1387, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.01% (0.6456 => 0.7683, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.97% (0.8172 => 0.9722, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.95% (0.1029 => 0.1224, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/messages-2: 18.73% (0.0662 => 0.0786, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.68% (0.0953 => 0.1131, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 18.57% (0.0614 => 0.0728, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 18.23% (0.3423 => 0.4047, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 18.07% (0.1151 => 0.1359, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.91% (0.5020 => 0.5919, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 17.75% (10.3673 => 12.2078, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/health/health: 17.51% (0.1268 => 0.1490, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.11% (0.5569 => 0.6522, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 17.09% (0.7433 => 0.8703, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.07% (1.1840 => 1.3861, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.01% (0.0770 => 0.0901, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 16.98% (3.8723 => 4.5299, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.93% (0.2758 => 0.3225, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.82% (0.9765 => 1.1407, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.81% (0.3307 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 16.43% (2.0273 => 2.3604, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.10% (0.5981 => 0.6944, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.03% (0.6450 => 0.7484, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/09-vor/vor: 16.01% (0.3180 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.99% (0.8101 => 0.9396, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 15.67% (0.2049 => 0.2370, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 15.65% (0.3387 => 0.3917, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 15.55% (2.2969 => 2.6540, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.23% (0.3441 => 0.3965, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.04% (0.1044 => 0.1201, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.83% (1.1861 => 1.3620, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.74% (0.8067 => 0.9256, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary3: 14.47% (0.3283 => 0.3758, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.26% (0.8921 => 1.0193, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 13.92% (0.3232 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.83% (0.0759 => 0.0864, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.29% (0.2603 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.14% (0.3379 => 0.3823, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 12.90% (17.1811 => 19.3982, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 12.89% (1.5603 => 1.7615, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.31% (14.3668 => 16.1358, std.dev.: 0.0116) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.78% (0.4636 => 0.5182, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 11.64% (0.3092 => 0.3452, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.51% (0.3865 => 0.4310, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 11.21% (0.3282 => 0.3650, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3427 => 0.3808, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.75% (0.4203 => 0.4655, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.74% (0.2430 => 0.2691, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.36% (0.4103 => 0.4528, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.32% (0.3886 => 0.4287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.15% (0.4048 => 0.4459, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3422 => 0.3764, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/exceptions: 9.87% (0.3828 => 0.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.60% (0.3603 => 0.3949, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 9.60% (0.3543 => 0.3883, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.58% (0.3694 => 0.4048, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.49% (0.3561 => 0.3899, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 9.47% (0.3684 => 0.4033, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3543 => 0.3878, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3497 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.38% (0.1268 => 0.1387, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.30% (0.3826 => 0.4182, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 9.04% (63.2438 => 68.9634, std.dev.: 0.0663) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.61% (0.4064 => 0.4414, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.99% (0.2905 => 0.3137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.91% (0.2831 => 0.3055, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.79% (0.7326 => 0.7897, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.77% (0.4879 => 0.5258, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: 7.73% (0.2871 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.52% (2.0665 => 2.2220, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: 7.20% (1.2842 => 1.3767, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: 7.19% (0.2877 => 0.3084, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.10% (0.3650 => 0.3909, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.99% (0.3935 => 0.4210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.89% (0.2756 => 0.2946, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.74% (2.2022 => 2.3507, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981) SingleSource/Benchmarks/Shootout-C++/fibo: 6.72% (0.2725 => 0.2908, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.52% (7.9617 => 8.4812, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.50% (0.2891 => 0.3079, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 6.16% (0.3052 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.14% (0.2802 => 0.2974, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.90% (0.3136 => 0.3321, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.83% (0.2266 => 0.2398, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.70% (0.3177 => 0.3358, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2570, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (1.1145 => 1.2948) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4274, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4503, std.dev.: 0.0125) SingleSource/Regression/C/uint64_to_float: 5.02% (0.5413 => 0.5685, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1069, std.dev.: 0.0191) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.90% (0.9957 => 1.0246, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9123, std.dev.: 0.0109) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.25% (3.6395 => 3.7215, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.15% (1.0313 => 1.0535, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2919, std.dev.: 0.0075) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2785, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5775, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.28% (5.2763 => 1.1988, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/salsa20: -75.21% (0.8651 => 0.2145) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.89% (5.3855 => 4.4761, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.54% (5.3526 => 4.4674, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: -11.19% (10.4361 => 9.2686, std.dev.: 0.0132) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.34% (1.7609 => 1.6140, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9560, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.65% (1.9577 => 0.6529, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3048, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.45% (1.5373 => 1.0230, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -30.81% (10.7105 => 7.4111, std.dev.: 0.0318) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8625, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0068, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0904, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.18% (0.2161 => 0.1725, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9126, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2799, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/McGill/chomp: -5.86% (1.2373 => 1.1648, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.85% (8.1563 => 7.7604, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.45% (0.4808 => 0.4594, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8413, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.78% (3.7221 => 3.6559, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.69% (3.6994 => 3.6369, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3306, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2269, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8579, std.dev.: 0.0154) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0022) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 09:42:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 11:42:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114174245.DA5D82A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7592?compare_to=7587&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7592, Order: 172420, Start Time: 2013-01-14 15:40:43, End Time: 2013-01-14 17:42:52 To: 7587, Order: 172400, Start Time: 2013-01-14 13:20:54, End Time: 2013-01-14 15:23:30 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 19 (15 on baseline) Performance Improvements: 9 (48 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1035 (1000 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 7.83% (44.4239 => 47.9019, std.dev.: 0.3843) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.15% (1.6894 => 1.8102, std.dev.: 0.0289) MultiSource/Benchmarks/Bullet/bullet: 6.27% (33.4272 => 35.5246, std.dev.: 0.1528) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.91% (0.8749 => 0.9179, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: 2.69% (2.6647 => 2.7365, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 10.18% (9.2292 => 10.1691, std.dev.: 0.2836) MultiSource/Benchmarks/Bullet/bullet: 6.01% (7.1023 => 7.5295, std.dev.: 0.0307) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 5.50% (4.7634 => 5.0254, std.dev.: 0.0501) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.02% (1.2184 => 1.2552, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 2.96% (1.0043 => 1.0340, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.65% (60.0650 => 61.6588, std.dev.: 0.5329) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.65% (41.3649 => 42.4618, std.dev.: 0.3854) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.61% (3.7351 => 3.8325, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.60% (8.5092 => 8.7305, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 2.21% (8.6656 => 8.8573, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.16% (4.3498 => 4.4437, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.60% (4.2483 => 4.3161, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.46% (1.4491 => 1.4702, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/pi: 1.02% (2.1892 => 2.2115, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.14% (1.0188 => 0.9155, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.61% (1.0856 => 1.0464, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.53% (1.0009 => 0.9656, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.43% (0.8909 => 0.8603, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.05% (0.9179 => 0.8899, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: -2.74% (2.2667 => 2.2046, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.69% (0.9888 => 0.9721, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -2.28% (2.6436 => 2.5834, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.95% (4.3681 => 4.2829, std.dev.: 0.0299) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.18% (1.1132 => 1.1263, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.71% (0.0425 => 0.0428, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.51% (0.0331 => 0.0336, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.96% (0.0314 => 0.0317, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.18% (0.0424 => 0.0429, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.73% (0.0252 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.31% (0.1428 => 0.1461, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: -4.01% (1.2084 => 1.1600, std.dev.: 0.2033) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.3972 => 0.3972, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.95% (0.1418 => 0.1474, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.0990 => 0.0973, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.83% (0.0566 => 0.0582, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.1494 => 1.1513, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 42.86% (0.0021 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0609 => 0.0610, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.90% (0.0310 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7400 => 0.7410, std.dev.: 0.0204) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.26% (0.0122 => 0.0068, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.27% (12.7462 => 12.7812, std.dev.: 0.0606) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 8.49% (44.1538 => 47.9019, std.dev.: 0.3843) MultiSource/Benchmarks/Bullet/bullet: 6.86% (33.2440 => 35.5246, std.dev.: 0.1528) MultiSource/Benchmarks/PAQ8p/paq8p: 6.18% (2.5772 => 2.7365, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.95% (1.0867 => 1.1296, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319187.50% (0.0008 => 2.5543, std.dev.: 0.0166) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 87.59% (1.1825 => 2.2182, std.dev.: 0.1790) MultiSource/Benchmarks/7zip/7zip-benchmark: 12.89% (9.0082 => 10.1691, std.dev.: 0.2836) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.51% (0.2562 => 0.2857, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 4.52% (7.2040 => 7.5295, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/pi: 3.39% (2.1390 => 2.2115, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.79% (4.1668 => 4.2829, std.dev.: 0.0299) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.07% (1.2298 => 1.2552, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.76% (3.7662 => 3.8325, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.37% (1.4504 => 1.4702, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.34% (4.3851 => 4.4437, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: -27.44% (0.1888 => 0.1370, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.88% (0.1684 => 0.1265, std.dev.: 0.0098) MultiSource/Applications/hbd/hbd: -19.72% (1.8964 => 1.5225, std.dev.: 0.1040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.87% (0.0862 => 0.0708, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.87% (0.1079 => 0.0897, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.75% (0.1009 => 0.0840, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.59% (0.7686 => 0.6488, std.dev.: 0.0279) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.35% (0.4074 => 0.3530, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: -12.05% (1.0220 => 0.8989, std.dev.: 0.0395) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.62% (1.2154 => 1.0742, std.dev.: 0.0079) MultiSource/Applications/aha/aha: -11.54% (0.1378 => 0.1219, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.32% (0.1210 => 0.1073, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.31% (6.4235 => 5.6970, std.dev.: 0.2815) MultiSource/Applications/hexxagon/hexxagon: -11.24% (1.1433 => 1.0148, std.dev.: 0.0397) MultiSource/Applications/Burg/burg: -11.20% (1.5979 => 1.4190, std.dev.: 0.0493) MultiSource/Applications/treecc/treecc: -10.81% (2.4719 => 2.2046, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.46% (1.5131 => 1.3549, std.dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.05% (0.9124 => 0.8207, std.dev.: 0.0181) MultiSource/Applications/lua/lua: -9.79% (4.6406 => 4.1864, std.dev.: 0.0517) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.25% (1.6874 => 1.5313, std.dev.: 0.0518) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.18% (1.1498 => 1.0443, std.dev.: 0.0218) MultiSource/Applications/siod/siod: -9.03% (2.6437 => 2.4050, std.dev.: 0.0623) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.12% (1.1731 => 1.0778, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.08% (0.6885 => 0.6329, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.55% (10.2703 => 9.4954, std.dev.: 0.2793) SingleSource/Benchmarks/Shootout-C++/fibo: -7.08% (0.2006 => 0.1864, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.82% (0.9550 => 0.8899, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/matrix: -6.67% (0.2385 => 0.2226, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.98% (0.3462 => 0.3255, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.68% (0.2709 => 0.2555, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.29% (0.3665 => 0.3471, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wc: -4.38% (0.2305 => 0.2204, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -4.25% (0.2564 => 0.2455, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.65% (1.0860 => 1.0464, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.64% (0.9507 => 0.9161, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.72% (0.9993 => 0.9721, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -30.07% (4.4739 => 3.1285, std.dev.: 0.2935) MultiSource/Applications/minisat/minisat: -22.65% (7.9891 => 6.1793, std.dev.: 0.3129) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -10.74% (4.5259 => 4.0396, std.dev.: 0.1023) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: -6.23% (2.2304 => 2.0914, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.64% (1.4446 => 1.3776, std.dev.: 0.0251) SingleSource/Benchmarks/Shootout-C++/lists: -2.64% (17.2182 => 16.7628, std.dev.: 0.0715) SingleSource/Benchmarks/Misc/mandel-2: -2.48% (0.8521 => 0.8310, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: -1.96% (2.8571 => 2.8011, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.51% (3.3596 => 3.3089, std.dev.: 0.0092) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.51% (1.2047 => 1.1263, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0099) MultiSource/Applications/lemon/lemon: -39.87% (1.9293 => 1.1600, std.dev.: 0.2033) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.90% (0.4049 => 0.3972, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.38% (0.1510 => 0.1474, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.51% (0.0978 => 0.0973, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.36% (0.0590 => 0.0582, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1617 => 1.1513, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7437 => 0.7410, std.dev.: 0.0204) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.09% (0.0092 => 0.0068, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7781 => 12.7812, std.dev.: 0.0606) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 11:31:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 13:31:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114193121.E63CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7593?compare_to=7590&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7593, Order: 172437, Start Time: 2013-01-14 17:57:05, End Time: 2013-01-14 19:31:26 To: 7590, Order: 172420, Start Time: 2013-01-14 15:59:15, End Time: 2013-01-14 17:33:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.00% (0.6779 => 0.7050, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.71% (0.0280 => 0.0506, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.55% (0.0717 => 0.1187, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.01% (0.0974 => 0.1578, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.94% (0.0267 => 0.0387) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.44% (0.6395 => 0.8789, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.84% (0.1132 => 0.1549, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.62% (0.6395 => 0.8673, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.66% (0.6260 => 0.8367, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.40% (0.5688 => 0.7531, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.39% (0.5805 => 0.7685, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.04% (0.6230 => 0.8226, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.39% (0.5575 => 0.7325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.26% (0.5567 => 0.7307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.17% (0.5941 => 0.7793, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.82% (0.5802 => 0.7590, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.42% (0.6033 => 0.7868, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.38% (0.5705 => 0.7438, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.09% (0.5849 => 0.7609, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.09% (0.5859 => 0.7622, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.07% (0.5478 => 0.7125, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.77% (0.5569 => 0.7227, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.77% (0.5570 => 0.7228, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.70% (0.6440 => 0.8353, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.47% (0.5925 => 0.7671, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.39% (0.5591 => 0.7234, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.47% (0.6052 => 0.7775, std.dev.: 0.0089) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.39% (0.6189 => 0.7946, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.24% (0.5857 => 0.7511, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.23% (0.6446 => 0.8266, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.21% (0.5863 => 0.7517, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.67% (1.6474 => 2.1032, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.78% (0.6194 => 0.7853, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.25% (0.6660 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.24% (0.6681 => 0.8434, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.19% (0.6297 => 0.7946, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.48% (0.6667 => 0.8299, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.54% (0.7524 => 0.9295, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.62% (0.7339 => 0.8999, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.48% (2.2587 => 2.7213, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 17.53% (1.1450 => 1.3457, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3357 => 0.3858, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.94% (1.6364 => 1.8481, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.99% (4.5069 => 5.0473, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.82% (0.4916 => 0.5497, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 11.34% (0.4515 => 0.5027, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.62% (3.5339 => 3.9093, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.39% (0.2385 => 0.2609, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.32% (9.2283 => 10.0882, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.24% (0.7021 => 0.7670, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.50% (1.2515 => 1.3579, std.dev.: 0.0038) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.13% (0.1230 => 0.1330, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.69% (0.5329 => 0.5739, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.39% (1.4642 => 1.5724, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.25% (0.2001 => 0.2146, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.99% (1.2784 => 1.3678, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: 6.65% (0.4524 => 0.4825, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.95% (0.4861 => 0.5150, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.38% (0.3255 => 0.3430, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.47% (1.3864 => 1.4345, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 3.45% (5.0226 => 5.1957, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.14% (5.4682 => 5.6398, std.dev.: 0.0136) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.95% (22.4056 => 23.0663, std.dev.: 0.0229) MultiSource/Applications/d/make_dparser: 2.82% (3.5154 => 3.6146, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 2.79% (0.6750 => 0.6938, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.36% (0.8418 => 0.8617, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 2.12% (0.7447 => 0.7605, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 2.01% (15.5079 => 15.8199, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.3722 => 1.3932, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.50% (0.9557 => 0.9700, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.37% (16.1920 => 16.4146, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.8161 => 4.8720, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6699, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1677, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5650, std.dev.: 0.1082) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2857, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6062, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.24% (79.7170 => 80.7017, std.dev.: 0.3541) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4789, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -6.76% (0.3194 => 0.2978, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.52% (0.3880 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.50% (0.3837 => 0.3626, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.39% (0.3896 => 0.3686, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.20% (0.3057 => 0.2898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.93% (0.2903 => 0.2760, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.87% (0.3205 => 0.3049, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.84% (0.3821 => 0.3636, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.59% (2.1713 => 2.0716, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: -4.53% (0.3026 => 0.2889, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.49% (0.3252 => 0.3106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (0.9852 => 0.9418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.35% (0.4280 => 0.4094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.15% (0.2989 => 0.2865, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -4.14% (1.3148 => 1.2604, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.84% (2.4924 => 2.3966, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.61% (0.4151 => 0.4001, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (0.3621 => 0.3493, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.23% (0.3931 => 0.3804, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.22% (0.9542 => 0.9235, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference-object: -3.21% (0.6441 => 0.6234, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.16% (0.6484 => 0.6279, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.07% (0.4427 => 0.4291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.05% (0.4321 => 0.4189, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: -3.04% (0.3788 => 0.3673, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -2.90% (0.3867 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.83% (0.7779 => 0.7559, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.75% (0.3849 => 0.3743, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.62% (0.4083 => 0.3976, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2687, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.25% (0.7919 => 0.7741, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.00% (0.7198 => 0.7054, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.87% (1.0544 => 1.0347, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.68% (1.2210 => 1.2005, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.61% (1.2221 => 1.2024, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.56% (0.9179 => 0.9036, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: -1.53% (0.7982 => 0.7860, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -1.46% (4.3330 => 4.2699, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.14% (14.2083 => 14.0459, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.05% (1.8100 => 0.7050, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3140, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0281, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7580, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0311, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1297, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.42% (4.7378 => 4.1022, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8588, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.18% (1.3096 => 1.2549, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.07% (7.9763 => 7.7316, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.42% (3.7241 => 3.6340, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4707, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8027, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1958, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.45% (1.6219 => 1.5984, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.38% (1.6307 => 1.6082, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 12:06:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 14:06:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114200644.9D53C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7594?compare_to=7592&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7594, Order: 172437, Start Time: 2013-01-14 18:01:35, End Time: 2013-01-14 20:06:50 To: 7592, Order: 172420, Start Time: 2013-01-14 15:40:43, End Time: 2013-01-14 17:42:52 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 15 (13 on baseline) Performance Improvements: 6 (27 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1042 (1023 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 60.75% (0.1070 => 0.1720, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.17% (4.5332 => 5.0397, std.dev.: 0.1764) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.72% (0.9747 => 1.0402, std.dev.: 0.0174) SingleSource/Benchmarks/McGill/chomp: 5.84% (0.1729 => 0.1830, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.78% (0.9998 => 1.0376, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.39% (1.5313 => 1.5832, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/moments: 2.68% (0.3734 => 0.3834, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 46.49% (3.1541 => 4.6203, std.dev.: 0.1909) SingleSource/Benchmarks/Linpack/linpack-pc: 34.96% (37.7009 => 50.8811, std.dev.: 0.9082) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 29.22% (1.4650 => 1.8931, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/lpbench: 22.44% (4.0802 => 4.9957, std.dev.: 0.0918) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.00% (14.8719 => 17.1021, std.dev.: 0.2093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 7.86% (2.2182 => 2.3925, std.dev.: 0.0163) SingleSource/Benchmarks/Dhrystone/fldry: 4.03% (0.6598 => 0.6864, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.06% (4.7316 => 4.7816, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.88% (0.1397 => 0.1273, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.90% (0.9841 => 0.9162, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.57% (0.9613 => 0.9366, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.44% (1.0200 => 0.9951, std.dev.: 0.0061) MultiSource/Benchmarks/7zip/7zip-benchmark: -2.29% (47.9019 => 46.8043, std.dev.: 0.1921) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.11% (5.0254 => 4.9698, std.dev.: 0.0206) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.29% (1.1263 => 1.1230, std.dev.: 0.1856) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.91% (0.0220 => 0.0222, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0428 => 0.0431, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0336 => 0.0334, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0317 => 0.0317, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0429 => 0.0425, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.57% (0.0230 => 0.0252, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1461 => 0.1452, std.dev.: 0.0321) MultiSource/Applications/lemon/lemon: 3.49% (1.1600 => 1.2005, std.dev.: 0.3818) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.73% (0.3972 => 0.4120, std.dev.: 0.0604) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.99% (0.1474 => 0.1518, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.04% (0.0973 => 0.1022, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.55% (0.0582 => 0.0591, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.1513 => 1.1569, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.52% (0.0319 => 0.0295, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.7410 => 0.7418, std.dev.: 0.0123) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 60.29% (0.0068 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.32% (12.7812 => 12.8215, std.dev.: 0.0304) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 55.94% (0.1103 => 0.1720, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/factor: 49.70% (0.0336 => 0.0503, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 6.40% (9.5202 => 10.1297, std.dev.: 0.2019) MultiSource/Benchmarks/7zip/7zip-benchmark: 6.00% (44.1538 => 46.8043, std.dev.: 0.1921) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.49% (23.5861 => 24.8817, std.dev.: 0.4808) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.78% (0.9998 => 1.0376, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.35% (0.8846 => 0.9054, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323050.00% (0.0008 => 2.5852, std.dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.33% (1.1825 => 2.3925, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.72% (0.2562 => 0.2888, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.16% (4.4540 => 4.9957, std.dev.: 0.0918) SingleSource/Benchmarks/Misc/pi: 3.42% (2.1390 => 2.2122, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.59% (1.8634 => 1.8931, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.37% (0.0808 => 0.0498, std.dev.: 0.0103) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.06% (0.0692 => 0.0484, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -26.59% (0.1888 => 0.1386, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -18.43% (1.8964 => 1.5468, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.90% (0.7686 => 0.6387, std.dev.: 0.0232) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.31% (0.1079 => 0.0903, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -12.36% (1.0220 => 0.8957, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.92% (0.0847 => 0.0746, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.58% (0.3560 => 0.3219, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.15% (1.1498 => 1.0446, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.84% (10.2703 => 9.4646, std.dev.: 0.2073) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.83% (0.6885 => 0.6346, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.40% (0.5746 => 0.5321, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.18% (1.6874 => 1.5832, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.42% (0.3462 => 0.3309, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: -4.20% (0.4002 => 0.3834, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.09% (1.0017 => 0.9607, std.dev.: 0.0145) MultiSource/Applications/d/make_dparser: -4.04% (3.7840 => 3.6312, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.14% (0.9512 => 0.9213, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.66% (1.0119 => 0.9951, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -8.21% (0.3217 => 0.2953, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.46% (23.3986 => 21.8874, std.dev.: 0.5675) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.55% (1.4446 => 1.3788, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.69% (0.5826 => 0.5669, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: -1.89% (2.8571 => 2.8031, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: -1.12% (1.5825 => 1.5647, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.78% (1.2047 => 1.1230, std.dev.: 0.1856) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.49% (0.0445 => 0.0425, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0070) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.10% (0.1530 => 0.1452, std.dev.: 0.0321) MultiSource/Applications/lemon/lemon: -37.78% (1.9293 => 1.2005, std.dev.: 0.3818) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.75% (0.4049 => 0.4120, std.dev.: 0.0604) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.53% (0.1510 => 0.1518, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.50% (0.0978 => 0.1022, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0590 => 0.0591, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.41% (1.1617 => 1.1569, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.07% (0.0268 => 0.0295, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.26% (0.7437 => 0.7418, std.dev.: 0.0123) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.48% (0.0092 => 0.0109, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.34% (12.7781 => 12.8215, std.dev.: 0.0304) Report Time: 0.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 12:23:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 14:23:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114202326.0CBBE2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7595?compare_to=7591&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7595, Order: 172437, Start Time: 2013-01-14 18:11:33, End Time: 2013-01-14 20:23:27 To: 7591, Order: 172413, Start Time: 2013-01-14 15:29:31, End Time: 2013-01-14 17:41:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/lencod/lencod: 2.85% (36.0385 => 37.0644, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: 2.35% (12.2078 => 12.4947, std.dev.: 0.0190) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.77% (0.0651 => 0.0656, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8363 => 499.8416, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.99% (1.1277 => 499.8416, std.dev.: 0.0108) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.82% (0.5229 => 1.6619, std.dev.: 0.0070) MultiSource/Applications/SPASS/SPASS: 20.71% (14.9895 => 18.0935, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 42.68% (14.1553 => 20.1965, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: 17.70% (4.1105 => 4.8380, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.69% (1.1048 => 1.7863, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.95% (7.1582 => 38.5075, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.12% (3.4629 => 6.3414, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.24% (0.6222 => 1.0779, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.28% (0.0720 => 7.4414, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 3835000.00% (0.0001 => 3.8351, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11202800.00% (0.0001 => 11.2029, std.dev.: 0.0241) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486400.00% (0.0001 => 5.4865, std.dev.: 0.0091) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 835.67% (1.1194 => 10.4739, std.dev.: 0.0056) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 150.74% (22.1758 => 55.6044, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/lowercase: 123.44% (0.0256 => 0.0572, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.20% (0.0929 => 0.1767, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.12% (0.0243 => 0.0462, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 71.57% (0.1463 => 0.2510, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 68.96% (21.9371 => 37.0644, std.dev.: 0.0076) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.89% (7.0540 => 11.0668, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.87% (2.9384 => 4.6094, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.19% (1.5859 => 2.3819, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 49.49% (0.0394 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.36% (8.1363 => 12.1520, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 46.55% (0.0232 => 0.0340, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 41.64% (0.0730 => 0.1034, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.32% (2.2024 => 3.0905, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.31% (0.3109 => 0.4331, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.06% (0.1062 => 0.1445, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.06% (0.0355 => 0.0483, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.24% (1.5415 => 2.0693, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.09% (4.2646 => 5.7184, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.57% (0.4615 => 0.6118, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.48% (0.2700 => 0.3523, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.02% (0.1892 => 0.2460, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.77% (0.2271 => 0.2947, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 29.64% (1.1642 => 1.5093, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/tsp/tsp: 29.53% (0.1175 => 0.1522, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 29.15% (0.4299 => 0.5552, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.49% (0.6675 => 0.8577, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.86% (0.5105 => 0.6476, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 26.85% (9.4845 => 12.0315, std.dev.: 0.0034) SingleSource/Benchmarks/Stanford/Oscar: 26.42% (0.0636 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.19% (0.2554 => 0.3223, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.76% (0.1584 => 0.1992, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.74% (0.1655 => 0.2081, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 25.61% (1.0722 => 1.3468, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.17% (3.8922 => 4.8719, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.89% (0.1125 => 0.1405, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 24.84% (0.0479 => 0.0598, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.39% (1.4186 => 1.7646, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.09% (0.0793 => 0.0984, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.56% (0.1906 => 0.2355, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.24% (0.1566 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.13% (0.3121 => 0.3843, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 22.94% (0.4289 => 0.5273, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 22.49% (5.7591 => 7.0542, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 21.88% (0.7115 => 0.8672, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.85% (0.0842 => 0.1026, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.65% (4.9449 => 6.0157, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761) SingleSource/Benchmarks/Shootout-C++/hash2: 21.54% (0.4620 => 0.5615, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 21.32% (0.1163 => 0.1411, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.98% (0.0672 => 0.0813, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 20.92% (3.3354 => 4.0331, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.75% (5.0018 => 6.0397, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.64% (0.1555 => 0.1876, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 20.52% (10.3673 => 12.4947, std.dev.: 0.0190) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.43% (0.0886 => 0.1067, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.37% (0.7835 => 0.9431, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 20.24% (0.3098 => 0.3725, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.23% (1.3050 => 1.5690, std.dev.: 0.0059) SingleSource/UnitTests/2006-12-11-LoadConstants: 20.21% (0.1143 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.14% (0.0730 => 0.0877, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.11% (0.0527 => 0.0633) MultiSource/Benchmarks/Olden/em3d/em3d: 19.76% (0.1695 => 0.2030, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.74% (0.1236 => 0.1480, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/messages-2: 19.64% (0.0662 => 0.0792, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.56% (0.0675 => 0.0807, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.5860 => 0.6991, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 18.95% (0.1029 => 0.1224, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 18.88% (0.6456 => 0.7675, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.55% (0.8172 => 0.9688, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.36% (0.0953 => 0.1128, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 18.25% (0.1151 => 0.1361, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 18.20% (0.3423 => 0.4046, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.2107 => 0.2484, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.80% (0.7433 => 0.8756, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.43% (0.5020 => 0.5895, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.27% (0.0770 => 0.0903, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.26% (1.1840 => 1.3884, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 17.13% (3.8723 => 4.5358, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.08% (0.5569 => 0.6520, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.04% (0.2758 => 0.3228, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 16.98% (0.0648 => 0.0758, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 16.70% (0.9765 => 1.1396, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 16.62% (2.0273 => 2.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.57% (0.3307 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.56% (0.1117 => 0.1302, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 16.38% (0.0818 => 0.0952, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.36% (0.0770 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.14% (0.6450 => 0.7491, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.07% (0.0834 => 0.0968, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 16.06% (0.3387 => 0.3931, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 16.06% (0.2049 => 0.2378, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.05% (0.5981 => 0.6941, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.93% (0.2065 => 0.2394, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 15.73% (2.2969 => 2.6582, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.71% (0.1044 => 0.1208, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.66% (0.8101 => 0.9370, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 15.66% (0.3180 => 0.3678, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.42% (0.8067 => 0.9311, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.23% (0.3441 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.99% (1.1861 => 1.3639, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: 14.46% (0.8921 => 1.0211, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.38% (0.3283 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 13.95% (0.3232 => 0.3683, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 13.90% (0.1144 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.83% (0.0759 => 0.0864, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.06% (1.5603 => 1.7641, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary2: 13.05% (0.3379 => 0.3820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.02% (0.2603 => 0.2942, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 12.98% (17.1811 => 19.4120, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.59% (14.3668 => 16.1761, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 11.71% (0.3092 => 0.3454, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.60% (0.4636 => 0.5174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.46% (0.3865 => 0.4308, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.41% (0.3427 => 0.3818, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.18% (0.3282 => 0.3649, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.80% (0.3927 => 0.4351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.58% (0.4103 => 0.4537, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.53% (0.2430 => 0.2686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.50% (0.3886 => 0.4294, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.42% (0.4203 => 0.4641, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.03% (0.4048 => 0.4454, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 9.86% (0.1268 => 0.1393, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 9.66% (0.3603 => 0.3951, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.58% (0.3684 => 0.4037, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.54% (0.3543 => 0.3881, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.48% (0.3543 => 0.3879, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.38% (0.3497 => 0.3825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.36% (0.3826 => 0.4184, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 9.12% (63.2438 => 69.0101, std.dev.: 0.0430) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.51% (0.4064 => 0.4410, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.41% (0.1438 => 0.1559, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 7.89% (0.6030 => 0.6506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.84% (0.2831 => 0.3053, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5925 => 0.6385, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 7.59% (0.2871 => 0.3089, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 7.44% (0.7326 => 0.7871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.32% (2.0665 => 2.2177, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 7.06% (1.2842 => 1.3749, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2877 => 0.3079, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.99% (0.3650 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.96% (0.3935 => 0.4209, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.93% (7.9617 => 8.5134, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.92% (2.2022 => 2.3546, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.80% (0.3162 => 0.3377, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.62% (0.2793 => 0.2978, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.2756 => 0.2938, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.53% (0.2725 => 0.2903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.48% (0.2714 => 0.2890, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.47% (0.2891 => 0.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.41% (0.2872 => 0.3056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 6.10% (0.2802 => 0.2973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.91% (0.2266 => 0.2400, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.3136 => 0.3320, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.57% (0.3177 => 0.3354, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2563, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2436, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.74% (11.6436 => 12.4281, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.59% (4.2280 => 4.4642, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0141) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.12% (0.9957 => 1.0268, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.50% (8.6802 => 8.8970, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.19% (3.6395 => 3.7191, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.97% (9.1159 => 9.2959, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (1.7254 => 1.7560, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.55% (27.8444 => 28.2771, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5827, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4521, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.21% (5.2763 => 1.2026, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.49% (0.8651 => 0.2120, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4673, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.72% (5.3526 => 4.4578, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -11.11% (10.4361 => 9.2767, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.34% (1.7609 => 1.6140, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -7.60% (54.1659 => 50.0489, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.42% (1.9577 => 0.6379, std.dev.: 0.0206) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4213, std.dev.: 0.0209) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8589, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0062, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7356, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.22% (0.9540 => 0.8565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2770, std.dev.: 0.0907) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.87% (1.8329 => 1.7070, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.73% (1.2373 => 1.1540, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5796, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.04% (1.5835 => 1.5037, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.95% (8.1563 => 7.7529, std.dev.: 0.0159) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8329, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Shootout-C++/ary3: -2.06% (3.7221 => 3.6453, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9551, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3310, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2184, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0016) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 13:28:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 15:28:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130114212837.13E392A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7596?compare_to=7589&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7596, Order: 172426, Start Time: 2013-01-14 17:43:05, End Time: 2013-01-14 21:28:41 To: 7589, Order: 172399, Start Time: 2013-01-14 12:43:58, End Time: 2013-01-14 16:23:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (178 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (760 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 16.42% (0.3526 => 0.4105, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.36% (54.1842 => 54.9219, std.dev.: 0.0728) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.69% (0.2969 => 0.3791, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.67% (0.1106 => 0.1401, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.98% (0.5900 => 0.7433, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.63% (0.4139 => 0.5200, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.16% (0.4253 => 0.5323, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.95% (0.4994 => 0.6240, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.92% (0.0642 => 0.0802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.14% (0.1620 => 0.2011, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.82% (0.5000 => 0.6191, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.47% (0.1549 => 0.1897, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 22.30% (1.5932 => 1.9485, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.26% (0.1604 => 0.1945, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.16% (0.3903 => 0.4729, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 21.03% (0.0604 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654) MultiSource/Benchmarks/McCat/05-eks/eks: 20.82% (0.1619 => 0.1956, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 19.96% (0.0947 => 0.1136, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 19.38% (0.5826 => 0.6955, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.36% (0.2866 => 0.3421, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.29% (0.1462 => 0.1744, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 19.26% (0.4029 => 0.4805, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.21% (0.1088 => 0.1297, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 19.13% (0.1218 => 0.1451, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 18.92% (0.5889 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.82% (0.2736 => 0.3251, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.77% (0.3890 => 0.4620, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.47% (1.3152 => 1.5581, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 18.16% (0.9697 => 1.1458, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.07% (0.3271 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (1.8794 => 2.2189, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 17.98% (0.7171 => 0.8460, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 17.94% (0.5546 => 0.6541, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.58% (0.4658 => 0.5477, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.43% (0.1968 => 0.2311, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.06% (3.5627 => 4.1705, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.91% (1.6211 => 1.8952, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.70% (0.2875 => 0.3355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 16.40% (0.2750 => 0.3201, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.35% (0.2813 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 16.22% (0.2823 => 0.3281, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.21% (0.2911 => 0.3383, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.18% (0.2725 => 0.3166, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.14% (0.2738 => 0.3180, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 16.12% (0.2811 => 0.3264, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.10% (2.0673 => 2.4002, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hello: 16.10% (0.2714 => 0.3151, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.06% (4.4195 => 5.1294, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.98% (0.2729 => 0.3165, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.95% (0.3930 => 0.4557, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.87% (0.3195 => 0.3702, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.71% (0.9909 => 1.1466, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.66% (0.5026 => 0.5813, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 15.64% (0.3267 => 0.3778, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.63% (1.9694 => 2.2773, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 15.62% (0.3258 => 0.3767, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.57% (0.4361 => 0.5040, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 15.57% (0.3096 => 0.3578, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.52% (1.9966 => 2.3065, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 15.39% (1.0781 => 1.2440, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 15.26% (4.2109 => 4.8536, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 15.21% (23.5202 => 27.0973, std.dev.: 0.0293) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.20% (0.3060 => 0.3525, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.18% (2.7292 => 3.1436, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary2: 15.13% (0.3317 => 0.3819, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.05% (0.3362 => 0.3868, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.92% (0.3124 => 0.3590, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.81% (0.3726 => 0.4278, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: 14.78% (0.3348 => 0.3843, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.72% (0.3282 => 0.3765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.65% (0.3678 => 0.4217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.55% (0.3477 => 0.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.45% (0.4146 => 0.4745, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.36% (0.3845 => 0.4397, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 14.29% (1.4269 => 1.6308, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 14.14% (0.4251 => 0.4852, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.10% (0.3469 => 0.3958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.09% (0.3690 => 0.4210, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.08% (0.3488 => 0.3979, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.05% (0.3446 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.00% (0.3465 => 0.3950, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.99% (0.3981 => 0.4538, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 13.91% (0.2566 => 0.2923, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 13.89% (0.3442 => 0.3920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.78% (0.3650 => 0.4153, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.76% (0.1090 => 0.1240, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 13.52% (0.7875 => 0.8940, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 13.47% (0.5012 => 0.5687, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.84% (0.6435 => 0.7261, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 12.41% (2.1653 => 2.4340, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 11.95% (5.5417 => 6.2042, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 11.80% (2.1013 => 2.3492, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 11.78% (0.2691 => 0.3008, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.76% (0.2737 => 0.3059, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 11.71% (4.6177 => 5.1584, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 11.57% (0.2075 => 0.2315, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.46% (0.3498 => 0.3899, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.3084 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.22% (0.2068 => 0.2300, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.80% (0.5361 => 0.5940, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.2103 => 0.2329, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.70% (0.6634 => 0.7344, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 10.64% (0.3336 => 0.3691, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.45% (11.6398 => 12.8557, std.dev.: 0.0073) MultiSource/Benchmarks/PAQ8p/paq8p: 10.01% (0.4847 => 0.5332, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.76% (0.7426 => 0.8151, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.30% (4.6926 => 5.1288, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.17% (0.2040 => 0.2227, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 7.95% (0.2391 => 0.2581, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 7.63% (2.0346 => 2.1899, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 7.45% (0.1383 => 0.1486, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.92% (11.9555 => 12.7832, std.dev.: 0.0203) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3792 => 0.3971, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.80% (29.0505 => 181.5081, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 89.87% (0.2162 => 0.4105, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.61% (0.3693 => 0.4085, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 10.17% (0.2802 => 0.3087, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6749, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2410, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6837, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-2: 4.56% (1.8057 => 1.8880, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 2.93% (0.6276 => 0.6460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1911, std.dev.: 0.0094) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3065, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0805, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5827, std.dev.: 0.0147) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4769, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5902, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.71% (17.2379 => 14.1851, std.dev.: 0.1599) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: -8.12% (0.2402 => 0.2207, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7957, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.32% (14.0481 => 13.4416, std.dev.: 0.0953) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2158, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8110, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1342, std.dev.: 0.0653) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5780, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.06% (105.3826 => 104.2612, std.dev.: 0.0561) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 13:40:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 15:40:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114214025.7D21A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7597?compare_to=7593&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7597, Order: 172454, Start Time: 2013-01-14 20:06:13, End Time: 2013-01-14 21:40:24 To: 7593, Order: 172437, Start Time: 2013-01-14 17:57:05, End Time: 2013-01-14 19:31:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (102 on baseline) Performance Improvements: 0 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.47% (0.4026 => 0.4367, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.88% (1.2549 => 1.2785, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.13% (0.0717 => 0.1184, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.27% (0.1500 => 0.2179, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.03% (0.6395 => 0.8763, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.28% (0.6395 => 0.8651, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.31% (0.6260 => 0.8345, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.27% (0.5805 => 0.7678, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.98% (0.5456 => 0.7201, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.59% (0.6230 => 0.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.10% (0.5575 => 0.7309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.02% (0.5941 => 0.7784, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.97% (0.5567 => 0.7291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.94% (0.5581 => 0.7308, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.25% (0.5802 => 0.7557, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.15% (0.6033 => 0.7852, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.99% (0.5705 => 0.7416, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.87% (0.5859 => 0.7609, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 29.65% (0.5849 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.45% (0.5478 => 0.7091, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.31% (0.5569 => 0.7201, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.26% (0.5570 => 0.7200, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.22% (0.6440 => 0.8322, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.15% (0.5925 => 0.7652, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.85% (0.5591 => 0.7204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.00% (0.6189 => 0.7922, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.97% (0.6052 => 0.7745, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 27.92% (0.5857 => 0.7492, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.90% (0.5863 => 0.7499, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.77% (0.6446 => 0.8236, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.49% (0.6304 => 0.8037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.95% (1.6474 => 2.0913, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.30% (0.6194 => 0.7823, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.90% (0.6297 => 0.7928, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.87% (0.6660 => 0.8383, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.74% (0.6681 => 0.8401, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.10% (0.6667 => 0.8274, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.21% (0.7339 => 0.8969, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.86% (2.2587 => 2.7073, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 17.03% (1.1450 => 1.3400, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.83% (0.1146 => 0.1316, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.42% (0.3357 => 0.3841, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.90% (0.3834 => 0.4367, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.47% (1.6364 => 1.8405, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.41% (0.1982 => 0.2228, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.46% (4.5069 => 5.0232, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.33% (0.4916 => 0.5473, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 10.92% (0.4515 => 0.5008, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.18% (3.5339 => 3.8937, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 8.86% (9.2283 => 10.0455, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.85% (0.2385 => 0.2596, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.65% (0.7021 => 0.7628, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.13% (1.2515 => 1.3533, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.96% (0.5329 => 0.5700, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.73% (1.4642 => 1.5627, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.45% (1.2784 => 1.3608, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 6.23% (0.4524 => 0.4806, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.10% (0.4861 => 0.5109, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 4.73% (0.3255 => 0.3409, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.89% (0.3319 => 0.3448, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.3864 => 1.4346, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.22% (5.0226 => 5.1844, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 2.56% (3.5154 => 3.6054, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.42% (5.4682 => 5.6003, std.dev.: 0.0185) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.19% (22.4056 => 22.8963, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++/bigfib: 1.94% (0.6750 => 0.6881, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.79% (0.8418 => 0.8569, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.61% (0.7447 => 0.7567, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.36% (15.5079 => 15.7187, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3874, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 1.05% (16.1920 => 16.3620, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6648, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.48% (0.9531 => 1.0339, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1700, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5673, std.dev.: 0.0987) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2862, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6030, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.42% (0.3194 => 0.2957, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.12% (0.3837 => 0.3602, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.67% (0.3812 => 0.3596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.66% (0.3323 => 0.3135, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.59% (0.3880 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.57% (0.3896 => 0.3679, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.56% (0.3831 => 0.3618, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.47% (0.3891 => 0.3678, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.43% (0.4033 => 0.3814) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0573, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.18% (0.2933 => 0.2781, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions: -5.15% (0.4176 => 0.3961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.14% (0.3252 => 0.3085, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.05% (0.3884 => 0.3688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.93% (0.3025 => 0.2876, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.86% (0.2428 => 0.2310, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.79% (0.9852 => 0.9380, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.72% (0.2989 => 0.2848, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -4.69% (1.3148 => 1.2531, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/parameter-passing: -4.56% (0.4280 => 0.4085, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.36% (0.4151 => 0.3970, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.20% (0.3621 => 0.3469, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.91% (0.4321 => 0.4152, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.88% (0.3658 => 0.3516, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.82% (0.6441 => 0.6195, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.73% (0.4427 => 0.4262, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.70% (0.6484 => 0.6244, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4003, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.64% (0.3788 => 0.3650, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -3.59% (0.3867 => 0.3728, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.57% (0.7779 => 0.7501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.40% (0.3849 => 0.3718, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.9542 => 0.9229, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.26% (0.4083 => 0.3950, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -3.18% (0.4248 => 0.4113, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.14% (0.4813 => 0.4662, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.88% (0.7919 => 0.7691, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -2.76% (20.7746 => 20.2018, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.31% (1.0544 => 1.0300, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -2.19% (0.7982 => 0.7807, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.92% (4.3330 => 4.2498, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.91% (1.2221 => 1.1987, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (1.2210 => 1.1980, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.85% (0.5999 => 0.5888, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.60% (0.8521 => 0.8385, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -1.53% (2.4021 => 2.3653, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.53% (0.7198 => 0.7088, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -1.33% (1.5610 => 1.5402, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.33% (14.2083 => 14.0197, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.21% (0.9077 => 0.8967, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.53% (1.8100 => 0.6782, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0049) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.25% (1.3643 => 1.0335, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0328, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1275, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3391, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.33% (0.5142 => 0.4662, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7309, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (1.3096 => 1.2785, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6389, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1939, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.42% (4.8776 => 4.8084, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6088, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 14:30:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 16:30:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130114223003.4224A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7598?compare_to=7594&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7598, Order: 172455, Start Time: 2013-01-14 20:25:48, End Time: 2013-01-14 22:30:09 To: 7594, Order: 172437, Start Time: 2013-01-14 18:01:35, End Time: 2013-01-14 20:06:50 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 8 (9 on baseline) Performance Improvements: 15 (27 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1040 (1027 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 8.96% (0.1284 => 0.1399, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.32% (24.8817 => 26.4550, std.dev.: 0.3698) MultiSource/Benchmarks/MallocBench/gs/gs: 3.23% (4.4492 => 4.5929, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.89% (0.6387 => 0.6508, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/flops: 21.35% (7.1408 => 8.6652, std.dev.: 0.1056) SingleSource/Benchmarks/Shootout/hash: 7.56% (4.0871 => 4.3960, std.dev.: 0.0385) MultiSource/Benchmarks/Bullet/bullet: 3.59% (7.2297 => 7.4892, std.dev.: 0.0649) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.39% (4.3805 => 4.4413, std.dev.: 0.0235) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: -37.44% (0.1720 => 0.1076, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.45% (1.0489 => 0.9393, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.71% (5.0397 => 4.6009, std.dev.: 0.1113) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.39% (1.0105 => 0.9661, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.37% (1.0330 => 0.9879, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.74% (1.0402 => 1.0013, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.98% (0.9854 => 0.9560, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.95% (0.9243 => 0.8970, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -10.52% (0.6723 => 0.6016, std.dev.: 0.0267) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.52% (0.6356 => 0.6196, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.35% (1.8931 => 1.8486, std.dev.: 0.0160) MultiSource/Benchmarks/FreeBench/mason/mason: -2.22% (0.5545 => 0.5422, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.57% (1.6058 => 1.5806, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.45% (5.4408 => 5.3617, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.39% (4.0836 => 4.0269, std.dev.: 0.0193) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.13% (1.1230 => 1.1215, std.dev.: 0.1346) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0222 => 0.0220, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0334 => 0.0335, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0317 => 0.0315, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0425 => 0.0423, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0220 => 0.0220, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1452 => 0.1456, std.dev.: 0.0343) MultiSource/Applications/lemon/lemon: 1.96% (1.2005 => 1.2240, std.dev.: 0.1306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.06% (0.4120 => 0.4246, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.37% (0.1518 => 0.1482, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.1022 => 0.0976, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -32.13% (0.0277 => 0.0188, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.02% (0.0591 => 0.0597, std.dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.80% (1.1569 => 1.1477, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -36.67% (0.0030 => 0.0019, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.47% (0.0295 => 0.0320, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7418 => 0.7404, std.dev.: 0.0132) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.01% (0.0109 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.52% (12.8215 => 12.7546, std.dev.: 0.0254) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.60% (0.0336 => 0.0506, std.dev.: 0.0032) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.16% (23.5861 => 26.4550, std.dev.: 0.3698) MultiSource/Benchmarks/Bullet/bullet: 8.52% (33.2440 => 36.0758, std.dev.: 0.9982) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.31% (44.1538 => 47.3794, std.dev.: 1.1766) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321025.00% (0.0008 => 2.5690, std.dev.: 0.0660) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.34% (1.1825 => 2.3572, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.25% (2.2499 => 2.4131, std.dev.: 0.0340) MultiSource/Benchmarks/Bullet/bullet: 3.96% (7.2040 => 7.4892, std.dev.: 0.0649) MultiSource/Benchmarks/mafft/pairlocalalign: 1.14% (63.1520 => 63.8739, std.dev.: 0.0680) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.16% (0.0808 => 0.0532, std.dev.: 0.0042) SingleSource/Benchmarks/SmallPT/smallpt: -26.59% (0.1888 => 0.1386, std.dev.: 0.0131) MultiSource/Benchmarks/BitBench/drop3/drop3: -24.86% (0.0692 => 0.0520, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.91% (0.1009 => 0.0798, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.31% (0.0676 => 0.0559, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.05% (0.1079 => 0.0895, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.33% (0.7686 => 0.6508, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.56% (0.4074 => 0.3481, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.96% (1.5131 => 1.3775, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.31% (0.7693 => 0.7054, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.86% (1.6874 => 1.5717, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.9588 => 0.9054, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.80% (0.9422 => 0.8970, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.69% (0.8990 => 0.8568, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.89% (1.0052 => 0.9661, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.47% (1.0234 => 0.9879, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.99% (0.9855 => 0.9560, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.98% (1.0119 => 0.9817, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.02% (5.0381 => 4.9364, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.39% (0.9372 => 0.6618, std.dev.: 0.0751) MultiSource/Benchmarks/Ptrdist/ft/ft: -18.88% (1.0816 => 0.8774, std.dev.: 0.0103) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.23% (0.1164 => 0.1010, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.45% (1.4588 => 1.3647, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6326, std.dev.: 0.1383) SingleSource/Benchmarks/Shootout/hash: -2.87% (4.5259 => 4.3960, std.dev.: 0.0385) MultiSource/Applications/spiff/spiff: -2.00% (2.8571 => 2.8000, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.91% (1.2047 => 1.1215, std.dev.: 0.1346) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.94% (0.0445 => 0.0423, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0343) MultiSource/Applications/lemon/lemon: -36.56% (1.9293 => 1.2240, std.dev.: 0.1306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.87% (0.4049 => 0.4246, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.85% (0.1510 => 0.1482, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -31.88% (0.0276 => 0.0188, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.19% (0.0590 => 0.0597, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1477, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.63% (0.0032 => 0.0019, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.40% (0.0268 => 0.0320, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.7437 => 0.7404, std.dev.: 0.0132) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.52% (0.0092 => 0.0121, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7546, std.dev.: 0.0254) Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 15:05:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 17:05:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130114230541.EE0E32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7599?compare_to=7595&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7599, Order: 172455, Start Time: 2013-01-14 20:53:44, End Time: 2013-01-14 23:05:45 To: 7595, Order: 172437, Start Time: 2013-01-14 18:11:33, End Time: 2013-01-14 20:23:27 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (219 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.51% (0.6379 => 0.6667, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.43% (10.4739 => 10.3242, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: -1.33% (37.0644 => 36.5701, std.dev.: 0.0096) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.76% (0.0656 => 0.0651, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8416 => 499.7863, std.dev.: 0.0289) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44219.08% (1.1277 => 499.7863, std.dev.: 0.0289) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.14% (0.5229 => 1.6740, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 21.61% (14.9895 => 18.2284, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 43.66% (14.1553 => 20.3356, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 18.71% (4.1105 => 4.8795, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.08% (1.1048 => 1.7907, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.29% (7.1582 => 38.6752, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.58% (3.4629 => 6.3919, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.88% (0.6222 => 1.0819, std.dev.: 0.0047) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.28% (0.0720 => 7.4414, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11154400.00% (0.0001 => 11.1545, std.dev.: 0.0209) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848400.00% (0.0001 => 9.8485, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486100.00% (0.0001 => 5.4862, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.30% (1.1194 => 10.3242, std.dev.: 0.0061) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784) MultiSource/Applications/ClamAV/clamscan: 150.20% (22.1758 => 55.4845, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.32% (0.1463 => 0.2521, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 66.70% (21.9371 => 36.5701, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.10% (7.0540 => 11.1521, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.83% (2.9384 => 4.6083, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 51.42% (0.1056 => 0.1599, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.75% (1.5859 => 2.3908, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.79% (8.1363 => 12.1876, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.65% (0.0439 => 0.0635) SingleSource/Benchmarks/CoyoteBench/almabench: 41.51% (0.0730 => 0.1033, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.86% (2.2024 => 3.1023, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 40.37% (0.3109 => 0.4364, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.13% (1.5415 => 2.0831, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.11% (4.2646 => 5.7620, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.09% (0.4615 => 0.6142, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.26% (0.2700 => 0.3544, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 31.01% (1.1642 => 1.5252, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.81% (0.1892 => 0.2475, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 30.47% (0.1175 => 0.1533, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.25% (0.2271 => 0.2958, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.96% (0.4299 => 0.5587, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.27% (0.6675 => 0.8629, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.37% (0.0793 => 0.1018, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 28.15% (0.2554 => 0.3273, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.89% (0.5105 => 0.6529, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.65% (0.1584 => 0.2022, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 27.46% (9.4845 => 12.0890, std.dev.: 0.0046) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 26.54% (1.0722 => 1.3568, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.75% (3.8922 => 4.8943, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.48% (0.1566 => 0.1965, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.43% (1.4186 => 1.7793, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.30% (0.0842 => 0.1055, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.76% (0.1143 => 0.1426, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.00% (0.0675 => 0.0837, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.81% (0.0886 => 0.1097, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 23.56% (0.1163 => 0.1437, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 22.92% (5.7591 => 7.0793, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 22.62% (0.4289 => 0.5259, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 22.59% (0.7115 => 0.8722, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.52% (4.9449 => 6.0587, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 22.06% (0.1695 => 0.2069, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.06% (0.1695 => 0.2069, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 21.92% (3.3354 => 4.0665, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.69% (5.0018 => 6.0869, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.67% (0.7835 => 0.9533, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 21.60% (0.4620 => 0.5618, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.81% (1.3050 => 1.5766, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.74% (0.1032 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.63% (0.1236 => 0.1491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 20.46% (0.3098 => 0.3732, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.31% (0.1940 => 0.2334, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.15% (0.5860 => 0.7041, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 20.11% (10.3673 => 12.4519, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.51% (0.8172 => 0.9766, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 19.16% (0.6456 => 0.7693, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 19.10% (0.7433 => 0.8853, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.81% (0.1510 => 0.1794, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.60% (0.2107 => 0.2499, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.53% (0.5020 => 0.5950, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 18.46% (0.3423 => 0.4055, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.15% (0.5569 => 0.6580, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 18.12% (3.8723 => 4.5738, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.71% (1.1840 => 1.3937, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.56% (0.9765 => 1.1480, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 17.55% (2.0273 => 2.3831, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978) MultiSource/Benchmarks/McCat/09-vor/vor: 17.26% (0.3180 => 0.3729, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.19% (0.6450 => 0.7559, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.02% (0.3307 => 0.3870, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: 16.87% (0.0818 => 0.0956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.58% (2.2969 => 2.6777, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.57% (0.5981 => 0.6972, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 16.56% (0.3387 => 0.3948, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.38% (0.8101 => 0.9428, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.13% (0.3441 => 0.3996, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.88% (0.8067 => 0.9348, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.82% (1.1861 => 1.3737, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.12% (0.8921 => 1.0270, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.29% (0.3283 => 0.3752, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 13.77% (0.3232 => 0.3677, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 13.66% (17.1811 => 19.5285, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.36% (14.3668 => 16.2861, std.dev.: 0.0103) MultiSource/Applications/hbd/hbd: 13.34% (1.5603 => 1.7685, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 13.29% (0.3092 => 0.3503, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 12.31% (0.3379 => 0.3795, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.20% (0.3427 => 0.3845, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.93% (0.4636 => 0.5189, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 11.64% (0.3282 => 0.3664, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.54% (0.3865 => 0.4311, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.48% (0.2430 => 0.2709, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 11.23% (0.3561 => 0.3961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.07% (0.3694 => 0.4103, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.06% (0.3543 => 0.3935, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.04% (0.3543 => 0.3934, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.97% (0.4103 => 0.4553, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.83% (0.4203 => 0.4658, std.dev.: 0.0101) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.68% (0.1114 => 0.1233, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 10.40% (0.4048 => 0.4469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 9.55% (0.3603 => 0.3947, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.54% (0.3826 => 0.4191, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.46% (0.1438 => 0.1574, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.42% (0.3684 => 0.4031, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 9.32% (63.2438 => 69.1385, std.dev.: 0.0370) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.01% (0.4064 => 0.4430, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 8.18% (0.6030 => 0.6523, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.4879 => 0.5267, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: 7.84% (0.7326 => 0.7900, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (7.9617 => 8.5769, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/strcat: 7.70% (0.2831 => 0.3049, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.39% (1.2842 => 1.3791, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.36% (2.0665 => 2.2186, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.12% (0.3650 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.02% (2.2022 => 2.3569, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.81% (0.2877 => 0.3073, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.81% (0.3935 => 0.4203, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.70% (0.3162 => 0.3374, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.66% (0.2266 => 0.2417, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.30% (0.2891 => 0.3073, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.16% (0.2872 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.06% (0.2756 => 0.2923, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 5.89% (0.2802 => 0.2967, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.3136 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.84% (0.2793 => 0.2956, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 5.49% (0.2714 => 0.2863, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.64% (0.3817 => 0.3956, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2534, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4595, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.08% (0.9957 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.6802 => 8.9176, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7179, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2866, std.dev.: 0.0134) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2803, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.47% (1.0785 => 1.0944, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4582, std.dev.: 0.0320) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1702, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.13% (5.2763 => 1.2066, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.53% (0.8651 => 0.2117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.93% (5.3855 => 4.4736, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.62% (5.3526 => 4.4629, std.dev.: 0.0095) MultiSource/Applications/JM/ldecod/ldecod: -10.34% (10.4361 => 9.3573, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.00% (1.7609 => 1.6200, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -7.51% (54.1659 => 50.0990, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.94% (1.9577 => 0.6667, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3050, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4210, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8599, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0034, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1246, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7360, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4934, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2906, std.dev.: 0.0709) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.59% (1.2373 => 1.1558, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5794, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.03% (8.1563 => 7.7457, std.dev.: 0.0064) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5120, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8307, std.dev.: 0.0178) MultiSource/Applications/siod/siod: -3.92% (3.2827 => 3.1541, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9574, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7221 => 3.6754, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2349, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0032) Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 15:38:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 17:38:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130114233822.1A95C2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7600?compare_to=7597&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7600, Order: 172475, Start Time: 2013-01-14 22:04:06, End Time: 2013-01-14 23:38:20 To: 7597, Order: 172454, Start Time: 2013-01-14 20:06:13, End Time: 2013-01-14 21:40:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (102 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.26% (0.6782 => 0.7139, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.09% (1.2785 => 1.2924, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.15% (0.6395 => 0.8771, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.37% (0.6395 => 0.8657, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.51% (0.6260 => 0.8358, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.47% (0.5688 => 0.7535, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.37% (0.5805 => 0.7684, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.97% (0.6230 => 0.8222, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.93% (0.5456 => 0.7198, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.46% (0.5575 => 0.7329, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.16% (0.5941 => 0.7792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (0.5802 => 0.7595, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.48% (0.5705 => 0.7444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.07% (0.5849 => 0.7608, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.88% (0.5478 => 0.7115, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.69% (0.5570 => 0.7224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.57% (0.5569 => 0.7216, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.46% (0.6440 => 0.8337, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.28% (0.5925 => 0.7660, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.24% (0.5591 => 0.7226, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.38% (0.5857 => 0.7519, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.26% (0.5863 => 0.7520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.26% (0.6189 => 0.7938, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.16% (0.6676 => 0.8556, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.00% (0.6446 => 0.8251, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 27.75% (0.0418 => 0.0534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.68% (0.6304 => 0.8049, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.38% (1.6474 => 2.0984, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.83% (0.6194 => 0.7856, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.18% (0.6681 => 0.8430, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.14% (0.6660 => 0.8401, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.11% (0.6297 => 0.7941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.63% (0.6667 => 0.8309, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.63% (0.7339 => 0.9000, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.62% (0.0582 => 0.0702, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.11% (2.2587 => 2.7129, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.34% (0.0693 => 0.0827, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 16.97% (1.1450 => 1.3393, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.49% (1.6364 => 1.8408, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.1982 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.60% (4.5069 => 5.0296, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.33% (0.4916 => 0.5473, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 10.94% (0.4515 => 0.5009, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.35% (3.5339 => 3.8996, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2385 => 0.2598, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 8.92% (9.2283 => 10.0515, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.57% (0.7021 => 0.7623, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.05% (1.2515 => 1.3523, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.09% (0.5329 => 0.5707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.97% (1.4642 => 1.5663, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.90% (0.2001 => 0.2139, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.57% (1.2784 => 1.3624, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: 6.23% (0.1879 => 0.1996, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4524 => 0.4798, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (0.4861 => 0.5105, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 4.61% (0.3255 => 0.3405, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3319 => 0.3452, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.3864 => 1.4313, std.dev.: 0.0168) MultiSource/Applications/oggenc/oggenc: 3.24% (5.0226 => 5.1851, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.50% (3.5154 => 3.6034, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (5.4682 => 5.5987, std.dev.: 0.0105) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (22.4056 => 22.8896, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/bigfib: 1.90% (0.6750 => 0.6878, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.64% (0.8418 => 0.8556, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 1.54% (0.7447 => 0.7562, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.38% (15.5079 => 15.7217, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3722 => 1.3894, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.02% (16.1920 => 16.3575, std.dev.: 0.0129) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6681, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4412, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1689, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4978, std.dev.: 0.0745) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.74% (0.6469 => 0.6646, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2842, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: -7.20% (0.3194 => 0.2964, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.89% (0.3837 => 0.3611, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wc: -5.37% (0.3205 => 0.3033, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.2849 => 0.2697, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.32% (0.2933 => 0.2777, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.27% (0.3831 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.25% (0.3848 => 0.3646, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0580, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: -5.19% (0.3026 => 0.2869, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.08% (0.4033 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.06% (0.3891 => 0.3694, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.06% (0.3896 => 0.3699, std.dev.: 0.0061) SingleSource/Regression/C++/ofstream_ctor: -4.97% (0.3059 => 0.2907, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.95% (0.3252 => 0.3091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.93% (0.4176 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.74% (0.2428 => 0.2313, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.69% (1.3148 => 1.2532, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.66% (0.9852 => 0.9393, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.62% (0.2989 => 0.2851, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.61% (0.3821 => 0.3645, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -4.52% (0.4199 => 0.4009, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.49% (0.6347 => 0.6062, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.48% (0.4151 => 0.3965, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference: -4.37% (0.7779 => 0.7439, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.30% (0.3142 => 0.3007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.22% (0.6441 => 0.6169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.18% (0.4280 => 0.4101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.04% (0.3931 => 0.3772, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.95% (0.3621 => 0.3478, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (2.4924 => 2.3952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.77% (0.4321 => 0.4158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.72% (0.4248 => 0.4090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.70% (0.3788 => 0.3648, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.69% (0.3849 => 0.3707, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4427 => 0.4264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.62% (0.3867 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.61% (0.6484 => 0.6250, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.42% (0.9542 => 0.9216, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.28% (0.4813 => 0.4655, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.83% (0.7919 => 0.7695, std.dev.: 0.0019) SingleSource/UnitTests/Vector/constpool: -2.40% (20.7746 => 20.2751, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.33% (1.0544 => 1.0298, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -2.18% (0.7982 => 0.7808, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.02% (1.2221 => 1.1974, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -1.95% (4.3330 => 4.2486, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.73% (0.5999 => 0.5895, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.68% (1.2210 => 1.2005, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.55% (0.8521 => 0.8389, std.dev.: 0.0017) MultiSource/Applications/siod/siod: -1.51% (2.4021 => 2.3659, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.50% (0.7198 => 0.7090, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (1.2300 => 1.2130, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.29% (14.2083 => 14.0245, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.24% (0.9077 => 0.8964, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.56% (1.8100 => 0.7139, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0256, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0326, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1304, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1728, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7347, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.95% (1.0557 => 1.0246, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6405, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8034, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1945, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6076, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.31% (1.3096 => 1.2924, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 16:54:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 18:54:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115005447.20C072A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7601?compare_to=7598&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7601, Order: 172483, Start Time: 2013-01-14 22:50:15, End Time: 2013-01-15 00:54:53 To: 7598, Order: 172455, Start Time: 2013-01-14 20:25:48, End Time: 2013-01-14 22:30:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 13 (11 on baseline) Performance Improvements: 4 (19 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (1033 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: 3.69% (0.4554 => 0.4722, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.29% (0.9067 => 0.9365, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.07% (0.3782 => 0.3898, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Bubblesort: 46.71% (0.0289 => 0.0424, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Treesort: 42.10% (0.0734 => 0.1043, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 34.76% (1.6068 => 2.1654, std.dev.: 0.0593) MultiSource/Applications/ALAC/encode/alacconvert-encode: 21.54% (0.0506 => 0.0615, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.55% (3.7867 => 4.2999, std.dev.: 0.1443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.03% (41.6654 => 44.1769, std.dev.: 0.1264) SingleSource/Benchmarks/Misc/flops: 2.69% (8.6652 => 8.8980, std.dev.: 0.0454) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.13% (2.7412 => 2.7997, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/lists: 1.41% (16.6326 => 16.8664, std.dev.: 0.0767) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.28% (5.5172 => 5.5876, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/viterbi/viterbi: -1.65% (3.6961 => 3.6351, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.22% (4.4413 => 4.3869, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/fibo: -1.15% (4.3774 => 4.3270, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -1.08% (1.5811 => 1.5641, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.75% (1.1215 => 1.1299, std.dev.: 0.0752) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.17% (0.0428 => 0.0433, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0335 => 0.0336, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.76% (0.0315 => 0.0330, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.42% (0.0423 => 0.0429, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: -7.27% (0.0220 => 0.0204, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.70% (0.0253 => 0.0231, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.30% (0.1456 => 0.1475, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -3.28% (1.2240 => 1.1838, std.dev.: 0.4063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.49% (0.4246 => 0.3928, std.dev.: 0.1402) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.08% (0.1482 => 0.1466, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.50% (0.0976 => 0.1059, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 43.62% (0.0188 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.02% (0.0597 => 0.0615, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.58% (1.1477 => 1.1543, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0019 => 0.0019, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.81% (0.0320 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.96% (0.7404 => 0.7475, std.dev.: 0.0770) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -66.94% (0.0121 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.21% (12.7546 => 12.7818, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.01% (1.8651 => 1.9213, std.dev.: 0.0147) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323300.00% (0.0008 => 2.5872, std.dev.: 0.0869) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.44% (1.1825 => 2.3347, std.dev.: 0.0527) SingleSource/Benchmarks/Stanford/Treesort: 45.67% (0.0716 => 0.1043, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Bubblesort: 34.60% (0.0315 => 0.0424, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 30.86% (1.6547 => 2.1654, std.dev.: 0.0593) MultiSource/Applications/ALAC/encode/alacconvert-encode: 26.80% (0.0485 => 0.0615, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.98% (3.7074 => 4.2999, std.dev.: 0.1443) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.94% (0.2562 => 0.2868, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.39% (42.3194 => 44.1769, std.dev.: 0.1264) SingleSource/Benchmarks/Misc/pi: 3.13% (2.1390 => 2.2060, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: -25.90% (0.1888 => 0.1399, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.63% (0.1684 => 0.1286, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.27% (0.0676 => 0.0539, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.68% (1.0960 => 0.9132, std.dev.: 0.0594) MultiSource/Applications/hexxagon/hexxagon: -10.54% (1.1433 => 1.0228, std.dev.: 0.0304) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.37% (6.4235 => 5.8216, std.dev.: 0.2165) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.49% (1.3924 => 1.2742, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.16% (0.3560 => 0.3305, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.26% (1.0234 => 0.9798, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -6.47% (0.3217 => 0.3009, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.92% (23.3986 => 22.2464, std.dev.: 0.4199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.19% (1.4446 => 1.3840, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists: -2.04% (17.2182 => 16.8664, std.dev.: 0.0767) MultiSource/Applications/spiff/spiff: -2.00% (2.8571 => 2.7999, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.22% (3.1921 => 3.1531, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/matrix: -1.16% (1.5825 => 1.5641, std.dev.: 0.0063) SingleSource/Benchmarks/SmallPT/smallpt: -1.07% (14.9448 => 14.7846, std.dev.: 0.0391) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.21% (1.2047 => 1.1299, std.dev.: 0.0752) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.61% (0.0328 => 0.0330, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0141) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: -10.13% (0.0227 => 0.0204, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.59% (0.1530 => 0.1475, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -38.64% (1.9293 => 1.1838, std.dev.: 0.4063) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.99% (0.4049 => 0.3928, std.dev.: 0.1402) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.91% (0.1510 => 0.1466, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.28% (0.0978 => 0.1059, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.17% (0.0276 => 0.0270, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0590 => 0.0615, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1617 => 1.1543, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.63% (0.0032 => 0.0019, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (0.7437 => 0.7475, std.dev.: 0.0770) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.52% (0.0092 => 0.0040, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.03% (12.7781 => 12.7818, std.dev.: 0.0115) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 17:36:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 19:36:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115013622.8E2C62A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7602?compare_to=7600&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7602, Order: 172490, Start Time: 2013-01-15 00:01:59, End Time: 2013-01-15 01:36:27 To: 7600, Order: 172475, Start Time: 2013-01-14 22:04:06, End Time: 2013-01-14 23:38:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 1 (125 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.21% (0.7139 => 0.6981, std.dev.: 0.0060) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.83% (0.0717 => 0.1189, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.06% (0.0974 => 0.1559, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.57% (0.1132 => 0.1546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.48% (0.6395 => 0.8664, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.63% (0.6260 => 0.8365, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.35% (0.5805 => 0.7683, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.09% (0.6230 => 0.8229, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.00% (0.5456 => 0.7202, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.48% (0.5575 => 0.7330, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.36% (0.5567 => 0.7313, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.19% (0.5941 => 0.7794, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.16% (0.5581 => 0.7320, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.97% (0.5802 => 0.7599, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.43% (0.5705 => 0.7441, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.07% (0.5849 => 0.7608, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.89% (0.5859 => 0.7610, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.88% (0.5478 => 0.7115, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.77% (0.5570 => 0.7228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.43% (0.5569 => 0.7208, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.35% (0.5925 => 0.7664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.30% (0.5591 => 0.7229, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.55% (0.6189 => 0.7956, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.48% (0.5857 => 0.7525, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.38% (0.5863 => 0.7527, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.22% (0.6052 => 0.7760, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.20% (0.6446 => 0.8264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.65% (1.6474 => 2.1029, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.78% (0.6194 => 0.7853, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.25% (0.6681 => 0.8435, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.25% (0.6660 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.16% (0.6297 => 0.7944, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.78% (0.6667 => 0.8319, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.26% (0.7524 => 0.9274, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.59% (0.7339 => 0.8997, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.47% (2.2587 => 2.7211, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 16.94% (1.1450 => 1.3390, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.65% (0.3834 => 0.4434, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.55% (1.6364 => 1.8418, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.79% (4.5069 => 5.0382, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 11.74% (0.4515 => 0.5045, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.53% (0.4916 => 0.5483, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.53% (3.5339 => 3.9060, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.01% (9.2283 => 10.0599, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.86% (0.7021 => 0.7643, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.51% (1.2515 => 1.3580, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.32% (0.5329 => 0.5719, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.06% (1.4642 => 1.5676, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.05% (0.2001 => 0.2142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.70% (0.1731 => 0.1847, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.2784 => 1.3626, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 6.08% (0.4524 => 0.4799, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (0.4861 => 0.5113, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.31% (0.3319 => 0.3462, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.71% (5.0226 => 5.2090, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.3864 => 1.4297, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.88% (5.4682 => 5.6255, std.dev.: 0.0092) MultiSource/Applications/d/make_dparser: 2.45% (3.5154 => 3.6014, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.6750 => 0.6903, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (22.4056 => 22.9113, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 2.10% (0.8418 => 0.8595, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.72% (0.7447 => 0.7575, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7676, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.3722 => 1.3899, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.04% (16.1920 => 16.3610, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6540, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9531 => 1.0272, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4410, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1688, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.5751 => 56.6834, std.dev.: 0.0451) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2836, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6068, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 1.13% (4.4335 => 4.4837, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.76% (0.1431 => 0.1320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -7.29% (0.3194 => 0.2961, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.92% (0.3837 => 0.3610, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: -5.68% (0.2871 => 0.2708, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.46% (0.2933 => 0.2773, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -5.41% (0.3848 => 0.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.41% (0.2849 => 0.2695, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.38% (0.3831 => 0.3625, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.33% (0.3812 => 0.3609, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: -5.31% (0.3896 => 0.3689, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.31% (0.3880 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.27% (0.3891 => 0.3686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -5.13% (0.4033 => 0.3826, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0601, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.3025 => 0.2872, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -5.03% (0.4176 => 0.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.99% (0.3026 => 0.2875, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.91% (0.3016 => 0.2868, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -4.81% (0.3059 => 0.2912, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.79% (0.3821 => 0.3638, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (0.9852 => 0.9400, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.59% (1.3148 => 1.2545, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.45% (0.4199 => 0.4012, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.32% (0.6347 => 0.6073, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.23% (0.3142 => 0.3009, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.11% (0.4280 => 0.4104, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.08% (0.7779 => 0.7462, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.02% (0.4151 => 0.3984, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3961, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/lists1: -3.75% (0.3867 => 0.3722, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (0.3621 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.58% (0.9542 => 0.9200, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -3.58% (0.4248 => 0.4096, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.49% (0.6484 => 0.6258, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.38% (0.3788 => 0.3660, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.31% (0.4321 => 0.4178, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.09% (0.4083 => 0.3957, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.08% (0.4813 => 0.4665, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2063, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.37% (0.7919 => 0.7731, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.08% (1.0544 => 1.0325, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.85% (1.2210 => 1.1984, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.80% (0.9179 => 0.9014, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.78% (1.2221 => 1.2004, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.68% (0.7982 => 0.7848, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -1.45% (4.3330 => 4.2700, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.42% (14.2083 => 14.0066, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.42% (0.7198 => 0.7096, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.23% (0.8521 => 0.8416, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -1.15% (1.5610 => 1.5431, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.43% (1.8100 => 0.6981, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0281, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0333, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1294, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.91% (0.4092 => 0.3523, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8585, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7306, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6472, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.60% (1.6219 => 1.5959, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3040 => 7.2007, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.31% (4.8776 => 4.8138, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5907, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 17:48:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 19:48:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115014812.EE26A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7603?compare_to=7599&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7603, Order: 172488, Start Time: 2013-01-14 23:36:19, End Time: 2013-01-15 01:48:16 To: 7599, Order: 172455, Start Time: 2013-01-14 20:53:44, End Time: 2013-01-14 23:05:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (219 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 1.55% (2.2827 => 2.3180, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.87% (12.4519 => 12.2187, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.06% (11.1521 => 11.0336, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0651 => 0.0650, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7863 => 499.8534, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.03% (1.1277 => 499.8534, std.dev.: 0.0062) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.41% (0.5229 => 1.6702, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 21.28% (14.9895 => 18.1797, std.dev.: 0.0061) MultiSource/Applications/kimwitu++/kc: 43.62% (14.1553 => 20.3299, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 18.28% (4.1105 => 4.8620, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.20% (1.1048 => 1.7920, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.48% (7.1582 => 38.5458, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.22% (3.4629 => 6.3792, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.06% (0.6222 => 1.0830, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.03% (0.0720 => 7.4441, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3834400.00% (0.0001 => 3.8345, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 11145000.00% (0.0001 => 11.1451, std.dev.: 0.0072) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848500.00% (0.0001 => 9.8486, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486900.00% (0.0001 => 5.4870, std.dev.: 0.0172) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 831.24% (1.1194 => 10.4243, std.dev.: 0.0228) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 151.83% (22.1758 => 55.8445, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.50% (0.0929 => 0.1779, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.59% (0.1463 => 0.2525, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 65.09% (21.9371 => 36.2161, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.18% (2.9384 => 4.6187, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.42% (7.0540 => 11.0336, std.dev.: 0.0062) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 51.42% (0.1056 => 0.1599) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.07% (1.5859 => 2.3958, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.32% (8.1363 => 12.2306, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.65% (0.0439 => 0.0635, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.32% (2.2024 => 3.1125, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 39.95% (0.3109 => 0.4351, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 39.11% (0.1432 => 0.1992, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.03% (1.5415 => 2.0815, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.00% (4.2646 => 5.7571, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.07% (0.4615 => 0.6141, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 32.09% (1.1642 => 1.5378, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.63% (0.2700 => 0.3527, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.50% (0.1892 => 0.2469, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.43% (0.2271 => 0.2962, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 30.05% (0.4299 => 0.5591, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.50% (0.6675 => 0.8644, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.64% (0.5105 => 0.6516, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 27.44% (9.4845 => 12.0870, std.dev.: 0.0111) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.38% (0.1125 => 0.1433, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.90% (0.2554 => 0.3241, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.39% (1.0722 => 1.3552, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.15% (3.8922 => 4.9099, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.84% (1.4186 => 1.7710, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 24.09% (0.0660 => 0.0819, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.78% (0.1337 => 0.1655, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 23.01% (5.7591 => 7.0844, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/hash: 22.97% (0.4289 => 0.5274, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 22.60% (0.7115 => 0.8723, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.57% (0.1143 => 0.1401, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.36% (4.9449 => 6.0507, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.29% (0.1032 => 0.1262, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 21.79% (3.3354 => 4.0621, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.69% (0.4620 => 0.5622, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.58% (0.0871 => 0.1059, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.42% (5.0018 => 6.0734, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 21.30% (0.7835 => 0.9504, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.20% (1.3050 => 1.5816, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.59% (0.1695 => 0.2044, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.47% (0.1236 => 0.1489, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 20.24% (0.3098 => 0.3725, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.19% (0.0842 => 0.1012, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.91% (0.5860 => 0.7027, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.79% (0.1940 => 0.2324, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.44% (0.8172 => 0.9761, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.16% (0.6456 => 0.7693, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.68% (0.1510 => 0.1792, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.49% (0.5020 => 0.5948, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.35% (0.3423 => 0.4051, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 17.93% (1.1840 => 1.3963, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 17.90% (3.8723 => 4.5655, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.88% (0.5569 => 0.6565, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 17.86% (10.3673 => 12.2187, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.84% (0.2758 => 0.3250, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 17.72% (0.7433 => 0.8750, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.56% (0.9765 => 1.1480, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 17.31% (2.0273 => 2.3783, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.12% (0.3307 => 0.3873, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.01% (0.6450 => 0.7547, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 16.92% (0.3387 => 0.3960, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 16.74% (0.2049 => 0.2392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.64% (0.5981 => 0.6976, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.53% (0.8101 => 0.9440, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 16.48% (0.3180 => 0.3704, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.43% (1.1861 => 1.3810, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 16.34% (2.2969 => 2.6722, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.26% (0.8067 => 0.9379, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.93% (0.3441 => 0.3989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.09% (0.8921 => 1.0267, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 14.62% (0.3283 => 0.3763, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.77% (0.3232 => 0.3677, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 13.68% (17.1811 => 19.5308, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.31% (14.3668 => 16.2792, std.dev.: 0.0028) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7677, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 12.76% (0.3379 => 0.3810, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 12.65% (0.3092 => 0.3483, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.11% (0.3427 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.08% (0.4636 => 0.5196, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.75% (0.3865 => 0.4319, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.96% (0.1268 => 0.1407, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.68% (0.4103 => 0.4541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.56% (0.4203 => 0.4647, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.53% (0.3828 => 0.4231, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.19% (0.3543 => 0.3904, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.10% (0.4048 => 0.4457, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.88% (0.3826 => 0.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 9.88% (0.3422 => 0.3760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 9.70% (63.2438 => 69.3763, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists1: 9.58% (0.3684 => 0.4037, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9.52% (0.3603 => 0.3946, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.4064 => 0.4433, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.68% (7.9617 => 8.5731, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (2.2022 => 2.3699, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.49% (0.5925 => 0.6369, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.42% (2.0665 => 2.2199, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.38% (0.7326 => 0.7867, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 7.24% (1.2842 => 1.3772, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.21% (0.2871 => 0.3078, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.21% (0.3650 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.3935 => 0.4212, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.61% (0.3162 => 0.3371, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.36% (0.2891 => 0.3075, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.20% (0.2872 => 0.3050, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 6.00% (0.3052 => 0.3235, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.94% (0.2793 => 0.2959, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 5.92% (0.2802 => 0.2968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 5.65% (0.2725 => 0.2879, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 5.60% (0.2714 => 0.2866, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2517, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.15% (1.1396 => 1.2439, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4257, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.70% (4.2280 => 4.4691, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3143, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (2.0360 => 2.1045, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.32% (0.9957 => 1.0288, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9071, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (3.6395 => 3.7234, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2860, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/fbench: 1.80% (2.2771 => 2.3180, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2784, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.24% (10.3460 => 10.4741, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1703, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.12% (5.2763 => 1.2072, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.62% (5.3855 => 4.4904, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.19% (5.3526 => 4.4859, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: -10.69% (10.4361 => 9.3209, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.71% (1.7609 => 1.6251, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.57% (54.1659 => 50.0644, std.dev.: 0.0114) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.80% (1.9577 => 0.6500, std.dev.: 0.0144) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3069, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4248, std.dev.: 0.0100) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8601, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7322, std.dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3212, std.dev.: 0.0204) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7062, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.20% (1.2373 => 1.1606, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.94% (8.1563 => 7.7536, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -4.23% (10.2830 => 9.8480, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.82% (3.2827 => 3.1572, std.dev.: 0.0065) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.91% (3.6994 => 3.6286, std.dev.: 0.0240) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7221 => 3.6763, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0012) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 19:16:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 21:16:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115031645.F05152A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7604?compare_to=7601&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7604, Order: 172491, Start Time: 2013-01-15 01:12:18, End Time: 2013-01-15 03:16:52 To: 7601, Order: 172483, Start Time: 2013-01-14 22:50:15, End Time: 2013-01-15 00:54:53 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 6 (6 on baseline) Performance Improvements: 4 (20 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1053 (1037 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.71% (0.0493 => 0.0674, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.53% (14.7386 => 15.9963, std.dev.: 0.3380) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.79% (1.0015 => 1.0294, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 3.33% (0.3302 => 0.3412, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 1.69% (3.5084 => 3.5678, std.dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: 1.11% (63.3479 => 64.0535, std.dev.: 0.2379) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -7.88% (9.3025 => 8.5693, std.dev.: 0.2227) SingleSource/Benchmarks/Adobe-C++/functionobjects: -6.21% (0.5326 => 0.4995, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -26.96% (2.1654 => 1.5817, std.dev.: 0.1262) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.65% (4.4957 => 4.1068, std.dev.: 0.1315) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.52% (1.1299 => 1.1240, std.dev.: 0.1577) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.85% (0.0433 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.19% (0.0336 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.55% (0.0330 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.63% (0.0429 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 7.84% (0.0204 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.87% (0.0231 => 0.0233, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.44% (0.1475 => 0.1439, std.dev.: 0.0235) MultiSource/Applications/lemon/lemon: -0.88% (1.1838 => 1.1734, std.dev.: 0.2985) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.86% (0.3928 => 0.4276, std.dev.: 0.1397) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.61% (0.1466 => 0.1475, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.23% (0.1059 => 0.0993, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.52% (0.0270 => 0.0320, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.78% (0.0615 => 0.0561, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.87% (1.1543 => 1.1874, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 57.89% (0.0019 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.38% (0.0026 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0613 => 0.0608, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.18% (0.0311 => 0.0298, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7475 => 0.7454, std.dev.: 0.0731) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 155.00% (0.0040 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.29% (12.7818 => 12.7451, std.dev.: 0.0190) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (14.9757 => 15.9963, std.dev.: 0.3380) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.04% (1.0088 => 1.0294, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323975.00% (0.0008 => 2.5926, std.dev.: 0.0310) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.30% (1.1825 => 2.3094, std.dev.: 0.0533) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (63.1520 => 64.0535, std.dev.: 0.2379) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.88% (0.0808 => 0.0510, std.dev.: 0.0077) SingleSource/Benchmarks/SmallPT/smallpt: -25.69% (0.1888 => 0.1403, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.40% (1.0986 => 0.9404, std.dev.: 0.0429) SingleSource/UnitTests/Vector/constpool: -13.33% (9.8875 => 8.5693, std.dev.: 0.2227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.26% (0.0889 => 0.0780, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.04% (0.0847 => 0.0745, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -10.25% (0.7686 => 0.6898, std.dev.: 0.0252) MultiSource/Applications/aha/aha: -9.22% (0.1378 => 0.1251, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.65% (6.4235 => 5.9962, std.dev.: 0.1508) SingleSource/Benchmarks/Shootout-C++/hash2: -6.10% (0.5134 => 0.4821, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary: -4.70% (0.2551 => 0.2431, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: -4.52% (0.3206 => 0.3061, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.55% (0.9124 => 0.8800, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -29.08% (4.4739 => 3.1731, std.dev.: 0.3671) SingleSource/Benchmarks/Shootout/hash: -9.85% (4.5259 => 4.0800, std.dev.: 0.0499) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.77% (1.4588 => 1.3309, std.dev.: 0.0178) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.80% (4.4540 => 4.1068, std.dev.: 0.1315) SingleSource/Benchmarks/Dhrystone/dry: -1.95% (0.5295 => 0.5192, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -1.06% (2.9083 => 2.8776, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.70% (1.2047 => 1.1240, std.dev.: 0.1577) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.76% (0.0451 => 0.0425, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.74% (0.0394 => 0.0332, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.17% (0.0445 => 0.0422, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (0.0255 => 0.0233, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.95% (0.1530 => 0.1439, std.dev.: 0.0235) MultiSource/Applications/lemon/lemon: -39.18% (1.9293 => 1.1734, std.dev.: 0.2985) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.61% (0.4049 => 0.4276, std.dev.: 0.1397) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.32% (0.1510 => 0.1475, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0978 => 0.0993, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.94% (0.0276 => 0.0320, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.21% (1.1617 => 1.1874, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.19% (0.0268 => 0.0298, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7437 => 0.7454, std.dev.: 0.0731) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.87% (0.0092 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7781 => 12.7451, std.dev.: 0.0190) Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 19:34:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 21:34:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115033416.5C75D2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7605?compare_to=7602&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7605, Order: 172498, Start Time: 2013-01-15 01:59:53, End Time: 2013-01-15 03:34:21 To: 7602, Order: 172490, Start Time: 2013-01-15 00:01:59, End Time: 2013-01-15 01:36:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.97% (0.0717 => 0.1190, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.94% (0.0267 => 0.0387, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.36% (0.6395 => 0.8784, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.42% (0.6395 => 0.8660, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.69% (0.6260 => 0.8369, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.52% (0.5688 => 0.7538, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.10% (0.6230 => 0.8230, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.09% (0.5456 => 0.7207, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.44% (0.5575 => 0.7328, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.40% (0.5567 => 0.7315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.27% (0.5941 => 0.7799, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (0.5802 => 0.7595, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.45% (0.6033 => 0.7870, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.36% (0.5705 => 0.7437, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.09% (0.5849 => 0.7609, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.01% (0.5478 => 0.7122, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.71% (0.5570 => 0.7225, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.54% (0.5569 => 0.7214, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.40% (0.5591 => 0.7235, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.37% (0.5925 => 0.7665, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.33% (0.0699 => 0.0904, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.45% (0.6676 => 0.8575, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.39% (0.5857 => 0.7520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.35% (0.5863 => 0.7525, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.17% (0.6446 => 0.8262, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.79% (0.6304 => 0.8056, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.57% (1.6474 => 2.1016, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.77% (0.6194 => 0.7852, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.38% (0.6660 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.19% (0.6297 => 0.7946, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.12% (0.6681 => 0.8426, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.79% (0.6667 => 0.8320, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.31% (0.0622 => 0.0767) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.29% (0.7524 => 0.9276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.58% (0.7339 => 0.8996, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.26% (2.2587 => 2.7162, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 17.30% (1.1450 => 1.3431, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.63% (0.3357 => 0.3848, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.97% (0.1081 => 0.1232, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.68% (1.6364 => 1.8439, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.90% (4.5069 => 5.0432, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.76% (0.4916 => 0.5494, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.03% (0.4515 => 0.5013, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.31% (3.5339 => 3.8982, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 9.08% (9.2283 => 10.0662, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.84% (0.7021 => 0.7642, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.53% (1.2515 => 1.3582, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.36% (0.5329 => 0.5721, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.18% (1.4642 => 1.5693, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (1.2784 => 1.3636, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 6.07% (0.1879 => 0.1993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4524 => 0.4798, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (0.4861 => 0.5141, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3255 => 0.3428, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.25% (0.3319 => 0.3460, std.dev.: 0.0044) MultiSource/Applications/oggenc/oggenc: 3.95% (5.0226 => 5.2208, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 3.23% (1.3864 => 1.4312, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (5.4682 => 5.6263, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 2.66% (3.5154 => 3.6090, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.40% (22.4056 => 22.9429, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 2.34% (0.6750 => 0.6908, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.96% (0.7447 => 0.7593, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.85% (0.8418 => 0.8574, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.76% (15.5079 => 15.7812, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3722 => 1.3915, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (0.9557 => 0.9680, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.25% (16.1920 => 16.3944, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.16% (4.8161 => 4.8720, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (4.0323 => 4.0761, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6603, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9531 => 1.0273, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.03% (1.2783 => 1.3682, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.1955 => 5.4422, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1680, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3828, std.dev.: 0.1048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0107) MultiSource/Benchmarks/llubenchmark/llu: 2.16% (3.7435 => 3.8243, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2842, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.45% (79.7170 => 80.8702, std.dev.: 0.2583) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.83% (0.3194 => 0.2976, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.73% (0.3837 => 0.3617, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.05% (0.2871 => 0.2726, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.03% (0.3323 => 0.3156, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.99% (0.2903 => 0.2758, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.97% (0.3016 => 0.2866, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -4.94% (0.3059 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.81% (0.2849 => 0.2712, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.74% (0.2933 => 0.2794, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.73% (2.1713 => 2.0685, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.53% (0.9852 => 0.9406, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: -4.45% (0.2989 => 0.2856, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.41% (0.3812 => 0.3644, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.38% (1.3148 => 1.2572, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-3: -4.26% (0.3848 => 0.3684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3831 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.21% (0.3896 => 0.3732, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -4.17% (0.4176 => 0.4002, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.16% (0.3891 => 0.3729, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.05% (0.4151 => 0.3983, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.95% (0.3142 => 0.3018, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.81% (2.4924 => 2.3974, std.dev.: 0.0140) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.71% (0.3884 => 0.3740, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.65% (0.3621 => 0.3489, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.55% (0.4199 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.51% (0.9542 => 0.9207, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.39% (0.3867 => 0.3736, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.34% (0.6441 => 0.6226, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.30% (0.4248 => 0.4108) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4280 => 0.4142, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.21% (0.7779 => 0.7529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.19% (0.4427 => 0.4286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.18% (0.3931 => 0.3806, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.18% (0.6484 => 0.6278, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sieve: -3.17% (0.3788 => 0.3668, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.09% (0.3849 => 0.3730, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.99% (0.4321 => 0.4192, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2308, std.dev.: 0.0102) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.60% (0.4813 => 0.4688, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.47% (0.4083 => 0.3982, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.36% (0.7919 => 0.7732, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.01% (1.0544 => 1.0332, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: -1.95% (0.7982 => 0.7826, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.67% (4.3330 => 4.2606, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.59% (1.2221 => 1.2027, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.43% (1.2210 => 1.2035, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -1.22% (2.4021 => 2.3728, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -1.03% (1.5610 => 1.5449, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.02% (14.2083 => 14.0627, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.46% (1.8100 => 0.6975, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3123, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2400, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.06% (1.3643 => 1.0224, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0345, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3843, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2077, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1279, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.08% (4.1534 => 3.8594, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.13% (7.9763 => 7.7264, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.19% (1.3096 => 1.2809, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.7241 => 3.6428, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4635, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.54% (1.6219 => 1.5970, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1925, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.52% (1.6307 => 1.6059, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.48% (4.8776 => 4.8056, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5861, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.16s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 20:30:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 22:30:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115043043.B7ECB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7606?compare_to=7603&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7606, Order: 172498, Start Time: 2013-01-15 02:18:38, End Time: 2013-01-15 04:30:48 To: 7603, Order: 172488, Start Time: 2013-01-14 23:36:19, End Time: 2013-01-15 01:48:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (218 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.48% (1.5378 => 1.5151, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0650 => 0.0651, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8534 => 499.7735, std.dev.: 0.0426) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44217.95% (1.1277 => 499.7735, std.dev.: 0.0426) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.76% (0.5229 => 1.6720, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 21.08% (14.9895 => 18.1497, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: 43.47% (14.1553 => 20.3092, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: 17.91% (4.1105 => 4.8465, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.48% (1.1048 => 1.7840, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.85% (7.1582 => 38.5005, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.29% (3.4629 => 6.3817, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.70% (0.6222 => 1.0870, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10231.53% (0.0720 => 7.4387, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: 3835300.00% (0.0001 => 3.8354, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11152600.00% (0.0001 => 11.1527, std.dev.: 0.0697) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850400.00% (0.0001 => 9.8505, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484000.00% (0.0001 => 5.4841, std.dev.: 0.0023) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 829.25% (1.1194 => 10.4020, std.dev.: 0.0147) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787) MultiSource/Applications/ClamAV/clamscan: 151.57% (22.1758 => 55.7884, std.dev.: 0.0386) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 72.32% (0.1463 => 0.2521, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.16% (21.9371 => 36.0128, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.05% (7.0540 => 11.0780, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.85% (2.9384 => 4.6088, std.dev.: 0.0014) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.90% (1.5859 => 2.3932, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.00% (8.1363 => 12.2041, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.19% (0.0439 => 0.0633) SingleSource/Benchmarks/CoyoteBench/almabench: 41.92% (0.0730 => 0.1036, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.20% (2.2024 => 3.1098, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 38.06% (0.1432 => 0.1977, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.64% (1.5415 => 2.0755, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.52% (4.2646 => 5.7369, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.83% (0.4615 => 0.6130, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.52% (0.2700 => 0.3524, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.14% (1.1642 => 1.5151, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.13% (0.1892 => 0.2462, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 30.04% (0.1175 => 0.1528, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.94% (0.2271 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.57% (0.4299 => 0.5570, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.54% (0.6675 => 0.8647, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.11% (0.5105 => 0.6540, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.74% (0.0793 => 0.1013, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 27.45% (0.2554 => 0.3255, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 27.25% (0.1655 => 0.2106, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 27.14% (9.4845 => 12.0585, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 26.35% (1.0722 => 1.3547, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.05% (3.8922 => 4.9060, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.22% (0.1566 => 0.1961, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.16% (0.1125 => 0.1408, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.97% (0.1906 => 0.2382, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.71% (1.4186 => 1.7691, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.71% (0.1143 => 0.1414, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.56% (0.0675 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.52% (0.3121 => 0.3855, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.26% (0.1337 => 0.1648, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.01% (0.1695 => 0.2085, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 22.85% (0.4289 => 0.5269, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 22.61% (5.7591 => 7.0613, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 22.42% (0.7115 => 0.8710, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.33% (0.0842 => 0.1030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.96% (4.9449 => 6.0308, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash2: 21.75% (0.4620 => 0.5625, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 21.43% (3.3354 => 4.0503, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.12% (5.0018 => 6.0584, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.88% (0.0886 => 0.1071, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.68% (0.7835 => 0.9455, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.64% (1.3050 => 1.5743, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 20.50% (0.3098 => 0.3733, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.68% (0.5860 => 0.7013, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.24% (0.1029 => 0.1227, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 19.24% (0.6456 => 0.7698, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.94% (0.8172 => 0.9720, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/18-imp/imp: 18.70% (0.3423 => 0.4063, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.39% (0.5020 => 0.5943, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 18.36% (0.7433 => 0.8798, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 17.74% (10.3673 => 12.2069, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 17.68% (3.8723 => 4.5568, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 17.57% (1.1840 => 1.3920, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.35% (0.9765 => 1.1459, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 17.33% (0.2049 => 0.2404, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 17.11% (2.0273 => 2.3741, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.02% (0.5569 => 0.6517, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.78% (0.3307 => 0.3862, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.76% (0.6450 => 0.7531, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 16.60% (2.2969 => 2.6782, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 16.38% (0.3180 => 0.3701, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.34% (0.5981 => 0.6958, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 16.33% (0.3387 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.27% (0.2065 => 0.2401, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.21% (0.8101 => 0.9414, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.19% (0.0834 => 0.0969, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.73% (0.8067 => 0.9336, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.72% (0.3441 => 0.3982, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.45% (1.1861 => 1.3693, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 14.76% (0.8921 => 1.0238, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.38% (0.3283 => 0.3755, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 13.71% (0.3232 => 0.3675, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 13.62% (17.1811 => 19.5208, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: 13.06% (1.5603 => 1.7641, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.03% (14.3668 => 16.2395, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: 12.84% (0.3379 => 0.3813, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: 12.45% (0.3092 => 0.3477, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.80% (0.4636 => 0.5183, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3427 => 0.3829, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.62% (0.3865 => 0.4314, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 11.49% (0.3282 => 0.3659, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.04% (0.4103 => 0.4556, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.61% (0.4203 => 0.4649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.31% (0.3927 => 0.4332, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.09% (0.1268 => 0.1396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.99% (0.3422 => 0.3764, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 9.93% (0.3886 => 0.4272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 9.91% (0.4048 => 0.4449, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.77% (63.2438 => 69.4202, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/sieve: 9.74% (0.3603 => 0.3954, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.40% (0.4064 => 0.4446, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.38% (0.3826 => 0.4185, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.29% (0.3543 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.80% (0.3694 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.75% (0.3543 => 0.3853, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.73% (0.3561 => 0.3872, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 8.72% (0.3473 => 0.3776, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.55% (0.1438 => 0.1561, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 7.73% (0.2871 => 0.3093, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.61% (0.6030 => 0.6489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.49% (0.2831 => 0.3043, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.28% (1.2842 => 1.3777, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.22% (2.2022 => 2.3613, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.20% (2.0665 => 2.2152, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 7.19% (0.7326 => 0.7853, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.15% (7.9617 => 8.5311, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.07% (0.3650 => 0.3908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.99% (0.2877 => 0.3078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.89% (0.3162 => 0.3380, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.73% (0.2793 => 0.2981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.61% (0.2725 => 0.2905, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.55% (0.2872 => 0.3060, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (0.2266 => 0.2414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.30% (0.2905 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.26% (0.2891 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.07% (0.2802 => 0.2972, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.3136 => 0.3320, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 5.87% (0.3052 => 0.3231, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2529, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6978, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.31% (1.1396 => 1.2457, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4260, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (4.2280 => 4.4678, std.dev.: 0.0078) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3108, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 3.46% (2.2771 => 2.3559, std.dev.: 0.0222) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.3316 => 0.3430, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.96% (0.9957 => 1.0252, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9077, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.21% (3.6395 => 3.7200, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2871, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (1.7254 => 1.7571, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2820, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4549, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.21% (5.2763 => 1.2025, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.86% (0.1622 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.56% (5.3855 => 4.4934, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.16% (5.3526 => 4.4875, std.dev.: 0.0073) MultiSource/Applications/JM/ldecod/ldecod: -10.92% (10.4361 => 9.2962, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.77% (1.7609 => 1.6240, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.52% (54.1659 => 50.0913, std.dev.: 0.0294) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.68% (1.9577 => 0.6523, std.dev.: 0.0152) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.56% (1.5373 => 1.0214, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4330, std.dev.: 0.0200) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8660, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0034, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4201, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7335, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4914, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2781, std.dev.: 0.0764) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.82% (1.2373 => 1.1529, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.06% (8.1563 => 7.7434, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.26% (10.2830 => 9.8454, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3277, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0011) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 21:31:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 23:31:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115053144.C32D12A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7607?compare_to=7605&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7607, Order: 172504, Start Time: 2013-01-15 03:57:44, End Time: 2013-01-15 05:31:49 To: 7605, Order: 172498, Start Time: 2013-01-15 01:59:53, End Time: 2013-01-15 03:34:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 1 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (858 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.89% (0.6975 => 0.6704, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.79% (0.0280 => 0.0523, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.55% (0.0717 => 0.1187, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.29% (0.0974 => 0.1571, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.08% (0.6395 => 0.8766, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.32% (0.6395 => 0.8654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.40% (0.6260 => 0.8351, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.61% (0.5688 => 0.7543, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.35% (0.5805 => 0.7683, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.06% (0.5456 => 0.7205, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.85% (0.6230 => 0.8214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.14% (0.5581 => 0.7319, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.14% (0.5941 => 0.7791, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.13% (0.5567 => 0.7300, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.97% (0.5802 => 0.7599, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.38% (0.6033 => 0.7866, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.25% (0.5705 => 0.7431, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.09% (0.5849 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.06% (0.5859 => 0.7620, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.81% (0.5478 => 0.7111, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.59% (0.5570 => 0.7218, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.39% (0.5569 => 0.7206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.35% (0.6440 => 0.8330, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.27% (0.5925 => 0.7659, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.08% (0.5591 => 0.7217, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.30% (0.5863 => 0.7522, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.26% (0.5857 => 0.7512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.19% (0.6052 => 0.7758, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.92% (0.6446 => 0.8246, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.52% (0.6304 => 0.8039, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.43% (1.6474 => 2.0992, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.54% (0.6194 => 0.7838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.08% (0.6660 => 0.8397, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.00% (0.6297 => 0.7934, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.98% (0.6681 => 0.8417, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.61% (0.6667 => 0.8308, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.22% (0.7524 => 0.9271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.37% (0.7339 => 0.8981, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.12% (2.2587 => 2.7131, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 16.87% (1.1450 => 1.3382, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 13.19% (0.0864 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.45% (1.6364 => 1.8402, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.63% (4.5069 => 5.0311, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (0.4916 => 0.5475, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 10.92% (0.4515 => 0.5008, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.17% (3.5339 => 3.8934, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 9.02% (9.2283 => 10.0606, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.01% (0.2385 => 0.2600, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.7021 => 0.7638, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.93% (1.2515 => 1.3507, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.5329 => 0.5715, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.05% (0.2001 => 0.2142, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.86% (1.4642 => 1.5646, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.1879 => 0.2000, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.43% (1.2784 => 1.3606, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.17% (0.4524 => 0.4803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.12% (0.4861 => 0.5110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.95% (0.3319 => 0.3450, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.26% (5.0226 => 5.1865, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.23% (1.3864 => 1.4312, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (5.4682 => 5.6112, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 2.28% (3.5154 => 3.5956, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.21% (22.4056 => 22.9006, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6750 => 0.6889, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 1.38% (15.5079 => 15.7217, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.23% (1.3722 => 1.3891, std.dev.: 0.0039) MultiSource/Applications/JM/lencod/lencod: 1.02% (16.1920 => 16.3564, std.dev.: 0.0106) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6771, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.77% (0.9531 => 1.0272, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.93% (1.2783 => 1.3669, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4413, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1695, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.61% (2.0478 => 2.1218, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4692, std.dev.: 0.0983) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2849, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5320 => 4.6023, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322) SingleSource/Benchmarks/Shootout-C++/objinst: -7.23% (0.3194 => 0.2963, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: -5.66% (0.3059 => 0.2886, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.51% (0.3323 => 0.3140, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -5.38% (0.3831 => 0.3625, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.27% (0.3205 => 0.3036, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -5.26% (0.2871 => 0.2720, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -5.22% (0.4176 => 0.3958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.17% (2.1713 => 2.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.07% (0.2939 => 0.2790, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.98% (0.2933 => 0.2787, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.80% (1.3148 => 1.2517, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: -4.77% (0.2849 => 0.2713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (0.9852 => 0.9391, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -4.40% (0.3025 => 0.2892, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.37% (0.4280 => 0.4093, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.32% (0.3821 => 0.3656, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.27% (0.6347 => 0.6076, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.27% (0.7779 => 0.7447, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.09% (0.3621 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.07% (0.4151 => 0.3982, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.02% (2.4924 => 2.3921, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: -3.78% (0.3867 => 0.3721, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.75% (0.4321 => 0.4159, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -3.63% (0.4248 => 0.4094, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.61% (0.3931 => 0.3789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.55% (0.4427 => 0.4270, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.53% (0.9542 => 0.9205, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.53% (0.3658 => 0.3529, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.38% (0.6484 => 0.6265, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.33% (0.3849 => 0.3721, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.20% (0.4813 => 0.4659, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.06% (0.4083 => 0.3958, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1962, std.dev.: 0.0765) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0302, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -2.15% (0.7982 => 0.7810, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -1.99% (0.9179 => 0.8996, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -1.98% (4.3330 => 4.2472, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.92% (1.2221 => 1.1986, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (1.2210 => 1.1981, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (0.8521 => 0.8393, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.50% (0.7198 => 0.7090, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -1.47% (2.4021 => 2.3669, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.41% (14.2083 => 14.0082, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.38% (1.2300 => 1.2130, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: -1.19% (1.5610 => 1.5425, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.15% (0.9077 => 0.8973, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.12% (34.0927 => 33.7108, std.dev.: 0.0370) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.96% (1.8100 => 0.6704, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2411, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0267, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0374, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2071, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1310, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1048, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.15% (2.2633 => 2.1693, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.21% (7.9763 => 7.7205, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.51% (3.7241 => 3.6307, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.85% (1.6086 => 1.5789, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3040 => 7.1779, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.54% (4.8776 => 4.8025, std.dev.: 0.0084) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.04% (3.7092 => 3.6705, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 21:32:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 14 Jan 2013 23:32:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115053204.2C6162A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7608?compare_to=7604&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7608, Order: 172504, Start Time: 2013-01-15 03:33:38, End Time: 2013-01-15 05:32:11 To: 7604, Order: 172491, Start Time: 2013-01-15 01:12:18, End Time: 2013-01-15 03:16:52 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 3 (10 on baseline) Performance Improvements: 55 (105 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1005 (948 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 2.55% (8.5693 => 8.7879, std.dev.: 0.0346) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 8.88% (2.0331 => 2.2137, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.47% (5.0825 => 5.1571, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: -26.11% (0.0674 => 0.0498, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.89% (0.0930 => 0.0745, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -8.73% (1.0713 => 0.9778, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -7.19% (1.1289 => 1.0477, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/bh/bh: -7.18% (0.3441 => 0.3194, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/voronoi/voronoi: -6.97% (0.2972 => 0.2765, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/em3d/em3d: -6.64% (0.2018 => 0.1884, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.15% (1.1414 => 1.0712, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.85% (0.9178 => 0.8641, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.83% (0.9435 => 0.8885, std.dev.: 0.0186) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.67% (0.1799 => 0.1697, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: -5.47% (0.3934 => 0.3719, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.90% (5.9962 => 5.7022, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.70% (0.9825 => 0.9363, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: -4.67% (1.4797 => 1.4106, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.49% (1.3213 => 1.2620, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.33% (0.9751 => 0.9329, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/09-vor/vor: -4.12% (0.3595 => 0.3447, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.78% (0.9296 => 0.8945, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.73% (2.4748 => 2.3824, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.55% (3.5613 => 3.4347, std.dev.: 0.0241) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.51% (1.2755 => 1.2307, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/05-eks/eks: -3.07% (0.4884 => 0.4734, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -2.92% (0.8150 => 0.7912, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -2.76% (0.9023 => 0.8774, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -2.51% (5.4003 => 5.2645, std.dev.: 0.0311) MultiSource/Applications/d/make_dparser: -2.48% (3.7118 => 3.6199, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -2.29% (16.6599 => 16.2784, std.dev.: 0.0624) MultiSource/Applications/JM/lencod/lencod: -2.28% (17.4601 => 17.0624, std.dev.: 0.0703) MultiSource/Applications/treecc/treecc: -2.17% (2.2422 => 2.1935, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.11% (0.9107 => 0.8915, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -1.95% (7.5783 => 7.4307, std.dev.: 0.0284) MultiSource/Applications/SPASS/SPASS: -1.89% (16.2953 => 15.9875, std.dev.: 0.0299) MultiSource/Applications/SIBsim4/SIBsim4: -1.26% (1.4021 => 1.3844, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -15.57% (3.7372 => 3.1552, std.dev.: 0.0996) MultiSource/Benchmarks/Olden/treeadd/treeadd: -11.09% (0.4086 => 0.3633, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.82% (0.3625 => 0.3269, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.50% (4.9661 => 4.5442, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.28% (45.0256 => 43.1007, std.dev.: 0.5160) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.74% (1.1081 => 1.0667, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: -2.43% (1.4182 => 1.3838, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.38% (1.5817 => 1.5441, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.15% (42.2006 => 41.2938, std.dev.: 0.2646) SingleSource/Benchmarks/Shootout/heapsort: -1.93% (3.1731 => 3.1120, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/fbench: -1.70% (2.4504 => 2.4088, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -1.70% (3.5678 => 3.5073, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.51% (4.4514 => 4.3843, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.39% (60.8059 => 59.9635, std.dev.: 0.2288) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.25% (1.4564 => 1.4382, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/lowercase: -1.20% (2.5926 => 2.5615, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/flops-6: -1.08% (2.4277 => 2.4014, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ReedSolomon: -1.07% (8.6043 => 8.5124, std.dev.: 0.0315) MultiSource/Applications/SIBsim4/SIBsim4: -1.05% (3.4538 => 3.4177, std.dev.: 0.0129) MultiSource/Applications/lambda-0_1_3/lambda: -1.03% (7.5648 => 7.4869, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.03% (1.5483 => 1.5324, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.69% (1.1240 => 1.1162, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0220 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.47% (0.0425 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0332 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.71% (0.0315 => 0.0234, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.54% (0.0422 => 0.0348, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: -29.27% (0.0205 => 0.0145, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -4.09% (0.0220 => 0.0211, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.58% (0.0233 => 0.0253, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.49% (0.1439 => 0.1446, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.40% (1.1734 => 1.1570, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -7.83% (0.4276 => 0.3941, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.17% (0.1475 => 0.1507, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.55% (0.0993 => 0.1068, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.75% (0.0320 => 0.0276, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.43% (0.0561 => 0.0553, std.dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.18% (1.1874 => 1.1496, std.dev.: 0.1025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -80.00% (0.0030 => 0.0006, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 188.89% (0.0009 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.65% (0.0608 => 0.0525, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.03% (0.0298 => 0.0283, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.7454 => 0.7409, std.dev.: 0.0086) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.98% (0.0102 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (12.7451 => 12.7524, std.dev.: 0.0191) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.70% (0.0336 => 0.0503, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 3.46% (9.5202 => 9.8495, std.dev.: 0.0643) MultiSource/Applications/JM/lencod/lencod: 2.16% (16.7012 => 17.0624, std.dev.: 0.0703) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.24% (23.5861 => 23.8787, std.dev.: 0.0155) MultiSource/Applications/JM/ldecod/ldecod: 1.06% (7.3529 => 7.4307, std.dev.: 0.0284) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320087.50% (0.0008 => 2.5615, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.25% (1.1825 => 2.3561, std.dev.: 0.1276) SingleSource/Benchmarks/Misc/pi: 3.49% (2.1390 => 2.2137, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (63.1520 => 64.3757, std.dev.: 0.2171) MultiSource/Applications/JM/lencod/lencod: 1.85% (6.8159 => 6.9419, std.dev.: 0.0157) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -29.34% (0.0692 => 0.0489, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -26.48% (0.1888 => 0.1388, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -26.16% (0.1009 => 0.0745, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -21.59% (1.8964 => 1.4869, std.dev.: 0.0295) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.68% (0.0862 => 0.0701, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -14.15% (1.0220 => 0.8774, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.11% (0.0847 => 0.0736, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -13.08% (1.1433 => 0.9938, std.dev.: 0.0137) MultiSource/Applications/aha/aha: -12.84% (0.1378 => 0.1201, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -11.81% (0.1058 => 0.0933, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: -11.72% (1.5979 => 1.4106, std.dev.: 0.0068) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.54% (1.2154 => 1.0752, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.36% (0.0889 => 0.0788, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: -11.26% (2.4719 => 2.1935, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.23% (6.4235 => 5.7022, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -11.12% (9.8875 => 8.7879, std.dev.: 0.0346) MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.91% (0.1332 => 0.1200, std.dev.: 0.0039) MultiSource/Applications/sgefa/sgefa: -9.73% (0.3598 => 0.3248, std.dev.: 0.0050) MultiSource/Applications/siod/siod: -8.90% (2.6437 => 2.4084, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: -8.56% (0.8653 => 0.7912, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.45% (0.7693 => 0.7043, std.dev.: 0.0237) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.41% (0.2283 => 0.2091, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.95% (0.2100 => 0.1933, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -7.65% (17.4365 => 16.1034, std.dev.: 0.0670) MultiSource/Applications/sqlite3/sqlite3: -7.32% (17.5634 => 16.2784, std.dev.: 0.0624) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.87% (1.0017 => 0.9329, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/hash2: -6.84% (0.5134 => 0.4783, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -6.71% (0.1610 => 0.1502, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.62% (0.9550 => 0.8918, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.46% (1.8127 => 1.6956, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: -6.46% (0.2385 => 0.2231, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2006 => 0.1881, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -6.22% (0.1928 => 0.1808, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.75% (0.3462 => 0.3263, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.62% (0.1798 => 0.1697, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -5.57% (0.4002 => 0.3779, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.37% (3.6295 => 3.4347, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.21% (0.9405 => 0.8915, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.18% (1.3310 => 1.2620, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.15% (0.3981 => 0.3776, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -5.11% (0.2135 => 0.2026, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: -5.10% (0.4689 => 0.4450, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.90% (0.9788 => 0.9308, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.2305 => 0.2192, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -4.88% (0.2725 => 0.2592, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.65% (1.0052 => 0.9585, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.58% (0.9512 => 0.9076, std.dev.: 0.0123) MultiSource/Applications/lemon/lemon: -4.41% (1.3979 => 1.3363, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: -4.34% (3.7840 => 3.6199, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.24% (0.3093 => 0.2962, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: -4.23% (0.6711 => 0.6427, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.98% (0.3665 => 0.3519, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -3.97% (0.7776 => 0.7467, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: -3.90% (0.2564 => 0.2464, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -3.81% (1.4392 => 1.3844, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: -3.71% (0.3206 => 0.3087, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.37% (1.0119 => 0.9778, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.28% (0.7693 => 0.7441, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.94% (1.2680 => 1.2307, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.92% (0.9214 => 0.8945, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.84% (0.6135 => 0.5961, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.83% (2.4519 => 2.3824, std.dev.: 0.0103) MultiSource/Applications/SPASS/SPASS: -2.80% (16.4479 => 15.9875, std.dev.: 0.0299) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.68% (0.3847 => 0.3744, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.59% (0.9612 => 0.9363, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: -1.70% (5.3553 => 5.2645, std.dev.: 0.0311) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.16% (0.9372 => 0.6452, std.dev.: 0.1016) SingleSource/Benchmarks/Shootout/heapsort: -30.44% (4.4739 => 3.1120, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.95% (4.2042 => 3.1552, std.dev.: 0.0996) MultiSource/Applications/minisat/minisat: -22.78% (7.9891 => 6.1694, std.dev.: 0.2870) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.18% (1.5623 => 1.2627, std.dev.: 0.0642) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.16% (0.1164 => 0.0941, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.83% (1.4235 => 1.2551, std.dev.: 0.0243) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.98% (0.4081 => 0.3633, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout/hash: -10.64% (4.5259 => 4.0442, std.dev.: 0.0516) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.87% (5.0421 => 4.5442, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: -9.11% (0.6628 => 0.6024, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/nestedloop: -8.91% (0.2200 => 0.2004, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: -8.22% (0.1704 => 0.1564, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.96% (4.4540 => 4.0993, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: -7.55% (9.0650 => 8.3802, std.dev.: 0.0352) MultiSource/Benchmarks/Olden/health/health: -6.73% (0.3654 => 0.3408, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.68% (1.6547 => 1.5441, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.50% (46.0987 => 43.1007, std.dev.: 0.5160) SingleSource/Benchmarks/Shootout/ary3: -6.24% (2.2304 => 2.0913, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.03% (23.3986 => 21.9868, std.dev.: 0.2673) MultiSource/Benchmarks/FreeBench/distray/distray: -4.45% (0.2427 => 0.2319, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: -3.57% (3.5443 => 3.4177, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.05% (40.4729 => 39.2379, std.dev.: 0.3848) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.98% (1.0995 => 1.0667, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: -2.85% (1.4244 => 1.3838, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.77% (1.4446 => 1.4046, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.54% (0.5826 => 0.5678, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.42% (42.3194 => 41.2938, std.dev.: 0.2646) MultiSource/Applications/sqlite3/sqlite3: -2.41% (4.4730 => 4.3653, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/mandel-2: -2.18% (0.8521 => 0.8335, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -2.01% (2.8571 => 2.7997, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.84% (3.7662 => 3.6969, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.81% (3.0082 => 2.9538, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.76% (61.0379 => 59.9635, std.dev.: 0.2288) SingleSource/Benchmarks/Misc/ReedSolomon: -1.53% (8.6447 => 8.5124, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.51% (2.4498 => 2.4128, std.dev.: 0.0068) SingleSource/Benchmarks/Stanford/FloatMM: -1.37% (0.8328 => 0.8214, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3596 => 3.3187, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.35% (1.2047 => 1.1162, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.32% (0.0451 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -28.66% (0.0328 => 0.0234, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -21.80% (0.0445 => 0.0348, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/casts: -31.92% (0.0213 => 0.0145, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: -7.05% (0.0227 => 0.0211, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.49% (0.1530 => 0.1446, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -40.03% (1.9293 => 1.1570, std.dev.: 0.0031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.67% (0.4049 => 0.3941, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1510 => 0.1507, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.20% (0.0978 => 0.1068, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.27% (0.0590 => 0.0553, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.04% (1.1617 => 1.1496, std.dev.: 0.1025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -81.25% (0.0032 => 0.0006, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.93% (0.0610 => 0.0525, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.60% (0.0268 => 0.0283, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0086) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.20% (12.7781 => 12.7524, std.dev.: 0.0191) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 22:52:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 00:52:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130115065201.C60C72A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7609?compare_to=7596&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7609, Order: 172499, Start Time: 2013-01-15 03:17:08, End Time: 2013-01-15 06:52:05 To: 7596, Order: 172426, Start Time: 2013-01-14 17:43:05, End Time: 2013-01-14 21:28:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (178 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.31% (0.8460 => 0.8349, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.16% (0.0625 => 0.0876, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.80% (0.1063 => 0.1401, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.25% (0.2969 => 0.3778, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.85% (0.1106 => 0.1403, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.41% (0.5900 => 0.7458, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.34% (0.4139 => 0.5188, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.83% (0.4253 => 0.5309, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.79% (0.0714 => 0.0891, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.80% (0.0584 => 0.0723, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.46% (0.1620 => 0.2000, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.45% (0.4994 => 0.6165, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 22.70% (0.0599 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.56% (0.5000 => 0.6128, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.41% (0.0897 => 0.1098, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.05% (0.0948 => 0.1157, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.75% (0.0584 => 0.0711, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 21.72% (1.5932 => 1.9393, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.14% (0.1003 => 0.1215, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 20.96% (0.1107 => 0.1339, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.95% (0.1604 => 0.1940, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 20.94% (0.1103 => 0.1334, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.66% (0.1549 => 0.1869, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.0821 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.42% (0.3903 => 0.4700, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.26% (0.1619 => 0.1947, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 20.20% (0.0604 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.15% (0.0541 => 0.0650, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 19.64% (0.0947 => 0.1133, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.41% (0.2736 => 0.3267, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 19.06% (0.4029 => 0.4797, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.97% (0.2014 => 0.2396, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.66% (0.1088 => 0.1291, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 18.62% (0.0698 => 0.0828, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734) MultiSource/Benchmarks/McCat/08-main/main: 18.56% (0.1218 => 0.1444, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 18.19% (0.5826 => 0.6886, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.07% (0.1505 => 0.1777, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 18.02% (0.9697 => 1.1444, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.86% (0.2866 => 0.3378, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 17.74% (0.5889 => 0.6934, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.40% (1.8794 => 2.2065, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: 17.40% (0.5546 => 0.6511, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.06% (0.2738 => 0.3205, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.03% (0.3271 => 0.3828, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.88% (1.3152 => 1.5372, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.64% (0.1160 => 0.1353, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 16.59% (0.1284 => 0.1497, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.51% (0.2792 => 0.3253, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.48% (3.5627 => 4.1497, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 16.43% (0.7171 => 0.8349, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.42% (0.2911 => 0.3389, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.40% (1.6211 => 1.8869, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.38% (0.4658 => 0.5421, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 16.38% (0.2803 => 0.3262, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 16.33% (0.2811 => 0.3270, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 16.26% (0.2823 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.26% (0.2725 => 0.3168, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.24% (2.0673 => 2.4031, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.21% (0.1968 => 0.2287, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 16.10% (0.2813 => 0.3266, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.09% (0.3195 => 0.3709, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.09% (0.2729 => 0.3168, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.08% (0.3004 => 0.3487, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 16.01% (0.9909 => 1.1495, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.91% (0.3362 => 0.3897, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.85% (0.3060 => 0.3545, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.75% (0.3930 => 0.4549, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.70% (0.5026 => 0.5815, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 15.52% (0.3267 => 0.3774, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.46% (4.4195 => 5.1027, std.dev.: 0.0214) MultiSource/Benchmarks/McCat/18-imp/imp: 15.41% (0.1421 => 0.1640, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.25% (1.9694 => 2.2698, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 15.16% (0.3317 => 0.3820, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.04% (0.3124 => 0.3594, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 14.93% (0.4361 => 0.5012, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/sieve: 14.90% (0.3726 => 0.4281, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.84% (1.9966 => 2.2929, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 14.82% (1.0781 => 1.2379, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.72% (0.3282 => 0.3765, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 14.65% (0.3678 => 0.4217, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.64% (2.7292 => 3.1288, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3348 => 0.3838, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.59% (0.1028 => 0.1178, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 14.55% (0.3477 => 0.3983, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.51% (0.3845 => 0.4403, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.46% (0.3625 => 0.4149, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 14.37% (23.5202 => 26.8996, std.dev.: 0.0289) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.31% (0.3488 => 0.3987, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 14.30% (0.4251 => 0.4859, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 14.29% (4.2109 => 4.8127, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/hash: 14.28% (0.4146 => 0.4738, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.24% (0.3981 => 0.4548, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.22% (0.3496 => 0.3993, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.07% (0.3690 => 0.4209, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3469 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 14.03% (0.3442 => 0.3925, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.97% (0.3465 => 0.3949, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 13.96% (0.3446 => 0.3927, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.92% (1.4269 => 1.6255, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/property: 13.81% (0.3650 => 0.4154, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.67% (0.1090 => 0.1239, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 13.55% (0.5012 => 0.5691, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: 13.51% (0.3724 => 0.4227, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 13.48% (0.3643 => 0.4134, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 13.29% (0.2566 => 0.2907, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 13.18% (0.7875 => 0.8913, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.31% (0.6435 => 0.7227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.47% (0.2737 => 0.3051, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.36% (2.1653 => 2.4113, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 11.35% (5.5417 => 6.1706, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (0.3498 => 0.3886, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 11.00% (0.2691 => 0.2987, std.dev.: 0.0038) MultiSource/Benchmarks/mafft/pairlocalalign: 10.95% (2.1013 => 2.3314, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/football/football: 10.94% (0.2075 => 0.2302, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 10.89% (4.6177 => 5.1207, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.83% (0.2068 => 0.2292, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.60% (0.3084 => 0.3411, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.37% (0.3336 => 0.3682, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.96% (0.5361 => 0.5895, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.68% (11.6398 => 12.7662, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 9.50% (0.6634 => 0.7264, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 9.37% (0.4847 => 0.5301, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.94% (4.6926 => 5.1121, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.87% (0.7426 => 0.8085, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.68% (0.2040 => 0.2217, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.39% (0.1383 => 0.1499, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 7.40% (0.2391 => 0.2568, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 7.34% (2.0346 => 2.1840, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (0.5584 => 0.5993, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.71% (11.9555 => 12.7583, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.72% (0.3792 => 0.3971, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5250, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.30% (0.5917 => 0.6704, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (0.3693 => 0.4092, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 9.99% (0.2802 => 0.3082, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 5.20% (15.4430 => 16.2466, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6730, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6837, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2007, std.dev.: 0.0052) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3053, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0812, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2081, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5864, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4764, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5719, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.59% (17.2379 => 14.3782, std.dev.: 0.1153) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.83% (0.2402 => 0.2214, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9788, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7999, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9573, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -6.46% (14.0481 => 13.1404, std.dev.: 0.2162) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2304, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8042, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1612, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5768, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1971, std.dev.: 0.0697) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.45s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 23:12:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 01:12:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115071259.D7FB22A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7610?compare_to=7606&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7610, Order: 172504, Start Time: 2013-01-15 05:01:04, End Time: 2013-01-15 07:13:02 To: 7606, Order: 172498, Start Time: 2013-01-15 02:18:38, End Time: 2013-01-15 04:30:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (218 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.23% (1.5151 => 1.5337, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.42% (1.1529 => 1.1693, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.30% (12.2069 => 12.0478, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -2.97% (2.3559 => 2.2860, std.dev.: 0.0113) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7735 => 499.8590, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.53% (1.1277 => 499.8590, std.dev.: 0.0023) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.08% (0.5229 => 1.6737, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 21.17% (14.9895 => 18.1635, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 43.74% (14.1553 => 20.3473, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 18.32% (4.1105 => 4.8636, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.59% (1.1048 => 1.7853, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.10% (7.1582 => 38.5185, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.50% (3.4629 => 6.3891, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.14% (0.6222 => 1.0897, std.dev.: 0.0141) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.72% (0.0720 => 7.4410, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11151700.00% (0.0001 => 11.1518, std.dev.: 0.0291) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849000.00% (0.0001 => 9.8491, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485000.00% (0.0001 => 5.4851, std.dev.: 0.0149) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 829.07% (1.1194 => 10.4000, std.dev.: 0.0289) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 150.98% (22.1758 => 55.6574, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.39% (0.0929 => 0.1778, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.39% (0.1463 => 0.2522, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 64.32% (21.9371 => 36.0463, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.85% (7.0540 => 11.0639, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.62% (2.9384 => 4.6020, std.dev.: 0.0017) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359) MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.90% (1.5859 => 2.3932, std.dev.: 0.0119) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.84% (8.1363 => 12.1914, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.19% (0.0439 => 0.0633) SingleSource/Benchmarks/CoyoteBench/almabench: 41.78% (0.0730 => 0.1035, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.44% (2.2024 => 3.1150, std.dev.: 0.0159) MultiSource/Applications/sgefa/sgefa: 40.53% (0.3109 => 0.4369, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0004) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.72% (4.2646 => 5.7452, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.60% (1.5415 => 2.0749, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.78% (0.4615 => 0.6128, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 31.74% (1.1642 => 1.5337, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.70% (0.2700 => 0.3529, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.60% (0.1892 => 0.2471, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 30.13% (0.1175 => 0.1529, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 30.12% (0.4299 => 0.5594, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.56% (0.6675 => 0.8648, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.82% (0.1125 => 0.1438, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 27.67% (0.1655 => 0.2113, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.64% (0.5105 => 0.6516, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 27.26% (9.4845 => 12.0704, std.dev.: 0.0148) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.74% (0.2554 => 0.3237, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.39% (1.0722 => 1.3551, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.98% (3.8922 => 4.9033, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.14% (1.4186 => 1.7753, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.98% (0.1906 => 0.2363, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.61% (0.3121 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 23.50% (0.4289 => 0.5297, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.13% (0.1695 => 0.2087, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 22.77% (5.7591 => 7.0703, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 22.49% (0.7115 => 0.8715, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.33% (0.0842 => 0.1030, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.22% (4.9449 => 6.0436, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 22.08% (0.4620 => 0.5640, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 21.93% (0.1163 => 0.1418, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 21.64% (3.3354 => 4.0572, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.18% (5.0018 => 6.0610, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 21.09% (0.1555 => 0.1883, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 21.08% (0.3098 => 0.3751, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.77% (0.7835 => 0.9462, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.70% (1.3050 => 1.5752, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 20.41% (0.1695 => 0.2041, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.5860 => 0.7023, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 19.58% (0.6456 => 0.7720, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.34% (0.1029 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.11% (0.1151 => 0.1371, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.09% (0.8172 => 0.9732, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 18.79% (0.7433 => 0.8830, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 18.63% (1.1840 => 1.4046, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.37% (0.2107 => 0.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.35% (0.5020 => 0.5941, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 18.32% (0.3423 => 0.4050, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.24% (0.2758 => 0.3261, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 17.88% (3.8723 => 4.5647, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.58% (0.2065 => 0.2428, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.40% (0.5569 => 0.6538, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.33% (0.9765 => 1.1457, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 17.33% (0.2049 => 0.2404, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.22% (2.0273 => 2.3765, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.18% (0.3307 => 0.3875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.83% (0.1117 => 0.1305, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.71% (0.6450 => 0.7528, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.54% (0.5981 => 0.6970, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 16.50% (0.3387 => 0.3946, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.47% (2.2969 => 2.6753, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.38% (0.8101 => 0.9428, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 16.32% (0.3180 => 0.3699, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 16.21% (10.3673 => 12.0478, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.19% (0.3441 => 0.3998, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.13% (0.8067 => 0.9368, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.65% (1.1861 => 1.3717, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 15.13% (0.8921 => 1.0271, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 14.83% (0.3283 => 0.3770, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 14.29% (0.3232 => 0.3694, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 13.89% (17.1811 => 19.5671, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.41% (1.5603 => 1.7696, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary2: 13.41% (0.3379 => 0.3832, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.02% (14.3668 => 16.2372, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 12.61% (0.3092 => 0.3482, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.21% (0.4636 => 0.5202, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.98% (0.3865 => 0.4328, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.93% (0.3427 => 0.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.31% (0.4103 => 0.4567, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.97% (0.4203 => 0.4664, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 10.94% (0.3886 => 0.4311, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 10.74% (0.3603 => 0.3990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.47% (0.4048 => 0.4472, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.23% (0.3422 => 0.3772, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.91% (0.3684 => 0.4049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.83% (0.3561 => 0.3911, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3826 => 0.4200, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.62% (0.4064 => 0.4455, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 9.61% (63.2438 => 69.3230, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0043) SingleSource/UnitTests/ObjC++/property-reference: 8.23% (0.7326 => 0.7929, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 8.16% (0.2831 => 0.3062, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.84% (1.2842 => 1.3849, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.79% (0.4879 => 0.5259, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/except: 7.70% (0.2871 => 0.3092, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.64% (2.0665 => 2.2244, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 7.47% (0.2877 => 0.3092, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.41% (7.9617 => 8.5519, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.24% (0.3162 => 0.3391, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.19% (0.3935 => 0.4218, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.18% (0.2756 => 0.2954, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3599, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.05% (0.2793 => 0.2990, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.94% (0.2725 => 0.2914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.78% (0.2714 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.58% (0.2266 => 0.2415, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.50% (0.2802 => 0.2984, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.35% (0.3136 => 0.3335, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3125, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2564, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4256, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4572, std.dev.: 0.0030) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3108, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.26% (0.9957 => 1.0282, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.6802 => 8.9174, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.43% (3.6395 => 3.7279, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2892, std.dev.: 0.0535) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (1.7254 => 1.7560, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2790, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 1.52% (1.0785 => 1.0949, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5806, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4589, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1692, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.25% (5.2763 => 1.2004, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.18% (0.8651 => 0.2147, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -41.68% (0.1622 => 0.0946, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.89% (5.3855 => 4.4761, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.44% (5.3526 => 4.4724, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -10.73% (10.4361 => 9.3160, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.76% (1.7609 => 1.6243, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.49% (54.1659 => 50.1068, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.97% (1.9577 => 0.6271, std.dev.: 0.0248) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3069, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0201, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4329, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8581, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0064, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.27% (0.2161 => 0.1723, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2909, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.50% (1.2373 => 1.1693, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.96% (8.1563 => 7.7519, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8145, std.dev.: 0.0108) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.01% (3.6994 => 3.6249, std.dev.: 0.0204) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9574, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.21% (3.7221 => 3.6772, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2304, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8555, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0018) Report Time: 1.64s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 23:29:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 01:29:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115072933.7F2B42A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7611?compare_to=7607&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7611, Order: 172508, Start Time: 2013-01-15 05:55:11, End Time: 2013-01-15 07:29:37 To: 7607, Order: 172504, Start Time: 2013-01-15 03:57:44, End Time: 2013-01-15 05:31:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.41% (0.0717 => 0.1186, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.24% (0.0974 => 0.1551, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0044) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.04% (0.6395 => 0.8764, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.32% (0.6395 => 0.8654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.58% (0.6260 => 0.8362, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.54% (0.5688 => 0.7539, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.35% (0.5805 => 0.7683, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.07% (0.5456 => 0.7206, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.77% (0.6230 => 0.8209, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.28% (0.5581 => 0.7327, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.22% (0.5567 => 0.7305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.17% (0.5941 => 0.7793, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.85% (0.5802 => 0.7592, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.45% (0.6033 => 0.7870, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.32% (0.5705 => 0.7435, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.04% (0.5849 => 0.7606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.90% (0.5859 => 0.7611, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.66% (0.5478 => 0.7103, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.57% (0.5570 => 0.7217, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.57% (0.6440 => 0.8344, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.43% (0.5569 => 0.7208, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.28% (0.5925 => 0.7660, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.10% (0.5591 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.26% (0.5863 => 0.7520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.21% (0.6676 => 0.8559, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.19% (0.5857 => 0.7508, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.03% (0.6446 => 0.8253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.33% (1.6474 => 2.0976, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.67% (0.6194 => 0.7846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.16% (0.6660 => 0.8402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.12% (0.6297 => 0.7942, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.91% (0.6681 => 0.8412, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.49% (0.6667 => 0.8300, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.10% (0.7524 => 0.9262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.31% (0.7339 => 0.8976, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.15% (2.2587 => 2.7138, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 17.04% (1.1450 => 1.3401, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.48% (0.3357 => 0.3843, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.43% (1.6364 => 1.8398, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.31% (0.1982 => 0.2226, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.92% (0.3834 => 0.4291, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.54% (4.5069 => 5.0270, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.43% (0.4916 => 0.5478, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 10.81% (0.4515 => 0.5003, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.23% (3.5339 => 3.8955, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2385 => 0.2598, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 8.91% (9.2283 => 10.0508, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.83% (0.7021 => 0.7641, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.87% (1.2515 => 1.3500, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.24% (0.5329 => 0.5715, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.05% (0.2001 => 0.2142, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.88% (1.4642 => 1.5650, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.55% (1.2784 => 1.3621, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4524 => 0.4796, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.31% (0.4861 => 0.5119, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.33% (5.0226 => 5.1899, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.3864 => 1.4297, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.68% (5.4682 => 5.6149, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.39% (3.5154 => 3.5994, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (22.4056 => 22.9127, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 2.03% (0.6750 => 0.6887, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.76% (0.8418 => 0.8566, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.51% (15.5079 => 15.7414, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.21% (1.3722 => 1.3888, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.04% (16.1920 => 16.3601, std.dev.: 0.0257) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6694, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.93% (0.9531 => 1.0287, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4414, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1690, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5339, std.dev.: 0.0334) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0072) MultiSource/Benchmarks/llubenchmark/llu: 2.37% (3.7435 => 3.8323, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2856, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6041, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4786, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -7.26% (0.3194 => 0.2962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.57% (0.2871 => 0.2711, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.52% (0.3059 => 0.2890, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.51% (0.3831 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.41% (0.2903 => 0.2746, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.12% (2.1713 => 2.0601, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hello: -5.09% (0.2849 => 0.2704, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.08% (0.2933 => 0.2784, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.99% (0.3205 => 0.3045, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.97% (0.3884 => 0.3691, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -4.83% (1.3148 => 1.2513, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: -4.82% (0.3026 => 0.2880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.76% (0.4199 => 0.3999, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.74% (0.9852 => 0.9385, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.74% (0.2428 => 0.2313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.74% (0.3252 => 0.3098, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.69% (0.3323 => 0.3167, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.4151 => 0.3963, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4280 => 0.4091, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: -4.20% (0.3621 => 0.3469, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.15% (0.7779 => 0.7456, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.98% (2.4924 => 2.3931, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: -3.88% (0.3867 => 0.3717, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.61% (0.4427 => 0.4267, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -3.60% (0.4248 => 0.4095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.59% (0.3931 => 0.3790, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.56% (0.3788 => 0.3653, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.55% (0.9542 => 0.9203, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.10% (0.4813 => 0.4664, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.04% (0.4083 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.90% (20.7746 => 20.1712, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.32% (0.7919 => 0.7735, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.29% (1.0544 => 1.0303, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -2.19% (0.7982 => 0.7807, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.94% (0.9179 => 0.9001, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.90% (4.3330 => 4.2505, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.87% (1.2221 => 1.1993, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.84% (1.2210 => 1.1985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.49% (0.7198 => 0.7091, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8521 => 0.8397, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.43% (14.2083 => 14.0053, std.dev.: 0.0149) MultiSource/Applications/siod/siod: -1.35% (2.4021 => 2.3697, std.dev.: 0.0024) MultiSource/Applications/hbd/hbd: -1.31% (1.5610 => 1.5405, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.05% (34.0927 => 33.7348, std.dev.: 0.0159) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.70% (1.8100 => 0.6751, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3150, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.53% (4.3504 => 3.2399, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0255, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7546, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0319, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3831, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2076, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1297, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1033, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.00% (7.9763 => 7.7372, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.55% (1.3096 => 1.2762, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: -2.43% (3.7241 => 3.6336, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1177, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.57% (1.6086 => 1.5833, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1929, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.52% (4.8776 => 4.8036, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7092 => 3.6658, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.15% (1.6307 => 1.6120, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6219 => 1.6036, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 14 23:49:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 01:49:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115074928.8F5562A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7612?compare_to=7608&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7612, Order: 172508, Start Time: 2013-01-15 05:49:13, End Time: 2013-01-15 07:49:35 To: 7608, Order: 172504, Start Time: 2013-01-15 03:33:38, End Time: 2013-01-15 05:32:11 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 10 (7 on baseline) Performance Improvements: 2 (68 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1051 (988 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.57% (0.7372 => 0.7488, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.39% (0.9585 => 0.9718, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.42% (1.4590 => 1.8445, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.01% (14.3652 => 15.9474, std.dev.: 0.5939) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.00% (1.2456 => 1.3079, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.72% (2.3561 => 2.4437, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/ReedSolomon: 2.04% (8.5124 => 8.6859, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.73% (5.3003 => 5.3919, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.71% (4.3843 => 4.4593, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.08% (11.5158 => 11.6396, std.dev.: 0.0313) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -7.69% (7.4104 => 6.8406, std.dev.: 0.1984) MultiSource/Benchmarks/BitBench/five11/five11: -1.18% (5.7184 => 5.6508, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.40% (1.1162 => 1.1117, std.dev.: 0.0297) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.71% (0.0427 => 0.0377, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0333 => 0.0336) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 12.39% (0.0234 => 0.0263, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.53% (0.0348 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 42.07% (0.0145 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 4.74% (0.0211 => 0.0221, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.58% (0.0253 => 0.0249, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1446 => 0.1458, std.dev.: 0.0200) MultiSource/Applications/lemon/lemon: -0.60% (1.1570 => 1.1501, std.dev.: 0.2470) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.04% (0.3941 => 0.3982, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.46% (0.1507 => 0.1470, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.49% (0.1068 => 0.1020, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.78% (0.0553 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.77% (1.1496 => 1.1585, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 383.33% (0.0006 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -19.23% (0.0026 => 0.0021, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.52% (0.0525 => 0.0517, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.07% (0.0283 => 0.0303, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.7409 => 0.7471, std.dev.: 0.0051) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.00% (0.0050 => 0.0045, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7524 => 12.7204, std.dev.: 0.5070) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.64% (0.7225 => 0.7488, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319562.50% (0.0008 => 2.5573, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.66% (1.1825 => 2.4437, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.39% (0.2562 => 0.2777, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/pi: 3.57% (2.1390 => 2.2154, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.69% (4.3851 => 4.4593, std.dev.: 0.0121) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.31% (0.0808 => 0.0450, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.70% (0.0727 => 0.0482, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.19% (0.0692 => 0.0490, std.dev.: 0.0013) SingleSource/Benchmarks/SmallPT/smallpt: -26.27% (0.1888 => 0.1392, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.82% (0.1684 => 0.1266, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.54% (0.1079 => 0.0879, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.46% (1.0960 => 0.9046, std.dev.: 0.0252) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.35% (0.1009 => 0.0844, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.88% (1.0986 => 0.9241, std.dev.: 0.0380) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.83% (0.7686 => 0.6469, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.48% (0.4074 => 0.3484, std.dev.: 0.0153) MultiSource/Applications/spiff/spiff: -13.28% (1.0220 => 0.8863, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -12.17% (9.8875 => 8.6841, std.dev.: 0.1542) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.16% (0.0847 => 0.0744, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: -11.42% (2.4719 => 2.1897, std.dev.: 0.0678) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.07% (0.1210 => 0.1076, std.dev.: 0.0028) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.64% (1.2154 => 1.0861, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.40% (1.3924 => 1.2476, std.dev.: 0.0318) MultiSource/Applications/aha/aha: -10.38% (0.1378 => 0.1235, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -10.20% (1.5979 => 1.4349, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.77% (1.5131 => 1.3653, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.74% (0.2372 => 0.2141, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.63% (0.7693 => 0.6952, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -9.41% (0.8653 => 0.7839, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -8.96% (2.6437 => 2.4069, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -8.57% (0.2100 => 0.1920, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -8.31% (0.3598 => 0.3299, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.17% (10.2703 => 9.4315, std.dev.: 0.0873) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.02% (1.6874 => 1.5521, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.93% (0.9550 => 0.8888, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/moments: -6.57% (0.4002 => 0.3739, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: -6.54% (0.1928 => 0.1802, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.49% (0.9588 => 0.8966, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -6.47% (0.5134 => 0.4802, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.90% (1.8127 => 1.7058, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary: -5.84% (0.2551 => 0.2402, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.69% (0.2618 => 0.2469, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -5.57% (0.2172 => 0.2051, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.45% (0.9127 => 0.8630, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.2725 => 0.2578, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.15% (0.3981 => 0.3776, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.08% (0.3665 => 0.3479, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: -4.80% (0.4689 => 0.4464, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -4.68% (0.2135 => 0.2035, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -4.65% (0.3206 => 0.3057, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.63% (1.0234 => 0.9760, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.14% (0.3093 => 0.2965, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.11% (1.3220 => 1.2677, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.04% (0.6934 => 0.6654, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: -3.90% (4.5936 => 4.4145, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.32% (1.0052 => 0.9718, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -2.01% (0.9759 => 0.9563, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -24.33% (4.2042 => 3.1812, std.dev.: 0.2519) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -11.11% (1.4588 => 1.2968, std.dev.: 0.0256) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.51% (2.8778 => 2.5753, std.dev.: 0.0861) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -10.26% (4.5259 => 4.0614, std.dev.: 0.1090) SingleSource/Benchmarks/Shootout-C++/lists1: -8.22% (0.6628 => 0.6083, std.dev.: 0.0196) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: -7.51% (0.1704 => 0.1576, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.04% (23.3986 => 21.9848, std.dev.: 0.2343) MultiSource/Benchmarks/Olden/health/health: -5.53% (0.3654 => 0.3452, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.00% (0.3349 => 0.3215, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -2.68% (17.2182 => 16.7566, std.dev.: 0.0669) MultiSource/Applications/spiff/spiff: -1.94% (2.8571 => 2.8016, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.38% (3.1921 => 3.1479, std.dev.: 0.0059) SingleSource/Benchmarks/SmallPT/smallpt: -1.13% (14.9448 => 14.7761, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout/matrix: -1.00% (1.5825 => 1.5666, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.72% (1.2047 => 1.1117, std.dev.: 0.0297) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.41% (0.0451 => 0.0377, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.82% (0.0328 => 0.0263, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.09% (0.0445 => 0.0409, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.35% (0.0255 => 0.0249, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.71% (0.1530 => 0.1458, std.dev.: 0.0200) MultiSource/Applications/lemon/lemon: -40.39% (1.9293 => 1.1501, std.dev.: 0.2470) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.65% (0.4049 => 0.3982, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.65% (0.1510 => 0.1470, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -33.33% (0.0009 => 0.0006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.29% (0.0978 => 0.1020, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.02% (0.0590 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1617 => 1.1585, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -22.22% (0.0027 => 0.0021, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.25% (0.0610 => 0.0517, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.06% (0.0268 => 0.0303, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.46% (0.7437 => 0.7471, std.dev.: 0.0051) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.09% (0.0092 => 0.0045, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (12.7781 => 12.7204, std.dev.: 0.5070) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 01:30:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 03:30:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115093057.DDBCF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7613?compare_to=7611&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7613, Order: 172514, Start Time: 2013-01-15 07:53:08, End Time: 2013-01-15 09:31:02 To: 7611, Order: 172508, Start Time: 2013-01-15 05:55:11, End Time: 2013-01-15 07:29:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (104 on baseline) Performance Improvements: 0 (120 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1100 (868 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.63% (0.8397 => 0.8534, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 1.05% (1.1454 => 1.1574, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 1.03% (4.2505 => 4.2943, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.11% (79.3095 => 80.9858, std.dev.: 0.5437) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.97% (0.0717 => 0.1190, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.94% (0.0267 => 0.0387, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.25% (0.6395 => 0.8777, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.84% (0.1132 => 0.1549, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.57% (0.6395 => 0.8670, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.53% (0.6260 => 0.8359, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.56% (0.5688 => 0.7540, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.10% (0.6230 => 0.8230, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.36% (0.5567 => 0.7313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.35% (0.5575 => 0.7323, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.14% (0.5581 => 0.7319, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.14% (0.5941 => 0.7791, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.95% (0.5802 => 0.7598, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.60% (0.5705 => 0.7451, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.47% (0.6033 => 0.7871, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.28% (0.5849 => 0.7620, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.92% (0.5859 => 0.7612, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.90% (0.5478 => 0.7116, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.69% (0.5570 => 0.7224, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.49% (0.6440 => 0.8339, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.48% (0.5569 => 0.7211, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.35% (0.5925 => 0.7664, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.17% (0.5591 => 0.7222, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.47% (0.0699 => 0.0898, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.44% (0.5857 => 0.7523, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.33% (0.6676 => 0.8567, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.31% (0.6189 => 0.7941, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.19% (0.5863 => 0.7516, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.13% (0.6446 => 0.8259, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.76% (0.6304 => 0.8054, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.43% (1.6474 => 2.0993, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.61% (0.6194 => 0.7842, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.34% (0.6681 => 0.8441, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.19% (0.6297 => 0.7946, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.51% (0.6667 => 0.8301, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.21% (0.7524 => 0.9270, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.52% (0.7339 => 0.8992, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.21% (2.2587 => 2.7152, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.35% (0.0680 => 0.0798, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 17.07% (1.1450 => 1.3404, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.83% (0.3357 => 0.3855, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.57% (0.1982 => 0.2251, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.07% (1.6364 => 1.8503, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 12.60% (0.4515 => 0.5084, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.96% (4.5069 => 5.0461, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.64% (0.4916 => 0.5488, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.35% (3.5339 => 3.8996, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2385 => 0.2606, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.20% (9.2283 => 10.0774, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 8.45% (1.2515 => 1.3573, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.36% (0.5329 => 0.5721, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.4642 => 1.5692, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.71% (1.2784 => 1.3642, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.59% (0.1731 => 0.1845, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.48% (0.4524 => 0.4817, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.41% (0.4861 => 0.5124, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2002, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 3.44% (1.3864 => 1.4341, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (5.4682 => 5.6245, std.dev.: 0.0090) MultiSource/Applications/d/make_dparser: 2.75% (3.5154 => 3.6121, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 2.63% (0.8418 => 0.8639, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.38% (22.4056 => 22.9389, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.6750 => 0.6903, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 1.84% (15.5079 => 15.7927, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.3722 => 1.3911, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 1.31% (16.1920 => 16.4047, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.9557 => 0.9674, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (4.8161 => 4.8714, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (4.0323 => 4.0763, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6747, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.92% (0.9531 => 1.0286, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.98% (1.2783 => 1.3675, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.73% (5.1955 => 5.4415, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1685, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3806, std.dev.: 0.5817) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2866, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6028, std.dev.: 0.0043) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 1.03% (4.4335 => 4.4793, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -6.98% (0.3194 => 0.2971, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.81% (0.3837 => 0.3614, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.23% (0.3057 => 0.2897, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.17% (0.2903 => 0.2753, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.10% (0.3059 => 0.2903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.98% (0.2849 => 0.2707, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.91% (0.2933 => 0.2789, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.89% (0.3025 => 0.2877, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.79% (2.1713 => 2.0674, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.54% (0.3323 => 0.3172, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -4.53% (0.3026 => 0.2889, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.53% (0.9852 => 0.9406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.52% (0.2989 => 0.2854, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.43% (1.3148 => 1.2566, std.dev.: 0.0197) SingleSource/UnitTests/ObjC/exceptions-2: -4.41% (0.3831 => 0.3662, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.35% (0.3812 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.30% (0.3880 => 0.3713, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.09% (0.4176 => 0.4005, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.97% (0.4151 => 0.3986, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -3.89% (2.4924 => 2.3954, std.dev.: 0.0076) SingleSource/UnitTests/ObjC++/Hello: -3.78% (0.6347 => 0.6107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.69% (0.7779 => 0.7492, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -3.67% (0.4199 => 0.4045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.65% (0.3867 => 0.3726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.52% (0.6441 => 0.6214, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.9542 => 0.9209, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/moments: -3.48% (0.4248 => 0.4100, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.43% (0.3931 => 0.3796, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -3.36% (0.4280 => 0.4136, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.28% (0.3658 => 0.3538, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.16% (0.4427 => 0.4287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (0.3849 => 0.3733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -2.98% (0.3788 => 0.3675, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.87% (0.4813 => 0.4675, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.71% (20.7746 => 20.2121, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.38% (0.4321 => 0.4218, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.94% (0.7919 => 0.7765, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.88% (1.0544 => 1.0346, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: -1.70% (0.9179 => 0.9023, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.40% (1.2221 => 1.2050, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.39% (0.7982 => 0.7871, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (1.2210 => 1.2054, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.06% (14.2083 => 14.0578, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -1.05% (2.4021 => 2.3768, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.59% (1.8100 => 0.6772, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.62% (0.1622 => 0.1028, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3146, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2406, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.73% (1.3643 => 1.0269, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0431, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1282, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8589, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.29% (1.3096 => 1.2665, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.15% (7.9763 => 7.7247, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6433, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4653, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3040 => 7.1985, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7092 => 3.6640, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 01:57:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 03:57:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115095703.E36832A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7614?compare_to=7610&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7614, Order: 172510, Start Time: 2013-01-15 07:43:15, End Time: 2013-01-15 09:57:08 To: 7610, Order: 172504, Start Time: 2013-01-15 05:01:04, End Time: 2013-01-15 07:13:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (213 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (660 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 7.81% (0.6271 => 0.6761, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.68% (0.0651 => 0.0688, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: -2.29% (499.8590 => 488.3890, std.dev.: 5.4044) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 43208.42% (1.1277 => 488.3890, std.dev.: 5.4044) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.71% (0.5229 => 1.6770, std.dev.: 0.0458) MultiSource/Applications/SPASS/SPASS: 21.38% (14.9895 => 18.1946, std.dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: 43.61% (14.1553 => 20.3287, std.dev.: 0.5307) MultiSource/Benchmarks/MallocBench/gs/gs: 18.62% (4.1105 => 4.8758, std.dev.: 0.0152) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.69% (1.1048 => 1.7863, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.28% (7.1582 => 38.5309, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.61% (3.4629 => 6.3929, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.90% (0.6222 => 1.0882, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.75% (0.0720 => 7.4439, std.dev.: 0.1253) MultiSource/Applications/SIBsim4/SIBsim4: 3835200.00% (0.0001 => 3.8353, std.dev.: 0.0153) MultiSource/Applications/SPASS/SPASS: 11142600.00% (0.0001 => 11.1427, std.dev.: 0.0200) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5497000.00% (0.0001 => 5.4971, std.dev.: 0.0209) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 834.95% (1.1194 => 10.4658, std.dev.: 0.0408) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 152.62% (22.1758 => 56.0207, std.dev.: 0.9610) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.28% (0.0929 => 0.1777, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.39% (0.1463 => 0.2522, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 64.53% (21.9371 => 36.0926, std.dev.: 0.1165) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.55% (7.0540 => 11.1133, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.82% (2.9384 => 4.6080, std.dev.: 0.0030) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.97% (1.5859 => 2.3942, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.34% (8.1363 => 12.2324, std.dev.: 0.0224) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.27% (2.2024 => 3.1113, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.32% (0.0439 => 0.0616, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 39.95% (0.3109 => 0.4351, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0067) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.85% (4.2646 => 5.7508, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.71% (1.5415 => 2.0766, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.85% (0.4615 => 0.6131, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 31.61% (1.1642 => 1.5322, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.31% (0.2271 => 0.2982, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.55% (0.1892 => 0.2470, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.52% (0.2700 => 0.3524, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 29.77% (0.4299 => 0.5579, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.48% (0.6675 => 0.8643, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 27.64% (9.4845 => 12.1061, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.62% (0.5105 => 0.6515, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 26.98% (0.2554 => 0.3243, std.dev.: 0.0091) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 26.71% (0.1655 => 0.2097, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 26.41% (1.0722 => 1.3554, std.dev.: 0.0391) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.05% (3.8922 => 4.9060, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.54% (0.1566 => 0.1966, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.31% (0.3121 => 0.3911, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.92% (1.4186 => 1.7721, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.24% (0.1906 => 0.2368, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 23.69% (0.4289 => 0.5305, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 23.67% (0.7115 => 0.8799, std.dev.: 0.0186) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.53% (0.1143 => 0.1412, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/em3d/em3d: 23.36% (0.1695 => 0.2091, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 22.87% (5.7591 => 7.0762, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.70% (4.9449 => 6.0672, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.42% (0.1695 => 0.2075, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 22.15% (0.0614 => 0.0750, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 22.06% (0.4620 => 0.5639, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.05% (0.0730 => 0.0891, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819) MultiSource/Benchmarks/Olden/mst/mst: 21.75% (0.1163 => 0.1416, std.dev.: 0.0049) MultiSource/Applications/d/make_dparser: 21.63% (3.3354 => 4.0569, std.dev.: 0.0083) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.36% (5.0018 => 6.0700, std.dev.: 0.0114) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.31% (0.7835 => 0.9505, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 21.08% (0.3098 => 0.3751, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.85% (1.3050 => 1.5771, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.65% (0.0770 => 0.0929, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.34% (0.5860 => 0.7052, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 19.59% (0.6456 => 0.7721, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 19.43% (0.3423 => 0.4088, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.40% (0.8172 => 0.9757, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.2107 => 0.2512, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 18.67% (1.1840 => 1.4050, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.54% (0.1510 => 0.1790, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.29% (0.5020 => 0.5938, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 18.06% (3.8723 => 4.5717, std.dev.: 0.1200) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.03% (0.5569 => 0.6573, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 17.99% (0.7433 => 0.8770, std.dev.: 0.0278) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.92% (0.6450 => 0.7606, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.56% (0.9765 => 1.1480, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 17.34% (2.0273 => 2.3789, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.15% (0.3307 => 0.3874, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.02% (0.5981 => 0.6999, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 16.59% (0.3387 => 0.3949, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.59% (0.8101 => 0.9445, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 16.49% (2.2969 => 2.6757, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/09-vor/vor: 16.48% (0.3180 => 0.3704, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/ReedSolomon: 16.40% (0.2049 => 0.2385, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.23% (0.8067 => 0.9376, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: 16.17% (10.3673 => 12.0433, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.11% (1.1861 => 1.3772, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.75% (0.3441 => 0.3983, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: 14.90% (0.8921 => 1.0250, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: 14.77% (0.3283 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 14.20% (0.3232 => 0.3691, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 14.15% (1.5603 => 1.7811, std.dev.: 0.0468) MultiSource/Applications/sqlite3/sqlite3: 13.98% (17.1811 => 19.5823, std.dev.: 0.3917) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.87% (0.2603 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.08% (0.3379 => 0.3821, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.02% (14.3668 => 16.2380, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bh/bh: 12.45% (0.3092 => 0.3477, std.dev.: 0.0121) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.32% (0.4636 => 0.5207, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.28% (0.3427 => 0.3848, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.13% (0.3865 => 0.4334, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.33% (0.3927 => 0.4372, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.26% (0.4103 => 0.4565, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.13% (0.4203 => 0.4671, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 11.04% (0.3886 => 0.4315, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.38% (0.3603 => 0.3977, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 10.32% (0.3422 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.28% (0.4048 => 0.4464, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 9.93% (0.3684 => 0.4050, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-3: 9.87% (0.3516 => 0.3863, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 9.84% (63.2438 => 69.4695, std.dev.: 0.1189) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3826 => 0.4199, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.06% (0.4064 => 0.4432, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.97% (0.1438 => 0.1567, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.14% (0.4879 => 0.5276, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/strcat: 8.09% (0.2831 => 0.3060, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.02% (0.5925 => 0.6400, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/except: 7.73% (0.2871 => 0.3093, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.63% (7.9617 => 8.5693, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.63% (2.0665 => 2.2242, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.56% (2.2022 => 2.3687, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.42% (0.3650 => 0.3921, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.27% (0.3935 => 0.4221, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.99% (0.2891 => 0.3093, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.95% (0.2905 => 0.3107, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.75% (0.2756 => 0.2942, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.66% (0.2266 => 0.2417, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 6.59% (0.3052 => 0.3253, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.52% (0.2793 => 0.2975, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 6.30% (0.2714 => 0.2885, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.28% (0.3136 => 0.3333, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2494, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (1.1145 => 1.2946, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (4.2280 => 4.4488, std.dev.: 0.0099) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1578 => 3.3098, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.62% (3.6395 => 3.7348, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.6802 => 8.9021, std.dev.: 0.0308) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (1.7254 => 1.7560, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2799, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.49% (1.0785 => 1.0946, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.11% (5.2763 => 1.2078, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.11% (0.8651 => 0.2153, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.50% (5.3855 => 4.4968, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.06% (5.3526 => 4.4930, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: -10.62% (10.4361 => 9.3283, std.dev.: 0.0215) SingleSource/UnitTests/Vector/constpool: -7.56% (54.1659 => 50.0693, std.dev.: 0.7330) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.52% (1.7609 => 1.6285, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.46% (1.9577 => 0.6761, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -41.25% (0.0400 => 0.0235, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.42% (0.3987 => 0.2495, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3089, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4263, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8649, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0070, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -18.51% (0.2161 => 0.1761, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.79% (2.5528 => 2.1242, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-6: -15.68% (1.6925 => 1.4272, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2880, std.dev.: 0.0211) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.85% (1.8329 => 1.7073, std.dev.: 0.0322) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0065) SingleSource/Benchmarks/McGill/chomp: -5.92% (1.2373 => 1.1641, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.23% (8.1563 => 7.7295, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8256, std.dev.: 0.0086) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -1.56% (3.7221 => 3.6642, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2241, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.49% (0.2116 => 0.0688, std.dev.: 0.0028) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 02:10:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 04:10:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115101011.D02D02A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7615?compare_to=7612&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7615, Order: 172514, Start Time: 2013-01-15 08:08:58, End Time: 2013-01-15 10:10:18 To: 7612, Order: 172508, Start Time: 2013-01-15 05:49:13, End Time: 2013-01-15 07:49:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 11 (10 on baseline) Performance Improvements: 5 (63 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1047 (990 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 3.10% (1.0094 => 1.0407, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: 1.97% (16.1740 => 16.4929, std.dev.: 0.0899) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 10.70% (20.0431 => 22.1874, std.dev.: 0.7288) SingleSource/Benchmarks/Linpack/linpack-pc: 6.59% (47.6717 => 50.8149, std.dev.: 0.0756) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.75% (0.2777 => 0.2881, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.37% (1.2968 => 1.3405, std.dev.: 0.0061) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.84% (9.2087 => 9.4701, std.dev.: 0.0476) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (63.1404 => 64.3751, std.dev.: 0.1884) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (3.4241 => 3.4806, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.15% (4.0075 => 4.0535, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/random: 1.01% (2.4526 => 2.4773, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.53% (2.4437 => 2.3330, std.dev.: 0.0386) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.60% (0.5337 => 0.5198, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: -1.85% (8.6859 => 8.5251, std.dev.: 0.0538) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (1.7750 => 1.7436, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.19% (4.4593 => 4.4063, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.03% (1.1117 => 1.1231, std.dev.: 0.0508) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.94% (0.0222 => 0.0140, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.16% (0.0377 => 0.0350, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0336 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 20.91% (0.0263 => 0.0318, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.89% (0.0409 => 0.0429, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.22% (0.0249 => 0.0236, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1458 => 0.1463, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 8.01% (1.1501 => 1.2422, std.dev.: 0.2515) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.88% (0.3982 => 0.4017, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.82% (0.1470 => 0.1482, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.33% (0.0006 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.63% (0.1020 => 0.0983, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.01% (0.0266 => 0.0274, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.36% (0.0596 => 0.0570, std.dev.: 0.0117) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1585 => 1.1520, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 28.57% (0.0021 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.76% (0.0517 => 0.0614, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.30% (0.0303 => 0.0313, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.54% (0.7471 => 0.7431, std.dev.: 0.0318) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.33% (0.0045 => 0.0078, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.27% (12.7204 => 12.7543, std.dev.: 0.1346) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 3.63% (9.5202 => 9.8660, std.dev.: 0.0411) MultiSource/Benchmarks/Bullet/bullet: 1.26% (33.2440 => 33.6616, std.dev.: 0.0828) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320125.00% (0.0008 => 2.5618, std.dev.: 0.0753) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.29% (1.1825 => 2.3330, std.dev.: 0.0386) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.45% (0.2562 => 0.2881, std.dev.: 0.0037) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.13% (9.0082 => 9.4701, std.dev.: 0.0476) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (4.1668 => 4.2896, std.dev.: 0.0274) MultiSource/Applications/JM/lencod/lencod: 2.34% (6.8159 => 6.9757, std.dev.: 0.0594) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (63.1520 => 64.3751, std.dev.: 0.1884) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0006) SingleSource/Benchmarks/SmallPT/smallpt: -27.65% (0.1888 => 0.1366, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.33% (0.0862 => 0.0704, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -16.91% (1.8964 => 1.5758, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.89% (1.0960 => 0.9219, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.47% (1.0986 => 0.9287, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: -12.70% (1.0220 => 0.8922, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.96% (6.4235 => 5.7195, std.dev.: 0.1108) MultiSource/Applications/hexxagon/hexxagon: -8.97% (1.1433 => 1.0407, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -8.68% (2.6437 => 2.4142, std.dev.: 0.0852) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.96% (0.2372 => 0.2207, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: -6.79% (0.1928 => 0.1797, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.59% (0.9550 => 0.8921, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: -6.33% (0.2385 => 0.2234, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -6.20% (0.4002 => 0.3754, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.19% (0.2100 => 0.1970, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.12% (1.6874 => 1.5842, std.dev.: 0.0376) SingleSource/Benchmarks/Shootout-C++/fibo: -6.08% (0.2006 => 0.1884, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: -6.06% (0.5134 => 0.4823, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -5.88% (0.2551 => 0.2401, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: -5.41% (17.4365 => 16.4929, std.dev.: 0.0899) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.37% (0.3462 => 0.3276, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.36% (0.9127 => 0.8638, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -5.25% (0.2135 => 0.2023, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: -4.97% (0.2172 => 0.2064, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.83% (0.9788 => 0.9315, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.80% (0.3981 => 0.3790, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.78% (0.9405 => 0.8955, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.71% (0.9091 => 0.8663, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: -4.66% (0.2725 => 0.2598, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -4.49% (0.2564 => 0.2449, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -4.16% (0.4689 => 0.4494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.15% (0.3665 => 0.3513, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.06% (1.0052 => 0.9644, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: -3.82% (3.7840 => 3.6393, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.70% (0.9488 => 0.9137, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists1: -3.40% (0.3206 => 0.3097, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.32% (1.0860 => 1.0499, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.95% (1.0119 => 0.9820, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.03% (0.9381 => 0.9191, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -29.36% (4.4739 => 3.1603, std.dev.: 0.1313) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.45% (4.2042 => 3.1764, std.dev.: 0.2161) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.61% (1.5623 => 1.2872, std.dev.: 0.1055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.85% (0.0845 => 0.0728, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.05% (2.8778 => 2.5886, std.dev.: 0.1091) SingleSource/Benchmarks/Shootout/hash: -9.87% (4.5259 => 4.0791, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists1: -8.75% (0.6628 => 0.6048, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.14% (0.3217 => 0.2955, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.11% (1.4588 => 1.3405, std.dev.: 0.0061) MultiSource/Applications/oggenc/oggenc: -5.93% (0.1704 => 0.1603, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: -5.82% (2.2304 => 2.1006, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -3.79% (1.8123 => 1.7436, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: -3.13% (17.2182 => 16.6799, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/ffbench: -3.03% (1.4244 => 1.3812, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: -1.92% (0.8521 => 0.8357, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -1.86% (4.4730 => 4.3899, std.dev.: 0.0296) MultiSource/Applications/SIBsim4/SIBsim4: -1.80% (3.5443 => 3.4806, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: -1.48% (2.8571 => 2.8147, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3596 => 3.3166, std.dev.: 0.0037) SingleSource/Benchmarks/SmallPT/smallpt: -1.24% (14.9448 => 14.7595, std.dev.: 0.0249) MultiSource/Benchmarks/Bullet/bullet: -1.22% (7.2040 => 7.1164, std.dev.: 0.0293) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.16% (3.7662 => 3.7226, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.08% (3.1921 => 3.1577, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.77% (1.2047 => 1.1231, std.dev.: 0.0508) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.91% (0.0233 => 0.0140, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -22.39% (0.0451 => 0.0350, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.45% (0.0255 => 0.0236, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.38% (0.1530 => 0.1463, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -35.61% (1.9293 => 1.2422, std.dev.: 0.2515) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4049 => 0.4017, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.85% (0.1510 => 0.1482, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.51% (0.0978 => 0.0983, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.39% (0.0590 => 0.0570, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1617 => 1.1520, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.79% (0.0268 => 0.0313, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.08% (0.7437 => 0.7431, std.dev.: 0.0318) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.19% (12.7781 => 12.7543, std.dev.: 0.1346) Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 03:28:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 05:28:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115112842.664A32A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7616?compare_to=7613&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7616, Order: 172517, Start Time: 2013-01-15 09:54:44, End Time: 2013-01-15 11:28:42 To: 7613, Order: 172514, Start Time: 2013-01-15 07:53:08, End Time: 2013-01-15 09:31:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 1 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 6.93% (3.7945 => 4.0573, std.dev.: 0.0357) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8534 => 0.8409, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.69% (0.0717 => 0.1188, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.22% (0.6395 => 0.8775, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.37% (0.6395 => 0.8657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.47% (0.6260 => 0.8355, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.42% (0.5805 => 0.7687, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.42% (0.5688 => 0.7532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.43% (0.5575 => 0.7327, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.29% (0.5567 => 0.7309, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.16% (0.5941 => 0.7792, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.83% (0.5802 => 0.7591, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.38% (0.5705 => 0.7438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.33% (0.6033 => 0.7863, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.06% (0.5859 => 0.7620, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.02% (0.5849 => 0.7605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.86% (0.5478 => 0.7114, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.52% (0.5569 => 0.7213, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.52% (0.5570 => 0.7214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.33% (0.5591 => 0.7231, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.44% (0.5857 => 0.7523, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.36% (0.6189 => 0.7944, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.22% (0.6676 => 0.8560, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.21% (0.5863 => 0.7517, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.21% (0.6052 => 0.7759, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.88% (0.6446 => 0.8243, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.41% (1.6474 => 2.0989, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.74% (0.6194 => 0.7850, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.09% (0.6297 => 0.7940, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.06% (0.6681 => 0.8422, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.13% (0.7524 => 0.9264, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.52% (0.7339 => 0.8992, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.12% (2.2587 => 2.7131, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 16.95% (1.1450 => 1.3391, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3357 => 0.3847, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.74% (1.6364 => 1.8448, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.70% (4.5069 => 5.0341, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.43% (0.4916 => 0.5478, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 10.90% (0.4515 => 0.5007, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.34% (3.5339 => 3.8994, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (9.2283 => 10.0556, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.21% (1.2515 => 1.3543, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.22% (0.5329 => 0.5714, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.97% (1.4642 => 1.5662, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.87% (1.2784 => 1.3662, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 5.33% (0.4524 => 0.4765, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (0.4861 => 0.5100, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.88% (0.3255 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.85% (0.3319 => 0.3480, std.dev.: 0.0034) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2002, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.3864 => 1.4331, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 2.57% (3.5154 => 3.6058, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.53% (5.4682 => 5.6068, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (22.4056 => 22.9086, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/bigfib: 1.91% (0.6750 => 0.6879, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.88% (0.8418 => 0.8576, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7676, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.46% (0.7447 => 0.7556, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 1.19% (16.1920 => 16.3854, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (4.8161 => 4.8658, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6757, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: 8.38% (3.7435 => 4.0573, std.dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.88% (0.9531 => 1.0282, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.02% (1.2783 => 1.3681, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4409, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1687, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1028, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.38% (54.5751 => 55.8714, std.dev.: 0.3622) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2847, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6027, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.09% (4.4335 => 4.4817, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.61% (0.3194 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.36% (0.3837 => 0.3593, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.84% (0.3323 => 0.3129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.82% (0.2871 => 0.2704, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.75% (0.3059 => 0.2883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.72% (0.3896 => 0.3673, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.72% (0.3880 => 0.3658, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-3: -5.72% (0.3848 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.72% (0.3831 => 0.3612, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.58% (0.2903 => 0.2741, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.55% (0.4033 => 0.3809, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.55% (0.3891 => 0.3675, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.51% (2.1713 => 2.0517, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wc: -5.49% (0.3205 => 0.3029, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.46% (0.4176 => 0.3948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.46% (0.2933 => 0.2773, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.17% (0.2939 => 0.2787, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.80% (1.3148 => 1.2517, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.75% (0.4151 => 0.3954, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/parameter-passing: -4.70% (0.4280 => 0.4079, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (0.9852 => 0.9400, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.29% (0.7779 => 0.7445, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.28% (0.3621 => 0.3466, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.24% (0.3821 => 0.3659, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: -4.19% (0.6441 => 0.6171, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -4.00% (2.4924 => 2.3928, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.86% (0.4248 => 0.4084, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.70% (0.4321 => 0.4161, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.64% (0.4427 => 0.4266, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.61% (0.3849 => 0.3710, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: -3.54% (0.3788 => 0.3654, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.51% (0.9542 => 0.9207, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.30% (0.6484 => 0.6270, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.28% (0.4083 => 0.3949, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.76% (0.4813 => 0.4680, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2366, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.34% (1.0544 => 1.0297, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.92% (1.2221 => 1.1986, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: -1.87% (4.3330 => 4.2520, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.80% (1.2210 => 1.1990, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: -1.73% (0.9179 => 0.9020, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.70% (0.5999 => 0.5897, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.53% (0.7982 => 0.7860, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -1.43% (1.5610 => 1.5387, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.31% (0.8521 => 0.8409, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.26% (14.2083 => 14.0297, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: -1.08% (34.0927 => 33.7242, std.dev.: 0.0318) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.50% (1.8100 => 0.6969, std.dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.02% (1.3643 => 1.0230, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0271, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2091, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.85% (1.0217 => 0.8598, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.33% (0.5142 => 0.4611, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8589, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1719, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.22% (7.9763 => 7.7195, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.43% (1.3096 => 1.2778, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.28% (3.1919 => 3.1191, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -2.09% (3.7241 => 3.6462, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1965, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.47% (1.6307 => 1.6068, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.8776 => 4.8071, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.37% (3.7092 => 3.6584, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 04:24:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 06:24:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115122434.BC2112A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7617?compare_to=7615&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7617, Order: 172525, Start Time: 2013-01-15 10:27:23, End Time: 2013-01-15 12:24:40 To: 7615, Order: 172514, Start Time: 2013-01-15 08:08:58, End Time: 2013-01-15 10:10:18 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 4 (13 on baseline) Performance Improvements: 36 (177 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1023 (873 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.80% (21.4911 => 22.0919, std.dev.: 0.1153) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.3694 => 2.4349, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.37% (42.9025 => 43.9185, std.dev.: 0.3665) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.28% (11.4917 => 11.6393, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -9.63% (0.3613 => 0.3265, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: -7.95% (0.1421 => 0.1308, std.dev.: 0.0038) MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.95% (1.1285 => 1.0726, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: -4.39% (0.4970 => 0.4752, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.33% (0.2542 => 0.2432, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -4.00% (1.0407 => 0.9991, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.73% (0.3353 => 0.3228, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -3.34% (1.3845 => 1.3382, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.09% (0.5502 => 0.5332, std.dev.: 0.0056) MultiSource/Applications/lambda-0_1_3/lambda: -2.99% (0.8140 => 0.7897, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.87% (0.6829 => 0.6633, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.79% (1.2845 => 1.2486, std.dev.: 0.0130) MultiSource/Applications/ClamAV/clamscan: -2.64% (16.4929 => 16.0581, std.dev.: 0.1411) MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.63% (1.1034 => 1.0744, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.59% (0.9219 => 0.8980, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/gs/gs: -2.52% (4.5130 => 4.3992, std.dev.: 0.0400) MultiSource/Applications/minisat/minisat: -2.39% (0.7621 => 0.7439, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -2.37% (4.2583 => 4.1573, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.15% (1.2809 => 1.2533, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.72% (0.6062 => 0.5958, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.64% (1.9285 => 1.8969, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: -1.63% (5.3580 => 5.2705, std.dev.: 0.0280) MultiSource/Applications/JM/lencod/lencod: -1.63% (17.3428 => 17.0599, std.dev.: 0.0487) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.62% (3.5043 => 3.4477, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.48% (7.5273 => 7.4160, std.dev.: 0.0326) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (7.3296 => 7.2350, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.15% (0.9123 => 0.9018, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -12.37% (0.8831 => 0.7739, std.dev.: 0.0389) MultiSource/Applications/minisat/minisat: -3.99% (6.4554 => 6.1979, std.dev.: 0.0362) MultiSource/Benchmarks/7zip/7zip-benchmark: -3.79% (9.4701 => 9.1108, std.dev.: 0.0602) MultiSource/Benchmarks/Olden/bisort/bisort: -3.30% (0.6664 => 0.6444, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.74% (2.4506 => 2.4080, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (3.4806 => 3.4204, std.dev.: 0.0213) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.56% (4.6137 => 4.5418, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/heapsort: -1.52% (3.1603 => 3.1122, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/heapsort: -1.22% (3.1764 => 3.1377, std.dev.: 0.0047) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.64% (1.1231 => 1.1159, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 42.14% (0.0140 => 0.0199, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 14.29% (0.0350 => 0.0400, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.04% (0.0336 => 0.0309, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.21% (0.0318 => 0.0276, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.99% (0.0429 => 0.0369, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -13.59% (0.0206 => 0.0178, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -5.88% (0.0221 => 0.0208, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.78% (0.0236 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.46% (0.1463 => 0.1427, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -8.11% (1.2422 => 1.1414, std.dev.: 0.0077) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.62% (0.4017 => 0.3992, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.31% (0.1482 => 0.1531, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -8.14% (0.0983 => 0.0903, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0274 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.16% (0.0570 => 0.0588, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.25% (1.1520 => 1.1491, std.dev.: 0.1012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.33% (0.0030 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.96% (0.0614 => 0.0559, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.45% (0.0313 => 0.0249, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7431 => 0.7410, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.44% (0.0078 => 0.0041, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7543 => 12.7606, std.dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.84% (9.5202 => 9.7905, std.dev.: 0.0126) MultiSource/Applications/JM/lencod/lencod: 2.15% (16.7012 => 17.0599, std.dev.: 0.0487) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.77% (0.7225 => 0.7353, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.8651 => 1.8969, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.35% (23.5861 => 23.9036, std.dev.: 0.0875) MultiSource/Benchmarks/PAQ8p/paq8p: 1.29% (2.5772 => 2.6105, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.09% (1.4110 => 1.4264, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321100.00% (0.0008 => 2.5696, std.dev.: 0.0681) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.19% (1.1825 => 2.4382, std.dev.: 0.0949) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.77% (0.2562 => 0.2838, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (63.1520 => 64.5461, std.dev.: 0.1343) MultiSource/Applications/JM/lencod/lencod: 1.59% (6.8159 => 6.9246, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.35% (0.0808 => 0.0482, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -37.57% (0.0692 => 0.0432, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -36.31% (0.0727 => 0.0463, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -27.54% (0.1888 => 0.1368, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.53% (0.1684 => 0.1254, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -19.94% (0.0707 => 0.0566, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -19.75% (1.8964 => 1.5218, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -19.28% (0.1079 => 0.0871, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.13% (0.1009 => 0.0816, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.03% (0.0862 => 0.0698, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.07% (1.0960 => 0.8980, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.40% (0.7686 => 0.6349, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -16.39% (0.1025 => 0.0857, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -16.06% (0.0847 => 0.0711, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.38% (1.0986 => 0.9296, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.00% (0.4074 => 0.3463, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: -12.66% (1.0220 => 0.8926, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: -12.61% (1.1433 => 0.9991, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -12.08% (1.5979 => 1.4048, std.dev.: 0.0166) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.60% (1.2154 => 1.0744, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: -11.39% (2.4719 => 2.1903, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.22% (6.4235 => 5.7029, std.dev.: 0.0092) SingleSource/UnitTests/Vector/constpool: -11.10% (9.8875 => 8.7898, std.dev.: 0.1449) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.95% (1.5131 => 1.3474, std.dev.: 0.0174) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.48% (0.2481 => 0.2221, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.43% (0.7693 => 0.6891, std.dev.: 0.0113) MultiSource/Applications/lua/lua: -10.41% (4.6406 => 4.1573, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.38% (1.1498 => 1.0304, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.99% (1.3924 => 1.2533, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.96% (0.9588 => 0.8633, std.dev.: 0.0199) MultiSource/Applications/aha/aha: -9.94% (0.1378 => 0.1241, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.78% (0.2372 => 0.2140, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.78% (0.9124 => 0.8232, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.11% (1.6874 => 1.5336, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.03% (10.2703 => 9.3424, std.dev.: 0.0833) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.03% (0.6885 => 0.6263, std.dev.: 0.0107) MultiSource/Applications/siod/siod: -8.84% (2.6437 => 2.4099, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -8.74% (0.8653 => 0.7897, std.dev.: 0.0049) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.57% (1.1731 => 1.0726, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: -8.51% (0.1610 => 0.1473, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.51% (0.1305 => 0.1194, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -8.48% (0.2100 => 0.1922, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.44% (0.1587 => 0.1453, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.43% (0.1317 => 0.1206, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: -7.91% (17.4365 => 16.0581, std.dev.: 0.1411) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -7.89% (0.1356 => 0.1249, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: -7.88% (0.2006 => 0.1848, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.47% (0.3560 => 0.3294, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: -7.42% (17.5634 => 16.2596, std.dev.: 0.2029) MultiSource/Applications/sgefa/sgefa: -7.31% (0.3598 => 0.3335, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.21% (0.5746 => 0.5332, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash2: -7.15% (0.5134 => 0.4767, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.10% (1.0017 => 0.9306, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.00% (0.2615 => 0.2432, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -6.95% (0.1928 => 0.1794, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -6.50% (0.2385 => 0.2230, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -6.47% (0.4002 => 0.3743, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: -6.41% (0.1824 => 0.1707, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.34% (0.9550 => 0.8945, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -6.30% (0.3665 => 0.3434, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.19% (1.3310 => 1.2486, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.17% (1.8127 => 1.7008, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.16% (0.2709 => 0.2542, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.04% (0.3462 => 0.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.88% (0.3981 => 0.3747, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -5.85% (0.2135 => 0.2010, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: -5.84% (0.2551 => 0.2402, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: -5.80% (0.2172 => 0.2046, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.69% (0.2618 => 0.2469, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: -5.43% (0.3206 => 0.3032, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: -5.42% (0.2305 => 0.2180, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.40% (0.9422 => 0.8913, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -5.39% (0.2725 => 0.2578, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.36% (0.2144 => 0.2029, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.33% (0.3093 => 0.2928, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.33% (0.9507 => 0.9000, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.12% (0.9127 => 0.8660, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.01% (3.6295 => 3.4477, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.97% (0.9405 => 0.8938, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.90% (0.9512 => 0.9046, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.89% (0.3394 => 0.3228, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -4.78% (0.4689 => 0.4465, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.68% (1.0234 => 0.9755, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.63% (5.0381 => 4.8046, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.49% (0.8990 => 0.8586, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.49% (0.9788 => 0.9349, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.40% (1.0052 => 0.9610, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -4.37% (0.2564 => 0.2452, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -4.35% (0.2665 => 0.2549, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.34% (0.6934 => 0.6633, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -4.33% (0.7776 => 0.7439, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.30% (1.3220 => 1.2651, std.dev.: 0.0143) MultiSource/Applications/lemon/lemon: -4.27% (1.3979 => 1.3382, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: -4.25% (0.6711 => 0.6426, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -4.23% (4.5936 => 4.3992, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.16% (0.9993 => 0.9577, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.15% (0.9091 => 0.8714, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.09% (0.9403 => 0.9018, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.96% (0.2577 => 0.2475, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -3.81% (3.7840 => 3.6397, std.dev.: 0.0124) MultiSource/Applications/SIBsim4/SIBsim4: -3.69% (1.4392 => 1.3861, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.68% (0.9488 => 0.9139, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.64% (0.2993 => 0.2884, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -3.63% (18.9377 => 18.2503, std.dev.: 0.0810) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.60% (4.6579 => 4.4903, std.dev.: 0.0261) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.59% (1.2680 => 1.2225, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.54% (0.7693 => 0.7421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.50% (0.2913 => 0.2811, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.39% (0.5369 => 0.5187, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.30% (1.0860 => 1.0502, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.27% (0.9214 => 0.8913, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.22% (0.3847 => 0.3723, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.13% (0.9685 => 0.9382, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.04% (1.0088 => 0.9781, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: -2.95% (16.4479 => 15.9628, std.dev.: 0.0835) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.89% (0.6135 => 0.5958, std.dev.: 0.0006) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.85% (0.4596 => 0.4465, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.82% (0.8926 => 0.8674, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.81% (0.9061 => 0.8806, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.80% (0.9381 => 0.9118, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.57% (0.9855 => 0.9602, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.56% (0.9612 => 0.9366, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.53% (1.0119 => 0.9863, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.44% (0.8846 => 0.8630, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.44% (0.8893 => 0.8676, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.35% (0.8732 => 0.8527, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.29% (2.4519 => 2.3958, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.01% (14.9757 => 14.6751, std.dev.: 0.0832) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.91% (0.9120 => 0.8946, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: -1.58% (5.3553 => 5.2705, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.02% (4.9104 => 4.8605, std.dev.: 0.0172) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.24% (0.9372 => 0.6444, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/heapsort: -30.44% (4.4739 => 3.1122, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.45% (1.0816 => 0.7739, std.dev.: 0.0389) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.37% (4.2042 => 3.1377, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: -22.42% (7.9891 => 6.1979, std.dev.: 0.0362) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.36% (0.1164 => 0.0927, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.28% (1.5623 => 1.2611, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.55% (2.8778 => 2.3441, std.dev.: 0.1190) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.66% (0.0845 => 0.0738, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.58% (1.4235 => 1.2586, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout/hash: -10.45% (4.5259 => 4.0529, std.dev.: 0.0165) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.27% (0.4081 => 0.3662, std.dev.: 0.0125) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.03% (1.6547 => 1.4887, std.dev.: 0.0518) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.92% (5.0421 => 4.5418, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists1: -8.92% (0.6628 => 0.6037, std.dev.: 0.0090) MultiSource/Applications/SPASS/SPASS: -8.03% (9.0650 => 8.3367, std.dev.: 0.0603) MultiSource/Applications/oggenc/oggenc: -7.57% (0.1704 => 0.1575, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: -6.51% (0.3654 => 0.3416, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: -6.25% (2.2304 => 2.0911, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.58% (23.3986 => 22.0919, std.dev.: 0.1153) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.40% (0.3349 => 0.3168, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.83% (42.3194 => 40.2751, std.dev.: 0.6079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.73% (46.0987 => 43.9185, std.dev.: 0.3665) MultiSource/Benchmarks/FreeBench/distray/distray: -4.41% (0.2427 => 0.2320) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.33% (2.5170 => 2.4080, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: -4.19% (1.8123 => 1.7364, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.04% (1.4446 => 1.3862, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/ffbench: -3.90% (1.4244 => 1.3688, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/lists: -3.57% (17.2182 => 16.6029, std.dev.: 0.2130) MultiSource/Applications/SIBsim4/SIBsim4: -3.50% (3.5443 => 3.4204, std.dev.: 0.0213) SingleSource/Benchmarks/McGill/chomp: -3.49% (1.0425 => 1.0061, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.11% (0.3406 => 0.3300, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.57% (3.0082 => 2.9308, std.dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.0995 => 1.0714, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.52% (0.5826 => 0.5679, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -2.07% (0.8521 => 0.8345, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -2.06% (0.5295 => 0.5186, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -2.05% (29.0327 => 28.4363, std.dev.: 0.0704) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.47% (3.7662 => 3.7109, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -1.46% (4.4730 => 4.4075, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.46% (3.1921 => 3.1455, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.37% (5.9063 => 5.8255, std.dev.: 0.0276) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3147, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -1.21% (8.7416 => 8.6356, std.dev.: 0.0223) SingleSource/Benchmarks/SmallPT/smallpt: -1.01% (14.9448 => 14.7935, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.37% (1.2047 => 1.1159, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.59% (0.0233 => 0.0199, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.31% (0.0451 => 0.0400, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.57% (0.0394 => 0.0309, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.85% (0.0328 => 0.0276, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.08% (0.0445 => 0.0369, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/casts: -16.43% (0.0213 => 0.0178, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -8.37% (0.0227 => 0.0208, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -93.33% (0.0015 => 0.0001, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -6.73% (0.1530 => 0.1427, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -40.84% (1.9293 => 1.1414, std.dev.: 0.0077) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.41% (0.4049 => 0.3992, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.39% (0.1510 => 0.1531, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.67% (0.0978 => 0.0903, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.34% (0.0590 => 0.0588, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.08% (1.1617 => 1.1491, std.dev.: 0.1012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -56.25% (0.0032 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.36% (0.0610 => 0.0559, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.09% (0.0268 => 0.0249, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7437 => 0.7410, std.dev.: 0.0036) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.43% (0.0092 => 0.0041, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (12.7781 => 12.7606, std.dev.: 0.0181) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 04:39:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 06:39:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115123919.E86AB2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7618?compare_to=7614&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7618, Order: 172525, Start Time: 2013-01-15 10:27:38, End Time: 2013-01-15 12:39:25 To: 7614, Order: 172510, Start Time: 2013-01-15 07:43:15, End Time: 2013-01-15 09:57:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (218 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.03% (1.3463 => 1.3325, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.03% (0.0688 => 0.0674, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 2.34% (488.3890 => 499.8235, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.38% (1.1277 => 499.8235, std.dev.: 0.0146) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.01% (0.5229 => 1.6681, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 21.39% (14.9895 => 18.1963, std.dev.: 0.0113) MultiSource/Applications/kimwitu++/kc: 43.82% (14.1553 => 20.3577, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/gs/gs: 18.38% (4.1105 => 4.8662, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.75% (1.1048 => 1.7870, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.96% (7.1582 => 38.5083, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.47% (3.4629 => 6.3879, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.70% (0.6222 => 1.0870, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.11% (0.0720 => 7.4420, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 3834600.00% (0.0001 => 3.8347, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11164300.00% (0.0001 => 11.1644, std.dev.: 0.0578) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850600.00% (0.0001 => 9.8507, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483100.00% (0.0001 => 5.4832, std.dev.: 0.0026) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 829.69% (1.1194 => 10.4070, std.dev.: 0.0161) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787) MultiSource/Applications/ClamAV/clamscan: 151.69% (22.1758 => 55.8136, std.dev.: 0.0409) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.50% (0.0929 => 0.1779, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.59% (0.1463 => 0.2525, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 64.35% (21.9371 => 36.0530, std.dev.: 0.0237) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.38% (7.0540 => 11.1018, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.73% (2.9384 => 4.6053, std.dev.: 0.0013) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 51.89% (0.1056 => 0.1604, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.01% (1.5859 => 2.3949, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.54% (8.1363 => 12.2483, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/IntMM: 50.25% (0.0394 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.29% (2.2024 => 3.1118, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.32% (0.0439 => 0.0616, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 40.21% (0.3109 => 0.4359, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 38.41% (0.1432 => 0.1982, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.65% (1.5415 => 2.0911, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.94% (4.2646 => 5.7545, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.96% (0.4615 => 0.6136, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1892 => 0.2474, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.67% (0.2700 => 0.3528, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 30.48% (1.1642 => 1.5190, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 29.63% (0.4299 => 0.5573, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.51% (0.6675 => 0.8645, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.87% (0.5105 => 0.6528, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 27.53% (9.4845 => 12.0954, std.dev.: 0.0045) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 26.98% (0.2554 => 0.3243, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.89% (0.1655 => 0.2100, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.47% (1.0722 => 1.3560, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.02% (3.8922 => 4.9050, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.60% (0.1125 => 0.1413, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.81% (1.4186 => 1.7706, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.38% (0.1337 => 0.1663, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.93% (0.3121 => 0.3868, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 23.08% (0.4289 => 0.5279, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 22.93% (5.7591 => 7.0798, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 22.60% (0.7115 => 0.8723, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.23% (4.9449 => 6.0442, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.19% (0.0730 => 0.0892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.95% (0.4620 => 0.5634, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 21.91% (3.3354 => 4.0661, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.47% (0.0871 => 0.1058, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.43% (5.0018 => 6.0737, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 21.29% (0.1151 => 0.1396, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.13% (1.3050 => 1.5808, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 21.11% (0.3098 => 0.3752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.92% (0.7835 => 0.9474, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/em3d/em3d: 20.83% (0.1695 => 0.2048, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.15% (0.1940 => 0.2331, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.97% (0.5860 => 0.7030, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.58% (0.8172 => 0.9772, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/bigfib: 19.56% (0.6456 => 0.7719, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.74% (0.1510 => 0.1793, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.40% (0.3423 => 0.4053, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.35% (0.5020 => 0.5941, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.06% (0.2758 => 0.3256, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 18.01% (0.7433 => 0.8772, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 17.98% (3.8723 => 4.5686, std.dev.: 0.0136) MultiSource/Benchmarks/nbench/nbench: 17.77% (1.1840 => 1.3944, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.67% (0.5569 => 0.6553, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.44% (0.9765 => 1.1468, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.39% (0.0834 => 0.0979, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.23% (2.0273 => 2.3767, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.10% (0.6450 => 0.7553, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ReedSolomon: 16.59% (0.2049 => 0.2389, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.58% (2.2969 => 2.6778, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 16.57% (0.3180 => 0.3707, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.50% (0.5981 => 0.6968, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 16.47% (0.3387 => 0.3945, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.45% (0.8101 => 0.9434, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 16.38% (10.3673 => 12.0659, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.18% (0.8067 => 0.9372, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.78% (0.3441 => 0.3984, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.63% (1.1861 => 1.3715, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.8921 => 1.0241, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 14.65% (0.3283 => 0.3764, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 14.17% (0.3232 => 0.3690, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.08% (1.5603 => 1.7800, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 13.76% (17.1811 => 19.5453, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.99% (14.3668 => 16.2328, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ary2: 12.78% (0.3379 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 12.58% (0.3092 => 0.3481, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.19% (0.3865 => 0.4336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.11% (0.3427 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.88% (0.3282 => 0.3672, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.86% (0.4636 => 0.5186, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.24% (0.4103 => 0.4564, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.09% (0.4203 => 0.4669, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.45% (0.4048 => 0.4471, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.20% (0.3422 => 0.3771, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 10.13% (0.3603 => 0.3968, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.10% (0.3694 => 0.4067, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 9.91% (0.3684 => 0.4049, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.82% (63.2438 => 69.4566, std.dev.: 0.0329) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.75% (0.3826 => 0.4199, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.4064 => 0.4433, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 8.19% (0.2831 => 0.3063, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.91% (2.0665 => 2.2300, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 7.83% (1.2842 => 1.3848, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.73% (7.9617 => 8.5770, std.dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7326 => 0.7890, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.45% (0.3650 => 0.3922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.42% (0.2871 => 0.3084, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.41% (2.2022 => 2.3653, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.29% (0.3935 => 0.4222, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.21% (0.3162 => 0.3390, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 6.99% (0.2905 => 0.3108, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.95% (0.2891 => 0.3092, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.78% (0.2802 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 6.72% (0.3052 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.68% (0.2756 => 0.2940, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.62% (0.2266 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 6.42% (0.2725 => 0.2900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.37% (0.2793 => 0.2971, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.19% (0.3136 => 0.3330, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 6.15% (0.2714 => 0.2881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2468, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4259, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.45% (4.2280 => 4.4583, std.dev.: 0.0073) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (3.1578 => 3.3089, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.54% (0.9957 => 1.0309, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1069, std.dev.: 0.0112) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9167, std.dev.: 0.0079) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.26% (1.0313 => 1.0546, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.22% (3.6395 => 3.7203, std.dev.: 0.0080) MultiSource/Applications/minisat/minisat: 2.12% (9.1159 => 9.3091, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2787, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.26% (10.3460 => 10.4764, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.11% (6.5088 => 6.5808, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.13% (5.2763 => 1.2065, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.58% (5.3855 => 4.4926, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.12% (5.3526 => 4.4895, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: -10.53% (10.4361 => 9.3372, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.63% (1.7609 => 1.6266, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.52% (54.1659 => 50.0910, std.dev.: 0.0210) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.16% (1.9577 => 0.6430, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3045, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0192, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4248, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8633, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0083, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1246, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2632, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.44% (1.2373 => 1.1576, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.05% (8.1563 => 7.7443, std.dev.: 0.0134) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.61% (10.2830 => 9.8088, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-5: -4.61% (1.5835 => 1.5105, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.96% (3.6994 => 3.6268, std.dev.: 0.0118) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3308, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.46% (3.7221 => 3.6678, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2286, std.dev.: 0.0035) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0017) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 05:25:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 07:25:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115132557.18D5F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7619?compare_to=7616&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7619, Order: 172525, Start Time: 2013-01-15 11:52:09, End Time: 2013-01-15 13:26:01 To: 7616, Order: 172517, Start Time: 2013-01-15 09:54:44, End Time: 2013-01-15 11:28:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (104 on baseline) Performance Improvements: 2 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.31% (55.8714 => 56.6037, std.dev.: 0.1204) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -6.34% (4.0573 => 3.8001, std.dev.: 0.0324) SingleSource/Benchmarks/Dhrystone/fldry: -1.82% (0.6969 => 0.6842, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.55% (0.0717 => 0.1187, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.34% (0.6395 => 0.8783, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.57% (0.1132 => 0.1546, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.54% (0.6395 => 0.8668, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.69% (0.6260 => 0.8369, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.45% (0.5688 => 0.7534, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.22% (0.5456 => 0.7214, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.04% (0.6230 => 0.8226, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.40% (0.5567 => 0.7315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.35% (0.5575 => 0.7323, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.29% (0.5941 => 0.7800, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.83% (0.5802 => 0.7591, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.53% (0.6033 => 0.7875, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.45% (0.5705 => 0.7442, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.18% (0.5849 => 0.7614, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.90% (0.5478 => 0.7116, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.64% (0.5570 => 0.7221, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.50% (0.5569 => 0.7212, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.40% (0.5591 => 0.7235, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.22% (0.5925 => 0.7656, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.56% (0.5857 => 0.7530, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.42% (0.6189 => 0.7948, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.29% (0.6052 => 0.7764, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.25% (0.6676 => 0.8562, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.23% (0.5863 => 0.7518, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.19% (0.6446 => 0.8263, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.84% (0.6304 => 0.8059, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.41% (1.6474 => 2.0990, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.80% (0.6194 => 0.7854, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.19% (0.6660 => 0.8404, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.16% (0.6297 => 0.7944, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.15% (0.6681 => 0.8428, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.33% (0.7524 => 0.9279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.65% (0.7339 => 0.9001, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.32% (2.2587 => 2.7177, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 17.01% (1.1450 => 1.3398, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.83% (0.3834 => 0.4326, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.66% (0.1982 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8424, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.64% (4.5069 => 5.0314, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.41% (0.4916 => 0.5477, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.35% (3.5339 => 3.8996, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.2385 => 0.2611, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.00% (9.2283 => 10.0584, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.70% (0.7021 => 0.7632, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.23% (1.2515 => 1.3545, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.30% (0.5329 => 0.5718, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.11% (1.4642 => 1.5683, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (1.2784 => 1.3622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.01% (0.1731 => 0.1835, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.48% (0.4524 => 0.4772, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (0.4861 => 0.5104, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 3.59% (5.0226 => 5.2028, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.22% (1.3864 => 1.4310, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.62% (5.4682 => 5.6113, std.dev.: 0.0264) MultiSource/Applications/d/make_dparser: 2.49% (3.5154 => 3.6029, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.27% (22.4056 => 22.9139, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: 1.57% (15.5079 => 15.7515, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 1.54% (0.8418 => 0.8548, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.29% (1.3722 => 1.3899, std.dev.: 0.0043) MultiSource/Applications/JM/lencod/lencod: 1.10% (16.1920 => 16.3709, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6755, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.71% (0.9531 => 1.0266, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4416, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.20% (11.6767 => 12.1676, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6037, std.dev.: 0.1204) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.3328 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2858, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5320 => 4.6001, std.dev.: 0.0040) MultiSource/Applications/viterbi/viterbi: 1.01% (4.4335 => 4.4782, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -7.45% (0.3194 => 0.2956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.33% (0.3837 => 0.3594, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.78% (0.3323 => 0.3131, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.77% (0.3831 => 0.3610, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.75% (0.3880 => 0.3657, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.65% (0.3896 => 0.3676, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.58% (0.2849 => 0.2690, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.53% (0.3891 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.50% (0.4033 => 0.3811, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions: -5.48% (0.4176 => 0.3947, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.42% (0.3025 => 0.2861, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.41% (2.1713 => 2.0539, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784) SingleSource/Benchmarks/Shootout-C++/strcat: -5.15% (0.2989 => 0.2835, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.06% (0.3026 => 0.2873, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.97% (1.3148 => 1.2494, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/property: -4.83% (0.4199 => 0.3996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.82% (0.4151 => 0.3951, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (0.9852 => 0.9402, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.32% (0.7779 => 0.7443, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -4.17% (0.3621 => 0.3470, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.09% (0.3867 => 0.3709, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.96% (0.4321 => 0.4150, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -3.96% (2.4924 => 2.3938, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.93% (0.4248 => 0.4081, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.66% (0.3931 => 0.3787, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.64% (0.4427 => 0.4266, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.55% (0.3658 => 0.3528, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.9542 => 0.9209, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3788 => 0.3656, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.47% (0.6484 => 0.6259, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.72% (20.7746 => 20.2088, std.dev.: 0.0342) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.70% (0.4813 => 0.4683, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.56% (0.7919 => 0.7716, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.28% (1.0544 => 1.0304, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -2.10% (0.7982 => 0.7814, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.85% (1.2221 => 1.1995, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.71% (1.2210 => 1.2001, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.68% (0.5999 => 0.5898, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.56% (4.3330 => 4.2652, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (0.8521 => 0.8391, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -1.36% (1.5610 => 1.5397, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.19% (14.2083 => 14.0391, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.15% (1.2300 => 1.2158, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.20% (1.8100 => 0.6842, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0279, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0310, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: -23.32% (7.5137 => 5.7615, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1285, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.98% (0.4092 => 0.3520, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.76% (0.5142 => 0.4640, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8591, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.73% (6.5803 => 6.3346, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7280, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.67% (1.3096 => 1.2746, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6425, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1959, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: -1.43% (3.7092 => 3.6561, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.38% (1.6086 => 1.5864, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.32% (1.6219 => 1.6005, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.07% (1.6307 => 1.6133, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 06:44:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 08:44:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115144458.CD5302A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7620?compare_to=7617&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7620, Order: 172528, Start Time: 2013-01-15 12:45:55, End Time: 2013-01-15 14:44:59 To: 7617, Order: 172525, Start Time: 2013-01-15 10:27:23, End Time: 2013-01-15 12:24:40 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (6 on baseline) Performance Improvements: 2 (129 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1052 (928 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.30% (0.8633 => 0.9004, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.56% (1.0304 => 1.0671, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/gs/gs: 1.96% (4.3992 => 4.4856, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 11.64% (0.7739 => 0.8640, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 2.28% (8.6608 => 8.8583, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.87% (58.7228 => 59.8223, std.dev.: 0.0476) SingleSource/Benchmarks/Misc/ffbench: 1.86% (1.3688 => 1.3943, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: 1.70% (2.5571 => 2.6005, std.dev.: 0.0118) MultiSource/Applications/siod/siod: 1.33% (3.5696 => 3.6170, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.54% (0.2165 => 0.2045, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.13% (4.4194 => 4.3251, std.dev.: 0.0238) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.23% (1.1159 => 1.1133, std.dev.: 0.0182) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.55% (0.0199 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.50% (0.0400 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 9.06% (0.0309 => 0.0337, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 14.49% (0.0276 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 14.91% (0.0369 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 16.29% (0.0178 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 10.58% (0.0208 => 0.0230, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.54% (0.1427 => 0.1449, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -1.28% (1.1414 => 1.1268, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.15% (0.3992 => 0.4038, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.25% (0.1531 => 0.1466, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.41% (0.0903 => 0.0997, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.82% (0.0588 => 0.0542, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.1491 => 1.1497, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 114.29% (0.0014 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 271.43% (0.0007 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.02% (0.0559 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.11% (0.0249 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7410 => 0.7379, std.dev.: 0.0055) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 46.34% (0.0041 => 0.0060, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (12.7606 => 12.7485, std.dev.: 0.0120) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.79% (0.0336 => 0.0510, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 1.89% (16.7012 => 17.0162, std.dev.: 0.0776) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320500.00% (0.0008 => 2.5648, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.78% (1.1825 => 2.3979, std.dev.: 0.0285) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.83% (0.2562 => 0.2865, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/pi: 3.37% (2.1390 => 2.2111, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -27.70% (0.1888 => 0.1365, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -26.07% (0.1684 => 0.1245, std.dev.: 0.0147) MultiSource/Applications/hbd/hbd: -20.24% (1.8964 => 1.5126, std.dev.: 0.0217) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.23% (0.1009 => 0.0815, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.14% (0.0862 => 0.0697, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.15% (0.1079 => 0.0894, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.53% (1.0986 => 0.9280, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.11% (0.4074 => 0.3499, std.dev.: 0.0077) MultiSource/Applications/spiff/spiff: -13.72% (1.0220 => 0.8818, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.58% (0.0847 => 0.0732, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -12.08% (1.1433 => 1.0052, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: -11.76% (1.5979 => 1.4100, std.dev.: 0.0165) MultiSource/Applications/treecc/treecc: -11.66% (2.4719 => 2.1838, std.dev.: 0.0059) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.28% (1.2154 => 1.0783, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.25% (6.4235 => 5.7008, std.dev.: 0.0158) MultiSource/Applications/aha/aha: -11.25% (0.1378 => 0.1223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -10.27% (9.8875 => 8.8717, std.dev.: 0.0753) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.23% (1.5131 => 1.3583, std.dev.: 0.0263) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.15% (0.1025 => 0.0921, std.dev.: 0.0021) MultiSource/Applications/lua/lua: -9.93% (4.6406 => 4.1798, std.dev.: 0.0249) MultiSource/Applications/sgefa/sgefa: -9.09% (0.3598 => 0.3271, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -9.02% (2.6437 => 2.4052, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -8.76% (0.8653 => 0.7895, std.dev.: 0.0100) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.52% (1.1731 => 1.0732, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.25% (10.2703 => 9.4225, std.dev.: 0.1140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.24% (0.9124 => 0.8372, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/fibo: -7.88% (0.2006 => 0.1848, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: -7.85% (17.4365 => 16.0669, std.dev.: 0.0906) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.73% (1.6874 => 1.5569, std.dev.: 0.0388) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.65% (0.6885 => 0.6358, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: -7.22% (17.5634 => 16.2952, std.dev.: 0.1004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.19% (1.1498 => 1.0671, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.11% (1.0017 => 0.9305, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: -6.87% (0.4002 => 0.3727, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: -6.85% (0.1928 => 0.1796, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: -6.80% (0.5134 => 0.4785, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: -6.74% (0.1824 => 0.1701, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.57% (0.2100 => 0.1962, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.41% (0.9550 => 0.8938, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: -6.33% (0.2385 => 0.2234, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.24% (0.3462 => 0.3246, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.12% (1.8127 => 1.7017, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.09% (0.9588 => 0.9004, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/except: -5.76% (0.2172 => 0.2047, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: -5.69% (0.2725 => 0.2570, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -5.64% (0.2551 => 0.2407, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.51% (0.3665 => 0.3463, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: -5.47% (0.2305 => 0.2179, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.17% (0.3981 => 0.3775, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.02% (0.9127 => 0.8669, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/lists1: -4.99% (0.3206 => 0.3046, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: -4.93% (0.4689 => 0.4458, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -4.92% (0.2135 => 0.2030, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.91% (0.9512 => 0.9045, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.85% (3.6295 => 3.4536, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.83% (0.9091 => 0.8652, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.83% (0.8990 => 0.8556, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.61% (0.9405 => 0.8971, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (1.0234 => 0.9764, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.59% (0.3093 => 0.2951, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: -4.41% (3.7840 => 3.6173, std.dev.: 0.0081) MultiSource/Applications/lemon/lemon: -4.40% (1.3979 => 1.3364, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.29% (0.9993 => 0.9564, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: -4.29% (0.2564 => 0.2454, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -4.20% (0.6711 => 0.6429, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.13% (0.2618 => 0.2510, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.05% (1.3220 => 1.2685, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/ary2: -3.98% (0.2665 => 0.2559, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: -3.97% (1.4392 => 1.3820, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: -3.75% (18.9377 => 18.2281, std.dev.: 0.0702) MultiSource/Applications/minisat/minisat: -3.74% (0.7776 => 0.7485, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.69% (5.0381 => 4.8522, std.dev.: 0.0658) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.54% (1.2680 => 1.2231, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.44% (0.7693 => 0.7428, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.26% (1.0119 => 0.9789, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.16% (1.0860 => 1.0517, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.09% (0.9214 => 0.8929, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.09% (1.0088 => 0.9776, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: -2.82% (16.4479 => 15.9833, std.dev.: 0.0506) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.82% (0.6135 => 0.5962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.53% (0.9855 => 0.9606, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.42% (2.4519 => 2.3925, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/gs/gs: -2.35% (4.5936 => 4.4856, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.21% (0.8732 => 0.8539, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.12% (0.9685 => 0.9480, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.92% (0.8846 => 0.8676, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: -1.65% (5.3553 => 5.2671, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.43% (0.8912 => 0.8785, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.20% (0.9372 => 0.6448, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/heapsort: -31.11% (4.4739 => 3.0822, std.dev.: 0.1164) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.06% (4.2042 => 3.1508, std.dev.: 0.0459) MultiSource/Applications/minisat/minisat: -21.64% (7.9891 => 6.2604, std.dev.: 0.1249) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.12% (1.0816 => 0.8640, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.83% (1.5623 => 1.2681, std.dev.: 0.0662) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -15.83% (1.4235 => 1.1981, std.dev.: 0.0303) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.46% (0.4081 => 0.3654, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: -10.26% (4.5259 => 4.0616, std.dev.: 0.0824) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.01% (1.4588 => 1.3128, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/lists1: -9.23% (0.6628 => 0.6016, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.09% (5.0421 => 4.5839, std.dev.: 0.0422) MultiSource/Applications/SPASS/SPASS: -8.69% (9.0650 => 8.2774, std.dev.: 0.1616) MultiSource/Benchmarks/Olden/health/health: -6.54% (0.3654 => 0.3415, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/ary3: -6.08% (2.2304 => 2.0947, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.98% (23.3986 => 22.2324, std.dev.: 0.1683) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.87% (0.3349 => 0.3186, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.82% (46.0987 => 43.8764, std.dev.: 0.2779) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.67% (42.3194 => 40.3428, std.dev.: 0.4981) SingleSource/Benchmarks/McGill/chomp: -3.50% (1.0425 => 1.0060, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: -3.41% (17.2182 => 16.6302, std.dev.: 0.0632) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -2.35% (4.4730 => 4.3677, std.dev.: 0.0337) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.27% (0.5826 => 0.5694, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -2.25% (2.8571 => 2.7929, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/ffbench: -2.11% (1.4244 => 1.3943, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.99% (61.0379 => 59.8223, std.dev.: 0.0476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.96% (3.0082 => 2.9491, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: -1.90% (0.6254 => 0.6135, std.dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: -1.83% (2.0298 => 1.9927, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/mandel-2: -1.77% (0.8521 => 0.8370, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.58% (3.5669 => 3.5104, std.dev.: 0.0143) MultiSource/Benchmarks/BitBench/five11/five11: -1.57% (5.7021 => 5.6127, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.42% (3.7662 => 3.7129, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.33% (5.9063 => 5.8279, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.28% (3.1921 => 3.1512, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -1.24% (8.7416 => 8.6331, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.02% (1.5595 => 1.5436, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-6: -1.02% (2.4234 => 2.3987, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.59% (1.2047 => 1.1133, std.dev.: 0.0182) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.44% (0.0233 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.66% (0.0328 => 0.0316, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.72% (0.0445 => 0.0424, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 1.32% (0.0227 => 0.0230, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.29% (0.1530 => 0.1449, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: -41.60% (1.9293 => 1.1268, std.dev.: 0.0136) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.27% (0.4049 => 0.4038, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.91% (0.1510 => 0.1466, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.94% (0.0978 => 0.0997, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0590 => 0.0542, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.03% (1.1617 => 1.1497, std.dev.: 0.0438) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.78% (0.7437 => 0.7379, std.dev.: 0.0055) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.78% (0.0092 => 0.0060, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7485, std.dev.: 0.0120) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 07:21:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 09:21:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115152110.A44862A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7621?compare_to=7618&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7621, Order: 172528, Start Time: 2013-01-15 13:09:38, End Time: 2013-01-15 15:21:15 To: 7618, Order: 172525, Start Time: 2013-01-15 10:27:38, End Time: 2013-01-15 12:39:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0417 => 0.0415, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.56% (0.0674 => 0.0650, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8235 => 499.8345, std.dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 44223.36% (1.1277 => 499.8345, std.dev.: 0.0122) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.51% (0.5229 => 1.6707, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 21.30% (14.9895 => 18.1828, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 43.75% (14.1553 => 20.3485, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: 18.22% (4.1105 => 4.8596, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.70% (1.1048 => 1.7865, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.33% (7.1582 => 38.5345, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.53% (3.4629 => 6.3902, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.72% (0.6222 => 1.0871, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.44% (0.0720 => 7.4408, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11163900.00% (0.0001 => 11.1640, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850500.00% (0.0001 => 9.8506, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484600.00% (0.0001 => 5.4847, std.dev.: 0.0020) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 830.28% (1.1194 => 10.4135, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.58% (22.1758 => 55.7907, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 92.03% (0.0929 => 0.1784, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 72.45% (0.1463 => 0.2523, std.dev.: 0.0028) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.28% (21.9371 => 36.0374, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.38% (7.0540 => 11.1013, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.73% (2.9384 => 4.6055, std.dev.: 0.0183) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.96% (1.5859 => 2.3941, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: 50.95% (0.1056 => 0.1594, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.28% (8.1363 => 12.2272, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.23% (2.2024 => 3.1104, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 39.98% (0.3109 => 0.4352, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.97% (1.5415 => 2.0805, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.83% (4.2646 => 5.7500, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.98% (0.4615 => 0.6137, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.81% (0.2700 => 0.3532, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1892 => 0.2474, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 30.60% (1.1642 => 1.5204, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: 30.47% (0.1175 => 0.1533, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.25% (0.2271 => 0.2958) MultiSource/Benchmarks/McCat/05-eks/eks: 29.73% (0.4299 => 0.5577, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.57% (0.6675 => 0.8649, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.54% (0.5105 => 0.6511, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 27.52% (9.4845 => 12.0947, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.94% (0.2554 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 26.45% (1.0722 => 1.3558, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.02% (3.8922 => 4.9048, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.92% (1.4186 => 1.7721, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.62% (0.1143 => 0.1413, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 22.88% (5.7591 => 7.0766, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 22.53% (0.7115 => 0.8718, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: 22.52% (0.0626 => 0.0767, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 22.41% (0.4289 => 0.5250, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.22% (4.9449 => 6.0435, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.97% (0.4620 => 0.5635, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819) MultiSource/Applications/d/make_dparser: 21.74% (3.3354 => 4.0606, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.37% (5.0018 => 6.0706, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 20.92% (0.7835 => 0.9474, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.88% (1.3050 => 1.5775, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: 20.85% (0.3098 => 0.3744, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800) MultiSource/Benchmarks/Olden/em3d/em3d: 20.83% (0.1695 => 0.2048, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.74% (0.1032 => 0.1246, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.63% (0.1236 => 0.1491, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.63% (0.1029 => 0.1231, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.59% (0.8172 => 0.9773, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 19.44% (0.6456 => 0.7711, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 18.38% (0.3423 => 0.4052, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.31% (0.5020 => 0.5939, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 17.99% (0.7433 => 0.8770, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764) MultiSource/Applications/lua/lua: 17.88% (3.8723 => 4.5648, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 17.74% (1.1840 => 1.3940, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.5569 => 0.6550, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.52% (0.9765 => 1.1476, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.14% (2.0273 => 2.3748, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.12% (0.3307 => 0.3873, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.87% (0.6450 => 0.7538, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 16.82% (0.3180 => 0.3715, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.75% (0.5981 => 0.6983, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 16.68% (0.3387 => 0.3952, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.65% (2.2969 => 2.6793, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/ReedSolomon: 16.59% (0.2049 => 0.2389, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.41% (0.8101 => 0.9430, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 16.40% (10.3673 => 12.0678, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.84% (0.3441 => 0.3986, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.78% (0.8067 => 0.9340, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.57% (1.1861 => 1.3708, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 14.89% (0.8921 => 1.0249, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.62% (0.3283 => 0.3763, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.17% (0.3232 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.82% (17.1811 => 19.5554, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 13.56% (1.5603 => 1.7719, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.96% (14.3668 => 16.2293, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 12.70% (0.3379 => 0.3808, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.65% (0.3092 => 0.3483, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.50% (0.4103 => 0.4616, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.40% (0.4636 => 0.5211, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.06% (0.3865 => 0.4331, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.99% (0.3427 => 0.3838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.70% (0.3282 => 0.3666, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.02% (0.4203 => 0.4666, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.95% (0.2430 => 0.2696, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 10.33% (0.4048 => 0.4466, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3422 => 0.3769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.07% (0.3603 => 0.3966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.91% (0.3684 => 0.4049, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.83% (63.2438 => 69.4615, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.70% (0.3826 => 0.4197, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.23% (0.4064 => 0.4439, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.6030 => 0.6519, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 8.05% (0.2831 => 0.3059, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.83% (0.5925 => 0.6389, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.74% (0.7326 => 0.7893, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.69% (7.9617 => 8.5738, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: 7.55% (1.2842 => 1.3811, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.50% (0.3935 => 0.4230) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.50% (2.0665 => 2.2214, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.48% (0.3650 => 0.3923, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 7.38% (0.2871 => 0.3083, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 7.23% (0.2877 => 0.3085, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 7.06% (0.2905 => 0.3110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.92% (0.2891 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.69% (0.2872 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.67% (0.2802 => 0.2989, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.62% (0.2266 => 0.2416, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 6.55% (0.3052 => 0.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.37% (0.2793 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 6.26% (0.2714 => 0.2884, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2565, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (1.1145 => 1.2948, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.33% (1.1396 => 1.2459, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4507, std.dev.: 0.0126) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (2.0360 => 2.1064, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.42% (0.9957 => 1.0298, std.dev.: 0.0056) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9005, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7178, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2844, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2779, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4567, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.11% (5.2763 => 1.2075, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/salsa20: -75.11% (0.8651 => 0.2153, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.51% (5.3855 => 4.4963, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.15% (5.3526 => 4.4881, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -10.59% (10.4361 => 9.3314, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.64% (1.7609 => 1.6264, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.52% (54.1659 => 50.0912, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.16% (1.9577 => 0.6624, std.dev.: 0.0145) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5624, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3086, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0227, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4204, std.dev.: 0.0229) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8585, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0043, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0904, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4198, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.16% (9.5636 => 8.4963, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.21% (0.9540 => 0.8566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2987, std.dev.: 0.0409) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.34% (1.2373 => 1.1589, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.13% (8.1563 => 7.7377, std.dev.: 0.0225) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8332, std.dev.: 0.0124) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.68% (3.7221 => 3.6596, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.26% (3.6994 => 3.6528, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0026) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 07:23:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 09:23:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115152327.8E2202A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7622?compare_to=7619&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7622, Order: 172528, Start Time: 2013-01-15 13:49:22, End Time: 2013-01-15 15:23:32 To: 7619, Order: 172525, Start Time: 2013-01-15 11:52:09, End Time: 2013-01-15 13:26:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (105 on baseline) Performance Improvements: 0 (127 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.73% (1.2746 => 1.2967, std.dev.: 0.0045) MultiSource/Benchmarks/llubenchmark/llu: 1.32% (3.8001 => 3.8503, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.17% (80.3001 => 81.2367, std.dev.: 0.1691) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.55% (0.0717 => 0.1187, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.36% (0.6395 => 0.8784, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.47% (0.6395 => 0.8663, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.61% (0.6260 => 0.8364, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.59% (0.5688 => 0.7542, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.45% (0.5805 => 0.7689, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.99% (0.6230 => 0.8223, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.39% (0.5575 => 0.7325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.26% (0.5941 => 0.7798, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.23% (0.5581 => 0.7324, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.92% (0.5802 => 0.7596, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.46% (0.5705 => 0.7443, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.12% (0.5849 => 0.7611, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.85% (0.5478 => 0.7113, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.64% (0.5570 => 0.7221, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.48% (0.5569 => 0.7211, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.33% (0.5591 => 0.7231, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.11% (0.5925 => 0.7650, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.47% (0.6189 => 0.7951, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.42% (0.6052 => 0.7772, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.38% (0.5863 => 0.7527, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.37% (0.6676 => 0.8570, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.34% (0.5857 => 0.7517, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/IntMM: 27.99% (0.0418 => 0.0535, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.97% (0.6446 => 0.8249, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.35% (1.6474 => 2.0980, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.65% (0.6194 => 0.7845, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.31% (0.6660 => 0.8412, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.22% (0.6681 => 0.8433, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.19% (0.6297 => 0.7946, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.70% (0.6667 => 0.8314, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.22% (0.7524 => 0.9271, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.56% (0.7339 => 0.8995, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.29% (2.2587 => 2.7171, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 16.98% (1.1450 => 1.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.66% (0.3357 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.66% (0.1982 => 0.2233, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8424, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.76% (4.5069 => 5.0371, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.35% (0.4916 => 0.5474, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 10.94% (0.4515 => 0.5009, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.25% (3.5339 => 3.8963, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 9.08% (9.2283 => 10.0661, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.97% (0.2385 => 0.2599, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.76% (0.7021 => 0.7636, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.14% (1.2515 => 1.3534, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.5329 => 0.5716, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.92% (1.4642 => 1.5655, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.2784 => 1.3627, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4524 => 0.4767, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.00% (0.4861 => 0.5104, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2004, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.3864 => 1.4305, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.66% (5.4682 => 5.6138, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 2.47% (3.5154 => 3.6023, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (22.4056 => 22.9123, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/bigfib: 1.99% (0.6750 => 0.6884, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 1.82% (0.8418 => 0.8571, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.57% (15.5079 => 15.7511, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.25% (1.3722 => 1.3894, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 1.10% (16.1920 => 16.3707, std.dev.: 0.0175) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6587, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9531 => 1.0291, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.66% (5.1955 => 5.4377, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1684, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4882, std.dev.: 0.0817) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 2.85% (3.7435 => 3.8503, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.91% (79.7170 => 81.2367, std.dev.: 0.1691) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2865, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6065, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4787, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: 1.00% (7.4937 => 7.5688, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -7.58% (0.3194 => 0.2952, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.33% (0.3837 => 0.3594, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: -5.88% (0.3812 => 0.3588, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.75% (0.3323 => 0.3132, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -5.74% (0.3831 => 0.3611, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.74% (0.3884 => 0.3661, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.71% (0.2871 => 0.2707, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.67% (0.3880 => 0.3660, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.63% (0.3057 => 0.2885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.62% (0.3896 => 0.3677, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.56% (0.3848 => 0.3634, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.55% (0.4033 => 0.3809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.55% (0.3205 => 0.3027, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.55% (0.2849 => 0.2691, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.49% (2.1713 => 2.0521, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.42% (0.3891 => 0.3680, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.36% (0.3025 => 0.2863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.31% (0.3016 => 0.2856, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.29% (0.3252 => 0.3080, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -5.19% (0.2989 => 0.2834, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -5.03% (1.3148 => 1.2487, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: -4.86% (0.4199 => 0.3995, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.78% (0.2428 => 0.2312, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.75% (0.4151 => 0.3954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.63% (0.4280 => 0.4082, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.56% (0.9852 => 0.9403, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.33% (0.6347 => 0.6072, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.21% (0.3821 => 0.3660, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -4.20% (0.3621 => 0.3469, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.09% (0.3867 => 0.3709, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.95% (2.4924 => 2.3939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.91% (0.4248 => 0.4082, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.3931 => 0.3780, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.59% (0.7779 => 0.7500, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.9542 => 0.9209, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.47% (0.3658 => 0.3531, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.47% (0.4321 => 0.4171, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.46% (0.4427 => 0.4274, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: -3.43% (0.3788 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.97% (0.4813 => 0.4670, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.7919 => 0.7705, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2327, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0301, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -2.22% (0.7982 => 0.7805, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -1.99% (4.3330 => 4.2469, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.88% (1.2221 => 1.1991, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (1.2210 => 1.2000, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.40% (1.5610 => 1.5392, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -1.36% (2.4021 => 2.3694, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.24% (14.2083 => 14.0317, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.11% (1.2300 => 1.2163, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.06% (34.0927 => 33.7320, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.90% (1.8100 => 0.6896, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3112, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -25.21% (1.3643 => 1.0204, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0323, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2075, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.35% (2.5106 => 2.1252, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8586, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.8545 => 0.8163, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (7.9763 => 7.7288, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.65% (4.8776 => 4.7969, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: -1.56% (3.7092 => 3.6513, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1956, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.25% (1.6086 => 1.5885, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.09% (1.6307 => 1.6130, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 09:04:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 11:04:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115170447.CFD6A2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7623?compare_to=7620&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7623, Order: 172533, Start Time: 2013-01-15 15:03:25, End Time: 2013-01-15 17:04:54 To: 7620, Order: 172528, Start Time: 2013-01-15 12:45:55, End Time: 2013-01-15 14:44:59 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 11 (11 on baseline) Performance Improvements: 3 (73 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1049 (979 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 70.05% (0.2778 => 0.4724, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: 64.97% (0.0922 => 0.1521, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/family/family: 62.56% (0.0430 => 0.0699, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 12.53% (0.9397 => 1.0574, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.42% (0.8874 => 0.9621, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.24% (0.9784 => 1.0395, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.28% (15.6974 => 16.8397, std.dev.: 0.2284) MultiSource/Benchmarks/Bullet/bullet: 6.74% (7.0950 => 7.5729, std.dev.: 0.0309) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.68% (2.3979 => 2.4621, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.87% (2.3748 => 2.4192, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.85% (4.3251 => 4.4052, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.87% (0.1632 => 0.1471, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -8.26% (0.2155 => 0.1977, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.94% (7.4875 => 7.0425, std.dev.: 0.1243) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.40% (1.1133 => 1.1089, std.dev.: 0.0489) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (0.0430 => 0.0428, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0337 => 0.0338, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0316 => 0.0315, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.24% (0.0424 => 0.0425, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/casts: -1.93% (0.0207 => 0.0203, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: -3.48% (0.0230 => 0.0222, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.48% (0.1449 => 0.1442, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 3.13% (1.1268 => 1.1621, std.dev.: 0.2407) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.4038 => 0.4026, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.50% (0.1466 => 0.1444, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.30% (0.0997 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.80% (0.0542 => 0.0568, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1497 => 1.1485, std.dev.: 0.1020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -30.00% (0.0030 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.30% (0.0615 => 0.0607, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.31% (0.0319 => 0.0318, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.38% (0.7379 => 0.7407, std.dev.: 0.0424) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 53.33% (0.0060 => 0.0092, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.03% (12.7485 => 12.7525, std.dev.: 0.0150) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 69.26% (0.2791 => 0.4724, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/life/life: 68.63% (0.0902 => 0.1521, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/family/family: 60.32% (0.0436 => 0.0699, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 10.56% (0.9564 => 1.0574, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.35% (0.9867 => 1.0395, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320637.50% (0.0008 => 2.5659, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 108.21% (1.1825 => 2.4621, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.98% (0.2562 => 0.2869, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 5.12% (7.2040 => 7.5729, std.dev.: 0.0309) SingleSource/Benchmarks/Misc/pi: 3.01% (2.1390 => 2.2033, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.84% (0.0808 => 0.0478, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.91% (0.0727 => 0.0495, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.34% (0.0692 => 0.0489, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -27.75% (0.1888 => 0.1364, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.47% (0.1684 => 0.1272, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.11% (0.1009 => 0.0796, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -18.98% (1.8964 => 1.5365, std.dev.: 0.0588) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.79% (0.1079 => 0.0887, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.02% (1.0960 => 0.9095, std.dev.: 0.0269) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.37% (0.7686 => 0.6428, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.95% (0.4074 => 0.3465, std.dev.: 0.0133) MultiSource/Applications/spiff/spiff: -12.95% (1.0220 => 0.8896, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -12.48% (0.1378 => 0.1206, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -11.75% (1.1433 => 1.0090, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.70% (0.0889 => 0.0785, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -11.70% (1.5979 => 1.4110, std.dev.: 0.0312) MultiSource/Applications/treecc/treecc: -11.02% (2.4719 => 2.1995, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.85% (1.5131 => 1.3489, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.24% (0.7693 => 0.6905, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.70% (1.3924 => 1.2574, std.dev.: 0.0309) MultiSource/Applications/sgefa/sgefa: -9.51% (0.3598 => 0.3256, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.50% (0.1210 => 0.1095, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.43% (0.5746 => 0.5204, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.23% (0.2372 => 0.2153, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.02% (0.3560 => 0.3239, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.92% (0.9124 => 0.8310, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -8.91% (2.6437 => 2.4082, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.75% (1.6874 => 1.5398, std.dev.: 0.0179) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.69% (0.9588 => 0.8755, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.60% (10.2703 => 9.3872, std.dev.: 0.1893) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.57% (0.6885 => 0.6295, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.47% (1.1498 => 1.0524, std.dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: -7.39% (17.4365 => 16.1488, std.dev.: 0.3204) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.31% (0.1587 => 0.1471, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.35% (0.2615 => 0.2449, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.46% (0.3462 => 0.3273, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.35% (0.3981 => 0.3768, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.26% (0.2283 => 0.2163, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.21% (0.3093 => 0.2932, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.13% (0.2709 => 0.2570, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: -5.01% (0.4689 => 0.4454, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.91% (1.0017 => 0.9525, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.48% (5.0381 => 4.8124, std.dev.: 0.0686) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.37% (0.6934 => 0.6631, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/ary2: -4.24% (0.2665 => 0.2552, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.22% (1.3220 => 1.2662, std.dev.: 0.0118) MultiSource/Applications/d/make_dparser: -4.20% (3.7840 => 3.6249, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/ary3: -4.06% (0.2564 => 0.2460, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -4.05% (0.3206 => 0.3076, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: -3.96% (0.2551 => 0.2450, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.70% (0.3847 => 0.3743, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.35% (0.4762 => 0.4650, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: -1.26% (0.9759 => 0.9636, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.53% (2.8778 => 2.3445, std.dev.: 0.1365) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.92% (0.1164 => 0.1002, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -11.74% (1.4588 => 1.2876, std.dev.: 0.0391) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -10.32% (4.5259 => 4.0587, std.dev.: 0.1792) SingleSource/Benchmarks/Shootout/nestedloop: -10.14% (0.2200 => 0.1977, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.34% (0.3609 => 0.3344, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/health/health: -6.54% (0.3654 => 0.3415, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.32% (46.0987 => 43.6467, std.dev.: 0.7049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.54% (1.4446 => 1.3934, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -3.01% (1.0425 => 1.0111, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.3406 => 0.3306, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.4730 => 4.3487, std.dev.: 0.0462) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.13% (0.5826 => 0.5702, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (5.7021 => 5.5956, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.60% (5.9063 => 5.8120, std.dev.: 0.0310) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3161, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/FloatMM: -1.28% (0.8328 => 0.8221, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.95% (1.2047 => 1.1089, std.dev.: 0.0489) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.49% (0.0445 => 0.0425, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/casts: -4.69% (0.0213 => 0.0203, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: -39.77% (1.9293 => 1.1621, std.dev.: 0.2407) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.57% (0.4049 => 0.4026, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.37% (0.1510 => 0.1444, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.73% (0.0590 => 0.0568, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.14% (1.1617 => 1.1485, std.dev.: 0.1020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -34.38% (0.0032 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.7437 => 0.7407, std.dev.: 0.0424) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0092 => 0.0092, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.20% (12.7781 => 12.7525, std.dev.: 0.0150) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 09:20:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 11:20:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115172046.D8A7E2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7624?compare_to=7622&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7624, Order: 172533, Start Time: 2013-01-15 15:46:50, End Time: 2013-01-15 17:20:52 To: 7622, Order: 172528, Start Time: 2013-01-15 13:49:22, End Time: 2013-01-15 15:23:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (100 on baseline) Performance Improvements: 2 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.10% (29.5128 => 29.8373, std.dev.: 0.0295) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.22% (1.2967 => 1.2679, std.dev.: 0.0086) MultiSource/Benchmarks/llubenchmark/llu: -2.00% (3.8503 => 3.7733, std.dev.: 0.0186) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.55% (0.0717 => 0.1187, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.57% (0.1132 => 0.1546, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.53% (0.6395 => 0.8667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.63% (0.6260 => 0.8365, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.52% (0.5688 => 0.7538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.51% (0.5805 => 0.7692, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.09% (0.6230 => 0.8229, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.59% (0.5575 => 0.7336, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.54% (0.5567 => 0.7323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.39% (0.5941 => 0.7806, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.37% (0.5581 => 0.7332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.92% (0.5802 => 0.7596, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.55% (0.5705 => 0.7448, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.50% (0.6033 => 0.7873, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.30% (0.5859 => 0.7634, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.26% (0.5849 => 0.7619, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.05% (0.5478 => 0.7124, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.73% (0.5570 => 0.7226, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.59% (0.5569 => 0.7217, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.55% (0.6440 => 0.8343, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.30% (0.5591 => 0.7229, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.23% (0.5925 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.44% (0.6189 => 0.7949, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.38% (0.5857 => 0.7519, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.37% (0.6676 => 0.8570, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.30% (0.5863 => 0.7522, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.08% (0.6446 => 0.8256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.81% (0.6304 => 0.8057, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.69% (1.6474 => 2.1036, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.64% (0.6194 => 0.7844, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.25% (0.6681 => 0.8435, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.14% (0.6297 => 0.7943, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (0.6667 => 0.8307, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.30% (0.7524 => 0.9277, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.58% (0.7339 => 0.8996, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.45% (2.2587 => 2.7206, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.03% (1.1450 => 1.3400, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.89% (0.3357 => 0.3857, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.64% (1.6364 => 1.8432, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.78% (4.5069 => 5.0377, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.45% (0.4916 => 0.5479, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.05% (0.4515 => 0.5014, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.48% (3.5339 => 3.9042, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.10% (0.2385 => 0.2602, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.00% (9.2283 => 10.0593, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.83% (0.7021 => 0.7641, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.09% (1.2515 => 1.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.36% (0.5329 => 0.5721, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.00% (1.4642 => 1.5667, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (1.2784 => 1.3638, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (0.4861 => 0.5102, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.88% (0.3255 => 0.3414, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.59% (5.0226 => 5.2028, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: 3.32% (1.3864 => 1.4324, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.70% (5.4682 => 5.6158, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 2.49% (3.5154 => 3.6031, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.36% (22.4056 => 22.9343, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/bigfib: 2.06% (0.6750 => 0.6889, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 1.88% (0.8418 => 0.8576, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 1.59% (15.5079 => 15.7551, std.dev.: 0.0152) MultiSource/Applications/minisat/minisat: 1.57% (0.7447 => 0.7564, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.22% (1.3722 => 1.3890, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 1.12% (16.1920 => 16.3731, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.49% (31.3723 => 55.6817, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3690, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.74% (5.1955 => 5.4419, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1685, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (54.5751 => 56.6371, std.dev.: 0.0496) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1042, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2844, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6016, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.55% (0.1431 => 0.1323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.48% (0.3194 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.25% (0.3837 => 0.3597, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.95% (0.3812 => 0.3585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.79% (0.3884 => 0.3659, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.77% (0.3831 => 0.3610, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.75% (0.2871 => 0.2706, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.74% (0.3848 => 0.3627, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.72% (0.3059 => 0.2884, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.72% (0.3323 => 0.3133, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.70% (0.3880 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.60% (0.3896 => 0.3678, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -5.48% (0.2849 => 0.2693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.45% (0.4033 => 0.3813, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.43% (0.3205 => 0.3031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.39% (2.1713 => 2.0542, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.34% (0.3016 => 0.2855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -5.32% (0.3025 => 0.2864, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.23% (0.3252 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -5.12% (0.2989 => 0.2836, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.98% (0.4199 => 0.3990, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.89% (1.3148 => 1.2505, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.72% (0.4151 => 0.3955, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.60% (0.4280 => 0.4083, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (0.9852 => 0.9400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.44% (0.6347 => 0.6065, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.35% (0.7779 => 0.7441, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -4.11% (0.3621 => 0.3472, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.11% (0.6441 => 0.6176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -4.11% (0.3867 => 0.3708, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.97% (2.4924 => 2.3935, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.96% (0.4321 => 0.4150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.93% (0.4248 => 0.4081, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.61% (0.4427 => 0.4267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.59% (0.3849 => 0.3711, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.56% (0.6484 => 0.6253, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (0.9542 => 0.9209, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.47% (0.3658 => 0.3531, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.23% (0.4083 => 0.3951, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2068, std.dev.: 0.0363) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.70% (0.4813 => 0.4683, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.61% (0.7919 => 0.7712, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.27% (1.0544 => 1.0305, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.90% (0.7982 => 0.7830, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.87% (1.2221 => 1.1992, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.79% (1.2210 => 1.1992, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.71% (4.3330 => 4.2588, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -1.49% (1.5610 => 1.5378, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8521 => 0.8397, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -1.28% (2.4021 => 2.3713, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.28% (14.2083 => 14.0264, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (1.2300 => 1.2146, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.20% (0.9077 => 0.8968, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.87% (1.8100 => 0.6902, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3964, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -23.34% (83.5423 => 64.0406, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1268, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8591, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4009, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.18% (1.3096 => 1.2679, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.10% (7.9763 => 7.7291, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.52% (3.7241 => 3.6301, std.dev.: 0.0318) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4669, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1933, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.45% (4.8776 => 4.8067, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.39% (1.6086 => 1.5863, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6092, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6042, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 10:03:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 12:03:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115180323.74EE52A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7625?compare_to=7621&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7625, Order: 172533, Start Time: 2013-01-15 15:51:37, End Time: 2013-01-15 18:03:23 To: 7621, Order: 172528, Start Time: 2013-01-15 13:09:38, End Time: 2013-01-15 15:21:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1331 => 0.1333) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0415 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8345 => 499.8376, std.dev.: 0.0125) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44223.63% (1.1277 => 499.8376, std.dev.: 0.0125) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.58% (0.5229 => 1.6711, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 21.33% (14.9895 => 18.1872, std.dev.: 0.0075) MultiSource/Applications/kimwitu++/kc: 43.69% (14.1553 => 20.3401, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 18.41% (4.1105 => 4.8671, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.82% (1.1048 => 1.7878, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.35% (7.1582 => 38.5361, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.52% (3.4629 => 6.3899, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.80% (0.6222 => 1.0876, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.58% (0.0720 => 7.4445, std.dev.: 0.0110) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 11143700.00% (0.0001 => 11.1438, std.dev.: 0.0547) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486600.00% (0.0001 => 5.4867, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 831.60% (1.1194 => 10.4283, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 151.60% (22.1758 => 55.7951, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/lowercase: 125.39% (0.0256 => 0.0577) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.39% (0.0929 => 0.1778, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.52% (0.1463 => 0.2524, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) MultiSource/Applications/JM/lencod/lencod: 64.36% (21.9371 => 36.0559, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.20% (7.0540 => 11.0889, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.73% (2.9384 => 4.6055, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.09% (1.5859 => 2.3962, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 51.04% (0.1056 => 0.1595, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.25% (8.1363 => 12.2246, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.43% (2.2024 => 3.1148, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.32% (0.0439 => 0.0616, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.98% (0.3109 => 0.4352, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.87% (4.2646 => 5.7516, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.84% (1.5415 => 2.0786, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.96% (0.4615 => 0.6136, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.66% (0.1892 => 0.2491, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.67% (0.2700 => 0.3528, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 30.48% (1.1642 => 1.5190, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.38% (0.2271 => 0.2961, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 30.38% (0.1175 => 0.1532, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.68% (0.4299 => 0.5575, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.57% (0.6675 => 0.8649, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.76% (0.5105 => 0.6522, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 27.50% (9.4845 => 12.0924, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.86% (0.2554 => 0.3240, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.46% (1.0722 => 1.3559, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.05% (3.8922 => 4.9060, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.87% (1.4186 => 1.7714, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.81% (0.3121 => 0.3864, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.53% (0.1143 => 0.1412, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 22.88% (5.7591 => 7.0768, std.dev.: 0.0099) MultiSource/Applications/minisat/minisat: 22.84% (0.7115 => 0.8740, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 22.62% (0.4289 => 0.5259, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.23% (4.9449 => 6.0442, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.19% (0.0730 => 0.0892, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 22.08% (0.4620 => 0.5640, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 21.73% (3.3354 => 4.0602, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.47% (0.0871 => 0.1058, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.45% (5.0018 => 6.0745, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 21.24% (0.3098 => 0.3756, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.05% (0.7835 => 0.9484, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.95% (1.3050 => 1.5784, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 20.71% (0.1695 => 0.2046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.47% (0.1236 => 0.1489, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.93% (0.5860 => 0.7028, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.37% (0.8172 => 0.9755, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 19.33% (0.6456 => 0.7704, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 18.85% (0.1268 => 0.1507, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.61% (0.1510 => 0.1791, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.52% (0.3423 => 0.4057, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.39% (0.5020 => 0.5943, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.05% (0.7433 => 0.8775, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.99% (3.8723 => 4.5688, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.73% (1.1840 => 1.3939, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.5569 => 0.6541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.44% (0.9765 => 1.1468, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 17.30% (2.0273 => 2.3781, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.15% (0.0834 => 0.0977, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.08% (0.3307 => 0.3872, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.01% (0.6450 => 0.7547, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 16.89% (0.3180 => 0.3717, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 16.77% (0.3387 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.55% (2.2969 => 2.6771, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 16.54% (0.2049 => 0.2388, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.49% (0.5981 => 0.6967, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.48% (0.8101 => 0.9436, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 16.35% (10.3673 => 12.0622, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.87% (0.8067 => 0.9347, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.84% (1.1861 => 1.3740, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.84% (0.3441 => 0.3986, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.8921 => 1.0241, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 14.65% (0.3283 => 0.3764, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 14.20% (0.3232 => 0.3691, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 13.76% (17.1811 => 19.5455, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 13.38% (1.5603 => 1.7691, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.02% (14.3668 => 16.2371, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary2: 12.78% (0.3379 => 0.3811, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.75% (0.4103 => 0.4626, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.61% (0.3092 => 0.3482, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.19% (0.4636 => 0.5201, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.14% (0.3427 => 0.3843, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.01% (0.3865 => 0.4329, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.51% (0.3927 => 0.4379, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.99% (0.4203 => 0.4665, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.33% (0.4048 => 0.4466, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (0.3422 => 0.3769, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.10% (0.3603 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.02% (0.3694 => 0.4064, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.88% (0.3684 => 0.4048, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 9.83% (63.2438 => 69.4620, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.72% (0.3826 => 0.4198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.4064 => 0.4433, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.16% (0.6030 => 0.6522, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.77% (0.7326 => 0.7895, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.64% (7.9617 => 8.5700, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.62% (2.0665 => 2.2240, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 7.57% (1.2842 => 1.3814, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.40% (0.3650 => 0.3920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 7.30% (0.2877 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.27% (0.3935 => 0.4221, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.18% (0.3162 => 0.3389, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.11% (0.3177 => 0.3403, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.81% (0.2891 => 0.3088, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.57% (0.2756 => 0.2937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.57% (0.2802 => 0.2986, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (0.2266 => 0.2414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.41% (0.2793 => 0.2972, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 6.35% (0.2725 => 0.2898, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.22% (0.3136 => 0.3331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 6.19% (0.2714 => 0.2882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2461, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.14% (1.1396 => 1.2438, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4520, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3112, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.24% (0.9957 => 1.0280, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9056, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.41% (3.6395 => 3.7271, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.95% (9.1159 => 9.2937, std.dev.: 0.0152) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2795, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.51% (1.0785 => 1.0948, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4571, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1699, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.13% (5.2763 => 1.2068, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.11% (0.8651 => 0.2153, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.57% (5.3855 => 4.4933, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.14% (5.3526 => 4.4885, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -10.65% (10.4361 => 9.3249, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.64% (1.7609 => 1.6263, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.58% (54.1659 => 50.0621, std.dev.: 0.0541) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.13% (1.9577 => 0.6630, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3086, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4322, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8522, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0063, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.04% (0.6223 => 0.5038, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2845, std.dev.: 0.0657) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2373 => 1.1542, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5794, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.94% (8.1563 => 7.7535, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.57% (1.5835 => 1.5111, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.23% (10.2830 => 9.8478, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1575, std.dev.: 0.0016) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.6994 => 3.6254, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.62% (12.5348 => 12.3313, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7221 => 3.6691, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout/lists: -1.25% (6.2999 => 6.2211, std.dev.: 0.0078) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0007) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 11:02:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 13:02:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130115190207.688BA2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7626?compare_to=7609&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7626, Order: 172533, Start Time: 2013-01-15 15:28:06, End Time: 2013-01-15 19:02:05 To: 7609, Order: 172499, Start Time: 2013-01-15 03:17:08, End Time: 2013-01-15 06:52:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (175 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (762 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.53% (2.4496 => 2.4872, std.dev.: 0.0109) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.26% (54.2368 => 54.9205, std.dev.: 0.0664) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.36% (0.1063 => 0.1407, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.28% (0.2969 => 0.3779, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.51% (0.4139 => 0.5195, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.06% (0.4253 => 0.5319, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.02% (0.5900 => 0.7376, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.97% (0.0584 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.58% (0.1620 => 0.2002, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.43% (0.4994 => 0.6164, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.88% (0.5000 => 0.6144, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 22.56% (1.5932 => 1.9526, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.19% (0.0897 => 0.1096, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.80% (0.0633 => 0.0771, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.92% (0.0822 => 0.0994, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 20.83% (0.0821 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 20.82% (0.1604 => 0.1938, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.79% (0.1549 => 0.1871, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.65% (0.3903 => 0.4709, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.52% (0.0541 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 20.51% (0.1619 => 0.1951, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 18.86% (0.4029 => 0.4789, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 18.57% (0.5826 => 0.6908, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.57% (0.2014 => 0.2388, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.47% (0.1088 => 0.1289, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.25% (0.5889 => 0.6964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.1505 => 0.1778, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.12% (0.3890 => 0.4595, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.06% (0.2736 => 0.3230, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.00% (0.2866 => 0.3382, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 17.70% (0.0808 => 0.0951, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 17.63% (0.9697 => 1.1407, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.33% (0.5546 => 0.6507, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 17.15% (1.8794 => 2.2018, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.15% (3.5627 => 4.1737, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.01% (0.2875 => 0.3364, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.97% (0.3271 => 0.3826, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.92% (1.3152 => 1.5377, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.81% (0.1160 => 0.1355, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 16.61% (0.2811 => 0.3278, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.53% (0.4658 => 0.5428, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.51% (0.2792 => 0.3253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.49% (0.2911 => 0.3391, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.47% (0.2750 => 0.3203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.44% (0.2738 => 0.3188, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 16.37% (0.2725 => 0.3171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 16.34% (0.2803 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.32% (0.2714 => 0.3157, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.31% (0.1968 => 0.2289, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.30% (1.6211 => 1.8853, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 16.19% (0.2823 => 0.3280, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 16.17% (0.2813 => 0.3268, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 16.15% (0.3004 => 0.3489, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.13% (0.7171 => 0.8328, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 16.12% (0.2780 => 0.3228, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.99% (0.3195 => 0.3706, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.99% (2.0673 => 2.3979, std.dev.: 0.0054) MultiSource/Applications/hexxagon/hexxagon: 15.95% (0.9909 => 1.1489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.92% (0.3096 => 0.3589, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3258 => 0.3771, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 15.73% (0.3267 => 0.3781, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 15.69% (0.1421 => 0.1644, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.48% (4.4195 => 5.1036, std.dev.: 0.0209) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.47% (0.3930 => 0.4538, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 15.47% (0.3317 => 0.3830, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.42% (0.3060 => 0.3532, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.33% (1.9694 => 2.2713, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.32% (0.4361 => 0.5029, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.26% (0.5026 => 0.5793, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.11% (2.7292 => 3.1415, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.08% (0.3362 => 0.3869, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.04% (0.3124 => 0.3594, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.99% (1.9966 => 2.2958, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.87% (0.3726 => 0.4280, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.85% (0.3496 => 0.4015, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.83% (0.3465 => 0.3979, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 14.82% (1.0781 => 1.2379, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 14.76% (0.3442 => 0.3950, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.68% (0.3460 => 0.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.68% (0.3678 => 0.4218, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 14.61% (0.3348 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.59% (0.3282 => 0.3761, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: 14.47% (0.3477 => 0.3980, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.43% (0.3625 => 0.4148, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 14.39% (4.2109 => 4.8170, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 14.33% (23.5202 => 26.8908, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/hash: 14.30% (0.4146 => 0.4739, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: 14.27% (0.3643 => 0.4163, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.12% (0.3724 => 0.4250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.12% (0.3690 => 0.4211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.12% (0.3981 => 0.4543, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.09% (0.4251 => 0.4850, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.76% (0.3845 => 0.4374, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 13.71% (1.4269 => 1.6225, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.49% (0.1090 => 0.1237, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 13.23% (0.5012 => 0.5675, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 13.17% (0.2566 => 0.2904, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 12.98% (0.7875 => 0.8897, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.16% (0.1028 => 0.1153, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.00% (0.6435 => 0.7207, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 11.70% (2.1653 => 2.4187, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 11.35% (4.6177 => 5.1420, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 11.30% (5.5417 => 6.1679, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.25% (0.2737 => 0.3045, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 11.24% (2.1013 => 2.3375, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: 11.23% (0.2075 => 0.2308, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 11.11% (0.2691 => 0.2990, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 10.92% (0.3498 => 0.3880, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.41% (0.3084 => 0.3405, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 9.68% (0.3336 => 0.3659, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.65% (0.2103 => 0.2306, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.48% (0.5361 => 0.5869, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.35% (0.4847 => 0.5300, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 9.32% (0.6634 => 0.7252, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.20% (11.6398 => 12.7106, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.07% (0.2040 => 0.2225, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.42% (4.6926 => 5.0876, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.28% (0.7426 => 0.8041, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 7.28% (0.2391 => 0.2565, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 7.02% (2.0346 => 2.1774, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.61% (0.5584 => 0.5953, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 6.32% (11.9555 => 12.7111, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.56% (0.3792 => 0.4003, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5147, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 8.28% (0.2802 => 0.3034, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2413, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8915, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6790, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5024, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2005, std.dev.: 0.0050) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3032, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2878, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2082, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4816, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5797, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5784, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.46% (17.2379 => 14.2284, std.dev.: 0.1501) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7951, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -5.19% (14.0481 => 13.3194, std.dev.: 0.2084) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4811, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.73% (41.7953 => 40.2364, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8051, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.89% (0.6293 => 0.6111, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1516, std.dev.: 0.0587) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5726, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0445, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (105.3826 => 104.2769, std.dev.: 0.0111) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 11:18:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 13:18:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115191823.4619F2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7627?compare_to=7624&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7627, Order: 172540, Start Time: 2013-01-15 17:44:16, End Time: 2013-01-15 19:18:27 To: 7624, Order: 172533, Start Time: 2013-01-15 15:46:50, End Time: 2013-01-15 17:20:52 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.69% (0.0717 => 0.1188, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.28% (0.6395 => 0.8779, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.40% (0.6395 => 0.8659, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.61% (0.6260 => 0.8364, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.44% (0.5805 => 0.7688, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.32% (0.5575 => 0.7321, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.11% (0.5581 => 0.7317, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.02% (0.5941 => 0.7784, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.80% (0.5802 => 0.7589, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.50% (0.5705 => 0.7445, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.11% (0.5859 => 0.7623, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.02% (0.5849 => 0.7605, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.81% (0.5478 => 0.7111, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.53% (0.5570 => 0.7215, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.50% (0.5569 => 0.7212, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.20% (0.5925 => 0.7655, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.12% (0.5591 => 0.7219, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.31% (0.5857 => 0.7515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 28.23% (0.0418 => 0.0536) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.23% (0.5863 => 0.7518, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.23% (0.6189 => 0.7936, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.16% (0.6676 => 0.8556, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.92% (0.6446 => 0.8246, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.58% (1.6474 => 2.1018, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.51% (0.6194 => 0.7836, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.23% (0.6297 => 0.7949, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.14% (0.6660 => 0.8401, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.09% (0.6681 => 0.8424, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.10% (0.7524 => 0.9262, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.52% (0.7339 => 0.8992, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.34% (2.2587 => 2.7181, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 17.02% (1.1450 => 1.3399, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3357 => 0.3847, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.63% (1.6364 => 1.8431, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.12% (0.0833 => 0.0934, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.80% (4.5069 => 5.0385, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.49% (0.4916 => 0.5481, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 11.01% (0.4515 => 0.5012, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.46% (3.5339 => 3.9036, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2385 => 0.2603, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 8.88% (9.2283 => 10.0480, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.69% (0.7021 => 0.7631, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.20% (1.2515 => 1.3541, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.28% (0.5329 => 0.5717, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.95% (1.4642 => 1.5659, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (1.2784 => 1.3635, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4524 => 0.4777, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.12% (0.4861 => 0.5110, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 4.92% (0.3255 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 3.65% (5.0226 => 5.2057, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.3864 => 1.4322, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.86% (5.4682 => 5.6245, std.dev.: 0.0050) MultiSource/Applications/d/make_dparser: 2.45% (3.5154 => 3.6014, std.dev.: 0.0122) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (22.4056 => 22.9419, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.6750 => 0.6891, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7669, std.dev.: 0.0174) MultiSource/Applications/spiff/spiff: 1.66% (0.8418 => 0.8558, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 1.56% (0.7447 => 0.7563, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3722 => 1.3892, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 1.05% (16.1920 => 16.3628, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6664, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4408, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1683, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4038, std.dev.: 0.1373) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2844, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6057, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.33% (0.3194 => 0.2960, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.61% (0.2903 => 0.2740, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -5.58% (0.2849 => 0.2690, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -5.49% (0.3205 => 0.3029, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.49% (0.2933 => 0.2772, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -5.36% (0.3059 => 0.2895, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.27% (2.1713 => 2.0569, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.26% (0.3252 => 0.3081, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -5.09% (0.3025 => 0.2871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.01% (0.3812 => 0.3621, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.86% (1.3148 => 1.2509, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.65% (0.3891 => 0.3710, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.63% (0.9852 => 0.9396, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.60% (0.4151 => 0.3960, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.59% (0.3896 => 0.3717, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.4176 => 0.3985, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.17% (0.4199 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.11% (0.6347 => 0.6086, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.01% (0.3867 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.95% (0.7779 => 0.7472, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.93% (0.4321 => 0.4151, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3961, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.79% (0.3931 => 0.3782, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.79% (0.4280 => 0.4118, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.76% (0.6441 => 0.6199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.74% (0.4248 => 0.4089, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3849 => 0.3712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.52% (0.4427 => 0.4271, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.52% (0.9542 => 0.9206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.35% (0.3788 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.71% (20.7746 => 20.2120, std.dev.: 0.0301) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.60% (0.4813 => 0.4688, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.53% (0.7919 => 0.7719, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.20% (1.0544 => 1.0312, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: -2.19% (0.7982 => 0.7807, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -1.85% (0.9179 => 0.9009, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -1.77% (4.3330 => 4.2563, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.73% (1.2221 => 1.2009, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.69% (1.2210 => 1.2004, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.37% (1.5610 => 1.5396, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.34% (0.8521 => 0.8407, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -1.33% (2.4021 => 2.3701, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.23% (14.2083 => 14.0337, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.03% (34.0927 => 33.7426, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.80% (1.8100 => 0.6734, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -37.05% (0.1622 => 0.1021, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.06% (1.3643 => 1.0224, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7490, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0325, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1737, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.02% (2.5106 => 2.1334, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.05% (2.2633 => 2.1717, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7308, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2730, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.23% (3.7241 => 3.6410, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.60% (1.6086 => 1.5829, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.53% (1.6307 => 1.6057, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1929, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.51% (4.8776 => 4.8041, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5998, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7092 => 3.6588, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 11:26:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 13:26:32 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115192632.E34362A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7628?compare_to=7623&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7628, Order: 172539, Start Time: 2013-01-15 17:24:41, End Time: 2013-01-15 19:26:40 To: 7623, Order: 172533, Start Time: 2013-01-15 15:03:25, End Time: 2013-01-15 17:04:54 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 8 (5 on baseline) Performance Improvements: 7 (61 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1048 (997 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.19% (1.4600 => 1.8570, std.dev.: 0.0101) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.35% (1.2602 => 1.5796, std.dev.: 0.0608) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.76% (2.3445 => 2.5967, std.dev.: 0.0911) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.93% (1.2876 => 1.3639, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (0.3344 => 0.3518, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 4.10% (3.4869 => 3.6300, std.dev.: 0.0248) SingleSource/Benchmarks/Misc/mandel: 2.23% (1.0428 => 1.0661, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.50% (1.5829 => 1.6067, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -41.15% (0.4724 => 0.2780, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/life/life: -40.50% (0.1521 => 0.0905, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -30.42% (0.4626 => 0.3219, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -9.28% (0.9570 => 0.8682, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.06% (0.2277 => 0.2139, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -5.09% (2.7042 => 2.5665, std.dev.: 0.0216) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.18% (2.4621 => 2.4084, std.dev.: 0.0137) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.36% (1.1089 => 1.1351, std.dev.: 0.0551) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0220 => 0.0221, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.37% (0.0428 => 0.0451, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0338 => 0.0335, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0315 => 0.0317, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.88% (0.0425 => 0.0433, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: 2.96% (0.0203 => 0.0209, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -0.90% (0.0222 => 0.0220, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.32% (0.1442 => 0.1461, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: -1.27% (1.1621 => 1.1473, std.dev.: 0.2914) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.79% (0.4026 => 0.4259, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.91% (0.1444 => 0.1402, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.03% (0.0994 => 0.0944, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.18% (0.0568 => 0.0567, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.63% (1.1485 => 1.1557, std.dev.: 0.0563) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.05% (0.0021 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -53.85% (0.0026 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.67% (0.0607 => 0.0524, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (0.0318 => 0.0264, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.93% (0.7407 => 0.7550, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7525 => 12.7644, std.dev.: 0.0258) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.06% (1.8651 => 1.9035, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.51% (0.7225 => 0.7334, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319562.50% (0.0008 => 2.5573, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.67% (1.1825 => 2.4084, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.93% (0.2562 => 0.2842, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.70% (0.0727 => 0.0482, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -27.44% (0.1888 => 0.1370, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.30% (0.1684 => 0.1258, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -19.25% (1.8964 => 1.5313, std.dev.: 0.0879) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.79% (0.0862 => 0.0700, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.61% (0.7686 => 0.6409, std.dev.: 0.0227) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.48% (1.0960 => 0.9154, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.32% (1.0986 => 0.9303, std.dev.: 0.0285) MultiSource/Applications/spiff/spiff: -13.10% (1.0220 => 0.8881, std.dev.: 0.0467) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.42% (0.1079 => 0.0945, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: -11.28% (2.4719 => 2.1931, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.74% (0.7693 => 0.6867, std.dev.: 0.0291) MultiSource/Applications/hexxagon/hexxagon: -10.67% (1.1433 => 1.0213, std.dev.: 0.0193) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.27% (1.2154 => 1.0906, std.dev.: 0.0450) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -9.97% (0.2709 => 0.2439, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.88% (6.4235 => 5.7891, std.dev.: 0.2445) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.24% (1.3924 => 1.2637, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -8.91% (2.6437 => 2.4081, std.dev.: 0.0605) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.68% (0.1210 => 0.1105, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.43% (0.2372 => 0.2172, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.40% (0.6885 => 0.6307, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.13% (0.9124 => 0.8382, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.01% (1.1498 => 1.0577, std.dev.: 0.0242) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.01% (0.3560 => 0.3275, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.83% (1.6874 => 1.5553, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/fibo: -7.28% (0.2006 => 0.1860, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.84% (0.5746 => 0.5353, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.78% (0.1755 => 0.1636, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: -6.72% (0.4002 => 0.3733, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.14% (0.2100 => 0.1971, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -6.08% (0.2385 => 0.2240, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.98% (0.3665 => 0.3446, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hello: -5.50% (0.1928 => 0.1822, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -5.12% (0.4689 => 0.4449, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.02% (0.9127 => 0.8669, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary2: -4.69% (0.2665 => 0.2540, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.55% (0.9788 => 0.9343, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.48% (0.6934 => 0.6693, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.30% (0.3394 => 0.3282, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.95% (1.0088 => 0.9790, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.42% (0.5369 => 0.5239, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.72% (0.9372 => 0.6493, std.dev.: 0.1089) SingleSource/Benchmarks/Shootout/heapsort: -26.05% (4.4739 => 3.3084, std.dev.: 0.4249) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.29% (0.1164 => 0.1021, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -10.06% (4.5259 => 4.0706, std.dev.: 0.0698) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.77% (2.8778 => 2.5967, std.dev.: 0.0911) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.96% (0.3217 => 0.2961, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.51% (1.4588 => 1.3639, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/ary3: -6.15% (2.2304 => 2.0932, std.dev.: 0.0427) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.39% (1.4446 => 1.3812, std.dev.: 0.0163) SingleSource/Benchmarks/McGill/chomp: -2.80% (1.0425 => 1.0133, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.98% (3.0082 => 2.9486, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.77% (0.5826 => 0.5723, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: -1.75% (4.4730 => 4.3947, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/ReedSolomon: -1.30% (8.6447 => 8.5319, std.dev.: 0.0327) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3596 => 3.3173, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.13% (3.1921 => 3.1561, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.78% (1.2047 => 1.1351, std.dev.: 0.0551) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0451 => 0.0451, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0072) MultiSource/Applications/lemon/lemon: -40.53% (1.9293 => 1.1473, std.dev.: 0.2914) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.19% (0.4049 => 0.4259, std.dev.: 0.0597) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.15% (0.1510 => 0.1402, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.48% (0.0978 => 0.0944, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.90% (0.0590 => 0.0567, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1617 => 1.1557, std.dev.: 0.0563) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -55.56% (0.0027 => 0.0012, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.10% (0.0610 => 0.0524, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.49% (0.0268 => 0.0264, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.52% (0.7437 => 0.7550, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7644, std.dev.: 0.0258) Report Time: 0.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 12:45:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 14:45:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115204534.593CF2A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7629?compare_to=7625&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7629, Order: 172540, Start Time: 2013-01-15 18:33:37, End Time: 2013-01-15 20:45:40 To: 7625, Order: 172533, Start Time: 2013-01-15 15:51:37, End Time: 2013-01-15 18:03:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (220 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.75% (11.0889 => 11.2834, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/SPASS/SPASS: 1.01% (11.1438 => 11.2558, std.dev.: 0.0111) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -0.03% (499.8376 => 499.7108, std.dev.: 0.0654) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44212.39% (1.1277 => 499.7108, std.dev.: 0.0654) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.76% (0.5229 => 1.6668, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 21.20% (14.9895 => 18.1670, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 43.83% (14.1553 => 20.3598, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 18.80% (4.1105 => 4.8833, std.dev.: 0.0165) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.68% (1.1048 => 1.7862, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.55% (7.1582 => 38.5504, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.71% (3.4629 => 6.3963, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.99% (0.6222 => 1.0888, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.31% (0.0720 => 7.4407, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11255700.00% (0.0001 => 11.2558, std.dev.: 0.0111) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9852600.00% (0.0001 => 9.8527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485000.00% (0.0001 => 5.4851, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 831.04% (1.1194 => 10.4221, std.dev.: 0.0128) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.75% (22.1758 => 55.8270, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/lowercase: 125.00% (0.0256 => 0.0576, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775) SingleSource/Regression/C/sumarray2d: 73.80% (0.0271 => 0.0471, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.18% (0.1463 => 0.2519, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 63.78% (21.9371 => 35.9293, std.dev.: 0.0025) SingleSource/Regression/C/sumarray: 60.61% (0.0231 => 0.0371, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.96% (7.0540 => 11.2834, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.11% (2.9384 => 4.6164, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/distray/distray: 51.33% (0.1056 => 0.1598, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.90% (1.5859 => 2.3931, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 50.51% (0.0394 => 0.0593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.41% (8.1363 => 12.2376, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.42% (0.0439 => 0.0634, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 42.19% (0.0730 => 0.1038, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.16% (2.2024 => 3.1088, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 40.01% (0.3109 => 0.4353, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.91% (0.1062 => 0.1454, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.84% (1.5415 => 2.0786, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.76% (4.2646 => 5.7468, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.87% (0.4615 => 0.6132, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.85% (0.2700 => 0.3533, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.71% (0.1892 => 0.2473, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 30.37% (1.1642 => 1.5178, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 30.30% (0.1175 => 0.1531, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.80% (0.4299 => 0.5580, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.26% (0.6675 => 0.8628, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.84% (0.5105 => 0.6526, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 27.51% (9.4845 => 12.0938, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/chomp: 27.43% (0.1655 => 0.2109, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.38% (0.1125 => 0.1433, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 26.90% (0.2554 => 0.3241, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.45% (1.0722 => 1.3558, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.90% (3.8922 => 4.9003, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.86% (1.4186 => 1.7713, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 23.43% (0.4289 => 0.5294, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.36% (0.1143 => 0.1410, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.30% (0.1695 => 0.2090, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 22.75% (5.7591 => 7.0694, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 22.52% (0.0626 => 0.0767, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.43% (0.7115 => 0.8711, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.26% (4.9449 => 6.0457, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash2: 22.23% (0.4620 => 0.5647, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 21.89% (0.1695 => 0.2066, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 21.75% (3.3354 => 4.0610, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 21.67% (0.1163 => 0.1415, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.48% (5.0018 => 6.0760, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.29% (0.1555 => 0.1886, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.17% (0.3098 => 0.3754, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.87% (1.3050 => 1.5773, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.68% (0.7835 => 0.9455, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.10% (0.1940 => 0.2330, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.55% (0.8172 => 0.9770, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 19.52% (0.6456 => 0.7716, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.38% (0.3423 => 0.4052, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.35% (0.5020 => 0.5941, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 18.30% (0.7433 => 0.8793, std.dev.: 0.0103) MultiSource/Applications/lua/lua: 17.96% (3.8723 => 4.5676, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2758 => 0.3249, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 17.70% (1.1840 => 1.3936, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 17.57% (0.2049 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.44% (0.5569 => 0.6540, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.43% (0.9765 => 1.1467, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 17.36% (0.0818 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.22% (0.6450 => 0.7561, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.14% (2.0273 => 2.3748, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.02% (0.3307 => 0.3870, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.59% (0.5981 => 0.6973, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 16.48% (0.3180 => 0.3704, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.40% (2.2969 => 2.6737, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 16.39% (0.3387 => 0.3942, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.33% (0.8101 => 0.9424, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 16.18% (10.3673 => 12.0447, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.96% (1.1861 => 1.3754, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.94% (0.8067 => 0.9353, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.87% (0.3441 => 0.3987, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 14.99% (0.3283 => 0.3775, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.76% (0.3232 => 0.3709, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.73% (0.8921 => 1.0235, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 13.75% (1.5603 => 1.7749, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 13.67% (0.3379 => 0.3841, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.67% (17.1811 => 19.5296, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.11% (14.3668 => 16.2500, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/bh/bh: 12.94% (0.3092 => 0.3492, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.60% (0.3865 => 0.4352, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.55% (0.4636 => 0.5218, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.02% (0.3427 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.91% (0.3282 => 0.3673, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.55% (0.4103 => 0.4577, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/property: 11.53% (0.3886 => 0.4334, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1268 => 0.1414, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.28% (0.4203 => 0.4677, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 10.62% (0.4048 => 0.4478, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.55% (0.3516 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.50% (0.3684 => 0.4071, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 10.37% (0.3422 => 0.3777, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.35% (0.3603 => 0.3976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.14% (0.3826 => 0.4214, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 10.14% (63.2438 => 69.6536, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.97% (0.4064 => 0.4469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.18% (0.1438 => 0.1570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 8.76% (0.2831 => 0.3079, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.32% (0.2871 => 0.3110, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.31% (2.2022 => 2.3853, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.24% (0.4879 => 0.5281, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.15% (2.0665 => 2.2350, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 8.06% (0.2877 => 0.3109, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 8.06% (0.2905 => 0.3139, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.05% (1.2842 => 1.3876, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.03% (0.5925 => 0.6401, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7326 => 0.7903, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.81% (0.3650 => 0.3935, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.62% (0.3162 => 0.3403, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.58% (0.2756 => 0.2965, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.57% (7.9617 => 8.5645, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.50% (0.3935 => 0.4230, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.34% (0.2793 => 0.2998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.23% (0.2725 => 0.2922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.08% (0.3052 => 0.3268, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (0.2872 => 0.3074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.96% (0.2802 => 0.2997, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.71% (0.2266 => 0.2418, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2458, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6982, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.74% (11.6436 => 12.4280, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4595, std.dev.: 0.0102) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3130, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1051, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.11% (0.9957 => 1.0267, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9090, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (3.6395 => 3.7170, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.94% (9.1159 => 9.2929, std.dev.: 0.0159) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2806, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4507, std.dev.: 0.0201) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.10% (5.2763 => 1.2081, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -74.87% (0.8651 => 0.2174, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.37% (0.1622 => 0.0951, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.04% (5.3855 => 4.5219, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.65% (5.3526 => 4.5150, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: -10.59% (10.4361 => 9.3309, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.52% (1.7609 => 1.6285, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -7.48% (54.1659 => 50.1155, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.94% (1.9577 => 0.6472, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.73% (10.7105 => 7.4189, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8629, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.41% (0.2161 => 0.1720, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.53% (1.6925 => 1.4296, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.39% (19.9488 => 18.2746, std.dev.: 0.0320) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.39% (1.2373 => 1.1582, std.dev.: 0.0093) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.31% (8.1563 => 7.7234, std.dev.: 0.0301) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.39% (10.2830 => 9.8318, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.6994 => 3.6375, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7221 => 3.6709, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0077) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0010) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 13:15:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 15:15:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115211537.037012A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7630?compare_to=7627&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7630, Order: 172545, Start Time: 2013-01-15 19:41:36, End Time: 2013-01-15 21:15:40 To: 7627, Order: 172540, Start Time: 2013-01-15 17:44:16, End Time: 2013-01-15 19:18:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (132 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.46% (0.3789 => 0.3996, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.69% (0.0717 => 0.1188, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.34% (0.6395 => 0.8783, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.48% (0.6395 => 0.8664, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.34% (0.6260 => 0.8347, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.49% (0.5688 => 0.7536, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.32% (0.5805 => 0.7681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.04% (0.6230 => 0.8226, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.02% (0.5456 => 0.7203, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.45% (0.5567 => 0.7318, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.26% (0.5941 => 0.7798, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.11% (0.5581 => 0.7317, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.80% (0.5802 => 0.7589, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.52% (0.5705 => 0.7446, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.12% (0.5849 => 0.7611, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.02% (0.5859 => 0.7618, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.77% (0.5570 => 0.7228, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.76% (0.5478 => 0.7108, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.32% (0.5569 => 0.7202, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.28% (0.5925 => 0.7660, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.26% (0.5591 => 0.7227, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.24% (0.5857 => 0.7511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.21% (0.5863 => 0.7517, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.18% (0.6676 => 0.8557, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.11% (0.6052 => 0.7753, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.03% (0.6446 => 0.8253, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.38% (1.6474 => 2.0985, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.61% (0.6194 => 0.7842, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.15% (0.6681 => 0.8428, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.01% (0.6297 => 0.7935, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (0.6667 => 0.8307, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.22% (0.7524 => 0.9271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.32% (0.7339 => 0.8977, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.28% (2.2587 => 2.7168, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 16.99% (1.1450 => 1.3395, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3357 => 0.3847, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.02% (0.1982 => 0.2240, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8424, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.82% (4.5069 => 5.0396, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.47% (0.4916 => 0.5480, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 10.92% (0.4515 => 0.5008, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.41% (3.5339 => 3.9017, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 8.96% (9.2283 => 10.0551, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.70% (0.7021 => 0.7632, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.24% (1.2515 => 1.3546, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.19% (0.5329 => 0.5712, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.4642 => 1.5686, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.61% (1.2784 => 1.3629, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 5.37% (0.4524 => 0.4767, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 5.10% (0.4861 => 0.5109, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.62% (5.0226 => 5.2045, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3.38% (1.3864 => 1.4333, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.00% (5.4682 => 5.6325, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 2.54% (3.5154 => 3.6048, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (22.4056 => 22.9455, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6750 => 0.6894, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.02% (0.8418 => 0.8588, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.72% (15.5079 => 15.7742, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 1.62% (0.7447 => 0.7568, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 1.05% (16.1920 => 16.3624, std.dev.: 0.0205) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.03% (4.8161 => 4.8655, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6679, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9531 => 1.0276, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.13% (1.2783 => 1.3695, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4406, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1690, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4948, std.dev.: 0.1310) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1003, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2859, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6050, std.dev.: 0.0140) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (79.7170 => 80.6399, std.dev.: 0.3489) MultiSource/Applications/viterbi/viterbi: 1.02% (4.4335 => 4.4788, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -7.29% (0.3194 => 0.2961, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.38% (0.1584 => 0.1483, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.69% (0.3057 => 0.2883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.68% (0.2903 => 0.2738, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.3059 => 0.2888, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.46% (0.2933 => 0.2773, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.37% (0.2849 => 0.2696, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.27% (0.2939 => 0.2784, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.17% (0.3252 => 0.3084, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -5.12% (0.3025 => 0.2870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.05% (2.1713 => 2.0617, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.3026 => 0.2874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.96% (0.3812 => 0.3623, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.88% (0.3831 => 0.3644, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -4.86% (0.3848 => 0.3661, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.75% (0.3896 => 0.3711, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.72% (0.2989 => 0.2848, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.68% (0.3891 => 0.3709) MultiSource/Applications/hexxagon/hexxagon: -4.60% (1.3148 => 1.2543, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.60% (0.4151 => 0.3960, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.59% (0.9852 => 0.9400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.56% (0.4033 => 0.3849, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.45% (0.3821 => 0.3651, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -4.25% (0.3621 => 0.3467, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -4.10% (0.6347 => 0.6087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.96% (0.3867 => 0.3714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.92% (0.7779 => 0.7474, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3963, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: -3.79% (0.4248 => 0.4087, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.71% (0.3931 => 0.3785, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -3.69% (0.4280 => 0.4122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.69% (0.3849 => 0.3707, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.63% (0.4321 => 0.4164, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (0.9542 => 0.9201, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: -3.51% (0.3788 => 0.3655, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.50% (0.4427 => 0.4272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1926, std.dev.: 0.0277) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.74% (0.4813 => 0.4681, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.32% (0.7919 => 0.7735, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.23% (1.0544 => 1.0309, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -1.77% (4.3330 => 4.2564, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1997, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (0.7982 => 0.7852, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.51% (1.2221 => 1.2037, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -1.42% (1.5610 => 1.5388, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.29% (0.8521 => 0.8411, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.19% (14.2083 => 14.0389, std.dev.: 0.0131) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.15% (1.2300 => 1.2159, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -1.12% (2.4021 => 2.3753, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.05% (34.0927 => 33.7364, std.dev.: 0.0317) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -64.22% (1.8100 => 0.6477, std.dev.: 0.0270) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3112, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -24.68% (1.3643 => 1.0276, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7550, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0326, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.69% (4.3779 => 3.3845, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.07% (2.5106 => 2.1322, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1039, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3403, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.42% (0.5142 => 0.4606, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.10% (4.1534 => 3.8587, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -4.08% (2.2633 => 2.1710, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.24% (1.3096 => 1.2672, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.08% (7.9763 => 7.7303, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.14% (3.7241 => 3.6445, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1941, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.49% (4.8776 => 4.8051, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.46% (1.6307 => 1.6069, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.32% (1.6219 => 1.6005, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.22% (1.6086 => 1.5889, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6695, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 13:44:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 15:44:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130115214457.29D062A6C064@llvm.org> http://llvm.org/perf/db_default/v4/nts/7631?compare_to=7628&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7631, Order: 172545, Start Time: 2013-01-15 19:44:02, End Time: 2013-01-15 21:45:05 To: 7628, Order: 172539, Start Time: 2013-01-15 17:24:41, End Time: 2013-01-15 19:26:40 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 3 (7 on baseline) Performance Improvements: 1 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1059 (1005 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.82% (21.0458 => 23.7438, std.dev.: 0.7970) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.20% (21.6686 => 22.1443, std.dev.: 0.1750) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.28% (1.8570 => 1.8807, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel: -1.54% (1.0661 => 1.0497, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.16% (1.1351 => 1.1219, std.dev.: 0.0963) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0335 => 0.0333, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0317 => 0.0317, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -16.40% (0.0433 => 0.0362, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/casts: -1.91% (0.0209 => 0.0205, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/test1: -10.91% (0.0220 => 0.0196, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -16.27% (0.0252 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.37% (0.1461 => 0.1441, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -0.22% (1.1473 => 1.1448, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.18% (0.4259 => 0.3996, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.06% (0.1402 => 0.1487, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.03% (0.0944 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.11% (0.0567 => 0.0538, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.55% (1.1557 => 1.1494, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.33% (0.0012 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.50% (0.0524 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.83% (0.0264 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.74% (0.7550 => 0.7419, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 190.48% (0.0042 => 0.0122, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7644 => 12.7538, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321775.00% (0.0008 => 2.5750, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.68% (1.1825 => 2.3849, std.dev.: 0.0364) MultiSource/Benchmarks/nbench/nbench: 15.76% (20.5117 => 23.7438, std.dev.: 0.7970) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.36% (0.2562 => 0.2853, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.10% (0.8800 => 0.8985, std.dev.: 0.0071) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (63.1520 => 64.1455, std.dev.: 0.3384) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.37% (0.0808 => 0.0498, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.53% (0.0727 => 0.0476, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.35% (0.0692 => 0.0482, std.dev.: 0.0061) SingleSource/Benchmarks/SmallPT/smallpt: -26.38% (0.1888 => 0.1390, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.00% (0.1684 => 0.1263, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.21% (0.1009 => 0.0795, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.38% (0.0676 => 0.0545, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -18.79% (1.8964 => 1.5400, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.49% (1.0986 => 0.9284, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.01% (0.1079 => 0.0917, std.dev.: 0.0055) MultiSource/Applications/spiff/spiff: -13.65% (1.0220 => 0.8825, std.dev.: 0.0108) MultiSource/Applications/aha/aha: -11.83% (0.1378 => 0.1215, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -11.33% (1.5979 => 1.4168, std.dev.: 0.0098) MultiSource/Applications/treecc/treecc: -11.28% (2.4719 => 2.1931, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -11.05% (1.1433 => 1.0170, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.24% (1.5131 => 1.3582, std.dev.: 0.0477) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.65% (1.3924 => 1.2581, std.dev.: 0.0200) MultiSource/Applications/siod/siod: -8.92% (2.6437 => 2.4080, std.dev.: 0.0098) MultiSource/Applications/lambda-0_1_3/lambda: -8.07% (0.8653 => 0.7955, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: -7.89% (0.3598 => 0.3314, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: -7.18% (0.2006 => 0.1862, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.62% (0.2144 => 0.2002, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: -6.04% (0.2385 => 0.2241, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: -5.98% (0.1824 => 0.1715, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.65% (0.3665 => 0.3458, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.19% (0.2100 => 0.1991, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: -4.82% (0.2305 => 0.2194, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.74% (0.9788 => 0.9324, std.dev.: 0.0133) MultiSource/Applications/lemon/lemon: -4.35% (1.3979 => 1.3371, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.21% (1.3220 => 1.2664, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.18% (0.3394 => 0.3252, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: -4.13% (3.7840 => 3.6278, std.dev.: 0.0174) MultiSource/Applications/SIBsim4/SIBsim4: -3.77% (1.4392 => 1.3849, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.17% (0.3847 => 0.3725, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.04% (1.0088 => 0.9781, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.58% (0.8926 => 0.8696, std.dev.: 0.0058) MultiSource/Applications/SPASS/SPASS: -2.20% (16.4479 => 16.0866, std.dev.: 0.0263) MultiSource/Applications/oggenc/oggenc: -1.96% (5.3553 => 5.2501, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.98% (0.1164 => 0.0978, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.71% (0.4081 => 0.3644, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -9.01% (0.6628 => 0.6031, std.dev.: 0.0179) MultiSource/Applications/SPASS/SPASS: -8.41% (9.0650 => 8.3030, std.dev.: 0.0736) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.33% (1.4588 => 1.3373, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/health/health: -6.51% (0.3654 => 0.3416, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.36% (23.3986 => 22.1443, std.dev.: 0.1750) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.98% (2.5170 => 2.4168, std.dev.: 0.0332) MultiSource/Applications/sqlite3/sqlite3: -2.74% (4.4730 => 4.3504, std.dev.: 0.0324) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.64% (0.5826 => 0.5672, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel-2: -2.31% (0.8521 => 0.8324, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.73% (3.0082 => 2.9561, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ReedSolomon: -1.36% (8.6447 => 8.5273, std.dev.: 0.0301) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.87% (1.2047 => 1.1219, std.dev.: 0.0963) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0129) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -18.65% (0.0445 => 0.0362, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/test1: -13.66% (0.0227 => 0.0196, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.25% (0.0255 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.82% (0.1530 => 0.1441, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -40.66% (1.9293 => 1.1448, std.dev.: 0.0110) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.31% (0.4049 => 0.3996, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.52% (0.1510 => 0.1487, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.41% (0.0978 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.81% (0.0590 => 0.0538, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.06% (1.1617 => 1.1494, std.dev.: 0.0365) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.24% (0.7437 => 0.7419, std.dev.: 0.0049) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.19% (12.7781 => 12.7538, std.dev.: 0.0136) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 15:12:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 17:12:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130115231254.AE31F2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7632?compare_to=7630&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7632, Order: 172550, Start Time: 2013-01-15 21:39:00, End Time: 2013-01-15 23:13:00 To: 7630, Order: 172545, Start Time: 2013-01-15 19:41:36, End Time: 2013-01-15 21:15:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.83% (0.0717 => 0.1189, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.96% (0.0974 => 0.1558, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.26% (0.6395 => 0.8778, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.37% (0.6395 => 0.8657, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.51% (0.6260 => 0.8358, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.56% (0.5688 => 0.7540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.18% (0.5456 => 0.7212, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.85% (0.6230 => 0.8214, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.46% (0.5575 => 0.7329, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.29% (0.5567 => 0.7309, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.12% (0.5941 => 0.7790, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (0.5802 => 0.7595, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.46% (0.5705 => 0.7443, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.09% (0.5849 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.09% (0.5859 => 0.7622, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.96% (0.5478 => 0.7119, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.66% (0.6440 => 0.8350, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.59% (0.5569 => 0.7217, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.59% (0.5570 => 0.7218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.35% (0.5591 => 0.7232, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.22% (0.5925 => 0.7656, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 28.47% (0.0418 => 0.0537, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.39% (0.5857 => 0.7520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.34% (0.6189 => 0.7943, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.28% (0.5863 => 0.7521, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.99% (0.6446 => 0.8250, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.81% (1.6474 => 2.1055, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.71% (0.6304 => 0.8051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.72% (0.6194 => 0.7849, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.16% (0.6681 => 0.8429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.14% (0.6297 => 0.7943, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (0.6667 => 0.8307, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.21% (0.7524 => 0.9270, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.50% (0.7339 => 0.8990, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.53% (2.2587 => 2.7225, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.10% (1.1450 => 1.3408, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.31% (0.3357 => 0.3871, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.92% (0.1982 => 0.2238, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.6364 => 1.8436, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.00% (4.5069 => 5.0478, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.70% (0.4916 => 0.5491, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.14% (0.4515 => 0.5018, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.65% (3.5339 => 3.9103, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.39% (0.2385 => 0.2609, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (9.2283 => 10.0650, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.80% (0.7021 => 0.7639, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 8.21% (1.2515 => 1.3543, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.40% (0.2001 => 0.2149, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.28% (0.5329 => 0.5717, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.04% (1.4642 => 1.5673, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.72% (1.2784 => 1.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 5.59% (0.4524 => 0.4777, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 5.27% (0.4861 => 0.5117, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.22% (0.3319 => 0.3459, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.3864 => 1.4355, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.50% (5.0226 => 5.1986, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.70% (5.4682 => 5.6156, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 2.55% (3.5154 => 3.6052, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.48% (22.4056 => 22.9606, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.21% (0.8418 => 0.8604, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.16% (0.6750 => 0.6896, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.76% (0.7447 => 0.7578, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 1.76% (15.5079 => 15.7802, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3722 => 1.3915, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 1.18% (16.1920 => 16.3836, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.8161 => 4.8704, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6691, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.07% (0.9531 => 1.0300, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.72% (5.1955 => 5.4409, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.21% (11.6767 => 12.1681, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4431, std.dev.: 0.1127) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0123) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2851, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5320 => 4.6006, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.05% (4.4335 => 4.4800, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.36% (0.3194 => 0.2959, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.1431 => 0.1326, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -5.40% (0.2871 => 0.2716, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.36% (0.3059 => 0.2895, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.36% (0.3323 => 0.3145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.27% (0.3057 => 0.2896, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.11% (0.2933 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -5.09% (0.3025 => 0.2871, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -5.09% (0.3205 => 0.3042, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.06% (2.1713 => 2.0615, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -4.93% (0.2939 => 0.2794, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.77% (0.3016 => 0.2872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.69% (0.3026 => 0.2884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.68% (0.2989 => 0.2849, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.49% (0.3831 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.49% (0.3812 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.43% (0.3880 => 0.3708, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.43% (0.9852 => 0.9416, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.41% (1.3148 => 1.2568, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.40% (0.3884 => 0.3713, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.34% (0.4151 => 0.3971, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.27% (0.3891 => 0.3725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.21% (0.3821 => 0.3660, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -3.99% (0.6347 => 0.6094, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.92% (0.7779 => 0.7474, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.89% (0.3621 => 0.3480, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.78% (0.3867 => 0.3721, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.73% (0.4321 => 0.4160, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.69% (2.4924 => 2.4004, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: -3.63% (0.4248 => 0.4094, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.51% (0.3849 => 0.3714, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.50% (0.3658 => 0.3530, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -3.48% (0.4280 => 0.4131, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.9542 => 0.9212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.43% (0.3931 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.42% (0.6484 => 0.6262, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: -3.19% (0.3788 => 0.3667, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.09% (0.4427 => 0.4290, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.89% (0.4083 => 0.3965, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.68% (0.4813 => 0.4684, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2387, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.36% (0.7919 => 0.7732, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0322, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -1.76% (0.9179 => 0.9017, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.57% (1.2221 => 1.2029, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.56% (1.2210 => 1.2019, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.55% (0.7982 => 0.7858, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -1.54% (4.3330 => 4.2664, std.dev.: 0.0106) MultiSource/Applications/hbd/hbd: -1.16% (1.5610 => 1.5429, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.14% (14.2083 => 14.0469, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -1.12% (2.4021 => 2.3752, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.06% (1.2300 => 1.2170, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.81% (1.8100 => 0.6731, std.dev.: 0.0197) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.70% (0.6962 => 0.3432, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.73% (1.3643 => 1.0269, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7535, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0299, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.74% (4.3779 => 3.3823, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.13% (2.5106 => 2.1308, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1724, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.96% (7.9763 => 7.7403, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.67% (1.6307 => 1.6035, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: -1.60% (3.7241 => 3.6644, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.60% (4.8776 => 4.7998, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1923, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.43% (2.1154 => 2.0851, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.22% (1.6086 => 1.5890, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 15:27:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 17:27:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130115232728.4387B2A6C065@llvm.org> http://llvm.org/perf/db_default/v4/nts/7633?compare_to=7629&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7633, Order: 172548, Start Time: 2013-01-15 21:15:45, End Time: 2013-01-15 23:27:34 To: 7629, Order: 172540, Start Time: 2013-01-15 18:33:37, End Time: 2013-01-15 20:45:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.37% (79.6434 => 81.5314, std.dev.: 0.0603) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0650 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7108 => 499.7781, std.dev.: 0.0402) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44218.36% (1.1277 => 499.7781, std.dev.: 0.0402) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.89% (0.5229 => 1.6675, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 21.20% (14.9895 => 18.1670, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 43.65% (14.1553 => 20.3335, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: 18.55% (4.1105 => 4.8732, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.57% (1.1048 => 1.7850, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.29% (7.1582 => 38.5318, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.61% (3.4629 => 6.3928, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.96% (0.6222 => 1.0886, std.dev.: 0.0001) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.64% (0.0720 => 7.4431, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11164100.00% (0.0001 => 11.1642, std.dev.: 0.0650) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848500.00% (0.0001 => 9.8486, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485000.00% (0.0001 => 5.4851, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 830.39% (1.1194 => 10.4148, std.dev.: 0.0114) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.86% (22.1758 => 55.8518, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.25% (0.1463 => 0.2520, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 63.72% (21.9371 => 35.9150, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 60.14% (7.0540 => 11.2965, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.22% (2.9384 => 4.6198, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 51.23% (0.1056 => 0.1597, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.77% (1.5859 => 2.3911, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.02% (8.1363 => 12.2063, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 50.00% (0.0394 => 0.0591, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.42% (0.0439 => 0.0634) SingleSource/Benchmarks/CoyoteBench/almabench: 42.05% (0.0730 => 0.1037, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.22% (2.2024 => 3.1103, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 40.43% (0.3109 => 0.4366, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0005) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.62% (1.5415 => 2.0752, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.56% (4.2646 => 5.7386, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.81% (0.4615 => 0.6129, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.77% (0.1892 => 0.2493, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.78% (0.2700 => 0.3531, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 30.42% (1.1642 => 1.5183, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 30.21% (0.1175 => 0.1530, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.99% (0.2271 => 0.2952, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.68% (0.4299 => 0.5575, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.38% (0.6675 => 0.8636, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.76% (0.5105 => 0.6522, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 27.32% (9.4845 => 12.0753, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.20% (0.1125 => 0.1431, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 27.19% (0.1655 => 0.2105, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 26.78% (0.2554 => 0.3238, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 26.25% (1.0722 => 1.3536, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.95% (3.8922 => 4.9023, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.51% (1.4186 => 1.7663, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.93% (0.3121 => 0.3868, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.36% (0.1143 => 0.1410, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 23.29% (0.0614 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 23.27% (0.4289 => 0.5287, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.95% (0.1695 => 0.2084, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 22.74% (5.7591 => 7.0686, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 22.46% (0.7115 => 0.8713, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 22.29% (0.4620 => 0.5650, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.08% (4.9449 => 6.0367, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.92% (0.0730 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1163 => 0.1417, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 21.54% (3.3354 => 4.0539, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.21% (5.0018 => 6.0626, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.05% (0.3098 => 0.3750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.79% (1.3050 => 1.5763, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 20.65% (0.1695 => 0.2045, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 20.54% (0.7835 => 0.9444, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 19.84% (0.3423 => 0.4102, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.69% (0.5860 => 0.7014, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 19.59% (0.6456 => 0.7721, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.49% (0.8172 => 0.9765, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 18.94% (0.1151 => 0.1369, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.82% (0.7433 => 0.8832, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.37% (0.5020 => 0.5942, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.81% (3.8723 => 4.5619, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.74% (0.5569 => 0.6557, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 17.53% (1.1840 => 1.3916, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 17.52% (0.2049 => 0.2408, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.30% (0.9765 => 1.1454, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.28% (0.0648 => 0.0760, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.28% (0.2107 => 0.2471, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 16.92% (2.0273 => 2.3703, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.57% (0.6450 => 0.7519, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 16.50% (0.3387 => 0.3946, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 16.45% (0.3180 => 0.3703, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.35% (0.5981 => 0.6959, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 16.33% (2.2969 => 2.6720, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.32% (0.8101 => 0.9423, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.05% (0.8067 => 0.9362, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 15.92% (10.3673 => 12.0175, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.75% (0.3441 => 0.3983, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.52% (1.1861 => 1.3702, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.14% (0.3283 => 0.3780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.66% (0.8921 => 1.0229, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 14.48% (0.3232 => 0.3700, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.25% (0.1144 => 0.1307, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 13.62% (17.1811 => 19.5219, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 13.61% (0.3379 => 0.3839, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.56% (1.5603 => 1.7718, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 13.49% (0.3092 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.09% (14.3668 => 16.2481, std.dev.: 0.0140) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.49% (0.4636 => 0.5215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.34% (0.3865 => 0.4342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.23% (0.3427 => 0.3846, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.44% (0.4203 => 0.4684, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.43% (0.4103 => 0.4572, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.00% (0.3927 => 0.4359, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.61% (0.3422 => 0.3785, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 10.57% (0.4048 => 0.4476, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 10.56% (0.3684 => 0.4073, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 10.27% (0.3603 => 0.3973, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 10.12% (63.2438 => 69.6410, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.06% (0.3826 => 0.4211, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.93% (0.3828 => 0.4208, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.69% (0.4064 => 0.4458, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3694 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3497 => 0.3830, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.51% (0.3543 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3543 => 0.3880, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3561 => 0.3898, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 8.37% (0.2831 => 0.3068, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5925 => 0.6421, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 8.36% (0.2871 => 0.3111) SingleSource/UnitTests/ObjC++/property-reference: 8.18% (0.7326 => 0.7925, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.16% (0.4879 => 0.5277, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.13% (2.2022 => 2.3812, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 8.06% (1.2842 => 1.3877, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.87% (2.0665 => 2.2292, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.84% (0.3650 => 0.3936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.62% (0.3162 => 0.3403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.61% (0.2877 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 7.56% (0.2725 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.55% (0.2756 => 0.2964, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 7.54% (0.2905 => 0.3124, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.52% (7.9617 => 8.5605, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.45% (0.3935 => 0.4228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.34% (0.2793 => 0.2998, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 7.15% (0.2714 => 0.2908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.13% (0.2891 => 0.3097, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.07% (0.2872 => 0.3075, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 6.82% (0.2802 => 0.2993, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.78% (0.3052 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.75% (0.2266 => 0.2419, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.60% (0.3136 => 0.3343, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2492, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.22% (4.2280 => 4.4486, std.dev.: 0.0155) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3139, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.13% (0.9957 => 1.0269, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.88% (8.6802 => 8.9302, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.24% (3.6395 => 3.7210, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.07% (9.1159 => 9.3043, std.dev.: 0.0103) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.56% (27.8444 => 28.2792, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.11% (10.3460 => 10.4610, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.11% (5.2763 => 1.2077, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.84% (0.8651 => 0.2177, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.11% (5.3855 => 4.5179, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.69% (5.3526 => 4.5126, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -10.66% (10.4361 => 9.3236, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.64% (1.7609 => 1.6263, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.46% (54.1659 => 50.1267, std.dev.: 0.0209) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.94% (1.9577 => 0.6472, std.dev.: 0.0185) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3037, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel-2: -33.70% (1.5373 => 1.0193, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.53% (10.7105 => 7.4407, std.dev.: 0.0167) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8591, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0065, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7319, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4926, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.35% (19.9488 => 18.2827, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/distray/distray: -7.79% (0.1592 => 0.1468) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.93% (1.2373 => 1.1639, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.89% (0.2497 => 0.2350) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.26% (8.1563 => 7.7273, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8170, std.dev.: 0.0098) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0020) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.68% (3.7221 => 3.6596, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.28% (0.2116 => 0.0650, std.dev.: 0.0000) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 15:51:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 17:51:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130115235120.4E9E42A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7634?compare_to=7626&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7634, Order: 172545, Start Time: 2013-01-15 20:17:08, End Time: 2013-01-15 23:51:24 To: 7626, Order: 172533, Start Time: 2013-01-15 15:28:06, End Time: 2013-01-15 19:02:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (178 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.28% (0.3230 => 0.3336, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.28% (0.3779 => 0.3903, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.22% (2.2713 => 2.3218, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.16% (0.6164 => 0.6297, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.02% (1.5377 => 1.5688, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.01% (0.3926 => 0.4044, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.29% (128.0484 => 129.6961, std.dev.: 0.3712) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.24% (0.0625 => 0.0889, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1063 => 0.1417, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 31.46% (0.2969 => 0.3903, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.09% (0.4994 => 0.6297, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.85% (0.4139 => 0.5209, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.58% (0.4253 => 0.5341, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.29% (0.5900 => 0.7392, std.dev.: 0.0168) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.98% (0.1549 => 0.1936, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.14% (0.1620 => 0.2011, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.48% (0.0822 => 0.1015, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.45% (1.5932 => 1.9668, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.36% (0.5000 => 0.6168, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: 23.21% (0.0599 => 0.0738, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.74% (0.0897 => 0.1101, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.93% (0.2736 => 0.3336, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.85% (0.3903 => 0.4756, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.55% (0.1462 => 0.1777, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.54% (0.1003 => 0.1219, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.51% (0.1604 => 0.1949, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.45% (0.2866 => 0.3452, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.75% (0.3271 => 0.3917, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 19.71% (0.4029 => 0.4823, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.28% (1.3152 => 1.5688, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 18.88% (0.1218 => 0.1448, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.87% (0.2014 => 0.2394, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.69% (0.3890 => 0.4617, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 18.37% (0.5826 => 0.6896, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.90% (0.5889 => 0.6943, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.89% (1.9694 => 2.3218, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.64% (0.9697 => 1.1408, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 17.62% (0.5546 => 0.6523, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 17.52% (1.8794 => 2.2087, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (0.4658 => 0.5474, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.46% (3.5627 => 4.1846, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.92% (0.4361 => 0.5099, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.83% (0.5026 => 0.5872, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.80% (1.6211 => 1.8935, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.72% (0.1968 => 0.2297, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.59% (0.2875 => 0.3352, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 16.50% (0.7171 => 0.8354, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.28% (0.2911 => 0.3385, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.20% (0.1284 => 0.1492, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.07% (4.4195 => 5.1295, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2750 => 0.3190, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 15.98% (0.2803 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 15.97% (0.1421 => 0.1648, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.95% (2.7292 => 3.1644, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.94% (0.2792 => 0.3237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 15.85% (0.2813 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.83% (0.2780 => 0.3220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.81% (0.2738 => 0.3171, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.76% (0.2729 => 0.3159, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.73% (0.3930 => 0.4548, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.69% (0.2823 => 0.3266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.65% (2.0673 => 2.3908, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 15.60% (0.9909 => 1.1455, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 15.49% (0.3267 => 0.3773, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.46% (0.3195 => 0.3689, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.46% (1.9966 => 2.3053, std.dev.: 0.0071) MultiSource/Applications/d/make_dparser: 15.44% (1.0781 => 1.2446, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 15.41% (0.3096 => 0.3573, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.32% (0.3465 => 0.3996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.28% (0.3488 => 0.4021, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.12% (0.3460 => 0.3983, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.10% (0.3258 => 0.3750, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.10% (0.3060 => 0.3522, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3317 => 0.3813, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 14.93% (4.2109 => 4.8397, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.72% (0.3124 => 0.3584, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.69% (0.3643 => 0.4178, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.66% (0.3362 => 0.3855, std.dev.: 0.0053) MultiSource/Benchmarks/Bullet/bullet: 14.60% (23.5202 => 26.9543, std.dev.: 0.0262) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.46% (0.3845 => 0.4401, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.35% (0.3282 => 0.3753, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 14.34% (0.3348 => 0.3828, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.31% (0.1090 => 0.1246, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.30% (0.3678 => 0.4204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.27% (0.3477 => 0.3973, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.10% (0.3625 => 0.4136, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 14.09% (0.4146 => 0.4730, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 13.99% (0.2566 => 0.2925, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 13.99% (1.4269 => 1.6265, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 13.95% (0.4251 => 0.4844, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.77% (0.3981 => 0.4529, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3690 => 0.4194, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 13.13% (0.7875 => 0.8909, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/bigfib: 13.07% (0.5012 => 0.5667, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.32% (2.1653 => 2.4321, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.26% (0.1028 => 0.1154, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.93% (0.6435 => 0.7203, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 11.68% (4.6177 => 5.1572, std.dev.: 0.0260) MultiSource/Applications/SPASS/SPASS: 11.62% (5.5417 => 6.1855, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 11.62% (2.1013 => 2.3454, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.22% (0.2737 => 0.3044, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.3498 => 0.3890, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.89% (0.2103 => 0.2332, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.69% (0.2068 => 0.2289, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (0.3084 => 0.3409, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 10.05% (0.6634 => 0.7301, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.95% (0.2040 => 0.2243, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.89% (0.5361 => 0.5891, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 9.86% (0.3336 => 0.3665, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.62% (0.1383 => 0.1516, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.55% (0.4847 => 0.5310, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.48% (11.6398 => 12.7438, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.63% (4.6926 => 5.0974, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.52% (0.7426 => 0.8059, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 7.65% (2.0346 => 2.1903, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 7.57% (0.2391 => 0.2572, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.25% (0.5584 => 0.5989, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 6.49% (11.9555 => 12.7310, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.88% (0.3792 => 0.4015, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5235, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.50% (0.3693 => 0.4044, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 8.53% (0.2802 => 0.3041, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6750, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2395, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.82% (1.8057 => 1.8928, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6958, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.96% (0.6276 => 0.6462, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1989, std.dev.: 0.0042) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3082, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.19% (4.0317 => 4.0796, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4793, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5857, std.dev.: 0.0170) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5564, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.80% (17.2379 => 14.1698, std.dev.: 0.0833) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -10.91% (0.2402 => 0.2140, std.dev.: 0.0055) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7892, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.71% (14.0481 => 13.3869, std.dev.: 0.2129) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2140, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8016, std.dev.: 0.0079) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1499, std.dev.: 0.0321) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.82% (10.7630 => 10.5670, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.67% (0.6293 => 0.6188, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5006, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.28% (105.3826 => 104.0380, std.dev.: 0.1114) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0433, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 16:06:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 18:06:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116000657.996872A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7635?compare_to=7631&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7635, Order: 172550, Start Time: 2013-01-15 22:02:23, End Time: 2013-01-16 00:07:05 To: 7631, Order: 172545, Start Time: 2013-01-15 19:44:02, End Time: 2013-01-15 21:45:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 40 (25 on baseline) Performance Improvements: 0 (31 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1023 (1007 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 69.83% (0.1001 => 0.1700, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 56.08% (0.0674 => 0.1052, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 34.59% (0.2981 => 0.4012, std.dev.: 0.0398) MultiSource/Benchmarks/Olden/health/health: 15.25% (0.1449 => 0.1670, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 13.01% (0.4652 => 0.5257, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.39% (0.2783 => 0.3100, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/mst/mst: 11.36% (0.1276 => 0.1421, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.23% (23.9097 => 26.3553, std.dev.: 0.5804) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (3.4430 => 3.7106, std.dev.: 0.0780) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.52% (2.3949 => 2.5750, std.dev.: 0.0281) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.44% (0.6922 => 0.7437, std.dev.: 0.0164) MultiSource/Benchmarks/Bullet/bullet: 7.19% (33.5070 => 35.9155, std.dev.: 0.5048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.10% (0.9763 => 1.0456, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.51% (1.0543 => 1.1229, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.46% (0.8696 => 0.9258, std.dev.: 0.0080) MultiSource/Applications/ClamAV/clamscan: 6.41% (16.1217 => 17.1556, std.dev.: 0.1062) MultiSource/Applications/siod/siod: 5.27% (2.4080 => 2.5348, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.26% (0.3229 => 0.3399, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 5.20% (0.7402 => 0.7787, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.6511 => 0.6768, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.36% (0.9140 => 0.9447, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.16% (0.9042 => 0.9328, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.84% (0.9781 => 1.0059, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 75.14% (0.1436 => 0.2515, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/bisort/bisort: 40.62% (0.6462 => 0.9087, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.00% (1.2629 => 1.6292, std.dev.: 0.0483) SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.33% (4.6084 => 5.8679, std.dev.: 0.1964) MultiSource/Applications/minisat/minisat: 22.93% (6.1892 => 7.6083, std.dev.: 0.1645) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.78% (1.2120 => 1.4639, std.dev.: 0.0056) MultiSource/Benchmarks/llubenchmark/llu: 9.72% (2.0070 => 2.2020, std.dev.: 0.0257) MultiSource/Benchmarks/Olden/perimeter/perimeter: 8.25% (0.3175 => 0.3437, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.11% (59.0709 => 63.8641, std.dev.: 0.2887) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.82% (41.2690 => 43.6713, std.dev.: 0.1654) MultiSource/Benchmarks/Olden/tsp/tsp: 5.10% (1.4833 => 1.5589, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 3.76% (28.4458 => 29.5162, std.dev.: 0.0438) SingleSource/Benchmarks/Dhrystone/fldry: 2.53% (0.6599 => 0.6766, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 2.45% (3.5428 => 3.6297, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 2.23% (3.4184 => 3.4947, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bh/bh: 2.13% (2.3890 => 2.4399, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.03% (1.2358 => 1.2485, std.dev.: 0.0021) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.91% (1.1219 => 1.1882, std.dev.: 0.0315) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.36% (0.0220 => 0.0223, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.93% (0.0430 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0333 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.32% (0.0317 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.30% (0.0362 => 0.0421, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: 12.24% (0.0196 => 0.0220, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 19.91% (0.0211 => 0.0253, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.37% (0.1441 => 0.1504, std.dev.: 0.0132) MultiSource/Applications/lemon/lemon: 5.39% (1.1448 => 1.2065, std.dev.: 0.2617) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.88% (0.3996 => 0.4231, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.94% (0.1487 => 0.1473, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.92% (0.0982 => 0.0973, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.37% (0.0267 => 0.0276, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.93% (0.0538 => 0.0543, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: 20.00% (0.0015 => 0.0018, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.13% (1.1494 => 1.1854, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.67% (0.0030 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.33% (0.0600 => 0.0626, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.71% (0.0319 => 0.0237, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7419 => 0.7409, std.dev.: 0.1614) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.16% (0.0122 => 0.0073, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7538 => 12.7599, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0018, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: 71.37% (0.0992 => 0.1700, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/NP/np: 53.44% (0.0189 => 0.0290, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 42.74% (0.0737 => 0.1052, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.74% (23.5861 => 26.3553, std.dev.: 0.5804) MultiSource/Benchmarks/McCat/05-eks/eks: 10.07% (0.4776 => 0.5257, std.dev.: 0.0066) MultiSource/Benchmarks/Bullet/bullet: 8.04% (33.2440 => 35.9155, std.dev.: 0.5048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.30% (0.6996 => 0.7437, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.97% (0.9867 => 1.0456, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.02% (2.4519 => 2.5750, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.72% (0.8926 => 0.9258, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322400.00% (0.0008 => 2.5800, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.79% (1.1825 => 2.4335, std.dev.: 0.0888) MultiSource/Benchmarks/Olden/mst/mst: 68.68% (0.1491 => 0.2515, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.38% (5.0421 => 5.8679, std.dev.: 0.1964) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.51% (0.2562 => 0.2908, std.dev.: 0.0031) MultiSource/Benchmarks/llubenchmark/llu: 8.48% (2.0298 => 2.2020, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.63% (61.0379 => 63.8641, std.dev.: 0.2887) MultiSource/Benchmarks/Olden/tsp/tsp: 3.81% (1.5017 => 1.5589, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 3.59% (2.1390 => 2.2158, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (42.3194 => 43.6713, std.dev.: 0.1654) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.84% (1.4235 => 1.4639, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 1.67% (29.0327 => 29.5162, std.dev.: 0.0438) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.52% (1.2298 => 1.2485, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 1.08% (3.5910 => 3.6297, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.64% (0.0727 => 0.0497, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -26.61% (0.0808 => 0.0593, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.68% (0.1684 => 0.1302, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.00% (1.0960 => 0.8987, std.dev.: 0.0419) MultiSource/Applications/Burg/burg: -9.49% (1.5979 => 1.4462, std.dev.: 0.0278) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.26% (0.2372 => 0.2176, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.08% (1.5131 => 1.3908, std.dev.: 0.0298) MultiSource/Benchmarks/SciMark2-C/scimark2: -8.08% (0.4074 => 0.3745, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: -7.05% (0.5134 => 0.4772, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/fibo: -6.58% (0.2006 => 0.1874, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4002 => 0.3771, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hello: -5.34% (0.1928 => 0.1825, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.2135 => 0.2027, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -4.96% (0.3206 => 0.3047, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.90% (0.3981 => 0.3786, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -4.33% (0.2725 => 0.2607, std.dev.: 0.0029) MultiSource/Applications/siod/siod: -4.12% (2.6437 => 2.5348, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/hash: -2.90% (0.4689 => 0.4553, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.78% (0.3847 => 0.3740, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -1.61% (17.4365 => 17.1556, std.dev.: 0.1062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -25.25% (4.2042 => 3.1427, std.dev.: 0.2806) SingleSource/Benchmarks/Shootout-C++/lists1: -8.55% (0.6628 => 0.6061, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/nestedloop: -8.45% (0.2200 => 0.2014, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: -5.93% (0.1704 => 0.1603, std.dev.: 0.0026) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.91% (2.5170 => 2.4187, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/ffbench: -3.17% (1.4244 => 1.3793, std.dev.: 0.0173) MultiSource/Benchmarks/Olden/bisort/bisort: -3.04% (0.9372 => 0.9087, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -1.54% (0.8521 => 0.8390, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -1.40% (3.5443 => 3.4947, std.dev.: 0.0147) SingleSource/Benchmarks/SmallPT/smallpt: -1.14% (14.9448 => 14.7750, std.dev.: 0.0490) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.37% (1.2047 => 1.1882, std.dev.: 0.0315) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.54% (0.0451 => 0.0426, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.99% (0.0394 => 0.0331, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.66% (0.0328 => 0.0316, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.39% (0.0445 => 0.0421, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.70% (0.1530 => 0.1504, std.dev.: 0.0132) MultiSource/Applications/lemon/lemon: -37.46% (1.9293 => 1.2065, std.dev.: 0.2617) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.49% (0.4049 => 0.4231, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.45% (0.1510 => 0.1473, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.51% (0.0978 => 0.0973, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.97% (0.0590 => 0.0543, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.04% (1.1617 => 1.1854, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0032 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.62% (0.0610 => 0.0626, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.57% (0.0268 => 0.0237, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.1614) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.65% (0.0092 => 0.0073, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (12.7781 => 12.7599, std.dev.: 0.0156) Report Time: 0.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 17:10:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 19:10:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116011024.DBE002A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7636?compare_to=7632&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7636, Order: 172569, Start Time: 2013-01-15 23:36:18, End Time: 2013-01-16 01:10:30 To: 7632, Order: 172550, Start Time: 2013-01-15 21:39:00, End Time: 2013-01-15 23:13:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.07% (0.6731 => 0.7005, std.dev.: 0.0095) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.97% (0.0717 => 0.1190) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.96% (0.0974 => 0.1558, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.48% (0.6395 => 0.8792, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.93% (0.1132 => 0.1550, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.62% (0.6395 => 0.8673, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.74% (0.6260 => 0.8372, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.84% (0.5688 => 0.7556, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.61% (0.5805 => 0.7698, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.55% (0.5456 => 0.7232, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.13% (0.6230 => 0.8232, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.65% (0.5567 => 0.7329, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.52% (0.5575 => 0.7332, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.41% (0.5941 => 0.7807, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.14% (0.5802 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.80% (0.5705 => 0.7462, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.73% (0.6033 => 0.7887, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.36% (0.5849 => 0.7625, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.07% (0.5478 => 0.7125, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.91% (0.5570 => 0.7236, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.81% (0.6440 => 0.8360, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.68% (0.5569 => 0.7222, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.48% (0.5591 => 0.7239, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.43% (0.5925 => 0.7669, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.75% (0.5857 => 0.7541, std.dev.: 0.0053) SingleSource/Benchmarks/Stanford/IntMM: 28.71% (0.0418 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.68% (0.6189 => 0.7964, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.58% (0.6676 => 0.8584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.48% (0.5863 => 0.7533, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.39% (0.6052 => 0.7770, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.27% (0.6446 => 0.8268, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.93% (0.6304 => 0.8065, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.61% (1.6474 => 2.1022, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.93% (0.6194 => 0.7862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.59% (0.6660 => 0.8431, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.41% (0.6297 => 0.7960, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.24% (0.6681 => 0.8434, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.93% (0.6667 => 0.8329, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.56% (0.7524 => 0.9297, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.71% (0.7339 => 0.9006, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.48% (2.2587 => 2.7212, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.51% (1.1450 => 1.3455, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3357 => 0.3873, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.83% (1.6364 => 1.8463, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.61% (0.1982 => 0.2232, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.05% (4.5069 => 5.0499, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.62% (0.4916 => 0.5487, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 11.25% (0.4515 => 0.5023, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.42% (3.5339 => 3.9020, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (9.2283 => 10.0914, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2385 => 0.2605, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7021 => 0.7646, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.39% (1.2515 => 1.3565, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.5329 => 0.5725, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.15% (1.4642 => 1.5689, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.85% (1.2784 => 1.3660, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.68% (0.4524 => 0.4826, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4861 => 0.5142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.75% (0.3255 => 0.3442, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.65% (1.3864 => 1.4370, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.50% (5.0226 => 5.1982, std.dev.: 0.0134) MultiSource/Applications/d/make_dparser: 2.76% (3.5154 => 3.6125, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.72% (5.4682 => 5.6167, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.61% (0.6750 => 0.6926, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.56% (22.4056 => 22.9803, std.dev.: 0.0158) MultiSource/Applications/spiff/spiff: 2.09% (0.8418 => 0.8594, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.93% (0.7447 => 0.7591, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.79% (15.5079 => 15.7853, std.dev.: 0.0080) MultiSource/Applications/JM/lencod/lencod: 1.57% (16.1920 => 16.4460, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.45% (1.3722 => 1.3921, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.40% (0.9557 => 0.9691, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (4.0323 => 4.0808, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.12% (4.8161 => 4.8701, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: 1.10% (7.0961 => 7.1745, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6699, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9531 => 1.0274, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.71% (5.1955 => 5.4401, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 4.22% (11.6767 => 12.1694, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5672, std.dev.: 0.0997) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.72% (0.6469 => 0.6645, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8210 => 28.2848, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.5320 => 4.6074, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 1.00% (4.4335 => 4.4780, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.00% (0.3884 => 0.3651, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.93% (0.3831 => 0.3604, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.88% (0.3896 => 0.3667, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.88% (0.3880 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.80% (0.4033 => 0.3799, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.53% (0.4176 => 0.3945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.16% (0.3837 => 0.3639, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.05% (0.4199 => 0.3987, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.95% (0.2871 => 0.2729, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.91% (0.3057 => 0.2907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.81% (0.4280 => 0.4074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.67% (0.2849 => 0.2716, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.60% (0.2933 => 0.2798, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -4.59% (0.3205 => 0.3058, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.54% (0.3059 => 0.2920, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.44% (0.3016 => 0.2882, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.35% (2.1713 => 2.0768, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.31% (0.9852 => 0.9427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -4.20% (0.3025 => 0.2898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.20% (0.3026 => 0.2899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.12% (0.3252 => 0.3118, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.05% (0.2989 => 0.2868, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.87% (1.3148 => 1.2639, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.85% (0.4151 => 0.3991, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3821 => 0.3684, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.56% (0.7779 => 0.7502, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (0.3621 => 0.3498, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.35% (0.6484 => 0.6267, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -3.26% (0.3867 => 0.3741, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.25% (2.4924 => 2.4113, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.25% (0.3658 => 0.3539, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.25% (0.9542 => 0.9232, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.12% (0.4321 => 0.4186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.04% (0.4248 => 0.4119, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.90% (0.3931 => 0.3817, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.89% (0.4427 => 0.4299, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -2.72% (0.3788 => 0.3685, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2199, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.18% (0.7919 => 0.7746, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.96% (1.0544 => 1.0337, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1997, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.66% (1.2221 => 1.2018, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -1.63% (0.9179 => 0.9029, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.63% (4.3330 => 4.2624, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.30% (0.7982 => 0.7878, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.24% (0.8521 => 0.8415, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.07% (1.2300 => 1.2169, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -1.04% (2.4021 => 2.3771, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.30% (1.8100 => 0.7005, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3107, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7533, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0317, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -22.75% (0.0756 => 0.0584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1737, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.09% (4.1534 => 3.8590, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.11% (7.9763 => 7.7286, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: -2.69% (3.7241 => 3.6239, std.dev.: 0.0269) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.12% (1.3096 => 1.2818, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1717, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.57% (4.8776 => 4.8010, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.46% (1.6086 => 1.5851, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6070, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 20:52:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 22:52:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116045243.DCABA2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7637?compare_to=7633&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7637, Order: 172597, Start Time: 2013-01-16 02:40:51, End Time: 2013-01-16 04:52:48 To: 7633, Order: 172548, Start Time: 2013-01-15 21:15:45, End Time: 2013-01-15 23:27:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 4 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/CoyoteBench/almabench: 16.30% (0.1037 => 0.1206, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 2.28% (35.9150 => 36.7321, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.19% (0.8835 => 0.8730, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.16% (0.8725 => 0.8624, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (11.2965 => 11.1821, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.79% (5.8484 => 5.6855, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.00% (0.0650 => 0.0676, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7781 => 499.8368, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44223.56% (1.1277 => 499.8368, std.dev.: 0.0108) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.30% (0.5229 => 1.6696, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 21.22% (14.9895 => 18.1702, std.dev.: 0.0035) MultiSource/Applications/kimwitu++/kc: 42.80% (14.1553 => 20.2133, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/gs/gs: 17.93% (4.1105 => 4.8476, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.13% (1.1048 => 1.7802, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 437.99% (7.1582 => 38.5107, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.80% (3.4629 => 6.3649, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.61% (0.6222 => 1.0802, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.06% (0.0720 => 7.4470, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11145300.00% (0.0001 => 11.1454, std.dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486900.00% (0.0001 => 5.4870, std.dev.: 0.0010) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.33% (1.1194 => 10.3805, std.dev.: 0.0060) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784) MultiSource/Applications/ClamAV/clamscan: 151.86% (22.1758 => 55.8513, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.25% (0.1463 => 0.2520, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 69.37% (0.0271 => 0.0459, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 67.44% (21.9371 => 36.7321, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.52% (7.0540 => 11.1821, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.54% (2.9384 => 4.5998, std.dev.: 0.0021) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 51.42% (0.1056 => 0.1599, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.27% (1.5859 => 2.3832, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.15% (8.1363 => 12.2164, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.75% (2.2024 => 3.0999, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 40.08% (0.3109 => 0.4355, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.57% (1.5415 => 2.0744, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.99% (4.2646 => 5.7142, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.52% (0.4615 => 0.6116, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.19% (0.2700 => 0.3542, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.69% (0.2271 => 0.2968, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.66% (0.1892 => 0.2472, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.19% (1.1642 => 1.5157, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.15% (0.6675 => 0.8621, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 27.62% (9.4845 => 12.1040, std.dev.: 0.0071) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.19% (0.5105 => 0.6493, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 27.04% (0.0636 => 0.0808, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.84% (0.1125 => 0.1427, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 26.70% (0.2554 => 0.3236, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 26.09% (1.0722 => 1.3519, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.82% (0.1584 => 0.1993, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.42% (3.8922 => 4.8815, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.66% (0.0730 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.45% (1.4186 => 1.7654, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.98% (0.1906 => 0.2363, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.84% (0.3121 => 0.3865, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.18% (0.1143 => 0.1408) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 22.88% (5.7591 => 7.0770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 22.69% (0.4289 => 0.5262, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 22.28% (0.7115 => 0.8700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.03% (4.9449 => 6.0344, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.89% (0.1695 => 0.2066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 21.71% (0.4620 => 0.5623, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 21.65% (0.1695 => 0.2062, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 21.47% (3.3354 => 4.0516, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.14% (5.0018 => 6.0590, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.43% (1.3050 => 1.5716, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.38% (0.7835 => 0.9432, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 20.11% (0.3098 => 0.3721, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.74% (0.5860 => 0.7017, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.71% (0.0842 => 0.1008, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.53% (0.1029 => 0.1230, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.21% (0.8172 => 0.9742, std.dev.: 0.0146) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 18.77% (0.1151 => 0.1367, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 18.65% (0.6456 => 0.7660, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 18.49% (0.3423 => 0.4056, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.34% (0.1510 => 0.1787, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 18.32% (0.7433 => 0.8795, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.01% (0.5020 => 0.5924, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.66% (0.2758 => 0.3245, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 17.52% (3.8723 => 4.5506, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 17.36% (1.1840 => 1.3896, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 17.18% (0.2049 => 0.2401, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.15% (0.9765 => 1.1440, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.15% (0.5569 => 0.6524, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 16.99% (0.0818 => 0.0957, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 16.76% (2.0273 => 2.3670, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.68% (0.6450 => 0.7526, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.51% (0.2065 => 0.2406, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 16.50% (0.3387 => 0.3946, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 16.42% (0.3180 => 0.3702, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.35% (0.5981 => 0.6959, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.34% (0.8101 => 0.9425, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 16.15% (10.3673 => 12.0417, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 16.13% (2.2969 => 2.6675, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.09% (0.1044 => 0.1212, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.72% (0.8067 => 0.9335, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.18% (1.1861 => 1.3662, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.51% (0.8921 => 1.0215, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 14.29% (0.3283 => 0.3752, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.10% (0.0759 => 0.0866, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 13.55% (0.3232 => 0.3670, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.52% (0.2603 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.48% (0.0838 => 0.0951, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 13.47% (17.1811 => 19.4948, std.dev.: 0.0096) MultiSource/Applications/hbd/hbd: 13.15% (1.5603 => 1.7655, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.80% (14.3668 => 16.2053, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 12.19% (0.3379 => 0.3791, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.67% (0.3427 => 0.3827, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.54% (0.4636 => 0.5171, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.41% (0.3865 => 0.4306, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 11.33% (0.3282 => 0.3654, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.2430 => 0.2701, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.14% (0.4103 => 0.4560, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.54% (0.4203 => 0.4646, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 10.42% (0.3927 => 0.4336, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 9.88% (0.4048 => 0.4448, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 9.72% (63.2438 => 69.3896, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/sieve: 9.66% (0.3603 => 0.3951, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: 9.59% (0.3422 => 0.3750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.54% (0.3828 => 0.4193, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3473 => 0.3797, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.29% (0.3543 => 0.3872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.28% (0.3684 => 0.4026, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/for-in: 9.26% (0.3694 => 0.4036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.09% (0.3543 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.04% (0.3516 => 0.3834, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.62% (0.1438 => 0.1562, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.51% (0.4064 => 0.4410, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.87% (0.4879 => 0.5263, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.67% (0.2831 => 0.3048, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.63% (0.6030 => 0.6490, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.46% (7.9617 => 8.5557, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: 7.29% (0.5925 => 0.6357, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.22% (0.7326 => 0.7855, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: 7.22% (1.2842 => 1.3769, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.11% (2.2022 => 2.3587, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.96% (0.3650 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 6.93% (2.0665 => 2.2097, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.78% (0.2891 => 0.3087, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 6.47% (0.2877 => 0.3063, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.39% (0.3162 => 0.3364, std.dev.: 0.0066) SingleSource/Regression/C++/ofstream_ctor: 6.33% (0.2905 => 0.3089, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.18% (0.2266 => 0.2406, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.84% (0.2756 => 0.2917, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 5.82% (0.2802 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wc: 5.73% (0.3052 => 0.3227, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.73% (0.2793 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.50% (0.2725 => 0.2875, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.38% (0.2714 => 0.2860, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2535, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.05% (1.1396 => 1.2427, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.58% (4.2280 => 4.4641, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3120, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.81% (0.9957 => 1.0336, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0064) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.6802 => 8.9247, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.42% (1.0313 => 1.0563, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7177, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.96% (9.1159 => 9.2949, std.dev.: 0.0097) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2848, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.51% (10.3460 => 10.5026, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/fbench: 1.28% (2.2771 => 2.3062, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.12% (5.2763 => 1.2071, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.17% (0.8651 => 0.2148, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.51% (5.3855 => 4.4964, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.09% (5.3526 => 4.4913, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -10.86% (10.4361 => 9.3032, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.10% (1.7609 => 1.6183, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9294, std.dev.: 0.0290) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.31% (1.9577 => 0.6595, std.dev.: 0.0079) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -33.77% (1.5373 => 1.0181, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4337, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8630, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.60% (2.6546 => 2.0015, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4933, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2705, std.dev.: 0.1045) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4811, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -5.90% (1.2373 => 1.1643, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5749, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6996, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5025, std.dev.: 0.0051) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8296, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -3.92% (3.2827 => 3.1540, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.72% (3.6994 => 3.6358, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2288, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0009) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 15 21:06:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 15 Jan 2013 23:06:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116050628.903B52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7638?compare_to=7636&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7638, Order: 172597, Start Time: 2013-01-16 03:32:24, End Time: 2013-01-16 05:06:35 To: 7636, Order: 172569, Start Time: 2013-01-15 23:36:18, End Time: 2013-01-16 01:10:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 15 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1089 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.08% (0.7161 => 0.7012, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.57% (0.7125 => 0.7013, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (0.7609 => 0.7502, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.39% (0.8431 => 0.8314, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.38% (0.7964 => 0.7854, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.38% (0.7533 => 0.7429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.37% (0.7862 => 0.7754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.32% (0.8360 => 0.8250, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.31% (0.8329 => 0.8220, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.31% (0.7960 => 0.7856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.29% (0.8232 => 0.8126, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (0.8792 => 0.8688, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.00% (5.4401 => 5.2770, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -1.18% (1.4532 => 1.4361, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.03% (3.8590 => 3.8192, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.50% (0.0717 => 0.1201, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.86% (0.6395 => 0.8688, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.04% (0.6395 => 0.8572, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.35% (0.6260 => 0.8285, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.07% (0.5688 => 0.7455, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.01% (0.5805 => 0.7605, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.77% (0.5456 => 0.7135, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.43% (0.6230 => 0.8126, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.06% (0.5575 => 0.7251, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.06% (0.5849 => 0.7607, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.91% (0.5941 => 0.7718, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 29.91% (0.5567 => 0.7232, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.78% (0.5581 => 0.7243, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.30% (0.5802 => 0.7502, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.10% (0.5705 => 0.7365, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.94% (0.6033 => 0.7779, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.64% (0.5859 => 0.7537, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.28% (0.5570 => 0.7145, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.12% (0.5857 => 0.7504, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.11% (0.6440 => 0.8250, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.02% (0.5478 => 0.7013, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.02% (0.5925 => 0.7585, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 27.98% (0.5569 => 0.7127, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.88% (0.5591 => 0.7150, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.55% (0.6676 => 0.8515, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.23% (1.6474 => 2.0960, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.90% (0.6189 => 0.7854, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.90% (0.6052 => 0.7680, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.75% (0.6446 => 0.8170, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.71% (0.5863 => 0.7429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.43% (0.6304 => 0.7970, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.31% (0.6681 => 0.8372, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.19% (0.6194 => 0.7754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.83% (0.6660 => 0.8314, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.76% (0.6297 => 0.7856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.29% (0.6667 => 0.8220, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.12% (0.7524 => 0.9188, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.42% (0.7339 => 0.8911, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.03% (2.2587 => 2.7111, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.23% (1.1450 => 1.3423, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.42% (1.6364 => 1.8397, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.27% (4.5069 => 5.0599, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.49% (0.4916 => 0.5481, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 11.18% (0.4515 => 0.5020, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.29% (3.5339 => 3.8977, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.2385 => 0.2611, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 9.06% (9.2283 => 10.0647, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.47% (0.7021 => 0.7616, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.45% (1.2515 => 1.3573, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4642 => 1.5687, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.02% (0.5329 => 0.5703, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.00% (0.2001 => 0.2141, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.99% (1.2784 => 1.3677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4524 => 0.4814, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (0.4861 => 0.5101, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 4.92% (0.3255 => 0.3415, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.26% (1.3864 => 1.4316, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 3.23% (5.0226 => 5.1847, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.46% (5.4682 => 5.6029, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 2.43% (3.5154 => 3.6007, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (22.4056 => 22.9276, std.dev.: 0.0082) MultiSource/Applications/spiff/spiff: 1.94% (0.8418 => 0.8581, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.61% (0.7447 => 0.7567, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.55% (15.5079 => 15.7475, std.dev.: 0.0177) MultiSource/Applications/JM/lencod/lencod: 1.34% (16.1920 => 16.4087, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3722 => 1.3883, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6711, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.10% (0.9531 => 1.0303, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4732, std.dev.: 0.1319) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6054, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2770, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2068, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -7.39% (0.3194 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.07% (0.3837 => 0.3604, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.46% (0.3812 => 0.3604, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.43% (0.3057 => 0.2891, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.39% (0.3323 => 0.3144, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.34% (0.2903 => 0.2748, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -5.28% (0.3848 => 0.3645, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -5.27% (0.2849 => 0.2699, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898) SingleSource/UnitTests/ObjC/exceptions-4: -5.26% (0.3880 => 0.3676, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.25% (0.3884 => 0.3680, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0573, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: -5.24% (0.3205 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.22% (0.2871 => 0.2721, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3831 => 0.3631, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.21% (0.3016 => 0.2859, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -5.19% (0.3025 => 0.2868, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -5.18% (0.3896 => 0.3694, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.16% (0.4033 => 0.3825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -5.16% (0.3026 => 0.2870, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.14% (0.3891 => 0.3691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: -5.00% (0.4176 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.82% (0.6347 => 0.6041, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.82% (0.2989 => 0.2845, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.73% (0.9852 => 0.9386, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.61% (0.7779 => 0.7420, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -4.60% (1.3148 => 1.2543, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.50% (0.4199 => 0.4010, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.43% (0.4151 => 0.3967, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.32% (0.3821 => 0.3656, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -4.18% (0.4280 => 0.4101, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.3931 => 0.3780, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.80% (0.3867 => 0.3720, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -3.77% (0.4248 => 0.4088, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.65% (0.9542 => 0.9194, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.59% (0.4321 => 0.4166, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.48% (0.4427 => 0.4273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.47% (0.3658 => 0.3531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.46% (0.3788 => 0.3657, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.42% (2.4924 => 2.4072, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.38% (0.3849 => 0.3719, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.35% (0.4813 => 0.4652, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.06% (0.4083 => 0.3958, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.58% (0.7198 => 0.7012, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.48% (0.7919 => 0.7723, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2827, std.dev.: 0.0264) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -2.02% (0.9179 => 0.8994, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.78% (1.2221 => 1.2004, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1997, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.70% (0.5999 => 0.5897, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -1.67% (4.3330 => 4.2608, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (0.7982 => 0.7862, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.35% (14.2083 => 14.0164, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.22% (34.0927 => 33.6754, std.dev.: 0.0223) MultiSource/Applications/hbd/hbd: -1.20% (1.5610 => 1.5423, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -1.19% (2.4021 => 2.3734, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.50% (1.8100 => 0.6969, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3157, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0243, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7598, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2090, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1272, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3391, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.78% (0.5142 => 0.4639, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8192, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7678, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/ary3: -2.41% (3.7241 => 3.6345, std.dev.: 0.0183) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1194, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4646, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3040 => 7.1987, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.43% (2.1154 => 2.0852, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5997, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6307 => 1.6121, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -1.07% (1.4516 => 1.4361, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.6086 => 1.5919, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 00:16:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 02:16:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116081658.2383B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7639?compare_to=7638&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7639, Order: 172598, Start Time: 2013-01-16 06:40:04, End Time: 2013-01-16 08:17:02 To: 7638, Order: 172597, Start Time: 2013-01-16 03:32:24, End Time: 2013-01-16 05:06:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (111 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.00% (0.3874 => 0.4494, std.dev.: 0.0042) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.39% (0.0717 => 0.1193, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0029) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.40% (0.1132 => 0.1544, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.97% (0.6395 => 0.8695, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.07% (0.6395 => 0.8574, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.30% (0.6260 => 0.8282, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.14% (0.5688 => 0.7459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.94% (0.5805 => 0.7601, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.87% (0.5456 => 0.7140, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.35% (0.6230 => 0.8121, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.28% (0.5849 => 0.7620, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.03% (0.5575 => 0.7249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.94% (0.5941 => 0.7720, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 29.89% (0.5567 => 0.7231, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.73% (0.5581 => 0.7240, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.20% (0.5802 => 0.7496, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.07% (0.6033 => 0.7787, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.89% (0.5705 => 0.7353, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.67% (0.5859 => 0.7539, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.26% (0.5478 => 0.7026, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.24% (0.5857 => 0.7511, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.19% (0.5569 => 0.7139, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.19% (0.5570 => 0.7140, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.11% (0.6440 => 0.8250, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.02% (0.5925 => 0.7585, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.72% (0.5591 => 0.7141, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.58% (0.6676 => 0.8517, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.30% (1.6474 => 2.0971, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.13% (0.6052 => 0.7694, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.84% (0.6189 => 0.7850, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.68% (0.5863 => 0.7427, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.62% (0.6446 => 0.8162, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.24% (0.6304 => 0.7958, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.25% (0.6681 => 0.8368, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.20% (0.6194 => 0.7755, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.06% (0.6297 => 0.7875, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.92% (0.6660 => 0.8320, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.17% (0.6667 => 0.8212, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.30% (0.7524 => 0.9202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.46% (0.7339 => 0.8914, std.dev.: 0.0229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.12% (2.2587 => 2.7131, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 17.28% (1.1450 => 1.3428, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.21% (0.3834 => 0.4494, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0063) MultiSource/Applications/sgefa/sgefa: 14.63% (0.3357 => 0.3848, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.58% (1.6364 => 1.8422, std.dev.: 0.0476) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.29% (4.5069 => 5.0609, std.dev.: 0.1196) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.53% (0.4916 => 0.5483, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/05-eks/eks: 11.25% (0.4515 => 0.5023, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.20% (3.5339 => 3.8945, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: 9.26% (9.2283 => 10.0824, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: 8.45% (1.2515 => 1.3572, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.42% (0.7021 => 0.7612, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.00% (0.5329 => 0.5702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.12% (0.4524 => 0.4801, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.83% (0.1731 => 0.1832, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (0.4861 => 0.5102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.76% (0.3255 => 0.3410, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.39% (1.3864 => 1.4334, std.dev.: 0.0072) MultiSource/Applications/oggenc/oggenc: 3.24% (5.0226 => 5.1852, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 2.49% (3.5154 => 3.6031, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.43% (5.4682 => 5.6009, std.dev.: 0.0125) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (22.4056 => 22.9122, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/bigfib: 2.01% (0.6750 => 0.6886, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.98% (0.8418 => 0.8585, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.58% (15.5079 => 15.7528, std.dev.: 0.0124) MultiSource/Applications/minisat/minisat: 1.52% (0.7447 => 0.7560, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 1.30% (16.1920 => 16.4023, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: 1.01% (7.0961 => 7.1681, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6620, std.dev.: 0.0777) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.61% (0.9531 => 1.0256, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1501, std.dev.: 0.0232) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4932, std.dev.: 0.0670) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1068, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6042, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.54% (5.1955 => 5.2755, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2060, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -7.36% (0.3194 => 0.2959, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.05% (0.3837 => 0.3605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.53% (0.3057 => 0.2888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/trivial-interface: -5.43% (0.3812 => 0.3605, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: -5.34% (0.3880 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.33% (0.3323 => 0.3146, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.30% (0.2849 => 0.2698, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.27% (0.3016 => 0.2857, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.26% (2.1713 => 2.0570, std.dev.: 0.0247) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.24% (0.3896 => 0.3692, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -5.23% (0.3059 => 0.2899, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -5.22% (0.3026 => 0.2868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.14% (0.3891 => 0.3691, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -5.09% (0.3025 => 0.2871, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -5.00% (0.4176 => 0.3967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.79% (0.6347 => 0.6043, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.78% (0.2989 => 0.2846, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -4.66% (1.3148 => 1.2535, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -4.60% (0.7779 => 0.7421, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.52% (0.4199 => 0.4009, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.46% (0.4151 => 0.3966, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.21% (0.4280 => 0.4100, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.90% (0.3867 => 0.3716, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.87% (0.3931 => 0.3779, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.81% (0.4248 => 0.4086, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.69% (0.3849 => 0.3707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.67% (0.3788 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.64% (0.9542 => 0.9195, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -3.36% (2.4924 => 2.4087, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.16% (0.4083 => 0.3954, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.99% (0.4813 => 0.4669, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.51% (20.7746 => 20.2533, std.dev.: 0.0524) MultiSource/Benchmarks/Bullet/bullet: -1.23% (34.0927 => 33.6747, std.dev.: 0.1170) MultiSource/Applications/hbd/hbd: -1.19% (1.5610 => 1.5425, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -1.08% (2.4021 => 2.3762, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.25% (1.8100 => 0.6833, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3107, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -24.45% (1.3643 => 1.0307, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0324, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3832, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1294, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1035, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3983, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2742, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/ary3: -2.37% (3.7241 => 3.6358, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (7.9763 => 7.7898, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4636, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1966, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6099, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6665, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: -1.04% (1.4516 => 1.4365, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 00:38:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 02:38:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116083850.2A0F12A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/7640?compare_to=7635&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7640, Order: 172598, Start Time: 2013-01-16 06:36:57, End Time: 2013-01-16 08:38:58 To: 7635, Order: 172550, Start Time: 2013-01-15 22:02:23, End Time: 2013-01-16 00:07:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (7 on baseline) Performance Improvements: 71 (54 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 985 (1002 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.43% (1.4585 => 1.8586, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 10.70% (1.7351 => 1.9208, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.82% (0.3288 => 0.3545, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.10% (4.7856 => 4.9818, std.dev.: 0.0429) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.07% (3.7311 => 3.8456, std.dev.: 0.0396) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.75% (21.8203 => 22.4194, std.dev.: 0.1189) SingleSource/Benchmarks/Misc/ffbench: 2.55% (1.3793 => 1.4145, std.dev.: 0.0106) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/trees/trees: -41.35% (0.1700 => 0.0997, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: -37.36% (0.1052 => 0.0659, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -25.20% (0.1837 => 0.1374, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -19.66% (0.0931 => 0.0748, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -19.52% (0.0840 => 0.0676, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -15.67% (0.0836 => 0.0705, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/objects/objects: -14.43% (0.1053 => 0.0901, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -13.18% (1.2335 => 1.0709, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: -12.16% (0.1670 => 0.1467, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -11.90% (1.0492 => 0.9243, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/mst/mst: -11.05% (0.1421 => 0.1264, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: -10.77% (0.3100 => 0.2766, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: -10.52% (0.5257 => 0.4704, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/ft/ft: -10.23% (0.2366 => 0.2124, std.dev.: 0.0075) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -9.76% (26.3553 => 23.7821, std.dev.: 0.7161) MultiSource/Benchmarks/PAQ8p/paq8p: -9.60% (2.8762 => 2.6000, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -8.70% (0.2987 => 0.2727, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -8.65% (0.9465 => 0.8646, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.27% (0.7437 => 0.6822, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: -7.80% (1.5727 => 1.4501, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.43% (0.9445 => 0.8743, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -7.42% (1.0287 => 0.9524, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -7.19% (1.1283 => 1.0472, std.dev.: 0.0127) MultiSource/Benchmarks/Bullet/bullet: -7.13% (35.9155 => 33.3562, std.dev.: 0.3430) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.94% (1.0069 => 0.9370, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -6.91% (0.9280 => 0.8639, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.82% (0.9313 => 0.8678, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -6.79% (0.9231 => 0.8604, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.75% (1.0456 => 0.9750, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.67% (0.9150 => 0.8540, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.56% (1.0503 => 0.9814, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -6.55% (0.9258 => 0.8652, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -6.33% (0.9568 => 0.8962, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.05% (0.9443 => 0.8872, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.04% (0.9733 => 0.9145, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: -5.92% (0.1758 => 0.1654, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.88% (1.0188 => 0.9589, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: -5.87% (0.2641 => 0.2486, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.78% (0.9533 => 0.8982, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.74% (0.3399 => 0.3204, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.66% (1.0040 => 0.9472, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.37% (0.2234 => 0.2114, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.60% (1.2800 => 1.2211, std.dev.: 0.0182) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.47% (1.3165 => 1.2576, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.37% (0.2334 => 0.2232, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: -4.14% (0.3770 => 0.3614, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.75% (0.9766 => 0.9400, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.70% (0.3029 => 0.2917, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -3.68% (10.1990 => 9.8233, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.62% (0.9224 => 0.8890, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.34% (0.9351 => 0.9039, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.16% (0.9254 => 0.8962, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.99% (1.0085 => 0.9783, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.67% (0.9148 => 0.8904, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.51% (0.9177 => 0.8947, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -30.62% (1.2546 => 0.8705, std.dev.: 0.1233) MultiSource/Benchmarks/Olden/bisort/bisort: -28.65% (0.9087 => 0.6484, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.94% (0.1131 => 0.0962, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.70% (1.4639 => 1.2780, std.dev.: 0.0383) MultiSource/Benchmarks/llubenchmark/llu: -9.53% (2.2020 => 1.9922, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/perimeter/perimeter: -7.88% (0.3437 => 0.3166, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.98% (63.8641 => 60.0446, std.dev.: 0.9777) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.33% (1.4675 => 1.3893, std.dev.: 0.0295) MultiSource/Benchmarks/Olden/tsp/tsp: -4.09% (1.5589 => 1.4952, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/health/health: -3.33% (0.3540 => 0.3422, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.12% (5.7927 => 5.6701, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.33% (4.8817 => 4.8169, std.dev.: 0.0209) MultiSource/Applications/JM/lencod/lencod: -1.27% (7.0143 => 6.9250, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.15% (3.1645 => 3.1282, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.11% (5.0432 => 4.9874, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -1.01% (3.6297 => 3.5932, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.94% (1.1882 => 1.1176, std.dev.: 0.0438) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0223 => 0.0223, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.94% (0.0426 => 0.0430, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.21% (0.0331 => 0.0335, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0316 => 0.0318, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.38% (0.0421 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0207 => 0.0207, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: -15.00% (0.0220 => 0.0187, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.05% (0.1504 => 0.1428, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: -5.36% (1.2065 => 1.1418, std.dev.: 0.3031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.40% (0.4231 => 0.4214, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.09% (0.1473 => 0.1489, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.75% (0.0973 => 0.0990, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.58% (0.0543 => 0.0557, std.dev.: 0.0132) MultiSource/Benchmarks/PAQ8p/paq8p: -16.67% (0.0018 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.92% (1.1854 => 1.1508, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.88% (0.0626 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.18% (0.0237 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (0.7409 => 0.7417, std.dev.: 0.0074) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.07% (0.0073 => 0.0062, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.08% (12.7599 => 12.7707, std.dev.: 0.0987) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 3.18% (9.5202 => 9.8233, std.dev.: 0.0389) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320925.00% (0.0008 => 2.5682, std.dev.: 0.0522) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.30% (1.1825 => 2.4158, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/ary3: 5.99% (1.8123 => 1.9208, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/pi: 3.01% (2.1390 => 2.2034, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 1.60% (6.8159 => 6.9250, std.dev.: 0.0114) MultiSource/Applications/lua/lua: 1.55% (29.0327 => 29.4815, std.dev.: 0.1370) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.23% (0.0808 => 0.0491, std.dev.: 0.0081) SingleSource/Benchmarks/SmallPT/smallpt: -26.69% (0.1888 => 0.1384, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.43% (0.1009 => 0.0813, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -19.41% (1.8964 => 1.5284, std.dev.: 0.0552) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.52% (0.0862 => 0.0711, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.81% (1.0986 => 0.9249, std.dev.: 0.0277) MultiSource/Applications/hexxagon/hexxagon: -12.68% (1.1433 => 0.9983, std.dev.: 0.0383) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.06% (10.2703 => 9.3395, std.dev.: 0.1329) MultiSource/Benchmarks/Olden/health/health: -8.88% (0.1610 => 0.1467, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.73% (1.0017 => 0.9243, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.76% (0.9550 => 0.8904, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.65% (0.9422 => 0.8890, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.63% (0.3981 => 0.3757, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.52% (0.9507 => 0.8982, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.51% (1.3310 => 1.2576, std.dev.: 0.0109) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.36% (0.2144 => 0.2029, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.01% (5.0381 => 4.7855, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.01% (0.8990 => 0.8540, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.97% (0.9512 => 0.9039, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.97% (0.9091 => 0.8639, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.87% (0.9405 => 0.8947, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.69% (0.9403 => 0.8962, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.61% (1.0052 => 0.9589, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.60% (0.9788 => 0.9338, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.17% (1.3220 => 1.2669, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.09% (0.2884 => 0.2766, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.84% (0.5369 => 0.5163, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.70% (1.2680 => 1.2211, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.57% (1.0860 => 1.0472, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.51% (0.9061 => 0.8743, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.36% (0.9855 => 0.9524, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.32% (1.0119 => 0.9783, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.07% (0.8926 => 0.8652, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.78% (0.8893 => 0.8646, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.52% (0.9612 => 0.9370, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.52% (0.9381 => 0.9145, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.05% (1.4805 => 1.4501, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.84% (0.9998 => 0.9814, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.73% (0.9120 => 0.8962, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.71% (0.9564 => 0.9400, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.53% (0.9010 => 0.8872, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.82% (0.9372 => 0.6484, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -14.91% (1.4588 => 1.2413, std.dev.: 0.0606) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.98% (0.4081 => 0.3633, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.22% (1.4235 => 1.2780, std.dev.: 0.0383) SingleSource/Benchmarks/Shootout/hash: -9.03% (4.5259 => 4.1173, std.dev.: 0.1457) MultiSource/Benchmarks/Olden/health/health: -6.35% (0.3654 => 0.3422, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.46% (0.3349 => 0.3166, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.18% (23.3986 => 22.4194, std.dev.: 0.1189) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.28% (40.4729 => 39.1441, std.dev.: 0.3125) SingleSource/Benchmarks/Shootout-C++/lists: -3.09% (17.2182 => 16.6867, std.dev.: 0.1272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.28% (0.5826 => 0.5693, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: -1.85% (2.0298 => 1.9922, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.22% (3.1921 => 3.1532, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.23% (1.2047 => 1.1176, std.dev.: 0.0438) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/test1: -17.62% (0.0227 => 0.0187, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.67% (0.1530 => 0.1428, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: -40.82% (1.9293 => 1.1418, std.dev.: 0.3031) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.08% (0.4049 => 0.4214, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.39% (0.1510 => 0.1489, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.23% (0.0978 => 0.0990, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.59% (0.0590 => 0.0557, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.94% (1.1617 => 1.1508, std.dev.: 0.0177) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.27% (0.7437 => 0.7417, std.dev.: 0.0074) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.61% (0.0092 => 0.0062, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7781 => 12.7707, std.dev.: 0.0987) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 01:02:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 03:02:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116090206.8FA3C2A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/7641?compare_to=7637&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7641, Order: 172598, Start Time: 2013-01-16 06:47:01, End Time: 2013-01-16 09:02:11 To: 7637, Order: 172597, Start Time: 2013-01-16 02:40:51, End Time: 2013-01-16 04:52:48 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0676 => 0.0675, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8368 => 499.8402, std.dev.: 0.0101) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 44223.86% (1.1277 => 499.8402, std.dev.: 0.0101) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.91% (0.5229 => 1.6676, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 21.25% (14.9895 => 18.1750, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: 42.95% (14.1553 => 20.2344, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 18.46% (4.1105 => 4.8691, std.dev.: 0.1378) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.74% (1.1048 => 1.7869, std.dev.: 0.0355) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 438.37% (7.1582 => 38.5378, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.77% (3.4629 => 6.3638, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.63% (0.6222 => 1.0803, std.dev.: 0.0024) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.06% (0.0720 => 7.4470, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11141400.00% (0.0001 => 11.1415, std.dev.: 0.0683) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484100.00% (0.0001 => 5.4842, std.dev.: 0.0289) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.01% (1.1194 => 10.3770, std.dev.: 0.3289) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 151.70% (22.1758 => 55.8174, std.dev.: 0.0520) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.99% (0.0929 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.25% (0.1463 => 0.2520, std.dev.: 0.0044) SingleSource/Regression/C/sumarray2d: 69.74% (0.0271 => 0.0460, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 67.43% (21.9371 => 36.7295, std.dev.: 0.0247) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.97% (7.0540 => 11.2136, std.dev.: 0.1738) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.79% (2.9384 => 4.6070, std.dev.: 0.0675) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 51.42% (0.1056 => 0.1599, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.33% (1.5859 => 2.3841, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.32% (8.1363 => 12.2303, std.dev.: 0.2239) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.91% (2.2024 => 3.1033, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0011) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.50% (1.5415 => 2.0733, std.dev.: 0.0520) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.24% (4.2646 => 5.7250, std.dev.: 0.1203) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.63% (0.4615 => 0.6121, std.dev.: 0.0163) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1892 => 0.2497, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.30% (0.2700 => 0.3545, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: 31.15% (0.1175 => 0.1541, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: 30.54% (1.1642 => 1.5197, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/05-eks/eks: 29.31% (0.4299 => 0.5559, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.09% (0.6675 => 0.8617, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 27.72% (9.4845 => 12.1137, std.dev.: 0.0152) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.21% (0.5105 => 0.6494, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 26.78% (0.2554 => 0.3238, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 26.13% (1.0722 => 1.3524, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.88% (0.1584 => 0.1994, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.67% (1.4186 => 1.7827, std.dev.: 0.0324) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.42% (3.8922 => 4.8817, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0094) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.87% (0.3121 => 0.3866, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.12% (0.0770 => 0.0948, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0060) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.10% (0.1143 => 0.1407, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 22.91% (5.7591 => 7.0783, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.57% (0.0443 => 0.0543, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 22.36% (0.7115 => 0.8706, std.dev.: 0.0172) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 22.06% (0.4289 => 0.5235, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.01% (0.1695 => 0.2068, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.94% (4.9449 => 6.0299, std.dev.: 0.1402) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.87% (0.1029 => 0.1254, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 21.80% (0.1555 => 0.1894, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 21.71% (0.4620 => 0.5623, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 21.46% (3.3354 => 4.0512, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.18% (5.0018 => 6.0610, std.dev.: 0.1357) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.96% (0.0730 => 0.0883, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.79% (1.3050 => 1.5763, std.dev.: 0.0370) MultiSource/Applications/spiff/spiff: 20.75% (0.7835 => 0.9461, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.59% (0.1695 => 0.2044, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/messages-2: 20.24% (0.0662 => 0.0796, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.21% (0.3098 => 0.3724, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.02% (0.5860 => 0.7033, std.dev.: 0.0225) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.00% (0.1940 => 0.2328, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.87% (0.8172 => 0.9796, std.dev.: 0.0409) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: 19.08% (0.3423 => 0.4076, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.89% (0.0953 => 0.1133, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 18.77% (0.6456 => 0.7668, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.75% (0.2758 => 0.3275, std.dev.: 0.0103) MultiSource/Applications/aha/aha: 18.68% (0.1151 => 0.1366, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.54% (0.1510 => 0.1790, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.28% (0.0640 => 0.0757, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.25% (0.5020 => 0.5936, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 18.17% (3.8723 => 4.5759, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.97% (0.2065 => 0.2436, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.92% (0.5569 => 0.6567, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.49% (0.3441 => 0.4043, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 17.43% (1.1840 => 1.3904, std.dev.: 0.0332) MultiSource/Applications/lambda-0_1_3/lambda: 17.36% (0.7433 => 0.8723, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.14% (0.9765 => 1.1439, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout/matrix: 17.11% (0.0818 => 0.0958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.02% (0.3307 => 0.3870, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.85% (0.5981 => 0.6989, std.dev.: 0.0175) MultiSource/Applications/treecc/treecc: 16.81% (2.0273 => 2.3681, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.65% (0.6450 => 0.7524, std.dev.: 0.0173) MultiSource/Benchmarks/sim/sim: 16.56% (0.3387 => 0.3948, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.31% (0.8101 => 0.9422, std.dev.: 0.0281) MultiSource/Benchmarks/McCat/09-vor/vor: 16.29% (0.3180 => 0.3698, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 16.13% (10.3673 => 12.0399, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.12% (2.2969 => 2.6671, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.94% (0.8067 => 0.9353, std.dev.: 0.0302) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.56% (1.1861 => 1.3706, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/football/football: 15.26% (0.8921 => 1.0282, std.dev.: 0.0231) SingleSource/UnitTests/SignlessTypes/rem: 14.42% (0.1144 => 0.1309, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 14.01% (0.3283 => 0.3743, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 13.71% (0.3232 => 0.3675, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: 13.46% (17.1811 => 19.4934, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/bh/bh: 13.36% (0.3092 => 0.3505, std.dev.: 0.0065) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7642, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.85% (14.3668 => 16.2124, std.dev.: 0.3849) SingleSource/Benchmarks/Shootout-C++/ary2: 12.28% (0.3379 => 0.3794, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.76% (0.3427 => 0.3830, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.65% (0.4636 => 0.5176, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.46% (0.3865 => 0.4308, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 11.37% (0.3282 => 0.3655, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.03% (0.2430 => 0.2698, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.47% (0.4203 => 0.4643, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.47% (0.3927 => 0.4338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.43% (0.4103 => 0.4531, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.08% (0.4048 => 0.4456, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 9.72% (63.2438 => 69.3883, std.dev.: 0.0883) SingleSource/Benchmarks/Shootout-C++/sieve: 9.60% (0.3603 => 0.3949, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.54% (0.3826 => 0.4191, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists: 9.53% (0.3422 => 0.3748, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.30% (0.3473 => 0.3796, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.23% (0.3543 => 0.3870, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: 9.23% (0.3684 => 0.4024, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.18% (0.3561 => 0.3888, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3543 => 0.3866, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.10% (0.3694 => 0.4030, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.99% (0.3516 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.59% (0.4064 => 0.4413, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/strcat: 7.88% (0.2831 => 0.3054, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.6030 => 0.6492, std.dev.: 0.0039) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.45% (7.9617 => 8.5549, std.dev.: 0.1635) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5925 => 0.6356, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.13% (0.7326 => 0.7848, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.12% (0.3935 => 0.4215, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.07% (2.0665 => 2.2127, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.07% (2.2022 => 2.3579, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.04% (0.3650 => 0.3907, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: 6.99% (1.2842 => 1.3740, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: 6.71% (0.2877 => 0.3070, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 6.69% (0.2871 => 0.3063, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 6.64% (0.2905 => 0.3098, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.3162 => 0.3366, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.33% (0.2891 => 0.3074, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.31% (0.2266 => 0.2409, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 5.96% (0.3052 => 0.3234, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.91% (0.2756 => 0.2919, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.61% (0.3136 => 0.3312, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 5.58% (0.2725 => 0.2877, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 5.42% (0.2714 => 0.2861, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.88% (4.3953 => 10.8952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2438, std.dev.: 0.0414) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0187) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (4.2280 => 4.4767, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3102, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.6802 => 8.9272, std.dev.: 0.0568) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.37% (0.6533 => 0.6688, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.35% (3.6395 => 3.7250, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2819, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5814, std.dev.: 0.0088) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4496, std.dev.: 0.0327) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.08% (5.2763 => 1.2092, std.dev.: 0.0224) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.54% (5.3855 => 4.4948, std.dev.: 0.0822) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.16% (5.3526 => 4.4878, std.dev.: 0.0696) MultiSource/Applications/JM/ldecod/ldecod: -10.86% (10.4361 => 9.3031, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6196, std.dev.: 0.0227) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9383, std.dev.: 0.0201) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -68.11% (1.9577 => 0.6243, std.dev.: 0.0267) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.45% (0.3987 => 0.2494, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3075, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.67% (1.5373 => 1.0197, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4336, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8624, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0067, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.06% (1.6925 => 1.4207, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7312, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0368) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0217) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2515, std.dev.: 0.0311) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.64% (0.3463 => 0.3233, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -6.41% (1.2373 => 1.1580, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7021, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.22% (0.8614 => 0.8164, std.dev.: 0.0101) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8299, std.dev.: 0.0168) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.88% (3.6994 => 3.6299, std.dev.: 0.0130) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3302, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: -1.46% (3.7221 => 3.6679, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2287, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8590, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.10% (0.2116 => 0.0675, std.dev.: 0.0058) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 01:04:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 03:04:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130116090431.AC9852A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7642?compare_to=7634&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7642, Order: 172597, Start Time: 2013-01-16 05:13:33, End Time: 2013-01-16 09:04:35 To: 7634, Order: 172545, Start Time: 2013-01-15 20:17:08, End Time: 2013-01-15 23:51:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (171 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (766 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.62% (14.1698 => 14.3993, std.dev.: 0.0329) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.19% (129.6961 => 131.2360, std.dev.: 0.3124) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.60% (0.0625 => 0.0910, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.62% (0.1063 => 0.1431, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.77% (0.4994 => 0.6381, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.45% (0.2969 => 0.3784, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.70% (0.4139 => 0.5244, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.29% (0.1107 => 0.1398, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.25% (0.5900 => 0.7449, std.dev.: 0.0176) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.70% (0.4253 => 0.5346, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.41% (0.1106 => 0.1387, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.96% (0.5000 => 0.6248, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.51% (0.1620 => 0.2017, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.20% (1.5932 => 1.9628, std.dev.: 0.0166) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.85% (0.0897 => 0.1102, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.85% (0.1549 => 0.1903, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 22.24% (0.1619 => 0.1979, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.05% (0.0948 => 0.1157, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.24% (0.3903 => 0.4732, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.72% (0.3890 => 0.4696, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.70% (0.0541 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.37% (1.3152 => 1.5831, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.10% (0.2736 => 0.3286, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.82% (0.2866 => 0.3434, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: 19.63% (0.4029 => 0.4820, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.60% (0.3271 => 0.3912, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.51% (1.9694 => 2.3536, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.07% (0.2014 => 0.2398, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.75% (0.1088 => 0.1292, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.74% (0.1462 => 0.1736, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 18.17% (1.8794 => 2.2209, std.dev.: 0.0262) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.14% (0.4658 => 0.5503, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 17.85% (0.5546 => 0.6536, std.dev.: 0.0254) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.65% (1.6211 => 1.9073, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.49% (0.5026 => 0.5905, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 17.46% (0.5889 => 0.6917, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.40% (1.9966 => 2.3440, std.dev.: 0.0292) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.39% (3.5627 => 4.1823, std.dev.: 0.0536) MultiSource/Applications/hbd/hbd: 17.24% (0.9697 => 1.1369, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.18% (0.2875 => 0.3369, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.77% (4.4195 => 5.1608, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.56% (0.4361 => 0.5083, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.35% (0.2911 => 0.3387, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.33% (0.2750 => 0.3199, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.30% (2.7292 => 3.1741, std.dev.: 0.0234) MultiSource/Benchmarks/Olden/bh/bh: 16.28% (0.1284 => 0.1493, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 16.25% (0.2714 => 0.3155, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 16.25% (0.7171 => 0.8336, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.19% (0.2792 => 0.3244, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.13% (0.3930 => 0.4564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.11% (0.2738 => 0.3179, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.04% (2.0673 => 2.3989, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/fibo: 16.00% (0.2725 => 0.3161, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 15.91% (0.2803 => 0.3249, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 15.83% (0.2811 => 0.3256, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.83% (0.2729 => 0.3161, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 15.82% (0.2813 => 0.3258, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 15.80% (0.9909 => 1.1475, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.74% (0.3195 => 0.3698, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 15.73% (0.2823 => 0.3267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.53% (0.3317 => 0.3832, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 15.48% (1.0781 => 1.2450, std.dev.: 0.0360) MultiSource/Applications/ClamAV/clamscan: 15.35% (4.2109 => 4.8572, std.dev.: 0.0519) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: 15.31% (0.3096 => 0.3570, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 15.27% (0.3267 => 0.3766, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.23% (0.3362 => 0.3874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.19% (0.3258 => 0.3753, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.88% (0.3124 => 0.3589, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.82% (0.3488 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 14.77% (0.3446 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.77% (0.3460 => 0.3971, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 14.76% (0.3442 => 0.3950, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.73% (23.5202 => 26.9849, std.dev.: 0.0985) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.59% (0.3845 => 0.4406, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.57% (0.3625 => 0.4153, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 14.55% (0.3348 => 0.3835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.47% (0.3726 => 0.4265, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.44% (0.4251 => 0.4865, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.41% (0.3282 => 0.3755, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 14.36% (0.3650 => 0.4174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.35% (0.3477 => 0.3976, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.23% (0.3724 => 0.4254, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.19% (0.3643 => 0.4160, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.17% (0.3678 => 0.4199, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.13% (0.7875 => 0.8988, std.dev.: 0.0338) MultiSource/Benchmarks/nbench/nbench: 14.07% (0.2566 => 0.2927, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 14.02% (1.4269 => 1.6270, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 13.77% (0.4146 => 0.4717, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.74% (0.3981 => 0.4528, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3690 => 0.4195, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 13.25% (0.5012 => 0.5676, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 12.92% (0.2075 => 0.2343, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 12.89% (2.1653 => 2.4445, std.dev.: 0.0754) MultiSource/Applications/minisat/minisat: 12.68% (0.3336 => 0.3759, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.35% (0.1028 => 0.1155, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 12.35% (4.6177 => 5.1880, std.dev.: 0.1512) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.23% (0.6435 => 0.7222, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 12.09% (5.5417 => 6.2116, std.dev.: 0.1246) MultiSource/Benchmarks/mafft/pairlocalalign: 11.81% (2.1013 => 2.3495, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.80% (0.2068 => 0.2312, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.62% (0.2737 => 0.3055, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 11.41% (0.3498 => 0.3897, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.99% (0.2103 => 0.2313, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.90% (0.5361 => 0.5892, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.70% (11.6398 => 12.7694, std.dev.: 0.0085) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.61% (0.2040 => 0.2236, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: 9.53% (0.4847 => 0.5309, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.04% (4.6926 => 5.1168, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.04% (0.1383 => 0.1508, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.65% (0.7426 => 0.8068, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 7.90% (0.2391 => 0.2580, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 7.72% (2.0346 => 2.1917, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.27% (0.5584 => 0.5990, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 6.81% (11.9555 => 12.7693, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.41% (0.3792 => 0.3997, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.91% (29.0505 => 181.5391, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.20% (0.5917 => 0.6757, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.56% (0.3693 => 0.4083, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2352, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6675, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/flops-2: 4.78% (1.8057 => 1.8920, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6868, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2006, std.dev.: 0.0434) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3017, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2092, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5860, std.dev.: 0.0343) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.88% (25.4195 => 16.5543, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/mandel-2: -20.90% (3.6262 => 2.8683, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: -16.47% (17.2379 => 14.3993, std.dev.: 0.0329) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -9.24% (0.2402 => 0.2180, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7921, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2253, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8003, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: -3.40% (14.0481 => 13.5705, std.dev.: 0.1176) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1923, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1997, std.dev.: 0.3630) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 02:14:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 04:14:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116101449.90FAC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7643?compare_to=7639&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7643, Order: 172601, Start Time: 2013-01-16 08:40:43, End Time: 2013-01-16 10:14:55 To: 7639, Order: 172598, Start Time: 2013-01-16 06:40:04, End Time: 2013-01-16 08:17:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (103 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.03% (78.8659 => 81.2537, std.dev.: 0.1976) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.09% (0.0717 => 0.1198, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.68% (0.0974 => 0.1565, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0045) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.14% (0.6395 => 0.8706, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.32% (0.6395 => 0.8590, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.67% (0.6260 => 0.8305, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.35% (0.5688 => 0.7471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.25% (0.5805 => 0.7619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.92% (0.5456 => 0.7143, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.53% (0.6230 => 0.8132, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.33% (0.5575 => 0.7266, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.33% (0.5849 => 0.7623, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.26% (0.5941 => 0.7739, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.11% (0.5567 => 0.7243, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.03% (0.5581 => 0.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.47% (0.5802 => 0.7512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.34% (0.6033 => 0.7803, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.26% (0.5705 => 0.7374, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.79% (0.5859 => 0.7546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.60% (0.5570 => 0.7163, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.51% (0.6440 => 0.8276, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.36% (0.5857 => 0.7518, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.31% (0.5478 => 0.7029, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.24% (0.5591 => 0.7170, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.23% (0.5569 => 0.7141, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.15% (0.5925 => 0.7593, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.74% (0.6676 => 0.8528, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.60% (1.6474 => 2.1021, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.25% (0.6052 => 0.7701, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.06% (0.6189 => 0.7864, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.95% (0.5863 => 0.7443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.95% (0.6446 => 0.8183, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.78% (0.6304 => 0.7992, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.67% (0.6681 => 0.8396, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.61% (0.6194 => 0.7780, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.23% (0.6660 => 0.8340, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.09% (0.6297 => 0.7877, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.55% (0.6667 => 0.8237, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.36% (0.7524 => 0.9206, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.47% (0.7339 => 0.8915, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.41% (2.2587 => 2.7196, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.45% (1.1450 => 1.3448, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.82% (0.1982 => 0.2236, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.71% (1.6364 => 1.8444, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.49% (4.5069 => 5.0700, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.88% (0.4916 => 0.5500, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.43% (0.4515 => 0.5031, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.51% (3.5339 => 3.9052, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2385 => 0.2615, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 9.26% (9.2283 => 10.0824, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.72% (0.7021 => 0.7633, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.43% (1.2515 => 1.3570, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.27% (1.2784 => 1.3713, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.22% (1.4642 => 1.5699, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.19% (0.5329 => 0.5712, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.76% (0.1731 => 0.1848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.01% (0.4524 => 0.4796, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.3255 => 0.3429, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.38% (1.3864 => 1.4332, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.37% (5.0226 => 5.1917, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.01% (5.4682 => 5.6327, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 2.57% (3.5154 => 3.6056, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (22.4056 => 22.9767, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/bigfib: 2.44% (0.6750 => 0.6915, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.20% (0.8418 => 0.8603, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 1.77% (15.5079 => 15.7819, std.dev.: 0.0295) MultiSource/Applications/minisat/minisat: 1.71% (0.7447 => 0.7574, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 1.47% (16.1920 => 16.4294, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3722 => 1.3916, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.05% (4.8161 => 4.8668, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (4.0323 => 4.0744, std.dev.: 0.0152) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6568, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.56% (0.9531 => 1.0347, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6519, std.dev.: 0.0687) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.93% (79.7170 => 81.2537, std.dev.: 0.1976) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6041, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (5.1955 => 5.2762, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2079, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.73% (0.3194 => 0.2979, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.55% (0.3837 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.15% (0.2871 => 0.2723, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.15% (0.3323 => 0.3152, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.06% (0.3812 => 0.3619, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.95% (0.2849 => 0.2708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.95% (0.3880 => 0.3688, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.88% (0.3896 => 0.3706, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.88% (0.2933 => 0.2790, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.87% (0.3016 => 0.2869, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.83% (0.3025 => 0.2879, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.81% (0.3848 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.78% (2.1713 => 2.0676, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.63% (0.3026 => 0.2886, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317) SingleSource/UnitTests/ObjC/exceptions: -4.53% (0.4176 => 0.3987, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.52% (0.3252 => 0.3105, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.47% (0.9852 => 0.9412, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.44% (0.7779 => 0.7434, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -4.35% (0.2989 => 0.2859, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -4.26% (1.3148 => 1.2588, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.94% (0.6441 => 0.6187, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.88% (0.4151 => 0.3990, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.69% (0.4280 => 0.4122, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (0.3621 => 0.3488, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.46% (0.3931 => 0.3795, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -3.44% (0.3867 => 0.3734, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.30% (0.3849 => 0.3722, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.30% (2.4924 => 2.4102, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.30% (0.4427 => 0.4281, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/moments: -3.27% (0.4248 => 0.4109, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.20% (0.9542 => 0.9237, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.10% (0.4321 => 0.4187, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: -3.09% (0.3788 => 0.3671, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.91% (0.4813 => 0.4673, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.82% (0.7198 => 0.6995, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.78% (20.7746 => 20.1981, std.dev.: 0.0772) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.74% (0.4083 => 0.3971, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.22% (0.7919 => 0.7743, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.97% (1.0544 => 1.0336, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.73% (1.2210 => 1.1999, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -1.70% (0.9179 => 0.9023, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.65% (1.2221 => 1.2019, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (0.7982 => 0.7857, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -1.32% (4.3330 => 4.2759, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.25% (14.2083 => 14.0311, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.71% (1.8100 => 0.6931, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3142, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0266, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7539, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0238, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2091, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.08% (2.5106 => 2.1319, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.75% (1.3096 => 1.2605, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7807, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6424, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.67% (1.6086 => 1.5818, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6061, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3040 => 7.2007, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6014, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6676, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 02:54:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 04:54:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116105444.233F52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7644?compare_to=7640&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7644, Order: 172601, Start Time: 2013-01-16 08:56:20, End Time: 2013-01-16 10:54:52 To: 7640, Order: 172598, Start Time: 2013-01-16 06:36:57, End Time: 2013-01-16 08:38:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 9 (12 on baseline) Performance Improvements: 5 (137 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1049 (914 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.31% (0.9983 => 1.0114, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.22% (4.8419 => 4.9008, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 8.34% (2.4158 => 2.6172, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.53% (1.6729 => 1.7989, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.82% (2.0985 => 2.1787, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/fldry: 2.88% (0.6598 => 0.6788, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.55% (3.9247 => 4.0247, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.99% (2.7581 => 2.8131, std.dev.: 0.0213) MultiSource/Applications/siod/siod: 1.12% (3.5932 => 3.6335, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.80% (5.8507 => 5.2772, std.dev.: 0.1188) MultiSource/Applications/lua/lua: -3.35% (29.4815 => 28.4927, std.dev.: 0.2872) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.62% (3.8456 => 3.7447, std.dev.: 0.0318) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -2.62% (4.3767 => 4.2620, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/whetstone: -1.35% (1.6413 => 1.6192, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.01% (1.1176 => 1.0951, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0223 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0335 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0318 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -13.04% (0.0207 => 0.0180, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -26.74% (0.0187 => 0.0137, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0252 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1428 => 0.1442, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 1.35% (1.1418 => 1.1572, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.15% (0.4214 => 0.3997, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.14% (0.1489 => 0.1506, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.78% (0.0990 => 0.1067, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.97% (0.0557 => 0.0546, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1508 => 1.1483, std.dev.: 0.1015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0608 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0318 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.12% (0.7417 => 0.7408, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.94% (0.0062 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7707 => 12.7493, std.dev.: 0.0400) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 2.98% (9.5202 => 9.8043, std.dev.: 0.0638) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.57% (1.8651 => 1.9131, std.dev.: 0.0133) MultiSource/Applications/JM/lencod/lencod: 2.52% (16.7012 => 17.1222, std.dev.: 0.0733) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320462.50% (0.0008 => 2.5645, std.dev.: 0.0218) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 121.33% (1.1825 => 2.6172, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.17% (0.2562 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.21% (1.6779 => 1.7989, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.60% (2.1030 => 2.1787, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/pi: 3.04% (2.1390 => 2.2041, std.dev.: 0.0053) MultiSource/Benchmarks/mafft/pairlocalalign: 1.78% (63.1520 => 64.2775, std.dev.: 0.2869) MultiSource/Applications/siod/siod: 1.18% (3.5910 => 3.6335, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.46% (0.0808 => 0.0473, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.15% (0.0727 => 0.0486, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -26.38% (0.1888 => 0.1390, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -23.37% (0.0676 => 0.0518, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -18.97% (1.8964 => 1.5366, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.14% (0.1009 => 0.0826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.47% (0.7686 => 0.6343, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.40% (0.1079 => 0.0902, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.32% (1.0960 => 0.9171, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.47% (1.0986 => 0.9286, std.dev.: 0.0286) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.46% (0.4074 => 0.3444, std.dev.: 0.0056) MultiSource/Applications/aha/aha: -14.73% (0.1378 => 0.1175, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -13.96% (1.0220 => 0.8793, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.75% (0.0847 => 0.0739, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -12.67% (9.8875 => 8.6347, std.dev.: 0.2590) MultiSource/Applications/treecc/treecc: -12.38% (2.4719 => 2.1658, std.dev.: 0.0220) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.83% (1.2154 => 1.0716, std.dev.: 0.0137) MultiSource/Applications/Burg/burg: -11.73% (1.5979 => 1.4104, std.dev.: 0.0202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.59% (0.0889 => 0.0786, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -11.54% (1.1433 => 1.0114, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.29% (6.4235 => 5.6985, std.dev.: 0.0799) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.67% (0.2372 => 0.2119, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.66% (0.7693 => 0.6873, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -10.17% (4.6406 => 4.1687, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.95% (1.5131 => 1.3625, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.75% (0.1210 => 0.1092, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.64% (0.9124 => 0.8244, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.63% (0.3560 => 0.3217, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.56% (0.6885 => 0.6227, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.41% (1.1498 => 1.0416, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.09% (1.3924 => 1.2659, std.dev.: 0.0313) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.07% (0.2481 => 0.2256, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -8.83% (2.6437 => 2.4102, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.74% (1.6874 => 1.5399, std.dev.: 0.0085) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.55% (1.1731 => 1.0728, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.51% (0.5746 => 0.5257, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.46% (10.2703 => 9.4011, std.dev.: 0.0339) MultiSource/Benchmarks/Olden/health/health: -8.45% (0.1610 => 0.1474, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -8.38% (0.2100 => 0.1924, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: -8.24% (0.8653 => 0.7940, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: -8.20% (0.3598 => 0.3303, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -7.80% (17.4365 => 16.0770, std.dev.: 0.0375) MultiSource/Applications/sqlite3/sqlite3: -7.35% (17.5634 => 16.2724, std.dev.: 0.1022) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.22% (0.2618 => 0.2429, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.12% (0.1798 => 0.1670, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: -6.88% (0.2006 => 0.1868, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.84% (1.8127 => 1.6887, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.56% (0.9588 => 0.8959, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: -6.45% (0.4002 => 0.3744, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.35% (0.2283 => 0.2138, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hello: -6.22% (0.1928 => 0.1808, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.07% (1.3310 => 1.2502, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: -6.00% (0.2385 => 0.2242, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.89% (0.3462 => 0.3258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.41% (0.9127 => 0.8633, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.38% (0.3981 => 0.3767, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.36% (0.9422 => 0.8917, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/lists: -5.28% (0.2725 => 0.2581, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wc: -5.08% (0.2305 => 0.2188, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.02% (3.6295 => 3.4473, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.97% (0.3665 => 0.3483, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.95% (0.9512 => 0.9041, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.84% (0.8990 => 0.8555, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.77% (0.9405 => 0.8956, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.67% (0.2615 => 0.2493, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.66% (0.3093 => 0.2949, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.47% (5.0381 => 4.8129, std.dev.: 0.0309) MultiSource/Applications/d/make_dparser: -4.37% (3.7840 => 3.6188, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.35% (1.0234 => 0.9789, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.33% (0.6934 => 0.6634, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sieve: -4.29% (0.2913 => 0.2788, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.28% (0.2993 => 0.2865, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.24% (1.3220 => 1.2660, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/bigfib: -4.14% (0.6711 => 0.6433, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -4.10% (1.3979 => 1.3406, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: -4.02% (0.3206 => 0.3077, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -4.02% (0.2564 => 0.2461, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: -4.01% (0.7776 => 0.7464, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -3.77% (0.4689 => 0.4512, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -3.72% (4.5936 => 4.4228, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: -3.67% (1.4392 => 1.3864, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.63% (0.7693 => 0.7414, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.55% (0.9993 => 0.9638, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: -3.50% (18.9377 => 18.2751, std.dev.: 0.0881) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.38% (4.6579 => 4.5003, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.29% (0.9855 => 0.9531, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.27% (0.9685 => 0.9368, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.19% (1.0119 => 0.9796, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.14% (0.9214 => 0.8925, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.08% (1.2680 => 1.2290, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.93% (0.6135 => 0.5955, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -2.92% (16.4479 => 15.9675, std.dev.: 0.1359) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.55% (0.8893 => 0.8666, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.41% (0.9381 => 0.9155, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.39% (2.4519 => 2.3933, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -1.74% (0.9759 => 0.9589, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.63% (0.6996 => 0.6882, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.08% (0.9372 => 0.6459, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/heapsort: -30.58% (4.4739 => 3.1059, std.dev.: 0.0352) MultiSource/Benchmarks/Ptrdist/ft/ft: -29.04% (1.0816 => 0.7675, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.11% (4.2042 => 3.1484, std.dev.: 0.1904) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.48% (0.1164 => 0.0914, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: -21.36% (7.9891 => 6.2830, std.dev.: 0.1750) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.49% (2.8778 => 2.3458, std.dev.: 0.0961) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.95% (1.5623 => 1.2819, std.dev.: 0.0434) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.15% (1.4235 => 1.2648, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.46% (0.4081 => 0.3654, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.54% (5.0421 => 4.5612, std.dev.: 0.0821) SingleSource/Benchmarks/Shootout/hash: -9.09% (4.5259 => 4.1145, std.dev.: 0.0637) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.05% (1.6547 => 1.5049, std.dev.: 0.0547) SingleSource/Benchmarks/Shootout-C++/lists1: -8.03% (0.6628 => 0.6096, std.dev.: 0.0067) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.24% (23.3986 => 21.9389, std.dev.: 0.2685) MultiSource/Applications/oggenc/oggenc: -6.10% (0.1704 => 0.1600, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.91% (46.0987 => 43.3730, std.dev.: 0.4554) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.82% (5.6033 => 5.2772, std.dev.: 0.1188) SingleSource/Benchmarks/Shootout/ary3: -5.32% (2.2304 => 2.1117, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.3201 => 0.3038, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.60% (0.3349 => 0.3195, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.01% (1.4446 => 1.3867, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (17.2182 => 16.5716, std.dev.: 0.0460) MultiSource/Applications/SIBsim4/SIBsim4: -3.58% (3.5443 => 3.4174, std.dev.: 0.0174) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.00% (42.3194 => 41.0516, std.dev.: 0.3403) SingleSource/Benchmarks/McGill/chomp: -2.91% (1.0425 => 1.0122, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.64% (0.5826 => 0.5672, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -2.40% (4.4730 => 4.3658, std.dev.: 0.0368) MultiSource/Applications/spiff/spiff: -2.27% (2.8571 => 2.7923, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.18% (61.0379 => 59.7090, std.dev.: 0.1286) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.72% (3.0082 => 2.9564, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -1.60% (0.8521 => 0.8385, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3596 => 3.3158, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.22% (3.1921 => 3.1532, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: -1.09% (1.5017 => 1.4853, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -9.10% (1.2047 => 1.0951, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -15.49% (0.0213 => 0.0180, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/test1: -39.65% (0.0227 => 0.0137, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -40.02% (1.9293 => 1.1572, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.28% (0.4049 => 0.3997, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.26% (0.1510 => 0.1506, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.10% (0.0978 => 0.1067, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0590 => 0.0546, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.15% (1.1617 => 1.1483, std.dev.: 0.1015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7437 => 0.7408, std.dev.: 0.0048) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.87% (0.0092 => 0.0036, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7493, std.dev.: 0.0400) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 03:44:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 05:44:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116114446.8061E2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7645?compare_to=7641&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7645, Order: 172601, Start Time: 2013-01-16 09:32:40, End Time: 2013-01-16 11:44:51 To: 7641, Order: 172598, Start Time: 2013-01-16 06:47:01, End Time: 2013-01-16 09:02:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (220 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.93% (0.6243 => 0.6613, std.dev.: 0.0082) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.41% (0.0675 => 0.0652, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8402 => 499.8391, std.dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.77% (1.1277 => 499.8391, std.dev.: 0.0122) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.97% (0.5229 => 1.6679, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 21.40% (14.9895 => 18.1976, std.dev.: 0.0306) MultiSource/Applications/kimwitu++/kc: 43.56% (14.1553 => 20.3208, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 18.56% (4.1105 => 4.8734, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.95% (1.1048 => 1.7892, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.89% (7.1582 => 38.6465, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.46% (3.4629 => 6.3875, std.dev.: 0.0239) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.25% (0.6222 => 1.0842, std.dev.: 0.0067) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.61% (0.0720 => 7.4474, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11138700.00% (0.0001 => 11.1388, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487900.00% (0.0001 => 5.4880, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.50% (1.1194 => 10.3824, std.dev.: 0.0492) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 151.66% (22.1758 => 55.8070, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 92.18% (0.0243 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 72.73% (0.1463 => 0.2527, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 66.62% (21.9371 => 36.5526, std.dev.: 0.0342) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.55% (7.0540 => 11.1844, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.20% (2.9384 => 4.6191, std.dev.: 0.0038) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 51.99% (0.1056 => 0.1605, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.98% (1.5859 => 2.3944, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.35% (8.1363 => 12.2331, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.22% (2.2024 => 3.1102, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.77% (0.0439 => 0.0618, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 40.11% (0.3109 => 0.4356, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 39.32% (0.1432 => 0.1995, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0011) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.25% (1.5415 => 2.0849, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.49% (4.2646 => 5.7353, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.82% (0.4615 => 0.6176, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.22% (0.2271 => 0.2980, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.08% (0.1892 => 0.2480, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.00% (0.2700 => 0.3537, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 30.64% (0.1175 => 0.1535, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 30.62% (1.1642 => 1.5207, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 30.57% (0.4299 => 0.5613, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.45% (0.6675 => 0.8641, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 27.96% (9.4845 => 12.1366, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.93% (0.5105 => 0.6531, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 27.45% (0.2554 => 0.3255, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 26.59% (1.0722 => 1.3573, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 26.53% (0.1655 => 0.2094, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.93% (3.8922 => 4.9014, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.87% (0.1906 => 0.2399, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.15% (1.4186 => 1.7754, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.39% (0.1566 => 0.1948, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.32% (0.3121 => 0.3880, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 23.35% (5.7591 => 7.1038, std.dev.: 0.0034) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.27% (0.1143 => 0.1409, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 22.92% (0.4289 => 0.5272, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.76% (0.0457 => 0.0561, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.64% (0.7115 => 0.8726, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.43% (4.9449 => 6.0541, std.dev.: 0.0147) MultiSource/Applications/viterbi/viterbi: 22.32% (0.1555 => 0.1902, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 22.08% (0.4620 => 0.5640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 21.70% (3.3354 => 4.0593, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.64% (5.0018 => 6.0844, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.58% (0.0871 => 0.1059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.33% (1.3050 => 1.5834, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.94% (0.1695 => 0.2050, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 20.88% (0.3098 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 20.77% (0.7835 => 0.9462, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.74% (0.1032 => 0.1246, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.46% (0.1940 => 0.2337, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.45% (0.8172 => 0.9843, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 20.20% (0.0614 => 0.0738, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.14% (0.5860 => 0.7040, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0886 => 0.1058, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.31% (0.0953 => 0.1137, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.27% (0.6456 => 0.7700, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.93% (0.1268 => 0.1508, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 18.84% (0.3423 => 0.4068, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.81% (0.1510 => 0.1794, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.57% (0.5569 => 0.6603, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.55% (0.5020 => 0.5951, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.31% (0.2758 => 0.3263, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 17.97% (3.8723 => 4.5681, std.dev.: 0.0167) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.94% (0.2107 => 0.2485, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 17.73% (1.1840 => 1.3939, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.73% (0.9765 => 1.1496, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 17.66% (0.7433 => 0.8746, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 17.48% (0.0818 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 17.34% (2.0273 => 2.3789, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.21% (0.3307 => 0.3876, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.20% (0.8101 => 0.9494, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.13% (0.6450 => 0.7555, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 16.98% (0.3387 => 0.3962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.90% (0.5981 => 0.6992, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 16.57% (0.3180 => 0.3707, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.48% (2.2969 => 2.6754, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.47% (0.8067 => 0.9396, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.10% (0.3441 => 0.3995, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 15.92% (10.3673 => 12.0180, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.78% (1.1861 => 1.3733, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/football/football: 15.03% (0.8921 => 1.0262, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 14.50% (0.3283 => 0.3759, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 14.08% (0.3232 => 0.3687, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.95% (0.2603 => 0.2966, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.64% (1.5603 => 1.7731, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 13.61% (17.1811 => 19.5202, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.11% (14.3668 => 16.2501, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 12.87% (0.3092 => 0.3490, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 12.61% (0.3379 => 0.3805, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.26% (0.3427 => 0.3847, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.95% (0.3865 => 0.4327, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.88% (0.3282 => 0.3672, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.45% (0.4636 => 0.5167, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.09% (0.4103 => 0.4558, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.95% (0.3828 => 0.4247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.83% (0.4203 => 0.4658, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.61% (0.3543 => 0.3919, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.60% (0.3473 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.42% (0.4048 => 0.4470, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3422 => 0.3765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.91% (0.3603 => 0.3960, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.88% (0.3826 => 0.4204, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 9.85% (63.2438 => 69.4747, std.dev.: 0.0707) SingleSource/Benchmarks/Shootout-C++/lists1: 9.69% (0.3684 => 0.4041, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.4064 => 0.4433, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.42% (0.4879 => 0.5290, std.dev.: 0.0056) SingleSource/UnitTests/ObjC++/property-reference-object: 8.28% (0.6030 => 0.6529, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 8.02% (0.2831 => 0.3058, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7326 => 0.7904, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.72% (2.0665 => 2.2261, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3721, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.62% (7.9617 => 8.5687, std.dev.: 0.0123) MultiSource/Applications/hexxagon/hexxagon: 7.53% (1.2842 => 1.3809, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 7.35% (0.2871 => 0.3082, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.24% (0.3935 => 0.4220, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.09% (0.2877 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.75% (0.2872 => 0.3066, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2905 => 0.3100, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.64% (0.2891 => 0.3083, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.44% (0.2266 => 0.2412, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 6.21% (0.2802 => 0.2976, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.19% (0.2793 => 0.2966, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 6.09% (0.2725 => 0.2891, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.06% (0.3136 => 0.3326, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2459, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4595, std.dev.: 0.0080) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.68% (0.4162 => 0.4315, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.12% (0.9957 => 1.0268, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9160, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (3.6395 => 3.7247, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2836, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2837, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5830, std.dev.: 0.0074) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4538, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.44% (6.6874 => 0.1709, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.94% (5.2763 => 1.2169, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.61% (5.3855 => 4.4907, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.29% (5.3526 => 4.4806, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -10.67% (10.4361 => 9.3223, std.dev.: 0.0287) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9643, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.55% (1.7609 => 1.6279, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.22% (1.9577 => 0.6613, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.13% (8.0499 => 5.3026, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4248, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8645, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.79% (2.5528 => 2.1243, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4924, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2855, std.dev.: 0.0745) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7062, std.dev.: 0.0173) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.00% (1.2373 => 1.1631, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7052, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -5.00% (1.5835 => 1.5043, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -4.60% (10.2830 => 9.8095, std.dev.: 0.0131) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.01% (3.6994 => 3.6251, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary3: -1.83% (3.7221 => 3.6540, std.dev.: 0.0035) MultiSource/Benchmarks/sim/sim: -1.82% (5.0483 => 4.9562, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3281, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2330, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0031) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 04:12:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 06:12:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116121236.3796F2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7646?compare_to=7643&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7646, Order: 172602, Start Time: 2013-01-16 10:38:22, End Time: 2013-01-16 12:12:42 To: 7643, Order: 172601, Start Time: 2013-01-16 08:40:43, End Time: 2013-01-16 10:14:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (108 on baseline) Performance Improvements: 1 (123 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (2.7196 => 2.7531, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.59% (1.2605 => 1.2931, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.66% (3.8217 => 3.7583, std.dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 84.64% (0.0280 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.95% (0.0717 => 0.1197, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.22% (0.0974 => 0.1580) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.75% (0.1132 => 0.1548, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.73% (0.0599 => 0.0819, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.11% (0.6395 => 0.8704, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.37% (0.6395 => 0.8593, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.68% (0.6260 => 0.8306, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.20% (0.5805 => 0.7616, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.19% (0.5688 => 0.7462, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.98% (0.5456 => 0.7146, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.48% (0.6230 => 0.8129, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.42% (0.5849 => 0.7628, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.21% (0.5941 => 0.7736, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.19% (0.5575 => 0.7258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.16% (0.5567 => 0.7246, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.94% (0.5581 => 0.7252, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.49% (0.5802 => 0.7513, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.29% (0.6033 => 0.7800, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.11% (0.5705 => 0.7366, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.78% (0.5859 => 0.7545, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.59% (0.6440 => 0.8281, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.48% (0.5569 => 0.7155, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.46% (0.5570 => 0.7155, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.44% (0.5478 => 0.7036, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.38% (0.5857 => 0.7519, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.25% (0.5925 => 0.7599, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.05% (0.5591 => 0.7159, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.88% (0.6676 => 0.8537, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.59% (1.6474 => 2.1020, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.36% (0.6052 => 0.7708, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.16% (0.6189 => 0.7870, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.98% (0.5863 => 0.7445, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.90% (0.6446 => 0.8180, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.84% (0.6304 => 0.7996, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.73% (0.6681 => 0.8400, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.35% (0.6194 => 0.7764, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.20% (0.6297 => 0.7884, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.20% (0.6660 => 0.8338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.52% (0.6667 => 0.8235, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.67% (0.7524 => 0.9230, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.89% (2.2587 => 2.7531, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.47% (0.7339 => 0.8915, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.34% (1.1450 => 1.3436, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3357 => 0.3847, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.73% (1.6364 => 1.8447, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.52% (4.5069 => 5.0710, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.31% (0.1982 => 0.2226, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.86% (0.4916 => 0.5499, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 11.61% (0.4515 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.59% (3.5339 => 3.9083, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2385 => 0.2616, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.23% (9.2283 => 10.0801, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0116) MultiSource/Applications/Burg/burg: 8.41% (1.2515 => 1.3567, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.32% (1.4642 => 1.5714, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.30% (0.5329 => 0.5718, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.28% (1.2784 => 1.3715, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.55% (0.1879 => 0.2002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4524 => 0.4820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.33% (0.4861 => 0.5120, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.88% (0.3834 => 0.4021, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.39% (1.3864 => 1.4334, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 3.37% (5.0226 => 5.1919, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (5.4682 => 5.6315, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 2.62% (3.5154 => 3.6075, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.50% (22.4056 => 22.9647, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6750 => 0.6906, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.14% (0.8418 => 0.8598, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.93% (0.7447 => 0.7591, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.77% (15.5079 => 15.7821, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3722 => 1.3926, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: 1.40% (16.1920 => 16.4182, std.dev.: 0.0169) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (0.9557 => 0.9671, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.8161 => 4.8679, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.37% (31.3723 => 55.6452, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3690, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5359, std.dev.: 0.0621) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6056, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (5.1955 => 5.2760, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2065, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3489 => 10.4660, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.48% (0.1431 => 0.1324, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.98% (0.3194 => 0.2971, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.12% (0.2871 => 0.2724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.10% (0.3057 => 0.2901, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.06% (0.3812 => 0.3619, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.06% (0.3323 => 0.3155, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.03% (0.2903 => 0.2757, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.96% (0.3831 => 0.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.90% (0.3205 => 0.3048, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.90% (0.3880 => 0.3690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.85% (0.3896 => 0.3707, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.84% (0.3059 => 0.2911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.81% (0.4033 => 0.3839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.80% (2.1713 => 2.0671, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.78% (0.3891 => 0.3705, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.73% (0.2939 => 0.2800, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.55% (0.3252 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.46% (0.9852 => 0.9413, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: -4.42% (0.2989 => 0.2857, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: -4.32% (0.2849 => 0.2726, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -4.30% (1.3148 => 1.2582, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.22% (0.6347 => 0.6079, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.13% (0.3025 => 0.2900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.11% (0.7779 => 0.7459, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.93% (0.6441 => 0.6188, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.74% (0.4280 => 0.4120, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -3.67% (0.3621 => 0.3488, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.61% (0.4151 => 0.4001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3867 => 0.3731, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.46% (0.3931 => 0.3795, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -3.30% (0.4248 => 0.4108, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.29% (2.4924 => 2.4105, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.28% (0.4427 => 0.4282, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.22% (0.3849 => 0.3725, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -3.17% (0.3788 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.9542 => 0.9242, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.03% (0.4321 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.83% (0.4813 => 0.4677, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.81% (0.7198 => 0.6996, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1921, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.77% (0.4083 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.30% (0.7919 => 0.7737, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.95% (1.0544 => 1.0338, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.71% (1.2210 => 1.2001, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: -1.69% (0.9179 => 0.9024, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.58% (1.2221 => 1.2028, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: -1.54% (4.3330 => 4.2661, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.21% (14.2083 => 14.0357, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.73% (1.8100 => 0.7108, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3120, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.68% (1.3643 => 1.0276, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0267, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2084, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1294, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (7.9763 => 7.7902, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1180, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -2.10% (3.7241 => 3.6458, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.41% (7.3040 => 7.2007, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.36% (1.6086 => 1.5868, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.13% (1.6307 => 1.6122, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 05:13:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 07:13:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116131346.F31702A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7647?compare_to=7644&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7647, Order: 172604, Start Time: 2013-01-16 11:13:01, End Time: 2013-01-16 13:13:55 To: 7644, Order: 172601, Start Time: 2013-01-16 08:56:20, End Time: 2013-01-16 10:54:52 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 4 (6 on baseline) Performance Improvements: 3 (62 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1056 (995 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.71% (0.6227 => 0.6458, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/lua/lua: 2.74% (28.4927 => 29.2725, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.55% (21.9389 => 22.4979, std.dev.: 0.1407) SingleSource/Benchmarks/Shootout/methcall: 1.01% (8.2874 => 8.3714, std.dev.: 0.0243) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -7.15% (2.6172 => 2.4302, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.03% (1.7989 => 1.6725, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.81% (2.1787 => 2.0956, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.21% (1.0951 => 1.1083, std.dev.: 0.0402) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.34% (0.0224 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0337 => 0.0339, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0428 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: 14.44% (0.0180 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 62.04% (0.0137 => 0.0222, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0251 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -23.08% (0.0013 => 0.0010, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1442 => 0.1453, std.dev.: 0.0214) MultiSource/Applications/lemon/lemon: -1.48% (1.1572 => 1.1401, std.dev.: 0.1986) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.45% (0.3997 => 0.4095, std.dev.: 0.0924) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.27% (0.1506 => 0.1510, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.37% (0.1067 => 0.0967, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.70% (0.0276 => 0.0252, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.06% (0.0546 => 0.0590, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.59% (1.1483 => 1.1551, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.72% (0.0029 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0607 => 0.0606, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.14% (0.0318 => 0.0308, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7408 => 0.7414, std.dev.: 0.0017) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 38.89% (0.0036 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.26% (12.7493 => 12.7830, std.dev.: 0.5122) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.21% (0.0336 => 0.0498, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322200.00% (0.0008 => 2.5784, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.51% (1.1825 => 2.4302, std.dev.: 0.0214) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.94% (0.2562 => 0.2868, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/pi: 3.45% (2.1390 => 2.2127, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 3.09% (6.8159 => 7.0264, std.dev.: 0.0738) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.98% (0.0808 => 0.0485, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.09% (0.0727 => 0.0501, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.12% (0.1684 => 0.1261, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.15% (1.0960 => 0.9190, std.dev.: 0.0506) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.57% (1.0986 => 0.9276, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.48% (0.7686 => 0.6496, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.35% (0.1079 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.81% (0.4074 => 0.3593, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: -11.76% (2.4719 => 2.1813, std.dev.: 0.0858) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.32% (1.2154 => 1.0778, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.30% (6.4235 => 5.6975, std.dev.: 0.2200) MultiSource/Applications/lua/lua: -9.66% (4.6406 => 4.1923, std.dev.: 0.0485) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.75% (0.9124 => 0.8417, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.58% (1.1498 => 1.0627, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.57% (0.7693 => 0.7111, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.17% (1.0017 => 0.9299, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.91% (1.6874 => 1.5708, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout-C++/hello: -6.85% (0.1928 => 0.1796, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: -6.56% (0.5134 => 0.4797, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.43% (0.9550 => 0.8936, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.40% (0.5746 => 0.5378, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.20% (0.6885 => 0.6458, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.39% (0.9507 => 0.8995, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.38% (0.9422 => 0.8915, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary: -5.37% (0.2551 => 0.2414, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.17% (0.9127 => 0.8655, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -5.11% (0.9788 => 0.9288, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/methcall: -5.06% (0.2135 => 0.2027, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.04% (0.8990 => 0.8537, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.02% (0.3665 => 0.3481, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: -4.96% (0.3206 => 0.3047, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.91% (0.9512 => 0.9045, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.80% (0.9405 => 0.8954, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.76% (0.9091 => 0.8658, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.72% (1.0052 => 0.9578, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.93% (0.9488 => 0.9115, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sieve: -3.54% (0.2913 => 0.2810, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.39% (0.9855 => 0.9521, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.36% (1.0119 => 0.9779, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.91% (0.9685 => 0.9403, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.84% (0.9061 => 0.8804, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.72% (0.8846 => 0.8605, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.58% (0.8893 => 0.8664, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.49% (0.8732 => 0.8515, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.23% (0.9381 => 0.9172, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.64% (0.9372 => 0.6500, std.dev.: 0.1103) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.75% (0.1164 => 0.1004, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -10.22% (4.5259 => 4.0633, std.dev.: 0.1623) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.58% (0.4081 => 0.3690, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: -9.34% (0.6628 => 0.6009, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.84% (1.4588 => 1.3445, std.dev.: 0.0091) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.58% (0.3217 => 0.2973, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.85% (23.3986 => 22.4979, std.dev.: 0.1407) SingleSource/Benchmarks/Shootout-C++/lists: -3.39% (17.2182 => 16.6343, std.dev.: 0.0486) MultiSource/Applications/sqlite3/sqlite3: -2.79% (4.4730 => 4.3480, std.dev.: 0.0484) SingleSource/Benchmarks/Misc/mandel-2: -2.43% (0.8521 => 0.8314, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: -1.52% (8.6447 => 8.5130, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3162, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.24% (3.1921 => 3.1524, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -1.23% (8.7416 => 8.6339, std.dev.: 0.0402) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.00% (1.2047 => 1.1083, std.dev.: 0.0402) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.04% (0.0445 => 0.0427, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -33.33% (0.0015 => 0.0010, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0214) MultiSource/Applications/lemon/lemon: -40.91% (1.9293 => 1.1401, std.dev.: 0.1986) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.14% (0.4049 => 0.4095, std.dev.: 0.0924) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1510 => 0.1510, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.12% (0.0978 => 0.0967, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -8.70% (0.0276 => 0.0252, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0590 => 0.0590, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1617 => 1.1551, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -56.25% (0.0032 => 0.0014, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.93% (0.0268 => 0.0308, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7437 => 0.7414, std.dev.: 0.0017) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7830, std.dev.: 0.5122) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 05:30:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 07:30:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130116133014.C34782A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7648?compare_to=7642&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7648, Order: 172601, Start Time: 2013-01-16 09:55:22, End Time: 2013-01-16 13:30:20 To: 7642, Order: 172597, Start Time: 2013-01-16 05:13:33, End Time: 2013-01-16 09:04:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (176 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (761 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 10.16% (0.2766 => 0.3047, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.60% (14.0376 => 14.4025, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 2.22% (53.5762 => 54.7654, std.dev.: 0.1031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.98% (2.1648 => 2.2076, std.dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/dry: 1.95% (13.5705 => 13.8357, std.dev.: 0.0351) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.58% (2.3209 => 2.2842, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/fldry: -1.00% (14.3993 => 14.2553, std.dev.: 0.0328) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.88% (0.0625 => 0.0918, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.94% (0.1063 => 0.1445, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.28% (0.2969 => 0.3779, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.78% (0.0547 => 0.0688, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.71% (0.4139 => 0.5203, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.50% (0.1106 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.37% (0.5900 => 0.7397, std.dev.: 0.0332) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.69% (0.4253 => 0.5303, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.55% (0.4994 => 0.6220, std.dev.: 0.0143) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.07% (0.1620 => 0.2010, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.56% (0.5000 => 0.6178, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.53% (0.0714 => 0.0882, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 23.52% (1.5932 => 1.9680, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.0897 => 0.1104, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.40% (0.1107 => 0.1355, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.54% (0.1003 => 0.1219, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.38% (0.1604 => 0.1947, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.30% (0.1549 => 0.1879, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.06% (0.1619 => 0.1960, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.75% (0.3903 => 0.4713, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/power/power: 20.36% (0.0604 => 0.0727, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 19.04% (0.4029 => 0.4796, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.97% (0.3890 => 0.4628, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.75% (0.1088 => 0.1292, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.68% (0.2736 => 0.3247, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.60% (0.1462 => 0.1734, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.56% (0.2866 => 0.3398, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/09-vor/vor: 18.47% (0.1505 => 0.1783, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.42% (1.3152 => 1.5574, std.dev.: 0.0208) SingleSource/UnitTests/ObjC++/Hello: 18.37% (0.5826 => 0.6896, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 17.95% (0.5889 => 0.6946, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 17.93% (1.8794 => 2.2164, std.dev.: 0.0409) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.92% (0.3271 => 0.3857, std.dev.: 0.0110) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.63% (0.0573 => 0.0674, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 17.60% (0.5546 => 0.6522, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.26% (3.5627 => 4.1777, std.dev.: 0.0607) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0048) MultiSource/Applications/hbd/hbd: 17.08% (0.9697 => 1.1353, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.87% (0.1968 => 0.2300, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.80% (1.6211 => 1.8934, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.79% (0.4658 => 0.5440, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: 16.59% (0.1284 => 0.1497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.57% (0.5026 => 0.5859, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.14% (0.2875 => 0.3339, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 16.12% (0.1421 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.89% (2.7292 => 3.1630, std.dev.: 0.0343) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.88% (0.3930 => 0.4554, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.88% (4.4195 => 5.1212, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.85% (1.9694 => 2.2815, std.dev.: 0.0510) SingleSource/UnitTests/ObjC++/property-reference: 15.84% (0.7171 => 0.8307, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.71% (0.4361 => 0.5046, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.66% (0.2911 => 0.3367, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.66% (1.9966 => 2.3093, std.dev.: 0.0484) SingleSource/Benchmarks/Shootout-C++/strcat: 15.60% (0.2750 => 0.3179, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 15.52% (0.2725 => 0.3148, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/except: 15.40% (0.2811 => 0.3244, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.40% (0.2792 => 0.3222, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.40% (0.3488 => 0.4025, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 15.35% (0.3465 => 0.3997, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 15.27% (1.0781 => 1.2427, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 15.25% (0.3004 => 0.3462, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 15.24% (0.3446 => 0.3971, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.23% (0.2738 => 0.3155, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 15.22% (0.2714 => 0.3127, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 15.20% (0.2803 => 0.3229, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3469 => 0.3996, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 15.17% (0.3460 => 0.3985, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 15.11% (0.2813 => 0.3238, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.11% (2.0673 => 2.3796, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.06% (0.2729 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 14.96% (0.2780 => 0.3196, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 14.96% (4.2109 => 4.8408, std.dev.: 0.1025) MultiSource/Applications/hexxagon/hexxagon: 14.88% (0.9909 => 1.1383, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.82% (0.3650 => 0.4191, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 14.78% (0.3267 => 0.3750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.77% (0.3195 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 14.61% (0.3258 => 0.3734, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 14.60% (0.3096 => 0.3548, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.58% (0.3643 => 0.4174, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 14.49% (23.5202 => 26.9294, std.dev.: 0.0939) SingleSource/UnitTests/ObjC/parameter-passing: 14.47% (0.3724 => 0.4263, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.40% (0.3362 => 0.3846, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.38% (0.3060 => 0.3500, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.37% (0.3124 => 0.3573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3317 => 0.3791, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 14.24% (1.4269 => 1.6301, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 13.89% (0.3348 => 0.3813, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3726 => 0.4243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.78% (0.3477 => 0.3956, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.74% (0.3282 => 0.3733, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.68% (0.3625 => 0.4121, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.67% (0.1090 => 0.1239, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 13.62% (0.3678 => 0.4179, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 13.52% (0.2566 => 0.2913, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 13.46% (0.4146 => 0.4704, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 13.46% (0.4251 => 0.4823, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.28% (0.7875 => 0.8921, std.dev.: 0.0185) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.26% (0.3845 => 0.4355, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.26% (0.3981 => 0.4509, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3690 => 0.4176, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 12.57% (0.5012 => 0.5642, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 12.43% (0.2075 => 0.2333, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.06% (0.1028 => 0.1152, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 11.95% (2.1653 => 2.4241, std.dev.: 0.0456) MultiSource/Benchmarks/mafft/pairlocalalign: 11.70% (2.1013 => 2.3472, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.61% (0.6435 => 0.7182, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 11.59% (5.5417 => 6.1842, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 11.58% (4.6177 => 5.1523, std.dev.: 0.0808) MultiSource/Applications/SIBsim4/SIBsim4: 11.52% (0.2691 => 0.3001, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.14% (0.2737 => 0.3042, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.78% (0.2068 => 0.2291, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 10.38% (0.3498 => 0.3861, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.28% (0.3084 => 0.3401, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.04% (0.3336 => 0.3671, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.80% (0.2103 => 0.2309, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.74% (0.5361 => 0.5883, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.51% (0.2040 => 0.2234, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.41% (11.6398 => 12.7348, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 9.39% (0.6634 => 0.7257, std.dev.: 0.0077) MultiSource/Benchmarks/PAQ8p/paq8p: 9.18% (0.4847 => 0.5292, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.89% (0.1383 => 0.1506, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.81% (4.6926 => 5.1061, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.65% (0.7426 => 0.8068, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 7.78% (0.2391 => 0.2577, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 7.40% (2.0346 => 2.1851, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.20% (0.5584 => 0.5986, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 6.55% (11.9555 => 12.7383, std.dev.: 0.0164) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5212, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0092) MultiSource/Applications/ClamAV/clamscan: 8.74% (0.2802 => 0.3047, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.34% (0.3693 => 0.4001, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6114, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2432, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6733, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6838, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-2: 4.45% (1.8057 => 1.8861, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1985, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3081, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2867, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2094, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.16% (4.0317 => 4.0784, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.11% (10.3705 => 10.4852, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5903, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5830, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/fldry: -17.30% (17.2379 => 14.2553, std.dev.: 0.0328) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7914, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: -7.17% (2.1113 => 1.9599, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary2: -6.62% (0.2402 => 0.2243, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2201, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7977, std.dev.: 0.0145) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1601, std.dev.: 0.0827) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0100) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.59% (0.6293 => 0.6193, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -1.51% (14.0481 => 13.8357, std.dev.: 0.0351) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2249, std.dev.: 0.0446) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0487, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 06:10:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 08:10:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116141011.1B03B2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7649?compare_to=7646&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7649, Order: 172607, Start Time: 2013-01-16 12:36:03, End Time: 2013-01-16 14:10:17 To: 7646, Order: 172602, Start Time: 2013-01-16 10:38:22, End Time: 2013-01-16 12:12:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 2 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.26% (2.7531 => 2.7185, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -4.07% (0.7108 => 0.6819, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 84.29% (0.0280 => 0.0516, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.67% (0.0717 => 0.1195, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.01% (0.0974 => 0.1578, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.08% (0.6395 => 0.8702, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.26% (0.6395 => 0.8586, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.54% (0.6260 => 0.8297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.29% (0.5688 => 0.7468, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.14% (0.5456 => 0.7155, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.04% (0.5805 => 0.7607, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.40% (0.5849 => 0.7627, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.37% (0.6230 => 0.8122, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.12% (0.5575 => 0.7254, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.09% (0.5567 => 0.7242, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.01% (0.5581 => 0.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.99% (0.5941 => 0.7723, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.52% (0.5802 => 0.7515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.40% (0.6033 => 0.7807, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.03% (0.5705 => 0.7361, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.44% (0.5857 => 0.7523, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.42% (0.6440 => 0.8270, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.40% (0.5570 => 0.7152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.39% (0.5478 => 0.7033, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.26% (0.5569 => 0.7143, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.24% (0.5925 => 0.7598, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.92% (0.5591 => 0.7152, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.79% (0.6676 => 0.8531, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.69% (1.6474 => 2.1036, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.28% (0.6052 => 0.7703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.07% (0.6446 => 0.8191, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.06% (0.6189 => 0.7864, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.02% (0.5863 => 0.7447, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.51% (0.6304 => 0.7975, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.84% (0.0445 => 0.0560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.31% (0.6194 => 0.7762, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.31% (0.6681 => 0.8372, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.12% (0.6297 => 0.7879, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.11% (0.6660 => 0.8332, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.62% (0.6667 => 0.8242, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.42% (0.7524 => 0.9211, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.54% (0.7339 => 0.8920, std.dev.: 0.0211) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.36% (2.2587 => 2.7185, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 17.40% (1.1450 => 1.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.57% (0.3357 => 0.3846, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.66% (0.1982 => 0.2233, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.55% (1.6364 => 1.8418, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.31% (4.5069 => 5.0616, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.43% (0.4916 => 0.5478, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 11.27% (0.4515 => 0.5024, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.57% (3.5339 => 3.9073, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2385 => 0.2613, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 9.07% (9.2283 => 10.0651, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.72% (0.7021 => 0.7633, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 8.40% (1.2515 => 1.3566, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.21% (0.5329 => 0.5713, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.18% (1.4642 => 1.5694, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.17% (1.2784 => 1.3701, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.16% (0.1731 => 0.1855, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 6.60% (0.1879 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4524 => 0.4802, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 6.08% (0.1761 => 0.1868, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 5.06% (0.4861 => 0.5107, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 4.88% (0.3255 => 0.3414, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 3.66% (5.0226 => 5.2065, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.28% (1.3864 => 1.4319, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.95% (5.4682 => 5.6294, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (22.4056 => 22.9762, std.dev.: 0.0218) MultiSource/Applications/d/make_dparser: 2.50% (3.5154 => 3.6032, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 2.12% (0.6750 => 0.6893, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.75% (0.7447 => 0.7577, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7663, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3722 => 1.3901, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 1.24% (16.1920 => 16.3923, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.46% (31.3723 => 55.6742, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.82% (0.9531 => 1.0276, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1495, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5048, std.dev.: 0.0728) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6050, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2769, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2068, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.62% (0.1431 => 0.1322, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -7.33% (0.3194 => 0.2960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -6.27% (0.3812 => 0.3573, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.21% (0.3831 => 0.3593, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -6.21% (0.3848 => 0.3609, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -6.13% (0.3880 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.04% (0.3891 => 0.3656, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.99% (0.3837 => 0.3607, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: -5.88% (0.4033 => 0.3796, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -5.82% (0.4176 => 0.3933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.69% (0.3884 => 0.3663, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.56% (0.3057 => 0.2887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.54% (0.2871 => 0.2712, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.48% (0.3323 => 0.3141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -5.34% (0.3205 => 0.3034, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -5.31% (0.4199 => 0.3976, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -5.26% (0.3059 => 0.2898, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.22% (2.1713 => 2.0579, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.22% (0.2933 => 0.2780, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -5.04% (0.2939 => 0.2791, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.88% (0.4280 => 0.4071, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.86% (0.3252 => 0.3094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.74% (0.3016 => 0.2873) SingleSource/Benchmarks/Shootout-C++/hello: -4.70% (0.2849 => 0.2715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.70% (0.6347 => 0.6049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -4.56% (0.3025 => 0.2887, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.54% (0.9852 => 0.9405, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -4.51% (1.3148 => 1.2555, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: -4.43% (0.3026 => 0.2892, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists1: -3.93% (0.3867 => 0.3715, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.4151 => 0.3989, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.82% (0.3931 => 0.3781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.76% (0.3621 => 0.3485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -3.65% (0.4248 => 0.4093, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.61% (0.3849 => 0.3710, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -3.54% (0.3788 => 0.3654, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.47% (0.3658 => 0.3531, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.47% (0.4321 => 0.4171, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.39% (0.4427 => 0.4277, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -3.26% (2.4924 => 2.4111, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.26% (0.9542 => 0.9231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.13% (0.4083 => 0.3955, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1585, std.dev.: 0.0231) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.85% (0.4813 => 0.4676, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.46% (0.7198 => 0.7021, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.92% (1.0544 => 1.0342, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.2210 => 1.1987, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -1.73% (0.9179 => 0.9020, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: -1.66% (4.3330 => 4.2612, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (1.2221 => 1.2021, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (0.7982 => 0.7863, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.34% (14.2083 => 14.0181, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.08% (1.2300 => 1.2167, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.33% (1.8100 => 0.6819, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.10% (6.6713 => 3.3954, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -24.81% (1.3643 => 1.0258, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7498, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0341, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1274, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3388, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1701, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7584, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1177, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6434, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4717, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1967, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6084, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5903, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 06:26:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 08:26:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116142631.D2BAE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7650?compare_to=7645&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7650, Order: 172605, Start Time: 2013-01-16 12:15:04, End Time: 2013-01-16 14:26:37 To: 7645, Order: 172601, Start Time: 2013-01-16 09:32:40, End Time: 2013-01-16 11:44:51 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.50% (10.3824 => 10.5386, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8391 => 499.7876, std.dev.: 0.0315) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44219.20% (1.1277 => 499.7876, std.dev.: 0.0315) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.88% (0.5229 => 1.6674, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 21.62% (14.9895 => 18.2307, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 43.38% (14.1553 => 20.2958, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 18.14% (4.1105 => 4.8560, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.99% (1.1048 => 1.7897, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.73% (7.1582 => 38.6348, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.41% (3.4629 => 6.3858, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.20% (0.6222 => 1.0839, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10251.94% (0.0720 => 7.4534, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 11145900.00% (0.0001 => 11.1460, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5511800.00% (0.0001 => 5.5119, std.dev.: 0.0262) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 841.45% (1.1194 => 10.5386, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 152.45% (22.1758 => 55.9827, std.dev.: 0.0197) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 91.77% (0.0243 => 0.0466, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.80% (0.1463 => 0.2528, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 66.57% (21.9371 => 36.5409, std.dev.: 0.0085) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.55% (7.0540 => 11.1838, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.10% (2.9384 => 4.6161, std.dev.: 0.0064) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 51.99% (0.1056 => 0.1605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.04% (1.5859 => 2.3953, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.32% (8.1363 => 12.2302, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.36% (2.2024 => 3.1134, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.55% (0.0439 => 0.0617, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.98% (0.3109 => 0.4352, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0003) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.00% (1.5415 => 2.0811, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.71% (4.2646 => 5.7447, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.02% (0.4615 => 0.6139, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.22% (0.2700 => 0.3543, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.18% (0.2271 => 0.2979, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.03% (0.1892 => 0.2479, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 30.62% (1.1642 => 1.5207, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 29.96% (0.4299 => 0.5587, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.45% (0.6675 => 0.8641, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 27.98% (9.4845 => 12.1379, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.87% (0.5105 => 0.6528, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813) MultiSource/Benchmarks/McCat/08-main/main: 27.25% (0.2554 => 0.3250, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.46% (1.0722 => 1.3559, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.82% (3.8922 => 4.8973, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.97% (1.4186 => 1.7728, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.71% (0.1906 => 0.2377) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.19% (0.3121 => 0.3876, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.33% (5.7591 => 7.1028, std.dev.: 0.0032) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.10% (0.1143 => 0.1407, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.76% (0.0457 => 0.0561, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 22.76% (0.4289 => 0.5265, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 22.68% (0.7115 => 0.8729, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.60% (0.1695 => 0.2078, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 22.52% (0.0626 => 0.0767, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.35% (4.9449 => 6.0501, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 22.25% (0.1555 => 0.1901, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.75% (0.4620 => 0.5625, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 21.68% (3.3354 => 4.0585, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.58% (0.0871 => 0.1059, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.58% (5.0018 => 6.0812, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.17% (1.3050 => 1.5813, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.00% (0.1695 => 0.2051, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815) MultiSource/Applications/spiff/spiff: 20.71% (0.7835 => 0.9458, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 20.56% (0.3098 => 0.3735, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.36% (0.1940 => 0.2335, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.22% (0.5860 => 0.7045, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.79% (0.8172 => 0.9789, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.41% (0.0953 => 0.1138) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 19.19% (0.6456 => 0.7695, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.87% (0.1510 => 0.1795, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: 18.69% (0.1268 => 0.1505, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.52% (0.3423 => 0.4057, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.47% (0.5020 => 0.5947, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.08% (0.2107 => 0.2488, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 18.01% (3.8723 => 4.5698, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.83% (1.1840 => 1.3951, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: 17.75% (0.7433 => 0.8752, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.62% (0.9765 => 1.1486, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.60% (0.5569 => 0.6549, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 17.48% (0.0818 => 0.0961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.22% (2.0273 => 2.3764, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.21% (0.3307 => 0.3876, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.16% (0.6450 => 0.7557, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.04% (0.5981 => 0.7000, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.84% (0.2049 => 0.2394, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.84% (0.8101 => 0.9465, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 16.68% (0.3387 => 0.3952, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 16.57% (0.3180 => 0.3707, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.44% (2.2969 => 2.6746, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.14% (1.1861 => 1.3775, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.09% (0.8067 => 0.9365, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 16.08% (10.3673 => 12.0343, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.21% (0.8921 => 1.0278, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.53% (0.3283 => 0.3760, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 13.99% (0.3232 => 0.3684, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.95% (0.2603 => 0.2966, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.77% (1.5603 => 1.7751, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 13.70% (17.1811 => 19.5350, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.02% (14.3668 => 16.2375, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/bh/bh: 12.84% (0.3092 => 0.3489, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 12.52% (0.3379 => 0.3802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.20% (0.3427 => 0.3845, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.03% (0.3865 => 0.4330, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.97% (0.3282 => 0.3675, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.82% (0.4636 => 0.5184, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/parameter-passing: 11.56% (0.3927 => 0.4381, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.4103 => 0.4547, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4203 => 0.4653, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 10.18% (0.4048 => 0.4460, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 9.96% (0.3422 => 0.3763, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.88% (0.3826 => 0.4204, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 9.83% (0.3603 => 0.3957, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.79% (63.2438 => 69.4341, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/lists1: 9.66% (0.3684 => 0.4040, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.86% (0.4064 => 0.4424, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.32% (0.4879 => 0.5285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 7.77% (0.2831 => 0.3051, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.74% (2.2022 => 2.3727, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.70% (0.7326 => 0.7890, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.57% (2.0665 => 2.2229, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.41% (7.9617 => 8.5517, std.dev.: 0.0060) MultiSource/Applications/hexxagon/hexxagon: 7.40% (1.2842 => 1.3792, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.26% (0.3650 => 0.3915, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.05% (0.3162 => 0.3385, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.04% (0.2871 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.88% (0.2877 => 0.3075, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 6.57% (0.2905 => 0.3096, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.43% (0.2891 => 0.3077, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.40% (0.2266 => 0.2411, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.34% (0.2872 => 0.3054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.17% (0.2756 => 0.2926, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 6.06% (0.3052 => 0.3237, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 5.98% (0.2725 => 0.2888, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.98% (0.2793 => 0.2960, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 5.86% (0.2714 => 0.2873, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2445, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4434, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3138, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.72% (0.9957 => 1.0327, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.57% (3.6395 => 3.7330, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.6802 => 8.9029, std.dev.: 0.0139) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.82% (9.1159 => 9.2816, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2837, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1704, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -76.94% (5.2763 => 1.2168, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.17% (0.8651 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.60% (5.3855 => 4.4914, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.28% (5.3526 => 4.4814, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -10.73% (10.4361 => 9.3164, std.dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: -7.73% (54.1659 => 49.9770, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.59% (1.7609 => 1.6273, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.08% (1.9577 => 0.6641, std.dev.: 0.0069) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0499 => 5.3095, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -33.53% (1.5373 => 1.0218, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4245, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8607, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0071, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3243, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4233, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7322, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.23% (9.5636 => 8.4899, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2701, std.dev.: 0.0880) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.78% (1.2373 => 1.1534, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7073, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.95% (0.4808 => 0.4570, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5095, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.43% (10.2830 => 9.8275, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.65% (3.6994 => 3.6382, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7221 => 3.6709, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0002) Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 07:36:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 09:36:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116153607.065BE2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7651?compare_to=7647&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7651, Order: 172608, Start Time: 2013-01-16 13:32:10, End Time: 2013-01-16 15:36:14 To: 7647, Order: 172604, Start Time: 2013-01-16 11:13:01, End Time: 2013-01-16 13:13:55 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 2 (5 on baseline) Performance Improvements: 2 (33 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1059 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 32.98% (38.7039 => 51.4669, std.dev.: 0.7244) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.41% (1.4592 => 1.8738, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -6.38% (5.9098 => 5.5327, std.dev.: 0.0748) MultiSource/Applications/lua/lua: -2.70% (29.2725 => 28.4835, std.dev.: 0.3013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.09% (1.1083 => 1.1204, std.dev.: 0.0819) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.36% (0.0221 => 0.0224, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.70% (0.0429 => 0.0432, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.47% (0.0339 => 0.0334, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0319 => 0.0322, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0427 => 0.0427, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/test1: -0.90% (0.0222 => 0.0220, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 30.00% (0.0010 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.17% (0.1453 => 0.1499, std.dev.: 0.0230) MultiSource/Applications/lemon/lemon: 1.22% (1.1401 => 1.1540, std.dev.: 0.3208) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.30% (0.4095 => 0.3960, std.dev.: 0.1627) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1510 => 0.1528, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.79% (0.0967 => 0.0994, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.92% (0.0252 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.83% (0.0590 => 0.0532, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.75% (1.1551 => 1.1464, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 7.14% (0.0014 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.53% (0.0606 => 0.0524, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.27% (0.0308 => 0.0315, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.25% (0.7414 => 0.7321, std.dev.: 0.0325) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.00% (0.0050 => 0.0055, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7830 => 12.8006, std.dev.: 0.4574) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321200.00% (0.0008 => 2.5704, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.29% (1.1825 => 2.3329, std.dev.: 0.0433) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.35% (3.7074 => 4.0541, std.dev.: 0.0665) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2159, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (63.1520 => 64.0678, std.dev.: 0.3316) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.39% (0.0808 => 0.0514, std.dev.: 0.0102) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.33% (0.1009 => 0.0814, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: -18.83% (1.8964 => 1.5393, std.dev.: 0.1371) MultiSource/Applications/aha/aha: -11.39% (0.1378 => 0.1221, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: -11.09% (2.4719 => 2.1977, std.dev.: 0.0944) MultiSource/Applications/lua/lua: -10.49% (4.6406 => 4.1538, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.97% (1.0017 => 0.9319, std.dev.: 0.0213) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.1610 => 0.1506, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -6.17% (0.1928 => 0.1809, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.74% (0.2283 => 0.2152, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: -5.62% (0.2385 => 0.2251, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.62% (0.1798 => 0.1697, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.23% (0.2618 => 0.2481, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.72% (0.9405 => 0.8961, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists1: -4.52% (0.3206 => 0.3061, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.48% (1.8127 => 1.7315, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.15% (0.9993 => 0.9578, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -3.74% (0.2725 => 0.2623, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.67% (1.0234 => 0.9858, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.45% (0.8732 => 0.8518, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.14% (0.8926 => 0.8735, std.dev.: 0.0064) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.00% (0.9372 => 0.6467, std.dev.: 0.0707) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.36% (1.5623 => 1.2599, std.dev.: 0.0287) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.84% (1.4235 => 1.2549, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -11.20% (1.4588 => 1.2954, std.dev.: 0.0285) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.86% (0.4081 => 0.3638, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.34% (0.3217 => 0.2981, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: -6.32% (0.3654 => 0.3423, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.81% (0.6628 => 0.6243, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.99% (0.3349 => 0.3182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: -3.26% (17.2182 => 16.6575, std.dev.: 0.0930) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.42% (0.5826 => 0.5685, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.11% (3.1921 => 3.1568, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.00% (1.2047 => 1.1204, std.dev.: 0.0819) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.04% (0.0445 => 0.0427, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0048) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.03% (0.1530 => 0.1499, std.dev.: 0.0230) MultiSource/Applications/lemon/lemon: -40.19% (1.9293 => 1.1540, std.dev.: 0.3208) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.20% (0.4049 => 0.3960, std.dev.: 0.1627) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.19% (0.1510 => 0.1528, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.83% (0.0590 => 0.0532, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.32% (1.1617 => 1.1464, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.12% (0.0032 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.10% (0.0610 => 0.0524, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.54% (0.0268 => 0.0315, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.56% (0.7437 => 0.7321, std.dev.: 0.0325) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.22% (0.0092 => 0.0055, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.18% (12.7781 => 12.8006, std.dev.: 0.4574) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 08:07:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 10:07:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116160746.C90E02A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7652?compare_to=7649&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7652, Order: 172612, Start Time: 2013-01-16 14:33:33, End Time: 2013-01-16 16:07:53 To: 7649, Order: 172607, Start Time: 2013-01-16 12:36:03, End Time: 2013-01-16 14:10:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.69% (79.9651 => 81.3127, std.dev.: 0.3370) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.75% (0.0974 => 0.1556, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.08% (0.6395 => 0.8702, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.25% (0.6395 => 0.8585, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.38% (0.6260 => 0.8287, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.34% (0.5805 => 0.7624, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.28% (0.5688 => 0.7467, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.92% (0.5456 => 0.7143, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.47% (0.6230 => 0.8128, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.33% (0.5849 => 0.7623, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.19% (0.5575 => 0.7258, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.15% (0.5941 => 0.7732, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.02% (0.5567 => 0.7238, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.85% (0.5581 => 0.7247, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.40% (0.5802 => 0.7508, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.32% (0.6033 => 0.7802, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.94% (0.5705 => 0.7356, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.74% (0.5859 => 0.7543, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.42% (0.5478 => 0.7035, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.42% (0.6440 => 0.8270, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.37% (0.5570 => 0.7150, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.31% (0.5857 => 0.7515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.14% (0.5925 => 0.7592, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.10% (0.5569 => 0.7134, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.96% (0.5591 => 0.7154, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.74% (0.6676 => 0.8528, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.52% (1.6474 => 2.1008, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.26% (0.6052 => 0.7702, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.08% (0.6189 => 0.7865, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.93% (0.6446 => 0.8182, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.91% (0.5863 => 0.7441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.44% (0.6304 => 0.7971, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.77% (0.6681 => 0.8403, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.35% (0.6194 => 0.7764, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.14% (0.6297 => 0.7880, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.94% (0.6660 => 0.8321, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.56% (0.6667 => 0.8238, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.36% (0.7524 => 0.9206, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.54% (0.7339 => 0.8920, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.52% (2.2587 => 2.7222, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 17.38% (1.1450 => 1.3440, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.13% (0.3834 => 0.4414, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.56% (1.6364 => 1.8420, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (4.5069 => 5.0665, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: 11.78% (0.4515 => 0.5047, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.57% (0.4916 => 0.5485, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.60% (3.5339 => 3.9086, std.dev.: 0.0138) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.01% (9.2283 => 10.0596, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.69% (0.7021 => 0.7631, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.36% (1.2515 => 1.3561, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.19% (0.5329 => 0.5712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4642 => 1.5688, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.00% (1.2784 => 1.3679, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.90% (0.2001 => 0.2139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.4524 => 0.4787, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.02% (0.4861 => 0.5105, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 3.73% (5.0226 => 5.2100, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.3864 => 1.4309, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (5.4682 => 5.6278, std.dev.: 0.0321) MultiSource/Applications/d/make_dparser: 2.64% (3.5154 => 3.6082, std.dev.: 0.0139) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.55% (22.4056 => 22.9761, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/bigfib: 2.22% (0.6750 => 0.6900, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.89% (0.8418 => 0.8577, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 1.79% (15.5079 => 15.7861, std.dev.: 0.0137) MultiSource/Applications/minisat/minisat: 1.79% (0.7447 => 0.7580, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3722 => 1.3892, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 1.21% (16.1920 => 16.3886, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6678, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.68% (0.9531 => 1.0358, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4203, std.dev.: 0.1442) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.00% (79.7170 => 81.3127, std.dev.: 0.3370) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.52% (5.1955 => 5.2744, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2067, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -7.48% (0.3194 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.41% (0.1431 => 0.1325, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.69% (0.3812 => 0.3557, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.60% (0.3848 => 0.3594, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.51% (0.3884 => 0.3631, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -6.50% (0.3831 => 0.3582, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -6.49% (0.3880 => 0.3628, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -6.44% (0.3896 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.40% (0.3891 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -6.32% (0.4033 => 0.3778, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -6.18% (0.4176 => 0.3918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.72% (0.3057 => 0.2882, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -5.64% (0.4199 => 0.3962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -5.61% (0.2871 => 0.2710, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.57% (0.3323 => 0.3138, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.51% (0.2903 => 0.2743, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -5.46% (0.3205 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.44% (0.2849 => 0.2694, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.40% (0.3016 => 0.2853, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: -5.39% (0.3059 => 0.2894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -5.29% (0.3025 => 0.2865, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.29% (2.1713 => 2.0565, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: -5.24% (0.2939 => 0.2785, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.21% (0.4280 => 0.4057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -5.01% (0.6347 => 0.6029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.98% (0.3252 => 0.3090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -4.88% (0.2989 => 0.2843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.77% (0.6441 => 0.6134, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.75% (0.9852 => 0.9384, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.73% (1.3148 => 1.2526, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -4.73% (0.7779 => 0.7411, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.41% (0.4151 => 0.3968, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012) SingleSource/Benchmarks/Shootout-C++/lists: -4.03% (0.3621 => 0.3475, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.88% (0.3867 => 0.3717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.82% (0.3931 => 0.3781, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -3.72% (0.4248 => 0.4090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4427 => 0.4264, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sieve: -3.59% (0.3788 => 0.3652, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.9542 => 0.9212, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.45% (0.4321 => 0.4172, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.32% (0.6484 => 0.6269, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: -3.31% (2.4924 => 2.4099, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.28% (0.3658 => 0.3538, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.91% (0.4813 => 0.4673, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.75% (20.7746 => 20.2025, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.7198 => 0.7013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.27% (0.7919 => 0.7739, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0321, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/football/football: -1.76% (0.9179 => 0.9017, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.76% (1.2210 => 1.1995, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.58% (0.7982 => 0.7856, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.57% (1.2221 => 1.2029, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: -1.46% (4.3330 => 4.2698, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.41% (14.2083 => 14.0080, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.21% (0.9077 => 0.8967, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.09% (1.2300 => 1.2166, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -1.03% (34.0927 => 33.7417, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6950, std.dev.: 0.0197) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.01% (0.6962 => 0.3411, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3095, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -25.29% (1.3643 => 1.0193, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0214, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.85% (1.0217 => 0.8598, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1289, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1773, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7766, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.7241 => 3.6429, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.58% (1.3096 => 1.2889, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1944, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6083, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6011, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -1.26% (3.7092 => 3.6625, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5903, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 09:08:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 11:08:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116170829.DACFC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7653?compare_to=7650&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7653, Order: 172612, Start Time: 2013-01-16 14:56:58, End Time: 2013-01-16 17:08:35 To: 7650, Order: 172605, Start Time: 2013-01-16 12:15:04, End Time: 2013-01-16 14:26:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (221 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1332 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.07% (0.0651 => 0.0671, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7876 => 499.8336, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44223.28% (1.1277 => 499.8336, std.dev.: 0.0094) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.16% (0.5229 => 1.6689, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 21.55% (14.9895 => 18.2195, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: 43.32% (14.1553 => 20.2875, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 18.71% (4.1105 => 4.8797, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.59% (1.1048 => 1.7852, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.09% (7.1582 => 38.6610, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.53% (3.4629 => 6.3901, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.90% (0.6222 => 1.0820, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10252.08% (0.0720 => 7.4535, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11152500.00% (0.0001 => 11.1526, std.dev.: 0.0409) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850400.00% (0.0001 => 9.8505, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5503500.00% (0.0001 => 5.5036, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 841.33% (1.1194 => 10.5373, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 152.48% (22.1758 => 55.9886, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 72.59% (0.1463 => 0.2525, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 69.74% (0.0271 => 0.0460, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 66.27% (21.9371 => 36.4750, std.dev.: 0.0075) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.77% (7.0540 => 11.2700, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.29% (2.9384 => 4.6217, std.dev.: 0.0018) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 51.61% (0.1056 => 0.1601, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.81% (1.5859 => 2.3917, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.25% (8.1363 => 12.2246, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.04% (2.2024 => 3.1062, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 40.43% (0.3109 => 0.4366, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.32% (0.0439 => 0.0616, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.21% (1.5415 => 2.0842, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.53% (4.2646 => 5.7373, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.91% (0.4615 => 0.6134, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 32.00% (0.1175 => 0.1551, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.74% (0.2700 => 0.3557, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.87% (0.2271 => 0.2972, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.76% (0.1892 => 0.2474, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 30.47% (1.1642 => 1.5189, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 29.82% (0.4299 => 0.5581, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.45% (0.6675 => 0.8641, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.03% (0.5105 => 0.6536, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 27.78% (9.4845 => 12.1193, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 27.56% (0.2554 => 0.3258, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.53% (0.1584 => 0.2020, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 26.30% (1.0722 => 1.3542, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 26.22% (0.1655 => 0.2089, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.73% (3.8922 => 4.8938, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.17% (1.4186 => 1.7757, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.00% (0.3121 => 0.3870, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 23.34% (5.7591 => 7.1034, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.25% (0.0770 => 0.0949, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.10% (0.1143 => 0.1407, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.80% (0.0842 => 0.1034, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.59% (0.7115 => 0.8722, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 22.57% (0.4289 => 0.5257, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.23% (4.9449 => 6.0443, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.06% (0.1029 => 0.1256, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 22.01% (0.1163 => 0.1419, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 21.95% (0.1695 => 0.2067, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.67% (0.4620 => 0.5621, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 21.63% (3.3354 => 4.0568, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.46% (5.0018 => 6.0754, std.dev.: 0.0132) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.44% (0.1940 => 0.2356, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.33% (1.3050 => 1.5834, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.84% (0.7835 => 0.9468, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 20.40% (0.3098 => 0.3730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.39% (0.5860 => 0.7055, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.71% (0.8172 => 0.9783, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.21% (0.1510 => 0.1800, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.11% (0.1151 => 0.1371, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 19.11% (0.3423 => 0.4077, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.10% (0.0953 => 0.1135, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 18.99% (0.6456 => 0.7682, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.70% (0.2107 => 0.2501, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 18.62% (0.7433 => 0.8817, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.15% (0.5020 => 0.5931, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 17.93% (3.8723 => 4.5665, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.83% (0.5569 => 0.6562, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 17.75% (1.1840 => 1.3942, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.39% (0.9765 => 1.1463, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.24% (2.0273 => 2.3769, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.05% (0.6450 => 0.7550, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 16.99% (0.0818 => 0.0957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.96% (0.3307 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.77% (0.5981 => 0.6984, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 16.68% (0.3387 => 0.3952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.59% (0.2049 => 0.2389, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.53% (0.8101 => 0.9440, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 16.46% (10.3673 => 12.0738, std.dev.: 0.0171) MultiSource/Applications/siod/siod: 16.46% (2.2969 => 2.6749, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 16.23% (0.3180 => 0.3696, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.77% (1.1861 => 1.3732, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.76% (0.8067 => 0.9338, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/football/football: 15.27% (0.8921 => 1.0283, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 14.22% (0.3283 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 13.74% (0.3232 => 0.3676, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.61% (1.5603 => 1.7726, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 13.50% (17.1811 => 19.5007, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 13.39% (0.3092 => 0.3506, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.97% (14.3668 => 16.2297, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 12.22% (0.3379 => 0.3792, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.11% (0.3427 => 0.3842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.77% (0.3865 => 0.4320, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.63% (0.4636 => 0.5175, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.82% (0.4103 => 0.4547, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 10.74% (0.3828 => 0.4239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.52% (0.4203 => 0.4645, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.31% (0.3561 => 0.3928, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.27% (0.3543 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 10.00% (0.4048 => 0.4453, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 9.69% (63.2438 => 69.3744, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout-C++/lists: 9.67% (0.3422 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 9.52% (0.3603 => 0.3946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 9.39% (0.3684 => 0.4030, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.33% (0.3826 => 0.4183, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.69% (0.4064 => 0.4417, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.47% (0.5925 => 0.6427, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7326 => 0.7927, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.93% (0.4879 => 0.5266, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 7.74% (0.2831 => 0.3050, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.48% (2.0665 => 2.2211, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 7.38% (1.2842 => 1.3790, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 7.36% (0.1440 => 0.1546, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.35% (7.9617 => 8.5470, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.01% (0.3650 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.93% (0.3162 => 0.3381, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.91% (0.3935 => 0.4207, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 6.83% (0.2871 => 0.3067, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 6.78% (0.2877 => 0.3072, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 6.47% (0.2905 => 0.3093, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.35% (0.2266 => 0.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2872 => 0.3051, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.19% (0.2891 => 0.3070, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 6.00% (0.2802 => 0.2970, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.95% (0.2756 => 0.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 5.90% (0.3052 => 0.3232, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.87% (0.2793 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.87% (0.3136 => 0.3320, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 5.69% (0.2725 => 0.2880, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 5.56% (0.2714 => 0.2865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.99% (0.3817 => 0.3931, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2519, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4605, std.dev.: 0.0137) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3128, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0104) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (0.9957 => 1.0283, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9091, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.36% (3.6395 => 3.7253, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2847, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2863, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4507, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1708, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.08% (5.2763 => 1.2092, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.06% (5.3855 => 4.5206, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.67% (5.3526 => 4.5138, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -10.68% (10.4361 => 9.3212, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.80% (1.7609 => 1.6235, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9709, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.78% (1.9577 => 0.6699, std.dev.: 0.0068) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3052, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.75% (1.5373 => 1.0185, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4280, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8692, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0047, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -20.31% (0.2161 => 0.1722, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4918, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2980, std.dev.: 0.1044) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.66% (1.2373 => 1.1549, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7020, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.25% (10.2830 => 9.8461, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9575, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2348, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.17% (0.1485 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.29% (0.2116 => 0.0671, std.dev.: 0.0010) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 09:55:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 11:55:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130116175541.007D92A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7654?compare_to=7648&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7654, Order: 172610, Start Time: 2013-01-16 14:21:45, End Time: 2013-01-16 17:55:47 To: 7648, Order: 172601, Start Time: 2013-01-16 09:55:22, End Time: 2013-01-16 13:30:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.74% (127.8879 => 130.1092, std.dev.: 0.6154) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -3.24% (13.8357 => 13.3869, std.dev.: 0.1286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.80% (0.0625 => 0.0880, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.18% (0.2969 => 0.3776, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.68% (0.1106 => 0.1390, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.61% (0.5900 => 0.7411, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.54% (0.4139 => 0.5196, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.82% (0.0415 => 0.0518, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.15% (0.4994 => 0.6200, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.05% (0.4253 => 0.5276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.83% (0.1620 => 0.2006, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 23.08% (1.5932 => 1.9609, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 23.04% (0.0599 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.52% (0.0897 => 0.1099, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.99% (0.1619 => 0.1975, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.95% (0.1107 => 0.1350) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.65% (0.0642 => 0.0781, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.64% (0.1003 => 0.1220, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.26% (0.1604 => 0.1945, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.17% (0.1549 => 0.1877, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 20.86% (0.0604 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.75% (0.3903 => 0.4713, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.02% (0.2014 => 0.2397, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 18.97% (0.1218 => 0.1449, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.1462 => 0.1739, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 18.94% (0.4029 => 0.4792, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.84% (0.1088 => 0.1293, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 18.44% (0.0808 => 0.0957, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.42% (0.2736 => 0.3240, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.32% (0.2866 => 0.3391, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.30% (0.3890 => 0.4602, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 17.94% (0.5826 => 0.6871, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 17.93% (1.8794 => 2.2164, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.79% (0.3271 => 0.3853, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 17.71% (0.5546 => 0.6528, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 17.60% (0.9697 => 1.1404, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.45% (0.0573 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.25% (1.3152 => 1.5421, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.24% (0.4658 => 0.5461, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.98% (3.5627 => 4.1677, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.90% (0.1160 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.80% (1.6211 => 1.8934, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.38% (0.2875 => 0.3346, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.37% (0.2792 => 0.3249, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 16.36% (0.1284 => 0.1494, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.23% (0.3930 => 0.4568, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.22% (0.2738 => 0.3182, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 16.19% (0.1421 => 0.1651, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.18% (0.2911 => 0.3382, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.10% (0.5026 => 0.5835, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.01% (0.4361 => 0.5059, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 16.00% (0.2750 => 0.3190, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 15.97% (0.2811 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.95% (0.2714 => 0.3147, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.91% (1.9694 => 2.2827, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/random: 15.84% (0.2803 => 0.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 15.82% (0.2725 => 0.3156, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.76% (0.2823 => 0.3268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 15.76% (0.2780 => 0.3218, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.68% (4.4195 => 5.1124, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.67% (2.7292 => 3.1569, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: 15.64% (0.2813 => 0.3253, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 15.62% (0.9909 => 1.1457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.61% (0.2729 => 0.3155, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.55% (0.3004 => 0.3471, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.54% (1.9966 => 2.3068, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.47% (2.0673 => 2.3872, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: 15.47% (0.7171 => 0.8280, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 15.31% (1.0781 => 1.2432, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.31% (0.3195 => 0.3684, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 15.12% (0.3267 => 0.3761, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.03% (0.3060 => 0.3520, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 15.01% (23.5202 => 27.0504, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sieve: 15.00% (0.3726 => 0.4285, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 14.95% (4.2109 => 4.8406, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary: 14.95% (0.3258 => 0.3745, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.92% (0.3124 => 0.3590, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.86% (0.3446 => 0.3958, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 14.82% (0.3496 => 0.4014, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.78% (0.3465 => 0.3977, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.76% (0.3488 => 0.4003, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3317 => 0.3806, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.73% (0.3442 => 0.3949, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.70% (0.3469 => 0.3979, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.63% (0.3362 => 0.3854, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.56% (0.3282 => 0.3760, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 14.43% (0.3348 => 0.3831, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 14.41% (0.3650 => 0.4176, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 14.38% (0.3477 => 0.3977, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 14.37% (1.4269 => 1.6320, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.34% (0.3625 => 0.4145, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.33% (0.3643 => 0.4165, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 14.30% (0.3678 => 0.4204, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 13.94% (0.4146 => 0.4724, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 13.90% (0.7875 => 0.8970, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 13.90% (0.4251 => 0.4842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.85% (0.3690 => 0.4201, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.84% (0.3981 => 0.4532, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.76% (0.1090 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 13.76% (0.2566 => 0.2919, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.64% (0.2068 => 0.2350, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 13.39% (0.5012 => 0.5683, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.3845 => 0.4354, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.18% (0.0804 => 0.0910, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.94% (0.1028 => 0.1161, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.39% (0.6435 => 0.7232, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 12.38% (2.1653 => 2.4333, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 11.86% (5.5417 => 6.1992, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 11.82% (0.2691 => 0.3009, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 11.81% (0.2075 => 0.2320, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 11.66% (4.6177 => 5.1561, std.dev.: 0.0129) MultiSource/Benchmarks/mafft/pairlocalalign: 11.60% (2.1013 => 2.3451, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.29% (0.2737 => 0.3046, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.01% (0.3498 => 0.3883, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.96% (0.3084 => 0.3422, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.51% (0.2103 => 0.2324, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.46% (0.5361 => 0.5922, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 10.16% (0.3336 => 0.3675, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.05% (0.2040 => 0.2245, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.99% (11.6398 => 12.8026, std.dev.: 0.0181) MultiSource/Benchmarks/PAQ8p/paq8p: 9.82% (0.4847 => 0.5323, std.dev.: 0.0082) MultiSource/Applications/siod/siod: 9.77% (0.6634 => 0.7282, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.39% (0.7426 => 0.8123, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.26% (0.1383 => 0.1511, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.20% (4.6926 => 5.1244, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: 8.11% (0.2391 => 0.2585, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 7.82% (2.0346 => 2.1938, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.74% (0.5584 => 0.6016, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 6.70% (11.9555 => 12.7566, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.43% (0.3792 => 0.3998, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.66% (29.0505 => 181.4681, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.72% (0.3693 => 0.4052, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 8.39% (0.2802 => 0.3037, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 5.20% (15.4430 => 16.2456, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6765, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6801, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8879, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1948, std.dev.: 0.0062) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3049, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2089, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5911, std.dev.: 0.0154) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4783, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5913, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -20.89% (3.6262 => 2.8687, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -17.00% (17.2379 => 14.3075, std.dev.: 0.0885) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7988, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.71% (14.0481 => 13.3869, std.dev.: 0.1286) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2215, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8060, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1507, std.dev.: 0.0410) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (105.3826 => 104.2429, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0454, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 09:56:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 11:56:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116175609.1A1FC2A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7655?compare_to=7651&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7655, Order: 172617, Start Time: 2013-01-16 15:53:20, End Time: 2013-01-16 17:56:16 To: 7651, Order: 172608, Start Time: 2013-01-16 13:32:10, End Time: 2013-01-16 15:36:14 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 21 (20 on baseline) Performance Improvements: 2 (51 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1040 (992 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/sumarray: 79.56% (0.0181 => 0.0325, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Queens: 62.73% (0.0432 => 0.0703, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.39% (3.4378 => 3.7261, std.dev.: 0.0218) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.08% (23.8979 => 25.8286, std.dev.: 0.2906) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.80% (5.7070 => 6.1520, std.dev.: 0.0860) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.37% (2.3945 => 2.5471, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.20% (0.3232 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.04% (0.9775 => 1.0268, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/oourafft: 4.90% (0.2165 => 0.2271, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.28% (0.8692 => 0.9064, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.65% (0.3284 => 0.3404, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.01% (4.5570 => 5.7878, std.dev.: 0.1314) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.58% (15.5742 => 17.3771, std.dev.: 0.1743) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.18% (2.2439 => 2.3825, std.dev.: 0.0420) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.67% (2.9436 => 3.1105, std.dev.: 0.0379) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.45% (2.3329 => 2.4367, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: 3.63% (7.0532 => 7.3090, std.dev.: 0.0922) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.03% (1.2165 => 1.2534, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.41% (3.7263 => 3.8162, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.24% (1.2954 => 1.3244, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/methcall: 1.02% (8.6453 => 8.7336, std.dev.: 0.0238) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/strcat: -6.71% (0.1728 => 0.1612, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.58% (3.5770 => 3.5206, std.dev.: 0.0156) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.92% (1.1204 => 1.1101, std.dev.: 0.0410) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.89% (0.0224 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0334 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0322 => 0.0319, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0427 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.98% (0.0205 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -29.55% (0.0220 => 0.0155, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.33% (0.1499 => 0.1464, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -0.17% (1.1540 => 1.1520, std.dev.: 0.1788) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.53% (0.3960 => 0.3981, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.95% (0.1528 => 0.1483, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0994 => 0.0994, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.50% (0.0532 => 0.0540, std.dev.: 0.0143) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1464 => 1.1473, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 26.67% (0.0015 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.98% (0.0524 => 0.0613, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.27% (0.0315 => 0.0319, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.57% (0.7321 => 0.7436, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.73% (0.0055 => 0.0095, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.8006 => 12.7709, std.dev.: 0.0194) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 61.24% (0.0436 => 0.0703, std.dev.: 0.0025) SingleSource/UnitTests/Vector/sumarray: 51.87% (0.0214 => 0.0325, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 48.51% (0.0336 => 0.0499, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.51% (23.5861 => 25.8286, std.dev.: 0.2906) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.06% (0.9867 => 1.0268, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.88% (2.4519 => 2.5471, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.75% (0.3277 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 3.06% (0.3402 => 0.3506, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.66% (3.6295 => 3.7261, std.dev.: 0.0218) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323012.50% (0.0008 => 2.5849, std.dev.: 0.0269) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.06% (1.1825 => 2.4367, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.79% (5.0421 => 5.7878, std.dev.: 0.1314) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.50% (0.2562 => 0.2831, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (1.8123 => 1.9343, std.dev.: 0.0309) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.89% (2.2499 => 2.3825, std.dev.: 0.0420) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.70% (4.1668 => 4.3627, std.dev.: 0.0464) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (16.6791 => 17.3771, std.dev.: 0.1743) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2161, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.40% (3.0082 => 3.1105, std.dev.: 0.0379) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.33% (3.7662 => 3.8162, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.84% (0.0808 => 0.0478, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.91% (0.0727 => 0.0495, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.57% (0.1684 => 0.1287, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -19.76% (1.8964 => 1.5217, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.35% (0.1079 => 0.0881, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.04% (0.1009 => 0.0827, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.05% (0.0862 => 0.0715, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.29% (0.7686 => 0.6434, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.97% (1.0986 => 0.9341, std.dev.: 0.0373) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.24% (0.4074 => 0.3494, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -11.86% (1.1433 => 1.0077, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.05% (0.7693 => 0.6843, std.dev.: 0.0121) MultiSource/Applications/lua/lua: -10.84% (4.6406 => 4.1374, std.dev.: 0.0751) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.53% (1.2154 => 1.0874, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.49% (1.5131 => 1.3544, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.15% (0.1025 => 0.0921, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.52% (0.3560 => 0.3221, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.42% (0.5746 => 0.5205, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.04% (0.9124 => 0.8299, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.02% (0.6885 => 0.6264, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.01% (0.1210 => 0.1101, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.82% (1.1498 => 1.0484, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.72% (10.2703 => 9.3748, std.dev.: 0.2414) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.16% (1.1731 => 1.0774, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.15% (1.6874 => 1.5498, std.dev.: 0.0240) MultiSource/Applications/ClamAV/clamscan: -7.58% (17.4365 => 16.1145, std.dev.: 0.3677) SingleSource/Benchmarks/Shootout-C++/fibo: -6.83% (0.2006 => 0.1869, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: -6.68% (0.5134 => 0.4791, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/hello: -6.33% (0.1928 => 0.1806, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.74% (0.2283 => 0.2152, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.48% (0.2100 => 0.1985, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash: -4.46% (0.4689 => 0.4480, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.23% (6.4235 => 6.1520, std.dev.: 0.0860) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.67% (0.9127 => 0.8792, std.dev.: 0.0098) MultiSource/Applications/minisat/minisat: -3.10% (0.7776 => 0.7535, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.78% (0.9685 => 0.9513, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.22% (0.9372 => 0.6446, std.dev.: 0.1026) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.60% (1.5623 => 1.2717, std.dev.: 0.0183) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.00% (0.1164 => 0.1001, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.76% (1.4235 => 1.2703, std.dev.: 0.0260) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.19% (0.4081 => 0.3665, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.21% (1.4588 => 1.3244, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/hash: -8.63% (4.5259 => 4.1352, std.dev.: 0.1443) SingleSource/Benchmarks/Shootout-C++/lists1: -7.30% (0.6628 => 0.6144, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.06% (1.4446 => 1.3715, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.34% (23.3986 => 22.3833, std.dev.: 0.1791) MultiSource/Applications/spiff/spiff: -2.40% (2.8571 => 2.7885, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ffbench: -1.69% (1.4244 => 1.4003, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.68% (4.4730 => 4.3980, std.dev.: 0.0250) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.30% (3.5669 => 3.5206, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/mandel-2: -1.26% (0.8521 => 0.8414, std.dev.: 0.0002) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.85% (1.2047 => 1.1101, std.dev.: 0.0410) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -31.72% (0.0227 => 0.0155, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.31% (0.1530 => 0.1464, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -40.29% (1.9293 => 1.1520, std.dev.: 0.1788) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.68% (0.4049 => 0.3981, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.79% (0.1510 => 0.1483, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0074) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.47% (0.0590 => 0.0540, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.24% (1.1617 => 1.1473, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.63% (0.0032 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7437 => 0.7436, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.26% (0.0092 => 0.0095, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7781 => 12.7709, std.dev.: 0.0194) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 10:05:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 12:05:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116180545.C61E52A6C066@llvm.org> http://llvm.org/perf/db_default/v4/nts/7656?compare_to=7652&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7656, Order: 172619, Start Time: 2013-01-16 16:31:17, End Time: 2013-01-16 18:05:36 To: 7652, Order: 172612, Start Time: 2013-01-16 14:33:33, End Time: 2013-01-16 16:07:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.05% (1.0358 => 1.0249, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.81% (0.0717 => 0.1196, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.86% (0.0974 => 0.1557, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 51.31% (0.0267 => 0.0404, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.73% (0.0599 => 0.0819, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.20% (0.6395 => 0.8710, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.39% (0.6395 => 0.8594, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.25% (0.5805 => 0.7619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.24% (0.5688 => 0.7465, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.05% (0.5456 => 0.7150, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.64% (0.6230 => 0.8139, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.52% (0.5849 => 0.7634, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.18% (0.5567 => 0.7247, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.16% (0.5941 => 0.7733, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.10% (0.5575 => 0.7253, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.08% (0.5581 => 0.7260, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.61% (0.5802 => 0.7520, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.40% (0.6033 => 0.7807, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.22% (0.5705 => 0.7372, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.86% (0.5859 => 0.7550, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.60% (0.5570 => 0.7163, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.59% (0.6440 => 0.8281, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.52% (0.5925 => 0.7615, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.51% (0.5857 => 0.7527, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.44% (0.5478 => 0.7036, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.35% (0.5569 => 0.7148, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.17% (0.5591 => 0.7166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.06% (0.6676 => 0.8549, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.66% (1.6474 => 2.1031, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.46% (0.6052 => 0.7714, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.12% (0.6446 => 0.8194, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.11% (0.6189 => 0.7867, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.00% (0.5863 => 0.7446, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (0.6304 => 0.7982, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.62% (0.6681 => 0.8393, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.52% (0.6194 => 0.7775, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.31% (0.6297 => 0.7891, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.14% (0.6660 => 0.8334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.70% (0.6667 => 0.8247, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.59% (0.7524 => 0.9224, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.73% (0.7339 => 0.8934, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.55% (2.2587 => 2.7228, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.62% (0.0693 => 0.0829, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.49% (1.1450 => 1.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.27% (0.1146 => 0.1321, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.67% (1.6364 => 1.8437, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.66% (0.1982 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (4.5069 => 5.0667, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 12.15% (0.0864 => 0.0969, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.74% (0.4916 => 0.5493, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 11.36% (0.4515 => 0.5028, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.60% (3.5339 => 3.9085, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.19% (9.2283 => 10.0765, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.75% (0.7021 => 0.7635, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.36% (1.2515 => 1.3561, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.49% (0.5329 => 0.5728, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.40% (1.4642 => 1.5725, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.13% (1.2784 => 1.3696, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.90% (0.2001 => 0.2139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 5.75% (0.4524 => 0.4784, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 5.10% (0.4861 => 0.5109, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 4.76% (0.3255 => 0.3410, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3319 => 0.3452, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: 3.66% (5.0226 => 5.2063, std.dev.: 0.0177) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.3864 => 1.4340, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.89% (5.4682 => 5.6265, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 2.62% (3.5154 => 3.6074, std.dev.: 0.0053) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (22.4056 => 22.9913, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 2.13% (0.6750 => 0.6894, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.94% (0.8418 => 0.8581, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 1.86% (15.5079 => 15.7960, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.37% (1.3722 => 1.3910, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.26% (16.1920 => 16.3963, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.11% (0.9557 => 0.9663, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.38% (31.3723 => 55.6492, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.53% (0.9531 => 1.0249, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5056, std.dev.: 0.1927) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (0.6469 => 0.6639, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6033, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2767, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2053, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -7.17% (0.3194 => 0.2965, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -6.53% (0.3812 => 0.3563, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -6.44% (0.3880 => 0.3630, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -6.42% (0.3831 => 0.3585, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -6.42% (0.3848 => 0.3601, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -6.26% (0.3896 => 0.3652, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -6.22% (0.3891 => 0.3649, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/for-in: -6.17% (0.4033 => 0.3784, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.02% (0.3837 => 0.3606, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -6.01% (0.4176 => 0.3925, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.97% (0.3884 => 0.3652, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2871 => 0.2705, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.66% (0.3057 => 0.2884, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.63% (0.3323 => 0.3136, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -5.51% (0.2849 => 0.2692, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -5.50% (0.4199 => 0.3968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.47% (0.3016 => 0.2851, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.44% (0.2903 => 0.2745, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.42% (0.2933 => 0.2774, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -5.40% (0.3205 => 0.3032, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.25% (2.1713 => 2.0574, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -5.22% (0.3025 => 0.2867, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -5.21% (0.2939 => 0.2786, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -5.13% (0.3059 => 0.2902, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -5.09% (0.3026 => 0.2872, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.07% (0.6347 => 0.6025, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.04% (0.3252 => 0.3088, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -5.02% (0.4280 => 0.4065, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -4.98% (0.2989 => 0.2840, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -4.77% (0.6441 => 0.6134, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.70% (0.7779 => 0.7413, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -4.66% (1.3148 => 1.2535, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.47% (0.9852 => 0.9412, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.46% (0.4151 => 0.3966, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.92% (0.3621 => 0.3479, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: -3.88% (0.3867 => 0.3717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.82% (0.3931 => 0.3781, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.59% (0.3849 => 0.3711, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: -3.53% (0.4248 => 0.4098, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.48% (0.4427 => 0.4273, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: -3.43% (0.3788 => 0.3658, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.32% (0.9542 => 0.9225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.30% (0.6484 => 0.6270, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: -3.26% (0.4813 => 0.4656, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.18% (0.4083 => 0.3953, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -3.16% (2.4924 => 2.4136, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.87% (0.4321 => 0.4197, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.7198 => 0.7013, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2929, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.18% (0.7919 => 0.7746, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.02% (1.0544 => 1.0331, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.72% (1.2221 => 1.2011, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: -1.61% (4.3330 => 4.2634, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.55% (1.2210 => 1.2021, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (0.7982 => 0.7862, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.25% (14.2083 => 14.0300, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5420, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.19% (0.8521 => 0.8420, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.15% (0.9077 => 0.8973, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.11% (34.0927 => 33.7138, std.dev.: 0.0123) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.2300 => 1.2176, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.44% (1.8100 => 0.6798, std.dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.55% (1.3643 => 1.0294, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0060) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0196, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.39% (1.0557 => 1.0199, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7805, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.80% (1.3096 => 1.2860, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.58% (1.6307 => 1.6050, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1958, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4366, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 11:50:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 13:50:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116195014.2DC662A6C067@llvm.org> http://llvm.org/perf/db_default/v4/nts/7657?compare_to=7653&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7657, Order: 172624, Start Time: 2013-01-16 17:38:44, End Time: 2013-01-16 19:50:18 To: 7653, Order: 172612, Start Time: 2013-01-16 14:56:58, End Time: 2013-01-16 17:08:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.62% (10.5373 => 10.3665, std.dev.: 0.0187) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1334 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.83% (0.0671 => 0.0652, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8336 => 499.8593, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.56% (1.1277 => 499.8593, std.dev.: 0.0004) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.28% (0.5229 => 1.6695, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 21.36% (14.9895 => 18.1906, std.dev.: 0.0202) MultiSource/Applications/kimwitu++/kc: 43.64% (14.1553 => 20.3326, std.dev.: 0.0096) MultiSource/Benchmarks/MallocBench/gs/gs: 18.38% (4.1105 => 4.8661, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.31% (1.1048 => 1.7822, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.20% (7.1582 => 38.5968, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.59% (3.4629 => 6.3920, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.27% (0.6222 => 1.0843, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.64% (0.0720 => 7.4467, std.dev.: 0.0121) MultiSource/Applications/SIBsim4/SIBsim4: 3834900.00% (0.0001 => 3.8350, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11151400.00% (0.0001 => 11.1515, std.dev.: 0.0601) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487300.00% (0.0001 => 5.4874, std.dev.: 0.0031) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.08% (1.1194 => 10.3665, std.dev.: 0.0187) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.31% (22.1758 => 55.5092, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.53% (0.0929 => 0.1770, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.39% (0.1463 => 0.2522, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 69.74% (0.0271 => 0.0460, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 66.19% (21.9371 => 36.4570, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.27% (7.0540 => 11.1642, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.03% (2.9384 => 4.6143, std.dev.: 0.0012) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 51.04% (0.1056 => 0.1595, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.71% (1.5859 => 2.3901, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.81% (8.1363 => 12.1892, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.65% (0.0439 => 0.0635, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.86% (2.2024 => 3.1022, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 40.24% (0.3109 => 0.4360, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.04% (1.5415 => 2.0816, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.22% (4.2646 => 5.7239, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.91% (0.4615 => 0.6134, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.04% (0.2700 => 0.3538, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.87% (0.1892 => 0.2476, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 30.57% (1.1642 => 1.5201, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.27% (0.0479 => 0.0624, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 29.77% (0.4299 => 0.5579, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.35% (0.6675 => 0.8634, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 27.76% (9.4845 => 12.1171, std.dev.: 0.0034) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.38% (0.5105 => 0.6503, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.11% (0.1125 => 0.1430, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 27.09% (0.2554 => 0.3246, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.39% (1.0722 => 1.3552, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 26.22% (0.1655 => 0.2089, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.60% (3.8922 => 4.8885, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.76% (0.1143 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.75% (1.4186 => 1.7697, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.03% (0.3121 => 0.3871, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 23.01% (0.4289 => 0.5276, std.dev.: 0.0078) MultiSource/Applications/oggenc/oggenc: 22.92% (5.7591 => 7.0789, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 22.60% (0.7115 => 0.8723, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/lists: 22.52% (0.0626 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.21% (4.9449 => 6.0432, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 21.71% (0.4620 => 0.5623, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 21.68% (3.3354 => 4.0586, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.25% (5.0018 => 6.0645, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 21.12% (0.1695 => 0.2053, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 20.85% (0.3098 => 0.3744, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.82% (0.7835 => 0.9466, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.77% (1.3050 => 1.5760, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.67% (0.1940 => 0.2341, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.12% (0.5860 => 0.7039, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.76% (0.8172 => 0.9787, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 19.35% (0.6456 => 0.7705, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 19.32% (0.0818 => 0.0976, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.99% (0.0953 => 0.1134, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.82% (0.7433 => 0.8832, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.65% (0.5020 => 0.5956, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.54% (0.1510 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.45% (0.1268 => 0.1502, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.29% (0.3423 => 0.4049, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.88% (3.8723 => 4.5646, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 17.50% (1.1840 => 1.3912, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.39% (0.9765 => 1.1463, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.33% (0.5569 => 0.6534, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.18% (0.3307 => 0.3875, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 17.13% (2.0273 => 2.3745, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 16.95% (2.2969 => 2.6863, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.76% (0.6450 => 0.7531, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.74% (0.5981 => 0.6982, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 16.45% (0.2049 => 0.2386, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.45% (0.3180 => 0.3703, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 16.45% (0.3387 => 0.3944, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.33% (0.8101 => 0.9424, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.98% (0.3441 => 0.3991, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.79% (0.8067 => 0.9341, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.49% (1.1861 => 1.3698, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 15.35% (10.3673 => 11.9589, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/football/football: 14.74% (0.8921 => 1.0236, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 14.53% (0.3283 => 0.3760, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 14.33% (0.3232 => 0.3695, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.43% (17.1811 => 19.4882, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 13.37% (1.5603 => 1.7689, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 13.16% (0.3092 => 0.3499, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.14% (0.3379 => 0.3823, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.79% (14.3668 => 16.2039, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.19% (0.3865 => 0.4336, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.99% (0.3427 => 0.3838, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.84% (0.4636 => 0.5185, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.1268 => 0.1412, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.32% (0.2430 => 0.2705, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.19% (0.4103 => 0.4562, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.85% (0.4203 => 0.4659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.34% (0.3473 => 0.3832, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 10.20% (0.4048 => 0.4461, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 10.02% (0.3422 => 0.3765, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 9.94% (0.3603 => 0.3961, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 9.83% (0.3684 => 0.4046, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.60% (0.4064 => 0.4454, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.43% (0.1114 => 0.1219, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.40% (63.2438 => 69.1867, std.dev.: 0.0184) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.90% (0.1438 => 0.1566, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 8.59% (0.6030 => 0.6548, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.15% (0.2871 => 0.3105, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/strcat: 8.05% (0.2831 => 0.3059, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.85% (0.4879 => 0.5262, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 7.71% (1.2842 => 1.3832, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.49% (2.0665 => 2.2213, std.dev.: 0.0029) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.45% (7.9617 => 8.5547, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (2.2022 => 2.3602, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.14% (0.3935 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 7.09% (0.2877 => 0.3081, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.08% (0.3162 => 0.3386, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.04% (0.2756 => 0.2950, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.86% (0.2725 => 0.2912, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.80% (0.3177 => 0.3393, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 6.78% (0.2905 => 0.3102, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.77% (0.2793 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.75% (0.2891 => 0.3086, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.48% (0.2872 => 0.3058, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.44% (0.2266 => 0.2412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.35% (0.2802 => 0.2980, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.26% (0.3052 => 0.3243, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.25% (0.3136 => 0.3332, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2406, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4611, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3128, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.3316 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1052, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0082) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (8.6802 => 8.9175, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7207, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2889, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2824, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.22% (10.3460 => 10.4727, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.04% (5.2763 => 1.2115, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.33% (0.8651 => 0.2134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.88% (5.3855 => 4.4765, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.45% (5.3526 => 4.4722, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: -10.77% (10.4361 => 9.3126, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.96% (1.7609 => 1.6208, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9883, std.dev.: 0.0230) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.58% (1.9577 => 0.6542, std.dev.: 0.0167) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0228, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4263, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8584, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0041, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4930, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2871, std.dev.: 0.0603) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7063, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5783, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: -5.89% (1.2373 => 1.1644, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5749, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7013, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.24% (10.2830 => 9.8465, std.dev.: 0.0117) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.88% (3.6994 => 3.6298, std.dev.: 0.0167) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.68% (3.7221 => 3.6594, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3308, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2272, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0026) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 12:03:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 14:03:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116200327.73A182A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7658?compare_to=7656&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7658, Order: 172630, Start Time: 2013-01-16 18:29:19, End Time: 2013-01-16 20:03:34 To: 7656, Order: 172619, Start Time: 2013-01-16 16:31:17, End Time: 2013-01-16 18:05:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (857 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.25% (0.6798 => 0.6951, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.95% (0.0717 => 0.1197, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.55% (0.0974 => 0.1554, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.84% (0.1132 => 0.1549, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.08% (0.6395 => 0.8702, std.dev.: 0.0038) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.07% (0.6395 => 0.8574, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.56% (0.6260 => 0.8298, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.15% (0.5688 => 0.7460, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.13% (0.5805 => 0.7612, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.90% (0.5456 => 0.7142, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.35% (0.6230 => 0.8121, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.24% (0.5849 => 0.7618, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.98% (0.5941 => 0.7722, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 29.94% (0.5567 => 0.7234, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.92% (0.5575 => 0.7243, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.82% (0.5581 => 0.7245, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.27% (0.6033 => 0.7799, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.16% (0.5802 => 0.7494, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.96% (0.5705 => 0.7357, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.78% (0.5859 => 0.7545, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.43% (0.6440 => 0.8271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.17% (0.5570 => 0.7139, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.07% (0.5857 => 0.7501, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.07% (0.5925 => 0.7588, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.04% (0.5478 => 0.7014, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 27.94% (0.5569 => 0.7125, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.74% (0.5591 => 0.7142, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.68% (0.6676 => 0.8524, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.52% (1.6474 => 2.1008, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.11% (0.6189 => 0.7867, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.95% (0.6052 => 0.7683, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.79% (0.6446 => 0.8173, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.62% (0.5863 => 0.7424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.40% (0.6304 => 0.7968, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.34% (0.6681 => 0.8374, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.15% (0.6660 => 0.8335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.14% (0.6194 => 0.7751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.88% (0.6297 => 0.7864, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.26% (0.6667 => 0.8218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.41% (0.7524 => 0.9210, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.32% (0.7339 => 0.8904, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.29% (2.2587 => 2.7169, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.46% (1.1450 => 1.3449, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.53% (0.1146 => 0.1324, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.54% (0.3357 => 0.3845, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.59% (1.6364 => 1.8424, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.39% (4.5069 => 5.0652, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.72% (0.4916 => 0.5492, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 11.27% (0.4515 => 0.5024, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.40% (3.5339 => 3.9013, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2385 => 0.2613, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 9.36% (9.2283 => 10.0924, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.65% (0.7021 => 0.7628, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.41% (1.2515 => 1.3568, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.29% (0.1230 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.29% (1.4642 => 1.5710, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.21% (0.5329 => 0.5713, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.08% (1.2784 => 1.3689, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.64% (0.1731 => 0.1846, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 6.06% (0.4524 => 0.4798, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 5.08% (0.4861 => 0.5108, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.77% (0.3834 => 0.4017, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 4.64% (0.3255 => 0.3406, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3319 => 0.3461, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.36% (5.0226 => 5.1915, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.24% (1.3864 => 1.4313, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.87% (5.4682 => 5.6254, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 2.76% (3.5154 => 3.6126, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.71% (22.4056 => 23.0138, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/bigfib: 2.39% (0.6750 => 0.6911, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.95% (0.8418 => 0.8582, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.83% (0.7447 => 0.7583, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.79% (15.5079 => 15.7853, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.36% (1.3722 => 1.3909, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 1.32% (16.1920 => 16.4050, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (4.0323 => 4.0742, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.04% (4.8161 => 4.8661, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6598, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.56% (0.9531 => 1.0252, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.94% (1.2783 => 1.3670, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (54.5751 => 56.6466, std.dev.: 0.0502) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1062, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (0.6469 => 0.6639, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2054, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -7.14% (0.3194 => 0.2966, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.86% (0.3837 => 0.3612) SingleSource/Benchmarks/Shootout-C++/fibo: -5.64% (0.2871 => 0.2709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.59% (0.3057 => 0.2886, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.55% (0.2903 => 0.2742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.44% (0.3016 => 0.2852, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.42% (0.3323 => 0.3143, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.35% (0.2933 => 0.2776, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: -5.33% (0.3059 => 0.2896, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -5.30% (0.3205 => 0.3035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.25% (0.3812 => 0.3612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -5.23% (0.2849 => 0.2700, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -5.14% (0.2939 => 0.2788, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3880 => 0.3681, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -5.10% (2.1713 => 2.0606, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: -5.03% (0.3896 => 0.3700, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -5.01% (0.3252 => 0.3089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3884 => 0.3690, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -4.96% (0.4033 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.89% (0.3025 => 0.2877, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: -4.79% (0.4176 => 0.3976, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: -4.75% (0.2989 => 0.2847, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.70% (0.6347 => 0.6049, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3821 => 0.3648, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.49% (1.3148 => 1.2558, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.45% (0.9852 => 0.9414, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference-object: -4.42% (0.6441 => 0.6156, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.24% (0.4151 => 0.3975, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -4.24% (0.4199 => 0.4021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.98% (0.3621 => 0.3477, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.83% (0.4280 => 0.4116, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -3.83% (2.4924 => 2.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.70% (0.4427 => 0.4263, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -3.70% (0.3867 => 0.3724, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -3.56% (0.3788 => 0.3653, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.56% (0.9542 => 0.9202, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.56% (0.3931 => 0.3791, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.53% (0.3849 => 0.3713, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -3.48% (0.4248 => 0.4100, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.28% (0.3658 => 0.3538, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.25% (0.6484 => 0.6273, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.12% (0.4321 => 0.4186, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.84% (0.4083 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.62% (0.4813 => 0.4687, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.31% (0.7919 => 0.7736, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -2.19% (20.7746 => 20.3205, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.7198 => 0.7041, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.92% (1.0544 => 1.0342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.80% (0.9179 => 0.9014, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.72% (1.2210 => 1.2000, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (1.2221 => 1.2021, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.48% (0.7982 => 0.7864, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -1.32% (4.3330 => 4.2760, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.23% (14.2083 => 14.0342, std.dev.: 0.0081) MultiSource/Applications/hbd/hbd: -1.21% (1.5610 => 1.5421, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.21% (0.8521 => 0.8418, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -1.02% (34.0927 => 33.7463, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6951, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2401, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.46% (1.3643 => 1.0306, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7514, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0264, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.87% (5.3397 => 4.1721, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1296, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3398, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.09% (1.0557 => 1.0231, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.93% (7.9763 => 7.7423, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/ary3: -2.93% (3.7241 => 3.6149, std.dev.: 0.0329) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1957, std.dev.: 0.0262) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.37% (3.7092 => 3.6582, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.07% (1.4516 => 1.4361, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.05% (1.6086 => 1.5917, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 12:23:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 14:23:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116202354.8BC442A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7659?compare_to=7655&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7659, Order: 172630, Start Time: 2013-01-16 18:16:31, End Time: 2013-01-16 20:24:03 To: 7655, Order: 172617, Start Time: 2013-01-16 15:53:20, End Time: 2013-01-16 17:56:16 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 56 (56 on baseline) Performance Improvements: 5 (8 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1002 (999 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionBitfields: 75.40% (0.0248 => 0.0435, std.dev.: 0.0005) SingleSource/Regression/C++/EH/dead_try_block: 70.27% (0.0148 => 0.0252, std.dev.: 0.0008) SingleSource/Regression/C/ConstructorDestructorAttributes: 69.68% (0.0155 => 0.0263, std.dev.: 0.0010) SingleSource/Regression/C++/pointer_member: 69.48% (0.0154 => 0.0261, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-26-Shorts: 68.49% (0.0219 => 0.0369, std.dev.: 0.0010) SingleSource/UnitTests/byval-alignment: 68.18% (0.0176 => 0.0296, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 67.11% (0.0751 => 0.1255, std.dev.: 0.0034) SingleSource/UnitTests/member-function-pointers: 65.84% (0.0202 => 0.0335, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/factor: 65.73% (0.0499 => 0.0827, std.dev.: 0.0008) SingleSource/UnitTests/2003-07-09-LoadShorts: 65.61% (0.0253 => 0.0419, std.dev.: 0.0007) SingleSource/UnitTests/2002-05-02-CastTest2: 65.52% (0.0203 => 0.0336, std.dev.: 0.0005) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 64.97% (0.0157 => 0.0259, std.dev.: 0.0002) SingleSource/Regression/C++/fixups: 62.61% (0.0238 => 0.0387, std.dev.: 0.0006) SingleSource/UnitTests/2008-07-13-InlineSetjmp: 62.13% (0.0169 => 0.0274, std.dev.: 0.0025) SingleSource/UnitTests/initp1: 61.91% (0.0470 => 0.0761, std.dev.: 0.0017) SingleSource/UnitTests/2007-01-04-KNR-Args: 61.83% (0.0186 => 0.0301, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 59.07% (0.0237 => 0.0377, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: 58.29% (0.0537 => 0.0850, std.dev.: 0.0067) SingleSource/UnitTests/Vector/divides: 57.73% (0.0194 => 0.0306, std.dev.: 0.0007) SingleSource/Regression/C++/EH/throw_rethrow_test: 55.56% (0.0252 => 0.0392, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/ccc: 47.60% (0.0250 => 0.0369, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 47.29% (0.0702 => 0.1034, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 45.39% (0.1681 => 0.2444, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 44.99% (0.2236 => 0.3242, std.dev.: 0.0193) SingleSource/Regression/C++/EH/function_try_block: 43.27% (0.0312 => 0.0447, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 42.87% (0.2517 => 0.3596, std.dev.: 0.0296) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 38.50% (0.0413 => 0.0572, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 32.33% (0.0529 => 0.0700, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.66% (0.1615 => 0.2094, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 29.21% (1.8980 => 2.4524, std.dev.: 0.0647) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.24% (1.2716 => 1.5926, std.dev.: 0.0569) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.86% (7.2905 => 8.5197, std.dev.: 0.2595) MultiSource/Applications/siod/siod: 12.10% (2.4079 => 2.6993, std.dev.: 0.0583) MultiSource/Applications/d/make_dparser: 10.09% (3.6143 => 3.9789, std.dev.: 0.1410) MultiSource/Benchmarks/mafft/pairlocalalign: 9.43% (10.1496 => 11.1071, std.dev.: 0.3637) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.42% (14.6976 => 15.7881, std.dev.: 0.3199) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.28% (0.8848 => 0.9492, std.dev.: 0.0131) MultiSource/Applications/sqlite3/sqlite3: 6.66% (16.4060 => 17.4986, std.dev.: 0.3429) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.15% (1.0074 => 1.0694, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 5.26% (17.0319 => 17.9283, std.dev.: 0.1851) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.90% (0.4649 => 0.4784, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.89% (0.9741 => 1.0023, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.01% (0.9139 => 0.9323, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 32.27% (1.6615 => 2.1977, std.dev.: 0.1600) MultiSource/Applications/minisat/minisat: 29.72% (6.2524 => 8.1109, std.dev.: 0.1724) SingleSource/Benchmarks/Shootout/heapsort: 24.62% (3.9279 => 4.8948, std.dev.: 0.0221) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.87% (2.5768 => 3.0631, std.dev.: 0.0328) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.35% (0.8702 => 1.0299, std.dev.: 0.0589) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.33% (2.4177 => 2.7642, std.dev.: 0.1167) MultiSource/Benchmarks/7zip/7zip-benchmark: 9.57% (9.8228 => 10.7632, std.dev.: 0.0759) SingleSource/Benchmarks/Shootout/hash: 8.29% (4.1352 => 4.4779, std.dev.: 0.0812) SingleSource/Benchmarks/Shootout/ary3: 6.29% (2.1130 => 2.2459, std.dev.: 0.0225) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.50% (22.3833 => 23.1670, std.dev.: 0.1615) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.91% (42.0553 => 43.2802, std.dev.: 0.0775) MultiSource/Benchmarks/BitBench/five11/five11: 2.18% (5.5537 => 5.6745, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.18% (4.7973 => 4.8537, std.dev.: 0.0209) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.88% (0.9641 => 0.9171, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.90% (1.0268 => 0.9970, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -6.69% (3.0829 => 2.8766, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.93% (4.3627 => 4.1911, std.dev.: 0.0621) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.45% (7.4023 => 7.2211, std.dev.: 0.0554) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.92% (1.1101 => 1.1314, std.dev.: 0.0686) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0222 => 0.0224, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.62% (0.0431 => 0.0438, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0337 => 0.0338, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0319 => 0.0321, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.28% (0.0429 => 0.0516, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: 0.48% (0.0207 => 0.0208, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: 43.87% (0.0155 => 0.0223, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0252 => 0.0251, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1464 => 0.1460, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 8.19% (1.1520 => 1.2463, std.dev.: 0.2770) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.13% (0.3981 => 0.3986, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.02% (0.1483 => 0.1513, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.47% (0.0994 => 0.1277, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.96% (0.0278 => 0.0289, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.37% (0.0540 => 0.0569, std.dev.: 0.0135) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1473 => 1.1503, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 63.16% (0.0019 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.69% (0.0026 => 0.0028, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0613 => 0.0618, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.03% (0.0319 => 0.0287, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (0.7436 => 0.7442, std.dev.: 0.0020) SingleSource/Regression/C/2003-05-21-UnionBitfields: 900.00% (0.0001 => 0.0010, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: -24.21% (0.0095 => 0.0072, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.86% (12.7709 => 12.8801, std.dev.: 0.0256) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/pointer_arithmetic: 209.43% (0.0053 => 0.0164, std.dev.: 0.0009) SingleSource/UnitTests/2002-05-02-CastTest1: 189.66% (0.0058 => 0.0168, std.dev.: 0.0012) SingleSource/UnitTests/2004-02-02-NegativeZero: 178.33% (0.0060 => 0.0167, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: 146.13% (0.0336 => 0.0827, std.dev.: 0.0008) SingleSource/Regression/C++/EH/function_try_block: 83.95% (0.0243 => 0.0447, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: 71.94% (0.0253 => 0.0435, std.dev.: 0.0005) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 70.39% (0.0152 => 0.0259, std.dev.: 0.0002) SingleSource/Regression/C++/EH/throw_rethrow_test: 68.97% (0.0232 => 0.0392, std.dev.: 0.0025) SingleSource/Regression/C++/pointer_member: 68.39% (0.0155 => 0.0261, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-02-DependentPHI: 68.39% (0.0155 => 0.0261, std.dev.: 0.0021) SingleSource/UnitTests/2002-05-02-CastTest2: 68.00% (0.0200 => 0.0336, std.dev.: 0.0005) SingleSource/UnitTests/byval-alignment: 67.23% (0.0177 => 0.0296, std.dev.: 0.0005) SingleSource/Regression/C++/EH/dead_try_block: 66.89% (0.0151 => 0.0252, std.dev.: 0.0008) SingleSource/UnitTests/2003-05-26-Shorts: 66.22% (0.0222 => 0.0369, std.dev.: 0.0010) SingleSource/UnitTests/2003-07-09-LoadShorts: 65.61% (0.0253 => 0.0419, std.dev.: 0.0007) SingleSource/UnitTests/member-function-pointers: 65.02% (0.0203 => 0.0335, std.dev.: 0.0007) SingleSource/Regression/C++/fixups: 63.29% (0.0237 => 0.0387, std.dev.: 0.0006) SingleSource/Regression/C/ConstructorDestructorAttributes: 62.35% (0.0162 => 0.0263, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 60.08% (0.0531 => 0.0850, std.dev.: 0.0067) SingleSource/UnitTests/initp1: 58.54% (0.0480 => 0.0761, std.dev.: 0.0017) SingleSource/Regression/C++/EH/ctor_dtor_count-2: 58.40% (0.0238 => 0.0377, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 57.47% (0.0797 => 0.1255, std.dev.: 0.0034) SingleSource/UnitTests/2007-01-04-KNR-Args: 56.77% (0.0192 => 0.0301, std.dev.: 0.0013) SingleSource/UnitTests/Vector/divides: 53.77% (0.0199 => 0.0306, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/ccc: 49.39% (0.0247 => 0.0369, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 48.35% (0.0697 => 0.1034, std.dev.: 0.0053) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 41.94% (0.0403 => 0.0572, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 39.26% (0.1755 => 0.2444, std.dev.: 0.0160) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 32.74% (0.2709 => 0.3596, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.49% (1.8651 => 2.4524, std.dev.: 0.0647) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.67% (0.2481 => 0.3242, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.10% (0.1622 => 0.2094, std.dev.: 0.0170) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.16% (7.2721 => 8.5197, std.dev.: 0.2595) MultiSource/Benchmarks/mafft/pairlocalalign: 16.67% (9.5202 => 11.1071, std.dev.: 0.3637) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.38% (1.3924 => 1.5926, std.dev.: 0.0569) MultiSource/Applications/JM/lencod/lencod: 7.35% (16.7012 => 17.9283, std.dev.: 0.1851) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.04% (23.5861 => 25.0118, std.dev.: 0.4519) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.01% (1.0088 => 1.0694, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 5.99% (33.2440 => 35.2351, std.dev.: 0.5320) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.76% (0.9061 => 0.9492, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.55% (2.4519 => 2.5635, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.47% (0.9010 => 0.9323, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.04% (0.9867 => 0.9970, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322362.50% (0.0008 => 2.5797, std.dev.: 0.0208) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 107.21% (1.1825 => 2.4503, std.dev.: 0.2656) SingleSource/Benchmarks/CoyoteBench/fftbench: 32.82% (1.6547 => 2.1977, std.dev.: 0.1600) MultiSource/Benchmarks/7zip/7zip-benchmark: 19.48% (9.0082 => 10.7632, std.dev.: 0.0759) SingleSource/Benchmarks/Stanford/Puzzle: 9.72% (0.1698 => 0.1863, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/heapsort: 9.41% (4.4739 => 4.8948, std.dev.: 0.0221) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.53% (2.2499 => 2.4418, std.dev.: 0.0559) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.44% (2.8778 => 3.0631, std.dev.: 0.0328) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.40% (46.0987 => 48.1289, std.dev.: 0.5864) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.73% (16.6791 => 17.3019, std.dev.: 0.2339) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.13% (7.0016 => 7.2211, std.dev.: 0.0554) MultiSource/Applications/JM/lencod/lencod: 2.68% (6.8159 => 6.9985, std.dev.: 0.0691) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (42.3194 => 43.2802, std.dev.: 0.0775) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.22% (0.0727 => 0.0500, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.57% (1.0986 => 0.9605, std.dev.: 0.0325) MultiSource/Applications/hexxagon/hexxagon: -9.20% (1.1433 => 1.0381, std.dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: -6.99% (17.4365 => 16.2175, std.dev.: 0.4557) MultiSource/Benchmarks/Olden/health/health: -6.77% (0.1610 => 0.1501, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.81% (1.0017 => 0.9535, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.06% (1.0234 => 1.0023, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -1.09% (2.9083 => 2.8766, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.08% (1.2047 => 1.1314, std.dev.: 0.0686) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 15.96% (0.0445 => 0.0516, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.58% (0.1530 => 0.1460, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -35.40% (1.9293 => 1.2463, std.dev.: 0.2770) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4049 => 0.3986, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.20% (0.1510 => 0.1513, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 30.57% (0.0978 => 0.1277, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.71% (0.0276 => 0.0289, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.56% (0.0590 => 0.0569, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.98% (1.1617 => 1.1503, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.31% (0.0610 => 0.0618, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.09% (0.0268 => 0.0287, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7437 => 0.7442, std.dev.: 0.0020) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0008 => 0.0010, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.74% (0.0092 => 0.0072, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.80% (12.7781 => 12.8801, std.dev.: 0.0256) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 14:00:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 16:00:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116220047.A35252A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7660?compare_to=7658&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7660, Order: 172648, Start Time: 2013-01-16 20:26:47, End Time: 2013-01-16 22:00:54 To: 7658, Order: 172630, Start Time: 2013-01-16 18:29:19, End Time: 2013-01-16 20:03:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (860 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.07% (1.1529 => 1.1652, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.47% (0.0974 => 0.1563, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.48% (0.1132 => 0.1545, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.68% (0.6395 => 0.8677, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 33.87% (0.6395 => 0.8561, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.16% (0.6260 => 0.8273, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.05% (0.5688 => 0.7454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.83% (0.5456 => 0.7138, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.71% (0.5805 => 0.7588, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.11% (0.6230 => 0.8106, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.07% (0.5849 => 0.7608, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.90% (0.5575 => 0.7242, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 29.73% (0.5567 => 0.7222, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.73% (0.5581 => 0.7240, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.71% (0.5941 => 0.7706, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 28.97% (0.5802 => 0.7483, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.94% (0.6033 => 0.7779, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.92% (0.5705 => 0.7355, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.42% (0.5859 => 0.7524, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.13% (0.5570 => 0.7137, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.06% (0.6440 => 0.8247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.03% (0.5857 => 0.7499, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.02% (0.5478 => 0.7013, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 27.99% (0.5569 => 0.7128, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 27.97% (0.5925 => 0.7582, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.54% (0.5591 => 0.7131, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.32% (0.6676 => 0.8500, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 26.98% (1.6474 => 2.0919, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.78% (0.6052 => 0.7673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.71% (0.6189 => 0.7842, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.47% (0.5863 => 0.7415, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.45% (0.6446 => 0.8151, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.09% (0.6304 => 0.7949, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.10% (0.6681 => 0.8358, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 24.96% (0.6194 => 0.7740, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.80% (0.6660 => 0.8312, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.65% (0.6297 => 0.7849, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.04% (0.6667 => 0.8203, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 21.97% (0.7524 => 0.9177, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.16% (0.7339 => 0.8892, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.79% (2.2587 => 2.7057, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 17.11% (1.1450 => 1.3409, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.95% (0.3357 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.98% (0.3834 => 0.4370, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.82% (0.1982 => 0.2236, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.45% (1.6364 => 1.8402, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.22% (4.5069 => 5.0575, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.47% (0.4916 => 0.5480, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.36% (0.4515 => 0.5028, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.18% (3.5339 => 3.8936, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.43% (0.2385 => 0.2610, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 9.22% (9.2283 => 10.0796, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.42% (0.7021 => 0.7612, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.85% (1.2515 => 1.3498, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.91% (1.4642 => 1.5654, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.5329 => 0.5696, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.86% (1.2784 => 1.3661, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 5.79% (0.4524 => 0.4786, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.3255 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 5.43% (0.4861 => 0.5125, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.01% (0.3319 => 0.3452, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 3.53% (5.0226 => 5.1998, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.3864 => 1.4322, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 2.56% (3.5154 => 3.6054, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.39% (5.4682 => 5.5988, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 2.16% (0.6750 => 0.6896, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (22.4056 => 22.8896, std.dev.: 0.0090) MultiSource/Applications/spiff/spiff: 1.76% (0.8418 => 0.8566, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.62% (15.5079 => 15.7592, std.dev.: 0.0100) MultiSource/Applications/minisat/minisat: 1.46% (0.7447 => 0.7556, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3722 => 1.3898, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 1.27% (16.1920 => 16.3969, std.dev.: 0.0141) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6584, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4924, std.dev.: 0.1792) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.23% (2.0478 => 2.1140, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (0.6469 => 0.6641, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.71% (4.5320 => 4.6095, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2774, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2081, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.79% (0.3194 => 0.2977, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.63% (0.1584 => 0.1479, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.63% (0.3837 => 0.3621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.07% (0.3057 => 0.2902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.90% (0.2428 => 0.2309, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -4.88% (0.2849 => 0.2710, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.77% (0.2933 => 0.2793, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3831 => 0.3650, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.66% (0.3026 => 0.2885, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.65% (0.3205 => 0.3056, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.64% (0.3252 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.63% (2.1713 => 2.0707, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.62% (0.9852 => 0.9397, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.60% (0.3025 => 0.2886, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.59% (0.2939 => 0.2804, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.4033 => 0.3848, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -4.36% (1.3148 => 1.2575, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -4.05% (0.4199 => 0.4029, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.05% (0.4151 => 0.3983, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.92% (0.6347 => 0.6098, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.86% (0.4280 => 0.4115, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists: -3.81% (0.3621 => 0.3483, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.76% (2.4924 => 2.3987, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.72% (0.3658 => 0.3522, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.67% (0.6484 => 0.6246, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.55% (0.7779 => 0.7503, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists1: -3.54% (0.3867 => 0.3730, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.52% (0.4321 => 0.4169, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.46% (0.3931 => 0.3795, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.39% (0.4427 => 0.4277, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.9542 => 0.9224, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: -3.30% (0.4248 => 0.4108, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: -3.12% (0.3788 => 0.3670, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.09% (0.3849 => 0.3730, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.77% (0.7919 => 0.7700, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.60% (0.4813 => 0.4688, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.60% (0.4083 => 0.3977, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -2.39% (0.7982 => 0.7791, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.29% (1.0544 => 1.0303, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -2.19% (20.7746 => 20.3189, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: -1.97% (4.3330 => 4.2477, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.82% (1.2210 => 1.1988, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.69% (0.7198 => 0.7076, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.57% (1.2221 => 1.2029, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (0.8521 => 0.8392, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.31% (34.0927 => 33.6477, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.25% (14.2083 => 14.0306, std.dev.: 0.0089) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.20% (1.2300 => 1.2153, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: -1.11% (18.2933 => 18.0910, std.dev.: 0.0200) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.71% (1.8100 => 0.6930, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0086) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3141, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -24.71% (1.3643 => 1.0272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0198, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2071, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1720, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.83% (3.7241 => 3.6188, std.dev.: 0.0321) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (7.9763 => 7.7836, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.36% (1.3096 => 1.2787, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6061, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1984, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.38% (1.6086 => 1.5864, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6219 => 1.6028, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4353, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6701, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 14:23:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 16:23:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130116222340.1CECC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7661?compare_to=7654&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7661, Order: 172630, Start Time: 2013-01-16 18:49:27, End Time: 2013-01-16 22:23:46 To: 7654, Order: 172610, Start Time: 2013-01-16 14:21:45, End Time: 2013-01-16 17:55:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (177 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (761 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.51% (54.0453 => 54.8591, std.dev.: 0.0453) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.03% (130.1092 => 131.4520, std.dev.: 0.1030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.96% (0.0625 => 0.0881, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.55% (0.1063 => 0.1409) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.11% (0.2969 => 0.3774, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.94% (0.1106 => 0.1404, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.96% (0.0547 => 0.0689, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.44% (0.5900 => 0.7401, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.25% (0.4139 => 0.5184, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.84% (0.0475 => 0.0593, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.65% (0.0714 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.58% (0.0415 => 0.0517, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.45% (0.4253 => 0.5293, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.0584 => 0.0725, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.94% (0.1107 => 0.1372, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.85% (0.4994 => 0.6185, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.58% (0.1620 => 0.2002, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.50% (0.5000 => 0.6175, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.02% (0.1021 => 0.1256, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 22.87% (0.0599 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.63% (0.0897 => 0.1100, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 22.48% (1.5932 => 1.9514, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.08% (0.1549 => 0.1891, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.92% (0.0584 => 0.0712, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.73% (0.0948 => 0.1154, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.64% (0.0633 => 0.0770, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.31% (0.1103 => 0.1338, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.24% (0.1003 => 0.1216, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.21% (0.0495 => 0.0600, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.18% (0.0642 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.01% (0.1604 => 0.1941, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.80% (0.0822 => 0.0993, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 20.57% (0.1619 => 0.1952, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 20.53% (0.0604 => 0.0728, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.52% (0.3903 => 0.4704, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 20.46% (0.0821 => 0.0989, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.33% (0.0541 => 0.0651, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 19.75% (0.0947 => 0.1134, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 19.33% (0.4029 => 0.4808, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 18.91% (0.0698 => 0.0830, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.74% (0.2866 => 0.3403, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 18.72% (0.1218 => 0.1446, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 18.57% (0.1088 => 0.1290, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.54% (0.1462 => 0.1733, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 18.34% (0.1505 => 0.1781, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.32% (0.2014 => 0.2383, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.20% (0.2736 => 0.3234, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 18.19% (0.0808 => 0.0955, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.07% (0.3271 => 0.3862, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.01% (0.0572 => 0.0675, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.97% (0.3890 => 0.4589, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 17.87% (1.8794 => 2.2153, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.78% (1.3152 => 1.5490, std.dev.: 0.0092) SingleSource/UnitTests/ObjC++/Hello: 17.54% (0.5826 => 0.6848, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 17.40% (0.5546 => 0.6511, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.24% (0.5889 => 0.6904, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 16.91% (0.9697 => 1.1337, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.55% (0.1160 => 0.1352, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.53% (3.5627 => 4.1515, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.42% (0.4658 => 0.5423, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.41% (0.1968 => 0.2291, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.38% (1.6211 => 1.8866, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.28% (0.5026 => 0.5844, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.90% (0.3930 => 0.4555, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 15.89% (0.1284 => 0.1488, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 15.83% (0.1421 => 0.1646, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 15.83% (0.2875 => 0.3330, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.66% (0.4361 => 0.5044, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 15.53% (0.2750 => 0.3177, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 15.38% (0.9909 => 1.1433, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 15.33% (0.2811 => 0.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 15.33% (0.2714 => 0.3130, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.32% (0.2911 => 0.3357, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.30% (1.9694 => 2.2708, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/heapsort: 15.29% (0.2792 => 0.3219, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 15.27% (0.7171 => 0.8266, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 15.27% (0.2725 => 0.3141, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.24% (4.4195 => 5.0929, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 15.23% (0.2803 => 0.3230, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.19% (0.2738 => 0.3154, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.19% (2.0673 => 2.3813, std.dev.: 0.0110) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.18% (0.3195 => 0.3680, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 15.18% (0.3004 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 15.14% (0.2813 => 0.3239, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 15.13% (0.2823 => 0.3250, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.11% (0.2780 => 0.3200, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.06% (1.9966 => 2.2973, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.02% (0.2729 => 0.3139, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 14.92% (1.0781 => 1.2389, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.89% (2.7292 => 3.1357, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: 14.73% (4.2109 => 4.8312, std.dev.: 0.0181) MultiSource/Benchmarks/Bullet/bullet: 14.67% (23.5202 => 26.9713, std.dev.: 0.0538) SingleSource/Benchmarks/Shootout-C++/wc: 14.60% (0.3096 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 14.57% (0.3267 => 0.3743, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 14.55% (0.3258 => 0.3732, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.46% (0.3362 => 0.3848, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 14.44% (0.3060 => 0.3502, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3317 => 0.3793, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.18% (0.3124 => 0.3567, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 14.16% (0.4146 => 0.4733, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 14.14% (1.4269 => 1.6287, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 13.96% (0.3726 => 0.4246, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3477 => 0.3962, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.94% (0.3465 => 0.3948, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.93% (0.3488 => 0.3974, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 13.92% (0.3348 => 0.3814, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.90% (0.3446 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.86% (0.3442 => 0.3919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.84% (0.3469 => 0.3949, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.80% (0.2566 => 0.2920, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 13.77% (0.3282 => 0.3734, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 13.70% (0.3678 => 0.4182, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.66% (0.3625 => 0.4120, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 13.59% (0.3650 => 0.4146, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 13.57% (0.7875 => 0.8944, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.41% (0.3981 => 0.4515, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 13.36% (0.4251 => 0.4819, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.35% (0.2068 => 0.2344, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.35% (0.3724 => 0.4221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.20% (0.3690 => 0.4177, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.03% (0.1090 => 0.1232, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.87% (0.3845 => 0.4340, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.65% (0.1028 => 0.1158, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 12.59% (0.5012 => 0.5643, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.09% (0.6435 => 0.7213, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 11.86% (2.1653 => 2.4222, std.dev.: 0.0113) MultiSource/Applications/SPASS/SPASS: 11.36% (5.5417 => 6.1711, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.33% (0.2737 => 0.3047, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 11.30% (0.2691 => 0.2995, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 11.28% (0.2075 => 0.2309, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 11.20% (4.6177 => 5.1347, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.10% (0.5361 => 0.5956, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.98% (2.1013 => 2.3320, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (0.3084 => 0.3409, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 10.46% (0.3498 => 0.3864, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.2103 => 0.2316, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.94% (11.6398 => 12.7973, std.dev.: 0.0130) MultiSource/Applications/minisat/minisat: 9.92% (0.3336 => 0.3667, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 9.83% (0.6634 => 0.7286, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: 9.30% (0.4847 => 0.5298, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.17% (4.6926 => 5.1231, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.17% (0.7426 => 0.8107, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.07% (0.2040 => 0.2225, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.68% (0.1383 => 0.1503, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 7.65% (0.2391 => 0.2574, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.47% (0.5584 => 0.6001, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 7.39% (2.0346 => 2.1849, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 6.56% (11.9555 => 12.7396, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3792 => 0.3967, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5107, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (0.3693 => 0.4072, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 9.24% (0.2802 => 0.3061, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2383, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6702, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.71% (79.9355 => 83.6976, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-2: 4.33% (1.8057 => 1.8839, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1944, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Applications/spiff/spiff: 1.19% (4.0317 => 4.0796, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2078, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5907, std.dev.: 0.0194) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4795, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5744, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.44% (17.2379 => 14.2311, std.dev.: 0.1573) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9744, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7980, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0103) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2187, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7946, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -3.25% (14.0481 => 13.5910, std.dev.: 0.0969) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1565, std.dev.: 0.0410) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1879, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0495, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 14:32:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 16:32:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130116223239.E45C82A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7662?compare_to=7657&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7662, Order: 172642, Start Time: 2013-01-16 20:20:43, End Time: 2013-01-16 22:32:46 To: 7657, Order: 172624, Start Time: 2013-01-16 17:38:44, End Time: 2013-01-16 19:50:18 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.86% (11.9589 => 12.3004, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.68% (0.6542 => 0.6652, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.06% (11.1642 => 11.0461, std.dev.: 0.0142) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1332 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (0.0652 => 0.0673, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8593 => 499.8479, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 44224.55% (1.1277 => 499.8479, std.dev.: 0.0046) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.76% (0.5229 => 1.6668, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 21.15% (14.9895 => 18.1600, std.dev.: 0.0208) MultiSource/Applications/kimwitu++/kc: 42.99% (14.1553 => 20.2401, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8499, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.10% (1.1048 => 1.7798, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.05% (7.1582 => 38.3002, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.51% (3.4629 => 6.3547, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.74% (0.6222 => 1.0810, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.92% (0.0720 => 7.4433, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3834400.00% (0.0001 => 3.8345, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11157900.00% (0.0001 => 11.1580, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483200.00% (0.0001 => 5.4833, std.dev.: 0.0155) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.16% (1.1194 => 10.3227, std.dev.: 0.0087) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 150.45% (22.1758 => 55.5391, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 90.53% (0.0243 => 0.0463) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.56% (0.0929 => 0.1761, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 69.37% (0.0271 => 0.0459, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.89% (21.9371 => 36.1713, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 59.14% (0.0394 => 0.0627, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.08% (2.9384 => 4.6157, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.59% (7.0540 => 11.0461, std.dev.: 0.0142) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 50.76% (0.1056 => 0.1592, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.32% (1.5859 => 2.3840, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.28% (8.1363 => 12.1457, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.44% (2.2024 => 3.0930, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 39.76% (0.3109 => 0.4345, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0016) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.41% (1.5415 => 2.0720, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.15% (4.2646 => 5.7209, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.24% (0.4615 => 0.6103, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 31.66% (0.1175 => 0.1547, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.29% (0.1892 => 0.2484, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.74% (0.2700 => 0.3530, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 30.24% (0.4299 => 0.5599, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 30.16% (1.1642 => 1.5153, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.88% (0.6675 => 0.8603, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.49% (0.0793 => 0.1011, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.40% (0.0719 => 0.0916, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.37% (0.5105 => 0.6502, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 27.29% (0.2554 => 0.3251, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 27.02% (9.4845 => 12.0470, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 26.59% (0.1655 => 0.2095, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 26.57% (0.0636 => 0.0805, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.22% (1.0722 => 1.3533, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.20% (0.1584 => 0.1999, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.26% (0.0479 => 0.0600, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.24% (0.1125 => 0.1409, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.17% (3.8922 => 4.8718, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.97% (0.1566 => 0.1957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.62% (1.4186 => 1.7678, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.03% (0.3121 => 0.3871, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.77% (0.1906 => 0.2359, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 23.60% (0.1555 => 0.1922, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 22.69% (0.4289 => 0.5262, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 22.32% (5.7591 => 7.0447, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.21% (0.0842 => 0.1029, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 22.02% (0.7115 => 0.8682, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 22.01% (0.4620 => 0.5637, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.77% (0.1695 => 0.2064, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.71% (4.9449 => 6.0185, std.dev.: 0.0125) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.70% (0.1143 => 0.1391, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 21.50% (0.1163 => 0.1413, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 21.16% (3.3354 => 4.0411, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.11% (0.0886 => 0.1073, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 21.01% (0.3098 => 0.3749, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.00% (5.0018 => 6.0520, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 20.94% (0.1695 => 0.2050, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.82% (0.0730 => 0.0882, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 20.76% (0.0660 => 0.0797, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.67% (0.1940 => 0.2341, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.61% (1.3050 => 1.5740) MultiSource/Applications/spiff/spiff: 20.42% (0.7835 => 0.9435, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 19.82% (0.1236 => 0.1481, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.71% (0.5860 => 0.7015, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.54% (0.8172 => 0.9769, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 19.35% (0.6456 => 0.7705, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.14% (0.1029 => 0.1226, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.78% (0.0953 => 0.1132, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 18.65% (10.3673 => 12.3004, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.51% (0.2107 => 0.2497, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 18.51% (0.1151 => 0.1364, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 18.46% (0.3423 => 0.4055, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 18.22% (0.7433 => 0.8787, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.67% (0.5020 => 0.5907, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.48% (0.2758 => 0.3240, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.44% (0.0648 => 0.0761, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 17.42% (3.8723 => 4.5469, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.36% (0.5569 => 0.6536, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3870, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.11% (0.9765 => 1.1436, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.03% (0.0834 => 0.0976, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.96% (0.3307 => 0.3868, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.87% (0.6450 => 0.7538, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 16.82% (2.0273 => 2.3683, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.47% (0.1117 => 0.1301, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.47% (0.5981 => 0.6966, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.42% (0.2065 => 0.2404, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.38% (0.8101 => 0.9428, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: 16.26% (0.0818 => 0.0951, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 16.23% (2.2969 => 2.6696, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 16.09% (0.3387 => 0.3932, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 15.96% (0.2049 => 0.2376, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.91% (0.3180 => 0.3686, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.84% (0.8067 => 0.9345, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.75% (0.3441 => 0.3983, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.71% (0.1044 => 0.1208, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.66% (1.1861 => 1.3718, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.51% (0.0838 => 0.0968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.02% (0.3283 => 0.3776, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary: 14.88% (0.3232 => 0.3713, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.86% (0.8921 => 1.0247, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 14.07% (0.1144 => 0.1305, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.72% (1.5603 => 1.7743, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.70% (0.0759 => 0.0863, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.33% (0.2603 => 0.2950, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 13.06% (17.1811 => 19.4250, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary2: 12.99% (0.3379 => 0.3818, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.75% (14.3668 => 16.1984, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.52% (0.3865 => 0.4349, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 12.52% (0.3092 => 0.3479, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.73% (0.3427 => 0.3829, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.69% (0.4636 => 0.5178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.40% (0.4203 => 0.4682, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.21% (0.4103 => 0.4563, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: 10.91% (0.3282 => 0.3640, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 10.80% (0.3603 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 10.77% (0.3927 => 0.4350, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.55% (0.3886 => 0.4296, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 10.50% (0.4048 => 0.4473, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 10.43% (0.3422 => 0.3779, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 10.04% (0.3684 => 0.4054, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.78% (0.3826 => 0.4200, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.50% (0.3516 => 0.3850, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.47% (0.4064 => 0.4449, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.45% (0.3694 => 0.4043, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.41% (0.3561 => 0.3896, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.40% (0.3543 => 0.3876, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/trivial-interface: 9.39% (0.3473 => 0.3799, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 9.37% (0.3543 => 0.3875, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 9.11% (63.2438 => 69.0024, std.dev.: 0.0196) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.69% (0.1438 => 0.1563, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 8.58% (0.2831 => 0.3074, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.97% (2.0665 => 2.2312, std.dev.: 0.0083) MultiSource/Applications/hexxagon/hexxagon: 7.94% (1.2842 => 1.3862, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.91% (0.4879 => 0.5265, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 7.91% (0.2871 => 0.3098, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.6030 => 0.6504, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 7.65% (0.2877 => 0.3097, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.64% (0.3650 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.62% (0.7326 => 0.7884, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.50% (0.3162 => 0.3399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.45% (0.2872 => 0.3086, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2905 => 0.3121, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (0.3935 => 0.4227, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.30% (0.2891 => 0.3102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.97% (0.2756 => 0.2948, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.97% (2.2022 => 2.3556, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/wc: 6.88% (0.3052 => 0.3262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 6.85% (0.2802 => 0.2994, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 6.79% (0.2725 => 0.2910, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.70% (0.3136 => 0.3346, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.66% (0.2793 => 0.2979, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 6.63% (0.2714 => 0.2894, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.60% (7.9617 => 8.4870, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.87% (0.2266 => 0.2399, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2476, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4696, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3134, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.48% (0.9957 => 1.0304, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0218) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.6802 => 8.9257, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.08% (9.1159 => 9.3054, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.78% (0.8333 => 0.8481, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6395 => 3.7024, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2866, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.39% (10.3460 => 10.4901, std.dev.: 0.0280) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.13% (5.2763 => 1.2066, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.59% (0.8651 => 0.2112, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.38% (5.3855 => 4.4494, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.07% (5.3526 => 4.4390, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -11.07% (10.4361 => 9.2813, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.98% (1.7609 => 1.6203, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9605, std.dev.: 0.0363) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.02% (1.9577 => 0.6652, std.dev.: 0.0041) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4288, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8548, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0041, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.93% (2.6778 => 2.0906, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0013) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -13.16% (3.1443 => 2.7306, std.dev.: 0.0027) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2545, std.dev.: 0.0401) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.62% (1.2373 => 1.1678, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7036, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.67% (10.2830 => 9.8031, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: -1.51% (3.6994 => 3.6434, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.10% (0.1485 => 0.1335, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0021) Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 14:51:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 16:51:23 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130116225123.1280F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7663?compare_to=7659&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7663, Order: 172650, Start Time: 2013-01-16 20:44:06, End Time: 2013-01-16 22:51:31 To: 7659, Order: 172630, Start Time: 2013-01-16 18:16:31, End Time: 2013-01-16 20:24:03 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 13 (27 on baseline) Performance Improvements: 19 (34 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1031 (1002 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-14-AtExit: 60.39% (0.0207 => 0.0332, std.dev.: 0.0018) SingleSource/UnitTests/2002-05-03-NotTest: 54.27% (0.0199 => 0.0307, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 47.27% (0.0567 => 0.0835, std.dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: 28.27% (9.0825 => 11.6501, std.dev.: 0.2522) SingleSource/Benchmarks/Shootout-C++/strcat: 6.87% (0.2038 => 0.2178, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: 3.93% (0.2571 => 0.2672, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.65% (1.7913 => 1.8566, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 24.10% (3.9809 => 4.9404, std.dev.: 0.1070) SingleSource/Benchmarks/Linpack/linpack-pc: 20.87% (42.3206 => 51.1524, std.dev.: 1.1635) MultiSource/Benchmarks/nbench/nbench: 20.77% (17.8854 => 21.5997, std.dev.: 0.8950) SingleSource/Benchmarks/Shootout-C++/hash: 5.81% (0.6177 => 0.6536, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 2.18% (0.5377 => 0.5494, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.64% (2.7712 => 2.8166, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-21-UnionBitfields: -41.84% (0.0435 => 0.0253, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -40.72% (0.1255 => 0.0744, std.dev.: 0.0087) SingleSource/Regression/C++/fixups: -37.47% (0.0387 => 0.0242, std.dev.: 0.0014) SingleSource/UnitTests/member-function-pointers: -34.33% (0.0335 => 0.0220, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -33.75% (0.1034 => 0.0685, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -30.81% (0.2444 => 0.1691, std.dev.: 0.0034) SingleSource/Regression/C++/EH/function_try_block: -30.65% (0.0447 => 0.0310, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -20.39% (1.5926 => 1.2678, std.dev.: 0.0768) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.31% (0.4979 => 0.4117, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -7.74% (11.1071 => 10.2474, std.dev.: 0.1248) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.42% (1.1184 => 1.0466, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -6.09% (0.9354 => 0.8784, std.dev.: 0.0123) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.04% (0.3712 => 0.3525, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.42% (1.4016 => 1.3536, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.03% (0.9516 => 0.9228, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -8.13% (0.5756 => 0.5288, std.dev.: 0.0138) SingleSource/Benchmarks/Stanford/Puzzle: -5.64% (0.1863 => 0.1758, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.20% (1.6363 => 1.6167, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -1.15% (3.6436 => 3.6018, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.66% (1.1314 => 1.1126, std.dev.: 0.0768) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.91% (0.0224 => 0.0235, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.51% (0.0438 => 0.0449, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.62% (0.0338 => 0.0357, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.36% (0.0321 => 0.0335, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.46% (0.0516 => 0.0493, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: 6.25% (0.0208 => 0.0221, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/test1: 5.83% (0.0223 => 0.0236, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.80% (0.0251 => 0.0253, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.68% (0.1460 => 0.1470, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -5.84% (1.2463 => 1.1735, std.dev.: 0.2029) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.13% (0.3986 => 0.3991, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.96% (0.1513 => 0.1588, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -16.21% (0.1277 => 0.1070, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.15% (0.0289 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.91% (0.0569 => 0.0614, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1503 => 1.1512, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.14% (0.0028 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.81% (0.0618 => 0.0613, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.80% (0.0287 => 0.0318, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7442 => 0.7401, std.dev.: 0.0336) SingleSource/Regression/C/2003-05-21-UnionBitfields: -90.00% (0.0010 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.94% (0.0072 => 0.0095, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.70% (12.8801 => 12.7901, std.dev.: 0.1199) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2004-02-02-NegativeZero: 170.00% (0.0060 => 0.0162, std.dev.: 0.0030) SingleSource/UnitTests/printargs: 169.57% (0.0092 => 0.0248, std.dev.: 0.0032) SingleSource/UnitTests/2005-11-29-LongSwitch: 78.08% (0.0146 => 0.0260, std.dev.: 0.0004) SingleSource/Regression/C/2008-01-07-LongDouble: 77.94% (0.0136 => 0.0242, std.dev.: 0.0013) SingleSource/UnitTests/2003-10-13-SwitchTest: 73.51% (0.0151 => 0.0262, std.dev.: 0.0007) SingleSource/Regression/C/PR1386: 71.14% (0.0149 => 0.0255, std.dev.: 0.0006) SingleSource/UnitTests/2003-09-18-BitFieldTest: 66.67% (0.0153 => 0.0255, std.dev.: 0.0004) SingleSource/UnitTests/2003-05-14-AtExit: 65.17% (0.0201 => 0.0332, std.dev.: 0.0018) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 63.77% (0.0403 => 0.0660, std.dev.: 0.0020) SingleSource/UnitTests/2002-05-03-NotTest: 60.73% (0.0191 => 0.0307, std.dev.: 0.0016) SingleSource/UnitTests/2002-05-02-CastTest2: 58.00% (0.0200 => 0.0316, std.dev.: 0.0039) SingleSource/Regression/C++/EH/ctor_dtor_count: 56.92% (0.0195 => 0.0306, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: 44.46% (0.0578 => 0.0835, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/strcat: 42.31% (0.0286 => 0.0407, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: 17.83% (9.8875 => 11.6501, std.dev.: 0.2522) MultiSource/Benchmarks/mafft/pairlocalalign: 7.64% (9.5202 => 10.2474, std.dev.: 0.1248) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.92% (23.5861 => 25.2191, std.dev.: 0.4766) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.20% (0.1963 => 0.2065, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.42% (1.8127 => 1.8566, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320950.00% (0.0008 => 2.5684, std.dev.: 0.0169) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.86% (1.1825 => 2.4106, std.dev.: 0.0987) SingleSource/Benchmarks/CoyoteBench/fftbench: 30.20% (1.6547 => 2.1545, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.51% (4.2042 => 4.9404, std.dev.: 0.1070) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.34% (3.7074 => 4.3132, std.dev.: 0.1601) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.84% (0.2562 => 0.2891, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 3.32% (7.2040 => 7.4429, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.68% (2.7432 => 2.8166, std.dev.: 0.0120) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.23% (0.0808 => 0.0491, std.dev.: 0.0098) MultiSource/Applications/hbd/hbd: -19.11% (1.8964 => 1.5340, std.dev.: 0.0523) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.52% (0.1079 => 0.0890, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.40% (0.0862 => 0.0712, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.07% (0.7686 => 0.6374, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.67% (1.0986 => 0.9264, std.dev.: 0.0512) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.48% (0.4074 => 0.3525, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -12.15% (1.1433 => 1.0044, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.54% (1.5131 => 1.3536, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.11% (0.7693 => 0.6992, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.93% (1.6874 => 1.5367, std.dev.: 0.0470) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.84% (1.1498 => 1.0482, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.31% (0.6885 => 0.6313, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.23% (0.9124 => 0.8373, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.42% (0.3560 => 0.3296, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.38% (0.5746 => 0.5322, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.37% (10.2703 => 9.5138, std.dev.: 0.1606) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.95% (6.4235 => 5.9772, std.dev.: 0.1328) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.93% (1.0017 => 0.9323, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.03% (0.9588 => 0.9010, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.64% (0.9550 => 0.9011, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.55% (0.9507 => 0.8979, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.19% (0.9127 => 0.8745, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.11% (0.3093 => 0.2966, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.70% (0.3462 => 0.3334, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -3.42% (1.4392 => 1.3900, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.99% (0.9512 => 0.9228, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -3.49% (3.5443 => 3.4205, std.dev.: 0.0437) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.23% (0.3406 => 0.3296, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: -2.33% (1.4244 => 1.3912, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3151, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1539, std.dev.: 0.0114) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.65% (1.2047 => 1.1126, std.dev.: 0.0768) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.86% (0.0233 => 0.0235, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.44% (0.0451 => 0.0449, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.39% (0.0394 => 0.0357, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.13% (0.0328 => 0.0335, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.79% (0.0445 => 0.0493, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/casts: 3.76% (0.0213 => 0.0221, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/test1: 3.96% (0.0227 => 0.0236, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.92% (0.1530 => 0.1470, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -39.17% (1.9293 => 1.1735, std.dev.: 0.2029) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.43% (0.4049 => 0.3991, std.dev.: 0.0474) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.17% (0.1510 => 0.1588, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.41% (0.0978 => 0.1070, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.07% (0.0590 => 0.0614, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1617 => 1.1512, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0336) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.26% (0.0092 => 0.0095, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7781 => 12.7901, std.dev.: 0.1199) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 15:58:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 17:58:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130116235814.712D22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7664?compare_to=7660&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7664, Order: 172660, Start Time: 2013-01-16 22:24:03, End Time: 2013-01-16 23:58:18 To: 7660, Order: 172648, Start Time: 2013-01-16 20:26:47, End Time: 2013-01-16 22:00:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (126 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.95% (0.0717 => 0.1197, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.01% (0.0974 => 0.1578, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 52.06% (0.0267 => 0.0406, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.00% (0.1500 => 0.2190, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.84% (0.1132 => 0.1549, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.73% (0.0599 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.50% (0.6395 => 0.8729, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.43% (0.6395 => 0.8597, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.96% (0.6260 => 0.8323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.51% (0.5805 => 0.7634, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.49% (0.5688 => 0.7479, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.20% (0.5456 => 0.7158, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.66% (0.6230 => 0.8140, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.63% (0.5941 => 0.7761, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.62% (0.5849 => 0.7640, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.43% (0.5567 => 0.7261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.39% (0.5575 => 0.7269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.25% (0.5581 => 0.7269, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.78% (0.5802 => 0.7530, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.60% (0.6033 => 0.7819, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.34% (0.5705 => 0.7379, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.13% (0.5859 => 0.7566, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.80% (0.6440 => 0.8295, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.62% (0.5570 => 0.7164, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.52% (0.5925 => 0.7615, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.48% (0.5857 => 0.7525, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.40% (0.5478 => 0.7034, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.39% (0.5569 => 0.7150, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.38% (0.5591 => 0.7178, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.59% (1.6474 => 2.1019, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.50% (0.6189 => 0.7891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.48% (0.6052 => 0.7715, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.07% (0.6446 => 0.8191, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.00% (0.5863 => 0.7446, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.82% (0.6304 => 0.7995, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.84% (0.0445 => 0.0560, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.67% (0.6681 => 0.8396, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.64% (0.6194 => 0.7782, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.41% (0.6660 => 0.8352, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.23% (0.6297 => 0.7886, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.74% (0.6667 => 0.8250, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.70% (0.7524 => 0.9232, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.75% (0.7339 => 0.8935, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.44% (2.2587 => 2.7204, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 17.24% (1.1450 => 1.3424, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.72% (0.3357 => 0.3851, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.02% (0.1982 => 0.2240, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.61% (1.6364 => 1.8428, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (4.5069 => 5.0666, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.55% (0.4916 => 0.5484, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 11.16% (0.4515 => 0.5019, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.46% (3.5339 => 3.9037, std.dev.: 0.0171) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.73% (0.2385 => 0.2617, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.25% (9.2283 => 10.0819, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.04% (0.7021 => 0.7656, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 7.99% (1.2515 => 1.3515, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.30% (0.5329 => 0.5718, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.00% (1.4642 => 1.5667, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.99% (1.2784 => 1.3678, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash: 6.30% (0.4524 => 0.4809, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 5.97% (0.4861 => 0.5151, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 5.91% (0.1761 => 0.1865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3255 => 0.3445, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.10% (0.3319 => 0.3455, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: 3.78% (5.0226 => 5.2126, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3.20% (1.3864 => 1.4308, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (5.4682 => 5.6272, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6750 => 0.6927, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.59% (22.4056 => 22.9861, std.dev.: 0.0214) MultiSource/Applications/d/make_dparser: 2.57% (3.5154 => 3.6057, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.96% (0.8418 => 0.8583, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 1.79% (0.7447 => 0.7580, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 1.75% (15.5079 => 15.7792, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.44% (0.9557 => 0.9695, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.41% (1.3722 => 1.3915, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.07% (16.1920 => 16.3651, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.06% (4.8161 => 4.8670, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6648, std.dev.: 0.0183) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9531 => 1.0278, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5011, std.dev.: 0.1246) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6016, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8210 => 28.2102, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.32% (0.3194 => 0.2992, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -5.30% (0.3812 => 0.3610, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.29% (0.3837 => 0.3634, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -5.24% (0.3896 => 0.3692, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-3: -5.22% (0.3848 => 0.3647, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -5.16% (0.4033 => 0.3825, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: -4.98% (0.4176 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3884 => 0.3704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.55% (0.2903 => 0.2771, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.54% (0.3323 => 0.3172, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.52% (0.4199 => 0.4009, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -4.29% (0.2939 => 0.2813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.23% (0.9852 => 0.9435, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.23% (0.2933 => 0.2809, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.21% (2.1713 => 2.0799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.20% (0.3026 => 0.2899, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.06% (0.3252 => 0.3120, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.02% (0.4280 => 0.4108, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.95% (1.3148 => 1.2628, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -3.95% (0.2989 => 0.2871, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -3.92% (0.3059 => 0.2939, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: -3.79% (0.2849 => 0.2741, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.79% (0.3142 => 0.3023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.78% (0.3016 => 0.2902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.61% (0.3658 => 0.3526, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.55% (0.6484 => 0.6254, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -3.51% (2.4924 => 2.4050, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (0.3025 => 0.2920, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.35% (0.9542 => 0.9222, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -3.33% (0.7779 => 0.7520, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.18% (0.4151 => 0.4019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (0.3621 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.10% (0.3931 => 0.3809, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.10% (0.3867 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.89% (0.4321 => 0.4196, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.78% (0.4427 => 0.4304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.75% (0.4248 => 0.4131, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.68% (0.7919 => 0.7707, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2337, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.55% (0.4083 => 0.3979, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.43% (0.4813 => 0.4696, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.11% (1.0544 => 1.0322, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: -1.90% (0.7982 => 0.7830, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -1.76% (4.3330 => 4.2569, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (1.2221 => 1.2020, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -1.63% (0.9179 => 0.9029, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.57% (0.7198 => 0.7085, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.42% (1.2210 => 1.2037, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.28% (0.8521 => 0.8412, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.23% (14.2083 => 14.0341, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.22% (1.2300 => 1.2150, std.dev.: 0.0024) MultiSource/Applications/siod/siod: -1.12% (2.4021 => 2.3751, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.76% (1.8100 => 0.6740, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.21% (1.3643 => 1.0340, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7560, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: -23.38% (83.5423 => 64.0121, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1273, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3389, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.30% (5.5807 => 5.3965, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7607, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.7241 => 3.6488, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4737, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.47% (1.6307 => 1.6068, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6219 => 1.5982, std.dev.: 0.0060) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1977, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6694, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -1.01% (1.4516 => 1.4370, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 17:14:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 19:14:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117011443.162782A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7665?compare_to=7662&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7665, Order: 172660, Start Time: 2013-01-16 23:03:17, End Time: 2013-01-17 01:14:50 To: 7662, Order: 172642, Start Time: 2013-01-16 20:20:43, End Time: 2013-01-16 22:32:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.48% (10.3227 => 10.4752, std.dev.: 0.0263) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/lencod/lencod: -1.37% (36.1713 => 35.6751, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.03% (1.2066 => 1.1942, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.22% (0.1335 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (0.0673 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8479 => 499.8288, std.dev.: 0.0133) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.85% (1.1277 => 499.8288, std.dev.: 0.0133) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.86% (0.5229 => 1.6673, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 20.62% (14.9895 => 18.0806, std.dev.: 0.0175) MultiSource/Applications/kimwitu++/kc: 43.05% (14.1553 => 20.2489, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (4.1105 => 4.8529, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.90% (1.1048 => 1.7776, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 435.13% (7.1582 => 38.3058, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.62% (3.4629 => 6.3587, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.92% (0.6222 => 1.0821, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10251.53% (0.0720 => 7.4531, std.dev.: 0.0037) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11158500.00% (0.0001 => 11.1586, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493000.00% (0.0001 => 5.4931, std.dev.: 0.0107) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 835.79% (1.1194 => 10.4752, std.dev.: 0.0263) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 152.52% (22.1758 => 55.9979, std.dev.: 0.0187) SingleSource/Benchmarks/Misc/lowercase: 124.61% (0.0256 => 0.0575, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.10% (0.0929 => 0.1766, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 89.71% (0.0243 => 0.0461, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 72.11% (0.1463 => 0.2518, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 62.62% (21.9371 => 35.6751, std.dev.: 0.0198) SingleSource/Benchmarks/Stanford/IntMM: 59.39% (0.0394 => 0.0628, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.17% (2.9384 => 4.6183, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.14% (7.0540 => 11.0844, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 50.85% (0.1056 => 0.1593, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.35% (1.5859 => 2.3844, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.47% (8.1363 => 12.1614, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.45% (2.2024 => 3.0933, std.dev.: 0.0162) MultiSource/Applications/sgefa/sgefa: 39.95% (0.3109 => 0.4351, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0006) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.36% (1.5415 => 2.0712, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.17% (4.2646 => 5.7217, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.50% (0.4615 => 0.6115, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.81% (0.2700 => 0.3532, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 30.47% (1.1642 => 1.5189, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.21% (0.2271 => 0.2957, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 30.13% (0.1175 => 0.1529, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.07% (0.1892 => 0.2461, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 29.43% (0.4299 => 0.5564, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.76% (0.6675 => 0.8595, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.54% (0.0719 => 0.0917, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.88% (0.5105 => 0.6477, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 26.63% (9.4845 => 12.0102, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/08-main/main: 26.55% (0.2554 => 0.3232, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 25.95% (1.0722 => 1.3504, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.88% (0.1584 => 0.1994, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.74% (0.1655 => 0.2081, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.48% (3.8922 => 4.8841, std.dev.: 0.0126) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.84% (0.0793 => 0.0990, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.57% (1.4186 => 1.7671, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.87% (0.1906 => 0.2361, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.49% (0.3121 => 0.3854, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 22.52% (5.7591 => 7.0561, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 22.36% (0.4289 => 0.5248, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.33% (0.0842 => 0.1030, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 22.12% (0.7115 => 0.8689, std.dev.: 0.0039) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.05% (0.1143 => 0.1395, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.80% (0.1555 => 0.1894, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 21.80% (0.4620 => 0.5627) MultiSource/Benchmarks/Olden/mst/mst: 21.75% (0.1163 => 0.1416, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.54% (4.9449 => 6.0100, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 21.13% (3.3354 => 4.0403, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.99% (0.0886 => 0.1072, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.72% (0.1940 => 0.2342, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.71% (5.0018 => 6.0379, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/whetstone: 20.61% (0.0660 => 0.0796, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.47% (1.3050 => 1.5721, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 20.40% (0.3098 => 0.3730, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.06% (0.1236 => 0.1484, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 19.92% (0.7835 => 0.9396, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 19.79% (0.0662 => 0.0793, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.49% (0.5860 => 0.7002, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.30% (0.8172 => 0.9749, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 18.93% (0.6456 => 0.7678, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 18.68% (0.1151 => 0.1366, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 18.55% (0.3423 => 0.4058, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 18.51% (0.7433 => 0.8809, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.47% (0.0953 => 0.1129, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.27% (0.2107 => 0.2492, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.21% (0.1510 => 0.1785, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 17.95% (10.3673 => 12.2287, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.89% (0.5020 => 0.5918, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 17.52% (3.8723 => 4.5508, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.44% (0.2758 => 0.3239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.40% (0.5569 => 0.6538, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 17.10% (1.1840 => 1.3865, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.10% (0.9765 => 1.1435, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.99% (0.3307 => 0.3869, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.79% (2.0273 => 2.3676, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.65% (0.1117 => 0.1303, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 16.50% (0.0818 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.39% (0.5981 => 0.6961, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.37% (0.2065 => 0.2403, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.25% (0.6450 => 0.7498, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 15.99% (2.2969 => 2.6642, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.88% (0.3180 => 0.3685, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 15.77% (0.3387 => 0.3921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.67% (0.2049 => 0.2370, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.55% (0.3441 => 0.3976, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.18% (1.1861 => 1.3662, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.12% (0.8067 => 0.9287, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: 14.74% (0.8921 => 1.0236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 14.50% (0.3283 => 0.3759, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.16% (0.1144 => 0.1306) SingleSource/Benchmarks/Shootout-C++/ary: 13.95% (0.3232 => 0.3683, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 13.83% (0.0759 => 0.0864, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 13.33% (17.1811 => 19.4715, std.dev.: 0.0094) MultiSource/Applications/hbd/hbd: 13.11% (1.5603 => 1.7649, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.49% (14.3668 => 16.1617, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 12.31% (0.3379 => 0.3795, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.72% (0.3865 => 0.4318, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.60% (0.4636 => 0.5174, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.53% (0.3427 => 0.3822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.13% (0.3927 => 0.4364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.85% (0.4203 => 0.4659, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 10.80% (0.4103 => 0.4546, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.70% (0.2430 => 0.2690, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 10.21% (0.3603 => 0.3971, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 10.15% (0.4048 => 0.4459, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 9.76% (0.3422 => 0.3756, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.67% (0.3516 => 0.3856, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 9.64% (0.3497 => 0.3834, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.54% (0.3826 => 0.4191, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 9.47% (0.3684 => 0.4033, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.46% (0.1268 => 0.1388, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 9.30% (63.2438 => 69.1280, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.74% (0.4064 => 0.4419, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.28% (0.1438 => 0.1557, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 7.84% (0.2831 => 0.3053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.62% (0.4879 => 0.5251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 7.45% (0.2871 => 0.3085, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 7.45% (1.2842 => 1.3799, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.41% (2.0665 => 2.2197, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.07% (2.2022 => 2.3579, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 6.92% (0.2877 => 0.3076, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.91% (0.3935 => 0.4207, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.86% (0.2872 => 0.3069, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.83% (0.3162 => 0.3378, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.73% (7.9617 => 8.4976, std.dev.: 0.0164) SingleSource/Regression/C++/ofstream_ctor: 6.68% (0.2905 => 0.3099, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.54% (0.2891 => 0.3080, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.31% (0.2756 => 0.2930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 6.29% (0.3052 => 0.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 6.25% (0.2802 => 0.2977, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.18% (0.2266 => 0.2406, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.05% (0.2793 => 0.2962, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 5.96% (0.3136 => 0.3323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 5.94% (0.2725 => 0.2887, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 5.82% (0.2714 => 0.2872, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2501, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4257, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (4.2280 => 4.4758, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.25% (0.9957 => 1.0281, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9047, std.dev.: 0.0256) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.24% (3.6395 => 3.7212, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2893, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2831, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4536, std.dev.: 0.0249) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.37% (5.2763 => 1.1942, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -75.17% (0.8651 => 0.2148, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.91% (5.3855 => 4.4748, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.58% (5.3526 => 4.4652, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -11.38% (10.4361 => 9.2480, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.96% (1.7609 => 1.6207, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -7.94% (54.1659 => 49.8657, std.dev.: 0.0124) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.58% (1.9577 => 0.6542, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.52% (1.5373 => 1.0220, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4215, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8585, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0073, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.87% (2.6778 => 2.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2899, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.56% (1.2373 => 1.1561, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7035, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.95% (0.4808 => 0.4570, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8020, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/flops-5: -4.52% (1.5835 => 1.5119, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9576, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.60% (3.6994 => 3.6401, std.dev.: 0.0144) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7221 => 3.6694, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2355, std.dev.: 0.0028) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0010) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 17:15:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 19:15:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117011524.2BED52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7666?compare_to=7663&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7666, Order: 172664, Start Time: 2013-01-16 23:09:49, End Time: 2013-01-17 01:15:31 To: 7663, Order: 172650, Start Time: 2013-01-16 20:44:06, End Time: 2013-01-16 22:51:31 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 38 (28 on baseline) Performance Improvements: 20 (10 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1005 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-5: 51.39% (0.0323 => 0.0489, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.08% (0.9139 => 1.1614, std.dev.: 0.0535) MultiSource/Applications/spiff/spiff: 15.35% (0.8984 => 1.0363, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 14.32% (4.4606 => 5.0993, std.dev.: 0.1758) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2917 => 0.3326, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.18% (0.9394 => 1.0350, std.dev.: 0.0270) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.15% (1.5367 => 1.6926, std.dev.: 0.0216) MultiSource/Applications/sqlite3/sqlite3: 9.64% (16.3298 => 17.9045, std.dev.: 0.0849) MultiSource/Applications/ClamAV/clamscan: 9.62% (16.1661 => 17.7217, std.dev.: 0.2724) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.81% (0.8933 => 0.9720, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.63% (0.4656 => 0.5058, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/health/health: 8.16% (0.1459 => 0.1578, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.75% (0.9530 => 1.0269, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.36% (0.9769 => 1.0488, std.dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: 6.56% (17.0345 => 18.1523, std.dev.: 0.1466) MultiSource/Applications/oggenc/oggenc: 5.89% (5.3525 => 5.6679, std.dev.: 0.0336) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (5.9772 => 6.3234, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.75% (0.8621 => 0.9117, std.dev.: 0.0108) MultiSource/Applications/JM/ldecod/ldecod: 5.74% (7.3815 => 7.8051, std.dev.: 0.1060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.65% (0.8568 => 0.9052, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.55% (14.6491 => 15.4614, std.dev.: 0.1985) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.25% (0.6933 => 0.7297, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.22% (0.8502 => 0.8946, std.dev.: 0.0038) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.33% (45.7182 => 47.6985, std.dev.: 0.7033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.25% (0.2966 => 0.3092, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 3.34% (16.0788 => 16.6153, std.dev.: 0.0557) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: 65.71% (0.0245 => 0.0406, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.63% (1.4657 => 1.8706, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_container: 27.55% (4.7800 => 6.0970, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.83% (0.0810 => 0.1003, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 12.28% (8.3978 => 9.4292, std.dev.: 0.3228) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.71% (2.5704 => 2.8458, std.dev.: 0.0713) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.41% (0.3184 => 0.3388, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (3.4205 => 3.5433, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: 3.14% (4.3586 => 4.4953, std.dev.: 0.0232) MultiSource/Applications/lua/lua: 2.23% (28.5173 => 29.1526, std.dev.: 0.2179) SingleSource/Benchmarks/Misc/pi: 1.56% (2.1835 => 2.2175, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: 1.24% (1.6167 => 1.6368, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/PR491: -58.42% (0.0190 => 0.0079, std.dev.: 0.0031) SingleSource/UnitTests/2003-10-13-SwitchTest: -47.33% (0.0262 => 0.0138, std.dev.: 0.0048) SingleSource/UnitTests/2003-05-14-AtExit: -43.07% (0.0332 => 0.0189, std.dev.: 0.0010) SingleSource/UnitTests/2002-05-03-NotTest: -42.67% (0.0307 => 0.0176, std.dev.: 0.0011) SingleSource/Regression/C/PR1386: -41.57% (0.0255 => 0.0149, std.dev.: 0.0004) SingleSource/UnitTests/2005-11-29-LongSwitch: -40.38% (0.0260 => 0.0155, std.dev.: 0.0027) SingleSource/UnitTests/2003-09-18-BitFieldTest: -40.00% (0.0255 => 0.0153, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: -28.74% (0.0835 => 0.0595, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -26.37% (11.6501 => 8.5785, std.dev.: 0.7790) SingleSource/Regression/C/bigstack: -22.75% (0.0589 => 0.0455, std.dev.: 0.0040) SingleSource/UnitTests/2006-12-11-LoadConstants: -21.45% (0.1590 => 0.1249, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -15.34% (0.0730 => 0.0618, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/rem: -8.37% (0.1242 => 0.1138, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.01% (0.4768 => 0.4529, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -25.31% (2.1545 => 1.6092, std.dev.: 0.1263) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.90% (5.6434 => 5.3671, std.dev.: 0.1071) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.63% (2.8166 => 2.7424, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.20% (1.7117 => 1.6740, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.76% (2.5829 => 2.5375, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.46% (6.5435 => 6.4482, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.00% (1.1126 => 1.1348, std.dev.: 0.2256) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.53% (0.0235 => 0.0222, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.01% (0.0449 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.16% (0.0357 => 0.0335, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.88% (0.0335 => 0.0322, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.78% (0.0493 => 0.0430, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -6.33% (0.0221 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -6.36% (0.0236 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.59% (0.1470 => 0.1508, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 34.32% (1.1735 => 1.5762, std.dev.: 0.1535) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.90% (0.3991 => 0.4386, std.dev.: 0.0654) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.51% (0.1588 => 0.1437, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.75% (0.1070 => 0.0955, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.97% (0.0277 => 0.0266, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.49% (0.0614 => 0.0568, std.dev.: 0.0186) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1512 => 1.1487, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.31% (0.0613 => 0.0605, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.52% (0.0318 => 0.0361, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.97% (0.7401 => 0.7621, std.dev.: 0.0347) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.42% (0.0095 => 0.0068, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7901 => 12.7567, std.dev.: 0.0251) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-5: 51.39% (0.0323 => 0.0489, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/factor: 45.54% (0.0336 => 0.0489, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.13% (0.2993 => 0.3326, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 11.01% (4.5936 => 5.0993, std.dev.: 0.1758) MultiSource/Applications/JM/lencod/lencod: 8.69% (16.7012 => 18.1523, std.dev.: 0.1466) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.03% (44.1538 => 47.6985, std.dev.: 0.7033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.50% (23.5861 => 25.3554, std.dev.: 0.6142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.29% (0.9867 => 1.0488, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.22% (0.4762 => 0.5058, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: 6.15% (7.3529 => 7.8051, std.dev.: 0.1060) MultiSource/Applications/oggenc/oggenc: 5.84% (5.3553 => 5.6679, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.36% (0.8736 => 0.9117, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.30% (0.6996 => 0.7297, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.35% (0.9405 => 0.9720, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.45% (0.8732 => 0.8946, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.94% (17.5634 => 17.9045, std.dev.: 0.0849) MultiSource/Applications/SPASS/SPASS: 1.02% (16.4479 => 16.6153, std.dev.: 0.0557) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321250.00% (0.0008 => 2.5708, std.dev.: 0.0295) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.62% (1.1825 => 2.3723, std.dev.: 0.0495) SingleSource/Benchmarks/Stanford/Quicksort: 84.55% (0.0220 => 0.0406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.92% (5.0421 => 6.0970, std.dev.: 0.0195) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.70% (0.0845 => 0.1003, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.92% (3.7074 => 4.3717, std.dev.: 0.0603) MultiSource/Benchmarks/nbench/nbench: 5.75% (20.5117 => 21.6919, std.dev.: 0.3768) MultiSource/Applications/JM/lencod/lencod: 3.99% (6.8159 => 7.0878, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/pi: 3.67% (2.1390 => 2.2175, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 3.05% (7.2040 => 7.4237, std.dev.: 0.0851) MultiSource/Applications/siod/siod: 1.23% (3.5910 => 3.6351, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.45% (0.7686 => 0.6575, std.dev.: 0.0393) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.74% (0.4074 => 0.3555, std.dev.: 0.0152) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.21% (1.2154 => 1.1035, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.56% (6.4235 => 6.3234, std.dev.: 0.0379) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.32% (0.1164 => 0.0974, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.03% (1.4588 => 1.3417, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3654 => 0.3426, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/lists: -3.37% (17.2182 => 16.6375, std.dev.: 0.2078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.32% (23.3986 => 22.6209, std.dev.: 0.2523) MultiSource/Applications/aha/aha: -1.06% (3.5321 => 3.4946, std.dev.: 0.0129) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.80% (1.2047 => 1.1348, std.dev.: 0.2256) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.44% (0.1530 => 0.1508, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -18.30% (1.9293 => 1.5762, std.dev.: 0.1535) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 8.32% (0.4049 => 0.4386, std.dev.: 0.0654) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.83% (0.1510 => 0.1437, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.35% (0.0978 => 0.0955, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.73% (0.0590 => 0.0568, std.dev.: 0.0186) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.12% (1.1617 => 1.1487, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0610 => 0.0605, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.70% (0.0268 => 0.0361, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.47% (0.7437 => 0.7621, std.dev.: 0.0347) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.09% (0.0092 => 0.0068, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7781 => 12.7567, std.dev.: 0.0251) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 17:55:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 19:55:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117015536.B062A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7667?compare_to=7664&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7667, Order: 172678, Start Time: 2013-01-17 00:21:41, End Time: 2013-01-17 01:55:42 To: 7664, Order: 172660, Start Time: 2013-01-16 22:24:03, End Time: 2013-01-16 23:58:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.09% (0.0717 => 0.1198) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.91% (0.0974 => 0.1577, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.06% (0.0267 => 0.0406) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.93% (0.1132 => 0.1550, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.51% (0.6395 => 0.8730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.53% (0.6395 => 0.8603, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.84% (0.6260 => 0.8316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.56% (0.5688 => 0.7483, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.51% (0.5805 => 0.7634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.16% (0.5456 => 0.7156, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.74% (0.6230 => 0.8145, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.55% (0.5849 => 0.7636, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.48% (0.5941 => 0.7752, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.48% (0.5575 => 0.7274, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.43% (0.5567 => 0.7261, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.17% (0.5581 => 0.7265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.80% (0.5802 => 0.7531, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.52% (0.6033 => 0.7814, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.22% (0.5705 => 0.7372, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.96% (0.5859 => 0.7556, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.74% (0.6440 => 0.8291, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.62% (0.5570 => 0.7164, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.50% (0.5857 => 0.7526, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.42% (0.5478 => 0.7035, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.42% (0.5925 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.38% (0.5591 => 0.7178, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.23% (0.5569 => 0.7141, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.06% (0.6676 => 0.8549, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.50% (0.6052 => 0.7716, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.48% (1.6474 => 2.1001, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.45% (0.6189 => 0.7888, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.20% (0.5863 => 0.7458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.96% (0.6446 => 0.8184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.82% (0.6304 => 0.7995, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.61% (0.6681 => 0.8392, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.54% (0.6660 => 0.8361, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.49% (0.6194 => 0.7773, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.28% (0.6297 => 0.7889, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.74% (0.6667 => 0.8250, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.77% (0.7524 => 0.9237, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.65% (0.7339 => 0.8928, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.38% (2.2587 => 2.7191, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 17.25% (1.1450 => 1.3425, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 14.85% (0.0707 => 0.0812, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/exptree: 13.89% (0.0864 => 0.0984, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.64% (1.6364 => 1.8433, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (4.5069 => 5.0716, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.36% (0.1982 => 0.2227, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.59% (0.4916 => 0.5486, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 11.36% (0.4515 => 0.5028, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.51% (3.5339 => 3.9054, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2385 => 0.2615, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.22% (9.2283 => 10.0788, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.17% (1.2515 => 1.3537, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.26% (0.5329 => 0.5716, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.24% (1.4642 => 1.5702, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.22% (0.1731 => 0.1856, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.14% (1.2784 => 1.3697, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.54% (0.4524 => 0.4820, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 5.91% (0.1761 => 0.1865, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.70% (0.4861 => 0.5138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.3255 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.32% (5.0226 => 5.1894, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 3.25% (1.3864 => 1.4315, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (5.4682 => 5.6229, std.dev.: 0.0148) MultiSource/Applications/d/make_dparser: 2.52% (3.5154 => 3.6040, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (22.4056 => 22.9684, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/bigfib: 2.49% (0.6750 => 0.6918, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.91% (0.7447 => 0.7589, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.70% (0.8418 => 0.8561, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 1.62% (15.5079 => 15.7586, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.3722 => 1.3912, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.22% (0.9557 => 0.9674, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.05% (16.1920 => 16.3626, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (4.0323 => 4.0744, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.39% (31.3723 => 55.6526, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.71% (0.9531 => 1.0266, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5751 => 56.3718, std.dev.: 0.1920) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0021) MultiSource/Benchmarks/llubenchmark/llu: 2.00% (3.7435 => 3.8183, std.dev.: 0.0285) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6035, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2769, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2068, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331) SingleSource/Benchmarks/Shootout-C++/objinst: -6.67% (0.3194 => 0.2981, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.22% (0.3848 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.22% (0.3831 => 0.3631, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.16% (0.3896 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.13% (0.3880 => 0.3681, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.08% (0.4033 => 0.3828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -5.00% (0.3057 => 0.2904, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.93% (0.4176 => 0.3970, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.86% (0.2903 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.84% (0.2871 => 0.2732, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.78% (0.3323 => 0.3164, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -4.77% (0.3059 => 0.2913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.74% (0.3205 => 0.3053, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.67% (0.2933 => 0.2796, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.49% (0.2428 => 0.2319, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.48% (2.1713 => 2.0740, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/property: -4.43% (0.4199 => 0.4013, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.40% (0.3252 => 0.3109, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.39% (0.2939 => 0.2810, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.25% (0.9852 => 0.9433, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.18% (0.2989 => 0.2864, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -4.13% (0.3026 => 0.2901, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.09% (0.4280 => 0.4105, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.05% (0.3016 => 0.2894, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.01% (1.3148 => 1.2621, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -3.59% (2.4924 => 2.4030, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.55% (0.3658 => 0.3528, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.47% (0.6484 => 0.6259, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.9542 => 0.9211, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (0.3621 => 0.3497, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.30% (0.4151 => 0.4014, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.28% (0.3931 => 0.3802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: -3.15% (0.4248 => 0.4114, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -3.10% (0.3867 => 0.3747, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.00% (0.4427 => 0.4294, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -2.90% (0.3788 => 0.3678, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.83% (0.7779 => 0.7559, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.65% (0.3849 => 0.3747, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2334, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.57% (0.4083 => 0.3978, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.53% (0.7919 => 0.7719, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.45% (0.4813 => 0.4695, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.18% (0.7198 => 0.7041, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.08% (1.0544 => 1.0325, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.80% (0.7982 => 0.7838, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -1.76% (0.9179 => 0.9017, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (1.2221 => 1.2016, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.58% (1.2210 => 1.2017, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -1.38% (4.3330 => 4.2730, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.38% (14.2083 => 14.0128, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.18% (1.2300 => 1.2155, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -1.14% (1.5610 => 1.5432, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -1.02% (2.4021 => 2.3776, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -64.00% (1.8100 => 0.6516, std.dev.: 0.0298) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.62% (0.1622 => 0.1028, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3128, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.19% (0.1983 => 0.1424, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.82% (1.3643 => 1.0257, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0269, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2072, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1286, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.76% (0.5142 => 0.4640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.01% (4.1534 => 3.8208, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.01% (1.0557 => 1.0239, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7703, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout/ary3: -2.31% (3.7241 => 3.6381, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.11% (1.3096 => 1.2820, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3040 => 7.1903, std.dev.: 0.0244) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4753, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.12% (1.6086 => 1.5906, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6691, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.02% (4.8776 => 4.8279, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.01% (1.4516 => 1.4370, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 18:48:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 20:48:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130117024831.0472D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7668?compare_to=7661&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7668, Order: 172660, Start Time: 2013-01-16 23:14:42, End Time: 2013-01-17 02:48:37 To: 7661, Order: 172630, Start Time: 2013-01-16 18:49:27, End Time: 2013-01-16 22:23:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (179 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.86% (2.0660 => 2.1044, std.dev.: 0.0133) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.48% (0.0625 => 0.0878, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.08% (0.1063 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.69% (0.2969 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.05% (0.5900 => 0.7437, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.78% (0.4139 => 0.5206, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.77% (0.1106 => 0.1391, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.69% (0.4253 => 0.5303, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.32% (0.0584 => 0.0726, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.95% (0.4994 => 0.6190, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.85% (0.1107 => 0.1371, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 23.37% (0.0599 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.32% (0.5000 => 0.6166, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 22.97% (0.0897 => 0.1103, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 22.63% (1.5932 => 1.9537, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.13% (0.1003 => 0.1225, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.58% (0.1103 => 0.1341, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.56% (0.1549 => 0.1883, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.98% (0.3903 => 0.4722, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 20.94% (0.1619 => 0.1958, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 20.70% (0.0604 => 0.0729, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.78% (0.4029 => 0.4826, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.2736 => 0.3266, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 19.29% (0.1218 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.29% (0.3271 => 0.3902, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 19.20% (0.0698 => 0.0832, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.15% (0.1462 => 0.1742, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.12% (0.1088 => 0.1296, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.12% (0.2014 => 0.2399, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 18.81% (0.0808 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 18.80% (0.1505 => 0.1788, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.71% (0.3890 => 0.4618, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 18.51% (1.8794 => 2.2272, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.42% (0.2866 => 0.3394, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.28% (0.5826 => 0.6891, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 18.23% (0.5546 => 0.6557, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.86% (0.5889 => 0.6941, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.54% (1.3152 => 1.5459, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.24% (0.1160 => 0.1360, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.22% (0.4658 => 0.5460, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.12% (3.5627 => 4.1728, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 17.05% (0.9697 => 1.1350, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.94% (1.6211 => 1.8957, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.87% (0.2875 => 0.3360, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 16.59% (0.1284 => 0.1497, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 16.40% (0.1421 => 0.1654, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.33% (0.2792 => 0.3248, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.30% (0.5026 => 0.5845, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.20% (4.4195 => 5.1356, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/except: 16.15% (0.2811 => 0.3265, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/random: 16.13% (0.2803 => 0.3255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.11% (0.2750 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 16.07% (0.2725 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.06% (0.2714 => 0.3150, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.01% (0.3930 => 0.4559, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: 15.96% (0.2738 => 0.3175, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.91% (0.2911 => 0.3374, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 15.89% (0.2813 => 0.3260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.89% (1.9694 => 2.2823, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 15.85% (0.3004 => 0.3480, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.84% (0.7171 => 0.8307, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.81% (2.0673 => 2.3941, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/objinst: 15.80% (0.2823 => 0.3269, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 15.79% (0.2780 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.78% (0.4361 => 0.5049, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.75% (1.9966 => 2.3110, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.70% (2.7292 => 3.1576, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 15.69% (1.0781 => 1.2473, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: 15.55% (0.9909 => 1.1450, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.52% (0.3195 => 0.3691, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 15.44% (0.3096 => 0.3574, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.34% (0.3488 => 0.4023, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 15.29% (4.2109 => 4.8546, std.dev.: 0.0176) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.21% (0.3465 => 0.3992, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.21% (0.3446 => 0.3970, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.16% (0.3060 => 0.3524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.15% (0.3267 => 0.3762, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 15.13% (0.3496 => 0.4025, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.03% (0.3460 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.02% (0.3469 => 0.3990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 15.01% (0.3258 => 0.3747, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.95% (0.3124 => 0.3591, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3317 => 0.3809, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 14.76% (0.3726 => 0.4276, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.71% (0.3650 => 0.4187, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 14.65% (1.4269 => 1.6360, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 14.58% (0.3643 => 0.4174, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.57% (0.3362 => 0.3852, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 14.55% (0.3724 => 0.4266, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 14.53% (23.5202 => 26.9382, std.dev.: 0.0294) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.41% (0.3282 => 0.3755, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.40% (0.3348 => 0.3830, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.36% (0.3678 => 0.4206, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.32% (0.7875 => 0.9003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.32% (0.3477 => 0.3975, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.23% (0.3625 => 0.4141, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 14.23% (0.4146 => 0.4736, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3690 => 0.4212, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.04% (0.3981 => 0.4540, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 14.03% (0.2566 => 0.2926, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 14.02% (0.4251 => 0.4847, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.85% (0.1090 => 0.1241, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.47% (0.3845 => 0.4363, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 13.29% (0.5012 => 0.5678, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.13% (0.1028 => 0.1163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.42% (0.6435 => 0.7234, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 12.30% (0.2691 => 0.3022, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 12.28% (2.1653 => 2.4313, std.dev.: 0.0059) MultiSource/Applications/SPASS/SPASS: 12.01% (5.5417 => 6.2074, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 11.97% (4.6177 => 5.1704, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/football/football: 11.95% (0.2075 => 0.2323, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.90% (0.2068 => 0.2314, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.75% (0.2103 => 0.2350, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 11.74% (2.1013 => 2.3480, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.66% (0.2737 => 0.3056, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.15% (0.3084 => 0.3428, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.12% (0.3498 => 0.3887, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.46% (0.5361 => 0.5922, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 10.37% (0.3336 => 0.3682, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 10.21% (0.6634 => 0.7311, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.10% (0.2040 => 0.2246, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.06% (11.6398 => 12.8113, std.dev.: 0.0170) MultiSource/Benchmarks/PAQ8p/paq8p: 9.92% (0.4847 => 0.5328, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.36% (0.7426 => 0.8121, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.28% (4.6926 => 5.1280, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: 8.28% (0.2391 => 0.2589, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.17% (0.1383 => 0.1496, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 8.01% (2.0346 => 2.1975, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.83% (0.5584 => 0.6021, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 6.73% (11.9555 => 12.7596, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.65% (29.0505 => 181.4630, std.dev.: 0.0412) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.18% (0.3693 => 0.4032, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 5.80% (0.2122 => 0.2245, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 5.22% (15.4430 => 16.2485, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6728, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6814, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1998, std.dev.: 0.0066) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3037, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2861, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2085, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5863, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4775, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.69% (25.4195 => 16.6003, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.62% (17.2379 => 14.2002, std.dev.: 0.1001) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9771, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8030, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.31% (2.1113 => 1.9570, std.dev.: 0.0081) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -4.27% (14.0481 => 13.4477, std.dev.: 0.1658) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2067, std.dev.: 0.0274) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1643, std.dev.: 0.0305) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5744, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1694, std.dev.: 0.0631) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 19:41:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 21:41:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117034129.F322E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7669?compare_to=7666&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7669, Order: 172689, Start Time: 2013-01-17 01:36:15, End Time: 2013-01-17 03:41:37 To: 7666, Order: 172664, Start Time: 2013-01-16 23:09:49, End Time: 2013-01-17 01:15:31 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 15 (18 on baseline) Performance Improvements: 24 (22 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1024 (1023 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 38.63% (0.0717 => 0.0994, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/18-imp/imp: 11.89% (0.3767 => 0.4215, std.dev.: 0.0140) MultiSource/Applications/aha/aha: 10.19% (0.1237 => 0.1363, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 7.84% (0.2142 => 0.2310, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.03% (1.2939 => 1.3202, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 40.40% (3.4085 => 4.7856, std.dev.: 0.0773) MultiSource/Benchmarks/Olden/bisort/bisort: 34.93% (0.6764 => 0.9127, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.89% (0.8981 => 1.1755, std.dev.: 0.0515) MultiSource/Benchmarks/Fhourstones/fhourstones: 22.89% (1.3553 => 1.6655, std.dev.: 0.0655) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.11% (2.4778 => 2.8274, std.dev.: 0.0529) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.82% (1.2761 => 1.4524, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.74% (3.7274 => 3.8667, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.57% (6.9523 => 7.0613, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: 1.42% (16.6375 => 16.8744, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/flops-8: 1.16% (2.3274 => 2.3544, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/flops-5: -32.31% (0.0489 => 0.0331, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Towers: -22.90% (0.0642 => 0.0495, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -13.49% (0.2350 => 0.2033, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -10.34% (5.0993 => 4.5718, std.dev.: 0.0779) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.12% (1.0013 => 0.9200, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.36% (1.0350 => 0.9588, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -7.18% (0.5058 => 0.4695, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/football/football: -6.89% (1.0403 => 0.9686, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.53% (1.0269 => 0.9598, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.38% (0.9720 => 0.9100, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -5.02% (0.9885 => 0.9389, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.63% (0.9167 => 0.8743, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.28% (0.9052 => 0.8665, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.38% (0.9375 => 0.9058, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.24% (0.9576 => 0.9266, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.10% (1.0944 => 1.0605, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.95% (0.9117 => 0.8848, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.33% (9.8193 => 9.6886, std.dev.: 0.0482) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Quicksort: -36.21% (0.0406 => 0.0259, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: -7.99% (2.2170 => 2.0398, std.dev.: 0.0651) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.56% (1.1596 => 1.0835, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: -2.29% (1.0803 => 1.0556, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops-4: -1.99% (1.7116 => 1.6776, std.dev.: 0.0100) MultiSource/Applications/lambda-0_1_3/lambda: -1.05% (7.5753 => 7.4959, std.dev.: 0.0070) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.35% (1.1348 => 1.1728, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0222 => 0.0223, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.93% (0.0431 => 0.0435, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.49% (0.0335 => 0.0340, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0322 => 0.0319, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.56% (0.0430 => 0.0441, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0207 => 0.0209, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0221 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.17% (0.0252 => 0.0244, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.71% (0.1508 => 0.1452, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: -20.50% (1.5762 => 1.2531, std.dev.: 0.2735) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.59% (0.4386 => 0.4141, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.09% (0.1437 => 0.1467, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.55% (0.0955 => 0.0902, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.75% (0.0266 => 0.0264, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.99% (0.0568 => 0.0534, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.1487 => 1.1480, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.67% (0.0030 => 0.0016, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.49% (0.0605 => 0.0614, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.08% (0.0361 => 0.0321, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.55% (0.7621 => 0.7503, std.dev.: 0.0354) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -5.88% (0.0068 => 0.0064, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.45% (12.7567 => 12.8142, std.dev.: 0.0258) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.92% (16.7012 => 18.8583, std.dev.: 0.3151) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 11.53% (4.9104 => 5.4767, std.dev.: 0.1864) MultiSource/Benchmarks/McCat/18-imp/imp: 10.72% (0.3807 => 0.4215, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.21% (7.2721 => 7.8692, std.dev.: 0.1510) SingleSource/Benchmarks/Shootout-C++/objinst: 7.44% (0.2150 => 0.2310, std.dev.: 0.0046) MultiSource/Applications/oggenc/oggenc: 5.44% (5.3553 => 5.6468, std.dev.: 0.0547) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320775.00% (0.0008 => 2.5670, std.dev.: 0.0198) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.72% (1.1825 => 2.3972, std.dev.: 0.0343) SingleSource/Benchmarks/Shootout-C++/heapsort: 13.83% (4.2042 => 4.7856, std.dev.: 0.0773) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.33% (2.5170 => 2.8274, std.dev.: 0.0529) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.10% (0.2562 => 0.2872, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.52% (20.5117 => 21.8494, std.dev.: 0.0490) MultiSource/Applications/JM/lencod/lencod: 3.57% (6.8159 => 7.0593, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/pi: 3.49% (2.1390 => 2.2137, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.67% (3.7662 => 3.8667, std.dev.: 0.0373) SingleSource/Benchmarks/Misc/flops-8: 1.18% (2.3269 => 2.3544, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.08% (4.9799 => 5.0338, std.dev.: 0.0205) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -25.16% (0.1888 => 0.1413, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -17.20% (1.8964 => 1.5703, std.dev.: 0.0931) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.54% (1.0986 => 0.9389, std.dev.: 0.0180) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.86% (0.4074 => 0.3591, std.dev.: 0.0047) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.27% (1.2154 => 1.0906, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.10% (1.1498 => 1.0682, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.66% (10.2703 => 9.6886, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout-C++/matrix: -5.58% (0.2385 => 0.2252, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -5.43% (0.7693 => 0.7275, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.15% (0.9550 => 0.9058, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.21% (0.9127 => 0.8743, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.69% (0.9512 => 0.9161, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.62% (0.8990 => 0.8665, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.39% (0.9091 => 0.8783, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.35% (1.0860 => 1.0605, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.14% (1.0119 => 1.0004, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -9.02% (4.5259 => 4.1177, std.dev.: 0.1544) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.53% (1.4588 => 1.3344, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: -2.00% (17.2182 => 16.8744, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.94% (0.5826 => 0.5713, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.46% (1.0995 => 1.0835, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0007) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.65% (1.2047 => 1.1728, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.90% (0.0445 => 0.0441, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.31% (0.0255 => 0.0244, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.10% (0.1530 => 0.1452, std.dev.: 0.0053) MultiSource/Applications/lemon/lemon: -35.05% (1.9293 => 1.2531, std.dev.: 0.2735) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.27% (0.4049 => 0.4141, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1510 => 0.1467, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.77% (0.0978 => 0.0902, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (0.0276 => 0.0264, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.49% (0.0590 => 0.0534, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.18% (1.1617 => 1.1480, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0032 => 0.0016, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.78% (0.0268 => 0.0321, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.89% (0.7437 => 0.7503, std.dev.: 0.0354) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.43% (0.0092 => 0.0064, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.28% (12.7781 => 12.8142, std.dev.: 0.0258) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 19:53:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 21:53:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117035301.583B62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7670?compare_to=7667&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7670, Order: 172694, Start Time: 2013-01-17 02:18:59, End Time: 2013-01-17 03:53:08 To: 7667, Order: 172678, Start Time: 2013-01-17 00:21:41, End Time: 2013-01-17 01:55:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (102 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.92% (0.0717 => 0.1204, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 62.73% (0.0974 => 0.1585, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.61% (0.0514 => 0.0805, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 52.43% (0.0267 => 0.0407) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.37% (0.1132 => 0.1555, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.09% (0.6395 => 0.8767, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.09% (0.6395 => 0.8639, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.42% (0.6260 => 0.8352, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.07% (0.5688 => 0.7512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.97% (0.5805 => 0.7661, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.84% (0.5456 => 0.7193, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.33% (0.6230 => 0.8182, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.22% (0.5849 => 0.7675, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.13% (0.5567 => 0.7300, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.05% (0.5575 => 0.7306, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.04% (0.0699 => 0.0916, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.04% (0.5941 => 0.7785, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.69% (0.5581 => 0.7294, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.46% (0.5802 => 0.7569, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.12% (0.6033 => 0.7850, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.96% (0.5705 => 0.7414, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.56% (0.5859 => 0.7591, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.34% (0.5570 => 0.7204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.32% (0.6440 => 0.8328, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.25% (0.5925 => 0.7658, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.20% (0.5857 => 0.7567, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.15% (0.5478 => 0.7075, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.09% (0.5569 => 0.7189, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.96% (0.5591 => 0.7210, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.62% (0.6676 => 0.8587, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.26% (1.6474 => 2.1130, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.24% (0.6052 => 0.7761, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.03% (0.6189 => 0.7924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.97% (0.5863 => 0.7503, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.68% (0.6446 => 0.8230, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.36% (0.6304 => 0.8029, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.31% (0.6681 => 0.8439, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.29% (0.0445 => 0.0562) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.28% (0.6194 => 0.7822, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.92% (0.6297 => 0.7929, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.90% (0.6660 => 0.8385, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.18% (0.0790 => 0.0981, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.22% (0.7524 => 0.9271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.29% (0.7339 => 0.8975, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.99% (0.0582 => 0.0710, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.97% (2.2587 => 2.7323, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 18.13% (1.1450 => 1.3526, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 13.77% (0.0864 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.14% (1.6364 => 1.8515, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.05% (4.5069 => 5.0951, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.12% (0.4916 => 0.5512, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.76% (0.4515 => 0.5046, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.06% (3.5339 => 3.9249, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.92% (9.2283 => 10.1435, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.85% (0.2385 => 0.2620, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.39% (0.7021 => 0.7680, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.81% (1.2515 => 1.3617, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.98% (0.5329 => 0.5754, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.80% (0.1731 => 0.1866, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.72% (1.4642 => 1.5773, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.57% (1.2784 => 1.3752, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 7.29% (0.1879 => 0.2016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.12% (0.4524 => 0.4846, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 6.98% (0.1761 => 0.1884, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4861 => 0.5179, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3255 => 0.3464, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.73% (0.1796 => 0.1899, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 4.02% (5.0226 => 5.2243, std.dev.: 0.0129) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (1.3864 => 1.4410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.37% (5.4682 => 5.6527, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.36% (22.4056 => 23.1575, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.6750 => 0.6969, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.18% (3.5154 => 3.6271, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 2.55% (15.5079 => 15.9029, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 2.39% (0.8418 => 0.8619, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: 2.38% (0.7447 => 0.7624, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.9557 => 0.9764, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5168 => 0.5279, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 1.90% (16.1920 => 16.4996, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.80% (1.3722 => 1.3969, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: 1.48% (7.0961 => 7.2012, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.42% (4.0323 => 4.0895, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.8161 => 4.8835, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.09% (4.8802 => 4.9334, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6619, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5157, std.dev.: 0.0960) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (0.6469 => 0.6639, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2769, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6018, std.dev.: 0.0044) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2068, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -5.35% (0.3812 => 0.3608, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.25% (0.3831 => 0.3630, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -5.23% (0.3880 => 0.3677, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -5.16% (0.3896 => 0.3695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.13% (0.4033 => 0.3826, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.79% (0.4176 => 0.3976, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.47% (0.6347 => 0.6063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.14% (0.4199 => 0.4025, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.13% (0.6441 => 0.6175, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.00% (0.3323 => 0.3190, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: -3.97% (0.4280 => 0.4110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.96% (0.3057 => 0.2936, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3821 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.82% (0.7779 => 0.7482, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.82% (0.9852 => 0.9476, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.75% (0.3016 => 0.2903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -3.65% (0.3205 => 0.3088, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.64% (0.2939 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.62% (2.1713 => 2.0927, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/methcall: -3.54% (0.3025 => 0.2918, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2707, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.30% (0.6484 => 0.6270, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.11% (0.3252 => 0.3151) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.06% (0.3658 => 0.3546, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.92% (2.4924 => 2.4195, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.9542 => 0.9281, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.02% (20.7746 => 20.3557, std.dev.: 0.0603) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.86% (0.7919 => 0.7772, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.82% (1.0544 => 1.0352, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.33% (1.2210 => 1.2048, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -1.26% (0.9179 => 0.9063, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -1.06% (4.3330 => 4.2869, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.61% (1.8100 => 0.6768, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.59% (1.3643 => 1.0288, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0218, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.84% (4.1024 => 3.2065, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1282, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0226, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.54% (3.7241 => 3.6295, std.dev.: 0.0138) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7753, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.80% (1.3096 => 1.2860, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5998, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6088, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4516 => 1.4368, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 19:56:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 21:56:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117035639.3292F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7671?compare_to=7665&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7671, Order: 172689, Start Time: 2013-01-17 01:45:00, End Time: 2013-01-17 03:56:46 To: 7665, Order: 172660, Start Time: 2013-01-16 23:03:17, End Time: 2013-01-17 01:14:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.66% (0.6542 => 0.6716, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (12.2287 => 11.9725, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8288 => 499.8499, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.72% (1.1277 => 499.8499, std.dev.: 0.0098) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.80% (0.5229 => 1.6618, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 20.66% (14.9895 => 18.0864, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 42.89% (14.1553 => 20.2264, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 18.09% (4.1105 => 4.8539, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.57% (1.1048 => 1.7740, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 434.92% (7.1582 => 38.2908, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.75% (3.4629 => 6.3631, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.71% (0.6222 => 1.0808, std.dev.: 0.0037) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.89% (0.0720 => 7.4440, std.dev.: 0.0061) MultiSource/Applications/SIBsim4/SIBsim4: 3835100.00% (0.0001 => 3.8352, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11181400.00% (0.0001 => 11.1815, std.dev.: 0.0065) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9847700.00% (0.0001 => 9.8478, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488700.00% (0.0001 => 5.4888, std.dev.: 0.0283) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 828.76% (1.1194 => 10.3965, std.dev.: 0.0109) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.42% (22.1758 => 55.7536, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 90.12% (0.0243 => 0.0462, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.10% (0.0929 => 0.1766, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.70% (0.1463 => 0.2512, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 69.37% (0.0271 => 0.0459) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 62.73% (21.9371 => 35.6973, std.dev.: 0.0065) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.78% (2.9384 => 4.6067, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.64% (7.0540 => 10.9785, std.dev.: 0.0077) SingleSource/Regression/C/sumarray: 55.41% (0.0231 => 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.44% (1.5859 => 2.3859, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/distray/distray: 50.28% (0.1056 => 0.1587, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.27% (8.1363 => 12.1450, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.61% (2.2024 => 3.0969, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 40.01% (0.3109 => 0.4353, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.10% (1.5415 => 2.0671, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.95% (4.2646 => 5.7123, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.57% (0.4615 => 0.6118, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.92% (0.1892 => 0.2496, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.13% (1.1642 => 1.5150, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.96% (0.2700 => 0.3509, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 29.94% (0.4299 => 0.5586, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 29.70% (0.1175 => 0.1524, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.84% (0.6675 => 0.8600, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.52% (0.5105 => 0.6510, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.26% (0.0719 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.21% (0.1584 => 0.2015, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.94% (0.2554 => 0.3242, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 26.89% (0.0636 => 0.0807) MultiSource/Benchmarks/mafft/pairlocalalign: 26.55% (9.4845 => 12.0028, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 25.96% (1.0722 => 1.3505, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.40% (3.8922 => 4.8807, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.34% (0.0746 => 0.0935, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.98% (0.1125 => 0.1406, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.56% (1.4186 => 1.7670, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.15% (0.1143 => 0.1419, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.77% (0.3121 => 0.3863, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.92% (0.0842 => 0.1035, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.81% (0.1337 => 0.1642, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: 22.56% (0.7115 => 0.8720, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 22.55% (5.7591 => 7.0580, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 22.31% (0.4289 => 0.5246, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 22.24% (0.1695 => 0.2072, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.83% (0.1695 => 0.2065, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 21.80% (0.4620 => 0.5627, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 21.67% (0.1163 => 0.1415, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.66% (4.9449 => 6.0162, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.56% (0.0886 => 0.1077, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 20.97% (3.3354 => 4.0350, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.87% (5.0018 => 6.0457, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.51% (0.7835 => 0.9442, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.49% (1.3050 => 1.5724, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 20.46% (0.3098 => 0.3732, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 20.45% (0.0660 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.23% (0.1236 => 0.1486, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.79% (0.1940 => 0.2324, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.59% (0.5860 => 0.7008, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.34% (0.1029 => 0.1228, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 19.16% (0.6456 => 0.7693, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.05% (0.8172 => 0.9729, std.dev.: 0.0098) MultiSource/Applications/aha/aha: 19.03% (0.1151 => 0.1370, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.79% (0.7433 => 0.8830, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 18.57% (0.0953 => 0.1130, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.32% (0.2107 => 0.2493, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.20% (0.2758 => 0.3260, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.94% (0.3423 => 0.4037, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.73% (0.5020 => 0.5910, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 17.59% (3.8723 => 4.5534, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.35% (0.5569 => 0.6535, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.05% (0.9765 => 1.1430, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 17.04% (1.1840 => 1.3857, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 16.85% (2.0273 => 2.3689, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.78% (0.3307 => 0.3862, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 16.63% (0.0818 => 0.0954, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.60% (0.8101 => 0.9446, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.50% (0.5981 => 0.6968, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.22% (0.6450 => 0.7496, std.dev.: 0.0018) MultiSource/Applications/siod/siod: 16.20% (2.2969 => 2.6691, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 16.10% (0.3180 => 0.3692, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 15.81% (0.2049 => 0.2373, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.75% (0.3441 => 0.3983, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.73% (0.8067 => 0.9336, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 15.48% (10.3673 => 11.9725, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 15.47% (0.3387 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.09% (1.1861 => 1.3651, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: 14.85% (0.8921 => 1.0246, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 14.71% (0.3283 => 0.3766, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.34% (0.1144 => 0.1308) SingleSource/Benchmarks/Shootout-C++/ary: 14.26% (0.3232 => 0.3693, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.48% (0.0838 => 0.0951, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: 13.25% (17.1811 => 19.4575, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 12.94% (1.5603 => 1.7622, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 12.78% (0.3379 => 0.3811, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.42% (14.3668 => 16.1509, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.08% (0.4636 => 0.5196, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 12.06% (0.3092 => 0.3465, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.82% (0.3865 => 0.4322, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.36% (0.4103 => 0.4569, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.35% (0.3427 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.06% (0.3282 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.75% (0.4203 => 0.4655, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.66% (0.2430 => 0.2689, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 10.37% (0.3828 => 0.4225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 10.30% (0.4048 => 0.4465, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/sieve: 10.30% (0.3603 => 0.3974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 10.08% (0.3422 => 0.3767, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.83% (0.3826 => 0.4202, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 9.77% (0.3684 => 0.4044, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 9.76% (0.3473 => 0.3812, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.76% (0.3516 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 9.23% (63.2438 => 69.0802, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/Large/ray: 9.08% (0.4064 => 0.4433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 8.23% (0.2831 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.14% (0.1438 => 0.1555, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.83% (0.4879 => 0.5261, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 7.76% (1.2842 => 1.3838, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.60% (2.0665 => 2.2235, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 7.37% (0.3650 => 0.3919, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.32% (0.7326 => 0.7862, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/except: 7.31% (0.2871 => 0.3081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 7.16% (0.2877 => 0.3083, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.09% (0.3935 => 0.4214, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.99% (0.3162 => 0.3383, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 6.82% (0.2905 => 0.3103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.79% (0.2872 => 0.3067, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.74% (7.9617 => 8.4987, std.dev.: 0.0165) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.73% (2.2022 => 2.3505, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 6.71% (0.2891 => 0.3085, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.49% (0.2756 => 0.2935, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 6.49% (0.3052 => 0.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 6.42% (0.2802 => 0.2982, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 6.23% (0.2793 => 0.2967, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 6.20% (0.2725 => 0.2894, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.12% (0.3136 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 6.04% (0.2714 => 0.2878, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.65% (0.2266 => 0.2394, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.51% (0.3177 => 0.3352, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2542, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4633, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.98% (3.1578 => 3.3151, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1066, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.08% (0.9957 => 1.0264, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9011, std.dev.: 0.0193) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7146, std.dev.: 0.0101) MultiSource/Applications/minisat/minisat: 1.95% (9.1159 => 9.2941, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2861, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5799, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4552, std.dev.: 0.0182) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.39% (5.2763 => 1.1932, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (5.3855 => 4.4663, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.63% (5.3526 => 4.4622, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -11.41% (10.4361 => 9.2458, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.25% (1.7609 => 1.6157, std.dev.: 0.0037) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9089, std.dev.: 0.0414) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.69% (1.9577 => 0.6716, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3066, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0211, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4235, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8579, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0037, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0904, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.76% (2.5528 => 2.1250, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.09% (1.6925 => 1.4202, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2777, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.89% (1.8329 => 1.7066, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.81% (1.2373 => 1.1654, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.44% (8.1563 => 7.7126, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.12% (1.5835 => 1.5025, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.43% (10.2830 => 9.8270, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9572, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -1.61% (3.6994 => 3.6399, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3135 => 2.2787, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0110) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0031) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 21:50:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 23:50:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117055025.128822A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7672?compare_to=7670&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7672, Order: 172699, Start Time: 2013-01-17 04:16:18, End Time: 2013-01-17 05:50:32 To: 7670, Order: 172694, Start Time: 2013-01-17 02:18:59, End Time: 2013-01-17 03:53:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.06% (0.0717 => 0.1205, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 63.04% (0.0974 => 0.1588, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 57.00% (0.0514 => 0.0807, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 52.43% (0.0267 => 0.0407, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.80% (0.1500 => 0.2202, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.46% (0.1132 => 0.1556, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.37% (0.6395 => 0.8785, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.64% (0.6395 => 0.8674, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.61% (0.6260 => 0.8364, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.79% (0.5688 => 0.7553, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.75% (0.6230 => 0.8208, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.58% (0.5849 => 0.7696, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.48% (0.5941 => 0.7811, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.33% (0.0699 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.22% (0.5567 => 0.7305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.02% (0.5581 => 0.7312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.82% (0.5802 => 0.7590, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.50% (0.6033 => 0.7873, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.32% (0.5705 => 0.7435, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.72% (0.6440 => 0.8354, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.72% (0.5478 => 0.7106, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.69% (0.5857 => 0.7596, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.61% (0.5570 => 0.7219, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.59% (0.5569 => 0.7217, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.55% (0.5925 => 0.7676, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.14% (0.5591 => 0.7220, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.74% (0.6676 => 0.8595, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.50% (0.6052 => 0.7777, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.36% (1.6474 => 2.1146, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.30% (0.5863 => 0.7522, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.29% (0.6189 => 0.7940, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.11% (0.6446 => 0.8258, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.73% (0.6304 => 0.8052, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.74% (0.0445 => 0.0564, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.67% (0.6194 => 0.7846, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.63% (0.6681 => 0.8460, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.41% (0.6297 => 0.7960, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.28% (0.6660 => 0.8410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.85% (0.6667 => 0.8324, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.60% (0.7524 => 0.9300, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.85% (0.7339 => 0.9016, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.21% (2.2587 => 2.7377, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 18.26% (1.1450 => 1.3541, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.06% (0.3357 => 0.3896, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.35% (0.0864 => 0.0988, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.31% (1.6364 => 1.8542, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.28% (4.5069 => 5.1055, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.92% (0.1982 => 0.2238, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.39% (0.4916 => 0.5525, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 12.03% (0.4515 => 0.5058, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.11% (3.5339 => 3.9266, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.16% (9.2283 => 10.1656, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.63% (0.7021 => 0.7697, std.dev.: 0.0130) MultiSource/Applications/Burg/burg: 9.01% (1.2515 => 1.3642, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.37% (0.5329 => 0.5775, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.91% (1.4642 => 1.5800, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.74% (1.2784 => 1.3773, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4524 => 0.4872, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 7.61% (0.1879 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4861 => 0.5207, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3255 => 0.3481, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1761 => 0.1876, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.96% (0.1796 => 0.1903, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.3319 => 0.3475, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 4.13% (5.0226 => 5.2302, std.dev.: 0.0085) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (1.3864 => 1.4420, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6750 => 0.7007, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.65% (5.4682 => 5.6677, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.55% (22.4056 => 23.2018, std.dev.: 0.0160) MultiSource/Applications/d/make_dparser: 3.36% (3.5154 => 3.6334, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.81% (15.5079 => 15.9434, std.dev.: 0.0150) MultiSource/Applications/minisat/minisat: 2.61% (0.7447 => 0.7641, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.51% (0.8418 => 0.8629, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (0.5168 => 0.5294, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.9557 => 0.9788, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: 2.02% (16.1920 => 16.5192, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.3722 => 1.3998, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.66% (4.0323 => 4.0993, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.8161 => 4.8940, std.dev.: 0.0150) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (7.0961 => 7.2067, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (4.8802 => 4.9402, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.0126 => 8.1090, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (6.7716 => 6.8518, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6609, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.79% (54.5751 => 56.6419, std.dev.: 0.0980) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.77% (2.0478 => 2.1046, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6086, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2765, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2069, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3489 => 10.4651, std.dev.: 0.0100) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.96% (0.3812 => 0.3623, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3831 => 0.3645, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.4176 => 0.3986, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.47% (0.3891 => 0.3717, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.93% (0.4199 => 0.4034, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3821 => 0.3675, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.74% (0.9852 => 0.9484, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.72% (0.6347 => 0.6111, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4280 => 0.4128, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.34% (0.3057 => 0.2955, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -3.31% (0.3205 => 0.3099, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.11% (0.7779 => 0.7537, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.99% (0.6484 => 0.6290, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.99% (2.1713 => 2.1064, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.84% (0.3658 => 0.3554, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.76% (1.3148 => 1.2785, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (2.4924 => 2.4249, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2457, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.76% (0.7919 => 0.7780, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.47% (1.0544 => 1.0389, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -1.10% (0.9179 => 0.9078, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.06% (1.2210 => 1.2081, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (1.2221 => 1.2098, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.22% (1.8100 => 0.6657, std.dev.: 0.0278) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -25.12% (1.3643 => 1.0216, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7499, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0235, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1736, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9703 => 2.3256, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.30% (2.5106 => 2.1266, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.64% (4.9100 => 4.3387, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.39% (1.0557 => 1.0199, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (7.9763 => 7.7888, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/ary3: -2.27% (3.7241 => 3.6394, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3040 => 7.1797, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.63% (1.6219 => 1.5955, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4705, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6692, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 21:56:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 16 Jan 2013 23:56:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117055627.F0E472A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7673?compare_to=7669&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7673, Order: 172699, Start Time: 2013-01-17 03:58:39, End Time: 2013-01-17 05:56:37 To: 7669, Order: 172689, Start Time: 2013-01-17 01:36:15, End Time: 2013-01-17 03:41:37 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 6 (13 on baseline) Performance Improvements: 95 (116 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 962 (934 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/lencod/lencod: 13.89% (7.0593 => 8.0398, std.dev.: 0.0009) SingleSource/Benchmarks/Linpack/linpack-pc: 10.59% (45.9248 => 50.7877, std.dev.: 0.3943) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.00% (4.2614 => 4.3894, std.dev.: 0.0333) MultiSource/Applications/viterbi/viterbi: 2.43% (3.6478 => 3.7363, std.dev.: 0.0083) SingleSource/Benchmarks/Misc/ffbench: 1.77% (1.3797 => 1.4041, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (63.6645 => 64.6023, std.dev.: 0.1508) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -30.99% (0.0994 => 0.0686, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -23.14% (0.0579 => 0.0445, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -22.53% (0.2184 => 0.1692, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: -21.35% (0.1644 => 0.1293, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -18.18% (0.0594 => 0.0486, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -17.60% (0.0591 => 0.0487, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -15.73% (0.1615 => 0.1361, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: -15.15% (0.1928 => 0.1636, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/misr: -14.46% (0.0754 => 0.0645, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.36% (1.4789 => 1.2666, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/perimeter/perimeter: -14.32% (0.0957 => 0.0820, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -12.99% (1.6338 => 1.4215, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/health/health: -12.40% (0.1686 => 0.1477, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.03% (0.2593 => 0.2281, std.dev.: 0.0029) MultiSource/Applications/aha/aha: -10.34% (0.1363 => 0.1222, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.46% (0.1078 => 0.0976, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -9.28% (18.8583 => 17.1079, std.dev.: 0.0310) MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.95% (0.1352 => 0.1231, std.dev.: 0.0036) MultiSource/Applications/treecc/treecc: -8.74% (2.4030 => 2.1929, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: -8.40% (17.6448 => 16.1631, std.dev.: 0.0903) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.32% (0.1358 => 0.1245, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -8.31% (0.2310 => 0.2118, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.91% (6.1959 => 5.7055, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: -7.89% (0.5030 => 0.4633, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: -7.17% (0.3096 => 0.2874, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1803 => 0.1677, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -6.62% (2.5729 => 2.4026, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.46% (1.0565 => 0.9882, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.35% (0.5514 => 0.5164, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.92% (1.2950 => 1.2183, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.85% (1.0451 => 0.9840, std.dev.: 0.0185) MultiSource/Applications/viterbi/viterbi: -5.78% (0.1833 => 0.1727, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: -5.68% (5.6468 => 5.3262, std.dev.: 0.0435) MultiSource/Benchmarks/Olden/em3d/em3d: -5.64% (0.1986 => 0.1874, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.46% (0.2948 => 0.2787, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: -5.30% (0.2641 => 0.2501, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -5.12% (0.2013 => 0.1910, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -5.05% (0.2137 => 0.2029, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -4.98% (1.0632 => 1.0102, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -4.76% (1.4739 => 1.4038, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: -4.75% (16.9067 => 16.1041, std.dev.: 0.0207) MultiSource/Applications/JM/ldecod/ldecod: -4.49% (7.7737 => 7.4246, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary2: -4.46% (0.2690 => 0.2570, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: -4.40% (3.7939 => 3.6269, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: -4.18% (16.9917 => 16.2818, std.dev.: 0.0730) SingleSource/Benchmarks/Shootout-C++/ary: -4.09% (0.2519 => 0.2416, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.07% (0.9781 => 0.9383, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: -3.69% (0.3900 => 0.3756, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.59% (0.3927 => 0.3786, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -3.54% (8.9936 => 8.6754, std.dev.: 0.0937) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.29% (2.4717 => 2.3904, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: -2.75% (0.4982 => 0.4845, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -2.44% (1.3748 => 1.3413, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash: -2.41% (0.4607 => 0.4496, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -2.21% (1.5703 => 1.5356, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.20% (1.3202 => 1.2912, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.99% (3.5058 => 3.4360, std.dev.: 0.0192) MultiSource/Applications/lambda-0_1_3/lambda: -1.80% (0.8052 => 0.7907, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -1.79% (0.6586 => 0.6468, std.dev.: 0.0031) MultiSource/Applications/lua/lua: -1.57% (4.2176 => 4.1512, std.dev.: 0.0145) MultiSource/Applications/minisat/minisat: -1.51% (0.7546 => 0.7432, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -34.52% (4.7856 => 3.1336, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/bisort/bisort: -29.47% (0.9127 => 0.6437, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/ft/ft: -26.13% (1.1755 => 0.8683, std.dev.: 0.0821) MultiSource/Benchmarks/Fhourstones/fhourstones: -23.81% (1.6655 => 1.2689, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/08-main/main: -16.57% (0.0833 => 0.0695, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -16.30% (3.7006 => 3.0975, std.dev.: 0.0261) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -13.56% (1.4524 => 1.2555, std.dev.: 0.0242) MultiSource/Benchmarks/BitBench/drop3/drop3: -10.32% (0.3296 => 0.2956, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -10.13% (9.2134 => 8.2805, std.dev.: 0.1166) SingleSource/Benchmarks/Shootout-C++/lists1: -9.99% (0.6715 => 0.6044, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.30% (0.3591 => 0.3257, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.81% (0.2143 => 0.1997, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: -6.67% (0.3656 => 0.3412, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: -6.44% (6.5950 => 6.1701, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: -5.64% (21.8494 => 20.6180, std.dev.: 0.1388) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.39% (5.0338 => 4.7627, std.dev.: 0.1016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.23% (45.8176 => 43.4214, std.dev.: 0.3326) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.09% (0.3342 => 0.3172, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.73% (3.8667 => 3.6838, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash: -4.66% (0.6433 => 0.6133, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.66% (0.2188 => 0.2086, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: -4.31% (4.7221 => 4.5186, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/ks/ks: -3.93% (1.1972 => 1.1501, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.68% (62.0141 => 59.7302, std.dev.: 0.2978) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.31% (40.6549 => 39.3085, std.dev.: 0.4598) MultiSource/Benchmarks/Olden/tsp/tsp: -3.22% (1.5398 => 1.4902, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/chomp: -2.89% (1.0479 => 1.0176, std.dev.: 0.0112) MultiSource/Benchmarks/7zip/7zip-benchmark: -2.83% (9.5650 => 9.2947, std.dev.: 0.0925) SingleSource/Benchmarks/Shootout/ary3: -2.74% (2.1506 => 2.0917, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/lpbench: -2.29% (4.1902 => 4.0944, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/flops-8: -1.56% (2.3544 => 2.3177, std.dev.: 0.0067) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.1625 => 7.0523, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (2.4227 => 2.3879, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.16% (1.5659 => 1.5478, std.dev.: 0.0062) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.77% (1.1728 => 1.1168, std.dev.: 0.0161) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.24% (0.0223 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.92% (0.0435 => 0.0431, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.06% (0.0340 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0319 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.61% (0.0441 => 0.0381, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -10.53% (0.0209 => 0.0187, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -1.79% (0.0223 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.28% (0.0244 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.83% (0.1452 => 0.1440, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -9.65% (1.2531 => 1.1322, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.93% (0.4141 => 0.4061, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.11% (0.1467 => 0.1498, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.55% (0.0902 => 0.0907, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.92% (0.0264 => 0.0277, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.12% (0.0534 => 0.0556, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1480 => 1.1476, std.dev.: 0.1009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 12.50% (0.0016 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.61% (0.0614 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.55% (0.0321 => 0.0239, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.32% (0.7503 => 0.7404, std.dev.: 0.0032) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 90.62% (0.0064 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (12.8142 => 12.7567, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.54% (0.0336 => 0.0489, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.53% (9.5202 => 9.8560, std.dev.: 0.0609) MultiSource/Applications/JM/lencod/lencod: 2.44% (16.7012 => 17.1079, std.dev.: 0.0310) MultiSource/Benchmarks/Bullet/bullet: 1.12% (33.2440 => 33.6179, std.dev.: 0.0541) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321000.00% (0.0008 => 2.5688, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 108.83% (1.1825 => 2.4694, std.dev.: 0.3101) MultiSource/Applications/JM/lencod/lencod: 17.96% (6.8159 => 8.0398, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.68% (0.2562 => 0.2810, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.34% (4.1668 => 4.3894, std.dev.: 0.0333) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.18% (9.0082 => 9.2947, std.dev.: 0.0925) SingleSource/Benchmarks/Misc/pi: 2.81% (2.1390 => 2.1990, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: 2.65% (3.6397 => 3.7363, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 2.30% (63.1520 => 64.6023, std.dev.: 0.1508) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.85% (0.0808 => 0.0486, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.01% (0.0727 => 0.0487, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -26.64% (0.1888 => 0.1385, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -20.42% (0.0862 => 0.0686, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -19.03% (1.8964 => 1.5356, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.73% (0.1009 => 0.0820, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -14.96% (1.0220 => 0.8691, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.83% (1.0986 => 0.9357, std.dev.: 0.0161) SingleSource/UnitTests/Vector/constpool: -12.26% (9.8875 => 8.6754, std.dev.: 0.0937) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.04% (0.0847 => 0.0745, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -11.64% (1.1433 => 1.0102, std.dev.: 0.0050) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.40% (1.2154 => 1.0769, std.dev.: 0.0063) MultiSource/Applications/aha/aha: -11.32% (0.1378 => 0.1222, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: -11.29% (2.4719 => 2.1929, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.18% (6.4235 => 5.7055, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -11.04% (1.5979 => 1.4215, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -10.55% (4.6406 => 4.1512, std.dev.: 0.0145) MultiSource/Applications/siod/siod: -9.12% (2.6437 => 2.4026, std.dev.: 0.0113) MultiSource/Applications/sgefa/sgefa: -8.75% (0.3598 => 0.3283, std.dev.: 0.0034) MultiSource/Applications/lambda-0_1_3/lambda: -8.62% (0.8653 => 0.7907, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.28% (0.9588 => 0.8794, std.dev.: 0.0294) MultiSource/Benchmarks/Olden/health/health: -8.26% (0.1610 => 0.1477, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.06% (0.2481 => 0.2281, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.91% (1.6874 => 1.5540, std.dev.: 0.0516) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.81% (0.2100 => 0.1936, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: -7.58% (0.1332 => 0.1231, std.dev.: 0.0036) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.46% (1.1731 => 1.0856, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -7.30% (17.4365 => 16.1631, std.dev.: 0.0903) MultiSource/Applications/sqlite3/sqlite3: -7.30% (17.5634 => 16.2818, std.dev.: 0.0730) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (0.2006 => 0.1873, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.61% (0.2709 => 0.2530, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.49% (0.3560 => 0.3329, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.34% (1.8127 => 1.6978, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.33% (1.0017 => 0.9383, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: -6.15% (0.4002 => 0.3756, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.98% (0.3462 => 0.3255, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.90% (0.1798 => 0.1692, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.78% (0.9550 => 0.8998, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -5.63% (0.5134 => 0.4845, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: -5.45% (0.1928 => 0.1823, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -5.37% (0.2385 => 0.2257, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.33% (3.6295 => 3.4360, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary: -5.29% (0.2551 => 0.2416, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -4.96% (0.2135 => 0.2029, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -4.95% (0.2725 => 0.2590, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.90% (0.3981 => 0.3786, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (1.3310 => 1.2666, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.61% (0.9127 => 0.8706, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.61% (0.3665 => 0.3496, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: -4.56% (0.2305 => 0.2200, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -4.42% (0.7776 => 0.7432, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.39% (0.2618 => 0.2503, std.dev.: 0.0044) MultiSource/Applications/d/make_dparser: -4.15% (3.7840 => 3.6269, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash: -4.12% (0.4689 => 0.4496, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.11% (0.3093 => 0.2966, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -4.05% (1.3979 => 1.3413, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: -3.96% (0.3206 => 0.3079, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.92% (1.2680 => 1.2183, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.82% (0.5369 => 0.5164, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: -3.62% (0.6711 => 0.6468, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.60% (1.0234 => 0.9866, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.56% (0.7693 => 0.7419, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.05% (0.9788 => 0.9489, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.87% (0.9488 => 0.9216, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.85% (0.6135 => 0.5960, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.70% (0.3847 => 0.3743, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.57% (0.9214 => 0.8977, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.51% (2.4519 => 2.3904, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: -2.46% (1.4392 => 1.4038, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.33% (1.3220 => 1.2912, std.dev.: 0.0084) MultiSource/Applications/SPASS/SPASS: -2.09% (16.4479 => 16.1041, std.dev.: 0.0207) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.32% (0.9372 => 0.6437, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout/heapsort: -30.77% (4.4739 => 3.0975, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.47% (4.2042 => 3.1336, std.dev.: 0.0148) MultiSource/Applications/minisat/minisat: -22.77% (7.9891 => 6.1701, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.96% (0.1164 => 0.0920, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.72% (1.0816 => 0.8683, std.dev.: 0.0821) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.78% (1.5623 => 1.2689, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.80% (1.4235 => 1.2555, std.dev.: 0.0242) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.61% (1.6547 => 1.4791, std.dev.: 0.0532) SingleSource/Benchmarks/Shootout/hash: -10.41% (4.5259 => 4.0549, std.dev.: 0.0513) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.38% (5.0421 => 4.5186, std.dev.: 0.0165) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.29% (0.4081 => 0.3661, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/nestedloop: -9.82% (0.2200 => 0.1984, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.75% (0.3609 => 0.3257, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists1: -8.81% (0.6628 => 0.6044, std.dev.: 0.0127) MultiSource/Applications/SPASS/SPASS: -8.65% (9.0650 => 8.2805, std.dev.: 0.1166) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.11% (0.3217 => 0.2956, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.07% (4.4540 => 4.0944, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.69% (23.3986 => 21.8342, std.dev.: 0.2933) MultiSource/Benchmarks/Olden/health/health: -6.62% (0.3654 => 0.3412, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: -6.22% (2.2304 => 2.0917, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.81% (46.0987 => 43.4214, std.dev.: 0.3326) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.29% (0.3349 => 0.3172, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.23% (1.4446 => 1.3691, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/ary3: -4.52% (1.8123 => 1.7303, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/distray/distray: -4.29% (0.2427 => 0.2323, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.35% (0.3406 => 0.3292, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -2.97% (17.2182 => 16.7067, std.dev.: 0.0168) MultiSource/Applications/sqlite3/sqlite3: -2.81% (4.4730 => 4.3474, std.dev.: 0.0438) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.20% (0.5826 => 0.5698, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.19% (3.7662 => 3.6838, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.14% (61.0379 => 59.7302, std.dev.: 0.2978) MultiSource/Benchmarks/Bullet/bullet: -2.11% (7.2040 => 7.0523, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.00% (1.0995 => 1.0775, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash: -1.93% (0.6254 => 0.6133, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: -1.90% (5.7021 => 5.5935, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.88% (3.0082 => 2.9517, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -1.88% (0.8521 => 0.8361, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -1.47% (1.5825 => 1.5593, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: -1.43% (1.4244 => 1.4041, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.41% (5.9063 => 5.8228, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.40% (3.1921 => 3.1475, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3151, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.30% (1.2047 => 1.1168, std.dev.: 0.0161) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.44% (0.0233 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.38% (0.0445 => 0.0381, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -12.21% (0.0213 => 0.0187, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.88% (0.1530 => 0.1440, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -41.32% (1.9293 => 1.1322, std.dev.: 0.0190) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.30% (0.4049 => 0.4061, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.79% (0.1510 => 0.1498, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.26% (0.0978 => 0.0907, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.76% (0.0590 => 0.0556, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1476, std.dev.: 0.1009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.02% (0.0610 => 0.0555, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.82% (0.0268 => 0.0239, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.7437 => 0.7404, std.dev.: 0.0032) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7781 => 12.7567, std.dev.: 0.0068) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 22:38:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 00:38:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117063843.4460C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7674?compare_to=7671&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7674, Order: 172699, Start Time: 2013-01-17 04:26:58, End Time: 2013-01-17 06:38:49 To: 7671, Order: 172689, Start Time: 2013-01-17 01:45:00, End Time: 2013-01-17 03:56:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 6 (222 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.00% (10.9785 => 11.1980, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.80% (2.2235 => 2.2636, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: 1.64% (11.9725 => 12.1686, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.40% (1.3838 => 1.4032, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.19% (1.0808 => 1.0937, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (8.4987 => 8.5865, std.dev.: 0.0120) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8499 => 499.8611, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.72% (1.1277 => 499.8611, std.dev.: 0.0090) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.87% (0.5229 => 1.6726, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 21.68% (14.9895 => 18.2395, std.dev.: 0.0101) MultiSource/Applications/kimwitu++/kc: 43.71% (14.1553 => 20.3423, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/gs/gs: 18.49% (4.1105 => 4.8704, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.59% (1.1048 => 1.7852, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.77% (7.1582 => 38.6375, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.81% (3.4629 => 6.3997, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.78% (0.6222 => 1.0937, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.11% (0.0720 => 7.4456, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3835000.00% (0.0001 => 3.8351, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11144200.00% (0.0001 => 11.1443, std.dev.: 0.0231) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850900.00% (0.0001 => 9.8510, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487500.00% (0.0001 => 5.4876, std.dev.: 0.0407) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.34% (1.1194 => 10.3582, std.dev.: 0.0314) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 151.56% (22.1758 => 55.7865, std.dev.: 0.0338) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 91.77% (0.0243 => 0.0466, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.93% (0.1463 => 0.2530, std.dev.: 0.0058) SingleSource/Regression/C/sumarray2d: 69.74% (0.0271 => 0.0460, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 64.11% (21.9371 => 36.0003, std.dev.: 0.0079) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.75% (7.0540 => 11.1980, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.40% (2.9384 => 4.6251, std.dev.: 0.0007) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361) MultiSource/Benchmarks/FreeBench/distray/distray: 51.89% (0.1056 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.01% (1.5859 => 2.3948, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.37% (8.1363 => 12.2348, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.16% (2.2024 => 3.1090, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 40.82% (0.3109 => 0.4378, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.32% (0.0439 => 0.0616, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 40.01% (0.1432 => 0.2005, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.03% (1.5415 => 2.0815, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.80% (4.2646 => 5.7488, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.37% (0.4615 => 0.6155, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.41% (0.2700 => 0.3548, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.87% (0.2271 => 0.2972, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 30.77% (1.1642 => 1.5224, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 30.75% (0.4299 => 0.5621, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 30.72% (0.1175 => 0.1536, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.50% (0.1892 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.65% (0.6675 => 0.8654, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.64% (0.5105 => 0.6516, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 27.55% (9.4845 => 12.0974, std.dev.: 0.0023) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 27.41% (0.2554 => 0.3254, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 26.48% (1.0722 => 1.3561, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 26.16% (0.1655 => 0.2088, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.77% (3.8922 => 4.8951, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.31% (1.4186 => 1.7777, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.42% (0.3121 => 0.3883, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 24.27% (0.4289 => 0.5330, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 23.57% (0.4620 => 0.5709, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.01% (0.1695 => 0.2085, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.81% (0.7115 => 0.8738, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 22.81% (5.7591 => 7.0726, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 22.72% (0.3098 => 0.3802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.57% (0.1143 => 0.1401, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.40% (4.9449 => 6.0524, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 22.38% (0.1555 => 0.1903, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 21.75% (0.1163 => 0.1416, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 21.74% (3.3354 => 4.0604, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.70% (0.0871 => 0.1060, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.57% (5.0018 => 6.0808, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.51% (0.0730 => 0.0887, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.19% (1.3050 => 1.5815, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 21.06% (0.7835 => 0.9485, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 20.94% (0.1695 => 0.2050, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.45% (0.6456 => 0.7776, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.36% (0.1940 => 0.2335, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.22% (0.5860 => 0.7045, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.19% (0.8172 => 0.9822, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 19.49% (0.3423 => 0.4090, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 19.20% (0.1151 => 0.1372, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.13% (0.2107 => 0.2510, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.93% (0.1268 => 0.1508, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.92% (0.5020 => 0.5970, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.87% (0.1510 => 0.1795, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.82% (0.7433 => 0.8832, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.36% (0.3307 => 0.3914, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.26% (0.1117 => 0.1321, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 18.15% (3.8723 => 4.5750, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.13% (0.2758 => 0.3258, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.08% (0.5569 => 0.6576, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.76% (0.9765 => 1.1499, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 17.74% (1.1840 => 1.3940, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.53% (0.2065 => 0.2427, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 17.39% (2.0273 => 2.3798, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: 17.37% (10.3673 => 12.1686, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 17.36% (0.0818 => 0.0960, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.16% (0.6450 => 0.7557, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.95% (0.8101 => 0.9474, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.89% (0.5981 => 0.6991, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.67% (0.0834 => 0.0973, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 16.60% (0.3180 => 0.3708, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 16.59% (0.3387 => 0.3949, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.40% (0.2049 => 0.2385, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.38% (2.2969 => 2.6731, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 16.27% (0.3232 => 0.3758, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.19% (0.3441 => 0.3998, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.98% (0.8067 => 0.9356, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.71% (1.1861 => 1.3724, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.22% (0.8921 => 1.0279, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.97% (0.3379 => 0.3885, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.92% (0.3865 => 0.4403, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.63% (1.5603 => 1.7729, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.59% (0.4636 => 0.5266, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 13.54% (17.1811 => 19.5072, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/bh/bh: 12.87% (0.3092 => 0.3490, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.65% (0.4103 => 0.4622, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.57% (14.3668 => 16.1721, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.51% (0.4203 => 0.4729, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.15% (0.3886 => 0.4358, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 12.04% (0.3422 => 0.3834, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.99% (0.3603 => 0.4035, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.97% (0.3282 => 0.3675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.94% (0.3684 => 0.4124, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.88% (0.3427 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.62% (0.3828 => 0.4273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.43% (0.3561 => 0.3968, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.24% (0.3826 => 0.4256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3516 => 0.3910, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.21% (0.3543 => 0.3940, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 11.20% (0.3473 => 0.3862, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.18% (0.3543 => 0.3939, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.2430 => 0.2701, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 11.12% (0.3497 => 0.3886, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.14% (0.2831 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.98% (63.2438 => 69.5583, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (2.0665 => 2.2636, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.42% (0.3162 => 0.3460, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.39% (0.1438 => 0.1573, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 9.27% (1.2842 => 1.4032, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2793 => 0.3051, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.07% (0.1114 => 0.1215, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.05% (0.3935 => 0.4291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.96% (0.2891 => 0.3150, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.71% (0.2802 => 0.3046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2872 => 0.3122, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.3052 => 0.3317, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 8.60% (0.7326 => 0.7956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 8.48% (0.2725 => 0.2956, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.4879 => 0.5264, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.85% (7.9617 => 8.5865, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3721, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.27% (0.2266 => 0.2408, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3817 => 0.3966, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2488, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4274, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.13% (4.2280 => 4.4449, std.dev.: 0.0152) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.64% (0.9957 => 1.0319, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9097, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (3.6395 => 3.7225, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2823, std.dev.: 0.0196) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2867, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.50% (1.0785 => 1.0947, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.39% (10.3460 => 10.4895, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.44% (6.6874 => 0.1709, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.17% (5.2763 => 1.2046, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.35% (5.3855 => 4.5051, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.09% (5.3526 => 4.4914, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -10.75% (10.4361 => 9.3138, std.dev.: 0.0049) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9704, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.74% (1.7609 => 1.6246, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.36% (1.9577 => 0.6586, std.dev.: 0.0052) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.49% (1.5373 => 1.0225, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4242, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8583, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.59% (2.6546 => 2.0019, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5892, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9695 => 2.3247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1247, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.21% (1.6925 => 1.4181, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7341, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4948, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.24% (0.9540 => 0.8563, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7560, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.50% (19.9488 => 18.2531, std.dev.: 0.0277) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -6.01% (1.2373 => 1.1630, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.47% (8.1563 => 7.7102, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5103, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.41% (0.4808 => 0.4596, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8339, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.96% (3.6994 => 3.6268, std.dev.: 0.0139) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9574, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6695, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0010) Report Time: 1.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 23:14:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 01:14:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130117071411.304312A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7675?compare_to=7668&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7675, Order: 172697, Start Time: 2013-01-17 03:39:56, End Time: 2013-01-17 07:14:17 To: 7668, Order: 172660, Start Time: 2013-01-16 23:14:42, End Time: 2013-01-17 02:48:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 8 (179 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.34% (1.9537 => 1.9995, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 1.63% (1.1450 => 1.1637, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 1.46% (2.1975 => 2.2295, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 1.39% (26.9382 => 27.3130, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.37% (2.3941 => 2.4268, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.09% (124.7524 => 131.0984, std.dev.: 0.2153) SingleSource/Benchmarks/Dhrystone/dry: 2.76% (13.4477 => 13.8188, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.24% (2.1650 => 2.1919, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.24% (0.0625 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.40% (0.1063 => 0.1418, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.69% (0.2969 => 0.3791, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.57% (0.4253 => 0.5383, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.46% (0.4139 => 0.5234, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.59% (0.5900 => 0.7410, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 25.50% (1.5932 => 1.9995, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.71% (0.4994 => 0.6228, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.10% (0.5000 => 0.6205, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.46% (0.1620 => 0.2000, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.31% (0.1021 => 0.1259, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.85% (0.1549 => 0.1903, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.47% (0.3903 => 0.4741, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 21.19% (0.1619 => 0.1962, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.90% (0.1462 => 0.1753, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.51% (0.3890 => 0.4649, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 19.38% (0.1218 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.34% (0.0698 => 0.0833, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 19.21% (0.4029 => 0.4803, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/09-vor/vor: 18.94% (0.1505 => 0.1790, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.86% (0.3271 => 0.3888, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.63% (0.2866 => 0.3400, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.61% (0.2875 => 0.3410, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 18.41% (0.5546 => 0.6567, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.23% (0.2792 => 0.3301, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: 18.21% (0.2811 => 0.3323, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 18.17% (1.8794 => 2.2208, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.07% (1.3152 => 1.5528, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 18.02% (0.2780 => 0.3281, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.01% (0.2738 => 0.3231, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676) SingleSource/Benchmarks/Shootout-C++/random: 17.95% (0.2803 => 0.3306) SingleSource/Benchmarks/Shootout-C++/fibo: 17.94% (0.2725 => 0.3214, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.91% (0.2714 => 0.3200, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/strcat: 17.82% (0.2750 => 0.3240, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: 17.74% (0.2813 => 0.3312, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 17.71% (0.5826 => 0.6858, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 17.71% (0.3004 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.65% (3.5627 => 4.1916, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.63% (0.2729 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.61% (1.6211 => 1.9066, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 17.61% (0.2823 => 0.3320, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.60% (0.4658 => 0.5478, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.55% (0.2911 => 0.3422, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 17.44% (0.9909 => 1.1637, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: 17.41% (0.9697 => 1.1385, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.39% (2.0673 => 2.4268, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wc: 17.38% (0.3096 => 0.3634, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 17.35% (0.5889 => 0.6911, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.33% (0.1160 => 0.1361, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 17.13% (0.1284 => 0.1504, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 17.00% (0.3258 => 0.3812, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.96% (0.3195 => 0.3737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.96% (0.3060 => 0.3579, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 16.90% (0.3267 => 0.3819, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.78% (0.3362 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.77% (0.5026 => 0.5869, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: 16.70% (0.3317 => 0.3871, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.59% (0.3930 => 0.4582, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 16.56% (0.3726 => 0.4343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.56% (0.4361 => 0.5083, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.34% (1.0781 => 1.2543, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: 16.13% (23.5202 => 27.3130, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.09% (0.3282 => 0.3810, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.08% (1.9694 => 2.2860, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/lists: 16.04% (0.3348 => 0.3885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.93% (0.3678 => 0.4264, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.87% (1.9966 => 2.3135, std.dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: 15.86% (4.2109 => 4.8786, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/lists1: 15.85% (0.3477 => 0.4028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.83% (0.3625 => 0.4199, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.72% (0.3981 => 0.4607, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.72% (2.7292 => 3.1582, std.dev.: 0.0119) SingleSource/UnitTests/ObjC++/property-reference: 15.69% (0.7171 => 0.8296, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 15.61% (0.4146 => 0.4793, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.59% (4.4195 => 5.1084, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/hash2: 15.57% (0.4251 => 0.4913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.47% (0.3690 => 0.4261, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.17% (1.4269 => 1.6434, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 15.16% (0.2566 => 0.2955, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.98% (0.3845 => 0.4421, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 14.55% (0.5012 => 0.5741, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 14.23% (0.7875 => 0.8996, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/for-in: 13.76% (0.3496 => 0.3977, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.62% (0.3465 => 0.3937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.58% (0.6435 => 0.7309, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 13.55% (0.3446 => 0.3913, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.54% (0.3442 => 0.3908, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.53% (0.3460 => 0.3928, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.28% (2.1653 => 2.4529, std.dev.: 0.0197) MultiSource/Applications/SIBsim4/SIBsim4: 13.23% (0.2691 => 0.3047, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 13.12% (0.3643 => 0.4121, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 13.06% (0.2075 => 0.2346, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 13.03% (5.5417 => 6.2636, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 12.75% (4.6177 => 5.2065, std.dev.: 0.0293) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.64% (0.2737 => 0.3083, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 12.48% (2.1013 => 2.3635, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.43% (0.2068 => 0.2325, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.89% (0.3498 => 0.3914, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.61% (0.3084 => 0.3442, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.33% (0.3336 => 0.3714, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 11.21% (0.6634 => 0.7378, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.08% (0.5361 => 0.5955, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.2103 => 0.2336, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (0.4847 => 0.5383, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.40% (11.6398 => 12.8498, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.09% (0.7426 => 0.8175, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 9.58% (2.0346 => 2.2295, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.50% (4.6926 => 5.1382, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (0.5584 => 0.6082, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 7.61% (11.9555 => 12.8650, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3792 => 0.3958, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.63% (29.0505 => 181.4571, std.dev.: 0.0380) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.69% (0.3693 => 0.4014, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 7.35% (0.2802 => 0.3008, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6087, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.18% (0.2122 => 0.2232, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2363, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6793, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops-2: 4.42% (1.8057 => 1.8855, std.dev.: 0.0043) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.80% (0.6276 => 0.6452, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2057, std.dev.: 0.0553) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3020, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.22% (4.0317 => 4.0808, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.09% (3.1722 => 3.2068, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4793, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5862, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5740, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.09% (17.2379 => 14.2925, std.dev.: 0.1628) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9781, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8002, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2117, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0122) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.88% (0.6293 => 0.6112, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1554, std.dev.: 0.0498) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5819, std.dev.: 0.0021) SingleSource/Benchmarks/Dhrystone/dry: -1.63% (14.0481 => 13.8188, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1301, std.dev.: 0.1063) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 16 23:47:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 01:47:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117074753.488F02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7676?compare_to=7672&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7676, Order: 172701, Start Time: 2013-01-17 06:14:00, End Time: 2013-01-17 07:47:59 To: 7672, Order: 172699, Start Time: 2013-01-17 04:16:18, End Time: 2013-01-17 05:50:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (115 on baseline) Performance Improvements: 0 (104 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (873 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.26% (0.6657 => 0.6874, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.20% (0.0717 => 0.1206, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.99% (0.0974 => 0.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 57.00% (0.0514 => 0.0807, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.87% (0.1500 => 0.2203, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.94% (0.0267 => 0.0387, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.54% (0.1132 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.29% (0.6395 => 0.8780, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.53% (0.6395 => 0.8667, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.79% (0.6260 => 0.8375, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.94% (0.5805 => 0.7717, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.40% (0.5688 => 0.7531, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.02% (0.5456 => 0.7203, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.78% (0.6230 => 0.8210, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.62% (0.0699 => 0.0920, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.54% (0.5849 => 0.7694, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.49% (0.5941 => 0.7812, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.46% (0.5575 => 0.7329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.40% (0.5567 => 0.7315, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.02% (0.5581 => 0.7312, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.70% (0.5802 => 0.7583, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.40% (0.6033 => 0.7867, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.36% (0.5705 => 0.7437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.75% (0.5570 => 0.7227, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.67% (0.5857 => 0.7595, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.63% (0.6440 => 0.8348, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.57% (0.5478 => 0.7098, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.50% (0.5925 => 0.7673, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.39% (0.5569 => 0.7206, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.31% (0.5591 => 0.7230, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.74% (0.6676 => 0.8595, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.37% (1.6474 => 2.1148, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.35% (0.6052 => 0.7768, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.09% (0.5863 => 0.7510, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.03% (0.6446 => 0.8253, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.66% (0.6304 => 0.8048, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.70% (0.6681 => 0.8465, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.62% (0.6194 => 0.7843, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.19% (0.6660 => 0.8404, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.16% (0.6297 => 0.7944, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.87% (0.6667 => 0.8325, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.30% (0.0790 => 0.0982, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.39% (0.7524 => 0.9284, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.86% (0.7339 => 0.9017, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.18% (2.2587 => 2.7372, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837) MultiSource/Applications/lemon/lemon: 18.31% (1.1450 => 1.3547, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.37% (0.1982 => 0.2247, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.30% (1.6364 => 1.8540, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.20% (4.5069 => 5.1018, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4916 => 0.5523, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.4515 => 0.5062, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.18% (3.5339 => 3.9291, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 10.13% (9.2283 => 10.1634, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.71% (0.7021 => 0.7703, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.86% (1.2515 => 1.3624, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.14% (0.5329 => 0.5763, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.80% (1.4642 => 1.5784, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.79% (1.2784 => 1.3780, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.70% (0.2001 => 0.2155, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 7.40% (0.4524 => 0.4859, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.99% (0.1731 => 0.1852, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (0.4861 => 0.5194, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.76% (0.3255 => 0.3475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.39% (0.1879 => 0.1999, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.82% (0.3319 => 0.3479, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.34% (5.0226 => 5.2405, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.17% (1.3864 => 1.4442, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 3.69% (0.6750 => 0.6999, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.50% (5.4682 => 5.6596, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.43% (22.4056 => 23.1739, std.dev.: 0.0134) MultiSource/Applications/d/make_dparser: 3.37% (3.5154 => 3.6338, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.78% (15.5079 => 15.9384, std.dev.: 0.0029) MultiSource/Applications/minisat/minisat: 2.58% (0.7447 => 0.7639, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.41% (0.8418 => 0.8621, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.9557 => 0.9776, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5168 => 0.5276, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.01% (16.1920 => 16.5178, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.96% (1.3722 => 1.3991, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.61% (4.0323 => 4.0974, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.56% (4.8161 => 4.8912, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 1.50% (7.0961 => 7.2028, std.dev.: 0.0201) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.30% (4.8802 => 4.9435, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.24% (8.0126 => 8.1116, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.10% (6.7716 => 6.8458, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6577, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.50% (54.5751 => 56.4831, std.dev.: 0.0815) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1069, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6061, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2774, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2072, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3831 => 0.3645, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.81% (0.3884 => 0.3697, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.77% (0.3896 => 0.3710, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.65% (0.3891 => 0.3710, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.27% (0.3837 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3821 => 0.3675, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.79% (0.3057 => 0.2941, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.70% (0.9852 => 0.9487, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.64% (0.7779 => 0.7496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.62% (0.2903 => 0.2798, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4280 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.48% (0.2933 => 0.2831, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -3.46% (0.3205 => 0.3094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.45% (0.3016 => 0.2912, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.30% (2.1713 => 2.0997, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -3.18% (1.3148 => 1.2730, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.95% (0.6484 => 0.6293, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.79% (0.3658 => 0.3556, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -2.77% (2.4924 => 2.4233, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.9542 => 0.9289, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.51% (0.4151 => 0.4047, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2616, std.dev.: 0.0419) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.70% (0.7919 => 0.7784, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.56% (1.0544 => 1.0380, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (1.2210 => 1.2076, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.09% (0.9179 => 0.9079, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.02% (1.2221 => 1.2096, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: -1.00% (4.3330 => 4.2895, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.02% (1.8100 => 0.6874, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.43% (1.3643 => 1.0310, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0250, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2072, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.41% (2.5106 => 2.1236, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6684, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.17% (1.0557 => 1.0222, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7743, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6473, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1933, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.30% (1.6219 => 1.6008, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.30% (1.6086 => 1.5877, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6307 => 1.6096, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.02% (1.4516 => 1.4368, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 00:15:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 02:15:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117081554.EDF032A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7677?compare_to=7673&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7677, Order: 172701, Start Time: 2013-01-17 06:13:39, End Time: 2013-01-17 08:16:04 To: 7673, Order: 172699, Start Time: 2013-01-17 03:58:39, End Time: 2013-01-17 05:56:37 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (6 on baseline) Performance Improvements: 4 (36 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1052 (1021 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 21.07% (1.5336 => 1.8567, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.42% (15.8504 => 16.8687, std.dev.: 0.1477) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.05% (0.3257 => 0.3454, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.36% (4.7627 => 4.9704, std.dev.: 0.0617) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.03% (2.6570 => 2.7375, std.dev.: 0.0307) MultiSource/Applications/SIBsim4/SIBsim4: 1.89% (3.4455 => 3.5107, std.dev.: 0.0246) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.83% (1.3691 => 1.3941, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -12.83% (8.0398 => 7.0081, std.dev.: 0.1167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.81% (2.4694 => 2.3506, std.dev.: 0.0445) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.75% (2.8300 => 2.7523, std.dev.: 0.0164) MultiSource/Applications/viterbi/viterbi: -2.70% (3.7363 => 3.6353, std.dev.: 0.0225) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.19% (1.1168 => 1.1301, std.dev.: 0.0576) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.21% (0.0218 => 0.0225, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.09% (0.0431 => 0.0440, std.dev.: 0.0204) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.00% (0.0333 => 0.0343, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0318 => 0.0321, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 13.39% (0.0381 => 0.0432, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: 9.63% (0.0187 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: 2.28% (0.0219 => 0.0224, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1440 => 0.1456, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: 3.41% (1.1322 => 1.1708, std.dev.: 0.3603) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.56% (0.4061 => 0.3957, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.13% (0.1498 => 0.1500, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.83% (0.0907 => 0.0978, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.58% (0.0556 => 0.0525, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1476 => 1.1491, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 61.11% (0.0018 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.63% (0.0555 => 0.0614, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.64% (0.0239 => 0.0317, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.27% (0.7404 => 0.7424, std.dev.: 0.0053) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.82% (0.0122 => 0.0060, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.10% (12.7567 => 12.7435, std.dev.: 0.0225) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 44.05% (0.0336 => 0.0484, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 3.96% (9.5202 => 9.8973, std.dev.: 0.1006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320725.00% (0.0008 => 2.5666, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.78% (1.1825 => 2.3506, std.dev.: 0.0445) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.06% (0.2562 => 0.2871, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/pi: 3.70% (2.1390 => 2.2182, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.37% (0.0808 => 0.0498, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0015) SingleSource/Benchmarks/SmallPT/smallpt: -26.01% (0.1888 => 0.1397, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.16% (0.1684 => 0.1294, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.79% (0.0862 => 0.0700, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.53% (0.1009 => 0.0822, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.66% (1.0986 => 0.9376, std.dev.: 0.0285) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.47% (0.2372 => 0.2100, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.00% (6.4235 => 5.7167, std.dev.: 0.2339) MultiSource/Applications/siod/siod: -7.97% (2.6437 => 2.4329, std.dev.: 0.0604) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.1610 => 0.1507, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.19% (0.2100 => 0.1970, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.35% (0.3981 => 0.3768, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: -5.10% (0.2551 => 0.2421, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -4.73% (0.2135 => 0.2034, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: -4.59% (0.4689 => 0.4474, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.43% (1.3220 => 1.2635, std.dev.: 0.0215) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.30% (0.3093 => 0.2960, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.56% (2.4519 => 2.3891, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.36% (0.9372 => 0.6433, std.dev.: 0.0219) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.83% (0.1164 => 0.1003, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.54% (0.4081 => 0.3651, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: -10.15% (4.5259 => 4.0664, std.dev.: 0.1583) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.41% (1.4588 => 1.3361, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/health/health: -6.27% (0.3654 => 0.3425, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.76% (0.3349 => 0.3156, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.29% (0.3609 => 0.3454, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.18% (23.3986 => 22.4216, std.dev.: 0.2324) SingleSource/Benchmarks/Shootout-C++/lists: -3.56% (17.2182 => 16.6049, std.dev.: 0.1074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.50% (1.4446 => 1.3941, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/mandel-2: -1.41% (0.8521 => 0.8401, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/FloatMM: -1.36% (0.8328 => 0.8215, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3147, std.dev.: 0.0057) SingleSource/Benchmarks/SmallPT/smallpt: -1.31% (14.9448 => 14.7484, std.dev.: 0.0657) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1545, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.19% (1.2047 => 1.1301, std.dev.: 0.0576) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.44% (0.0451 => 0.0440, std.dev.: 0.0204) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.94% (0.0394 => 0.0343, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0123) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0064) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -39.31% (1.9293 => 1.1708, std.dev.: 0.3603) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.27% (0.4049 => 0.3957, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.66% (0.1510 => 0.1500, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0978 => 0.0978, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.02% (0.0590 => 0.0525, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.08% (1.1617 => 1.1491, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.28% (0.0268 => 0.0317, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7437 => 0.7424, std.dev.: 0.0053) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.78% (0.0092 => 0.0060, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.27% (12.7781 => 12.7435, std.dev.: 0.0225) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 01:23:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 03:23:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117092333.85EF92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7678?compare_to=7674&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7678, Order: 172703, Start Time: 2013-01-17 07:08:58, End Time: 2013-01-17 09:23:38 To: 7674, Order: 172699, Start Time: 2013-01-17 04:26:58, End Time: 2013-01-17 06:38:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (221 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.47% (0.6991 => 0.7094, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.31% (0.9356 => 0.9479, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.17% (3.1305 => 3.1671, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8611 => 499.7608, std.dev.: 0.0412) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44216.82% (1.1277 => 499.7608, std.dev.: 0.0412) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.20% (0.5229 => 1.6743, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 21.56% (14.9895 => 18.2219, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 43.82% (14.1553 => 20.3576, std.dev.: 0.0323) MultiSource/Benchmarks/MallocBench/gs/gs: 18.56% (4.1105 => 4.8733, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.40% (1.1048 => 1.7831, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.15% (7.1582 => 38.5936, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.77% (3.4629 => 6.3983, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.50% (0.6222 => 1.0982, std.dev.: 0.0094) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10244.86% (0.0720 => 7.4483, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3834700.00% (0.0001 => 3.8348, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 11197500.00% (0.0001 => 11.1976, std.dev.: 0.0236) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487600.00% (0.0001 => 5.4877, std.dev.: 0.0007) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.54% (1.1194 => 10.2933, std.dev.: 0.0871) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.24% (22.1758 => 55.4919, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 72.52% (0.1463 => 0.2524, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 69.74% (0.0271 => 0.0460, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.09% (21.9371 => 35.9970, std.dev.: 0.0217) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.31% (7.0540 => 11.1674, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.43% (2.9384 => 4.6259, std.dev.: 0.0146) MultiSource/Benchmarks/FreeBench/distray/distray: 51.61% (0.1056 => 0.1601, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.65% (1.5859 => 2.3892, std.dev.: 0.0354) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.90% (8.1363 => 12.1960, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.22% (2.2024 => 3.1103, std.dev.: 0.0780) MultiSource/Applications/sgefa/sgefa: 40.82% (0.3109 => 0.4378, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 39.87% (0.1432 => 0.2003, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0011) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.11% (1.5415 => 2.0827, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.68% (4.2646 => 5.7434, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.17% (0.4615 => 0.6146, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.37% (0.2700 => 0.3574, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.29% (0.1892 => 0.2503, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.87% (0.2271 => 0.2972, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 30.75% (1.1642 => 1.5222, std.dev.: 0.0100) MultiSource/Benchmarks/McCat/05-eks/eks: 30.59% (0.4299 => 0.5614, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.44% (0.6675 => 0.8640, std.dev.: 0.0285) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 27.72% (9.4845 => 12.1139, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.53% (0.1584 => 0.2020, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.46% (0.5105 => 0.6507, std.dev.: 0.0163) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.29% (0.1125 => 0.1432, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: 27.22% (0.0485 => 0.0617, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.94% (0.2554 => 0.3242, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.91% (0.0457 => 0.0580, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 26.35% (1.0722 => 1.3547, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.87% (1.4186 => 1.7856, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.66% (0.1906 => 0.2395, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.65% (3.8922 => 4.8905, std.dev.: 0.1209) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 24.27% (0.4289 => 0.5330, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.13% (0.3121 => 0.3874, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.64% (0.0770 => 0.0952, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 23.29% (0.4620 => 0.5696, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 22.63% (0.7115 => 0.8725, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 22.61% (5.7591 => 7.0615, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.53% (4.9449 => 6.0591, std.dev.: 0.0088) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.48% (0.1143 => 0.1400, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.42% (0.1695 => 0.2075, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.37% (0.3098 => 0.3791, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.25% (0.1555 => 0.1901, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.01% (0.0886 => 0.1081, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.90% (0.1032 => 0.1258, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 21.76% (3.3354 => 4.0613, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.47% (0.0871 => 0.1058, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.47% (0.5860 => 0.7118, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.41% (5.0018 => 6.0725, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.23% (1.3050 => 1.5821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.23% (0.0730 => 0.0885, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 21.18% (0.1695 => 0.2054, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 21.07% (0.7835 => 0.9486, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 20.54% (0.0662 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.38% (0.2758 => 0.3320, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.26% (0.0834 => 0.1003, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 20.14% (0.6456 => 0.7756, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.97% (0.8172 => 0.9804, std.dev.: 0.0191) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 19.29% (0.1151 => 0.1373, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.2107 => 0.2512, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 19.11% (0.3423 => 0.4077, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 18.93% (0.1268 => 0.1508, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 18.86% (0.7433 => 0.8835, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.76% (0.5020 => 0.5962, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.74% (0.1510 => 0.1793, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.73% (0.5569 => 0.6612, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.61% (0.5981 => 0.7094, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 18.59% (0.0640 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.17% (0.3307 => 0.3908, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 18.02% (3.8723 => 4.5700, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.82% (0.9765 => 1.1505, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.56% (1.1840 => 1.3919, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.50% (0.8067 => 0.9479, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.35% (0.3441 => 0.4038, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 17.23% (2.0273 => 2.3766, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 17.23% (0.2049 => 0.2402, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 17.20% (10.3673 => 12.1505, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 16.87% (0.0818 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.79% (0.6450 => 0.7533, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.76% (0.8101 => 0.9459, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 16.65% (0.3387 => 0.3951, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.59% (0.0838 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 16.45% (0.3180 => 0.3703, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 16.42% (0.3283 => 0.3822, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.38% (2.2969 => 2.6731, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 16.09% (0.3232 => 0.3752, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.99% (1.1861 => 1.3758, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.61% (0.8921 => 1.0314, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.79% (0.0798 => 0.0916, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.53% (0.3379 => 0.3870, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.66% (1.5603 => 1.7734, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.57% (0.4636 => 0.5265, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 13.27% (17.1811 => 19.4614, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/bh/bh: 12.65% (0.3092 => 0.3483, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.63% (0.4203 => 0.4734, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.52% (14.3668 => 16.1649, std.dev.: 0.0207) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.26% (0.4103 => 0.4606, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: 11.86% (0.4048 => 0.4528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.85% (0.3282 => 0.3671, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.82% (0.3427 => 0.3832, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 11.78% (0.3684 => 0.4118, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.37% (0.3886 => 0.4328, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.15% (0.2430 => 0.2701, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.03% (0.3826 => 0.4248, std.dev.: 0.0015) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.56% (0.4064 => 0.4493, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 9.77% (63.2438 => 69.4235, std.dev.: 0.0543) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.29% (2.0665 => 2.2585, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 9.19% (0.2905 => 0.3172, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.18% (0.1438 => 0.1570, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 9.10% (1.2842 => 1.4011, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/except: 9.09% (0.2871 => 0.3132, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.96% (0.2891 => 0.3150, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 8.90% (0.2877 => 0.3133, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.85% (0.3650 => 0.3973, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.81% (0.2793 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.79% (0.3162 => 0.3440, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.74% (0.3935 => 0.4279, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.42% (0.6030 => 0.6538, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.42% (0.3052 => 0.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.42% (0.2756 => 0.2988, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.29% (0.2725 => 0.2951, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.11% (0.2714 => 0.2934, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 8.05% (0.7326 => 0.7916, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.69% (0.4879 => 0.5254, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.66% (7.9617 => 8.5715, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3652, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.86% (0.3177 => 0.3395, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.99% (0.3817 => 0.3931, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2461, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6960, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 6.74% (11.6436 => 12.4282, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4514, std.dev.: 0.0093) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3133, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0181) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.36% (0.9957 => 1.0292, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.69% (0.6533 => 0.6709) MultiSource/Applications/minisat/minisat: 2.17% (9.1159 => 9.3135, std.dev.: 0.0426) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 2.04% (0.8333 => 0.8503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7117, std.dev.: 0.0083) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0058) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2825, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5850, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4587, std.dev.: 0.0152) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.25% (5.2763 => 1.2006, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -75.56% (0.8651 => 0.2114, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -42.60% (0.1622 => 0.0931, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.54% (5.3855 => 4.4947, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.32% (5.3526 => 4.4789, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: -10.69% (10.4361 => 9.3209, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.94% (1.7609 => 1.6211, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9907, std.dev.: 0.0146) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.72% (1.9577 => 0.6515, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0201, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.28% (1.1492 => 0.7667, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4274, std.dev.: 0.0097) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8611, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.29% (2.6546 => 2.0099, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.91% (1.6925 => 1.4232, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4941, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2881, std.dev.: 0.0650) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.99% (1.6805 => 1.5799, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2373 => 1.1645, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.59% (8.1563 => 7.7006, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.20% (10.2830 => 9.8512, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.73% (3.6994 => 3.6355, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7221 => 3.6735, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0036) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 01:49:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 03:49:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117094943.B02082A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7679?compare_to=7676&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7679, Order: 172705, Start Time: 2013-01-17 08:15:13, End Time: 2013-01-17 09:49:50 To: 7676, Order: 172701, Start Time: 2013-01-17 06:14:00, End Time: 2013-01-17 07:47:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.34% (0.0717 => 0.1207, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 61.81% (0.0974 => 0.1576, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.81% (0.0514 => 0.0806, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.73% (0.1500 => 0.2201, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 45.32% (0.0267 => 0.0388, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.63% (0.1132 => 0.1558, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.51% (0.6395 => 0.8666, std.dev.: 0.0014) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.69% (0.6260 => 0.8369, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.42% (0.5688 => 0.7532, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.27% (0.5805 => 0.7678, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.75% (0.6230 => 0.8208, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.51% (0.5849 => 0.7692, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.44% (0.5941 => 0.7809, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.43% (0.5575 => 0.7327, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.20% (0.5581 => 0.7322, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (0.5802 => 0.7595, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.47% (0.6033 => 0.7871, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.20% (0.5705 => 0.7428, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.87% (0.5859 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.69% (0.5857 => 0.7596, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.64% (0.5925 => 0.7681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.62% (0.5570 => 0.7220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.59% (0.5478 => 0.7099, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.47% (0.5569 => 0.7210, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.19% (0.5591 => 0.7223, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.83% (0.6676 => 0.8601, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.52% (0.6052 => 0.7778, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.48% (1.6474 => 2.1165, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.39% (0.6189 => 0.7946, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.33% (0.0699 => 0.0897, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.28% (0.5863 => 0.7521, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.22% (0.6446 => 0.8265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.52% (0.6304 => 0.8039, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.57% (0.6681 => 0.8456, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.56% (0.6194 => 0.7839, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.38% (0.6297 => 0.7958, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.34% (0.6660 => 0.8414, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.87% (0.6667 => 0.8325, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.58% (0.7524 => 0.9298, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.80% (0.7339 => 0.9012, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.17% (2.2587 => 2.7368, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 18.18% (1.1450 => 1.3532, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.29% (4.5069 => 5.1058, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.23% (1.6364 => 1.8529, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.17% (0.1982 => 0.2243, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.41% (0.4916 => 0.5526, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.20% (3.5339 => 3.9298, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.19% (0.2385 => 0.2628, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 10.18% (9.2283 => 10.1681, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.76% (0.7021 => 0.7706, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.98% (1.2515 => 1.3639, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.20% (0.5329 => 0.5766, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.92% (1.4642 => 1.5801, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.90% (0.2001 => 0.2159, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.82% (1.2784 => 1.3784, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4524 => 0.4860, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.97% (0.4861 => 0.5200, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.93% (0.1731 => 0.1851, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.3255 => 0.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.39% (0.1879 => 0.1999, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.37% (5.0226 => 5.2423, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 4.03% (1.3864 => 1.4423, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 3.61% (0.6750 => 0.6994, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.57% (5.4682 => 5.6635, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.52% (22.4056 => 23.1940, std.dev.: 0.0229) MultiSource/Applications/d/make_dparser: 3.43% (3.5154 => 3.6359, std.dev.: 0.0075) MultiSource/Applications/SPASS/SPASS: 2.83% (15.5079 => 15.9464, std.dev.: 0.0169) MultiSource/Applications/minisat/minisat: 2.54% (0.7447 => 0.7636, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 2.42% (0.8418 => 0.8622, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.9557 => 0.9774, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.17% (16.1920 => 16.5429, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.13% (0.5168 => 0.5278, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.05% (1.3722 => 1.4003, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.80% (4.0323 => 4.1047, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.62% (4.8161 => 4.8941, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: 1.53% (7.0961 => 7.2047, std.dev.: 0.0223) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.32% (8.0126 => 8.1180, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.29% (4.8802 => 4.9431, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.7716 => 6.8468, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.38% (31.3723 => 55.6497, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.62% (0.9531 => 1.0257, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.10% (1.2783 => 1.3690, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5201, std.dev.: 0.1393) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.05% (2.0478 => 2.1103, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 2.27% (3.7435 => 3.8286, std.dev.: 0.0281) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6078, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (5.1955 => 5.2712, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2060, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.01% (0.3812 => 0.3621, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.93% (0.3831 => 0.3642, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.84% (0.3884 => 0.3696, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693) SingleSource/UnitTests/ObjC/synchronized: -4.80% (0.3896 => 0.3709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.68% (0.3891 => 0.3709, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.4176 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.40% (0.6347 => 0.6068, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.35% (0.3837 => 0.3670, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference-object: -3.97% (0.6441 => 0.6185, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.93% (0.4199 => 0.4034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.90% (0.2871 => 0.2759, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.74% (0.3821 => 0.3678, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.69% (0.2903 => 0.2796, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.68% (0.9852 => 0.9489, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4280 => 0.4126, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.46% (0.3205 => 0.3094, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.34% (0.3323 => 0.3212, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.31% (2.1713 => 2.0995, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.14% (0.3252 => 0.3150, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -3.11% (1.3148 => 1.2739, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.99% (0.6484 => 0.6290, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.84% (0.3658 => 0.3554, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -2.69% (2.4924 => 2.4253, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.9542 => 0.9291, std.dev.: 0.0018) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2434, std.dev.: 0.0174) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.51% (0.4151 => 0.4047, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.50% (1.0544 => 1.0386, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: -1.18% (0.9179 => 0.9071, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.06% (1.2210 => 1.2080, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.62% (1.8100 => 0.6946, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3124, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -24.51% (1.3643 => 1.0299, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0203, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2086, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1297, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.67% (0.5142 => 0.4645, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.72% (1.3096 => 1.2609, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (7.9763 => 7.7920, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1185, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.7241 => 3.6430, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4737, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1965, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6086, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3474, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0059) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 02:33:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 04:33:01 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117103301.BA1DC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7680?compare_to=7677&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7680, Order: 172705, Start Time: 2013-01-17 08:33:01, End Time: 2013-01-17 10:33:11 To: 7677, Order: 172701, Start Time: 2013-01-17 06:13:39, End Time: 2013-01-17 08:16:04 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 3 (9 on baseline) Performance Improvements: 10 (92 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1050 (962 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.44% (1.0800 => 1.0955, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.68% (4.1380 => 4.2904, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.07% (40.5318 => 41.3698, std.dev.: 0.2564) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -3.96% (5.4984 => 5.2805, std.dev.: 0.0117) MultiSource/Applications/ClamAV/clamscan: -3.31% (16.7340 => 16.1809, std.dev.: 0.1494) MultiSource/Applications/SPASS/SPASS: -3.24% (16.5313 => 15.9951, std.dev.: 0.1016) MultiSource/Applications/JM/ldecod/ldecod: -2.65% (7.6133 => 7.4115, std.dev.: 0.0196) MultiSource/Applications/JM/lencod/lencod: -2.12% (17.4389 => 17.0685, std.dev.: 0.1159) MultiSource/Applications/d/make_dparser: -1.65% (3.6660 => 3.6055, std.dev.: 0.0226) MultiSource/Applications/SIBsim4/SIBsim4: -1.53% (1.4173 => 1.3956, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -5.30% (0.2093 => 0.1982, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.98% (0.2190 => 0.2081, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: -2.14% (0.4808 => 0.4705, std.dev.: 0.0029) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.94% (1.1301 => 1.1195, std.dev.: 0.0343) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.78% (0.0225 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.82% (0.0440 => 0.0432, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.62% (0.0343 => 0.0334, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0321 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -4.88% (0.0205 => 0.0195, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -12.05% (0.0224 => 0.0197, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -16.60% (0.0253 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -1.65% (0.1456 => 0.1432, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -0.31% (1.1708 => 1.1672, std.dev.: 0.3320) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.25% (0.3957 => 0.4125, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.00% (0.1500 => 0.1485, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.24% (0.0978 => 0.1039, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.62% (0.0525 => 0.0586, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.1491 => 1.1480, std.dev.: 0.1648) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.81% (0.0614 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.89% (0.0317 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.75% (0.7424 => 0.7368, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 103.33% (0.0060 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.00% (12.7435 => 12.7440, std.dev.: 0.0359) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.50% (1.8651 => 1.9303, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 2.20% (16.7012 => 17.0685, std.dev.: 0.1159) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319712.50% (0.0008 => 2.5585, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.25% (1.1825 => 2.3680, std.dev.: 0.0426) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.25% (0.2562 => 0.2927, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/pi: 3.11% (2.1390 => 2.2055, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.97% (4.1668 => 4.2904, std.dev.: 0.0325) MultiSource/Applications/siod/siod: 1.04% (3.5910 => 3.6283, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.73% (0.0808 => 0.0487, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -26.22% (0.1888 => 0.1393, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.34% (0.1684 => 0.1291, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -20.07% (0.0862 => 0.0689, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -18.72% (1.8964 => 1.5414, std.dev.: 0.0509) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.89% (0.1079 => 0.0886, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.32% (1.0960 => 0.9171, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.85% (1.0986 => 0.9355, std.dev.: 0.0384) MultiSource/Applications/spiff/spiff: -14.82% (1.0220 => 0.8705, std.dev.: 0.0145) MultiSource/Applications/aha/aha: -12.70% (0.1378 => 0.1203, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -11.53% (1.5979 => 1.4137, std.dev.: 0.0125) MultiSource/Applications/treecc/treecc: -11.49% (2.4719 => 2.1878, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.36% (0.0889 => 0.0788, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.11% (6.4235 => 5.7101, std.dev.: 0.0270) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.87% (1.2154 => 1.0955, std.dev.: 0.0058) MultiSource/Applications/sgefa/sgefa: -9.81% (0.3598 => 0.3245, std.dev.: 0.0053) MultiSource/Applications/lua/lua: -9.71% (4.6406 => 4.1902, std.dev.: 0.0881) MultiSource/Applications/siod/siod: -8.87% (2.6437 => 2.4092, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.43% (0.2372 => 0.2172, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.19% (1.3924 => 1.2784, std.dev.: 0.0228) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.12% (1.1731 => 1.0778, std.dev.: 0.0302) SingleSource/Benchmarks/Shootout-C++/ary: -7.60% (0.2551 => 0.2357, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -7.36% (17.5634 => 16.2699, std.dev.: 0.4322) MultiSource/Applications/ClamAV/clamscan: -7.20% (17.4365 => 16.1809, std.dev.: 0.1494) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.76% (0.2100 => 0.1958, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -6.53% (0.2006 => 0.1875, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.42% (1.8127 => 1.6964, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.05% (1.0017 => 0.9411, std.dev.: 0.0129) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.98% (0.2709 => 0.2547, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: -5.95% (0.2385 => 0.2243, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.1928 => 0.1817, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: -5.48% (0.1824 => 0.1724, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: -5.37% (0.4002 => 0.3787, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.35% (3.6295 => 3.4353, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.24% (0.3665 => 0.3473, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/except: -5.20% (0.2172 => 0.2059, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.5134 => 0.4870, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: -5.02% (0.2050 => 0.1947, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.85% (0.3981 => 0.3788, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -4.72% (3.7840 => 3.6055, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/sieve: -4.43% (0.2913 => 0.2784, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: -4.41% (0.4689 => 0.4482, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.25% (0.3462 => 0.3315, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -4.18% (0.2725 => 0.2611, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -4.18% (0.3206 => 0.3072, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.75% (0.3093 => 0.2977, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: -3.60% (0.7776 => 0.7496, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: -3.41% (0.6711 => 0.6482, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.39% (0.7693 => 0.7432, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: -3.03% (1.4392 => 1.3956, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -2.75% (16.4479 => 15.9951, std.dev.: 0.1016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.71% (0.6135 => 0.5969, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.55% (2.4519 => 2.3894, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.33% (0.9214 => 0.8999, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -1.40% (5.3553 => 5.2805, std.dev.: 0.0117) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -29.85% (4.4739 => 3.1386, std.dev.: 0.1805) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.98% (4.2042 => 3.1541, std.dev.: 0.2311) MultiSource/Applications/minisat/minisat: -22.58% (7.9891 => 6.1851, std.dev.: 0.4226) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.75% (0.1164 => 0.1004, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: -10.78% (4.5259 => 4.0378, std.dev.: 0.0698) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.29% (2.8778 => 2.5818, std.dev.: 0.0781) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.12% (0.4081 => 0.3668, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/nestedloop: -9.91% (0.2200 => 0.1982, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.80% (5.0421 => 4.5482, std.dev.: 0.0441) SingleSource/Benchmarks/Shootout-C++/lists1: -9.05% (0.6628 => 0.6028, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.84% (1.4588 => 1.3298, std.dev.: 0.0393) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: -7.81% (0.1704 => 0.1571, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: -7.04% (9.0650 => 8.4267, std.dev.: 0.1441) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.95% (46.0987 => 42.8969, std.dev.: 0.7416) SingleSource/Benchmarks/Shootout/ary3: -6.20% (2.2304 => 2.0922, std.dev.: 0.0227) MultiSource/Benchmarks/Olden/health/health: -5.86% (0.3654 => 0.3440, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.28% (23.3986 => 22.1631, std.dev.: 0.2159) SingleSource/Benchmarks/Shootout-C++/ary3: -4.16% (1.8123 => 1.7369, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.52% (1.4446 => 1.3938, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists: -3.41% (17.2182 => 16.6316, std.dev.: 0.0782) SingleSource/Benchmarks/McGill/chomp: -3.35% (1.0425 => 1.0076, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.02% (40.4729 => 39.2488, std.dev.: 0.4137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.69% (0.5826 => 0.5669, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: -2.56% (4.4730 => 4.3586, std.dev.: 0.0392) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.24% (42.3194 => 41.3698, std.dev.: 0.2564) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.15% (3.0082 => 2.9436, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: -2.12% (2.8571 => 2.7964, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.10% (1.0995 => 1.0764, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.81% (3.7662 => 3.6980, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/ReedSolomon: -1.55% (8.6447 => 8.5108, std.dev.: 0.0342) SingleSource/Benchmarks/Misc/mandel-2: -1.41% (0.8521 => 0.8401, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.41% (3.3596 => 3.3123, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/FloatMM: -1.24% (0.8328 => 0.8225, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -1.10% (8.7416 => 8.6451, std.dev.: 0.0097) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.07% (1.2047 => 1.1195, std.dev.: 0.0343) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -8.45% (0.0213 => 0.0195, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -13.22% (0.0227 => 0.0197, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.25% (0.0255 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.41% (0.1530 => 0.1432, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -39.50% (1.9293 => 1.1672, std.dev.: 0.3320) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.88% (0.4049 => 0.4125, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1510 => 0.1485, std.dev.: 0.0206) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.24% (0.0978 => 0.1039, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.68% (0.0590 => 0.0586, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.18% (1.1617 => 1.1480, std.dev.: 0.1648) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.93% (0.7437 => 0.7368, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.27% (12.7781 => 12.7440, std.dev.: 0.0359) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 03:46:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 05:46:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117114654.34B9E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7681?compare_to=7679&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7681, Order: 172707, Start Time: 2013-01-17 10:13:15, End Time: 2013-01-17 11:47:00 To: 7679, Order: 172705, Start Time: 2013-01-17 08:15:13, End Time: 2013-01-17 09:49:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.20% (0.0717 => 0.1206, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.99% (0.0974 => 0.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.81% (0.0514 => 0.0806, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 46.73% (0.1500 => 0.2201, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 45.32% (0.0267 => 0.0388, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.54% (0.1132 => 0.1557, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.62% (0.6395 => 0.8673, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.77% (0.6260 => 0.8374, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.33% (0.5688 => 0.7527, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.30% (0.5805 => 0.7680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.04% (0.5456 => 0.7204, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.80% (0.6230 => 0.8211, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.76% (0.0699 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.44% (0.5849 => 0.7688, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.36% (0.5567 => 0.7313, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.27% (0.5941 => 0.7799, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.17% (0.5575 => 0.7313, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.02% (0.5581 => 0.7312, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.63% (0.5802 => 0.7579, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.39% (0.5705 => 0.7439, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.27% (0.6033 => 0.7859, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.73% (0.5859 => 0.7601, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.66% (0.5570 => 0.7222, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.59% (0.5857 => 0.7590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.54% (0.5478 => 0.7096, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.50% (0.5569 => 0.7212, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.50% (0.5925 => 0.7673, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.28% (0.5591 => 0.7228, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.83% (0.6676 => 0.8601, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.57% (1.6474 => 2.1180, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.19% (0.5863 => 0.7516, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.14% (0.6446 => 0.8260, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.78% (0.6681 => 0.8470, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.72% (0.6194 => 0.7849, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.25% (0.6297 => 0.7950, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.14% (0.6660 => 0.8401, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.75% (0.6667 => 0.8317, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.30% (0.0790 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.60% (0.7524 => 0.9300, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.77% (0.7339 => 0.9010, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.47% (0.0445 => 0.0545, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.22% (2.2587 => 2.7379, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 18.30% (1.1450 => 1.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3357 => 0.3873, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.30% (1.6364 => 1.8540, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.23% (4.5069 => 5.1033, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.39% (0.4916 => 0.5525, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 12.05% (0.4515 => 0.5059, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.12% (3.5339 => 3.9269, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 10.19% (9.2283 => 10.1691, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.10% (0.2385 => 0.2626, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.84% (0.7021 => 0.7712, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 9.00% (1.2515 => 1.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.13% (0.5329 => 0.5762, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.98% (1.4642 => 1.5811, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.76% (1.2784 => 1.3776, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.74% (0.4524 => 0.4874, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.65% (0.2001 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 7.19% (0.3255 => 0.3489, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.10% (0.4861 => 0.5206, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.05% (0.1731 => 0.1853, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.33% (0.1879 => 0.1998, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.00% (0.3319 => 0.3485, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 4.31% (5.0226 => 5.2390, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3.95% (1.3864 => 1.4412, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: 3.82% (0.6750 => 0.7008, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.52% (5.4682 => 5.6606, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.49% (22.4056 => 23.1867, std.dev.: 0.0206) MultiSource/Applications/d/make_dparser: 3.35% (3.5154 => 3.6330, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: 2.99% (0.3446 => 0.3549, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.83% (15.5079 => 15.9466, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.50% (0.9557 => 0.9796, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.41% (0.8418 => 0.8621, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.32% (0.5168 => 0.5288, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.05% (1.3722 => 1.4003, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 2.02% (16.1920 => 16.5194, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (4.0323 => 4.1010, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.68% (4.8161 => 4.8969, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: 1.56% (7.0961 => 7.2065, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.38% (4.8802 => 4.9476, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.25% (8.0126 => 8.1124, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.11% (6.7716 => 6.8470, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6632, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9531 => 1.0283, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4157, std.dev.: 0.1106) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0078) MultiSource/Benchmarks/llubenchmark/llu: 2.11% (3.7435 => 3.8225, std.dev.: 0.0186) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6049, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2773, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2067, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.36% (79.7170 => 80.8016, std.dev.: 0.2473) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3880 => 0.3700, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -4.63% (0.3848 => 0.3670, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.4033 => 0.3853, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.45% (0.3884 => 0.3711, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.29% (0.3891 => 0.3724, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -4.29% (0.4176 => 0.3997, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.04% (0.3837 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.79% (0.3821 => 0.3676, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.77% (0.6347 => 0.6108, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.55% (0.9852 => 0.9502, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -3.52% (0.6441 => 0.6214, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.37% (0.3057 => 0.2954, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.34% (0.7779 => 0.7519, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4280 => 0.4141, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.08% (0.6484 => 0.6284, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.94% (2.1713 => 2.1075, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.79% (1.3148 => 1.2781, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -2.74% (2.4924 => 2.4241, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2832, std.dev.: 0.0989) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.69% (0.7919 => 0.7785, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.53% (1.0544 => 1.0383, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.47% (0.7198 => 0.7092, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.10% (0.9179 => 0.9078, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (1.2210 => 1.2079, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.55% (1.8100 => 0.6960, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.99% (1.3643 => 1.0234, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0222, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.83% (4.1024 => 3.2067, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1316, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (7.9763 => 7.7838, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3040 => 7.1896, std.dev.: 0.0247) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4756, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.44% (2.1154 => 2.0850, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5998, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6093, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6688, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4364, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 04:00:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 06:00:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130117120033.C977B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7682?compare_to=7675&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7682, Order: 172704, Start Time: 2013-01-17 08:12:12, End Time: 2013-01-17 12:00:41 To: 7675, Order: 172697, Start Time: 2013-01-17 03:39:56, End Time: 2013-01-17 07:14:17 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (176 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (761 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 15.31% (0.3527 => 0.4067, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 53.60% (0.0625 => 0.0960, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.72% (0.1063 => 0.1464, std.dev.: 0.0041) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.52% (0.0582 => 0.0748, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.09% (0.2969 => 0.3803, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.01% (0.1107 => 0.1406, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.97% (0.5900 => 0.7491, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.67% (0.4139 => 0.5243, std.dev.: 0.0117) MultiSource/Applications/oggenc/oggenc: 26.44% (1.5932 => 2.0144, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.95% (0.4994 => 0.6290, std.dev.: 0.0141) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.46% (0.4253 => 0.5336, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.20% (0.5000 => 0.6260, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.26% (0.1620 => 0.2013, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.43% (0.1549 => 0.1912, std.dev.: 0.0051) MultiSource/Applications/viterbi/viterbi: 23.02% (0.0947 => 0.1165, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.63% (0.1003 => 0.1230, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.19% (0.2736 => 0.3343, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.91% (0.3903 => 0.4758, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.49% (0.4029 => 0.4895, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.72% (0.3890 => 0.4696, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.46% (0.1090 => 0.1313, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.38% (0.2866 => 0.3450, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.04% (0.1462 => 0.1755, std.dev.: 0.0048) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.87% (1.3152 => 1.5765, std.dev.: 0.0248) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.66% (0.2014 => 0.2410, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.44% (0.3271 => 0.3907, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 19.15% (1.8794 => 2.2393, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.06% (0.4658 => 0.5546, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: 18.45% (0.5546 => 0.6569, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.30% (0.5026 => 0.5946, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.12% (3.5627 => 4.2083, std.dev.: 0.0610) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.94% (0.1968 => 0.2321, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.92% (1.6211 => 1.9116, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.77% (0.2875 => 0.3386, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.66% (0.4361 => 0.5131, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 17.65% (0.5826 => 0.6854, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/hello: 17.50% (0.2714 => 0.3189, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: 17.38% (0.9697 => 1.1382, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 17.36% (0.2725 => 0.3198, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 17.34% (0.5889 => 0.6910, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 17.30% (0.2780 => 0.3261, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.30% (0.2729 => 0.3201, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 17.05% (0.2750 => 0.3219, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 17.03% (1.0781 => 1.2617, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.97% (0.2911 => 0.3405, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.90% (0.9909 => 1.1584, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.90% (0.3930 => 0.4594, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.88% (2.0673 => 2.4162, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 16.86% (0.2811 => 0.3285, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.86% (2.7292 => 3.1893, std.dev.: 0.0182) MultiSource/Benchmarks/Bullet/bullet: 16.72% (23.5202 => 27.4527, std.dev.: 0.1056) SingleSource/Benchmarks/Shootout-C++/random: 16.70% (0.2803 => 0.3271, std.dev.: 0.0180) SingleSource/UnitTests/ObjC++/property-reference: 16.69% (0.7171 => 0.8368, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/methcall: 16.67% (0.2813 => 0.3282, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wc: 16.60% (0.3096 => 0.3610, std.dev.: 0.0060) MultiSource/Applications/ClamAV/clamscan: 16.55% (4.2109 => 4.9079, std.dev.: 0.0886) MultiSource/Benchmarks/nbench/nbench: 16.52% (0.2566 => 0.2990, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.49% (1.9694 => 2.2942, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.34% (0.0673 => 0.0783, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 16.34% (0.3317 => 0.3859, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.26% (1.9966 => 2.3213, std.dev.: 0.0423) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 16.11% (0.3258 => 0.3783, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 16.04% (0.3267 => 0.3791, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.01% (0.3060 => 0.3550, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.86% (0.3845 => 0.4455, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.78% (0.3124 => 0.3617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.73% (0.3362 => 0.3891, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 15.57% (0.4251 => 0.4913, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/sieve: 15.57% (0.3726 => 0.4306, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/lists: 15.53% (0.3348 => 0.3868, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.37% (4.4195 => 5.0988, std.dev.: 0.0425) SingleSource/Benchmarks/Shootout-C++/moments: 15.33% (0.3678 => 0.4242, std.dev.: 0.0093) MultiSource/Applications/lua/lua: 15.27% (1.4269 => 1.6448, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 15.15% (0.4146 => 0.4774, std.dev.: 0.0051) MultiSource/Applications/treecc/treecc: 15.07% (0.7875 => 0.9062, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.06% (0.3625 => 0.4171, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 15.01% (0.2691 => 0.3095, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.85% (0.3690 => 0.4238, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: 14.60% (0.3446 => 0.3949, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.59% (0.3981 => 0.4562, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/synchronized: 14.38% (0.3469 => 0.3968, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/trivial-interface: 14.32% (0.3442 => 0.3935, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: 14.31% (0.3465 => 0.3961, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-3: 14.31% (0.3460 => 0.3955, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.28% (0.3488 => 0.3986, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/property: 14.05% (0.3650 => 0.4163, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: 13.95% (2.1653 => 2.4674, std.dev.: 0.0323) SingleSource/Benchmarks/Misc-C++/bigfib: 13.95% (0.5012 => 0.5711, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 13.94% (0.3724 => 0.4243, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/exceptions: 13.86% (0.3643 => 0.4148, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: 13.57% (5.5417 => 6.2936, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: 13.33% (4.6177 => 5.2333, std.dev.: 0.0645) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1028 => 0.1165, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.16% (0.6435 => 0.7282, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 12.91% (2.1013 => 2.3726, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: 12.67% (0.2075 => 0.2338, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.53% (0.2737 => 0.3080, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.52% (0.2068 => 0.2327, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.86% (0.6634 => 0.7421, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: 11.78% (0.3498 => 0.3910, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.67% (0.3084 => 0.3444, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.67% (0.2040 => 0.2278, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.32% (0.5361 => 0.5968, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.03% (0.2103 => 0.2335, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 10.96% (0.4847 => 0.5378, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.35% (11.6398 => 12.8445, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.27% (0.7426 => 0.8189, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.70% (4.6926 => 5.1476, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: 9.66% (0.2391 => 0.2622, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (0.5584 => 0.6108, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 9.27% (2.0346 => 2.2232, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 7.35% (11.9555 => 12.8344, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.06% (0.3792 => 0.3984, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5209, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 88.11% (0.2162 => 0.4067, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0119) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.94% (0.3693 => 0.4060, std.dev.: 0.0023) MultiSource/Applications/ClamAV/clamscan: 9.85% (0.2802 => 0.3078, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2421, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/objinst: 5.06% (12.0509 => 12.6606, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6852, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-2: 4.34% (1.8057 => 1.8841, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1905, std.dev.: 0.0098) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3110, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.45% (1.0142 => 1.0289, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2843, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.22% (3.1722 => 3.2110, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.11% (1.2197 => 1.2332, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5893, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4769, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.08% (25.4195 => 16.5014, std.dev.: 0.0383) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/fldry: -17.42% (17.2379 => 14.2346, std.dev.: 0.1383) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0044) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9775, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8027, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0076) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: -4.60% (14.0481 => 13.4025, std.dev.: 0.1891) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2334, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8121, std.dev.: 0.0249) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2230, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5769, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.27% (105.3826 => 104.0416, std.dev.: 0.1339) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0440, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 04:06:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 06:06:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117120639.0D8392A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7683?compare_to=7678&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7683, Order: 172707, Start Time: 2013-01-17 09:54:13, End Time: 2013-01-17 12:06:47 To: 7678, Order: 172703, Start Time: 2013-01-17 07:08:58, End Time: 2013-01-17 09:23:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (222 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.21% (12.1505 => 12.2976, std.dev.: 0.0126) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.55% (3.8689 => 3.8088, std.dev.: 0.0087) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7608 => 499.8383, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44223.69% (1.1277 => 499.8383, std.dev.: 0.0053) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.09% (0.5229 => 1.6685, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 21.97% (14.9895 => 18.2820, std.dev.: 0.0137) MultiSource/Applications/kimwitu++/kc: 44.69% (14.1553 => 20.4819, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 18.64% (4.1105 => 4.8769, std.dev.: 0.0271) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.95% (1.1048 => 1.7892, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 440.92% (7.1582 => 38.7199, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.89% (3.4629 => 6.4371, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.44% (0.6222 => 1.0978, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.39% (0.0720 => 7.4458, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11181600.00% (0.0001 => 11.1817, std.dev.: 0.0237) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483300.00% (0.0001 => 5.4834, std.dev.: 0.0017) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.54% (1.1194 => 10.3493, std.dev.: 0.0056) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 151.37% (22.1758 => 55.7431, std.dev.: 0.0534) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.96% (0.0929 => 0.1774, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 72.52% (0.1463 => 0.2524, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 70.11% (0.0271 => 0.0461) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206) MultiSource/Applications/JM/lencod/lencod: 62.98% (21.9371 => 35.7525, std.dev.: 0.0181) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 57.49% (7.0540 => 11.1091, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.99% (2.9384 => 4.6131, std.dev.: 0.0102) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 51.89% (0.1056 => 0.1604, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.37% (1.5859 => 2.4006, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.09% (8.1363 => 12.2121, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.40% (2.2024 => 3.1142, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.00% (0.0439 => 0.0619, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 40.27% (0.3109 => 0.4361, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 40.22% (0.1432 => 0.2008, std.dev.: 0.0003) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.34% (4.2646 => 5.7718, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.17% (1.5415 => 2.0836, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.35% (0.4615 => 0.6154, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.79% (0.2271 => 0.2993, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.30% (0.2700 => 0.3545, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 30.94% (1.1642 => 1.5244, std.dev.: 0.0158) MultiSource/Benchmarks/Olden/tsp/tsp: 30.64% (0.1175 => 0.1535, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.50% (0.1892 => 0.2469, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 29.96% (0.4299 => 0.5587, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.90% (0.6675 => 0.8671, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.11% (0.5105 => 0.6540, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 27.45% (0.2554 => 0.3255, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 27.20% (9.4845 => 12.0644, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 26.89% (0.1655 => 0.2100, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 26.87% (1.0722 => 1.3603, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.83% (0.1584 => 0.2009, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.04% (3.8922 => 4.9059, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 25.23% (0.4289 => 0.5371, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.98% (1.4186 => 1.7730, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.35% (0.3121 => 0.3881, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 23.96% (0.4620 => 0.5727, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: 23.32% (0.0626 => 0.0772, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.24% (0.1695 => 0.2089, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 23.09% (0.7115 => 0.8758, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: 22.89% (0.3098 => 0.3807, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 22.84% (5.7591 => 7.0742, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 22.70% (0.1555 => 0.1908, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.33% (4.9449 => 6.0489, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.92% (5.0018 => 6.0984, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.81% (0.0871 => 0.1061, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 21.76% (3.3354 => 4.0612, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.63% (0.0675 => 0.0821, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.60% (0.1236 => 0.1503, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.41% (0.1032 => 0.1253, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.29% (1.3050 => 1.5828, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 21.06% (0.1695 => 0.2052, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: 21.03% (0.0485 => 0.0587, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 21.01% (0.7835 => 0.9481, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/bigfib: 20.80% (0.6456 => 0.7799, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.67% (0.1940 => 0.2341, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 20.55% (0.1163 => 0.1402, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.53% (0.5860 => 0.7063, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 20.07% (0.1151 => 0.1382, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.86% (0.8172 => 0.9795, std.dev.: 0.0157) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.74% (0.2107 => 0.2523, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0886 => 0.1058, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.21% (0.1510 => 0.1800, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.20% (0.5020 => 0.5984, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 18.78% (0.3423 => 0.4066, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.75% (0.3307 => 0.3927, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 18.63% (0.7433 => 0.8818, std.dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: 18.62% (10.3673 => 12.2976, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.56% (0.2758 => 0.3270, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 18.23% (3.8723 => 4.5783, std.dev.: 0.0143) MultiSource/Applications/treecc/treecc: 18.17% (2.0273 => 2.3956, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.05% (0.5569 => 0.6574, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 18.04% (1.1840 => 1.3976, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.01% (0.9765 => 1.1524, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.79% (0.0770 => 0.0907, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.68% (0.0933 => 0.1098, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.34% (0.1044 => 0.1225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.10% (0.5981 => 0.7004, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary3: 17.00% (0.3283 => 0.3841, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.96% (0.6450 => 0.7544, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 16.95% (2.2969 => 2.6862, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ReedSolomon: 16.94% (0.2049 => 0.2396, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 16.92% (0.3180 => 0.3718, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.75% (0.8101 => 0.9458, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.62% (0.3441 => 0.4013, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 16.49% (0.3232 => 0.3765, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 16.45% (0.3387 => 0.3944, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 16.43% (0.0633 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.19% (0.8067 => 0.9373, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.94% (1.1861 => 1.3752, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 15.36% (0.3379 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 15.26% (0.8921 => 1.0282, std.dev.: 0.0036) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 14.29% (1.5603 => 1.7833, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.14% (0.2603 => 0.2971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.02% (0.3865 => 0.4407, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.40% (17.1811 => 19.4830, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.4636 => 0.5256, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.26% (0.4103 => 0.4647, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.04% (0.4203 => 0.4751, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 12.81% (0.3092 => 0.3488, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.73% (14.3668 => 16.1963, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/sieve: 12.55% (0.3603 => 0.4055, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.46% (0.3427 => 0.3854, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.33% (0.4048 => 0.4547, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 12.27% (0.3422 => 0.3842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 12.19% (0.3684 => 0.4133, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.98% (0.2430 => 0.2721, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 11.88% (0.3282 => 0.3672, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.60% (0.3826 => 0.4270, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.34% (0.4064 => 0.4525, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.31% (0.3927 => 0.4371, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.23% (0.1114 => 0.1228, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 10.09% (63.2438 => 69.6282, std.dev.: 0.0892) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.99% (2.0665 => 2.2729, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 9.79% (0.2871 => 0.3152, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3561 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.71% (0.2905 => 0.3187, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/trivial-interface: 9.70% (0.3473 => 0.3810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.69% (0.3694 => 0.4052, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2877 => 0.3154, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3543 => 0.3884, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.61% (0.3162 => 0.3466, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 9.46% (1.2842 => 1.4057, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.41% (0.2891 => 0.3163, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.34% (0.3650 => 0.3991, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.07% (0.3935 => 0.4292, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.98% (0.2872 => 0.3130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.78% (0.3052 => 0.3320, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.76% (0.1438 => 0.1564, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/random: 8.71% (0.2802 => 0.3046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.62% (0.2725 => 0.2960, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.56% (0.2793 => 0.3032, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.39% (0.3136 => 0.3399, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 8.20% (0.7326 => 0.7927, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/Hello: 7.93% (0.5925 => 0.6395, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.91% (0.4879 => 0.5265, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.59% (2.2022 => 2.3694, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.23% (7.9617 => 8.5374, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.22% (0.2266 => 0.2407, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.60% (0.3131 => 0.3275, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2404, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4629, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 5.13% (3.1578 => 3.3199, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.69% (0.9957 => 1.0324, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1052, std.dev.: 0.0179) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.51% (8.6802 => 8.8984, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.24% (3.6395 => 3.7209, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.99% (9.1159 => 9.2973, std.dev.: 0.0133) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2856, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4541, std.dev.: 0.0161) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1707, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.35% (5.2763 => 1.1951, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.49% (5.3855 => 4.4972, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.17% (5.3526 => 4.4871, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: -11.02% (10.4361 => 9.2865, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.09% (1.7609 => 1.6184, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9727, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.67% (1.9577 => 0.6525, std.dev.: 0.0169) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/lowercase: -34.03% (8.0499 => 5.3108, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.73% (1.5373 => 1.0188, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4264, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8633, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.32% (2.6546 => 2.0089, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.93% (2.6778 => 2.0906, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7312, std.dev.: 0.0022) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.08% (3.2416 => 2.9150, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3033, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.66% (1.2373 => 1.1549, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7075, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.99% (0.4808 => 0.4568, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.49% (1.5835 => 1.5124, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8354, std.dev.: 0.0150) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.99% (3.7221 => 3.6480, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0101) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0034) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 04:48:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 06:48:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117124825.679392A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7684?compare_to=7680&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7684, Order: 172708, Start Time: 2013-01-17 10:50:18, End Time: 2013-01-17 12:48:34 To: 7680, Order: 172705, Start Time: 2013-01-17 08:33:01, End Time: 2013-01-17 10:33:11 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 7 (11 on baseline) Performance Improvements: 10 (145 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1046 (907 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.2085 => 1.2246, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.05% (1.4606 => 1.8557, std.dev.: 0.0086) SingleSource/Benchmarks/Stanford/Puzzle: 11.38% (0.1687 => 0.1879, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/fldry: 4.75% (0.6508 => 0.6817, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/except: 4.03% (0.4937 => 0.5136, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.74% (2.3680 => 2.4328, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.95% (1.3298 => 1.3557, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.48% (0.3388 => 0.3270, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.72% (0.7502 => 0.7373, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.64% (0.9999 => 0.9835, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.20% (0.9571 => 0.9456, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.19% (0.9149 => 0.9040, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.58% (0.3561 => 0.3291, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.51% (0.3106 => 0.2997, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: -1.65% (5.7034 => 5.6095, std.dev.: 0.0099) MultiSource/Applications/hexxagon/hexxagon: -1.50% (13.9854 => 13.7750, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.07% (41.3698 => 40.9267, std.dev.: 0.1545) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.24% (1.1195 => 1.1222, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0432 => 0.0429, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.60% (0.0334 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.94% (0.0318 => 0.0315, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.93% (0.0430 => 0.0426, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 5.13% (0.0195 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 11.17% (0.0197 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.48% (0.0211 => 0.0231, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.28% (0.1432 => 0.1428, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 2.70% (1.1672 => 1.1987, std.dev.: 0.0513) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.44% (0.4125 => 0.4107, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.74% (0.1485 => 0.1474, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.56% (0.1039 => 0.1002, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.04% (0.0586 => 0.0533, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.57% (1.1480 => 1.1546, std.dev.: 0.1003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0609 => 0.0612, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0311 => 0.0311, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.57% (0.7368 => 0.7410, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0007 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.33% (0.0122 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.44% (12.7440 => 12.8001, std.dev.: 0.1095) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.49% (0.0336 => 0.0509, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 4.19% (9.5202 => 9.9191, std.dev.: 0.1006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.22% (1.4110 => 1.4423, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.05% (0.7225 => 0.7373, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 1.99% (16.7012 => 17.0337, std.dev.: 0.0825) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323250.00% (0.0008 => 2.5868, std.dev.: 0.0599) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.73% (1.1825 => 2.4328, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.51% (0.2562 => 0.2857, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 10.66% (0.1698 => 0.1879, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/except: 2.93% (0.4990 => 0.5136, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 1.04% (3.5910 => 3.6285, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.66% (0.0727 => 0.0475, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0001) SingleSource/Benchmarks/SmallPT/smallpt: -27.01% (0.1888 => 0.1378, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.47% (0.1684 => 0.1272, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: -19.06% (1.8964 => 1.5349, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.03% (0.0862 => 0.0698, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.09% (1.0960 => 0.8977, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.90% (0.0676 => 0.0555, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.44% (0.1009 => 0.0833, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.35% (0.7686 => 0.6429, std.dev.: 0.0057) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.54% (0.4074 => 0.3441, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.96% (1.0986 => 0.9343, std.dev.: 0.0076) MultiSource/Applications/spiff/spiff: -14.71% (1.0220 => 0.8717, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.46% (0.1079 => 0.0923, std.dev.: 0.0002) MultiSource/Applications/aha/aha: -14.44% (0.1378 => 0.1179, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.11% (0.0847 => 0.0736, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -12.20% (1.5979 => 1.4030, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.89% (0.2372 => 0.2090, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -11.71% (0.1025 => 0.0905, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.31% (1.2154 => 1.0779, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: -11.30% (1.1433 => 1.0141, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.30% (6.4235 => 5.6978, std.dev.: 0.2573) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.18% (1.3924 => 1.2367, std.dev.: 0.0194) MultiSource/Applications/treecc/treecc: -11.09% (2.4719 => 2.1977, std.dev.: 0.0059) MultiSource/Applications/lua/lua: -10.36% (4.6406 => 4.1597, std.dev.: 0.0353) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.67% (1.5131 => 1.3668, std.dev.: 0.0061) MultiSource/Applications/sgefa/sgefa: -9.34% (0.3598 => 0.3262, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.27% (0.2481 => 0.2251, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -9.02% (2.6437 => 2.4052, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.98% (0.6885 => 0.6267, std.dev.: 0.0118) MultiSource/Applications/lambda-0_1_3/lambda: -8.64% (0.8653 => 0.7905, std.dev.: 0.0031) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.59% (1.1731 => 1.0723, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.58% (0.7693 => 0.7033, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.38% (1.1498 => 1.0535, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.25% (0.9124 => 0.8371, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.15% (0.3560 => 0.3270, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: -8.14% (0.1610 => 0.1479, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: -7.89% (0.1824 => 0.1680, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.88% (10.2703 => 9.4614, std.dev.: 0.0896) MultiSource/Applications/ClamAV/clamscan: -7.60% (17.4365 => 16.1107, std.dev.: 0.0371) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.32% (0.9588 => 0.8886, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.16% (1.6874 => 1.5666, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -7.12% (17.5634 => 16.3126, std.dev.: 0.0617) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.12% (0.5746 => 0.5337, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.57% (0.2100 => 0.1962, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.43% (1.8127 => 1.6961, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.36% (0.1587 => 0.1486, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -6.06% (0.5134 => 0.4823, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.99% (1.0017 => 0.9417, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2709 => 0.2548, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.80% (0.9550 => 0.8996, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -5.48% (0.2006 => 0.1896, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.42% (0.2618 => 0.2476, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.39% (0.2283 => 0.2160, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.24% (1.3310 => 1.2613, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.16% (3.6295 => 3.4421, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.12% (0.2615 => 0.2481, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.97% (0.3665 => 0.3483, std.dev.: 0.0065) MultiSource/Applications/d/make_dparser: -4.76% (3.7840 => 3.6038, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.64% (0.9507 => 0.9066, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.53% (0.9422 => 0.8995, std.dev.: 0.0149) MultiSource/Applications/minisat/minisat: -4.49% (0.7776 => 0.7427, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary: -4.47% (0.2551 => 0.2437, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.43% (0.9127 => 0.8723, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.40% (1.0234 => 0.9784, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists1: -4.18% (0.3206 => 0.3072, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.12% (1.3220 => 1.2675, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.09% (0.3981 => 0.3818, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.07% (0.9512 => 0.9125, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: -4.03% (1.3979 => 1.3415, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.01% (0.9405 => 0.9028, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.91% (5.0381 => 4.8410, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/hash: -3.84% (0.4689 => 0.4509, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.84% (0.8990 => 0.8645, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.82% (0.9091 => 0.8744, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.71% (0.9403 => 0.9054, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.71% (0.9788 => 0.9425, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: -3.68% (1.4392 => 1.3863, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.61% (1.0052 => 0.9689, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.59% (0.3394 => 0.3272, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.47% (0.2993 => 0.2889, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.47% (0.7693 => 0.7426, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -3.47% (18.9377 => 18.2805, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.42% (1.2680 => 1.2246, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.42% (0.9993 => 0.9651, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.02% (0.5369 => 0.5207, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.99% (0.9488 => 0.9204, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.93% (0.6135 => 0.5955, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.73% (4.6579 => 4.5306, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.72% (1.0860 => 1.0565, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.63% (1.0119 => 0.9853, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: -2.60% (16.4479 => 16.0204, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.36% (0.9685 => 0.9456, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.19% (2.4519 => 2.3983, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.98% (0.8893 => 0.8717, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.90% (14.9757 => 14.6913, std.dev.: 0.0850) MultiSource/Benchmarks/Prolangs-C/football/football: -1.77% (0.9759 => 0.9586, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.64% (0.9612 => 0.9454, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: -1.33% (5.3553 => 5.2843, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.32% (0.9381 => 0.9257, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.15% (0.8732 => 0.8632, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.13% (0.9998 => 0.9885, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.03% (0.9372 => 0.6464, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.69% (1.0816 => 0.7713, std.dev.: 0.0444) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.63% (4.2042 => 3.1687, std.dev.: 0.1705) MultiSource/Applications/minisat/minisat: -22.32% (7.9891 => 6.2057, std.dev.: 0.0547) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.77% (1.5623 => 1.2691, std.dev.: 0.0246) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.96% (0.1164 => 0.0955, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.43% (0.0845 => 0.0740, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.27% (1.4235 => 1.2631, std.dev.: 0.0200) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.55% (2.8778 => 2.5741, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.88% (0.4081 => 0.3678, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/hash: -9.60% (4.5259 => 4.0914, std.dev.: 0.1414) SingleSource/Benchmarks/Shootout-C++/lists1: -9.08% (0.6628 => 0.6026, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.81% (0.3609 => 0.3291, std.dev.: 0.0094) MultiSource/Applications/SPASS/SPASS: -8.59% (9.0650 => 8.2862, std.dev.: 0.0996) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: -7.63% (0.1704 => 0.1574, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.07% (1.4588 => 1.3557, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.37% (0.3201 => 0.2997, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3654 => 0.3426, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.47% (46.0987 => 43.5770, std.dev.: 0.5079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.15% (23.3986 => 22.1925, std.dev.: 0.0825) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.99% (2.5170 => 2.4166, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.85% (1.4446 => 1.3890, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.61% (0.3349 => 0.3228, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -3.50% (17.2182 => 16.6164, std.dev.: 0.1384) MultiSource/Applications/sqlite3/sqlite3: -3.48% (4.4730 => 4.3174, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.42% (40.4729 => 39.0880, std.dev.: 0.3280) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.29% (42.3194 => 40.9267, std.dev.: 0.1545) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.25% (61.0379 => 59.0561, std.dev.: 0.3326) SingleSource/Benchmarks/Misc/ffbench: -3.02% (1.4244 => 1.3814, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/chomp: -2.51% (1.0425 => 1.0163, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.48% (3.0082 => 2.9335, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.15% (0.5826 => 0.5701, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.84% (3.7662 => 3.6969, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: -1.82% (14.0297 => 13.7750, std.dev.: 0.0180) MultiSource/Benchmarks/BitBench/five11/five11: -1.62% (5.7021 => 5.6095, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.58% (2.4498 => 2.4110, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/mandel-2: -1.50% (0.8521 => 0.8393, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.47% (3.1921 => 3.1453, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: -1.19% (2.8571 => 2.8231, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/fibo: -1.15% (4.3512 => 4.3013, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.11% (2.5334 => 2.5053, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.85% (1.2047 => 1.1222, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.74% (0.0394 => 0.0332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.27% (0.0445 => 0.0426, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.67% (0.1530 => 0.1428, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -37.87% (1.9293 => 1.1987, std.dev.: 0.0513) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.43% (0.4049 => 0.4107, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.38% (0.1510 => 0.1474, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.45% (0.0978 => 0.1002, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.66% (0.0590 => 0.0533, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1617 => 1.1546, std.dev.: 0.1003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7437 => 0.7410, std.dev.: 0.0087) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.61% (0.0092 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.17% (12.7781 => 12.8001, std.dev.: 0.1095) Report Time: 0.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 05:43:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 07:43:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117134356.F22832A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7685?compare_to=7681&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7685, Order: 172709, Start Time: 2013-01-17 12:10:10, End Time: 2013-01-17 13:44:04 To: 7681, Order: 172707, Start Time: 2013-01-17 10:13:15, End Time: 2013-01-17 11:47:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (113 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (870 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 16.13% (0.3738 => 0.4341, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.92% (0.0717 => 0.1204, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.68% (0.0974 => 0.1565, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.61% (0.0514 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.37% (0.1132 => 0.1555, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.86% (0.6395 => 0.8752, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.03% (0.6395 => 0.8635, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.23% (0.6260 => 0.8340, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.94% (0.5805 => 0.7659, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.86% (0.5688 => 0.7500, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.54% (0.5456 => 0.7177, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.22% (0.6230 => 0.8175, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.19% (0.0699 => 0.0917, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.96% (0.5849 => 0.7660, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.85% (0.5575 => 0.7295, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.73% (0.5567 => 0.7278, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.51% (0.5581 => 0.7284, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.20% (0.5802 => 0.7554, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.89% (0.6033 => 0.7836, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.85% (0.5705 => 0.7408, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.31% (0.5859 => 0.7576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.23% (0.5570 => 0.7198, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.08% (0.6440 => 0.8313, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.03% (0.5857 => 0.7557, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.01% (0.5925 => 0.7644, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.92% (0.5478 => 0.7062, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.84% (0.5569 => 0.7175, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.62% (0.5591 => 0.7191, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.25% (0.6676 => 0.8562, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.90% (1.6474 => 2.1070, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.76% (0.6052 => 0.7732, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.68% (0.6189 => 0.7902, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.58% (0.6446 => 0.8224, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.53% (0.5863 => 0.7477, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.09% (0.6304 => 0.8012, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.13% (0.6681 => 0.8427, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.98% (0.6194 => 0.7803, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.62% (0.6660 => 0.8366, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.60% (0.6297 => 0.7909, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.18% (0.6667 => 0.8279, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.05% (0.0790 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.94% (0.7524 => 0.9250, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.21% (0.7339 => 0.8969, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.62% (2.2587 => 2.7245, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.93% (1.1450 => 1.3503, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.43% (0.0621 => 0.0723, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.22% (1.6364 => 1.8528, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.22% (0.3834 => 0.4341, std.dev.: 0.0084) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.18% (4.5069 => 5.1009, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.02% (0.1982 => 0.2240, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.12% (0.4916 => 0.5512, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4515 => 0.5055, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.87% (3.5339 => 3.9179, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.2283 => 10.1554, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.94% (0.2385 => 0.2622, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.31% (0.7021 => 0.7675, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.69% (1.2515 => 1.3603, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.80% (1.4642 => 1.5784, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.67% (0.5329 => 0.5738, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.61% (1.2784 => 1.3757, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.50% (0.2001 => 0.2151, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.79% (0.4524 => 0.4831, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4861 => 0.5171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.33% (0.1879 => 0.1998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.24% (0.3255 => 0.3458, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 4.06% (5.0226 => 5.2266, std.dev.: 0.0177) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.3864 => 1.4389, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 3.20% (3.5154 => 3.6279, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6750 => 0.6959, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.07% (22.4056 => 23.0944, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (5.4682 => 5.6229, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 2.51% (15.5079 => 15.8976, std.dev.: 0.0129) MultiSource/Applications/spiff/spiff: 2.26% (0.8418 => 0.8608, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.14% (0.7447 => 0.7606, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 1.99% (16.1920 => 16.5146, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.94% (1.3722 => 1.3988, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.70% (0.9557 => 0.9719, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.59% (4.0323 => 4.0964, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 1.51% (7.0961 => 7.2029, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.45% (4.8161 => 4.8860, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.20% (8.0126 => 8.1086, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.13% (4.8802 => 4.9353, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6589, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9531 => 1.0281, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.5751 => 56.6831, std.dev.: 0.0462) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.0478 => 2.1080, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6031, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2706, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2075, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.41% (0.3812 => 0.3644, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.39% (0.3848 => 0.3679, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.38% (0.3880 => 0.3710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3831 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3884 => 0.3718, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.26% (0.4033 => 0.3861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.19% (0.3891 => 0.3728, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.12% (0.3323 => 0.3186, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.09% (0.3057 => 0.2932, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: -4.07% (0.4176 => 0.4006, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.98% (0.9852 => 0.9460, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.91% (0.3016 => 0.2898, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.87% (0.3821 => 0.3673, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -3.83% (0.2849 => 0.2740, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.82% (0.2933 => 0.2821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.81% (0.3205 => 0.3083, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.77% (0.3026 => 0.2912, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.72% (0.7779 => 0.7490, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (0.3025 => 0.2914, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.65% (2.1713 => 2.0921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.50% (0.4199 => 0.4052, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.36% (0.4280 => 0.4136, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.31% (1.3148 => 1.2713, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.04% (0.4151 => 0.4025, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.98% (0.6484 => 0.6291, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.59% (0.3867 => 0.3767, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.51% (20.7746 => 20.2540, std.dev.: 0.0536) MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (2.4924 => 2.4336, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.81% (0.7919 => 0.7776, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.66% (1.0544 => 1.0369, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.51% (0.7198 => 0.7089, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.32% (0.9179 => 0.9058, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (0.7982 => 0.7880, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: -1.19% (4.3330 => 4.2815, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.15% (1.2221 => 1.2080, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.14% (1.2210 => 1.2071, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.38% (1.8100 => 0.6991, std.dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.10% (1.3643 => 1.0219, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7540, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0261, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.37% (2.5106 => 2.1248, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1713, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.78% (1.3096 => 1.2732, std.dev.: 0.0112) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7772, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/ary3: -2.34% (3.7241 => 3.6369, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1974, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6086, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6681, std.dev.: 0.0033) MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4367, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.03% (1.6086 => 1.5921, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 06:49:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 08:49:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117144900.35C422A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7686?compare_to=7683&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7686, Order: 172709, Start Time: 2013-01-17 12:37:05, End Time: 2013-01-17 14:49:08 To: 7683, Order: 172707, Start Time: 2013-01-17 09:54:13, End Time: 2013-01-17 12:06:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (218 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/JM/lencod/lencod: 1.21% (35.7525 => 36.1834, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.85% (0.6525 => 0.6776, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8383 => 499.8488, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44224.63% (1.1277 => 499.8488, std.dev.: 0.0033) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 219.64% (0.5229 => 1.6714, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 21.54% (14.9895 => 18.2180, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 43.65% (14.1553 => 20.3337, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: 18.41% (4.1105 => 4.8674, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.75% (1.1048 => 1.7870, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.46% (7.1582 => 38.6157, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.10% (3.4629 => 6.4097, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.52% (0.6222 => 1.0983, std.dev.: 0.0071) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.56% (0.0720 => 7.4452, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11145100.00% (0.0001 => 11.1452, std.dev.: 0.0226) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849100.00% (0.0001 => 9.8492, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488000.00% (0.0001 => 5.4881, std.dev.: 0.0081) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.20% (1.1194 => 10.3119, std.dev.: 0.0493) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 150.69% (22.1758 => 55.5925, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.07% (0.0929 => 0.1775, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 90.95% (0.0243 => 0.0464, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.73% (0.1463 => 0.2527, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 69.37% (0.0271 => 0.0459, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 64.94% (21.9371 => 36.1834, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.86% (7.0540 => 11.2057, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.04% (2.9384 => 4.6145, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 51.99% (0.1056 => 0.1605, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.04% (1.5859 => 2.3953, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.90% (8.1363 => 12.1966, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.25% (2.2024 => 3.1109, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.55% (0.0439 => 0.0617, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 40.17% (0.3109 => 0.4358, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 40.08% (0.1432 => 0.2006, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.91% (0.1062 => 0.1454, std.dev.: 0.0009) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.01% (1.5415 => 2.0812, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.73% (4.2646 => 5.7457, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.09% (0.4615 => 0.6142, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.87% (0.2271 => 0.2972, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 30.78% (0.2700 => 0.3531, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 30.72% (1.1642 => 1.5218, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.44% (0.1892 => 0.2468, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 30.08% (0.4299 => 0.5592, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.83% (0.6675 => 0.8666, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.89% (0.5105 => 0.6529, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 27.68% (9.4845 => 12.1095, std.dev.: 0.0104) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810) SingleSource/Benchmarks/McGill/chomp: 27.31% (0.1655 => 0.2107, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 26.94% (0.2554 => 0.3242, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 26.62% (1.0722 => 1.3576, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.04% (0.1125 => 0.1418, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.81% (3.8922 => 4.8969, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 25.74% (0.4289 => 0.5393, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 25.40% (0.0626 => 0.0785, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.05% (0.0479 => 0.0599, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.93% (1.4186 => 1.7722, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.03% (0.3121 => 0.3871, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 23.96% (0.4620 => 0.5727, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 23.94% (0.0660 => 0.0818) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.72% (0.1695 => 0.2097, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 23.34% (0.3098 => 0.3821, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 22.92% (0.7115 => 0.8746, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 22.87% (5.7591 => 7.0763, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.70% (4.9449 => 6.0674, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 22.12% (0.1555 => 0.1899, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 21.86% (3.3354 => 4.0644, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.58% (0.0871 => 0.1059, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.46% (5.0018 => 6.0754, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.35% (0.1143 => 0.1387, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.21% (1.3050 => 1.5818, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638) SingleSource/Benchmarks/Misc-C++/bigfib: 20.94% (0.6456 => 0.7808, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.84% (0.7835 => 0.9468, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.82% (0.0730 => 0.0882) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.10% (0.5860 => 0.7038, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 19.94% (0.0662 => 0.0794, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.62% (0.0953 => 0.1140, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.46% (0.8172 => 0.9762, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 19.26% (10.3673 => 12.3645, std.dev.: 0.0108) MultiSource/Applications/aha/aha: 19.03% (0.1151 => 0.1370, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.84% (0.5020 => 0.5966, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.81% (0.1510 => 0.1794, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.75% (0.2107 => 0.2502, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 18.38% (0.3423 => 0.4052, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.17% (0.3307 => 0.3908, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.98% (3.8723 => 4.5685, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 17.97% (0.7433 => 0.8769, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.91% (0.2758 => 0.3252, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 17.82% (1.1840 => 1.3950, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 17.52% (0.2049 => 0.2408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.44% (0.9765 => 1.1468, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 17.39% (0.3283 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.36% (0.5569 => 0.6536, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.09% (2.0273 => 2.3738, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.01% (0.1117 => 0.1307, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 16.89% (0.3232 => 0.3778, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.88% (0.6450 => 0.7539, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.80% (0.8101 => 0.9462, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.79% (0.0834 => 0.0974, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.77% (0.5981 => 0.6984, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.70% (0.8067 => 0.9414, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.51% (0.2065 => 0.2406, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 16.50% (0.3387 => 0.3946, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.19% (0.3180 => 0.3695, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 16.17% (2.2969 => 2.6683, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.06% (1.1861 => 1.3766, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.98% (0.3441 => 0.3991, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: 15.89% (0.3379 => 0.3916, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.07% (0.8921 => 1.0265, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 14.63% (1.5603 => 1.7885, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/rem: 14.51% (0.1144 => 0.1310, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.00% (0.3865 => 0.4406, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.91% (0.4636 => 0.5281, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 13.79% (17.1811 => 19.5511, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.11% (0.4103 => 0.4641, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.11% (0.4203 => 0.4754, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (0.3603 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.73% (14.3668 => 16.1952, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 12.62% (0.4048 => 0.4559, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 12.58% (0.3092 => 0.3481, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 12.45% (0.3422 => 0.3848, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/oourafft: 12.22% (0.3282 => 0.3683, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 12.21% (0.3684 => 0.4134, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.85% (0.3427 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.79% (0.4064 => 0.4543, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.63% (0.3826 => 0.4271, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.56% (0.2430 => 0.2711, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 10.95% (0.3927 => 0.4357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.63% (0.2831 => 0.3132, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 10.62% (0.2871 => 0.3176, std.dev.: 0.0036) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1268 => 0.1402, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 10.09% (63.2438 => 69.6248, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.09% (2.0665 => 2.2750, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 10.08% (0.2877 => 0.3167, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2756 => 0.3025, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.6030 => 0.6617, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.72% (0.2725 => 0.2990, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.67% (0.2905 => 0.3186, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.65% (0.2891 => 0.3170, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3543 => 0.3884, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.62% (0.2714 => 0.2975, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3473 => 0.3806, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 9.58% (0.3694 => 0.4048, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.58% (0.3162 => 0.3465, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.51% (0.3543 => 0.3880, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.48% (0.3650 => 0.3996, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.43% (0.3935 => 0.4306, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.39% (0.3516 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.33% (0.2872 => 0.3140, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.31% (1.2842 => 1.4037, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 9.21% (0.3052 => 0.3333, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 9.15% (0.7326 => 0.7996, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/random: 9.10% (0.2802 => 0.3057, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.95% (0.2793 => 0.3043, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 8.83% (0.1438 => 0.1565, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.71% (0.3136 => 0.3409, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (2.2022 => 2.3820, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.95% (0.4879 => 0.5267, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.34% (7.9617 => 8.5462, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.27% (0.2266 => 0.2408, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.76% (0.3131 => 0.3280, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2479, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.83% (4.2280 => 4.4747, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0142) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (3.6395 => 3.7351, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.6802 => 8.9025, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2893, std.dev.: 0.0262) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2822, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4510, std.dev.: 0.0098) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1706, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.30% (5.2763 => 1.1975, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.47% (0.8651 => 0.2122, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.44% (5.3855 => 4.5000, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.06% (5.3526 => 4.4929, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -10.66% (10.4361 => 9.3239, std.dev.: 0.0061) SingleSource/UnitTests/Vector/constpool: -7.92% (54.1659 => 49.8762, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.90% (1.7609 => 1.6218, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.39% (1.9577 => 0.6776, std.dev.: 0.0029) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4292, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8574, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0055, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1268, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4947, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3059, std.dev.: 0.0376) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: -6.51% (1.2373 => 1.1568, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6967, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8293, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.74% (3.6994 => 3.6349, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.59% (3.7221 => 3.6630, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2368, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0018) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 07:06:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 09:06:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117150657.D23662A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7687?compare_to=7684&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7687, Order: 172709, Start Time: 2013-01-17 13:06:46, End Time: 2013-01-17 15:07:07 To: 7684, Order: 172708, Start Time: 2013-01-17 10:50:18, End Time: 2013-01-17 12:48:34 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) Performance Regressions: 14 (10 on baseline) Performance Improvements: 2 (87 on baseline) Existing Failures: 41 (40 on baseline) Unchanged Tests: 1047 (966 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.79% (0.0921 => 0.1048, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 6.23% (0.2072 => 0.2201, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.17% (0.3441 => 0.3550, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.05% (0.8886 => 0.9068, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.74% (1.9057 => 1.9389, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.50% (0.9425 => 0.9566, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.07% (0.9506 => 0.9608, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.82% (0.7713 => 0.8702, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary3: 8.63% (1.7638 => 1.9161, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/recursive: 5.02% (2.4110 => 2.5320, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.25% (59.0561 => 60.9772, std.dev.: 0.6241) SingleSource/Benchmarks/Misc/flops: 3.03% (8.5989 => 8.8595, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (63.2326 => 64.1268, std.dev.: 0.2155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.41% (3.5013 => 3.5505, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: -7.24% (0.1879 => 0.1743, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.62% (2.7985 => 2.7533, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.34% (1.1222 => 1.1072, std.dev.: 0.0153) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.43% (0.0429 => 0.0448, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.71% (0.0332 => 0.0341, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.95% (0.0315 => 0.0318, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0426 => 0.0428, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: 0.46% (0.0219 => 0.0220, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.87% (0.0231 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1428 => 0.1444, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -2.18% (1.1987 => 1.1726, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.63% (0.4107 => 0.4040, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.75% (0.1474 => 0.1485, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.69% (0.1002 => 0.0955, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.50% (0.0533 => 0.0525, std.dev.: 0.0154) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.49% (1.1546 => 1.1489, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2200.00% (0.0001 => 0.0023, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.63% (0.0612 => 0.0602, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.32% (0.0311 => 0.0312, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.88% (0.7410 => 0.7345, std.dev.: 0.1371) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.53% (0.0085 => 0.0122, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.8001 => 12.7708, std.dev.: 0.0921) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 52.38% (0.0336 => 0.0512, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.96% (1.8651 => 1.9389, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.06% (0.7225 => 0.7374, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321662.50% (0.0008 => 2.5741, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.51% (1.1825 => 2.4065, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.65% (0.2562 => 0.2886, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 5.73% (1.8123 => 1.9161, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/pi: 3.56% (2.1390 => 2.2152, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (63.1520 => 64.1268, std.dev.: 0.2155) MultiSource/Applications/siod/siod: 1.03% (3.5910 => 3.6280, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.22% (0.0727 => 0.0500, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: -27.60% (0.1888 => 0.1367, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.24% (0.1684 => 0.1259, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.27% (0.0676 => 0.0539, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.72% (0.1009 => 0.0810, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -19.51% (1.8964 => 1.5264, std.dev.: 0.0134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.90% (0.7686 => 0.6464, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.57% (0.1079 => 0.0911, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -14.40% (1.0220 => 0.8748, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.36% (1.0986 => 0.9518, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.86% (0.4074 => 0.3550, std.dev.: 0.0018) MultiSource/Applications/aha/aha: -12.84% (0.1378 => 0.1201, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: -11.68% (2.4719 => 2.1833, std.dev.: 0.0148) MultiSource/Applications/hexxagon/hexxagon: -11.44% (1.1433 => 1.0125, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -11.37% (1.5979 => 1.4162, std.dev.: 0.0058) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.85% (1.2154 => 1.0835, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.60% (6.4235 => 5.7425, std.dev.: 0.2243) MultiSource/Applications/lua/lua: -10.13% (4.6406 => 4.1705, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.00% (0.1210 => 0.1089, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.88% (1.5131 => 1.3636, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.54% (0.7693 => 0.6959, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.27% (0.9124 => 0.8278, std.dev.: 0.0144) MultiSource/Applications/sgefa/sgefa: -8.45% (0.3598 => 0.3294, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -8.40% (0.8653 => 0.7926, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -8.37% (2.6437 => 2.4224, std.dev.: 0.0071) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.30% (1.1731 => 1.0757, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.16% (1.1498 => 1.0560, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.81% (1.6874 => 1.5556, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.70% (0.2481 => 0.2290, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.58% (0.3560 => 0.3290, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -7.47% (17.5634 => 16.2518, std.dev.: 0.1392) MultiSource/Applications/ClamAV/clamscan: -7.40% (17.4365 => 16.1459, std.dev.: 0.0272) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.30% (10.2703 => 9.5202, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.91% (0.6885 => 0.6409, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.32% (0.5746 => 0.5383, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.18% (0.2283 => 0.2142, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -5.53% (0.2006 => 0.1895, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.42% (0.9588 => 0.9068, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.3310 => 1.2605, std.dev.: 0.0218) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.85% (0.2618 => 0.2491, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.54% (3.6295 => 3.4646, std.dev.: 0.0312) MultiSource/Applications/d/make_dparser: -4.42% (3.7840 => 3.6167, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (1.0234 => 0.9783, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.33% (0.3394 => 0.3247, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: -4.13% (0.7776 => 0.7455, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.02% (0.2615 => 0.2510, std.dev.: 0.0011) SingleSource/Benchmarks/Linpack/linpack-pc: -3.94% (0.2566 => 0.2465, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.92% (0.9512 => 0.9139, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.78% (5.0381 => 4.8475, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.76% (1.3220 => 1.2723, std.dev.: 0.0118) MultiSource/Applications/SIBsim4/SIBsim4: -3.68% (1.4392 => 1.3862, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.64% (0.8990 => 0.8663, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.61% (1.0052 => 0.9689, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: -3.58% (1.3979 => 1.3478, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: -3.51% (18.9377 => 18.2730, std.dev.: 0.0475) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.00% (1.2680 => 1.2300, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.41% (4.6579 => 4.5457, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/gs/gs: -2.38% (4.5936 => 4.4844, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.27% (0.9788 => 0.9566, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.24% (0.9855 => 0.9634, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.47% (0.8893 => 0.8762, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.96% (0.9372 => 0.6470, std.dev.: 0.0123) MultiSource/Applications/minisat/minisat: -22.24% (7.9891 => 6.2127, std.dev.: 0.0562) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.55% (1.0816 => 0.8702, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.49% (1.5623 => 1.2734, std.dev.: 0.0233) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.55% (1.4235 => 1.2591, std.dev.: 0.0237) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.73% (0.4081 => 0.3643, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -10.57% (4.5259 => 4.0475, std.dev.: 0.1678) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.62% (0.3217 => 0.2972, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.65% (23.3986 => 21.8417, std.dev.: 0.5450) MultiSource/Benchmarks/Olden/health/health: -6.19% (0.3654 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.51% (0.3349 => 0.3198, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -3.61% (4.4730 => 4.3117, std.dev.: 0.0523) MultiSource/Applications/SIBsim4/SIBsim4: -3.36% (3.5443 => 3.4252, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -3.03% (17.2182 => 16.6964, std.dev.: 0.0781) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.98% (2.5170 => 2.4421, std.dev.: 0.0180) MultiSource/Applications/lua/lua: -2.30% (29.0327 => 28.3641, std.dev.: 0.0306) MultiSource/Applications/hexxagon/hexxagon: -1.90% (14.0297 => 13.7626, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.85% (3.1921 => 3.1332, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -1.16% (1.5825 => 1.5642, std.dev.: 0.0067) MultiSource/Applications/aha/aha: -1.11% (3.5321 => 3.4930, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.09% (1.2047 => 1.1072, std.dev.: 0.0153) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.67% (0.0451 => 0.0448, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.62% (0.1530 => 0.1444, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -39.22% (1.9293 => 1.1726, std.dev.: 0.0216) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.22% (0.4049 => 0.4040, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1510 => 0.1485, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.35% (0.0978 => 0.0955, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.02% (0.0590 => 0.0525, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.10% (1.1617 => 1.1489, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -28.13% (0.0032 => 0.0023, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.31% (0.0610 => 0.0602, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.42% (0.0268 => 0.0312, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.24% (0.7437 => 0.7345, std.dev.: 0.1371) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7781 => 12.7708, std.dev.: 0.0921) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 07:41:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 09:41:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117154113.292602A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7688?compare_to=7685&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7688, Order: 172718, Start Time: 2013-01-17 14:07:30, End Time: 2013-01-17 15:41:20 To: 7685, Order: 172709, Start Time: 2013-01-17 12:10:10, End Time: 2013-01-17 13:44:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 1 (113 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (868 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.94% (0.4341 => 0.4083, std.dev.: 0.0022) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.92% (0.0717 => 0.1204, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.68% (0.0974 => 0.1565, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.42% (0.0514 => 0.0804, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 46.47% (0.1500 => 0.2197, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.19% (0.1132 => 0.1553, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.68% (0.6395 => 0.8741, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.86% (0.6395 => 0.8624, std.dev.: 0.0060) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.08% (0.6260 => 0.8331, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.87% (0.5805 => 0.7655, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.82% (0.5688 => 0.7498, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.47% (0.0699 => 0.0919, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.09% (0.6230 => 0.8167, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.00% (0.5941 => 0.7783, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.95% (0.5849 => 0.7659, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.79% (0.5567 => 0.7281, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.74% (0.5575 => 0.7289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.60% (0.5581 => 0.7289, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.37% (0.5802 => 0.7564, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.87% (0.6033 => 0.7835, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.75% (0.5705 => 0.7402, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.32% (0.5859 => 0.7577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.13% (0.6440 => 0.8316, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.03% (0.5925 => 0.7645, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.99% (0.5570 => 0.7185, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.99% (0.5857 => 0.7555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.90% (0.5478 => 0.7061, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.89% (0.5569 => 0.7178, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.67% (0.5591 => 0.7194, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.05% (1.6474 => 2.1095, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.91% (0.6052 => 0.7741, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.75% (0.5863 => 0.7490, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.73% (0.6189 => 0.7905, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.55% (0.6446 => 0.8222, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.06% (0.6304 => 0.8010, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.98% (0.6194 => 0.7803, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.94% (0.6681 => 0.8414, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.87% (0.6297 => 0.7926, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.78% (0.6660 => 0.8377, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.30% (0.0790 => 0.0982, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.27% (0.6667 => 0.8285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.98% (0.7524 => 0.9253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.07% (0.7339 => 0.8959, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.78% (2.2587 => 2.7281, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.58% (0.0622 => 0.0750, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 18.05% (1.1450 => 1.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.94% (0.3357 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1081 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.18% (4.5069 => 5.1007, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.17% (1.6364 => 1.8519, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.14% (0.4916 => 0.5513, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 11.81% (0.4515 => 0.5048, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.00% (3.5339 => 3.9228, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.96% (9.2283 => 10.1477, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.36% (0.7021 => 0.7678, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.92% (1.2515 => 1.3631, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.75% (0.5329 => 0.5742, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.69% (1.4642 => 1.5768, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.67% (1.2784 => 1.3765, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.64% (0.1731 => 0.1846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.49% (0.3834 => 0.4083, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.4524 => 0.4816, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.28% (0.1879 => 0.1997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.09% (0.4861 => 0.5157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.05% (0.3255 => 0.3452, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3319 => 0.3472, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 4.22% (5.0226 => 5.2344, std.dev.: 0.0135) MultiSource/Applications/SIBsim4/SIBsim4: 4.01% (1.3864 => 1.4420, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 3.22% (3.5154 => 3.6286, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.99% (22.4056 => 23.0765, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/bigfib: 2.89% (0.6750 => 0.6945, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (5.4682 => 5.6215, std.dev.: 0.0169) MultiSource/Applications/spiff/spiff: 2.57% (0.8418 => 0.8634, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.40% (15.5079 => 15.8805, std.dev.: 0.0065) MultiSource/Applications/minisat/minisat: 2.22% (0.7447 => 0.7612, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 2.08% (16.1920 => 16.5281, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.91% (1.3722 => 1.3984, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.62% (0.9557 => 0.9712, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 1.57% (7.0961 => 7.2077, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.57% (4.0323 => 4.0957, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.39% (4.8161 => 4.8832, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.27% (8.0126 => 8.1147, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.23% (4.8802 => 4.9402, std.dev.: 0.0103) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6646, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9531 => 1.0291, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.00% (1.2783 => 1.3678, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.5751 => 56.3595, std.dev.: 0.1166) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.63% (0.6469 => 0.6639, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2768, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6028, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9570, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2069, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3831 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.69% (0.3880 => 0.3698, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.46% (0.2871 => 0.2743, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.45% (0.3323 => 0.3175, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.38% (0.6347 => 0.6069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.34% (0.2903 => 0.2777, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference: -4.31% (0.7779 => 0.7444, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.29% (0.4176 => 0.3997, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.21% (0.2849 => 0.2729, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: -4.09% (0.3205 => 0.3074, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.06% (0.2933 => 0.2814, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -4.05% (0.3059 => 0.2935, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.05% (0.6441 => 0.6180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.98% (0.4199 => 0.4032, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.97% (0.9852 => 0.9461, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.88% (2.1713 => 2.0871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.58% (0.2989 => 0.2882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.50% (0.4280 => 0.4130, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.3142 => 0.3034, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.38% (1.3148 => 1.2703, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.30% (0.4151 => 0.4014, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.09% (0.3658 => 0.3545, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.96% (0.6484 => 0.6292) SingleSource/Benchmarks/Shootout-C++/lists: -2.90% (0.3621 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.85% (0.3931 => 0.3819, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -2.79% (0.3867 => 0.3759, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.67% (0.4427 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.55% (0.4321 => 0.4211, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -2.39% (2.4924 => 2.4328, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2916, std.dev.: 0.0124) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.71% (1.0544 => 1.0364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.70% (0.7919 => 0.7784, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.35% (0.9179 => 0.9055, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -1.17% (4.3330 => 4.2823, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (1.2210 => 1.2079, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (1.2221 => 1.2093, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.50% (1.8100 => 0.6969, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3088, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.53% (1.3643 => 1.0297, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0249, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.75% (0.0756 => 0.0584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2076, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3389, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.67% (2.2633 => 2.1802, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.85% (7.9763 => 7.7493, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2793, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4751, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1970, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.37% (3.7092 => 3.6583, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.04% (1.4516 => 1.4365, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 08:28:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 10:28:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130117162812.987AF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7689?compare_to=7682&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7689, Order: 172709, Start Time: 2013-01-17 12:52:49, End Time: 2013-01-17 16:28:20 To: 7682, Order: 172704, Start Time: 2013-01-17 08:12:12, End Time: 2013-01-17 12:00:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (182 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.85% (0.4354 => 0.5044, std.dev.: 0.0259) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.49% (2.0606 => 2.1120, std.dev.: 0.0131) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.04% (2.0144 => 1.9934, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.68% (0.0625 => 0.0923, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.41% (0.1063 => 0.1450, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.96% (0.2969 => 0.3799, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.56% (0.4253 => 0.5425, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.12% (0.1106 => 0.1406, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.01% (0.1107 => 0.1406, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.71% (0.5900 => 0.7476, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.65% (0.4139 => 0.5242, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.47% (0.4994 => 0.6266, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.18% (0.5000 => 0.6259, std.dev.: 0.0054) MultiSource/Applications/oggenc/oggenc: 25.12% (1.5932 => 1.9934, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.89% (0.1620 => 0.2007, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.05% (0.1549 => 0.1906, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.0948 => 0.1160, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.91% (0.3903 => 0.4758, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.62% (0.1619 => 0.1969, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.54% (0.4029 => 0.4897, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.52% (0.1462 => 0.1762, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.39% (0.2736 => 0.3294, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.31% (0.2866 => 0.3448, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.10% (0.3890 => 0.4672, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.62% (0.1218 => 0.1457, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.61% (0.2014 => 0.2409, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.52% (1.3152 => 1.5719, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.50% (0.3271 => 0.3909, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.01% (0.0605 => 0.0720, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 18.89% (0.0561 => 0.0667, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 18.57% (0.5826 => 0.6908, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 18.50% (0.5546 => 0.6572, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 18.30% (1.8794 => 2.2234, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.26% (0.2875 => 0.3400, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.22% (0.5889 => 0.6962, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.19% (0.5026 => 0.5940, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.98% (3.5627 => 4.2031, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.97% (0.4658 => 0.5495, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.73% (0.2792 => 0.3287, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.72% (1.6211 => 1.9083, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/hello: 17.69% (0.2714 => 0.3194, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.68% (0.1968 => 0.2316, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 17.68% (0.2811 => 0.3308, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.64% (0.2738 => 0.3221, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 17.61% (0.2725 => 0.3205, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 17.55% (0.2780 => 0.3268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 17.43% (0.7171 => 0.8421, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.41% (0.2803 => 0.3291, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.38% (0.0673 => 0.0790, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.37% (0.2729 => 0.3203, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 17.35% (0.9909 => 1.1628, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.26% (2.0673 => 2.4241, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 17.22% (0.9697 => 1.1367, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.20% (0.4361 => 0.5111, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 17.14% (0.2823 => 0.3307, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 17.10% (0.2813 => 0.3294, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 17.04% (0.3004 => 0.3516, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 17.02% (0.3096 => 0.3623, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.97% (1.0781 => 1.2610, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.83% (0.3060 => 0.3575, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.82% (0.3930 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.62% (0.3267 => 0.3810, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.62% (0.3195 => 0.3726, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 16.40% (23.5202 => 27.3770, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary: 16.39% (0.3258 => 0.3792, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.35% (2.7292 => 3.1753, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/sieve: 16.32% (0.3726 => 0.4334, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.31% (1.9694 => 2.2906, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/ary2: 16.13% (0.3317 => 0.3852, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.13% (4.2109 => 4.8900, std.dev.: 0.0563) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.07% (0.3845 => 0.4463, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.03% (1.9966 => 2.3166, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.01% (0.3124 => 0.3624, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.00% (0.3362 => 0.3900, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.72% (0.3282 => 0.3798, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.61% (4.4195 => 5.1096, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.57% (0.3981 => 0.4601, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 15.44% (0.3477 => 0.4014, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.42% (0.3625 => 0.4184, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 15.39% (0.3678 => 0.4244, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 15.20% (0.4146 => 0.4776, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.15% (0.3690 => 0.4249, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.13% (1.4269 => 1.6428, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 14.98% (0.4251 => 0.4888, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 14.91% (0.7875 => 0.9049, std.dev.: 0.0104) MultiSource/Applications/SIBsim4/SIBsim4: 14.27% (0.2691 => 0.3075, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 14.19% (0.5012 => 0.5723, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.11% (0.3488 => 0.3980, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 14.05% (0.3465 => 0.3952, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.02% (0.3446 => 0.3929, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.93% (0.3460 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.89% (0.3469 => 0.3951, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.83% (0.3442 => 0.3918, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.80% (2.1653 => 2.4641, std.dev.: 0.0228) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.70% (0.3650 => 0.4150, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.64% (0.2068 => 0.2350, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 13.55% (5.5417 => 6.2928, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: 13.53% (0.3643 => 0.4136, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.48% (0.3724 => 0.4226, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 13.39% (4.6177 => 5.2359, std.dev.: 0.0426) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.27% (0.6435 => 0.7289, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 13.11% (0.2075 => 0.2347, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.75% (0.2737 => 0.3086, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.71% (2.1013 => 2.3684, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.75% (0.2103 => 0.2350, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.58% (0.3084 => 0.3441, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.38% (0.6634 => 0.7389, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.30% (0.5361 => 0.5967, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 11.15% (0.3336 => 0.3708, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 10.89% (0.4847 => 0.5375, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.27% (0.7426 => 0.8189, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.17% (11.6398 => 12.8236, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 9.66% (0.2391 => 0.2622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.47% (4.6926 => 5.1369, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 9.21% (2.0346 => 2.2219, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.92% (0.5584 => 0.6082, std.dev.: 0.0070) MultiSource/Applications/kimwitu++/kc: 7.48% (11.9555 => 12.8493, std.dev.: 0.0157) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.69% (0.3792 => 0.3970, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.59% (29.0505 => 181.4462, std.dev.: 0.0418) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0318) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0293, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.28% (0.5917 => 0.6762, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.96% (0.3693 => 0.4061, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 8.32% (0.2802 => 0.3035, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 6.60% (0.2122 => 0.2262, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2371, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6683, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8906, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6860, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1906, std.dev.: 0.0101) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3078, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0831, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5951, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4773, std.dev.: 0.0096) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5662, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.24% (17.2379 => 14.2669, std.dev.: 0.1167) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8042, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2274, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8080, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -3.23% (14.0481 => 13.5947, std.dev.: 0.0926) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.02% (0.6293 => 0.6103, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7746, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.22% (197.4719 => 193.0927, std.dev.: 0.0450) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.69% (10.7630 => 10.5809, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1570, std.dev.: 0.0947) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0442, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.42s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 09:23:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 11:23:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117172331.A32E92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7690?compare_to=7687&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7690, Order: 172718, Start Time: 2013-01-17 15:26:28, End Time: 2013-01-17 17:23:41 To: 7687, Order: 172709, Start Time: 2013-01-17 13:06:46, End Time: 2013-01-17 15:07:07 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 1 (1 on baseline) Performance Regressions: 8 (10 on baseline) Performance Improvements: 18 (166 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1037 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.13% (1.4592 => 1.8697, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (0.3322 => 0.3522, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.83% (1.2455 => 1.3056, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.46% (4.7452 => 4.9566, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.00% (2.7533 => 2.8083, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.35% (3.9562 => 4.0097, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.20% (1.3989 => 1.4157, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/five11/five11: 1.08% (5.5999 => 5.6606, std.dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -5.41% (0.2201 => 0.2082, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.33% (0.9829 => 0.9600, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.17% (1.0991 => 1.0753, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.98% (0.9518 => 0.9330, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.90% (0.9103 => 0.8930, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.57% (0.9009 => 0.8868, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -1.48% (2.4224 => 2.3865, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.29% (0.9608 => 0.9484, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.17% (0.8831 => 0.8728, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.11% (1.9389 => 1.9173, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.05% (3.4646 => 3.4283, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.26% (16.3717 => 14.8564, std.dev.: 0.1367) SingleSource/Benchmarks/Shootout-C++/ackermann: -8.99% (3.8763 => 3.5280, std.dev.: 0.0802) SingleSource/Benchmarks/BenchmarkGame/recursive: -6.73% (2.5320 => 2.3615, std.dev.: 0.0575) SingleSource/Benchmarks/Shootout-C++/lists1: -4.51% (0.6258 => 0.5976, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.96% (60.9772 => 59.7828, std.dev.: 0.3705) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (2.4421 => 2.4094, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.04% (1.4576 => 1.4425, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.29% (1.1072 => 1.1215, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.09% (0.0220 => 0.0156, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.79% (0.0448 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.81% (0.0341 => 0.0253, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.52% (0.0318 => 0.0275, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -12.62% (0.0428 => 0.0374, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -30.58% (0.0206 => 0.0143, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -35.45% (0.0220 => 0.0142, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.44% (0.0229 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1444 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -3.15% (1.1726 => 1.1357, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.75% (0.4040 => 0.3929, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1485 => 0.1482, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.63% (0.0955 => 0.0961, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.22% (0.0273 => 0.0226, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.76% (0.0525 => 0.0550, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1489 => 1.1472, std.dev.: 0.1039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -8.70% (0.0023 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.49% (0.0602 => 0.0581, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.64% (0.0312 => 0.0314, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.7345 => 0.7360, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.08% (0.0122 => 0.0067, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.29% (12.7708 => 12.7337, std.dev.: 0.0264) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.24% (0.0336 => 0.0488, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 3.00% (9.5202 => 9.8059, std.dev.: 0.1035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.80% (1.8651 => 1.9173, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (0.7225 => 0.7395, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 2.26% (16.7012 => 17.0786, std.dev.: 0.0953) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.28% (1.4110 => 1.4290, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322175.00% (0.0008 => 2.5782, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.81% (1.1825 => 2.4337, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.30% (0.2562 => 0.2826, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 3.21% (2.1390 => 2.2076, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.86% (0.0808 => 0.0494, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.80% (0.0727 => 0.0474, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -27.61% (0.1684 => 0.1219, std.dev.: 0.0050) SingleSource/Benchmarks/SmallPT/smallpt: -27.44% (0.1888 => 0.1370, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.67% (0.0526 => 0.0412, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -20.65% (1.8964 => 1.5048, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -20.00% (0.7686 => 0.6149, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.72% (0.0862 => 0.0692, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.43% (1.0960 => 0.8940, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.16% (0.1079 => 0.0883, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.05% (0.0676 => 0.0554, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.64% (0.1009 => 0.0831, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -17.37% (0.1025 => 0.0847, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -15.07% (1.0986 => 0.9330, std.dev.: 0.0069) MultiSource/Applications/aha/aha: -14.37% (0.1378 => 0.1180, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -13.96% (0.5746 => 0.4944, std.dev.: 0.0294) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.92% (0.4074 => 0.3507, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.81% (0.0847 => 0.0730, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -13.30% (1.0220 => 0.8861, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -12.47% (1.5979 => 1.3987, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -12.07% (1.3924 => 1.2243, std.dev.: 0.0226) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.07% (1.2154 => 1.0687, std.dev.: 0.0091) MultiSource/Applications/treecc/treecc: -11.78% (2.4719 => 2.1806, std.dev.: 0.0078) MultiSource/Applications/hexxagon/hexxagon: -11.66% (1.1433 => 1.0100, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -11.44% (9.8875 => 8.7562, std.dev.: 0.1679) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.41% (6.4235 => 5.6903, std.dev.: 0.0519) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -10.78% (0.1058 => 0.0944, std.dev.: 0.0020) MultiSource/Applications/lua/lua: -10.47% (4.6406 => 4.1547, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.46% (0.2372 => 0.2124, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.41% (1.5131 => 1.3556, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.33% (0.1210 => 0.1085, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.08% (0.9124 => 0.8204, std.dev.: 0.0155) MultiSource/Applications/siod/siod: -9.73% (2.6437 => 2.3865, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.62% (0.7693 => 0.6953, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: -9.28% (0.3598 => 0.3264, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.98% (1.1498 => 1.0465, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.94% (1.6874 => 1.5365, std.dev.: 0.0202) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.46% (0.2481 => 0.2271, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.35% (0.1317 => 0.1207, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -8.32% (0.8653 => 0.7933, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.29% (0.3560 => 0.3265, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: -8.11% (17.4365 => 16.0232, std.dev.: 0.0410) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.03% (0.6885 => 0.6332, std.dev.: 0.0060) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.94% (1.1731 => 1.0800, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -7.61% (17.5634 => 16.2272, std.dev.: 0.1272) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.42% (10.2703 => 9.5086, std.dev.: 0.0752) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.15% (0.2615 => 0.2428, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.09% (0.2144 => 0.1992, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.60% (1.8127 => 1.6930, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.53% (1.0017 => 0.9363, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.43% (0.2100 => 0.1965, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -6.43% (0.5134 => 0.4804, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -6.32% (0.4002 => 0.3749, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -5.93% (0.2006 => 0.1887, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.91% (0.9550 => 0.8986, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.65% (0.2618 => 0.2470, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.54% (1.3310 => 1.2572, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.54% (3.6295 => 3.4283, std.dev.: 0.0109) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.53% (1.0234 => 0.9668, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.35% (0.2709 => 0.2564, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.34% (0.9588 => 0.9076, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/except: -5.02% (0.2172 => 0.2063, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -4.95% (0.2385 => 0.2267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.3462 => 0.3291, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.85% (0.9422 => 0.8965, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.83% (0.3665 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.82% (0.2283 => 0.2173, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: -4.80% (3.7840 => 3.6024, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.71% (0.9507 => 0.9059, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.70% (0.3981 => 0.3794, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.63% (0.3394 => 0.3237, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.62% (0.9127 => 0.8705, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.55% (0.9405 => 0.8977, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: -4.51% (0.2725 => 0.2602, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.40% (1.3220 => 1.2638, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.40% (5.0381 => 4.8166, std.dev.: 0.0409) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.38% (0.9512 => 0.9095, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: -4.36% (1.3979 => 1.3370, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.25% (0.9788 => 0.9372, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.20% (1.0052 => 0.9630, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4689 => 0.4493, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.17% (0.8990 => 0.8615, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.00% (0.2551 => 0.2449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.99% (0.9091 => 0.8728, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.99% (0.9403 => 0.9028, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.93% (0.9993 => 0.9600, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: -3.91% (0.7776 => 0.7472, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -3.88% (1.4392 => 1.3833, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: -3.86% (0.6711 => 0.6452, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -3.76% (18.9377 => 18.2264, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/lists1: -3.74% (0.3206 => 0.3086, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.69% (0.3093 => 0.2979, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.53% (1.2680 => 1.2233, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.52% (0.7693 => 0.7422, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.17% (0.9488 => 0.9187, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.14% (1.0119 => 0.9801, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.10% (0.9214 => 0.8928, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.99% (4.6579 => 4.5188, std.dev.: 0.0284) MultiSource/Applications/SPASS/SPASS: -2.92% (16.4479 => 15.9680, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.92% (0.6135 => 0.5956, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.80% (1.0860 => 1.0556, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.75% (2.4519 => 2.3844, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.60% (0.9685 => 0.9433, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.55% (1.0088 => 0.9831, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.44% (0.5369 => 0.5238, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.44% (0.9855 => 0.9615, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.22% (0.8926 => 0.8728, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.13% (0.9061 => 0.8868, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.04% (14.9757 => 14.6697, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.84% (0.8846 => 0.8683, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.80% (0.9612 => 0.9439, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.73% (0.9381 => 0.9219, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.48% (0.9120 => 0.8985, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: -1.43% (0.9759 => 0.9619, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: -1.26% (5.3553 => 5.2876, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.15% (0.9998 => 0.9883, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.92% (0.9372 => 0.6474, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/heapsort: -30.55% (4.4739 => 3.1073, std.dev.: 0.4118) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.69% (1.0816 => 0.7713, std.dev.: 0.0477) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.36% (4.2042 => 3.1382, std.dev.: 0.0180) MultiSource/Applications/minisat/minisat: -22.40% (7.9891 => 6.1995, std.dev.: 0.0312) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.31% (1.5623 => 1.2606, std.dev.: 0.0374) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.24% (0.1164 => 0.0975, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -16.09% (0.0845 => 0.0709, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.87% (1.4235 => 1.2546, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.93% (16.6791 => 14.8564, std.dev.: 0.1367) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -10.90% (23.3986 => 20.8489, std.dev.: 0.6156) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.90% (1.6547 => 1.4744, std.dev.: 0.0684) SingleSource/Benchmarks/Shootout/hash: -10.65% (4.5259 => 4.0440, std.dev.: 0.0858) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.63% (2.8778 => 2.5720, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0149) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.21% (1.4588 => 1.3099, std.dev.: 0.0347) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.18% (5.0421 => 4.5287, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/lists1: -9.84% (0.6628 => 0.5976, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/mst/mst: -9.19% (0.1491 => 0.1354, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.3654 => 0.3420, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/ary3: -6.29% (2.2304 => 2.0901, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.97% (0.3201 => 0.3010, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: -5.87% (0.1704 => 0.1604, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.49% (0.3349 => 0.3165, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.28% (46.0987 => 43.6638, std.dev.: 0.2747) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.27% (2.5170 => 2.4094, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -3.61% (4.4730 => 4.3115, std.dev.: 0.0536) SingleSource/Benchmarks/Shootout-C++/lists: -3.46% (17.2182 => 16.6225, std.dev.: 0.0710) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.34% (40.4729 => 39.1197, std.dev.: 0.0625) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.08% (0.3406 => 0.3301, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.61% (0.5826 => 0.5674, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.59% (42.3194 => 41.2249, std.dev.: 0.4049) SingleSource/Benchmarks/Misc/mandel-2: -2.58% (0.8521 => 0.8301, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.49% (1.0995 => 1.0721, std.dev.: 0.0098) MultiSource/Applications/spiff/spiff: -2.22% (2.8571 => 2.7937, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.06% (61.0379 => 59.7828, std.dev.: 0.3705) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.00% (1.4446 => 1.4157, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.99% (3.0082 => 2.9482, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.77% (3.7662 => 3.6997, std.dev.: 0.0203) SingleSource/Benchmarks/Misc/ReedSolomon: -1.49% (8.6447 => 8.5157, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.39% (5.9063 => 5.8242, std.dev.: 0.0245) SingleSource/Benchmarks/Stanford/FloatMM: -1.32% (0.8328 => 0.8218, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3157, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -1.25% (1.5017 => 1.4829, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -1.20% (8.7416 => 8.6365, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1543, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -1.15% (14.9448 => 14.7728, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/flops-6: -1.02% (2.4234 => 2.3987, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.01% (2.5334 => 2.5077, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.91% (1.2047 => 1.1215, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.05% (0.0233 => 0.0156, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -35.79% (0.0394 => 0.0253, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.16% (0.0328 => 0.0275, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.96% (0.0445 => 0.0374, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -32.86% (0.0213 => 0.0143, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/test1: -37.44% (0.0227 => 0.0142, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.42% (0.1530 => 0.1447, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -41.13% (1.9293 => 1.1357, std.dev.: 0.0087) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.96% (0.4049 => 0.3929, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.85% (0.1510 => 0.1482, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.74% (0.0978 => 0.0961, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.12% (0.0276 => 0.0226, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.78% (0.0590 => 0.0550, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.25% (1.1617 => 1.1472, std.dev.: 0.1039) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -34.38% (0.0032 => 0.0021, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.75% (0.0610 => 0.0581, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (0.7437 => 0.7360, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.17% (0.0092 => 0.0067, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.35% (12.7781 => 12.7337, std.dev.: 0.0264) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 09:31:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 11:31:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117173105.23A182A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7691?compare_to=7686&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7691, Order: 172718, Start Time: 2013-01-17 15:19:15, End Time: 2013-01-17 17:31:12 To: 7686, Order: 172709, Start Time: 2013-01-17 12:37:05, End Time: 2013-01-17 14:49:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (221 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (649 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8488 => 499.8486, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 44224.61% (1.1277 => 499.8486, std.dev.: 0.0049) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.86% (0.5229 => 1.6778, std.dev.: 0.0173) MultiSource/Applications/SPASS/SPASS: 21.54% (14.9895 => 18.2186, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 43.90% (14.1553 => 20.3700, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: 18.48% (4.1105 => 4.8700, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.90% (1.1048 => 1.7887, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.64% (7.1582 => 38.6288, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.97% (3.4629 => 6.4054, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.97% (0.6222 => 1.0949, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.19% (0.0720 => 7.4435, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 11145300.00% (0.0001 => 11.1454, std.dev.: 0.0198) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483500.00% (0.0001 => 5.4836, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 829.11% (1.1194 => 10.4005, std.dev.: 0.0156) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0018) MultiSource/Applications/ClamAV/clamscan: 151.90% (22.1758 => 55.8602, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 91.77% (0.0243 => 0.0466, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.28% (0.0929 => 0.1777, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.86% (0.1463 => 0.2529, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.11% (0.0271 => 0.0461, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 65.75% (0.0730 => 0.1210, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 63.77% (21.9371 => 35.9255, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.13% (7.0540 => 11.1544, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.07% (2.9384 => 4.6154, std.dev.: 0.0161) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 51.99% (0.1056 => 0.1605, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.97% (1.5859 => 2.3942, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.52% (8.1363 => 12.2465, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 41.04% (0.3109 => 0.4385, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.02% (2.2024 => 3.1059, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 40.64% (0.1432 => 0.2014, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.55% (0.0439 => 0.0617, std.dev.: 0.0010) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.17% (1.5415 => 2.0836, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.87% (4.2646 => 5.7516, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.24% (0.4615 => 0.6149, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.93% (0.2700 => 0.3562, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.50% (0.1892 => 0.2488, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.04% (0.2271 => 0.2976, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 30.91% (0.4299 => 0.5628, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 30.70% (1.1642 => 1.5216, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.68% (0.6675 => 0.8656, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.36% (0.1125 => 0.1444, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.25% (0.5105 => 0.6547, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 27.64% (9.4845 => 12.1056, std.dev.: 0.0142) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811) SingleSource/Benchmarks/McGill/chomp: 27.49% (0.1655 => 0.2110, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: 27.40% (0.1555 => 0.1981, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 27.02% (0.2554 => 0.3244, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.77% (0.1584 => 0.2008, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.60% (1.0722 => 1.3574, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.99% (3.8922 => 4.9038, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.07% (1.4186 => 1.7742, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.92% (0.1906 => 0.2381, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.36% (0.4289 => 0.5334, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.13% (0.3121 => 0.3874, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 23.81% (0.4620 => 0.5720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.54% (0.1695 => 0.2094, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.23% (5.7591 => 7.0972, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.16% (0.0842 => 0.1037, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.97% (0.7115 => 0.8749, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.89% (0.3098 => 0.3807, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 22.84% (0.0626 => 0.0769, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.57% (4.9449 => 6.0611, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 22.04% (3.3354 => 4.0704, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.81% (0.0871 => 0.1061, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.63% (5.0018 => 6.0836, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.43% (0.1143 => 0.1388, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.27% (1.3050 => 1.5826, std.dev.: 0.0114) MultiSource/Applications/spiff/spiff: 21.07% (0.7835 => 0.9486, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.82% (0.0730 => 0.0882, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 20.65% (0.1695 => 0.2045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 20.54% (0.6456 => 0.7782, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.44% (0.5860 => 0.7058, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.15% (0.1940 => 0.2331, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.62% (0.8172 => 0.9775, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374) MultiSource/Benchmarks/McCat/18-imp/imp: 19.19% (0.3423 => 0.4080, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.94% (0.2107 => 0.2506, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 18.88% (0.7433 => 0.8836, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 18.86% (10.3673 => 12.3221, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.85% (0.2758 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.81% (0.1510 => 0.1794, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.63% (0.5020 => 0.5955, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.29% (0.3307 => 0.3912, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 17.95% (3.8723 => 4.5675, std.dev.: 0.0057) MultiSource/Benchmarks/nbench/nbench: 17.85% (1.1840 => 1.3953, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.74% (0.5569 => 0.6557, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.67% (0.9765 => 1.1490, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 17.48% (0.0818 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 17.39% (2.0273 => 2.3798, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.09% (0.6450 => 0.7552, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.90% (0.5981 => 0.6992, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 16.74% (0.3387 => 0.3954, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 16.64% (0.2049 => 0.2390, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.58% (0.8101 => 0.9444, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 16.41% (2.2969 => 2.6738, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/ary: 16.40% (0.3232 => 0.3762, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.38% (0.3180 => 0.3701, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.25% (0.8067 => 0.9378, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.22% (0.3441 => 0.3999, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.77% (1.1861 => 1.3732, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/football/football: 15.24% (0.8921 => 1.0281, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3379 => 0.3883, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 14.32% (1.5603 => 1.7838, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.66% (0.3865 => 0.4393, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 13.64% (17.1811 => 19.5241, std.dev.: 0.0097) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.63% (0.4636 => 0.5268, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 12.81% (0.3092 => 0.3488, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.78% (14.3668 => 16.2031, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.66% (0.4203 => 0.4735, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 12.61% (0.3282 => 0.3696, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.48% (0.4103 => 0.4615, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/moments: 12.33% (0.4048 => 0.4547, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.24% (0.3603 => 0.4044, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.96% (0.3427 => 0.3837, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.89% (0.3684 => 0.4122, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.27% (0.4064 => 0.4522, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 10.29% (63.2438 => 69.7530, std.dev.: 0.0162) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.21% (0.3694 => 0.4071, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.14% (0.2831 => 0.3118, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.86% (2.0665 => 2.2703, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2877 => 0.3154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 9.30% (1.2842 => 1.4036, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.04% (0.1438 => 0.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.03% (0.2891 => 0.3152, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.95% (0.3935 => 0.4287, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.75% (0.3052 => 0.3319, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 8.74% (0.6030 => 0.6557, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2802 => 0.3045, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.35% (0.7326 => 0.7938, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.30% (0.4879 => 0.5284, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.29% (0.3136 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (2.2022 => 2.3842, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.59% (7.9617 => 8.5663, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.49% (0.2266 => 0.2413, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.01% (4.3953 => 10.9009, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2447, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.95% (4.2280 => 4.4794, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3121, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (0.9957 => 1.0300, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1051, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9126, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 2.08% (0.8333 => 0.8506, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.06% (9.1159 => 9.3041, std.dev.: 0.0415) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6395 => 3.7134, std.dev.: 0.0070) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2825, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4519, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1706, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.28% (5.2763 => 1.1989, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.11% (0.8651 => 0.2153, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.25% (5.3855 => 4.5104, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.94% (5.3526 => 4.4995, std.dev.: 0.0111) MultiSource/Applications/JM/ldecod/ldecod: -10.44% (10.4361 => 9.3468, std.dev.: 0.0074) SingleSource/UnitTests/Vector/constpool: -7.99% (54.1659 => 49.8401, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.43% (1.7609 => 1.6301, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.06% (1.9577 => 0.6644, std.dev.: 0.0139) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.45% (1.5373 => 1.0231, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4231, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8609, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.62% (0.2161 => 0.1737, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0009) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1270, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7341, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4949, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2939, std.dev.: 0.0424) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.42% (1.2373 => 1.1579, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.68% (8.1563 => 7.6929, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.27% (10.2830 => 9.8442, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0065) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.84% (5.0483 => 4.9556, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.50% (3.7221 => 3.6661, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2275, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: -1.05% (3.6994 => 3.6604, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0021) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 11:09:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 13:09:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117190938.9180C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7692?compare_to=7688&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7692, Order: 172729, Start Time: 2013-01-17 17:36:00, End Time: 2013-01-17 19:09:46 To: 7688, Order: 172718, Start Time: 2013-01-17 14:07:30, End Time: 2013-01-17 15:41:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (113 on baseline) Performance Improvements: 0 (115 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (864 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.29% (1.2793 => 1.2958, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.78% (0.0717 => 0.1203, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.78% (0.0974 => 0.1566, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.42% (0.0514 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.47% (0.1500 => 0.2197, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 44.94% (0.0267 => 0.0387) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.10% (0.1132 => 0.1552, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.83% (0.6395 => 0.8750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.87% (0.6395 => 0.8625, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.18% (0.6260 => 0.8337, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.01% (0.5805 => 0.7663, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.94% (0.5688 => 0.7505, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.71% (0.5456 => 0.7186, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.09% (0.6230 => 0.8167, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.05% (0.5849 => 0.7665, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.04% (0.0699 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.76% (0.5575 => 0.7290, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.72% (0.5941 => 0.7766, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.70% (0.5567 => 0.7276, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.64% (0.5581 => 0.7291, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.14% (0.5802 => 0.7551, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.90% (0.6033 => 0.7837, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.73% (0.5705 => 0.7401, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.36% (0.5859 => 0.7579, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.08% (0.5857 => 0.7560, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.06% (0.5478 => 0.7070, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.96% (0.5570 => 0.7183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.93% (0.6440 => 0.8303, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.91% (0.5569 => 0.7179, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.86% (0.5925 => 0.7635, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.62% (0.5591 => 0.7191, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.92% (1.6474 => 2.1074, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.89% (0.6052 => 0.7740, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.63% (0.6189 => 0.7899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.55% (0.5863 => 0.7478, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.49% (0.6446 => 0.8218, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.05% (0.6304 => 0.8009, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.10% (0.6681 => 0.8425, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.91% (0.6194 => 0.7799, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.77% (0.6297 => 0.7920, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.77% (0.6660 => 0.8376, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.07% (0.6667 => 0.8272, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.05% (0.0790 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.02% (0.7524 => 0.9256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.24% (0.7339 => 0.8971, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.81% (2.2587 => 2.7287, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.58% (0.0622 => 0.0750, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 18.00% (1.1450 => 1.3511, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.26% (0.0621 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.71% (0.1146 => 0.1326, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 15.07% (0.3357 => 0.3863, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.11% (1.6364 => 1.8510, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.11% (4.5069 => 5.0976, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.14% (0.4916 => 0.5513, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 11.78% (0.4515 => 0.5047, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.95% (3.5339 => 3.9208, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.02% (0.2385 => 0.2624, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.96% (9.2283 => 10.1476, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.24% (0.7021 => 0.7670, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.81% (1.2515 => 1.3617, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.79% (0.5329 => 0.5744, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.69% (1.4642 => 1.5768, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.67% (1.2784 => 1.3764, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4524 => 0.4850, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.94% (0.3834 => 0.4100, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3255 => 0.3461, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.28% (0.1879 => 0.1997, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.15% (0.4861 => 0.5160, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 5.85% (0.1761 => 0.1864, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 4.20% (5.0226 => 5.2337, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.84% (1.3864 => 1.4397, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 3.23% (3.5154 => 3.6290, std.dev.: 0.0084) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (22.4056 => 23.0808, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 2.98% (0.6750 => 0.6951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.84% (5.4682 => 5.6233, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.45% (15.5079 => 15.8872, std.dev.: 0.0121) MultiSource/Applications/minisat/minisat: 2.22% (0.7447 => 0.7612, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.21% (0.8418 => 0.8604, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 1.98% (16.1920 => 16.5121, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.3722 => 1.3970, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 1.69% (7.0961 => 7.2157, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.9557 => 0.9714, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.64% (4.0323 => 4.0983, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.47% (4.8161 => 4.8868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.35% (8.0126 => 8.1211, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.11% (4.8802 => 4.9344, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6595, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9531 => 1.0291, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6212, std.dev.: 0.0478) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.11% (2.0478 => 2.1115, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.68% (4.5320 => 4.6081, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2076, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3489 => 10.4661, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6551 => 3.6936, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3812 => 0.3631, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.70% (0.3831 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.35% (0.2871 => 0.2746, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.33% (0.7779 => 0.7442, std.dev.: 0.0071) SingleSource/UnitTests/ObjC++/Hello: -4.27% (0.6347 => 0.6076, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.18% (0.2849 => 0.2730, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: -4.12% (0.3059 => 0.2933, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.10% (0.6441 => 0.6177, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.03% (0.3821 => 0.3667, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.00% (0.2903 => 0.2787, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.99% (0.3205 => 0.3077, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.97% (2.1713 => 2.0850, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.97% (0.3025 => 0.2905, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.94% (0.3252 => 0.3124, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.91% (0.9852 => 0.9467, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4280 => 0.4125, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.61% (1.3148 => 1.2674, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: -3.41% (0.2989 => 0.2887, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.30% (0.4151 => 0.4014, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.06% (0.3658 => 0.3546, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.02% (0.6484 => 0.6288, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: -2.74% (0.3867 => 0.3761, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.66% (0.4321 => 0.4206, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.60% (0.4427 => 0.4312, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -2.50% (0.4248 => 0.4142, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2704, std.dev.: 0.0382) MultiSource/Benchmarks/PAQ8p/paq8p: -2.38% (2.4924 => 2.4330, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.12% (0.4813 => 0.4711, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.79% (0.7919 => 0.7777, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.54% (1.0544 => 1.0382, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -1.27% (0.9179 => 0.9062, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.07% (1.2221 => 1.2090, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.05% (4.3330 => 4.2873, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.27% (1.8100 => 0.6649, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2416, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0260, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0270, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2072, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.06% (2.5106 => 2.1325, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7251, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.66% (4.9100 => 4.3374, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7483, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7705, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout/ary3: -2.38% (3.7241 => 3.6356, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1186, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1925, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.33% (1.6307 => 1.6090, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6022, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -1.08% (1.4516 => 1.4359, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.05% (1.3096 => 1.2958, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 11:49:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 13:49:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117194939.557232A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7693?compare_to=7690&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7693, Order: 172731, Start Time: 2013-01-17 17:42:28, End Time: 2013-01-17 19:49:47 To: 7690, Order: 172718, Start Time: 2013-01-17 15:26:28, End Time: 2013-01-17 17:23:41 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 52 (31 on baseline) Performance Improvements: 1 (29 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1011 (1003 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 108.66% (0.0127 => 0.0265, std.dev.: 0.0004) SingleSource/UnitTests/2006-02-04-DivRem: 73.91% (0.0161 => 0.0280, std.dev.: 0.0013) SingleSource/UnitTests/2003-04-22-Switch: 57.95% (0.0176 => 0.0278, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 44.60% (0.2428 => 0.3511, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 43.08% (0.0253 => 0.0362, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/mason/mason: 42.59% (0.0796 => 0.1135, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: 41.79% (0.0280 => 0.0397, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 35.11% (0.1219 => 0.1647, std.dev.: 0.0107) MultiSource/Applications/Burg/burg: 23.94% (1.3987 => 1.7335, std.dev.: 0.0777) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 17.84% (0.0695 => 0.0819, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 15.94% (7.3947 => 8.5733, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 15.68% (0.6590 => 0.7623, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.29% (0.6149 => 0.6966, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 11.68% (16.2272 => 18.1224, std.dev.: 0.0799) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.34% (0.3624 => 0.4035, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.11% (4.8166 => 5.3518, std.dev.: 0.1138) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.59% (1.9173 => 2.1204, std.dev.: 0.0480) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.14% (1.5365 => 1.6770, std.dev.: 0.0525) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.69% (9.5086 => 10.3350, std.dev.: 0.2341) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.41% (23.8622 => 25.6302, std.dev.: 0.1768) MultiSource/Applications/kimwitu++/kc: 7.35% (18.2264 => 19.5658, std.dev.: 0.0840) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.89% (0.9028 => 0.9650, std.dev.: 0.0223) MultiSource/Applications/oggenc/oggenc: 6.23% (5.2876 => 5.6168, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.71% (0.8723 => 0.9134, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.33% (0.9807 => 1.0232, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.05% (44.3185 => 46.1147, std.dev.: 0.5789) MultiSource/Applications/minisat/minisat: 2.97% (0.7472 => 0.7694, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 2.56% (4.1547 => 4.2611, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.54% (0.4992 => 0.5119, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.24% (0.9439 => 0.9650, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 62.89% (0.0415 => 0.0676, std.dev.: 0.0075) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 31.03% (0.0709 => 0.0929, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.93% (1.4744 => 1.9010, std.dev.: 0.1416) SingleSource/Benchmarks/CoyoteBench/lpbench: 21.02% (4.0904 => 4.9500, std.dev.: 0.1147) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.45% (2.4094 => 2.8781, std.dev.: 0.0578) MultiSource/Applications/SPASS/SPASS: 16.68% (8.6013 => 10.0363, std.dev.: 0.0831) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.82% (14.8564 => 17.0583, std.dev.: 0.1244) MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.50% (2.5720 => 2.9450, std.dev.: 0.0600) MultiSource/Benchmarks/7zip/7zip-benchmark: 14.00% (9.1694 => 10.4528, std.dev.: 0.1037) SingleSource/Benchmarks/Shootout-C++/ary3: 10.48% (1.7359 => 1.9179, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 10.34% (20.6567 => 22.7920, std.dev.: 0.5353) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.83% (20.8489 => 22.4817, std.dev.: 0.0406) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.54% (43.6638 => 46.5213, std.dev.: 0.4242) SingleSource/Benchmarks/Shootout/hash: 5.85% (4.0440 => 4.2804, std.dev.: 0.0745) SingleSource/Benchmarks/BenchmarkGame/recursive: 4.62% (2.3615 => 2.4705, std.dev.: 0.0205) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.60% (1.3099 => 1.3571, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.20% (39.1197 => 40.3723, std.dev.: 0.1277) MultiSource/Benchmarks/Olden/tsp/tsp: 2.18% (1.4829 => 1.5153, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.04% (4.9566 => 5.0578, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.54% (4.4082 => 4.4761, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.33% (2.7234 => 2.7597, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/lists: 1.04% (7.2998 => 7.3759, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -1.27% (63.8739 => 63.0639, std.dev.: 0.2570) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.20% (1.1215 => 1.1237, std.dev.: 0.3591) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 45.51% (0.0156 => 0.0227, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.62% (0.0431 => 0.0438, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 33.99% (0.0253 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.09% (0.0275 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 16.31% (0.0374 => 0.0435, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 47.55% (0.0143 => 0.0211, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 57.04% (0.0142 => 0.0223, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.43% (0.0230 => 0.0231, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.52% (0.1447 => 0.1469, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: 28.64% (1.1357 => 1.4610, std.dev.: 0.3148) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.17% (0.3929 => 0.3975, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.55% (0.1482 => 0.1505, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.0961 => 0.0938, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 34.07% (0.0226 => 0.0303, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.45% (0.0550 => 0.0558, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.22% (1.1472 => 1.1497, std.dev.: 0.0990) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 52.38% (0.0021 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.48% (0.0581 => 0.0555, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (0.0314 => 0.0307, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (0.7360 => 0.7401, std.dev.: 0.0085) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 22.39% (0.0067 => 0.0082, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.39% (12.7337 => 12.7836, std.dev.: 0.0912) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-05-12-MinIntProblem: 70.97% (0.0155 => 0.0265, std.dev.: 0.0004) SingleSource/UnitTests/2006-02-04-DivRem: 60.92% (0.0174 => 0.0280, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: 43.13% (0.0793 => 0.1135, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/fp-convert: 40.78% (0.0282 => 0.0397, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 34.26% (0.2615 => 0.3511, std.dev.: 0.0274) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.04% (0.0688 => 0.0819, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 16.60% (7.3529 => 8.5733, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.69% (1.8651 => 2.1204, std.dev.: 0.0480) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.54% (7.2721 => 8.1111, std.dev.: 0.3229) MultiSource/Applications/JM/lencod/lencod: 11.24% (16.7012 => 18.5776, std.dev.: 0.6805) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.94% (0.6934 => 0.7623, std.dev.: 0.0201) MultiSource/Benchmarks/mafft/pairlocalalign: 8.73% (9.5202 => 10.3513, std.dev.: 0.2538) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.67% (23.5861 => 25.6302, std.dev.: 0.1768) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.23% (5.0381 => 5.3518, std.dev.: 0.1138) MultiSource/Applications/oggenc/oggenc: 4.88% (5.3553 => 5.6168, std.dev.: 0.0579) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.44% (44.1538 => 46.1147, std.dev.: 0.5789) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.70% (0.9867 => 1.0232, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 3.32% (18.9377 => 19.5658, std.dev.: 0.0840) MultiSource/Applications/sqlite3/sqlite3: 3.18% (17.5634 => 18.1224, std.dev.: 0.0799) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 325212.50% (0.0008 => 2.6025, std.dev.: 0.1226) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.97% (1.1825 => 2.4120, std.dev.: 0.0288) MultiSource/Benchmarks/MallocBench/gs/gs: 17.25% (0.0771 => 0.0904, std.dev.: 0.0017) MultiSource/Benchmarks/7zip/7zip-benchmark: 16.04% (9.0082 => 10.4528, std.dev.: 0.1037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.35% (2.5170 => 2.8781, std.dev.: 0.0578) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.14% (4.4540 => 4.9500, std.dev.: 0.1147) MultiSource/Benchmarks/nbench/nbench: 11.12% (20.5117 => 22.7920, std.dev.: 0.5353) MultiSource/Applications/SPASS/SPASS: 10.71% (9.0650 => 10.0363, std.dev.: 0.0831) SingleSource/Benchmarks/Shootout-C++/ary3: 5.83% (1.8123 => 1.9179, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.27% (16.6791 => 17.0583, std.dev.: 0.1244) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.08% (4.3851 => 4.4761, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.56% (4.9799 => 5.0578, std.dev.: 0.0217) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.76% (0.0808 => 0.0511, std.dev.: 0.0055) SingleSource/Benchmarks/SmallPT/smallpt: -23.62% (0.1888 => 0.1442, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.94% (0.1009 => 0.0828, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.65% (6.4235 => 5.7397, std.dev.: 0.2225) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.51% (0.4074 => 0.3646, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -9.37% (0.7686 => 0.6966, std.dev.: 0.0221) MultiSource/Applications/hexxagon/hexxagon: -8.93% (1.1433 => 1.0412, std.dev.: 0.0326) MultiSource/Applications/lua/lua: -8.18% (4.6406 => 4.2611, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: -6.71% (0.1610 => 0.1502, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.69% (1.8127 => 1.7096, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.26% (1.0017 => 0.9490, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/hash2: -4.91% (0.5134 => 0.4882, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.11% (3.6295 => 3.4802, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.36% (0.9507 => 0.9188, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.87% (0.6135 => 0.5959, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -26.85% (0.9372 => 0.6856, std.dev.: 0.0592) MultiSource/Applications/minisat/minisat: -16.49% (7.9891 => 6.6720, std.dev.: 0.3594) MultiSource/Benchmarks/Fhourstones/fhourstones: -14.39% (1.5623 => 1.3375, std.dev.: 0.0687) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.52% (1.4235 => 1.2737, std.dev.: 0.0278) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.75% (0.4081 => 0.3683, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/lists1: -7.83% (0.6628 => 0.6109, std.dev.: 0.0196) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.97% (1.4588 => 1.3571, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/hash: -5.42% (4.5259 => 4.2804, std.dev.: 0.0745) MultiSource/Benchmarks/Olden/health/health: -5.42% (0.3654 => 0.3456, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.42% (0.3349 => 0.3201, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.92% (23.3986 => 22.4817, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/lists: -3.19% (17.2182 => 16.6686, std.dev.: 0.1050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.87% (0.5826 => 0.5717, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -1.76% (14.0297 => 13.7829, std.dev.: 0.0133) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.72% (1.2047 => 1.1237, std.dev.: 0.3591) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -0.94% (0.0213 => 0.0211, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.99% (0.1530 => 0.1469, std.dev.: 0.0044) MultiSource/Applications/lemon/lemon: -24.27% (1.9293 => 1.4610, std.dev.: 0.3148) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.83% (0.4049 => 0.3975, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.33% (0.1510 => 0.1505, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.09% (0.0978 => 0.0938, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.78% (0.0276 => 0.0303, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.42% (0.0590 => 0.0558, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.03% (1.1617 => 1.1497, std.dev.: 0.0990) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0032 => 0.0032, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.02% (0.0610 => 0.0555, std.dev.: 0.0151) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.55% (0.0268 => 0.0307, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0085) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.87% (0.0092 => 0.0082, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7836, std.dev.: 0.0912) Report Time: 0.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 12:13:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 14:13:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117201332.59F2C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7694?compare_to=7691&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7694, Order: 172731, Start Time: 2013-01-17 18:01:41, End Time: 2013-01-17 20:13:40 To: 7691, Order: 172718, Start Time: 2013-01-17 15:19:15, End Time: 2013-01-17 17:31:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (219 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.13% (3.1325 => 3.1680, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0652 => 0.0654, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8486 => 499.8350, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.40% (1.1277 => 499.8350, std.dev.: 0.0121) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 220.88% (0.5229 => 1.6779, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 21.72% (14.9895 => 18.2452, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 43.68% (14.1553 => 20.3377, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 18.50% (4.1105 => 4.8709, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.89% (1.1048 => 1.7886, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 439.35% (7.1582 => 38.6080, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.33% (3.4629 => 6.4178, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.99% (0.6222 => 1.0950, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.22% (0.0720 => 7.4428, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11140000.00% (0.0001 => 11.1401, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850500.00% (0.0001 => 9.8506) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486300.00% (0.0001 => 5.4864, std.dev.: 0.0040) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 828.73% (1.1194 => 10.3962, std.dev.: 0.0084) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 151.79% (22.1758 => 55.8374, std.dev.: 0.0387) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.39% (0.0929 => 0.1778, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 91.36% (0.0243 => 0.0465, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.86% (0.1463 => 0.2529, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.11% (0.0271 => 0.0461, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.62% (0.0730 => 0.1209, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 63.86% (21.9371 => 35.9466, std.dev.: 0.0183) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 58.21% (7.0540 => 11.1604, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.17% (2.9384 => 4.6183, std.dev.: 0.0030) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361) MultiSource/Benchmarks/FreeBench/distray/distray: 52.18% (0.1056 => 0.1607, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.12% (1.5859 => 2.3966, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.48% (8.1363 => 12.2439, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.22% (2.2024 => 3.1103, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 41.07% (0.3109 => 0.4386, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.77% (0.0439 => 0.0618, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 40.64% (0.1432 => 0.2014, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.34% (4.2646 => 5.7718, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.08% (1.5415 => 2.0822, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.22% (0.4615 => 0.6148, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.18% (0.1892 => 0.2482, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.15% (0.2700 => 0.3541, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 31.12% (0.4299 => 0.5637, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.09% (0.2271 => 0.2977, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.54% (1.1642 => 1.5198, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.90% (0.6675 => 0.8671, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.72% (0.5105 => 0.6520, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 27.67% (9.4845 => 12.1084, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.98% (0.2554 => 0.3243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 26.66% (1.0722 => 1.3580, std.dev.: 0.0134) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.09% (3.8922 => 4.9075, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.26% (0.0479 => 0.0600, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.22% (0.0793 => 0.0993) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.07% (1.4186 => 1.7742, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.76% (0.1906 => 0.2378, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.38% (0.3121 => 0.3882, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.34% (0.4289 => 0.5333, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.93% (0.1337 => 0.1657, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 23.74% (0.4620 => 0.5717, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 23.23% (5.7591 => 7.0971, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 23.05% (0.7115 => 0.8755, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.82% (0.3098 => 0.3805, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.80% (0.0842 => 0.1034, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 22.52% (0.0626 => 0.0767) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.50% (4.9449 => 6.0576, std.dev.: 0.0135) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 22.38% (0.1555 => 0.1903, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.93% (5.0018 => 6.0985, std.dev.: 0.0061) MultiSource/Applications/d/make_dparser: 21.89% (3.3354 => 4.0656, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.81% (0.0871 => 0.1061, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.56% (0.0886 => 0.1077, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.43% (0.1143 => 0.1388) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.30% (1.3050 => 1.5829, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 21.12% (0.7835 => 0.9490, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.83% (0.1032 => 0.1247, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.82% (0.0730 => 0.0882, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.72% (0.6456 => 0.7794, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.71% (0.1695 => 0.2046, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.34% (0.5860 => 0.7052, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.93% (0.8172 => 0.9801, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.03% (0.2107 => 0.2508, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.94% (0.1510 => 0.1796, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 18.87% (10.3673 => 12.3239, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 18.77% (0.7433 => 0.8828, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504) MultiSource/Benchmarks/McCat/18-imp/imp: 18.52% (0.3423 => 0.4057, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.51% (0.3307 => 0.3919, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.14% (0.5569 => 0.6579, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.13% (0.2758 => 0.3258, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.98% (3.8723 => 4.5685, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 17.93% (1.1840 => 1.3963, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.68% (0.9765 => 1.1491, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 17.48% (0.0818 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 17.29% (2.0273 => 2.3778, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 17.07% (0.3387 => 0.3965, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.98% (0.6450 => 0.7545, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.97% (0.3283 => 0.3840, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.75% (0.5981 => 0.6983, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.64% (0.2049 => 0.2390, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.55% (0.8101 => 0.9442, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.42% (0.3180 => 0.3702, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.30% (2.2969 => 2.6714, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.10% (0.3441 => 0.3995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.89% (0.8067 => 0.9349, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.74% (1.1861 => 1.3728, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 15.23% (0.8921 => 1.0280, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3379 => 0.3883, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 14.32% (1.5603 => 1.7837, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.95% (0.3865 => 0.4404, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.4636 => 0.5275, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 13.64% (17.1811 => 19.5245, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.94% (0.4203 => 0.4747, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.84% (14.3668 => 16.2119, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/oourafft: 12.71% (0.3282 => 0.3699, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: 12.68% (0.3092 => 0.3484, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.58% (0.4103 => 0.4619, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 12.43% (0.3603 => 0.4051, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.35% (0.4048 => 0.4548, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.14% (0.3427 => 0.3843, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 12.13% (0.3422 => 0.3837, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 11.83% (0.3684 => 0.4120, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.69% (0.2430 => 0.2714, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 10.35% (63.2438 => 69.7890, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.25% (0.3473 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.25% (0.3543 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 10.21% (0.2831 => 0.3120, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.13% (0.3516 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.80% (2.0665 => 2.2690, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.66% (0.2877 => 0.3155, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.54% (0.2905 => 0.3182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 9.51% (0.2871 => 0.3144, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.34% (1.2842 => 1.4042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.33% (0.3162 => 0.3457, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.11% (0.1438 => 0.1569, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.02% (0.2872 => 0.3131, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.00% (0.3935 => 0.4289, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 8.81% (0.3052 => 0.3321, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.69% (0.6030 => 0.6554, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.67% (0.2802 => 0.3045, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.44% (0.4879 => 0.5291, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.2793 => 0.3028) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.5925 => 0.6416, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.27% (2.2022 => 2.3843, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.3136 => 0.3395, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.53% (7.9617 => 8.5614, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.53% (0.2266 => 0.2414, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2495, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4558, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3140, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.47% (0.9957 => 1.0303, std.dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1048, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.6802 => 8.9044, std.dev.: 0.0155) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.35% (3.6395 => 3.7252, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.07% (9.1159 => 9.3047, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.04% (0.8333 => 0.8503, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2849, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1706, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.27% (5.2763 => 1.1991, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -74.88% (0.8651 => 0.2173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.20% (5.3855 => 4.5131, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.93% (5.3526 => 4.4997, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: -10.50% (10.4361 => 9.3406, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9005, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.44% (1.7609 => 1.6299, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.75% (1.9577 => 0.6705, std.dev.: 0.0135) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4280, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8548, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0066, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.62% (0.2161 => 0.1737, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2861, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.10% (1.8329 => 1.7028, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.34% (1.2373 => 1.1589, std.dev.: 0.0275) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.52% (8.1563 => 7.7064, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8252, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.80% (3.7221 => 3.6552, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.11% (4.9088 => 4.8542, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0027) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 13:01:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 15:01:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130117210119.496572A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7695?compare_to=7689&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7695, Order: 172718, Start Time: 2013-01-17 17:25:01, End Time: 2013-01-17 21:01:26 To: 7689, Order: 172709, Start Time: 2013-01-17 12:52:49, End Time: 2013-01-17 16:28:20 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.74% (0.6266 => 0.6563, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.07% (1.5719 => 1.6044, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.03% (54.2788 => 54.8399, std.dev.: 0.0630) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 54.08% (0.0625 => 0.0963, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 43.74% (0.1063 => 0.1528, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 43.10% (0.0239 => 0.0342, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.21% (0.0714 => 0.0944, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.42% (0.4994 => 0.6563, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.79% (0.2969 => 0.3794, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.44% (0.4253 => 0.5420, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.01% (0.1107 => 0.1406, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.88% (0.5900 => 0.7486, std.dev.: 0.0248) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.72% (0.4139 => 0.5245, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.53% (0.0897 => 0.1135, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.83% (1.5932 => 2.0048, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.55% (0.0642 => 0.0806, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.32% (0.0541 => 0.0678, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.68% (0.5000 => 0.6234, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.12% (0.0452 => 0.0561, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.95% (0.1620 => 0.2008, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.51% (0.1021 => 0.1261, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.50% (0.1549 => 0.1913, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 22.11% (0.1619 => 0.1977, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.99% (1.3152 => 1.6044, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.93% (0.3903 => 0.4759, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.90% (0.0822 => 0.1002, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.88% (0.1604 => 0.1955, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.36% (0.0604 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 20.33% (0.1505 => 0.1811, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 20.27% (0.0947 => 0.1139, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.26% (0.3890 => 0.4678, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.24% (0.2866 => 0.3446, std.dev.: 0.0072) MultiSource/Applications/spiff/spiff: 20.05% (0.4029 => 0.4837, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.99% (0.2736 => 0.3283, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.97% (0.1462 => 0.1754, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.41% (0.3271 => 0.3906, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 19.29% (1.8794 => 2.2420, std.dev.: 0.0315) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.22% (0.2014 => 0.2401, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 18.79% (0.5546 => 0.6588, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.70% (0.5026 => 0.5966, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.63% (0.4658 => 0.5526, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.55% (0.1968 => 0.2333, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.14% (0.5826 => 0.6883, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.14% (1.9694 => 2.3266, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.09% (0.2875 => 0.3395, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.92% (3.5627 => 4.2013, std.dev.: 0.0591) SingleSource/UnitTests/ObjC++/property-reference-object: 17.73% (0.5889 => 0.6933, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.60% (0.2750 => 0.3234, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 17.57% (0.2811 => 0.3305, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.55% (0.2792 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.49% (1.6211 => 1.9046, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/fibo: 17.36% (0.2725 => 0.3198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 17.34% (0.2803 => 0.3289, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.34% (0.2780 => 0.3262, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.29% (0.3060 => 0.3589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.24% (0.2738 => 0.3210, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 17.23% (0.9697 => 1.1368, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.22% (0.2729 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.17% (2.0673 => 2.4223, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 17.09% (0.9909 => 1.1602, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 17.07% (0.2823 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 17.06% (0.2813 => 0.3293, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.06% (0.1284 => 0.1503, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.00% (0.2911 => 0.3406, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.96% (0.7171 => 0.8387, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.95% (2.7292 => 3.1917, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/wc: 16.89% (0.3096 => 0.3619, std.dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 16.88% (0.3004 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 16.82% (0.1421 => 0.1660, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.76% (1.0781 => 1.2588, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.67% (0.3930 => 0.4585, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.53% (0.3195 => 0.3723, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: 16.48% (23.5202 => 27.3965, std.dev.: 0.0989) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.40% (0.4361 => 0.5076, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary: 16.30% (0.3258 => 0.3789, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.23% (4.2109 => 4.8944, std.dev.: 0.0698) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.21% (1.9966 => 2.3202, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.13% (4.4195 => 5.1324, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/sieve: 16.00% (0.3726 => 0.4322, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.92% (0.3845 => 0.4457, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 15.83% (0.3317 => 0.3842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.82% (0.3362 => 0.3894, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.78% (0.3124 => 0.3617, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash: 15.56% (0.4146 => 0.4791, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 15.44% (0.3348 => 0.3865, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.42% (0.3282 => 0.3788, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.42% (0.3477 => 0.4013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.33% (0.3678 => 0.4242, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.27% (1.4269 => 1.6448, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.22% (0.3981 => 0.4587, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.17% (0.3625 => 0.4175, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.07% (0.3690 => 0.4246, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 14.82% (0.4251 => 0.4881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.79% (0.3488 => 0.4004, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.49% (0.7875 => 0.9016, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/for-in: 14.27% (0.3496 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 14.16% (0.3446 => 0.3934, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 14.15% (0.5012 => 0.5721, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3465 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 14.04% (0.3469 => 0.3956, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.02% (0.3460 => 0.3945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.84% (0.3650 => 0.4155, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.2691 => 0.3061, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 13.59% (0.3643 => 0.4138, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.53% (0.3724 => 0.4228, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.43% (2.1653 => 2.4562, std.dev.: 0.0261) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.23% (0.1028 => 0.1164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.16% (0.2075 => 0.2348, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 13.15% (4.6177 => 5.2251, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.07% (0.6435 => 0.7276, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 13.05% (5.5417 => 6.2649, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 12.49% (2.1013 => 2.3638, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.42% (0.2737 => 0.3077, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 11.89% (0.3498 => 0.3914, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.38% (0.3084 => 0.3435, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.12% (0.5361 => 0.5957, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 11.03% (0.3336 => 0.3704, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.84% (0.2103 => 0.2331, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 10.81% (0.6634 => 0.7351, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: 10.77% (0.4847 => 0.5369, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.23% (11.6398 => 12.8302, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.05% (0.7426 => 0.8172, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.47% (4.6926 => 5.1372, std.dev.: 0.0076) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 8.93% (2.0346 => 2.2162, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.85% (0.5584 => 0.6078, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 7.29% (11.9555 => 12.8274, std.dev.: 0.0212) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.80% (0.3792 => 0.3974, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5228, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 10.21% (0.2802 => 0.3088, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.96% (0.3693 => 0.4061, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6112, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6788, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2433, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.84% (1.8057 => 1.8931, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6835, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1936, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3121, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2074, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0104) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5894, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5709, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.41% (17.2379 => 14.2363, std.dev.: 0.1149) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9769, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8051, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -6.44% (14.0481 => 13.1439, std.dev.: 0.2604) SingleSource/Benchmarks/Shootout-C++/ary2: -6.12% (0.2402 => 0.2255, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2304, std.dev.: 0.0340) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8028, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.29% (0.6293 => 0.6149, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.1975, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5762, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1969, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 13:06:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 15:06:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117210653.E0BD02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7696?compare_to=7692&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7696, Order: 172741, Start Time: 2013-01-17 19:33:24, End Time: 2013-01-17 21:07:01 To: 7692, Order: 172729, Start Time: 2013-01-17 17:36:00, End Time: 2013-01-17 19:09:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (120 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (867 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.39% (0.6649 => 0.6941, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.09% (0.0717 => 0.1198, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.06% (0.0974 => 0.1559, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.66% (0.1132 => 0.1547, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.45% (0.6395 => 0.8726, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.57% (0.6395 => 0.8606, std.dev.: 0.0065) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.81% (0.6260 => 0.8314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.47% (0.5688 => 0.7478, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.43% (0.5456 => 0.7171, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.35% (0.5805 => 0.7625, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.86% (0.5849 => 0.7654, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.80% (0.6230 => 0.8149, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.37% (0.5575 => 0.7268, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.34% (0.5581 => 0.7274, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.33% (0.5941 => 0.7743, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.27% (0.5567 => 0.7252, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.87% (0.5802 => 0.7535, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.69% (0.6033 => 0.7824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.43% (0.5705 => 0.7384, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.80% (0.5569 => 0.7173, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.79% (0.5859 => 0.7546, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.75% (0.5857 => 0.7541, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.71% (0.5570 => 0.7169, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.61% (0.5478 => 0.7045, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.59% (0.6440 => 0.8281, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.56% (0.5925 => 0.7617, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.42% (0.5591 => 0.7180, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.52% (1.6474 => 2.1007, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.51% (0.6052 => 0.7717, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.26% (0.6189 => 0.7876, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.15% (0.5863 => 0.7455, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.01% (0.6446 => 0.8187, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.76% (0.6304 => 0.7991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.73% (0.6194 => 0.7788, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.61% (0.6681 => 0.8392, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.44% (0.6660 => 0.8354, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.31% (0.6297 => 0.7891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.79% (0.6667 => 0.8253, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.69% (0.7524 => 0.9231, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.80% (0.7339 => 0.8939, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.49% (2.2587 => 2.7216, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 17.53% (1.1450 => 1.3457, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.72% (0.3357 => 0.3851, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.85% (1.6364 => 1.8467, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.67% (4.5069 => 5.0780, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.66% (0.4916 => 0.5489, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.41% (0.4515 => 0.5030, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.59% (3.5339 => 3.9082, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2385 => 0.2616, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.32% (9.2283 => 10.0888, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.96% (0.7021 => 0.7650, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.35% (1.2515 => 1.3560, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.34% (0.5329 => 0.5720, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.31% (1.2784 => 1.3719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.27% (0.4524 => 0.4853, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.25% (1.4642 => 1.5703, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (0.3255 => 0.3459, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4861 => 0.5161, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.86% (0.3319 => 0.3447, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 3.66% (1.3864 => 1.4372, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.56% (5.0226 => 5.2015, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6750 => 0.6946, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (5.4682 => 5.6211, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 2.73% (3.5154 => 3.6113, std.dev.: 0.0121) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.70% (22.4056 => 23.0111, std.dev.: 0.0209) MultiSource/Applications/SPASS/SPASS: 2.06% (15.5079 => 15.8273, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 1.88% (0.7447 => 0.7587, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 1.87% (0.8418 => 0.8575, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.9557 => 0.9705, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.3722 => 1.3932, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 1.37% (16.1920 => 16.4135, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.14% (4.0323 => 4.0783, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.09% (4.8161 => 4.8684, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6711, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.65% (0.9531 => 1.0260, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1496, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5785, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2772, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2077, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.79% (0.3194 => 0.3009, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.85% (0.3837 => 0.3651, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3831 => 0.3648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.70% (0.3891 => 0.3708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.62% (0.4176 => 0.3983, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.49% (0.2428 => 0.2319, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.46% (0.6347 => 0.6064, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.37% (0.9852 => 0.9421, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: -4.36% (0.7779 => 0.7440, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3884 => 0.3717, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.25% (0.3057 => 0.2927, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.25% (0.2871 => 0.2749, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.24% (0.4199 => 0.4021, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.18% (0.6441 => 0.6172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.08% (0.3016 => 0.2893, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.06% (0.2933 => 0.2814, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.02% (0.4280 => 0.4108, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.94% (0.3252 => 0.3124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.90% (2.1713 => 2.0866, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -3.87% (0.3026 => 0.2909, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.84% (0.2939 => 0.2826, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -3.78% (0.3205 => 0.3084, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.76% (0.3059 => 0.2944, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.76% (0.3142 => 0.3024, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -3.73% (1.3148 => 1.2658, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.17% (2.4924 => 2.4135, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.12% (0.4321 => 0.4186, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.02% (0.9542 => 0.9254, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.01% (0.4151 => 0.4026, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.55% (0.4427 => 0.4314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.54% (0.3931 => 0.3831, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.54% (0.7919 => 0.7718, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3123, std.dev.: 0.0612) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.14% (0.7198 => 0.7044, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -2.12% (0.7982 => 0.7813, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.96% (1.0544 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -1.89% (4.3330 => 4.2511, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.48% (1.2210 => 1.2029, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.42% (1.2221 => 1.2048, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.37% (14.2083 => 14.0142, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -1.27% (2.4021 => 2.3716, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -1.01% (1.5610 => 1.5452, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6941, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.11% (6.6713 => 3.3953, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3094, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0271, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0221, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1314, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.71% (4.9100 => 4.3348, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7483, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1486, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.72% (7.9763 => 7.7595, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.74% (3.7241 => 3.6592, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3040 => 7.1917, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6664, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6033, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -1.04% (1.4516 => 1.4365, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 14:12:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 16:12:58 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130117221258.49EA72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7697?compare_to=7693&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7697, Order: 172746, Start Time: 2013-01-17 20:10:45, End Time: 2013-01-17 22:13:08 To: 7693, Order: 172731, Start Time: 2013-01-17 17:42:28, End Time: 2013-01-17 19:49:47 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (9 on baseline) Performance Improvements: 40 (34 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1022 (1020 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 19.69% (1.7818 => 2.1326, std.dev.: 0.0882) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.13% (0.3461 => 0.3673, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2003-04-22-Switch: -41.01% (0.0278 => 0.0164, std.dev.: 0.0020) SingleSource/UnitTests/2006-02-04-DivRem: -36.07% (0.0280 => 0.0179, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -31.49% (0.0397 => 0.0272, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -30.48% (0.1135 => 0.0789, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -26.86% (0.3511 => 0.2568, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -20.38% (0.1148 => 0.0914, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -18.03% (0.3079 => 0.2524, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -17.60% (0.4097 => 0.3376, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -12.41% (8.5733 => 7.5092, std.dev.: 0.0546) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -11.66% (0.7623 => 0.6734, std.dev.: 0.0071) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -9.60% (8.1111 => 7.3323, std.dev.: 0.2053) MultiSource/Applications/ClamAV/clamscan: -9.22% (18.1432 => 16.4711, std.dev.: 0.3893) MultiSource/Benchmarks/MallocBench/espresso/espresso: -8.59% (5.3518 => 4.8921, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.72% (0.2655 => 0.2450, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.13% (0.3547 => 0.3294, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -7.06% (1.0724 => 0.9967, std.dev.: 0.0261) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.98% (0.4470 => 0.4158, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.96% (10.3350 => 9.6152, std.dev.: 0.2343) MultiSource/Benchmarks/MallocBench/gs/gs: -6.89% (4.8401 => 4.5068, std.dev.: 0.0295) MultiSource/Applications/JM/lencod/lencod: -6.47% (18.5776 => 17.3748, std.dev.: 0.3248) MultiSource/Benchmarks/Prolangs-C++/city/city: -6.02% (1.5747 => 1.4799, std.dev.: 0.0251) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.53% (0.2768 => 0.2615, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: -5.48% (19.5658 => 18.4930, std.dev.: 0.1325) MultiSource/Benchmarks/Bullet/bullet: -5.30% (35.6921 => 33.7994, std.dev.: 0.7139) MultiSource/Benchmarks/nbench/nbench: -5.26% (1.3280 => 1.2582, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.56% (0.3067 => 0.2927, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.48% (1.5230 => 1.4547, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.75% (0.7209 => 0.6939, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/football/football: -3.44% (1.0107 => 0.9759, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.42% (1.0232 => 0.9882, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.07% (0.9905 => 0.9700, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Towers: -36.84% (0.0304 => 0.0192, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.89% (0.0676 => 0.0501, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.49% (0.0929 => 0.0813, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.13% (0.3246 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.76% (4.4606 => 4.2928, std.dev.: 0.0557) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.71% (0.6050 => 0.5886, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.35% (1.3571 => 1.3252, std.dev.: 0.0082) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.23% (0.5346 => 0.5227, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.05% (42.2141 => 41.3497, std.dev.: 0.2960) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.94% (1.1237 => 1.1343, std.dev.: 0.0638) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.20% (0.0227 => 0.0222, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.37% (0.0438 => 0.0432, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.26% (0.0339 => 0.0311, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0322 => 0.0320, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0435 => 0.0431, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/casts: -2.37% (0.0211 => 0.0206, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -1.35% (0.0223 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0231 => 0.0231, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1469 => 0.1472, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -15.98% (1.4610 => 1.2275, std.dev.: 0.3709) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.35% (0.3975 => 0.3961, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.05% (0.1505 => 0.1429, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.77% (0.0938 => 0.0964, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.87% (0.0303 => 0.0264, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.02% (0.0558 => 0.0586, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1497 => 1.1487, std.dev.: 0.0411) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.37% (0.0555 => 0.0607, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.28% (0.0307 => 0.0314, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7401 => 0.7456, std.dev.: 0.0574) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.46% (0.0082 => 0.0048, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7836 => 12.7892, std.dev.: 0.0362) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.24% (0.2879 => 0.3001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.10% (1.4110 => 1.4547, std.dev.: 0.0044) MultiSource/Applications/JM/ldecod/ldecod: 2.13% (7.3529 => 7.5092, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.22% (1.0867 => 1.1000, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324925.00% (0.0008 => 2.6002, std.dev.: 0.0581) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.18% (1.1825 => 2.3789, std.dev.: 0.0933) MultiSource/Applications/JM/lencod/lencod: 3.96% (6.8159 => 7.0855, std.dev.: 0.0609) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.89% (16.6791 => 16.9946, std.dev.: 0.0919) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0014) SingleSource/Benchmarks/SmallPT/smallpt: -26.38% (0.1888 => 0.1390, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.37% (0.0862 => 0.0695, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.25% (0.1009 => 0.0845, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.93% (6.4235 => 5.7854, std.dev.: 0.1939) MultiSource/Applications/hexxagon/hexxagon: -9.46% (1.1433 => 1.0352, std.dev.: 0.0374) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.47% (0.3560 => 0.3294, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.42% (0.2618 => 0.2450, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.38% (10.2703 => 9.6152, std.dev.: 0.2343) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.90% (1.8127 => 1.7057, std.dev.: 0.0382) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.69% (0.9588 => 0.9042, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.24% (0.2100 => 0.1990, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.12% (0.2283 => 0.2166, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.11% (1.0234 => 0.9813, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.07% (0.5746 => 0.5512, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.90% (0.3462 => 0.3327, std.dev.: 0.0039) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.86% (1.1731 => 1.1278, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4689 => 0.4518, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.90% (0.7693 => 0.7470, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.90% (5.0381 => 4.8921, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.88% (0.6934 => 0.6734, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.38% (0.6135 => 0.5989, std.dev.: 0.0055) MultiSource/Applications/kimwitu++/kc: -2.35% (18.9377 => 18.4930, std.dev.: 0.1325) MultiSource/Benchmarks/MallocBench/gs/gs: -1.89% (4.5936 => 4.5068, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.57% (0.9855 => 0.9700, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.16% (1.4588 => 1.3252, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.53% (1.4235 => 1.3021, std.dev.: 0.0223) SingleSource/Benchmarks/Shootout/hash: -7.96% (4.5259 => 4.1658, std.dev.: 0.1226) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.30% (0.3217 => 0.2982, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.29% (42.3194 => 41.3497, std.dev.: 0.2960) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.99% (0.5826 => 0.5710, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -1.52% (14.0297 => 13.8162, std.dev.: 0.0262) SingleSource/Benchmarks/SmallPT/smallpt: -1.40% (14.9448 => 14.7354, std.dev.: 0.0699) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3596 => 3.3177, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.84% (1.2047 => 1.1343, std.dev.: 0.0638) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.07% (0.0394 => 0.0311, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.79% (0.1530 => 0.1472, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -36.38% (1.9293 => 1.2275, std.dev.: 0.3709) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.17% (0.4049 => 0.3961, std.dev.: 0.0268) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.36% (0.1510 => 0.1429, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.43% (0.0978 => 0.0964, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (0.0276 => 0.0264, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.68% (0.0590 => 0.0586, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.12% (1.1617 => 1.1487, std.dev.: 0.0411) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.26% (0.7437 => 0.7456, std.dev.: 0.0574) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.83% (0.0092 => 0.0048, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7781 => 12.7892, std.dev.: 0.0362) Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 14:56:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 16:56:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130117225600.C452F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7698?compare_to=7694&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7698, Order: 172751, Start Time: 2013-01-17 20:43:47, End Time: 2013-01-17 22:56:08 To: 7694, Order: 172731, Start Time: 2013-01-17 18:01:41, End Time: 2013-01-17 20:13:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (225 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (646 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.10% (11.1604 => 11.2835, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.13% (12.3239 => 12.1842, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.03% (10.3962 => 10.2888, std.dev.: 0.0113) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.36% (0.0654 => 0.0676, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8350 => 499.8479, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 44224.55% (1.1277 => 499.8479, std.dev.: 0.0057) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 221.32% (0.5229 => 1.6802, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 22.27% (14.9895 => 18.3275, std.dev.: 0.0180) MultiSource/Applications/kimwitu++/kc: 44.94% (14.1553 => 20.5162, std.dev.: 0.0147) MultiSource/Benchmarks/MallocBench/gs/gs: 19.05% (4.1105 => 4.8935, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.82% (1.1048 => 1.7878, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 442.78% (7.1582 => 38.8530, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.75% (3.4629 => 6.4323, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.02% (0.6222 => 1.1014, std.dev.: 0.0061) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.03% (0.0720 => 7.4441, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11154400.00% (0.0001 => 11.1545, std.dev.: 0.0109) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488200.00% (0.0001 => 5.4883, std.dev.: 0.0281) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.14% (1.1194 => 10.2888, std.dev.: 0.0113) SingleSource/UnitTests/SignlessTypes/factor: 166.22% (0.0296 => 0.0788) MultiSource/Applications/ClamAV/clamscan: 150.18% (22.1758 => 55.4787, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.60% (0.0929 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 73.14% (0.1463 => 0.2533, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 70.48% (0.0271 => 0.0462, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 64.84% (21.9371 => 36.1603, std.dev.: 0.0177) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 59.96% (7.0540 => 11.2835, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.68% (2.9384 => 4.6334, std.dev.: 0.0013) SingleSource/Regression/C/sumarray: 57.14% (0.0231 => 0.0363, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 51.89% (0.1056 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.46% (1.5859 => 2.4020, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.16% (8.1363 => 12.2172, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.10% (0.0439 => 0.0637, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.95% (2.2024 => 3.1263, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 41.24% (0.3109 => 0.4391, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 39.53% (0.1432 => 0.1998, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 35.09% (1.5415 => 2.0824, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 35.03% (4.2646 => 5.7587, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.85% (0.4615 => 0.6177, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.85% (0.2700 => 0.3560, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.26% (0.2271 => 0.2981, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 31.06% (1.1642 => 1.5258, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.97% (0.1892 => 0.2478, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 30.84% (0.4299 => 0.5625, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 30.55% (0.1175 => 0.1534, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 30.16% (0.6675 => 0.8688, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 28.65% (0.0719 => 0.0925, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.53% (0.1125 => 0.1446, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.40% (0.5105 => 0.6555, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 28.30% (0.0636 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 28.24% (9.4845 => 12.1633, std.dev.: 0.0049) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.73% (0.1143 => 0.1460, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 27.68% (0.2554 => 0.3261, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 27.31% (1.0722 => 1.3650, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/chomp: 26.95% (0.1655 => 0.2101, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.91% (0.0457 => 0.0580, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.22% (3.8922 => 4.9129, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.60% (1.4186 => 1.7818, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash: 25.25% (0.4289 => 0.5372, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.10% (0.1566 => 0.1959, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.64% (0.3121 => 0.3890, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.16% (0.1337 => 0.1660, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.11% (0.0730 => 0.0906, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 24.09% (0.4620 => 0.5733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 23.64% (0.0626 => 0.0774, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 23.33% (0.7115 => 0.8775, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 23.20% (5.7591 => 7.0952, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 23.11% (0.3098 => 0.3814, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.01% (0.1695 => 0.2085, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.80% (4.9449 => 6.0721, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 22.58% (0.0660 => 0.0809, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 22.57% (0.1555 => 0.1906, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 22.44% (0.1163 => 0.1424, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 22.20% (0.0527 => 0.0644, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 22.15% (3.3354 => 4.0742, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.93% (0.0871 => 0.1062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.79% (5.0018 => 6.0917, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.60% (0.1236 => 0.1503, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.60% (0.7835 => 0.9527, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: 21.44% (0.0485 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.43% (1.3050 => 1.5847, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 21.42% (0.1695 => 0.2058, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.41% (0.1032 => 0.1253, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 21.41% (0.6456 => 0.7838, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.82% (0.1940 => 0.2344, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 20.68% (0.0614 => 0.0741, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.60% (0.5860 => 0.7067, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.28% (0.8172 => 0.9829, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.70% (0.5020 => 0.6009, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 19.69% (0.3423 => 0.4097, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 19.62% (0.7433 => 0.8891, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.34% (0.1510 => 0.1802, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.22% (0.2107 => 0.2512, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 19.01% (0.1268 => 0.1509, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.93% (0.3307 => 0.3933, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 18.62% (3.8723 => 4.5932, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.42% (0.2758 => 0.3266, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.5569 => 0.6591, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.16% (0.9765 => 1.1538, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ReedSolomon: 18.06% (0.2049 => 0.2419, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 18.06% (1.1840 => 1.3978, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 17.90% (2.0273 => 2.3902, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.90% (0.0933 => 0.1100, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 17.73% (0.0818 => 0.0963, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 17.53% (10.3673 => 12.1842, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.49% (0.6450 => 0.7578, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.43% (0.1044 => 0.1226, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 17.11% (2.2969 => 2.6899, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 17.06% (0.3283 => 0.3843, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 16.95% (0.3180 => 0.3719, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.83% (0.8101 => 0.9464, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 16.71% (0.3387 => 0.3953, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 16.68% (0.3232 => 0.3771, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.62% (0.3441 => 0.4013, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: 16.59% (0.0633 => 0.0738, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.46% (0.8067 => 0.9395, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.02% (1.1861 => 1.3761, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 15.69% (0.3379 => 0.3909, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.68% (0.8921 => 1.0320, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: 14.53% (1.5603 => 1.7870, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.41% (0.2603 => 0.2978, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3865 => 0.4412, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.87% (0.4636 => 0.5279, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 13.84% (17.1811 => 19.5587, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.43% (0.4103 => 0.4654, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 13.20% (0.3092 => 0.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.06% (0.4203 => 0.4752, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 12.90% (0.4048 => 0.4570, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.69% (14.3668 => 16.1895, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 12.58% (0.3282 => 0.3695, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.46% (0.3603 => 0.4052, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.43% (0.3927 => 0.4415, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 12.39% (0.3422 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 12.30% (0.3684 => 0.4137, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.20% (0.3427 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.00% (0.3826 => 0.4285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.89% (0.3886 => 0.4348, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions: 11.26% (0.3828 => 0.4259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.95% (0.3543 => 0.3931, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.91% (0.3473 => 0.3852, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.91% (0.3694 => 0.4097, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.81% (0.3543 => 0.3926, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.67% (0.3516 => 0.3891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.49% (0.2831 => 0.3128, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/except: 10.34% (0.2871 => 0.3168, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.32% (0.1114 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.21% (2.0665 => 2.2774, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 10.00% (63.2438 => 69.5682, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.80% (0.2756 => 0.3026, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.67% (0.3650 => 0.4003, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.63% (0.2877 => 0.3154, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 9.57% (0.2905 => 0.3183, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 9.53% (0.1438 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.50% (0.2725 => 0.2984, std.dev.: 0.0091) MultiSource/Applications/hexxagon/hexxagon: 9.45% (1.2842 => 1.4055, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.36% (0.3162 => 0.3458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.36% (0.2714 => 0.2968, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.24% (0.2891 => 0.3158, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.12% (0.3935 => 0.4294, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.01% (0.3052 => 0.3327, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7326 => 0.7984, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2802 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.37% (2.2022 => 2.3866, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.35% (0.3136 => 0.3398, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.17% (0.5925 => 0.6409, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.82% (7.9617 => 8.5843, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.35% (0.2266 => 0.2410, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.46% (0.3817 => 0.3949, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2480, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6960, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.72% (4.2280 => 4.4698, std.dev.: 0.0113) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3124, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.43% (0.9957 => 1.0299, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.03% (8.6802 => 8.9436, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.03% (9.1159 => 9.3005, std.dev.: 0.0321) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.99% (3.6395 => 3.7119, std.dev.: 0.0148) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2804, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4526, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.03% (6.5088 => 6.5758, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1704, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.19% (5.2763 => 1.2037, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -75.31% (0.8651 => 0.2136, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.42% (0.1622 => 0.0934, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.75% (5.3855 => 4.4832, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.42% (5.3526 => 4.4735, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: -10.48% (10.4361 => 9.3420, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.88% (1.7609 => 1.6222, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9488, std.dev.: 0.0413) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.28% (1.9577 => 0.6602, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4312, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8574, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.14% (1.6925 => 1.4194, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.16% (9.5636 => 8.4960, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2676, std.dev.: 0.0246) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -6.04% (1.2373 => 1.1626, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7034, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8369, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1575, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9572, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2786, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.50% (3.7221 => 3.6662, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0020) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 15:03:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 17:03:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130117230351.DBB482A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7699?compare_to=7696&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7699, Order: 172753, Start Time: 2013-01-17 21:30:18, End Time: 2013-01-17 23:03:59 To: 7696, Order: 172741, Start Time: 2013-01-17 19:33:24, End Time: 2013-01-17 21:07:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (120 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.50% (79.8608 => 81.0585, std.dev.: 0.2699) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.50% (0.0717 => 0.1201, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.47% (0.0974 => 0.1563, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.23% (0.0514 => 0.0803, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 44.57% (0.0267 => 0.0386, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.23% (0.0599 => 0.0822, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.93% (0.1132 => 0.1550, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.56% (0.6395 => 0.8733, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.65% (0.6395 => 0.8611, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.05% (0.6260 => 0.8329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.72% (0.5688 => 0.7492, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.44% (0.5805 => 0.7630, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.30% (0.5456 => 0.7164, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.98% (0.5849 => 0.7661, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.95% (0.6230 => 0.8158, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.90% (0.0699 => 0.0915, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.62% (0.5941 => 0.7760, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.57% (0.5575 => 0.7279, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.52% (0.5567 => 0.7266, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.35% (0.5581 => 0.7275, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.06% (0.5802 => 0.7546, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.69% (0.5705 => 0.7399, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.62% (0.6033 => 0.7820, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.05% (0.5859 => 0.7561, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.98% (0.5570 => 0.7184, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.91% (0.5569 => 0.7179, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.84% (0.5857 => 0.7546, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.80% (0.6440 => 0.8295, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.78% (0.5925 => 0.7630, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.66% (0.5478 => 0.7048, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.46% (0.5591 => 0.7182, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.73% (1.6474 => 2.1042, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.69% (0.6052 => 0.7728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.56% (0.5863 => 0.7479, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.48% (0.6189 => 0.7890, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.43% (0.6446 => 0.8214, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.03% (0.6304 => 0.8008, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.90% (0.6194 => 0.7798, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.82% (0.6681 => 0.8406, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.65% (0.6297 => 0.7912, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.51% (0.6660 => 0.8359, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.83% (0.6667 => 0.8256, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.81% (0.7524 => 0.9240, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.01% (0.7339 => 0.8954, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.56% (2.2587 => 2.7231, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 17.58% (1.1450 => 1.3463, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.55% (0.3357 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1081 => 0.1234, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.99% (1.6364 => 1.8489, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.77% (4.5069 => 5.0825, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.84% (0.4916 => 0.5498, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.75% (3.5339 => 3.9139, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 9.57% (9.2283 => 10.1115, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.14% (0.7021 => 0.7663, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.41% (1.2515 => 1.3568, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.49% (0.5329 => 0.5728, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.4642 => 1.5719, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.34% (1.2784 => 1.3722, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4524 => 0.4847, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.21% (0.4861 => 0.5163, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 6.07% (0.1879 => 0.1993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.05% (0.3255 => 0.3452, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.22% (0.3319 => 0.3459, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.94% (1.3864 => 1.4410, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.86% (5.0226 => 5.2165, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 2.90% (3.5154 => 3.6172, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (22.4056 => 23.0462, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (5.4682 => 5.6238, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 2.83% (0.6750 => 0.6941, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.12% (15.5079 => 15.8359, std.dev.: 0.0118) MultiSource/Applications/minisat/minisat: 2.01% (0.7447 => 0.7597, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 1.73% (16.1920 => 16.4728, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.71% (0.9557 => 0.9720, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.3722 => 1.3956, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 1.24% (7.0961 => 7.1842, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.24% (4.0323 => 4.0823, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.13% (4.8161 => 4.8703, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.44% (31.3723 => 55.6655, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5644, std.dev.: 0.0847) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1087, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.68% (79.7170 => 81.0585, std.dev.: 0.2699) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2777, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6025, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2072, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.51% (0.3812 => 0.3602, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.46% (0.3831 => 0.3622, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.43% (0.3848 => 0.3639, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.39% (0.3880 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.31% (0.3896 => 0.3689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -5.18% (0.4033 => 0.3824, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.96% (0.4176 => 0.3969, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.62% (0.4199 => 0.4005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.41% (0.2903 => 0.2775, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -4.33% (0.7779 => 0.7442, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.32% (0.4280 => 0.4095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.16% (0.2933 => 0.2811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.14% (0.3016 => 0.2891, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.11% (0.2849 => 0.2732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.08% (0.6441 => 0.6178, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.06% (0.9852 => 0.9452, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -4.00% (0.3025 => 0.2904, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.98% (0.2939 => 0.2822, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.93% (0.3026 => 0.2907, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.91% (2.1713 => 2.0865, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.81% (0.3252 => 0.3128, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.66% (0.3142 => 0.3027, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: -3.50% (1.3148 => 1.2688, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.42% (0.3658 => 0.3533, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.38% (0.6484 => 0.6265, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.35% (0.4151 => 0.4012, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -3.11% (2.4924 => 2.4149, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists: -2.98% (0.3621 => 0.3513, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.92% (0.4321 => 0.4195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: -2.82% (0.3867 => 0.3758, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.70% (0.3931 => 0.3825, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.53% (0.4427 => 0.4315, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -2.50% (0.4248 => 0.4142, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.41% (0.7919 => 0.7728, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3103, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.93% (0.7198 => 0.7059, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.87% (1.0544 => 1.0347, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -1.67% (4.3330 => 4.2608, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.45% (14.2083 => 14.0018, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.36% (1.2221 => 1.2055, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.26% (1.2210 => 1.2056, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -1.23% (2.4021 => 2.3725, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: -1.06% (1.5610 => 1.5444, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.18% (1.8100 => 0.6846, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0287, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.72% (4.3779 => 3.3834, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.97% (0.6299 => 0.5041, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.85% (1.0217 => 0.8598, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1315, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1039, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.71% (2.2633 => 2.1793, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.53% (3.7241 => 3.6297, std.dev.: 0.0139) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (7.9763 => 7.7909, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4662, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857) MultiSource/Benchmarks/Bullet/bullet: -1.37% (7.3040 => 7.2038, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6012, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -1.19% (3.7092 => 3.6651, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: -1.09% (1.4516 => 1.4358, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 16:36:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 18:36:00 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118003600.32DC52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7700?compare_to=7697&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7700, Order: 172760, Start Time: 2013-01-17 22:33:14, End Time: 2013-01-18 00:36:10 To: 7697, Order: 172746, Start Time: 2013-01-17 20:10:45, End Time: 2013-01-17 22:13:08 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 20 (13 on baseline) Performance Improvements: 1 (21 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1043 (1029 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.99% (0.8761 => 1.0074, std.dev.: 0.0159) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.86% (4.8921 => 5.2279, std.dev.: 0.0814) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.65% (0.3294 => 0.3480, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.53% (0.8956 => 0.9362, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.08% (0.8643 => 0.8996, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (15.1045 => 15.6300, std.dev.: 0.0768) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.24% (0.9997 => 1.0321, std.dev.: 0.0125) MultiSource/Applications/ClamAV/clamscan: 2.95% (16.4711 => 16.9570, std.dev.: 0.0949) MultiSource/Applications/JM/ldecod/ldecod: 2.64% (7.5092 => 7.7075, std.dev.: 0.0297) MultiSource/Applications/lemon/lemon: 1.79% (1.3666 => 1.3910, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 85.45% (0.1354 => 0.2511, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 51.21% (0.8662 => 1.3098, std.dev.: 0.0567) MultiSource/Benchmarks/Olden/bisort/bisort: 37.41% (0.6517 => 0.8955, std.dev.: 0.0253) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.83% (42.8049 => 46.5862, std.dev.: 0.4833) MultiSource/Benchmarks/Olden/perimeter/perimeter: 5.77% (0.3174 => 0.3357, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.79% (21.9874 => 22.8200, std.dev.: 0.3103) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.84% (2.3201 => 2.3859, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.19% (2.4616 => 2.5156, std.dev.: 0.0167) MultiSource/Applications/aha/aha: 2.12% (3.5085 => 3.5829, std.dev.: 0.0252) MultiSource/Benchmarks/Olden/bh/bh: 1.39% (2.3935 => 2.4267, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -4.79% (9.9053 => 9.4305, std.dev.: 0.1812) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.36% (1.1343 => 1.1302, std.dev.: 0.0290) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0222 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0432 => 0.0433, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.07% (0.0311 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0320 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0431 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0206 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0220 => 0.0219, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0231 => 0.0231, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1472 => 0.1477, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: 15.64% (1.2275 => 1.4195, std.dev.: 0.1334) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.19% (0.3961 => 0.4008, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.54% (0.1429 => 0.1451, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.52% (0.0964 => 0.0959, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.17% (0.0264 => 0.0275, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.24% (0.0586 => 0.0567, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1487 => 1.1517, std.dev.: 0.0964) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.99% (0.0607 => 0.0613, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.55% (0.0314 => 0.0306, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.70% (0.7456 => 0.7404, std.dev.: 0.0648) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0048 => 0.0036, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.33% (12.7892 => 12.7473, std.dev.: 0.0887) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.60% (0.0336 => 0.0506, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 10.38% (0.9127 => 1.0074, std.dev.: 0.0159) MultiSource/Applications/JM/ldecod/ldecod: 4.82% (7.3529 => 7.7075, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.37% (14.9757 => 15.6300, std.dev.: 0.0768) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.32% (0.9061 => 0.9362, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.02% (0.8732 => 0.8996, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323250.00% (0.0008 => 2.5868, std.dev.: 0.0756) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.69% (1.1825 => 2.4205, std.dev.: 0.0834) MultiSource/Benchmarks/Olden/mst/mst: 68.41% (0.1491 => 0.2511, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.10% (1.0816 => 1.3098, std.dev.: 0.0567) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.76% (0.2562 => 0.2889, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.04% (2.2499 => 2.3859, std.dev.: 0.0207) MultiSource/Applications/JM/lencod/lencod: 4.26% (6.8159 => 7.1060, std.dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -23.89% (0.1888 => 0.1437, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.64% (1.0986 => 0.9488, std.dev.: 0.0575) MultiSource/Applications/hexxagon/hexxagon: -10.96% (1.1433 => 1.0180, std.dev.: 0.0203) MultiSource/Applications/lua/lua: -9.37% (4.6406 => 4.2059, std.dev.: 0.1473) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.81% (0.2100 => 0.1957, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.49% (0.7693 => 0.7194, std.dev.: 0.0169) SingleSource/Benchmarks/Shootout-C++/fibo: -6.33% (0.2006 => 0.1879, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: -4.93% (0.2172 => 0.2065, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.99% (1.0017 => 0.9617, std.dev.: 0.0145) MultiSource/Applications/ClamAV/clamscan: -2.75% (17.4365 => 16.9570, std.dev.: 0.0949) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -26.10% (4.4739 => 3.3062, std.dev.: 0.2142) SingleSource/Benchmarks/Shootout/hash: -10.77% (4.5259 => 4.0384, std.dev.: 0.1091) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.61% (0.4081 => 0.3648, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.00% (1.4588 => 1.3129, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout/ary3: -5.76% (2.2304 => 2.1019, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.00% (0.3201 => 0.3041, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -3.02% (4.4730 => 4.3381, std.dev.: 0.0510) MultiSource/Applications/hexxagon/hexxagon: -1.53% (14.0297 => 13.8156, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3154, std.dev.: 0.0082) SingleSource/Benchmarks/SmallPT/smallpt: -1.22% (14.9448 => 14.7625, std.dev.: 0.0654) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.18% (1.2047 => 1.1302, std.dev.: 0.0290) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.48% (0.0394 => 0.0333, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.46% (0.1530 => 0.1477, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: -26.42% (1.9293 => 1.4195, std.dev.: 0.1334) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.01% (0.4049 => 0.4008, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.91% (0.1510 => 0.1451, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.94% (0.0978 => 0.0959, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.90% (0.0590 => 0.0567, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.86% (1.1617 => 1.1517, std.dev.: 0.0964) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.18% (0.0268 => 0.0306, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.7437 => 0.7404, std.dev.: 0.0648) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.87% (0.0092 => 0.0036, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.24% (12.7781 => 12.7473, std.dev.: 0.0887) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 17:00:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 19:00:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118010051.570F12A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7701?compare_to=7699&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7701, Order: 172762, Start Time: 2013-01-17 23:27:39, End Time: 2013-01-18 01:00:59 To: 7699, Order: 172753, Start Time: 2013-01-17 21:30:18, End Time: 2013-01-17 23:03:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 38 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1066 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.30% (0.4074 => 0.3899, std.dev.: 0.0049) MultiSource/Applications/JM/lencod/lencod: -4.27% (16.4728 => 15.7693, std.dev.: 0.0179) MultiSource/Benchmarks/mafft/pairlocalalign: -3.62% (10.1115 => 9.7454, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -3.44% (7.1842 => 6.9371, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.36% (0.7059 => 0.6822, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.35% (6.8179 => 6.5897, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: -3.23% (3.6172 => 3.5005, std.dev.: 0.0107) MultiSource/Benchmarks/sim/sim: -2.98% (0.3422 => 0.3320, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -2.81% (1.3463 => 1.3085, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.50% (8.0898 => 7.8875, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (23.0462 => 22.4761, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: -2.47% (17.0904 => 16.6684, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.20% (1.8489 => 1.8083, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -2.10% (2.4149 => 2.3643, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -2.05% (1.3568 => 1.3290, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.02% (4.0823 => 3.9999, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: -1.89% (15.8359 => 15.5359, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.87% (4.9209 => 4.8291, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.81% (4.8703 => 4.7820, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -1.80% (1.4410 => 1.4151, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.61% (1.5719 => 1.5466, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.55% (14.0018 => 13.7846, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.54% (0.6755 => 0.6651) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.53% (1.2191 => 1.2005, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -1.47% (4.0484 => 3.9888, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.44% (0.7663 => 0.7553, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.38% (1.3722 => 1.3533, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.36% (0.7883 => 0.7776, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.33% (5.0825 => 5.0149, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: -1.26% (15.2690 => 15.0765, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -1.26% (4.2608 => 4.2071, std.dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: -1.24% (5.2165 => 5.1516, std.dev.: 0.0115) MultiSource/Applications/treecc/treecc: -1.23% (2.1390 => 2.1126, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: -1.20% (0.8602 => 0.8499, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.18% (1.2056 => 1.1914, std.dev.: 0.0021) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.17% (43.3368 => 42.8290, std.dev.: 0.0074) MultiSource/Applications/kimwitu++/kc: -1.06% (18.2359 => 18.0425, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (1.2055 => 1.1929, std.dev.: 0.0002) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705) SingleSource/Benchmarks/Misc/lowercase: 76.43% (0.0280 => 0.0494, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.83% (0.0717 => 0.1189, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 58.93% (0.0974 => 0.1548, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.67% (0.0514 => 0.0795, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 44.40% (0.1500 => 0.2166, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 35.89% (0.0599 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 35.89% (0.0418 => 0.0568, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.70% (0.6395 => 0.8678, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.42% (0.1132 => 0.1533, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 33.98% (0.6395 => 0.8568, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.33% (0.6260 => 0.8284, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.92% (0.5805 => 0.7600, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 30.87% (0.5688 => 0.7444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.66% (0.5456 => 0.7129, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.19% (0.6230 => 0.8111, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.16% (0.5849 => 0.7613, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.01% (0.5941 => 0.7724, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 29.94% (0.5567 => 0.7234, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.85% (0.5575 => 0.7239, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.62% (0.5581 => 0.7234, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.28% (0.5802 => 0.7501, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.97% (0.5705 => 0.7358, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.92% (0.6033 => 0.7778, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.37% (0.5859 => 0.7521, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.29% (0.5478 => 0.7028, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.28% (0.5570 => 0.7145, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.26% (0.5857 => 0.7512, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.20% (0.6440 => 0.8256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.12% (0.5569 => 0.7135, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.03% (0.5925 => 0.7586, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.92% (0.5591 => 0.7152, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.38% (0.6676 => 0.8504, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.04% (1.6474 => 2.0928, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.00% (0.6052 => 0.7686, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 26.77% (0.6189 => 0.7846, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.69% (0.5863 => 0.7428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.50% (0.6446 => 0.8154, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.32% (0.6304 => 0.7963, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.17% (0.6194 => 0.7753, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.12% (0.6681 => 0.8359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.87% (0.6297 => 0.7863, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.83% (0.6660 => 0.8314, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.19% (0.6667 => 0.8213, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.16% (0.7524 => 0.9191, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.32% (0.7339 => 0.8904, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.45% (0.0582 => 0.0701, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.89% (2.2587 => 2.7080, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.05% (0.0693 => 0.0825, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 18.97% (0.0622 => 0.0740, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.25% (0.0634 => 0.0737, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.49% (0.1146 => 0.1312, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 14.28% (1.1450 => 1.3085, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 13.73% (0.3357 => 0.3818, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.86% (0.1081 => 0.1220, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.27% (4.5069 => 5.0149, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.4916 => 0.5437, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.50% (1.6364 => 1.8083, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 10.37% (0.4515 => 0.4983, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.17% (3.5339 => 3.8934, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.72% (0.2385 => 0.2593, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.7021 => 0.7553, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.29% (0.4524 => 0.4854, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.95% (0.2001 => 0.2140, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.46% (0.4861 => 0.5175, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 6.19% (1.2515 => 1.3290, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.12% (0.5329 => 0.5655, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.86% (1.2784 => 1.3533, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.63% (1.4642 => 1.5466, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 5.60% (9.2283 => 9.7454, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.3255 => 0.3425, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.31% (0.3319 => 0.3429, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 2.81% (0.6750 => 0.6940, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.57% (5.0226 => 5.1516, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.34% (5.4682 => 5.5962, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.3864 => 1.4151, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6597, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.52% (0.9531 => 1.0248, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.50% (0.2380 => 0.2487, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5173, std.dev.: 0.1190) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.83% (2.0478 => 2.1057, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6469 => 0.6636, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.95% (3.7435 => 3.8166, std.dev.: 0.0164) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6051, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.61% (5.1955 => 5.2789, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2056, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.29% (0.1281 => 0.1098, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.69% (0.1584 => 0.1478, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -5.59% (0.3831 => 0.3617, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.57% (0.3880 => 0.3664, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -5.54% (0.3848 => 0.3635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.47% (0.3896 => 0.3683, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: -5.41% (0.4033 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.40% (0.3891 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.32% (0.4176 => 0.3954, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.22% (0.7198 => 0.6822, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -5.14% (2.4924 => 2.3643, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.99% (0.3884 => 0.3690, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.94% (0.2428 => 0.2308, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.91% (0.4199 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.71% (0.9852 => 0.9388, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4280 => 0.4081, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3142 => 0.3005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -4.17% (0.7779 => 0.7455, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.16% (0.6347 => 0.6083, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.88% (0.3658 => 0.3516, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.70% (0.6441 => 0.6203, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.69% (0.2903 => 0.2796, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.61% (0.6484 => 0.6250, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.46% (0.9542 => 0.9212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.44% (0.2933 => 0.2832, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.32% (1.3148 => 1.2711, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: -3.30% (0.3059 => 0.2958, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.26% (2.1713 => 2.1005, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.14% (0.3252 => 0.3150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.08% (0.7919 => 0.7675, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.06% (0.4151 => 0.4024, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.98% (14.2083 => 13.7846, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.97% (20.7746 => 20.1586, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/gs/gs: -2.91% (4.3330 => 4.2071, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.69% (6.7716 => 6.5897, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -2.61% (16.1920 => 15.7693, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.59% (0.3931 => 0.3829, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -2.58% (0.7982 => 0.7776, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -2.54% (17.1032 => 16.6684, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.48% (0.4321 => 0.4214, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.42% (1.2210 => 1.1914, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.41% (1.0544 => 1.0290, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (1.2300 => 1.2005, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.39% (1.2221 => 1.1929, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.26% (0.4427 => 0.4327, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: -2.24% (7.0961 => 6.9371, std.dev.: 0.0157) MultiSource/Applications/siod/siod: -2.20% (2.4021 => 2.3493, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.05% (0.5999 => 0.5876, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -2.00% (0.9179 => 0.8995, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.90% (0.8521 => 0.8359, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -1.74% (4.0594 => 3.9888, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.56% (8.0126 => 7.8875, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.53% (34.0927 => 33.5721, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.45% (0.9077 => 0.8945, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -1.41% (1.5610 => 1.5390, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: -1.37% (18.2933 => 18.0425, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: -1.28% (2.1401 => 2.1126, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -1.16% (15.2527 => 15.0765, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.05% (4.8802 => 4.8291, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.05% (1.8100 => 0.6688, std.dev.: 0.0320) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3094, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.52% (1.3643 => 1.0298, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0168, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.76% (4.1024 => 3.2096, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1295, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3403, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1784, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.60% (1.3096 => 1.2755, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7703, std.dev.: 0.0337) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.07% (3.7241 => 3.6469, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4639, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.65% (1.6307 => 1.6038, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.61% (1.6219 => 1.5958, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.42% (7.3040 => 7.2003, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5892, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.04% (3.7092 => 3.6707, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4366, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 17:37:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 19:37:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118013732.6D82C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7702?compare_to=7698&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7702, Order: 172762, Start Time: 2013-01-17 23:26:32, End Time: 2013-01-18 01:37:40 To: 7698, Order: 172751, Start Time: 2013-01-17 20:43:47, End Time: 2013-01-17 22:56:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 40 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1060 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/lencod/lencod: -16.40% (36.1603 => 30.2307, std.dev.: 0.0080) MultiSource/Benchmarks/PAQ8p/paq8p: -9.41% (12.1842 => 11.0371, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.15% (0.3560 => 0.3270, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.08% (8.5843 => 8.1479, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: -4.53% (12.1633 => 11.6123, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.45% (11.2835 => 10.7818, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.00% (38.8530 => 37.2981, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: -3.54% (9.3420 => 9.0110, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.46% (1.7878 => 1.7259, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -3.21% (4.0742 => 3.9435, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: -2.99% (0.3953 => 0.3835, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.76% (6.0721 => 5.9043, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.64% (1.2037 => 1.1719, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.60% (6.0917 => 5.9333, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: -2.56% (7.0952 => 6.9137, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.50% (12.2172 => 11.9112, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: -2.35% (19.5587 => 19.0992, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: -2.29% (1.6802 => 1.6418, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (16.1895 => 15.8290, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.20% (0.9395 => 0.9188, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -2.19% (18.3275 => 17.9256, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -2.04% (69.5682 => 68.1501, std.dev.: 0.0280) MultiSource/Applications/lemon/lemon: -2.03% (1.3650 => 1.3373, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -1.97% (1.5258 => 1.4957, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.90% (2.0824 => 2.0428, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.86% (1.7870 => 1.7537, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.82% (1.7818 => 1.7493, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.81% (0.8891 => 0.8730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.77% (0.8688 => 0.8534, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.77% (0.7578 => 0.7444, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.62% (0.6555 => 0.6449, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.60% (4.5932 => 4.5196, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: -1.56% (0.8775 => 0.8638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.51% (1.1014 => 1.0848, std.dev.: 0.0055) MultiSource/Benchmarks/MallocBench/gs/gs: -1.45% (4.8935 => 4.8226, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.44% (49.9367 => 49.2154, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.41% (2.3866 => 2.3530, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -1.28% (20.5162 => 20.2530, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.28% (5.7587 => 5.6851, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.15% (6.4323 => 6.3585, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.55% (0.0676 => 0.0652, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8479 => 499.8515, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.86% (1.1277 => 499.8515, std.dev.: 0.0016) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.98% (0.5229 => 1.6418, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 19.59% (14.9895 => 17.9256, std.dev.: 0.0095) MultiSource/Applications/kimwitu++/kc: 43.08% (14.1553 => 20.2530, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: 17.32% (4.1105 => 4.8226, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.22% (1.1048 => 1.7259, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.05% (7.1582 => 37.2981, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.62% (3.4629 => 6.3585, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.35% (0.6222 => 1.0848, std.dev.: 0.0055) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.67% (0.0720 => 7.4460, std.dev.: 0.0089) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 11154200.00% (0.0001 => 11.1543, std.dev.: 0.0711) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493000.00% (0.0001 => 5.4931, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.08% (1.1194 => 10.3330, std.dev.: 0.0084) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.29% (22.1758 => 55.2819, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.99% (0.0929 => 0.1765, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 70.68% (0.1463 => 0.2497, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.06% (2.9384 => 4.6151, std.dev.: 0.0061) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.85% (7.0540 => 10.7818, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.69% (1.5859 => 2.3898, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.40% (8.1363 => 11.9112, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.65% (2.2024 => 3.0977, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 39.11% (0.1432 => 0.1992, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.08% (0.3109 => 0.4324, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 37.81% (21.9371 => 30.2307, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.31% (4.2646 => 5.6851, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.52% (1.5415 => 2.0428, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.24% (0.4615 => 0.6103, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 31.45% (0.0814 => 0.1070, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.85% (0.2271 => 0.2949, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 29.65% (0.1892 => 0.2453, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 29.33% (0.4299 => 0.5560, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 28.47% (1.1642 => 1.4957, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.85% (0.6675 => 0.8534, std.dev.: 0.0045) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.64% (0.1125 => 0.1436, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.33% (0.5105 => 0.6449, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.30% (0.0479 => 0.0605, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.47% (0.0793 => 0.0995, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.35% (3.8922 => 4.8789, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/08-main/main: 25.25% (0.2554 => 0.3199, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 24.97% (0.4289 => 0.5360, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 24.83% (0.1655 => 0.2066, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 24.72% (1.0722 => 1.3373, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.45% (0.1906 => 0.2372, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.15% (0.1143 => 0.1419, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.65% (0.3121 => 0.3859, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.31% (1.4186 => 1.7493, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 23.31% (0.4620 => 0.5697, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 22.43% (9.4845 => 11.6123, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.83% (0.1695 => 0.2065, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.50% (0.3098 => 0.3764, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 21.48% (0.1555 => 0.1889, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.41% (0.7115 => 0.8638, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.13% (0.0672 => 0.0814, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.11% (0.2700 => 0.3270, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.06% (0.7835 => 0.9485, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.43% (1.3050 => 1.5716, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 20.05% (5.7591 => 6.9137, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 20.03% (0.6456 => 0.7749, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.76% (0.1695 => 0.2030, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 19.60% (0.1163 => 0.1391, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.40% (4.9449 => 5.9043, std.dev.: 0.0087) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.37% (0.8172 => 0.9755, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.5860 => 0.6991, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.92% (0.1940 => 0.2307, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.62% (5.0018 => 5.9333, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.23% (3.3354 => 3.9435, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.78% (0.3307 => 0.3895, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.77% (0.5020 => 0.5912, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.45% (0.7433 => 0.8730, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.42% (0.9765 => 1.1466, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.38% (0.5569 => 0.6537, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 17.03% (1.1840 => 1.3856, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.94% (0.3283 => 0.3839, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 16.91% (0.0834 => 0.0975, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 16.84% (2.0273 => 2.3687, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/18-imp/imp: 16.80% (0.3423 => 0.3998, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 16.72% (3.8723 => 4.5196, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.69% (0.5981 => 0.6979, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.62% (0.3232 => 0.3769, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.01% (0.3441 => 0.3992, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.86% (2.2969 => 2.6611, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.81% (0.8101 => 0.9382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.76% (0.0933 => 0.1080, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.71% (0.2049 => 0.2371, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.42% (0.1044 => 0.1205, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.41% (0.6450 => 0.7444, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.91% (1.1861 => 1.3629, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 14.78% (0.3180 => 0.3650, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 14.75% (0.8921 => 1.0237, std.dev.: 0.0113) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3379 => 0.3871, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.90% (0.8067 => 0.9188, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.58% (0.3865 => 0.4390, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.37% (0.4636 => 0.5256, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.97% (0.4103 => 0.4635, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.59% (0.4203 => 0.4732, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.40% (1.5603 => 1.7537, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.38% (0.3927 => 0.4413, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.21% (0.3603 => 0.4043, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.15% (0.4048 => 0.4540, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 12.10% (0.3422 => 0.3836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.99% (0.3886 => 0.4352, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.86% (0.3684 => 0.4121, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.39% (0.3828 => 0.4264, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.32% (0.2430 => 0.2705, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/oourafft: 11.18% (0.3282 => 0.3649, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 11.16% (17.1811 => 19.0992, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.09% (0.3473 => 0.3858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.04% (0.3694 => 0.4102, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 11.04% (0.3561 => 0.3954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 11.01% (0.3497 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.80% (0.3092 => 0.3426, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.4064 => 0.4499, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2831 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.36% (0.3427 => 0.3782, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.18% (14.3668 => 15.8290, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.74% (2.0665 => 2.2677, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 9.66% (0.2877 => 0.3155, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.61% (0.2871 => 0.3147, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 9.40% (0.2905 => 0.3178, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2891 => 0.3159, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.10% (1.2842 => 1.4010, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.09% (0.2872 => 0.3133, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 9.06% (0.2725 => 0.2972, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.01% (0.3162 => 0.3447, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2802 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.88% (0.3052 => 0.3323, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7326 => 0.7952, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 8.37% (0.5925 => 0.6421, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.76% (63.2438 => 68.1501, std.dev.: 0.0280) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.85% (2.2022 => 2.3530, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 6.46% (10.3673 => 11.0371, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.34% (7.9617 => 8.1479, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.25% (32.5116 => 59.2512, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6977, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4258, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (4.2280 => 4.4677, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 5.08% (0.5413 => 0.5688, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3113, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0174) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.6802 => 8.9150, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6395 => 3.7087, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2832, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2825, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4511, std.dev.: 0.0217) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.79% (5.2763 => 1.1719, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.62% (0.8651 => 0.2109, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.76% (5.3855 => 4.4831, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.75% (5.3526 => 4.4560, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -13.66% (10.4361 => 9.0110, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.36% (1.7609 => 1.6137, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9515, std.dev.: 0.0285) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.56% (1.9577 => 0.6546, std.dev.: 0.0133) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3059, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel-2: -33.54% (1.5373 => 1.0217, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4260, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8645, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0052, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3242, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.19% (1.6925 => 1.4185, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/matrix: -13.17% (3.1443 => 2.7303, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.15% (19.9488 => 18.3226, std.dev.: 0.0472) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.91% (1.2373 => 1.1642, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (8.1563 => 7.6954, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.57% (10.2830 => 9.8129, std.dev.: 0.0208) MultiSource/Applications/siod/siod: -3.81% (3.2827 => 3.1575, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/ary3: -1.59% (3.6994 => 3.6406, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/ary3: -1.52% (3.7221 => 3.6654, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0006) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 17:39:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 19:39:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130118013929.292482A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7703?compare_to=7695&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7703, Order: 172753, Start Time: 2013-01-17 22:02:43, End Time: 2013-01-18 01:39:36 To: 7695, Order: 172718, Start Time: 2013-01-17 17:25:01, End Time: 2013-01-17 21:01:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (181 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.70% (0.4678 => 0.4851, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: 1.34% (2.4284 => 2.4610, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.36% (0.6696 => 0.6854, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: 2.15% (13.1439 => 13.4268, std.dev.: 0.0794) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.03% (2.0752 => 2.1173, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.13% (0.1528 => 0.1419, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.76% (0.0625 => 0.0886, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.49% (0.1063 => 0.1419, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 33.26% (0.0475 => 0.0633, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 31.89% (0.1107 => 0.1460, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.75% (0.1106 => 0.1424, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.26% (0.4253 => 0.5455, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.19% (0.2969 => 0.3806, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.85% (0.5900 => 0.7484, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.62% (0.4139 => 0.5241, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.42% (0.0897 => 0.1134, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.20% (0.0584 => 0.0737, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.93% (0.4994 => 0.6289, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 25.20% (0.1619 => 0.2027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.14% (0.5000 => 0.6257, std.dev.: 0.0173) MultiSource/Applications/oggenc/oggenc: 25.04% (1.5932 => 1.9922, std.dev.: 0.0096) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.70% (0.3890 => 0.4851, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/em3d/em3d: 24.47% (0.0948 => 0.1180, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.43% (0.1549 => 0.1912, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.33% (0.1003 => 0.1227, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.03% (0.0572 => 0.0698, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.95% (0.1604 => 0.1956, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.88% (0.3903 => 0.4757, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.76% (0.1103 => 0.1343, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.42% (0.2736 => 0.3322, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.22% (0.4029 => 0.4884, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/09-vor/vor: 20.93% (0.1505 => 0.1820, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0037) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.45% (0.1462 => 0.1761, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.39% (0.3271 => 0.3938, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: 20.24% (1.8794 => 2.2598, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.13% (0.2866 => 0.3443, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.04% (0.1088 => 0.1306, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.79% (0.1218 => 0.1459, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.76% (0.2014 => 0.2412, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.74% (0.1160 => 0.1389, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.18% (1.3152 => 1.5674, std.dev.: 0.0159) MultiSource/Applications/Burg/burg: 19.13% (0.5546 => 0.6607, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.06% (0.4658 => 0.5546, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 18.61% (0.1284 => 0.1523, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.27% (1.6211 => 1.9173, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.27% (0.5026 => 0.5944, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.22% (0.2738 => 0.3237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.16% (0.2875 => 0.3397, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.10% (3.5627 => 4.2074, std.dev.: 0.0646) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.07% (0.1090 => 0.1287, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 17.93% (0.2750 => 0.3243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.80% (0.2792 => 0.3289, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.73% (0.2911 => 0.3427, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.71% (0.5826 => 0.6858, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 17.55% (0.2780 => 0.3268, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.55% (1.9694 => 2.3150, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/hello: 17.50% (0.2714 => 0.3189, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.45% (0.2803 => 0.3292, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 17.44% (0.5889 => 0.6916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.41% (0.2729 => 0.3204, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 17.40% (0.2811 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.39% (0.2725 => 0.3199, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.1421 => 0.1668, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.38% (2.0673 => 2.4266, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 17.37% (0.3258 => 0.3824, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 17.30% (0.9909 => 1.1623, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.29% (0.3060 => 0.3589, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.29% (0.2823 => 0.3311, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 17.28% (0.3004 => 0.3523, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 17.28% (0.2813 => 0.3299, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.27% (0.4361 => 0.5114, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: 17.25% (0.9697 => 1.1370, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.18% (0.3930 => 0.4605, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.13% (0.3362 => 0.3938, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 17.06% (4.2109 => 4.9293, std.dev.: 0.0515) MultiSource/Applications/d/make_dparser: 17.00% (1.0781 => 1.2614, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/wc: 16.99% (0.3096 => 0.3622, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 16.97% (0.3317 => 0.3880, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 16.96% (0.3267 => 0.3821, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 16.81% (0.4146 => 0.4843, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.81% (0.3195 => 0.3732, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 16.69% (23.5202 => 27.4455, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.68% (0.3124 => 0.3645, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.64% (1.9966 => 2.3288, std.dev.: 0.0328) SingleSource/UnitTests/ObjC++/property-reference: 16.64% (0.7171 => 0.8364, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.54% (2.7292 => 3.1806, std.dev.: 0.0117) MultiSource/Benchmarks/nbench/nbench: 16.52% (0.2566 => 0.2990, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.39% (0.3282 => 0.3820, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.37% (4.4195 => 5.1429, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/lists: 16.22% (0.3348 => 0.3891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 16.16% (0.3477 => 0.4039, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.08% (0.3625 => 0.4208, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 16.02% (0.4251 => 0.4932, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 16.00% (0.3726 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.99% (0.3845 => 0.4460, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 15.72% (0.3678 => 0.4256, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 15.61% (1.4269 => 1.6496, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 15.44% (0.7875 => 0.9091, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.20% (0.3690 => 0.4251, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.20% (0.3981 => 0.4586, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.18% (0.1028 => 0.1184, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 14.78% (0.5012 => 0.5753, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 14.68% (0.2691 => 0.3086, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 14.36% (2.1653 => 2.4762, std.dev.: 0.0160) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 13.96% (0.3496 => 0.3984, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 13.93% (0.3446 => 0.3926, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 13.82% (4.6177 => 5.2557, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.79% (0.3488 => 0.3969, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.73% (0.3460 => 0.3935, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.71% (0.3442 => 0.3914, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.47% (0.6435 => 0.7302, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/property: 13.45% (0.3650 => 0.4141, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.39% (0.2068 => 0.2345, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 13.34% (0.3643 => 0.4129, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 13.24% (5.5417 => 6.2755, std.dev.: 0.0157) MultiSource/Benchmarks/mafft/pairlocalalign: 13.24% (2.1013 => 2.3795, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/parameter-passing: 13.18% (0.3724 => 0.4215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.64% (0.2737 => 0.3083, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.2103 => 0.2359, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 11.84% (0.3498 => 0.3912, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 11.59% (0.6634 => 0.7403, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.58% (0.3084 => 0.3441, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.42% (0.5361 => 0.5973, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 11.21% (0.3336 => 0.3710, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (0.4847 => 0.5383, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.85% (0.1383 => 0.1533, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.50% (0.7426 => 0.8206, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.30% (11.6398 => 12.8390, std.dev.: 0.0118) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 9.51% (2.0346 => 2.2281, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.39% (4.6926 => 5.1333, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.26% (0.5584 => 0.6101, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8547, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3792 => 0.3959, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5217, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 15.84% (0.5917 => 0.6854, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.64% (0.3693 => 0.4123, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.2122 => 0.2242, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2373, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6686, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6887, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1924, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.70% (2.0820 => 2.1173, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3073, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0821, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2090, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5965, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4809, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.02% (1.2197 => 1.2321, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5692, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.84% (17.2379 => 14.3354, std.dev.: 0.0350) SingleSource/UnitTests/Vector/multiplies: -11.34% (2.3713 => 2.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -9.53% (0.2402 => 0.2173, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9773, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8115, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9589, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.42% (14.0481 => 13.4268, std.dev.: 0.0794) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2193, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8051, std.dev.: 0.0078) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.61% (0.6293 => 0.6129, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1918, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1835, std.dev.: 0.0382) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0437, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 18:54:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 20:54:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118025459.5389B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7704?compare_to=7700&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7704, Order: 172770, Start Time: 2013-01-18 00:53:18, End Time: 2013-01-18 02:55:09 To: 7700, Order: 172760, Start Time: 2013-01-17 22:33:14, End Time: 2013-01-18 00:36:10 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (9 on baseline) Performance Improvements: 30 (46 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1026 (1008 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.95% (19.2590 => 21.9463, std.dev.: 0.0556) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.85% (3.6778 => 4.0033, std.dev.: 0.1012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.94% (15.9849 => 16.7739, std.dev.: 0.2798) SingleSource/Benchmarks/Linpack/linpack-pc: 3.74% (50.8869 => 52.7897, std.dev.: 0.1218) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.63% (1.3129 => 1.3606, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 2.79% (1.3666 => 1.4047, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.31% (5.2794 => 5.4014, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/flops: 2.03% (8.6788 => 8.8551, std.dev.: 0.0216) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -23.46% (0.0618 => 0.0473, std.dev.: 0.0001) MultiSource/Applications/aha/aha: -19.83% (0.1513 => 0.1213, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -16.58% (0.0977 => 0.0815, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.60% (0.1870 => 0.1597, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -13.25% (0.1004 => 0.0871, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.20% (0.1333 => 0.1157, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -12.23% (1.0074 => 0.8842, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/distray/distray: -11.70% (0.1111 => 0.0981, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: -8.61% (1.5095 => 1.3796, std.dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.26% (0.7417 => 0.6804, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.20% (0.3542 => 0.3287, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.76% (0.3106 => 0.2927, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.36% (0.9511 => 0.9001, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.80% (0.9362 => 0.8913, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.69% (0.9528 => 0.9081, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: -4.07% (16.7703 => 16.0877, std.dev.: 0.2649) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.89% (1.9530 => 1.8771, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.87% (0.9421 => 0.9056, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.67% (0.9135 => 0.8800, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.52% (0.9007 => 0.8690, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.41% (0.7395 => 0.7143, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.67% (1.0171 => 0.9899, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.42% (0.9832 => 0.9594, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.32% (0.8949 => 0.8741, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.16% (0.9617 => 0.9409, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -1.84% (2.6017 => 2.5537, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.74% (0.9658 => 0.9490, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.14% (1.0012 => 0.9898, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.20% (4.4531 => 4.3552, std.dev.: 0.0342) MultiSource/Applications/aha/aha: -2.16% (3.5829 => 3.5055, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.01% (1.1302 => 1.1075, std.dev.: 0.0470) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.36% (0.0221 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.50% (0.0333 => 0.0338, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.26% (0.0318 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0431 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.83% (0.0219 => 0.0223, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0231 => 0.0230, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: 44.44% (0.0009 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.51% (0.1477 => 0.1440, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: -16.95% (1.4195 => 1.1789, std.dev.: 0.1609) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.97% (0.4008 => 0.4127, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.82% (0.1451 => 0.1521, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.83% (0.0959 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0275 => 0.0276, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.59% (0.0567 => 0.0541, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1517 => 1.1451, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0613 => 0.0607, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0306 => 0.0306, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.14% (0.7404 => 0.7414, std.dev.: 0.1301) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 63.89% (0.0036 => 0.0059, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.38% (12.7473 => 12.7958, std.dev.: 0.0375) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.11% (0.0336 => 0.0501, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322362.50% (0.0008 => 2.5797, std.dev.: 0.0139) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.91% (1.1825 => 2.4231, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.69% (0.2562 => 0.2887, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (3.7074 => 4.0033, std.dev.: 0.1012) MultiSource/Benchmarks/nbench/nbench: 6.99% (20.5117 => 21.9463, std.dev.: 0.0556) SingleSource/Benchmarks/Linpack/linpack-pc: 3.72% (50.8945 => 52.7897, std.dev.: 0.1218) SingleSource/Benchmarks/Misc/pi: 3.57% (2.1390 => 2.2153, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 1.08% (3.5910 => 3.6299, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.87% (0.0727 => 0.0488, std.dev.: 0.0007) SingleSource/Benchmarks/SmallPT/smallpt: -27.70% (0.1888 => 0.1365, std.dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.72% (0.0692 => 0.0514, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.92% (0.1684 => 0.1298, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -19.93% (1.8964 => 1.5185, std.dev.: 0.1219) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.61% (0.0862 => 0.0693, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.14% (0.1009 => 0.0826, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.85% (0.1079 => 0.0908, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.66% (1.0986 => 0.9375, std.dev.: 0.0264) MultiSource/Applications/Burg/burg: -13.66% (1.5979 => 1.3796, std.dev.: 0.0461) SingleSource/UnitTests/Vector/constpool: -13.41% (9.8875 => 8.5612, std.dev.: 0.3790) MultiSource/Applications/aha/aha: -11.97% (0.1378 => 0.1213, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -11.45% (1.1433 => 1.0124, std.dev.: 0.0186) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.95% (1.5131 => 1.3626, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.72% (1.3924 => 1.2571, std.dev.: 0.0279) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.69% (10.2703 => 9.2747, std.dev.: 0.3127) MultiSource/Applications/siod/siod: -8.69% (2.6437 => 2.4140, std.dev.: 0.0882) MultiSource/Applications/sqlite3/sqlite3: -8.40% (17.5634 => 16.0877, std.dev.: 0.2649) MultiSource/Applications/lambda-0_1_3/lambda: -8.15% (0.8653 => 0.7948, std.dev.: 0.0088) MultiSource/Applications/d/make_dparser: -7.43% (3.7840 => 3.5029, std.dev.: 0.1017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.77% (0.2481 => 0.2313, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.07% (1.0017 => 0.9409, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.17% (0.9550 => 0.9056, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.88% (0.3665 => 0.3486, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: -4.55% (0.7776 => 0.7422, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.48% (0.9507 => 0.9081, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.39% (0.9422 => 0.9008, std.dev.: 0.0148) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.12% (0.6135 => 0.5882, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.85% (0.9091 => 0.8741, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.62% (0.9512 => 0.9168, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.60% (0.9405 => 0.9066, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.34% (0.8990 => 0.8690, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.12% (0.9127 => 0.8842, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.22% (1.0860 => 1.0619, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.01% (0.9685 => 0.9490, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.73% (0.9372 => 0.6492, std.dev.: 0.1111) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.31% (4.2042 => 3.2241, std.dev.: 0.3433) MultiSource/Applications/minisat/minisat: -22.59% (7.9891 => 6.1845, std.dev.: 0.2960) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0157) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.73% (1.4588 => 1.3606, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -2.77% (4.4730 => 4.3493, std.dev.: 0.0339) MultiSource/Applications/hexxagon/hexxagon: -1.95% (14.0297 => 13.7562, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.40% (3.1921 => 3.1474, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/ffbench: -1.38% (1.4244 => 1.4047, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/FloatMM: -1.24% (0.8328 => 0.8225, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.07% (1.2047 => 1.1075, std.dev.: 0.0470) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0057) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.88% (0.1530 => 0.1440, std.dev.: 0.0091) MultiSource/Applications/lemon/lemon: -38.89% (1.9293 => 1.1789, std.dev.: 0.1609) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.93% (0.4049 => 0.4127, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.73% (0.1510 => 0.1521, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.12% (0.0978 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.43% (1.1617 => 1.1451, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.18% (0.0268 => 0.0306, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7437 => 0.7414, std.dev.: 0.1301) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.87% (0.0092 => 0.0059, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7781 => 12.7958, std.dev.: 0.0375) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 18:57:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 20:57:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118025734.BE3BB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7705?compare_to=7701&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7705, Order: 172774, Start Time: 2013-01-18 01:24:10, End Time: 2013-01-18 02:57:42 To: 7701, Order: 172762, Start Time: 2013-01-17 23:27:39, End Time: 2013-01-18 01:00:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (138 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.60% (0.6688 => 0.6929, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.39% (0.0717 => 0.1193, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.86% (0.0974 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.80% (0.1500 => 0.2172, std.dev.: 0.0029) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.29% (0.6395 => 0.8716, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 36.12% (0.0418 => 0.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.34% (0.6395 => 0.8591, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.75% (0.6260 => 0.8310, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.31% (0.5688 => 0.7469, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.18% (0.5805 => 0.7615, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.10% (0.5456 => 0.7153, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.55% (0.6230 => 0.8133, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.45% (0.5567 => 0.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.43% (0.5849 => 0.7629, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.33% (0.5941 => 0.7743, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.31% (0.5575 => 0.7265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.03% (0.5581 => 0.7257, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.90% (0.0699 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.87% (0.5802 => 0.7535, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.38% (0.5705 => 0.7381, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.27% (0.6033 => 0.7799, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.71% (0.5570 => 0.7169, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.65% (0.6440 => 0.8285, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.51% (0.5857 => 0.7527, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.44% (0.5569 => 0.7153, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.44% (0.5478 => 0.7036, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.39% (0.5925 => 0.7607, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.37% (0.5591 => 0.7177, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.58% (0.6052 => 0.7721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.32% (0.6189 => 0.7880, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.27% (0.5863 => 0.7462, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.25% (1.6474 => 2.0963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.10% (0.6446 => 0.8193, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.76% (0.6304 => 0.7991, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.73% (0.6681 => 0.8400, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.61% (0.6194 => 0.7780, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.33% (0.6297 => 0.7892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.12% (0.6660 => 0.8333, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.70% (0.6667 => 0.8247, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.66% (0.7524 => 0.9229, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.60% (0.7339 => 0.8924, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.79% (0.0582 => 0.0703, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.18% (2.2587 => 2.7146, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.48% (0.0693 => 0.0828, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.29% (0.0622 => 0.0742, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.40% (0.0634 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.59% (1.1450 => 1.3120, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3357 => 0.3833, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.31% (0.1982 => 0.2226, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.46% (4.5069 => 5.0236, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.96% (0.4916 => 0.5455, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 10.83% (0.4515 => 0.5004, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.74% (1.6364 => 1.8121, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.42% (3.5339 => 3.9020, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.75% (0.7021 => 0.7565, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.15% (0.2001 => 0.2144, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.10% (0.4524 => 0.4845, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5329 => 0.5673, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.44% (1.2515 => 1.3321, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.2784 => 1.3566, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.07% (0.1731 => 0.1836, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.85% (1.4642 => 1.5498, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 5.84% (9.2283 => 9.7671, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 5.82% (0.4861 => 0.5144, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 4.82% (0.3255 => 0.3412, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.46% (0.3319 => 0.3434, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.94% (5.0226 => 5.1705, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.64% (0.6750 => 0.6928, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.60% (5.4682 => 5.6105, std.dev.: 0.0057) MultiSource/Applications/spiff/spiff: 1.20% (0.8418 => 0.8519, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.3722 => 1.3861, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.38% (31.3723 => 55.6496, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.44% (0.9531 => 1.0335, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4919, std.dev.: 0.1397) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.15% (2.0478 => 2.1123, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (5.1955 => 5.2758, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2060, std.dev.: 0.0019) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.33% (0.3848 => 0.3643, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.30% (0.3812 => 0.3610, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.28% (2.4924 => 2.3607, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -5.27% (0.3831 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.26% (0.3896 => 0.3691, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.7198 => 0.6820, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.21% (0.4033 => 0.3823, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.17% (0.3891 => 0.3690, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.12% (0.4176 => 0.3962, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.82% (0.2428 => 0.2311, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -4.77% (0.6347 => 0.6044, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.74% (0.4199 => 0.4000, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (0.9852 => 0.9410, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -4.46% (0.4280 => 0.4089, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.41% (0.6441 => 0.6157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.36% (0.3323 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.29% (0.3057 => 0.2926, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012) SingleSource/UnitTests/ObjC++/property-reference: -4.10% (0.7779 => 0.7460, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.90% (2.1713 => 2.0867, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.82% (0.3059 => 0.2942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.78% (0.3252 => 0.3129, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.73% (1.3148 => 1.2658, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.71% (0.3016 => 0.2904, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: -3.71% (0.2939 => 0.2830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.70% (0.3026 => 0.2914, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (0.3025 => 0.2915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.64% (0.3658 => 0.3525, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.57% (0.4151 => 0.4003, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/strcat: -3.48% (0.2989 => 0.2885, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.44% (0.6484 => 0.6261, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.9542 => 0.9240, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -3.12% (0.3621 => 0.3508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.08% (0.7919 => 0.7675, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3931 => 0.3811, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.96% (0.4321 => 0.4193, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1773, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (14.2083 => 13.8038, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.78% (0.3849 => 0.3742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.74% (0.3867 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.73% (4.3330 => 4.2149, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: -2.71% (0.4248 => 0.4133, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.67% (0.4427 => 0.4309, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.66% (6.7716 => 6.5915, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -2.52% (0.7982 => 0.7781, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.43% (1.0544 => 1.0288, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.31% (17.1032 => 16.7082, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.27% (1.2221 => 1.1943, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.27% (1.2210 => 1.1933, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -2.25% (16.1920 => 15.8270, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.11% (1.2300 => 1.2040, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -2.09% (7.0961 => 6.9478, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -2.04% (2.4021 => 2.3532, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.95% (1.5610 => 1.5306, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.91% (34.0927 => 33.4430, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/football/football: -1.87% (0.9179 => 0.9007, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.80% (0.5999 => 0.5891, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (0.8521 => 0.8378, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.49% (0.9077 => 0.8942, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -1.49% (4.0594 => 3.9991, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: -1.37% (18.2933 => 18.0421, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.30% (8.0126 => 7.9082, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: -1.08% (2.1401 => 2.1169, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -1.03% (15.2527 => 15.0961, std.dev.: 0.0100) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.72% (1.8100 => 0.6929, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3090, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0200, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.88% (5.3397 => 4.1712, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1295, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7583, std.dev.: 0.0286) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.3096 => 1.2761, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/ary3: -2.46% (3.7241 => 3.6326, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1969, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.43% (1.6219 => 1.5987, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6076, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6664, std.dev.: 0.0082) MultiSource/Applications/lemon/lemon: -1.04% (1.4516 => 1.4365, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 20:19:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 22:19:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118041905.5DC562A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7706?compare_to=7702&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7706, Order: 172779, Start Time: 2013-01-18 02:07:50, End Time: 2013-01-18 04:19:13 To: 7702, Order: 172762, Start Time: 2013-01-17 23:26:32, End Time: 2013-01-18 01:37:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.38% (2.3530 => 2.3855, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (10.7818 => 10.8902, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.12% (11.0371 => 10.8032, std.dev.: 0.0156) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8515 => 499.8001, std.dev.: 0.0245) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44220.31% (1.1277 => 499.8001, std.dev.: 0.0245) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.39% (0.5229 => 1.6492, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 20.35% (14.9895 => 18.0406, std.dev.: 0.0105) MultiSource/Applications/kimwitu++/kc: 43.44% (14.1553 => 20.3043, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: 17.65% (4.1105 => 4.8358, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.93% (1.1048 => 1.7338, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.97% (7.1582 => 37.5785, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.91% (3.4629 => 6.4034, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.64% (0.6222 => 1.0866, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.75% (0.0720 => 7.4475, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11150700.00% (0.0001 => 11.1508, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487700.00% (0.0001 => 5.4878, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.43% (1.1194 => 10.3705, std.dev.: 0.0066) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.95% (22.1758 => 55.6509, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.18% (0.1463 => 0.2519, std.dev.: 0.0011) SingleSource/Regression/C/sumarray2d: 69.00% (0.0271 => 0.0458) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.33% (2.9384 => 4.6229, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.38% (7.0540 => 10.8902, std.dev.: 0.0057) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.48% (1.5859 => 2.4023, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.84% (8.1363 => 11.9476, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.45% (2.2024 => 3.1154, std.dev.: 0.0021) SingleSource/UnitTests/vla: 39.72% (0.0355 => 0.0496, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 39.32% (0.1432 => 0.1995, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 38.45% (21.9371 => 30.3721, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.91% (0.1062 => 0.1454, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.74% (4.2646 => 5.7033, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.99% (1.5415 => 2.0501, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.68% (0.4615 => 0.6123, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.81% (0.1892 => 0.2475, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.38% (0.2271 => 0.2961, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.06% (0.0479 => 0.0623, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 29.63% (0.4299 => 0.5573, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 28.90% (1.1642 => 1.5006, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.75% (0.6675 => 0.8594, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.38% (0.5105 => 0.6503, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.11% (0.1125 => 0.1430, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 26.95% (0.1555 => 0.1974, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.66% (0.2554 => 0.3235, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 26.28% (0.1655 => 0.2090, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.24% (3.8922 => 4.9134, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.04% (0.0457 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.54% (0.1566 => 0.1966, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 25.30% (1.0722 => 1.3435, std.dev.: 0.0154) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.02% (0.1143 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.71% (0.1906 => 0.2377, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 24.34% (0.4289 => 0.5333, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.09% (0.3121 => 0.3873, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.75% (1.4186 => 1.7555, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 23.12% (0.4620 => 0.5688, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.96% (9.4845 => 11.6622, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.83% (0.1695 => 0.2082, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.46% (0.7115 => 0.8713, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.41% (0.2700 => 0.3278, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.34% (0.7835 => 0.9507, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 20.99% (5.7591 => 6.9678, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.93% (1.3050 => 1.5781, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 20.88% (0.3098 => 0.3745, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.79% (0.1236 => 0.1493, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 20.11% (0.6456 => 0.7754, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 20.07% (0.1151 => 0.1382, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.71% (4.9449 => 5.9197, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.66% (0.5860 => 0.7012, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.31% (0.8172 => 0.9750, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 18.95% (3.3354 => 3.9676, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.90% (5.0018 => 5.9472, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.65% (0.5020 => 0.5956, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.08% (0.3307 => 0.3905, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 17.82% (1.1840 => 1.3950, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.65% (0.9765 => 1.1489, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.63% (0.5569 => 0.6551, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.62% (0.1510 => 0.1776, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.56% (0.7433 => 0.8738, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.30% (2.0273 => 2.3781, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.10% (3.8723 => 4.5346, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.87% (0.5981 => 0.6990, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 16.74% (0.2049 => 0.2392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.34% (2.2969 => 2.6721, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.30% (0.3441 => 0.4002, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.22% (0.8101 => 0.9415, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 15.90% (0.3283 => 0.3805, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.88% (0.6450 => 0.7474, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 15.66% (0.3232 => 0.3738, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.14% (0.8921 => 1.0272, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.88% (1.1861 => 1.3626, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3379 => 0.3860, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.17% (0.8067 => 0.9210, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.14% (0.2603 => 0.2971, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.43% (0.3387 => 0.3842, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.20% (0.3865 => 0.4375, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.01% (0.4636 => 0.5239, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 12.93% (1.5603 => 1.7620, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 12.37% (0.3282 => 0.3688, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.16% (0.4203 => 0.4714, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.11% (0.4103 => 0.4600, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.3603 => 0.4031, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.83% (0.4048 => 0.4527, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.81% (0.2430 => 0.2717, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 11.60% (0.3422 => 0.3819, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.57% (17.1811 => 19.1687, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: 11.19% (0.3092 => 0.3438, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 10.85% (0.3927 => 0.4353, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.72% (0.3826 => 0.4236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.63% (0.3886 => 0.4299, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.49% (14.3668 => 15.8732, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.21% (0.4064 => 0.4479, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2831 => 0.3101, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3543 => 0.3874, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 9.33% (0.3473 => 0.3797, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.30% (0.3516 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.27% (0.3561 => 0.3891, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.21% (0.3497 => 0.3819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2871 => 0.3135, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.97% (2.0665 => 2.2518, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3951, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.49% (63.2438 => 68.6105, std.dev.: 0.0408) SingleSource/Regression/C++/ofstream_ctor: 8.47% (0.2905 => 0.3151, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.35% (0.3162 => 0.3426, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.32% (2.2022 => 2.3855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.27% (0.2756 => 0.2984, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.25% (0.2872 => 0.3109, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.20% (0.2891 => 0.3128, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0077) SingleSource/UnitTests/ObjC++/property-reference-object: 8.13% (0.6030 => 0.6520, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.03% (0.3935 => 0.4251, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.82% (0.2802 => 0.3021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.91% (0.4879 => 0.5216, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 4.20% (10.3673 => 10.8032, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (7.9617 => 8.1498, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2435, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261) SingleSource/Benchmarks/Misc/richards_benchmark: 9.23% (1.1396 => 1.2448, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4470, std.dev.: 0.0127) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3121, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.46% (0.9957 => 1.0302, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0118) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.6802 => 8.9045, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.21% (3.6395 => 3.7199, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.95% (9.1159 => 9.2935, std.dev.: 0.0062) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2819, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5752, std.dev.: 0.0117) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1708, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.66% (5.2763 => 1.1785, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.23% (0.8651 => 0.2143, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.41% (5.3855 => 4.5017, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.18% (5.3526 => 4.4867, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: -13.31% (10.4361 => 9.0466, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.85% (1.7609 => 1.6226, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9242, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.05% (1.9577 => 0.6647, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.12% (0.3987 => 0.2467, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4246, std.dev.: 0.0271) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8572, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0058, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.53% (0.0757 => 0.0594, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4918, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2870, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.01% (1.2373 => 1.1629, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7029, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8409, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2312, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0021) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 20:54:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 22:54:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118045427.051AF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7707?compare_to=7705&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7707, Order: 172781, Start Time: 2013-01-18 03:21:10, End Time: 2013-01-18 04:54:35 To: 7705, Order: 172774, Start Time: 2013-01-18 01:24:10, End Time: 2013-01-18 02:57:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (95 on baseline) Performance Improvements: 0 (136 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (861 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (80.0565 => 81.1209, std.dev.: 0.1273) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 76.43% (0.0280 => 0.0494, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.97% (0.0717 => 0.1190, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.09% (0.6395 => 0.8703, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.26% (0.6395 => 0.8586, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.46% (0.6260 => 0.8292, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.35% (0.5805 => 0.7625, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.15% (0.5688 => 0.7460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.85% (0.5456 => 0.7139, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.51% (0.6230 => 0.8131, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.43% (0.5849 => 0.7629, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.25% (0.5567 => 0.7251, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.25% (0.5941 => 0.7738, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.04% (0.5575 => 0.7250, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.03% (0.5581 => 0.7257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.71% (0.5802 => 0.7526, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.24% (0.5705 => 0.7373, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.19% (0.6033 => 0.7794, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.84% (0.5859 => 0.7549, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.56% (0.6440 => 0.8279, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.55% (0.5857 => 0.7529, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.51% (0.5570 => 0.7158, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.48% (0.5478 => 0.7038, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.27% (0.5925 => 0.7600, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.25% (0.5569 => 0.7142, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.24% (0.5591 => 0.7170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.55% (0.6676 => 0.8515, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.34% (0.6189 => 0.7881, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.17% (1.6474 => 2.0950, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.10% (0.6052 => 0.7692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.07% (0.5863 => 0.7450, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.85% (0.6446 => 0.8177, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.59% (0.6304 => 0.7980, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.59% (0.6194 => 0.7779, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.27% (0.6681 => 0.8369, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.09% (0.6297 => 0.7877, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.98% (0.6660 => 0.8324, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.73% (0.6667 => 0.8249, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.40% (0.7524 => 0.9209, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.58% (0.7339 => 0.8923, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.02% (2.2587 => 2.7110, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.52% (1.1450 => 1.3112, std.dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 14.03% (0.3357 => 0.3828, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.1982 => 0.2217, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.42% (4.5069 => 5.0217, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.92% (0.4916 => 0.5453, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.73% (1.6364 => 1.8120, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 10.59% (0.4515 => 0.4993, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.34% (3.5339 => 3.8992, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.93% (0.2385 => 0.2598, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.38% (0.7021 => 0.7539, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.51% (1.2515 => 1.3330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.37% (0.4524 => 0.4812, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.10% (0.5329 => 0.5654, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.93% (1.2784 => 1.3542, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.89% (1.4642 => 1.5505, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 5.87% (9.2283 => 9.7703, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/hash2: 5.35% (0.4861 => 0.5121, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.06% (0.3255 => 0.3387, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.77% (0.3319 => 0.3444, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.69% (5.0226 => 5.1577, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.20% (5.4682 => 5.5887, std.dev.: 0.0059) MultiSource/Applications/SIBsim4/SIBsim4: 2.11% (1.3864 => 1.4157, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 2.01% (0.6750 => 0.6886, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 1.33% (0.8418 => 0.8530, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6534, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4981, std.dev.: 0.2089) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.76% (79.7170 => 81.1209, std.dev.: 0.1273) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6059, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.54% (5.1955 => 5.2757, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2065, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.13% (1.5103 => 1.5273, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.05% (0.1281 => 0.1101, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -6.70% (0.3194 => 0.2980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.58% (0.3837 => 0.3623, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.38% (2.4924 => 2.3582, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.22% (0.3812 => 0.3613, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.12% (0.3323 => 0.3153, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.10% (0.3880 => 0.3682, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -5.02% (0.2871 => 0.2727, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.02% (0.3848 => 0.3655, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.98% (0.4033 => 0.3832, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.96% (0.2903 => 0.2759, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.95% (0.3896 => 0.3703, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.94% (0.3057 => 0.2906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.86% (0.4176 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.84% (0.2849 => 0.2711, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: -4.84% (0.3205 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: -4.71% (0.3059 => 0.2915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.71% (0.2933 => 0.2795, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.68% (0.3016 => 0.2875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.66% (0.2939 => 0.2802, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.61% (0.3884 => 0.3705, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -4.59% (0.3026 => 0.2887, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.51% (0.9852 => 0.9408, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -4.50% (0.3025 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.44% (2.1713 => 2.0748, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: -4.43% (0.6347 => 0.6066, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.40% (0.3252 => 0.3109, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.38% (0.4199 => 0.4015, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -4.30% (1.3148 => 1.2583, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: -4.25% (0.2989 => 0.2862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.16% (0.6441 => 0.6173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.14% (0.4151 => 0.3979, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -4.07% (0.4280 => 0.4106, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.01% (0.3142 => 0.3016, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.73% (0.3621 => 0.3486, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.55% (0.7779 => 0.7503, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3867 => 0.3731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.39% (0.4427 => 0.4277, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.38% (0.3931 => 0.3798, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -3.34% (0.4248 => 0.4106, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.27% (0.3849 => 0.3723, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.9542 => 0.9230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.08% (0.4321 => 0.4188, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -3.04% (0.3788 => 0.3673, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.89% (0.7919 => 0.7690, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.89% (0.4083 => 0.3965, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.82% (14.2083 => 13.8074, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: -2.65% (4.3330 => 4.2182, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.62% (6.7716 => 6.5945, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -2.54% (0.7982 => 0.7779, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -2.47% (17.1032 => 16.6812, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: -2.47% (16.1920 => 15.7926, std.dev.: 0.0193) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2685, std.dev.: 0.0243) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.37% (0.4813 => 0.4699, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.22% (1.0544 => 1.0310, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.21% (1.2210 => 1.1940, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.17% (1.2221 => 1.1956, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -2.15% (7.0961 => 6.9433, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -2.04% (1.5610 => 1.5292, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -1.99% (34.0927 => 33.4133, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -1.88% (2.4021 => 2.3569, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -1.85% (0.9179 => 0.9009, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.75% (0.5999 => 0.5894, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.68% (0.8521 => 0.8378, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.57% (4.0594 => 3.9957, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.36% (8.0126 => 7.9039, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: -1.32% (18.2933 => 18.0519, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.12% (0.9077 => 0.8975, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -1.05% (15.2527 => 15.0920, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.43% (1.8100 => 0.6982, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.91% (8.0445 => 5.3163, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0271, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0250, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7483, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8192, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2730, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/ary3: -2.65% (3.7241 => 3.6255, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7747, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4770, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1973, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6093, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7092 => 3.6611, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 21:14:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 17 Jan 2013 23:14:02 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118051402.8E0C42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7708?compare_to=7704&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7708, Order: 172781, Start Time: 2013-01-18 03:13:56, End Time: 2013-01-18 05:14:12 To: 7704, Order: 172770, Start Time: 2013-01-18 00:53:18, End Time: 2013-01-18 02:55:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (9 on baseline) Performance Improvements: 3 (70 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (984 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.08% (23.4175 => 23.6711, std.dev.: 0.0604) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.36% (5.7254 => 6.4329, std.dev.: 0.0781) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.53% (2.3769 => 2.4371, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 2.23% (3.6732 => 3.7552, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.23% (1.5508 => 1.5698, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.77% (0.6761 => 0.6506, std.dev.: 0.0097) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.30% (0.9020 => 0.8903, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: -3.72% (52.7897 => 50.8252, std.dev.: 0.1447) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.01% (1.1075 => 1.1187, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0224 => 0.0223, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0435 => 0.0434, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -25.44% (0.0338 => 0.0252, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -19.88% (0.0322 => 0.0258, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0431 => 0.0433, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: -17.79% (0.0208 => 0.0171, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -39.91% (0.0223 => 0.0134, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.42% (0.1440 => 0.1446, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.48% (1.1789 => 1.1615, std.dev.: 0.0461) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.94% (0.4127 => 0.4207, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.96% (0.1521 => 0.1476, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.45% (0.0967 => 0.1039, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0541 => 0.0541, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1451 => 1.1445, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.69% (0.0026 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.05% (0.0607 => 0.0546, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (0.0306 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7414 => 0.7403, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 106.78% (0.0059 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.49% (12.7958 => 12.7329, std.dev.: 0.0149) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.43% (0.0336 => 0.0492, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321887.50% (0.0008 => 2.5759, std.dev.: 0.0203) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.99% (1.1825 => 2.4122, std.dev.: 0.0914) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.81% (5.6033 => 6.4329, std.dev.: 0.0781) SingleSource/Benchmarks/Misc/pi: 3.54% (2.1390 => 2.2147, std.dev.: 0.0127) MultiSource/Applications/JM/lencod/lencod: 3.28% (6.8159 => 7.0396, std.dev.: 0.0750) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.63% (9.0082 => 9.2450, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: 2.13% (3.6768 => 3.7552, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.98% (63.1520 => 64.4025, std.dev.: 0.0689) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.11% (0.0808 => 0.0492, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.22% (0.0727 => 0.0500, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: -27.54% (0.1888 => 0.1368, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.31% (0.0692 => 0.0503, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -21.50% (0.1079 => 0.0847, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: -20.08% (1.8964 => 1.5156, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.25% (1.0960 => 0.8960, std.dev.: 0.0688) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.04% (0.1009 => 0.0827, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.17% (0.0862 => 0.0714, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.11% (0.7686 => 0.6371, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.43% (1.0986 => 0.9401, std.dev.: 0.0075) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.38% (0.4074 => 0.3529, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: -11.43% (1.1433 => 1.0126, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -11.00% (0.7693 => 0.6847, std.dev.: 0.0072) MultiSource/Applications/lua/lua: -10.76% (4.6406 => 4.1412, std.dev.: 0.0583) MultiSource/Applications/sqlite3/sqlite3: -9.61% (17.5634 => 15.8758, std.dev.: 0.3485) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.55% (1.6874 => 1.5262, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.34% (1.5131 => 1.3718, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.23% (10.2703 => 9.3224, std.dev.: 0.1897) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.63% (0.9124 => 0.8337, std.dev.: 0.0068) MultiSource/Applications/lambda-0_1_3/lambda: -8.53% (0.8653 => 0.7915, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.44% (1.1498 => 1.0527, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.34% (0.3560 => 0.3263, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.23% (0.5746 => 0.5273, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.02% (0.6885 => 0.6333, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.59% (0.2372 => 0.2192, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.14% (0.9588 => 0.8903, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -6.99% (3.7840 => 3.5196, std.dev.: 0.1003) MultiSource/Applications/lemon/lemon: -6.57% (1.3979 => 1.3061, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.53% (0.2709 => 0.2532, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.50% (0.7693 => 0.7193, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.26% (1.8127 => 1.6992, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.17% (0.6934 => 0.6506, std.dev.: 0.0097) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.62% (0.1798 => 0.1697, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.41% (0.2144 => 0.2028, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.99% (0.9550 => 0.9073, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.26% (1.0234 => 0.9798, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.00% (0.9422 => 0.9045, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.90% (0.9507 => 0.9136, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.57% (0.9127 => 0.8801, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.53% (0.8990 => 0.8673, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.44% (0.9512 => 0.9185, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.43% (0.9405 => 0.9082, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.42% (1.0052 => 0.9708, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.36% (0.9403 => 0.9087, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.33% (0.9091 => 0.8788, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.11% (0.4762 => 0.4614, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.11% (1.0860 => 1.0631, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.93% (0.9488 => 0.9305, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.87% (0.9855 => 0.9671, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.84% (1.0088 => 0.9902, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.21% (0.9061 => 0.8951, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.30% (7.9891 => 6.2078, std.dev.: 0.2189) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.87% (0.1164 => 0.0956, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.86% (1.5623 => 1.2832, std.dev.: 0.0592) MultiSource/Benchmarks/BitBench/drop3/drop3: -9.85% (0.3217 => 0.2900, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.18% (0.4081 => 0.3747, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.3654 => 0.3420, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.31% (0.3201 => 0.2999, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.87% (0.3349 => 0.3186, std.dev.: 0.0057) MultiSource/Applications/sqlite3/sqlite3: -3.72% (4.4730 => 4.3068, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.34% (1.4446 => 1.3964, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.88% (0.5826 => 0.5658, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.52% (1.0995 => 1.0718, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/ffbench: -2.44% (1.4244 => 1.3896, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel-2: -2.05% (0.8521 => 0.8346, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -2.00% (7.2040 => 7.0596, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/methcall: -1.73% (8.7416 => 8.5903, std.dev.: 0.0564) SingleSource/Benchmarks/SmallPT/smallpt: -1.38% (14.9448 => 14.7386, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.23% (3.1921 => 3.1527, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.14% (1.2047 => 1.1187, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0122) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -36.04% (0.0394 => 0.0252, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -21.34% (0.0328 => 0.0258, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: -19.72% (0.0213 => 0.0171, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/test1: -40.97% (0.0227 => 0.0134, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.49% (0.1530 => 0.1446, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -39.80% (1.9293 => 1.1615, std.dev.: 0.0461) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.90% (0.4049 => 0.4207, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.25% (0.1510 => 0.1476, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.24% (0.0978 => 0.1039, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.48% (1.1617 => 1.1445, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -11.11% (0.0027 => 0.0024, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.49% (0.0610 => 0.0546, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.7437 => 0.7403, std.dev.: 0.0022) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.35% (12.7781 => 12.7329, std.dev.: 0.0149) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 22:12:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 00:12:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130118061243.B56AA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7709?compare_to=7703&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7709, Order: 172779, Start Time: 2013-01-18 02:38:14, End Time: 2013-01-18 06:12:52 To: 7703, Order: 172753, Start Time: 2013-01-17 22:02:43, End Time: 2013-01-18 01:39:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (182 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 1.97% (13.4268 => 13.6914, std.dev.: 0.0372) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.68% (0.0625 => 0.0898, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.24% (0.1063 => 0.1427, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.36% (0.2969 => 0.3811, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.31% (0.1106 => 0.1408, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.94% (0.4139 => 0.5254, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.83% (0.1107 => 0.1404, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.75% (0.5900 => 0.7478, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.53% (0.4994 => 0.6319, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.45% (0.4253 => 0.5378, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.33% (0.0714 => 0.0902, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 25.87% (1.5932 => 2.0054, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.62% (0.1620 => 0.2035, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.77% (0.0541 => 0.0675, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.68% (0.3890 => 0.4850, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.64% (0.5000 => 0.6232, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.43% (0.1549 => 0.1912, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 22.79% (0.1619 => 0.1988, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.73% (0.1003 => 0.1231, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.42% (0.3903 => 0.4778, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/power/power: 22.35% (0.0604 => 0.0739, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.19% (0.1604 => 0.1960, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 22.19% (0.4029 => 0.4923, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.77% (0.2866 => 0.3490, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.48% (0.1462 => 0.1776, std.dev.: 0.0045) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 20.66% (0.1505 => 0.1816, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.62% (0.0582 => 0.0702, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.29% (0.2736 => 0.3291, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.22% (0.1088 => 0.1308, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.00% (1.3152 => 1.5783, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.57% (0.3271 => 0.3911, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.34% (0.4658 => 0.5559, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 19.13% (1.8794 => 2.2389, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 18.91% (0.5546 => 0.6595, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.61% (1.6211 => 1.9228, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.33% (0.2738 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.23% (0.2875 => 0.3399, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.05% (0.5026 => 0.5933, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.03% (3.5627 => 4.2049, std.dev.: 0.0728) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.98% (0.1090 => 0.1286, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.84% (0.4361 => 0.5139, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.76% (0.1160 => 0.1366, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 17.64% (0.2750 => 0.3235, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 17.61% (0.2725 => 0.3205, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 17.61% (0.2714 => 0.3192, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.55% (0.2911 => 0.3422, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 17.52% (0.2803 => 0.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.44% (0.2729 => 0.3205, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.44% (0.9697 => 1.1388, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 17.39% (0.2823 => 0.3314, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.37% (0.2792 => 0.3277, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 17.36% (0.2811 => 0.3299, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.35% (0.3930 => 0.4612, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 17.27% (0.9909 => 1.1620, std.dev.: 0.0111) SingleSource/UnitTests/ObjC++/Hello: 17.23% (0.5826 => 0.6830, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 17.21% (0.3317 => 0.3888, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 17.17% (0.2813 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 17.12% (0.3096 => 0.3626, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.08% (0.3004 => 0.3517, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.06% (0.3060 => 0.3582, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 17.01% (1.0781 => 1.2615, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.01% (2.0673 => 2.4189, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.94% (0.0673 => 0.0787, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.82% (1.9694 => 2.3007, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.78% (0.3195 => 0.3731, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 16.71% (0.3267 => 0.3813, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 16.69% (0.5889 => 0.6872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.67% (0.3258 => 0.3801, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 16.47% (0.7171 => 0.8352, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.44% (1.9966 => 2.3248, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.27% (0.3362 => 0.3909, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.25% (2.7292 => 3.1726, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.18% (4.4195 => 5.1345, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/lists: 16.13% (0.3348 => 0.3888, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 16.08% (4.2109 => 4.8879, std.dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.07% (0.3845 => 0.4463, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.07% (0.3124 => 0.3626, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 16.06% (0.2566 => 0.2978, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 15.99% (0.4146 => 0.4809, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.97% (0.3625 => 0.4204, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 15.94% (0.3726 => 0.4320, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.94% (0.3282 => 0.3805, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.72% (23.5202 => 27.2165, std.dev.: 0.0428) SingleSource/Benchmarks/Shootout-C++/lists1: 15.67% (0.3477 => 0.4022, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 15.66% (0.3678 => 0.4254, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 15.64% (1.4269 => 1.6500, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.42% (0.3981 => 0.4595, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.34% (0.3690 => 0.4256, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 15.15% (0.4251 => 0.4895, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 15.05% (0.7875 => 0.9060, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 14.64% (0.5012 => 0.5746, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: 14.34% (2.1653 => 2.4759, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/for-in: 14.02% (0.3496 => 0.3986, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.69% (4.6177 => 5.2497, std.dev.: 0.0309) SingleSource/UnitTests/ObjC/exceptions-3: 13.67% (0.3460 => 0.3933, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.52% (0.3446 => 0.3912, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 13.52% (0.3469 => 0.3938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.50% (0.3488 => 0.3959, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.41% (0.6435 => 0.7298, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 13.35% (0.2075 => 0.2352, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 13.32% (5.5417 => 6.2798, std.dev.: 0.0146) MultiSource/Applications/SIBsim4/SIBsim4: 13.27% (0.2691 => 0.3048, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.25% (0.2068 => 0.2342, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.01% (0.3643 => 0.4117, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 12.92% (2.1013 => 2.3727, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.26% (0.3084 => 0.3462, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.06% (0.3498 => 0.3920, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 11.65% (0.6634 => 0.7407, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.64% (0.5361 => 0.5985, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.18% (0.4847 => 0.5389, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.2103 => 0.2333, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.82% (11.6398 => 12.8996, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.44% (0.7426 => 0.8201, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.85% (4.6926 => 5.1548, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 9.45% (2.0346 => 2.2268, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.22% (0.5584 => 0.6099, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.32% (11.9555 => 12.8312, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3792 => 0.3973, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.57% (29.0505 => 181.4401, std.dev.: 0.0432) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.54% (0.3693 => 0.4119, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 9.67% (0.2802 => 0.3073, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2409, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6841, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2046, std.dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3074, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.33% (7.1849 => 7.2804, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2097, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5878, std.dev.: 0.0172) MultiSource/Applications/sqlite3/sqlite3: 1.01% (10.3705 => 10.4748, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.68% (25.4195 => 16.6042, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.11% (17.2379 => 14.1164, std.dev.: 0.0958) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7966, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/ary2: -6.41% (0.2402 => 0.2248, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2157, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8086, std.dev.: 0.0089) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: -2.54% (14.0481 => 13.6914, std.dev.: 0.0372) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1481, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5805, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4980, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (105.3826 => 104.2498, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.29s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 22:51:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 00:51:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118065135.DB72E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7710?compare_to=7707&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7710, Order: 172783, Start Time: 2013-01-18 05:17:52, End Time: 2013-01-18 06:51:44 To: 7707, Order: 172781, Start Time: 2013-01-18 03:21:10, End Time: 2013-01-18 04:54:35 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (865 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.57% (3.7492 => 3.8080, std.dev.: 0.0170) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.11% (0.0717 => 0.1191, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.13% (0.1500 => 0.2177, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.92% (0.6395 => 0.8692, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.25% (0.6395 => 0.8585, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.43% (0.6260 => 0.8290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.16% (0.5805 => 0.7614, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.07% (0.5688 => 0.7455, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.90% (0.5456 => 0.7142, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.58% (0.6230 => 0.8135, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.33% (0.0699 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.26% (0.5849 => 0.7619, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.15% (0.5575 => 0.7256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.11% (0.5567 => 0.7243, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.10% (0.5941 => 0.7729, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.03% (0.5581 => 0.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.59% (0.5802 => 0.7519, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.29% (0.5705 => 0.7376, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.09% (0.6033 => 0.7788, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.86% (0.5859 => 0.7550, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.40% (0.5570 => 0.7152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.40% (0.6440 => 0.8269, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.37% (0.5478 => 0.7032, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.31% (0.5857 => 0.7515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.14% (0.5925 => 0.7592, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.07% (0.5569 => 0.7132, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.06% (0.5591 => 0.7160, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.38% (0.6676 => 0.8504, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.29% (1.6474 => 2.0969, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.21% (0.6189 => 0.7873, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.86% (0.5863 => 0.7438, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.82% (0.6052 => 0.7675, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.81% (0.6446 => 0.8174, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.46% (0.6304 => 0.7972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.44% (0.6194 => 0.7770, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.37% (0.6681 => 0.8376, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.92% (0.6660 => 0.8320, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.85% (0.6297 => 0.7862, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.58% (0.6667 => 0.8239, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.47% (0.7524 => 0.9215, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.38% (0.7339 => 0.8908, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.08% (2.2587 => 2.7123, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.75% (0.1146 => 0.1315, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.64% (1.1450 => 1.3126, std.dev.: 0.0154) MultiSource/Applications/sgefa/sgefa: 13.94% (0.3357 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.47% (4.5069 => 5.0240, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.86% (0.4916 => 0.5450, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.69% (1.6364 => 1.8114, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 10.61% (0.4515 => 0.4994, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.36% (3.5339 => 3.8999, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.10% (0.2385 => 0.2602, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.63% (0.7021 => 0.7557, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 6.53% (1.2515 => 1.3332, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash: 6.41% (0.4524 => 0.4814, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.31% (0.5329 => 0.5665, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.09% (1.2784 => 1.3562, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.06% (1.4642 => 1.5530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 5.88% (0.4861 => 0.5147, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 5.85% (9.2283 => 9.7684, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.90% (0.3834 => 0.4022, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 4.58% (0.3255 => 0.3404, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.67% (5.0226 => 5.1569, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.28% (5.4682 => 5.5929, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 2.27% (0.6750 => 0.6903, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.15% (1.3864 => 1.4162, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.53% (0.8418 => 0.8547, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6583, std.dev.: 0.0170) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.48% (0.9531 => 1.0339, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6539, std.dev.: 0.0827) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.72% (3.7435 => 3.8080, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6048, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2774, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2071, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.14% (0.3194 => 0.2998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.61% (0.3812 => 0.3598, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.43% (0.7198 => 0.6807, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.43% (0.3831 => 0.3623, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -5.41% (0.3880 => 0.3670, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -5.36% (0.3896 => 0.3687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.36% (0.4033 => 0.3817, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.32% (2.4924 => 2.3598, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.29% (0.3891 => 0.3685, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.00% (0.3837 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.72% (0.4199 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.55% (0.9852 => 0.9404, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.52% (0.6347 => 0.6060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.48% (0.3057 => 0.2920, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652) SingleSource/UnitTests/ObjC/parameter-passing: -4.42% (0.4280 => 0.4091, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -4.35% (0.6441 => 0.6161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.31% (0.2903 => 0.2778, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -4.25% (0.2849 => 0.2728, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: -4.22% (0.3059 => 0.2930, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -4.15% (0.3205 => 0.3072, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: -3.97% (0.3026 => 0.2906, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.95% (0.3142 => 0.3018, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.87% (1.3148 => 1.2639, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -3.87% (0.3025 => 0.2908, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.85% (2.1713 => 2.0877, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: -3.71% (0.2989 => 0.2878, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.49% (0.4151 => 0.4006, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.36% (0.3658 => 0.3535, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.36% (0.6484 => 0.6266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.28% (0.9542 => 0.9229, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists: -3.26% (0.3621 => 0.3503, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.04% (0.3849 => 0.3732, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -2.97% (0.3867 => 0.3752, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.87% (0.4427 => 0.4300, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.86% (14.2083 => 13.8018, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.82% (0.3931 => 0.3820, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.77% (0.7919 => 0.7700, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: -2.73% (0.4248 => 0.4132, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -2.47% (4.3330 => 4.2261, std.dev.: 0.0043) MultiSource/Applications/sqlite3/sqlite3: -2.47% (17.1032 => 16.6816, std.dev.: 0.0236) MultiSource/Applications/JM/lencod/lencod: -2.44% (16.1920 => 15.7962, std.dev.: 0.0102) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2681, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: -2.42% (0.7982 => 0.7789, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.35% (6.7716 => 6.6128, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.20% (1.2210 => 1.1941, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -2.11% (7.0961 => 6.9464, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.2300 => 1.2054, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: -1.94% (1.5610 => 1.5307, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.87% (1.2221 => 1.1993, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.85% (34.0927 => 33.4634, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/football/football: -1.74% (0.9179 => 0.9019, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.67% (0.5999 => 0.5899, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -1.66% (2.4021 => 2.3623, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -1.41% (4.0594 => 4.0021, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.26% (8.0126 => 7.9114, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.26% (0.9077 => 0.8963, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -1.06% (18.2933 => 18.0998, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.82% (1.8100 => 0.6910, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0249, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.68% (4.3779 => 3.3850, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.83% (5.3397 => 4.1739, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2085, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1287, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7718, std.dev.: 0.0164) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1181, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6407, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.3040 => 7.1989, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -1.12% (1.4516 => 1.4354, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.07% (1.6219 => 1.6045, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 23:00:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 01:00:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118070027.6B1AA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7711?compare_to=7706&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7711, Order: 172782, Start Time: 2013-01-18 04:49:21, End Time: 2013-01-18 07:00:34 To: 7706, Order: 172779, Start Time: 2013-01-18 02:07:50, End Time: 2013-01-18 04:19:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8001 => 499.8481, std.dev.: 0.0072) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.56% (1.1277 => 499.8481, std.dev.: 0.0072) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.03% (0.5229 => 1.6473, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.36% (14.9895 => 18.0419, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 43.65% (14.1553 => 20.3343, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/gs/gs: 17.65% (4.1105 => 4.8360, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.14% (1.1048 => 1.7361, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.07% (7.1582 => 37.5855, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.98% (3.4629 => 6.4056, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.28% (0.6222 => 1.0906, std.dev.: 0.0070) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.06% (0.0720 => 7.4470, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11151600.00% (0.0001 => 11.1517, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482500.00% (0.0001 => 5.4826, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 834.06% (1.1194 => 10.4559, std.dev.: 0.0325) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785) MultiSource/Applications/ClamAV/clamscan: 150.76% (22.1758 => 55.6082, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.77% (0.1463 => 0.2513, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 69.00% (0.0271 => 0.0458, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.05% (2.9384 => 4.6149, std.dev.: 0.0062) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.98% (7.0540 => 10.8614, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.79% (1.5859 => 2.4072, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.46% (8.1363 => 11.9167, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.69% (2.2024 => 3.1205, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.24% (21.9371 => 30.3269, std.dev.: 0.0143) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.76% (4.2646 => 5.7043, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.02% (1.5415 => 2.0505, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.85% (0.4615 => 0.6131, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.60% (0.2271 => 0.2966, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.39% (0.1892 => 0.2467, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 29.57% (0.4299 => 0.5570, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 29.12% (1.1642 => 1.5032, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.87% (0.6675 => 0.8602, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.71% (0.1125 => 0.1448, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.29% (0.5105 => 0.6498, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 26.89% (0.1655 => 0.2100, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.83% (0.1584 => 0.2009, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.23% (3.8922 => 4.9133, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 25.34% (1.0722 => 1.3439, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.02% (0.1143 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 24.29% (0.4289 => 0.5331, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.06% (0.3121 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.77% (1.4186 => 1.7558, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.72% (0.1695 => 0.2097, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.42% (0.4620 => 0.5702, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.26% (0.1337 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.88% (9.4845 => 11.6546, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.76% (0.0457 => 0.0561, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.23% (0.7115 => 0.8697, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.80% (0.1555 => 0.1894, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.37% (0.2700 => 0.3277, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.90% (5.7591 => 6.9626, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.78% (1.3050 => 1.5762, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 20.71% (0.7835 => 0.9458, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 20.29% (0.6456 => 0.7766, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 19.98% (0.1151 => 0.1381, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.78% (4.9449 => 5.9229, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.66% (0.5860 => 0.7012, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.12% (0.1940 => 0.2311, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9438, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: 18.77% (3.3354 => 3.9614, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.71% (0.5020 => 0.5959, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.29% (0.3307 => 0.3912, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.75% (0.0834 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.70% (1.1840 => 1.3936, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 17.68% (0.7433 => 0.8747, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.62% (0.9765 => 1.1486, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.53% (0.5569 => 0.6545, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 17.52% (0.2049 => 0.2408, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 17.25% (2.0273 => 2.3770, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 17.24% (3.8723 => 4.5397, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 17.21% (0.3423 => 0.4012, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.07% (0.5981 => 0.7002, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.51% (0.3441 => 0.4009, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 16.30% (0.3283 => 0.3818, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.28% (2.2969 => 2.6709, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.24% (0.8101 => 0.9417, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 15.97% (0.3232 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.95% (0.6450 => 0.7479, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.24% (0.8921 => 1.0281, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 15.19% (0.3180 => 0.3663, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.61% (1.1861 => 1.3594, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.31% (0.3865 => 0.4418, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3379 => 0.3860, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.09% (0.8067 => 0.9204, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.4636 => 0.5286, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.37% (0.3387 => 0.3840, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.67% (0.4103 => 0.4623, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.64% (1.5603 => 1.7575, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.54% (0.4203 => 0.4730, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.20% (0.4048 => 0.4542) SingleSource/Benchmarks/Misc/oourafft: 12.10% (0.3282 => 0.3679, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.99% (0.1268 => 0.1420, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.98% (0.3422 => 0.3832, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.96% (0.3603 => 0.4034, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.62% (0.3684 => 0.4112, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: 11.58% (17.1811 => 19.1699, std.dev.: 0.0145) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.48% (0.2430 => 0.2709, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.13% (0.3826 => 0.4252, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.93% (0.4064 => 0.4508, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/parameter-passing: 10.75% (0.3927 => 0.4349, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.55% (14.3668 => 15.8819, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/property: 10.40% (0.3886 => 0.4290, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.39% (0.3427 => 0.3783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.32% (2.0665 => 2.2590, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.29% (0.3543 => 0.3872, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 9.24% (0.3473 => 0.3794, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.20% (0.3694 => 0.4034, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3516 => 0.3839, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.18% (0.3561 => 0.3888, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.14% (0.3543 => 0.3867, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.13% (0.2871 => 0.3133, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.11% (0.2877 => 0.3139, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.06% (0.3497 => 0.3814, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.88% (0.2905 => 0.3163, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.82% (0.3162 => 0.3441, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.80% (1.2842 => 1.3972, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (0.2756 => 0.2989, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 8.42% (0.3052 => 0.3309, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.23% (0.3935 => 0.4259, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.19% (63.2438 => 68.4241, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/fibo: 8.18% (0.2725 => 0.2948, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (2.2022 => 2.3780, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.78% (0.3136 => 0.3380, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.69% (0.6030 => 0.6494, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7326 => 0.7886, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.80% (0.4879 => 0.5211, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (10.3673 => 10.7999, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 3.83% (0.3131 => 0.3251, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.33% (7.9617 => 8.1473, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2477, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4260, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4412, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3139, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.63% (0.9957 => 1.0318, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0054) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.6802 => 8.9088, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (3.6395 => 3.7234, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2811, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2838, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4540, std.dev.: 0.0219) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1762, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.81% (5.3855 => 4.4804, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.41% (5.3526 => 4.4745, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -13.35% (10.4361 => 9.0433, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.08% (1.7609 => 1.6186, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -7.93% (54.1659 => 49.8720, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.87% (1.9577 => 0.6682, std.dev.: 0.0067) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3086, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.40% (1.5373 => 1.0238, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4317, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8524, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1248, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.01% (1.6925 => 1.4216, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4923, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2984, std.dev.: 0.0686) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.17% (1.2373 => 1.1609, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7050, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8369, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0079) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2358, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0023) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 17 23:37:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 01:37:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118073712.967322A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7712?compare_to=7708&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7712, Order: 172783, Start Time: 2013-01-18 05:33:39, End Time: 2013-01-18 07:37:22 To: 7708, Order: 172781, Start Time: 2013-01-18 03:13:56, End Time: 2013-01-18 05:14:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (7 on baseline) Performance Improvements: 2 (30 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1059 (1026 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.44% (1.4594 => 1.8599, std.dev.: 0.0100) MultiSource/Benchmarks/nbench/nbench: 7.52% (20.6232 => 22.1736, std.dev.: 0.5062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.87% (0.3289 => 0.3515, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.41% (6.4329 => 5.5060, std.dev.: 0.0553) MultiSource/Benchmarks/mafft/pairlocalalign: -1.64% (64.4025 => 63.3441, std.dev.: 0.2871) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.09% (1.1187 => 1.1177, std.dev.: 0.0359) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.04% (0.0223 => 0.0232, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.76% (0.0434 => 0.0446, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 37.30% (0.0252 => 0.0346, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 26.74% (0.0258 => 0.0327, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.15% (0.0433 => 0.0438, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: 22.81% (0.0171 => 0.0210, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: 67.91% (0.0134 => 0.0225, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.60% (0.1446 => 0.1498, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: -0.45% (1.1615 => 1.1563, std.dev.: 0.0520) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.71% (0.4207 => 0.4093, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.66% (0.1476 => 0.1530, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.97% (0.1039 => 0.0977, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.22% (0.0541 => 0.0553, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.15% (1.1445 => 1.1577, std.dev.: 0.0252) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 8.33% (0.0024 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.26% (0.0546 => 0.0602, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0314 => 0.0314, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7403 => 0.7424, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.67% (0.0122 => 0.0098, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.47% (12.7329 => 12.9206, std.dev.: 0.1195) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/printargs: 111.96% (0.0092 => 0.0195, std.dev.: 0.0034) SingleSource/UnitTests/SignlessTypes/factor: 58.63% (0.0336 => 0.0533, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322737.50% (0.0008 => 2.5827, std.dev.: 0.2101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.66% (1.1825 => 2.4319, std.dev.: 0.0318) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.76% (0.2562 => 0.2889, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 8.10% (20.5117 => 22.1736, std.dev.: 0.5062) MultiSource/Applications/JM/lencod/lencod: 2.50% (6.8159 => 6.9865, std.dev.: 0.0590) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.22% (0.0808 => 0.0483, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.40% (0.0727 => 0.0506, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -20.07% (1.8964 => 1.5158, std.dev.: 0.0396) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.60% (0.1684 => 0.1354, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.64% (0.0676 => 0.0550, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.64% (0.1009 => 0.0831, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.14% (0.7686 => 0.6522, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.34% (1.0986 => 0.9411, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.17% (6.4235 => 5.7057, std.dev.: 0.1818) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.98% (1.2154 => 1.0819, std.dev.: 0.0416) MultiSource/Applications/hexxagon/hexxagon: -10.77% (1.1433 => 1.0202, std.dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: -9.11% (17.5634 => 15.9641, std.dev.: 0.3834) MultiSource/Applications/lambda-0_1_3/lambda: -8.83% (0.8653 => 0.7889, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -7.53% (1.5131 => 1.3991, std.dev.: 0.0114) MultiSource/Applications/lemon/lemon: -6.25% (1.3979 => 1.3105, std.dev.: 0.0320) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.24% (0.2100 => 0.1969, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -5.98% (0.5134 => 0.4827, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.29% (0.3462 => 0.3279, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.04% (0.9993 => 0.9689, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.10% (7.9891 => 6.2234, std.dev.: 0.5296) SingleSource/Benchmarks/Shootout/hash: -10.07% (4.5259 => 4.0702, std.dev.: 0.1278) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.14% (1.4588 => 1.3255, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.87% (0.3201 => 0.3045, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -3.61% (4.4730 => 4.3117, std.dev.: 0.0620) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.41% (1.0995 => 1.0620, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/lists: -2.95% (17.2182 => 16.7107, std.dev.: 0.0594) MultiSource/Applications/spiff/spiff: -2.35% (2.8571 => 2.7901, std.dev.: 0.0124) MultiSource/Applications/hexxagon/hexxagon: -1.81% (14.0297 => 13.7752, std.dev.: 0.0864) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.14% (3.1921 => 3.1557, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.22% (1.2047 => 1.1177, std.dev.: 0.0359) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.43% (0.0233 => 0.0232, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.11% (0.0451 => 0.0446, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.18% (0.0394 => 0.0346, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.30% (0.0328 => 0.0327, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.57% (0.0445 => 0.0438, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0227 => 0.0225, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.09% (0.1530 => 0.1498, std.dev.: 0.0062) MultiSource/Applications/lemon/lemon: -40.07% (1.9293 => 1.1563, std.dev.: 0.0520) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.09% (0.4049 => 0.4093, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.32% (0.1510 => 0.1530, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.10% (0.0978 => 0.0977, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.27% (0.0590 => 0.0553, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.1617 => 1.1577, std.dev.: 0.0252) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.31% (0.0610 => 0.0602, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7437 => 0.7424, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.52% (0.0092 => 0.0098, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.12% (12.7781 => 12.9206, std.dev.: 0.1195) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 00:52:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 02:52:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118085245.A00D52A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/7713?compare_to=7710&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7713, Order: 172789, Start Time: 2013-01-18 07:14:57, End Time: 2013-01-18 08:52:51 To: 7710, Order: 172783, Start Time: 2013-01-18 05:17:52, End Time: 2013-01-18 06:51:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (88 on baseline) Performance Improvements: 0 (112 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (892 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.39% (0.0717 => 0.1193, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.11% (0.6395 => 0.8704, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.09% (0.6395 => 0.8575, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.40% (0.6260 => 0.8288, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.21% (0.5805 => 0.7617, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.03% (0.5688 => 0.7453, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.68% (0.5456 => 0.7130, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.47% (0.6230 => 0.8128, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.30% (0.5849 => 0.7621, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.10% (0.5941 => 0.7729, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.05% (0.5567 => 0.7240, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.88% (0.5575 => 0.7241, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.82% (0.5581 => 0.7245, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.58% (0.5802 => 0.7518, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.22% (0.5705 => 0.7372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.04% (0.6033 => 0.7785, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.39% (0.5857 => 0.7520, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.38% (0.5570 => 0.7151, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.34% (0.6440 => 0.8265, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.33% (0.5478 => 0.7030, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.14% (0.5569 => 0.7136, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.14% (0.5925 => 0.7592, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.96% (0.5591 => 0.7154, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.62% (0.6676 => 0.8520, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.10% (0.6189 => 0.7866, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.06% (1.6474 => 2.0932, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.97% (0.5863 => 0.7444, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.92% (0.6052 => 0.7681, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.84% (0.6446 => 0.8176, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.55% (0.6304 => 0.7978, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.76% (0.6681 => 0.8402, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.48% (0.6194 => 0.7772, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.08% (0.6660 => 0.8330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.92% (0.6297 => 0.7866, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.58% (0.6667 => 0.8239, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.49% (0.7524 => 0.9216, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.37% (0.7339 => 0.8907, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.04% (2.2587 => 2.7114, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.92% (0.1146 => 0.1317, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 14.71% (1.1450 => 1.3134, std.dev.: 0.0394) MultiSource/Applications/sgefa/sgefa: 14.42% (0.3357 => 0.3841, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.32% (0.1081 => 0.1225, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8247, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.41% (4.5069 => 5.0210, std.dev.: 0.1410) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4916 => 0.5467, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.31% (3.5339 => 3.8984, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.77% (0.2385 => 0.2618, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.7021 => 0.7552, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.20% (0.2001 => 0.2145, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (1.2784 => 1.3623, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 6.45% (0.4524 => 0.4816, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.21% (0.5329 => 0.5660, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (9.2283 => 9.7649, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 5.78% (0.4861 => 0.5142, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.78% (0.1731 => 0.1831, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 4.52% (0.3255 => 0.3402, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.64% (5.0226 => 5.1551, std.dev.: 0.0511) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.32% (5.4682 => 5.5953, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.31% (0.6750 => 0.6906, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6714, std.dev.: 0.0600) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5751 => 56.4379, std.dev.: 0.0698) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1060, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2777, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2085, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.23% (0.3194 => 0.2995, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.64% (0.3812 => 0.3597, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.49% (0.3880 => 0.3667, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -5.42% (0.3896 => 0.3685, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -5.36% (2.4924 => 2.3587, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.36% (0.7198 => 0.6812, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-3: -5.35% (0.3848 => 0.3642, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.15% (0.4176 => 0.3961, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.11% (0.3837 => 0.3641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.67% (0.4199 => 0.4003, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -4.55% (0.6347 => 0.6058, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.42% (0.3323 => 0.3176, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -4.39% (0.2871 => 0.2745, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.38% (0.3057 => 0.2923, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -4.38% (0.6441 => 0.6159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.37% (0.2903 => 0.2776, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -4.35% (0.4280 => 0.4094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.22% (0.3059 => 0.2930, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.19% (0.2933 => 0.2810, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.18% (0.3016 => 0.2890, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -4.04% (0.2849 => 0.2734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.84% (0.3252 => 0.3127, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.78% (2.1713 => 2.0892, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/methcall: -3.74% (0.3025 => 0.2912, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -3.68% (0.2989 => 0.2879, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -3.64% (0.7779 => 0.7496, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (0.3621 => 0.3507, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.09% (0.9542 => 0.9247, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (0.3849 => 0.3733, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -2.95% (0.3867 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.77% (14.2083 => 13.8144, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: -2.68% (0.4248 => 0.4134, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2249, std.dev.: 0.0231) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.56% (0.4813 => 0.4690, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.36% (6.7716 => 6.6116, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.01% (1.2221 => 1.1975, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.98% (1.2210 => 1.1968, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -1.75% (34.0927 => 33.4955, std.dev.: 0.0928) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.29% (1.8100 => 0.6825, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3129, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.85% (1.3643 => 1.0253, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0249, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.88% (5.3397 => 4.1714, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1331, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3388, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.00% (0.3626 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.8545 => 0.8163, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1782, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.62% (7.9763 => 7.7670, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6291, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1184, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.26% (1.3096 => 1.2800, std.dev.: 0.0087) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3040 => 7.1792, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.55% (1.6086 => 1.5836, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6061, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.06% (1.6219 => 1.6047, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 01:45:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 03:45:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118094551.2CA082A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7714?compare_to=7711&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7714, Order: 172793, Start Time: 2013-01-18 07:30:52, End Time: 2013-01-18 09:45:57 To: 7711, Order: 172782, Start Time: 2013-01-18 04:49:21, End Time: 2013-01-18 07:00:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (210 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (664 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (10.7999 => 10.6770, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1332 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8481 => 499.7883, std.dev.: 0.0303) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44219.26% (1.1277 => 499.7883, std.dev.: 0.0303) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.62% (0.5229 => 1.6399, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 19.49% (14.9895 => 17.9117, std.dev.: 0.0447) MultiSource/Applications/kimwitu++/kc: 42.68% (14.1553 => 20.1972, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 17.34% (4.1105 => 4.8234, std.dev.: 0.1640) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.30% (1.1048 => 1.7268, std.dev.: 0.0439) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.48% (7.1582 => 37.3283, std.dev.: 0.0180) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.53% (3.4629 => 6.3554, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.85% (0.6222 => 1.0817, std.dev.: 0.0023) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.67% (0.0720 => 7.4460, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11170700.00% (0.0001 => 11.1708, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.58% (1.1194 => 10.3385, std.dev.: 0.2557) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 150.33% (22.1758 => 55.5121, std.dev.: 0.0534) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0034) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.58% (2.9384 => 4.6010, std.dev.: 0.1148) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.39% (7.0540 => 10.8204, std.dev.: 0.1994) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.39% (1.5859 => 2.3850, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.51% (8.1363 => 11.9202, std.dev.: 0.1986) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.71% (2.2024 => 3.0989, std.dev.: 0.0195) MultiSource/Applications/sgefa/sgefa: 39.11% (0.3109 => 0.4325, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.13% (21.9371 => 30.3027, std.dev.: 0.0201) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.44% (4.2646 => 5.6908, std.dev.: 0.1208) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.98% (0.4615 => 0.6137, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.59% (1.5415 => 2.0438, std.dev.: 0.0486) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 32.06% (0.2271 => 0.2999, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.71% (0.1892 => 0.2473, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/05-eks/eks: 29.05% (0.4299 => 0.5548, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.12% (0.6675 => 0.8552, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 28.11% (1.1642 => 1.4914, std.dev.: 0.0140) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.56% (0.5105 => 0.6461, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.24% (0.3121 => 0.3940, std.dev.: 0.0106) SingleSource/Benchmarks/McGill/chomp: 26.10% (0.1655 => 0.2087, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.78% (0.1125 => 0.1415, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.68% (0.0479 => 0.0602, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.53% (3.8922 => 4.8857, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/08-main/main: 25.37% (0.2554 => 0.3202, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 24.55% (1.0722 => 1.3354, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0095) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.88% (0.1143 => 0.1416, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.69% (0.1566 => 0.1937, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 23.36% (0.4289 => 0.5291, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.27% (1.4186 => 1.7487, std.dev.: 0.0506) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.81% (0.1337 => 0.1642, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash2: 22.77% (0.4620 => 0.5672, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.38% (9.4845 => 11.6070, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.95% (0.1695 => 0.2067, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 21.53% (0.7115 => 0.8647, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.94% (0.1151 => 0.1392, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.81% (0.2700 => 0.3262, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 20.79% (0.7835 => 0.9464, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 20.79% (0.3098 => 0.3742, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.35% (1.3050 => 1.5706, std.dev.: 0.0326) MultiSource/Applications/oggenc/oggenc: 20.26% (5.7591 => 6.9258, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.15% (0.1236 => 0.1485, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 20.11% (0.0567 => 0.0681, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.5860 => 0.7031, std.dev.: 0.0213) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.85% (0.0675 => 0.0809, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.69% (0.8172 => 0.9781, std.dev.: 0.0493) SingleSource/Benchmarks/Misc-C++/bigfib: 19.64% (0.6456 => 0.7724, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.57% (0.1032 => 0.1234, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.54% (0.2758 => 0.3297, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 19.47% (0.1695 => 0.2025, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.27% (4.9449 => 5.8980, std.dev.: 0.1515) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.42% (5.0018 => 5.9231, std.dev.: 0.1393) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.28% (0.0886 => 0.1048, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.17% (3.3354 => 3.9413, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.95% (0.5020 => 0.5921, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.63% (0.3307 => 0.3890, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 17.51% (0.1268 => 0.1490, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.45% (0.9765 => 1.1469, std.dev.: 0.0323) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.37% (0.2107 => 0.2473, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.20% (0.5569 => 0.6527, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.09% (0.1510 => 0.1768, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.07% (1.1840 => 1.3861, std.dev.: 0.0308) MultiSource/Applications/lambda-0_1_3/lambda: 17.02% (0.7433 => 0.8698, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.83% (0.3423 => 0.3999, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 16.79% (2.0273 => 2.3676, std.dev.: 0.0076) MultiSource/Applications/lua/lua: 16.70% (3.8723 => 4.5190, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.57% (0.5981 => 0.6972, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.45% (0.3441 => 0.4007, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 15.96% (0.3283 => 0.3807, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.81% (0.8101 => 0.9382, std.dev.: 0.0286) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.69% (0.6450 => 0.7462, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary: 15.66% (0.3232 => 0.3738, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 15.59% (2.2969 => 2.6549, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.28% (0.0759 => 0.0875, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.23% (0.1044 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.98% (0.8921 => 1.0257, std.dev.: 0.0241) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.75% (0.3180 => 0.3649, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.24% (1.1861 => 1.3550, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.88% (0.8067 => 0.9187, std.dev.: 0.0310) SingleSource/Benchmarks/Shootout-C++/ary2: 13.79% (0.3379 => 0.3845, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.71% (0.2603 => 0.2960, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 13.20% (0.3387 => 0.3834, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.01% (0.3865 => 0.4368, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.96% (0.4636 => 0.5237, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.38% (1.5603 => 1.7535, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.02% (0.4103 => 0.4596, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.82% (0.4203 => 0.4700, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.4048 => 0.4520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 11.57% (0.3603 => 0.4020, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.49% (0.3282 => 0.3659, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.17% (17.1811 => 19.1008, std.dev.: 0.0269) SingleSource/Benchmarks/Stanford/Puzzle: 11.12% (0.1268 => 0.1409, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 11.02% (0.3684 => 0.4090, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.70% (0.4064 => 0.4499, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.51% (0.3826 => 0.4228, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.39% (0.3427 => 0.3783, std.dev.: 0.0120) SingleSource/UnitTests/ObjC/property: 10.29% (0.3886 => 0.4286, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.98% (14.3668 => 15.8009, std.dev.: 0.3841) SingleSource/UnitTests/ObjC/exceptions: 9.72% (0.3828 => 0.4200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.43% (0.3543 => 0.3877, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 9.29% (0.3694 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-4: 9.20% (0.3543 => 0.3869, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.18% (0.3497 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.91% (2.0665 => 2.2507, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/except: 8.85% (0.2871 => 0.3125, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 8.59% (0.2877 => 0.3124, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 8.49% (1.2842 => 1.3932, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.44% (0.3650 => 0.3958, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.37% (0.2891 => 0.3133, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.29% (0.2872 => 0.3110, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.16% (0.3935 => 0.4256, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.15% (63.2438 => 68.4006, std.dev.: 0.0819) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.3052 => 0.3298, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.06% (0.2756 => 0.2978, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 7.99% (0.2802 => 0.3026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.96% (0.6030 => 0.6510, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 7.88% (0.7326 => 0.7903, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 7.82% (0.2725 => 0.2938, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.43% (0.3136 => 0.3369, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.38% (2.2022 => 2.3648, std.dev.: 0.0346) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/objinst: 3.42% (0.3131 => 0.3238, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 2.99% (10.3673 => 10.6770, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2461, std.dev.: 0.0293) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6979, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.44% (4.2280 => 4.4578, std.dev.: 0.0152) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3135, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.20% (0.9957 => 1.0375, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9122, std.dev.: 0.0881) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.44% (3.6395 => 3.7283, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.30% (0.6533 => 0.6683, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2831, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2807, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.19% (6.5088 => 6.5861, std.dev.: 0.0162) MultiSource/Applications/lemon/lemon: 1.11% (1.4460 => 1.4620, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4500, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.43% (6.6874 => 0.1716, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.76% (5.2763 => 1.1736, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.64% (5.3526 => 4.4621, std.dev.: 0.0679) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.63% (5.3855 => 4.4897, std.dev.: 0.0601) MultiSource/Applications/JM/ldecod/ldecod: -13.75% (10.4361 => 9.0009, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.97% (1.7609 => 1.6206, std.dev.: 0.0223) SingleSource/UnitTests/Vector/constpool: -7.94% (54.1659 => 49.8640, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.64% (1.9577 => 0.6726, std.dev.: 0.0087) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3061, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7637, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4326, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8639, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3242, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -18.79% (0.2161 => 0.1755, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7312, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4943, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2941, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.01% (1.6805 => 1.5795, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2373 => 1.1645, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7037, std.dev.: 0.0072) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.01% (0.4808 => 0.4567, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.49% (10.2830 => 9.8215, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: -1.32% (3.6994 => 3.6504, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2241, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.17% (0.1485 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0077) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 01:57:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 03:57:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118095751.DC5C72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7715?compare_to=7712&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7715, Order: 172795, Start Time: 2013-01-18 07:57:11, End Time: 2013-01-18 09:58:00 To: 7712, Order: 172783, Start Time: 2013-01-18 05:33:39, End Time: 2013-01-18 07:37:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (7 on baseline) Performance Improvements: 14 (66 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1047 (990 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 11.41% (1.9723 => 2.1973, std.dev.: 0.0069) MultiSource/Applications/siod/siod: 1.48% (3.5598 => 3.6126, std.dev.: 0.0106) MultiSource/Benchmarks/mafft/pairlocalalign: 1.32% (63.3441 => 64.1827, std.dev.: 0.3208) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -19.70% (10.7805 => 8.6571, std.dev.: 0.1903) SingleSource/UnitTests/2006-12-11-LoadConstants: -14.51% (0.1358 => 0.1161, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -12.02% (0.0882 => 0.0776, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: -2.54% (9.6770 => 9.4308, std.dev.: 0.0510) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.50% (0.5124 => 0.4996, std.dev.: 0.0008) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.38% (0.4667 => 0.4556, std.dev.: 0.0038) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.65% (44.9840 => 44.2408, std.dev.: 0.1363) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -15.70% (1.7261 => 1.4551, std.dev.: 0.0873) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.87% (2.4492 => 2.3055, std.dev.: 0.0441) MultiSource/Benchmarks/7zip/7zip-benchmark: -4.96% (9.7106 => 9.2292, std.dev.: 0.1841) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.13% (4.2177 => 4.0856, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/hash: -1.96% (0.6238 => 0.6116, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.67% (2.4451 => 2.4042, std.dev.: 0.0145) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.1785 => 7.0593, std.dev.: 0.0342) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.73% (1.1177 => 1.1095, std.dev.: 0.1621) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.45% (0.0232 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.57% (0.0446 => 0.0439) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.31% (0.0346 => 0.0338, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.53% (0.0327 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.68% (0.0438 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.95% (0.0210 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -10.67% (0.0225 => 0.0201, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.17% (0.0230 => 0.0225, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.47% (0.1498 => 0.1446, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -1.10% (1.1563 => 1.1436, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.20% (0.4093 => 0.3921, std.dev.: 0.0628) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.39% (0.1530 => 0.1536, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.10% (0.0977 => 0.0976, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0274 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.17% (0.0553 => 0.0541, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.1577 => 1.1531, std.dev.: 0.1210) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.16% (0.0602 => 0.0615, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0314 => 0.0314, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (0.7424 => 0.7408, std.dev.: 0.0007) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0098 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.25% (12.9206 => 12.7587, std.dev.: 0.0250) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.45% (0.2879 => 0.3007, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320337.50% (0.0008 => 2.5635, std.dev.: 0.0132) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.59% (1.1825 => 2.3601, std.dev.: 0.1226) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.61% (0.2562 => 0.2885, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 2.73% (2.1390 => 2.1973, std.dev.: 0.0069) MultiSource/Benchmarks/mafft/pairlocalalign: 1.63% (63.1520 => 64.1827, std.dev.: 0.3208) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: -25.79% (0.1888 => 0.1401, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -23.08% (0.0676 => 0.0520, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.80% (0.1684 => 0.1300, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -19.12% (1.8964 => 1.5338, std.dev.: 0.0803) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.10% (0.0862 => 0.0706, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.89% (0.7686 => 0.6465, std.dev.: 0.0395) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.68% (0.4074 => 0.3476, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.29% (1.0986 => 0.9526, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.51% (0.0847 => 0.0741, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -12.44% (9.8875 => 8.6571, std.dev.: 0.1903) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.24% (6.4235 => 5.7015, std.dev.: 0.0530) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -10.86% (0.1317 => 0.1174, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: -10.60% (1.5979 => 1.4286, std.dev.: 0.0485) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.63% (1.6874 => 1.5249, std.dev.: 0.0539) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.73% (1.1498 => 1.0494, std.dev.: 0.0331) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.69% (0.9124 => 0.8331, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.61% (1.3924 => 1.2725, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.47% (0.6885 => 0.6302, std.dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: -8.42% (0.3598 => 0.3295, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.28% (0.3560 => 0.3301, std.dev.: 0.0073) MultiSource/Applications/lambda-0_1_3/lambda: -7.19% (0.8653 => 0.8031, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.00% (0.2100 => 0.1974, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.92% (1.8127 => 1.7053, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.73% (0.7693 => 0.7252, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: -5.29% (0.2172 => 0.2057, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: -5.12% (0.5134 => 0.4871, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/moments: -5.00% (0.4002 => 0.3802, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.94% (3.6295 => 3.4503, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.81% (0.6135 => 0.5840, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.97% (0.3981 => 0.3823, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.87% (0.3462 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.86% (0.9422 => 0.9058, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.59% (0.8990 => 0.8667, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: -3.55% (0.6711 => 0.6473, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: -3.33% (0.4689 => 0.4533, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.27% (0.9512 => 0.9201, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.11% (0.3665 => 0.3551, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.04% (0.9091 => 0.8815, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.02% (0.9214 => 0.8936, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.96% (0.9993 => 0.9697, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.12% (2.4519 => 2.3999, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -29.58% (4.4739 => 3.1503, std.dev.: 0.2570) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.06% (4.2042 => 3.1505, std.dev.: 0.3078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.78% (5.0421 => 4.5488, std.dev.: 0.1753) SingleSource/Benchmarks/Shootout/hash: -9.14% (4.5259 => 4.1122, std.dev.: 0.0604) SingleSource/Benchmarks/Shootout/nestedloop: -9.05% (0.2200 => 0.2001, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: -8.96% (0.6628 => 0.6034, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.27% (4.4540 => 4.0856, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.39% (23.3986 => 21.9036, std.dev.: 0.0894) SingleSource/Benchmarks/Shootout/ary3: -4.55% (2.2304 => 2.1289, std.dev.: 0.0162) SingleSource/Benchmarks/McGill/chomp: -3.44% (1.0425 => 1.0066, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -3.27% (17.2182 => 16.6546, std.dev.: 0.0915) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.00% (0.5826 => 0.5651, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.55% (42.3194 => 41.2400, std.dev.: 0.0814) MultiSource/Applications/spiff/spiff: -2.38% (2.8571 => 2.7890, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.36% (3.0082 => 2.9372, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.0995 => 1.0743, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/hash: -2.21% (0.6254 => 0.6116, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.09% (4.0355 => 3.9513, std.dev.: 0.0314) MultiSource/Benchmarks/Bullet/bullet: -2.01% (7.2040 => 7.0593, std.dev.: 0.0342) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.86% (2.4498 => 2.4042, std.dev.: 0.0145) MultiSource/Applications/hexxagon/hexxagon: -1.82% (14.0297 => 13.7737, std.dev.: 0.0435) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3154, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.17% (3.1921 => 3.1548, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -1.07% (1.0604 => 1.0491, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.90% (1.2047 => 1.1095, std.dev.: 0.1621) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.66% (0.0451 => 0.0439) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -11.45% (0.0227 => 0.0201, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.76% (0.0255 => 0.0225, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.49% (0.1530 => 0.1446, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -40.72% (1.9293 => 1.1436, std.dev.: 0.0263) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.16% (0.4049 => 0.3921, std.dev.: 0.0628) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.72% (0.1510 => 0.1536, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1617 => 1.1531, std.dev.: 0.1210) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7437 => 0.7408, std.dev.: 0.0007) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.52% (0.0092 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7781 => 12.7587, std.dev.: 0.0250) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 02:50:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 04:50:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118105023.CFF082A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7716?compare_to=7713&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7716, Order: 172798, Start Time: 2013-01-18 09:16:36, End Time: 2013-01-18 10:50:32 To: 7713, Order: 172789, Start Time: 2013-01-18 07:14:57, End Time: 2013-01-18 08:52:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (121 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (875 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.14% (79.9040 => 80.8189, std.dev.: 0.2829) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.39% (0.0717 => 0.1193, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.06% (0.6395 => 0.8701, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.35% (0.6395 => 0.8592, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.49% (0.6260 => 0.8294, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.18% (0.5805 => 0.7615, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.15% (0.5688 => 0.7460, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.87% (0.5456 => 0.7140, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.55% (0.6230 => 0.8133, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.28% (0.5849 => 0.7620, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.23% (0.5567 => 0.7250, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.19% (0.5581 => 0.7266, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.08% (0.5575 => 0.7252, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.08% (0.5941 => 0.7728, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.61% (0.5802 => 0.7520, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.36% (0.5705 => 0.7380, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.11% (0.6033 => 0.7789, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.56% (0.6440 => 0.8279, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.55% (0.5570 => 0.7160, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.44% (0.5478 => 0.7036, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.41% (0.5857 => 0.7521, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.21% (0.5591 => 0.7168, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.14% (0.5569 => 0.7136, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.14% (0.5925 => 0.7592, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.49% (0.6676 => 0.8511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.23% (0.6189 => 0.7874, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.22% (1.6474 => 2.0959, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.13% (0.6052 => 0.7694, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.97% (0.5863 => 0.7444, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.88% (0.6446 => 0.8179, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.60% (0.6304 => 0.7981, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.57% (0.6194 => 0.7778, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.46% (0.6681 => 0.8382, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.17% (0.6297 => 0.7882, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.00% (0.6660 => 0.8325, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.67% (0.6667 => 0.8245, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.42% (0.7524 => 0.9211, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.34% (0.7339 => 0.8905, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.11% (2.2587 => 2.7130, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 14.55% (1.1450 => 1.3116, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3357 => 0.3832, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.60% (0.1982 => 0.2212, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.43% (4.5069 => 5.0221, std.dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.21% (0.4916 => 0.5467, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.74% (1.6364 => 1.8121, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 10.65% (0.4515 => 0.4996, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.38% (3.5339 => 3.9006, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.55% (0.7021 => 0.7551, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 6.92% (1.2515 => 1.3381, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 6.27% (0.4861 => 0.5166, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.27% (0.5329 => 0.5663, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.03% (1.2784 => 1.3555, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.94% (1.4642 => 1.5512, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 5.93% (9.2283 => 9.7754, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.89% (0.1731 => 0.1833, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 5.16% (0.3255 => 0.3423, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3319 => 0.3451, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 2.74% (0.6750 => 0.6935, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.54% (5.4682 => 5.6072, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 2.46% (5.0226 => 5.1460, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 2.18% (1.3864 => 1.4166, std.dev.: 0.0116) MultiSource/Applications/spiff/spiff: 1.35% (0.8418 => 0.8532, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6752, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9531 => 1.0293, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1498, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4184, std.dev.: 0.0278) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1074, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.58% (5.1955 => 5.2777, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6025, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2073, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (79.7170 => 80.8189, std.dev.: 0.2829) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.31% (0.1584 => 0.1484, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.7198 => 0.6800, std.dev.: 0.0055) MultiSource/Benchmarks/PAQ8p/paq8p: -5.41% (2.4924 => 2.3576, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.01% (0.3812 => 0.3621, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.96% (0.3831 => 0.3641, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.89% (0.3884 => 0.3694, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.87% (0.3880 => 0.3691, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.79% (0.4033 => 0.3840, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.65% (0.4176 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (0.9852 => 0.9402, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.51% (0.3837 => 0.3664, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/Hello: -4.05% (0.6347 => 0.6090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.05% (0.4199 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.93% (0.4280 => 0.4112, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.65% (0.2903 => 0.2797, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -3.44% (0.2939 => 0.2838, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -3.34% (1.3148 => 1.2709, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.22% (0.6484 => 0.6275, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.16% (2.1713 => 2.1026, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.15% (0.9542 => 0.9241, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.96% (0.4151 => 0.4028, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.82% (14.2083 => 13.8072, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.69% (0.7919 => 0.7706, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2300, std.dev.: 0.0315) MultiSource/Applications/JM/lencod/lencod: -2.46% (16.1920 => 15.7940, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.44% (0.4427 => 0.4319, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: -2.44% (17.1032 => 16.6860, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: -2.32% (4.3330 => 4.2325, std.dev.: 0.0084) MultiSource/Applications/lambda-0_1_3/lambda: -2.27% (0.7982 => 0.7801, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.26% (6.7716 => 6.6184, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.23% (1.0544 => 1.0309, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.2210 => 1.1943, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.18% (1.2221 => 1.1954, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.99% (1.2300 => 1.2055, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.95% (7.0961 => 6.9575, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/football/football: -1.85% (0.9179 => 0.9009, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.76% (34.0927 => 33.4925, std.dev.: 0.0235) MultiSource/Applications/siod/siod: -1.71% (2.4021 => 2.3611, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.67% (1.5610 => 1.5350, std.dev.: 0.0045) MultiSource/Applications/lua/lua: -1.39% (4.0594 => 4.0028, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.27% (8.0126 => 7.9110, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.40% (1.8100 => 0.6805, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3097, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0224, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1315, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.64% (4.9100 => 4.3384, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.29% (5.5807 => 5.3972, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (7.9763 => 7.7840, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6426, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1959, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.27% (3.7092 => 3.6622, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6023, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.19% (1.6307 => 1.6113, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0051) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 02:51:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 04:51:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130118105136.DED562A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7717?compare_to=7709&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7717, Order: 172789, Start Time: 2013-01-18 07:04:15, End Time: 2013-01-18 10:51:45 To: 7709, Order: 172779, Start Time: 2013-01-18 02:38:14, End Time: 2013-01-18 06:12:52 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.76% (0.0625 => 0.0936, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.23% (0.1063 => 0.1480, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.60% (0.2969 => 0.3818, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.03% (0.1106 => 0.1416, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.78% (0.4139 => 0.5289, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.98% (0.5900 => 0.7492, std.dev.: 0.0191) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.74% (0.1107 => 0.1403, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.74% (0.0475 => 0.0602, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.36% (0.4253 => 0.5374, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.93% (0.1620 => 0.2040, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.60% (0.5000 => 0.6280, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.55% (0.4994 => 0.6270, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 25.23% (1.5932 => 1.9951, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1021 => 0.1268, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.97% (0.0897 => 0.1112, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.56% (0.1549 => 0.1914, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 23.10% (0.1619 => 0.1993, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.42% (0.3903 => 0.4778, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.39% (0.1103 => 0.1350, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.38% (0.1604 => 0.1963, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.30% (0.2736 => 0.3346, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 22.19% (0.0604 => 0.0738, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.00% (0.0541 => 0.0660, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 21.97% (0.4029 => 0.4914, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/08-main/main: 21.92% (0.1218 => 0.1485, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.78% (0.0822 => 0.1001, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.48% (0.1462 => 0.1776, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 20.80% (0.0947 => 0.1144, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.59% (0.3890 => 0.4691, std.dev.: 0.0108) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.45% (0.0582 => 0.0701, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.16% (0.2014 => 0.2420, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.04% (0.1088 => 0.1306, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.99% (0.2866 => 0.3439, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.63% (0.3271 => 0.3913, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.28% (1.3152 => 1.5688, std.dev.: 0.0258) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 19.22% (0.5546 => 0.6612, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.06% (0.2875 => 0.3423, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 19.04% (1.8794 => 2.2373, std.dev.: 0.0295) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.40% (0.4658 => 0.5515, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 18.38% (0.9697 => 1.1479, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.23% (0.5026 => 0.5942, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.21% (3.5627 => 4.2113, std.dev.: 0.0669) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.11% (0.5826 => 0.6881, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hello: 18.09% (0.2714 => 0.3205, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.95% (1.6211 => 1.9121, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/strcat: 17.85% (0.2750 => 0.3241, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 17.76% (0.1284 => 0.1512, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.71% (0.3930 => 0.4626, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.68% (0.2738 => 0.3222, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 17.50% (0.2725 => 0.3202, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.45% (0.1421 => 0.1669, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.43% (0.3258 => 0.3826, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 17.37% (0.2803 => 0.3290, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 17.37% (0.5889 => 0.6912, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/except: 17.36% (0.2811 => 0.3299, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 17.30% (0.3317 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.30% (0.2792 => 0.3275, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 17.29% (0.2823 => 0.3311, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.26% (0.2729 => 0.3200, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: 17.21% (0.2813 => 0.3297, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 17.14% (0.7171 => 0.8400, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.03% (2.0673 => 2.4193, std.dev.: 0.0423) MultiSource/Applications/hexxagon/hexxagon: 16.91% (0.9909 => 1.1585, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.88% (0.4361 => 0.5097, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wc: 16.83% (0.3096 => 0.3617, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 16.80% (4.2109 => 4.9184, std.dev.: 0.0787) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.80% (0.3060 => 0.3574, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.79% (1.9694 => 2.3001, std.dev.: 0.0473) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.74% (0.3195 => 0.3730, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 16.71% (1.0781 => 1.2583, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 16.68% (0.3267 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.61% (1.9966 => 2.3282, std.dev.: 0.0378) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.46% (2.7292 => 3.1784, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/lists: 16.31% (0.3348 => 0.3894, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.28% (0.3625 => 0.4215, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 16.18% (0.4146 => 0.4817, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.10% (0.3124 => 0.3627, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 15.97% (23.5202 => 27.2762, std.dev.: 0.4153) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.97% (4.4195 => 5.1252, std.dev.: 0.0387) MultiSource/Applications/JM/ldecod/ldecod: 15.96% (2.1653 => 2.5108, std.dev.: 0.0163) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.3845 => 0.4458, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sieve: 15.92% (0.3726 => 0.4319, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.85% (0.3362 => 0.3895, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.78% (0.1090 => 0.1262, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 15.69% (1.4269 => 1.6508, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 15.55% (0.4251 => 0.4912, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 15.50% (0.3477 => 0.4016, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 15.50% (0.3678 => 0.4248, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 15.44% (0.7875 => 0.9091, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 15.43% (0.2566 => 0.2962, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.23% (0.3690 => 0.4252, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.10% (0.3981 => 0.4582, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.65% (0.3488 => 0.3999, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 14.56% (0.3496 => 0.4005, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 14.51% (0.5012 => 0.5739, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-4: 14.23% (0.3465 => 0.3958, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: 14.10% (0.3446 => 0.3932, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: 14.00% (0.3442 => 0.3924, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/synchronized: 13.98% (0.3469 => 0.3954, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 13.84% (0.3460 => 0.3939, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 13.71% (5.5417 => 6.3014, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/property: 13.67% (0.3650 => 0.4149, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.62% (0.1028 => 0.1168, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 13.60% (0.2691 => 0.3057, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 13.59% (4.6177 => 5.2452, std.dev.: 0.0501) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.58% (0.6435 => 0.7309, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3724 => 0.4225, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.39% (0.2068 => 0.2345, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.30% (0.2075 => 0.2351, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.01% (0.2737 => 0.3093, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 12.90% (2.1013 => 2.3723, std.dev.: 0.0566) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.32% (0.3084 => 0.3464, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.29% (0.3498 => 0.3928, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.13% (0.2103 => 0.2358, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 11.74% (0.6634 => 0.7413, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.62% (0.5361 => 0.5984, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.48% (0.3336 => 0.3719, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: 11.37% (0.4847 => 0.5398, std.dev.: 0.0146) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.95% (11.6398 => 12.9139, std.dev.: 0.1210) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.58% (0.7426 => 0.8212, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.30% (4.6926 => 5.1761, std.dev.: 0.0088) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.76% (0.5584 => 0.6129, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 9.38% (2.0346 => 2.2254, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 7.42% (11.9555 => 12.8428, std.dev.: 0.0314) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.22% (0.3792 => 0.3990, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5275, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0084) MultiSource/Applications/ClamAV/clamscan: 10.46% (0.2802 => 0.3095, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.88% (0.3693 => 0.4021, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6812, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2441, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8925, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6844, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1927, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3084, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.46% (2.0820 => 2.1125, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2901, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1063, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.21% (1.0142 => 1.0265, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0802, std.dev.: 0.0127) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2084, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5899, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4768, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5819, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.31% (17.2379 => 14.2546, std.dev.: 0.1744) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary2: -8.87% (0.2402 => 0.2189, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7992, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0041) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2282, std.dev.: 0.2026) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8073, std.dev.: 0.0570) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7747, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.26% (0.6293 => 0.6151, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1655, std.dev.: 0.0425) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.06% (105.3826 => 104.2655, std.dev.: 0.0343) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0490, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 04:16:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 06:16:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118121628.4EDA22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7718?compare_to=7715&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7718, Order: 172799, Start Time: 2013-01-18 10:15:08, End Time: 2013-01-18 12:16:38 To: 7715, Order: 172795, Start Time: 2013-01-18 07:57:11, End Time: 2013-01-18 09:58:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 13 (10 on baseline) Performance Improvements: 2 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1049 (1004 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.91% (1.4598 => 1.8673, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.83% (42.9225 => 47.5723, std.dev.: 1.0658) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.22% (0.3285 => 0.3588, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.32% (2.9372 => 3.1816, std.dev.: 0.0538) SingleSource/Benchmarks/Shootout-C++/hash: 4.28% (0.6116 => 0.6378, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.09% (3.7018 => 3.8531, std.dev.: 0.0494) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.80% (4.2529 => 4.4143, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 3.20% (28.3743 => 29.2823, std.dev.: 0.1634) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.14% (59.2281 => 61.0899, std.dev.: 0.5320) MultiSource/Applications/sqlite3/sqlite3: 2.94% (4.3061 => 4.4326, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.79% (4.8745 => 5.0106, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.52% (8.5146 => 8.7294, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.20% (5.2828 => 5.3992, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.99% (0.9425 => 0.9237, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.99% (1.4996 => 1.4698, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.51% (1.1095 => 1.1817, std.dev.: 0.0244) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0224 => 0.0224) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.68% (0.0439 => 0.0436) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0338 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0322 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0435 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 10.95% (0.0201 => 0.0223, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.67% (0.0225 => 0.0231, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.69% (0.1446 => 0.1436, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 8.27% (1.1436 => 1.2382, std.dev.: 0.2197) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.73% (0.3921 => 0.4028, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.45% (0.1536 => 0.1483, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.0976 => 0.1002, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.43% (0.0276 => 0.0192, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 14.05% (0.0541 => 0.0617, std.dev.: 0.0121) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.21% (1.1531 => 1.1507, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.79% (0.0615 => 0.0604, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0314 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.43% (0.7408 => 0.7440, std.dev.: 0.0317) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.55% (0.0098 => 0.0071, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7587 => 12.7708, std.dev.: 0.4940) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.11% (0.0336 => 0.0501, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320725.00% (0.0008 => 2.5666, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.20% (1.1825 => 2.3437, std.dev.: 0.0566) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.53% (0.2562 => 0.2883, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.28% (2.2499 => 2.3911, std.dev.: 0.0545) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.76% (3.0082 => 3.1816, std.dev.: 0.0538) MultiSource/Applications/JM/lencod/lencod: 3.42% (6.8159 => 7.0487, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/pi: 3.07% (2.1390 => 2.2046, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.03% (4.2843 => 4.4143, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (63.1520 => 64.1164, std.dev.: 0.2488) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -29.77% (0.0692 => 0.0486, std.dev.: 0.0047) MultiSource/Applications/hbd/hbd: -17.23% (1.8964 => 1.5696, std.dev.: 0.0564) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.01% (0.0676 => 0.0561, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.82% (0.0862 => 0.0717, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.29% (0.1079 => 0.0914, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.13% (1.0986 => 0.9434, std.dev.: 0.0219) SingleSource/UnitTests/Vector/constpool: -11.49% (9.8875 => 8.7518, std.dev.: 0.0966) MultiSource/Applications/lua/lua: -9.48% (4.6406 => 4.2009, std.dev.: 0.1589) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.25% (10.2703 => 9.3204, std.dev.: 0.3267) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.56% (1.6874 => 1.5430, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.22% (1.3924 => 1.2779, std.dev.: 0.0339) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.62% (0.2100 => 0.1940, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2006 => 0.1897, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: -5.07% (0.4002 => 0.3799, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.05% (0.6135 => 0.5825, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.47% (0.3665 => 0.3501, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.17% (0.9507 => 0.9111, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.02% (0.9422 => 0.9043, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.93% (0.9512 => 0.9138, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.74% (0.8990 => 0.8654, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.49% (1.0052 => 0.9701, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.47% (0.9403 => 0.9077, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.20% (0.9091 => 0.8800, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.65% (0.9488 => 0.9237, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.17% (1.0119 => 0.9899, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.06% (0.9855 => 0.9652, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.78% (1.0088 => 0.9908, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.32% (0.9061 => 0.8941, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.14% (0.8846 => 0.8745, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.19% (0.9372 => 0.6543, std.dev.: 0.0987) SingleSource/Benchmarks/Shootout/heapsort: -29.94% (4.4739 => 3.1342, std.dev.: 0.3892) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.37% (1.5623 => 1.2909, std.dev.: 0.0570) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.80% (1.4235 => 1.2698, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.76% (0.4081 => 0.3642, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: -10.36% (4.5259 => 4.0572, std.dev.: 0.0389) SingleSource/Benchmarks/Shootout/nestedloop: -10.00% (0.2200 => 0.1980, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.87% (1.4588 => 1.3294, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout/ary3: -6.33% (2.2304 => 2.0892, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.22% (0.3201 => 0.3034, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.87% (0.3349 => 0.3186, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.78% (23.3986 => 22.2803, std.dev.: 0.3434) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.33% (1.4446 => 1.3965, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: -3.25% (17.2182 => 16.6588, std.dev.: 0.0776) MultiSource/Benchmarks/Bullet/bullet: -2.26% (7.2040 => 7.0409, std.dev.: 0.0389) SingleSource/Benchmarks/Misc/mandel-2: -2.19% (0.8521 => 0.8334, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.96% (0.5826 => 0.5712, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: -1.81% (2.8571 => 2.8053, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.49% (3.1921 => 3.1444, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -1.11% (1.5825 => 1.5650, std.dev.: 0.0041) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.91% (1.2047 => 1.1817, std.dev.: 0.0244) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.14% (0.1530 => 0.1436, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: -35.82% (1.9293 => 1.2382, std.dev.: 0.2197) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4049 => 0.4028, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.79% (0.1510 => 0.1483, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.45% (0.0978 => 0.1002, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.43% (0.0276 => 0.0192, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.58% (0.0590 => 0.0617, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.95% (1.1617 => 1.1507, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7437 => 0.7440, std.dev.: 0.0317) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.83% (0.0092 => 0.0071, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7781 => 12.7708, std.dev.: 0.4940) Report Time: 0.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 04:27:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 06:27:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118122741.E4BE02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7719?compare_to=7714&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7719, Order: 172799, Start Time: 2013-01-18 10:16:32, End Time: 2013-01-18 12:27:50 To: 7714, Order: 172793, Start Time: 2013-01-18 07:30:52, End Time: 2013-01-18 09:45:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.18% (1.0375 => 1.0253, std.dev.: 0.0021) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1334 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7883 => 499.8482, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.57% (1.1277 => 499.8482, std.dev.: 0.0038) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.96% (0.5229 => 1.6417, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 19.63% (14.9895 => 17.9316, std.dev.: 0.0042) MultiSource/Applications/kimwitu++/kc: 42.86% (14.1553 => 20.2219, std.dev.: 0.0296) MultiSource/Benchmarks/MallocBench/gs/gs: 17.45% (4.1105 => 4.8276, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.37% (1.1048 => 1.7276, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.03% (7.1582 => 37.3680, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.95% (3.4629 => 6.3700, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.92% (0.6222 => 1.0821, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10249.03% (0.0720 => 7.4513, std.dev.: 0.0132) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11160900.00% (0.0001 => 11.1610, std.dev.: 0.0688) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487100.00% (0.0001 => 5.4872, std.dev.: 0.0074) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.27% (1.1194 => 10.3351, std.dev.: 0.0197) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784) MultiSource/Applications/ClamAV/clamscan: 150.70% (22.1758 => 55.5937, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.20% (0.0929 => 0.1767, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.93% (2.9384 => 4.6112, std.dev.: 0.0146) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.14% (7.0540 => 10.8025, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.64% (1.5859 => 2.3890, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.59% (8.1363 => 11.9267, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.73% (2.2024 => 3.0994, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 38.20% (21.9371 => 30.3180, std.dev.: 0.0064) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.72% (0.1062 => 0.1452, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.19% (4.2646 => 5.6799, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.53% (1.5415 => 2.0430, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (0.4615 => 0.6112, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.16% (0.2271 => 0.2956, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.02% (0.1892 => 0.2460, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.36% (0.4299 => 0.5561, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 29.29% (1.1642 => 1.5052, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.03% (0.6675 => 0.8546, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.46% (0.5105 => 0.6456, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.14% (0.1584 => 0.1998, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.89% (0.0479 => 0.0603, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.69% (3.8922 => 4.8921, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 24.75% (1.0722 => 1.3376, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.88% (0.1143 => 0.1416, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 23.85% (0.4289 => 0.5312, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.65% (0.3121 => 0.3859, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.48% (1.4186 => 1.7517, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.04% (0.1337 => 0.1645, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 22.88% (0.4620 => 0.5677, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 22.45% (9.4845 => 11.6138, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.44% (0.2700 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.33% (0.0842 => 0.1030, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.29% (0.7115 => 0.8701, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.89% (0.1695 => 0.2066, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.64% (0.0730 => 0.0888, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 21.41% (0.1163 => 0.1412, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.03% (0.1151 => 0.1393, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.92% (0.3098 => 0.3746, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 20.86% (0.7835 => 0.9469, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.65% (0.0886 => 0.1069, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.42% (1.3050 => 1.5715, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.39% (0.1236 => 0.1488, std.dev.: 0.0062) MultiSource/Applications/oggenc/oggenc: 20.15% (5.7591 => 6.9198, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.15% (0.0675 => 0.0811, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.72% (0.6456 => 0.7729, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 19.47% (0.1695 => 0.2025, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.32% (4.9449 => 5.9004, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.13% (0.5860 => 0.6981, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.10% (0.8172 => 0.9733, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.02% (0.1940 => 0.2309, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.61% (5.0018 => 5.9326, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/bisort/bisort: 18.57% (0.0614 => 0.0728, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 18.32% (0.7433 => 0.8795, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.28% (3.3354 => 3.9452, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.13% (0.5020 => 0.5930, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.08% (0.2107 => 0.2488, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.91% (0.2758 => 0.3252, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.75% (0.3307 => 0.3894, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.75% (0.0834 => 0.0982, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.65% (0.5569 => 0.6552, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.3423 => 0.4025, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 17.35% (0.1268 => 0.1488, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 17.27% (3.8723 => 4.5411, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.17% (0.9765 => 1.1442, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 17.12% (1.1840 => 1.3867, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.09% (0.1510 => 0.1768, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 16.69% (2.0273 => 2.3656, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.27% (0.5981 => 0.6954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.17% (0.3283 => 0.3814, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.98% (0.3441 => 0.3991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3232 => 0.3743, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.74% (0.8101 => 0.9376, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 15.64% (2.2969 => 2.6561, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.52% (0.6450 => 0.7451, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.05% (0.8921 => 1.0264, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.69% (0.3180 => 0.3647, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.35% (1.1861 => 1.3563, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 13.94% (0.3379 => 0.3850, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.84% (0.0838 => 0.0954, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.65% (0.8067 => 0.9168, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.20% (0.3865 => 0.4375, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.96% (0.4636 => 0.5237, std.dev.: 0.0067) MultiSource/Applications/hbd/hbd: 12.95% (1.5603 => 1.7624, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.23% (0.4103 => 0.4605, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.09% (0.4203 => 0.4711, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.68% (0.4048 => 0.4521, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.63% (0.3603 => 0.4022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.49% (0.3282 => 0.3659, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.48% (0.3422 => 0.3815, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.12% (17.1811 => 19.0922, std.dev.: 0.0195) SingleSource/Benchmarks/Stanford/Puzzle: 11.12% (0.1268 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.07% (0.2430 => 0.2699, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.80% (0.3092 => 0.3426, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3826 => 0.4233, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.29% (0.3828 => 0.4222, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.29% (0.4064 => 0.4482, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.09% (14.3668 => 15.8170, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.89% (0.3427 => 0.3766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.85% (0.3543 => 0.3892, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 9.78% (0.2831 => 0.3108, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.07% (2.0665 => 2.2539, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.76% (0.2877 => 0.3129, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.71% (1.2842 => 1.3961, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.61% (0.2905 => 0.3155, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.54% (0.2891 => 0.3138, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.50% (0.2872 => 0.3116, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.35% (0.3162 => 0.3426, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.33% (0.2725 => 0.2952, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.24% (0.2756 => 0.2983, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.23% (63.2438 => 68.4514, std.dev.: 0.0377) SingleSource/UnitTests/ObjC++/property-reference-object: 8.21% (0.6030 => 0.6525, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.21% (0.2802 => 0.3032, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.09% (0.2793 => 0.3019, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: 7.94% (0.7326 => 0.7908, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 7.92% (0.2714 => 0.2929, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.86% (0.5925 => 0.6391, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.49% (0.3136 => 0.3371, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.38% (2.2022 => 2.3647, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.72% (0.4879 => 0.5207, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.37% (10.3673 => 10.6134, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (7.9617 => 8.1418, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2387, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (4.2280 => 4.4736, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3125, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (2.0360 => 2.1046, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.97% (0.9957 => 1.0253, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9197, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.25% (3.6395 => 3.7213, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7570, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.80% (9.1159 => 9.2802, std.dev.: 0.0210) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2822, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5769, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0207) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.23% (0.8651 => 0.2143, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.76% (5.3855 => 4.4827, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.56% (5.3526 => 4.4663, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -13.43% (10.4361 => 9.0343, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.06% (1.7609 => 1.6190, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -7.91% (54.1659 => 49.8830, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.09% (1.9577 => 0.6638, std.dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3066, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.61% (1.5373 => 1.0206, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4300, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8593, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.31% (2.6546 => 2.0093, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4198, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7320, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4926, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2870, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.72% (1.2373 => 1.1542, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.47% (8.1563 => 7.7098, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.80% (0.4808 => 0.4577, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -4.54% (10.2830 => 9.8158, std.dev.: 0.0171) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.82% (5.0483 => 4.9565, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.81% (3.6994 => 3.6325, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7221 => 3.6694, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2362, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.17% (0.1485 => 0.1334, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0029) Report Time: 1.30s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 04:47:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 06:47:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118124702.773282A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7720?compare_to=7716&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7720, Order: 172801, Start Time: 2013-01-18 11:13:41, End Time: 2013-01-18 12:47:11 To: 7716, Order: 172798, Start Time: 2013-01-18 09:16:36, End Time: 2013-01-18 10:50:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (125 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (871 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.25% (0.0717 => 0.1192, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.45% (0.0974 => 0.1553, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 44.53% (0.1500 => 0.2168, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.56% (0.0599 => 0.0818, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.00% (0.6395 => 0.8697, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.21% (0.6395 => 0.8583, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.19% (0.5688 => 0.7462, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.18% (0.5805 => 0.7615, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.88% (0.5456 => 0.7141, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.42% (0.6230 => 0.8125, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.40% (0.5849 => 0.7627, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.14% (0.5567 => 0.7245, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.05% (0.5941 => 0.7726, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.01% (0.5581 => 0.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.01% (0.5575 => 0.7248, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.54% (0.5802 => 0.7516, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.26% (0.5705 => 0.7374, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.12% (0.6033 => 0.7790, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.54% (0.6440 => 0.8278, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.53% (0.5857 => 0.7528, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.51% (0.5570 => 0.7158, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.48% (0.5478 => 0.7038, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.16% (0.5569 => 0.7137, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.12% (0.5925 => 0.7591, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.06% (0.5591 => 0.7160, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.34% (0.6676 => 0.8501, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.24% (0.6189 => 0.7875, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.16% (1.6474 => 2.0949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.93% (0.6052 => 0.7682, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.90% (0.6446 => 0.8180, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.90% (0.0699 => 0.0887, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.86% (0.5863 => 0.7438, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (0.6304 => 0.7982, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.44% (0.6194 => 0.7770, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.36% (0.6681 => 0.8375, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.11% (0.6660 => 0.8332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.95% (0.6297 => 0.7868, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.70% (0.6667 => 0.8247, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.47% (0.7524 => 0.9215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.47% (0.7339 => 0.8915, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.99% (2.2587 => 2.7103, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.45% (0.0622 => 0.0743, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.61% (1.1450 => 1.3123, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.00% (0.3357 => 0.3827, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.50% (4.5069 => 5.0253, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.03% (0.4916 => 0.5458, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.73% (1.6364 => 1.8120, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 10.68% (0.4515 => 0.4997, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.25% (3.5339 => 3.8961, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.7021 => 0.7550, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4524 => 0.4833, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 6.68% (1.2515 => 1.3351, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.27% (0.5329 => 0.5663, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.2784 => 1.3557, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.02% (1.4642 => 1.5523, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.89% (0.1731 => 0.1833, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.79% (9.2283 => 9.7629, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.86% (0.3319 => 0.3447, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6750 => 0.6927, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (5.4682 => 5.6043, std.dev.: 0.0247) MultiSource/Applications/oggenc/oggenc: 2.45% (5.0226 => 5.1457, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: 2.06% (1.3864 => 1.4149, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.48% (0.8418 => 0.8543, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.07% (0.9557 => 0.9659, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.01% (1.3722 => 1.3861, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6771, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.6004, std.dev.: 0.0632) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1035, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6032, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (5.1955 => 5.2762, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2090, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.05% (0.1281 => 0.1101, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.44% (0.1584 => 0.1482, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.64% (0.3194 => 0.3014, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.63% (0.7198 => 0.6793, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -5.41% (2.4924 => 2.3576, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: -5.04% (0.3812 => 0.3620, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.96% (0.3834 => 0.3644, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: -4.93% (0.3831 => 0.3642, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.92% (0.3880 => 0.3689, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.92% (0.3884 => 0.3693, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.81% (0.4033 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.77% (0.3896 => 0.3710, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.75% (0.3891 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.65% (0.4176 => 0.3982, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.60% (0.9852 => 0.9399, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.57% (0.2428 => 0.2317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.14% (0.3142 => 0.3012, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.06% (0.7779 => 0.7463, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030) SingleSource/UnitTests/ObjC++/Hello: -4.02% (0.6347 => 0.6092, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -3.93% (0.4280 => 0.4112, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.44% (0.3658 => 0.3532, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.40% (0.2939 => 0.2839, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.40% (1.3148 => 1.2701, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.38% (0.3252 => 0.3142, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.34% (0.3026 => 0.2925, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.26% (0.9542 => 0.9231, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.21% (2.1713 => 2.1015, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.01% (0.4151 => 0.4026, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.91% (14.2083 => 13.7950, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.75% (0.7919 => 0.7701, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.61% (20.7746 => 20.2324, std.dev.: 0.0182) MultiSource/Applications/JM/lencod/lencod: -2.48% (16.1920 => 15.7902, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -2.44% (17.1032 => 16.6858, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.44% (0.4427 => 0.4319, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -2.39% (4.3330 => 4.2293, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.34% (6.7716 => 6.6134, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.31% (0.4321 => 0.4221, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -2.29% (0.7982 => 0.7799, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.18% (1.0544 => 1.0314, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (1.2210 => 1.1948, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -2.13% (7.0961 => 6.9449, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.13% (1.2221 => 1.1961, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.2300 => 1.2054, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/football/football: -1.84% (0.9179 => 0.9010, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -1.75% (2.4021 => 2.3601, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -1.75% (34.0927 => 33.4976, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.72% (0.5999 => 0.5896, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -1.72% (1.5610 => 1.5342, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.70% (0.8521 => 0.8376, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -1.34% (4.0594 => 4.0049, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.22% (8.0126 => 7.9149, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.13% (0.9077 => 0.8974, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.50% (1.8100 => 0.6968, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3089, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.96% (1.3643 => 1.0238, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0147, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7581, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3840, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2083, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1271, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.43% (4.7378 => 4.1017, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1764, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.09% (1.0557 => 1.0231, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (7.9763 => 7.7841, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1177, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -2.26% (3.7241 => 3.6398, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1957, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.33% (1.6307 => 1.6090, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6219 => 1.6016, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5891, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 06:33:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 08:33:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118143359.E732B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7721?compare_to=7718&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7721, Order: 172808, Start Time: 2013-01-18 12:33:50, End Time: 2013-01-18 14:34:09 To: 7718, Order: 172799, Start Time: 2013-01-18 10:15:08, End Time: 2013-01-18 12:16:38 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (4 on baseline) Performance Improvements: 21 (67 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1036 (992 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.70% (15.5285 => 17.3455, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout/nestedloop: 9.65% (0.1980 => 0.2171, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/fldry: 4.89% (0.6525 => 0.6844, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.04% (5.2876 => 5.5013, std.dev.: 0.0420) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.10% (3.9418 => 4.0246, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.95% (2.3437 => 2.3893, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.12% (2.7554 => 2.7862, std.dev.: 0.0068) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -15.34% (0.0919 => 0.0778, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -13.49% (0.1075 => 0.0930, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: -12.67% (1.6002 => 1.3975, std.dev.: 0.0535) MultiSource/Applications/treecc/treecc: -11.80% (2.4758 => 2.1836, std.dev.: 0.0557) SingleSource/Benchmarks/SmallPT/smallpt: -9.08% (0.1520 => 0.1382, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.40% (0.9752 => 0.8933, std.dev.: 0.0169) SingleSource/Benchmarks/Linpack/linpack-pc: -5.87% (0.2657 => 0.2501, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/05-eks/eks: -5.61% (0.4937 => 0.4660, std.dev.: 0.0051) MultiSource/Applications/ClamAV/clamscan: -3.56% (16.5240 => 15.9352, std.dev.: 0.1398) MultiSource/Benchmarks/Prolangs-C/football/football: -3.15% (0.9893 => 0.9581, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -2.49% (1.3370 => 1.3037, std.dev.: 0.0108) MultiSource/Applications/hbd/hbd: -2.42% (1.5696 => 1.5316, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.96% (1.7321 => 1.6982, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.87% (1.0024 => 0.9837, std.dev.: 0.0049) MultiSource/Applications/lambda-0_1_3/lambda: -1.74% (0.8031 => 0.7891, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -4.91% (0.6153 => 0.5851, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.24% (3.8531 => 3.6899, std.dev.: 0.0571) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.59% (2.5572 => 2.4655, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -2.23% (4.4326 => 4.3337, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.65% (1.5712 => 1.5453, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.09% (5.9397 => 5.8749, std.dev.: 0.0206) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.08% (1.1817 => 1.1217, std.dev.: 0.0363) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0224 => 0.0224, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.61% (0.0436 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0339 => 0.0341) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0223 => 0.0223, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.87% (0.0231 => 0.0229, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1436 => 0.1435, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -4.99% (1.2382 => 1.1764, std.dev.: 0.0502) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.19% (0.4028 => 0.3980, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.30% (0.1483 => 0.1532, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.79% (0.1002 => 0.0934, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 39.06% (0.0192 => 0.0267, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.51% (0.0617 => 0.0546, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1507 => 1.1497, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0604 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.96% (0.0314 => 0.0311, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.01% (0.7440 => 0.7515, std.dev.: 0.0017) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.03% (0.0071 => 0.0044, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.46% (12.7708 => 12.8291, std.dev.: 0.0181) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.81% (0.0336 => 0.0500, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322950.00% (0.0008 => 2.5844, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.05% (1.1825 => 2.3893, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.00% (16.6791 => 17.3455, std.dev.: 0.0472) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0115) SingleSource/Benchmarks/SmallPT/smallpt: -26.80% (0.1888 => 0.1382, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.64% (0.1684 => 0.1269, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.99% (0.1009 => 0.0777, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -19.24% (1.8964 => 1.5316, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.56% (0.0862 => 0.0702, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.96% (0.7686 => 0.6459, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.94% (0.1079 => 0.0907, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.85% (0.4074 => 0.3469, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -12.54% (1.5979 => 1.3975, std.dev.: 0.0535) SingleSource/UnitTests/Vector/constpool: -12.27% (9.8875 => 8.6739, std.dev.: 0.1135) MultiSource/Applications/treecc/treecc: -11.66% (2.4719 => 2.1836, std.dev.: 0.0557) MultiSource/Applications/hexxagon/hexxagon: -11.54% (1.1433 => 1.0114, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.10% (6.4235 => 5.7102, std.dev.: 0.0325) MultiSource/Applications/aha/aha: -10.89% (0.1378 => 0.1228, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -10.85% (4.6406 => 4.1371, std.dev.: 0.0422) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.74% (0.7693 => 0.6867, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.65% (1.5131 => 1.3520, std.dev.: 0.0254) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.39% (1.6874 => 1.5120, std.dev.: 0.0333) MultiSource/Applications/sqlite3/sqlite3: -10.09% (17.5634 => 15.7917, std.dev.: 0.6840) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.76% (0.6885 => 0.6213, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.66% (1.1498 => 1.0387, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.56% (10.2703 => 9.2885, std.dev.: 0.1267) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.85% (0.3560 => 0.3245, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: -8.81% (0.8653 => 0.7891, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -8.61% (17.4365 => 15.9352, std.dev.: 0.1398) MultiSource/Benchmarks/Olden/health/health: -8.07% (0.1610 => 0.1480, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.63% (0.9124 => 0.8428, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.62% (0.2283 => 0.2109, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.62% (0.1798 => 0.1661, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: -7.62% (3.7840 => 3.4958, std.dev.: 0.0922) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.83% (0.9588 => 0.8933, std.dev.: 0.0169) MultiSource/Applications/lemon/lemon: -6.74% (1.3979 => 1.3037, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.67% (0.2100 => 0.1960, std.dev.: 0.0030) MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.62% (1.1731 => 1.0954, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -6.60% (0.5134 => 0.4795, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.40% (0.7693 => 0.7201, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.32% (1.8127 => 1.6982, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.20% (0.5746 => 0.5390, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2006 => 0.1885, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.66% (1.3310 => 1.2556, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: -5.44% (1.4392 => 1.3609, std.dev.: 0.0129) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.17% (1.2680 => 1.2024, std.dev.: 0.0192) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.97% (5.0381 => 4.7875, std.dev.: 0.0611) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.93% (3.6295 => 3.4507, std.dev.: 0.0186) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.66% (0.6135 => 0.5849, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.88% (1.0234 => 0.9837, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.87% (1.3220 => 1.2708, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9759 => 0.9581, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.10% (0.9372 => 0.6457, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.15% (1.0816 => 0.8637, std.dev.: 0.0111) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.63% (1.5623 => 1.2713, std.dev.: 0.0163) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.10% (1.4235 => 1.2655, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/hash: -10.27% (4.5259 => 4.0611, std.dev.: 0.1736) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.19% (0.4081 => 0.3665, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.07% (23.3986 => 21.7448, std.dev.: 0.2700) MultiSource/Benchmarks/Olden/health/health: -6.60% (0.3654 => 0.3413, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: -3.47% (3.5443 => 3.4214, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.36% (1.4446 => 1.3961, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -3.11% (4.4730 => 4.3337, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/lists: -2.68% (17.2182 => 16.7564, std.dev.: 0.0646) MultiSource/Applications/spiff/spiff: -2.29% (2.8571 => 2.7916, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.13% (42.3194 => 41.4180, std.dev.: 0.1350) MultiSource/Applications/hexxagon/hexxagon: -1.88% (14.0297 => 13.7655, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3596 => 3.3166, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.25% (3.5669 => 3.5223, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.89% (1.2047 => 1.1217, std.dev.: 0.0363) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.21% (0.1530 => 0.1435, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -39.02% (1.9293 => 1.1764, std.dev.: 0.0502) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.70% (0.4049 => 0.3980, std.dev.: 0.0263) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1510 => 0.1532, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.0978 => 0.0934, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0590 => 0.0546, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.03% (1.1617 => 1.1497, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.05% (0.7437 => 0.7515, std.dev.: 0.0017) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.17% (0.0092 => 0.0044, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.40% (12.7781 => 12.8291, std.dev.: 0.0181) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 06:43:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 08:43:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118144359.9D9382A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7722?compare_to=7720&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7722, Order: 172808, Start Time: 2013-01-18 13:10:20, End Time: 2013-01-18 14:44:08 To: 7720, Order: 172801, Start Time: 2013-01-18 11:13:41, End Time: 2013-01-18 12:47:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (97 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.02% (1.1536 => 1.1654, std.dev.: 0.0017) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.67% (0.0717 => 0.1195, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.86% (0.0974 => 0.1557, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0055) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.43% (0.6395 => 0.8725, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.54% (0.6395 => 0.8604, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.46% (0.6260 => 0.8292, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.66% (0.5688 => 0.7489, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.30% (0.5805 => 0.7622, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.20% (0.5456 => 0.7158, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.83% (0.6230 => 0.8151, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.65% (0.5849 => 0.7642, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.54% (0.5567 => 0.7267, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.46% (0.5575 => 0.7273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.44% (0.5581 => 0.7280, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.08% (0.5941 => 0.7728, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.87% (0.5802 => 0.7535, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.52% (0.5705 => 0.7389, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.39% (0.6033 => 0.7806, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.96% (0.5859 => 0.7556, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.92% (0.5570 => 0.7181, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.79% (0.5478 => 0.7055, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.70% (0.5857 => 0.7538, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.66% (0.6440 => 0.8286, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.59% (0.5569 => 0.7161, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.42% (0.5925 => 0.7609, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.21% (0.5591 => 0.7168, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.70% (0.6676 => 0.8525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.55% (0.6189 => 0.7894, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.49% (1.6474 => 2.1002, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.41% (0.6052 => 0.7711, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.23% (0.6446 => 0.8201, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.22% (0.5863 => 0.7459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.65% (0.6304 => 0.7984, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.77% (0.6194 => 0.7790, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.59% (0.6681 => 0.8391, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.23% (0.6297 => 0.7886, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.18% (0.6660 => 0.8337, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.94% (0.6667 => 0.8263, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.57% (0.7524 => 0.9222, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.79% (0.7339 => 0.8938, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.58% (2.2587 => 2.7236, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.80% (1.1450 => 1.3145, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 14.15% (0.3357 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.41% (0.1982 => 0.2228, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.72% (4.5069 => 5.0351, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.19% (0.4916 => 0.5466, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 10.94% (0.4515 => 0.5009, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.80% (1.6364 => 1.8132, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.72% (3.5339 => 3.9126, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2385 => 0.2603, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.93% (0.7021 => 0.7578, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.25% (0.2001 => 0.2146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.96% (0.4524 => 0.4839, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.96% (1.2515 => 1.3386, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.70% (0.5329 => 0.5686, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.40% (0.4861 => 0.5172, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.28% (1.4642 => 1.5561, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.21% (1.2784 => 1.3578, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 5.98% (9.2283 => 9.7803, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 5.38% (0.3255 => 0.3430, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.07% (5.0226 => 5.1770, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6750 => 0.6950, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.83% (5.4682 => 5.6228, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 2.25% (1.3864 => 1.4176, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.18% (0.9557 => 0.9670, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3722 => 1.3883, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6555, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1497, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5931, std.dev.: 0.1400) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6111, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2773, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2061, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.74% (0.1281 => 0.1105, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.15% (2.4924 => 2.3640, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.82% (0.3880 => 0.3693, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.76% (0.3884 => 0.3699, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.63% (0.7198 => 0.6865, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.33% (0.4176 => 0.3995, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.33% (0.9852 => 0.9425, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.32% (0.2428 => 0.2323, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.88% (0.4199 => 0.4036, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.71% (0.6441 => 0.6202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.63% (0.3057 => 0.2946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.60% (0.4280 => 0.4126, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.60% (0.3142 => 0.3029, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -3.59% (0.2871 => 0.2768, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.56% (0.7779 => 0.7502, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.55% (0.2903 => 0.2800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.35% (0.3016 => 0.2915, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -3.34% (0.3205 => 0.3098, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.30% (2.1713 => 2.0997, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -3.20% (1.3148 => 1.2727, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.15% (0.9542 => 0.9241, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.15% (0.6484 => 0.6280, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.09% (0.3658 => 0.3545, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.96% (0.4151 => 0.4028, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.75% (14.2083 => 13.8180, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2720, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.39% (0.7919 => 0.7730, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.36% (6.7716 => 6.6115, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -2.30% (17.1032 => 16.7104, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: -2.25% (16.1920 => 15.8274, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: -2.05% (4.3330 => 4.2440, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.98% (1.0544 => 1.0335, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -1.93% (7.0961 => 6.9593, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.91% (1.2210 => 1.1977, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.88% (1.2300 => 1.2069, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.87% (1.2221 => 1.1993, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -1.72% (0.9179 => 0.9021, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (0.7982 => 0.7852, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8521 => 0.8399, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.33% (1.5610 => 1.5403, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.27% (34.0927 => 33.6603, std.dev.: 0.0116) MultiSource/Applications/siod/siod: -1.20% (2.4021 => 2.3732, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.18% (8.0126 => 7.9179, std.dev.: 0.0110) MultiSource/Applications/lua/lua: -1.03% (4.0594 => 4.0174, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.09% (1.8100 => 0.6861, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0271, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0257, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2082, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1295, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1046) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.69% (7.1848 => 6.6326, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7773, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.02% (1.3096 => 1.2832, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1927, std.dev.: 0.0272) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.35% (1.6219 => 1.6000, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7092 => 3.6606, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.25% (1.6307 => 1.6103, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5892, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 07:09:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 09:09:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118150901.19BF42A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7723?compare_to=7719&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7723, Order: 172808, Start Time: 2013-01-18 12:58:07, End Time: 2013-01-18 15:09:10 To: 7719, Order: 172799, Start Time: 2013-01-18 10:16:32, End Time: 2013-01-18 12:27:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (215 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.17% (10.6134 => 10.9501, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 1.76% (0.6638 => 0.6755, std.dev.: 0.0014) SingleSource/Benchmarks/Linpack/linpack-pc: 1.31% (76.8087 => 77.8187, std.dev.: 0.0169) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1334 => 0.1334, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0417 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8482 => 499.8541, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.10% (1.1277 => 499.8541, std.dev.: 0.0067) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.59% (0.5229 => 1.6450, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 19.91% (14.9895 => 17.9739, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 42.43% (14.1553 => 20.1621, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 17.08% (4.1105 => 4.8126, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.34% (1.1048 => 1.7272, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.19% (7.1582 => 37.3795, std.dev.: 0.0182) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.69% (3.4629 => 6.3610, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.93% (0.6222 => 1.0822, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10248.89% (0.0720 => 7.4512, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 11148700.00% (0.0001 => 11.1488, std.dev.: 0.0511) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486700.00% (0.0001 => 5.4868, std.dev.: 0.0212) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.59% (1.1194 => 10.3499, std.dev.: 0.0130) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.18% (22.1758 => 55.2575, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.18% (2.9384 => 4.6186, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.71% (7.0540 => 10.8425, std.dev.: 0.0235) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.93% (1.5859 => 2.3936, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.64% (8.1363 => 11.9310, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 41.69% (0.0439 => 0.0622, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.89% (2.2024 => 3.1029, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 39.14% (0.3109 => 0.4326, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.25% (21.9371 => 30.3272, std.dev.: 0.0283) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.46% (4.2646 => 5.6917, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.69% (1.5415 => 2.0454, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.31% (0.4615 => 0.6106, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.50% (0.1892 => 0.2469, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.81% (0.2271 => 0.2948, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.75% (0.4299 => 0.5578, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 28.49% (1.1642 => 1.4959, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.99% (0.6675 => 0.8543, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0793 => 0.1009, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.20% (0.1125 => 0.1431, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 26.59% (0.1655 => 0.2095) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.48% (0.5105 => 0.6457, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 26.00% (0.2554 => 0.3218, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.60% (0.0457 => 0.0574, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.59% (3.8922 => 4.8883, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.26% (0.0479 => 0.0600, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 25.11% (0.1175 => 0.1470, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (0.1566 => 0.1958, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 24.70% (1.0722 => 1.3370, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 23.55% (0.4289 => 0.5299, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.49% (0.3121 => 0.3854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.17% (1.4186 => 1.7473, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.11% (0.1337 => 0.1646, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.83% (0.1555 => 0.1910, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.77% (0.1695 => 0.2081, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.75% (0.1143 => 0.1403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 22.73% (0.4620 => 0.5670, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 22.57% (9.4845 => 11.6254, std.dev.: 0.0050) MultiSource/Applications/minisat/minisat: 21.55% (0.7115 => 0.8648, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.13% (0.0672 => 0.0814, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.96% (0.2700 => 0.3266, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.96% (0.0730 => 0.0883, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.86% (0.7835 => 0.9469, std.dev.: 0.0080) MultiSource/Applications/aha/aha: 20.68% (0.1151 => 0.1389, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 20.66% (0.3098 => 0.3738, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 20.55% (5.7591 => 6.9426, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.47% (0.1236 => 0.1489, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.41% (1.3050 => 1.5713, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/15-trie/trie: 20.30% (0.0527 => 0.0634) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.85% (0.0675 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.79% (0.1940 => 0.2324, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 19.79% (0.0662 => 0.0793, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.71% (0.0842 => 0.1008, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 19.64% (0.6456 => 0.7724, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 19.47% (0.1695 => 0.2025, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.43% (0.1163 => 0.1389, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.28% (4.9449 => 5.8984, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.01% (0.5860 => 0.6974, std.dev.: 0.0055) MultiSource/Applications/d/make_dparser: 18.61% (3.3354 => 3.9562, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.58% (0.8172 => 0.9690, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.48% (5.0018 => 5.9261, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 18.40% (0.0614 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.28% (0.0886 => 0.1048, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.75% (0.5020 => 0.5911, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.66% (0.0770 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.66% (0.2758 => 0.3245, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.42% (0.3307 => 0.3883, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 17.35% (0.1268 => 0.1488, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.19% (0.1117 => 0.1309, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.11% (0.9765 => 1.1436, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 17.10% (1.1840 => 1.3865, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 17.08% (0.2049 => 0.2399, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.99% (0.2107 => 0.2465, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 16.99% (0.5569 => 0.6515, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 16.98% (3.8723 => 4.5299, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 16.95% (0.1510 => 0.1766, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 16.87% (0.7433 => 0.8687, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.3423 => 0.3994, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 16.61% (2.0273 => 2.3640, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.42% (0.5981 => 0.6963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.42% (0.3283 => 0.3822, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.32% (0.2065 => 0.2402, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.73% (2.2969 => 2.6583, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary: 15.69% (0.3232 => 0.3739, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.66% (0.8101 => 0.9370, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.63% (0.3441 => 0.3979, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.46% (0.6450 => 0.7447, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.13% (0.1044 => 0.1202, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810) MultiSource/Benchmarks/Prolangs-C/football/football: 14.91% (0.8921 => 1.0251, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.53% (0.3180 => 0.3642, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.32% (1.1861 => 1.3559, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.15% (0.3379 => 0.3857, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.61% (0.8067 => 0.9165, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.56% (0.2603 => 0.2956, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.99% (0.3865 => 0.4367, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.71% (1.5603 => 1.7586, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.66% (0.4636 => 0.5223, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.02% (0.4103 => 0.4596, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.93% (0.3603 => 0.4033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.85% (0.4203 => 0.4701, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.79% (0.3282 => 0.3669, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.43% (0.3422 => 0.3813, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.36% (0.4048 => 0.4508, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.14% (17.1811 => 19.0953, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.91% (0.2430 => 0.2695, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 10.86% (0.3684 => 0.4084, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 10.74% (0.3092 => 0.3424, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.45% (0.3826 => 0.4226, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.43% (0.4064 => 0.4488, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.27% (14.3668 => 15.8422, std.dev.: 0.0227) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.86% (0.3427 => 0.3765, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.85% (0.3473 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.79% (0.3543 => 0.3890, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 9.44% (0.2871 => 0.3142, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 8.85% (1.2842 => 1.3978, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.83% (2.0665 => 2.2489, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.64% (0.2756 => 0.2994, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.61% (0.2905 => 0.3155, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 8.52% (0.2877 => 0.3122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.45% (0.2793 => 0.3029, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.44% (0.3162 => 0.3429, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.34% (63.2438 => 68.5153, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.27% (0.3650 => 0.3952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hello: 8.22% (0.2714 => 0.2937, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2802 => 0.3025, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.90% (0.3052 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3935 => 0.4242, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (2.2022 => 2.3681, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 7.45% (0.6030 => 0.6479, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.40% (0.3136 => 0.3368, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.33% (0.7326 => 0.7863, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/Hello: 7.16% (0.5925 => 0.6349, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.60% (0.4879 => 0.5201, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 5.62% (10.3673 => 10.9501, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.14% (7.9617 => 8.1320, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2466, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.77% (4.2280 => 4.4721, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.47% (8.6802 => 8.8945, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.18% (3.6395 => 3.7188, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.06% (1.0313 => 1.0525, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2885, std.dev.: 0.0123) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2820, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.24% (10.3460 => 10.4743, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1750, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -42.48% (0.1622 => 0.0933, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4672, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.48% (5.3526 => 4.4703, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: -13.53% (10.4361 => 9.0236, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.87% (1.7609 => 1.6224, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9539, std.dev.: 0.0192) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.50% (1.9577 => 0.6755, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3061, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4304, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8608, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0045, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.06% (0.6223 => 0.5037, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2552, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7036, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.11% (1.2373 => 1.1617, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.62% (8.1563 => 7.6980, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.74% (0.4808 => 0.4580, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.46% (10.2830 => 9.8241, std.dev.: 0.0095) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.6994 => 3.6255, std.dev.: 0.0145) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.17% (0.1485 => 0.1334, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 07:16:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 09:16:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130118151657.E6E4E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7724?compare_to=7717&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7724, Order: 172801, Start Time: 2013-01-18 11:42:28, End Time: 2013-01-18 15:17:06 To: 7717, Order: 172789, Start Time: 2013-01-18 07:04:15, End Time: 2013-01-18 10:51:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 6 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -2.89% (2.5108 => 2.4383, std.dev.: 0.0275) MultiSource/Applications/spiff/spiff: -2.24% (0.4914 => 0.4804, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.81% (0.6129 => 0.6018, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: -1.58% (0.9091 => 0.8947, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.20% (5.1761 => 5.1139, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: -1.20% (5.2452 => 5.1824, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.68% (0.0625 => 0.0898, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.29% (0.0714 => 0.0916, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.96% (0.2969 => 0.3799, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.27% (0.4253 => 0.5413) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.11% (0.4139 => 0.5261, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.12% (0.5900 => 0.7441, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.61% (0.4994 => 0.6273, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.43% (0.1620 => 0.2032, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 24.69% (1.5932 => 1.9866, std.dev.: 0.0073) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.66% (0.0584 => 0.0728, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.57% (0.1107 => 0.1379, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.56% (0.5000 => 0.6228, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: 23.87% (0.0599 => 0.0742, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.30% (0.0897 => 0.1106, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.76% (0.1103 => 0.1343, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.70% (0.1604 => 0.1952, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.62% (0.0495 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.60% (0.3903 => 0.4746, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 21.52% (0.0604 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 21.49% (0.1619 => 0.1967, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.47% (0.2736 => 0.3296, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.43% (1.3152 => 1.5839, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 20.10% (0.0582 => 0.0699, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.10% (0.2866 => 0.3442, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.70% (0.1462 => 0.1750, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.39% (0.1088 => 0.1299, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.36% (0.3890 => 0.4643, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.31% (0.2014 => 0.2403, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 19.31% (0.0808 => 0.0964, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.24% (0.4029 => 0.4804, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.23% (0.3271 => 0.3900, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 18.64% (0.5546 => 0.6580, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 18.60% (0.1505 => 0.1785, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 18.32% (1.8794 => 2.2238, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.11% (0.5026 => 0.5936, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 18.09% (0.5826 => 0.6880, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.99% (3.5627 => 4.2037, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.91% (0.2875 => 0.3390, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.85% (0.0605 => 0.0713, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.82% (1.6211 => 1.9100, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.80% (0.0573 => 0.0675, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.70% (0.2803 => 0.3299, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.64% (0.5889 => 0.6928, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.64% (0.2750 => 0.3235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.58% (0.2714 => 0.3191, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.57% (0.2738 => 0.3219, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 17.41% (0.2780 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.38% (0.1968 => 0.2310, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.37% (0.4658 => 0.5467, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.05% (0.2792 => 0.3268, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 16.99% (0.2725 => 0.3188, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 16.99% (0.7171 => 0.8389, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 16.97% (0.2811 => 0.3288, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 16.96% (0.3096 => 0.3621, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.90% (0.3195 => 0.3735, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.78% (0.2729 => 0.3187, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.76% (2.0673 => 2.4137, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 16.71% (0.2813 => 0.3283, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.66% (0.2911 => 0.3396, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 16.60% (0.9697 => 1.1307, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 16.54% (0.2823 => 0.3290, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 16.49% (1.0781 => 1.2559, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary: 16.48% (0.3258 => 0.3795, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 16.41% (0.9909 => 1.1535, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.39% (4.4195 => 5.1440, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.34% (0.3930 => 0.4572, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.26% (0.4361 => 0.5070, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 16.22% (0.3317 => 0.3855, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 15.89% (0.3267 => 0.3786, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 15.70% (0.4146 => 0.4797, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.69% (0.3060 => 0.3540, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.68% (1.9694 => 2.2783, std.dev.: 0.0056) MultiSource/Applications/ClamAV/clamscan: 15.65% (4.2109 => 4.8697, std.dev.: 0.0855) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.59% (0.3362 => 0.3886, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.49% (0.3124 => 0.3608, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.48% (2.7292 => 3.1516, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.47% (1.9966 => 2.3054, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 15.39% (0.2566 => 0.2961, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 15.38% (0.3726 => 0.4299, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.34% (23.5202 => 27.1283, std.dev.: 0.0261) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.31% (0.3625 => 0.4180, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 15.26% (0.3348 => 0.3859, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.14% (0.3282 => 0.3779, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.03% (0.3845 => 0.4423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 15.01% (0.3678 => 0.4230, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.99% (0.3690 => 0.4243, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.98% (0.3477 => 0.3998, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0033) MultiSource/Applications/lua/lua: 14.91% (1.4269 => 1.6396, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.75% (0.3981 => 0.4568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.54% (0.4251 => 0.4869, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: 14.39% (0.3446 => 0.3942, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 14.33% (0.3496 => 0.3997, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.30% (0.1028 => 0.1175, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 14.25% (0.5012 => 0.5726, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.20% (0.3465 => 0.3957, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.16% (0.3488 => 0.3982, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 14.10% (0.3469 => 0.3958, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 14.08% (0.3460 => 0.3947, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.84% (0.3650 => 0.4155, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.64% (0.3643 => 0.4140, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 13.61% (0.7875 => 0.8947, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.07% (0.6435 => 0.7276, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 12.88% (5.5417 => 6.2552, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 12.61% (2.1653 => 2.4383, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/football/football: 12.53% (0.2075 => 0.2335, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 12.41% (0.2691 => 0.3025, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 12.23% (4.6177 => 5.1824, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: 12.13% (2.1013 => 2.3562, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.06% (0.2737 => 0.3067, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 11.80% (0.2068 => 0.2312, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.3084 => 0.3430, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.21% (0.3498 => 0.3890, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.06% (0.1383 => 0.1536, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.78% (0.2040 => 0.2260, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.65% (0.5361 => 0.5932, std.dev.: 0.0068) MultiSource/Applications/minisat/minisat: 10.55% (0.3336 => 0.3688, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 10.42% (0.4847 => 0.5352, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 10.34% (0.6634 => 0.7320, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.27% (0.2103 => 0.2319, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.13% (11.6398 => 12.8186, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.36% (0.7426 => 0.8121, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.98% (4.6926 => 5.1139, std.dev.: 0.0143) MultiSource/Applications/lemon/lemon: 8.62% (0.2391 => 0.2597, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 8.38% (2.0346 => 2.2052, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (0.5584 => 0.6018, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 6.88% (11.9555 => 12.7777, std.dev.: 0.0235) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5286, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0079) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.61% (0.3693 => 0.4048, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2416, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6678, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6848, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8883, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.10% (2.0820 => 2.1257, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std.dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3059, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2092, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4830, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6854, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5889, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5997, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.14% (17.2379 => 14.2830, std.dev.: 0.0265) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9777, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8004, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -7.41% (0.2402 => 0.2224, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.80% (14.0481 => 13.5140, std.dev.: 0.1547) SingleSource/UnitTests/Vector/build2: -3.76% (11.2080 => 10.7865, std.dev.: 0.0132) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2240, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1222, std.dev.: 0.1040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5758, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1235, std.dev.: 0.0761) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0470, std.dev.: 0.0040) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 08:40:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 10:40:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118164046.48F892A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7725?compare_to=7722&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7725, Order: 172820, Start Time: 2013-01-18 15:07:13, End Time: 2013-01-18 16:40:54 To: 7722, Order: 172808, Start Time: 2013-01-18 13:10:20, End Time: 2013-01-18 14:44:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (95 on baseline) Performance Improvements: 0 (119 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.75% (0.0974 => 0.1556, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.42% (0.6395 => 0.8724, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.22% (0.1132 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.68% (0.6395 => 0.8613, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.42% (0.5805 => 0.7629, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.38% (0.5688 => 0.7473, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.05% (0.5456 => 0.7150, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.96% (0.6230 => 0.8159, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.69% (0.5849 => 0.7644, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.41% (0.5567 => 0.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.33% (0.5575 => 0.7266, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.21% (0.5581 => 0.7267, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.15% (0.5941 => 0.7732, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.85% (0.5802 => 0.7534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.54% (0.5705 => 0.7390, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.32% (0.6033 => 0.7802, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.99% (0.5570 => 0.7185, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.86% (0.5859 => 0.7550, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.77% (0.5478 => 0.7054, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.77% (0.5857 => 0.7542, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.62% (0.6440 => 0.8283, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.57% (0.5569 => 0.7160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.47% (0.5925 => 0.7612, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.17% (0.5591 => 0.7166, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.65% (0.6676 => 0.8522, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.64% (1.6474 => 2.1028, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.47% (0.6189 => 0.7889, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.45% (0.6052 => 0.7713, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.22% (0.5863 => 0.7459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.21% (0.6446 => 0.8200, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (0.6304 => 0.7982, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.67% (0.6194 => 0.7784, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.57% (0.6681 => 0.8389, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.28% (0.6297 => 0.7889, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.26% (0.6660 => 0.8342, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.95% (0.6667 => 0.8264, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.59% (0.7524 => 0.9224, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.76% (0.7339 => 0.8936, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.57% (2.2587 => 2.7233, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3152, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: 14.18% (0.3357 => 0.3833, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.51% (0.1982 => 0.2230, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.84% (4.5069 => 5.0404, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.25% (0.4916 => 0.5469, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 10.96% (0.4515 => 0.5010, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.85% (1.6364 => 1.8139, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.77% (3.5339 => 3.9145, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2385 => 0.2603, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.00% (0.7021 => 0.7583, std.dev.: 0.0133) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4524 => 0.4837, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 6.77% (1.2515 => 1.3362, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.61% (0.5329 => 0.5681, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4861 => 0.5173, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.2784 => 1.3584, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.18% (1.4642 => 1.5547, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (9.2283 => 9.7897, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/matrix: 5.38% (0.3255 => 0.3430, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.04% (0.3319 => 0.3453, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.03% (5.0226 => 5.1748, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.88% (5.4682 => 5.6256, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.3864 => 1.4178, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.25% (0.9557 => 0.9676, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.12% (1.3722 => 1.3876, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6649, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.71% (0.9531 => 1.0266, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6035, std.dev.: 0.1225) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1047, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2764, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6019, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2052, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4535, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.74% (0.1281 => 0.1105, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.13% (2.4924 => 2.3645, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.76% (0.3884 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.65% (0.3848 => 0.3669, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.59% (0.4033 => 0.3848, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.56% (0.7198 => 0.6870, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -4.45% (0.4176 => 0.3990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.35% (0.9852 => 0.9423, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.28% (0.2428 => 0.2324, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.85% (0.3142 => 0.3021, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.77% (0.6441 => 0.6198, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.63% (0.3057 => 0.2946, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4280 => 0.4125, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.55% (0.2903 => 0.2800, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.52% (0.7779 => 0.7505, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.37% (0.3205 => 0.3097, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.31% (0.3025 => 0.2925, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.25% (0.3323 => 0.3215, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.24% (1.3148 => 1.2722, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.23% (2.1713 => 2.1011, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.21% (0.9542 => 0.9236, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.16% (0.6484 => 0.6279, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.91% (0.4151 => 0.4030, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.71% (14.2083 => 13.8230, std.dev.: 0.0150) MultiSource/Applications/sqlite3/sqlite3: -2.43% (17.1032 => 16.6883, std.dev.: 0.0227) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.36% (0.7919 => 0.7732, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2878, std.dev.: 0.0255) MultiSource/Applications/JM/lencod/lencod: -2.33% (16.1920 => 15.8155, std.dev.: 0.0129) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.27% (6.7716 => 6.6182, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.00% (1.0544 => 1.0333, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.97% (1.2221 => 1.1980, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: -1.96% (4.3330 => 4.2481, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.96% (1.2210 => 1.1971, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9610, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.90% (1.2300 => 1.2066, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/football/football: -1.71% (0.9179 => 0.9022, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: -1.62% (0.7982 => 0.7853, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.43% (0.8521 => 0.8399, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.25% (8.0126 => 7.9128, std.dev.: 0.0066) MultiSource/Applications/hbd/hbd: -1.24% (1.5610 => 1.5417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.20% (34.0927 => 33.6820, std.dev.: 0.0210) MultiSource/Applications/siod/siod: -1.15% (2.4021 => 2.3744, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -1.08% (4.0594 => 4.0155, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.13% (1.8100 => 0.6855, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3098, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0237, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0237, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.00% (0.6299 => 0.5039, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0012) SingleSource/UnitTests/Vector/multiplies: -15.31% (2.5106 => 2.1262, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.31% (4.7378 => 4.1071, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.54% (0.5142 => 0.4600, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.64% (5.2027 => 4.8051, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6999, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fbench: -4.06% (2.2633 => 2.1714, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (7.9763 => 7.7885, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.7241 => 3.6515, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4652, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1905, std.dev.: 0.0302) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5996, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6084, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7092 => 3.6619, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3473, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.6086 => 1.5915, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 08:53:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 10:53:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118165304.84F692A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7726?compare_to=7721&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7726, Order: 172820, Start Time: 2013-01-18 14:53:03, End Time: 2013-01-18 16:53:15 To: 7721, Order: 172808, Start Time: 2013-01-18 12:33:50, End Time: 2013-01-18 14:34:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (9 on baseline) Performance Improvements: 3 (47 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1057 (1007 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.35% (0.6213 => 0.6359, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 3.95% (50.8333 => 52.8437, std.dev.: 0.4690) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (63.4314 => 64.3636, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.24% (5.1995 => 5.2640, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.89% (0.9819 => 0.9535, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -11.45% (21.9434 => 19.4302, std.dev.: 0.5936) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.83% (3.5760 => 3.5107, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.29% (1.1217 => 1.1072, std.dev.: 0.2337) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -29.46% (0.0224 => 0.0158, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.96% (0.0429 => 0.0382, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0341 => 0.0339, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0430 => 0.0432, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -39.91% (0.0223 => 0.0134, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.24% (0.0229 => 0.0217, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.91% (0.1435 => 0.1448, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: -1.24% (1.1764 => 1.1618, std.dev.: 0.3819) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.50% (0.3980 => 0.4000, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.63% (0.1532 => 0.1507, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.32% (0.0934 => 0.0993, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.50% (0.0267 => 0.0271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.75% (0.0546 => 0.0561, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1497 => 1.1542, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -10.00% (0.0030 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.08% (0.0026 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0608 => 0.0604, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.97% (0.0311 => 0.0252, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.69% (0.7515 => 0.7388, std.dev.: 0.1642) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 109.09% (0.0044 => 0.0092, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.48% (12.8291 => 12.7676, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.24% (0.0336 => 0.0488, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321737.50% (0.0008 => 2.5747, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.66% (1.1825 => 2.3610, std.dev.: 0.0371) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.19% (0.2562 => 0.2823, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.73% (3.7074 => 3.8826, std.dev.: 0.0439) SingleSource/Benchmarks/Linpack/linpack-pc: 3.83% (50.8945 => 52.8437, std.dev.: 0.4690) SingleSource/Benchmarks/Misc/pi: 3.51% (2.1390 => 2.2141, std.dev.: 0.0025) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.44% (9.0082 => 9.2278, std.dev.: 0.0518) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (63.1520 => 64.3636, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.71% (0.0808 => 0.0471, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.10% (0.1684 => 0.1295, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.20% (0.1009 => 0.0785, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.75% (0.0676 => 0.0529, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.26% (1.0960 => 0.8959, std.dev.: 0.0441) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.98% (0.0862 => 0.0707, std.dev.: 0.0026) MultiSource/Benchmarks/SciMark2-C/scimark2: -15.37% (0.4074 => 0.3448, std.dev.: 0.0171) SingleSource/UnitTests/Vector/constpool: -13.16% (9.8875 => 8.5863, std.dev.: 0.1969) MultiSource/Applications/spiff/spiff: -12.69% (1.0220 => 0.8923, std.dev.: 0.0499) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.45% (0.2481 => 0.2172, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: -10.55% (2.4719 => 2.2112, std.dev.: 0.0878) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.32% (1.5131 => 1.3569, std.dev.: 0.0312) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.27% (1.3924 => 1.2494, std.dev.: 0.0500) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.39% (10.2703 => 9.3059, std.dev.: 0.1413) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.89% (0.9124 => 0.8313, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.85% (1.1498 => 1.0480, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.64% (0.6885 => 0.6359, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.76% (0.2100 => 0.1958, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.46% (1.3310 => 1.2450, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/fibo: -6.38% (0.2006 => 0.1878, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.76% (0.2884 => 0.2718, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.69% (0.3394 => 0.3201, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.34% (1.3220 => 1.2646, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.20% (0.9422 => 0.9026, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.98% (0.9512 => 0.9133, std.dev.: 0.0080) MultiSource/Benchmarks/sim/sim: -3.88% (0.3715 => 0.3571, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.70% (0.8990 => 0.8657, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.66% (5.0381 => 4.8537, std.dev.: 0.0563) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.63% (1.0052 => 0.9687, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.57% (0.9091 => 0.8766, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.42% (0.9403 => 0.9081, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.71% (0.9061 => 0.8906, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: -1.16% (9.5202 => 9.4097, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.08% (0.9372 => 0.6459, std.dev.: 0.0714) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.73% (0.4081 => 0.3643, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.43% (1.4588 => 1.3358, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/health/health: -6.54% (0.3654 => 0.3415, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.29% (0.3349 => 0.3172, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.39% (1.4446 => 1.3812, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout-C++/lists: -3.34% (17.2182 => 16.6429, std.dev.: 0.2050) SingleSource/Benchmarks/Misc/mandel-2: -1.95% (0.8521 => 0.8355, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -1.85% (14.0297 => 13.7698, std.dev.: 0.0635) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.39% (3.5669 => 3.5172, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.23% (5.9063 => 5.8338, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.09% (3.1921 => 3.1573, std.dev.: 0.0077) MultiSource/Benchmarks/BitBench/five11/five11: -1.00% (5.7021 => 5.6448, std.dev.: 0.0081) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.09% (1.2047 => 1.1072, std.dev.: 0.2337) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -32.19% (0.0233 => 0.0158, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.30% (0.0451 => 0.0382, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -40.97% (0.0227 => 0.0134, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.90% (0.0255 => 0.0217, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.36% (0.1530 => 0.1448, std.dev.: 0.0109) MultiSource/Applications/lemon/lemon: -39.78% (1.9293 => 1.1618, std.dev.: 0.3819) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.21% (0.4049 => 0.4000, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1510 => 0.1507, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0978 => 0.0993, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.81% (0.0276 => 0.0271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.65% (1.1617 => 1.1542, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.62% (0.0032 => 0.0027, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.97% (0.0268 => 0.0252, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.66% (0.7437 => 0.7388, std.dev.: 0.1642) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0092 => 0.0092, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7676, std.dev.: 0.0099) Report Time: 0.72s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 09:50:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 11:50:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118175032.7D8862A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7727?compare_to=7723&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7727, Order: 172824, Start Time: 2013-01-18 15:39:31, End Time: 2013-01-18 17:50:41 To: 7723, Order: 172808, Start Time: 2013-01-18 12:58:07, End Time: 2013-01-18 15:09:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (212 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (658 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.77% (0.6755 => 0.6500, std.dev.: 0.0097) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.07% (0.1334 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0415 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0652 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8541 => 499.8455, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.33% (1.1277 => 499.8455, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.92% (0.5229 => 1.6415, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 19.49% (14.9895 => 17.9111, std.dev.: 0.0157) MultiSource/Applications/kimwitu++/kc: 42.40% (14.1553 => 20.1571, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 16.92% (4.1105 => 4.8060, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.33% (1.1048 => 1.7271, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.97% (7.1582 => 37.3633, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.60% (3.4629 => 6.3578, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.85% (0.6222 => 1.0817, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.11% (0.0720 => 7.4420, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11171600.00% (0.0001 => 11.1717, std.dev.: 0.0435) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482700.00% (0.0001 => 5.4828, std.dev.: 0.0373) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.09% (1.1194 => 10.3443, std.dev.: 0.0079) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782) MultiSource/Applications/ClamAV/clamscan: 149.08% (22.1758 => 55.2352, std.dev.: 0.0232) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.74% (0.0929 => 0.1772, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.20% (2.9384 => 4.6192, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.71% (7.0540 => 10.8429, std.dev.: 0.0056) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.70% (1.5859 => 2.3899, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.49% (8.1363 => 11.9191, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.05% (0.0439 => 0.0628, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.80% (2.2024 => 3.1010, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 38.98% (0.3109 => 0.4321, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.20% (21.9371 => 30.3160, std.dev.: 0.0188) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.44% (0.1062 => 0.1449, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.28% (4.2646 => 5.6838, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.62% (1.5415 => 2.0443, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.05% (0.4615 => 0.6094, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.60% (0.1892 => 0.2471, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.68% (0.2271 => 0.2945, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.24% (0.4299 => 0.5556, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 28.23% (1.1642 => 1.4928, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.00% (0.6675 => 0.8544, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 26.28% (0.1655 => 0.2090, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.19% (0.5105 => 0.6442, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.36% (3.8922 => 4.8793, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.05% (0.0479 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 24.94% (0.2554 => 0.3191, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 24.68% (1.0722 => 1.3368, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.59% (0.0793 => 0.0988, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 23.81% (0.4289 => 0.5310, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.63% (0.1566 => 0.1936, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.39% (0.3121 => 0.3851, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 23.32% (0.1175 => 0.1449, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.13% (1.4186 => 1.7467, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 22.96% (0.1337 => 0.1644, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 22.75% (0.4620 => 0.5671, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.66% (0.1143 => 0.1402, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.39% (9.4845 => 11.6084, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.71% (0.1695 => 0.2063, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.42% (0.7115 => 0.8639, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.98% (0.0672 => 0.0813, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.96% (0.0730 => 0.0883) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.89% (0.2700 => 0.3264, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 20.59% (0.3098 => 0.3736, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.47% (5.7591 => 6.9381, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/lists: 20.45% (0.0626 => 0.0754, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.38% (1.3050 => 1.5709, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 20.23% (0.7835 => 0.9420, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.15% (0.1236 => 0.1485, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 19.92% (0.0527 => 0.0632, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 19.79% (0.0662 => 0.0793, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.73% (0.1029 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.70% (0.0675 => 0.0808, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.60% (0.0842 => 0.1007) MultiSource/Benchmarks/Olden/em3d/em3d: 19.47% (0.1695 => 0.2025, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 19.45% (0.6456 => 0.7712, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.35% (0.1163 => 0.1388, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.20% (4.9449 => 5.8944, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.20% (0.5860 => 0.6985, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.98% (0.8172 => 0.9723, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.58% (5.0018 => 5.9312, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.45% (0.1940 => 0.2298, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 18.31% (3.3354 => 3.9460, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 18.24% (0.0614 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.06% (0.0886 => 0.1046, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.59% (0.0648 => 0.0762, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.59% (0.5020 => 0.5903, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.42% (0.3307 => 0.3883, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 17.27% (0.1268 => 0.1487, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.08% (0.5569 => 0.6520, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.07% (0.9765 => 1.1432, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 17.06% (1.1840 => 1.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.02% (0.1510 => 0.1767, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.98% (0.2049 => 0.2397, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.94% (0.2107 => 0.2464, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 16.92% (0.1117 => 0.1306, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 16.78% (0.7433 => 0.8680, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 16.59% (0.3423 => 0.3991, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.47% (3.8723 => 4.5099, std.dev.: 0.0057) MultiSource/Applications/treecc/treecc: 16.35% (2.0273 => 2.3588, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.32% (0.5981 => 0.6957, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.17% (0.2065 => 0.2399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.08% (0.3283 => 0.3811, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.78% (0.3441 => 0.3984, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 15.66% (0.3232 => 0.3738, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.65% (0.8101 => 0.9369, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.41% (0.6450 => 0.7444, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 15.37% (2.2969 => 2.6499, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.86% (0.8921 => 1.0247, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.85% (0.1044 => 0.1199, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 14.50% (0.3180 => 0.3641, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.27% (1.1861 => 1.3554, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary2: 14.15% (0.3379 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.81% (0.8067 => 0.9181, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.52% (0.2603 => 0.2955, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 12.94% (0.3865 => 0.4365, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.77% (0.4636 => 0.5228, std.dev.: 0.0079) MultiSource/Applications/hbd/hbd: 12.27% (1.5603 => 1.7517, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.94% (0.4203 => 0.4705, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.75% (0.4103 => 0.4585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3603 => 0.4013, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.1268 => 0.1412, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.31% (0.4048 => 0.4506, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.16% (0.3422 => 0.3804, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.11% (17.1811 => 19.0907, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 11.05% (0.3684 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.91% (0.2430 => 0.2695, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 10.58% (0.3092 => 0.3419, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.48% (0.3826 => 0.4227, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 10.34% (0.3828 => 0.4224, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.33% (0.4064 => 0.4484, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.28% (14.3668 => 15.8431, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.89% (0.3427 => 0.3766, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.77% (0.3694 => 0.4055, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3561 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.73% (0.3516 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.64% (0.2831 => 0.3104, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 9.33% (0.2871 => 0.3139, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.75% (2.0665 => 2.2473, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.48% (0.2877 => 0.3121, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.45% (0.2793 => 0.3029, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 8.34% (1.2842 => 1.3913, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.30% (0.2905 => 0.3146, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.30% (63.2438 => 68.4904, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2891 => 0.3130, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.22% (0.2725 => 0.2949, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.11% (0.3650 => 0.3946, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.96% (0.3052 => 0.3295, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 7.96% (0.2802 => 0.3025, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3935 => 0.4240, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.55% (2.2022 => 2.3684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.41% (0.6030 => 0.6477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.40% (0.3136 => 0.3368, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.28% (0.7326 => 0.7859, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 7.19% (0.5925 => 0.6351, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.60% (0.4879 => 0.5201, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 5.61% (10.3673 => 10.9486, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.09% (7.9617 => 8.1279, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2454, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.14% (1.1396 => 1.2438, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4475, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3135, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0065) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.38% (0.9957 => 1.0294, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9112, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.36% (3.6395 => 3.7255, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 2.09% (9.1159 => 9.3068, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2835, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.74% (5.2763 => 1.1745, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.54% (0.1622 => 0.0932, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4671, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.52% (5.3526 => 4.4686, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0186, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.83% (1.7609 => 1.6230, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9617, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.80% (1.9577 => 0.6500, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3075, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4263, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8613, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0036, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0060) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.18% (1.6925 => 1.4187, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2807, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.92% (4.8142 => 4.4812, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7035, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7995, std.dev.: 0.0228) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.92% (3.2827 => 3.1540, std.dev.: 0.0014) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3302, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.48% (3.7221 => 3.6671, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout/ary3: -1.44% (3.6994 => 3.6461, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/lists: -1.20% (6.2999 => 6.2246, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std.dev.: 0.0085) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0010) Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 10:37:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 12:37:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118183739.E82142A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7728?compare_to=7725&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7728, Order: 172824, Start Time: 2013-01-18 17:04:15, End Time: 2013-01-18 18:37:47 To: 7725, Order: 172820, Start Time: 2013-01-18 15:07:13, End Time: 2013-01-18 16:40:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (97 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.49% (0.3739 => 0.4019, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.21% (0.6855 => 0.7075, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.39% (0.0717 => 0.1193, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.75% (0.0974 => 0.1556, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.73% (0.0599 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.26% (0.6395 => 0.8714, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.54% (0.6395 => 0.8604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.59% (0.5688 => 0.7485, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.49% (0.5805 => 0.7633, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.03% (0.5456 => 0.7149, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.82% (0.6230 => 0.8150, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.50% (0.5849 => 0.7633, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.48% (0.5567 => 0.7264, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.39% (0.5575 => 0.7269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.25% (0.5581 => 0.7269, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.23% (0.5941 => 0.7737, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.99% (0.5802 => 0.7542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.52% (0.6033 => 0.7814, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.48% (0.5705 => 0.7387, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.92% (0.5570 => 0.7181, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.90% (0.6440 => 0.8301, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.81% (0.5859 => 0.7547, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.71% (0.5478 => 0.7051, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.63% (0.5857 => 0.7534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.53% (0.5569 => 0.7158, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.52% (0.5925 => 0.7615, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.17% (0.5591 => 0.7166, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.74% (0.6676 => 0.8528, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.57% (0.6189 => 0.7895, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.55% (1.6474 => 2.1013, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.53% (0.6052 => 0.7718, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.49% (0.5863 => 0.7475, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.40% (0.6446 => 0.8212, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (0.6304 => 0.7982, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.82% (0.6681 => 0.8406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.56% (0.6194 => 0.7777, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.21% (0.6660 => 0.8339, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.20% (0.6297 => 0.7884, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.85% (0.6667 => 0.8257, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.29% (0.0790 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.50% (0.7524 => 0.9217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.83% (0.7339 => 0.8941, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.47% (2.2587 => 2.7211, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.18% (0.1146 => 0.1320, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.83% (1.1450 => 1.3148, std.dev.: 0.0049) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.41% (0.1081 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.80% (4.5069 => 5.0388, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.09% (0.4916 => 0.5461, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 10.87% (0.4515 => 0.5006, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.85% (1.6364 => 1.8139, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.75% (3.5339 => 3.9138, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.14% (0.2385 => 0.2603, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.89% (0.7021 => 0.7575, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.56% (0.4524 => 0.4866, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.25% (0.2001 => 0.2146, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.80% (1.2515 => 1.3366, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.57% (0.5329 => 0.5679, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4861 => 0.5173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.28% (1.2784 => 1.3587, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.20% (1.4642 => 1.5550, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.09% (9.2283 => 9.7900, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3255 => 0.3428, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.83% (0.3834 => 0.4019, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3319 => 0.3461, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.08% (5.0226 => 5.1771, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.84% (5.4682 => 5.6234, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 2.80% (0.6750 => 0.6939, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 2.39% (1.3864 => 1.4195, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.81% (0.8418 => 0.8570, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.25% (0.9557 => 0.9676, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.41% (31.3723 => 55.6571, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.62% (0.9531 => 1.0257, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.02% (1.2783 => 1.3681, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4940, std.dev.: 0.1016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6051, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.59% (5.1955 => 5.2779, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2070, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.16% (2.4924 => 2.3638, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -4.75% (0.3831 => 0.3649, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.64% (0.4033 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.7198 => 0.6867, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -4.53% (0.4176 => 0.3987, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.48% (0.9852 => 0.9411, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.03% (0.6347 => 0.6091, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/property: -3.93% (0.4199 => 0.4034, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.77% (0.6441 => 0.6198, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.69% (0.3142 => 0.3026, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.63% (0.3057 => 0.2946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4280 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.43% (0.3205 => 0.3095, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.35% (0.3016 => 0.2915, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.28% (0.7779 => 0.7524, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -3.27% (0.3059 => 0.2959, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.27% (2.1713 => 2.1004, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.16% (0.9542 => 0.9240, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.10% (0.6484 => 0.6283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.00% (1.3148 => 1.2754, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.78% (14.2083 => 13.8126, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.77% (0.4151 => 0.4036, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.43% (17.1032 => 16.6878, std.dev.: 0.0123) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.35% (6.7716 => 6.6126, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.34% (20.7746 => 20.2892, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: -2.26% (16.1920 => 15.8257, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: -2.06% (4.3330 => 4.2437, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.95% (1.0544 => 1.0338, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.89% (1.2221 => 1.1990, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.88% (1.2210 => 1.1980, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -1.87% (7.0961 => 6.9634, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.53% (1.2300 => 1.2112, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.42% (0.8521 => 0.8400, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.27% (1.5610 => 1.5411, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.27% (8.0126 => 7.9110, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -1.25% (2.4021 => 2.3720, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.25% (34.0927 => 33.6678, std.dev.: 0.0244) MultiSource/Applications/lua/lua: -1.08% (4.0594 => 4.0157, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.91% (1.8100 => 0.7075, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7500, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0253, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1310, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3400, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8194, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.67% (7.9763 => 7.7636, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2759, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/ary3: -2.42% (3.7241 => 3.6339, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.86% (1.6307 => 1.6004, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4624, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1947, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6015, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5902, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6688, std.dev.: 0.0141) MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4366, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 11:09:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 13:09:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118190911.3833C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7729?compare_to=7726&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7729, Order: 172824, Start Time: 2013-01-18 17:10:21, End Time: 2013-01-18 19:09:22 To: 7726, Order: 172820, Start Time: 2013-01-18 14:53:03, End Time: 2013-01-18 16:53:15 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (9 on baseline) Performance Improvements: 1 (88 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1058 (966 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.02% (1.5144 => 1.5298, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.92% (1.7209 => 1.8744, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/heapsort: 5.39% (3.1530 => 3.3228, std.dev.: 0.0530) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.31% (0.3353 => 0.3531, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.52% (6.9829 => 7.2984, std.dev.: 0.1037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.81% (4.4318 => 4.3515, std.dev.: 0.0139) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.15% (1.1072 => 1.1199, std.dev.: 0.0275) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 41.77% (0.0158 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.02% (0.0382 => 0.0405, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.29% (0.0339 => 0.0340, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0432 => 0.0434, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -2.88% (0.0208 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 32.84% (0.0134 => 0.0178, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.69% (0.0217 => 0.0225, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1448 => 0.1452, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -2.53% (1.1618 => 1.1324, std.dev.: 0.1574) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.98% (0.4000 => 0.3961, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1507 => 0.1504, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.82% (0.0993 => 0.0965, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.52% (0.0271 => 0.0191, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.63% (0.0561 => 0.0535, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.1542 => 1.1494, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 7.41% (0.0027 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 114.29% (0.0007 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.92% (0.0604 => 0.0532, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.54% (0.0252 => 0.0271, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.28% (0.7388 => 0.7409, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7676 => 12.7855, std.dev.: 0.0423) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.11% (0.0336 => 0.0501, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.43% (1.8651 => 1.8917, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319575.00% (0.0008 => 2.5574, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.25% (1.1825 => 2.3679, std.dev.: 0.0241) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.36% (0.2562 => 0.2853, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 4.54% (3.7074 => 3.8757, std.dev.: 0.0599) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.24% (7.0016 => 7.2984, std.dev.: 0.1037) SingleSource/Benchmarks/Misc/pi: 3.58% (2.1390 => 2.2156, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: 2.66% (6.8159 => 6.9970, std.dev.: 0.0352) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -43.32% (0.0808 => 0.0458, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.29% (0.0727 => 0.0485, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.75% (0.0692 => 0.0500, std.dev.: 0.0036) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.16% (0.1684 => 0.1294, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.12% (0.1009 => 0.0806, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -19.33% (1.8964 => 1.5298, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -16.73% (9.8875 => 8.2331, std.dev.: 0.3304) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.03% (1.0986 => 0.9445, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: -13.57% (1.5979 => 1.3810, std.dev.: 0.0168) MultiSource/Applications/spiff/spiff: -12.76% (1.0220 => 0.8916, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.92% (0.0889 => 0.0783, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -11.90% (0.1378 => 0.1214, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -11.41% (1.1433 => 1.0128, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.30% (0.2372 => 0.2104, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.13% (6.4235 => 5.7087, std.dev.: 0.0648) MultiSource/Applications/sgefa/sgefa: -10.14% (0.3598 => 0.3233, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: -9.79% (17.5634 => 15.8446, std.dev.: 0.4234) MultiSource/Applications/siod/siod: -9.11% (2.6437 => 2.4028, std.dev.: 0.0226) MultiSource/Applications/ClamAV/clamscan: -8.57% (17.4365 => 15.9420, std.dev.: 0.1212) SingleSource/Benchmarks/McGill/chomp: -8.48% (0.1793 => 0.1641, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.39% (1.6874 => 1.5459, std.dev.: 0.0522) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.74% (0.1317 => 0.1215, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: -7.18% (3.7840 => 3.5124, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.90% (0.2100 => 0.1955, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -6.66% (1.3979 => 1.3048, std.dev.: 0.0221) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.40% (0.2283 => 0.2137, std.dev.: 0.0007) SingleSource/Benchmarks/Linpack/linpack-pc: -6.39% (0.2566 => 0.2402, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -6.28% (0.2006 => 0.1880, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: -6.02% (0.5134 => 0.4825, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/moments: -5.77% (0.4002 => 0.3771, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: -5.65% (0.1928 => 0.1819, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.2385 => 0.2253, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.42% (0.7693 => 0.7276, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.38% (0.9550 => 0.9036, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: -5.20% (1.4392 => 1.3644, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.17% (0.3462 => 0.3283, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.85% (0.2618 => 0.2491, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: -4.78% (0.2551 => 0.2429, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: -4.76% (0.2564 => 0.2442, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: -4.70% (0.2725 => 0.2597, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.64% (0.3665 => 0.3495, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -4.49% (0.3206 => 0.3062, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.45% (0.3981 => 0.3804, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -4.44% (0.4689 => 0.4481, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.33% (0.3093 => 0.2959, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.29% (0.6996 => 0.6696, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.16% (0.2884 => 0.2764, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.14% (1.3220 => 1.2673, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.10% (0.5369 => 0.5149, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3394 => 0.3259, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -3.95% (0.6711 => 0.6446, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: -3.94% (0.2665 => 0.2560, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.85% (4.6579 => 4.4786, std.dev.: 0.0189) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.64% (1.2680 => 1.2218, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.09% (0.9214 => 0.8929, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.00% (0.9403 => 0.9121, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.86% (14.9757 => 14.5475, std.dev.: 0.0912) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.80% (7.2721 => 7.0688, std.dev.: 0.0673) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.75% (0.4762 => 0.4631, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.41% (4.8904 => 4.7723, std.dev.: 0.0394) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -25.73% (4.4739 => 3.3228, std.dev.: 0.0530) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.24% (4.2042 => 3.1431, std.dev.: 0.0732) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.31% (0.1164 => 0.0916, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.99% (1.0816 => 0.8546, std.dev.: 0.0777) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.19% (0.4081 => 0.3665, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/hash: -9.75% (4.5259 => 4.0844, std.dev.: 0.1659) SingleSource/Benchmarks/Shootout/nestedloop: -9.41% (0.2200 => 0.1993, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: -9.08% (0.6628 => 0.6026, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.10% (4.4540 => 4.0933, std.dev.: 0.0563) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.17% (1.4588 => 1.3542, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.59% (0.3201 => 0.2990, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: -6.29% (0.3654 => 0.3424, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/ary3: -6.06% (2.2304 => 2.0953, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.55% (0.3349 => 0.3163, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.64% (1.4446 => 1.3776, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/ffbench: -4.28% (1.4244 => 1.3635, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: -3.44% (1.8123 => 1.7499, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6328, std.dev.: 0.0607) MultiSource/Applications/SIBsim4/SIBsim4: -3.34% (3.5443 => 3.4258, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -3.29% (4.4730 => 4.3257, std.dev.: 0.0308) MultiSource/Applications/spiff/spiff: -2.51% (2.8571 => 2.7855, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.96% (0.5826 => 0.5712, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -1.77% (14.0297 => 13.7812, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: -1.32% (8.6447 => 8.5306, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/methcall: -1.15% (8.7416 => 8.6408, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.03% (3.5669 => 3.5303, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.04% (1.2047 => 1.1199, std.dev.: 0.0275) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.20% (0.0451 => 0.0405, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -5.16% (0.0213 => 0.0202, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -21.59% (0.0227 => 0.0178, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.76% (0.0255 => 0.0225, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.10% (0.1530 => 0.1452, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -41.31% (1.9293 => 1.1324, std.dev.: 0.1574) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.17% (0.4049 => 0.3961, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1510 => 0.1504, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.33% (0.0978 => 0.0965, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.32% (0.0590 => 0.0535, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.06% (1.1617 => 1.1494, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -44.44% (0.0027 => 0.0015, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.79% (0.0610 => 0.0532, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.12% (0.0268 => 0.0271, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (12.7781 => 12.7855, std.dev.: 0.0423) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 11:42:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 13:42:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130118194226.F39662A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7730?compare_to=7724&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7730, Order: 172824, Start Time: 2013-01-18 16:07:44, End Time: 2013-01-18 19:42:31 To: 7724, Order: 172801, Start Time: 2013-01-18 11:42:28, End Time: 2013-01-18 15:17:06 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.09% (0.7441 => 0.7820, std.dev.: 0.0065) MultiSource/Applications/JM/lencod/lencod: 1.05% (5.1824 => 5.2366, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.29% (54.1425 => 54.8430, std.dev.: 0.0373) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.56% (2.4623 => 2.4238, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 52.00% (0.0625 => 0.0950, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.69% (0.1063 => 0.1453, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.54% (0.5900 => 0.7820, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.95% (0.0475 => 0.0622, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.93% (0.1106 => 0.1437, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 28.18% (0.1107 => 0.1419, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.06% (0.2969 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.77% (0.4253 => 0.5434, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.01% (0.0822 => 0.1044, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.75% (0.4994 => 0.6330, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.48% (0.4139 => 0.5235, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.39% (0.0642 => 0.0805, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.35% (0.0714 => 0.0895, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 25.05% (1.5932 => 1.9923, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.30% (0.5000 => 0.6215, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.95% (0.1620 => 0.2008, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 22.15% (0.0948 => 0.1158, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.85% (0.3903 => 0.4756, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.76% (0.1604 => 0.1953, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 21.68% (0.1619 => 0.1970, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.41% (0.1462 => 0.1775, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.06% (1.3152 => 1.5922, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.65% (0.2736 => 0.3301, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 20.49% (0.0947 => 0.1141, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.27% (0.2866 => 0.3447, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 20.08% (0.4029 => 0.4838, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.96% (0.3271 => 0.3924, std.dev.: 0.0059) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.67% (0.1088 => 0.1302, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.66% (0.2014 => 0.2410, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.51% (0.3890 => 0.4649, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.95% (0.1968 => 0.2341, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 18.91% (0.5546 => 0.6595, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.35% (0.0605 => 0.0716, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.34% (0.5026 => 0.5948, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 18.20% (1.8794 => 2.2215, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.16% (0.4658 => 0.5504, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.08% (3.5627 => 4.2069, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.02% (1.6211 => 1.9132, std.dev.: 0.0104) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.50% (0.4361 => 0.5124, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 17.49% (0.5889 => 0.6919, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.43% (0.2875 => 0.3376, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.38% (0.2738 => 0.3214, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 17.29% (0.1284 => 0.1506, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 17.11% (0.2811 => 0.3292, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 17.04% (0.2823 => 0.3304, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.03% (0.2725 => 0.3189, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 16.98% (0.2750 => 0.3217, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 16.97% (0.9697 => 1.1343, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.87% (0.2911 => 0.3402, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 16.86% (1.0781 => 1.2599, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 16.80% (0.2714 => 0.3170, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 16.78% (0.2813 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.77% (0.2803 => 0.3273, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.74% (0.3930 => 0.4588, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.70% (2.0673 => 2.4125, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 16.61% (0.9909 => 1.1555, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 16.57% (0.7171 => 0.8359, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.34% (4.4195 => 5.1417, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wc: 16.31% (0.3096 => 0.3601, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/ary3: 16.28% (0.3267 => 0.3799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 16.22% (0.3317 => 0.3855, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.19% (1.9694 => 2.2882, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.18% (0.3195 => 0.3712, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.06% (2.7292 => 3.1676, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: 16.05% (0.3258 => 0.3781, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.88% (0.3060 => 0.3546, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.85% (1.9966 => 2.3130, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: 15.83% (4.2109 => 4.8776, std.dev.: 0.0254) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.64% (0.3625 => 0.4192, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.62% (0.3124 => 0.3612, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 15.46% (0.4146 => 0.4787, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 15.46% (0.3726 => 0.4302, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.42% (0.3845 => 0.4438, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.38% (0.3362 => 0.3879, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 15.35% (0.2566 => 0.2960, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 15.29% (0.3348 => 0.3860, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.16% (0.3477 => 0.4004, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 15.06% (1.4269 => 1.6418, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 15.04% (0.3678 => 0.4231, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 15.03% (0.4251 => 0.4890, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.92% (0.3981 => 0.4575, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 14.90% (23.5202 => 27.0250, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: 14.40% (0.3465 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.39% (0.3488 => 0.3990, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 14.28% (0.3446 => 0.3938, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.22% (0.3460 => 0.3952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 14.21% (0.3469 => 0.3962, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/for-in: 14.19% (0.3496 => 0.3992, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.19% (0.5012 => 0.5723, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.18% (0.3442 => 0.3930, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.11% (0.7875 => 0.8986, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/property: 13.89% (0.3650 => 0.4157, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3724 => 0.4236, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.70% (0.3643 => 0.4142, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.40% (4.6177 => 5.2366, std.dev.: 0.0061) MultiSource/Applications/SPASS/SPASS: 13.39% (5.5417 => 6.2836, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: 13.30% (2.1653 => 2.4532, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.13% (0.6435 => 0.7280, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 13.06% (0.2075 => 0.2346, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: 12.97% (0.2691 => 0.3040, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 12.96% (2.1013 => 2.3736, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.94% (0.1028 => 0.1161, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.14% (0.2068 => 0.2319, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 11.41% (0.3498 => 0.3897, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.19% (0.3084 => 0.3429, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.00% (0.4847 => 0.5380, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 10.99% (0.6634 => 0.7363, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.99% (0.5361 => 0.5950, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.52% (11.6398 => 12.8641, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.01% (0.7426 => 0.8169, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.49% (4.6926 => 5.1380, std.dev.: 0.0035) MultiSource/Applications/lemon/lemon: 9.45% (0.2391 => 0.2617, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.07% (2.0346 => 2.2191, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.58% (0.5584 => 0.6063, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 7.20% (11.9555 => 12.8167, std.dev.: 0.0179) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.91% (0.3792 => 0.3978, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5282, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.64% (0.3693 => 0.4049, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6763, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2349, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6890, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2072, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3021, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2867, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0800, std.dev.: 0.0113) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2096, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4811, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5887, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.12% (2.4764 => 2.4238, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5581, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.62% (17.2379 => 14.2012, std.dev.: 0.1164) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8060, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.80% (14.0481 => 13.5149, std.dev.: 0.1360) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2167, std.dev.: 0.0197) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.2043, std.dev.: 0.0301) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5743, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1753, std.dev.: 0.0554) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0461, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 12:34:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 14:34:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118203432.549992A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7731?compare_to=7728&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7731, Order: 172833, Start Time: 2013-01-18 19:01:13, End Time: 2013-01-18 20:34:41 To: 7728, Order: 172824, Start Time: 2013-01-18 17:04:15, End Time: 2013-01-18 18:37:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (870 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.86% (0.0974 => 0.1557, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.64% (0.0514 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.87% (0.1500 => 0.2173, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.45% (0.6395 => 0.8726, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.04% (0.1132 => 0.1540, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.75% (0.6395 => 0.8617, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.56% (0.5688 => 0.7483, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.49% (0.5805 => 0.7633, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.30% (0.5456 => 0.7164, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.96% (0.6230 => 0.8159, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.79% (0.5849 => 0.7650, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.47% (0.0699 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.44% (0.5575 => 0.7272, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.38% (0.5567 => 0.7258, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.30% (0.5581 => 0.7272, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.15% (0.5941 => 0.7732, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.92% (0.5802 => 0.7538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.59% (0.5705 => 0.7393, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.47% (0.6033 => 0.7811, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.03% (0.5478 => 0.7068, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.98% (0.5859 => 0.7557, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.92% (0.5570 => 0.7181, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.84% (0.5569 => 0.7175, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.84% (0.5857 => 0.7546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.73% (0.6440 => 0.8290, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.59% (0.5925 => 0.7619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.31% (0.5591 => 0.7174, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.74% (0.6189 => 0.7906, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.71% (0.6676 => 0.8526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.58% (0.6052 => 0.7721, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.53% (1.6474 => 2.1010, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.27% (0.6446 => 0.8204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.26% (0.5863 => 0.7461, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.81% (0.6304 => 0.7994, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.80% (0.6194 => 0.7792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.57% (0.6681 => 0.8389, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.38% (0.6660 => 0.8350, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.25% (0.6297 => 0.7887, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.85% (0.6667 => 0.8257, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.67% (0.7524 => 0.9230, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.95% (0.7339 => 0.8950, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.41% (2.2587 => 2.7197, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.10% (0.1146 => 0.1319, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.79% (1.1450 => 1.3144, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.69% (4.5069 => 5.0336, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.11% (0.4916 => 0.5462, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 10.90% (0.4515 => 0.5007, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.83% (1.6364 => 1.8137, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.72% (3.5339 => 3.9127, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.88% (0.7021 => 0.7574, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4524 => 0.4847, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 6.88% (1.2515 => 1.3376, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.64% (0.5329 => 0.5683, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.22% (1.4642 => 1.5553, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.2784 => 1.3576, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 6.13% (0.4861 => 0.5159, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.12% (0.1731 => 0.1837, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (9.2283 => 9.7818, std.dev.: 0.0179) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.92% (0.3319 => 0.3449, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.91% (5.0226 => 5.1690, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.80% (5.4682 => 5.6213, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 2.65% (0.6750 => 0.6929, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.27% (1.3864 => 1.4179, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.67% (0.8418 => 0.8559, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3874, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6622, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.56% (0.9531 => 1.0347, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.30% (54.5751 => 56.3786, std.dev.: 0.0894) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.15% (2.0478 => 2.1123, std.dev.: 0.0095) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.67% (0.6469 => 0.6642, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6050, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2771, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2074, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.08% (2.4924 => 2.3657, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.51% (0.3812 => 0.3640, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.7198 => 0.6874, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.44% (0.9852 => 0.9415, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.41% (0.3896 => 0.3724, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.41% (0.3831 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.39% (0.4033 => 0.3856, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.14% (0.6347 => 0.6084, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.12% (0.3323 => 0.3186, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -4.01% (0.2871 => 0.2756, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.96% (0.3057 => 0.2936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.94% (0.3884 => 0.3731, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.88% (0.3142 => 0.3020, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.83% (0.6441 => 0.6194, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -3.76% (0.4199 => 0.4041, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.76% (0.2849 => 0.2742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.75% (0.2933 => 0.2823, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.74% (0.3205 => 0.3085) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.65% (0.3016 => 0.2906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.56% (2.1713 => 2.0941, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: -3.53% (0.3059 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.41% (0.3252 => 0.3141, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.41% (1.3148 => 1.2700, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4280 => 0.4138, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.23% (0.7779 => 0.7528, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.20% (0.4151 => 0.4018, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.15% (0.9542 => 0.9241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.14% (0.3658 => 0.3543, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.12% (0.6484 => 0.6282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -2.79% (0.3621 => 0.3520, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.67% (14.2083 => 13.8284, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/lists1: -2.61% (0.3867 => 0.3766, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.57% (0.3931 => 0.3830, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2492, std.dev.: 0.0421) MultiSource/Applications/sqlite3/sqlite3: -2.44% (17.1032 => 16.6860, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.39% (0.4427 => 0.4321, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.30% (0.7919 => 0.7737, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.30% (6.7716 => 6.6161, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: -2.23% (16.1920 => 15.8314, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.08% (1.0544 => 1.0325, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (4.3330 => 4.2432, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (1.2210 => 1.1963, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.91% (1.2221 => 1.1987, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -1.90% (7.0961 => 6.9610, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.84% (1.2300 => 1.2074, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: -1.76% (0.9179 => 0.9017, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: -1.69% (0.7982 => 0.7847, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.68% (1.5610 => 1.5348, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (0.8521 => 0.8393, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.45% (34.0927 => 33.5986, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.30% (8.0126 => 7.9087, std.dev.: 0.0059) MultiSource/Applications/siod/siod: -1.28% (2.4021 => 2.3714, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.20% (4.0594 => 4.0107, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.23% (1.8100 => 0.7018, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2400, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0245, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0187, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3835, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.50% (3.7241 => 3.6309, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.41% (7.9763 => 7.7843, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2793, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.55% (1.6219 => 1.5968, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4743, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.3040 => 7.1971, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6688, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.04% (1.6307 => 1.6138, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 13:13:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 15:13:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118211336.067D32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7732?compare_to=7727&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7732, Order: 172833, Start Time: 2013-01-18 19:02:52, End Time: 2013-01-18 21:13:45 To: 7727, Order: 172824, Start Time: 2013-01-18 15:39:31, End Time: 2013-01-18 17:50:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.11% (0.6500 => 0.6767, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8455 => 499.8280, std.dev.: 0.0164) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 44222.78% (1.1277 => 499.8280, std.dev.: 0.0164) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.11% (0.5229 => 1.6425, std.dev.: 0.0029) MultiSource/Applications/SPASS/SPASS: 19.69% (14.9895 => 17.9413, std.dev.: 0.0154) MultiSource/Applications/kimwitu++/kc: 42.80% (14.1553 => 20.2137, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 17.20% (4.1105 => 4.8175, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.60% (1.1048 => 1.7301, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.58% (7.1582 => 37.4073, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.74% (3.4629 => 6.3628, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.35% (0.6222 => 1.0848, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10244.72% (0.0720 => 7.4482, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11156600.00% (0.0001 => 11.1567, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484500.00% (0.0001 => 5.4846, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.02% (1.1194 => 10.2987, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.62% (22.1758 => 55.1324, std.dev.: 0.0167) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 71.57% (0.1463 => 0.2510, std.dev.: 0.0038) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 62.77% (0.0231 => 0.0376, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.06% (2.9384 => 4.6151, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.02% (7.0540 => 10.8649, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.89% (1.5859 => 2.3930, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.66% (8.1363 => 11.9324, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.28% (0.0439 => 0.0629, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.86% (2.2024 => 3.1022, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.53% (0.3109 => 0.4338, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 38.42% (21.9371 => 30.3663, std.dev.: 0.0146) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.43% (4.2646 => 5.6903, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0447, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.26% (0.4615 => 0.6104, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.60% (0.1892 => 0.2471, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.16% (0.2271 => 0.2956, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.19% (0.4299 => 0.5554, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 28.63% (1.1642 => 1.4975, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.06% (0.6675 => 0.8548, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 26.59% (0.1655 => 0.2095, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.50% (0.5105 => 0.6458, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.47% (3.8922 => 4.8836, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.47% (0.0479 => 0.0601, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.38% (0.0457 => 0.0573, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.25% (0.2554 => 0.3199, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.97% (0.0793 => 0.0991, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.66% (1.0722 => 1.3366, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.58% (0.3121 => 0.3857, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.41% (0.1337 => 0.1650, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.40% (0.1175 => 0.1450, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.33% (1.4186 => 1.7495, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 23.20% (0.4620 => 0.5692, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.13% (0.1695 => 0.2087, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.75% (0.1143 => 0.1403, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 22.52% (9.4845 => 11.6206, std.dev.: 0.0505) MultiSource/Applications/minisat/minisat: 21.46% (0.7115 => 0.8642, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.10% (0.0730 => 0.0884, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.04% (0.2700 => 0.3268, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 20.98% (0.0672 => 0.0813, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 20.63% (5.7591 => 6.9473, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0527 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.49% (1.3050 => 1.5724, std.dev.: 0.0104) MultiSource/Applications/spiff/spiff: 20.47% (0.7835 => 0.9439, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.31% (0.1236 => 0.1487, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/messages-2: 20.09% (0.0662 => 0.0795, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.00% (0.0675 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 19.95% (0.0842 => 0.1010, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.83% (0.1029 => 0.1233, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.75% (0.6456 => 0.7731, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 19.60% (0.1163 => 0.1391, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.41% (4.9449 => 5.9045, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.38% (0.1032 => 0.1232, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.5860 => 0.6995, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 19.29% (0.1695 => 0.2022, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.83% (0.8172 => 0.9711, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.82% (0.0834 => 0.0991, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.61% (5.0018 => 5.9324, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 18.57% (0.0614 => 0.0728, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 18.19% (3.3354 => 3.9422, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.87% (0.5020 => 0.5917, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.69% (0.3307 => 0.3892, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.66% (0.2758 => 0.3245, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 17.28% (0.2049 => 0.2403, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.26% (0.5569 => 0.6530, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.22% (0.9765 => 1.1447, std.dev.: 0.0040) MultiSource/Benchmarks/nbench/nbench: 17.19% (1.1840 => 1.3875, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 17.06% (0.7433 => 0.8701, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.04% (0.2107 => 0.2466, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.02% (0.1510 => 0.1767, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.86% (0.3423 => 0.4000, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 16.63% (2.0273 => 2.3645, std.dev.: 0.0047) MultiSource/Applications/lua/lua: 16.53% (3.8723 => 4.5123, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.52% (0.5981 => 0.6969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.39% (0.3283 => 0.3821, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.03% (0.3232 => 0.3750, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.91% (0.8101 => 0.9390, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.72% (0.3441 => 0.3982, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.63% (0.6450 => 0.7458, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 15.55% (2.2969 => 2.6540, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.33% (0.1044 => 0.1204, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.8921 => 1.0254, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 14.84% (0.3180 => 0.3652, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3379 => 0.3871, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.32% (1.1861 => 1.3559, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.75% (0.8067 => 0.9176, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.32% (0.3865 => 0.4380, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.24% (0.4636 => 0.5250, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.14% (0.3387 => 0.3832, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 12.52% (1.5603 => 1.7556, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.36% (0.4103 => 0.4610, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.04% (0.4203 => 0.4709, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.83% (0.1268 => 0.1418, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.4048 => 0.4520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 11.66% (0.3422 => 0.3821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.60% (0.3603 => 0.4021, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.19% (17.1811 => 19.1043, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists1: 11.10% (0.3684 => 0.4093, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.83% (0.3092 => 0.3427, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3826 => 0.4233, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.31% (0.2871 => 0.3167, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.22% (14.3668 => 15.8353, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/strcat: 10.10% (0.2831 => 0.3117, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.98% (0.3427 => 0.3769, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.89% (0.3497 => 0.3843, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.85% (0.3543 => 0.3892, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 9.77% (0.3561 => 0.3909, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.73% (0.3516 => 0.3858, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.18% (0.2756 => 0.3009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.18% (2.0665 => 2.2562, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 8.95% (0.2725 => 0.2969, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.88% (0.2905 => 0.3163, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2891 => 0.3147, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.74% (0.3650 => 0.3969, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 8.73% (0.2714 => 0.2951, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.67% (1.2842 => 1.3955, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.63% (0.3162 => 0.3435, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.46% (0.2872 => 0.3115, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 8.32% (0.3052 => 0.3306, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.16% (0.3935 => 0.4256, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.15% (63.2438 => 68.3970, std.dev.: 0.0242) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.89% (0.7326 => 0.7904, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.78% (0.3136 => 0.3380, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.56% (2.2022 => 2.3687, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.4879 => 0.5200, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 4.71% (10.3673 => 10.8560, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.3131 => 0.3243, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (7.9617 => 8.1347, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.23% (32.5116 => 59.2462, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 9.08% (1.1396 => 1.2431, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4264, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4475, std.dev.: 0.0122) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3138, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.29% (0.9957 => 1.0285, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9186, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.25% (3.6395 => 3.7213, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.99% (9.1159 => 9.2977, std.dev.: 0.0144) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2857, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4585, std.dev.: 0.0424) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.75% (5.2763 => 1.1740, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.21% (5.3855 => 4.4589, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.61% (5.3526 => 4.4636, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -13.66% (10.4361 => 9.0109, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.94% (1.7609 => 1.6210, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9653, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.43% (1.9577 => 0.6767, std.dev.: 0.0046) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4287, std.dev.: 0.0105) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8627, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0074, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.31% (0.2161 => 0.1722, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.14% (3.1443 => 2.7311, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4939, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9126, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2790, std.dev.: 0.0348) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.26% (1.2373 => 1.1599, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7037, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8356, std.dev.: 0.0151) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3310, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.10% (3.6994 => 3.6587, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2347, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0136) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0010) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 13:36:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 15:36:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130118213614.BE0AF2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7733?compare_to=7729&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7733, Order: 172835, Start Time: 2013-01-18 19:29:58, End Time: 2013-01-18 21:36:25 To: 7729, Order: 172824, Start Time: 2013-01-18 17:10:21, End Time: 2013-01-18 19:09:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 29 (18 on baseline) Performance Improvements: 1 (19 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (1026 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 33.62% (0.1258 => 0.1681, std.dev.: 0.0161) MultiSource/Benchmarks/McCat/05-eks/eks: 17.92% (0.4681 => 0.5520, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/em3d/em3d: 17.66% (0.1886 => 0.2219, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 16.18% (0.9435 => 1.0962, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.26% (0.6696 => 0.7718, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.46% (0.8670 => 0.9837, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 11.65% (0.3280 => 0.3662, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: 8.19% (16.3259 => 17.6630, std.dev.: 0.3784) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.65% (44.0572 => 47.4272, std.dev.: 0.4006) MultiSource/Applications/kimwitu++/kc: 7.61% (18.2413 => 19.6299, std.dev.: 0.4067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.30% (1.0851 => 1.1643, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.41% (0.8763 => 0.9237, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.19% (0.8855 => 0.9315, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.92% (7.0688 => 7.4168, std.dev.: 0.1324) SingleSource/UnitTests/Vector/constpool: 4.57% (8.2331 => 8.6092, std.dev.: 0.0807) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.01% (1.4900 => 1.5348, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.65% (1.2673 => 1.3009, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 39.30% (0.6469 => 0.9011, std.dev.: 0.0184) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.51% (1.2693 => 1.6312, std.dev.: 0.0308) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.56% (0.8546 => 1.0816, std.dev.: 0.0681) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.41% (2.5690 => 2.9905, std.dev.: 0.0330) MultiSource/Benchmarks/Olden/treeadd/treeadd: 13.32% (0.3665 => 0.4153, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.86% (43.2192 => 47.9137, std.dev.: 1.7516) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.98% (9.2390 => 10.0683, std.dev.: 0.2464) MultiSource/Benchmarks/Olden/tsp/tsp: 5.76% (1.4917 => 1.5776, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.31% (1.2137 => 1.2539, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 1.83% (2.7855 => 2.8366, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: 1.10% (1.5678 => 1.5850, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 1.04% (8.5306 => 8.6195, std.dev.: 0.0188) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.75% (7.2984 => 7.0245, std.dev.: 0.0660) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 9.05% (1.1199 => 1.2213, std.dev.: 0.0650) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0224 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.67% (0.0405 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0340 => 0.0339, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0321 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0434 => 0.0432, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: 2.97% (0.0202 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 24.72% (0.0178 => 0.0222, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.44% (0.0225 => 0.0224, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.62% (0.1452 => 0.1461, std.dev.: 0.0333) MultiSource/Applications/lemon/lemon: 12.52% (1.1324 => 1.2742, std.dev.: 0.3022) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.78% (0.3961 => 0.4269, std.dev.: 0.0587) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.80% (0.1504 => 0.1477, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.35% (0.0965 => 0.1007, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 45.03% (0.0191 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.79% (0.0535 => 0.0582, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.78% (1.1494 => 1.1584, std.dev.: 0.0769) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 80.00% (0.0015 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.29% (0.0532 => 0.0608, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.81% (0.0271 => 0.0303, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.04% (0.7409 => 0.7406, std.dev.: 0.0526) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.89% (0.0074 => 0.0043, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (12.7855 => 12.7570, std.dev.: 0.0241) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.30% (0.0336 => 0.0505, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 15.58% (0.4776 => 0.5520, std.dev.: 0.0196) MultiSource/Benchmarks/Olden/em3d/em3d: 15.15% (0.1927 => 0.2219, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: 11.89% (0.3273 => 0.3662, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.43% (1.0017 => 1.0962, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.42% (0.8990 => 0.9837, std.dev.: 0.0083) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.41% (44.1538 => 47.4272, std.dev.: 0.4006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.14% (1.0867 => 1.1643, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.93% (0.2879 => 0.3021, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.52% (0.8912 => 0.9315, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: 3.67% (1.4805 => 1.5348, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322750.00% (0.0008 => 2.5828, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.82% (1.1825 => 2.3392, std.dev.: 0.0346) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.77% (9.0082 => 10.0683, std.dev.: 0.2464) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.92% (2.8778 => 2.9905, std.dev.: 0.0330) SingleSource/Benchmarks/Misc/pi: 3.61% (2.1390 => 2.2163, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 3.35% (6.8159 => 7.0439, std.dev.: 0.0417) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.96% (1.2298 => 1.2539, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.81% (0.0727 => 0.0503, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -12.93% (9.8875 => 8.6092, std.dev.: 0.0807) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.09% (1.0986 => 0.9658, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: -5.97% (0.4002 => 0.3763, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -4.87% (0.5134 => 0.4884, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -4.44% (0.2385 => 0.2279, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists: -3.85% (0.2725 => 0.2620, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.87% (0.9512 => 0.9239, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: -2.75% (0.4689 => 0.4560, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.60% (1.3220 => 1.3009, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -23.34% (4.4739 => 3.4299, std.dev.: 0.3332) SingleSource/Benchmarks/Shootout-C++/heapsort: -15.09% (4.2042 => 3.5696, std.dev.: 0.2212) SingleSource/Benchmarks/Shootout/hash: -9.37% (4.5259 => 4.1019, std.dev.: 0.1225) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.57% (1.4588 => 1.3338, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/lists1: -8.40% (0.6628 => 0.6071, std.dev.: 0.0215) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.30% (0.3217 => 0.2982, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/mandel-2: -2.14% (0.8521 => 0.8339, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.02% (3.1921 => 3.1596, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.38% (1.2047 => 1.2213, std.dev.: 0.0650) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.16% (0.0255 => 0.0224, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0333) MultiSource/Applications/lemon/lemon: -33.96% (1.9293 => 1.2742, std.dev.: 0.3022) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.43% (0.4049 => 0.4269, std.dev.: 0.0587) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.19% (0.1510 => 0.1477, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.97% (0.0978 => 0.1007, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.36% (0.0590 => 0.0582, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.1617 => 1.1584, std.dev.: 0.0769) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.06% (0.0268 => 0.0303, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0526) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -53.26% (0.0092 => 0.0043, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7781 => 12.7570, std.dev.: 0.0241) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 14:31:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 16:31:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130118223125.5BD2C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7734?compare_to=7731&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7734, Order: 172842, Start Time: 2013-01-18 20:57:54, End Time: 2013-01-18 22:31:34 To: 7731, Order: 172833, Start Time: 2013-01-18 19:01:13, End Time: 2013-01-18 20:34:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (94 on baseline) Performance Improvements: 0 (131 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (867 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.11% (0.0717 => 0.1191, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.55% (0.0974 => 0.1554, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.06% (0.0514 => 0.0797, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.47% (0.1500 => 0.2167, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.36% (0.0418 => 0.0570, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.20% (0.6395 => 0.8710, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.87% (0.1132 => 0.1538, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.32% (0.6395 => 0.8590, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.25% (0.6260 => 0.8279, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.54% (0.5688 => 0.7482, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.23% (0.5805 => 0.7618, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.12% (0.5456 => 0.7154, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.63% (0.6230 => 0.8138, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.57% (0.5849 => 0.7637, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.35% (0.5575 => 0.7267, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.28% (0.5581 => 0.7271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.25% (0.5567 => 0.7251, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.06% (0.5941 => 0.7727, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.75% (0.5802 => 0.7528, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.34% (0.6033 => 0.7803, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.24% (0.5705 => 0.7373, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.82% (0.5570 => 0.7175, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.79% (0.5478 => 0.7055, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.73% (0.5859 => 0.7542, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.70% (0.5857 => 0.7538, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.59% (0.6440 => 0.8281, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.44% (0.5569 => 0.7153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.34% (0.5925 => 0.7604, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.01% (0.5591 => 0.7157, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.70% (0.6676 => 0.8525, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.45% (0.6052 => 0.7713, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.29% (0.6189 => 0.7878, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.23% (0.6446 => 0.8201, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.18% (1.6474 => 2.0951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.12% (0.5863 => 0.7453, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.48% (0.6304 => 0.7973, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.46% (0.6194 => 0.7771, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.43% (0.6681 => 0.8380, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.14% (0.6297 => 0.7880, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.14% (0.6660 => 0.8334, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.73% (0.6667 => 0.8249, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.40% (0.7524 => 0.9209, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.58% (0.7339 => 0.8923, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.13% (0.0582 => 0.0705, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.12% (2.2587 => 2.7131, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.60% (1.1450 => 1.3122, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 13.85% (0.3357 => 0.3822, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.41% (4.5069 => 5.0213, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.94% (0.4916 => 0.5454, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.70% (1.6364 => 1.8115, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 10.70% (0.4515 => 0.4998, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.38% (3.5339 => 3.9008, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.97% (0.2385 => 0.2599, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.7021 => 0.7544, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.30% (0.2001 => 0.2147, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 6.64% (1.2515 => 1.3346, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.27% (0.5329 => 0.5663, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.12% (1.2784 => 1.3566, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.03% (0.4861 => 0.5154, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.97% (1.4642 => 1.5516, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 5.71% (9.2283 => 9.7550, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/matrix: 5.01% (0.3255 => 0.3418, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.80% (0.3319 => 0.3445, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.89% (5.0226 => 5.1679, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 2.56% (0.6750 => 0.6923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.16% (5.4682 => 5.5863, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 2.14% (1.3864 => 1.4161, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.28% (0.8418 => 0.8526, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.47% (31.3723 => 55.6773, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5107, std.dev.: 0.0402) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.24% (2.0478 => 2.1141, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.58% (0.6469 => 0.6636, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6052, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2770, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2070, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.16% (10.3489 => 10.4689, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.98% (0.3194 => 0.3003, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.40% (2.4924 => 2.3578, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -5.19% (0.3812 => 0.3614, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.12% (0.3848 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.06% (0.4033 => 0.3829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.06% (0.3896 => 0.3699, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.99% (0.3891 => 0.3697, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.87% (0.3837 => 0.3650, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.86% (0.4176 => 0.3973, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.63% (0.9852 => 0.9396, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.51% (0.3884 => 0.3709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.48% (0.4199 => 0.4011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.24% (0.6347 => 0.6078, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -4.14% (0.4280 => 0.4103, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -4.04% (0.6441 => 0.6181, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.86% (0.3057 => 0.2939, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.85% (0.3142 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.83% (0.2871 => 0.2761, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.82% (0.2903 => 0.2792, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.66% (0.3059 => 0.2947, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.61% (0.3016 => 0.2907, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.58% (2.1713 => 2.0936, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.57% (0.3025 => 0.2917, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -3.54% (0.2939 => 0.2835, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.47% (0.3026 => 0.2921, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -3.46% (1.3148 => 1.2693, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.9542 => 0.9218, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.37% (0.4151 => 0.4011, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.36% (0.7779 => 0.7518, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.34% (0.3658 => 0.3536, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.19% (0.6484 => 0.6277, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.90% (0.3931 => 0.3817, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -2.87% (0.3621 => 0.3517, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.81% (14.2083 => 13.8095, std.dev.: 0.0183) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2071, std.dev.: 0.0279) SingleSource/Benchmarks/Shootout-C++/lists1: -2.72% (0.3867 => 0.3762, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.67% (17.1032 => 16.6466, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.60% (0.4427 => 0.4312, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -2.57% (16.1920 => 15.7762, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.43% (6.7716 => 6.6069, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.39% (0.7919 => 0.7730, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -2.33% (0.7982 => 0.7796, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: -2.30% (4.3330 => 4.2332, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.16% (1.2210 => 1.1946, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.14% (1.0544 => 1.0318, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.12% (1.2221 => 1.1962, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.09% (7.0961 => 6.9480, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.00% (1.2300 => 1.2054, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -1.84% (34.0927 => 33.4662, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/football/football: -1.83% (0.9179 => 0.9011, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -1.79% (2.4021 => 2.3592, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.62% (0.8521 => 0.8383, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.41% (4.0594 => 4.0020, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.35% (8.0126 => 7.9043, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -1.17% (1.5610 => 1.5427, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -1.14% (18.2933 => 18.0846, std.dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: -1.01% (15.2527 => 15.0988, std.dev.: 0.0162) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.54% (1.8100 => 0.6781, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2415, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.06% (1.3643 => 1.0224, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -23.35% (83.5423 => 64.0343, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1292, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3392, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8044, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.55% (7.9763 => 7.7730, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6434, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1962, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.44% (1.6086 => 1.5854, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.14% (1.6219 => 1.6034, std.dev.: 0.0055) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4364, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.01% (1.6307 => 1.6143, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 15:55:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 17:55:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130118235521.007612A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7735?compare_to=7732&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7735, Order: 172843, Start Time: 2013-01-18 21:44:10, End Time: 2013-01-18 23:55:29 To: 7732, Order: 172833, Start Time: 2013-01-18 19:02:52, End Time: 2013-01-18 21:13:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 5 (215 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.93% (0.8701 => 0.8869, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 1.78% (10.8560 => 11.0489, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 1.18% (4.5123 => 4.5656, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 1.13% (20.2137 => 20.4413, std.dev.: 0.0118) MultiSource/Applications/siod/siod: 1.02% (2.6540 => 2.6811, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -2.96% (0.4191 => 0.4067, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8280 => 499.8299, std.dev.: 0.0175) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44222.95% (1.1277 => 499.8299, std.dev.: 0.0175) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.47% (0.5229 => 1.6496, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 20.64% (14.9895 => 18.0831, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 44.41% (14.1553 => 20.4413, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8498, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.92% (1.1048 => 1.7336, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.85% (7.1582 => 37.6415, std.dev.: 0.0214) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.50% (3.4629 => 6.4237, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.33% (0.6222 => 1.0909, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.53% (0.0720 => 7.4423, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3835300.00% (0.0001 => 3.8354, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11155300.00% (0.0001 => 11.1554, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848600.00% (0.0001 => 9.8487, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488500.00% (0.0001 => 5.4886, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.56% (1.1194 => 10.2936, std.dev.: 0.0053) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.09% (22.1758 => 55.2370, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.85% (0.0929 => 0.1773, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 61.90% (0.0231 => 0.0374, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.16% (2.9384 => 4.6180, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.15% (7.0540 => 10.8034, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.57% (1.5859 => 2.4037, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.97% (8.1363 => 11.9577, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.28% (0.0439 => 0.0629, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.59% (2.2024 => 3.1184, std.dev.: 0.0161) MultiSource/Applications/sgefa/sgefa: 40.21% (0.3109 => 0.4359, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 39.59% (0.1432 => 0.1999, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.36% (21.9371 => 30.3512, std.dev.: 0.0105) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.96% (4.2646 => 5.7127, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.31% (1.5415 => 2.0550, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.65% (0.4615 => 0.6122, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.34% (0.1892 => 0.2485, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.40% (0.4299 => 0.5563, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 29.04% (1.1642 => 1.5023, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.75% (0.6675 => 0.8594, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.68% (0.5105 => 0.6518, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.38% (0.1143 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 26.83% (0.1655 => 0.2099, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.12% (3.8922 => 4.9088, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/08-main/main: 26.00% (0.2554 => 0.3218, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.82% (0.0457 => 0.0575, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 25.56% (1.0722 => 1.3463, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.29% (0.4289 => 0.5331, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.25% (0.0730 => 0.0907, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.1337 => 0.1661, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.06% (0.3121 => 0.3872, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.91% (0.1175 => 0.1456, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.90% (1.4186 => 1.7577, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 23.55% (0.4620 => 0.5708, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.19% (0.1695 => 0.2088, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 22.83% (9.4845 => 11.6499, std.dev.: 0.0128) MultiSource/Applications/minisat/minisat: 22.38% (0.7115 => 0.8707, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.74% (0.2700 => 0.3287, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 21.55% (0.1151 => 0.1399, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.47% (0.3098 => 0.3763, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 21.29% (5.7591 => 6.9850, std.dev.: 0.0108) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.89% (0.7835 => 0.9472, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.74% (1.3050 => 1.5757, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 20.42% (0.6456 => 0.7774, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.14% (0.0834 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.71% (0.5860 => 0.7015, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.69% (4.9449 => 5.9187, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.40% (0.8172 => 0.9757, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: 19.32% (0.7433 => 0.8869, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 18.93% (3.3354 => 3.9669, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9436, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.47% (0.5020 => 0.5947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.39% (0.3307 => 0.3915, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.99% (0.5569 => 0.6571, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.90% (3.8723 => 4.5656, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.82% (0.9765 => 1.1505, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 17.68% (1.1840 => 1.3933, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.3423 => 0.4013, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 17.23% (0.2049 => 0.2402, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.21% (2.0273 => 2.3761, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.80% (0.2065 => 0.2412, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.79% (0.5981 => 0.6985, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 16.73% (2.2969 => 2.6811, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.60% (0.8101 => 0.9446, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.45% (0.3441 => 0.4007, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.20% (0.6450 => 0.7495, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 15.35% (0.3180 => 0.3668, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.32% (0.8921 => 1.0288, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.01% (1.1861 => 1.3641, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.92% (0.3379 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.32% (0.8067 => 0.9222, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.02% (0.3865 => 0.4407, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.61% (0.3387 => 0.3848, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.33% (0.4636 => 0.5254, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.17% (1.5603 => 1.7658, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.61% (0.4203 => 0.4733, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.07% (0.3603 => 0.4038, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 11.98% (0.3422 => 0.3832, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.73% (0.2430 => 0.2715, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 11.71% (17.1811 => 19.1932, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/lists1: 11.59% (0.3684 => 0.4111, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.38% (0.3927 => 0.4374, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.37% (0.4064 => 0.4526, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.16% (0.3826 => 0.4253, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.00% (0.3427 => 0.3804, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.65% (14.3668 => 15.8973, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2831 => 0.3126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.14% (0.1114 => 0.1227, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.60% (0.3543 => 0.3883, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (2.0665 => 2.2634, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.47% (0.2756 => 0.3017, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.33% (0.3162 => 0.3457, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.25% (1.2842 => 1.4030, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2725 => 0.2976, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.13% (0.2793 => 0.3048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.05% (0.6030 => 0.6576, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.72% (0.7326 => 0.7965, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 8.70% (63.2438 => 68.7434, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/Hello: 8.69% (0.5925 => 0.6440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.3052 => 0.3317, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.57% (0.2802 => 0.3042, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3657, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 6.57% (10.3673 => 11.0489, std.dev.: 0.0132) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.30% (0.3177 => 0.3377, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (7.9617 => 8.1439, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2406, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.07% (1.1396 => 1.2430, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4272, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.86% (4.2280 => 4.4758, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 5.12% (0.5413 => 0.5690, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (3.1578 => 3.3106, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0133) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.32% (0.9957 => 1.0288, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.6802 => 8.9082, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.93% (9.1159 => 9.2918, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7096, std.dev.: 0.0092) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2840, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.57% (1.0785 => 1.0954, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1791, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.00% (0.8651 => 0.2163, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.12% (5.3855 => 4.4636, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.51% (5.3526 => 4.4690, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -13.33% (10.4361 => 9.0445, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.14% (1.7609 => 1.6176, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9286, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.10% (1.9577 => 0.6636, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.52% (1.5373 => 1.0220, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4247, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8512, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.30% (2.6546 => 2.0094, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.22% (0.0756 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7318, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4942, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2965, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.30% (1.2373 => 1.1594, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7043, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5061, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8167, std.dev.: 0.0179) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2781, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7221 => 3.6756, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8558, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2322, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0020) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 16:01:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 18:01:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119000119.A06332A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7736?compare_to=7733&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7736, Order: 172849, Start Time: 2013-01-18 21:55:48, End Time: 2013-01-19 00:01:30 To: 7733, Order: 172835, Start Time: 2013-01-18 19:29:58, End Time: 2013-01-18 21:36:25 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 19 (19 on baseline) Performance Improvements: 11 (15 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (1029 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-23-TransparentUnion: 94.44% (0.0126 => 0.0245, std.dev.: 0.0012) SingleSource/Regression/C/sumarray2d: 57.82% (0.0275 => 0.0434, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 18.84% (1.5512 => 1.8434, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.29% (0.9020 => 1.0038, std.dev.: 0.0190) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.33% (3.5128 => 3.7704, std.dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.73% (1.7338 => 1.8505, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: 5.83% (0.2074 => 0.2195, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 4.76% (0.2099 => 0.2199, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 4.18% (16.3813 => 17.0660, std.dev.: 0.1223) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.68% (0.5002 => 0.5186, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.51% (0.7358 => 0.7543, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 28.21% (1.5801 => 2.0258, std.dev.: 0.0623) SingleSource/Benchmarks/Shootout-C++/heapsort: 27.75% (3.5696 => 4.5603, std.dev.: 0.2344) SingleSource/Benchmarks/Linpack/linpack-pc: 17.76% (43.1833 => 50.8536, std.dev.: 2.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.68% (3.9051 => 4.5563, std.dev.: 0.1132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.49% (60.9192 => 62.4383, std.dev.: 0.5159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.06% (2.7434 => 2.7999, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.52% (5.2615 => 5.3415, std.dev.: 0.0082) MultiSource/Benchmarks/BitBench/five11/five11: 1.24% (5.5936 => 5.6632, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: -12.39% (0.2219 => 0.1944, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: -12.25% (0.5520 => 0.4844, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -8.67% (1.0962 => 1.0012, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.21% (0.9837 => 0.9029, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: -7.57% (0.3157 => 0.2918, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.56% (1.0572 => 1.0090, std.dev.: 0.0170) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/McCat/09-vor/vor: -14.58% (0.1543 => 0.1318, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/08-main/main: -14.53% (0.0833 => 0.0712, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/tsp/tsp: -2.66% (1.5776 => 1.5357, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.56% (1.4292 => 1.3926, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/richards_benchmark: -1.30% (1.3760 => 1.3581, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.80% (1.2213 => 1.1382, std.dev.: 0.0947) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 26.91% (0.0223 => 0.0283, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.47% (0.0432 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.83% (0.0339 => 0.0352, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.66% (0.0318 => 0.0336, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.94% (0.0432 => 0.0449, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: 5.77% (0.0208 => 0.0220, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/test1: 6.31% (0.0222 => 0.0236, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.12% (0.0224 => 0.0231, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -42.86% (0.0014 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -0.55% (0.1461 => 0.1453, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: -3.48% (1.2742 => 1.2298, std.dev.: 0.1467) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.90% (0.4269 => 0.4017, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.33% (0.1477 => 0.1541, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.29% (0.1007 => 0.0994, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.15% (0.0582 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.60% (1.1584 => 1.1515, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.17% (0.0608 => 0.0534, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.95% (0.0303 => 0.0288, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.93% (0.7406 => 0.7549, std.dev.: 0.0215) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 51.16% (0.0043 => 0.0065, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.28% (12.7570 => 12.7925, std.dev.: 0.0792) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarray2d: 58.39% (0.0274 => 0.0434, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.46% (0.8926 => 1.0038, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.27% (1.0867 => 1.1657, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.73% (0.9010 => 0.9436, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.88% (3.6295 => 3.7704, std.dev.: 0.0424) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.51% (0.5059 => 0.5186, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.09% (1.8127 => 1.8505, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320462.50% (0.0008 => 2.5645, std.dev.: 0.0840) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.07% (1.1825 => 2.3895, std.dev.: 0.0347) MultiSource/Benchmarks/Olden/mst/mst: 60.63% (0.1491 => 0.2395, std.dev.: 0.0310) SingleSource/Benchmarks/Stanford/Quicksort: 50.45% (0.0220 => 0.0331, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 22.90% (3.7074 => 4.5563, std.dev.: 0.1132) SingleSource/Benchmarks/CoyoteBench/fftbench: 22.43% (1.6547 => 2.0258, std.dev.: 0.0623) MultiSource/Applications/JM/lencod/lencod: 3.70% (6.8159 => 7.0680, std.dev.: 0.0217) SingleSource/Benchmarks/Misc/pi: 3.58% (2.1390 => 2.2156, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.29% (61.0379 => 62.4383, std.dev.: 0.5159) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.07% (2.7432 => 2.7999, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.54% (5.2605 => 5.3415, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.43% (4.3851 => 4.4480, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.62% (0.0808 => 0.0504, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.40% (0.0862 => 0.0712, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -4.86% (1.3979 => 1.3300, std.dev.: 0.0248) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -4.58% (10.2703 => 9.7998, std.dev.: 0.0408) MultiSource/Applications/sqlite3/sqlite3: -2.83% (17.5634 => 17.0660, std.dev.: 0.1223) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.95% (0.7693 => 0.7543, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -9.71% (4.5259 => 4.0866, std.dev.: 0.1603) MultiSource/Benchmarks/Olden/bisort/bisort: -9.59% (0.9372 => 0.8473, std.dev.: 0.0292) MultiSource/Applications/minisat/minisat: -9.15% (7.9891 => 7.2584, std.dev.: 0.2810) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.00% (0.3201 => 0.2945, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.33% (1.4588 => 1.3519, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.60% (1.4446 => 1.3926, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/ffbench: -2.18% (1.4244 => 1.3934, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/mandel-2: -1.91% (0.8521 => 0.8358, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -1.25% (14.0297 => 13.8546, std.dev.: 0.0141) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.52% (1.2047 => 1.1382, std.dev.: 0.0947) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.46% (0.0233 => 0.0283, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.89% (0.0451 => 0.0447, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.66% (0.0394 => 0.0352, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.44% (0.0328 => 0.0336, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.90% (0.0445 => 0.0449, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: 3.29% (0.0213 => 0.0220, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/test1: 3.96% (0.0227 => 0.0236, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0050) MultiSource/Applications/lemon/lemon: -36.26% (1.9293 => 1.2298, std.dev.: 0.1467) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.79% (0.4049 => 0.4017, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.05% (0.1510 => 0.1541, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.44% (0.0590 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.88% (1.1617 => 1.1515, std.dev.: 0.0244) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.46% (0.0610 => 0.0534, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.46% (0.0268 => 0.0288, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.51% (0.7437 => 0.7549, std.dev.: 0.0215) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.35% (0.0092 => 0.0065, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.11% (12.7781 => 12.7925, std.dev.: 0.0792) Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 16:08:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 18:08:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119000809.C4D9A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7737?compare_to=7730&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7737, Order: 172836, Start Time: 2013-01-18 20:33:28, End Time: 2013-01-19 00:08:18 To: 7730, Order: 172824, Start Time: 2013-01-18 16:07:44, End Time: 2013-01-18 19:42:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 8.21% (0.2106 => 0.2279, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -1.55% (13.5149 => 13.3058, std.dev.: 0.0742) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 51.20% (0.0625 => 0.0945, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 40.17% (0.1063 => 0.1490, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.57% (0.1106 => 0.1422, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.99% (0.2969 => 0.3800, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.45% (0.0714 => 0.0910, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.28% (0.4139 => 0.5268, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.92% (0.4253 => 0.5398, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.39% (0.5900 => 0.7457, std.dev.: 0.0276) MultiSource/Applications/oggenc/oggenc: 25.56% (1.5932 => 2.0005, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.06% (0.5000 => 0.6253, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.93% (0.1107 => 0.1383, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.75% (0.4994 => 0.6230, std.dev.: 0.0171) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.77% (0.1620 => 0.2005, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.73% (0.1003 => 0.1231, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.0948 => 0.1160, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.65% (0.3903 => 0.4748, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.57% (0.1604 => 0.1950, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.69% (0.2736 => 0.3302, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.40% (1.3152 => 1.5835, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.31% (0.2866 => 0.3448, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 20.20% (0.4029 => 0.4843, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.71% (0.2014 => 0.2411, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.49% (0.3890 => 0.4648, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 19.35% (1.8794 => 2.2430, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 19.07% (0.0561 => 0.0668, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 19.04% (0.5546 => 0.6602, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.77% (0.3271 => 0.3885, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.68% (1.6211 => 1.9239, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.54% (0.5026 => 0.5958, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.25% (0.4658 => 0.5508, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.23% (0.2875 => 0.3399, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.13% (3.5627 => 4.2085, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.99% (0.1968 => 0.2322, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.80% (0.2792 => 0.3289, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.73% (0.5826 => 0.6859, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 17.61% (0.2725 => 0.3205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.60% (0.2738 => 0.3220, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 17.54% (0.5889 => 0.6922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.48% (0.2803 => 0.3293, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 17.47% (0.9697 => 1.1391, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 17.45% (0.1284 => 0.1508, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.40% (0.3930 => 0.4614, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 17.35% (0.2750 => 0.3227, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.20% (0.4361 => 0.5111, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 17.11% (0.2823 => 0.3306, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/methcall: 17.10% (0.2813 => 0.3294, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.09% (0.0673 => 0.0788, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 17.04% (0.2811 => 0.3290, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 16.97% (1.0781 => 1.2610, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.96% (0.3195 => 0.3737, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 16.91% (0.3258 => 0.3809, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.90% (0.2911 => 0.3403, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.86% (0.2729 => 0.3189, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 16.84% (0.3004 => 0.3510, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 16.80% (0.2780 => 0.3247, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 16.67% (0.3096 => 0.3612, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.65% (4.4195 => 5.1555, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.58% (2.0673 => 2.4101, std.dev.: 0.0166) SingleSource/UnitTests/ObjC++/property-reference: 16.58% (0.7171 => 0.8360, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 16.46% (0.3317 => 0.3863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.38% (0.3267 => 0.3802, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.33% (1.9694 => 2.2911, std.dev.: 0.0174) MultiSource/Applications/hexxagon/hexxagon: 16.30% (0.9909 => 1.1524, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.18% (1.9966 => 2.3196, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.11% (2.7292 => 3.1689, std.dev.: 0.0168) MultiSource/Applications/ClamAV/clamscan: 15.99% (4.2109 => 4.8841, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.88% (0.3060 => 0.3546, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.85% (0.3362 => 0.3895, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 15.83% (0.3726 => 0.4316, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.78% (0.3124 => 0.3617, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.73% (23.5202 => 27.2194, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/lists: 15.50% (0.3348 => 0.3867, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 15.50% (0.3678 => 0.4248, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.45% (0.3845 => 0.4439, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.39% (0.2566 => 0.2961, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.39% (0.3282 => 0.3787, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.36% (0.4146 => 0.4783, std.dev.: 0.0029) MultiSource/Applications/lua/lua: 15.34% (1.4269 => 1.6458, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.28% (0.3625 => 0.4179, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists1: 15.27% (0.3477 => 0.4008, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 14.94% (0.4251 => 0.4886, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.90% (0.3981 => 0.4574, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 14.83% (0.3446 => 0.3957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.80% (0.3690 => 0.4236, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 14.69% (0.3465 => 0.3974, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.67% (0.3442 => 0.3947, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 14.65% (0.3460 => 0.3967, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 14.62% (0.7875 => 0.9026, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/bigfib: 14.45% (0.5012 => 0.5736, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 14.44% (0.3650 => 0.4177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.21% (0.3724 => 0.4253, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: 14.14% (0.3643 => 0.4158, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.44% (2.1653 => 2.4564, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/football/football: 13.35% (0.2075 => 0.2352, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 13.31% (5.5417 => 6.2795, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.30% (0.6435 => 0.7291, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.2737 => 0.3101, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 13.24% (4.6177 => 5.2291, std.dev.: 0.0457) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.20% (0.2068 => 0.2341, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 13.19% (0.2691 => 0.3046, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 13.07% (0.3336 => 0.3772, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 12.77% (2.1013 => 2.3696, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.36% (0.1383 => 0.1554, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.06% (0.3084 => 0.3456, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.45% (0.5361 => 0.5975, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 11.35% (0.3498 => 0.3895, std.dev.: 0.0109) MultiSource/Applications/siod/siod: 11.09% (0.6634 => 0.7370, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 10.91% (0.4847 => 0.5376, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.81% (11.6398 => 12.8975, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.19% (0.7426 => 0.8183, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 9.62% (0.2391 => 0.2621, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.59% (4.6926 => 5.1426, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 9.33% (2.0346 => 2.2244, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.72% (0.5584 => 0.6071, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: 7.24% (11.9555 => 12.8211, std.dev.: 0.0261) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5238, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.21% (0.3693 => 0.4033, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6778, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2445, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-2: 4.79% (1.8057 => 1.8922, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6807, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2102, std.dev.: 0.0375) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2999, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2883, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2086, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5902, std.dev.: 0.0248) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4760, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.21% (2.4764 => 2.4217, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5586, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.18% (17.2379 => 14.2761, std.dev.: 0.0675) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -9.70% (0.2402 => 0.2169, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9750, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8019, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -5.28% (14.0481 => 13.3058, std.dev.: 0.0742) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2116, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8111, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1687, std.dev.: 0.0324) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1684, std.dev.: 0.0863) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0430, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 16:28:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 18:28:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119002813.143A62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7738?compare_to=7734&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7738, Order: 172858, Start Time: 2013-01-18 22:54:48, End Time: 2013-01-19 00:28:22 To: 7734, Order: 172842, Start Time: 2013-01-18 20:57:54, End Time: 2013-01-18 22:31:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (96 on baseline) Performance Improvements: 0 (121 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (875 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.87% (0.3939 => 0.4052, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.25% (0.0717 => 0.1192, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.65% (0.0974 => 0.1555, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.25% (0.0514 => 0.0798, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.73% (0.0599 => 0.0819) SingleSource/Benchmarks/Stanford/IntMM: 36.12% (0.0418 => 0.0569, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.12% (0.6395 => 0.8705, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.95% (0.1132 => 0.1539, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.15% (0.6395 => 0.8579, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.11% (0.6260 => 0.8270, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.47% (0.5805 => 0.7632, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.14% (0.5688 => 0.7459, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.92% (0.5456 => 0.7143, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.43% (0.6230 => 0.8126, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.42% (0.5849 => 0.7628, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.27% (0.5567 => 0.7252, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.19% (0.0699 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.03% (0.5941 => 0.7725, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.01% (0.5575 => 0.7248, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.92% (0.5581 => 0.7251, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.54% (0.5802 => 0.7516, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.12% (0.6033 => 0.7790, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.10% (0.5705 => 0.7365, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.59% (0.5859 => 0.7534, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.59% (0.5478 => 0.7044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.57% (0.6440 => 0.8280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.46% (0.5857 => 0.7524, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.46% (0.5570 => 0.7155, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.21% (0.5569 => 0.7140, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.17% (0.5925 => 0.7594, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.76% (0.5591 => 0.7143, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.38% (0.6676 => 0.8504, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.21% (0.6189 => 0.7873, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.18% (1.6474 => 2.0952, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.13% (0.6052 => 0.7694, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.09% (0.5863 => 0.7451, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.95% (0.6446 => 0.8183, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.33% (0.6304 => 0.7964, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.40% (0.6681 => 0.8378, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.25% (0.6194 => 0.7758, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.85% (0.6660 => 0.8315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.81% (0.6297 => 0.7859, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.47% (0.6667 => 0.8232, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.26% (0.7524 => 0.9199, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.42% (0.7339 => 0.8911, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.31% (0.0582 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.10% (2.2587 => 2.7127, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.91% (0.0693 => 0.0831, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.77% (0.0622 => 0.0745, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.72% (0.0634 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.52% (1.1450 => 1.3113, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 14.03% (0.3357 => 0.3828, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.11% (0.1982 => 0.2222, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.65% (4.5069 => 5.0321, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.17% (0.4916 => 0.5465, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.83% (1.6364 => 1.8136, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/05-eks/eks: 10.76% (0.4515 => 0.5001, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.41% (3.5339 => 3.9018, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2385 => 0.2605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.7021 => 0.7576, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4524 => 0.4851, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 6.62% (1.2515 => 1.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.46% (0.5329 => 0.5673, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.27% (0.4861 => 0.5166, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.2784 => 1.3572, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.00% (1.4642 => 1.5520, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 5.89% (9.2283 => 9.7715, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.69% (0.3834 => 0.4052, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.98% (0.3319 => 0.3451, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.60% (5.0226 => 5.1531, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.33% (5.4682 => 5.5954, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.3864 => 1.4178, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.46% (0.8418 => 0.8541, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.05% (1.3722 => 1.3866, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.40% (31.3723 => 55.6534, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9531 => 1.0280, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6075, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2768, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9563, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2089, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.90% (0.1281 => 0.1103, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.27% (2.4924 => 2.3611, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.77% (0.3837 => 0.3654, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.65% (0.2428 => 0.2315, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.50% (0.9852 => 0.9409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4033 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.15% (0.3831 => 0.3672, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -4.12% (0.3880 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.11% (0.3896 => 0.3736, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3848 => 0.3693, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -4.00% (0.4176 => 0.4009, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.99% (0.7198 => 0.6911, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.98% (0.3891 => 0.3736, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.71% (0.3884 => 0.3740, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.63% (0.3057 => 0.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.62% (0.2903 => 0.2798, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.60% (0.4199 => 0.4048, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.54% (0.6441 => 0.6213, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.48% (0.9542 => 0.9210, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -3.46% (0.3205 => 0.3094, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.42% (0.3016 => 0.2913, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.40% (2.1713 => 2.0975, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -3.37% (1.3148 => 1.2705, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.35% (0.3252 => 0.3143, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.31% (0.3658 => 0.3537, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.30% (0.3059 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.25% (0.6484 => 0.6273, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.18% (0.4151 => 0.4019, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.83% (20.7746 => 20.1877, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.82% (0.3931 => 0.3820, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.82% (0.7779 => 0.7560, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.66% (0.7919 => 0.7708, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8406, std.dev.: 0.0392) MultiSource/Benchmarks/MallocBench/gs/gs: -2.48% (4.3330 => 4.2257, std.dev.: 0.0108) MultiSource/Applications/lambda-0_1_3/lambda: -2.47% (0.7982 => 0.7785, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -2.46% (17.1032 => 16.6823, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -2.45% (16.1920 => 15.7953, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.41% (6.7716 => 6.6086, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.10% (1.0544 => 1.0323, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -1.98% (7.0961 => 6.9559, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.97% (1.2300 => 1.2058, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.87% (1.2210 => 1.1982, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: -1.85% (0.9179 => 0.9009, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.60% (2.4021 => 2.3637, std.dev.: 0.0046) MultiSource/Applications/hbd/hbd: -1.52% (1.5610 => 1.5372, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (0.8521 => 0.8392, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.40% (34.0927 => 33.6160, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.29% (4.0594 => 4.0070, std.dev.: 0.0039) MultiSource/Applications/kimwitu++/kc: -1.12% (18.2933 => 18.0878, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.03% (8.0126 => 7.9304, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.10% (1.8100 => 0.6678, std.dev.: 0.0336) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.91% (8.0445 => 5.3166, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.86% (1.3643 => 1.0251, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7562, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0209, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1725, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2074, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.99% (0.6299 => 0.5040, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -16.91% (0.3418 => 0.2840, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.08% (2.5106 => 2.1321, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3402, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1492, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.28% (5.5807 => 5.3976, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.58% (7.9763 => 7.7707, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.57% (1.3096 => 1.2760, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1180, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6472, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4661, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1925, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6086, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5884, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6655, std.dev.: 0.0068) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 18:25:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 20:25:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119022511.DEC5D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7739?compare_to=7738&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7739, Order: 172874, Start Time: 2013-01-19 00:51:37, End Time: 2013-01-19 02:25:21 To: 7738, Order: 172858, Start Time: 2013-01-18 22:54:48, End Time: 2013-01-19 00:28:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (98 on baseline) Performance Improvements: 0 (116 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.05% (54.8161 => 56.4899, std.dev.: 0.1180) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.96% (0.0974 => 0.1558, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.45% (0.0514 => 0.0799, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 44.73% (0.1500 => 0.2171, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.89% (0.0599 => 0.0820, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.47% (0.6395 => 0.8727, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.13% (0.1132 => 0.1541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.56% (0.6395 => 0.8605, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.51% (0.6260 => 0.8295, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.63% (0.5688 => 0.7487, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.49% (0.5805 => 0.7633, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.29% (0.5456 => 0.7163, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.79% (0.6230 => 0.8148, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.62% (0.5849 => 0.7640, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.39% (0.5567 => 0.7259, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.39% (0.5575 => 0.7269, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.25% (0.5581 => 0.7269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.18% (0.5941 => 0.7734, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.94% (0.5802 => 0.7539, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.54% (0.6033 => 0.7815, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.34% (0.5705 => 0.7379, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.95% (0.5859 => 0.7555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.87% (0.5570 => 0.7178, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.85% (0.6440 => 0.8298, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.77% (0.5478 => 0.7054, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.73% (0.5857 => 0.7540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.51% (0.5569 => 0.7157, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.37% (0.5925 => 0.7606, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.08% (0.5591 => 0.7161, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.82% (0.6676 => 0.8533, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.56% (0.6052 => 0.7720, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.44% (0.6189 => 0.7887, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.30% (0.6446 => 0.8206, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.29% (0.5863 => 0.7463, std.dev.: 0.0149) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.21% (1.6474 => 2.0957, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.65% (0.6304 => 0.7984, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.74% (0.6681 => 0.8401, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.59% (0.6194 => 0.7779, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.36% (0.6660 => 0.8349, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.22% (0.6297 => 0.7885, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.68% (0.6667 => 0.8246, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.63% (0.7524 => 0.9227, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.79% (0.7339 => 0.8938, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.19% (2.2587 => 2.7148, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.88% (0.0634 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.72% (1.1450 => 1.3135, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.12% (0.3357 => 0.3831, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.51% (0.1081 => 0.1227, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.66% (0.1982 => 0.2233, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.77% (4.5069 => 5.0375, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.17% (0.4916 => 0.5465, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.05% (0.4515 => 0.5014, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.90% (1.6364 => 1.8148, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.57% (3.5339 => 3.9075, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.92% (0.7021 => 0.7577, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4524 => 0.4876, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.65% (0.2001 => 0.2154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.77% (0.4861 => 0.5190, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 6.76% (1.2515 => 1.3361, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.68% (0.5329 => 0.5685, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.27% (1.2784 => 1.3586, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.16% (1.4642 => 1.5544, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.04% (9.2283 => 9.7861, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/matrix: 5.41% (0.3255 => 0.3431, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: 3.13% (0.3446 => 0.3554, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 2.96% (0.6750 => 0.6950, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 2.90% (5.0226 => 5.1685, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.48% (5.4682 => 5.6036, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 2.42% (1.3864 => 1.4200, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.89% (0.8418 => 0.8577, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.29% (0.9557 => 0.9680, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.14% (1.3722 => 1.3878, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6613, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.74% (0.9531 => 1.0269, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4899, std.dev.: 0.1180) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.61% (0.6469 => 0.6638, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.66% (4.5320 => 4.6073, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2765, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2086, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.82% (0.1281 => 0.1104, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -5.12% (2.4924 => 2.3647, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.68% (0.7198 => 0.6861, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.63% (0.3821 => 0.3644, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.38% (0.9852 => 0.9420, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.35% (0.3837 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.18% (0.3848 => 0.3687, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.12% (0.3831 => 0.3673, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.4033 => 0.3867, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.11% (0.3891 => 0.3731, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.10% (0.3880 => 0.3721, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.04% (0.3142 => 0.3015, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.4176 => 0.4012, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.74% (0.6441 => 0.6200, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.55% (0.3884 => 0.3746, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.55% (0.3323 => 0.3205, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.41% (0.4199 => 0.4056, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.40% (0.3057 => 0.2953, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (0.9542 => 0.9218, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.33% (0.6484 => 0.6268, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4280 => 0.4143, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.20% (0.3658 => 0.3541, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.05% (1.3148 => 1.2747, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.05% (0.7779 => 0.7542, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.96% (2.1713 => 2.1071, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.82% (0.4151 => 0.4034, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.75% (20.7746 => 20.2041, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.68% (14.2083 => 13.8281, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.55% (0.7919 => 0.7717, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -2.46% (17.1032 => 16.6818, std.dev.: 0.0154) MultiSource/Applications/JM/lencod/lencod: -2.34% (16.1920 => 15.8132, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.33% (6.7716 => 6.6138, std.dev.: 0.0170) MultiSource/Benchmarks/MallocBench/gs/gs: -2.14% (4.3330 => 4.2404, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.06% (1.2210 => 1.1958, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -2.00% (0.7982 => 0.7822, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.95% (1.2221 => 1.1983, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.93% (1.0544 => 1.0340, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: -1.87% (7.0961 => 6.9634, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.85% (1.2300 => 1.2072, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.71% (0.9179 => 0.9022, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.54% (1.5610 => 1.5369, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (0.8521 => 0.8393, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.47% (2.4021 => 2.3668, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: -1.19% (34.0927 => 33.6866, std.dev.: 0.0069) MultiSource/Applications/lua/lua: -1.18% (4.0594 => 4.0114, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.10% (8.0126 => 7.9248, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.51% (1.8100 => 0.6785, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3126, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -24.33% (1.3643 => 1.0324, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0280, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2076, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.96% (0.6299 => 0.5042, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1294, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.65% (4.9100 => 4.3379, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (1.7753 => 1.6988, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1786, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.73% (3.7241 => 3.6224, std.dev.: 0.0235) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7649, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.3096 => 1.2823, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4673, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1932, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.44% (1.6086 => 1.5855, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6003, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7092 => 3.6632, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.12% (1.6307 => 1.6124, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 18:25:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 20:25:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119022517.214FB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7740?compare_to=7736&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7740, Order: 172872, Start Time: 2013-01-19 00:22:13, End Time: 2013-01-19 02:25:24 To: 7736, Order: 172849, Start Time: 2013-01-18 21:55:48, End Time: 2013-01-19 00:01:30 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (9 on baseline) Performance Improvements: 18 (28 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1043 (1026 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.12% (1.4696 => 1.8828, std.dev.: 0.0046) MultiSource/Benchmarks/nbench/nbench: 8.36% (20.5464 => 22.2647, std.dev.: 0.5135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.71% (3.5136 => 3.5738, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -37.30% (0.0429 => 0.0269, std.dev.: 0.0029) SingleSource/Regression/C/sumarray2d: -36.64% (0.0434 => 0.0275, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: -15.04% (0.1556 => 0.1322, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: -14.71% (0.1496 => 0.1276, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -11.67% (1.0038 => 0.8867, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.43% (0.2186 => 0.1958, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -7.47% (0.9855 => 0.9119, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.48% (1.0170 => 0.9511, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -6.29% (0.9724 => 0.9112, std.dev.: 0.0217) SingleSource/Benchmarks/Shootout-C++/hash2: -6.11% (0.5154 => 0.4839, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.92% (0.9029 => 0.8675, std.dev.: 0.0087) MultiSource/Benchmarks/sim/sim: -2.97% (0.3676 => 0.3567, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -2.60% (0.9810 => 0.9555, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.18% (0.9963 => 0.9845, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.21% (2.0588 => 1.9928, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.58% (62.4383 => 60.8267, std.dev.: 0.3180) SingleSource/Benchmarks/Shootout-C++/lists: -2.05% (17.0022 => 16.6537, std.dev.: 0.0955) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.23% (2.7999 => 2.7656, std.dev.: 0.0125) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.55% (1.1382 => 1.1206, std.dev.: 0.0357) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -20.85% (0.0283 => 0.0224, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.13% (0.0447 => 0.0433, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.69% (0.0352 => 0.0339, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.46% (0.0336 => 0.0321, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.23% (0.0449 => 0.0430, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: -5.45% (0.0220 => 0.0208, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -5.93% (0.0236 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0231 => 0.0231, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.65% (0.1453 => 0.1477, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 0.23% (1.2298 => 1.2326, std.dev.: 0.2766) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.74% (0.4017 => 0.3947, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.00% (0.1541 => 0.1464, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.70% (0.0994 => 0.0987, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0278 => 0.0277, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.41% (0.0552 => 0.0615, std.dev.: 0.0114) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1515 => 1.1488, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.92% (0.0534 => 0.0619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.03% (0.0288 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.83% (0.7549 => 0.7486, std.dev.: 0.0239) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.92% (0.0065 => 0.0102, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7925 => 12.7591, std.dev.: 0.2146) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322712.50% (0.0008 => 2.5825, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.85% (1.1825 => 2.3632, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.72% (0.2562 => 0.2888, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 8.55% (20.5117 => 22.2647, std.dev.: 0.5135) MultiSource/Applications/JM/lencod/lencod: 4.59% (6.8159 => 7.1286, std.dev.: 0.0749) SingleSource/Benchmarks/Misc/pi: 3.12% (2.1390 => 2.2058, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.32% (0.8800 => 0.8916, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.11% (4.3851 => 4.4336, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.04% (1.8634 => 1.8828, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0050) SingleSource/Benchmarks/SmallPT/smallpt: -25.53% (0.1888 => 0.1406, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.11% (1.0986 => 0.9436, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.69% (0.7686 => 0.6634, std.dev.: 0.0162) MultiSource/Applications/lua/lua: -9.98% (4.6406 => 4.1776, std.dev.: 0.1670) MultiSource/Applications/hbd/hbd: -6.69% (1.8964 => 1.7696, std.dev.: 0.0419) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (0.7693 => 0.7227, std.dev.: 0.0148) MultiSource/Applications/ClamAV/clamscan: -5.90% (17.4365 => 16.4080, std.dev.: 0.3201) MultiSource/Applications/spiff/spiff: -5.60% (1.0220 => 0.9648, std.dev.: 0.0211) MultiSource/Benchmarks/sim/sim: -3.98% (0.3715 => 0.3567, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.80% (1.0234 => 0.9845, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: -3.75% (1.4392 => 1.3853, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.50% (0.8990 => 0.8675, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.90% (0.4762 => 0.4624, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.06% (1.4588 => 1.3266, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/ary3: -5.73% (2.2304 => 2.1027, std.dev.: 0.0486) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.31% (0.3201 => 0.3031, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: -4.57% (0.3217 => 0.3070, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.39% (23.3986 => 22.3708, std.dev.: 0.2858) SingleSource/Benchmarks/Shootout-C++/lists: -3.28% (17.2182 => 16.6537, std.dev.: 0.0955) MultiSource/Applications/sqlite3/sqlite3: -2.88% (4.4730 => 4.3440, std.dev.: 0.0440) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.83% (40.4729 => 39.3272, std.dev.: 0.4117) SingleSource/Benchmarks/Misc/ffbench: -1.93% (1.4244 => 1.3969, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: -1.82% (2.0298 => 1.9928, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: -1.79% (2.8571 => 2.8061, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/matrix: -1.00% (2.9083 => 2.8792, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.98% (1.2047 => 1.1206, std.dev.: 0.0357) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.46% (0.1530 => 0.1477, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: -36.11% (1.9293 => 1.2326, std.dev.: 0.2766) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.52% (0.4049 => 0.3947, std.dev.: 0.0513) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.05% (0.1510 => 0.1464, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.92% (0.0978 => 0.0987, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0590 => 0.0615, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.11% (1.1617 => 1.1488, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.48% (0.0610 => 0.0619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.66% (0.7437 => 0.7486, std.dev.: 0.0239) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.87% (0.0092 => 0.0102, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7781 => 12.7591, std.dev.: 0.2146) Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 18:36:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 20:36:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119023628.D71622A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7741?compare_to=7735&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7741, Order: 172872, Start Time: 2013-01-19 00:25:52, End Time: 2013-01-19 02:36:38 To: 7735, Order: 172843, Start Time: 2013-01-18 21:44:10, End Time: 2013-01-18 23:55:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 4 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.04% (11.0489 => 11.1641, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.41% (0.8869 => 0.8744, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.31% (10.2936 => 10.1588, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.13% (1.1791 => 1.1658, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.04% (68.7434 => 68.0273, std.dev.: 0.0082) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0653 => 0.0652, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8299 => 499.8383, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 44223.69% (1.1277 => 499.8383, std.dev.: 0.0115) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.63% (0.5229 => 1.6452, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 19.84% (14.9895 => 17.9629, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 42.99% (14.1553 => 20.2412, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/gs/gs: 17.80% (4.1105 => 4.8420, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.65% (1.1048 => 1.7307, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.67% (7.1582 => 37.2707, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.95% (3.4629 => 6.3700, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.08% (0.6222 => 1.0831, std.dev.: 0.0124) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.89% (0.0720 => 7.4476, std.dev.: 0.0053) MultiSource/Applications/SIBsim4/SIBsim4: 3834500.00% (0.0001 => 3.8346, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11155400.00% (0.0001 => 11.1555, std.dev.: 0.0250) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484600.00% (0.0001 => 5.4847, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 807.52% (1.1194 => 10.1588, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 147.33% (22.1758 => 54.8472, std.dev.: 0.0188) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 90.31% (0.0929 => 0.1768, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 64.25% (0.0730 => 0.1199, std.dev.: 0.0020) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.63% (2.9384 => 4.6318, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.91% (7.0540 => 10.8570, std.dev.: 0.0040) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.23% (1.5859 => 2.3983, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.11% (8.1363 => 11.8880, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.94% (2.2024 => 3.1040, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 39.37% (0.3109 => 0.4333, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 37.67% (21.9371 => 30.2005, std.dev.: 0.0164) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.53% (0.1062 => 0.1450, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.72% (4.2646 => 5.7028, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.75% (1.5415 => 2.0463, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.26% (0.4615 => 0.6104, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.44% (0.1892 => 0.2468, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.99% (0.2271 => 0.2952, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 29.47% (0.4299 => 0.5566, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 28.69% (1.1642 => 1.4982, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.03% (0.6675 => 0.8546, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 26.65% (0.1655 => 0.2096, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.58% (0.1584 => 0.2005, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.52% (0.5105 => 0.6459, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.10% (0.0479 => 0.0604, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.73% (3.8922 => 4.8937, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 25.41% (0.2554 => 0.3203, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.35% (0.0793 => 0.0994, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 25.09% (1.0722 => 1.3412, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 24.11% (0.4289 => 0.5323, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 23.66% (0.1175 => 0.1453, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.47% (1.4186 => 1.7515, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.19% (0.1695 => 0.2088, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.10% (0.1143 => 0.1407, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.03% (0.4620 => 0.5684, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 22.45% (9.4845 => 11.6142, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.78% (0.0730 => 0.0889, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 21.62% (0.7115 => 0.8653, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.22% (0.2700 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.82% (0.7835 => 0.9466, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.77% (1.3050 => 1.5760, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 20.72% (0.3098 => 0.3740, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 20.41% (5.7591 => 6.9345, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/messages-2: 20.39% (0.0662 => 0.0797, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.83% (0.0953 => 0.1142, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 19.53% (0.6456 => 0.7717, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.40% (0.5860 => 0.6997, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.40% (4.9449 => 5.9043, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.05% (0.8172 => 0.9729, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.64% (5.0018 => 5.9342, std.dev.: 0.0095) MultiSource/Applications/d/make_dparser: 18.57% (3.3354 => 3.9547, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.24% (0.2758 => 0.3261, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.90% (0.3307 => 0.3899, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.87% (0.5569 => 0.6564, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.81% (0.5020 => 0.5914, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 17.64% (0.7433 => 0.8744, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.63% (0.9765 => 1.1487, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.11% (1.1840 => 1.3866, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.05% (0.1044 => 0.1222, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 17.00% (0.3423 => 0.4005, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 16.98% (0.2049 => 0.2397, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.89% (3.8723 => 4.5264, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: 16.87% (2.0273 => 2.3693, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.82% (0.5981 => 0.6987, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.51% (0.3441 => 0.4009, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.14% (0.3283 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.06% (0.8101 => 0.9402, std.dev.: 0.0030) MultiSource/Applications/siod/siod: 16.00% (2.2969 => 2.6645, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.77% (0.6450 => 0.7467, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 15.75% (0.3232 => 0.3741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.8921 => 1.0266, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 14.97% (0.3180 => 0.3656, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.52% (1.1861 => 1.3583, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.17% (0.8067 => 0.9210, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 13.76% (0.3379 => 0.3844, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.43% (0.3387 => 0.3842, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.43% (0.3865 => 0.4384, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 12.66% (1.5603 => 1.7578, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.60% (0.4636 => 0.5220, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.92% (0.4103 => 0.4592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.87% (0.4203 => 0.4702, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.86% (0.4048 => 0.4528, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.65% (0.2430 => 0.2713, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.38% (17.1811 => 19.1365, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/lists: 11.34% (0.3422 => 0.3810, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 11.32% (0.3603 => 0.4011, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.30% (0.3282 => 0.3653, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.15% (0.3927 => 0.4365, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 11.05% (0.3684 => 0.4091, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 10.87% (0.3092 => 0.3428, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.77% (0.3826 => 0.4238, std.dev.: 0.0084) SingleSource/UnitTests/ObjC/property: 10.68% (0.3886 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.4064 => 0.4498, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.41% (14.3668 => 15.8625, std.dev.: 0.0267) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.33% (0.3427 => 0.3781, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.01% (0.3828 => 0.4211, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.57% (0.3543 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.56% (0.3473 => 0.3805, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.54% (0.3543 => 0.3881, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.54% (0.2831 => 0.3101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3497 => 0.3827, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.87% (2.0665 => 2.2497, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 8.86% (0.2877 => 0.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.74% (0.2871 => 0.3122, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.60% (0.2756 => 0.2993, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.58% (0.3650 => 0.3963, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.53% (1.2842 => 1.3937, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.36% (0.2905 => 0.3148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.36% (0.3052 => 0.3307, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2725 => 0.2950, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.23% (0.2793 => 0.3023, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.08% (0.2872 => 0.3104, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.08% (0.6030 => 0.6517, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.88% (0.3935 => 0.4245, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5925 => 0.6386, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: 7.69% (10.3673 => 11.1641, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: 7.56% (63.2438 => 68.0273, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.37% (0.3136 => 0.3367, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3572, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.04% (7.9617 => 8.1240, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.26% (32.5116 => 59.2558, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6959, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.25% (4.2280 => 4.4501, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.51% (0.9957 => 1.0306, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0120) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.6802 => 8.9158, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.35% (1.0313 => 1.0555, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.25% (3.6395 => 3.7215, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 2.02% (0.8333 => 0.8501, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.99% (9.1159 => 9.2972, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2820, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4549, std.dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.90% (5.2763 => 1.1658, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.68% (0.8651 => 0.2104, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.41% (5.3855 => 4.4479, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.03% (5.3526 => 4.4410, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -13.54% (10.4361 => 9.0226, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.08% (1.7609 => 1.6186, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9185, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.40% (1.9577 => 0.6383, std.dev.: 0.0196) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.59% (1.5373 => 1.0209, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4235, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8621, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0057, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1267, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.49% (19.9488 => 18.2552, std.dev.: 0.0289) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -5.96% (1.2373 => 1.1635, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.69% (8.1563 => 7.6920, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8333, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.83% (3.6994 => 3.6317, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2266, std.dev.: 0.0075) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0019) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 20:22:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 22:22:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119042211.408FA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7742?compare_to=7739&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7742, Order: 172883, Start Time: 2013-01-19 02:48:38, End Time: 2013-01-19 04:22:20 To: 7739, Order: 172874, Start Time: 2013-01-19 00:51:37, End Time: 2013-01-19 02:25:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 1 (113 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.59% (3.8822 => 3.7815, std.dev.: 0.0242) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.67% (0.0717 => 0.1195, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.06% (0.0974 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.80% (0.1500 => 0.2172, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.48% (0.6395 => 0.8728, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.22% (0.1132 => 0.1542, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.46% (0.6395 => 0.8599, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.94% (0.5688 => 0.7505, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.58% (0.5805 => 0.7638, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.36% (0.5456 => 0.7167, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.90% (0.0699 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.83% (0.6230 => 0.8151, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.67% (0.5849 => 0.7643, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.64% (0.5575 => 0.7283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.48% (0.5567 => 0.7264, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.42% (0.5581 => 0.7279, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.10% (0.5941 => 0.7729, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.77% (0.5802 => 0.7529, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.62% (0.6033 => 0.7820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.27% (0.5705 => 0.7375, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.87% (0.5570 => 0.7178, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.84% (0.5859 => 0.7549, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.81% (0.5478 => 0.7056, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.79% (0.6440 => 0.8294, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.63% (0.5857 => 0.7534, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.41% (0.5569 => 0.7151, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.37% (0.5925 => 0.7606, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.22% (0.5591 => 0.7169, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.61% (0.6052 => 0.7723, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.61% (1.6474 => 2.1022, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.46% (0.5863 => 0.7473, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.42% (0.6189 => 0.7886, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.30% (0.6446 => 0.8206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.84% (0.6304 => 0.7996, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.70% (0.6194 => 0.7786, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.58% (0.6681 => 0.8390, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.42% (0.6660 => 0.8353, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.08% (0.6297 => 0.7876, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.88% (0.6667 => 0.8259, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.59% (0.7524 => 0.9224, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.81% (0.7339 => 0.8940, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.44% (2.2587 => 2.7204, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.26% (0.0621 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.36% (0.1146 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 14.79% (1.1450 => 1.3144, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.41% (0.1982 => 0.2228, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.23% (0.3834 => 0.4303, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.84% (4.5069 => 5.0406, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.29% (0.4916 => 0.5471, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.95% (1.6364 => 1.8156, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.77% (3.5339 => 3.9145, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.43% (0.2385 => 0.2610, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.03% (0.7021 => 0.7585, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.87% (0.4524 => 0.4880, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.01% (1.2515 => 1.3392, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.81% (0.5329 => 0.5692, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4861 => 0.5188, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.39% (1.2784 => 1.3601, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.25% (1.4642 => 1.5557, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (9.2283 => 9.7953, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.3255 => 0.3434, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.22% (0.3446 => 0.3557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.05% (0.6750 => 0.6956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 2.95% (0.3394 => 0.3494, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 2.94% (5.0226 => 5.1703, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.70% (5.4682 => 5.6158, std.dev.: 0.0138) MultiSource/Applications/SIBsim4/SIBsim4: 2.57% (1.3864 => 1.4220, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.06% (0.8418 => 0.8591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3722 => 1.3892, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.45% (31.3723 => 55.6702, std.dev.: 0.0145) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.64% (0.9531 => 1.0259, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3672, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4900, std.dev.: 0.1106) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.66% (0.6469 => 0.6641, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2768, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2089, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4580, std.dev.: 0.0189) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.39% (0.3194 => 0.3022, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -4.66% (2.4924 => 2.3762, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.53% (0.3821 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3831 => 0.3663, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.38% (0.3837 => 0.3669, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.36% (0.9852 => 0.9422, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.24% (0.3891 => 0.3726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.12% (0.4176 => 0.4004, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.81% (0.3884 => 0.3736, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.70% (0.6347 => 0.6112, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.47% (0.9542 => 0.9211, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.46% (0.6441 => 0.6218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.37% (0.3057 => 0.2954, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.36% (0.4280 => 0.4136, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.27% (0.6484 => 0.6272, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.20% (0.3658 => 0.3541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.89% (2.1713 => 2.1086, std.dev.: 0.0104) MultiSource/Applications/hexxagon/hexxagon: -2.84% (1.3148 => 1.2775, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.83% (0.7779 => 0.7559, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.65% (0.4151 => 0.4041, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8403, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: -2.53% (17.1032 => 16.6712, std.dev.: 0.0147) SingleSource/UnitTests/Vector/constpool: -2.48% (20.7746 => 20.2594, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.44% (0.7919 => 0.7726, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -2.32% (16.1920 => 15.8165, std.dev.: 0.0103) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.16% (6.7716 => 6.6256, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: -2.12% (4.3330 => 4.2413, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.2221 => 1.1972, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (1.2210 => 1.1963, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.97% (1.0544 => 1.0336, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.84% (7.0961 => 6.9655, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.82% (1.2300 => 1.2076, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.69% (0.9179 => 0.9024, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -1.58% (0.7982 => 0.7856, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.44% (0.8521 => 0.8398, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.20% (34.0927 => 33.6840, std.dev.: 0.0094) MultiSource/Applications/hbd/hbd: -1.18% (1.5610 => 1.5426, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -1.13% (4.0594 => 4.0137, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9308, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.22% (1.8100 => 0.6839, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3134, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -25.02% (1.3643 => 1.0229, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0144, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1312, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1048, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7253, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3390, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.65% (5.2027 => 4.8045, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1775, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.84% (1.3096 => 1.2724, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.66% (7.9763 => 7.7641, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -1.91% (3.7241 => 3.6528, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4667, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.47% (7.3040 => 7.1964, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6075, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6581, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.27% (1.6219 => 1.6013, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 20:34:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 22:34:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119043405.07C1F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7743?compare_to=7737&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7743, Order: 172874, Start Time: 2013-01-19 00:59:46, End Time: 2013-01-19 04:34:15 To: 7737, Order: 172836, Start Time: 2013-01-18 20:33:28, End Time: 2013-01-19 00:08:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 2.09% (2.0005 => 2.0423, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.34% (0.6220 => 0.6428, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.94% (124.5773 => 128.2438, std.dev.: 1.0465) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.17% (1.5835 => 1.5650, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 60.96% (0.0625 => 0.1006, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 44.21% (0.1063 => 0.1533, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 28.19% (1.5932 => 2.0423, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.85% (0.2969 => 0.3796, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.31% (0.1106 => 0.1408, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.84% (0.4139 => 0.5250, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.73% (0.5900 => 0.7477, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.40% (0.4253 => 0.5376, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.59% (0.4994 => 0.6272, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.19% (0.1620 => 0.2028, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.93% (0.1107 => 0.1383, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.86% (0.5000 => 0.6243, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.27% (0.1549 => 0.1925, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 23.51% (0.0808 => 0.0998, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.39% (0.1103 => 0.1361, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.13% (0.1604 => 0.1975, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.81% (0.0947 => 0.1163, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 22.67% (0.1619 => 0.1986, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.70% (0.3903 => 0.4750, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 21.44% (0.4029 => 0.4893, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: 21.44% (0.0821 => 0.0997, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.41% (0.0822 => 0.0998, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.64% (0.1090 => 0.1315, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.18% (0.3271 => 0.3931, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.15% (0.3890 => 0.4674, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.90% (0.1462 => 0.1753, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.82% (0.2866 => 0.3434, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.48% (0.2736 => 0.3269, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.31% (0.1160 => 0.1384, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.99% (1.3152 => 1.5650, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/oourafft: 18.89% (0.0561 => 0.0667, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.75% (0.1968 => 0.2337, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 18.56% (1.8794 => 2.2282, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 18.54% (0.5546 => 0.6574, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 18.18% (0.9697 => 1.1460, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 18.10% (0.2823 => 0.3334, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.09% (1.6211 => 1.9143, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.01% (0.4658 => 0.5497, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.95% (0.2875 => 0.3391, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.83% (3.5627 => 4.1980, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: 17.81% (0.2813 => 0.3314, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 17.57% (0.2811 => 0.3305, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 17.53% (0.2750 => 0.3232, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.48% (0.3060 => 0.3595, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 17.48% (0.2780 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.44% (0.2792 => 0.3279, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.35% (0.2738 => 0.3213, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 17.32% (0.2725 => 0.3197, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.31% (0.5026 => 0.5896, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 17.27% (0.2803 => 0.3287, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 17.23% (0.5826 => 0.6830, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.22% (0.4361 => 0.5112, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 17.21% (0.1284 => 0.1505, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.15% (0.2729 => 0.3197, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.07% (2.0673 => 2.4201, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 16.99% (0.9909 => 1.1593, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 16.99% (0.3267 => 0.3822, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.94% (0.0673 => 0.0787, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.93% (0.3195 => 0.3736, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 16.91% (0.5889 => 0.6885, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.86% (1.0781 => 1.2599, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/wc: 16.83% (0.3096 => 0.3617, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.82% (0.3930 => 0.4591, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 16.57% (0.3258 => 0.3798, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.55% (1.9694 => 2.2953, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/property-reference: 16.43% (0.7171 => 0.8349, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.33% (0.3124 => 0.3634, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 16.28% (0.4146 => 0.4821, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 16.22% (0.3317 => 0.3855, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 16.17% (0.2566 => 0.2981, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: 16.16% (23.5202 => 27.3217, std.dev.: 0.0255) MultiSource/Applications/ClamAV/clamscan: 16.16% (4.2109 => 4.8912, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/sieve: 16.13% (0.3726 => 0.4327, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.04% (1.9966 => 2.3168, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 16.01% (0.3678 => 0.4267, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.94% (0.3362 => 0.3898, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 15.93% (0.3477 => 0.4031, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.89% (0.3845 => 0.4456, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.89% (0.3625 => 0.4201, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.81% (2.7292 => 3.1607, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.71% (4.4195 => 5.1138, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 15.55% (0.4251 => 0.4912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.39% (0.3690 => 0.4258, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.28% (0.7875 => 0.9078, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.15% (0.3981 => 0.4584, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 15.12% (1.4269 => 1.6427, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 14.60% (0.5012 => 0.5744, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.46% (0.2068 => 0.2367, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.36% (0.3488 => 0.3989, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: 14.13% (0.3446 => 0.3933, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 14.13% (0.3496 => 0.3990, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: 14.09% (0.3442 => 0.3927, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 14.08% (0.3465 => 0.3953, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 14.07% (0.3469 => 0.3957, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 14.05% (0.3460 => 0.3946, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 13.86% (0.3650 => 0.4156, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 13.78% (2.1653 => 2.4637, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.66% (0.6435 => 0.7314, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.64% (0.3643 => 0.4140, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.62% (0.1028 => 0.1168, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 13.56% (0.3724 => 0.4229, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 13.46% (5.5417 => 6.2877, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 13.41% (4.6177 => 5.2368, std.dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 13.19% (0.2691 => 0.3046, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 13.01% (0.2075 => 0.2345, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 12.65% (2.1013 => 2.3672, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 11.98% (0.3498 => 0.3917, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.68% (0.5361 => 0.5987, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 11.56% (0.6634 => 0.7401, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.54% (0.3084 => 0.3440, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.27% (0.2040 => 0.2270, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.15% (0.3336 => 0.3708, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 11.14% (0.4847 => 0.5387, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.14% (0.1383 => 0.1537, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.2103 => 0.2336, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.71% (0.7426 => 0.8221, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.71% (11.6398 => 12.8859, std.dev.: 0.0238) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.16% (4.6926 => 5.1695, std.dev.: 0.0083) MultiSource/Applications/lemon/lemon: 9.37% (0.2391 => 0.2615, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 9.26% (2.0346 => 2.2230, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.06% (0.5584 => 0.6090, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.43% (11.9555 => 12.8439, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.93% (0.3792 => 0.3979, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5160, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.96% (0.3693 => 0.4061, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6117, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2381, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8934, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6811, std.dev.: 0.0044) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.96% (0.6276 => 0.6462, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.95% (0.6244 => 0.6428, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1929, std.dev.: 0.0132) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3018, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0829, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2092, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5735, std.dev.: 0.0225) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.48% (2.4764 => 2.4151, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5752, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.43% (17.2379 => 14.2326, std.dev.: 0.1145) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -8.74% (0.2402 => 0.2192, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7990, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.77% (14.0481 => 13.5180, std.dev.: 0.1662) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2260, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.67% (11.2080 => 10.7970, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1411, std.dev.: 0.0469) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.72% (0.6293 => 0.6185, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2302, std.dev.: 0.0427) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0431, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 20:44:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 22:44:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119044442.880D02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7744?compare_to=7740&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7744, Order: 172883, Start Time: 2013-01-19 02:44:17, End Time: 2013-01-19 04:44:54 To: 7740, Order: 172872, Start Time: 2013-01-19 00:22:13, End Time: 2013-01-19 02:25:24 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (12 on baseline) Performance Improvements: 29 (127 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1025 (924 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-10-SignConversions: 113.71% (0.0124 => 0.0265, std.dev.: 0.0009) SingleSource/UnitTests/TestLoop: 77.19% (0.0171 => 0.0303, std.dev.: 0.0010) SingleSource/UnitTests/2003-07-08-BitOpsTest: 66.67% (0.0165 => 0.0275, std.dev.: 0.0008) SingleSource/Regression/C/globalrefs: 53.47% (0.0202 => 0.0310, std.dev.: 0.0025) SingleSource/UnitTests/2003-05-07-VarArgs: 45.14% (0.0257 => 0.0373, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 38.06% (1.5077 => 2.0815, std.dev.: 0.0289) SingleSource/Benchmarks/CoyoteBench/lpbench: 20.04% (4.1806 => 5.0186, std.dev.: 0.1220) SingleSource/Benchmarks/Shootout/heapsort: 8.24% (3.3063 => 3.5789, std.dev.: 0.0533) SingleSource/Benchmarks/Shootout/ary3: 4.16% (2.1027 => 2.1901, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.41% (1.0675 => 1.0825, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -9.38% (1.1263 => 1.0206, std.dev.: 0.0326) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.84% (0.1674 => 0.1526, std.dev.: 0.0043) MultiSource/Applications/siod/siod: -7.44% (2.6064 => 2.4124, std.dev.: 0.0224) MultiSource/Applications/sgefa/sgefa: -7.23% (0.3540 => 0.3284, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -7.14% (0.9648 => 0.8959, std.dev.: 0.0198) MultiSource/Benchmarks/SciMark2-C/scimark2: -6.35% (0.3716 => 0.3480, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/09-vor/vor: -5.90% (0.3562 => 0.3352, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.95% (1.0925 => 1.0384, std.dev.: 0.0097) MultiSource/Applications/d/make_dparser: -4.72% (3.6937 => 3.5195, std.dev.: 0.0309) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.97% (0.9178 => 0.8814, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.82% (0.3714 => 0.3572, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.91% (9.5309 => 9.2534, std.dev.: 0.0850) MultiSource/Benchmarks/McCat/18-imp/imp: -2.69% (0.3822 => 0.3719, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.66% (4.9008 => 4.7702, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.60% (0.7123 => 0.6938, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: -2.59% (0.7554 => 0.7358, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: -2.52% (16.1942 => 15.7865, std.dev.: 0.1537) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -2.52% (0.6634 => 0.6467, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.51% (0.6773 => 0.6603, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.15% (0.5403 => 0.5287, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -1.77% (4.1776 => 4.1035, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.69% (0.6340 => 0.6233, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.40% (1.2337 => 1.2164, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.25% (4.4362 => 4.2478, std.dev.: 0.0130) MultiSource/Applications/minisat/minisat: -3.74% (6.4423 => 6.2011, std.dev.: 0.0893) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.38% (1.5852 => 1.5475, std.dev.: 0.0055) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.54% (2.4477 => 2.4099, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.51% (4.0717 => 4.0103, std.dev.: 0.0218) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.03% (2.7656 => 2.7372, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.79% (1.1206 => 1.1117, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.34% (0.0224 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0339 => 0.0338, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.25% (0.0321 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -0.90% (0.0222 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0231 => 0.0230, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.17% (0.1477 => 0.1445, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -4.23% (1.2326 => 1.1804, std.dev.: 0.0745) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.94% (0.3947 => 0.4142, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.61% (0.1464 => 0.1455, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.74% (0.0987 => 0.0960, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.81% (0.0277 => 0.0272, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.08% (0.0615 => 0.0553, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1488 => 1.1482, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.10% (0.0619 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.96% (0.0314 => 0.0311, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.28% (0.7486 => 0.7390, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -0.98% (0.0102 => 0.0101, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.03% (12.7591 => 12.7629, std.dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2003-07-08-BitOpsTest: 70.81% (0.0161 => 0.0275, std.dev.: 0.0008) SingleSource/UnitTests/TestLoop: 64.67% (0.0184 => 0.0303, std.dev.: 0.0010) SingleSource/Regression/C/globalrefs: 57.36% (0.0197 => 0.0310, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 52.38% (0.0336 => 0.0512, std.dev.: 0.0005) SingleSource/UnitTests/2003-05-07-VarArgs: 46.27% (0.0255 => 0.0373, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.79% (0.4596 => 0.4724, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322962.50% (0.0008 => 2.5845, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.27% (1.1825 => 2.3800, std.dev.: 0.0401) SingleSource/Benchmarks/CoyoteBench/fftbench: 25.79% (1.6547 => 2.0815, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.72% (0.2562 => 0.2888, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.68% (4.4540 => 5.0186, std.dev.: 0.1220) SingleSource/Benchmarks/Misc/pi: 2.33% (2.1390 => 2.1888, std.dev.: 0.0147) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.21% (0.0808 => 0.0475, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.84% (0.0727 => 0.0481, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/drop3/drop3: -31.07% (0.0692 => 0.0477, std.dev.: 0.0008) SingleSource/Benchmarks/SmallPT/smallpt: -27.60% (0.1888 => 0.1367, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.57% (0.1684 => 0.1287, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.50% (0.1009 => 0.0782, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.01% (0.0676 => 0.0534, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -20.69% (1.8964 => 1.5040, std.dev.: 0.1048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.92% (1.0960 => 0.9106, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.03% (0.1079 => 0.0906, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.86% (0.7686 => 0.6467, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.96% (1.0986 => 0.9342, std.dev.: 0.0202) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.58% (0.4074 => 0.3480, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.40% (0.0847 => 0.0742, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: -12.34% (1.0220 => 0.8959, std.dev.: 0.0198) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.90% (1.2154 => 1.0708, std.dev.: 0.0076) MultiSource/Applications/lua/lua: -11.57% (4.6406 => 4.1035, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.47% (0.0889 => 0.0787, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.45% (6.4235 => 5.6880, std.dev.: 0.1728) MultiSource/Applications/treecc/treecc: -11.25% (2.4719 => 2.1938, std.dev.: 0.0268) MultiSource/Applications/hexxagon/hexxagon: -10.73% (1.1433 => 1.0206, std.dev.: 0.0326) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -10.71% (0.1317 => 0.1176, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.45% (1.5131 => 1.3550, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.44% (0.1025 => 0.0918, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.25% (0.9124 => 0.8189, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.90% (10.2703 => 9.2534, std.dev.: 0.0850) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.81% (0.7693 => 0.6938, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.69% (1.1498 => 1.0384, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.47% (0.6885 => 0.6233, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -9.40% (0.8653 => 0.7840, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.39% (1.3924 => 1.2616, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.27% (0.3560 => 0.3230, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.22% (1.6874 => 1.5318, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: -8.86% (17.4365 => 15.8923, std.dev.: 0.4009) MultiSource/Applications/siod/siod: -8.75% (2.6437 => 2.4124, std.dev.: 0.0224) MultiSource/Applications/sgefa/sgefa: -8.73% (0.3598 => 0.3284, std.dev.: 0.0029) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (1.1731 => 1.0719, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -8.45% (0.1610 => 0.1474, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.41% (0.2283 => 0.2091, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.26% (0.2481 => 0.2276, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.07% (0.9588 => 0.8814, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.99% (0.5746 => 0.5287, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.23% (0.1798 => 0.1668, std.dev.: 0.0024) MultiSource/Applications/d/make_dparser: -6.99% (3.7840 => 3.5195, std.dev.: 0.0309) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.30% (0.2618 => 0.2453, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.24% (0.2100 => 0.1969, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.21% (0.7693 => 0.7215, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.98% (1.0017 => 0.9418, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.92% (0.9550 => 0.8985, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.83% (0.2144 => 0.2019, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.68% (1.3310 => 1.2554, std.dev.: 0.0072) MultiSource/Applications/minisat/minisat: -5.38% (0.7776 => 0.7358, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.32% (5.0381 => 4.7702, std.dev.: 0.0135) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.28% (0.6135 => 0.5811, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: -5.24% (0.5134 => 0.4865, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.24% (0.2615 => 0.2478, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: -4.96% (1.4392 => 1.3678, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.3462 => 0.3292, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.77% (0.6934 => 0.6603, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.72% (0.9507 => 0.9058, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.65% (0.2884 => 0.2750, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.61% (1.0234 => 0.9762, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.39% (1.3220 => 1.2640, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.35% (0.2577 => 0.2465, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.22% (0.9127 => 0.8742, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.21% (0.9788 => 0.9376, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.16% (0.9405 => 0.9014, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.11% (0.3093 => 0.2966, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.09% (4.6579 => 4.4675, std.dev.: 0.0203) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.07% (1.2680 => 1.2164, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.05% (0.8990 => 0.8626, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: -4.02% (16.4479 => 15.7865, std.dev.: 0.1537) MultiSource/Benchmarks/sim/sim: -4.01% (0.3715 => 0.3566, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.01% (0.9512 => 0.9131, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/08-main/main: -3.91% (0.2915 => 0.2801, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: -3.91% (18.9377 => 18.1973, std.dev.: 0.1298) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.72% (1.0052 => 0.9678, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.72% (0.9091 => 0.8753, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.67% (0.9403 => 0.9058, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.51% (0.3702 => 0.3572, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.49% (0.9993 => 0.9644, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -3.46% (0.6711 => 0.6479, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.36% (14.9757 => 14.4730, std.dev.: 0.0739) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.24% (7.2721 => 7.0364, std.dev.: 0.0487) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.19% (0.9214 => 0.8920, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.09% (0.4762 => 0.4615, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.77% (0.9488 => 0.9225, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.70% (0.6996 => 0.6807, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: -2.64% (5.3553 => 5.2138, std.dev.: 0.0449) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.62% (4.8904 => 4.7625, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.30% (1.0119 => 0.9886, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.18% (0.9685 => 0.9474, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: -2.17% (1.2708 => 1.2432, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.60% (4.9104 => 4.8320, std.dev.: 0.0179) MultiSource/Benchmarks/Prolangs-C/football/football: -1.59% (0.9759 => 0.9604, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.56% (0.8732 => 0.8596, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.45% (0.8846 => 0.8718, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.24% (0.9612 => 0.9493, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.88% (0.9372 => 0.6478, std.dev.: 0.0062) MultiSource/Applications/minisat/minisat: -22.38% (7.9891 => 6.2011, std.dev.: 0.0893) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.16% (1.0816 => 0.8636, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/heapsort: -20.00% (4.4739 => 3.5789, std.dev.: 0.0533) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.74% (1.5623 => 1.2695, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.66% (2.8778 => 2.5709, std.dev.: 0.1063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.63% (1.4588 => 1.3037, std.dev.: 0.0321) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.78% (5.0421 => 4.5491, std.dev.: 0.0482) SingleSource/Benchmarks/Shootout/hash: -9.02% (4.5259 => 4.1176, std.dev.: 0.0832) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/health/health: -6.68% (0.3654 => 0.3410, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.01% (23.3986 => 21.9933, std.dev.: 0.5222) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.52% (0.3349 => 0.3164, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.19% (0.3201 => 0.3035, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.26% (2.5170 => 2.4099, std.dev.: 0.0119) MultiSource/Applications/sqlite3/sqlite3: -3.48% (4.4730 => 4.3175, std.dev.: 0.0549) MultiSource/Applications/SIBsim4/SIBsim4: -3.47% (3.5443 => 3.4214, std.dev.: 0.0217) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.46% (40.4729 => 39.0722, std.dev.: 0.2014) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6335, std.dev.: 0.1361) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.12% (1.4446 => 1.3995, std.dev.: 0.0118) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.99% (0.3406 => 0.3304, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.27% (0.5826 => 0.5694, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -2.19% (29.0327 => 28.3980, std.dev.: 0.1638) MultiSource/Applications/hexxagon/hexxagon: -1.84% (14.0297 => 13.7720, std.dev.: 0.0292) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.55% (1.0995 => 1.0825, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -1.49% (8.7416 => 8.6114, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.43% (3.1921 => 3.1465, std.dev.: 0.0161) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.72% (1.2047 => 1.1117, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.56% (0.1530 => 0.1445, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -38.82% (1.9293 => 1.1804, std.dev.: 0.0745) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.30% (0.4049 => 0.4142, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.64% (0.1510 => 0.1455, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -22.22% (0.0009 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.0978 => 0.0960, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.27% (0.0590 => 0.0553, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.16% (1.1617 => 1.1482, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.63% (0.7437 => 0.7390, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.78% (0.0092 => 0.0101, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7629, std.dev.: 0.0184) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 21:17:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 18 Jan 2013 23:17:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119051749.5DBBA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7745?compare_to=7741&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7745, Order: 172883, Start Time: 2013-01-19 03:07:05, End Time: 2013-01-19 05:17:58 To: 7741, Order: 172872, Start Time: 2013-01-19 00:25:52, End Time: 2013-01-19 02:36:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (218 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.16% (1.1658 => 1.1793, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: 1.12% (11.1641 => 11.2893, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (37.2707 => 37.6468, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.08% (0.6383 => 0.6707, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1333 => 0.1332, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0652 => 0.0651, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8383 => 499.8401, std.dev.: 0.0128) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.85% (1.1277 => 499.8401, std.dev.: 0.0128) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.93% (0.5229 => 1.6520, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 20.65% (14.9895 => 18.0853, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 44.41% (14.1553 => 20.4415, std.dev.: 0.0161) MultiSource/Benchmarks/MallocBench/gs/gs: 18.42% (4.1105 => 4.8678, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.38% (1.1048 => 1.7387, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.93% (7.1582 => 37.6468, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.15% (3.4629 => 6.4115, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.22% (0.6222 => 1.0902, std.dev.: 0.0060) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.17% (0.0720 => 7.4442, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 3835200.00% (0.0001 => 3.8353, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11144100.00% (0.0001 => 11.1442, std.dev.: 0.0259) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486300.00% (0.0001 => 5.4864, std.dev.: 0.0105) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.17% (1.1194 => 10.2556, std.dev.: 0.0134) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.40% (22.1758 => 55.0851, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.17% (0.0929 => 0.1776) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 71.70% (0.1463 => 0.2512, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.70% (2.9384 => 4.6338, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.65% (7.0540 => 10.9088, std.dev.: 0.0127) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.01% (1.5859 => 2.4108, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.81% (8.1363 => 11.9446, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.04% (2.2024 => 3.1282, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 40.01% (0.3109 => 0.4353, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 39.73% (0.1432 => 0.2001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.47% (21.9371 => 30.3768, std.dev.: 0.0128) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.41% (4.2646 => 5.7319, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.44% (1.5415 => 2.0570, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.83% (0.4615 => 0.6130, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.18% (0.1892 => 0.2482, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.56% (0.2271 => 0.2965, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 29.42% (1.1642 => 1.5067, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.52% (0.6675 => 0.8579, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615) SingleSource/Benchmarks/Stanford/Oscar: 28.14% (0.0636 => 0.0815, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.65% (0.1143 => 0.1459, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.40% (0.1584 => 0.2018, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.33% (0.5105 => 0.6500, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.61% (0.0793 => 0.1004, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.24% (3.8922 => 4.9136, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 26.12% (0.2554 => 0.3221, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 25.61% (1.0722 => 1.3468, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (0.1566 => 0.1958, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 24.55% (0.0660 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.53% (0.1337 => 0.1665, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.52% (0.0730 => 0.0909, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.46% (0.4289 => 0.5338, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.45% (0.1906 => 0.2372, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.29% (0.3121 => 0.3879, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.25% (0.1695 => 0.2106, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.04% (1.4186 => 1.7597, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 23.91% (0.1175 => 0.1456, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.51% (0.4620 => 0.5706, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 22.97% (9.4845 => 11.6634, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.35% (0.7115 => 0.8705, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.2700 => 0.3290, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.84% (0.1236 => 0.1506, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.74% (0.1555 => 0.1893, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.30% (0.3098 => 0.3758, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.23% (1.3050 => 1.5820, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.97% (0.7835 => 0.9478, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 20.94% (5.7591 => 6.9651, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 20.76% (0.1151 => 0.1390, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.31% (0.1029 => 0.1238, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.31% (0.6456 => 0.7767, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.12% (0.5860 => 0.7039, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.90% (4.9449 => 5.9290, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.44% (0.8172 => 0.9761, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.04% (5.0018 => 5.9543, std.dev.: 0.0108) MultiSource/Applications/d/make_dparser: 18.98% (3.3354 => 3.9686, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.94% (0.0834 => 0.0992, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 18.50% (0.7433 => 0.8808, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.48% (0.3307 => 0.3918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.41% (0.5020 => 0.5944, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.35% (0.2758 => 0.3264, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.11% (0.9765 => 1.1533, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.90% (0.5569 => 0.6566, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 17.69% (1.1840 => 1.3935, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 17.56% (3.8723 => 4.5522, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 17.43% (2.0273 => 2.3806, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ReedSolomon: 17.42% (0.2049 => 0.2406, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.32% (0.3423 => 0.4016, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.12% (0.5981 => 0.7005, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.93% (2.2969 => 2.6857, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.86% (0.1044 => 0.1220, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.86% (0.3441 => 0.4021, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 16.57% (0.3283 => 0.3827, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.41% (0.8101 => 0.9430, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.6450 => 0.7500, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 16.00% (0.3232 => 0.3749, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.56% (0.8921 => 1.0309, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 15.53% (0.3180 => 0.3674, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.22% (0.8067 => 0.9295, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.08% (1.1861 => 1.3650, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.37% (0.2603 => 0.2977, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.18% (0.3379 => 0.3858, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3865 => 0.4399, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 13.52% (0.3387 => 0.3845, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.29% (0.4636 => 0.5252, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7642, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.84% (0.4103 => 0.4630, std.dev.: 0.0052) SingleSource/Benchmarks/Stanford/Puzzle: 12.54% (0.1268 => 0.1427, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.37% (0.4203 => 0.4723, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.02% (0.2430 => 0.2722, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.93% (0.3603 => 0.4033, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.75% (0.3422 => 0.3824, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.68% (17.1811 => 19.1885, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/parameter-passing: 11.46% (0.3927 => 0.4377, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.45% (0.3684 => 0.4106, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.37% (0.3826 => 0.4261, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.35% (0.3092 => 0.3443, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.07% (0.4064 => 0.4514, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (14.3668 => 15.9039, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.32% (0.1114 => 0.1229, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 9.96% (0.2831 => 0.3113, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.68% (0.3543 => 0.3886, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 9.65% (0.3543 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.59% (0.3473 => 0.3806, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.27% (2.0665 => 2.2580, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.11% (0.2877 => 0.3139, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.03% (1.2842 => 1.4002, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 8.89% (10.3673 => 11.2893, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.85% (0.3650 => 0.3973, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.82% (0.2891 => 0.3146, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2905 => 0.3161, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.73% (0.3162 => 0.3438, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.2756 => 0.2992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.49% (0.2802 => 0.3040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.27% (0.2793 => 0.3024, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.26% (63.2438 => 68.4692, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout-C++/hello: 8.22% (0.2714 => 0.2937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (2.2022 => 2.3698, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.99% (0.4879 => 0.5220, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (7.9617 => 8.1502, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2437, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.24% (1.1396 => 1.2449, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.14% (4.2280 => 4.4454, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3137, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9075, std.dev.: 0.0180) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7229, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.98% (9.1159 => 9.2966, std.dev.: 0.0300) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (27.8444 => 28.2835, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4581, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1793, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/salsa20: -75.47% (0.8651 => 0.2122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.13% (5.3855 => 4.4629, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.58% (5.3526 => 4.4650, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -13.31% (10.4361 => 9.0473, std.dev.: 0.0127) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9460, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.62% (1.7609 => 1.6268, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.74% (1.9577 => 0.6707, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.88% (0.0628 => 0.0365, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3081, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0191, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4249, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8605, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0067, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.11% (0.6223 => 0.5034, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: -15.63% (1.6925 => 1.4280, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4925, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9116, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.36% (19.9488 => 18.2818, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2373 => 1.1650, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6996, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8373, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -2.05% (3.7221 => 3.6457, std.dev.: 0.0171) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: -1.18% (3.6994 => 3.6556, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2326, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0018) Report Time: 1.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 22:19:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 00:19:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119061901.E7BC82A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7746?compare_to=7742&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7746, Order: 172886, Start Time: 2013-01-19 04:45:42, End Time: 2013-01-19 06:19:10 To: 7742, Order: 172883, Start Time: 2013-01-19 02:48:38, End Time: 2013-01-19 04:22:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (96 on baseline) Performance Improvements: 0 (134 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 65.83% (0.0717 => 0.1189, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.34% (0.0974 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.86% (0.0514 => 0.0796, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 44.40% (0.1500 => 0.2166, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.39% (0.0599 => 0.0817, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.09% (0.6395 => 0.8703, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 35.89% (0.0418 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.78% (0.1132 => 0.1537) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.03% (0.6395 => 0.8571, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.03% (0.6260 => 0.8265, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.19% (0.5688 => 0.7462, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.99% (0.5805 => 0.7604, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.79% (0.5456 => 0.7136, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.32% (0.6230 => 0.8119, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.26% (0.5849 => 0.7619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.12% (0.5567 => 0.7244, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.04% (0.0699 => 0.0909, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 29.97% (0.5575 => 0.7246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 29.87% (0.5581 => 0.7248, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.79% (0.5941 => 0.7711, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.37% (0.5802 => 0.7506, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.90% (0.5705 => 0.7354, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.89% (0.6033 => 0.7776, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.64% (0.5859 => 0.7537, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.48% (0.6440 => 0.8274, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.44% (0.5478 => 0.7036, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.42% (0.5570 => 0.7153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.21% (0.5857 => 0.7509, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.07% (0.5925 => 0.7588, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.05% (0.5569 => 0.7131, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 27.78% (0.5591 => 0.7144, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.32% (0.6676 => 0.8500, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.11% (0.6189 => 0.7867, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.01% (1.6474 => 2.0923, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 26.92% (0.6052 => 0.7681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 26.85% (0.5863 => 0.7437, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 26.78% (0.6446 => 0.8172, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.30% (0.6304 => 0.7962, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.33% (0.6194 => 0.7763, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.09% (0.6681 => 0.8357, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 24.86% (0.6660 => 0.8316, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.63% (0.6297 => 0.7848, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.41% (0.6667 => 0.8228, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.12% (0.7524 => 0.9188, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.27% (0.7339 => 0.8900, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.96% (0.0582 => 0.0704, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.97% (2.2587 => 2.7097, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 19.77% (0.0693 => 0.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.61% (0.0622 => 0.0744, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 16.56% (0.0634 => 0.0739) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.01% (0.1146 => 0.1318, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.48% (1.1450 => 1.3108, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 13.97% (0.3357 => 0.3826, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1081 => 0.1224, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.44% (4.5069 => 5.0226, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.90% (0.4916 => 0.5452, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 10.68% (0.4515 => 0.4997, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.64% (1.6364 => 1.8105, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.35% (3.5339 => 3.8997, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.65% (0.7021 => 0.7558, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 6.47% (1.2515 => 1.3325, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.32% (0.5329 => 0.5666, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.05% (1.2784 => 1.3557, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/hash2: 6.01% (0.4861 => 0.5153, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.89% (0.1731 => 0.1833, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.88% (1.4642 => 1.5503, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 5.75% (9.2283 => 9.7591, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.3255 => 0.3416, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.71% (0.3319 => 0.3442, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 2.87% (5.0226 => 5.1667, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 2.46% (0.6750 => 0.6916, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.32% (1.3864 => 1.4185, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.15% (5.4682 => 5.5859, std.dev.: 0.0128) MultiSource/Applications/spiff/spiff: 1.63% (0.8418 => 0.8555, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.42% (31.3723 => 55.6595, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.28% (0.9531 => 1.0320, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4160, std.dev.: 0.1048) SingleSource/Benchmarks/Misc-C++/bigfib: 3.19% (0.3328 => 0.3434, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6061, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.55% (5.1955 => 5.2760, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8210 => 28.2094, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3489 => 10.4604, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.97% (0.1281 => 0.1102, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.50% (0.1584 => 0.1481, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.70% (0.7198 => 0.6788, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -5.25% (2.4924 => 2.3615, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.93% (0.3837 => 0.3648, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.74% (0.9852 => 0.9385, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -4.70% (0.3812 => 0.3633, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.70% (0.2428 => 0.2314, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.66% (0.3821 => 0.3643, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.60% (0.3848 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.59% (0.3831 => 0.3655, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.54% (0.3896 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.52% (0.3891 => 0.3715, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.15% (0.3884 => 0.3723, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.01% (0.3142 => 0.3016, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.99% (0.3057 => 0.2935, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -3.95% (0.4199 => 0.4033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.94% (0.2871 => 0.2758, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: -3.86% (0.6347 => 0.6102, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.84% (0.3205 => 0.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.75% (0.2933 => 0.2823, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.74% (0.4280 => 0.4120, std.dev.: 0.0033) SingleSource/Regression/C++/ofstream_ctor: -3.73% (0.3059 => 0.2945, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.72% (0.3252 => 0.3131, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.72% (2.1713 => 2.0906, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -3.70% (1.3148 => 1.2662, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: -3.64% (0.3025 => 0.2915, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: -3.62% (0.6441 => 0.6208, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (0.9542 => 0.9199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.58% (0.3658 => 0.3527, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: -3.58% (0.2849 => 0.2747, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.54% (0.2939 => 0.2835, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: -3.47% (0.3026 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.42% (0.4151 => 0.4009, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.39% (0.6484 => 0.6264, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -3.06% (0.7779 => 0.7541, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -2.98% (0.3621 => 0.3513, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.93% (0.3931 => 0.3816, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.88% (0.7919 => 0.7691, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (14.2083 => 13.8038, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/lists1: -2.74% (0.3867 => 0.3761, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2155, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.66% (0.4321 => 0.4206, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -2.64% (4.3330 => 4.2186, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: -2.61% (17.1032 => 16.6560, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.60% (0.4427 => 0.4312, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -2.56% (16.1920 => 15.7781, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.55% (6.7716 => 6.5990, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.30% (1.0544 => 1.0301, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.27% (1.2210 => 1.1933, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.25% (1.2221 => 1.1946, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: -2.10% (7.0961 => 6.9471, std.dev.: 0.0156) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.09% (1.2300 => 1.2043, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -2.01% (2.4021 => 2.3538, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -1.99% (0.9179 => 0.8996, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.97% (0.7982 => 0.7825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.83% (0.5999 => 0.5889, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -1.74% (1.5610 => 1.5338, std.dev.: 0.0003) MultiSource/Applications/lua/lua: -1.67% (4.0594 => 3.9917, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.64% (0.8521 => 0.8381, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.26% (34.0927 => 33.6632, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.25% (8.0126 => 7.9121, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -1.15% (18.2933 => 18.0838, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -1.04% (15.2527 => 15.0944, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.33% (1.8100 => 0.6818, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.86% (0.6962 => 0.3421, std.dev.: 0.0220) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.91% (8.0445 => 5.3163, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.48% (1.3643 => 1.0303, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0261, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.75% (4.3779 => 3.3820, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2080, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1301, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1041, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.60% (4.9100 => 4.3402, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.36% (7.9763 => 7.7884, std.dev.: 0.0194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.21% (1.3096 => 1.2806, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6432, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4677, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1980, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6007, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6660, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -1.09% (1.4516 => 1.4358, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 23:00:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 01:00:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119070052.2A2732A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7747?compare_to=7744&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7747, Order: 172888, Start Time: 2013-01-19 05:03:06, End Time: 2013-01-19 07:01:03 To: 7744, Order: 172883, Start Time: 2013-01-19 02:44:17, End Time: 2013-01-19 04:44:54 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (7 on baseline) Performance Improvements: 25 (128 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1032 (928 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.24% (3.4241 => 3.4664, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.62% (6.8540 => 7.1707, std.dev.: 0.1016) SingleSource/Benchmarks/Linpack/linpack-pc: 3.75% (50.9185 => 52.8289, std.dev.: 0.1090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.95% (40.9135 => 41.7112, std.dev.: 0.2907) MultiSource/Benchmarks/mafft/pairlocalalign: 1.86% (63.1103 => 64.2857, std.dev.: 0.0830) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.86% (2.3800 => 2.4243, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.39% (3.4985 => 3.5472, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/globalrefs: -50.97% (0.0310 => 0.0152, std.dev.: 0.0020) SingleSource/UnitTests/2003-05-07-VarArgs: -49.60% (0.0373 => 0.0188, std.dev.: 0.0032) SingleSource/UnitTests/2003-07-08-BitOpsTest: -44.36% (0.0275 => 0.0153, std.dev.: 0.0009) SingleSource/UnitTests/TestLoop: -42.57% (0.0303 => 0.0174, std.dev.: 0.0010) SingleSource/UnitTests/2003-07-10-SignConversions: -39.62% (0.0265 => 0.0160, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -11.60% (0.0888 => 0.0785, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: -9.39% (0.1299 => 0.1177, std.dev.: 0.0043) SingleSource/Regression/C++/ofstream_ctor: -6.43% (0.2178 => 0.2038, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: -5.26% (0.3992 => 0.3782, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -3.98% (8.8966 => 8.5425, std.dev.: 0.1210) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.96% (0.4724 => 0.4537, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.86% (24.4451 => 23.5016, std.dev.: 0.1260) MultiSource/Applications/Burg/burg: -2.05% (1.4192 => 1.3901, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: -1.28% (33.8339 => 33.3999, std.dev.: 0.0617) MultiSource/Benchmarks/mafft/pairlocalalign: -1.21% (9.5504 => 9.4346, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -29.87% (2.0815 => 1.4597, std.dev.: 0.0665) SingleSource/Benchmarks/CoyoteBench/lpbench: -17.99% (5.0186 => 4.1158, std.dev.: 0.2597) SingleSource/Benchmarks/Shootout/heapsort: -12.83% (3.5789 => 3.1196, std.dev.: 0.0945) SingleSource/Benchmarks/Shootout-C++/heapsort: -11.68% (3.5949 => 3.1749, std.dev.: 0.0433) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.01% (9.5262 => 9.0485, std.dev.: 0.0998) SingleSource/Benchmarks/Shootout/ary3: -4.37% (2.1901 => 2.0945, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -3.81% (1.7984 => 1.7298, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: -2.43% (1.4053 => 1.3712, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: -1.30% (7.1378 => 7.0452, std.dev.: 0.0170) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.08% (1.0825 => 1.0708, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.08% (1.1117 => 1.1108, std.dev.: 0.1679) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0431 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.49% (0.0338 => 0.0262, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0317 => 0.0317, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.40% (0.0429 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -32.27% (0.0220 => 0.0149, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -92.31% (0.0013 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.76% (0.1445 => 0.1456, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -2.97% (1.1804 => 1.1453, std.dev.: 0.0312) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.29% (0.4142 => 0.3923, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.69% (0.1455 => 0.1465, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.96% (0.0960 => 0.0998, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.88% (0.0272 => 0.0256, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.86% (0.0553 => 0.0602, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1482 => 1.1491, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -55.17% (0.0029 => 0.0013, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.26% (0.0606 => 0.0562, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0311 => 0.0311, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.18% (0.7390 => 0.7403, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.68% (0.0101 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7629 => 12.7679, std.dev.: 0.0061) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 38.99% (0.0336 => 0.0467, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320900.00% (0.0008 => 2.5680, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.01% (1.1825 => 2.4243, std.dev.: 0.0110) SingleSource/Benchmarks/Linpack/linpack-pc: 3.80% (50.8945 => 52.8289, std.dev.: 0.1090) SingleSource/Benchmarks/Misc/pi: 2.81% (2.1390 => 2.1990, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.58% (6.8159 => 6.9918, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (63.1520 => 64.2857, std.dev.: 0.0830) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -25.95% (0.1888 => 0.1398, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.00% (0.1684 => 0.1263, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.35% (0.0707 => 0.0549, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.75% (0.0676 => 0.0529, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.21% (0.1009 => 0.0795, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -20.49% (1.8964 => 1.5078, std.dev.: 0.0238) SingleSource/Benchmarks/Shootout/hash: -20.16% (0.0615 => 0.0491, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.84% (0.0862 => 0.0691, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.13% (0.1079 => 0.0905, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.51% (1.0986 => 0.9392, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: -14.44% (1.0220 => 0.8744, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/tsp/tsp: -14.02% (0.1369 => 0.1177, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -13.60% (9.8875 => 8.5425, std.dev.: 0.1210) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.58% (0.0847 => 0.0732, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: -13.00% (1.5979 => 1.3901, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.90% (0.2481 => 0.2161, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: -11.79% (2.4719 => 2.1804, std.dev.: 0.0126) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.63% (1.2154 => 1.0740, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.54% (0.1317 => 0.1165, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.38% (6.4235 => 5.6925, std.dev.: 0.0569) MultiSource/Applications/lua/lua: -11.15% (4.6406 => 4.1232, std.dev.: 0.0349) MultiSource/Applications/hexxagon/hexxagon: -10.99% (1.1433 => 1.0176, std.dev.: 0.0051) MultiSource/Applications/aha/aha: -10.60% (0.1378 => 0.1232, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.24% (0.1025 => 0.0920, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: -9.90% (0.2283 => 0.2057, std.dev.: 0.0027) MultiSource/Applications/lambda-0_1_3/lambda: -9.88% (0.8653 => 0.7798, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -9.85% (0.9124 => 0.8225, std.dev.: 0.0252) MultiSource/Applications/sqlite3/sqlite3: -9.66% (17.5634 => 15.8663, std.dev.: 0.0436) MultiSource/Applications/siod/siod: -9.61% (2.6437 => 2.3896, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.35% (1.6874 => 1.5297, std.dev.: 0.0420) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -9.24% (0.2618 => 0.2376, std.dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: -8.89% (17.4365 => 15.8863, std.dev.: 0.1134) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.1610 => 0.1468, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.74% (0.1305 => 0.1191, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.63% (0.9588 => 0.8761, std.dev.: 0.0182) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.41% (1.1731 => 1.0744, std.dev.: 0.0140) MultiSource/Applications/sgefa/sgefa: -8.25% (0.3598 => 0.3301, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: -7.58% (3.7840 => 3.4970, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.57% (0.2100 => 0.1941, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: -7.40% (0.1824 => 0.1689, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -6.55% (1.3979 => 1.3064, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -6.13% (0.2006 => 0.1883, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.10% (1.3310 => 1.2498, std.dev.: 0.0271) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.10% (0.7693 => 0.7224, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.02% (1.8127 => 1.7036, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -6.00% (0.5134 => 0.4826, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: -5.89% (0.1716 => 0.1615, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -5.87% (1.4392 => 1.3547, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/moments: -5.70% (0.4002 => 0.3774, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.69% (1.0017 => 0.9447, std.dev.: 0.0112) MultiSource/Benchmarks/sim/sim: -5.63% (0.3715 => 0.3506, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.54% (0.9550 => 0.9021, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.27% (0.2884 => 0.2732, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.23% (5.0381 => 4.7746, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.2385 => 0.2262, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -5.13% (0.7776 => 0.7377, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.08% (0.3462 => 0.3286, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.04% (0.6135 => 0.5826, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.76% (1.2680 => 1.2077, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.53% (0.3665 => 0.3499, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.53% (0.3093 => 0.2953, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.49% (3.6295 => 3.4664, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.35% (0.3981 => 0.3808, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.30% (0.5369 => 0.5138, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.22% (0.9127 => 0.8742, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: -4.15% (0.2725 => 0.2612, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: -4.08% (0.2551 => 0.2447, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.95% (0.9788 => 0.9401, std.dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: -3.72% (16.4479 => 15.8357, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/hash: -3.65% (0.4689 => 0.4518, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.52% (0.9214 => 0.8890, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.47% (0.9993 => 0.9646, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.47% (0.9403 => 0.9077, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.46% (0.6996 => 0.6754, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: -3.43% (0.6711 => 0.6481, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.74% (0.9488 => 0.9228, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -2.65% (7.3529 => 7.1577, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.57% (1.0860 => 1.0581, std.dev.: 0.0077) MultiSource/Applications/JM/lencod/lencod: -2.32% (16.7012 => 16.3138, std.dev.: 0.0851) MultiSource/Applications/oggenc/oggenc: -2.13% (5.3553 => 5.2414, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.79% (0.8926 => 0.8766, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.79% (0.9372 => 0.6486, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout/heapsort: -30.27% (4.4739 => 3.1196, std.dev.: 0.0945) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.48% (4.2042 => 3.1749, std.dev.: 0.0433) MultiSource/Applications/minisat/minisat: -22.19% (7.9891 => 6.2162, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.45% (1.0816 => 0.8496, std.dev.: 0.0288) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.84% (0.1164 => 0.0968, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/nestedloop: -12.27% (0.2200 => 0.1930, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.78% (1.6547 => 1.4597, std.dev.: 0.0665) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.83% (0.4081 => 0.3639, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/hash: -10.30% (4.5259 => 4.0596, std.dev.: 0.0403) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.22% (5.0421 => 4.5269, std.dev.: 0.0503) MultiSource/Applications/oggenc/oggenc: -9.33% (0.1704 => 0.1545, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists1: -8.98% (0.6628 => 0.6033, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.52% (0.3217 => 0.2943, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.17% (1.4588 => 1.3396, std.dev.: 0.0141) MultiSource/Applications/SPASS/SPASS: -7.88% (9.0650 => 8.3507, std.dev.: 0.1557) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.98% (23.3986 => 21.7643, std.dev.: 0.2877) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.90% (0.3201 => 0.2980, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: -6.09% (2.2304 => 2.0945, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -6.09% (0.3349 => 0.3145, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -6.08% (0.3654 => 0.3432, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.12% (46.0987 => 43.7383, std.dev.: 0.2327) SingleSource/Benchmarks/Shootout-C++/ary3: -4.55% (1.8123 => 1.7298, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.10% (1.4446 => 1.3854, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: -3.74% (4.4730 => 4.3058, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ffbench: -3.73% (1.4244 => 1.3712, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (17.2182 => 16.6145, std.dev.: 0.0250) MultiSource/Applications/SIBsim4/SIBsim4: -3.49% (3.5443 => 3.4206, std.dev.: 0.0240) SingleSource/Benchmarks/McGill/chomp: -3.29% (1.0425 => 1.0082, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (40.4729 => 39.1776, std.dev.: 0.3503) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.14% (0.3406 => 0.3299, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (1.0995 => 1.0708, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -2.55% (0.8521 => 0.8304, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -2.36% (29.0327 => 28.3465, std.dev.: 0.1374) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.35% (3.0082 => 2.9375, std.dev.: 0.0096) MultiSource/Applications/spiff/spiff: -2.23% (2.8571 => 2.7933, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.23% (0.5826 => 0.5696, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -2.20% (7.2040 => 7.0452, std.dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: -1.78% (14.0297 => 13.7795, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.77% (3.7662 => 3.6997, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.75% (61.0379 => 59.9670, std.dev.: 0.0919) SingleSource/Benchmarks/Shootout-C++/hash: -1.65% (0.6254 => 0.6151, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: -1.48% (8.6447 => 8.5169, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3169, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.16% (5.9063 => 5.8380, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/matrix: -1.09% (2.9083 => 2.8766, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.79% (1.2047 => 1.1108, std.dev.: 0.1679) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -33.50% (0.0394 => 0.0262, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.94% (0.0445 => 0.0423, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -34.36% (0.0227 => 0.0149, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -93.33% (0.0015 => 0.0001, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -40.64% (1.9293 => 1.1453, std.dev.: 0.0312) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.11% (0.4049 => 0.3923, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.98% (0.1510 => 0.1465, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.04% (0.0978 => 0.0998, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.25% (0.0276 => 0.0256, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.03% (0.0590 => 0.0602, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.08% (1.1617 => 1.1491, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -59.38% (0.0032 => 0.0013, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.87% (0.0610 => 0.0562, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.04% (0.0268 => 0.0311, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.46% (0.7437 => 0.7403, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -75.00% (0.0008 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0092 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7679, std.dev.: 0.0061) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 18 23:58:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 01:58:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119075859.83AAE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7748?compare_to=7745&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7748, Order: 172888, Start Time: 2013-01-19 05:48:10, End Time: 2013-01-19 07:59:08 To: 7745, Order: 172883, Start Time: 2013-01-19 03:07:05, End Time: 2013-01-19 05:17:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (218 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.15% (10.2556 => 10.3736, std.dev.: 0.0430) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.69% (11.2893 => 11.0980, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8401 => 499.8245, std.dev.: 0.0255) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44222.47% (1.1277 => 499.8245, std.dev.: 0.0255) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.70% (0.5229 => 1.6508, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 20.44% (14.9895 => 18.0539, std.dev.: 0.0077) MultiSource/Applications/kimwitu++/kc: 43.87% (14.1553 => 20.3657, std.dev.: 0.0244) MultiSource/Benchmarks/MallocBench/gs/gs: 18.10% (4.1105 => 4.8547, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.25% (1.1048 => 1.7373, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.64% (7.1582 => 37.6261, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.74% (3.4629 => 6.3974, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.82% (0.6222 => 1.0877, std.dev.: 0.0063) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.67% (0.0720 => 7.4424, std.dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: 3835200.00% (0.0001 => 3.8353, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11172000.00% (0.0001 => 11.1721, std.dev.: 0.0486) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489600.00% (0.0001 => 5.4897, std.dev.: 0.0029) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.71% (1.1194 => 10.3736, std.dev.: 0.0430) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.01% (22.1758 => 55.4422, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.39% (0.0929 => 0.1778, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.70% (0.1463 => 0.2512, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.57% (2.9384 => 4.6301, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.55% (7.0540 => 10.9022, std.dev.: 0.0182) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.47% (1.5859 => 2.4022, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.02% (8.1363 => 11.9617, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.24% (2.2024 => 3.1107, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 39.73% (0.1432 => 0.2001, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 39.66% (0.3109 => 0.4342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 38.34% (21.9371 => 30.3479, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.04% (4.2646 => 5.7164, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.43% (1.5415 => 2.0569, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.96% (0.4615 => 0.6136, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.34% (0.1892 => 0.2485, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.69% (0.2271 => 0.2968, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.91% (0.4299 => 0.5585, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 29.26% (1.1642 => 1.5048, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.42% (0.6675 => 0.8572, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.08% (0.1584 => 0.2013, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 27.07% (0.1655 => 0.2103, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.86% (0.0793 => 0.1006, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.58% (0.5105 => 0.6462, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 26.16% (0.2554 => 0.3222, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.11% (3.8922 => 4.9085, std.dev.: 0.0183) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.98% (0.1143 => 0.1440, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 25.46% (1.0722 => 1.3452, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.78% (0.1566 => 0.1954, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: 24.70% (0.0660 => 0.0823, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.66% (0.1906 => 0.2376, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.35% (0.3121 => 0.3881, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.16% (0.1337 => 0.1660, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.00% (1.4186 => 1.7591, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 23.57% (0.4620 => 0.5709, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.54% (0.1695 => 0.2094, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 22.93% (9.4845 => 11.6589, std.dev.: 0.0178) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 22.08% (0.7115 => 0.8686, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.96% (0.2700 => 0.3293, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.50% (0.0842 => 0.1023, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.00% (0.7835 => 0.9480, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.97% (1.3050 => 1.5787, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 20.80% (5.7591 => 6.9572, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.41% (0.1029 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 20.20% (0.6456 => 0.7760, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 20.20% (0.0614 => 0.0738, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.07% (0.8172 => 0.9812, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.88% (4.9449 => 5.9280, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.5860 => 0.7021, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1940 => 0.2323, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.66% (0.0834 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.09% (5.0018 => 5.9568, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 18.92% (3.3354 => 3.9663, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.56% (0.2758 => 0.3270, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.19% (0.5020 => 0.5933, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 18.14% (0.7433 => 0.8781, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.11% (0.3307 => 0.3906, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.04% (0.9765 => 1.1527, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.99% (0.5569 => 0.6571, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.92% (0.0770 => 0.0908, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.2107 => 0.2484, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.59% (1.1840 => 1.3923, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 17.46% (3.8723 => 4.5484, std.dev.: 0.0112) MultiSource/Applications/treecc/treecc: 17.42% (2.0273 => 2.3805, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.37% (0.5981 => 0.7020, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.32% (0.3423 => 0.4016, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 17.28% (0.2049 => 0.2403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.68% (0.3441 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.68% (0.8101 => 0.9452, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.54% (2.2969 => 2.6769, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.45% (0.6450 => 0.7511, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 16.27% (0.3232 => 0.3758, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.44% (0.3180 => 0.3671, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.26% (0.8921 => 1.0282, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.97% (1.1861 => 1.3637, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.62% (0.8067 => 0.9246, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3379 => 0.3869, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.25% (0.2603 => 0.2974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.87% (0.3865 => 0.4401, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.59% (0.4636 => 0.5266, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.40% (0.3387 => 0.3841, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.13% (1.5603 => 1.7652, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.77% (0.4103 => 0.4627, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 12.45% (0.4048 => 0.4552, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.42% (0.4203 => 0.4725, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Puzzle: 12.15% (0.1268 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.04% (0.3422 => 0.3834, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.99% (0.3603 => 0.4035, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.81% (0.2430 => 0.2717, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.68% (0.3826 => 0.4273, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 11.61% (17.1811 => 19.1764, std.dev.: 0.0225) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.48% (0.3684 => 0.4107, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.29% (0.3092 => 0.3441, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.20% (0.4064 => 0.4519, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.72% (14.3668 => 15.9069, std.dev.: 0.0164) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.17% (0.2831 => 0.3119, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2871 => 0.3157, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 9.73% (0.2877 => 0.3157, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.65% (2.0665 => 2.2660, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.19% (0.2905 => 0.3172, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 9.17% (1.2842 => 1.4020, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.10% (0.3650 => 0.3982, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.08% (0.3162 => 0.3449, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.91% (0.3052 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.85% (0.2802 => 0.3050, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.77% (0.2872 => 0.3124, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.70% (0.2725 => 0.2962, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.66% (63.2438 => 68.7207, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2714 => 0.2946, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.51% (0.3935 => 0.4270, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7326 => 0.7937, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.62% (2.2022 => 2.3700, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.05% (0.4879 => 0.5223, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.05% (10.3673 => 11.0980, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.89% (0.3177 => 0.3396, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.22% (0.3131 => 0.3263, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.20% (0.3817 => 0.3939, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.64% (7.9617 => 8.1720, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2504, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6957, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2436, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4599, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3112, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (2.0360 => 2.1046, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.23% (0.9957 => 1.0279, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9234, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7205, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.94% (9.1159 => 9.2930, std.dev.: 0.0033) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2824, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4557, std.dev.: 0.0225) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.64% (5.2763 => 1.1798, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -75.23% (0.8651 => 0.2143, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.68% (5.3855 => 4.4872, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.32% (5.3526 => 4.4792, std.dev.: 0.0138) MultiSource/Applications/JM/ldecod/ldecod: -13.35% (10.4361 => 9.0433, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9857, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.56% (1.7609 => 1.6278, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.66% (1.9577 => 0.6722, std.dev.: 0.0047) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3074, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4290, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8646, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0057, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0902, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.48% (19.9488 => 18.2564, std.dev.: 0.0268) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4815, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.56% (1.2373 => 1.1561, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7044, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.67% (1.5835 => 1.5096, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.51% (10.2830 => 9.8191, std.dev.: 0.0093) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3281, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -1.64% (3.6994 => 3.6389, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2353, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0019) Report Time: 1.63s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 00:20:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 02:20:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119082021.D79312A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7749?compare_to=7746&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7749, Order: 172888, Start Time: 2013-01-19 06:42:34, End Time: 2013-01-19 08:20:30 To: 7746, Order: 172886, Start Time: 2013-01-19 04:45:42, End Time: 2013-01-19 06:19:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (92 on baseline) Performance Improvements: 0 (98 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (902 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (79.7143 => 81.1573, std.dev.: 0.2505) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.53% (0.0717 => 0.1194, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.06% (0.0974 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.51% (0.6395 => 0.8730, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.22% (0.1132 => 0.1542, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.53% (0.6395 => 0.8603, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.64% (0.6260 => 0.8303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.56% (0.5688 => 0.7483, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.51% (0.5805 => 0.7634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.23% (0.5456 => 0.7160, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.04% (0.6230 => 0.8164, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.57% (0.5849 => 0.7637, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.56% (0.5567 => 0.7268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.51% (0.5575 => 0.7276, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.30% (0.5941 => 0.7741, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.28% (0.5581 => 0.7271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.89% (0.5802 => 0.7536, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.41% (0.5705 => 0.7383, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.39% (0.6033 => 0.7806, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.98% (0.5570 => 0.7184, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.97% (0.5478 => 0.7065, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.96% (0.6440 => 0.8305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.84% (0.5859 => 0.7549, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.84% (0.5857 => 0.7546, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.50% (0.5569 => 0.7156, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.47% (0.5925 => 0.7612, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.22% (0.5591 => 0.7169, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.83% (0.6676 => 0.8534, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.68% (0.6189 => 0.7902, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.62% (1.6474 => 2.1024, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.55% (0.6446 => 0.8222, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.45% (0.6052 => 0.7713, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.31% (0.5863 => 0.7464, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.74% (0.6304 => 0.7990, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.77% (0.6681 => 0.8403, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.65% (0.6194 => 0.7783, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.32% (0.6660 => 0.8346, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.23% (0.6297 => 0.7886, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.89% (0.6667 => 0.8260, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.74% (0.7524 => 0.9235, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.87% (0.7339 => 0.8944, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.48% (0.0582 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.57% (2.2587 => 2.7233, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.92% (1.1450 => 1.3273, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 14.27% (0.3357 => 0.3836, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.60% (0.1081 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.20% (4.5069 => 5.0569, std.dev.: 0.1309) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (0.4916 => 0.5475, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 11.10% (0.4515 => 0.5016, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.98% (1.6364 => 1.8161, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.82% (3.5339 => 3.9164, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.39% (0.2385 => 0.2609, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.7021 => 0.7580, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 7.56% (0.4524 => 0.4866, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 7.04% (1.2515 => 1.3396, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.77% (0.5329 => 0.5690, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4861 => 0.5179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.19% (9.2283 => 9.7991, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.02% (0.6750 => 0.6954, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.81% (5.4682 => 5.6217, std.dev.: 0.0087) MultiSource/Applications/spiff/spiff: 1.96% (0.8418 => 0.8583, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.14% (0.9557 => 0.9666, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6780, std.dev.: 0.0831) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0134) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.91% (54.5751 => 56.7107, std.dev.: 0.0425) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1051, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.81% (79.7170 => 81.1573, std.dev.: 0.2505) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0046) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2086, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.18% (10.3489 => 10.4707, std.dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.39% (0.7198 => 0.6810, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3831 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.77% (2.4924 => 2.3735, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.59% (0.3880 => 0.3702, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.45% (0.4176 => 0.3990, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.17% (0.3884 => 0.3722, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.02% (0.4199 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.92% (0.6347 => 0.6098, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.79% (0.3142 => 0.3023, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.60% (0.6441 => 0.6209, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4280 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.55% (0.2903 => 0.2800, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.55% (0.3016 => 0.2909, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: -3.53% (0.3205 => 0.3092, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.40% (0.2939 => 0.2839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.37% (2.1713 => 2.0982, std.dev.: 0.0198) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.04% (0.4151 => 0.4025, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.89% (0.7779 => 0.7554, std.dev.: 0.0027) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2415, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.26% (0.4427 => 0.4327, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.88% (1.2221 => 1.1991, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -1.35% (2.4021 => 2.3697, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.03% (34.0927 => 33.7405, std.dev.: 0.1009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.45% (1.8100 => 0.6797, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3124, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.44% (1.3643 => 1.0308, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.69% (0.2274 => 0.1758, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3399, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1488, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.13% (2.2633 => 2.1699, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (7.9763 => 7.7858, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -1.99% (3.7241 => 3.6499, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1980, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.34% (1.3096 => 1.2920, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5907, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0032) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 01:10:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 03:10:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119091034.A4FB52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7750?compare_to=7743&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7750, Order: 172886, Start Time: 2013-01-19 05:26:21, End Time: 2013-01-19 09:10:44 To: 7743, Order: 172874, Start Time: 2013-01-19 00:59:46, End Time: 2013-01-19 04:34:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (178 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (760 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.36% (2.2953 => 2.3494, std.dev.: 0.0208) MultiSource/Applications/treecc/treecc: 1.44% (0.9078 => 0.9209, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 18.37% (100.0941 => 118.4774, std.dev.: 0.1786) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.08% (2.0556 => 2.1189, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.10% (54.1978 => 54.7928, std.dev.: 0.1182) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -2.55% (2.0423 => 1.9902, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.09% (2.4201 => 2.3938, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: -1.00% (1.1460 => 1.1345, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 48.80% (0.0625 => 0.0930, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 43.09% (0.1063 => 0.1521, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.93% (0.4139 => 0.5295, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.75% (0.2969 => 0.3793, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.42% (0.0547 => 0.0697, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.51% (0.0415 => 0.0525, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.49% (0.1106 => 0.1399, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.43% (0.4253 => 0.5377, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.07% (0.5900 => 0.7438, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.93% (0.4994 => 0.6289, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.91% (0.0714 => 0.0899) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.19% (0.1620 => 0.2028, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 24.92% (1.5932 => 1.9902, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.28% (0.5000 => 0.6214, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.97% (0.0822 => 0.1019, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 23.78% (0.1619 => 0.2004, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.56% (0.1549 => 0.1914, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.21% (0.1103 => 0.1359, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.27% (0.0642 => 0.0785, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.13% (0.1107 => 0.1352, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.07% (0.1604 => 0.1958, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.83% (0.1003 => 0.1222, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.82% (0.4029 => 0.4908, std.dev.: 0.0080) MultiSource/Applications/aha/aha: 21.62% (0.0481 => 0.0585, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.60% (0.3903 => 0.4746, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: 20.95% (0.0821 => 0.0993, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.75% (0.3890 => 0.4697, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 19.93% (0.1505 => 0.1805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.91% (0.1090 => 0.1307, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.90% (0.1462 => 0.1753, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.83% (0.1160 => 0.1390, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.70% (0.2736 => 0.3275, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 19.68% (0.0808 => 0.0967, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.58% (0.1088 => 0.1301, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 19.46% (0.1218 => 0.1455, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.46% (1.3152 => 1.5711, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.36% (0.2866 => 0.3421, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.30% (1.9694 => 2.3494, std.dev.: 0.0208) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.27% (0.2014 => 0.2402, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.23% (0.3271 => 0.3900, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/oourafft: 18.89% (0.0561 => 0.0667, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 18.88% (0.5546 => 0.6593, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 18.68% (1.8794 => 2.2305, std.dev.: 0.0338) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.39% (0.1968 => 0.2330, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 18.15% (0.1284 => 0.1517, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.70% (1.6211 => 1.9081, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.63% (0.4658 => 0.5479, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.42% (3.5627 => 4.1833, std.dev.: 0.0629) MultiSource/Applications/d/make_dparser: 17.28% (1.0781 => 1.2644, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.99% (0.9697 => 1.1345, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: 16.94% (0.7875 => 0.9209, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.79% (0.0673 => 0.0786, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.77% (0.5026 => 0.5869, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.76% (0.4361 => 0.5092, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 16.75% (0.1421 => 0.1659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 16.60% (0.5826 => 0.6793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 16.58% (0.2823 => 0.3291, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.57% (0.2813 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.56% (0.2875 => 0.3351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.48% (0.2792 => 0.3252, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.46% (0.3930 => 0.4577, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 16.34% (0.5889 => 0.6851, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.31% (4.2109 => 4.8979, std.dev.: 0.0825) SingleSource/Benchmarks/Shootout-C++/strcat: 16.22% (0.2750 => 0.3196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.18% (0.2738 => 0.3181, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 16.08% (0.2811 => 0.3263, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 16.08% (0.9909 => 1.1502, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: 15.94% (0.2911 => 0.3375, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/fibo: 15.93% (0.2725 => 0.3159, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 15.91% (0.2803 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.90% (0.3195 => 0.3703, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hello: 15.88% (0.2714 => 0.3145, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 15.86% (0.2780 => 0.3221, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 15.86% (0.2566 => 0.2973, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: 15.83% (0.7171 => 0.8306, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.79% (2.0673 => 2.3938, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 15.79% (0.2729 => 0.3160, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.78% (0.3004 => 0.3478, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.72% (2.7292 => 3.1581, std.dev.: 0.0383) MultiSource/Applications/SIBsim4/SIBsim4: 15.68% (0.2691 => 0.3113, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.65% (1.9966 => 2.3091, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.61% (4.4195 => 5.1094, std.dev.: 0.0338) MultiSource/Applications/lua/lua: 15.57% (1.4269 => 1.6490, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/wc: 15.47% (0.3096 => 0.3575, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 15.46% (0.3267 => 0.3772, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.39% (0.3060 => 0.3531, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 15.38% (0.3258 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.20% (0.3362 => 0.3873, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 15.12% (0.4146 => 0.4773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.11% (0.3124 => 0.3596, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 15.11% (23.5202 => 27.0730, std.dev.: 0.1045) SingleSource/Benchmarks/Shootout-C++/sieve: 15.08% (0.3726 => 0.4288, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 14.98% (0.3317 => 0.3814, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.90% (0.3348 => 0.3847, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.85% (0.3845 => 0.4416, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 14.75% (0.3477 => 0.3990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.74% (0.3678 => 0.4220, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.59% (0.3282 => 0.3761, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.46% (4.6177 => 5.2856, std.dev.: 0.0327) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.42% (0.3690 => 0.4222, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.39% (0.3981 => 0.4554, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 14.37% (0.4251 => 0.4862, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.23% (2.1653 => 2.4735, std.dev.: 0.0253) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.88% (0.3488 => 0.3972, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 13.73% (0.5012 => 0.5700, std.dev.: 0.0210) SingleSource/UnitTests/ObjC/exceptions-4: 13.71% (0.3465 => 0.3940, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.70% (0.3446 => 0.3918, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 13.61% (0.3469 => 0.3941, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.58% (0.3460 => 0.3930, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 13.56% (5.5417 => 6.2931, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/trivial-interface: 13.51% (0.3442 => 0.3907, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3724 => 0.4218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.20% (0.3643 => 0.4124, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.93% (0.6435 => 0.7267, std.dev.: 0.0223) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3668, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.39% (0.2737 => 0.3076, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.35% (0.2040 => 0.2292, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 11.81% (0.3498 => 0.3911, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 11.71% (0.6634 => 0.7411, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.60% (0.5361 => 0.5983, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.50% (0.1383 => 0.1542, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.18% (0.3336 => 0.3709, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.08% (0.2103 => 0.2336, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: 10.91% (0.4847 => 0.5376, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.75% (0.7426 => 0.8224, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.72% (11.6398 => 12.8872, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.95% (4.6926 => 5.1596, std.dev.: 0.1358) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 9.35% (2.0346 => 2.2249, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.79% (0.5584 => 0.6075, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 7.13% (11.9555 => 12.8083, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5183, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0260) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.62% (0.3693 => 0.4122, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 8.96% (0.2802 => 0.3053, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6731, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2390, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8910, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6759, std.dev.: 0.0817) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1977, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.47% (1.0927 => 1.1088, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3030, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0062) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0811, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2102, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4814, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5975, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5859, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -20.89% (3.6262 => 2.8687, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -16.99% (17.2379 => 14.3100, std.dev.: 0.1335) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9751, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7912, std.dev.: 0.0187) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -6.95% (0.2402 => 0.2235, std.dev.: 0.0036) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2317, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8084, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0025) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1432, std.dev.: 0.8360) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5751, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.03% (105.3826 => 104.2935, std.dev.: 0.3849) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0496, std.dev.: 0.0630) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 01:20:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 03:20:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119092025.DB52C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7751?compare_to=7747&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7751, Order: 172890, Start Time: 2013-01-19 07:18:25, End Time: 2013-01-19 09:20:36 To: 7747, Order: 172888, Start Time: 2013-01-19 05:03:06, End Time: 2013-01-19 07:01:03 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (7 on baseline) Performance Improvements: 0 (42 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1061 (1014 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: 12.23% (0.1177 => 0.1321, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.71% (1.0708 => 1.0891, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 1.23% (6.9918 => 7.0780, std.dev.: 0.0181) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.48% (1.1108 => 1.1272, std.dev.: 0.1251) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.81% (0.0430 => 0.0405, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.20% (0.0262 => 0.0251, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0317 => 0.0319, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.73% (0.0423 => 0.0403, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -3.90% (0.0205 => 0.0197, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -7.38% (0.0149 => 0.0138, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 1200.00% (0.0001 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.03% (0.1456 => 0.1471, std.dev.: 0.0257) MultiSource/Applications/lemon/lemon: 3.09% (1.1453 => 1.1807, std.dev.: 0.5027) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.12% (0.3923 => 0.4124, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.60% (0.1465 => 0.1547, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.50% (0.0998 => 0.0993, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.81% (0.0256 => 0.0276, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.97% (0.0602 => 0.0548, std.dev.: 0.0128) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1491 => 1.1519, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.08% (0.0013 => 0.0016, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.47% (0.0562 => 0.0604, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.72% (0.0311 => 0.0287, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.39% (0.7403 => 0.7432, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.19% (0.0069 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.02% (12.7679 => 12.7648, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.45% (0.0336 => 0.0482, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321637.50% (0.0008 => 2.5739, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.78% (1.1825 => 2.3742, std.dev.: 0.0336) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.80% (0.2562 => 0.2890, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.31% (3.7074 => 3.9041, std.dev.: 0.0539) MultiSource/Applications/JM/lencod/lencod: 3.85% (6.8159 => 7.0780, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/pi: 3.16% (2.1390 => 2.2065, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -32.80% (0.0808 => 0.0543, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.15% (0.0676 => 0.0506, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: -19.49% (0.0549 => 0.0442, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.94% (0.1009 => 0.0828, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.61% (1.0960 => 0.9249, std.dev.: 0.0622) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.32% (6.4235 => 5.6962, std.dev.: 0.1124) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.87% (1.2154 => 1.0833, std.dev.: 0.0499) MultiSource/Applications/d/make_dparser: -6.81% (3.7840 => 3.5264, std.dev.: 0.0975) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: -5.80% (0.5134 => 0.4836, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.72% (1.0017 => 0.9444, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.48% (0.3981 => 0.3763, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: -5.29% (0.1928 => 0.1826, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: -5.20% (0.2385 => 0.2261, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.77% (0.3665 => 0.3490, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.76% (0.6135 => 0.5843, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: -4.30% (0.3206 => 0.3068, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.17% (0.9422 => 0.9029, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.92% (0.9512 => 0.9139, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: -3.76% (0.6711 => 0.6459, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.42% (0.9507 => 0.9182, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.01% (0.9403 => 0.9120, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.47% (0.9855 => 0.9710, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -29.65% (0.9372 => 0.6593, std.dev.: 0.0958) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.58% (4.2042 => 3.2129, std.dev.: 0.0894) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.56% (0.4081 => 0.3650, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: -8.15% (0.6628 => 0.6088, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.03% (1.4588 => 1.3416, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.49% (0.3217 => 0.2976, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/health/health: -5.56% (0.3654 => 0.3451, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.37% (0.3201 => 0.3029, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -4.24% (1.8123 => 1.7355, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/lists: -3.47% (17.2182 => 16.6214, std.dev.: 0.0876) SingleSource/Benchmarks/McGill/chomp: -2.94% (1.0425 => 1.0118, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.95% (42.3194 => 41.4959, std.dev.: 0.1693) SingleSource/Benchmarks/Misc/mandel-2: -1.91% (0.8521 => 0.8358, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -1.42% (14.0297 => 13.8304, std.dev.: 0.0189) SingleSource/Benchmarks/Stanford/FloatMM: -1.42% (0.8328 => 0.8210, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3152, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.17% (3.1921 => 3.1546, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -1.12% (2.9083 => 2.8756, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.43% (1.2047 => 1.1272, std.dev.: 0.1251) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -10.20% (0.0451 => 0.0405, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -36.29% (0.0394 => 0.0251, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.44% (0.0445 => 0.0403, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: -7.51% (0.0213 => 0.0197, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -39.21% (0.0227 => 0.0138, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.86% (0.1530 => 0.1471, std.dev.: 0.0257) MultiSource/Applications/lemon/lemon: -38.80% (1.9293 => 1.1807, std.dev.: 0.5027) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.85% (0.4049 => 0.4124, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.45% (0.1510 => 0.1547, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0978 => 0.0993, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.12% (0.0590 => 0.0548, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.84% (1.1617 => 1.1519, std.dev.: 0.0214) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0032 => 0.0016, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.09% (0.0268 => 0.0287, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (0.7437 => 0.7432, std.dev.: 0.0009) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -7.61% (0.0092 => 0.0085, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.10% (12.7781 => 12.7648, std.dev.: 0.0070) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 02:18:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 04:18:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119101807.8D3772A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7752?compare_to=7749&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7752, Order: 172892, Start Time: 2013-01-19 08:44:27, End Time: 2013-01-19 10:18:17 To: 7749, Order: 172888, Start Time: 2013-01-19 06:42:34, End Time: 2013-01-19 08:20:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (119 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (874 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 66.67% (0.0717 => 0.1195, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 59.96% (0.0974 => 0.1558, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 44.80% (0.1500 => 0.2172, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.51% (0.6395 => 0.8730, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.62% (0.6395 => 0.8609, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.67% (0.6260 => 0.8305, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.63% (0.5688 => 0.7487, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.61% (0.5805 => 0.7640, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.27% (0.5456 => 0.7162, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.95% (0.6230 => 0.8158, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.81% (0.5849 => 0.7651, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.71% (0.5575 => 0.7287, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.50% (0.5581 => 0.7283, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.43% (0.5567 => 0.7261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.96% (0.5802 => 0.7540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.54% (0.6033 => 0.7815, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.43% (0.5705 => 0.7384, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.07% (0.5859 => 0.7562, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.90% (0.6440 => 0.8301, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.90% (0.5478 => 0.7061, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.89% (0.5570 => 0.7179, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.75% (0.5857 => 0.7541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.64% (0.5569 => 0.7164, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.54% (0.5925 => 0.7616, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.22% (0.5591 => 0.7169, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.57% (0.6189 => 0.7895, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.51% (0.6446 => 0.8219, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.48% (0.5863 => 0.7474, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.46% (0.6052 => 0.7714, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.41% (1.6474 => 2.0990, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.68% (0.6304 => 0.7986, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.73% (0.6194 => 0.7788, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.71% (0.6681 => 0.8399, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.33% (0.6660 => 0.8347, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.30% (0.6297 => 0.7890, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.92% (0.6667 => 0.8262, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.77% (0.7524 => 0.9237, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.84% (0.7339 => 0.8942, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.58% (2.2587 => 2.7236, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.07% (1.1450 => 1.3175, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.27% (0.3357 => 0.3836, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.07% (4.5069 => 5.0507, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.39% (0.4916 => 0.5476, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 11.18% (0.4515 => 0.5020, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.02% (1.6364 => 1.8168, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.72% (3.5339 => 3.9128, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.43% (0.2385 => 0.2610, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.10% (0.7021 => 0.7590, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.2001 => 0.2153, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 7.24% (1.2515 => 1.3421, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.05% (0.4524 => 0.4843, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.83% (0.5329 => 0.5693, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.59% (0.1731 => 0.1845, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.54% (0.4861 => 0.5179, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.48% (1.4642 => 1.5591, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.41% (1.2784 => 1.3604, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 6.10% (9.2283 => 9.7912, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.3255 => 0.3425, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.34% (0.3319 => 0.3463, std.dev.: 0.0048) MultiSource/Applications/oggenc/oggenc: 3.03% (5.0226 => 5.1747, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 2.95% (0.6750 => 0.6949, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (5.4682 => 5.6243, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.3864 => 1.4189, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: 1.77% (0.8418 => 0.8567, std.dev.: 0.0043) MultiSource/Applications/minisat/minisat: 1.34% (0.7447 => 0.7547, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3722 => 1.3898, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.20% (0.9557 => 0.9672, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.49% (31.3723 => 55.6813, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.07% (0.9531 => 1.0300, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5506, std.dev.: 0.0962) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.64% (0.6469 => 0.6640, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6052, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.39% (27.8210 => 28.2091, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.66% (0.1281 => 0.1106, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.39% (0.7198 => 0.6810, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.91% (0.3812 => 0.3625, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (2.4924 => 2.3737, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.68% (0.3848 => 0.3668, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.38% (0.3837 => 0.3669, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.37% (0.3821 => 0.3654, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.27% (0.9852 => 0.9431, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.16% (0.2428 => 0.2327, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/property: -3.88% (0.4199 => 0.4036, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.83% (0.7779 => 0.7481, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -3.83% (0.6347 => 0.6104, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.79% (0.3142 => 0.3023, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.69% (0.2903 => 0.2796, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.66% (0.2871 => 0.2766, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.64% (0.4280 => 0.4124, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.55% (0.3016 => 0.2909, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.54% (0.6441 => 0.6213, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.48% (0.2933 => 0.2831, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.44% (0.2939 => 0.2838, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.41% (0.9542 => 0.9217, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: -3.33% (0.3059 => 0.2957, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.32% (2.1713 => 2.0993, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.23% (0.3252 => 0.3147, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -3.13% (1.3148 => 1.2737, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.02% (0.6484 => 0.6288, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.99% (0.4151 => 0.4027, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.98% (0.3658 => 0.3549, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2244, std.dev.: 0.0225) MultiSource/Applications/sqlite3/sqlite3: -2.47% (17.1032 => 16.6812, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8591, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -2.29% (16.1920 => 15.8210, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.28% (6.7716 => 6.6170, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.15% (0.7919 => 0.7749, std.dev.: 0.0052) MultiSource/Applications/JM/ldecod/ldecod: -1.86% (7.0961 => 6.9640, std.dev.: 0.0234) MultiSource/Benchmarks/MallocBench/gs/gs: -1.84% (4.3330 => 4.2533, std.dev.: 0.0194) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.79% (1.2210 => 1.1991, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.74% (1.0544 => 1.0361, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: -1.69% (0.7982 => 0.7847, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.60% (1.2300 => 1.2103, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: -1.59% (0.9179 => 0.9033, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: -1.23% (1.5610 => 1.5418, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.06% (34.0927 => 33.7317, std.dev.: 0.0190) MultiSource/Applications/lua/lua: -1.04% (4.0594 => 4.0170, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.00% (8.0126 => 7.9322, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.53% (1.8100 => 0.6963, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3095, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.43% (1.3643 => 1.0310, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0180, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2078, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6676, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1701, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.31% (7.9763 => 7.7920, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.93% (3.7241 => 3.6523, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.66% (1.6219 => 1.5950, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4700, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1934, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6092, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5892, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6675, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -1.08% (1.4516 => 1.4359, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 02:45:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 04:45:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119104503.81E642A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7753?compare_to=7748&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7753, Order: 172890, Start Time: 2013-01-19 08:33:23, End Time: 2013-01-19 10:45:12 To: 7748, Order: 172888, Start Time: 2013-01-19 05:48:10, End Time: 2013-01-19 07:59:08 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.11% (1.5048 => 1.5215, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.99% (0.0651 => 0.0677, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8245 => 499.8406, std.dev.: 0.0118) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44223.90% (1.1277 => 499.8406, std.dev.: 0.0118) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.05% (0.5229 => 1.6526, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 20.49% (14.9895 => 18.0602, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 43.95% (14.1553 => 20.3771, std.dev.: 0.0308) MultiSource/Benchmarks/MallocBench/gs/gs: 18.32% (4.1105 => 4.8635, std.dev.: 0.0270) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.47% (1.1048 => 1.7397, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.00% (7.1582 => 37.6523, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.82% (3.4629 => 6.4001, std.dev.: 0.0209) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.59% (0.6222 => 1.0863, std.dev.: 0.0052) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.56% (0.0720 => 7.4452, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11148000.00% (0.0001 => 11.1481, std.dev.: 0.0702) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0021) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.16% (1.1194 => 10.3674, std.dev.: 0.0179) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.04% (22.1758 => 55.4493, std.dev.: 0.0486) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 91.28% (0.0929 => 0.1777, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.67% (2.9384 => 4.6329, std.dev.: 0.0039) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.65% (7.0540 => 10.9089, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.61% (1.5859 => 2.4044, std.dev.: 0.0073) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.25% (8.1363 => 11.9806, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.33% (2.2024 => 3.1126, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops: 40.15% (0.1432 => 0.2007, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 39.98% (0.3109 => 0.4352, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 38.45% (21.9371 => 30.3709, std.dev.: 0.0291) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0016) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.06% (4.2646 => 5.7172, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.89% (0.4615 => 0.6179, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.31% (1.5415 => 2.0549, std.dev.: 0.0076) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.71% (0.1892 => 0.2492, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.69% (1.1642 => 1.5215, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.60% (0.2271 => 0.2966, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 30.54% (0.4299 => 0.5612, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.45% (0.6675 => 0.8574, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 28.14% (0.0636 => 0.0815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 27.40% (0.1175 => 0.1497, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.29% (0.5105 => 0.6498, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.21% (0.1584 => 0.2015, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 26.62% (0.2554 => 0.3234, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.48% (0.0457 => 0.0578, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.28% (3.8922 => 4.9150, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.02% (0.1906 => 0.2402, std.dev.: 0.0026) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.98% (0.1143 => 0.1440, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 25.56% (1.0722 => 1.3463, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.97% (0.1566 => 0.1957, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.91% (0.1337 => 0.1670, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.70% (0.3121 => 0.3892, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.31% (1.4186 => 1.7634, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 24.29% (0.4289 => 0.5331, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 23.68% (0.4620 => 0.5714, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 23.09% (9.4845 => 11.6740, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.48% (0.1695 => 0.2076, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.30% (0.2700 => 0.3302, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 22.11% (0.7115 => 0.8688, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 21.81% (0.7835 => 0.9544, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.97% (1.3050 => 1.5787, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 20.86% (5.7591 => 6.9604, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.70% (0.1029 => 0.1242, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.42% (0.1151 => 0.1386, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 20.41% (0.1695 => 0.2041, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.40% (0.8172 => 0.9839, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 20.24% (0.6456 => 0.7763, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.01% (4.9449 => 5.9343, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.93% (0.5860 => 0.7028, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.69% (0.1940 => 0.2322, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.66% (0.0834 => 0.0998, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.53% (0.0886 => 0.1059, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.40% (0.2758 => 0.3293, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.14% (5.0018 => 5.9593, std.dev.: 0.0105) MultiSource/Applications/d/make_dparser: 19.14% (3.3354 => 3.9738, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 18.96% (0.7433 => 0.8842, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.65% (0.5020 => 0.5956, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.59% (0.5569 => 0.6604, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.23% (0.3307 => 0.3910, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.07% (0.9765 => 1.1530, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.99% (0.2107 => 0.2486, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.79% (0.0770 => 0.0907, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.74% (3.8723 => 4.5593, std.dev.: 0.0077) MultiSource/Benchmarks/nbench/nbench: 17.64% (1.1840 => 1.3928, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/18-imp/imp: 17.47% (0.3423 => 0.4021, std.dev.: 0.0025) MultiSource/Applications/treecc/treecc: 17.40% (2.0273 => 2.3800, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.25% (0.5981 => 0.7013, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.07% (0.8101 => 0.9484, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 16.94% (0.3283 => 0.3839, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.80% (0.3441 => 0.4019, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 16.51% (2.2969 => 2.6762, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 16.50% (0.2049 => 0.2387, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 16.27% (0.3232 => 0.3758, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.26% (0.6450 => 0.7499, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: 16.01% (0.0818 => 0.0949, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.77% (0.0704 => 0.0815, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/football/football: 15.40% (0.8921 => 1.0295, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.10% (0.8067 => 0.9285, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.98% (1.1861 => 1.3638, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.77% (0.3379 => 0.3878, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.92% (0.3865 => 0.4403, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 13.79% (0.3387 => 0.3854, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7676, std.dev.: 0.0138) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.01% (0.4636 => 0.5239, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.77% (0.4103 => 0.4627, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.71% (0.4203 => 0.4737, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 12.33% (0.4048 => 0.4547, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3927 => 0.4407, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.99% (0.3603 => 0.4035, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.98% (0.3422 => 0.3832, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 11.74% (17.1811 => 19.1976, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 11.70% (0.3282 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 11.59% (0.3684 => 0.4111, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 11.58% (0.3092 => 0.3450, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.45% (0.3826 => 0.4264, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.10% (0.4064 => 0.4515, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2831 => 0.3140, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.76% (14.3668 => 15.9131, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions-4: 10.73% (0.3543 => 0.3923, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.64% (0.3543 => 0.3920, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.54% (0.3473 => 0.3839, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 10.17% (0.2871 => 0.3163, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.69% (2.0665 => 2.2668, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 9.59% (0.2877 => 0.3153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2891 => 0.3159, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 9.26% (0.2905 => 0.3174, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 9.17% (1.2842 => 1.4019, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.01% (0.3650 => 0.3979, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2756 => 0.3004, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.92% (0.3162 => 0.3444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.82% (0.2802 => 0.3049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.81% (0.3052 => 0.3321, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.66% (0.2793 => 0.3035, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.64% (63.2438 => 68.7064, std.dev.: 0.0857) SingleSource/Benchmarks/Shootout-C++/hello: 8.62% (0.2714 => 0.2948, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.56% (0.3935 => 0.4272, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7326 => 0.7934, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.65% (2.2022 => 2.3707, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0071) MultiSource/Benchmarks/PAQ8p/paq8p: 7.05% (10.3673 => 11.0986, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.77% (0.3177 => 0.3392, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.73% (7.9617 => 8.1793, std.dev.: 0.0138) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.21% (32.5116 => 59.2410, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4531, std.dev.: 0.0075) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3135, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.50% (2.0360 => 2.1073, std.dev.: 0.0161) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.05% (0.9957 => 1.0261, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9098, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7143, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/bisort/bisort: 1.93% (0.8333 => 0.8494, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2840, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8444 => 28.2867, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4562, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.62% (5.2763 => 1.1809, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -75.24% (0.8651 => 0.2142, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.71% (5.3855 => 4.4854, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.31% (5.3526 => 4.4798, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -13.14% (10.4361 => 9.0646, std.dev.: 0.0157) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9658, std.dev.: 0.0537) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.54% (1.7609 => 1.6281, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.53% (1.9577 => 0.6357, std.dev.: 0.0188) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0196, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.73% (10.7105 => 7.4188, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8572, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.36% (2.6546 => 2.0079, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.56% (0.0756 => 0.0593, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4197, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/matrix: -12.97% (3.1443 => 2.7366, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4936, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.28% (19.9488 => 18.2966, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4814, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2373 => 1.1650, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7039, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.90% (1.5835 => 1.5059, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.76% (0.4808 => 0.4579, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8394, std.dev.: 0.0030) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.40% (3.7221 => 3.6701, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/ary3: -1.15% (3.6994 => 3.6567, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8548, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0095) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0025) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 03:35:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 05:35:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119113551.70C472A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7754?compare_to=7751&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7754, Order: 172894, Start Time: 2013-01-19 09:37:55, End Time: 2013-01-19 11:36:02 To: 7751, Order: 172890, Start Time: 2013-01-19 07:18:25, End Time: 2013-01-19 09:20:36 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (12 on baseline) Performance Improvements: 10 (120 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (931 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: 27.29% (0.1990 => 0.2533, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 22.23% (7.4468 => 9.1022, std.dev.: 0.1697) SingleSource/Benchmarks/Stanford/Puzzle: 17.20% (0.1715 => 0.2010, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.56% (4.1309 => 4.4018, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/hash: 4.86% (0.6151 => 0.6450, std.dev.: 0.0001) SingleSource/Benchmarks/Linpack/linpack-pc: 2.94% (51.3099 => 52.8162, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.55% (0.4115 => 0.4220, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 2.13% (63.2540 => 64.6034, std.dev.: 0.1769) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.93% (3.5290 => 3.5972, std.dev.: 0.0169) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.68% (2.7618 => 2.8083, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.59% (0.2430 => 0.2124, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.14% (1.0759 => 1.0421, std.dev.: 0.0074) MultiSource/Benchmarks/SciMark2-C/scimark2: -2.91% (0.3606 => 0.3501, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.78% (9.3535 => 9.1866, std.dev.: 0.0510) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.35% (1.9105 => 1.8847, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.20% (1.2317 => 1.2169, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.27% (0.3642 => 0.3450, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.43% (7.0778 => 6.8353, std.dev.: 0.0456) SingleSource/Benchmarks/Misc/flops: -2.46% (8.8599 => 8.6416, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/heapsort: -2.08% (3.2129 => 3.1462, std.dev.: 0.0224) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.36% (1.1272 => 1.1231, std.dev.: 0.1245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -13.12% (0.0221 => 0.0192, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.14% (0.0405 => 0.0368, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 14.34% (0.0251 => 0.0287, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.67% (0.0319 => 0.0269, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -9.43% (0.0403 => 0.0365, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -17.26% (0.0197 => 0.0163, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: 22.46% (0.0138 => 0.0169, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.58% (0.1471 => 0.1433, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -3.74% (1.1807 => 1.1366, std.dev.: 0.2982) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.35% (0.4124 => 0.3986, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.91% (0.1547 => 0.1502, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.93% (0.0993 => 0.0954, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: - (0.0548 => 0.0548, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.1519 => 1.1459, std.dev.: 0.1050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -93.75% (0.0016 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.09% (0.0604 => 0.0537, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.06% (0.0287 => 0.0313, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7432 => 0.7396, std.dev.: 0.0360) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.18% (0.0085 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.07% (12.7648 => 12.7559, std.dev.: 0.0217) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.05% (1.8651 => 1.8847, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321887.50% (0.0008 => 2.5759, std.dev.: 0.0645) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.47% (1.1825 => 2.4060, std.dev.: 0.0227) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.37% (0.2070 => 0.2533, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 22.18% (7.4497 => 9.1022, std.dev.: 0.1697) SingleSource/Benchmarks/Stanford/Puzzle: 18.37% (0.1698 => 0.2010, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.64% (4.1668 => 4.4018, std.dev.: 0.0297) SingleSource/Benchmarks/Linpack/linpack-pc: 3.78% (50.8945 => 52.8162, std.dev.: 0.0271) SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.6254 => 0.6450, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.30% (63.1520 => 64.6034, std.dev.: 0.1769) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.60% (2.7640 => 2.8083, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.12% (0.0727 => 0.0508, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.06% (0.0692 => 0.0484, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -28.28% (0.1888 => 0.1354, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -20.26% (1.8964 => 1.5122, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.97% (0.0676 => 0.0541, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.52% (0.1009 => 0.0812, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.14% (0.0862 => 0.0697, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.51% (1.0960 => 0.9260, std.dev.: 0.0594) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.66% (1.0986 => 0.9376, std.dev.: 0.0282) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -14.39% (0.2481 => 0.2124, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.06% (0.4074 => 0.3501, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: -12.82% (1.5979 => 1.3931, std.dev.: 0.0264) SingleSource/UnitTests/Vector/constpool: -12.42% (9.8875 => 8.6597, std.dev.: 0.1194) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.92% (0.0847 => 0.0746, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -11.90% (0.1378 => 0.1214, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -11.66% (1.1433 => 1.0100, std.dev.: 0.0287) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.53% (6.4235 => 5.6826, std.dev.: 0.0510) MultiSource/Applications/treecc/treecc: -11.34% (2.4719 => 2.1915, std.dev.: 0.1061) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -11.16% (1.5131 => 1.3443, std.dev.: 0.0290) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.55% (10.2703 => 9.1866, std.dev.: 0.0510) MultiSource/Applications/lua/lua: -10.49% (4.6406 => 4.1539, std.dev.: 0.0853) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -10.47% (0.2618 => 0.2344, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: -10.26% (0.3598 => 0.3229, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -10.21% (0.6885 => 0.6182, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -9.86% (17.5634 => 15.8324, std.dev.: 0.6110) MultiSource/Benchmarks/Ptrdist/ft/ft: -9.59% (0.2283 => 0.2064, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.37% (1.1498 => 1.0421, std.dev.: 0.0074) MultiSource/Applications/siod/siod: -9.26% (2.6437 => 2.3989, std.dev.: 0.0538) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.99% (0.9124 => 0.8304, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: -8.39% (0.1610 => 0.1475, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -8.06% (0.8653 => 0.7956, std.dev.: 0.0141) MultiSource/Applications/ClamAV/clamscan: -7.90% (17.4365 => 16.0592, std.dev.: 0.5340) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.84% (0.3560 => 0.3281, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: -7.79% (0.1824 => 0.1682, std.dev.: 0.0042) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.45% (1.1731 => 1.0857, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.37% (0.1587 => 0.1470, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.20% (0.9588 => 0.8898, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.14% (0.2100 => 0.1950, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.04% (0.2884 => 0.2681, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.56% (1.8127 => 1.6937, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.20% (0.5746 => 0.5390, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -6.07% (0.4002 => 0.3759, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.07% (1.0017 => 0.9409, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/hash2: -6.02% (0.5134 => 0.4825, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.01% (0.7693 => 0.7231, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -5.93% (0.2006 => 0.1887, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.49% (0.6135 => 0.5798, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.41% (0.2144 => 0.2028, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -5.39% (0.1928 => 0.1824, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.39% (0.2709 => 0.2563, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.24% (0.2615 => 0.2478, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.14% (3.6295 => 3.4428, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/matrix: -5.12% (0.2385 => 0.2263, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -5.07% (0.2269 => 0.2154, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.94% (5.0381 => 4.7891, std.dev.: 0.0726) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.88% (0.3462 => 0.3293, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -4.76% (4.5936 => 4.3749, std.dev.: 0.0659) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.62% (0.3981 => 0.3797, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3394 => 0.3246, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.33% (0.3093 => 0.2959, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.32% (1.0234 => 0.9792, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary: -4.19% (0.2551 => 0.2444, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.15% (0.3665 => 0.3513, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -4.15% (0.2725 => 0.2612, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.03% (1.2680 => 1.2169, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.98% (0.8990 => 0.8632, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: -3.92% (0.4689 => 0.4505, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -3.71% (0.3206 => 0.3087, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.65% (1.3220 => 1.2737, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -3.63% (0.3715 => 0.3580, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.62% (1.0052 => 0.9688, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.55% (0.9403 => 0.9069, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/bigfib: -3.46% (0.6711 => 0.6479, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.43% (0.9091 => 0.8779, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.38% (0.9214 => 0.8903, std.dev.: 0.0043) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.22% (7.2721 => 7.0379, std.dev.: 0.0672) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.04% (4.8904 => 4.7416, std.dev.: 0.0492) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.88% (2.4519 => 2.3814, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.01% (1.0119 => 0.9916, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.88% (0.7225 => 0.7089, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.18% (23.5861 => 23.3073, std.dev.: 0.0216) MultiSource/Benchmarks/mafft/pairlocalalign: -1.06% (9.5202 => 9.4189, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.00% (0.9372 => 0.6467, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/heapsort: -30.18% (4.4739 => 3.1238, std.dev.: 0.0320) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.15% (1.0816 => 0.7771, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.17% (4.2042 => 3.1462, std.dev.: 0.0224) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.24% (0.1164 => 0.0940, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.19% (0.0845 => 0.0742, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -10.96% (4.5259 => 4.0298, std.dev.: 0.0983) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.39% (0.4081 => 0.3657, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.21% (5.0421 => 4.5272, std.dev.: 0.0711) SingleSource/Benchmarks/Shootout-C++/lists1: -9.07% (0.6628 => 0.6027, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.62% (1.4588 => 1.3330, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.85% (46.0987 => 42.9404, std.dev.: 0.5260) MultiSource/Benchmarks/Olden/health/health: -6.49% (0.3654 => 0.3417, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/ary3: -5.92% (2.2304 => 2.0983, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.57% (23.3986 => 22.0961, std.dev.: 0.1539) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.99% (0.3349 => 0.3182, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.41% (0.3609 => 0.3450, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.82% (2.5170 => 2.4209, std.dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.71% (2.4498 => 2.3589, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/lists: -3.30% (17.2182 => 16.6500, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ffbench: -3.29% (1.4244 => 1.3776, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -2.76% (8.8872 => 8.6416, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.71% (0.5826 => 0.5668, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -2.38% (7.0016 => 6.8353, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.29% (3.0082 => 2.9392, std.dev.: 0.0243) SingleSource/Benchmarks/Dhrystone/dry: -2.15% (0.5295 => 0.5181, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.05% (42.3194 => 41.4501, std.dev.: 0.1157) SingleSource/Benchmarks/Misc/mandel-2: -2.05% (0.8521 => 0.8346, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.00% (61.0379 => 59.8142, std.dev.: 0.3552) MultiSource/Applications/sqlite3/sqlite3: -1.95% (4.4730 => 4.3860, std.dev.: 0.0244) MultiSource/Applications/hexxagon/hexxagon: -1.88% (14.0297 => 13.7656, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: -1.44% (7.2040 => 7.1003, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3145, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1543, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.11% (1.5476 => 1.5304, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.77% (1.2047 => 1.1231, std.dev.: 0.1245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -17.60% (0.0233 => 0.0192, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.40% (0.0451 => 0.0368, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -27.16% (0.0394 => 0.0287, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -17.99% (0.0328 => 0.0269, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.98% (0.0445 => 0.0365, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -23.47% (0.0213 => 0.0163, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -25.55% (0.0227 => 0.0169, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.34% (0.1530 => 0.1433, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -41.09% (1.9293 => 1.1366, std.dev.: 0.2982) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4049 => 0.3986, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.53% (0.1510 => 0.1502, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.0978 => 0.0954, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.12% (0.0590 => 0.0548, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.36% (1.1617 => 1.1459, std.dev.: 0.1050) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.97% (0.0610 => 0.0537, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.79% (0.0268 => 0.0313, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.55% (0.7437 => 0.7396, std.dev.: 0.0360) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 11.96% (0.0092 => 0.0103, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7781 => 12.7559, std.dev.: 0.0217) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 04:17:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 06:17:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119121720.982AB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7755?compare_to=7752&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7755, Order: 172894, Start Time: 2013-01-19 10:41:28, End Time: 2013-01-19 12:17:30 To: 7752, Order: 172892, Start Time: 2013-01-19 08:44:27, End Time: 2013-01-19 10:18:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (98 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (891 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.09% (0.0717 => 0.1198, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.37% (0.0974 => 0.1562, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.03% (0.0514 => 0.0802, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.13% (0.1500 => 0.2177, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.23% (0.0599 => 0.0822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.01% (0.1132 => 0.1551, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.62% (0.6395 => 0.8737, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.76% (0.6395 => 0.8618, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.76% (0.6260 => 0.8311, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.98% (0.5688 => 0.7507, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.82% (0.5805 => 0.7652, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.51% (0.5456 => 0.7175, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.96% (0.6230 => 0.8159, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.79% (0.5849 => 0.7650, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.73% (0.5575 => 0.7288, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.52% (0.5567 => 0.7266, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.42% (0.5581 => 0.7279, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.35% (0.5941 => 0.7744, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.21% (0.5802 => 0.7555, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.75% (0.6033 => 0.7828, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.61% (0.5705 => 0.7394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.10% (0.5859 => 0.7564, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.05% (0.5570 => 0.7188, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.91% (0.5857 => 0.7550, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.88% (0.5478 => 0.7060, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.76% (0.5925 => 0.7629, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.68% (0.5569 => 0.7166, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.42% (0.5591 => 0.7180, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.03% (0.6676 => 0.8547, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.90% (1.6474 => 2.1071, std.dev.: 0.0492) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.89% (0.6189 => 0.7915, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.73% (0.6052 => 0.7730, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.51% (0.5863 => 0.7476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.41% (0.6446 => 0.8213, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.90% (0.6304 => 0.8000, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.93% (0.6194 => 0.7800, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.86% (0.6681 => 0.8409, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.59% (0.6660 => 0.8364, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.38% (0.6297 => 0.7895, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.28% (0.0622 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.13% (0.6667 => 0.8276, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.83% (0.7524 => 0.9242, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.02% (0.7339 => 0.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.82% (0.0582 => 0.0709, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.82% (2.2587 => 2.7290, std.dev.: 0.0542) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 20.14% (0.0566 => 0.0680, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.79% (0.0680 => 0.0801) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 15.28% (0.0707 => 0.0815, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 15.28% (1.1450 => 1.3199, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.04% (0.3357 => 0.3862, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.26% (4.5069 => 5.0594, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.49% (0.4916 => 0.5481, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.32% (1.6364 => 1.8217, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 11.18% (0.4515 => 0.5020, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.96% (3.5339 => 3.9213, std.dev.: 0.0453) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.52% (0.2385 => 0.2612, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 7.48% (1.2515 => 1.3451, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash: 7.45% (0.4524 => 0.4861, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4861 => 0.5199, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.88% (1.4642 => 1.5649, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1731 => 0.1849, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.55% (1.2784 => 1.3621, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 6.50% (9.2283 => 9.8281, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3255 => 0.3441, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 3.25% (5.0226 => 5.1860, std.dev.: 0.0040) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.3864 => 1.4218, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 2.17% (0.8418 => 0.8601, std.dev.: 0.0024) MultiSource/Applications/minisat/minisat: 1.83% (0.7447 => 0.7583, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3722 => 1.3931, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 1.09% (15.5079 => 15.6770, std.dev.: 0.0338) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.48% (31.3723 => 55.6781, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5576, std.dev.: 0.1365) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.0478 => 2.1107, std.dev.: 0.0091) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (0.6469 => 0.6664, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2772, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.38% (27.8210 => 28.2059, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.35% (0.1281 => 0.1110, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.36% (0.7198 => 0.6812, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: -5.01% (0.3194 => 0.3034, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/trivial-interface: -4.98% (0.3812 => 0.3622, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.85% (0.3880 => 0.3692, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.79% (0.4033 => 0.3840, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.77% (0.3896 => 0.3710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.70% (0.3848 => 0.3667, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -4.59% (2.4924 => 2.3781, std.dev.: 0.0076) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.48% (0.4176 => 0.3989, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.37% (0.3821 => 0.3654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.12% (0.3837 => 0.3679, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.00% (0.9852 => 0.9458, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.95% (0.7779 => 0.7472, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/Hello: -3.91% (0.6347 => 0.6099, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.72% (0.3142 => 0.3025, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/parameter-passing: -3.67% (0.4280 => 0.4123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.66% (0.6441 => 0.6205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.37% (0.3323 => 0.3211, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.36% (0.9542 => 0.9221, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.30% (0.3057 => 0.2956, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.90% (0.6484 => 0.6296, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.90% (0.3658 => 0.3552, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.82% (2.1713 => 2.1101, std.dev.: 0.0082) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2209, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (14.2083 => 13.8676, std.dev.: 0.0075) MultiSource/Applications/sqlite3/sqlite3: -2.31% (17.1032 => 16.7084, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.12% (6.7716 => 6.6279, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: -2.00% (16.1920 => 15.8676, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.74% (1.2221 => 1.2008, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.68% (1.0544 => 1.0367, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (1.2210 => 1.2022, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -1.53% (7.0961 => 6.9873, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: -1.49% (4.3330 => 4.2686, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: -1.48% (0.7982 => 0.7864, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.34% (0.7919 => 0.7813, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.18% (1.2300 => 1.2155, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -1.01% (2.4021 => 2.3779, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.12% (1.8100 => 0.7037, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.96% (0.6962 => 0.3414, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.59% (1.3643 => 1.0288, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.37% (83.5423 => 64.0191, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.73% (4.3779 => 3.3830, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2090, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.38% (4.7378 => 4.1037, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.61% (4.9100 => 4.3401, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1701, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1807, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0107) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7584, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout/ary3: -2.50% (3.7241 => 3.6309, std.dev.: 0.0233) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1958, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5903, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 05:26:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 07:26:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119132628.D0B572A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7756?compare_to=7753&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7756, Order: 172894, Start Time: 2013-01-19 11:15:31, End Time: 2013-01-19 13:26:38 To: 7753, Order: 172890, Start Time: 2013-01-19 08:33:23, End Time: 2013-01-19 10:45:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 4 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.33% (1.5215 => 1.5013, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.20% (10.9089 => 10.7783, std.dev.: 0.0113) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.09% (10.3674 => 10.2548, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.22% (1.3218 => 1.2924, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0677 => 0.0676, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8406 => 499.8454, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44224.32% (1.1277 => 499.8454, std.dev.: 0.0082) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.24% (0.5229 => 1.6484, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 20.03% (14.9895 => 17.9913, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 43.43% (14.1553 => 20.3029, std.dev.: 0.0166) MultiSource/Benchmarks/MallocBench/gs/gs: 18.05% (4.1105 => 4.8523, std.dev.: 0.0068) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.52% (1.1048 => 1.7292, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.19% (7.1582 => 37.5942, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.13% (3.4629 => 6.3763, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.11% (0.6222 => 1.0833, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.28% (0.0720 => 7.4450, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 11170300.00% (0.0001 => 11.1704, std.dev.: 0.0462) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486400.00% (0.0001 => 5.4865, std.dev.: 0.0170) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.10% (1.1194 => 10.2548, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.16% (22.1758 => 55.2529, std.dev.: 0.0253) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.81% (0.1463 => 0.2499, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 67.16% (0.0271 => 0.0453, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.84% (2.9384 => 4.6085, std.dev.: 0.0049) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.80% (7.0540 => 10.7783, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.96% (1.5859 => 2.3940, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.64% (8.1363 => 11.9310, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.94% (2.2024 => 3.1041, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.43% (0.3109 => 0.4335, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 39.39% (0.1432 => 0.1996, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.08% (21.9371 => 30.2900, std.dev.: 0.0178) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.82% (0.1062 => 0.1453, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.57% (4.2646 => 5.6964, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0446, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.52% (0.4615 => 0.6116, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.50% (0.1892 => 0.2469, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.31% (0.4299 => 0.5559, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 28.96% (1.1642 => 1.5013, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.37% (0.0793 => 0.1018, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.99% (0.6675 => 0.8543, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608) MultiSource/Benchmarks/McCat/08-main/main: 26.47% (0.2554 => 0.3230, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.43% (0.5105 => 0.6454, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.70% (3.8922 => 4.8924, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.54% (0.1566 => 0.1966, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.36% (0.1175 => 0.1473, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.08% (0.1655 => 0.2070, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 25.02% (1.0722 => 1.3405, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 24.62% (0.4289 => 0.5345, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0030) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.00% (0.3121 => 0.3870, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.70% (1.4186 => 1.7548, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.23% (0.4620 => 0.5693, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.63% (0.2700 => 0.3311, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 22.39% (9.4845 => 11.6085, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.95% (0.1695 => 0.2067, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1163 => 0.1417, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 21.77% (0.7115 => 0.8664, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 21.34% (0.3098 => 0.3759, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.11% (0.0886 => 0.1073, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.87% (0.7835 => 0.9470, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.63% (0.1236 => 0.1491, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.57% (1.3050 => 1.5735, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.57% (0.1940 => 0.2339, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 20.53% (5.7591 => 6.9412, std.dev.: 0.0136) MultiSource/Benchmarks/Olden/em3d/em3d: 20.18% (0.1695 => 0.2037, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.97% (0.6456 => 0.7745, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.56% (0.5860 => 0.7006, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.46% (4.9449 => 5.9074, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.35% (0.8172 => 0.9753, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 18.92% (0.7433 => 0.8839, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.75% (5.0018 => 5.9397, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 18.54% (3.3354 => 3.9538, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.51% (0.2107 => 0.2497, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.47% (0.0834 => 0.0988, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.17% (0.3307 => 0.3908, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.12% (0.5569 => 0.6578, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.97% (0.5020 => 0.5922, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 17.65% (0.3423 => 0.4027, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.59% (0.9765 => 1.1483, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 17.20% (3.8723 => 4.5385, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: 17.16% (2.0273 => 2.3752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.05% (0.2065 => 0.2417, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 16.98% (1.1840 => 1.3850, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.74% (0.8101 => 0.9457, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: 16.51% (0.3283 => 0.3825, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.50% (0.2049 => 0.2387, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.30% (2.2969 => 2.6712, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 16.24% (0.3232 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.97% (0.0933 => 0.1082, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.67% (0.6450 => 0.7461, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.21% (0.8921 => 1.0278, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.16% (0.3180 => 0.3662, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.83% (0.3379 => 0.3880, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.59% (1.1861 => 1.3591, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.45% (0.8067 => 0.9233, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.68% (0.2603 => 0.2959, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.61% (0.3865 => 0.4391, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.46% (0.4636 => 0.5260, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 13.14% (0.3387 => 0.3832, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.72% (0.4103 => 0.4625, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.68% (1.5603 => 1.7582, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.35% (0.4203 => 0.4722, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 11.93% (0.4048 => 0.4531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 11.78% (0.3422 => 0.3825, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.76% (0.3927 => 0.4389, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.45% (17.1811 => 19.1483, std.dev.: 0.0211) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.37% (0.3684 => 0.4103, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.32% (0.2430 => 0.2705, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 11.16% (0.3092 => 0.3437, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.08% (0.3826 => 0.4250, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.76% (0.3828 => 0.4240, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.61% (0.4064 => 0.4495, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (14.3668 => 15.8601, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 10.37% (0.3473 => 0.3833, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.28% (0.3561 => 0.3927, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.27% (0.3427 => 0.3779, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.27% (0.3497 => 0.3856, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 10.24% (0.2831 => 0.3121, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.75% (2.0665 => 2.2680, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2725 => 0.2983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.37% (0.2891 => 0.3162, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.25% (0.2756 => 0.3011, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.13% (1.2842 => 1.4014, std.dev.: 0.0147) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.47% (0.6030 => 0.6541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.45% (0.2793 => 0.3029, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.28% (0.3935 => 0.4261, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.25% (0.5925 => 0.6414, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.07% (63.2438 => 68.3473, std.dev.: 0.0323) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 7.28% (10.3673 => 11.1218, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.10% (2.2022 => 2.3585, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.39% (0.4879 => 0.5191, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.01% (0.3817 => 0.3932, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.11% (7.9617 => 8.1299, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.24% (32.5116 => 59.2502, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.83% (6.6465 => 7.6984, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4606, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.32% (0.9957 => 1.0288, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.45% (1.0313 => 1.0566, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.36% (8.6802 => 8.8850, std.dev.: 0.0234) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (3.6395 => 3.7246, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.27% (0.6533 => 0.6681, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.86% (9.1159 => 9.2853, std.dev.: 0.0264) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2822, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.15% (10.3460 => 10.4645, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5803, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.80% (5.2763 => 1.1716, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.29% (0.8651 => 0.2138, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.30% (5.3855 => 4.4537, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.89% (5.3526 => 4.4488, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0184, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.27% (1.7609 => 1.6153, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9628, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.72% (1.9577 => 0.6515, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0211, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4245, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -24.92% (85.0658 => 63.8646, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.32% (2.6546 => 2.0091, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.07% (0.6223 => 0.5036) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4929, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.24% (19.9488 => 18.3052, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.70% (1.2373 => 1.1668, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.47% (8.1563 => 7.7100, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.60% (1.5835 => 1.5106, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8408, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9572, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/ary3: -1.56% (3.6994 => 3.6418, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.46% (3.7221 => 3.6677, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0161) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0007) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 05:45:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 07:45:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119134504.5A8B52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7757?compare_to=7750&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7757, Order: 172894, Start Time: 2013-01-19 10:01:48, End Time: 2013-01-19 13:45:13 To: 7750, Order: 172886, Start Time: 2013-01-19 05:26:21, End Time: 2013-01-19 09:10:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (181 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.90% (0.4697 => 0.4880, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.04% (0.5479 => 0.5591, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.45% (2.3938 => 2.4286, std.dev.: 0.0113) MultiSource/Benchmarks/Bullet/bullet: 1.44% (27.0730 => 27.4624, std.dev.: 0.0824) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: 8.76% (0.2432 => 0.2645, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.52% (124.2964 => 129.9143, std.dev.: 0.1142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.94% (0.6697 => 0.6827, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.36% (0.0625 => 0.0921, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.59% (0.1063 => 0.1452, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.71% (0.0547 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.53% (0.0475 => 0.0620, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 30.14% (0.0584 => 0.0760, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.18% (0.1107 => 0.1430, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.22% (0.2969 => 0.3807, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.40% (0.0584 => 0.0744, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.32% (0.5900 => 0.7512, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.12% (0.1106 => 0.1406, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.11% (0.4253 => 0.5406, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.04% (0.4139 => 0.5258, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.45% (0.4994 => 0.6315, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.45% (0.3890 => 0.4880, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.44% (0.1549 => 0.1943, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.36% (0.5000 => 0.6268, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 25.33% (1.5932 => 1.9968, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.31% (0.0897 => 0.1124, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 24.54% (0.0599 => 0.0746, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 24.52% (0.1619 => 0.2016, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.32% (0.1620 => 0.2014, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.13% (0.0572 => 0.0710, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.00% (0.1021 => 0.1266, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.93% (0.1003 => 0.1233, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 22.59% (0.4029 => 0.4939, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.37% (0.0541 => 0.0662, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 22.35% (0.0604 => 0.0739, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.26% (0.1604 => 0.1961, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.19% (0.3903 => 0.4769, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.04% (0.2736 => 0.3339, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.02% (0.2866 => 0.3497, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 21.62% (0.0481 => 0.0585, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 21.44% (0.0947 => 0.1150, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 20.67% (0.0808 => 0.0975, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.66% (0.1462 => 0.1764, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.64% (0.3271 => 0.3946, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.55% (0.1090 => 0.1314, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.50% (0.1088 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 20.44% (0.1218 => 0.1467, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.42% (1.3152 => 1.5838, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.34% (0.1160 => 0.1396, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 20.14% (1.8794 => 2.2579, std.dev.: 0.0338) MultiSource/Applications/Burg/burg: 20.12% (0.5546 => 0.6662, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.03% (0.4658 => 0.5591, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.96% (0.2014 => 0.2416, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 19.73% (0.1505 => 0.1802, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 19.43% (0.0561 => 0.0670, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.38% (1.6211 => 1.9353, std.dev.: 0.0135) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.78% (3.5627 => 4.2318, std.dev.: 0.0500) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.54% (0.2875 => 0.3408, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.34% (0.1968 => 0.2329, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.27% (0.2792 => 0.3302, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/fibo: 18.13% (0.2725 => 0.3219, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 18.07% (0.1284 => 0.1516, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.99% (0.5826 => 0.6874, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.97% (0.2738 => 0.3230, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/except: 17.97% (0.2811 => 0.3316, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.0582 => 0.0686, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 17.81% (0.9697 => 1.1424, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.75% (0.4361 => 0.5135, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 17.55% (0.2780 => 0.3268, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 17.54% (0.5889 => 0.6922, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.53% (0.0673 => 0.0791, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.48% (2.0673 => 2.4286, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary: 17.46% (0.3258 => 0.3827, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 17.46% (4.2109 => 4.9463, std.dev.: 0.0822) SingleSource/Benchmarks/Shootout-C++/random: 17.41% (0.2803 => 0.3291, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 17.38% (1.0781 => 1.2655, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/strcat: 17.38% (0.2750 => 0.3228, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.28% (0.3930 => 0.4609, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 17.28% (0.2813 => 0.3299, std.dev.: 0.0129) MultiSource/Applications/hexxagon/hexxagon: 17.24% (0.9909 => 1.1617, std.dev.: 0.0053) SingleSource/Regression/C++/ofstream_ctor: 17.08% (0.3004 => 0.3517, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.08% (0.2729 => 0.3195, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.00% (1.9966 => 2.3361, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/wc: 16.99% (0.3096 => 0.3622, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.95% (1.9694 => 2.3033, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.95% (0.5026 => 0.5878, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary2: 16.94% (0.3317 => 0.3879, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference: 16.86% (0.7171 => 0.8380, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: 16.76% (23.5202 => 27.4624, std.dev.: 0.0824) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.71% (4.4195 => 5.1578, std.dev.: 0.0348) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.68% (2.7292 => 3.1845, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/ary3: 16.59% (0.3267 => 0.3809, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.50% (0.3060 => 0.3565, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/sieve: 16.45% (0.3726 => 0.4339, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.29% (0.3124 => 0.3633, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 16.28% (0.4146 => 0.4821, std.dev.: 0.0078) MultiSource/Benchmarks/nbench/nbench: 16.13% (0.2566 => 0.2980, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/lists: 16.07% (0.3348 => 0.3886, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.91% (0.3362 => 0.3897, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 15.91% (1.4269 => 1.6539, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.90% (0.3282 => 0.3804, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.89% (0.7875 => 0.9126, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.70% (0.3981 => 0.4606, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 15.68% (0.2691 => 0.3113, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 15.67% (0.3477 => 0.4022, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/moments: 15.66% (0.3678 => 0.4254, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash2: 15.62% (0.4251 => 0.4915, std.dev.: 0.0043) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.60% (0.3845 => 0.4445, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.2075 => 0.2395, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.42% (0.3690 => 0.4259, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-4: 15.35% (0.3465 => 0.3997, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.34% (0.3488 => 0.4023, std.dev.: 0.0038) MultiSource/Applications/JM/ldecod/ldecod: 15.23% (2.1653 => 2.4950, std.dev.: 0.0209) SingleSource/UnitTests/ObjC/exceptions-2: 15.06% (0.3446 => 0.3965, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/property: 14.88% (0.3650 => 0.4193, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: 14.82% (0.3469 => 0.3983, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-3: 14.71% (0.3460 => 0.3969, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 14.70% (0.3496 => 0.4010, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 14.64% (0.3442 => 0.3946, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 14.64% (0.3498 => 0.4010, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions: 14.25% (0.3643 => 0.4162, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/parameter-passing: 14.15% (0.3724 => 0.4251, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 14.11% (5.5417 => 6.3234, std.dev.: 0.0051) MultiSource/Applications/JM/lencod/lencod: 14.09% (4.6177 => 5.2684, std.dev.: 0.0557) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.97% (0.2068 => 0.2357, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: 13.61% (2.1013 => 2.3872, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.58% (0.6435 => 0.7309, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.93% (0.2737 => 0.3091, std.dev.: 0.0036) MultiSource/Applications/minisat/minisat: 12.32% (0.3336 => 0.3747, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.27% (0.2103 => 0.2361, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 12.26% (0.6634 => 0.7447, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.87% (0.3084 => 0.3450, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.84% (0.5361 => 0.5996, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.51% (0.4847 => 0.5405, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.99% (0.1383 => 0.1535, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.90% (11.6398 => 12.9091, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.83% (0.7426 => 0.8230, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.28% (4.6926 => 5.1752, std.dev.: 0.0077) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.15% (0.5584 => 0.6151, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 10.01% (2.0346 => 2.2383, std.dev.: 0.0068) MultiSource/Applications/kimwitu++/kc: 7.82% (11.9555 => 12.8905, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5276, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0297) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 15.38% (0.5917 => 0.6827, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: 10.96% (0.2802 => 0.3109, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.10% (0.3693 => 0.4066, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: 9.66% (0.2412 => 0.2645, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2419, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6709, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 4.87% (1.8057 => 1.8937, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6808, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1910, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3113, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2863, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2095, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4810, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5857, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.04% (25.4195 => 16.5113, std.dev.: 0.0366) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/fldry: -16.11% (17.2379 => 14.4604, std.dev.: 0.0724) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0059) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9762, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7978, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2057, std.dev.: 0.0175) SingleSource/Benchmarks/Dhrystone/dry: -3.73% (14.0481 => 13.5241, std.dev.: 0.1312) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.2048, std.dev.: 0.0748) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5723, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.30% (105.3826 => 104.0127, std.dev.: 0.1386) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 05:50:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 07:50:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119135011.B4C0C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7758?compare_to=7754&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7758, Order: 172901, Start Time: 2013-01-19 11:53:04, End Time: 2013-01-19 13:50:22 To: 7754, Order: 172894, Start Time: 2013-01-19 09:37:55, End Time: 2013-01-19 11:36:02 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (12 on baseline) Performance Improvements: 13 (161 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1033 (890 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 4.80% (0.6182 => 0.6479, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.46% (1.4113 => 1.4460, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.36% (0.8304 => 0.8500, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.34% (0.9260 => 0.9477, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.99% (9.1866 => 9.3697, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.3443 => 1.3697, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.68% (4.7845 => 4.8647, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (1.0589 => 1.0757, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.33% (0.9048 => 0.9168, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.32% (0.9492 => 0.9617, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.21% (1.0835 => 1.0966, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 12.37% (19.4936 => 21.9055, std.dev.: 0.9124) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.02% (0.7771 => 0.8472, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout/heapsort: 5.60% (3.1238 => 3.2986, std.dev.: 0.0235) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.37% (4.7527 => 4.9603, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops: 2.44% (8.6416 => 8.8528, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.83% (5.0605 => 5.1529, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 1.61% (3.5762 => 3.6336, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/JM/ldecod/ldecod: -1.59% (7.2189 => 7.1043, std.dev.: 0.0228) MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (0.7956 => 0.7837, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -1.20% (5.3034 => 5.2398, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/nestedloop: -19.50% (0.2533 => 0.2039, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/salsa20: -18.13% (9.1022 => 7.4520, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Puzzle: -14.68% (0.2010 => 0.1715, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.74% (6.1372 => 5.4164, std.dev.: 0.2695) SingleSource/Benchmarks/Shootout-C++/hash: -4.91% (0.6450 => 0.6133, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -3.56% (1.3188 => 1.2718, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.88% (3.5972 => 3.5294, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.84% (1.4147 => 1.3887, std.dev.: 0.0085) SingleSource/Benchmarks/McGill/chomp: -1.78% (1.0275 => 1.0092, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: -1.48% (4.3860 => 4.3209, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.07% (1.1231 => 1.1111, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 15.10% (0.0192 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.39% (0.0368 => 0.0432, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.27% (0.0287 => 0.0269, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 18.22% (0.0269 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0365 => 0.0356, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 11.66% (0.0163 => 0.0182, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -1.18% (0.0169 => 0.0167, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.88% (0.1433 => 0.1460, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 0.18% (1.1366 => 1.1386, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.05% (0.3986 => 0.3944, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.73% (0.1502 => 0.1446, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.47% (0.0954 => 0.0968, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.57% (0.0191 => 0.0215, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.12% (0.0548 => 0.0587, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1459 => 1.1516, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2600.00% (0.0001 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0001 => 0.0002, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.49% (0.0537 => 0.0545, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -24.92% (0.0313 => 0.0235, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.61% (0.7396 => 0.7515, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -65.05% (0.0103 => 0.0036, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7559 => 12.7393, std.dev.: 0.2352) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.24% (0.0336 => 0.0488, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.48% (1.4110 => 1.4460, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.94% (1.8651 => 1.9013, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.25% (0.9867 => 0.9990, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321237.50% (0.0008 => 2.5707, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.24% (1.1825 => 2.4270, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.72% (0.2562 => 0.2811, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 3.34% (2.1390 => 2.2105, std.dev.: 0.0052) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.37% (9.0082 => 9.2215, std.dev.: 0.0572) MultiSource/Benchmarks/mafft/pairlocalalign: 1.80% (63.1520 => 64.2895, std.dev.: 0.1700) MultiSource/Applications/siod/siod: 1.19% (3.5910 => 3.6336, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.10% (1.2298 => 1.2433, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.12% (0.0727 => 0.0508, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0014) SingleSource/Benchmarks/SmallPT/smallpt: -26.69% (0.1888 => 0.1384, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.89% (0.1684 => 0.1248, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: -20.91% (1.8964 => 1.4998, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.23% (0.0676 => 0.0546, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.56% (0.0862 => 0.0702, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.64% (0.1009 => 0.0831, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -16.27% (0.0707 => 0.0592, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.25% (0.7686 => 0.6514, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -14.72% (9.8875 => 8.4325, std.dev.: 0.2051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.64% (0.1079 => 0.0921, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.46% (1.0986 => 0.9397, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.62% (0.4074 => 0.3519, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: -13.53% (1.0960 => 0.9477, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: -13.51% (1.0220 => 0.8839, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: -12.58% (1.5979 => 1.3969, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: -12.35% (2.4719 => 2.1665, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.28% (0.0847 => 0.0743, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -11.80% (0.1025 => 0.0904, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -11.44% (1.1433 => 1.0125, std.dev.: 0.0021) MultiSource/Applications/aha/aha: -11.18% (0.1378 => 0.1224, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.13% (6.4235 => 5.7087, std.dev.: 0.0197) MultiSource/Applications/lua/lua: -10.90% (4.6406 => 4.1349, std.dev.: 0.0481) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.46% (1.2154 => 1.0883, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: -9.72% (17.5634 => 15.8570, std.dev.: 0.0798) MultiSource/Applications/sgefa/sgefa: -9.64% (0.3598 => 0.3251, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.55% (0.7693 => 0.6958, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.48% (1.5131 => 1.3697, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: -9.43% (0.8653 => 0.7837, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.27% (0.2372 => 0.2152, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -9.21% (2.6437 => 2.4003, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.04% (1.3924 => 1.2665, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -9.00% (0.1356 => 0.1234, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.81% (1.6874 => 1.5388, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.77% (10.2703 => 9.3697, std.dev.: 0.0367) MultiSource/Benchmarks/Olden/health/health: -8.57% (0.1610 => 0.1472, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -8.56% (17.4365 => 15.9432, std.dev.: 0.0264) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.20% (0.1317 => 0.1209, std.dev.: 0.0039) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.95% (1.1731 => 1.0798, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.78% (0.3560 => 0.3283, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -7.61% (3.7840 => 3.4962, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.58% (0.9588 => 0.8861, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.50% (1.1498 => 1.0636, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.88% (0.2283 => 0.2126, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.84% (0.9124 => 0.8500, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -6.81% (1.3979 => 1.3027, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (0.1798 => 0.1677, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.33% (0.2100 => 0.1967, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: -6.25% (0.1824 => 0.1710, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2006 => 0.1881, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -6.16% (0.5134 => 0.4818, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.13% (1.8127 => 1.7016, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/moments: -5.97% (0.4002 => 0.3763, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.90% (0.6885 => 0.6479, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.62% (0.7693 => 0.7261, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.36% (0.5746 => 0.5438, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: -5.28% (0.2385 => 0.2259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.3462 => 0.3281, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -5.22% (0.3715 => 0.3521, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.03% (3.6295 => 3.4471, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.96% (1.0017 => 0.9520, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.92% (0.6135 => 0.5833, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: -4.73% (0.2915 => 0.2777, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: -4.69% (0.7776 => 0.7411, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: -4.52% (1.4392 => 1.3742, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.51% (0.9550 => 0.9119, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (1.0234 => 0.9775, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.47% (0.3981 => 0.3803, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -4.43% (0.2551 => 0.2438, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.42% (0.3665 => 0.3503, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -4.38% (16.4479 => 15.7276, std.dev.: 0.0450) MultiSource/Applications/kimwitu++/kc: -4.21% (18.9377 => 18.1400, std.dev.: 0.2480) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.11% (0.9512 => 0.9121, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.06% (0.9422 => 0.9039, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.05% (1.2680 => 1.2167, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.01% (0.3093 => 0.2969, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -3.93% (4.5936 => 4.4131, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.92% (5.0381 => 4.8405, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/hash: -3.77% (0.4689 => 0.4512, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.68% (0.8990 => 0.8659, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: -3.67% (0.6711 => 0.6465, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.50% (4.6579 => 4.4948, std.dev.: 0.0455) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.44% (1.0052 => 0.9706, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: -3.41% (0.3807 => 0.3677, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.40% (0.9214 => 0.8901, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: -3.38% (7.3529 => 7.1043, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.31% (0.9091 => 0.8790, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.30% (0.9788 => 0.9465, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.26% (0.9403 => 0.9096, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.25% (0.9127 => 0.8830, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.87% (0.9993 => 0.9706, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.83% (0.4762 => 0.4627, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.76% (0.5369 => 0.5221, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.65% (14.9757 => 14.5786, std.dev.: 0.1103) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.57% (0.4121 => 0.4015, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.52% (0.9405 => 0.9168, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -2.40% (16.7012 => 16.3011, std.dev.: 0.0654) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.28% (7.2721 => 7.1063, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.28% (0.9488 => 0.9272, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: -2.16% (5.3553 => 5.2398, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.14% (2.4519 => 2.3995, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.13% (1.0119 => 0.9903, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.00% (0.9855 => 0.9658, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.55% (0.9061 => 0.8921, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.38% (1.0088 => 0.9949, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.26% (0.8893 => 0.8781, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: -1.14% (9.5202 => 9.4117, std.dev.: 0.0194) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.78% (0.9372 => 0.6487, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/heapsort: -26.27% (4.4739 => 3.2986, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.64% (4.2042 => 3.1682, std.dev.: 0.0594) MultiSource/Applications/minisat/minisat: -22.07% (7.9891 => 6.2259, std.dev.: 0.0519) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.67% (1.0816 => 0.8472, std.dev.: 0.0143) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.90% (0.1164 => 0.0944, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.59% (1.5623 => 1.2718, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.02% (1.4235 => 1.2666, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.84% (1.6547 => 1.4753, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout/hash: -10.34% (4.5259 => 4.0577, std.dev.: 0.0871) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.27% (0.4081 => 0.3662, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.44% (5.0421 => 4.5660, std.dev.: 0.0479) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.36% (2.8778 => 2.6085, std.dev.: 0.0272) MultiSource/Applications/oggenc/oggenc: -8.92% (0.1704 => 0.1552, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: -8.55% (0.6628 => 0.6061, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.82% (4.4540 => 4.1059, std.dev.: 0.0172) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.77% (1.4588 => 1.3455, std.dev.: 0.0159) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -7.03% (9.0650 => 8.4275, std.dev.: 0.0780) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: -6.13% (2.2304 => 2.0937, std.dev.: 0.0183) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.57% (46.0987 => 43.5300, std.dev.: 0.2907) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.34% (0.3349 => 0.3170, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.28% (0.3201 => 0.3032, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.05% (23.3986 => 22.2162, std.dev.: 0.1377) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.88% (0.3609 => 0.3433, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.87% (1.4446 => 1.3887, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: -3.68% (1.4244 => 1.3720, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: -3.46% (3.5443 => 3.4218, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -3.40% (4.4730 => 4.3209, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: -3.19% (1.0425 => 1.0092, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (17.2182 => 16.6764, std.dev.: 0.0311) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.08% (0.3406 => 0.3301, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (40.4729 => 39.2350, std.dev.: 0.1462) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (1.0995 => 1.0708, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.43% (3.0082 => 2.9352, std.dev.: 0.0151) MultiSource/Applications/lua/lua: -2.03% (29.0327 => 28.4434, std.dev.: 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.01% (0.5826 => 0.5709, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -1.93% (0.6254 => 0.6133, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.86% (7.2040 => 7.0697, std.dev.: 0.0081) MultiSource/Applications/hexxagon/hexxagon: -1.80% (14.0297 => 13.7767, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/mandel-2: -1.80% (0.8521 => 0.8368, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: -1.77% (2.8571 => 2.8064, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.61% (3.7662 => 3.7057, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (3.1921 => 3.1450, std.dev.: 0.0066) MultiSource/Benchmarks/llubenchmark/llu: -1.44% (2.0298 => 2.0005, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: -1.37% (8.6447 => 8.5262, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3596 => 3.3176, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.21% (5.5974 => 5.5298, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/methcall: -1.10% (8.7416 => 8.6455, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.05% (3.5669 => 3.5294, std.dev.: 0.0095) SingleSource/Benchmarks/SmallPT/smallpt: -1.05% (14.9448 => 14.7883, std.dev.: 0.0189) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.77% (1.2047 => 1.1111, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -31.73% (0.0394 => 0.0269, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.00% (0.0445 => 0.0356, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -14.55% (0.0213 => 0.0182, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/test1: -26.43% (0.0227 => 0.0167, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.58% (0.1530 => 0.1460, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -40.98% (1.9293 => 1.1386, std.dev.: 0.0242) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.59% (0.4049 => 0.3944, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.24% (0.1510 => 0.1446, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.02% (0.0978 => 0.0968, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.10% (0.0276 => 0.0215, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0590 => 0.0587, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.87% (1.1617 => 1.1516, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.62% (0.0032 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -92.59% (0.0027 => 0.0002, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.66% (0.0610 => 0.0545, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.31% (0.0268 => 0.0235, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.05% (0.7437 => 0.7515, std.dev.: 0.0024) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.87% (0.0092 => 0.0036, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.30% (12.7781 => 12.7393, std.dev.: 0.2352) Report Time: 0.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 06:15:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 08:15:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119141500.B15522A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7759?compare_to=7755&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7759, Order: 172901, Start Time: 2013-01-19 12:41:18, End Time: 2013-01-19 14:15:11 To: 7755, Order: 172894, Start Time: 2013-01-19 10:41:28, End Time: 2013-01-19 12:17:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (110 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 67.50% (0.0717 => 0.1201, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 60.37% (0.0974 => 0.1562, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 55.84% (0.0514 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.06% (0.0599 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.64% (0.6395 => 0.8738, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 36.31% (0.1132 => 0.1543, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 35.30% (0.6260 => 0.8470, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.71% (0.6395 => 0.8615, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.84% (0.5688 => 0.7499, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.66% (0.5805 => 0.7643, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.38% (0.5456 => 0.7168, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.16% (0.6230 => 0.8171, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.91% (0.5849 => 0.7657, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.78% (0.5575 => 0.7291, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.59% (0.5567 => 0.7270, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.50% (0.5581 => 0.7283, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.26% (0.5941 => 0.7739, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.08% (0.5802 => 0.7547, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.67% (0.6033 => 0.7823, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.61% (0.5705 => 0.7394, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.16% (0.5570 => 0.7194, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.15% (0.5859 => 0.7567, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.95% (0.5478 => 0.7064, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.93% (0.6440 => 0.8303, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.75% (0.5857 => 0.7541, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.68% (0.5569 => 0.7166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.61% (0.5925 => 0.7620, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.30% (0.5591 => 0.7173, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.80% (0.6676 => 0.8532, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.73% (0.6189 => 0.7905, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.64% (1.6474 => 2.1027, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.53% (0.6052 => 0.7718, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.46% (0.6446 => 0.8216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.29% (0.5863 => 0.7463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.82% (0.6304 => 0.7995, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.77% (0.6681 => 0.8403, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.77% (0.6194 => 0.7790, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.36% (0.6660 => 0.8349, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.25% (0.6297 => 0.7887, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.06% (0.6667 => 0.8271, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.71% (0.7524 => 0.9233, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.86% (0.7339 => 0.8943, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.65% (0.0582 => 0.0708, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.61% (2.2587 => 2.7243, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.26% (0.0621 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.45% (0.1146 => 0.1323, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.45% (0.3357 => 0.3842, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.82% (0.1982 => 0.2236, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.09% (4.5069 => 5.0516, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (0.4916 => 0.5475, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.25% (0.4515 => 0.5023, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.06% (1.6364 => 1.8174, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.80% (3.5339 => 3.9156, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.56% (0.2385 => 0.2613, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.15% (0.7021 => 0.7593, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.2001 => 0.2153, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 7.54% (0.4524 => 0.4865, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 7.34% (1.2515 => 1.3434, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 6.87% (0.4861 => 0.5195, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.70% (0.1731 => 0.1847, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.62% (1.2784 => 1.3630, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.42% (1.4642 => 1.5582, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 6.21% (9.2283 => 9.8012, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.3255 => 0.3436, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.6750 => 0.6972, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.25% (5.0226 => 5.1859, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 3.13% (0.3446 => 0.3554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.01% (0.3394 => 0.3496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.99% (5.4682 => 5.6315, std.dev.: 0.0293) MultiSource/Applications/SIBsim4/SIBsim4: 2.48% (1.3864 => 1.4208, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 1.82% (0.8418 => 0.8571, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.44% (0.7447 => 0.7554, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.38% (1.3722 => 1.3911, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.36% (0.9557 => 0.9687, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 1.02% (15.5079 => 15.6658, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.43% (31.3723 => 55.6637, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0097) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6565, std.dev.: 0.0686) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.0478 => 2.1081, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.60% (0.6469 => 0.6637, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6049, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.59% (5.1955 => 5.2779, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.40% (27.8210 => 28.2104, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.58% (0.1281 => 0.1107, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.45% (0.7198 => 0.6806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -5.04% (0.3812 => 0.3620, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.91% (0.3831 => 0.3643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.90% (0.3880 => 0.3690, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.89% (0.3848 => 0.3660, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.84% (0.3884 => 0.3696, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.73% (0.3891 => 0.3707, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.64% (2.4924 => 2.3767, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.4176 => 0.3986, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.45% (0.3821 => 0.3651, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.15% (0.9852 => 0.9443, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -4.07% (0.4199 => 0.4028, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.01% (0.3837 => 0.3683, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.97% (0.6347 => 0.6095, std.dev.: 0.0054) SingleSource/UnitTests/ObjC++/property-reference: -3.84% (0.7779 => 0.7480, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: -3.71% (0.4280 => 0.4121, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -3.65% (0.6441 => 0.6206, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.55% (0.3323 => 0.3205, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.37% (0.9542 => 0.9220, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.37% (0.3057 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.01% (0.3658 => 0.3548, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.96% (0.6484 => 0.6292, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.95% (2.1713 => 2.1073, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.87% (1.3148 => 1.2770, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.75% (0.4151 => 0.4037, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2495, std.dev.: 0.0364) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.46% (14.2083 => 13.8588, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6984, std.dev.: 0.0225) MultiSource/Applications/JM/lencod/lencod: -2.20% (16.1920 => 15.8352, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.07% (0.7919 => 0.7755, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.05% (6.7716 => 6.6325, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.78% (1.2210 => 1.1993, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.75% (1.2221 => 1.2007, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.74% (4.3330 => 4.2575, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.69% (1.0544 => 1.0366, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -1.63% (7.0961 => 6.9804, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.57% (1.2300 => 1.2107, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/football/football: -1.50% (0.9179 => 0.9041, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: -1.50% (0.7982 => 0.7862, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.28% (0.8521 => 0.8412, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.06% (1.5610 => 1.5444, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -1.04% (4.0594 => 4.0170, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.34% (1.8100 => 0.6997, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.52% (4.3504 => 3.2401, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -24.22% (1.3643 => 1.0338, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.36% (83.5423 => 64.0303, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.79% (4.1024 => 3.2084, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1332, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3395, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.40% (0.5142 => 0.4607, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3982, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.22% (1.3096 => 1.2674, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.62% (7.9763 => 7.7671, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/ary3: -2.40% (3.7241 => 3.6347, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.50% (7.3040 => 7.1942, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6075, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6025, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3478, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5904, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6692, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 08:07:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 10:07:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119160743.C03352A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7760?compare_to=7756&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7760, Order: 172901, Start Time: 2013-01-19 13:56:49, End Time: 2013-01-19 16:07:54 To: 7756, Order: 172894, Start Time: 2013-01-19 11:15:31, End Time: 2013-01-19 13:26:38 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1332 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.40% (0.0676 => 0.0653, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8454 => 499.8538, std.dev.: 0.0078) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.07% (1.1277 => 499.8538, std.dev.: 0.0078) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.67% (0.5229 => 1.6454, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 19.97% (14.9895 => 17.9832, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 43.30% (14.1553 => 20.2851, std.dev.: 0.0212) MultiSource/Benchmarks/MallocBench/gs/gs: 17.64% (4.1105 => 4.8354, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.48% (1.1048 => 1.7288, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.78% (7.1582 => 37.5646, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.18% (3.4629 => 6.3781, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.08% (0.6222 => 1.0831, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.58% (0.0720 => 7.4445, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 11153500.00% (0.0001 => 11.1536, std.dev.: 0.0176) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0114) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.64% (1.1194 => 10.2497, std.dev.: 0.0131) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.07% (22.1758 => 55.2327, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 89.88% (0.0929 => 0.1764, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454) MultiSource/Benchmarks/FreeBench/neural/neural: 71.09% (0.1463 => 0.2503, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.79% (2.9384 => 4.6071, std.dev.: 0.0025) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.72% (7.0540 => 10.7727, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.92% (1.5859 => 2.3934, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.73% (8.1363 => 11.9381, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.76% (2.2024 => 3.1002, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 39.32% (0.1432 => 0.1995, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 39.08% (0.3109 => 0.4324, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.18% (21.9371 => 30.3119, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.63% (0.1062 => 0.1451, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.43% (4.2646 => 5.6902, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.80% (1.5415 => 2.0471, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.33% (0.4615 => 0.6107, std.dev.: 0.0063) SingleSource/Benchmarks/McGill/exptree: 31.70% (0.0814 => 0.1072, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.44% (0.1892 => 0.2468, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.07% (0.2271 => 0.2954, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.03% (0.4299 => 0.5547, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 28.77% (1.1642 => 1.4991, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.01% (0.6675 => 0.8545, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.80% (0.5105 => 0.6473, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.23% (0.0793 => 0.1001, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.58% (3.8922 => 4.8879, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 25.26% (0.1655 => 0.2073, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 25.18% (1.0722 => 1.3422, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.84% (0.3121 => 0.3865, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 23.83% (0.1175 => 0.1455, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.56% (1.4186 => 1.7528, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 23.40% (0.4620 => 0.5701, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 22.37% (9.4845 => 11.6062, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.33% (0.0730 => 0.0893, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.95% (0.1695 => 0.2067, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.59% (0.2700 => 0.3283, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: 21.57% (0.7115 => 0.8650, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.30% (0.3098 => 0.3758, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.96% (0.7835 => 0.9477, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.63% (0.1236 => 0.1491, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.48% (1.3050 => 1.5722, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 20.47% (5.7591 => 6.9380, std.dev.: 0.0032) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 19.95% (0.6456 => 0.7744, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.72% (0.1151 => 0.1378, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.42% (0.5860 => 0.6998, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.41% (4.9449 => 5.9049, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.31% (0.8172 => 0.9750, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.64% (5.0018 => 5.9342, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 18.52% (3.3354 => 3.9532, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.19% (0.7433 => 0.8785, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.02% (0.2758 => 0.3255, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.93% (0.5020 => 0.5920, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.87% (0.3307 => 0.3898, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.78% (0.5569 => 0.6559, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.57% (0.9765 => 1.1481, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 16.98% (1.1840 => 1.3851, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 16.97% (2.0273 => 2.3713, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 16.94% (3.8723 => 4.5284, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.3423 => 0.4001, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.85% (0.5981 => 0.6989, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 16.54% (0.3283 => 0.3826, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.27% (0.3441 => 0.4001, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.27% (0.8101 => 0.9419, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 16.17% (2.2969 => 2.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.71% (0.6450 => 0.7463, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 15.57% (0.2049 => 0.2368, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.09% (0.3180 => 0.3660, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.77% (0.8921 => 1.0239, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3379 => 0.3871, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.51% (1.1861 => 1.3582, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.26% (0.8067 => 0.9217, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.87% (0.3865 => 0.4401, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.11% (0.4636 => 0.5244, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.92% (1.5603 => 1.7619, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.82% (0.4103 => 0.4629, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.28% (0.4203 => 0.4719, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 11.88% (0.4048 => 0.4529, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.85% (0.3603 => 0.4030, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.71% (0.3927 => 0.4387, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: 11.69% (0.3422 => 0.3822, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: 11.49% (17.1811 => 19.1551, std.dev.: 0.0204) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.37% (0.3684 => 0.4103, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.33% (0.3282 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3826 => 0.4245, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.56% (0.4064 => 0.4493, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.39% (14.3668 => 15.8597, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.24% (0.3427 => 0.3778, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.22% (0.3543 => 0.3905, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 10.15% (0.3516 => 0.3873, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.10% (0.2831 => 0.3117, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.51% (2.0665 => 2.2631, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 9.44% (0.2871 => 0.3142, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: 9.28% (0.2877 => 0.3144, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.09% (0.2905 => 0.3169, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.07% (0.3650 => 0.3981, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.99% (0.2891 => 0.3151, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.92% (0.3162 => 0.3444, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.92% (1.2842 => 1.3987, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.51% (0.6030 => 0.6543, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.36% (0.2714 => 0.2941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 8.35% (0.5925 => 0.6420, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.34% (0.7326 => 0.7937, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.23% (0.3935 => 0.4259, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.04% (63.2438 => 68.3306, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.31% (10.3673 => 11.1254, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.10% (2.2022 => 2.3585, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.46% (0.4879 => 0.5194, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.3131 => 0.3250, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.15% (7.9617 => 8.1329, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.22% (32.5116 => 59.2435, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.35% (1.1396 => 1.2461, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.92% (2.8904 => 3.1483, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.79% (4.2280 => 4.4730, std.dev.: 0.0057) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3145, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.43% (8.6802 => 8.8907, std.dev.: 0.0210) MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.28% (0.6533 => 0.6682, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.14% (3.6395 => 3.7173, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.80% (9.1159 => 9.2796, std.dev.: 0.0286) MultiSource/Benchmarks/mafft/pairlocalalign: 1.57% (27.8444 => 28.2817, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4551, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.80% (5.2763 => 1.1712, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.30% (0.8651 => 0.2137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.27% (5.3855 => 4.4552, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.88% (5.3526 => 4.4491, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: -13.57% (10.4361 => 9.0199, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.24% (1.7609 => 1.6158, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9729, std.dev.: 0.0182) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.75% (1.9577 => 0.6510, std.dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3062, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.70% (10.7105 => 7.4222, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8548, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0046, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3242, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.04% (0.2161 => 0.1728, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.09% (0.6223 => 0.5035, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4249, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7329, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2860, std.dev.: 0.0139) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4813, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.88% (1.2373 => 1.1645, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.47% (8.1563 => 7.7104, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.89% (1.5835 => 1.5060, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8381, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0077) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.75% (3.6994 => 3.6345, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/ary3: -1.67% (3.7221 => 3.6600, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0027) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 08:12:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 10:12:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119161201.CFF802A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7761?compare_to=7759&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7761, Order: 172902, Start Time: 2013-01-19 14:38:22, End Time: 2013-01-19 16:12:12 To: 7759, Order: 172901, Start Time: 2013-01-19 12:41:18, End Time: 2013-01-19 14:15:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 2 (112 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.97% (0.8470 => 0.8303, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.93% (0.6637 => 0.6509, std.dev.: 0.0012) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.71% (0.0974 => 0.1614, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.80% (0.1500 => 0.2172, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.81% (0.1132 => 0.1560, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.47% (0.6395 => 0.8727, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.65% (0.6395 => 0.8611, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.64% (0.6260 => 0.8303, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.76% (0.0699 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.68% (0.5688 => 0.7490, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.51% (0.5805 => 0.7634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.23% (0.5456 => 0.7160, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.01% (0.6230 => 0.8162, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.84% (0.5849 => 0.7653, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.73% (0.5575 => 0.7288, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.41% (0.5567 => 0.7260, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.37% (0.5581 => 0.7276, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.04% (0.5802 => 0.7545, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.54% (0.6033 => 0.7815, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.40% (0.5705 => 0.7382, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.10% (0.5859 => 0.7564, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.88% (0.5478 => 0.7060, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.87% (0.5570 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.82% (0.5857 => 0.7545, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.77% (0.6440 => 0.8293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.75% (0.5569 => 0.7170, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.62% (0.5925 => 0.7621, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.19% (0.5591 => 0.7167, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.74% (0.6676 => 0.8528, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.65% (0.6189 => 0.7900, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.49% (1.6474 => 2.1002, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.46% (0.6446 => 0.8216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.45% (0.6052 => 0.7713, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.29% (0.5863 => 0.7463, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.74% (0.6304 => 0.7990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.70% (0.6681 => 0.8398, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.69% (0.6194 => 0.7785, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.44% (0.6660 => 0.8354, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.25% (0.6297 => 0.7887, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.80% (0.6667 => 0.8254, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.74% (0.7524 => 0.9235, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.80% (0.7339 => 0.8939, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.41% (2.2587 => 2.7197, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 14.91% (1.1450 => 1.3157, std.dev.: 0.0055) MultiSource/Applications/sgefa/sgefa: 14.57% (0.3357 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.61% (0.0833 => 0.0938) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.16% (0.1982 => 0.2223, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.64% (4.5069 => 5.0314, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.51% (0.4916 => 0.5482, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.30% (0.4515 => 0.5025, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.93% (1.6364 => 1.8152, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.75% (3.5339 => 3.9138, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.7021 => 0.7609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4524 => 0.4873, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 7.50% (1.2515 => 1.3454, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.50% (0.2001 => 0.2151, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4861 => 0.5205, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.60% (1.2784 => 1.3628, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.59% (9.2283 => 9.8361, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.58% (1.4642 => 1.5605, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.53% (0.1731 => 0.1844, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.3255 => 0.3449, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.37% (0.3319 => 0.3464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.33% (0.3394 => 0.3507, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.27% (0.6750 => 0.6971, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1740, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.93% (5.4682 => 5.6284, std.dev.: 0.0195) MultiSource/Applications/SIBsim4/SIBsim4: 2.28% (1.3864 => 1.4180, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.69% (0.8418 => 0.8560, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (0.9557 => 0.9703, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3722 => 1.3901, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8053, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.2380 => 0.2486, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8210 => 28.2660, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2772, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.48% (4.5320 => 4.5990, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.54% (0.7198 => 0.6799, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -4.64% (0.3812 => 0.3635, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.59% (0.3880 => 0.3702, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.54% (0.3831 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.51% (0.3884 => 0.3709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.45% (0.3891 => 0.3718, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.44% (2.4924 => 2.3817, std.dev.: 0.0096) SingleSource/UnitTests/ObjC/for-in: -4.44% (0.4033 => 0.3854, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.40% (0.9852 => 0.9419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.33% (0.4176 => 0.3995, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.16% (0.2428 => 0.2327, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.88% (0.4199 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.85% (0.3142 => 0.3021, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.83% (0.3837 => 0.3690, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.75% (0.6347 => 0.6109, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/parameter-passing: -3.43% (0.4280 => 0.4133, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.33% (0.9542 => 0.9224, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.21% (0.3834 => 0.3711, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.19% (0.3323 => 0.3217, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: -3.15% (0.7779 => 0.7534, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.08% (0.6484 => 0.6284, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.98% (0.3658 => 0.3549, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.67% (14.2083 => 13.8286, std.dev.: 0.0170) MultiSource/Applications/sqlite3/sqlite3: -2.61% (17.1032 => 16.6573, std.dev.: 0.0255) MultiSource/Applications/hexxagon/hexxagon: -2.58% (1.3148 => 1.2809, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2478, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.53% (2.1713 => 2.1163, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.22% (6.7716 => 6.6212, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -2.15% (16.1920 => 15.8431, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.11% (0.7919 => 0.7752, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.09% (1.2221 => 1.1966, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.94% (1.2210 => 1.1973, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -1.92% (4.3330 => 4.2498, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.81% (7.0961 => 6.9678, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.80% (1.0544 => 1.0354, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.72% (1.2300 => 1.2088, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.38% (0.8521 => 0.8403, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -1.26% (2.4021 => 2.3719, std.dev.: 0.0004) MultiSource/Applications/lua/lua: -1.12% (4.0594 => 4.0140, std.dev.: 0.0119) MultiSource/Applications/hbd/hbd: -1.05% (1.5610 => 1.5446, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6951, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2407, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -23.50% (7.5137 => 5.7478, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9197, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.81% (4.1024 => 3.2075, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1305, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.39% (4.7378 => 4.1033, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3394, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.70% (0.5142 => 0.4643, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1729, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (7.9763 => 7.7537, std.dev.: 0.0206) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1185, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2810, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.7241 => 3.6495, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4667, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.43% (7.3040 => 7.1992, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6093, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5891, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3474, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6042, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.03% (1.4516 => 1.4367, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 08:20:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 10:20:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119162039.341F62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7762?compare_to=7758&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7762, Order: 172902, Start Time: 2013-01-19 14:22:47, End Time: 2013-01-19 16:20:51 To: 7758, Order: 172901, Start Time: 2013-01-19 11:53:04, End Time: 2013-01-19 13:50:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (8 on baseline) Performance Improvements: 16 (178 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1043 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.83% (1.4998 => 1.5273, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.81% (1.2453 => 1.3052, std.dev.: 0.0117) SingleSource/Benchmarks/Linpack/linpack-pc: 4.05% (50.7698 => 52.8239, std.dev.: 0.2220) SingleSource/Benchmarks/McGill/chomp: 1.42% (1.0092 => 1.0235, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.29% (2.9352 => 2.9732, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.83% (0.1160 => 0.1046, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.65% (0.9477 => 0.9036, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.79% (1.4460 => 1.4057, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.89% (0.8500 => 0.8339, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.89% (4.8405 => 4.7489, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.74% (1.0757 => 1.0570, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.67% (0.6903 => 0.6788, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.51% (0.9168 => 0.9030, std.dev.: 0.0029) MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.43% (1.0883 => 1.0727, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.39% (0.9520 => 0.9388, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.37% (1.0966 => 1.0816, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.36% (0.8830 => 0.8710, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.24% (0.9599 => 0.9480, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.15% (0.9154 => 0.9049, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.13% (0.9119 => 0.9016, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -5.14% (3.2986 => 3.1289, std.dev.: 0.0277) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.47% (1.1111 => 1.1163, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.12% (0.0432 => 0.0371, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.60% (0.0269 => 0.0262, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.94% (0.0318 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 20.79% (0.0356 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -9.89% (0.0182 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 29.94% (0.0167 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.74% (0.0230 => 0.0226, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.34% (0.1460 => 0.1455, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 0.92% (1.1386 => 1.1491, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.63% (0.3944 => 0.3969, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.18% (0.1446 => 0.1492, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.65% (0.0968 => 0.0952, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 28.37% (0.0215 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.33% (0.0587 => 0.0544, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.56% (1.1516 => 1.1452, std.dev.: 0.1056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 7.41% (0.0027 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1200.00% (0.0002 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.61% (0.0545 => 0.0581, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.43% (0.0235 => 0.0236, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.56% (0.7515 => 0.7398, std.dev.: 0.0075) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 241.67% (0.0036 => 0.0123, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7393 => 12.7448, std.dev.: 0.0507) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.15% (0.0336 => 0.0481, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321062.50% (0.0008 => 2.5693, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.04% (1.1825 => 2.3418, std.dev.: 0.0465) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.83% (0.2562 => 0.2865, std.dev.: 0.0010) SingleSource/Benchmarks/Linpack/linpack-pc: 3.79% (50.8945 => 52.8239, std.dev.: 0.2220) SingleSource/Benchmarks/Misc/pi: 2.91% (2.1390 => 2.2013, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 2.55% (6.8159 => 6.9895, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: 1.92% (63.1520 => 64.3673, std.dev.: 0.0594) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.09% (0.0808 => 0.0476, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.01% (0.0727 => 0.0487, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -26.80% (0.1888 => 0.1382, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.80% (0.1009 => 0.0789, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.53% (0.0676 => 0.0544, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -19.46% (1.8964 => 1.5273, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.91% (0.0862 => 0.0699, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.55% (1.0960 => 0.9036, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.87% (0.1079 => 0.0897, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.51% (0.7686 => 0.6494, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.75% (1.0986 => 0.9366, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -14.39% (9.8875 => 8.4651, std.dev.: 0.2262) MultiSource/Applications/spiff/spiff: -14.32% (1.0220 => 0.8756, std.dev.: 0.0129) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.89% (0.4074 => 0.3508, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.55% (0.1210 => 0.1046, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -13.09% (1.5979 => 1.3887, std.dev.: 0.0174) MultiSource/Applications/treecc/treecc: -12.29% (2.4719 => 2.1681, std.dev.: 0.0205) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.74% (1.2154 => 1.0727, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.65% (6.4235 => 5.6749, std.dev.: 0.0853) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.49% (0.2481 => 0.2196, std.dev.: 0.0061) MultiSource/Applications/aha/aha: -11.47% (0.1378 => 0.1220, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -11.42% (4.6406 => 4.1106, std.dev.: 0.0204) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.25% (0.0889 => 0.0789, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -10.92% (1.1433 => 1.0184, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.73% (0.1025 => 0.0915, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/health/health: -10.50% (0.1610 => 0.1441, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.37% (0.2372 => 0.2126, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.31% (1.5131 => 1.3571, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.28% (1.3924 => 1.2492, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.18% (0.7693 => 0.6910, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -10.02% (17.5634 => 15.8028, std.dev.: 0.0794) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.99% (10.2703 => 9.2443, std.dev.: 0.0711) MultiSource/Applications/sgefa/sgefa: -9.87% (0.3598 => 0.3243, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.70% (1.6874 => 1.5237, std.dev.: 0.0305) MultiSource/Applications/siod/siod: -9.69% (2.6437 => 2.3876, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.66% (1.1498 => 1.0387, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.34% (0.1317 => 0.1194, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.29% (0.9588 => 0.8697, std.dev.: 0.0158) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.88% (1.1731 => 1.0689, std.dev.: 0.0128) MultiSource/Applications/ClamAV/clamscan: -8.74% (17.4365 => 15.9131, std.dev.: 0.0725) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.60% (0.9124 => 0.8339, std.dev.: 0.0035) MultiSource/Applications/lambda-0_1_3/lambda: -8.32% (0.8653 => 0.7933, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.19% (0.2283 => 0.2096, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: -8.11% (0.1369 => 0.1258, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: -7.94% (3.7840 => 3.4835, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.87% (0.3560 => 0.3280, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.52% (0.6885 => 0.6367, std.dev.: 0.0078) MultiSource/Applications/lemon/lemon: -6.94% (1.3979 => 1.3009, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.93% (1.3310 => 1.2388, std.dev.: 0.0126) MultiSource/Applications/viterbi/viterbi: -6.91% (0.1824 => 0.1698, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.81% (0.2144 => 0.1998, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.74% (0.5746 => 0.5359, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: -6.72% (0.5134 => 0.4789, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.41% (0.7693 => 0.7200, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.32% (1.8127 => 1.6981, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.28% (1.0017 => 0.9388, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -6.28% (0.1928 => 0.1807, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: -6.18% (0.2006 => 0.1882, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.76% (0.2100 => 0.1979, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.74% (5.0381 => 4.7489, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.63% (3.6295 => 3.4253, std.dev.: 0.0469) SingleSource/Benchmarks/Shootout-C++/moments: -5.62% (0.4002 => 0.3777, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.59% (0.9550 => 0.9016, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.54% (0.2709 => 0.2559, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -5.39% (0.2135 => 0.2020, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -5.36% (0.3394 => 0.3212, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.35% (0.2615 => 0.2475, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.34% (0.3462 => 0.3277, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.34% (0.2884 => 0.2730, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.33% (0.6135 => 0.5808, std.dev.: 0.0077) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.28% (0.2577 => 0.2441, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.07% (0.3981 => 0.3779, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -5.06% (4.5936 => 4.3611, std.dev.: 0.0506) MultiSource/Applications/SIBsim4/SIBsim4: -5.06% (1.4392 => 1.3664, std.dev.: 0.0114) MultiSource/Applications/minisat/minisat: -5.05% (0.7776 => 0.7383, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -4.76% (0.3715 => 0.3538, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.72% (1.2680 => 1.2082, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.72% (0.6934 => 0.6607, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.2385 => 0.2273, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/except: -4.60% (0.2172 => 0.2072, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.58% (0.3665 => 0.3497, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.57% (0.9127 => 0.8710, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.43% (0.5369 => 0.5131, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: -4.43% (0.2551 => 0.2438, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: -4.40% (0.2725 => 0.2605, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.39% (4.6579 => 4.4535, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.37% (0.9507 => 0.9092, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.36% (0.3093 => 0.2958, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.29% (0.9422 => 0.9018, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -4.27% (0.3206 => 0.3069, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -4.22% (18.9377 => 18.1382, std.dev.: 0.0810) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.18% (1.3220 => 1.2667, std.dev.: 0.0082) MultiSource/Applications/SPASS/SPASS: -4.17% (16.4479 => 15.7627, std.dev.: 0.0407) SingleSource/Benchmarks/Shootout-C++/ary2: -4.13% (0.2665 => 0.2555, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.07% (1.0234 => 0.9817, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/08-main/main: -4.05% (0.2915 => 0.2797, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.05% (0.9512 => 0.9127, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.00% (0.9788 => 0.9396, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.99% (0.9405 => 0.9030, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: -3.98% (0.4776 => 0.4586, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.78% (0.9214 => 0.8866, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.77% (0.8990 => 0.8651, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.2993 => 0.2885, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.55% (1.0052 => 0.9695, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.50% (0.9091 => 0.8773, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.49% (0.9993 => 0.9644, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -3.45% (0.4689 => 0.4527, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.28% (0.9403 => 0.9095, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -3.18% (0.3273 => 0.3169, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.13% (14.9757 => 14.5063, std.dev.: 0.0198) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.09% (0.4762 => 0.4615, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: -3.05% (0.6711 => 0.6506, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.99% (4.8904 => 4.7443, std.dev.: 0.0207) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.97% (0.6996 => 0.6788, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -2.83% (7.3529 => 7.1449, std.dev.: 0.0570) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.76% (7.2721 => 7.0711, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.67% (1.0860 => 1.0570, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.44% (1.0119 => 0.9872, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.34% (0.9855 => 0.9624, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: -2.25% (16.7012 => 16.3254, std.dev.: 0.0609) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.24% (0.9685 => 0.9468, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.22% (0.9488 => 0.9277, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.11% (1.0088 => 0.9875, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: -2.04% (5.3553 => 5.2463, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.7225 => 0.7084, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.75% (0.9061 => 0.8902, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.62% (0.8926 => 0.8781, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.55% (0.8893 => 0.8755, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.37% (0.9612 => 0.9480, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.23% (0.9381 => 0.9266, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -1.21% (0.9759 => 0.9641, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: -1.08% (9.5202 => 9.4171, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.07% (0.9998 => 0.9891, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.99% (0.9372 => 0.6468, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout/heapsort: -30.06% (4.4739 => 3.1289, std.dev.: 0.0277) MultiSource/Applications/minisat/minisat: -22.36% (7.9891 => 6.2031, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.95% (1.0816 => 0.8658, std.dev.: 0.0092) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.00% (1.5623 => 1.2655, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/heapsort: -18.17% (4.2042 => 3.4402, std.dev.: 0.2603) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.95% (0.1164 => 0.0990, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.79% (1.4235 => 1.2556, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/hash: -10.74% (4.5259 => 4.0400, std.dev.: 0.0863) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.53% (2.8778 => 2.5747, std.dev.: 0.0226) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.17% (5.0421 => 4.5295, std.dev.: 0.1342) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.02% (0.4081 => 0.3672, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.06% (1.4588 => 1.3267, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists1: -8.83% (0.6628 => 0.6043, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -7.78% (9.0650 => 8.3599, std.dev.: 0.1442) MultiSource/Benchmarks/Olden/health/health: -6.60% (0.3654 => 0.3413, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.17% (46.0987 => 43.2566, std.dev.: 0.9024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.14% (23.3986 => 21.9617, std.dev.: 0.3685) MultiSource/Applications/oggenc/oggenc: -6.04% (0.1704 => 0.1601, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: -5.94% (2.2304 => 2.0980, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.3201 => 0.3033, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.20% (0.3349 => 0.3175, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.41% (2.5170 => 2.4061, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.01% (1.4446 => 1.3866, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: -3.68% (17.2182 => 16.5841, std.dev.: 0.0423) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.61% (40.4729 => 39.0101, std.dev.: 0.3589) MultiSource/Applications/SIBsim4/SIBsim4: -3.58% (3.5443 => 3.4175, std.dev.: 0.0262) MultiSource/Applications/sqlite3/sqlite3: -3.48% (4.4730 => 4.3175, std.dev.: 0.0541) SingleSource/Benchmarks/Misc/ffbench: -3.37% (1.4244 => 1.3764, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.63% (0.5826 => 0.5673, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -2.36% (29.0327 => 28.3477, std.dev.: 0.0343) MultiSource/Applications/spiff/spiff: -2.34% (2.8571 => 2.7903, std.dev.: 0.0128) SingleSource/Benchmarks/Dhrystone/dry: -2.06% (0.5295 => 0.5186, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.90% (42.3194 => 41.5151, std.dev.: 0.3108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.84% (61.0379 => 59.9146, std.dev.: 0.0852) SingleSource/Benchmarks/McGill/chomp: -1.82% (1.0425 => 1.0235, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0010) SingleSource/Benchmarks/SmallPT/smallpt: -1.38% (14.9448 => 14.7390, std.dev.: 0.0435) MultiSource/Benchmarks/BitBench/five11/five11: -1.30% (5.7021 => 5.6282, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.21% (3.1921 => 3.1534, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.16% (3.0082 => 2.9732, std.dev.: 0.0057) MultiSource/Applications/aha/aha: -1.15% (3.5321 => 3.4914, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.34% (1.2047 => 1.1163, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -17.74% (0.0451 => 0.0371, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -33.50% (0.0394 => 0.0262, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.96% (0.0328 => 0.0315, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -23.00% (0.0213 => 0.0164, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -4.41% (0.0227 => 0.0217, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.37% (0.0255 => 0.0226, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.90% (0.1530 => 0.1455, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -40.44% (1.9293 => 1.1491, std.dev.: 0.0314) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.98% (0.4049 => 0.3969, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.19% (0.1510 => 0.1492, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.0978 => 0.0952, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.80% (0.0590 => 0.0544, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.42% (1.1617 => 1.1452, std.dev.: 0.1056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.75% (0.0610 => 0.0581, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.94% (0.0268 => 0.0236, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.52% (0.7437 => 0.7398, std.dev.: 0.0075) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7781 => 12.7448, std.dev.: 0.0507) Report Time: 0.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 10:10:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 12:10:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119181040.2F9222A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7763?compare_to=7757&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7763, Order: 172901, Start Time: 2013-01-19 14:36:06, End Time: 2013-01-19 18:10:50 To: 7757, Order: 172894, Start Time: 2013-01-19 10:01:48, End Time: 2013-01-19 13:45:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.73% (2.4111 => 2.4529, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.88% (0.0625 => 0.0918, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.12% (0.1063 => 0.1447, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.46% (0.2969 => 0.3814, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.89% (0.4139 => 0.5252, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.83% (0.1107 => 0.1404, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.78% (0.5900 => 0.7480, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.76% (0.4253 => 0.5391, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.57% (0.4994 => 0.6271, std.dev.: 0.0171) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 25.21% (1.5932 => 1.9948, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.57% (0.1620 => 0.2018, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.56% (0.5000 => 0.6228, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.09% (0.1021 => 0.1267, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.05% (0.1549 => 0.1906, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.73% (0.1003 => 0.1231, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.26% (0.1604 => 0.1961, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.24% (0.3903 => 0.4771, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: 22.19% (0.0604 => 0.0738, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 21.93% (0.1619 => 0.1974, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.83% (0.2736 => 0.3306, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 20.77% (0.4029 => 0.4866, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.40% (0.1088 => 0.1310, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 20.36% (0.1218 => 0.1466, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.25% (0.1462 => 0.1758, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.08% (0.3890 => 0.4671, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.01% (0.2014 => 0.2417, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.52% (1.3152 => 1.5719, std.dev.: 0.0312) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.33% (0.2866 => 0.3420, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 18.90% (0.5546 => 0.6594, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.67% (3.5627 => 4.2280, std.dev.: 0.0561) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 18.65% (1.8794 => 2.2299, std.dev.: 0.0421) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.53% (0.3271 => 0.3877, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.24% (1.6211 => 1.9168, std.dev.: 0.0239) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.18% (0.4658 => 0.5505, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.09% (0.1968 => 0.2324, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.88% (0.2875 => 0.3389, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.0582 => 0.0686, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 17.83% (0.1284 => 0.1513, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.73% (0.2792 => 0.3287, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 17.68% (0.5826 => 0.6856, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.53% (0.5026 => 0.5907, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: 17.43% (0.2811 => 0.3301, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.43% (0.9697 => 1.1387, std.dev.: 0.0078) SingleSource/UnitTests/ObjC++/property-reference-object: 17.41% (0.5889 => 0.6914, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.36% (0.4361 => 0.5118, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.35% (0.2911 => 0.3416, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.28% (0.2738 => 0.3211, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 17.27% (0.2750 => 0.3225, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.23% (0.2780 => 0.3259, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/objinst: 17.22% (0.2823 => 0.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.21% (0.2714 => 0.3181, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.18% (0.3930 => 0.4605, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 17.17% (0.2813 => 0.3296, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/fibo: 17.14% (0.2725 => 0.3192, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.11% (0.2729 => 0.3196, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.09% (2.0673 => 2.4207, std.dev.: 0.0036) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.90% (0.3195 => 0.3735, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 16.83% (0.3096 => 0.3617, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.77% (1.0781 => 1.2589, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 16.66% (0.9909 => 1.1560, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.65% (1.9694 => 2.2974, std.dev.: 0.0488) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 16.47% (0.3267 => 0.3805, std.dev.: 0.0015) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.42% (2.7292 => 3.1774, std.dev.: 0.0377) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.41% (0.3060 => 0.3562, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 16.40% (4.2109 => 4.9015, std.dev.: 0.0976) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.31% (1.9966 => 2.3222, std.dev.: 0.0461) MultiSource/Benchmarks/Bullet/bullet: 16.30% (23.5202 => 27.3539, std.dev.: 0.1183) SingleSource/Benchmarks/Shootout-C++/ary: 16.27% (0.3258 => 0.3788, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.25% (4.4195 => 5.1378, std.dev.: 0.0412) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.20% (0.3124 => 0.3630, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 16.16% (0.3726 => 0.4328, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.03% (0.3362 => 0.3901, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 16.01% (0.3317 => 0.3848, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 15.83% (0.3348 => 0.3878, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.81% (0.3282 => 0.3801, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.76% (0.7171 => 0.8301, std.dev.: 0.0045) MultiSource/Applications/lua/lua: 15.69% (1.4269 => 1.6508, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: 15.62% (0.3477 => 0.4020, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.50% (0.3981 => 0.4598, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.48% (0.3625 => 0.4186, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 15.47% (0.3678 => 0.4247, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 15.24% (0.4251 => 0.4899, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.15% (0.3690 => 0.4249, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.15% (0.4146 => 0.4774, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 14.87% (0.7875 => 0.9046, std.dev.: 0.0168) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 14.72% (0.3465 => 0.3975, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.62% (0.3488 => 0.3998, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.62% (0.3496 => 0.4007, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 14.58% (0.3442 => 0.3944, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/synchronized: 14.56% (0.3469 => 0.3974, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.54% (0.3460 => 0.3963, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.51% (0.3845 => 0.4403, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 14.45% (0.5012 => 0.5736, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 14.42% (0.2691 => 0.3079, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/property: 14.33% (0.3650 => 0.4173, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.16% (0.3643 => 0.4159, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 14.15% (0.3724 => 0.4251, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.78% (0.2075 => 0.2361, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: 13.75% (2.1653 => 2.4630, std.dev.: 0.0332) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 13.60% (5.5417 => 6.2956, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.57% (0.6435 => 0.7308, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 13.45% (2.1013 => 2.3839, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 13.31% (4.6177 => 5.2321, std.dev.: 0.0589) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.93% (0.2737 => 0.3091, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.57% (0.2068 => 0.2328, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.30% (0.2040 => 0.2291, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 11.98% (0.3498 => 0.3917, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 11.87% (0.3336 => 0.3732, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.70% (0.2103 => 0.2349, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.67% (0.3084 => 0.3444, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 11.65% (0.6634 => 0.7407, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: 11.49% (0.4847 => 0.5404, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.36% (0.5361 => 0.5970, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.71% (11.6398 => 12.8863, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.63% (0.1383 => 0.1530, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.56% (0.7426 => 0.8210, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.89% (4.6926 => 5.1569, std.dev.: 0.0230) MultiSource/Applications/sqlite3/sqlite3: 9.87% (2.0346 => 2.2355, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.22% (0.5584 => 0.6099, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 7.64% (11.9555 => 12.8689, std.dev.: 0.0166) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.38% (0.3792 => 0.3996, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.80% (29.0505 => 181.5070, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0310) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 15.97% (0.5917 => 0.6862, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.42% (0.2802 => 0.3066, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.99% (0.3693 => 0.4025, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6822, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2389, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6849, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.60% (1.8057 => 1.8887, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2111, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3062, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.30% (7.1849 => 7.2781, std.dev.: 0.0081) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0826, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2087, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5838, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4777, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5746, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.08% (17.2379 => 14.2941, std.dev.: 0.0937) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7976, std.dev.: 0.0080) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -4.89% (14.0481 => 13.3608, std.dev.: 0.1263) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2258, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419) SingleSource/UnitTests/Vector/build2: -3.70% (11.2080 => 10.7938, std.dev.: 0.0161) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.92% (0.6293 => 0.6109, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1661, std.dev.: 0.0515) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1717, std.dev.: 0.0563) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0476, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 10:48:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 12:48:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119184837.BC1912A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7764?compare_to=7760&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7764, Order: 172902, Start Time: 2013-01-19 16:37:59, End Time: 2013-01-19 18:48:47 To: 7760, Order: 172901, Start Time: 2013-01-19 13:56:49, End Time: 2013-01-19 16:07:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.89% (0.6682 => 0.6556) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.30% (0.1332 => 0.1328) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0653 => 0.0651, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8538 => 499.8572, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.37% (1.1277 => 499.8572, std.dev.: 0.0029) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.63% (0.5229 => 1.6452, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 19.94% (14.9895 => 17.9780, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 43.34% (14.1553 => 20.2898, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/gs/gs: 17.61% (4.1105 => 4.8345, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.74% (1.1048 => 1.7317, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.79% (7.1582 => 37.4940, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.92% (3.4629 => 6.3689, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.20% (0.6222 => 1.0839, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10289.03% (0.0720 => 7.4801, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11181200.00% (0.0001 => 11.1813, std.dev.: 0.0574) MultiSource/Applications/kimwitu++/kc: 50800.00% (0.0001 => 0.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488500.00% (0.0001 => 5.4886, std.dev.: 0.0191) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.05% (1.1194 => 10.2319, std.dev.: 0.0017) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.99% (22.1758 => 55.2163, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.45% (0.0929 => 0.1825, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.17% (2.9384 => 4.6182, std.dev.: 0.0046) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.62% (7.0540 => 10.7657, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.99% (1.5859 => 2.3946, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.73% (8.1363 => 11.9383, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.77% (2.2024 => 3.1003, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.00% (21.9371 => 30.2729, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0008) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.84% (1.5415 => 2.0477, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.79% (4.2646 => 5.6631, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.59% (0.4615 => 0.6119, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.81% (0.1892 => 0.2475, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.12% (0.2271 => 0.2955, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 29.63% (0.4299 => 0.5573, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 29.28% (1.1642 => 1.5051, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.30% (0.6675 => 0.8564, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.50% (0.5105 => 0.6458, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.64% (3.8922 => 4.8900, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.20% (0.1655 => 0.2072, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 25.08% (1.0722 => 1.3411, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.34% (0.4289 => 0.5333, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.32% (0.1143 => 0.1421, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 23.74% (0.1175 => 0.1454, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.74% (0.3121 => 0.3862, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.65% (1.4186 => 1.7541, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.31% (0.4620 => 0.5697, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.87% (9.4845 => 11.6532, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.19% (0.0730 => 0.0892, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070) MultiSource/Applications/aha/aha: 21.63% (0.1151 => 0.1400, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 21.62% (0.7115 => 0.8653, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.44% (0.2700 => 0.3279, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.82% (0.7835 => 0.9466, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052) MultiSource/Applications/oggenc/oggenc: 20.75% (5.7591 => 6.9543, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.55% (1.3050 => 1.5732, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.23% (0.1236 => 0.1486, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.21% (0.6456 => 0.7761, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.92% (0.1029 => 0.1234, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.67% (0.1032 => 0.1235, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.61% (0.5860 => 0.7009, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.59% (0.8172 => 0.9773, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.45% (4.9449 => 5.9069, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.94% (0.0834 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9434, std.dev.: 0.0100) MultiSource/Applications/d/make_dparser: 18.53% (3.3354 => 3.9536, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.89% (0.5020 => 0.5918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.81% (0.3307 => 0.3896, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 17.72% (0.7433 => 0.8750, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.58% (0.5569 => 0.6548, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.55% (0.9765 => 1.1479, std.dev.: 0.0071) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.37% (0.2107 => 0.2473, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.12% (0.3423 => 0.4009, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 17.06% (1.1840 => 1.3860, std.dev.: 0.0061) MultiSource/Applications/treecc/treecc: 16.97% (2.0273 => 2.3714, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.97% (0.5981 => 0.6996, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0031) MultiSource/Applications/lua/lua: 16.95% (3.8723 => 4.5286, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 16.66% (0.3283 => 0.3830, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.34% (0.3232 => 0.3760, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 16.33% (2.2969 => 2.6719, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.23% (0.8101 => 0.9416, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 15.81% (0.2049 => 0.2373, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.77% (0.6450 => 0.7467, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.03% (0.3180 => 0.3658, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 14.92% (0.8921 => 1.0252, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.63% (1.1861 => 1.3596, std.dev.: 0.0050) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3379 => 0.3869, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.12% (0.8067 => 0.9206, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.92% (0.3865 => 0.4403, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.02% (0.3387 => 0.3828, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.99% (0.4636 => 0.5238, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.75% (0.4103 => 0.4626, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 12.68% (1.5603 => 1.7581, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.49% (0.4203 => 0.4728, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.13% (0.4048 => 0.4539, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 12.04% (0.3422 => 0.3834, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.02% (0.3603 => 0.4036, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 11.56% (0.3684 => 0.4110, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.49% (17.1811 => 19.1554, std.dev.: 0.0198) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.36% (0.2430 => 0.2706, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.35% (0.3886 => 0.4327, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.08% (0.3826 => 0.4250, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.71% (0.3828 => 0.4238, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.4064 => 0.4497, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.44% (0.3497 => 0.3862, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (14.3668 => 15.8551, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.36% (0.3427 => 0.3782, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2831 => 0.3123, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.31% (0.3694 => 0.4075, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.24% (0.3516 => 0.3876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.04% (2.0665 => 2.2739, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/except: 9.68% (0.2871 => 0.3149, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.59% (0.2877 => 0.3153, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.26% (0.3650 => 0.3988, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 9.26% (0.2905 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.02% (1.2842 => 1.4000, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.95% (0.3162 => 0.3445, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.88% (0.3052 => 0.3323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.88% (0.2872 => 0.3127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.78% (0.2802 => 0.3048, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 8.73% (0.2725 => 0.2963, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.63% (0.2793 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.44% (0.3935 => 0.4267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.10% (63.2438 => 68.3692, std.dev.: 0.0196) SingleSource/UnitTests/ObjC++/property-reference-object: 8.06% (0.6030 => 0.6516, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.04% (0.7326 => 0.7915, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.98% (0.5925 => 0.6398, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.95% (10.3673 => 11.1916, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.06% (2.2022 => 2.3576, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.99% (0.3817 => 0.3931, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.17% (7.9617 => 8.1344, std.dev.: 0.0116) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4727, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.19% (4.2280 => 4.4474, std.dev.: 0.0163) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3116, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9197, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0561, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (27.8444 => 28.3833, std.dev.: 0.0031) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2902, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.66% (3.6395 => 3.6998, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/tsp/tsp: 1.54% (1.0785 => 1.0951, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4579, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5749, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.76% (5.2763 => 1.1737, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.04% (0.8651 => 0.2159, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.36% (5.3855 => 4.4505, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.91% (5.3526 => 4.4477, std.dev.: 0.0034) MultiSource/Applications/JM/ldecod/ldecod: -13.63% (10.4361 => 9.0139, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.85% (1.7609 => 1.6226, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.73% (54.1659 => 49.9766, std.dev.: 0.0436) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.83% (1.9577 => 0.6689, std.dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3062, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0221, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4263, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7560, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0039, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1273, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7330, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4941, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.16% (19.9488 => 18.3218, std.dev.: 0.0951) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.06% (1.2373 => 1.1623, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7012, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5042, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.26% (10.2830 => 9.8451, std.dev.: 0.0100) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.6994 => 3.6272, std.dev.: 0.0167) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.71% (3.7221 => 3.6586, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.19% (6.2999 => 6.2250, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.57% (0.1485 => 0.1328) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0015) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 13:03:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 15:03:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119210333.2C9FE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7765?compare_to=7761&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7765, Order: 172909, Start Time: 2013-01-19 19:29:51, End Time: 2013-01-19 21:03:43 To: 7761, Order: 172902, Start Time: 2013-01-19 14:38:22, End Time: 2013-01-19 16:12:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (100 on baseline) Performance Improvements: 2 (129 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1100 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.4054 => 56.3914, std.dev.: 0.1636) MultiSource/Benchmarks/llubenchmark/llu: 1.28% (3.7952 => 3.8438, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.70% (2.1163 => 2.0804, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -1.27% (1.2809 => 1.2646, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.76% (0.0717 => 0.1210, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.71% (0.0974 => 0.1614, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.06% (0.0514 => 0.0833, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.45% (0.0267 => 0.0375, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.54% (0.1132 => 0.1557, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.56% (0.6395 => 0.8733, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.67% (0.6395 => 0.8612, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.72% (0.5688 => 0.7492, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.61% (0.5805 => 0.7640, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.47% (0.0699 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.38% (0.5456 => 0.7168, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.95% (0.6230 => 0.8158, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.89% (0.5849 => 0.7656, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.66% (0.5567 => 0.7274, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.53% (0.5581 => 0.7285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.49% (0.5575 => 0.7275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.97% (0.5802 => 0.7541, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.59% (0.6033 => 0.7818, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.41% (0.5705 => 0.7383, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.17% (0.5859 => 0.7568, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.96% (0.5570 => 0.7183, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.88% (0.6440 => 0.8300, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.88% (0.5478 => 0.7060, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.84% (0.5857 => 0.7546, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.64% (0.5569 => 0.7164, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.49% (0.5925 => 0.7613, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.17% (0.5591 => 0.7166, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.89% (0.6676 => 0.8538, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.74% (0.6189 => 0.7906, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.58% (1.6474 => 2.1018, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.53% (0.6052 => 0.7718, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.43% (0.6446 => 0.8214, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.36% (0.5863 => 0.7467, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.78% (0.6304 => 0.7992, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.70% (0.6194 => 0.7786, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.70% (0.6681 => 0.8398, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.39% (0.6660 => 0.8351, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.23% (0.6297 => 0.7886, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.94% (0.6667 => 0.8263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.61% (0.7524 => 0.9225, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.87% (0.7339 => 0.8944, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.52% (2.2587 => 2.7221, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.62% (0.1146 => 0.1325, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3160, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.26% (0.1982 => 0.2225, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.39% (0.4916 => 0.5476, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.28% (4.5069 => 5.0153, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 11.12% (0.4515 => 0.5017, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.91% (1.6364 => 1.8149, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.81% (3.5339 => 3.9158, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.2385 => 0.2601, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.23% (0.7021 => 0.7599, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.33% (1.2515 => 1.3432, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.53% (0.1731 => 0.1844, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.51% (1.2784 => 1.3616, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.4642 => 1.5584, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 6.43% (0.4524 => 0.4815, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 6.38% (9.2283 => 9.8167, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (0.4861 => 0.5149, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3255 => 0.3401, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1737, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.74% (5.4682 => 5.6182, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/bigfib: 2.71% (0.6750 => 0.6933, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.34% (1.3864 => 1.4189, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 1.51% (0.8418 => 0.8545, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 1.34% (0.7447 => 0.7547, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.20% (1.3722 => 1.3886, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8161, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.92% (1.2783 => 1.3667, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1491, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.33% (54.5751 => 56.3914, std.dev.: 0.1636) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/llubenchmark/llu: 2.68% (3.7435 => 3.8438, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8210 => 28.2652, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5973, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4555, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6551 => 3.6924, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331) SingleSource/Benchmarks/Shootout-C++/objinst: -6.39% (0.3194 => 0.2990, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -6.11% (0.3812 => 0.3579, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -6.03% (0.3831 => 0.3600, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.95% (0.3896 => 0.3664, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.95% (0.3880 => 0.3649, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.93% (0.3848 => 0.3620, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.78% (0.3891 => 0.3666, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: -5.78% (0.4033 => 0.3800, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.60% (0.4176 => 0.3942, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.45% (0.7198 => 0.6806, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.41% (0.3884 => 0.3674, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.13% (0.3837 => 0.3640, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -5.12% (0.4199 => 0.3984, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.05% (2.4924 => 2.3665, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -4.77% (0.4280 => 0.4076, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.65% (0.3057 => 0.2915, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.63% (0.3323 => 0.3169, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -4.63% (0.6347 => 0.6053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.60% (0.2871 => 0.2739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.49% (0.2849 => 0.2721, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.48% (0.2903 => 0.2773, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.43% (0.3205 => 0.3063, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -4.36% (0.6441 => 0.6160, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.32% (0.2428 => 0.2323, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.28% (0.3016 => 0.2887, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -4.25% (0.2939 => 0.2814, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.24% (0.9852 => 0.9434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.19% (2.1713 => 2.0804, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: -4.18% (0.3059 => 0.2931, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -4.03% (0.3025 => 0.2903, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.99% (0.7779 => 0.7469, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.97% (0.3252 => 0.3123, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.85% (0.3142 => 0.3021, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -3.82% (1.3148 => 1.2646, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.66% (0.4151 => 0.3999, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: -3.48% (0.2989 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.25% (0.6484 => 0.6273, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.20% (0.3658 => 0.3541, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -3.15% (0.3621 => 0.3507, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.08% (0.3931 => 0.3810, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.06% (0.9542 => 0.9250, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.01% (0.3849 => 0.3733, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.85% (0.4427 => 0.4301, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.75% (0.4321 => 0.4202, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.70% (14.2083 => 13.8240, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists1: -2.66% (0.3867 => 0.3764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: -2.59% (0.4248 => 0.4138, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.59% (0.7919 => 0.7714, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.49% (6.7716 => 6.6033, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2704, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -2.40% (17.1032 => 16.6919, std.dev.: 0.0168) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8383, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.10% (1.2221 => 1.1964, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.04% (4.3330 => 4.2445, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.01% (1.2210 => 1.1965, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.97% (1.0544 => 1.0336, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -1.95% (0.7982 => 0.7826, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.90% (1.2300 => 1.2066, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -1.74% (7.0961 => 6.9724, std.dev.: 0.0050) MultiSource/Applications/hbd/hbd: -1.54% (1.5610 => 1.5369, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -1.33% (2.4021 => 2.3702, std.dev.: 0.0026) MultiSource/Applications/lua/lua: -1.15% (4.0594 => 4.0126, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.11% (8.0126 => 7.9235, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.75% (1.8100 => 0.6743, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3150, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9203, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1295, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1487, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.57% (7.9763 => 7.7716, std.dev.: 0.0186) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.3096 => 1.2796, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6390, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1920, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3475, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6696, std.dev.: 0.0063) MultiSource/Applications/lemon/lemon: -1.06% (1.4516 => 1.4362, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 13:22:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 15:22:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119212215.39BBC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7766?compare_to=7762&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7766, Order: 172909, Start Time: 2013-01-19 19:18:39, End Time: 2013-01-19 21:22:27 To: 7762, Order: 172902, Start Time: 2013-01-19 14:22:47, End Time: 2013-01-19 16:20:51 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 33 (16 on baseline) Performance Improvements: 0 (27 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1031 (1020 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-2: 74.74% (0.0289 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: 41.72% (0.0429 => 0.0608, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 41.35% (0.0711 => 0.1005, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.20% (4.7548 => 5.3824, std.dev.: 0.1818) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 11.95% (0.6910 => 0.7736, std.dev.: 0.0170) MultiSource/Applications/ALAC/encode/alacconvert-encode: 10.14% (1.0727 => 1.1815, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 8.47% (0.6494 => 0.7044, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 7.37% (4.1106 => 4.4136, std.dev.: 0.0894) SingleSource/Benchmarks/Shootout-C++/methcall: 6.58% (0.2020 => 0.2153, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 6.39% (2.5491 => 2.7120, std.dev.: 0.0534) MultiSource/Applications/kimwitu++/kc: 5.12% (18.1382 => 19.0671, std.dev.: 0.3471) MultiSource/Applications/sqlite3/sqlite3: 4.83% (15.8028 => 16.5664, std.dev.: 0.2399) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.69% (0.3241 => 0.3393, std.dev.: 0.0042) MultiSource/Benchmarks/sim/sim: 4.66% (0.3538 => 0.3703, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 55.79% (3.1289 => 4.8746, std.dev.: 0.0777) MultiSource/Applications/minisat/minisat: 28.51% (6.2031 => 7.9716, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.72% (4.5295 => 5.4226, std.dev.: 0.3421) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.10% (0.3275 => 0.3573, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.08% (15.9111 => 17.1968, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout/ary3: 6.27% (2.0980 => 2.2295, std.dev.: 0.0487) SingleSource/Benchmarks/Shootout/hash: 5.75% (4.0400 => 4.2724, std.dev.: 0.0746) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.01% (41.5151 => 43.5944, std.dev.: 0.4610) SingleSource/Benchmarks/McGill/chomp: 4.94% (1.0235 => 1.0741, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.90% (4.7809 => 5.0152, std.dev.: 0.0511) MultiSource/Benchmarks/nbench/nbench: 4.55% (20.6479 => 21.5879, std.dev.: 0.3638) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.70% (2.3532 => 2.4403, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/flops: 2.87% (8.6273 => 8.8753, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.73% (4.1070 => 4.2192, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/bh/bh: 2.72% (2.3890 => 2.4541, std.dev.: 0.0210) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.17% (2.3418 => 2.3927, std.dev.: 0.0060) MultiSource/Applications/JM/lencod/lencod: 1.60% (6.9895 => 7.1012, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.59% (3.5046 => 3.5603, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.19% (1.8339 => 1.8558, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.22% (1.1163 => 1.1299, std.dev.: 0.0348) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0222 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.71% (0.0371 => 0.0433, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 28.63% (0.0262 => 0.0337, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.90% (0.0315 => 0.0321, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0430 => 0.0432, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: 27.44% (0.0164 => 0.0209, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: 3.69% (0.0217 => 0.0225, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.10% (0.0226 => 0.0233, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -1.92% (0.1455 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 7.64% (1.1491 => 1.2369, std.dev.: 0.0237) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.77% (0.3969 => 0.4079, std.dev.: 0.0574) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.22% (0.1492 => 0.1429, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.00% (0.0952 => 0.0933, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.84% (0.0544 => 0.0534, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.24% (1.1452 => 1.1479, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.02% (0.0581 => 0.0546, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.36% (0.0236 => 0.0310, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7398 => 0.7453, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.96% (0.0123 => 0.0080, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.15% (12.7448 => 12.7636, std.dev.: 0.0840) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops-2: 73.54% (0.0291 => 0.0505, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 44.64% (0.0336 => 0.0486, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/heapsort: 40.09% (0.0434 => 0.0608, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 36.18% (0.0738 => 0.1005, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.61% (4.9104 => 5.3824, std.dev.: 0.1818) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.3277 => 0.3393, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321637.50% (0.0008 => 2.5739, std.dev.: 0.0204) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.34% (1.1825 => 2.3927, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/heapsort: 8.96% (4.4739 => 4.8746, std.dev.: 0.0777) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.46% (2.2499 => 2.4403, std.dev.: 0.0239) MultiSource/Benchmarks/nbench/nbench: 5.25% (20.5117 => 21.5879, std.dev.: 0.3638) MultiSource/Applications/JM/lencod/lencod: 4.19% (6.8159 => 7.1012, std.dev.: 0.0167) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.10% (16.6791 => 17.1968, std.dev.: 0.0268) SingleSource/Benchmarks/McGill/chomp: 3.03% (1.0425 => 1.0741, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.01% (42.3194 => 43.5944, std.dev.: 0.4610) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.26% (4.1668 => 4.2192, std.dev.: 0.0057) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.05% (0.0727 => 0.0494, std.dev.: 0.0078) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: -19.05% (1.8964 => 1.5351, std.dev.: 0.1265) MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.36% (0.1009 => 0.0854, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.45% (1.0986 => 0.9399, std.dev.: 0.0495) MultiSource/Applications/aha/aha: -12.41% (0.1378 => 0.1207, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.08% (0.2372 => 0.2133, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: -9.18% (1.1433 => 1.0383, std.dev.: 0.0306) MultiSource/Applications/lambda-0_1_3/lambda: -8.40% (0.8653 => 0.7926, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -8.35% (0.7686 => 0.7044, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.20% (0.1317 => 0.1209, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -7.77% (17.4365 => 16.0815, std.dev.: 0.4511) MultiSource/Applications/d/make_dparser: -6.51% (3.7840 => 3.5377, std.dev.: 0.0777) MultiSource/Applications/sqlite3/sqlite3: -5.68% (17.5634 => 16.5664, std.dev.: 0.2399) MultiSource/Applications/lemon/lemon: -4.39% (1.3979 => 1.3365, std.dev.: 0.0230) SingleSource/Benchmarks/Shootout-C++/hash2: -4.03% (0.5134 => 0.4927, std.dev.: 0.0067) MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.79% (1.2154 => 1.1815, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.32% (0.1164 => 0.1009, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.07% (0.4081 => 0.3670, std.dev.: 0.0117) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.58% (0.3217 => 0.2973, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/hash: -5.60% (4.5259 => 4.2724, std.dev.: 0.0746) MultiSource/Applications/sqlite3/sqlite3: -3.18% (4.4730 => 4.3307, std.dev.: 0.0458) SingleSource/Benchmarks/Shootout-C++/lists: -2.89% (17.2182 => 16.7210, std.dev.: 0.0646) MultiSource/Applications/spiff/spiff: -2.16% (2.8571 => 2.7953, std.dev.: 0.0113) MultiSource/Applications/hexxagon/hexxagon: -1.81% (14.0297 => 13.7753, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/methcall: -1.17% (8.7416 => 8.6397, std.dev.: 0.0170) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.21% (1.2047 => 1.1299, std.dev.: 0.0348) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0227 => 0.0225, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (0.0255 => 0.0233, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -6.73% (0.1530 => 0.1427, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: -35.89% (1.9293 => 1.2369, std.dev.: 0.0237) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4049 => 0.4079, std.dev.: 0.0574) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.36% (0.1510 => 0.1429, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.0978 => 0.0933, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.49% (0.0590 => 0.0534, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.19% (1.1617 => 1.1479, std.dev.: 0.0363) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.49% (0.0610 => 0.0546, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.67% (0.0268 => 0.0310, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7437 => 0.7453, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.04% (0.0092 => 0.0080, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7636, std.dev.: 0.0840) Report Time: 0.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 13:56:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 15:56:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130119215631.75F392A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7767?compare_to=7764&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7767, Order: 172909, Start Time: 2013-01-19 19:45:37, End Time: 2013-01-19 21:56:41 To: 7764, Order: 172902, Start Time: 2013-01-19 16:37:59, End Time: 2013-01-19 18:48:47 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1328 => 0.1327, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0651 => 0.0651, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8572 => 499.8313, std.dev.: 0.0158) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.07% (1.1277 => 499.8313, std.dev.: 0.0158) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.19% (0.5229 => 1.6429, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 20.03% (14.9895 => 17.9913, std.dev.: 0.0091) MultiSource/Applications/kimwitu++/kc: 43.30% (14.1553 => 20.2849, std.dev.: 0.0148) MultiSource/Benchmarks/MallocBench/gs/gs: 17.58% (4.1105 => 4.8331, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.82% (1.1048 => 1.7326, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.50% (7.1582 => 37.4732, std.dev.: 0.0210) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.03% (3.4629 => 6.3728, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.24% (0.6222 => 1.0841, std.dev.: 0.0054) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10287.22% (0.0720 => 7.4788, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11189200.00% (0.0001 => 11.1893, std.dev.: 0.0066) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485600.00% (0.0001 => 5.4857, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 808.26% (1.1194 => 10.1671, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.59% (22.1758 => 54.9059, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 64.25% (0.0730 => 0.1199, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.32% (2.9384 => 4.6228, std.dev.: 0.0077) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.54% (7.0540 => 10.7605, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.83% (1.5859 => 2.3920, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.29% (8.1363 => 11.9028, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.91% (2.2024 => 3.1034, std.dev.: 0.0135) MultiSource/Applications/sgefa/sgefa: 39.43% (0.3109 => 0.4335, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608) MultiSource/Applications/JM/lencod/lencod: 37.70% (21.9371 => 30.2063, std.dev.: 0.0121) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.70% (1.5415 => 2.0455, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.62% (4.2646 => 5.6556, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.37% (0.4615 => 0.6109, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.18% (0.1892 => 0.2463, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.94% (0.2271 => 0.2951, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 29.03% (1.1642 => 1.5022, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.27% (0.6675 => 0.8562, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.46% (0.5105 => 0.6456, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 25.61% (0.2554 => 0.3208, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.54% (3.8922 => 4.8861, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 25.26% (0.1655 => 0.2073, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 25.05% (1.0722 => 1.3408, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 23.88% (0.4289 => 0.5313, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.61% (1.4186 => 1.7536, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.55% (0.3121 => 0.3856, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.41% (0.1337 => 0.1650, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.31% (0.4620 => 0.5697, std.dev.: 0.0109) MultiSource/Benchmarks/mafft/pairlocalalign: 22.90% (9.4845 => 11.6568, std.dev.: 0.0539) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.01% (0.1695 => 0.2068, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.64% (0.7115 => 0.8655, std.dev.: 0.0074) MultiSource/Applications/viterbi/viterbi: 21.41% (0.1555 => 0.1888, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.30% (0.2700 => 0.3275, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 20.78% (0.7835 => 0.9463, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.69% (5.7591 => 6.9504, std.dev.: 0.0103) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.52% (1.3050 => 1.5728, std.dev.: 0.0090) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 20.15% (0.6456 => 0.7757) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.83% (0.5860 => 0.7022, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 19.81% (0.1151 => 0.1379, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.59% (0.1695 => 0.2027, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.33% (4.9449 => 5.9008, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.02% (0.1940 => 0.2309, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.02% (0.8172 => 0.9726, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.57% (5.0018 => 5.9305, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 18.43% (3.3354 => 3.9500, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.87% (0.3307 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.85% (0.5020 => 0.5916, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.76% (0.7433 => 0.8753, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.57% (0.9765 => 1.1481, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.45% (0.5569 => 0.6541, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 17.06% (1.1840 => 1.3860, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 17.05% (3.8723 => 4.5325, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.90% (0.5981 => 0.6992, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.85% (2.0273 => 2.3688, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/18-imp/imp: 16.83% (0.3423 => 0.3999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.3283 => 0.3824, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.22% (0.8101 => 0.9415, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.05% (2.2969 => 2.6655, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.64% (0.6450 => 0.7459, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942) MultiSource/Benchmarks/McCat/09-vor/vor: 14.97% (0.3180 => 0.3656, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/football/football: 14.81% (0.8921 => 1.0242, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.57% (1.1861 => 1.3589, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.23% (0.3379 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.09% (0.8067 => 0.9204, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.40% (0.3865 => 0.4383, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.22% (0.4636 => 0.5249, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 12.99% (0.3387 => 0.3827, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.88% (1.5603 => 1.7612, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.60% (0.4103 => 0.4620, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.18% (0.4203 => 0.4715, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 12.12% (0.3927 => 0.4403, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.77% (0.3603 => 0.4027, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.69% (0.3422 => 0.3822, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.48% (17.1811 => 19.1539, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/lists1: 11.32% (0.3684 => 0.4101, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.02% (0.3828 => 0.4250, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3826 => 0.4245, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 10.94% (0.3282 => 0.3641, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.87% (0.3092 => 0.3428, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.67% (0.3561 => 0.3941, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.58% (0.3543 => 0.3918, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.41% (0.4064 => 0.4487, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (14.3668 => 15.8404, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/strcat: 10.00% (0.2831 => 0.3114, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.44% (2.0665 => 2.2616, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/except: 9.33% (0.2871 => 0.3139, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.32% (0.2877 => 0.3145, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2905 => 0.3165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.85% (1.2842 => 1.3979, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.76% (0.3162 => 0.3439, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.62% (0.6030 => 0.6550, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.49% (0.5925 => 0.6428, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.46% (0.2802 => 0.3039, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.45% (0.2793 => 0.3029, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 8.38% (0.7326 => 0.7940, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.33% (0.2725 => 0.2952, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.29% (0.2714 => 0.2939, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.16% (0.3935 => 0.4256, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 7.97% (63.2438 => 68.2812, std.dev.: 0.0205) MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (10.3673 => 11.1400, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.76% (2.2022 => 2.3511, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.3131 => 0.3252, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.25% (0.3817 => 0.3941, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.97% (7.9617 => 8.1185, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4733, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.30% (4.2280 => 4.4521, std.dev.: 0.0103) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3124, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1048, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.34% (0.9957 => 1.0290, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.6802 => 8.9206, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.98% (0.8333 => 0.8498, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.95% (27.8444 => 28.3870, std.dev.: 0.0105) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2813, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.75% (3.6395 => 3.7033, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4544, std.dev.: 0.0289) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.88% (5.2763 => 1.1673, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.40% (0.8651 => 0.2128, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.54% (5.3855 => 4.4409, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.06% (5.3526 => 4.4395, std.dev.: 0.0035) MultiSource/Applications/JM/ldecod/ldecod: -13.75% (10.4361 => 9.0015, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6196, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9486, std.dev.: 0.1633) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.35% (1.9577 => 0.6784, std.dev.: 0.0023) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.56% (1.5373 => 1.0214, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4256, std.dev.: 0.0129) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7547, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0903, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4241, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7357, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4926, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2589, std.dev.: 0.0258) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.34% (1.2373 => 1.1588, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7022, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -4.43% (10.2830 => 9.8276, std.dev.: 0.0103) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6705, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: -1.32% (3.6994 => 3.6505, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2232, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0029) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 14:35:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 16:35:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130119223534.D8BD52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7768?compare_to=7763&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7768, Order: 172902, Start Time: 2013-01-19 19:01:31, End Time: 2013-01-19 22:35:44 To: 7763, Order: 172901, Start Time: 2013-01-19 14:36:06, End Time: 2013-01-19 18:10:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (181 on baseline) Performance Improvements: 1 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.67% (0.0696 => 0.0819, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.99% (125.1101 => 128.8494, std.dev.: 1.0325) MultiSource/Benchmarks/Olden/perimeter/perimeter: 1.67% (0.6109 => 0.6211, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.32% (54.1324 => 54.8455, std.dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.64% (2.4529 => 2.4126, std.dev.: 0.0098) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.28% (0.0625 => 0.0908, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.84% (0.1106 => 0.1425, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.26% (0.2969 => 0.3808, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.63% (0.5900 => 0.7471, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.55% (0.4139 => 0.5238, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.51% (0.0547 => 0.0692, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.20% (0.1107 => 0.1397, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.65% (0.4994 => 0.6275, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.46% (0.4253 => 0.5336, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.21% (0.0714 => 0.0894, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.76% (0.5000 => 0.6238, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 24.72% (1.5932 => 1.9871, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.36% (0.0642 => 0.0792, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.31% (0.1549 => 0.1910, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.43% (0.0633 => 0.0775, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 22.35% (0.0604 => 0.0739, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.03% (0.1103 => 0.1346, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.02% (0.0822 => 0.1003, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.93% (0.3903 => 0.4759, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 21.56% (0.1619 => 0.1968, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.05% (0.3890 => 0.4709, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.72% (0.2736 => 0.3303, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.31% (0.1462 => 0.1759, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 20.11% (0.1218 => 0.1463, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.09% (0.1090 => 0.1309, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.05% (0.4029 => 0.4837, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.03% (0.2866 => 0.3440, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.77% (0.0698 => 0.0836, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.76% (0.2014 => 0.2412, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.46% (1.3152 => 1.5711, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.41% (0.3271 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 19.33% (0.5546 => 0.6618, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 18.86% (1.8794 => 2.2339, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.50% (0.5026 => 0.5956, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.44% (0.4658 => 0.5517, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/strcat: 18.04% (0.2750 => 0.3246, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.99% (1.6211 => 1.9127, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.98% (0.2875 => 0.3392, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.98% (3.5627 => 4.2033, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.94% (0.1968 => 0.2321, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 17.91% (0.2780 => 0.3278, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 17.91% (0.1284 => 0.1514, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 17.91% (0.9697 => 1.1434, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 17.80% (0.5826 => 0.6863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 17.79% (0.2811 => 0.3311, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.73% (0.2792 => 0.3287, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.45% (0.2813 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.39% (0.2725 => 0.3199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.39% (0.2714 => 0.3186, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 17.36% (0.2823 => 0.3313, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.31% (0.1421 => 0.1667, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.30% (2.0673 => 2.4249, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 17.27% (0.2803 => 0.3287, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.24% (0.2911 => 0.3413, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.24% (0.2738 => 0.3210, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.19% (1.0781 => 1.2634, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.17% (0.4361 => 0.5110, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.15% (0.2729 => 0.3197, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 17.14% (0.3004 => 0.3519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 17.03% (0.3258 => 0.3813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.99% (0.3060 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.99% (0.3267 => 0.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.96% (0.3195 => 0.3737, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.95% (0.3930 => 0.4596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.93% (0.3096 => 0.3620, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 16.91% (0.9909 => 1.1585, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.76% (1.9694 => 2.2995, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 16.56% (23.5202 => 27.4148, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 16.50% (4.2109 => 4.9059, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.45% (0.3124 => 0.3638, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 16.40% (0.3317 => 0.3861, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.33% (1.9966 => 2.3226, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 16.29% (0.3726 => 0.4333) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.27% (2.7292 => 3.1732, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.24% (0.3362 => 0.3908, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists: 15.98% (0.3348 => 0.3883, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.97% (4.4195 => 5.1252, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.97% (0.3282 => 0.3806, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.89% (0.3625 => 0.4201, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 15.86% (0.7171 => 0.8308, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 15.85% (0.3477 => 0.4028, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 15.66% (0.3678 => 0.4254, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.65% (0.4146 => 0.4795, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.55% (0.3981 => 0.4600, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.50% (1.4269 => 1.6481, std.dev.: 0.0044) MultiSource/Benchmarks/nbench/nbench: 15.47% (0.2566 => 0.2963, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 15.38% (0.4251 => 0.4905, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.28% (0.3690 => 0.4254, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 15.12% (0.7875 => 0.9066, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.67% (0.3845 => 0.4409, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 14.60% (0.5012 => 0.5744, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.91% (0.1028 => 0.1171, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.86% (0.6435 => 0.7327, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.83% (0.2068 => 0.2354, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 13.71% (2.1653 => 2.4622, std.dev.: 0.0154) SingleSource/UnitTests/ObjC/exceptions-4: 13.68% (0.3465 => 0.3939, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.65% (0.3488 => 0.3964, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 13.64% (5.5417 => 6.2977, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/football/football: 13.64% (0.2075 => 0.2358, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 13.60% (0.3442 => 0.3910, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 13.58% (0.3469 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 13.56% (0.3496 => 0.3970, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.55% (0.3460 => 0.3929, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.52% (4.6177 => 5.2422, std.dev.: 0.0086) MultiSource/Applications/SIBsim4/SIBsim4: 13.49% (0.2691 => 0.3054, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.2737 => 0.3101, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.18% (0.3724 => 0.4215, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.18% (0.3643 => 0.4123, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.02% (2.1013 => 2.3749, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 12.55% (0.3498 => 0.3937, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.25% (0.2040 => 0.2290, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.96% (0.3084 => 0.3453, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.70% (0.5361 => 0.5988, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.55% (0.6634 => 0.7400, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 11.53% (0.4847 => 0.5406, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.01% (11.6398 => 12.9209, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.76% (0.7426 => 0.8225, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.27% (0.1383 => 0.1525, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.08% (4.6926 => 5.1658, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 9.93% (2.0346 => 2.2367, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.35% (0.5584 => 0.6106, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 7.81% (11.9555 => 12.8889, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5146, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.84% (0.0695 => 0.0819, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.18% (0.3693 => 0.4069, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6750, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2400, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops-2: 4.81% (1.8057 => 1.8926, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6808, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2120, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2852, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.28% (4.0317 => 4.0835, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2084, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.08% (50.0626 => 50.6035, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4781, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 1.03% (1.5594 => 1.5755, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.58% (2.4764 => 2.4126, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.71% (25.4195 => 16.5956, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.46% (17.2379 => 14.2278, std.dev.: 0.0343) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1017, std.dev.: 0.0042) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9774, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8041, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ary2: -7.45% (0.2402 => 0.2223, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (41.7953 => 40.2440, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1161, std.dev.: 0.0751) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5743, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/bh/bh: -1.37% (5.5810 => 5.5045, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1999, std.dev.: 0.0409) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0034) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 15:00:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 17:00:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130119230047.214742A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7769?compare_to=7765&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7769, Order: 172918, Start Time: 2013-01-19 21:27:04, End Time: 2013-01-19 23:00:57 To: 7765, Order: 172909, Start Time: 2013-01-19 19:29:51, End Time: 2013-01-19 21:03:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (99 on baseline) Performance Improvements: 0 (130 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (863 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.62% (0.0717 => 0.1209, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.81% (0.0974 => 0.1615, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.26% (0.0514 => 0.0834, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.63% (0.1132 => 0.1558, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.40% (0.0599 => 0.0823, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.43% (0.6395 => 0.8725, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.54% (0.6395 => 0.8604, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.72% (0.6260 => 0.8308, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.76% (0.0699 => 0.0921, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.51% (0.5849 => 0.7692, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.50% (0.5688 => 0.7480, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.49% (0.5805 => 0.7633, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.18% (0.5456 => 0.7157, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.93% (0.6230 => 0.8157, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.71% (0.5575 => 0.7287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.47% (0.5567 => 0.7263, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.46% (0.5581 => 0.7281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.09% (0.5802 => 0.7548, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.76% (0.5705 => 0.7403, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.37% (0.6033 => 0.7805, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.24% (0.5859 => 0.7572, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.05% (0.5925 => 0.7646, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.98% (0.5570 => 0.7184, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.95% (0.5478 => 0.7064, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.89% (0.5857 => 0.7549, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.66% (0.5569 => 0.7165, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.31% (0.5591 => 0.7174, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.97% (0.6189 => 0.7920, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.58% (0.6052 => 0.7721, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.53% (0.5863 => 0.7477, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.52% (1.6474 => 2.1008, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.41% (0.6446 => 0.8213, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.92% (0.6304 => 0.8001, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.86% (0.6194 => 0.7796, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.59% (0.6681 => 0.8391, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.41% (0.6660 => 0.8352, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.30% (0.6297 => 0.7890, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 23.92% (0.6667 => 0.8262, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.74% (0.7524 => 0.9235, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.87% (0.7339 => 0.8944, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.64% (2.2587 => 2.7250, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.97% (1.1450 => 1.3164, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 14.60% (0.3357 => 0.3847, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.61% (0.1982 => 0.2232, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.24% (0.0833 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.51% (0.4916 => 0.5482, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.30% (4.5069 => 5.0163, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/05-eks/eks: 11.16% (0.4515 => 0.5019, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.93% (1.6364 => 1.8153, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.86% (3.5339 => 3.9177, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.25% (0.7021 => 0.7600, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.40% (1.2515 => 1.3441, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4524 => 0.4838, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.53% (0.1731 => 0.1844, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 6.51% (9.2283 => 9.8291, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (1.2784 => 1.3613, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.4642 => 1.5584, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 6.19% (0.4861 => 0.5162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.25% (0.3319 => 0.3460, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.14% (5.0226 => 5.1802, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.65% (5.4682 => 5.6131, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 2.37% (1.3864 => 1.4192, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.77% (0.8418 => 0.8567, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.17% (1.3722 => 1.3883, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.10% (0.9557 => 0.9662, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8070, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.45% (0.2380 => 0.2486, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4951, std.dev.: 0.1597) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.93% (2.0478 => 2.1077, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8210 => 28.2647, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2770, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6551 => 3.6925, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.95% (0.3194 => 0.3004, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -5.51% (0.3848 => 0.3636, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.49% (0.3896 => 0.3682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.48% (0.3812 => 0.3603, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.39% (0.3880 => 0.3671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -5.38% (0.4033 => 0.3816, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.35% (0.3891 => 0.3683, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.30% (0.3831 => 0.3628, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions: -5.12% (0.4176 => 0.3962, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.02% (0.3884 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.98% (0.3837 => 0.3646, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.96% (0.7198 => 0.6841, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.96% (2.4924 => 2.3688, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -4.74% (0.4199 => 0.4000, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.45% (0.3821 => 0.3651, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.39% (0.3323 => 0.3177, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: -4.32% (0.2871 => 0.2747, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.32% (0.3057 => 0.2925, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.28% (0.9852 => 0.9430, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.23% (0.4280 => 0.4099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.13% (0.2903 => 0.2783, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.06% (0.2933 => 0.2814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.00% (0.2849 => 0.2735, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.88% (0.3142 => 0.3020, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.86% (0.3059 => 0.2941, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -3.80% (0.3026 => 0.2911, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.68% (2.1713 => 2.0914, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.63% (0.3252 => 0.3134, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.57% (0.3025 => 0.2917, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -3.52% (1.3148 => 1.2685, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.19% (0.6484 => 0.6277, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.09% (0.3658 => 0.3545, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.07% (0.9542 => 0.9249, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -3.03% (0.7779 => 0.7543, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -2.93% (0.3621 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.82% (0.3931 => 0.3820, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.67% (14.2083 => 13.8283, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.65% (0.3849 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2304, std.dev.: 0.0673) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.52% (0.4321 => 0.4212, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: -2.47% (0.4248 => 0.4143, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.47% (6.7716 => 6.6045, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -2.44% (17.1032 => 16.6853, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.29% (0.7919 => 0.7738, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.12% (1.2221 => 1.1962, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: -2.11% (4.3330 => 4.2415, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -2.10% (16.1920 => 15.8512, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.04% (1.2210 => 1.1961, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.92% (1.0544 => 1.0342, std.dev.: 0.0026) MultiSource/Applications/JM/ldecod/ldecod: -1.85% (7.0961 => 6.9649, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.82% (1.2300 => 1.2076, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: -1.73% (0.7982 => 0.7844, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -1.61% (0.9179 => 0.9031, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -1.54% (1.5610 => 1.5369, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.37% (0.8521 => 0.8404, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -1.23% (2.4021 => 2.3726, std.dev.: 0.0017) MultiSource/Applications/lua/lua: -1.12% (4.0594 => 4.0139, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.08% (8.0126 => 7.9263, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6923, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.51% (4.3504 => 3.2408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.56% (1.3643 => 1.0292, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9172, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3839, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.46% (0.0757 => 0.0587, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2089, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1333, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.36% (4.7378 => 4.1047, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7253, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3393, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6345, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.64% (7.9763 => 7.7659, std.dev.: 0.0124) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.09% (3.7241 => 3.6464, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7077, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4684, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.47% (1.6307 => 1.6068, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1978, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6003, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -1.08% (1.4516 => 1.4359, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6703, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.01% (1.6086 => 1.5924, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 15:42:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 17:42:14 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130119234214.4D20E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7770?compare_to=7766&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7770, Order: 172918, Start Time: 2013-01-19 21:39:43, End Time: 2013-01-19 23:42:26 To: 7766, Order: 172909, Start Time: 2013-01-19 19:18:39, End Time: 2013-01-19 21:22:27 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (10 on baseline) Performance Improvements: 12 (34 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (1019 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/d/make_dparser: 8.68% (3.5377 => 3.8446, std.dev.: 0.0865) MultiSource/Applications/minisat/minisat: 5.28% (0.7496 => 0.7892, std.dev.: 0.0132) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.38% (46.7284 => 49.2440, std.dev.: 0.9753) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.89% (61.1475 => 63.5250, std.dev.: 0.4667) SingleSource/Benchmarks/Misc/pi: 3.83% (2.1280 => 2.2094, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.61% (0.5907 => 0.6120, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 2.41% (28.7526 => 29.4450, std.dev.: 0.0648) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/viterbi/viterbi: -16.62% (0.2064 => 0.1721, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -13.43% (0.1132 => 0.0980, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -12.57% (0.0843 => 0.0737, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: -11.16% (0.4237 => 0.3764, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -10.87% (5.3824 => 4.7972, std.dev.: 0.0387) MultiSource/Benchmarks/nbench/nbench: -6.72% (1.3316 => 1.2421, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/bigfib: -6.43% (0.6906 => 0.6462, std.dev.: 0.0141) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -5.43% (1.0741 => 1.0158, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.84% (2.8278 => 2.7474, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/ffbench: -1.25% (1.4158 => 1.3981, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.22% (7.1012 => 7.0143, std.dev.: 0.0244) SingleSource/Benchmarks/Misc-C++/mandel-text: -1.11% (1.8558 => 1.8352, std.dev.: 0.0027) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.73% (1.1299 => 1.1217, std.dev.: 0.0463) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0223 => 0.0221, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0337 => 0.0335, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0321 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0432 => 0.0429, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0209 => 0.0208, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -1.78% (0.0225 => 0.0221, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.58% (0.0233 => 0.0227, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 4.63% (0.1427 => 0.1493, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: -5.80% (1.2369 => 1.1652, std.dev.: 0.1759) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.59% (0.4079 => 0.4014, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.62% (0.1429 => 0.1495, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.61% (0.0933 => 0.1004, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.27% (0.0275 => 0.0255, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.62% (0.0534 => 0.0564, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1479 => 1.1476, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.99% (0.0546 => 0.0606, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.29% (0.0310 => 0.0306, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.71% (0.7453 => 0.7400, std.dev.: 0.0082) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 3.75% (0.0080 => 0.0083, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7636 => 12.7627, std.dev.: 0.4915) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.73% (0.0336 => 0.0493, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322687.50% (0.0008 => 2.5823, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.20% (1.1825 => 2.4383, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.84% (0.2562 => 0.2891, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.82% (46.0987 => 49.2440, std.dev.: 0.9753) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.07% (61.0379 => 63.5250, std.dev.: 0.4667) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.78% (0.5897 => 0.6120, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/pi: 3.29% (2.1390 => 2.2094, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.91% (6.8159 => 7.0143, std.dev.: 0.0244) MultiSource/Applications/lua/lua: 1.42% (29.0327 => 29.4450, std.dev.: 0.0648) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.48% (0.0808 => 0.0489, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.60% (0.0676 => 0.0530, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.83% (0.1009 => 0.0819, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.43% (1.0986 => 0.9401, std.dev.: 0.0222) MultiSource/Applications/hbd/hbd: -14.18% (1.8964 => 1.6275, std.dev.: 0.0520) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.60% (6.4235 => 5.6781, std.dev.: 0.2853) MultiSource/Applications/aha/aha: -10.60% (0.1378 => 0.1232, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -5.22% (0.4002 => 0.3793, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: -5.18% (0.5134 => 0.4868, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -5.12% (0.2385 => 0.2263, std.dev.: 0.0039) MultiSource/Applications/ClamAV/clamscan: -4.83% (17.4365 => 16.5937, std.dev.: 0.2763) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.69% (0.2709 => 0.2582, std.dev.: 0.0049) MultiSource/Applications/lua/lua: -4.61% (4.6406 => 4.4267, std.dev.: 0.0737) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.31% (4.9104 => 4.7972, std.dev.: 0.0387) MultiSource/Benchmarks/nbench/nbench: -2.26% (1.2708 => 1.2421, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.63% (0.9372 => 0.6501, std.dev.: 0.1011) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.95% (1.4588 => 1.2991, std.dev.: 0.0434) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.46% (0.4081 => 0.3654, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: -9.04% (0.6628 => 0.6029, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.34% (0.3217 => 0.2981, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.55% (17.2182 => 16.6066, std.dev.: 0.0978) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.20% (40.4729 => 39.1778, std.dev.: 0.4488) MultiSource/Applications/sqlite3/sqlite3: -3.09% (4.4730 => 4.3349, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/ffbench: -1.85% (1.4244 => 1.3981, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -1.61% (14.0297 => 13.8038, std.dev.: 0.0242) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3146, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/matrix: -1.17% (2.9083 => 2.8743, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -1.14% (1.5825 => 1.5645, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/fibo: -1.09% (4.3512 => 4.3036, std.dev.: 0.0076) MultiSource/Applications/aha/aha: -1.02% (3.5321 => 3.4960, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel: -1.02% (1.0604 => 1.0496, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.89% (1.2047 => 1.1217, std.dev.: 0.0463) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.98% (0.0255 => 0.0227, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.42% (0.1530 => 0.1493, std.dev.: 0.0220) MultiSource/Applications/lemon/lemon: -39.61% (1.9293 => 1.1652, std.dev.: 0.1759) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.86% (0.4049 => 0.4014, std.dev.: 0.0221) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1510 => 0.1495, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.0978 => 0.1004, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.61% (0.0276 => 0.0255, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.41% (0.0590 => 0.0564, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1476, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.18% (0.0268 => 0.0306, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7437 => 0.7400, std.dev.: 0.0082) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.78% (0.0092 => 0.0083, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7627, std.dev.: 0.4915) Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 16:37:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 18:37:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120003751.8971A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7771?compare_to=7767&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7771, Order: 172922, Start Time: 2013-01-19 22:26:53, End Time: 2013-01-20 00:38:01 To: 7767, Order: 172909, Start Time: 2013-01-19 19:45:37, End Time: 2013-01-19 21:56:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/Burg/burg: 1.29% (1.5022 => 1.5216, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.26% (3.7763 => 3.8616, std.dev.: 0.0317) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1327 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8313 => 499.8509, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 44224.81% (1.1277 => 499.8509, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.30% (0.5229 => 1.6435, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 20.19% (14.9895 => 18.0155, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 43.77% (14.1553 => 20.3517, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: 17.84% (4.1105 => 4.8439, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.92% (1.1048 => 1.7337, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.43% (7.1582 => 37.5398, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.00% (3.4629 => 6.3719, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.53% (0.6222 => 1.0859, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10288.61% (0.0720 => 7.4798, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11165900.00% (0.0001 => 11.1660, std.dev.: 0.0217) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485600.00% (0.0001 => 5.4857, std.dev.: 0.0318) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 809.16% (1.1194 => 10.1771, std.dev.: 0.0111) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 147.96% (22.1758 => 54.9870, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.88% (0.0929 => 0.1829, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.37% (2.9384 => 4.6241, std.dev.: 0.0170) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.69% (7.0540 => 10.7705, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.26% (1.5859 => 2.3989, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.58% (0.1056 => 0.1569, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.58% (8.1363 => 11.9259, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.00% (2.2024 => 3.1054, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609) MultiSource/Applications/JM/lencod/lencod: 37.82% (21.9371 => 30.2343, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0010) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.97% (4.2646 => 5.6707, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.72% (1.5415 => 2.0459, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.72% (0.4615 => 0.6125, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.73% (0.0479 => 0.0631, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.70% (1.1642 => 1.5216, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.44% (0.1892 => 0.2468, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.21% (0.2271 => 0.2957, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 29.66% (0.4299 => 0.5574, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.51% (0.6675 => 0.8578, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.91% (0.1125 => 0.1439, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.84% (0.5105 => 0.6475, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.60% (0.1143 => 0.1447, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.78% (3.8922 => 4.8955, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 25.46% (1.0722 => 1.3452, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 24.39% (0.4289 => 0.5335, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.13% (0.3121 => 0.3874, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 23.91% (0.1175 => 0.1456, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.83% (1.4186 => 1.7566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.68% (0.4620 => 0.5714, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 22.99% (9.4845 => 11.6650, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.12% (0.1695 => 0.2070, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.98% (0.3098 => 0.3779, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.74% (0.1555 => 0.1893, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818) MultiSource/Applications/minisat/minisat: 21.69% (0.7115 => 0.8658, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.56% (0.2700 => 0.3282, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.44% (0.7835 => 0.9515, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.77% (1.3050 => 1.5760, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: 20.72% (5.7591 => 6.9523, std.dev.: 0.0136) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.51% (0.6456 => 0.7780) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.21% (0.1029 => 0.1237, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.5860 => 0.7021, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.63% (0.8172 => 0.9776, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.57% (4.9449 => 5.9124, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.43% (0.1940 => 0.2317, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.79% (5.0018 => 5.9414, std.dev.: 0.0073) MultiSource/Applications/d/make_dparser: 18.59% (3.3354 => 3.9553, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 18.40% (0.7433 => 0.8801, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.27% (0.5020 => 0.5937, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.24% (0.2758 => 0.3261, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.11% (0.3307 => 0.3906, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.89% (0.9765 => 1.1512, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.5569 => 0.6554, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.24% (2.0273 => 2.3769, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 17.18% (3.8723 => 4.5374, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.14% (0.5981 => 0.7006, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 17.09% (1.1840 => 1.3864, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 16.94% (0.3283 => 0.3839, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.62% (0.3232 => 0.3769, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.48% (2.2969 => 2.6754, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.38% (0.8101 => 0.9428, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.88% (0.6450 => 0.7474, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 15.86% (0.2049 => 0.2374, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 15.22% (0.3180 => 0.3664, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.10% (1.1861 => 1.3652, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: 14.95% (0.8921 => 1.0255, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.35% (0.8067 => 0.9225, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.95% (0.3865 => 0.4404, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.95% (0.2603 => 0.2966, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.33% (0.4636 => 0.5254, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.09% (0.4103 => 0.4640, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 13.04% (1.5603 => 1.7637, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.59% (0.4203 => 0.4732, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.38% (0.4048 => 0.4549, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.27% (0.3603 => 0.4045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.16% (0.3422 => 0.3838, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.68% (0.3886 => 0.4340, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 11.64% (0.3684 => 0.4113, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.51% (17.1811 => 19.1584, std.dev.: 0.0096) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.49% (0.4064 => 0.4531, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.44% (0.2430 => 0.2708, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3826 => 0.4263, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.1268 => 0.1412, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.09% (0.3092 => 0.3435, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.59% (0.3561 => 0.3938, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.56% (0.2831 => 0.3130, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.56% (0.3694 => 0.4084, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.36% (14.3668 => 15.8549, std.dev.: 0.0135) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 10.15% (0.2905 => 0.3200, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2871 => 0.3160, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.05% (2.0665 => 2.2741, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.77% (0.2877 => 0.3158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.54% (0.6030 => 0.6605, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.48% (0.2891 => 0.3165, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.44% (0.2872 => 0.3143, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.42% (0.3650 => 0.3994, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.31% (1.2842 => 1.4038, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.25% (0.2756 => 0.3011, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.21% (0.3052 => 0.3333, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.17% (0.2802 => 0.3059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.16% (0.7326 => 0.7997, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.95% (0.2725 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.81% (0.2714 => 0.2953, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.79% (0.3935 => 0.4281, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.08% (63.2438 => 68.3546, std.dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: 7.52% (10.3673 => 11.1465, std.dev.: 0.0152) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.84% (2.2022 => 2.3529, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.4879 => 0.5185, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.09% (7.9617 => 8.1282, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4704, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.50% (4.2280 => 4.4604, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.92% (0.9957 => 1.0248, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.90% (8.6802 => 8.9323, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.33% (3.6395 => 3.7244, std.dev.: 0.0094) MultiSource/Benchmarks/llubenchmark/llu: 2.21% (3.7781 => 3.8616, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 2.05% (0.8333 => 0.8504, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (27.8444 => 28.3832, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2868, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5841, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.80% (5.2763 => 1.1711, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.08% (0.8651 => 0.2156, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.47% (5.3855 => 4.4447, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.04% (5.3526 => 4.4407, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -13.64% (10.4361 => 9.0127, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.91% (1.7609 => 1.6217, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9839, std.dev.: 0.0310) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.76% (1.9577 => 0.6507, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.54% (0.0506 => 0.0311, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.10% (0.3987 => 0.2468, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.75% (1.5373 => 1.0185, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.55% (1.1492 => 0.7636, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -30.68% (10.7105 => 7.4245, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7512, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.32% (2.6546 => 2.0091, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4936, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.41% (19.9488 => 18.2717, std.dev.: 0.0402) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.34% (1.2373 => 1.1589, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7049, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.28% (10.2830 => 9.8434, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0048) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.93% (3.6994 => 3.6281, std.dev.: 0.0194) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.69% (3.7221 => 3.6592, std.dev.: 0.0222) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3302, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2285, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.57% (0.1485 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0013) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 16:58:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 18:58:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120005822.754812A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7772?compare_to=7769&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7772, Order: 172925, Start Time: 2013-01-19 23:24:33, End Time: 2013-01-20 00:58:33 To: 7769, Order: 172918, Start Time: 2013-01-19 21:27:04, End Time: 2013-01-19 23:00:57 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 0 (120 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (872 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.26% (0.0514 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.87% (0.1500 => 0.2173, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.72% (0.1132 => 0.1559, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.37% (0.6395 => 0.8721, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.61% (0.6395 => 0.8608, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.54% (0.6260 => 0.8297, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.70% (0.5688 => 0.7491, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.65% (0.5805 => 0.7642, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.33% (0.0699 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.29% (0.5456 => 0.7163, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.93% (0.6230 => 0.8157, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.79% (0.5849 => 0.7650, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.57% (0.5575 => 0.7279, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.48% (0.5567 => 0.7264, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.35% (0.5941 => 0.7744, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.32% (0.5581 => 0.7273, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.25% (0.5802 => 0.7557, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.69% (0.6033 => 0.7824, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.41% (0.5705 => 0.7383, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.17% (0.5859 => 0.7568, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.08% (0.6440 => 0.8313, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.92% (0.5478 => 0.7062, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.90% (0.5570 => 0.7180, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.79% (0.5857 => 0.7543, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.76% (0.5925 => 0.7629, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.64% (0.5569 => 0.7164, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.31% (0.5591 => 0.7174, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.89% (0.6676 => 0.8538, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.66% (0.6052 => 0.7726, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.65% (0.6189 => 0.7900, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.44% (0.5863 => 0.7472, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.44% (1.6474 => 2.0995, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.27% (0.6446 => 0.8204, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.74% (0.6304 => 0.7990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 25.94% (0.6681 => 0.8414, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.77% (0.6194 => 0.7790, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.38% (0.6660 => 0.8350, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.33% (0.6297 => 0.7892, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.00% (0.6667 => 0.8267, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.77% (0.7524 => 0.9237, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.84% (0.7339 => 0.8942, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.55% (2.2587 => 2.7229, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.83% (1.1450 => 1.3148, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.78% (0.1081 => 0.1230, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.06% (0.1982 => 0.2221, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.41% (0.4916 => 0.5477, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.40% (4.5069 => 5.0205, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 11.34% (0.4515 => 0.5027, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.91% (1.6364 => 1.8149, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.73% (3.5339 => 3.9132, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.32% (0.7021 => 0.7605, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.80% (0.1731 => 0.1866, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4524 => 0.4872, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.50% (0.2001 => 0.2151, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.41% (1.2515 => 1.3442, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.02% (0.5329 => 0.5703, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4861 => 0.5178, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.48% (1.2784 => 1.3613, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.47% (1.4642 => 1.5590, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 6.44% (9.2283 => 9.8224, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.13% (5.4682 => 5.6394, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 3.04% (0.6750 => 0.6955, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.81% (5.0226 => 5.1635, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 2.52% (1.3864 => 1.4213, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 2.00% (0.8418 => 0.8586, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.37% (0.7447 => 0.7549, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.27% (1.3722 => 1.3896, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.27% (0.9557 => 0.9678, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8202, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.19% (0.9531 => 1.0312, std.dev.: 0.0115) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1494, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5450, std.dev.: 0.0457) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.75% (2.0478 => 2.1041, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8210 => 28.2644, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2769, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5973, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.73% (0.3194 => 0.3011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.20% (0.3848 => 0.3648, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -5.19% (0.3831 => 0.3632, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions-4: -5.18% (0.3880 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.13% (0.3896 => 0.3696, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -5.08% (0.4033 => 0.3828, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.01% (0.3891 => 0.3696, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -4.89% (0.4176 => 0.3972, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.74% (2.4924 => 2.3743, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.63% (0.3884 => 0.3704, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.53% (0.3837 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.43% (0.4199 => 0.4013, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -4.35% (0.6347 => 0.6071, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.28% (0.9852 => 0.9430, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -4.04% (0.4280 => 0.4107, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.91% (0.3323 => 0.3193, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -3.65% (0.3205 => 0.3088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.61% (0.3016 => 0.2907, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -3.50% (0.2939 => 0.2836, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.44% (0.3026 => 0.2922, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.42% (0.7779 => 0.7513, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -3.40% (0.3025 => 0.2922, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.40% (2.1713 => 2.0975, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.32% (0.3252 => 0.3144, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.27% (0.9542 => 0.9230, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.12% (0.6484 => 0.6282, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -3.09% (1.3148 => 1.2742, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.03% (0.3658 => 0.3547, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.69% (14.2083 => 13.8255, std.dev.: 0.0123) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2360, std.dev.: 0.0295) MultiSource/Applications/sqlite3/sqlite3: -2.52% (17.1032 => 16.6716, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.43% (6.7716 => 6.6070, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.34% (0.7919 => 0.7734, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.19% (1.2221 => 1.1953, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -2.11% (4.3330 => 4.2417, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.05% (1.2210 => 1.1960, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -2.05% (16.1920 => 15.8607, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.89% (1.0544 => 1.0345, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.80% (1.2300 => 1.2078, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -1.72% (7.0961 => 6.9741, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: -1.62% (0.9179 => 0.9030, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (0.8521 => 0.8392, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.37% (1.5610 => 1.5396, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -1.32% (2.4021 => 2.3705, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9312, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6924, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3145, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2413, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.70% (1.3643 => 1.0273, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9151, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3837, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2081, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1303, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1045, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3390, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1490, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1721, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.48% (7.9763 => 7.7781, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1180, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6388, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1979, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.22% (1.6086 => 1.5890, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.20% (4.4002 => 4.3476, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6219 => 1.6027, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (3.7092 => 3.6670, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.12% (1.6307 => 1.6125, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 18:32:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 20:32:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120023235.E8B372A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7773?compare_to=7770&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7773, Order: 172928, Start Time: 2013-01-20 00:02:38, End Time: 2013-01-20 02:32:48 To: 7770, Order: 172918, Start Time: 2013-01-19 21:39:43, End Time: 2013-01-19 23:42:26 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 21 (13 on baseline) Performance Improvements: 0 (19 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1043 (1031 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 27.15% (0.1153 => 0.1466, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: 17.07% (8.2930 => 9.7088, std.dev.: 0.5476) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.30% (0.8968 => 0.9802, std.dev.: 0.0319) MultiSource/Applications/kimwitu++/kc: 6.63% (18.2011 => 19.4087, std.dev.: 0.3803) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.13% (0.8909 => 0.9455, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.80% (7.0472 => 7.3858, std.dev.: 0.1140) SingleSource/Benchmarks/Shootout-C++/moments: 3.95% (0.3793 => 0.3943, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 3.65% (16.7336 => 17.3443, std.dev.: 0.2258) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.39% (0.3512 => 0.3631, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 43.52% (3.1209 => 4.4792, std.dev.: 0.2275) MultiSource/Applications/ALAC/encode/alacconvert-encode: 33.40% (0.0482 => 0.0643, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.59% (4.5309 => 6.0077, std.dev.: 0.3416) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.11% (15.3278 => 16.5703, std.dev.: 0.3128) SingleSource/Benchmarks/Shootout/ary3: 5.84% (2.0912 => 2.2133, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 4.92% (3.0301 => 3.1792, std.dev.: 0.0405) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.83% (4.1887 => 4.3073, std.dev.: 0.0352) MultiSource/Applications/JM/lencod/lencod: 2.35% (7.0143 => 7.1793, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.80% (4.4353 => 4.5153, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: 1.71% (2.5823 => 2.6265, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists: 1.25% (16.6066 => 16.8136, std.dev.: 0.0751) SingleSource/Benchmarks/Misc-C++/mandel-text: 1.08% (1.8352 => 1.8551, std.dev.: 0.0069) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 9.00% (1.1217 => 1.2227, std.dev.: 0.0595) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.43% (0.0221 => 0.0233, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.32% (0.0431 => 0.0441, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.18% (0.0335 => 0.0349, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.35% (0.0318 => 0.0335, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.20% (0.0429 => 0.0447, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 3.37% (0.0208 => 0.0215, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: 3.62% (0.0221 => 0.0229, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.76% (0.0227 => 0.0231, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.28% (0.1493 => 0.1459, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: 3.14% (1.1652 => 1.2018, std.dev.: 0.2321) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.92% (0.4014 => 0.3977, std.dev.: 0.0730) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.54% (0.1495 => 0.1487, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.89% (0.1004 => 0.0985, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.45% (0.0255 => 0.0274, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.17% (0.0564 => 0.0627, std.dev.: 0.0125) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.1476 => 1.1470, std.dev.: 0.1040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0606 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.01% (0.0306 => 0.0355, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.57% (0.7400 => 0.7664, std.dev.: 0.0467) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.42% (0.0083 => 0.0037, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.40% (12.7627 => 12.8135, std.dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 52.98% (0.0336 => 0.0514, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.16% (0.1210 => 0.1466, std.dev.: 0.0099) MultiSource/Applications/SPASS/SPASS: 5.45% (16.4479 => 17.3443, std.dev.: 0.2258) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.16% (0.2113 => 0.2222, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 328212.50% (0.0008 => 2.6265, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.66% (1.1825 => 2.3846, std.dev.: 0.0233) MultiSource/Applications/ALAC/encode/alacconvert-encode: 32.58% (0.0485 => 0.0643, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.15% (5.0421 => 6.0077, std.dev.: 0.3416) MultiSource/Benchmarks/nbench/nbench: 6.63% (20.5117 => 21.8712, std.dev.: 0.4489) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.68% (3.0082 => 3.1792, std.dev.: 0.0405) MultiSource/Applications/JM/lencod/lencod: 5.33% (6.8159 => 7.1793, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (4.1668 => 4.3073, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.97% (4.3851 => 4.5153, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.76% (0.0808 => 0.0511, std.dev.: 0.0029) SingleSource/Benchmarks/SmallPT/smallpt: -26.06% (0.1888 => 0.1396, std.dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.29% (0.0692 => 0.0517, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.04% (0.0676 => 0.0527, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.75% (0.0862 => 0.0709, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.94% (0.1079 => 0.0907, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.59% (0.7686 => 0.6488, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -11.94% (1.0986 => 0.9674, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.77% (0.7693 => 0.7018, std.dev.: 0.0209) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.77% (0.2481 => 0.2313, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.81% (0.7693 => 0.7323, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.11% (0.9422 => 0.9035, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.87% (0.3981 => 0.3827, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.13% (1.0052 => 0.9737, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.73% (0.4081 => 0.3684, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/hash: -8.39% (4.5259 => 4.1463, std.dev.: 0.1468) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.18% (0.3217 => 0.2954, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/lists: -2.35% (17.2182 => 16.8136, std.dev.: 0.0751) MultiSource/Applications/hexxagon/hexxagon: -1.59% (14.0297 => 13.8063, std.dev.: 0.0416) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.49% (1.2047 => 1.2227, std.dev.: 0.0595) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0233 => 0.0233, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.22% (0.0451 => 0.0441, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.42% (0.0394 => 0.0349, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.13% (0.0328 => 0.0335, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.45% (0.0445 => 0.0447, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: 0.88% (0.0227 => 0.0229, std.dev.: 0.0040) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1530 => 0.1459, std.dev.: 0.0075) MultiSource/Applications/lemon/lemon: -37.71% (1.9293 => 1.2018, std.dev.: 0.2321) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.78% (0.4049 => 0.3977, std.dev.: 0.0730) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.52% (0.1510 => 0.1487, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.72% (0.0978 => 0.0985, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.27% (0.0590 => 0.0627, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.1617 => 1.1470, std.dev.: 0.1040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.46% (0.0268 => 0.0355, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.05% (0.7437 => 0.7664, std.dev.: 0.0467) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.78% (0.0092 => 0.0037, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.28% (12.7781 => 12.8135, std.dev.: 0.0083) Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 18:55:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 20:55:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120025539.5C4B62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7774?compare_to=7772&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7774, Order: 172936, Start Time: 2013-01-20 01:21:46, End Time: 2013-01-20 02:55:49 To: 7772, Order: 172925, Start Time: 2013-01-19 23:24:33, End Time: 2013-01-20 00:58:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (106 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.81% (0.0974 => 0.1615, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0010) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.72% (0.1132 => 0.1559, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.39% (0.6395 => 0.8722, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.62% (0.6395 => 0.8609, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.81% (0.6260 => 0.8314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.80% (0.5688 => 0.7497, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.62% (0.0699 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.47% (0.5805 => 0.7632, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.34% (0.5456 => 0.7166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.03% (0.5849 => 0.7664, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 30.98% (0.6230 => 0.8160, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.43% (0.5567 => 0.7261, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.42% (0.5575 => 0.7271, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.25% (0.5581 => 0.7269, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.18% (0.5941 => 0.7734, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.18% (0.5802 => 0.7553, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.47% (0.6033 => 0.7811, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.43% (0.5705 => 0.7384, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.07% (0.6440 => 0.8312, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.98% (0.5570 => 0.7184, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.91% (0.5859 => 0.7553, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.90% (0.5478 => 0.7061, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.82% (0.5857 => 0.7545, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 28.68% (0.5569 => 0.7166, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.68% (0.5925 => 0.7624, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.17% (0.5591 => 0.7166, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.11% (0.6189 => 0.7929, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.97% (0.6676 => 0.8543, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.56% (1.6474 => 2.1014, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.54% (0.6052 => 0.7719, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.48% (0.5863 => 0.7474, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.35% (0.6446 => 0.8209, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.62% (0.6304 => 0.7982, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.01% (0.6681 => 0.8419, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.73% (0.6194 => 0.7788, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.33% (0.6297 => 0.7892, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.21% (0.6660 => 0.8339, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.03% (0.6667 => 0.8269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.61% (0.7524 => 0.9225, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 21.84% (0.7339 => 0.8942, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.49% (2.2587 => 2.7216, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 15.00% (1.1450 => 1.3168, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.31% (0.1982 => 0.2226, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.49% (0.4916 => 0.5481, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 11.41% (0.4515 => 0.5030, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.32% (4.5069 => 5.0171, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.91% (1.6364 => 1.8149, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.81% (3.5339 => 3.9158, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.30% (0.7021 => 0.7604, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 7.96% (0.4524 => 0.4884, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.63% (1.2515 => 1.3470, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.09% (0.5329 => 0.5707, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4861 => 0.5205, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.50% (1.2784 => 1.3615, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.49% (9.2283 => 9.8274, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.45% (1.4642 => 1.5587, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3255 => 0.3441, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.10% (0.3319 => 0.3455, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3446 => 0.3562, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.6750 => 0.6972, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.11% (5.0226 => 5.1787, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.09% (5.4682 => 5.6369, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 2.37% (1.3864 => 1.4192, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 2.09% (0.8418 => 0.8594, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.46% (0.9557 => 0.9697, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.42% (0.7447 => 0.7553, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3722 => 1.3900, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7992, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.86% (0.9531 => 1.0280, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5205, std.dev.: 0.0685) SingleSource/Benchmarks/Misc-C++/bigfib: 3.22% (0.3328 => 0.3435, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1059, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8210 => 28.2643, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.57% (5.1955 => 5.2773, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5320 => 4.6021, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.11% (0.1281 => 0.1113, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: -5.48% (0.3831 => 0.3621, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.41% (0.3880 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -5.40% (0.3812 => 0.3606, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.37% (0.3891 => 0.3682, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.36% (0.3896 => 0.3687, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/for-in: -5.28% (0.4033 => 0.3820, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.13% (0.7198 => 0.6829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -5.05% (0.4176 => 0.3965, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.98% (2.4924 => 2.3684, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.76% (0.3884 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -4.64% (0.4199 => 0.4004, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.58% (0.3821 => 0.3646, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.34% (0.9852 => 0.9424, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.28% (0.2428 => 0.2324, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/parameter-passing: -4.14% (0.4280 => 0.4103, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.13% (0.6347 => 0.6085, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: -4.01% (0.6441 => 0.6183, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.40% (0.3323 => 0.3210, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.20% (0.7779 => 0.7530, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (0.9542 => 0.9243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.13% (0.6484 => 0.6281, std.dev.: 0.0022) SingleSource/UnitTests/Vector/constpool: -2.93% (20.7746 => 20.1665, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.93% (0.3658 => 0.3551, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.79% (1.3148 => 1.2781, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.73% (2.1713 => 2.1121, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.67% (14.2083 => 13.8285, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.58% (0.4151 => 0.4044, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.41% (6.7716 => 6.6084, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: -2.39% (17.1032 => 16.6940, std.dev.: 0.0212) MultiSource/Applications/JM/lencod/lencod: -2.08% (16.1920 => 15.8552, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (4.3330 => 4.2432, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.00% (1.2210 => 1.1966, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.90% (1.2221 => 1.1989, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.86% (0.7919 => 0.7772, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.84% (1.0544 => 1.0350, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -1.77% (7.0961 => 6.9705, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.73% (1.2300 => 1.2087, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -1.62% (0.7982 => 0.7853, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.33% (0.8521 => 0.8408, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -1.22% (2.4021 => 2.3727, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.84% (1.8100 => 0.6907, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3136, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.49% (4.3504 => 3.2414, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0281, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9227, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7514, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.70% (4.3779 => 3.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2082, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1283, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3396, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1718, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7609, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.42% (1.3096 => 1.2779, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.03% (3.7241 => 3.6484, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4638, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (3.7092 => 3.6488, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.48% (7.3040 => 7.1957, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5904, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 19:01:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 21:01:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130120030141.54B022A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7775?compare_to=7768&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7775, Order: 172925, Start Time: 2013-01-19 23:27:24, End Time: 2013-01-20 03:01:51 To: 7768, Order: 172902, Start Time: 2013-01-19 19:01:31, End Time: 2013-01-19 22:35:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (184 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (753 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.18% (3.1732 => 3.2105, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 1.16% (1.9871 => 2.0102, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.09% (1.5711 => 1.5882, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.84% (0.0625 => 0.0924, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.81% (0.1063 => 0.1433, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.43% (0.2969 => 0.3813, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.12% (0.1106 => 0.1406, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.04% (0.4139 => 0.5258, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.69% (0.5900 => 0.7475, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 26.17% (1.5932 => 2.0102, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.87% (0.4994 => 0.6286, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.68% (0.1620 => 0.2036, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.18% (0.5000 => 0.6259, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.14% (0.0541 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.71% (0.0599 => 0.0747) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.55% (0.4253 => 0.5297, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.30% (0.0897 => 0.1115, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.67% (0.1107 => 0.1358, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.63% (0.1003 => 0.1230, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.34% (0.1549 => 0.1895, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.26% (0.3903 => 0.4772, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.19% (0.1604 => 0.1960, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.14% (0.0822 => 0.1004, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.87% (0.1619 => 0.1973, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.59% (0.3890 => 0.4730, std.dev.: 0.0067) MultiSource/Applications/spiff/spiff: 21.15% (0.4029 => 0.4881, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.10% (0.1090 => 0.1320, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.76% (1.3152 => 1.5882, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.59% (0.1462 => 0.1763, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 20.44% (0.1218 => 0.1467, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.31% (0.1088 => 0.1309, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.31% (0.2014 => 0.2423, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.85% (0.2736 => 0.3279, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/09-vor/vor: 19.80% (0.1505 => 0.1803, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 19.73% (0.5546 => 0.6640, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 19.59% (1.8794 => 2.2475, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.43% (0.2866 => 0.3423, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.28% (0.4658 => 0.5556, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.23% (0.0572 => 0.0682, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.71% (0.3271 => 0.3883, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.66% (0.5026 => 0.5964, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.41% (3.5627 => 4.2185, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.24% (0.1968 => 0.2327, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.24% (1.6211 => 1.9168, std.dev.: 0.0070) MultiSource/Applications/d/make_dparser: 18.18% (1.0781 => 1.2741, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 17.99% (0.1284 => 0.1515, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.77% (0.2875 => 0.3386, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.64% (2.7292 => 3.2105, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.55% (0.2792 => 0.3282, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.47% (0.2811 => 0.3302, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 17.46% (0.5826 => 0.6843, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.46% (0.3930 => 0.4616, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.39% (0.3060 => 0.3592, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.38% (0.2750 => 0.3228, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.35% (0.0582 => 0.0683, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 17.35% (0.9697 => 1.1379, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 17.31% (0.2813 => 0.3300, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.31% (0.2738 => 0.3212, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.28% (2.0673 => 2.4245, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 17.23% (0.2780 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.22% (0.2823 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.20% (0.4361 => 0.5111, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.17% (0.2725 => 0.3193, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.17% (0.2714 => 0.3180, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 17.16% (0.2803 => 0.3284, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.15% (0.5889 => 0.6899, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.11% (0.2729 => 0.3196, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.11% (0.2911 => 0.3409, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.05% (1.9694 => 2.3052, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.96% (1.9966 => 2.3352, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 16.75% (4.2109 => 4.9162, std.dev.: 0.0125) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.74% (0.3195 => 0.3730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.69% (0.7171 => 0.8368, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 16.68% (0.9909 => 1.1562, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/wc: 16.63% (0.3096 => 0.3611, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.51% (0.3258 => 0.3796, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 16.37% (0.3726 => 0.4336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.36% (0.3362 => 0.3912, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.29% (4.4195 => 5.1395, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: 16.16% (0.3317 => 0.3853, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.11% (23.5202 => 27.3089, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.03% (0.3625 => 0.4206, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.98% (1.4269 => 1.6549, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 15.90% (0.3477 => 0.4030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 15.89% (0.3348 => 0.3880, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 15.85% (0.7875 => 0.9123, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.75% (0.3282 => 0.3799, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.67% (0.2566 => 0.2968, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.62% (0.3981 => 0.4603, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 15.58% (0.4146 => 0.4792, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 15.58% (0.3678 => 0.4251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 15.46% (0.4251 => 0.4908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.34% (0.3690 => 0.4256, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.23% (0.2068 => 0.2383, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.85% (0.3845 => 0.4416, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 14.43% (0.5012 => 0.5735, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.40% (0.1028 => 0.1176, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.24% (2.1653 => 2.4736, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/exceptions-2: 14.22% (0.3446 => 0.3936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.16% (0.3460 => 0.3950, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.15% (0.3469 => 0.3960, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 14.14% (0.3465 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.13% (0.3488 => 0.3981, std.dev.: 0.0086) MultiSource/Applications/SPASS/SPASS: 14.09% (5.5417 => 6.3225, std.dev.: 0.0092) SingleSource/UnitTests/ObjC/for-in: 14.07% (0.3496 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.06% (0.3442 => 0.3926, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.03% (0.6435 => 0.7338, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/property: 13.95% (0.3650 => 0.4159, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 13.89% (4.6177 => 5.2592, std.dev.: 0.0123) MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.2691 => 0.3061, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.72% (0.3724 => 0.4235, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.67% (0.3643 => 0.4141, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861) MultiSource/Benchmarks/Prolangs-C/football/football: 13.35% (0.2075 => 0.2352, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.2737 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.23% (2.1013 => 2.3793, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.0804 => 0.0907, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 12.78% (0.3498 => 0.3945, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.19% (0.3084 => 0.3460, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.2103 => 0.2359, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.01% (0.5361 => 0.6005, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 11.93% (0.3336 => 0.3734, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 11.89% (0.6634 => 0.7423, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.71% (0.1383 => 0.1545, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 11.64% (0.4847 => 0.5411, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.30% (0.7426 => 0.8265, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.27% (11.6398 => 12.9518, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.49% (4.6926 => 5.1850, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 10.02% (2.0346 => 2.2385, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.92% (0.5584 => 0.6138, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.12% (11.9555 => 12.9259, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.83% (0.3792 => 0.3975, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5361, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.62% (0.3693 => 0.4122, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 9.74% (0.2802 => 0.3075, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.59% (3.3903 => 3.6138, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (12.0509 => 12.6818, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2345, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6876, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.65% (1.8057 => 1.8897, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2053, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.52% (7.1849 => 7.2940, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3085, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2088, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6860, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4813, std.dev.: 0.0062) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5912, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.29% (2.4764 => 2.4196, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5805, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.64% (17.2379 => 14.1972, std.dev.: 0.0198) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: -8.58% (0.2402 => 0.2196, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7932, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2234, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.71% (11.2080 => 10.7927, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0054) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7739, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1731, std.dev.: 0.0627) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5001, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2134, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0463, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 19:18:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 21:18:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120031844.908822A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7776?compare_to=7771&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7776, Order: 172932, Start Time: 2013-01-20 01:08:03, End Time: 2013-01-20 03:18:54 To: 7771, Order: 172922, Start Time: 2013-01-19 22:26:53, End Time: 2013-01-20 00:38:01 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.94% (0.6507 => 0.6698, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/Burg/burg: -1.25% (1.5216 => 1.5026, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1328 => 0.1328) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8509 => 499.8452, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.31% (1.1277 => 499.8452, std.dev.: 0.0062) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.63% (0.5229 => 1.6452, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 19.84% (14.9895 => 17.9640, std.dev.: 0.0093) MultiSource/Applications/kimwitu++/kc: 43.16% (14.1553 => 20.2645, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 17.53% (4.1105 => 4.8312, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.90% (1.1048 => 1.7334, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.02% (7.1582 => 37.5101, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.05% (3.4629 => 6.3736, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.08% (0.6222 => 1.0831, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10290.14% (0.0720 => 7.4809, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11153600.00% (0.0001 => 11.1537, std.dev.: 0.0284) MultiSource/Applications/kimwitu++/kc: 50700.00% (0.0001 => 0.0508, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0034) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 807.51% (1.1194 => 10.1587, std.dev.: 0.0117) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.45% (22.1758 => 54.8730, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0012) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.15% (2.9384 => 4.6178, std.dev.: 0.0055) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.34% (7.0540 => 10.7459, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.85% (1.5859 => 2.3924, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.45% (8.1363 => 11.9156, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.90% (2.2024 => 3.1031, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 39.59% (0.3109 => 0.4340, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 37.93% (21.9371 => 30.2582, std.dev.: 0.0164) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.91% (4.2646 => 5.6681, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.89% (1.5415 => 2.0485, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (0.4615 => 0.6112, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.55% (0.1892 => 0.2470, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.27% (0.0479 => 0.0624, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.47% (0.4299 => 0.5566, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 29.07% (1.1642 => 1.5026, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.39% (0.6675 => 0.8570, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.82% (0.1125 => 0.1438, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.50% (0.5105 => 0.6458, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.53% (3.8922 => 4.8859, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 25.45% (0.2554 => 0.3204, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 25.10% (1.0722 => 1.3413, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.45% (0.1906 => 0.2372, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.31% (0.1337 => 0.1662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.22% (0.4289 => 0.5328, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.07% (0.1566 => 0.1943, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.77% (0.3121 => 0.3863, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.69% (1.4186 => 1.7546, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.66% (0.1175 => 0.1453, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.16% (0.4620 => 0.5690, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 22.83% (0.1143 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.75% (9.4845 => 11.6418, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.92% (0.0730 => 0.0890, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 21.60% (0.7115 => 0.8652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.07% (0.2700 => 0.3269, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 20.77% (0.0626 => 0.0756, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.71% (0.1236 => 0.1492, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 20.68% (0.0527 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.56% (1.3050 => 1.5733, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 20.55% (0.7835 => 0.9445, std.dev.: 0.0088) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.36% (5.7591 => 6.9316, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.12% (0.1029 => 0.1236, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 19.90% (0.6456 => 0.7741, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.47% (0.5860 => 0.7001, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.34% (4.9449 => 5.9012, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.22% (0.8172 => 0.9743, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.97% (0.1940 => 0.2308, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.54% (5.0018 => 5.9292, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 18.42% (3.3354 => 3.9498, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 18.07% (0.0592 => 0.0699, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.93% (0.3307 => 0.3900, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.83% (0.5020 => 0.5915, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.62% (0.9765 => 1.1486, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.58% (0.5569 => 0.6548, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 17.53% (0.7433 => 0.8736, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 17.15% (1.1840 => 1.3871, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.99% (0.5981 => 0.6997, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.97% (3.8723 => 4.5294, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.94% (0.3423 => 0.4003, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.87% (2.0273 => 2.3694, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.3283 => 0.3824, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.42% (0.3441 => 0.4006, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.42% (0.8101 => 0.9431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.18% (0.3232 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 15.95% (2.2969 => 2.6632, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.75% (0.6450 => 0.7466, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.52% (0.1044 => 0.1206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 14.91% (0.3180 => 0.3654, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.88% (0.8921 => 1.0248, std.dev.: 0.0092) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.63% (1.1861 => 1.3596, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3379 => 0.3864, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.26% (0.8067 => 0.9217, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.40% (0.4636 => 0.5257, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.70% (1.5603 => 1.7585, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.41% (0.4103 => 0.4612, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.23% (0.4203 => 0.4717, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 11.91% (0.4048 => 0.4530, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.74% (0.3603 => 0.4026, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.45% (0.3886 => 0.4331, std.dev.: 0.0064) MultiSource/Applications/sqlite3/sqlite3: 11.41% (17.1811 => 19.1414, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/lists1: 11.35% (0.3684 => 0.4102, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 10.97% (0.3282 => 0.3642, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.96% (0.3092 => 0.3431, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.90% (0.4064 => 0.4507, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.85% (0.3826 => 0.4241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.58% (0.3694 => 0.4085, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.52% (0.3497 => 0.3865, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.50% (0.3561 => 0.3935, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.50% (0.3543 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.42% (0.3427 => 0.3784, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.33% (14.3668 => 15.8515, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/strcat: 10.17% (0.2831 => 0.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 9.94% (0.1268 => 0.1394, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.47% (2.0665 => 2.2622, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 9.40% (0.2871 => 0.3141, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.37% (0.2872 => 0.3141, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.07% (0.1114 => 0.1215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.06% (0.2891 => 0.3153, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.03% (0.2714 => 0.2959, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.03% (1.2842 => 1.4001, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.6030 => 0.6567, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.75% (0.3052 => 0.3319, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7326 => 0.7949, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/fibo: 8.48% (0.2725 => 0.2956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.2793 => 0.3028, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.23% (0.3935 => 0.4259, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.23% (10.3673 => 11.2204, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.91% (0.3136 => 0.3384, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.65% (63.2438 => 68.0842, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.82% (2.2022 => 2.3523, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.4879 => 0.5181, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.06% (0.3131 => 0.3258, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.80% (7.9617 => 8.1047, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4778, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4632, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3134, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.09% (0.9957 => 1.0265, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9010, std.dev.: 0.0204) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (27.8444 => 28.3833, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.86% (9.1159 => 9.2854, std.dev.: 0.0475) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.85% (3.6395 => 3.7068, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4523, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.85% (5.2763 => 1.1689, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.68% (5.3855 => 4.4334, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.25% (5.3526 => 4.4292, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: -13.60% (10.4361 => 9.0171, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.16% (1.7609 => 1.6172, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9638, std.dev.: 0.0367) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.79% (1.9577 => 0.6698, std.dev.: 0.0064) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0499 => 5.3095, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.69% (1.5373 => 1.0194, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.67% (10.7105 => 7.4254, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7524, std.dev.: 0.0089) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0063, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4259, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4934, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3121, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.90% (1.2373 => 1.1519, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7042, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5109, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8398, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7221 => 3.6757, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2335, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.57% (0.1485 => 0.1328) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0003) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 20:52:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 22:52:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120045254.4F0662A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7777?compare_to=7774&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7777, Order: 172951, Start Time: 2013-01-20 03:19:03, End Time: 2013-01-20 04:53:04 To: 7774, Order: 172936, Start Time: 2013-01-20 01:21:46, End Time: 2013-01-20 02:55:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 3 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.62% (2.1121 => 2.0778, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference: -1.50% (0.7530 => 0.7417, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -1.15% (1.2781 => 1.2634, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.49% (0.0315 => 0.0704, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.45% (0.0514 => 0.0835, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.90% (0.1132 => 0.1561, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.75% (0.6395 => 0.8745, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.03% (0.6395 => 0.8635, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.07% (0.6260 => 0.8330, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.05% (0.0699 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.65% (0.6230 => 0.8202, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.54% (0.5688 => 0.7482, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.52% (0.5805 => 0.7635, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.45% (0.5456 => 0.7172, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.05% (0.5849 => 0.7665, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.82% (0.5567 => 0.7283, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.71% (0.5575 => 0.7287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.50% (0.5941 => 0.7753, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.48% (0.5581 => 0.7282, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.99% (0.5802 => 0.7542, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.84% (0.6033 => 0.7833, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.59% (0.5705 => 0.7393, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.26% (0.5478 => 0.7081, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.23% (0.5857 => 0.7569, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.13% (0.6440 => 0.8316, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.07% (0.5569 => 0.7188, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.03% (0.5859 => 0.7560, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.96% (0.5570 => 0.7183, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.84% (0.5925 => 0.7634, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.53% (0.5591 => 0.7186, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.21% (0.6676 => 0.8559, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.79% (0.6052 => 0.7734, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.74% (0.6446 => 0.8234, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.57% (0.6189 => 0.7895, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.53% (1.6474 => 2.1009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.29% (0.5863 => 0.7463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.98% (0.6304 => 0.8005, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.01% (0.6681 => 0.8419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.88% (0.6194 => 0.7797, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.69% (0.6660 => 0.8371, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.44% (0.6297 => 0.7899, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.49% (0.6667 => 0.8300, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.94% (0.7524 => 0.9250, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.05% (0.7339 => 0.8957, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.73% (2.2587 => 2.7269, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.99% (1.1450 => 1.3166, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.06% (0.1081 => 0.1233, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.48% (0.0833 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.46% (0.1982 => 0.2229, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.4515 => 0.5035, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.45% (0.4916 => 0.5479, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.40% (4.5069 => 5.0208, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.93% (1.6364 => 1.8153, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.67% (3.5339 => 3.9109, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.43% (0.1230 => 0.1346, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2385 => 0.2606, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.7021 => 0.7580, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.37% (1.2515 => 1.3437, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.94% (0.5329 => 0.5699, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.73% (1.2784 => 1.3644, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 6.63% (0.4524 => 0.4824, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (9.2283 => 9.8393, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.56% (1.4642 => 1.5602, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.18% (0.1731 => 0.1838, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.84% (0.4861 => 0.5145, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.27% (0.3255 => 0.3394, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.16% (0.3319 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.22% (5.0226 => 5.1843, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 2.52% (1.3864 => 1.4214, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 2.50% (0.6750 => 0.6919, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.48% (5.4682 => 5.6037, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.57% (0.8418 => 0.8550, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3722 => 1.3895, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8137, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3671, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6060, std.dev.: 0.0528) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.59% (27.8210 => 28.2634, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2766, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.42% (4.5320 => 4.5964, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.19% (10.3489 => 10.4720, std.dev.: 0.0135) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.45% (0.3194 => 0.2988, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.80% (0.3880 => 0.3655, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.72% (0.3884 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.70% (0.3896 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.67% (0.3848 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.65% (0.3891 => 0.3671, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: -5.63% (0.4033 => 0.3806, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.48% (0.6347 => 0.5999, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.42% (0.3837 => 0.3629, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.34% (0.4176 => 0.3953, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.11% (0.6441 => 0.6112, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.00% (2.4924 => 2.3678, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.88% (0.4199 => 0.3994, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.81% (0.2871 => 0.2733) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.78% (0.3057 => 0.2911, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.68% (0.2903 => 0.2767, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -4.65% (0.7779 => 0.7417, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.61% (0.3016 => 0.2877, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.58% (0.4280 => 0.4084, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -4.53% (0.2849 => 0.2720, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -4.46% (0.3205 => 0.3062, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -4.41% (0.3059 => 0.2924, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.41% (0.2428 => 0.2321, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: -4.36% (0.2939 => 0.2811, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.34% (0.9852 => 0.9424, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.31% (2.1713 => 2.0778, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.18% (0.3252 => 0.3116, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/except: -4.10% (0.3026 => 0.2902, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -4.07% (0.3025 => 0.2902, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.91% (1.3148 => 1.2634, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.81% (0.4151 => 0.3993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: -3.61% (0.2989 => 0.2881, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (0.3621 => 0.3493, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.35% (0.3849 => 0.3720, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.28% (0.3931 => 0.3802, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.14% (0.4427 => 0.4288, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: -3.10% (0.3867 => 0.3747, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.08% (0.6484 => 0.6284, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.92% (0.4248 => 0.4124, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.87% (0.4321 => 0.4197, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: -2.80% (0.3788 => 0.3682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (0.9542 => 0.9276, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2057, std.dev.: 0.0433) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.48% (14.2083 => 13.8559, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.45% (0.7919 => 0.7725, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.33% (6.7716 => 6.6138, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -2.32% (17.1032 => 16.7066, std.dev.: 0.0219) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.24% (0.4813 => 0.4705, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -2.22% (4.3330 => 4.2366, std.dev.: 0.0113) MultiSource/Applications/lambda-0_1_3/lambda: -2.13% (0.7982 => 0.7812, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.04% (1.2210 => 1.1961, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.03% (1.0544 => 1.0330, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.99% (1.2221 => 1.1978, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: -1.92% (1.5610 => 1.5310, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.91% (16.1920 => 15.8824, std.dev.: 0.0122) MultiSource/Applications/JM/ldecod/ldecod: -1.72% (7.0961 => 6.9737, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.56% (34.0927 => 33.5608, std.dev.: 0.0191) MultiSource/Applications/siod/siod: -1.54% (2.4021 => 2.3650, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.50% (1.2300 => 1.2115, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.30% (0.8521 => 0.8410, std.dev.: 0.0023) MultiSource/Applications/lua/lua: -1.19% (4.0594 => 4.0110, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9309, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.54% (1.8100 => 0.6961, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3143, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2410, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.60% (1.3643 => 1.0287, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9225, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.69% (4.3779 => 3.3844, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.80% (4.1024 => 3.2079, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.62% (4.9100 => 4.3397, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.35% (5.3830 => 5.1491, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.46% (3.7241 => 3.6325, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (7.9763 => 7.7916, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3040 => 7.1854, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.57% (1.3096 => 1.2891, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6011, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3477, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6115, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 20:56:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 19 Jan 2013 22:56:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120045657.746392A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7778?compare_to=7773&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7778, Order: 172950, Start Time: 2013-01-20 02:52:28, End Time: 2013-01-20 04:57:09 To: 7773, Order: 172928, Start Time: 2013-01-20 00:02:38, End Time: 2013-01-20 02:32:48 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (16 on baseline) Performance Improvements: 14 (22 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1040 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.07% (1.2615 => 1.3507, std.dev.: 0.0301) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.72% (4.8670 => 5.1943, std.dev.: 0.0606) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.59% (0.9478 => 0.9913, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/football/football: 4.31% (0.9706 => 1.0124, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 29.47% (39.2714 => 50.8430, std.dev.: 1.2410) MultiSource/Applications/minisat/minisat: 7.18% (7.4478 => 7.9829, std.dev.: 0.0778) SingleSource/Benchmarks/Misc/pi: 3.23% (2.1409 => 2.2101, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.10% (39.7879 => 40.6227, std.dev.: 0.1368) MultiSource/Applications/aha/aha: 1.88% (3.5296 => 3.5959, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/bh/bh: 1.06% (2.4037 => 2.4291, std.dev.: 0.0085) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -20.60% (0.1466 => 0.1164, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -15.23% (1.0576 => 0.8965, std.dev.: 0.0578) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -15.13% (0.0952 => 0.0808, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -12.38% (0.2529 => 0.2216, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.47% (0.2856 => 0.2614, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.27% (1.0468 => 0.9707, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/ary3: -4.87% (0.2631 => 0.2503, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.07% (1.9534 => 1.8934, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.31% (1.0116 => 0.9983, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.60% (0.0643 => 0.0517, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -8.59% (48.0500 => 43.9219, std.dev.: 1.5850) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.60% (1.2918 => 1.2582, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.41% (2.7787 => 2.7396, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.20% (5.0267 => 4.9666, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.65% (1.2227 => 1.1659, std.dev.: 0.1762) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.36% (0.0441 => 0.0435, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.44% (0.0349 => 0.0337, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.07% (0.0335 => 0.0318, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.68% (0.0447 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -3.72% (0.0215 => 0.0207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -3.06% (0.0229 => 0.0222, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0231 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.14% (0.0014 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1459 => 0.1464, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: 38.53% (1.2018 => 1.6649, std.dev.: 0.0673) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.3977 => 0.4044, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.14% (0.1487 => 0.1504, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.65% (0.0985 => 0.0949, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0274 => 0.0277, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.47% (0.0627 => 0.0530, std.dev.: 0.0085) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.48% (1.1470 => 1.1869, std.dev.: 0.0311) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.33% (0.0030 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 237.50% (0.0008 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0607 => 0.0610, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.70% (0.0355 => 0.0317, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.99% (0.7664 => 0.7358, std.dev.: 0.0185) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 72.97% (0.0037 => 0.0064, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (12.8135 => 12.7557, std.dev.: 0.0224) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.89% (0.0336 => 0.0507, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 37.04% (0.0845 => 0.1158, std.dev.: 0.0116) MultiSource/Applications/SPASS/SPASS: 6.68% (16.4479 => 17.5472, std.dev.: 0.2500) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.78% (4.9104 => 5.1943, std.dev.: 0.0606) MultiSource/Benchmarks/Prolangs-C/football/football: 3.74% (0.9759 => 1.0124, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.44% (0.9120 => 0.9434, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.13% (0.9612 => 0.9913, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.52% (1.8651 => 1.8934, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323175.00% (0.0008 => 2.5862, std.dev.: 0.0738) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.84% (1.1825 => 2.3986, std.dev.: 0.0492) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.84% (0.2562 => 0.2891, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.46% (3.7074 => 4.0211, std.dev.: 0.1073) MultiSource/Applications/JM/lencod/lencod: 4.05% (6.8159 => 7.0922, std.dev.: 0.0864) SingleSource/Benchmarks/Misc/pi: 3.32% (2.1390 => 2.2101, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.31% (1.2298 => 1.2582, std.dev.: 0.0075) MultiSource/Applications/aha/aha: 1.81% (3.5321 => 3.5959, std.dev.: 0.0110) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.66% (0.0808 => 0.0536, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.99% (0.0727 => 0.0509, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.72% (0.0692 => 0.0514, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.14% (0.0862 => 0.0697, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.08% (0.7686 => 0.6527, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.08% (1.5131 => 1.3908, std.dev.: 0.0397) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.81% (1.3924 => 1.2836, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -6.13% (0.2006 => 0.1883, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: -5.22% (0.4002 => 0.3793, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: -4.28% (0.2385 => 0.2283, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.59% (0.9091 => 0.8765, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.40% (1.3220 => 1.2903, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.34% (1.0119 => 0.9983, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -10.44% (4.5259 => 4.0534, std.dev.: 0.1658) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.70% (1.4588 => 1.3173, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.81% (0.3201 => 0.2983, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/ary3: -6.03% (2.2304 => 2.0958, std.dev.: 0.0502) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.61% (23.3986 => 22.3210, std.dev.: 0.3704) SingleSource/Benchmarks/Shootout-C++/lists: -3.53% (17.2182 => 16.6097, std.dev.: 0.2043) SingleSource/Benchmarks/Misc/mandel-2: -1.73% (0.8521 => 0.8374, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -1.72% (14.0297 => 13.7887, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/methcall: -1.09% (8.7416 => 8.6463, std.dev.: 0.0325) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.22% (1.2047 => 1.1659, std.dev.: 0.1762) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -4.31% (0.1530 => 0.1464, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: -13.70% (1.9293 => 1.6649, std.dev.: 0.0673) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.12% (0.4049 => 0.4044, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1510 => 0.1504, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.0978 => 0.0949, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0590 => 0.0530, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.17% (1.1617 => 1.1869, std.dev.: 0.0311) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.28% (0.0268 => 0.0317, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.06% (0.7437 => 0.7358, std.dev.: 0.0185) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.43% (0.0092 => 0.0064, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7557, std.dev.: 0.0224) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 22:00:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 00:00:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120060000.88BB52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7779?compare_to=7776&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7779, Order: 172953, Start Time: 2013-01-20 03:49:13, End Time: 2013-01-20 06:00:10 To: 7776, Order: 172932, Start Time: 2013-01-20 01:08:03, End Time: 2013-01-20 03:18:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (213 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (659 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.93% (11.2204 => 10.8916, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1328 => 0.1327, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8452 => 499.8303, std.dev.: 0.0109) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44222.98% (1.1277 => 499.8303, std.dev.: 0.0109) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.71% (0.5229 => 1.6456, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 19.81% (14.9895 => 17.9584, std.dev.: 0.0153) MultiSource/Applications/kimwitu++/kc: 43.31% (14.1553 => 20.2863, std.dev.: 0.0240) MultiSource/Benchmarks/MallocBench/gs/gs: 17.79% (4.1105 => 4.8418, std.dev.: 0.0075) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.61% (1.1048 => 1.7302, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.56% (7.1582 => 37.4773, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.86% (3.4629 => 6.3670, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.87% (0.6222 => 1.0818, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10300.56% (0.0720 => 7.4884, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 3834700.00% (0.0001 => 3.8348, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11191700.00% (0.0001 => 11.1918, std.dev.: 0.0556) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484400.00% (0.0001 => 5.4845, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.91% (1.1194 => 10.2415, std.dev.: 0.0566) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.34% (22.1758 => 55.0722, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.23% (0.0929 => 0.1823, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.23% (2.9384 => 4.6201, std.dev.: 0.0081) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.63% (7.0540 => 10.7665, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.07% (1.5859 => 2.3958, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.61% (8.1363 => 11.9288, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.19% (2.2024 => 3.1096, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops: 39.59% (0.1432 => 0.1999, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.31% (0.3109 => 0.4331, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.13% (21.9371 => 30.3014, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0001) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.70% (4.2646 => 5.6593, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.56% (1.5415 => 2.0434, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (0.4615 => 0.6112, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 30.55% (0.1892 => 0.2470, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.90% (0.2271 => 0.2950, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 29.38% (1.1642 => 1.5062, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 29.17% (0.4299 => 0.5553, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.31% (0.6675 => 0.8565, std.dev.: 0.0134) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.62% (0.5105 => 0.6464, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.98% (0.1143 => 0.1440, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.78% (0.1125 => 0.1415, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.69% (3.8922 => 4.8922, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.97% (1.0722 => 1.3399, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.24% (0.1906 => 0.2368, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.93% (0.1337 => 0.1657, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.83% (0.1175 => 0.1455, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.75% (1.4186 => 1.7555, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: 23.07% (0.4620 => 0.5686, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.01% (0.0730 => 0.0898, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 22.84% (9.4845 => 11.6511, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.95% (0.1695 => 0.2067, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 21.70% (0.7115 => 0.8659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.48% (0.1555 => 0.1889, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.37% (0.2700 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815) MultiSource/Applications/oggenc/oggenc: 20.61% (5.7591 => 6.9461, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 20.56% (0.7835 => 0.9446, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.47% (0.1236 => 0.1489, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.42% (1.3050 => 1.5715, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.02% (0.1029 => 0.1235, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.97% (0.6456 => 0.7745, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 19.76% (0.1695 => 0.2030, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.48% (4.9449 => 5.9082, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.31% (0.8172 => 0.9750, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.28% (0.5860 => 0.6990, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.28% (0.1940 => 0.2314, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.72% (5.0018 => 5.9381, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.38% (3.3354 => 3.9485, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.98% (0.2758 => 0.3254, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.87% (0.7433 => 0.8761, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.81% (0.5020 => 0.5914, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.69% (0.3307 => 0.3892, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.67% (0.9765 => 1.1490, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.54% (0.5569 => 0.6546, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 16.97% (0.3423 => 0.4004, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 16.92% (2.0273 => 2.3704, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 16.89% (3.8723 => 4.5264, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 16.86% (1.1840 => 1.3836, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.85% (0.5981 => 0.6989, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 16.45% (0.3283 => 0.3823, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.26% (2.2969 => 2.6704, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.25% (0.3441 => 0.4000, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.16% (0.8101 => 0.9410, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 16.03% (0.3232 => 0.3750, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.77% (0.6450 => 0.7467, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 15.47% (0.2049 => 0.2366, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.19% (0.3180 => 0.3663, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.8921 => 1.0232, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.61% (1.1861 => 1.3594, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.32% (0.8067 => 0.9222, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 14.18% (0.3379 => 0.3858, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.60% (0.2603 => 0.2957, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.40% (0.4636 => 0.5257, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.08% (0.3387 => 0.3830, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.70% (1.5603 => 1.7585, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.70% (0.4103 => 0.4624, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.49% (0.4203 => 0.4728, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: 11.98% (0.4048 => 0.4533, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.81% (0.3422 => 0.3826, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 11.74% (0.3603 => 0.4026, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.43% (0.3282 => 0.3657, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.41% (0.3927 => 0.4375, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists1: 11.37% (0.3684 => 0.4103, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.26% (17.1811 => 19.1162, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 11.19% (0.3092 => 0.3438, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3826 => 0.4249, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.4064 => 0.4512, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.01% (0.3886 => 0.4314, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1268 => 0.1402, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.27% (0.3427 => 0.3779, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (14.3668 => 15.8406, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/strcat: 10.07% (0.2831 => 0.3116, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.74% (0.3561 => 0.3908, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.70% (0.3516 => 0.3857, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.69% (0.3497 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.56% (2.0665 => 2.2640, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.52% (0.2877 => 0.3151, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 9.33% (0.2871 => 0.3139, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2872 => 0.3138, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.10% (0.2714 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.90% (1.2842 => 1.3985, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.82% (0.3162 => 0.3441, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.71% (0.3650 => 0.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 8.70% (0.2725 => 0.2962, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.56% (0.2756 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.46% (0.2802 => 0.3039, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.2793 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.13% (0.3935 => 0.4255, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 8.11% (0.6030 => 0.6519, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.06% (63.2438 => 68.3439, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 7.65% (0.5925 => 0.6378, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.16% (2.2022 => 2.3598, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.42% (0.4879 => 0.5192, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 5.06% (10.3673 => 10.8916, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.04% (7.9617 => 8.1244, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4743, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 9.33% (1.1396 => 1.2459, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.01% (4.2280 => 4.4400, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3119, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1063, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.21% (0.9957 => 1.0277, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.54% (8.6802 => 8.9004, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6395 => 3.7124, std.dev.: 0.0110) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (27.8444 => 28.3849, std.dev.: 0.0045) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2836, std.dev.: 0.0387) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (1.7254 => 1.7561, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.79% (5.2763 => 1.1718, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.47% (5.3855 => 4.4447, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.83% (5.3526 => 4.4520, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -13.80% (10.4361 => 8.9954, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.20% (1.7609 => 1.6165, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9166, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.35% (1.9577 => 0.6588, std.dev.: 0.0159) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.56% (0.0628 => 0.0367, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -38.34% (0.0506 => 0.0312, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -38.07% (0.3987 => 0.2469) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4267, std.dev.: 0.0175) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7608, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.36% (2.6546 => 2.0080, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -20.04% (0.2161 => 0.1728, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7320, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4903, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2624, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.76% (1.2373 => 1.1536, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6971, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.85% (0.4808 => 0.4575, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5074, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.58% (10.2830 => 9.8125, std.dev.: 0.0155) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: -1.78% (3.6994 => 3.6336, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2332, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0000) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 22:49:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 00:49:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120064957.325EA2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7780?compare_to=7777&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7780, Order: 172958, Start Time: 2013-01-20 05:16:27, End Time: 2013-01-20 06:50:07 To: 7777, Order: 172951, Start Time: 2013-01-20 03:19:03, End Time: 2013-01-20 04:53:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 1 (133 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (859 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -12.54% (0.4274 => 0.3738, std.dev.: 0.0190) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 62.26% (0.0514 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.90% (0.1132 => 0.1561, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.76% (0.6395 => 0.8746, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.01% (0.6395 => 0.8634, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.97% (0.6260 => 0.8324, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.05% (0.0699 => 0.0923, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.59% (0.5688 => 0.7485, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.52% (0.5805 => 0.7635, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.49% (0.5456 => 0.7174, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.46% (0.6230 => 0.8190, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.03% (0.5849 => 0.7664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.77% (0.5567 => 0.7280, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.76% (0.5575 => 0.7290, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.68% (0.5581 => 0.7293, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.43% (0.5941 => 0.7749, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.99% (0.5802 => 0.7542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.80% (0.6033 => 0.7831, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.57% (0.5705 => 0.7392, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.26% (0.5478 => 0.7081, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.16% (0.6440 => 0.8318, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.15% (0.5859 => 0.7567, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.11% (0.5857 => 0.7562, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.05% (0.5569 => 0.7187, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 28.99% (0.5570 => 0.7185, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.79% (0.5925 => 0.7631, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.67% (0.5591 => 0.7194, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.09% (0.6676 => 0.8551, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.61% (0.6052 => 0.7723, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.58% (0.6189 => 0.7896, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.43% (1.6474 => 2.0992, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.17% (0.5863 => 0.7456, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.92% (0.6304 => 0.8001, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.03% (0.6681 => 0.8420, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.85% (0.6194 => 0.7795, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.69% (0.6660 => 0.8371, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.31% (0.6297 => 0.7891, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.16% (0.6667 => 0.8278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.81% (0.7524 => 0.9240, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.07% (0.7339 => 0.8959, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.72% (2.2587 => 2.7266, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.04% (1.1450 => 1.3172, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.06% (0.1081 => 0.1233, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.36% (0.0833 => 0.0936, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.36% (0.1982 => 0.2227, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.45% (0.4916 => 0.5479, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.45% (0.4515 => 0.5032, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.23% (4.5069 => 5.0129, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.14% (1.6364 => 1.8187, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.61% (3.5339 => 3.9090, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.99% (0.7021 => 0.7582, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.35% (0.2001 => 0.2148, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.30% (1.2515 => 1.3428, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.70% (0.5329 => 0.5686, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (1.2784 => 1.3638, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 6.56% (9.2283 => 9.8340, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.44% (1.4642 => 1.5585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.1731 => 0.1841, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 6.15% (0.4524 => 0.4802, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 5.72% (0.4861 => 0.5139, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.21% (0.3255 => 0.3392, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.10% (0.3319 => 0.3455, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.19% (5.0226 => 5.1830, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.3864 => 1.4223, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.51% (5.4682 => 5.6053, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 2.37% (0.6750 => 0.6910, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.57% (0.8418 => 0.8550, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.14% (1.3722 => 1.3879, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7914, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.5751 => 56.6912, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8210 => 28.2653, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (5.1955 => 5.2765, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5974, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4562, std.dev.: 0.0164) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.54% (0.3194 => 0.2985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -5.90% (0.3812 => 0.3587, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -5.80% (0.3848 => 0.3625, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -5.79% (0.3831 => 0.3609, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -5.75% (0.3896 => 0.3672, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.70% (0.3880 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.68% (0.3891 => 0.3670, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.68% (0.4033 => 0.3804, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.66% (0.3884 => 0.3664, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -5.55% (0.6347 => 0.5995, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -5.44% (0.4176 => 0.3949, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.34% (0.3837 => 0.3632, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.19% (0.6441 => 0.6107, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -5.00% (0.3323 => 0.3157, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.97% (2.4924 => 2.3685, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -4.93% (0.4199 => 0.3992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.91% (0.2871 => 0.2730, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.81% (0.3057 => 0.2910, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -4.81% (0.7779 => 0.7405, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.72% (0.2903 => 0.2766, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -4.65% (0.4280 => 0.4081, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -4.63% (0.2849 => 0.2717, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.58% (0.3016 => 0.2878, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -4.52% (0.3205 => 0.3060, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -4.51% (0.3059 => 0.2921, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.50% (0.2933 => 0.2801) SingleSource/Benchmarks/Shootout-C++/except: -4.46% (0.3026 => 0.2891, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: -4.42% (0.2939 => 0.2809, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (0.9852 => 0.9418, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.37% (2.1713 => 2.0765, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (0.3025 => 0.2896, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.01% (0.3142 => 0.3016) MultiSource/Applications/hexxagon/hexxagon: -3.92% (1.3148 => 1.2633, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/strcat: -3.48% (0.2989 => 0.2885, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -3.45% (0.3621 => 0.3496, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.33% (0.3849 => 0.3721, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.28% (0.3931 => 0.3802, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.24% (0.6484 => 0.6274, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.23% (0.4427 => 0.4284, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.12% (0.4321 => 0.4186, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.01% (0.3658 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.00% (0.3867 => 0.3751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.97% (0.4248 => 0.4122, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.86% (20.7746 => 20.1796, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/sieve: -2.80% (0.3788 => 0.3682, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.9542 => 0.9277, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.54% (0.7919 => 0.7718, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.50% (0.4083 => 0.3981, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.45% (14.2083 => 13.8600, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.30% (6.7716 => 6.6160, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.24% (0.4813 => 0.4705, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7237, std.dev.: 0.0190) MultiSource/Benchmarks/MallocBench/gs/gs: -2.19% (4.3330 => 4.2383, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.07% (1.2221 => 1.1968, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.07% (1.0544 => 1.0326, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -2.04% (0.7982 => 0.7819, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.01% (1.2210 => 1.1965, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8728, std.dev.: 0.0146) MultiSource/Applications/hbd/hbd: -1.95% (1.5610 => 1.5305, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.0961 => 6.9694, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.78% (1.2300 => 1.2081, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/football/football: -1.57% (0.9179 => 0.9035, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.51% (34.0927 => 33.5796, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -1.48% (2.4021 => 2.3665, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.46% (0.8521 => 0.8397, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -1.22% (4.0594 => 4.0098, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.13% (0.9077 => 0.8974, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9308, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.03% (1.8100 => 0.6873, std.dev.: 0.0261) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3095, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.50% (4.3504 => 3.2409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.92% (1.3643 => 1.0243, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9223, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -22.71% (4.3779 => 3.3836, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.78% (4.1024 => 3.2088, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.06% (2.5106 => 2.1324, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6676, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.37% (4.7378 => 4.1043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.63% (4.9100 => 4.3390, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6327, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.34% (5.3830 => 5.1493, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.46% (2.2633 => 2.1850, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.81% (1.3096 => 1.2728, std.dev.: 0.0075) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (7.9763 => 7.7816, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.46% (1.6307 => 1.6069, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.3040 => 7.2115, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.19% (4.4002 => 4.3479, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5913, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -1.05% (1.4516 => 1.4363, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 23:17:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 01:17:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120071757.24AB12A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7781?compare_to=7778&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7781, Order: 172958, Start Time: 2013-01-20 05:15:46, End Time: 2013-01-20 07:18:10 To: 7778, Order: 172950, Start Time: 2013-01-20 02:52:28, End Time: 2013-01-20 04:57:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (6 on baseline) Performance Improvements: 18 (37 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1041 (1020 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 13.05% (20.0639 => 22.6827, std.dev.: 0.6357) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.11% (0.3529 => 0.3674, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 2.72% (8.6311 => 8.8657, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/ffbench: 1.68% (1.3760 => 1.3991, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.39% (1.8548 => 1.8805, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -28.26% (0.0835 => 0.0599, std.dev.: 0.0070) MultiSource/Applications/spiff/spiff: -22.53% (1.1442 => 0.8864, std.dev.: 0.0140) MultiSource/Applications/viterbi/viterbi: -15.80% (0.2044 => 0.1721, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/04-bisect/bisect: -12.31% (0.1446 => 0.1268, std.dev.: 0.0058) MultiSource/Applications/aha/aha: -11.44% (0.1372 => 0.1215, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -10.27% (1.5518 => 1.3925, std.dev.: 0.0160) MultiSource/Applications/SPASS/SPASS: -10.10% (17.5472 => 15.7746, std.dev.: 0.6382) MultiSource/Benchmarks/McCat/05-eks/eks: -8.95% (0.5150 => 0.4689, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: -6.56% (1.4682 => 1.3719, std.dev.: 0.0339) MultiSource/Applications/JM/lencod/lencod: -6.36% (17.5140 => 16.3997, std.dev.: 0.1401) MultiSource/Benchmarks/McCat/09-vor/vor: -6.35% (0.3589 => 0.3361, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -6.14% (5.1943 => 4.8755, std.dev.: 0.0850) MultiSource/Applications/JM/ldecod/ldecod: -5.84% (7.5968 => 7.1531, std.dev.: 0.0835) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -6.75% (1.3668 => 1.2745, std.dev.: 0.0282) MultiSource/Applications/SIBsim4/SIBsim4: -6.41% (3.6516 => 3.4177, std.dev.: 0.0376) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.31% (40.6227 => 39.2763, std.dev.: 0.5176) MultiSource/Applications/aha/aha: -2.61% (3.5959 => 3.5020, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.24% (4.6038 => 4.5468, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.12% (1.1659 => 1.1295, std.dev.: 0.1834) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0223 => 0.0223, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.45% (0.0435 => 0.0420, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0337 => 0.0339, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0318 => 0.0320, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.15% (0.0435 => 0.0430, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0207 => 0.0206, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0222 => 0.0222, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.75% (0.1464 => 0.1453, std.dev.: 0.0221) MultiSource/Applications/lemon/lemon: -29.99% (1.6649 => 1.1656, std.dev.: 0.4082) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.09% (0.4044 => 0.4000, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.13% (0.1504 => 0.1472, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.91% (0.0949 => 0.1043, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.69% (0.0277 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.13% (0.0530 => 0.0536, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.23% (1.1869 => 1.1486, std.dev.: 0.0553) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -51.61% (0.0031 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0610 => 0.0539, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.95% (0.0317 => 0.0314, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.82% (0.7358 => 0.7492, std.dev.: 0.0298) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.44% (0.0064 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.22% (12.7557 => 12.7833, std.dev.: 0.0180) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.81% (0.0336 => 0.0500, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322150.00% (0.0008 => 2.5780, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.35% (1.1825 => 2.3928, std.dev.: 0.0334) MultiSource/Benchmarks/nbench/nbench: 10.58% (20.5117 => 22.6827, std.dev.: 0.6357) SingleSource/Benchmarks/Misc/pi: 3.22% (2.1390 => 2.2078, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.43% (4.3851 => 4.4480, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.97% (0.0808 => 0.0477, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.64% (0.0727 => 0.0497, std.dev.: 0.0046) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.15% (0.1684 => 0.1311, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.86% (0.0676 => 0.0562, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.29% (0.7686 => 0.6434, std.dev.: 0.0432) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.66% (0.1079 => 0.0910, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: -13.27% (1.0220 => 0.8864, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: -12.85% (1.5979 => 1.3925, std.dev.: 0.0160) MultiSource/Applications/aha/aha: -11.83% (0.1378 => 0.1215, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.09% (6.4235 => 5.7109, std.dev.: 0.2594) MultiSource/Applications/siod/siod: -9.37% (2.6437 => 2.3961, std.dev.: 0.0338) MultiSource/Applications/sgefa/sgefa: -9.01% (0.3598 => 0.3274, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.71% (0.2100 => 0.1938, std.dev.: 0.0063) MultiSource/Applications/d/make_dparser: -7.09% (3.7840 => 3.5157, std.dev.: 0.0215) MultiSource/Applications/lemon/lemon: -6.72% (1.3979 => 1.3040, std.dev.: 0.0307) MultiSource/Applications/viterbi/viterbi: -5.65% (0.1824 => 0.1721, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -5.53% (0.5134 => 0.4850, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/matrix: -5.16% (0.2385 => 0.2262, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.84% (0.6135 => 0.5838, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.76% (0.2481 => 0.2363, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.60% (0.3981 => 0.3798, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary: -3.96% (0.2551 => 0.2450, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash: -3.90% (0.4689 => 0.4506, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.86% (4.6579 => 4.5246, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (1.3220 => 1.2880, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -18.42% (1.5623 => 1.2745, std.dev.: 0.0282) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.35% (0.1164 => 0.0997, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.45% (1.4235 => 1.2605, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/lists1: -8.25% (0.6628 => 0.6081, std.dev.: 0.0192) MultiSource/Applications/oggenc/oggenc: -5.99% (0.1704 => 0.1602, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.03% (0.3201 => 0.3040, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: -3.57% (3.5443 => 3.4177, std.dev.: 0.0376) MultiSource/Applications/hexxagon/hexxagon: -1.87% (14.0297 => 13.7672, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/ffbench: -1.78% (1.4244 => 1.3991, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: -1.33% (8.6447 => 8.5301, std.dev.: 0.0345) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.24% (1.2047 => 1.1295, std.dev.: 0.1834) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.87% (0.0451 => 0.0420, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0221) MultiSource/Applications/lemon/lemon: -39.58% (1.9293 => 1.1656, std.dev.: 0.4082) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.21% (0.4049 => 0.4000, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.52% (0.1510 => 0.1472, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.65% (0.0978 => 0.1043, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.35% (0.0276 => 0.0264, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.15% (0.0590 => 0.0536, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.13% (1.1617 => 1.1486, std.dev.: 0.0553) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.12% (0.0032 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -11.64% (0.0610 => 0.0539, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (0.7437 => 0.7492, std.dev.: 0.0298) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.74% (0.0092 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7833, std.dev.: 0.0180) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 19 23:29:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 01:29:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130120072904.4B51B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7782?compare_to=7775&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7782, Order: 172953, Start Time: 2013-01-20 03:54:32, End Time: 2013-01-20 07:29:15 To: 7775, Order: 172925, Start Time: 2013-01-19 23:27:24, End Time: 2013-01-20 03:01:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (181 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 8.46% (0.1194 => 0.1295, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.29% (126.8979 => 129.8101, std.dev.: 0.8393) MultiSource/Benchmarks/Olden/perimeter/perimeter: 2.08% (0.6102 => 0.6229, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.18% (1.5882 => 1.5695, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (3.2105 => 3.1730, std.dev.: 0.0126) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.04% (0.0625 => 0.0919, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.12% (0.1063 => 0.1447, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.36% (0.0415 => 0.0541, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.48% (0.1106 => 0.1421, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.02% (0.2969 => 0.3801, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.71% (0.5900 => 0.7476, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.69% (0.0547 => 0.0693, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.46% (0.4139 => 0.5234, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.53% (0.4253 => 0.5339, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.25% (0.1620 => 0.2029, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.22% (1.5932 => 1.9950, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.17% (0.4994 => 0.6251, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.85% (0.1549 => 0.1934, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.70% (0.5000 => 0.6235, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.30% (0.1107 => 0.1376, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 23.95% (0.0948 => 0.1175, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.66% (0.1103 => 0.1364, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.07% (0.1604 => 0.1974, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 22.79% (0.1619 => 0.1988, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.33% (0.1003 => 0.1227, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.85% (0.3903 => 0.4756, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.76% (0.2866 => 0.3461, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.53% (0.4029 => 0.4856, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.26% (0.3890 => 0.4678, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.21% (0.3271 => 0.3932, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.76% (0.2014 => 0.2412, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.57% (0.1160 => 0.1387, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.44% (0.2736 => 0.3268, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.34% (1.3152 => 1.5695, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 19.01% (1.8794 => 2.2367, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 19.00% (0.5546 => 0.6600, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.88% (0.0572 => 0.0680, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.48% (0.4658 => 0.5519, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.19% (1.6211 => 1.9160, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.99% (3.5627 => 4.2035, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.78% (0.1968 => 0.2318, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 17.68% (0.1284 => 0.1511, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.63% (0.5026 => 0.5912, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 17.60% (1.0781 => 1.2678, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.54% (0.4361 => 0.5126, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.32% (0.2875 => 0.3373, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 17.06% (0.5826 => 0.6820, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 17.03% (0.2813 => 0.3292, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 16.93% (0.2823 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 16.91% (0.2714 => 0.3173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 16.86% (0.2811 => 0.3285, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 16.84% (0.5889 => 0.6881, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.84% (0.3930 => 0.4592, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 16.83% (0.9697 => 1.1329, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: 16.66% (0.2725 => 0.3179, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.61% (2.0673 => 2.4107, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.60% (0.2729 => 0.3182, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 16.59% (4.2109 => 4.9095, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.58% (0.2792 => 0.3255, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.54% (0.2738 => 0.3191, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 16.45% (0.2803 => 0.3264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.44% (0.3060 => 0.3563, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.42% (0.2911 => 0.3389, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.38% (1.9694 => 2.2919, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 16.36% (0.7171 => 0.8344, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 16.34% (0.9909 => 1.1528, std.dev.: 0.0038) SingleSource/Regression/C++/ofstream_ctor: 16.28% (0.3004 => 0.3493, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.26% (2.7292 => 3.1730, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.17% (1.9966 => 2.3195, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: 16.02% (0.3096 => 0.3592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 15.92% (0.3267 => 0.3787, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3258 => 0.3773, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (4.4195 => 5.1164, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ary2: 15.68% (0.3317 => 0.3837, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.62% (0.3362 => 0.3887, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.52% (0.3124 => 0.3609, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 15.51% (1.4269 => 1.6482, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 15.47% (0.2566 => 0.2963, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.34% (0.3625 => 0.4181, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 15.32% (0.3726 => 0.4297, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3282 => 0.3782, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.23% (0.3348 => 0.3858, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 15.20% (23.5202 => 27.0962, std.dev.: 0.0455) SingleSource/Benchmarks/Shootout-C++/lists1: 15.19% (0.3477 => 0.4005, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 14.98% (0.7875 => 0.9055, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/moments: 14.95% (0.3678 => 0.4228, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.83% (0.4146 => 0.4761, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.64% (0.3981 => 0.4564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.58% (0.4251 => 0.4871, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.53% (0.3690 => 0.4226, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.41% (0.3845 => 0.4399, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 13.97% (0.5012 => 0.5712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.62% (0.3488 => 0.3963, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 13.61% (2.1653 => 2.4601, std.dev.: 0.0231) MultiSource/Applications/SIBsim4/SIBsim4: 13.56% (0.2691 => 0.3056, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 13.54% (0.3465 => 0.3934, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 13.50% (0.3496 => 0.3968, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 13.43% (5.5417 => 6.2857, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/exceptions-3: 13.41% (0.3460 => 0.3924, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 13.40% (0.3469 => 0.3934, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 13.39% (0.3442 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 13.20% (0.2075 => 0.2349, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 13.18% (0.3724 => 0.4215, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: 13.18% (0.3650 => 0.4131, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.04% (0.6435 => 0.7274, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 12.89% (4.6177 => 5.2131, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 12.88% (2.1013 => 2.3720, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.39% (0.2737 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.33% (0.2068 => 0.2323, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.79% (0.1383 => 0.1546, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.75% (0.3336 => 0.3728, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.72% (0.2040 => 0.2279, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.58% (0.3498 => 0.3903, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.57% (0.5361 => 0.5981, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.32% (0.3084 => 0.3433, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 11.31% (0.6634 => 0.7384, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 10.73% (0.4847 => 0.5367, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.56% (0.2103 => 0.2325, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.48% (11.6398 => 12.8601, std.dev.: 0.0187) MultiSource/Applications/lemon/lemon: 10.29% (0.2391 => 0.2637, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.15% (0.7426 => 0.8180, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.46% (4.6926 => 5.1364, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 9.30% (2.0346 => 2.2238, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.06% (0.5584 => 0.6090, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 7.35% (11.9555 => 12.8338, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3792 => 0.3957, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5367, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.72% (0.3693 => 0.4089, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 8.37% (0.1195 => 0.1295, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.57% (3.3903 => 3.6130, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2386, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6703, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6842, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1984, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3046, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2830, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2091, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6001, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4779, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.5997, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -17.00% (17.2379 => 14.3076, std.dev.: 0.0513) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -10.78% (0.2402 => 0.2143, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7924, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2200, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.64% (14.0481 => 13.5374, std.dev.: 0.1445) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0119) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1402, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5772, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1936, std.dev.: 0.0640) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0449, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 00:43:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 02:43:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120084312.EC5EA2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/7783?compare_to=7779&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7783, Order: 172964, Start Time: 2013-01-20 06:30:24, End Time: 2013-01-20 08:43:22 To: 7779, Order: 172953, Start Time: 2013-01-20 03:49:13, End Time: 2013-01-20 06:00:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 5 (208 on baseline) Performance Improvements: 6 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1089 (666 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.87% (10.8916 => 11.3132, std.dev.: 0.0044) MultiSource/Applications/Burg/burg: 1.03% (1.5062 => 1.5217, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.14% (4.3120 => 4.4041, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.13% (3.1310 => 3.1976, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (79.8994 => 81.1036, std.dev.: 0.1548) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (0.7744 => 0.7602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.42% (0.8788 => 0.8663, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.37% (0.7686 => 0.7581, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.33% (0.8275 => 0.8165, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -2.45% (4.4977 => 4.3874, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.6358 => 4.5622, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1327 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0652 => 0.0655, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8303 => 499.8456, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.34% (1.1277 => 499.8456, std.dev.: 0.0068) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.45% (0.5229 => 1.6495, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 20.03% (14.9895 => 17.9918, std.dev.: 0.0201) MultiSource/Applications/kimwitu++/kc: 43.37% (14.1553 => 20.2951, std.dev.: 0.0347) MultiSource/Benchmarks/MallocBench/gs/gs: 17.83% (4.1105 => 4.8432, std.dev.: 0.0361) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.66% (1.1048 => 1.7308, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.77% (7.1582 => 37.5638, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.91% (3.4629 => 6.3685, std.dev.: 0.1972) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.88% (0.6222 => 1.0819, std.dev.: 0.0178) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.69% (0.0720 => 7.4453, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 11157700.00% (0.0001 => 11.1578, std.dev.: 0.0583) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495400.00% (0.0001 => 5.4955, std.dev.: 0.2613) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.75% (1.1194 => 10.2397, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.55% (22.1758 => 55.1172, std.dev.: 0.0340) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.77% (0.0929 => 0.1828, std.dev.: 0.0042) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.72% (2.9384 => 4.6343, std.dev.: 0.0065) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.93% (7.0540 => 10.7880, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.07% (1.5859 => 2.3958, std.dev.: 0.0633) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.70% (8.1363 => 11.9362, std.dev.: 0.0456) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.16% (2.2024 => 3.1089, std.dev.: 0.0871) SingleSource/Benchmarks/Misc/flops: 39.80% (0.1432 => 0.2002, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 39.43% (0.3109 => 0.4335, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 38.13% (21.9371 => 30.3017, std.dev.: 0.0279) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0010) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.19% (4.2646 => 5.6799, std.dev.: 0.0210) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.42% (0.4615 => 0.6111, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.30% (1.5415 => 2.0394, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 30.71% (1.1642 => 1.5217, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.94% (0.2271 => 0.2951, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 29.59% (0.4299 => 0.5571, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.52% (0.6675 => 0.8579, std.dev.: 0.0280) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.06% (0.1892 => 0.2404, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.03% (0.5105 => 0.6485, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.20% (0.1584 => 0.1999, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.95% (3.8922 => 4.9023, std.dev.: 0.0927) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.60% (0.0793 => 0.0996, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.93% (0.1143 => 0.1428, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 24.06% (1.0722 => 1.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.75% (1.4186 => 1.7555, std.dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.52% (0.3121 => 0.3855, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 23.46% (0.4289 => 0.5295, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash2: 22.81% (0.4620 => 0.5674, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 22.51% (9.4845 => 11.6196, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1695 => 0.2072, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 21.97% (0.7115 => 0.8678, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.88% (0.0672 => 0.0819, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 21.33% (0.7835 => 0.9506, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.11% (0.2700 => 0.3270, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.89% (0.1029 => 0.1244, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.61% (5.7591 => 6.9461, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.54% (1.3050 => 1.5731, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/matrix: 20.53% (0.3098 => 0.3734, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.07% (0.0842 => 0.1011, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.83% (0.0953 => 0.1142, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 19.73% (0.6456 => 0.7730, std.dev.: 0.0238) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 19.59% (0.1695 => 0.2027, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.37% (0.5860 => 0.6995, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.26% (4.9449 => 5.8972, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.18% (0.0834 => 0.0994, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.89% (0.8172 => 0.9716, std.dev.: 0.0210) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.87% (0.1940 => 0.2306, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.53% (5.0018 => 5.9284, std.dev.: 0.0107) MultiSource/Applications/d/make_dparser: 18.44% (3.3354 => 3.9503, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.85% (0.5020 => 0.5916, std.dev.: 0.0227) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.75% (0.0648 => 0.0763, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.71% (0.5569 => 0.6555, std.dev.: 0.0074) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.65% (0.7433 => 0.8745, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.62% (0.9765 => 1.1486, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.62% (0.1510 => 0.1776, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.54% (0.3307 => 0.3887, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/health/health: 17.51% (0.1268 => 0.1490, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.18% (0.2107 => 0.2469, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: 17.14% (1.1840 => 1.3869, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 17.00% (3.8723 => 4.5306, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/18-imp/imp: 16.94% (0.3423 => 0.4003, std.dev.: 0.0070) MultiSource/Applications/treecc/treecc: 16.88% (2.0273 => 2.3696, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.79% (0.5981 => 0.6985, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0056) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.37% (0.8101 => 0.9427, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.37% (0.2065 => 0.2403, std.dev.: 0.0113) MultiSource/Applications/siod/siod: 16.17% (2.2969 => 2.6684, std.dev.: 0.0257) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.89% (0.6450 => 0.7475, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 15.75% (0.3283 => 0.3800, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3232 => 0.3730, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810) MultiSource/Benchmarks/Prolangs-C/football/football: 15.05% (0.8921 => 1.0264, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/09-vor/vor: 14.97% (0.3180 => 0.3656, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/rem: 14.77% (0.1144 => 0.1313, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.56% (1.1861 => 1.3588, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.03% (0.8067 => 0.9199, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.98% (0.2603 => 0.2967, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: 13.58% (0.3379 => 0.3838, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.35% (0.3865 => 0.4381, std.dev.: 0.0129) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.75% (1.5603 => 1.7592, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.60% (0.4636 => 0.5220, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.23% (0.4103 => 0.4605, std.dev.: 0.0025) SingleSource/Benchmarks/Stanford/Puzzle: 11.99% (0.1268 => 0.1420, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.68% (0.4203 => 0.4694, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/oourafft: 11.37% (0.3282 => 0.3655, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 11.33% (17.1811 => 19.1275, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.32% (0.2430 => 0.2705, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 11.16% (0.3422 => 0.3804, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/sieve: 11.13% (0.3603 => 0.4004, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.95% (0.1114 => 0.1236, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: 10.94% (0.3684 => 0.4087, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.77% (0.3826 => 0.4238, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 10.70% (0.3927 => 0.4347, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.59% (0.3427 => 0.3790, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 10.34% (0.3886 => 0.4288, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (14.3668 => 15.8412, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 9.40% (0.2831 => 0.3097, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-4: 9.23% (0.3543 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.15% (0.3694 => 0.4032, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.13% (0.3473 => 0.3790, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 9.12% (10.3673 => 11.3132, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.09% (0.3543 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.07% (0.3561 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.96% (0.3516 => 0.3831, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.87% (2.0665 => 2.2497, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/except: 8.78% (0.2871 => 0.3123, std.dev.: 0.0082) SingleSource/Regression/C++/ofstream_ctor: 8.50% (0.2905 => 0.3152, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.40% (1.2842 => 1.3921, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.27% (0.3650 => 0.3952, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.27% (0.2891 => 0.3130, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.06% (0.3162 => 0.3417, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.03% (63.2438 => 68.3241, std.dev.: 0.0842) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: 7.93% (0.3052 => 0.3294, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.87% (0.2872 => 0.3098, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2793 => 0.3010, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.70% (0.3935 => 0.4238, std.dev.: 0.0091) SingleSource/UnitTests/ObjC++/property-reference-object: 7.66% (0.6030 => 0.6492, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.55% (0.7326 => 0.7879, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.33% (0.3136 => 0.3366, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.32% (0.5925 => 0.6359, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.17% (2.2022 => 2.3600, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.45% (7.9617 => 8.1567, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0438) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4767, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0183) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.77% (4.2280 => 4.4721, std.dev.: 0.0171) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1578 => 3.3097, std.dev.: 0.0117) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.19% (0.9957 => 1.0275, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9233, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7218, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2784, std.dev.: 0.0330) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2523, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1692, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.76% (5.2763 => 1.1735, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -75.26% (0.8651 => 0.2140, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.38% (5.3855 => 4.4496, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.84% (5.3526 => 4.4514, std.dev.: 0.0118) MultiSource/Applications/JM/ldecod/ldecod: -13.61% (10.4361 => 9.0156, std.dev.: 0.0258) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9461, std.dev.: 0.0535) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.65% (1.7609 => 1.6262, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -65.90% (1.9577 => 0.6676, std.dev.: 0.0059) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.72% (0.6962 => 0.3431, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.97% (0.3987 => 0.2473, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3039, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.48% (10.7105 => 7.4456, std.dev.: 0.0089) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7512, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -22.85% (3.3453 => 2.5809, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -20.31% (0.2161 => 0.1722, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1248, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0726) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2790, std.dev.: 0.0361) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.62% (8.1563 => 7.6979, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8411, std.dev.: 0.0441) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1556, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/lists: -1.84% (6.2999 => 6.1839, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.76% (4.6441 => 4.5622, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3309, std.dev.: 0.0400) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0033) Report Time: 1.50s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 00:51:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 02:51:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120085118.2402E2A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/7784?compare_to=7780&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7784, Order: 172964, Start Time: 2013-01-20 07:13:27, End Time: 2013-01-20 08:51:28 To: 7780, Order: 172958, Start Time: 2013-01-20 05:16:27, End Time: 2013-01-20 06:50:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (94 on baseline) Performance Improvements: 17 (107 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1085 (891 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.22% (8.5420 => 9.0730, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.32% (4.3479 => 4.4051, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.59% (0.7723 => 0.7446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.52% (0.8231 => 0.7941, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.31% (0.7392 => 0.7147, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.28% (0.7194 => 0.6958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.26% (0.7081 => 0.6850, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.19% (0.7185 => 0.6956, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.19% (0.8190 => 0.7929, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.19% (0.7187 => 0.6958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.14% (0.8634 => 0.8363, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.09% (0.7795 => 0.7554, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.05% (0.7562 => 0.7331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.98% (0.7456 => 0.7234, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.94% (0.7542 => 0.7320, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.84% (0.7891 => 0.7667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.54% (0.7631 => 0.7437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.47% (0.8420 => 0.8212, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vectorizer/gcc-loops: -1.19% (4.5028 => 4.4493, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 123.81% (0.0315 => 0.0705, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.35% (0.0514 => 0.0891, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.76% (0.0717 => 0.1210, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.99% (0.1132 => 0.1596, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.86% (0.6395 => 0.8752, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.81% (0.6260 => 0.8251, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.76% (0.0699 => 0.0921, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.69% (0.5456 => 0.7185, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.63% (0.5688 => 0.7487, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.49% (0.5805 => 0.7633, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.46% (0.5849 => 0.7689, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.91% (0.5567 => 0.7288, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.77% (0.6395 => 0.8363, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.64% (0.5575 => 0.7283, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.51% (0.5581 => 0.7284, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.62% (0.5941 => 0.7701, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.95% (0.5859 => 0.7555, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.84% (0.6033 => 0.7773, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.49% (0.6440 => 0.8275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.81% (0.6189 => 0.7910, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.76% (1.6474 => 2.1047, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.64% (0.6676 => 0.8521, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.27% (0.6230 => 0.7929, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.17% (0.6304 => 0.8017, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.16% (0.5802 => 0.7320, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.81% (0.6660 => 0.8379, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.52% (0.5925 => 0.7437, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.28% (0.5705 => 0.7147, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.17% (0.5857 => 0.7331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.05% (0.5478 => 0.6850, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.94% (0.5569 => 0.6958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.88% (0.5570 => 0.6956, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.45% (0.5591 => 0.6958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.38% (0.5863 => 0.7234, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.19% (0.6446 => 0.7941, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.10% (0.7524 => 0.9262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.03% (0.6052 => 0.7446, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.92% (0.6681 => 0.8212, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.96% (0.6194 => 0.7554, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.76% (0.6297 => 0.7667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.00% (0.6667 => 0.8067, std.dev.: 0.0164) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.78% (2.2587 => 2.7281, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.75% (0.7339 => 0.8715, std.dev.: 0.0166) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.33% (0.0833 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.88% (0.1146 => 0.1328, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.38% (1.1450 => 1.3096, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4515 => 0.5055, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.59% (0.4916 => 0.5486, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.49% (4.5069 => 5.0247, std.dev.: 0.1377) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.70% (3.5339 => 3.9120, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.65% (1.6364 => 1.8106, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.14% (0.1982 => 0.2183, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.60% (0.2385 => 0.2614, std.dev.: 0.0072) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1230 => 0.1343, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.05% (0.7021 => 0.7586, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.85% (1.2515 => 1.3498, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.45% (0.2001 => 0.2150, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 7.27% (0.4524 => 0.4853, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.89% (0.5329 => 0.5696, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (0.4861 => 0.5161, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 6.14% (9.2283 => 9.7946, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 4.79% (0.3255 => 0.3411, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.91% (5.0226 => 5.1690, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/bigfib: 2.73% (0.6750 => 0.6934, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (5.4682 => 5.6062, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 1.58% (0.8418 => 0.8551, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.10% (0.9557 => 0.9662, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8171, std.dev.: 0.0841) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9531 => 1.0298, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0074) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1476, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6127, std.dev.: 0.0418) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2821, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 1.60% (4.8812 => 4.9593, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2686, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -6.01% (0.3194 => 0.3002, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -5.53% (0.3831 => 0.3619, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -5.46% (0.3880 => 0.3668, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: -5.46% (0.3848 => 0.3638, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -5.46% (0.3812 => 0.3604, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -5.45% (0.6347 => 0.6001, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.34% (0.3896 => 0.3688, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.33% (0.4033 => 0.3818, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.32% (0.3891 => 0.3684, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.18% (0.7198 => 0.6825, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions: -5.17% (0.4176 => 0.3960, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -5.11% (0.6441 => 0.6112, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -5.08% (0.7779 => 0.7384, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.95% (0.3837 => 0.3647, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.95% (2.4924 => 2.3690, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.84% (0.3884 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -4.64% (0.4199 => 0.4004, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.35% (0.3057 => 0.2924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -4.30% (0.4280 => 0.4096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.25% (0.2871 => 0.2749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.15% (0.3323 => 0.3185, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.13% (0.2903 => 0.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: -4.07% (0.2849 => 0.2733, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.01% (0.3016 => 0.2895, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: -3.91% (0.2939 => 0.2824, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.79% (2.1713 => 2.0891, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.76% (0.3142 => 0.3024, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: -3.73% (0.3026 => 0.2913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.60% (0.3025 => 0.2916, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.54% (0.3252 => 0.3137, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1598, std.dev.: 0.0298) SingleSource/Benchmarks/Shootout-C++/lists: -2.90% (0.3621 => 0.3516, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.88% (0.3849 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.87% (0.3931 => 0.3818, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.80% (0.4427 => 0.4303, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.9542 => 0.9278, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/moments: -2.54% (0.4248 => 0.4140, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.20% (0.4813 => 0.4707, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.89% (1.2221 => 1.1990, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -1.49% (7.0961 => 6.9901, std.dev.: 0.0083) MultiSource/Benchmarks/Bullet/bullet: -1.41% (34.0927 => 33.6108, std.dev.: 0.0835) MultiSource/Applications/siod/siod: -1.41% (2.4021 => 2.3682, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.97% (1.8100 => 0.6884, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3082, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0271, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9203, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7557, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1964, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3572, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (7.9763 => 7.7825, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.12% (3.7241 => 3.6452, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.93% (1.3096 => 1.2843, std.dev.: 0.0055) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1737, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.51% (1.6219 => 1.5974, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5860, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6085, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 01:40:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 03:40:28 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120094028.1BC7C2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7785?compare_to=7781&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7785, Order: 172966, Start Time: 2013-01-20 07:37:50, End Time: 2013-01-20 09:40:39 To: 7781, Order: 172958, Start Time: 2013-01-20 05:15:46, End Time: 2013-01-20 07:18:10 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (3 on baseline) Performance Improvements: 1 (35 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1060 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 6.91% (47.5385 => 50.8248, std.dev.: 0.1649) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.21% (1.5431 => 1.5926, std.dev.: 0.0132) MultiSource/Applications/sqlite3/sqlite3: 2.50% (4.3162 => 4.4240, std.dev.: 0.0386) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.36% (0.9634 => 0.9407, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.74% (1.1295 => 1.1099, std.dev.: 0.2194) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0223 => 0.0224, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.00% (0.0420 => 0.0441, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.88% (0.0339 => 0.0336, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0320 => 0.0323, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0430 => 0.0429, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 1.46% (0.0206 => 0.0209, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0222 => 0.0222, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.87% (0.0230 => 0.0232, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.75% (0.1453 => 0.1493, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -1.04% (1.1656 => 1.1535, std.dev.: 0.0802) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.17% (0.4000 => 0.4087, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.33% (0.1472 => 0.1423, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.04% (0.1043 => 0.0980, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -23.11% (0.0264 => 0.0203, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.89% (0.0536 => 0.0589, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1486 => 1.1461, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 13.33% (0.0015 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.79% (0.0539 => 0.0581, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0314 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.76% (0.7492 => 0.7360, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 148.98% (0.0049 => 0.0122, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.03% (12.7833 => 12.7876, std.dev.: 0.0315) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323137.50% (0.0008 => 2.5859, std.dev.: 0.0639) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.68% (1.1825 => 2.4085, std.dev.: 0.0926) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.80% (0.2562 => 0.2890, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -46.66% (0.0808 => 0.0431, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.32% (0.0727 => 0.0492, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.87% (0.1684 => 0.1282, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.89% (0.1079 => 0.0886, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.82% (0.7686 => 0.6470, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.58% (1.0986 => 0.9384, std.dev.: 0.0440) MultiSource/Applications/aha/aha: -11.03% (0.1378 => 0.1226, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.90% (1.5131 => 1.3481, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.54% (0.7693 => 0.6882, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.90% (10.2703 => 9.2537, std.dev.: 0.3494) MultiSource/Benchmarks/Prolangs-C/loader/loader: -9.89% (0.3560 => 0.3208, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.58% (1.3924 => 1.2590, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.51% (1.6874 => 1.5270, std.dev.: 0.0147) MultiSource/Applications/lambda-0_1_3/lambda: -9.15% (0.8653 => 0.7861, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.88% (0.5746 => 0.5236, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.12% (1.0017 => 0.9404, std.dev.: 0.0112) MultiSource/Benchmarks/sim/sim: -4.25% (0.3715 => 0.3557, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.25% (0.9507 => 0.9103, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.15% (0.9127 => 0.8748, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.14% (0.9405 => 0.9016, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.89% (0.9788 => 0.9407, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.77% (0.4762 => 0.4630, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -11.26% (1.4588 => 1.2945, std.dev.: 0.0309) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.99% (4.4540 => 4.0981, std.dev.: 0.1079) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.78% (0.3201 => 0.2952, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.50% (23.3986 => 22.3452, std.dev.: 0.2032) SingleSource/Benchmarks/Misc/ffbench: -2.27% (1.4244 => 1.3920, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.03% (0.5826 => 0.5708, std.dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: -1.99% (2.0298 => 1.9894, std.dev.: 0.0132) MultiSource/Applications/hexxagon/hexxagon: -1.92% (14.0297 => 13.7598, std.dev.: 0.0811) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.87% (1.2047 => 1.1099, std.dev.: 0.2194) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.22% (0.0451 => 0.0441, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.42% (0.1530 => 0.1493, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -40.21% (1.9293 => 1.1535, std.dev.: 0.0802) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4049 => 0.4087, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.76% (0.1510 => 0.1423, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.20% (0.0978 => 0.0980, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.45% (0.0276 => 0.0203, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0590 => 0.0589, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.34% (1.1617 => 1.1461, std.dev.: 0.0399) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.75% (0.0610 => 0.0581, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.04% (0.7437 => 0.7360, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7781 => 12.7876, std.dev.: 0.0315) Report Time: 0.74s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 02:49:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 04:49:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120104904.CC6912A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7786?compare_to=7784&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7786, Order: 172968, Start Time: 2013-01-20 09:15:11, End Time: 2013-01-20 10:49:15 To: 7784, Order: 172964, Start Time: 2013-01-20 07:13:27, End Time: 2013-01-20 08:51:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (100 on baseline) Performance Improvements: 0 (124 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (868 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (79.9004 => 81.0760, std.dev.: 0.2639) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.35% (0.0514 => 0.0891, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 45.07% (0.1500 => 0.2176, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.08% (0.1132 => 0.1597, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.75% (0.6395 => 0.8745, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.77% (0.6260 => 0.8249, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.61% (0.5805 => 0.7640, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.56% (0.5688 => 0.7483, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.49% (0.5456 => 0.7174, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.08% (0.5849 => 0.7667, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.81% (0.5567 => 0.7282, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.63% (0.6395 => 0.8354, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.62% (0.5581 => 0.7290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.60% (0.5575 => 0.7281, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.51% (0.5941 => 0.7694, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.00% (0.5859 => 0.7558, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.90% (0.0699 => 0.0901, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.89% (0.6033 => 0.7776, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.48% (0.6440 => 0.8274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.84% (0.6189 => 0.7912, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.80% (1.6474 => 2.1054, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.53% (0.6676 => 0.8514, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.97% (0.6304 => 0.8004, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.89% (0.6230 => 0.7905, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.89% (0.5802 => 0.7304, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.71% (0.6660 => 0.8372, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.42% (0.5705 => 0.7155) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.20% (0.5925 => 0.7418, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.98% (0.5857 => 0.7320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.81% (0.5570 => 0.6952, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.81% (0.5478 => 0.6837, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.80% (0.5569 => 0.6950, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.43% (0.5591 => 0.6957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.23% (0.5863 => 0.7225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.13% (0.6446 => 0.7937, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.80% (0.6052 => 0.7432, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.79% (0.7524 => 0.9239, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.27% (0.6681 => 0.8169, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.89% (0.6194 => 0.7550, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.68% (0.6297 => 0.7662, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.89% (2.2587 => 2.7305, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.73% (0.6667 => 0.8049, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.74% (0.7339 => 0.8714, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (0.0833 => 0.0970, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 14.66% (0.3357 => 0.3849, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.28% (1.1450 => 1.3085, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.06% (0.1081 => 0.1233, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.66% (0.4916 => 0.5489, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.55% (4.5069 => 5.0276, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 11.52% (0.4515 => 0.5035, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.84% (3.5339 => 3.9170, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.65% (1.6364 => 1.8107, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.24% (0.1982 => 0.2185, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.43% (0.2385 => 0.2610, std.dev.: 0.0028) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.02% (0.1230 => 0.1341, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.7021 => 0.7609, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.65% (0.2001 => 0.2154, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 7.33% (1.2515 => 1.3432, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.02% (0.5329 => 0.5703, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.83% (0.4524 => 0.4833, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.4642 => 1.5595, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.42% (0.4861 => 0.5173, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.31% (1.2784 => 1.3591, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.30% (0.1731 => 0.1840, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (9.2283 => 9.7887, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 4.95% (0.3255 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3319 => 0.3461, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 2.92% (5.0226 => 5.1693, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6750 => 0.6946, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.59% (5.4682 => 5.6097, std.dev.: 0.0177) MultiSource/Applications/spiff/spiff: 1.59% (0.8418 => 0.8552, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 1.46% (0.7447 => 0.7556, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.19% (1.3722 => 1.3885, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.07% (0.9557 => 0.9659, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8033, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.64% (0.9531 => 1.0259, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4149, std.dev.: 0.1995) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.70% (79.7170 => 81.0760, std.dev.: 0.2639) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8210 => 28.2801, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6014, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2707, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -6.07% (0.3194 => 0.3000, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.94% (2.4924 => 2.3694, std.dev.: 0.0170) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.82% (0.3837 => 0.3652, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -4.55% (0.4176 => 0.3986, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.7198 => 0.6873, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -4.51% (0.6347 => 0.6061, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -4.45% (0.7779 => 0.7433, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.40% (0.9852 => 0.9419, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.34% (0.3821 => 0.3655, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.28% (0.2428 => 0.2324, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -4.27% (0.6441 => 0.6166, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.24% (0.3323 => 0.3182, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.12% (0.3057 => 0.2931, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -4.08% (0.2871 => 0.2754, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.01% (0.3142 => 0.3016, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.84% (0.3205 => 0.3082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.83% (0.2849 => 0.2740, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.81% (0.3016 => 0.2901, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.78% (0.2933 => 0.2822, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -3.77% (0.3025 => 0.2911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -3.74% (0.4280 => 0.4120, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/random: -3.67% (0.2939 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.65% (2.1713 => 2.0920, std.dev.: 0.0096) SingleSource/Regression/C++/ofstream_ctor: -3.60% (0.3059 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.57% (0.3252 => 0.3136, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2707, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.32% (0.4151 => 0.4013, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.07% (0.6484 => 0.6285, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.03% (0.3658 => 0.3547, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.98% (20.7746 => 20.1557, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/lists: -2.95% (0.3621 => 0.3514, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.9542 => 0.9265, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.72% (0.3931 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.64% (0.4427 => 0.4310, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.50% (0.4321 => 0.4213, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8573, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/moments: -2.42% (0.4248 => 0.4145, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.24% (1.2210 => 1.1936, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -2.24% (17.1032 => 16.7205, std.dev.: 0.0094) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.19% (6.7716 => 6.6230, std.dev.: 0.0118) MultiSource/Benchmarks/MallocBench/gs/gs: -2.14% (4.3330 => 4.2402, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.13% (1.2221 => 1.1961, std.dev.: 0.0041) MultiSource/Applications/lambda-0_1_3/lambda: -1.98% (0.7982 => 0.7824, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8734, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.96% (1.0544 => 1.0337, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.0961 => 6.9694, std.dev.: 0.0071) MultiSource/Applications/hbd/hbd: -1.76% (1.5610 => 1.5335, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.71% (1.2300 => 1.2090, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: -1.51% (0.9179 => 0.9040, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -1.44% (2.4021 => 2.3676, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -1.18% (4.0594 => 4.0114, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -1.06% (34.0927 => 33.7315, std.dev.: 0.0186) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.48% (1.8100 => 0.6610, std.dev.: 0.0245) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.93% (0.6962 => 0.3416, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3134, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.29% (4.3504 => 3.2500, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0266, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9278, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1294, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3566, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -9.07% (1.2842 => 1.1677, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.30% (7.9763 => 7.7927, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1193, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.08% (3.7241 => 3.6468, std.dev.: 0.0062) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1879, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.45% (6.5735 => 6.4779, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.45% (1.6219 => 1.5984, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6083, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 03:25:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 05:25:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120112534.6ADED2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7787?compare_to=7783&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7787, Order: 172968, Start Time: 2013-01-20 09:13:57, End Time: 2013-01-20 11:25:44 To: 7783, Order: 172964, Start Time: 2013-01-20 06:30:24, End Time: 2013-01-20 08:43:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (657 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.36% (1.9008 => 1.9266, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.47% (11.3132 => 11.0337, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1330 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0655 => 0.0655, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8456 => 499.8529, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.99% (1.1277 => 499.8529, std.dev.: 0.0076) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.36% (0.5229 => 1.6438, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 19.72% (14.9895 => 17.9457, std.dev.: 0.0220) MultiSource/Applications/kimwitu++/kc: 43.07% (14.1553 => 20.2526, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 17.40% (4.1105 => 4.8258, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.26% (1.1048 => 1.7264, std.dev.: 0.0024) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.09% (7.1582 => 37.3719, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.35% (3.4629 => 6.3494, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.77% (0.6222 => 1.0812, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.19% (0.0720 => 7.4435, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11148000.00% (0.0001 => 11.1481, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849100.00% (0.0001 => 9.8492, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486000.00% (0.0001 => 5.4861, std.dev.: 0.0124) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.32% (1.1194 => 10.2573, std.dev.: 0.0154) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.32% (22.1758 => 55.0680, std.dev.: 0.0483) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0069) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.40% (2.9384 => 4.6251, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.34% (7.0540 => 10.8165, std.dev.: 0.0127) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.59% (1.5859 => 2.3882, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.35% (8.1363 => 11.9074, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.69% (2.2024 => 3.0986, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 39.27% (0.3109 => 0.4330, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.27% (0.0439 => 0.0607, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 38.08% (21.9371 => 30.2918, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.01% (0.1062 => 0.1455, std.dev.: 0.0011) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.67% (4.2646 => 5.6577, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.35% (0.4615 => 0.6108, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.72% (1.5415 => 2.0305, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.03% (0.2271 => 0.2953, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/05-eks/eks: 29.17% (0.4299 => 0.5553, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 29.04% (1.1642 => 1.5023, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.00% (0.6675 => 0.8544, std.dev.: 0.0146) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 27.20% (0.0636 => 0.0809, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.59% (0.1892 => 0.2395, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.51% (0.0479 => 0.0606, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.50% (0.5105 => 0.6458, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.73% (0.0793 => 0.0997, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.69% (0.1125 => 0.1414, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.42% (3.8922 => 4.8817, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/08-main/main: 25.22% (0.2554 => 0.3198, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.11% (0.1143 => 0.1430, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 25.02% (0.1655 => 0.2069, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 23.64% (0.4289 => 0.5303, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 23.61% (1.0722 => 1.3254, std.dev.: 0.0170) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.61% (0.3121 => 0.3858, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.50% (1.4186 => 1.7520, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 22.88% (0.4620 => 0.5677, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 22.22% (9.4845 => 11.5915, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.01% (0.1695 => 0.2068, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 21.67% (0.7115 => 0.8657, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 21.48% (0.1555 => 0.1889, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.28% (0.0672 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.26% (0.2700 => 0.3274, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 20.98% (0.3098 => 0.3748, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/whetstone: 20.91% (0.0660 => 0.0798, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.68% (0.7835 => 0.9455, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/lists: 20.61% (0.0626 => 0.0755, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.50% (5.7591 => 6.9395, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.31% (0.1236 => 0.1487, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.30% (0.0675 => 0.0812, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.27% (1.3050 => 1.5695, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 19.84% (0.6456 => 0.7737, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.83% (0.0953 => 0.1142, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 19.53% (0.1695 => 0.2026, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 19.52% (0.1163 => 0.1390, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 19.37% (0.1151 => 0.1374, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.30% (0.0834 => 0.0995, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.19% (4.9449 => 5.8937, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.18% (0.5860 => 0.6984, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.11% (0.8172 => 0.9734, std.dev.: 0.0169) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.81% (0.1940 => 0.2305, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bisort/bisort: 18.73% (0.0614 => 0.0729, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 18.73% (0.7433 => 0.8825, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.40% (0.0886 => 0.1049, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.34% (5.0018 => 5.9191, std.dev.: 0.0098) MultiSource/Applications/d/make_dparser: 18.20% (3.3354 => 3.9426, std.dev.: 0.0157) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.73% (0.2758 => 0.3247, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.67% (0.5020 => 0.5907, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 17.43% (0.1268 => 0.1489, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.36% (0.3307 => 0.3881, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.31% (0.9765 => 1.1455, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.17% (0.5569 => 0.6525, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.10% (0.1117 => 0.1308, std.dev.: 0.0040) MultiSource/Applications/lua/lua: 16.94% (3.8723 => 4.5284, std.dev.: 0.0114) MultiSource/Benchmarks/nbench/nbench: 16.84% (1.1840 => 1.3834, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/18-imp/imp: 16.77% (0.3423 => 0.3997, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.65% (0.5981 => 0.6977, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 16.59% (2.0273 => 2.3637, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 16.17% (0.3283 => 0.3814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.08% (0.0933 => 0.1083, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.92% (0.8101 => 0.9391, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 15.87% (0.3232 => 0.3745, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 15.83% (2.2969 => 2.6605, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.60% (0.6450 => 0.7456, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 15.57% (0.2049 => 0.2368, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.52% (0.1044 => 0.1206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 14.81% (0.3180 => 0.3651, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.65% (0.8921 => 1.0228, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.34% (1.1861 => 1.3562, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 14.06% (0.3379 => 0.3854, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.72% (0.8067 => 0.9174, std.dev.: 0.0101) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3865 => 0.4377, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 13.02% (1.5603 => 1.7635, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.94% (0.4636 => 0.5236, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 12.90% (0.3387 => 0.3824, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.43% (0.4103 => 0.4613, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.04% (0.4203 => 0.4709, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 11.81% (0.4048 => 0.4526, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.75% (0.3422 => 0.3824, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.49% (0.3282 => 0.3659, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.1268 => 0.1412, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 11.32% (17.1811 => 19.1255, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.32% (0.2430 => 0.2705, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.80% (0.3092 => 0.3426, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.72% (0.3826 => 0.4236, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 10.47% (0.3886 => 0.4293, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.4064 => 0.4489, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.17% (14.3668 => 15.8283, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.07% (0.3427 => 0.3772, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.51% (0.3543 => 0.3880, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: 9.49% (0.3561 => 0.3899, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/trivial-interface: 9.47% (0.3473 => 0.3802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.38% (0.3497 => 0.3825, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (2.0665 => 2.2602, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions-3: 9.36% (0.3516 => 0.3845, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.20% (0.2871 => 0.3135, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.16% (0.1114 => 0.1216, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 8.90% (0.2877 => 0.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.64% (1.2842 => 1.3951, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.49% (0.2756 => 0.2990, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.49% (0.3052 => 0.3311, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2872 => 0.3113, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3935 => 0.4252, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.02% (63.2438 => 68.3174, std.dev.: 0.0967) SingleSource/Benchmarks/Shootout-C++/hello: 8.00% (0.2714 => 0.2931, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/Hello: 7.73% (0.5925 => 0.6383, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.72% (0.3136 => 0.3378, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.50% (2.2022 => 2.3674, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 6.43% (10.3673 => 11.0337, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.35% (0.4879 => 0.5189, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 3.61% (0.3131 => 0.3244) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.40% (7.9617 => 8.1524, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4767, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.32% (1.1396 => 1.2458, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4512, std.dev.: 0.0095) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3112, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.3316 => 0.3430, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1051, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.02% (0.9957 => 1.0258, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9111, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7227, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2206, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2714, std.dev.: 0.0233) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2510, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4561, std.dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.83% (5.2763 => 1.1699, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.39% (5.3855 => 4.4491, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.82% (5.3526 => 4.4523, std.dev.: 0.0145) MultiSource/Applications/JM/ldecod/ldecod: -13.77% (10.4361 => 8.9991, std.dev.: 0.0362) SingleSource/UnitTests/Vector/constpool: -7.89% (54.1659 => 49.8905, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.86% (1.7609 => 1.6225, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.30% (1.9577 => 0.6598, std.dev.: 0.0065) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.95% (0.3987 => 0.2474, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3088, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0227, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -30.50% (10.7105 => 7.4437, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -25.05% (85.0658 => 63.7570, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.31% (2.6546 => 2.0093, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7323, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4906, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3137, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7062, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.98% (1.2373 => 1.1633, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7045, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.58% (1.5835 => 1.5110, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8250, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.76% (4.6441 => 4.5622, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.6994 => 3.6375, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0094) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0036) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 03:59:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 05:59:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120115925.0F4C22A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7788?compare_to=7785&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7788, Order: 172969, Start Time: 2013-01-20 10:00:37, End Time: 2013-01-20 11:59:37 To: 7785, Order: 172966, Start Time: 2013-01-20 07:37:50, End Time: 2013-01-20 09:40:39 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (7 on baseline) Performance Improvements: 9 (99 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1047 (957 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.64% (4.7380 => 4.8157, std.dev.: 0.0244) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.84% (1.4588 => 1.8795, std.dev.: 0.0194) SingleSource/Benchmarks/Misc/pi: 27.31% (1.7397 => 2.2148, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.27% (5.5066 => 6.0721, std.dev.: 0.1057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.89% (7.1186 => 7.5378, std.dev.: 0.0716) MultiSource/Benchmarks/mafft/pairlocalalign: 2.41% (62.8587 => 64.3763, std.dev.: 0.1050) MultiSource/Applications/hexxagon/hexxagon: 1.79% (13.7598 => 14.0064, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/mandel: 1.47% (1.0399 => 1.0552, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.10% (0.2539 => 0.2435, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.73% (0.9228 => 0.9068, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.89% (2.3846 => 2.2919, std.dev.: 0.0305) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.24% (1.5926 => 1.5569, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.12% (1.4168 => 1.3868, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.89% (3.7957 => 3.7238, std.dev.: 0.0115) MultiSource/Benchmarks/BitBench/five11/five11: -1.44% (5.6949 => 5.6131, std.dev.: 0.0220) MultiSource/Applications/viterbi/viterbi: -1.29% (3.6641 => 3.6170, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/matrix: -1.05% (2.9090 => 2.8785, std.dev.: 0.0020) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.07% (1.1099 => 1.1091, std.dev.: 0.0291) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0224 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.13% (0.0441 => 0.0436, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0336 => 0.0337, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0323 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -11.89% (0.0429 => 0.0378, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -0.96% (0.0209 => 0.0207, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: -20.27% (0.0222 => 0.0177, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.86% (0.0232 => 0.0234, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: 44.44% (0.0009 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.15% (0.1493 => 0.1431, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -0.88% (1.1535 => 1.1434, std.dev.: 0.2823) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4087 => 0.3973, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.23% (0.1423 => 0.1469, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.63% (0.0980 => 0.0996, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.03% (0.0203 => 0.0266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.81% (0.0589 => 0.0543, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.45% (1.1461 => 1.1513, std.dev.: 0.0977) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0017 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.44% (0.0581 => 0.0601, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (0.0314 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.61% (0.7360 => 0.7405, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -69.67% (0.0122 => 0.0037, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (12.7876 => 12.7592, std.dev.: 0.0154) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320700.00% (0.0008 => 2.5664, std.dev.: 0.0277) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.23% (1.1825 => 2.3441, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.37% (5.6033 => 6.0721, std.dev.: 0.1057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.08% (0.2562 => 0.2769, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.66% (7.0016 => 7.5378, std.dev.: 0.0716) SingleSource/Benchmarks/Misc/pi: 3.54% (2.1390 => 2.2148, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.94% (63.1520 => 64.3763, std.dev.: 0.1050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.09% (0.0808 => 0.0476, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-3: -27.27% (0.0374 => 0.0272, std.dev.: 0.0031) SingleSource/Benchmarks/SmallPT/smallpt: -26.85% (0.1888 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.86% (0.1684 => 0.1299, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.30% (0.1009 => 0.0784, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -20.81% (1.8964 => 1.5018, std.dev.: 0.0827) MultiSource/Benchmarks/VersaBench/dbms/dbms: -19.11% (1.0960 => 0.8865, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.77% (0.7686 => 0.6243, std.dev.: 0.0367) MultiSource/Applications/spiff/spiff: -14.95% (1.0220 => 0.8692, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.76% (1.0986 => 0.9365, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -12.80% (1.5979 => 1.3933, std.dev.: 0.0756) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.22% (1.2154 => 1.0669, std.dev.: 0.0432) MultiSource/Applications/aha/aha: -11.83% (0.1378 => 0.1215, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -11.79% (4.6406 => 4.0937, std.dev.: 0.2112) MultiSource/Applications/sgefa/sgefa: -11.62% (0.3598 => 0.3180, std.dev.: 0.0119) MultiSource/Applications/hexxagon/hexxagon: -11.61% (1.1433 => 1.0106, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.49% (6.4235 => 5.6853, std.dev.: 0.0869) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.42% (1.6874 => 1.5116, std.dev.: 0.0592) MultiSource/Applications/sqlite3/sqlite3: -9.84% (17.5634 => 15.8351, std.dev.: 0.6230) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.61% (0.2372 => 0.2144, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.37% (1.1498 => 1.0421, std.dev.: 0.0372) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (0.1240 => 0.1127, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.66% (0.1317 => 0.1203, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: -8.56% (17.4365 => 15.9443, std.dev.: 0.2934) MultiSource/Applications/d/make_dparser: -7.66% (3.7840 => 3.4941, std.dev.: 0.0196) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -7.49% (0.2709 => 0.2506, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.88% (0.2615 => 0.2435, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.73% (0.1798 => 0.1677, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.52% (0.2100 => 0.1963, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.30% (0.7693 => 0.7208, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.13% (1.0017 => 0.9403, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: -5.92% (0.5134 => 0.4830, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: -5.91% (0.1928 => 0.1814, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: -5.88% (0.2006 => 0.1888, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.62% (0.4002 => 0.3777, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.55% (0.9550 => 0.9020, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.46% (0.3093 => 0.2924, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.42% (1.3310 => 1.2589, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/matrix: -5.03% (0.2385 => 0.2265, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.44% (0.9507 => 0.9085, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.38% (0.9422 => 0.9009, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.37% (0.3981 => 0.3807, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.33% (0.9127 => 0.8732, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.31% (0.3665 => 0.3507, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.30% (0.3462 => 0.3313, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.26% (1.3220 => 1.2657, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: -4.26% (0.2725 => 0.2609, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -4.04% (0.2551 => 0.2448, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.99% (0.8990 => 0.8631, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.95% (0.9512 => 0.9136, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.91% (0.9788 => 0.9405, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: -3.90% (0.3206 => 0.3081, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.85% (0.9405 => 0.9043, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.83% (0.9091 => 0.8743, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.82% (0.5369 => 0.5164, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: -3.64% (0.6711 => 0.6467, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.58% (1.0052 => 0.9692, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.56% (0.9403 => 0.9068, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.30% (0.9993 => 0.9663, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: -3.26% (0.4689 => 0.4536, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.76% (0.9488 => 0.9226, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.61% (1.0860 => 1.0577, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.19% (1.0119 => 0.9897, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.06% (0.9855 => 0.9652, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.93% (4.9104 => 4.8157, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.83% (0.8926 => 0.8763, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.78% (0.9061 => 0.8900, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.36% (0.9612 => 0.9481, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.96% (0.9372 => 0.6470, std.dev.: 0.1104) SingleSource/Benchmarks/Shootout/heapsort: -29.82% (4.4739 => 3.1400, std.dev.: 0.3526) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.72% (4.2042 => 3.1649, std.dev.: 0.2714) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.19% (0.1164 => 0.0929, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.04% (1.5623 => 1.2805, std.dev.: 0.0469) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.71% (2.8778 => 2.3681, std.dev.: 0.1179) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.38% (0.0845 => 0.0715, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: -8.64% (0.2200 => 0.2010, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: -8.54% (0.6628 => 0.6062, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.52% (0.3217 => 0.2943, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.77% (1.4588 => 1.3455, std.dev.: 0.0247) MultiSource/Benchmarks/Olden/health/health: -6.54% (0.3654 => 0.3415, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: -6.31% (2.2304 => 2.0897, std.dev.: 0.0309) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.07% (16.6791 => 15.6669, std.dev.: 0.1626) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.22% (0.3201 => 0.3034, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.00% (1.4446 => 1.3868, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/lists: -3.59% (17.2182 => 16.5997, std.dev.: 0.0664) MultiSource/Applications/SIBsim4/SIBsim4: -3.53% (3.5443 => 3.4193, std.dev.: 0.0421) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.35% (40.4729 => 39.1170, std.dev.: 0.0864) SingleSource/Benchmarks/Misc/mandel-2: -2.28% (0.8521 => 0.8327, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.14% (3.5669 => 3.4905, std.dev.: 0.0288) MultiSource/Applications/spiff/spiff: -2.04% (2.8571 => 2.7989, std.dev.: 0.0207) MultiSource/Benchmarks/Bullet/bullet: -1.89% (7.2040 => 7.0682, std.dev.: 0.0134) MultiSource/Benchmarks/BitBench/five11/five11: -1.56% (5.7021 => 5.6131, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3151, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.13% (3.7662 => 3.7238, std.dev.: 0.0115) SingleSource/Benchmarks/SmallPT/smallpt: -1.05% (14.9448 => 14.7872, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/matrix: -1.02% (2.9083 => 2.8785, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.02% (3.5321 => 3.4962, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.94% (1.2047 => 1.1091, std.dev.: 0.0291) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.06% (0.0445 => 0.0378, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/test1: -22.03% (0.0227 => 0.0177, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.24% (0.0255 => 0.0234, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.47% (0.1530 => 0.1431, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -40.73% (1.9293 => 1.1434, std.dev.: 0.2823) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.88% (0.4049 => 0.3973, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.72% (0.1510 => 0.1469, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.84% (0.0978 => 0.0996, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.62% (0.0276 => 0.0266, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.97% (0.0590 => 0.0543, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.90% (1.1617 => 1.1513, std.dev.: 0.0977) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.48% (0.0610 => 0.0601, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.43% (0.7437 => 0.7405, std.dev.: 0.0071) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.78% (0.0092 => 0.0037, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7781 => 12.7592, std.dev.: 0.0154) Report Time: 0.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 04:14:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 06:14:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130120121414.A9A6B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7789?compare_to=7782&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7789, Order: 172966, Start Time: 2013-01-20 08:39:46, End Time: 2013-01-20 12:14:26 To: 7782, Order: 172953, Start Time: 2013-01-20 03:54:32, End Time: 2013-01-20 07:29:15 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (178 on baseline) Performance Improvements: 3 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (759 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 7.58% (0.2099 => 0.2258, std.dev.: 0.0024) SingleSource/Benchmarks/Dhrystone/dry: 1.92% (13.5374 => 13.7969, std.dev.: 0.0986) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.80% (2.0665 => 2.1037, std.dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/d/make_dparser: -1.06% (1.2678 => 1.2544, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -7.72% (0.1295 => 0.1195, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.05% (0.6229 => 0.6101, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.60% (0.0625 => 0.0885, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.22% (0.2969 => 0.3807, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.33% (0.0547 => 0.0691, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.13% (0.1106 => 0.1395, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.07% (0.4139 => 0.5218, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.26% (0.0475 => 0.0595, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.08% (0.5900 => 0.7380, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.93% (0.0714 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.83% (0.0584 => 0.0729, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.81% (0.4253 => 0.5308, std.dev.: 0.0024) MultiSource/Applications/oggenc/oggenc: 24.64% (1.5932 => 1.9857, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.63% (0.4994 => 0.6224, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.14% (0.1549 => 0.1923, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.90% (0.5000 => 0.6195, std.dev.: 0.0172) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.75% (0.0897 => 0.1110, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.52% (0.1620 => 0.2001, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.60% (0.0584 => 0.0716, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.29% (0.3903 => 0.4773, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.26% (0.0948 => 0.1159, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.13% (0.1604 => 0.1959, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.77% (0.1107 => 0.1348, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.67% (0.1103 => 0.1342, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 21.44% (0.0821 => 0.0997, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.41% (0.0822 => 0.0998, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.00% (0.1619 => 0.1959, std.dev.: 0.0036) MultiSource/Applications/viterbi/viterbi: 20.27% (0.0947 => 0.1139, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.97% (0.1462 => 0.1754, std.dev.: 0.0040) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.76% (0.1088 => 0.1303, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.61% (0.2014 => 0.2409, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 19.54% (0.1218 => 0.1456, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.31% (0.3890 => 0.4641, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: 19.29% (0.4029 => 0.4806, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.2736 => 0.3262, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.84% (0.2866 => 0.3406, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 18.39% (0.5546 => 0.6566, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.12% (1.3152 => 1.5535, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.04% (0.3271 => 0.3861, std.dev.: 0.0131) MultiSource/Benchmarks/MallocBench/gs/gs: 18.00% (1.8794 => 2.2177, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.98% (0.2875 => 0.3392, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.64% (3.5627 => 4.1912, std.dev.: 0.0639) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.60% (0.4658 => 0.5478, std.dev.: 0.0123) SingleSource/UnitTests/ObjC++/Hello: 17.59% (0.5826 => 0.6851, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 17.56% (0.2750 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.48% (0.1968 => 0.2312, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.47% (1.6211 => 1.9043, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/fibo: 17.43% (0.2725 => 0.3200, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.42% (0.2738 => 0.3215, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 17.39% (0.2823 => 0.3314, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.38% (0.2911 => 0.3417, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.37% (0.2792 => 0.3277, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.36% (0.2811 => 0.3299, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 17.35% (0.2813 => 0.3301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 17.32% (0.2714 => 0.3184, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 17.27% (0.2803 => 0.3287, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 17.27% (0.2780 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.19% (0.2729 => 0.3198, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 17.18% (0.3096 => 0.3628, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 17.17% (0.5889 => 0.6900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.07% (2.0673 => 2.4202, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 17.01% (0.3004 => 0.3515, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.84% (0.3195 => 0.3733, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: 16.81% (0.9909 => 1.1575, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: 16.81% (0.9697 => 1.1327, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.72% (0.3930 => 0.4587, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 16.64% (0.3258 => 0.3800, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 16.62% (0.3267 => 0.3810, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.60% (0.3060 => 0.3568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 16.40% (0.3317 => 0.3861, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.40% (0.4361 => 0.5076, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.35% (0.5026 => 0.5848, std.dev.: 0.0093) MultiSource/Applications/d/make_dparser: 16.35% (1.0781 => 1.2544, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.23% (1.9694 => 2.2891, std.dev.: 0.0403) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.19% (0.3625 => 0.4212, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.13% (0.3124 => 0.3628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.98% (0.3348 => 0.3883, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 15.96% (0.3678 => 0.4265, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/sieve: 15.94% (0.3726 => 0.4320, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.88% (0.3362 => 0.3896, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.87% (0.3282 => 0.3803, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.79% (4.2109 => 4.8759, std.dev.: 0.1013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.76% (1.9966 => 2.3113, std.dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/lists1: 15.76% (0.3477 => 0.4025, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 15.76% (0.7171 => 0.8301, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 15.61% (23.5202 => 27.1924, std.dev.: 0.1221) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.54% (4.4195 => 5.1063, std.dev.: 0.0384) SingleSource/Benchmarks/Shootout-C++/hash2: 15.53% (0.4251 => 0.4911, std.dev.: 0.0127) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.51% (2.7292 => 3.1524, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout-C++/hash: 15.34% (0.4146 => 0.4782, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.12% (0.3690 => 0.4248, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.12% (0.3981 => 0.4583, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.08% (1.4269 => 1.6421, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 15.04% (0.2566 => 0.2952, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.88% (0.3845 => 0.4417, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/bigfib: 14.47% (0.5012 => 0.5737, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 14.27% (0.7875 => 0.8999, std.dev.: 0.0177) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.47% (0.3488 => 0.3958, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 13.45% (0.3442 => 0.3905, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.44% (0.3496 => 0.3966, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.44% (0.6435 => 0.7300, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 13.39% (0.3465 => 0.3929, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 13.38% (0.3446 => 0.3907, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.32% (0.3460 => 0.3921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.30% (0.2075 => 0.2351, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.12% (2.1653 => 2.4493, std.dev.: 0.0373) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.04% (0.2691 => 0.3042, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.92% (0.3724 => 0.4205, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.90% (0.3643 => 0.4113, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.87% (5.5417 => 6.2551, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.68% (0.2737 => 0.3084, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: 12.60% (4.6177 => 5.1995, std.dev.: 0.0714) MultiSource/Benchmarks/mafft/pairlocalalign: 12.46% (2.1013 => 2.3632, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.24% (0.5361 => 0.6017, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.2068 => 0.2318, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.77% (0.3084 => 0.3447, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.13% (0.2040 => 0.2267, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 11.06% (0.3336 => 0.3705, std.dev.: 0.0053) MultiSource/Applications/siod/siod: 10.96% (0.6634 => 0.7361, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 10.85% (0.4847 => 0.5373, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.65% (0.2103 => 0.2327, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.60% (11.6398 => 12.8732, std.dev.: 0.0120) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.90% (0.7426 => 0.8161, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.76% (0.1383 => 0.1518, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.53% (4.6926 => 5.1400, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: 9.42% (2.0346 => 2.2262, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.49% (0.5584 => 0.6058, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8550, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.14% (0.3792 => 0.3949, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.90% (29.0505 => 181.5353, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0094) MultiSource/Applications/ClamAV/clamscan: 9.28% (0.2802 => 0.3062, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.23% (0.3693 => 0.3997, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 6.41% (0.2122 => 0.2258, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2379, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6684, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6907, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8904, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2129, std.dev.: 0.0417) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2908, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2078, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5390, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4789, std.dev.: 0.0036) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5832, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.09% (2.4764 => 2.4246, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5756, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.18% (17.2379 => 14.2759, std.dev.: 0.1085) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7995, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9595, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -6.99% (0.2402 => 0.2234, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2129, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.05% (0.6293 => 0.6101, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1890, std.dev.: 0.0382) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1639, std.dev.: 0.0499) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.01% (16.2163 => 16.0520, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 04:46:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 06:46:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120124619.336072A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7790?compare_to=7786&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7790, Order: 172971, Start Time: 2013-01-20 11:12:44, End Time: 2013-01-20 12:46:30 To: 7786, Order: 172968, Start Time: 2013-01-20 09:15:11, End Time: 2013-01-20 10:49:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (135 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.48% (0.6610 => 0.6906, std.dev.: 0.0097) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.35% (0.0514 => 0.0891, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.62% (0.0717 => 0.1209, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.81% (0.0974 => 0.1615, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 40.82% (0.0267 => 0.0376, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.73% (0.0599 => 0.0825, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.62% (0.6395 => 0.8737, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.05% (0.0699 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.65% (0.6260 => 0.8241, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.39% (0.5805 => 0.7627, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.38% (0.5688 => 0.7473, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.38% (0.5456 => 0.7168, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.10% (0.5849 => 0.7668, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.75% (0.5567 => 0.7279, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.46% (0.5581 => 0.7281, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.44% (0.5575 => 0.7272, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.43% (0.6395 => 0.8341, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.47% (0.5941 => 0.7692, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.84% (0.5859 => 0.7549, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.79% (0.6033 => 0.7770, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.23% (0.6440 => 0.8258, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.70% (1.6474 => 2.1038, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.63% (0.6189 => 0.7899, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.44% (0.6676 => 0.8508, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.92% (0.6304 => 0.8001, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.84% (0.6230 => 0.7902, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.82% (0.5802 => 0.7300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.60% (0.6660 => 0.8365, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.06% (0.5925 => 0.7410, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.03% (0.5705 => 0.7133, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.71% (0.5857 => 0.7304, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.70% (0.5478 => 0.6831, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.62% (0.5569 => 0.6940, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.60% (0.5570 => 0.6940, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.56% (0.0790 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.11% (0.5591 => 0.6939, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (0.5863 => 0.7219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.08% (0.6446 => 0.7934, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.83% (0.7524 => 0.9242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.59% (0.6052 => 0.7419, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.24% (0.6681 => 0.8167, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.81% (0.6194 => 0.7545, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.68% (0.6297 => 0.7662, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.01% (2.2587 => 2.7332, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.59% (0.6667 => 0.8040, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.45% (0.7339 => 0.8693, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.33% (0.0833 => 0.0969) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.79% (0.1146 => 0.1327, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 14.71% (0.0707 => 0.0811, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.66% (0.3357 => 0.3849, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.18% (1.1450 => 1.3074, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.43% (4.5069 => 5.0219, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.37% (0.4916 => 0.5475, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.27% (0.4515 => 0.5024, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.80% (3.5339 => 3.9156, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.52% (1.6364 => 1.8085, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.29% (0.1982 => 0.2186, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.22% (0.2385 => 0.2605, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.94% (0.1230 => 0.1340, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.26% (0.7021 => 0.7601, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.27% (1.2515 => 1.3425, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.10% (0.2001 => 0.2143, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.91% (0.5329 => 0.5697, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 6.48% (0.4524 => 0.4817, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.35% (1.4642 => 1.5572, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.26% (1.2784 => 1.3584, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.24% (0.1731 => 0.1839, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (9.2283 => 9.7963, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 5.92% (0.4861 => 0.5149, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.49% (0.3255 => 0.3401, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.11% (5.0226 => 5.1788, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 2.62% (0.6750 => 0.6927, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (5.4682 => 5.6062, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: 2.38% (1.3864 => 1.4194, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 1.82% (0.8418 => 0.8571, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.09% (1.3722 => 1.3872, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7967, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.41% (0.2380 => 0.2485, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1468, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.51% (54.5751 => 56.4922, std.dev.: 0.1050) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1017, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2825, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (79.7170 => 80.8130, std.dev.: 0.1677) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.20% (10.3489 => 10.4733, std.dev.: 0.0467) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -6.57% (0.3194 => 0.2984, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -6.16% (0.3812 => 0.3577, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -6.08% (0.3880 => 0.3644, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -6.06% (0.3831 => 0.3599, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -6.03% (0.3848 => 0.3616, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -6.02% (0.3884 => 0.3650, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -5.98% (0.3896 => 0.3663, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -5.94% (0.3891 => 0.3660, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -5.90% (0.4033 => 0.3795, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: -5.68% (0.4176 => 0.3939, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.45% (0.3837 => 0.3628, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -5.22% (0.4199 => 0.3980, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -5.20% (0.6347 => 0.6017, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.95% (2.4924 => 2.3691) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.91% (0.3323 => 0.3160, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -4.88% (0.7779 => 0.7399, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: -4.83% (0.6441 => 0.6130, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.79% (0.7198 => 0.6853, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -4.79% (0.4280 => 0.4075, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.67% (0.2871 => 0.2737, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.58% (0.3057 => 0.2917, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.51% (0.2903 => 0.2772, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.50% (0.9852 => 0.9409, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.31% (0.3016 => 0.2886, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -4.31% (0.3205 => 0.3067, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.30% (0.2933 => 0.2807, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -4.28% (0.3059 => 0.2928, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: -4.28% (0.2849 => 0.2727, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -4.26% (0.3025 => 0.2896, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -4.22% (2.1713 => 2.0797, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.17% (0.3142 => 0.3011, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -4.09% (0.3252 => 0.3119, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -4.03% (0.3026 => 0.2904, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -3.84% (1.3148 => 1.2643, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/BoolLiteralTest: -3.76% (0.3834 => 0.3690, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.71% (0.4151 => 0.3997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: -3.38% (0.2989 => 0.2888, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/lists: -3.26% (0.3621 => 0.3503, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.25% (0.3849 => 0.3724, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.23% (0.3931 => 0.3804, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -3.08% (0.3867 => 0.3748, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.07% (0.6484 => 0.6285, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.91% (0.9542 => 0.9264, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.80% (0.4427 => 0.4303, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.72% (20.7746 => 20.2088, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.62% (0.4321 => 0.4208, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.58% (14.2083 => 13.8416, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.58% (0.7919 => 0.7715, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/moments: -2.57% (0.4248 => 0.4139, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.50% (6.7716 => 6.6026, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -2.41% (17.1032 => 16.6903, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: -2.28% (4.3330 => 4.2343, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.25% (1.2221 => 1.1946, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.23% (1.2210 => 1.1938, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -2.16% (0.4813 => 0.4709, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -2.11% (16.1920 => 15.8508, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -2.01% (1.0544 => 1.0332, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -1.98% (0.7982 => 0.7824, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -1.97% (1.5610 => 1.5303, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.89% (1.2300 => 1.2068, std.dev.: 0.0020) MultiSource/Applications/JM/ldecod/ldecod: -1.85% (7.0961 => 6.9645, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -1.60% (0.9179 => 0.9032, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -1.55% (2.4021 => 2.3649, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -1.49% (34.0927 => 33.5840, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.48% (0.8521 => 0.8395, std.dev.: 0.0016) MultiSource/Applications/lua/lua: -1.28% (4.0594 => 4.0075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.25% (8.0126 => 7.9127, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.85% (1.8100 => 0.6906, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.73% (0.6962 => 0.3430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0289, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9253, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7590, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1977, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1281, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.78% (0.5142 => 0.4639, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6338, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.02% (1.3096 => 1.2701, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7753, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6408, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1737, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4627, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.24% (1.6219 => 1.6018, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.6307 => 1.6111, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6698, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.6086 => 1.5919, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 06:07:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 08:07:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120140710.15E0E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7791?compare_to=7787&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7791, Order: 172971, Start Time: 2013-01-20 11:56:15, End Time: 2013-01-20 14:07:21 To: 7787, Order: 172968, Start Time: 2013-01-20 09:13:57, End Time: 2013-01-20 11:25:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.55% (11.0337 => 11.2050, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1329 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0655 => 0.0654, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8529 => 499.8353, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44223.43% (1.1277 => 499.8353, std.dev.: 0.0115) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.55% (0.5229 => 1.6448, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 20.11% (14.9895 => 18.0040, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 43.41% (14.1553 => 20.3006, std.dev.: 0.0152) MultiSource/Benchmarks/MallocBench/gs/gs: 18.14% (4.1105 => 4.8563, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.46% (1.1048 => 1.7286, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.02% (7.1582 => 37.4390, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.66% (3.4629 => 6.3601, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.20% (0.6222 => 1.0839, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10244.17% (0.0720 => 7.4478, std.dev.: 0.0048) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11177300.00% (0.0001 => 11.1774, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482000.00% (0.0001 => 5.4821, std.dev.: 0.0293) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.81% (1.1194 => 10.2516, std.dev.: 0.0021) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783) MultiSource/Applications/ClamAV/clamscan: 148.37% (22.1758 => 55.0783, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.45% (0.0929 => 0.1825, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 70.88% (0.1463 => 0.2500, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.73% (2.9384 => 4.6347, std.dev.: 0.0017) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.88% (7.0540 => 10.7840, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.14% (1.5859 => 2.3970, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.45% (8.1363 => 11.9160, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.18% (2.2024 => 3.1093, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/flops: 39.66% (0.1432 => 0.2000, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.50% (0.3109 => 0.4337, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.06% (21.9371 => 30.2864, std.dev.: 0.0101) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0006) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.08% (4.2646 => 5.6752, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.50% (0.4615 => 0.6115, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.05% (1.5415 => 2.0355, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 31.94% (0.0814 => 0.1074, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.99% (0.2271 => 0.2952, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 29.57% (0.4299 => 0.5570, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 29.15% (1.1642 => 1.5036, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.45% (0.6675 => 0.8574, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.82% (0.5105 => 0.6474, std.dev.: 0.0141) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.64% (0.1892 => 0.2396, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.60% (0.1143 => 0.1447, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.23% (0.0793 => 0.1001, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.87% (3.8922 => 4.8993, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 25.61% (0.2554 => 0.3208, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.65% (0.1566 => 0.1952, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.32% (0.4289 => 0.5332, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.03% (0.3121 => 0.3871, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 23.94% (1.0722 => 1.3289, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.83% (1.4186 => 1.7566, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 23.66% (0.1175 => 0.1453, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.15% (0.0730 => 0.0899, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.01% (0.4620 => 0.5683, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 22.55% (9.4845 => 11.6230, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.77% (0.7115 => 0.8664, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.15% (0.2700 => 0.3271, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.89% (0.1029 => 0.1244, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.58% (5.7591 => 6.9446, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.55% (0.0842 => 0.1015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.49% (1.3050 => 1.5724, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.23% (0.7835 => 0.9420, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 20.00% (0.6456 => 0.7747, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.77% (0.1032 => 0.1236, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 19.72% (0.1151 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.69% (0.1163 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.64% (0.1940 => 0.2321, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.51% (4.9449 => 5.9096, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.39% (0.5860 => 0.6996, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.06% (0.0834 => 0.0993, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.05% (0.8172 => 0.9729, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.69% (5.0018 => 5.9366, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.62% (0.0886 => 0.1051, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.61% (3.3354 => 3.9562, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.91% (0.7433 => 0.8764, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.83% (0.5020 => 0.5915, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.77% (0.2758 => 0.3248, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.65% (0.5569 => 0.6552, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 17.59% (0.1268 => 0.1491, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.54% (0.3307 => 0.3887, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.52% (0.9765 => 1.1476, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.32% (0.2107 => 0.2472, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.3423 => 0.4013, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.19% (0.1117 => 0.1309, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 17.13% (1.1840 => 1.3868, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.01% (3.8723 => 4.5310, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 16.86% (2.0273 => 2.3692, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.74% (0.5981 => 0.6982, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 16.30% (0.2049 => 0.2383, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 16.27% (0.3283 => 0.3817, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.26% (2.2969 => 2.6704, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.10% (0.3441 => 0.3995, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.90% (0.3232 => 0.3746, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.87% (0.8101 => 0.9387, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.69% (0.6450 => 0.7462, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/football/football: 15.21% (0.8921 => 1.0278, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.00% (0.3180 => 0.3657, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 14.69% (0.1144 => 0.1312, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.52% (1.1861 => 1.3583, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.37% (0.8067 => 0.9226, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.12% (0.3379 => 0.3856, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.43% (0.3865 => 0.4384, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.07% (0.4636 => 0.5242, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.86% (1.5603 => 1.7609, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.72% (0.4103 => 0.4625, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.11% (0.4203 => 0.4712, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: 11.75% (0.3422 => 0.3824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.66% (0.4048 => 0.4520, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 11.66% (0.3603 => 0.4023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.64% (0.3282 => 0.3664, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.40% (17.1811 => 19.1406, std.dev.: 0.0064) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.18% (0.3684 => 0.4096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.18% (0.3927 => 0.4366, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3826 => 0.4249, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 10.90% (0.3092 => 0.3429, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 10.73% (0.3886 => 0.4303, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.46% (0.4064 => 0.4489, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.43% (14.3668 => 15.8646, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.39% (0.3427 => 0.3783, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.03% (0.3828 => 0.4212, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.78% (0.2831 => 0.3108, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.58% (0.3561 => 0.3902, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.54% (0.3543 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3473 => 0.3803, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.44% (0.3497 => 0.3827, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.21% (2.0665 => 2.2569, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: 9.21% (0.2877 => 0.3142, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.05% (0.2905 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 8.75% (1.2842 => 1.3966, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.70% (0.3162 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.70% (0.2714 => 0.2950, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.63% (0.3650 => 0.3965, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.49% (0.2756 => 0.2990, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 8.49% (0.3052 => 0.3311, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.39% (0.2802 => 0.3037, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.23% (0.3935 => 0.4259, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 8.11% (63.2438 => 68.3746, std.dev.: 0.0159) SingleSource/UnitTests/ObjC++/property-reference-object: 8.09% (0.6030 => 0.6518, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.08% (10.3673 => 11.2050, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.71% (0.7326 => 0.7891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.65% (0.5925 => 0.6378, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.32% (2.2022 => 2.3634, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.3131 => 0.3252, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.9617 => 8.1490, std.dev.: 0.0148) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4757, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4528, std.dev.: 0.0127) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3130, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1066, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.95% (0.9957 => 1.0251, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9065, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.49% (3.6395 => 3.7300, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2824, std.dev.: 0.0209) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2484, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5755, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4502, std.dev.: 0.0242) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.79% (5.2763 => 1.1720, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -75.34% (0.8651 => 0.2133, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (5.3855 => 4.4442, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.88% (5.3526 => 4.4489, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -13.58% (10.4361 => 9.0190, std.dev.: 0.0163) SingleSource/UnitTests/Vector/constpool: -7.92% (54.1659 => 49.8739, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.84% (1.7609 => 1.6229, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.17% (1.9577 => 0.6622, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.95% (0.3987 => 0.2474, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3065, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.50% (10.7105 => 7.4439, std.dev.: 0.0217) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7644, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.79% (2.5528 => 2.1243, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7342, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4924, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2776, std.dev.: 0.1161) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.05% (1.8329 => 1.7037, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) SingleSource/Benchmarks/McGill/chomp: -6.13% (1.2373 => 1.1614, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.48% (8.1563 => 7.7097, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8406, std.dev.: 0.0016) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.85% (4.6441 => 4.5580, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.76% (3.6994 => 3.6342, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6705, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0057) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0019) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 06:15:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 08:15:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120141538.901202A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7792?compare_to=7788&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7792, Order: 172971, Start Time: 2013-01-20 12:16:52, End Time: 2013-01-20 14:15:51 To: 7788, Order: 172969, Start Time: 2013-01-20 10:00:37, End Time: 2013-01-20 11:59:37 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (8 on baseline) Performance Improvements: 1 (132 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (923 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.78% (0.6290 => 0.6842, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.97% (0.5168 => 0.5425, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.15% (0.8865 => 0.9233, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.99% (0.6243 => 0.6492, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.77% (1.5116 => 1.5384, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.72% (0.6880 => 0.6998, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.62% (0.8337 => 0.8472, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.59% (1.0421 => 1.0587, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.59% (0.6285 => 0.6385, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.43% (0.7208 => 0.7311, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.27% (4.7536 => 4.8138, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 10.51% (0.7708 => 0.8518, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout/heapsort: 5.08% (3.1400 => 3.2995, std.dev.: 0.0565) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.65% (39.1170 => 40.5454, std.dev.: 0.0479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.27% (40.9081 => 41.8370, std.dev.: 0.0932) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.11% (0.8803 => 0.8989, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.45% (43.2493 => 43.8776, std.dev.: 0.2214) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2237 => 1.2374, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/hash: -1.61% (4.1317 => 4.0650, std.dev.: 0.0156) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.24% (1.1091 => 1.1228, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.93% (0.0224 => 0.0148, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.65% (0.0436 => 0.0407, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.82% (0.0337 => 0.0314, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.50% (0.0320 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.38% (0.0378 => 0.0387, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -33.33% (0.0207 => 0.0138, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: 24.29% (0.0177 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.94% (0.0234 => 0.0185, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1431 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 0.81% (1.1434 => 1.1527, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.16% (0.3973 => 0.3887, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.27% (0.1469 => 0.1465, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.0996 => 0.0974, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.20% (0.0266 => 0.0191, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0543 => 0.0532, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.12% (1.1513 => 1.1499, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.59% (0.0017 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.62% (0.0026 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.66% (0.0601 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.66% (0.0319 => 0.0285, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.57% (0.7405 => 0.7521, std.dev.: 0.0027) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 154.05% (0.0037 => 0.0094, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.51% (12.7592 => 12.8241, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.51% (0.0336 => 0.0499, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320275.00% (0.0008 => 2.5630, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.07% (1.1825 => 2.4131, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/pi: 3.58% (2.1390 => 2.2155, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.15% (0.8800 => 0.8989, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 1.81% (63.1520 => 64.2967, std.dev.: 0.1544) MultiSource/Applications/siod/siod: 1.09% (3.5910 => 3.6302, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.02% (11.5523 => 11.6696, std.dev.: 0.0165) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0001) SingleSource/Benchmarks/SmallPT/smallpt: -26.85% (0.1888 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -23.37% (0.0676 => 0.0518, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.79% (0.1684 => 0.1317, std.dev.: 0.0031) MultiSource/Applications/hbd/hbd: -20.02% (1.8964 => 1.5167, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.33% (0.1009 => 0.0824, std.dev.: 0.0004) MultiSource/Applications/aha/aha: -16.04% (0.1378 => 0.1157, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.76% (1.0960 => 0.9233, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.53% (0.7686 => 0.6492, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.83% (0.1079 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.70% (0.4074 => 0.3516, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -13.48% (1.0220 => 0.8842, std.dev.: 0.0177) MultiSource/Applications/Burg/burg: -12.80% (1.5979 => 1.3933, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.28% (0.0847 => 0.0743, std.dev.: 0.0004) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.99% (1.2154 => 1.0697, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.47% (0.0889 => 0.0787, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: -11.46% (2.4719 => 2.1885, std.dev.: 0.0121) MultiSource/Applications/lua/lua: -11.34% (4.6406 => 4.1144, std.dev.: 0.0139) MultiSource/Applications/hexxagon/hexxagon: -11.01% (1.1433 => 1.0174, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.58% (6.4235 => 5.7436, std.dev.: 0.0783) SingleSource/UnitTests/Vector/constpool: -10.28% (9.8875 => 8.8712, std.dev.: 0.0536) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.00% (1.5131 => 1.3618, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -9.62% (17.5634 => 15.8745, std.dev.: 0.0399) MultiSource/Applications/sgefa/sgefa: -9.34% (0.3598 => 0.3262, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.26% (0.1317 => 0.1195, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: -9.13% (0.8653 => 0.7863, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.12% (10.2703 => 9.3334, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.03% (0.7693 => 0.6998, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -8.94% (2.6437 => 2.4074, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.83% (1.6874 => 1.5384, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.77% (1.1731 => 1.0702, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.66% (0.1305 => 0.1192, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.59% (0.2481 => 0.2268, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: -8.52% (17.4365 => 15.9508, std.dev.: 0.0354) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.92% (1.1498 => 1.0587, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.80% (0.2283 => 0.2105, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: -7.62% (0.1824 => 0.1685, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: -7.52% (3.7840 => 3.4993, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.44% (0.9588 => 0.8875, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.26% (0.6885 => 0.6385, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.25% (0.3560 => 0.3302, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.15% (0.9124 => 0.8472, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/health/health: -6.96% (0.1610 => 0.1498, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.78% (1.3979 => 1.3031, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.71% (0.2100 => 0.1959, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: -6.42% (0.2915 => 0.2728, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.41% (1.3310 => 1.2457, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.88% (1.8127 => 1.7061, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: -5.67% (0.5134 => 0.4843, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.59% (0.5746 => 0.5425, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.46% (0.2618 => 0.2475, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -5.32% (0.2385 => 0.2258, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.20% (0.2615 => 0.2479, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.15% (0.4002 => 0.3796, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.04% (0.6135 => 0.5826, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (0.2006 => 0.1905, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: -4.98% (0.7776 => 0.7389, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.97% (0.7693 => 0.7311, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -4.88% (1.4392 => 1.3690, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.87% (0.2709 => 0.2577, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.76% (3.6295 => 3.4567, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.65% (0.2884 => 0.2750, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.45% (5.0381 => 4.8138, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.42% (1.2680 => 1.2120, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.32% (1.0234 => 0.9792, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.22% (0.3462 => 0.3316, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.20% (1.3220 => 1.2665, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: -4.11% (16.4479 => 15.7711, std.dev.: 0.0663) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.98% (0.3093 => 0.2970, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.69% (4.6579 => 4.4858, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.64% (0.3981 => 0.3836, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -3.63% (4.5936 => 4.4268, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++/bigfib: -3.56% (0.6711 => 0.6472, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.53% (0.9512 => 0.9176, std.dev.: 0.0052) MultiSource/Applications/kimwitu++/kc: -3.46% (18.9377 => 18.2832, std.dev.: 0.0611) MultiSource/Benchmarks/sim/sim: -3.45% (0.3715 => 0.3587, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -3.41% (0.4689 => 0.4529, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.36% (0.4762 => 0.4602, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.31% (0.9214 => 0.8909, std.dev.: 0.0044) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.25% (7.2721 => 7.0361, std.dev.: 0.0732) MultiSource/Applications/oggenc/oggenc: -2.58% (5.3553 => 5.2172, std.dev.: 0.0418) MultiSource/Applications/JM/ldecod/ldecod: -2.58% (7.3529 => 7.1634, std.dev.: 0.0323) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.53% (4.9104 => 4.7863, std.dev.: 0.0252) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.52% (0.6996 => 0.6820, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.35% (4.8904 => 4.7757, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.06% (0.9855 => 0.9652, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.84% (2.4519 => 2.4067, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: -1.79% (1.2708 => 1.2481, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.73% (0.9372 => 0.6492, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -26.25% (4.4739 => 3.2995, std.dev.: 0.0565) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.75% (4.2042 => 3.2059, std.dev.: 0.1070) MultiSource/Applications/minisat/minisat: -22.34% (7.9891 => 6.2042, std.dev.: 0.0377) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.25% (1.0816 => 0.8518, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.79% (1.5623 => 1.2687, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.43% (0.1164 => 0.0996, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.19% (1.4235 => 1.2642, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.37% (2.8778 => 2.5793, std.dev.: 0.0920) SingleSource/Benchmarks/Shootout/hash: -10.18% (4.5259 => 4.0650, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists1: -9.72% (0.6628 => 0.5984, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.64% (5.0421 => 4.5562, std.dev.: 0.0335) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.52% (1.4588 => 1.3345, std.dev.: 0.0392) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.43% (0.4081 => 0.3737, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -7.21% (9.0650 => 8.4110, std.dev.: 0.2309) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.93% (0.3217 => 0.2994, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: -6.72% (4.4540 => 4.1547, std.dev.: 0.0357) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.01% (23.3986 => 21.9920, std.dev.: 0.1407) SingleSource/Benchmarks/Shootout/ary3: -5.82% (2.2304 => 2.1006, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.22% (0.3201 => 0.3034, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.82% (46.0987 => 43.8776, std.dev.: 0.2214) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.23% (2.5170 => 2.4105, std.dev.: 0.0282) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.91% (0.3349 => 0.3218, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -3.53% (4.4730 => 4.3149, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.50% (1.4446 => 1.3941, std.dev.: 0.0080) MultiSource/Applications/SIBsim4/SIBsim4: -3.45% (3.5443 => 3.4219, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.23% (0.3406 => 0.3296, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.07% (17.2182 => 16.6894, std.dev.: 0.1056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.75% (1.0995 => 1.0693, std.dev.: 0.0099) MultiSource/Benchmarks/llubenchmark/llu: -2.57% (2.0298 => 1.9776, std.dev.: 0.0198) SingleSource/Benchmarks/McGill/chomp: -2.38% (1.0425 => 1.0177, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.28% (0.5826 => 0.5693, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: -2.09% (2.8571 => 2.7975, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.85% (2.4498 => 2.4045, std.dev.: 0.0117) MultiSource/Applications/lua/lua: -1.84% (29.0327 => 28.4975, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.70% (3.7662 => 3.7020, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.33% (3.1921 => 3.1497, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.27% (7.2040 => 7.1123, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.16% (2.7640 => 2.7320, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.14% (42.3194 => 41.8370, std.dev.: 0.0932) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.11% (3.3596 => 3.3222, std.dev.: 0.0058) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.80% (1.2047 => 1.1228, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.48% (0.0233 => 0.0148, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.76% (0.0451 => 0.0407, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.30% (0.0394 => 0.0314, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.88% (0.0328 => 0.0312, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.03% (0.0445 => 0.0387, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -35.21% (0.0213 => 0.0138, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -27.45% (0.0255 => 0.0185, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.54% (0.1530 => 0.1430, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -40.25% (1.9293 => 1.1527, std.dev.: 0.0210) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.00% (0.4049 => 0.3887, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.98% (0.1510 => 0.1465, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.41% (0.0978 => 0.0974, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.83% (0.0590 => 0.0532, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.02% (1.1617 => 1.1499, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.04% (0.0027 => 0.0017, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0610 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.13% (0.7437 => 0.7521, std.dev.: 0.0027) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.17% (0.0092 => 0.0094, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.36% (12.7781 => 12.8241, std.dev.: 0.0065) Report Time: 0.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 06:43:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 08:43:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120144334.233592A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7793?compare_to=7790&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7793, Order: 172973, Start Time: 2013-01-20 13:09:45, End Time: 2013-01-20 14:43:45 To: 7790, Order: 172971, Start Time: 2013-01-20 11:12:44, End Time: 2013-01-20 12:46:30 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 24 (107 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1080 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.62% (0.3690 => 0.3971, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions-2: 2.83% (0.3599 => 0.3701, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 2.80% (0.3577 => 0.3677, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 2.77% (0.3644 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 2.77% (0.7399 => 0.7604, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 2.74% (0.3650 => 0.3750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 2.69% (0.3980 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 2.65% (0.4075 => 0.4183, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 2.54% (0.3939 => 0.4039, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 2.24% (0.6017 => 0.6152, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 2.23% (0.6130 => 0.6267, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 1.71% (0.7824 => 0.7958, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 1.71% (18.1237 => 18.4340, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.48% (2.0797 => 2.1104, std.dev.: 0.0105) MultiSource/Applications/hexxagon/hexxagon: 1.35% (1.2643 => 1.2814, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 1.33% (2.3649 => 2.3963, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.31% (0.9633 => 0.9759, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 1.18% (4.2343 => 4.2842, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 1.16% (33.5840 => 33.9740, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.09% (5.6062 => 5.6675, std.dev.: 0.0206) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.08% (43.0258 => 43.4912, std.dev.: 0.0281) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.06% (6.6026 => 6.6727, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: 1.03% (2.1267 => 2.1486, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.01% (4.0075 => 4.0481, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.11% (0.6395 => 0.8768, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.05% (0.0699 => 0.0930, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.30% (0.6260 => 0.8282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.10% (0.5688 => 0.7514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.06% (0.5805 => 0.7666, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.89% (0.5456 => 0.7196, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.53% (0.5849 => 0.7693, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.29% (0.6395 => 0.8396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.10% (0.5575 => 0.7309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.09% (0.5567 => 0.7298, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.03% (0.5581 => 0.7313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.94% (0.5941 => 0.7720, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.56% (0.5859 => 0.7591, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.84% (0.6440 => 0.8297, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.74% (1.6474 => 2.1208, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.16% (0.6189 => 0.7932, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.47% (0.6304 => 0.8036, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.37% (0.6230 => 0.7935, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.34% (0.5802 => 0.7330, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.22% (0.6660 => 0.8406, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.84% (0.5705 => 0.7179, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.69% (0.5925 => 0.7447, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.37% (0.5857 => 0.7343, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.35% (0.5570 => 0.6982, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.32% (0.5478 => 0.6865, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.19% (0.5569 => 0.6972, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.84% (0.5591 => 0.6980, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.55% (0.5863 => 0.7244, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.47% (0.6446 => 0.7959, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.31% (0.6052 => 0.7463, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.77% (0.6681 => 0.8202, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.46% (0.6194 => 0.7585, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.26% (0.6297 => 0.7699, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.70% (2.2587 => 2.7489, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.18% (0.6667 => 0.8079, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.16% (0.7339 => 0.8745, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.94% (0.3357 => 0.3892, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.83% (1.1450 => 1.3148, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.63% (0.1230 => 0.1410, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.27% (4.5069 => 5.0598, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.23% (0.4515 => 0.5067, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.65% (3.5339 => 3.9455, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.27% (1.6364 => 1.8208, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1982 => 0.2191, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.19% (0.7021 => 0.7666, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.23% (1.2515 => 1.3545, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4524 => 0.4889, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.86% (0.5329 => 0.5748, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.21% (1.4642 => 1.5697, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4861 => 0.5208, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.70% (1.2784 => 1.3641, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 6.60% (9.2283 => 9.8376, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3255 => 0.3441, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.06% (0.3319 => 0.3487, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.64% (5.4682 => 5.6675, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/bigfib: 3.63% (0.6750 => 0.6995, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3446 => 0.3561, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.15% (5.0226 => 5.1806, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.95% (1.3864 => 1.4273, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 2.74% (0.8418 => 0.8649, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.11% (0.9557 => 0.9759, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 2.00% (0.7447 => 0.7596, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.82% (1.3722 => 1.3972, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.59% (15.5079 => 15.7546, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.45% (22.4056 => 22.7311, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8083, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.36% (0.9531 => 1.0328, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1495, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.46% (54.5751 => 56.4618, std.dev.: 0.1146) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0101) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2816, std.dev.: 0.0014) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.49% (4.5320 => 4.5996, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2689, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4542, std.dev.: 0.0134) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.65% (2.4924 => 2.3764, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.17% (0.7198 => 0.6898, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.04% (0.3837 => 0.3682, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.98% (0.3821 => 0.3669, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.69% (0.3142 => 0.3026, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9852 => 0.9491, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-3: -3.56% (0.3848 => 0.3711, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/trivial-interface: -3.54% (0.3812 => 0.3677, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3896 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3880 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.45% (0.3884 => 0.3750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.45% (0.4033 => 0.3894, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.42% (0.3891 => 0.3758, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.40% (0.3323 => 0.3210, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3831 => 0.3701, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions: -3.28% (0.4176 => 0.4039, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.27% (0.3057 => 0.2957, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.80% (2.1713 => 2.1104, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.78% (0.6484 => 0.6304, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.70% (0.6441 => 0.6267, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: -2.67% (0.4199 => 0.4087, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.66% (20.7746 => 20.2224, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.59% (0.9542 => 0.9295, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.54% (1.3148 => 1.2814, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.25% (0.7779 => 0.7604, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8903, std.dev.: 0.0123) MultiSource/Applications/sqlite3/sqlite3: -1.98% (17.1032 => 16.7651, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.80% (1.2210 => 1.1990, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.67% (1.2221 => 1.2017, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.52% (16.1920 => 15.9452, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.46% (0.7919 => 0.7803, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6727, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -1.31% (1.5610 => 1.5405, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.29% (1.0544 => 1.0408, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -1.27% (7.0961 => 7.0061, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.21% (1.2300 => 1.2151, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.13% (4.3330 => 4.2842, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: -1.11% (0.9179 => 0.9077, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6941, std.dev.: 0.0203) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3151, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0256, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9178, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1971, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3527, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1774, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.67% (1.3096 => 1.2616, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.80% (3.7241 => 3.6197, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (7.9763 => 7.7912, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1193, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1739, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/ary3: -1.62% (3.7092 => 3.6492, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4715, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.54% (1.6086 => 1.5838, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6025, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.04% (1.6307 => 1.6138, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 08:34:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 10:34:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120163408.28DA92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7794?compare_to=7792&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7794, Order: 172974, Start Time: 2013-01-20 14:32:55, End Time: 2013-01-20 16:34:20 To: 7792, Order: 172971, Start Time: 2013-01-20 12:16:52, End Time: 2013-01-20 14:15:51 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (8 on baseline) Performance Improvements: 2 (63 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (992 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.04% (4.7863 => 4.8838, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.80% (1.4132 => 1.4387, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: 12.04% (4.1547 => 4.6550, std.dev.: 0.1801) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.06% (0.3322 => 0.3623, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 8.70% (1.7405 => 1.8919, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.64% (1.5775 => 1.6033, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.71% (40.5454 => 39.0392, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.67% (7.1588 => 6.8958, std.dev.: 0.0522) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.41% (1.1228 => 1.1386, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 52.03% (0.0148 => 0.0225, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.13% (0.0407 => 0.0436, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.96% (0.0314 => 0.0339, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.21% (0.0312 => 0.0322, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.92% (0.0387 => 0.0437, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/casts: 54.35% (0.0138 => 0.0213, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: 1.36% (0.0220 => 0.0223, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 36.22% (0.0185 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.56% (0.1430 => 0.1422, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 1.08% (1.1527 => 1.1652, std.dev.: 0.2169) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.58% (0.3887 => 0.4065, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.18% (0.1465 => 0.1433, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.16% (0.0974 => 0.0995, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.66% (0.0191 => 0.0184, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.40% (0.0532 => 0.0582, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.1499 => 1.1465, std.dev.: 0.0913) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 52.94% (0.0017 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.62% (0.0617 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.35% (0.0285 => 0.0284, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.49% (0.7521 => 0.7409, std.dev.: 0.0093) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.79% (0.0094 => 0.0122, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.60% (12.8241 => 12.7466, std.dev.: 0.5035) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.30% (0.0336 => 0.0505, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.96% (1.4110 => 1.4387, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321150.00% (0.0008 => 2.5700, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.57% (1.1825 => 2.4427, std.dev.: 0.0763) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.98% (0.2562 => 0.2869, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 4.39% (1.8123 => 1.8919, std.dev.: 0.0240) SingleSource/Benchmarks/Misc/pi: 3.38% (2.1390 => 2.2112, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.25% (2.2499 => 2.3006, std.dev.: 0.0115) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.87% (0.0808 => 0.0502, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.43% (0.0727 => 0.0484, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/SmallPT/smallpt: -26.32% (0.1888 => 0.1391, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.04% (0.1684 => 0.1296, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.12% (0.0676 => 0.0540, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -19.54% (1.8964 => 1.5258, std.dev.: 0.0560) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.56% (0.0862 => 0.0702, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.55% (1.0960 => 0.9037, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.92% (0.1079 => 0.0918, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.55% (1.0986 => 0.9387, std.dev.: 0.0050) MultiSource/Applications/aha/aha: -12.12% (0.1378 => 0.1211, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: -11.26% (1.5979 => 1.4180, std.dev.: 0.0665) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.00% (6.4235 => 5.7169, std.dev.: 0.1487) MultiSource/Applications/lua/lua: -10.41% (4.6406 => 4.1574, std.dev.: 0.1835) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.28% (1.3924 => 1.2492, std.dev.: 0.0120) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -10.25% (0.1317 => 0.1182, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.57% (0.2372 => 0.2145, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -9.57% (17.5634 => 15.8833, std.dev.: 0.6218) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.34% (0.1210 => 0.1097, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.11% (1.5131 => 1.3753, std.dev.: 0.0389) MultiSource/Applications/ClamAV/clamscan: -7.99% (17.4365 => 16.0439, std.dev.: 0.2982) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.62% (1.6874 => 1.5589, std.dev.: 0.0410) MultiSource/Benchmarks/Olden/health/health: -7.52% (0.1610 => 0.1489, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.94% (0.2709 => 0.2521, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: -6.61% (1.3979 => 1.3055, std.dev.: 0.0341) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.41% (0.2481 => 0.2322, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.41% (0.7693 => 0.7200, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.86% (0.2100 => 0.1977, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.47% (0.9550 => 0.9028, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.30% (1.3310 => 1.2604, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.97% (0.6135 => 0.5830, std.dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: -4.48% (1.4392 => 1.3747, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.36% (1.0017 => 0.9580, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.33% (0.3462 => 0.3312, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.11% (0.9127 => 0.8752, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/moments: -4.05% (0.4002 => 0.3840, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.91% (0.5369 => 0.5159, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.76% (0.9788 => 0.9420, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.65% (0.6711 => 0.6533, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.34% (1.0860 => 1.0606, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -2.24% (7.3529 => 7.1879, std.dev.: 0.0522) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.15% (1.0088 => 0.9871, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -22.34% (4.2042 => 3.2651, std.dev.: 0.2682) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.06% (2.8778 => 2.3868, std.dev.: 0.0892) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.33% (5.0421 => 4.5716, std.dev.: 0.1117) SingleSource/Benchmarks/Shootout/hash: -8.57% (4.5259 => 4.1381, std.dev.: 0.0766) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.80% (0.3217 => 0.2966, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.3654 => 0.3420, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.06% (0.3201 => 0.3039, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.54% (40.4729 => 39.0392, std.dev.: 0.0405) MultiSource/Applications/sqlite3/sqlite3: -3.52% (4.4730 => 4.3155, std.dev.: 0.0561) MultiSource/Applications/SIBsim4/SIBsim4: -3.49% (3.5443 => 3.4205, std.dev.: 0.0240) SingleSource/Benchmarks/Shootout-C++/lists: -3.32% (17.2182 => 16.6471, std.dev.: 0.2174) SingleSource/Benchmarks/McGill/chomp: -2.94% (1.0425 => 1.0119, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.90% (3.0082 => 2.9511, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/ReedSolomon: -1.51% (8.6447 => 8.5142, std.dev.: 0.0413) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0001) SingleSource/Benchmarks/SmallPT/smallpt: -1.28% (14.9448 => 14.7536, std.dev.: 0.0374) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3170, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/dt: -1.13% (0.9870 => 0.9758, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.49% (1.2047 => 1.1386, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.80% (0.0445 => 0.0437, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0060) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -7.06% (0.1530 => 0.1422, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -39.61% (1.9293 => 1.1652, std.dev.: 0.2169) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.40% (0.4049 => 0.4065, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.10% (0.1510 => 0.1433, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.74% (0.0978 => 0.0995, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -33.33% (0.0276 => 0.0184, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.36% (0.0590 => 0.0582, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.31% (1.1617 => 1.1465, std.dev.: 0.0913) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (0.0268 => 0.0284, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0093) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7781 => 12.7466, std.dev.: 0.5035) Report Time: 0.65s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 08:40:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 10:40:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120164025.8ABD02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7795?compare_to=7793&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7795, Order: 172974, Start Time: 2013-01-20 15:06:57, End Time: 2013-01-20 16:40:37 To: 7793, Order: 172973, Start Time: 2013-01-20 13:09:45, End Time: 2013-01-20 14:43:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (105 on baseline) Performance Improvements: 2 (106 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1099 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 21.87% (7.4469 => 9.0756, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.50% (5.7494 => 5.9508, std.dev.: 0.0038) MultiSource/Benchmarks/llubenchmark/llu: 2.12% (3.8083 => 3.8890, std.dev.: 0.0167) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.41% (0.7958 => 0.7846, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: -1.08% (18.4340 => 18.2358, std.dev.: 0.0160) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.93% (0.0514 => 0.0894, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.72% (0.6395 => 0.8743, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.71% (0.6260 => 0.8245, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.67% (0.5456 => 0.7184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.66% (0.5688 => 0.7489, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.65% (0.5805 => 0.7642, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.30% (0.5849 => 0.7680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.84% (0.5581 => 0.7302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.81% (0.5567 => 0.7282, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.73% (0.5575 => 0.7288, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.63% (0.6395 => 0.8354, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.61% (0.5941 => 0.7700, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.22% (0.5859 => 0.7571, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.14% (0.6033 => 0.7791, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.49% (0.6440 => 0.8275, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.00% (1.6474 => 2.1087, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.84% (0.6189 => 0.7912, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.79% (0.6676 => 0.8531, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.19% (0.6230 => 0.7924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.01% (0.6304 => 0.8007, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.11% (0.5802 => 0.7317, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.92% (0.6660 => 0.8386, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.35% (0.5925 => 0.7427, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.33% (0.5705 => 0.7150, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.08% (0.5857 => 0.7326, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.00% (0.5569 => 0.6961, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.97% (0.5570 => 0.6961, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.97% (0.5478 => 0.6846, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.54% (0.5591 => 0.6963, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.37% (0.5863 => 0.7233, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.29% (0.6446 => 0.7947, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.07% (0.7524 => 0.9260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.93% (0.6052 => 0.7440, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.51% (0.6681 => 0.8185, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.02% (0.6194 => 0.7558, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.72% (0.6297 => 0.7665, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.08% (2.2587 => 2.7349, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.03% (0.6667 => 0.8069, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.79% (0.7339 => 0.8718, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.51% (0.0634 => 0.0745, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.14% (0.1146 => 0.1331, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: 15.07% (0.3357 => 0.3863, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 14.37% (1.1450 => 1.3095, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1081 => 0.1234, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.96% (0.4916 => 0.5504, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 11.92% (0.4515 => 0.5053, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.79% (4.5069 => 5.0383, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.05% (3.5339 => 3.9245, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.88% (1.6364 => 1.8144, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.84% (0.1982 => 0.2177, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2385 => 0.2615, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.67% (0.7021 => 0.7630, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.98% (0.4524 => 0.4885, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 7.58% (1.2515 => 1.3464, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.30% (0.5329 => 0.5718, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: 6.83% (0.4861 => 0.5193, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1731 => 0.1849, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.68% (1.4642 => 1.5620, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.41% (1.2784 => 1.3604, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.29% (9.2283 => 9.8085, std.dev.: 0.0125) SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.82% (0.3834 => 0.4057, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3255 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.48% (0.1879 => 0.1982, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.37% (0.3319 => 0.3464, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.6750 => 0.6972, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.16% (0.3446 => 0.3555, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.91% (5.4682 => 5.6274, std.dev.: 0.0146) MultiSource/Applications/oggenc/oggenc: 2.74% (5.0226 => 5.1601, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (1.3864 => 1.4219, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.13% (0.8418 => 0.8597, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 1.69% (0.7447 => 0.7573, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.64% (0.9557 => 0.9714, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3722 => 1.3920, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.03% (15.5079 => 15.6683, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7999, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.99% (0.9531 => 1.0293, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.37% (0.2380 => 0.2484, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1478, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 3.89% (3.7435 => 3.8890, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (54.5751 => 56.5821, std.dev.: 0.0505) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0125) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2825, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6009, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2681, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4579, std.dev.: 0.0162) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.81% (2.4924 => 2.3725, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.74% (0.7198 => 0.6857, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.30% (0.3837 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.12% (0.3812 => 0.3655, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.11% (0.9852 => 0.9447, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.08% (0.3821 => 0.3665, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3831 => 0.3676, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.96% (0.3884 => 0.3730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.95% (0.3896 => 0.3742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3848 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.92% (0.4033 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.4176 => 0.4018, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.36% (0.4199 => 0.4058, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.30% (0.3057 => 0.2956, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.15% (0.6484 => 0.6280, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.95% (0.3658 => 0.3550, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.92% (2.1713 => 2.1078, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -2.84% (1.3148 => 1.2775, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -2.81% (0.6441 => 0.6260, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.9542 => 0.9279, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2204, std.dev.: 0.0365) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.60% (0.4151 => 0.4043, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.36% (14.2083 => 13.8726, std.dev.: 0.0093) SingleSource/UnitTests/ObjC++/property-reference: -2.17% (0.7779 => 0.7610, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -2.15% (17.1032 => 16.7352, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.09% (1.2221 => 1.1966, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.03% (0.7919 => 0.7758, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.00% (1.2210 => 1.1966, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.91% (1.0544 => 1.0343, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -1.87% (16.1920 => 15.8897, std.dev.: 0.0104) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.77% (6.7716 => 6.6517, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: -1.75% (4.3330 => 4.2570, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.44% (7.0961 => 6.9939, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: -1.44% (0.9179 => 0.9047, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -1.43% (1.5610 => 1.5387, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -1.13% (2.4021 => 2.3750, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.31% (1.8100 => 0.7003, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3087, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.06% (1.3643 => 1.0224, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9266, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: -23.33% (7.5137 => 5.7610, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1982, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1281, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3559, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.30% (0.5142 => 0.4664, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8194, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1734, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.62% (3.7241 => 3.6267, std.dev.: 0.0356) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7810, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -2.04% (7.3040 => 7.1548, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7076, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4679, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.50% (1.6307 => 1.6062, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5861, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.18% (1.6219 => 1.6028, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6709, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 08:40:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 10:40:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130120164034.3C1AE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7796?compare_to=7789&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7796, Order: 172971, Start Time: 2013-01-20 13:07:04, End Time: 2013-01-20 16:40:45 To: 7789, Order: 172966, Start Time: 2013-01-20 08:39:46, End Time: 2013-01-20 12:14:26 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.34% (0.6696 => 0.6853, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.40% (0.0625 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.39% (0.2969 => 0.3812, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.67% (0.1106 => 0.1401, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.43% (0.4253 => 0.5377, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.19% (0.4139 => 0.5223, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.75% (0.5900 => 0.7419, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.18% (1.5932 => 1.9943, std.dev.: 0.0102) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.61% (0.4994 => 0.6223, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.14% (0.5000 => 0.6207, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.70% (0.1620 => 0.2004, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.33% (0.1003 => 0.1227, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.31% (0.1107 => 0.1354, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.07% (0.1604 => 0.1958, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.93% (0.3903 => 0.4759, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.76% (0.1549 => 0.1886, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 21.49% (0.1619 => 0.1967, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.49% (0.0947 => 0.1141, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.18% (0.1462 => 0.1757, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.85% (0.1088 => 0.1304, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.2736 => 0.3278, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.77% (0.3890 => 0.4659, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 19.61% (0.4029 => 0.4819, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.56% (0.2014 => 0.2408, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 19.48% (0.0698 => 0.0834, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.98% (0.2866 => 0.3410, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 18.50% (0.5546 => 0.6572, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.50% (0.0573 => 0.0679) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.33% (1.3152 => 1.5563, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.25% (0.3271 => 0.3868, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: 18.19% (1.8794 => 2.2213, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.05% (0.4658 => 0.5499, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.85% (1.6211 => 1.9105, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.84% (0.1968 => 0.2319, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.80% (3.5627 => 4.1970, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/Hello: 17.59% (0.5826 => 0.6851, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.50% (0.1160 => 0.1363, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 17.30% (0.5889 => 0.6908, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/18-imp/imp: 17.17% (0.1421 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.01% (0.4361 => 0.5103, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.94% (0.2875 => 0.3362, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 16.88% (0.9697 => 1.1334, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.87% (0.5026 => 0.5874, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.72% (0.3930 => 0.4587, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 16.68% (0.2811 => 0.3280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.62% (0.2750 => 0.3207, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.59% (1.0781 => 1.2570, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.58% (0.2792 => 0.3255, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.47% (0.2738 => 0.3189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 16.47% (0.2823 => 0.3288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 16.47% (0.2714 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 16.42% (0.2813 => 0.3275, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 16.41% (0.2803 => 0.3263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.40% (0.2725 => 0.3172, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.32% (0.2911 => 0.3386, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.29% (0.2780 => 0.3233, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 16.25% (0.3004 => 0.3492, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.24% (2.7292 => 3.1723, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.23% (0.2729 => 0.3172, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.18% (0.3195 => 0.3712, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.18% (2.0673 => 2.4018, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.10% (0.3267 => 0.3793, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.08% (1.9694 => 2.2860, std.dev.: 0.0031) MultiSource/Applications/ClamAV/clamscan: 16.01% (4.2109 => 4.8852, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 15.98% (0.9909 => 1.1492, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (4.4195 => 5.1220, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.87% (1.9966 => 2.3134, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/wc: 15.76% (0.3096 => 0.3584, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.65% (0.3060 => 0.3539, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary2: 15.65% (0.3317 => 0.3836, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 15.62% (0.7171 => 0.8291, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 15.44% (23.5202 => 27.1511, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 15.33% (1.4269 => 1.6456, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 15.32% (0.3726 => 0.4297, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.32% (0.1090 => 0.1257, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.30% (0.3124 => 0.3602, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.28% (0.2566 => 0.2958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 15.11% (0.3348 => 0.3854, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.05% (0.3282 => 0.3776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.05% (0.4146 => 0.4770, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.02% (0.3362 => 0.3867, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 14.96% (0.3477 => 0.3997, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.87% (0.3625 => 0.4164, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 14.79% (0.3678 => 0.4222, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 14.61% (0.4251 => 0.4872, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.59% (0.3981 => 0.4562, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.55% (0.3690 => 0.4227, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.49% (0.7875 => 0.9016, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.07% (0.3845 => 0.4386, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 13.89% (0.5012 => 0.5708, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.64% (0.2075 => 0.2358, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 13.62% (0.3496 => 0.3972, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.53% (0.3488 => 0.3960, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.49% (0.3469 => 0.3937, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 13.48% (0.3442 => 0.3906, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 13.45% (0.2691 => 0.3053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 13.44% (0.3446 => 0.3909, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 13.34% (0.3650 => 0.4137, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 13.32% (5.5417 => 6.2800, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.32% (0.6435 => 0.7292, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 13.21% (2.1653 => 2.4514, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/parameter-passing: 13.16% (0.3724 => 0.4214, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.81% (2.1013 => 2.3705, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.79% (0.2737 => 0.3087, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.76% (4.6177 => 5.2070, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.03% (0.5361 => 0.6006, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.86% (0.2040 => 0.2282, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.74% (0.3084 => 0.3446, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 11.66% (0.3498 => 0.3906, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.36% (0.2103 => 0.2342, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.30% (0.3336 => 0.3713, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 11.25% (0.6634 => 0.7380, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: 11.22% (0.4847 => 0.5391, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.01% (11.6398 => 12.9213, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.62% (0.7426 => 0.8215, std.dev.: 0.0129) MultiSource/Applications/lemon/lemon: 10.62% (0.2391 => 0.2645, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.29% (4.6926 => 5.1753, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 9.65% (2.0346 => 2.2309, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.38% (0.5584 => 0.6108, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 7.52% (11.9555 => 12.8547, std.dev.: 0.0069) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.25% (0.3792 => 0.3953, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5194, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 15.82% (0.5917 => 0.6853, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6123, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.31% (0.3693 => 0.3926, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 5.42% (0.2122 => 0.2237, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2417, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (12.0509 => 12.6692, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6861, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-2: 4.52% (1.8057 => 1.8874, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2049, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3051, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2892, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.40% (1.0927 => 1.1080, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2082, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4807, std.dev.: 0.0056) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5909, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5694, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.61% (17.2379 => 14.3746, std.dev.: 0.1756) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013) SingleSource/Benchmarks/Shootout-C++/ary2: -7.87% (0.2402 => 0.2213, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7966, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -3.82% (14.0481 => 13.5120, std.dev.: 0.1524) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2233, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8044, std.dev.: 0.0107) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.76% (0.6293 => 0.6119, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1390, std.dev.: 0.0436) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5788, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1337, std.dev.: 0.0616) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0419, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 08:48:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 10:48:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120164859.640352A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7797?compare_to=7791&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7797, Order: 172974, Start Time: 2013-01-20 14:37:49, End Time: 2013-01-20 16:49:10 To: 7791, Order: 172971, Start Time: 2013-01-20 11:56:15, End Time: 2013-01-20 14:07:21 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (214 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.86% (11.2050 => 10.8841, std.dev.: 0.0104) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0654 => 0.0654, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8353 => 499.8367, std.dev.: 0.0092) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44223.55% (1.1277 => 499.8367, std.dev.: 0.0092) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.94% (0.5229 => 1.6416, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 19.72% (14.9895 => 17.9455, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 42.89% (14.1553 => 20.2267, std.dev.: 0.0183) MultiSource/Benchmarks/MallocBench/gs/gs: 17.57% (4.1105 => 4.8326, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.49% (1.1048 => 1.7289, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.28% (7.1582 => 37.3858, std.dev.: 0.0241) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.72% (3.4629 => 6.3620, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.56% (0.6222 => 1.0799, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.36% (0.0720 => 7.4465, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11193500.00% (0.0001 => 11.1936, std.dev.: 0.0363) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486800.00% (0.0001 => 5.4869, std.dev.: 0.0304) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.15% (1.1194 => 10.3449, std.dev.: 0.0118) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.44% (22.1758 => 55.3145, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.61% (0.1463 => 0.2496, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 59.90% (0.0394 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.25% (2.9384 => 4.6206, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.18% (7.0540 => 10.8054, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.79% (1.5859 => 2.3914, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.78% (8.1363 => 11.9421, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.76% (2.2024 => 3.1000, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 38.98% (0.3109 => 0.4321, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.36% (21.9371 => 30.3523, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0003) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.54% (4.2646 => 5.6521, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.22% (0.4615 => 0.6102, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.76% (1.5415 => 2.0311, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.07% (0.2271 => 0.2954, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 29.43% (0.4299 => 0.5564, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 29.01% (1.1642 => 1.5019, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.99% (0.6675 => 0.8543, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.21% (0.1584 => 0.2015, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.60% (0.1143 => 0.1447, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.52% (0.5105 => 0.6459, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.06% (0.1892 => 0.2385, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 26.04% (0.1655 => 0.2086, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 25.69% (0.2554 => 0.3210, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.47% (3.8922 => 4.8837, std.dev.: 0.0110) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 23.99% (0.4289 => 0.5318, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.75% (0.1566 => 0.1938, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.68% (0.3121 => 0.3860, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 23.57% (0.1175 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 23.48% (1.0722 => 1.3239, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.39% (1.4186 => 1.7504, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 23.38% (0.4620 => 0.5700, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.18% (0.1695 => 0.2071, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 22.11% (9.4845 => 11.5813, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: 21.53% (0.7115 => 0.8647, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.22% (0.1555 => 0.1885, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.00% (0.2700 => 0.3267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 20.87% (0.0527 => 0.0637, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 20.85% (0.0662 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.59% (0.0675 => 0.0814, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.50% (0.7835 => 0.9441, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.44% (0.0871 => 0.1049) MultiSource/Applications/oggenc/oggenc: 20.41% (5.7591 => 6.9348, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.31% (0.1236 => 0.1487, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.18% (1.3050 => 1.5684, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145) MultiSource/Benchmarks/Olden/mst/mst: 19.78% (0.1163 => 0.1393, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.67% (0.6456 => 0.7726, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.47% (0.1695 => 0.2025, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.20% (0.5860 => 0.6985, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.17% (4.9449 => 5.8928, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.92% (0.1940 => 0.2307, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.51% (0.0886 => 0.1050, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.47% (0.0834 => 0.0988, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.41% (5.0018 => 5.9227, std.dev.: 0.0113) MultiSource/Applications/d/make_dparser: 18.29% (3.3354 => 3.9456, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2758 => 0.3249, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.71% (0.5020 => 0.5909, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.60% (0.3307 => 0.3889, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.38% (0.7433 => 0.8725, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.27% (0.9765 => 1.1451, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.24% (0.5569 => 0.6529, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.15% (0.1510 => 0.1769, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.05% (0.2065 => 0.2417, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 16.88% (1.1840 => 1.3839, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 16.83% (0.3423 => 0.3999, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.80% (3.8723 => 4.5229, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.72% (0.5981 => 0.6981, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 16.61% (2.0273 => 2.3640, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ReedSolomon: 16.50% (0.2049 => 0.2387, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.05% (0.3283 => 0.3810, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 15.85% (2.2969 => 2.6610, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.78% (0.3441 => 0.3984, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.76% (0.8101 => 0.9378, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 15.66% (0.3232 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.61% (0.1044 => 0.1207, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.50% (0.6450 => 0.7450, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 14.81% (0.3180 => 0.3651, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.44% (0.8921 => 1.0209, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.30% (1.1861 => 1.3557, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.00% (0.3379 => 0.3852, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.81% (0.8067 => 0.9181, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.33% (0.2603 => 0.2950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.22% (0.3865 => 0.4376, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7643, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.92% (0.4636 => 0.5235, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 12.73% (0.3387 => 0.3818, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.33% (0.4103 => 0.4609, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.78% (0.4048 => 0.4525, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.49% (0.3603 => 0.4017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 11.40% (0.3422 => 0.3812, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.05% (17.1811 => 19.0791, std.dev.: 0.0295) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 10.97% (0.3684 => 0.4088, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.82% (0.3828 => 0.4242, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 10.67% (0.3092 => 0.3422, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.61% (0.3826 => 0.4232, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.44% (0.3543 => 0.3913, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.43% (0.4064 => 0.4488, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.42% (0.3473 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.35% (0.3516 => 0.3880, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.98% (0.3427 => 0.3769, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.91% (14.3668 => 15.7905, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.07% (0.1114 => 0.1215, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.04% (2.0665 => 2.2533, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/except: 8.95% (0.2871 => 0.3128, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 8.72% (0.2877 => 0.3128, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 8.64% (0.2905 => 0.3156, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.63% (0.3650 => 0.3965, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.53% (1.2842 => 1.3937, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.47% (0.2891 => 0.3136, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.38% (0.3162 => 0.3427, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.36% (0.3052 => 0.3307, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 8.21% (0.2802 => 0.3032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.17% (63.2438 => 68.4081, std.dev.: 0.0248) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.98% (0.2793 => 0.3016, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (0.3935 => 0.4249, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3724, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 7.56% (0.5925 => 0.6373, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.35% (0.4879 => 0.5189, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.98% (10.3673 => 10.8841, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.26% (7.9617 => 8.1415, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4738, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6980, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.28% (4.2280 => 4.4512, std.dev.: 0.0068) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3134, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.04% (0.9957 => 1.0260, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9077, std.dev.: 0.0196) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7126, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.70% (9.1159 => 9.2709, std.dev.: 0.0304) MultiSource/Benchmarks/mafft/pairlocalalign: 1.45% (27.8444 => 28.2495, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1762, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.01% (5.3855 => 4.4693, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.35% (5.3526 => 4.4774, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -13.75% (10.4361 => 9.0012, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.91% (1.7609 => 1.6216, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9080, std.dev.: 0.0112) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.42% (1.9577 => 0.6574, std.dev.: 0.0143) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.92% (0.3987 => 0.2475, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.75% (0.0506 => 0.0315) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -37.25% (0.0400 => 0.0251, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -33.72% (1.5373 => 1.0189, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.51% (10.7105 => 7.4428, std.dev.: 0.0126) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7636, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0078, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2859, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7039, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.37% (10.2830 => 9.8332, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.69% (4.6441 => 4.5656, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -1.62% (3.6994 => 3.6395, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.50% (3.7221 => 3.6663, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0123) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0022) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 10:37:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 12:37:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120183741.64E462A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7798?compare_to=7795&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7798, Order: 172983, Start Time: 2013-01-20 17:03:54, End Time: 2013-01-20 18:37:51 To: 7795, Order: 172974, Start Time: 2013-01-20 15:06:57, End Time: 2013-01-20 16:40:37 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 2 (109 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.40% (80.3165 => 81.4399, std.dev.: 0.1730) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.83% (1.2841 => 1.2606, std.dev.: 0.0083) MultiSource/Benchmarks/llubenchmark/llu: -1.81% (3.8890 => 3.8188, std.dev.: 0.0132) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.93% (0.0514 => 0.0894, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.67% (0.6395 => 0.8740, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.76% (0.6260 => 0.8248, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.73% (0.5688 => 0.7493, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.54% (0.5805 => 0.7636, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.10% (0.5849 => 0.7668, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.81% (0.5567 => 0.7282, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.80% (0.5581 => 0.7300, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.74% (0.5575 => 0.7289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.54% (0.6395 => 0.8348, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.66% (0.5941 => 0.7703, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.11% (0.6033 => 0.7789, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.03% (0.5859 => 0.7560, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.56% (0.6440 => 0.8279, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.03% (1.6474 => 2.1092, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.89% (0.6189 => 0.7915, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.67% (0.6676 => 0.8523, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.98% (0.6304 => 0.8005, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.97% (0.6230 => 0.7910, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.09% (0.5802 => 0.7316, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.89% (0.6660 => 0.8384, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.52% (0.5925 => 0.7437, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.28% (0.5705 => 0.7147, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.10% (0.5857 => 0.7327, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.06% (0.0790 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.92% (0.5569 => 0.6957, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.90% (0.5478 => 0.6842, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.76% (0.5570 => 0.6949, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.31% (0.5591 => 0.6950, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.30% (0.5863 => 0.7229, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.29% (0.6446 => 0.7947, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.11% (0.7524 => 0.9263, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.00% (0.6052 => 0.7444, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.41% (0.6681 => 0.8178, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.12% (0.6194 => 0.7564, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.82% (0.6297 => 0.7671, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.11% (2.2587 => 2.7354, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.88% (0.6667 => 0.8059, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.42% (0.0622 => 0.0749) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.74% (0.7339 => 0.8714, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.69% (0.0833 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333) MultiSource/Applications/sgefa/sgefa: 14.78% (0.3357 => 0.3853, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.31% (1.1450 => 1.3089, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.86% (0.4916 => 0.5499, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.77% (4.5069 => 5.0372, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.01% (3.5339 => 3.9231, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.85% (1.6364 => 1.8140, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.94% (0.1982 => 0.2179, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.77% (0.2385 => 0.2618, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.65% (0.7021 => 0.7628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4524 => 0.4890, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.46% (1.2515 => 1.3449, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.5329 => 0.5725, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.91% (0.4861 => 0.5197, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.82% (0.1731 => 0.1849, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.71% (1.4642 => 1.5625, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.51% (1.2784 => 1.3616, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: 6.27% (9.2283 => 9.8067, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.53% (0.3255 => 0.3435, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.50% (0.3834 => 0.3968, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 3.36% (0.6750 => 0.6977, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3446 => 0.3551, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 2.98% (0.3394 => 0.3495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (5.4682 => 5.6266, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 2.73% (5.0226 => 5.1597, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.3864 => 1.4223, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 1.87% (0.8418 => 0.8575, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 1.62% (0.7447 => 0.7568, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.9557 => 0.9705, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.46% (1.3722 => 1.3922, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8077, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9531 => 1.0274, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5999, std.dev.: 0.0480) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1030, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.7170 => 81.4399, std.dev.: 0.1730) MultiSource/Benchmarks/llubenchmark/llu: 2.01% (3.7435 => 3.8188, std.dev.: 0.0132) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8210 => 28.2800, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6007, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.37% (5.1955 => 5.2667, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4564, std.dev.: 0.0201) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (2.4924 => 2.3737, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.61% (0.7198 => 0.6866, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.43% (0.3837 => 0.3667, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3812 => 0.3651, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.20% (0.2428 => 0.2326, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.17% (0.9852 => 0.9441, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.04% (0.3884 => 0.3727, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.95% (0.3896 => 0.3742, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.92% (0.4033 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.91% (0.3891 => 0.3739, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3831 => 0.3682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.78% (0.4176 => 0.4018, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.43% (0.3057 => 0.2952, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.33% (0.4199 => 0.4059, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.10% (0.6347 => 0.6150, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.04% (2.1713 => 2.1054, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.03% (0.3658 => 0.3547, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.99% (0.6484 => 0.6290, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.87% (1.3148 => 1.2771, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.83% (0.6441 => 0.6259, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.70% (0.9542 => 0.9284, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.65% (0.4151 => 0.4041, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2429, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.45% (14.2083 => 13.8602, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -2.17% (17.1032 => 16.7320, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (1.2210 => 1.1949, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.13% (0.7779 => 0.7613, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.01% (1.2221 => 1.1975, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -1.89% (4.3330 => 4.2509, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.88% (6.7716 => 6.6445, std.dev.: 0.0071) MultiSource/Applications/JM/lencod/lencod: -1.85% (16.1920 => 15.8931, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.82% (1.0544 => 1.0352, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: -1.70% (0.7982 => 0.7846, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -1.58% (7.0961 => 6.9838, std.dev.: 0.0126) MultiSource/Applications/hbd/hbd: -1.49% (1.5610 => 1.5378, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.48% (1.2300 => 1.2118, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.45% (0.9179 => 0.9046, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.27% (0.8521 => 0.8413, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -1.24% (2.4021 => 2.3722, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.61% (1.8100 => 0.6949, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: -33.90% (8.0445 => 5.3173, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0244, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9173, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1300, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3558, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -4.11% (2.2633 => 2.1702, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.74% (1.3096 => 1.2606, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4011, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.57% (7.9763 => 7.7715, std.dev.: 0.0231) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1717, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4660, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.48% (2.3169 => 2.2827, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.46% (1.6086 => 1.5851, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.27% (1.6307 => 1.6100, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.22% (1.6219 => 1.6021, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 10:51:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 12:51:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120185159.6C4D02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7799?compare_to=7794&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7799, Order: 172983, Start Time: 2013-01-20 16:51:19, End Time: 2013-01-20 18:52:12 To: 7794, Order: 172974, Start Time: 2013-01-20 14:32:55, End Time: 2013-01-20 16:34:20 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (4 on baseline) Performance Improvements: 2 (76 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1059 (983 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.73% (0.9037 => 0.9374, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.22% (1.4656 => 1.8499, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.04% (6.8958 => 7.0363, std.dev.: 0.0352) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/spiff/spiff: -1.47% (0.9038 => 0.8905, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.35% (4.5929 => 4.5309, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.77% (1.1386 => 1.1298, std.dev.: 0.2683) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.44% (0.0225 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0436 => 0.0434, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0339 => 0.0338, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0322 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0437 => 0.0435, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0223 => 0.0224, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.39% (0.1422 => 0.1456, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -3.87% (1.1652 => 1.1201, std.dev.: 0.3632) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.17% (0.4065 => 0.3936, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.47% (0.1433 => 0.1454, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.90% (0.0995 => 0.0986, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.93% (0.0184 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.61% (0.0582 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.26% (1.1465 => 1.1495, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.32% (0.0607 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.97% (0.0284 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7409 => 0.7408, std.dev.: 0.1421) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.82% (0.0122 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (12.7466 => 12.7540, std.dev.: 0.0309) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323412.50% (0.0008 => 2.5881, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.56% (1.1825 => 2.3835, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.87% (0.2562 => 0.2866, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.24% (0.0808 => 0.0499, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.74% (0.0727 => 0.0489, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.75% (0.0692 => 0.0500, std.dev.: 0.0021) SingleSource/Benchmarks/SmallPT/smallpt: -27.44% (0.1888 => 0.1370, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.40% (0.1684 => 0.1290, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.13% (0.1009 => 0.0816, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -18.94% (1.8964 => 1.5372, std.dev.: 0.0617) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.78% (0.7686 => 0.6550, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.47% (1.0960 => 0.9374, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.28% (1.0986 => 0.9417, std.dev.: 0.0464) MultiSource/Applications/spiff/spiff: -12.87% (1.0220 => 0.8905, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.78% (0.4074 => 0.3594, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -11.28% (1.1433 => 1.0143, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.04% (6.4235 => 5.7144, std.dev.: 0.2690) MultiSource/Applications/aha/aha: -10.67% (0.1378 => 0.1231, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: -10.30% (2.4719 => 2.2173, std.dev.: 0.0481) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.75% (1.3924 => 1.2567, std.dev.: 0.0471) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.11% (1.5131 => 1.3753, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.83% (0.7693 => 0.7014, std.dev.: 0.0111) MultiSource/Applications/siod/siod: -8.81% (2.6437 => 2.4108, std.dev.: 0.0633) MultiSource/Applications/sgefa/sgefa: -8.20% (0.3598 => 0.3303, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.90% (1.6874 => 1.5541, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.80% (0.2372 => 0.2187, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.80% (10.2703 => 9.4697, std.dev.: 0.0722) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.59% (1.1498 => 1.0625, std.dev.: 0.0290) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.58% (0.2481 => 0.2293, std.dev.: 0.0059) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.46% (1.1731 => 1.0856, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.97% (0.6885 => 0.6405, std.dev.: 0.0129) MultiSource/Applications/d/make_dparser: -6.92% (3.7840 => 3.5221, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.48% (0.2100 => 0.1964, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.93% (0.3560 => 0.3349, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.91% (0.7693 => 0.7238, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/hash2: -5.73% (0.5134 => 0.4840, std.dev.: 0.0063) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.68% (1.3310 => 1.2554, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.09% (0.9550 => 0.9064, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: -5.07% (0.2385 => 0.2264, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.98% (0.2709 => 0.2574, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.95% (0.3981 => 0.3784, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: -4.94% (0.7776 => 0.7392, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.79% (0.9124 => 0.8687, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/moments: -4.57% (0.4002 => 0.3819, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists: -4.40% (0.2725 => 0.2605, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.3665 => 0.3506, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.06% (4.6579 => 4.4688, std.dev.: 0.0387) SingleSource/Benchmarks/Shootout-C++/hash: -3.50% (0.4689 => 0.4525, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.34% (0.8990 => 0.8690, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.17% (0.9091 => 0.8803, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.06% (0.9403 => 0.9115, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.84% (0.9512 => 0.9242, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.68% (14.9757 => 14.5748, std.dev.: 0.0717) MultiSource/Benchmarks/MallocBench/gs/gs: -2.13% (4.5936 => 4.4959, std.dev.: 0.0338) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.12% (0.4762 => 0.4661, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.61% (7.9891 => 6.1831, std.dev.: 0.6909) SingleSource/Benchmarks/Shootout-C++/heapsort: -18.94% (4.2042 => 3.4081, std.dev.: 0.2967) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.74% (2.8778 => 2.3384, std.dev.: 0.1318) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -12.04% (1.4588 => 1.2831, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout/hash: -10.61% (4.5259 => 4.0457, std.dev.: 0.1468) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.00% (0.4081 => 0.3673, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.64% (23.3986 => 21.3779, std.dev.: 0.4181) SingleSource/Benchmarks/Shootout-C++/lists1: -7.56% (0.6628 => 0.6127, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.55% (0.3217 => 0.2974, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -6.78% (9.0650 => 8.4508, std.dev.: 0.1854) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.06% (0.3201 => 0.3039, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists: -3.42% (17.2182 => 16.6289, std.dev.: 0.1095) MultiSource/Applications/sqlite3/sqlite3: -3.29% (4.4730 => 4.3258, std.dev.: 0.0462) SingleSource/Benchmarks/McGill/chomp: -2.44% (1.0425 => 1.0171, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ffbench: -2.25% (1.4244 => 1.3923, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.01% (0.5826 => 0.5709, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.59% (3.0082 => 2.9605, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.50% (3.1921 => 3.1442, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3147, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout/matrix: -1.21% (1.5825 => 1.5633, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.22% (1.2047 => 1.1298, std.dev.: 0.2683) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -41.94% (1.9293 => 1.1201, std.dev.: 0.3632) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4049 => 0.3936, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.71% (0.1510 => 0.1454, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0978 => 0.0986, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.05% (1.1617 => 1.1495, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7437 => 0.7408, std.dev.: 0.1421) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.19% (12.7781 => 12.7540, std.dev.: 0.0309) Report Time: 0.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 11:30:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 13:30:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120193051.A78C62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7800?compare_to=7797&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7800, Order: 172983, Start Time: 2013-01-20 17:19:47, End Time: 2013-01-20 19:31:02 To: 7797, Order: 172974, Start Time: 2013-01-20 14:37:49, End Time: 2013-01-20 16:49:10 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.57% (0.0654 => 0.0697, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8367 => 499.8503, std.dev.: 0.0084) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.76% (1.1277 => 499.8503, std.dev.: 0.0084) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.61% (0.5229 => 1.6451, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 19.80% (14.9895 => 17.9581, std.dev.: 0.0088) MultiSource/Applications/kimwitu++/kc: 42.92% (14.1553 => 20.2304, std.dev.: 0.0234) MultiSource/Benchmarks/MallocBench/gs/gs: 17.59% (4.1105 => 4.8337, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.43% (1.1048 => 1.7282, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.29% (7.1582 => 37.3869, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83.90% (3.4629 => 6.3683, std.dev.: 0.0149) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.72% (0.6222 => 1.0809, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.33% (0.0720 => 7.4472, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11184400.00% (0.0001 => 11.1845, std.dev.: 0.0232) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490900.00% (0.0001 => 5.4910, std.dev.: 0.0353) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.59% (1.1194 => 10.3387, std.dev.: 0.0042) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.61% (22.1758 => 55.3541, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.47% (0.1463 => 0.2494, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.29% (2.9384 => 4.6218, std.dev.: 0.0069) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.20% (7.0540 => 10.8068, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.65% (1.5859 => 2.3891, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.77% (8.1363 => 11.9413, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.81% (2.2024 => 3.1013, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: 39.79% (0.3109 => 0.4346, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.42% (21.9371 => 30.3644, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.10% (0.1062 => 0.1456, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.34% (0.0355 => 0.0484, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.49% (4.2646 => 5.6502, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.33% (0.4615 => 0.6107, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.88% (1.5415 => 2.0329, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/exptree: 31.82% (0.0814 => 0.1073, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.85% (0.2271 => 0.2949, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/05-eks/eks: 29.24% (0.4299 => 0.5556, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 29.17% (1.1642 => 1.5038, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.09% (0.6675 => 0.8550, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.44% (0.5105 => 0.6455, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 26.22% (0.1655 => 0.2089, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.11% (0.1892 => 0.2386, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.43% (3.8922 => 4.8820, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.04% (0.4289 => 0.5320, std.dev.: 0.0116) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.78% (0.1337 => 0.1655, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 23.66% (0.1175 => 0.1453, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.65% (0.3121 => 0.3859, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.47% (1.4186 => 1.7516, std.dev.: 0.0052) MultiSource/Applications/lemon/lemon: 23.47% (1.0722 => 1.3238, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.01% (0.4620 => 0.5683, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.92% (0.0842 => 0.1035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.52% (0.0675 => 0.0827, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 22.30% (9.4845 => 11.5992, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.06% (0.1695 => 0.2069, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 21.58% (0.1163 => 0.1414, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.43% (0.0672 => 0.0816, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 21.42% (0.7115 => 0.8639, std.dev.: 0.0027) MultiSource/Applications/viterbi/viterbi: 21.35% (0.1555 => 0.1887, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.19% (0.1029 => 0.1247, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.19% (0.2700 => 0.3272, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.11% (0.0886 => 0.1073, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 20.93% (0.0626 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 20.76% (0.3098 => 0.3741, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.68% (0.7835 => 0.9455, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.42% (1.3050 => 1.5715, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 20.40% (5.7591 => 6.9337, std.dev.: 0.0191) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 19.59% (0.1695 => 0.2027, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 19.55% (0.1151 => 0.1376, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/bigfib: 19.55% (0.6456 => 0.7718, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.51% (0.5860 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.34% (4.9449 => 5.9010, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.26% (0.8172 => 0.9746, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.44% (5.0018 => 5.9240, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.37% (0.2107 => 0.2494, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 18.35% (3.3354 => 3.9474, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.23% (0.3307 => 0.3910, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.95% (0.2758 => 0.3253, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 17.85% (0.7433 => 0.8760, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.63% (0.5569 => 0.6551, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.55% (0.5020 => 0.5901, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.33% (0.9765 => 1.1457, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.22% (0.1510 => 0.1770, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.92% (3.8723 => 4.5273, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/18-imp/imp: 16.91% (0.3423 => 0.4002, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 16.82% (1.1840 => 1.3832, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 16.78% (2.0273 => 2.3674, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 16.40% (0.2049 => 0.2385, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.37% (0.5981 => 0.6960, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 16.05% (0.3283 => 0.3810, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.97% (0.8101 => 0.9395, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 15.95% (0.3441 => 0.3990, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 15.93% (2.2969 => 2.6629, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 15.72% (0.3232 => 0.3740, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.61% (0.1044 => 0.1207, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.46% (0.6450 => 0.7447, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.60% (1.1861 => 1.3593, std.dev.: 0.0101) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 14.45% (0.8921 => 1.0210, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.38% (0.8067 => 0.9227, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary2: 13.85% (0.3379 => 0.3847, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.37% (0.2603 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.14% (0.3865 => 0.4373, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.92% (0.4636 => 0.5235, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 12.65% (1.5603 => 1.7577, std.dev.: 0.0117) MultiSource/Benchmarks/sim/sim: 12.64% (0.3387 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.23% (0.4103 => 0.4605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.3927 => 0.4394, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.76% (0.3282 => 0.3668, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.50% (0.3886 => 0.4333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.46% (0.3603 => 0.4016, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.37% (0.3422 => 0.3811, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.2430 => 0.2702, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 11.07% (17.1811 => 19.0826, std.dev.: 0.0235) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.03% (0.3092 => 0.3433, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 10.88% (0.3684 => 0.4085, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3826 => 0.4233, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.44% (0.3543 => 0.3913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.31% (0.4064 => 0.4483, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.01% (0.3427 => 0.3770, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.97% (14.3668 => 15.7994, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.25% (0.1114 => 0.1217, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.00% (2.0665 => 2.2524, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 8.95% (0.2905 => 0.3165, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.74% (1.2842 => 1.3965, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2714 => 0.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.20% (63.2438 => 68.4307, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/wc: 8.19% (0.3052 => 0.3302, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2802 => 0.3031, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.16% (0.2756 => 0.2981, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.15% (0.2872 => 0.3106, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.07% (0.2725 => 0.2945, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2793 => 0.3018, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.93% (0.3935 => 0.4247, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.83% (0.6030 => 0.6502, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.68% (0.3136 => 0.3377, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.68% (2.2022 => 2.3713, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.59% (0.7326 => 0.7882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.03% (10.3673 => 10.8891, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/objinst: 3.42% (0.3131 => 0.3238, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.09% (0.3817 => 0.3935, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.27% (7.9617 => 8.1423, std.dev.: 0.0122) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4734, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6978, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4275, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.65% (4.2280 => 4.4669, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3103, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9167, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7113, std.dev.: 0.0095) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2862, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.46% (27.8444 => 28.2498, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4505, std.dev.: 0.0195) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1762, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -74.99% (0.8651 => 0.2164, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.99% (5.3855 => 4.4703, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.33% (5.3526 => 4.4785, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: -13.67% (10.4361 => 9.0093, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.92% (1.7609 => 1.6214, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.85% (54.1659 => 49.9156, std.dev.: 0.0645) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.72% (1.9577 => 0.6319, std.dev.: 0.0218) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.95% (0.3987 => 0.2474, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.77% (1.5373 => 1.0181, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.47% (10.7105 => 7.4465, std.dev.: 0.0078) MultiSource/Benchmarks/PAQ8p/paq8p: -25.04% (85.0658 => 63.7649, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.76% (2.5528 => 2.1249, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.29% (19.9488 => 18.2947, std.dev.: 0.0574) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.29% (0.2497 => 0.2340, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.19% (1.2373 => 1.1607, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5752, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7008, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8356, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.74% (3.6994 => 3.6350, std.dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: -1.73% (4.6441 => 4.5638, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -1.62% (3.7221 => 3.6617, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: -1.33% (6.2999 => 6.2161, std.dev.: 0.0157) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.06% (0.2116 => 0.0697, std.dev.: 0.0005) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 12:34:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 14:34:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120203439.AD2A02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7801?compare_to=7798&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7801, Order: 172985, Start Time: 2013-01-20 19:01:01, End Time: 2013-01-20 20:34:49 To: 7798, Order: 172983, Start Time: 2013-01-20 17:03:54, End Time: 2013-01-20 18:37:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (102 on baseline) Performance Improvements: 0 (108 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.54% (0.0514 => 0.0892, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.27% (0.1500 => 0.2179, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.79% (0.6395 => 0.8748, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.19% (0.0699 => 0.0924, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.81% (0.6260 => 0.8251, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.80% (0.5805 => 0.7651, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.73% (0.5688 => 0.7493, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.58% (0.5456 => 0.7179, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.24% (0.5849 => 0.7676, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.91% (0.5575 => 0.7298, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.87% (0.5581 => 0.7304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.82% (0.5567 => 0.7283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.82% (0.6395 => 0.8366, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.64% (0.5941 => 0.7702, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.17% (0.5859 => 0.7568, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.02% (0.6033 => 0.7784, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.43% (0.6440 => 0.8271, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.92% (1.6474 => 2.1074, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.66% (0.6189 => 0.7901, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.59% (0.6676 => 0.8518, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.20% (0.6304 => 0.8019, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.14% (0.6230 => 0.7921, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.13% (0.5802 => 0.7318, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.80% (0.6660 => 0.8378, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.38% (0.5705 => 0.7153, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.25% (0.5925 => 0.7421, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.08% (0.5478 => 0.6852, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.92% (0.5570 => 0.6958, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.89% (0.5857 => 0.7315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.83% (0.5569 => 0.6952, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.52% (0.5591 => 0.6962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.29% (0.6446 => 0.7947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.26% (0.5863 => 0.7227, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.06% (0.7524 => 0.9259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.84% (0.6052 => 0.7434, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.62% (0.6681 => 0.8192, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.12% (0.6194 => 0.7564, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.88% (0.6297 => 0.7675, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.05% (2.2587 => 2.7342, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.77% (0.6667 => 0.8052, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.35% (0.0693 => 0.0834, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.65% (0.7339 => 0.8708, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.57% (0.0833 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 15.64% (0.3357 => 0.3882, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.27% (1.1450 => 1.3084, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.80% (0.4916 => 0.5496, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.80% (4.5069 => 5.0385, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.04% (3.5339 => 3.9239, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.87% (1.6364 => 1.8142, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.99% (0.1982 => 0.2180, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.94% (0.2385 => 0.2622, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.52% (0.7021 => 0.7619, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.70% (0.2001 => 0.2155, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4524 => 0.4872, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 7.54% (1.2515 => 1.3459, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.43% (0.5329 => 0.5725, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4861 => 0.5191, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.64% (0.1731 => 0.1846, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.62% (1.4642 => 1.5612, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.38% (1.2784 => 1.3600, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 6.27% (9.2283 => 9.8072, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3255 => 0.3443, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.46% (0.3319 => 0.3467, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.27% (0.6750 => 0.6971, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3446 => 0.3552, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.92% (5.4682 => 5.6279, std.dev.: 0.0052) MultiSource/Applications/SIBsim4/SIBsim4: 2.81% (1.3864 => 1.4253, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 2.72% (5.0226 => 5.1590, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.30% (0.8418 => 0.8612, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.68% (0.7447 => 0.7572, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.63% (0.9557 => 0.9713, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8132, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9531 => 1.0278, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.91% (54.5751 => 56.7066, std.dev.: 0.0776) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.84% (2.0478 => 2.1059, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8210 => 28.2813, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6013, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2706, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4542, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (3.6551 => 3.6918, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.79% (2.4924 => 2.3729, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.7198 => 0.6858, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3812 => 0.3654, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.13% (0.9852 => 0.9445, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.97% (0.3880 => 0.3726, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3831 => 0.3680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.86% (0.3891 => 0.3741, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.84% (0.4033 => 0.3878, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.67% (0.3323 => 0.3201, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.66% (0.4176 => 0.4023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.37% (0.3057 => 0.2954, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.04% (0.6484 => 0.6287, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.03% (0.3658 => 0.3547, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.01% (0.6347 => 0.6156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.81% (0.6441 => 0.6260, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.74% (2.1713 => 2.1118, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.9542 => 0.9283, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.67% (0.4151 => 0.4040, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.63% (1.3148 => 1.2802, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8574, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: -2.46% (0.7779 => 0.7588, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.45% (20.7746 => 20.2652, std.dev.: 0.0296) MultiSource/Applications/sqlite3/sqlite3: -2.19% (17.1032 => 16.7281, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.17% (0.7919 => 0.7747, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.09% (1.2221 => 1.1965, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.02% (1.2210 => 1.1963, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.88% (6.7716 => 6.6446, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/gs/gs: -1.87% (4.3330 => 4.2518, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.86% (1.0544 => 1.0348, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -1.78% (16.1920 => 15.9038, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -1.54% (7.0961 => 6.9869, std.dev.: 0.0150) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.47% (1.2300 => 1.2119, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -1.46% (1.5610 => 1.5382, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/football/football: -1.43% (0.9179 => 0.9048, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.26% (0.8521 => 0.8414, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -1.24% (2.4021 => 2.3723, std.dev.: 0.0083) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.56% (1.8100 => 0.6776, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0050) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3141, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9291, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1977, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3554, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (7.9763 => 7.7790, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.39% (1.3096 => 1.2783, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.13% (3.7241 => 3.6447, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1726, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.44% (1.6219 => 1.5986, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.37% (1.6307 => 1.6084, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 13:08:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 15:08:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130120210808.AD8C62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7802?compare_to=7796&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7802, Order: 172983, Start Time: 2013-01-20 17:34:26, End Time: 2013-01-20 21:08:18 To: 7796, Order: 172971, Start Time: 2013-01-20 13:07:04, End Time: 2013-01-20 16:40:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (181 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.81% (0.0696 => 0.0813, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.09% (54.2801 => 54.8718, std.dev.: 0.0969) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.51% (1.9943 => 1.9641, std.dev.: 0.0021) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.00% (0.0625 => 0.0875, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 31.98% (0.1063 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 27.55% (0.2969 => 0.3787, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.33% (0.0714 => 0.0902, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.22% (0.1106 => 0.1396, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.14% (0.0547 => 0.0690) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 25.90% (0.4139 => 0.5211, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.68% (0.4253 => 0.5345, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.61% (0.5900 => 0.7411, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.06% (0.0415 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.05% (0.0475 => 0.0594, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.49% (0.0584 => 0.0727, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.89% (0.4994 => 0.6187, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 23.71% (0.0599 => 0.0741, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.52% (0.0897 => 0.1108, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.46% (0.5000 => 0.6173, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.28% (1.5932 => 1.9641, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.27% (0.1620 => 0.1997, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.11% (0.1021 => 0.1257, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.47% (0.1549 => 0.1897, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0584 => 0.0713, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 21.96% (0.0633 => 0.0772, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.73% (0.1003 => 0.1221, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.63% (0.1604 => 0.1951, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.50% (0.0642 => 0.0780, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.49% (0.1103 => 0.1340, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.41% (0.0495 => 0.0601, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.32% (0.1107 => 0.1343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.29% (0.3903 => 0.4734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.17% (0.0822 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.89% (0.0541 => 0.0654, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.36% (0.2736 => 0.3293, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 19.55% (0.0808 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.50% (0.2866 => 0.3425, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/08-main/main: 19.46% (0.1218 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.30% (0.1088 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.17% (0.2014 => 0.2400, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 19.01% (0.4029 => 0.4795, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 18.89% (0.3890 => 0.4625, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/09-vor/vor: 18.74% (0.1505 => 0.1787, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.62% (0.3271 => 0.3880, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 18.60% (1.8794 => 2.2289, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.38% (0.4658 => 0.5514, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.18% (0.0572 => 0.0676, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 18.10% (0.5546 => 0.6550, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 18.09% (0.5826 => 0.6880, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.87% (0.5026 => 0.5924, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 17.74% (0.5889 => 0.6934, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.74% (0.2875 => 0.3385, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.71% (1.3152 => 1.5481, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.55% (3.5627 => 4.1881, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.49% (1.6211 => 1.9046, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/strcat: 17.45% (0.2750 => 0.3230, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.38% (0.2911 => 0.3417, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 17.32% (0.2823 => 0.3312) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.29% (0.4361 => 0.5115, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.28% (0.1968 => 0.2308, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 17.25% (0.2811 => 0.3296, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.23% (0.2792 => 0.3273, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 17.21% (0.2714 => 0.3181, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.21% (0.2813 => 0.3297, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.12% (0.2803 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.07% (0.1160 => 0.1358, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 17.06% (0.2725 => 0.3190, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 17.06% (0.1284 => 0.1503, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 16.91% (0.3004 => 0.3512, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.89% (0.2729 => 0.3190, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.88% (2.0673 => 2.4162, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 16.79% (0.9697 => 1.1325, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.63% (0.9909 => 1.1557, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 16.61% (0.1421 => 0.1657, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.56% (0.3195 => 0.3724, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wc: 16.41% (0.3096 => 0.3604, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.31% (0.3930 => 0.4571, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 16.25% (0.3267 => 0.3798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.21% (0.3258 => 0.3786, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.18% (0.3060 => 0.3555, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 16.11% (0.7171 => 0.8326, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 16.07% (0.3317 => 0.3850, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.01% (0.3124 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.94% (0.3282 => 0.3805, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.89% (0.3625 => 0.4201, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.85% (0.3477 => 0.4028, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 15.81% (1.0781 => 1.2486, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sieve: 15.75% (0.3726 => 0.4313, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.66% (1.9694 => 2.2778, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout-C++/moments: 15.63% (0.3678 => 0.4253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.62% (0.3362 => 0.3887, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.56% (0.4146 => 0.4791, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 15.55% (4.2109 => 4.8657, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.42% (1.9966 => 2.3045, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 15.36% (23.5202 => 27.1329, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.32% (4.4195 => 5.0966, std.dev.: 0.0325) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.27% (2.7292 => 3.1459, std.dev.: 0.0107) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.16% (0.3845 => 0.4428, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.03% (1.4269 => 1.6413, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 15.01% (0.4251 => 0.4889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.99% (0.3690 => 0.4243, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.97% (0.3981 => 0.4577, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.77% (0.1090 => 0.1251, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 14.73% (0.2566 => 0.2944, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.56% (0.2068 => 0.2369, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 14.15% (0.5012 => 0.5721, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 13.97% (0.7875 => 0.8975, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.36% (0.3496 => 0.3963, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 13.35% (0.3469 => 0.3932, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.33% (0.1028 => 0.1165, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.32% (0.6435 => 0.7292, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.28% (0.3465 => 0.3925) SingleSource/UnitTests/ObjC/exceptions-2: 13.26% (0.3446 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.21% (0.3650 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.20% (0.2075 => 0.2349, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3442 => 0.3896, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.19% (0.3488 => 0.3948, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 12.97% (0.3724 => 0.4207, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 12.85% (2.1653 => 2.4436, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/exceptions: 12.82% (0.3643 => 0.4110, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 12.76% (5.5417 => 6.2488, std.dev.: 0.0084) MultiSource/Applications/SIBsim4/SIBsim4: 12.71% (0.2691 => 0.3033, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.57% (0.2737 => 0.3081, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 12.43% (4.6177 => 5.1917, std.dev.: 0.0085) MultiSource/Benchmarks/mafft/pairlocalalign: 12.14% (2.1013 => 2.3563, std.dev.: 0.0133) MultiSource/Applications/lambda-0_1_3/lambda: 11.61% (0.3498 => 0.3904, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.45% (0.3084 => 0.3437, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.13% (0.2040 => 0.2267, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 10.96% (0.6634 => 0.7361, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.82% (0.5361 => 0.5941, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.75% (0.2103 => 0.2329, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.37% (11.6398 => 12.8464, std.dev.: 0.0216) MultiSource/Applications/lemon/lemon: 10.25% (0.2391 => 0.2636, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.95% (0.7426 => 0.8165, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.54% (0.1383 => 0.1515, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.50% (4.6926 => 5.1385, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 9.13% (2.0346 => 2.2204, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.99% (0.5584 => 0.6086, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 7.53% (11.9555 => 12.8555, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.01% (0.3792 => 0.3944, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5297, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.98% (0.0695 => 0.0813, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.64% (0.3693 => 0.4012, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6736, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2353, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.86% (1.8057 => 1.8935, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6816, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/health/health: 3.09% (0.6276 => 0.6470, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1937, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.90% (2.0820 => 2.1216, std.dev.: 0.0053) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2857, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0816, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2080, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4808, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5846, std.dev.: 0.0333) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.35% (2.4764 => 2.4429, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5782, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.50% (17.2379 => 14.3929, std.dev.: 0.0626) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7982, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0027) SingleSource/Benchmarks/Dhrystone/dry: -5.86% (14.0481 => 13.2244, std.dev.: 0.2914) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2138, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8020, std.dev.: 0.0057) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1237, std.dev.: 0.0427) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.02% (0.6293 => 0.6166, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5795, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1988, std.dev.: 0.0514) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 13:13:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 15:13:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130120211308.327152A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7803?compare_to=7799&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7803, Order: 172986, Start Time: 2013-01-20 19:13:04, End Time: 2013-01-20 21:13:20 To: 7799, Order: 172983, Start Time: 2013-01-20 16:51:19, End Time: 2013-01-20 18:52:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (7 on baseline) Performance Improvements: 8 (88 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1051 (968 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/strcat: 8.32% (0.1539 => 0.1667, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.76% (1.2831 => 1.3699, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (0.3281 => 0.3476, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 1.83% (0.8417 => 0.8571, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/pi: 1.58% (2.1796 => 2.2140, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/tsp/tsp: -7.71% (0.1413 => 0.1304, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.62% (0.9256 => 0.8828, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.05% (0.6890 => 0.6611, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.45% (0.5480 => 0.5291, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.92% (0.8687 => 0.8433, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.28% (9.4697 => 9.2535, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.85% (1.5541 => 1.5254, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.46% (1.3753 => 1.3552, std.dev.: 0.0071) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.89% (1.1298 => 1.1198, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0224 => 0.0224, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -13.13% (0.0434 => 0.0377, std.dev.: 0.0150) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0338 => 0.0340, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0322 => 0.0321, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.29% (0.0435 => 0.0412, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/casts: -13.33% (0.0210 => 0.0182, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0224 => 0.0224, std.dev.: 0.0077) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0253 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -42.86% (0.0014 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.96% (0.1456 => 0.1442, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.47% (1.1201 => 1.1590, std.dev.: 0.0395) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.36% (0.3936 => 0.4147, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.99% (0.1454 => 0.1483, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.01% (0.0986 => 0.0976, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.18% (0.0263 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.38% (0.0561 => 0.0608, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.1495 => 1.1468, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.65% (0.0615 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.38% (0.0318 => 0.0285, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.00% (0.7408 => 0.7334, std.dev.: 0.0143) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -30.08% (0.0123 => 0.0086, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7540 => 12.7630, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.40% (0.0336 => 0.0502, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.02% (0.1384 => 0.1495, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319162.50% (0.0008 => 2.5541, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.72% (1.1825 => 2.3972, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.79% (0.2562 => 0.2864, std.dev.: 0.0022) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.40% (9.0082 => 9.4047, std.dev.: 0.1048) SingleSource/Benchmarks/Misc/pi: 3.51% (2.1390 => 2.2140, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.09% (0.0808 => 0.0476, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -26.48% (0.1888 => 0.1388, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.21% (0.1009 => 0.0795, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -19.39% (1.8964 => 1.5286, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -18.07% (0.1079 => 0.0884, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.85% (0.7686 => 0.6468, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: -13.76% (1.0220 => 0.8814, std.dev.: 0.0122) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.65% (0.4074 => 0.3518, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: -12.80% (1.5979 => 1.3933, std.dev.: 0.0152) MultiSource/Applications/treecc/treecc: -12.03% (2.4719 => 2.1745, std.dev.: 0.0283) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.64% (1.2154 => 1.0739, std.dev.: 0.0220) MultiSource/Applications/hexxagon/hexxagon: -10.97% (1.1433 => 1.0179, std.dev.: 0.0086) MultiSource/Applications/lua/lua: -10.83% (4.6406 => 4.1378, std.dev.: 0.0309) MultiSource/Applications/aha/aha: -10.74% (0.1378 => 0.1230, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.65% (6.4235 => 5.7396, std.dev.: 0.2178) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.44% (1.5131 => 1.3552, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.90% (10.2703 => 9.2535, std.dev.: 0.0340) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.78% (0.7693 => 0.6941, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.60% (1.6874 => 1.5254, std.dev.: 0.0076) MultiSource/Applications/sqlite3/sqlite3: -9.49% (17.5634 => 15.8959, std.dev.: 0.1070) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.43% (0.2481 => 0.2247, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/health/health: -9.19% (0.1610 => 0.1462, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.07% (1.1498 => 1.0455, std.dev.: 0.0221) MultiSource/Applications/siod/siod: -8.75% (2.6437 => 2.4123, std.dev.: 0.0180) MultiSource/Applications/sgefa/sgefa: -8.25% (0.3598 => 0.3301, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.22% (0.6885 => 0.6319, std.dev.: 0.0124) MultiSource/Applications/lambda-0_1_3/lambda: -8.22% (0.8653 => 0.7942, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -8.16% (17.4365 => 16.0144, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.03% (0.3560 => 0.3274, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.01% (0.2372 => 0.2182, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.93% (0.9588 => 0.8828, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.92% (0.5746 => 0.5291, std.dev.: 0.0067) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.83% (1.1731 => 1.0812, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.58% (0.2283 => 0.2110, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.57% (0.9124 => 0.8433, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: -6.90% (3.7840 => 3.5229, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.30% (1.3310 => 1.2471, std.dev.: 0.0226) MultiSource/Applications/lemon/lemon: -6.20% (1.3979 => 1.3113, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.14% (0.2100 => 0.1971, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.80% (1.0017 => 0.9436, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.69% (0.2618 => 0.2469, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.51% (0.2577 => 0.2435, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.91% (5.0381 => 4.7906, std.dev.: 0.0510) SingleSource/Benchmarks/Shootout-C++/moments: -4.82% (0.4002 => 0.3809, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -4.80% (1.4392 => 1.3701, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.78% (0.7776 => 0.7404, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.71% (1.2680 => 1.2083, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -4.66% (0.6934 => 0.6611, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.62% (0.3462 => 0.3302, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.04% (1.0234 => 0.9821, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.02% (0.9422 => 0.9043, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: -3.96% (0.3715 => 0.3568, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.90% (1.3220 => 1.2704, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.88% (0.9512 => 0.9143, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/gs/gs: -3.85% (4.5936 => 4.4167, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/hash: -3.60% (0.4689 => 0.4520, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.57% (0.3981 => 0.3839, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -3.55% (18.9377 => 18.2651, std.dev.: 0.1793) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.24% (0.8990 => 0.8699, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.09% (0.9091 => 0.8810, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.94% (1.0052 => 0.9756, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.85% (0.9403 => 0.9135, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.81% (0.4762 => 0.4628, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -2.72% (7.3529 => 7.1528, std.dev.: 0.0409) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.44% (0.6996 => 0.6825, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: -2.08% (5.3553 => 5.2439, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.91% (0.9855 => 0.9667, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -1.88% (16.7012 => 16.3868, std.dev.: 0.0684) MultiSource/Benchmarks/Prolangs-C/football/football: -1.86% (0.9759 => 0.9577, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.04% (0.9372 => 0.6463, std.dev.: 0.0304) MultiSource/Applications/minisat/minisat: -22.58% (7.9891 => 6.1851, std.dev.: 0.0134) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.76% (1.0816 => 0.8571, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.41% (1.5623 => 1.2747, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.16% (1.4235 => 1.2646, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.92% (0.4081 => 0.3676, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.29% (4.4540 => 4.0846, std.dev.: 0.0722) MultiSource/Applications/SPASS/SPASS: -6.81% (9.0650 => 8.4479, std.dev.: 0.1154) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.09% (1.4588 => 1.3699, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.28% (0.3201 => 0.3032, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.75% (0.3349 => 0.3190, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -3.46% (4.4730 => 4.3182, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: -3.28% (3.5443 => 3.4280, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.71% (1.4446 => 1.4055, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: -2.51% (2.8571 => 2.7853, std.dev.: 0.0075) MultiSource/Benchmarks/llubenchmark/llu: -2.00% (2.0298 => 1.9892, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.07% (3.1921 => 3.1578, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.05% (1.2047 => 1.1198, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.41% (0.0451 => 0.0377, std.dev.: 0.0150) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0092) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -7.42% (0.0445 => 0.0412, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/casts: -14.55% (0.0213 => 0.0182, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0077) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -39.93% (1.9293 => 1.1590, std.dev.: 0.0395) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.42% (0.4049 => 0.4147, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.79% (0.1510 => 0.1483, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.05% (0.0590 => 0.0608, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.28% (1.1617 => 1.1468, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.38% (0.7437 => 0.7334, std.dev.: 0.0143) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.52% (0.0092 => 0.0086, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7630, std.dev.: 0.0085) Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 14:12:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 16:12:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130120221221.20D842A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7804?compare_to=7800&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7804, Order: 172987, Start Time: 2013-01-20 20:01:08, End Time: 2013-01-20 22:12:32 To: 7800, Order: 172983, Start Time: 2013-01-20 17:19:47, End Time: 2013-01-20 19:31:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (215 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.03% (0.6319 => 0.6637, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.68% (42.1558 => 42.8640, std.dev.: 0.1007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.03% (0.0697 => 0.0655, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -0.04% (499.8503 => 499.6675, std.dev.: 0.0917) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44208.55% (1.1277 => 499.6675, std.dev.: 0.0917) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.90% (0.5229 => 1.6466, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 19.74% (14.9895 => 17.9477, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: 42.89% (14.1553 => 20.2266, std.dev.: 0.0221) MultiSource/Benchmarks/MallocBench/gs/gs: 17.37% (4.1105 => 4.8246, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.21% (1.1048 => 1.7258, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.06% (7.1582 => 37.3702, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.16% (3.4629 => 6.3773, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/stepanov_container: 73.96% (0.6222 => 1.0824, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10247.92% (0.0720 => 7.4505, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11155600.00% (0.0001 => 11.1557, std.dev.: 0.0282) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489500.00% (0.0001 => 5.4896, std.dev.: 0.0284) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.33% (1.1194 => 10.3358, std.dev.: 0.0329) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783) MultiSource/Applications/ClamAV/clamscan: 149.50% (22.1758 => 55.3276, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/lowercase: 120.70% (0.0256 => 0.0565) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.02% (0.0929 => 0.1821, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.40% (0.1463 => 0.2493, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.05% (2.9384 => 4.6149, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.19% (7.0540 => 10.8058, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.64% (1.5859 => 2.3890, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/distray/distray: 48.11% (0.1056 => 0.1564, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: 46.98% (0.0232 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.70% (8.1363 => 11.9359, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.75% (2.2024 => 3.0998, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 38.98% (0.3109 => 0.4321, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.50% (0.0439 => 0.0608, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.31% (21.9371 => 30.3412, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0000) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.58% (4.2646 => 5.6541, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.26% (0.4615 => 0.6104, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 31.57% (0.0814 => 0.1071, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.49% (1.5415 => 2.0269, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 29.90% (0.2271 => 0.2950, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.29% (0.4299 => 0.5558, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 29.00% (1.1642 => 1.5018, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.88% (0.6675 => 0.8536, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.62% (0.5105 => 0.6464, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 26.22% (0.1655 => 0.2089, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.10% (0.0793 => 0.1000, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.07% (0.1584 => 0.1997, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.06% (0.1892 => 0.2385, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.87% (0.1125 => 0.1416, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 25.49% (0.2554 => 0.3205, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.37% (3.8922 => 4.8795, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.01% (0.4289 => 0.5319, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/hash: 23.92% (0.0485 => 0.0601, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 23.74% (0.1175 => 0.1454, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.61% (0.3121 => 0.3858, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: 23.47% (1.0722 => 1.3238, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.30% (1.4186 => 1.7491, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.19% (0.1337 => 0.1647, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.13% (0.1695 => 0.2087, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 22.94% (0.4620 => 0.5680, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.88% (0.0730 => 0.0897, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.80% (0.0842 => 0.1034, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 22.22% (9.4845 => 11.5921, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 21.91% (0.7115 => 0.8674, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.58% (0.0672 => 0.0817, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 21.15% (0.1163 => 0.1409, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.07% (0.2700 => 0.3269, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.06% (0.0660 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 20.66% (0.3098 => 0.3738, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.57% (0.7835 => 0.9447, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.55% (0.1236 => 0.1490, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.39% (5.7591 => 6.9331, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.21% (1.3050 => 1.5688, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.59% (0.6456 => 0.7721, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.48% (0.1032 => 0.1233, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 19.46% (0.1151 => 0.1375, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.17% (4.9449 => 5.8929, std.dev.: 0.0134) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.09% (0.8172 => 0.9732, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bisort/bisort: 19.06% (0.0614 => 0.0731, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.03% (0.5860 => 0.6975, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/ft/ft: 18.92% (0.1940 => 0.2307, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 18.58% (3.3354 => 3.9551, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.42% (5.0018 => 5.9229, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.14% (0.3307 => 0.3907, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.91% (0.2758 => 0.3252, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.79% (0.0770 => 0.0907, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.71% (0.5020 => 0.5909, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 17.58% (0.7433 => 0.8740, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.47% (0.5569 => 0.6542, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.33% (0.9765 => 1.1457, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0084) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.22% (0.1510 => 0.1770, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.09% (0.2107 => 0.2467, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 16.88% (3.8723 => 4.5258, std.dev.: 0.0094) MultiSource/Applications/treecc/treecc: 16.76% (2.0273 => 2.3671, std.dev.: 0.0090) MultiSource/Benchmarks/nbench/nbench: 16.70% (1.1840 => 1.3817, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.54% (0.5981 => 0.6970, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 16.45% (0.2049 => 0.2386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.05% (0.3283 => 0.3810, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.04% (0.3441 => 0.3993, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 15.99% (0.8101 => 0.9396, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 15.87% (2.2969 => 2.6614, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.86% (0.0933 => 0.1081, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.80% (0.1044 => 0.1209, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 15.69% (0.3232 => 0.3739, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.30% (0.6450 => 0.7437, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 14.87% (0.3180 => 0.3653, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 14.60% (0.1144 => 0.1311, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 14.39% (0.8921 => 1.0205, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary2: 14.38% (0.3379 => 0.3865, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.32% (1.1861 => 1.3560, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.85% (0.8067 => 0.9184, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.29% (0.2603 => 0.2949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.17% (0.3865 => 0.4374, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.14% (0.4636 => 0.5245, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 12.67% (0.3387 => 0.3816, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.58% (1.5603 => 1.7566, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.28% (0.4103 => 0.4607, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.3927 => 0.4394, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.87% (0.4203 => 0.4702, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 11.51% (0.3422 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.49% (0.4048 => 0.4513, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.35% (0.3603 => 0.4012, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.22% (17.1811 => 19.1089, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 11.13% (0.3684 => 0.4094, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.11% (0.2430 => 0.2700, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 10.88% (0.1268 => 0.1406, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.84% (0.3828 => 0.4243, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.82% (0.3826 => 0.4240, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 10.53% (0.3543 => 0.3916, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.43% (0.4064 => 0.4488, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.41% (0.3543 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.39% (0.3561 => 0.3931, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.07% (0.3427 => 0.3772, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.90% (14.3668 => 15.7894, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/except: 9.89% (0.2871 => 0.3155, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 9.61% (0.2831 => 0.3103, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 9.03% (1.2842 => 1.4001, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.01% (2.0665 => 2.2526, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.73% (0.2725 => 0.2963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2905 => 0.3157, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 8.47% (0.2714 => 0.2944, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.41% (0.2891 => 0.3134, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.29% (0.3162 => 0.3424, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.19% (63.2438 => 68.4248, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/random: 8.10% (0.2802 => 0.3029, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.07% (0.3136 => 0.3389, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2793 => 0.3018, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.80% (0.3935 => 0.4242, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.79% (0.6030 => 0.6500, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.73% (2.2022 => 2.3724, std.dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: 7.63% (0.7326 => 0.7885, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 7.43% (0.5925 => 0.6365, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.36% (0.3177 => 0.3379, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.00% (10.3673 => 10.8856, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (7.9617 => 8.1448, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4751, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4274, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4559, std.dev.: 0.0135) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3137, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (0.9957 => 1.0283, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.6802 => 8.9083, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7108, std.dev.: 0.0111) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2786, std.dev.: 0.0379) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (27.8444 => 28.2537, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 1.36% (1.0785 => 1.0932, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5820, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4507, std.dev.: 0.0220) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1763, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -74.80% (0.8651 => 0.2180, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.97% (5.3855 => 4.4717, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.41% (5.3526 => 4.4742, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -13.75% (10.4361 => 9.0009, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.91% (1.7609 => 1.6216, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -7.90% (54.1659 => 49.8883, std.dev.: 0.0249) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.10% (1.9577 => 0.6637, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.92% (0.3987 => 0.2475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3056, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0204, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.50% (10.7105 => 7.4440, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -25.06% (85.0658 => 63.7507, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0063, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -20.87% (0.0757 => 0.0599, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1252, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4929, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.31% (19.9488 => 18.2913, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: -6.96% (1.2373 => 1.1512, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.59% (8.1563 => 7.7005, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.10% (0.4808 => 0.4563, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -4.47% (10.2830 => 9.8238, std.dev.: 0.0110) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0082) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.03% (1.0554 => 1.0340, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.78% (4.6441 => 4.5615, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (3.7221 => 3.6615, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0025) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 14:31:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 16:31:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130120223148.B451A2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7805?compare_to=7801&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7805, Order: 172988, Start Time: 2013-01-20 20:58:10, End Time: 2013-01-20 22:31:59 To: 7801, Order: 172985, Start Time: 2013-01-20 19:01:01, End Time: 2013-01-20 20:34:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (101 on baseline) Performance Improvements: 0 (112 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.35% (0.0514 => 0.0891, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.76% (0.0717 => 0.1210, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.61% (0.0974 => 0.1613, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.20% (0.1500 => 0.2178, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.99% (0.1132 => 0.1596, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 36.60% (0.0418 => 0.0571, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.50% (0.6395 => 0.8729, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.05% (0.0699 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.49% (0.6260 => 0.8231, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.47% (0.5688 => 0.7478, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.32% (0.5456 => 0.7165, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.32% (0.5805 => 0.7623, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.98% (0.5849 => 0.7661, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.73% (0.5567 => 0.7278, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.67% (0.5575 => 0.7285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.46% (0.5581 => 0.7281, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.32% (0.6395 => 0.8334, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.51% (0.5941 => 0.7694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.98% (0.5859 => 0.7557, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.78% (0.6033 => 0.7769, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.31% (0.6440 => 0.8263, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.60% (0.6189 => 0.7897, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.59% (1.6474 => 2.1019, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.37% (0.6676 => 0.8503, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.81% (0.6304 => 0.7994, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.79% (0.6230 => 0.7899, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.90% (0.5802 => 0.7305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.57% (0.6660 => 0.8363, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.18% (0.5925 => 0.7417, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.10% (0.5705 => 0.7137, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.81% (0.5857 => 0.7310, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.70% (0.5570 => 0.6946, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.66% (0.5478 => 0.6829, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.64% (0.5569 => 0.6941, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.38% (0.5591 => 0.6954, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.11% (0.5863 => 0.7218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.04% (0.6446 => 0.7931, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.77% (0.7524 => 0.9237, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.59% (0.6052 => 0.7419, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.34% (0.0582 => 0.0712, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.23% (0.6681 => 0.8166, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.71% (0.6194 => 0.7539, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.63% (0.6297 => 0.7659, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.66% (2.2587 => 2.7254, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.61% (0.6667 => 0.8041, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.35% (0.7339 => 0.8686, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.33% (0.0833 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.69% (0.3357 => 0.3850, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.04% (1.1450 => 1.3058, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.76% (0.4515 => 0.5046, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.55% (0.4916 => 0.5484, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.50% (4.5069 => 5.0253, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.74% (3.5339 => 3.9135, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.74% (1.6364 => 1.8121, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.74% (0.1982 => 0.2175, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2385 => 0.2616, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.7021 => 0.7609, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.38% (0.4524 => 0.4858, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 7.26% (1.2515 => 1.3423, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.04% (0.5329 => 0.5704, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 6.95% (0.4861 => 0.5199, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.41% (0.1731 => 0.1842, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.36% (1.4642 => 1.5573, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.2784 => 1.3577, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.07% (9.2283 => 9.7885, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.13% (0.3319 => 0.3456, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.07% (0.6750 => 0.6957, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3446 => 0.3551, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.50% (5.0226 => 5.1484, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.47% (5.4682 => 5.6032, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 2.46% (1.3864 => 1.4205, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.90% (0.8418 => 0.8578, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.41% (0.9557 => 0.9692, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.26% (1.3722 => 1.3895, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8169, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.19% (0.9531 => 1.0312, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1498, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6206, std.dev.: 0.1100) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1062, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8210 => 28.2813, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.19% (10.3489 => 10.4718, std.dev.: 0.0150) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.93% (2.4924 => 2.3695, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.61% (0.2428 => 0.2316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.46% (0.3837 => 0.3666, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (0.9852 => 0.9418, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.01% (0.3812 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.98% (0.3896 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.92% (0.4033 => 0.3875, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.92% (0.3831 => 0.3681, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.4176 => 0.4014, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.50% (0.4199 => 0.4052, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3884 => 0.3749, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.37% (0.3057 => 0.2954) SingleSource/UnitTests/ObjC/parameter-passing: -3.18% (0.4280 => 0.4144, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.17% (0.3658 => 0.3542, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.09% (2.1713 => 2.1042, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.96% (0.6347 => 0.6159, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.94% (1.3148 => 1.2762, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.91% (0.6484 => 0.6295, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.84% (0.4151 => 0.4033, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.83% (0.6441 => 0.6259, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.9542 => 0.9274, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.64% (0.7919 => 0.7710, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -2.63% (20.7746 => 20.2288, std.dev.: 0.0641) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.48% (14.2083 => 13.8553, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference: -2.35% (0.7779 => 0.7596, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7015, std.dev.: 0.0203) MultiSource/Applications/lambda-0_1_3/lambda: -2.31% (0.7982 => 0.7798, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/gs/gs: -2.20% (4.3330 => 4.2375, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.19% (1.2221 => 1.1953, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (1.2210 => 1.1949, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.04% (6.7716 => 6.6334, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -2.01% (16.1920 => 15.8663, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.98% (1.0544 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (1.2300 => 1.2064, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -1.79% (2.4021 => 2.3590, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/football/football: -1.75% (0.9179 => 0.9018, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -1.66% (7.0961 => 6.9782, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -1.60% (1.5610 => 1.5360, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.42% (0.8521 => 0.8400, std.dev.: 0.0014) MultiSource/Applications/lua/lua: -1.39% (4.0594 => 4.0030, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.10% (34.0927 => 33.7173, std.dev.: 0.0214) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.16% (1.8100 => 0.6668, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3125, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0237, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9291, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1980, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1311, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3577, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2667, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3989, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.66% (7.9763 => 7.7642, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6290, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1750, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4754, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.44% (1.6219 => 1.5985, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.39% (1.6307 => 1.6080, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5883, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6667, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 16:17:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 18:17:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121001752.7EF5F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7806?compare_to=7803&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7806, Order: 172996, Start Time: 2013-01-20 22:20:59, End Time: 2013-01-21 00:18:05 To: 7803, Order: 172986, Start Time: 2013-01-20 19:13:04, End Time: 2013-01-20 21:13:20 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (7 on baseline) Performance Improvements: 6 (177 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.53% (1.4587 => 1.8748, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.21% (5.5210 => 6.3056, std.dev.: 0.2023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -8.16% (0.1495 => 0.1373, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.57% (0.9392 => 0.9245, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.28% (1.1026 => 1.0554, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: -4.17% (3.2436 => 3.1084, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.88% (1.3699 => 1.3305, std.dev.: 0.0097) SingleSource/Benchmarks/Dhrystone/dry: -2.04% (0.5283 => 0.5175, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.14% (1.1198 => 1.1182, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.43% (0.0224 => 0.0176, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.51% (0.0377 => 0.0394, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.59% (0.0340 => 0.0321, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0321 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.59% (0.0412 => 0.0356, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -19.23% (0.0182 => 0.0147, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: -29.46% (0.0224 => 0.0158, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 0.90% (0.1442 => 0.1455, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -3.18% (1.1590 => 1.1222, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.36% (0.4147 => 0.3966, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1483 => 0.1482, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.92% (0.0976 => 0.0967, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.22% (0.0274 => 0.0246, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.86% (0.0608 => 0.0542, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.1468 => 1.1426, std.dev.: 0.1072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -13.79% (0.0029 => 0.0025, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0026 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.77% (0.0611 => 0.0533, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.81% (0.0285 => 0.0220, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.02% (0.7334 => 0.7409, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0007 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.60% (0.0086 => 0.0070, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.10% (12.7630 => 12.7505, std.dev.: 0.5058) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.49% (0.0336 => 0.0509, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322375.00% (0.0008 => 2.5798, std.dev.: 0.0574) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.13% (1.1825 => 2.3665, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.53% (5.6033 => 6.3056, std.dev.: 0.2023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.05% (0.2562 => 0.2845, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.96% (63.1520 => 64.3915, std.dev.: 0.0623) MultiSource/Applications/siod/siod: 1.06% (3.5910 => 3.6292, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.71% (0.0808 => 0.0471, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.32% (0.0727 => 0.0492, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -27.44% (0.1888 => 0.1370, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.52% (0.1684 => 0.1288, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -20.21% (1.8964 => 1.5132, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -19.22% (0.1025 => 0.0828, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.75% (0.7686 => 0.6245, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.33% (0.1009 => 0.0824, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: -18.18% (0.0737 => 0.0603, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.40% (0.0862 => 0.0712, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.96% (0.1079 => 0.0896, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.95% (1.0960 => 0.9102, std.dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: -16.67% (9.8875 => 8.2392, std.dev.: 0.1721) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.47% (1.0986 => 0.9396, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.38% (0.4074 => 0.3488, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: -14.25% (1.0220 => 0.8764, std.dev.: 0.0124) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -13.59% (0.1317 => 0.1138, std.dev.: 0.0038) MultiSource/Applications/aha/aha: -12.77% (0.1378 => 0.1202, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: -12.39% (1.5979 => 1.3999, std.dev.: 0.0116) MultiSource/Applications/treecc/treecc: -12.00% (2.4719 => 2.1753, std.dev.: 0.0207) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.74% (1.2154 => 1.0727, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/loader/loader: -11.35% (0.3560 => 0.3156, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.26% (6.4235 => 5.7002, std.dev.: 0.0082) MultiSource/Applications/hexxagon/hexxagon: -11.20% (1.1433 => 1.0152, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -10.91% (4.6406 => 4.1341, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.88% (1.5131 => 1.3485, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/tsp/tsp: -10.81% (0.1369 => 0.1221, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.76% (0.2481 => 0.2214, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.75% (0.7693 => 0.6866, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.35% (10.2703 => 9.2070, std.dev.: 0.0963) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.97% (1.1498 => 1.0352, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -9.69% (17.5634 => 15.8610, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.69% (1.3924 => 1.2575, std.dev.: 0.0119) MultiSource/Applications/sgefa/sgefa: -9.53% (0.3598 => 0.3255, std.dev.: 0.0033) MultiSource/Applications/siod/siod: -9.29% (2.6437 => 2.3981, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -9.28% (0.6885 => 0.6246, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: -9.15% (0.2884 => 0.2620, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.15% (1.6874 => 1.5330, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.81% (0.9588 => 0.8743, std.dev.: 0.0137) MultiSource/Applications/ClamAV/clamscan: -8.74% (17.4365 => 15.9122, std.dev.: 0.0624) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.68% (0.2372 => 0.2166, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: -8.61% (0.1824 => 0.1667, std.dev.: 0.0043) MultiSource/Applications/lambda-0_1_3/lambda: -8.51% (0.8653 => 0.7917, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.46% (0.9124 => 0.8352, std.dev.: 0.0179) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.46% (1.1731 => 1.0739, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.00% (0.1587 => 0.1460, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.81% (0.5746 => 0.5297, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/health/health: -7.45% (0.1610 => 0.1490, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.24% (1.3310 => 1.2346, std.dev.: 0.0232) MultiSource/Applications/d/make_dparser: -7.24% (3.7840 => 3.5101, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.95% (0.2100 => 0.1954, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -6.92% (1.3979 => 1.3012, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -6.91% (0.6934 => 0.6455, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (0.2006 => 0.1877, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.40% (0.2283 => 0.2137, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -6.23% (0.5134 => 0.4814, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.01% (1.8127 => 1.7038, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.00% (1.0017 => 0.9416, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.91% (0.7693 => 0.7238, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/moments: -5.75% (0.4002 => 0.3772, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.57% (0.9550 => 0.9018, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.2385 => 0.2253, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.46% (0.2144 => 0.2027, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.40% (5.0381 => 4.7659, std.dev.: 0.0417) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.17% (3.6295 => 3.4418, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.17% (0.6135 => 0.5818, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.16% (0.2615 => 0.2480, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.09% (0.2709 => 0.2571, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: -5.05% (4.5936 => 4.3617, std.dev.: 0.0486) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.94% (0.3462 => 0.3291, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -4.78% (0.7776 => 0.7404, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -4.71% (1.4392 => 1.3714, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.3981 => 0.3796, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.62% (0.2577 => 0.2458, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/lists: -4.55% (0.2725 => 0.2601, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.47% (0.3665 => 0.3501, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: -4.39% (0.2551 => 0.2439, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.25% (1.0234 => 0.9799, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.21% (1.2680 => 1.2146, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.15% (0.9507 => 0.9112, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.13% (0.9422 => 0.9033, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.07% (0.3093 => 0.2967, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.99% (1.3220 => 1.2693, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: -3.98% (0.2915 => 0.2799, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -3.98% (0.2665 => 0.2559, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.95% (4.6579 => 4.4738, std.dev.: 0.0466) MultiSource/Applications/SPASS/SPASS: -3.88% (16.4479 => 15.8089, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.82% (0.9127 => 0.8778, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.72% (0.9788 => 0.9424, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.69% (0.9405 => 0.9058, std.dev.: 0.0032) MultiSource/Applications/kimwitu++/kc: -3.63% (18.9377 => 18.2511, std.dev.: 0.0495) SingleSource/Benchmarks/Shootout-C++/hash: -3.56% (0.4689 => 0.4522, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.54% (0.9512 => 0.9175, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.52% (0.9403 => 0.9072, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -3.50% (0.6711 => 0.6476, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.50% (0.3715 => 0.3585, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.48% (0.9214 => 0.8893, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.48% (0.8990 => 0.8677, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.39% (1.0052 => 0.9711, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.36% (0.3394 => 0.3280, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: -3.34% (0.3206 => 0.3099, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.07% (0.9993 => 0.9686, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.04% (14.9757 => 14.5210, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.02% (0.9091 => 0.8816, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.71% (0.4762 => 0.4633, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -2.61% (7.3529 => 7.1613, std.dev.: 0.0326) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.56% (0.9488 => 0.9245, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.53% (4.9104 => 4.7861, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.51% (1.0119 => 0.9865, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.50% (2.4519 => 2.3906, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.38% (1.0860 => 1.0602, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.30% (7.2721 => 7.1052, std.dev.: 0.0058) MultiSource/Applications/oggenc/oggenc: -2.25% (5.3553 => 5.2349, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.19% (4.8904 => 4.7832, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.96% (0.9855 => 0.9662, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: -1.90% (1.2708 => 1.2467, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.86% (0.6996 => 0.6866, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: -1.83% (16.7012 => 16.3958, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.82% (0.9685 => 0.9509, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.57% (0.8926 => 0.8786, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.46% (0.9061 => 0.8929, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.39% (0.9612 => 0.9478, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -1.33% (0.9759 => 0.9629, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.26% (0.8893 => 0.8781, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.09% (0.9372 => 0.6458, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/heapsort: -30.52% (4.4739 => 3.1084, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.10% (1.0816 => 0.7777, std.dev.: 0.0450) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.60% (4.2042 => 3.2119, std.dev.: 0.0536) MultiSource/Applications/minisat/minisat: -22.46% (7.9891 => 6.1944, std.dev.: 0.2442) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.37% (1.5623 => 1.2597, std.dev.: 0.0070) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.73% (0.1164 => 0.0946, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.41% (2.8778 => 2.3481, std.dev.: 0.1131) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.72% (1.4235 => 1.2567, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.73% (0.4081 => 0.3643, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/hash: -10.66% (4.5259 => 4.0434, std.dev.: 0.0772) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.67% (5.0421 => 4.5544, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.79% (1.4588 => 1.3305, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists1: -8.74% (0.6628 => 0.6049, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.39% (4.4540 => 4.0802, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.38% (23.3986 => 21.4385, std.dev.: 0.4172) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.19% (16.6791 => 15.3138, std.dev.: 0.3574) MultiSource/Applications/oggenc/oggenc: -7.92% (0.1704 => 0.1569, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.77% (0.3217 => 0.2967, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: -7.53% (9.0650 => 8.3827, std.dev.: 0.1275) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.97% (0.3201 => 0.2978, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -6.35% (2.2304 => 2.0888, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.24% (46.0987 => 43.2215, std.dev.: 0.3237) MultiSource/Benchmarks/Olden/health/health: -6.21% (0.3654 => 0.3427, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.96% (0.3349 => 0.3183, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/distray/distray: -4.45% (0.2427 => 0.2319, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -4.45% (1.8123 => 1.7317, std.dev.: 0.0051) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.25% (2.5170 => 2.4100, std.dev.: 0.0367) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.01% (1.0995 => 1.0554, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.88% (1.4446 => 1.3886, std.dev.: 0.0133) MultiSource/Applications/SIBsim4/SIBsim4: -3.57% (3.5443 => 3.4179, std.dev.: 0.0142) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.53% (40.4729 => 39.0449, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/lists: -3.50% (17.2182 => 16.6161, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -3.22% (4.4730 => 4.3291, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.3406 => 0.3306, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: -2.83% (1.4244 => 1.3841, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.76% (0.5826 => 0.5665, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.56% (42.3194 => 41.2372, std.dev.: 0.1999) MultiSource/Applications/spiff/spiff: -2.40% (2.8571 => 2.7885, std.dev.: 0.0089) SingleSource/Benchmarks/Dhrystone/dry: -2.27% (0.5295 => 0.5175, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -2.19% (0.8521 => 0.8334, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -1.99% (29.0327 => 28.4559, std.dev.: 0.0118) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.2040 => 7.0826, std.dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.52% (3.0082 => 2.9624, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.51% (3.3596 => 3.3090, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (3.1921 => 3.1448, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.41% (3.7662 => 3.7131, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/five11/five11: -1.33% (5.7021 => 5.6264, std.dev.: 0.0153) MultiSource/Applications/aha/aha: -1.21% (3.5321 => 3.4895, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/tsp/tsp: -1.13% (1.5017 => 1.4848, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/flops-7: -1.00% (1.7446 => 1.7271, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.18% (1.2047 => 1.1182, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.46% (0.0233 => 0.0176, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -12.64% (0.0451 => 0.0394, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -18.53% (0.0394 => 0.0321, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.00% (0.0445 => 0.0356, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -30.99% (0.0213 => 0.0147, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: -30.40% (0.0227 => 0.0158, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.90% (0.1530 => 0.1455, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: -41.83% (1.9293 => 1.1222, std.dev.: 0.0151) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.05% (0.4049 => 0.3966, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.85% (0.1510 => 0.1482, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.12% (0.0978 => 0.0967, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.87% (0.0276 => 0.0246, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0590 => 0.0542, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.64% (1.1617 => 1.1426, std.dev.: 0.1072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.88% (0.0032 => 0.0025, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -51.85% (0.0027 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.62% (0.0610 => 0.0533, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.91% (0.0268 => 0.0220, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.38% (0.7437 => 0.7409, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.91% (0.0092 => 0.0070, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (12.7781 => 12.7505, std.dev.: 0.5058) Report Time: 0.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 16:28:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 18:28:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121002857.53D282A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7807?compare_to=7805&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7807, Order: 172996, Start Time: 2013-01-20 22:55:17, End Time: 2013-01-21 00:29:09 To: 7805, Order: 172988, Start Time: 2013-01-20 20:58:10, End Time: 2013-01-20 22:31:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (99 on baseline) Performance Improvements: 0 (118 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (875 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.33% (0.6668 => 0.6957, std.dev.: 0.0051) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 76.79% (0.0280 => 0.0495, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 72.96% (0.0514 => 0.0889, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.20% (0.0717 => 0.1206, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.30% (0.0974 => 0.1610, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/neural/neural: 44.60% (0.1500 => 0.2169, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.81% (0.1132 => 0.1594, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.20% (0.6395 => 0.8710, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.76% (0.0699 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.05% (0.6260 => 0.8204, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.00% (0.5688 => 0.7451, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.96% (0.5456 => 0.7145, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.84% (0.5805 => 0.7595, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.57% (0.5849 => 0.7637, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.06% (0.5575 => 0.7251, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.05% (0.5581 => 0.7258, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.03% (0.5567 => 0.7239, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 29.84% (0.6395 => 0.8303, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.02% (0.5941 => 0.7665, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.53% (0.6033 => 0.7754, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.37% (0.5859 => 0.7521, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 27.70% (0.6440 => 0.8224, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.30% (1.6474 => 2.0971, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.03% (0.6189 => 0.7862, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 26.89% (0.6676 => 0.8471, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.44% (0.6304 => 0.7971, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.31% (0.6230 => 0.7869, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.22% (0.5802 => 0.7265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.18% (0.6660 => 0.8337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 24.56% (0.5705 => 0.7106, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 24.54% (0.5925 => 0.7379, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.30% (0.0790 => 0.0982, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.17% (0.5569 => 0.6915, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.13% (0.5478 => 0.6800, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.12% (0.5857 => 0.7270, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.09% (0.5570 => 0.6912, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 23.57% (0.5591 => 0.6909, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.57% (0.6446 => 0.7901, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.46% (0.5863 => 0.7180, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.38% (0.7524 => 0.9208, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.16% (0.0582 => 0.0711, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.08% (0.6052 => 0.7388, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.60% (0.6681 => 0.8124, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.25% (0.6194 => 0.7510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.01% (0.6297 => 0.7620, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.58% (2.2587 => 2.7235, std.dev.: 0.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.02% (0.6667 => 0.8002, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 17.97% (0.7339 => 0.8658, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.09% (0.0833 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.54% (0.3357 => 0.3845, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.04% (1.1450 => 1.3058, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.51% (0.4916 => 0.5482, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.32% (4.5069 => 5.0171, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/05-eks/eks: 11.23% (0.4515 => 0.5022, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.50% (3.5339 => 3.9051, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.44% (1.6364 => 1.8073, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.14% (0.1982 => 0.2183, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.31% (0.2385 => 0.2607, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.54% (0.1230 => 0.1335, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.86% (0.7021 => 0.7573, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.45% (0.2001 => 0.2150, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.30% (1.2515 => 1.3429, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/hash: 6.98% (0.4524 => 0.4840, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.51% (0.5329 => 0.5676, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.38% (0.4861 => 0.5171, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.32% (1.4642 => 1.5568, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.14% (1.2784 => 1.3569, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.01% (0.1731 => 0.1835, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (9.2283 => 9.7645, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.3255 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.07% (0.3319 => 0.3454, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 2.90% (0.6750 => 0.6946, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 2.78% (5.0226 => 5.1621, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.52% (5.4682 => 5.6059, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 2.33% (1.3864 => 1.4187, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.48% (0.8418 => 0.8543, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.11% (1.3722 => 1.3874, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.05% (0.9557 => 0.9657, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8167, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.73% (0.9531 => 1.0268, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1494, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5769, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2830, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.5320 => 4.6015, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (79.7170 => 80.7752, std.dev.: 0.3997) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.19% (0.1281 => 0.1112, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.60% (0.3194 => 0.3015, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.27% (2.4924 => 2.3611, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.82% (0.7198 => 0.6851, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.72% (0.3812 => 0.3632, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.54% (0.3831 => 0.3657, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.51% (0.3880 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.50% (0.3891 => 0.3716, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.4033 => 0.3852, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.41% (0.9852 => 0.9418, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.39% (0.3896 => 0.3725, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.96% (0.3884 => 0.3730, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.94% (0.3323 => 0.3192, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.88% (0.3142 => 0.3020, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/property: -3.79% (0.4199 => 0.4040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.73% (0.2871 => 0.2764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.62% (0.2903 => 0.2798, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4280 => 0.4127, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.40% (0.6347 => 0.6131, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.38% (1.3148 => 1.2704, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.38% (2.1713 => 2.0980, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.20% (0.3252 => 0.3148, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.9542 => 0.9242, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.14% (0.3658 => 0.3543, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.14% (0.6441 => 0.6239, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.08% (0.6484 => 0.6284, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.99% (0.4151 => 0.4027, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -2.79% (0.7779 => 0.7562, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.64% (14.2083 => 13.8337, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.54% (0.3931 => 0.3831, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2466, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.48% (0.4427 => 0.4317, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.45% (0.7919 => 0.7725, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.35% (17.1032 => 16.7014, std.dev.: 0.0163) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.25% (6.7716 => 6.6195, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.22% (1.2210 => 1.1939, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: -2.16% (16.1920 => 15.8419, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: -2.13% (4.3330 => 4.2407, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: -2.05% (0.7982 => 0.7818, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.98% (1.0544 => 1.0335, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -1.89% (7.0961 => 6.9617, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.82% (0.9179 => 0.9012, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.69% (1.5610 => 1.5346, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -1.55% (2.4021 => 2.3648, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.41% (1.2300 => 1.2127, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.29% (0.8521 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.20% (34.0927 => 33.6822, std.dev.: 0.0131) MultiSource/Applications/lua/lua: -1.19% (4.0594 => 4.0109, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.56% (1.8100 => 0.6957, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3157, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.69% (1.3643 => 1.0274, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9162, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.46% (0.0757 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1985, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.36% (2.5106 => 2.1249, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.68% (2.2633 => 2.1801, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.54% (7.9763 => 7.7737, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.7241 => 3.6438, std.dev.: 0.0302) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1716, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5990, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.39% (1.6086 => 1.5863, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 18:33:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 20:33:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121023347.590A02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7808?compare_to=7807&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7808, Order: 172997, Start Time: 2013-01-21 01:00:18, End Time: 2013-01-21 02:33:58 To: 7807, Order: 172996, Start Time: 2013-01-20 22:55:17, End Time: 2013-01-21 00:29:09 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (101 on baseline) Performance Improvements: 0 (117 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (874 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.06% (3.7904 => 3.8305, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 77.14% (0.0280 => 0.0496, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 72.96% (0.0514 => 0.0889, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.34% (0.0717 => 0.1207, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.20% (0.0974 => 0.1609) MultiSource/Benchmarks/FreeBench/neural/neural: 44.67% (0.1500 => 0.2170, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.20% (0.0267 => 0.0377, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.90% (0.1132 => 0.1595, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.56% (0.0599 => 0.0824, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.11% (0.6395 => 0.8704, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.90% (0.0699 => 0.0922) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.02% (0.6260 => 0.8202, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 30.98% (0.5688 => 0.7450, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.96% (0.5456 => 0.7145, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 30.92% (0.5805 => 0.7600, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 30.48% (0.5849 => 0.7632, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.23% (0.5581 => 0.7268, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.14% (0.5567 => 0.7245, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.01% (0.5575 => 0.7248, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 29.82% (0.6395 => 0.8302, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.05% (0.5941 => 0.7667, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.46% (0.6033 => 0.7750, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.35% (0.5859 => 0.7520, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 27.89% (0.6440 => 0.8236, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.45% (1.6474 => 2.0996, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.11% (0.6189 => 0.7867, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 26.83% (0.6676 => 0.8467, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.36% (0.6304 => 0.7966, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.23% (0.6230 => 0.7864, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.34% (0.5802 => 0.7272, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.12% (0.6660 => 0.8333, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 24.83% (0.5925 => 0.7396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 24.43% (0.5705 => 0.7099, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.43% (0.0790 => 0.0983, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.31% (0.5857 => 0.7281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.22% (0.5478 => 0.6805, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.08% (0.5570 => 0.6911, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.04% (0.5569 => 0.6908, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 23.61% (0.5591 => 0.6911, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.46% (0.6446 => 0.7894, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 22.45% (0.5863 => 0.7179, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.31% (0.6052 => 0.7402, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.30% (0.7524 => 0.9202, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.16% (0.0582 => 0.0711, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.60% (0.6681 => 0.8124, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.33% (0.6194 => 0.7515, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.06% (0.6297 => 0.7623, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.45% (2.2587 => 2.7207, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.06% (0.0693 => 0.0832, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 19.96% (0.6667 => 0.7998, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.94% (0.0622 => 0.0746, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.04% (0.7339 => 0.8663, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.03% (0.0634 => 0.0742, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.09% (0.0833 => 0.0967, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.51% (0.3357 => 0.3844, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.03% (1.1450 => 1.3057, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.69% (0.1081 => 0.1229, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.43% (0.4916 => 0.5478, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.43% (0.4515 => 0.5031, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.29% (4.5069 => 5.0157, std.dev.: 0.0077) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.50% (3.5339 => 3.9049, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.47% (1.6364 => 1.8078, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.19% (0.1982 => 0.2184, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.10% (0.2385 => 0.2602, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.54% (0.1230 => 0.1335) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.92% (0.7021 => 0.7577, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.34% (1.2515 => 1.3434, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 6.94% (0.4524 => 0.4838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.50% (0.4861 => 0.5177, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.49% (0.5329 => 0.5675, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.43% (1.4642 => 1.5584, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.11% (1.2784 => 1.3565, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 5.95% (0.1731 => 0.1834, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 5.81% (9.2283 => 9.7649, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: 5.25% (0.3255 => 0.3426, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.10% (0.3319 => 0.3455, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 2.87% (0.6750 => 0.6944, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.77% (5.0226 => 5.1616, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.49% (5.4682 => 5.6045, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.26% (1.3864 => 1.4177, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.70% (0.8418 => 0.8561, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.14% (0.9557 => 0.9666, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8007, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0077) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5046, std.dev.: 0.1152) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1032, std.dev.: 0.0064) MultiSource/Benchmarks/llubenchmark/llu: 2.32% (3.7435 => 3.8305, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2815, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6017, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.51% (79.7170 => 80.9210, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.23% (10.3489 => 10.4765, std.dev.: 0.0141) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1281 => 0.1111, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.29% (2.4924 => 2.3605, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.61% (0.3837 => 0.3660, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3812 => 0.3638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.51% (0.3880 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.49% (0.3831 => 0.3659, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.45% (0.3891 => 0.3718, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.43% (0.9852 => 0.9416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.39% (0.4033 => 0.3856, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.32% (0.2428 => 0.2323, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3821 => 0.3662, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.11% (0.3142 => 0.3013, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.97% (0.3323 => 0.3191, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.94% (0.3884 => 0.3731, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.79% (0.4199 => 0.4040, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4280 => 0.4127, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.51% (0.3016 => 0.2910, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: -3.51% (0.2849 => 0.2749, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.49% (0.3205 => 0.3093, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.43% (0.6347 => 0.6129, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.32% (0.3252 => 0.3144, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.30% (1.3148 => 1.2714, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.29% (2.1713 => 2.0998, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -3.23% (0.6441 => 0.6233, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.17% (0.3658 => 0.3542, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (0.9542 => 0.9242, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.10% (0.6484 => 0.6283, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.99% (0.4151 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.80% (0.7779 => 0.7561, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2380, std.dev.: 0.0587) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.56% (14.2083 => 13.8445, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.54% (0.3931 => 0.3831, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.44% (0.4427 => 0.4319, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.37% (17.1032 => 16.6986, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.34% (0.7919 => 0.7734, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.31% (0.4321 => 0.4221, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.18% (6.7716 => 6.6240, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.18% (1.2210 => 1.1944, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.18% (1.2221 => 1.1955, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: -2.18% (16.1920 => 15.8397, std.dev.: 0.0182) MultiSource/Benchmarks/MallocBench/gs/gs: -2.04% (4.3330 => 4.2445, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.99% (1.0544 => 1.0334, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.95% (0.7982 => 0.7826, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -1.85% (0.9179 => 0.9009, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.81% (7.0961 => 6.9675, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (1.2300 => 1.2084, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -1.60% (1.5610 => 1.5360, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.33% (0.8521 => 0.8408, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: -1.20% (34.0927 => 33.6829, std.dev.: 0.0170) MultiSource/Applications/lua/lua: -1.09% (4.0594 => 4.0151, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.74% (1.8100 => 0.6925, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.90% (1.3643 => 1.0246, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9223, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1267, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1723, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.43% (7.9763 => 7.7823, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.7241 => 3.6497, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1727, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.52% (1.6086 => 1.5842, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.14% (3.7092 => 3.6668, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 18:59:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 20:59:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121025913.6C4362A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7809?compare_to=7806&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7809, Order: 172997, Start Time: 2013-01-21 00:57:34, End Time: 2013-01-21 02:59:26 To: 7806, Order: 172996, Start Time: 2013-01-20 22:20:59, End Time: 2013-01-21 00:18:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 12 (7 on baseline) Performance Improvements: 1 (81 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1051 (975 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 21.50% (0.0828 => 0.1006, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.56% (1.3885 => 1.4380, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.81% (1.2346 => 1.2693, std.dev.: 0.0124) MultiSource/Applications/spiff/spiff: 2.29% (0.8764 => 0.8965, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.15% (15.3138 => 16.1028, std.dev.: 0.2542) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.25% (0.3437 => 0.3583, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/treeadd/treeadd: 2.80% (0.3643 => 0.3745, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: 2.38% (8.6456 => 8.8516, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.36% (8.5282 => 8.7294, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.28% (5.2794 => 5.3996, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.04% (2.3665 => 2.4147, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.10% (11.5342 => 11.6616, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.79% (6.3056 => 5.8141, std.dev.: 0.0712) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.38% (1.1182 => 1.1225, std.dev.: 0.0777) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 28.98% (0.0176 => 0.0227, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.41% (0.0394 => 0.0435, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.92% (0.0321 => 0.0340, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.26% (0.0318 => 0.0322, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.19% (0.0356 => 0.0435, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: 42.18% (0.0147 => 0.0209, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 41.14% (0.0158 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1455 => 0.1458, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 1.98% (1.1222 => 1.1444, std.dev.: 0.0421) MultiSource/Applications/obsequi/Obsequi: - (0.0001 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.40% (0.3966 => 0.3982, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.75% (0.1482 => 0.1456, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.83% (0.0967 => 0.1004, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.35% (0.0246 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.14% (0.0542 => 0.0525, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.1426 => 1.1480, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 16.00% (0.0025 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0013 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.38% (0.0533 => 0.0599, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.82% (0.0220 => 0.0216, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (0.7409 => 0.7440, std.dev.: 0.0074) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.86% (0.0070 => 0.0061, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7505 => 12.7595, std.dev.: 0.2096) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.51% (0.2879 => 0.2980, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.91% (1.4110 => 1.4380, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320700.00% (0.0008 => 2.5664, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.20% (1.1825 => 2.4147, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.53% (0.2562 => 0.2883, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.76% (5.6033 => 5.8141, std.dev.: 0.0712) SingleSource/Benchmarks/Misc/pi: 3.49% (2.1390 => 2.2136, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.85% (0.0808 => 0.0486, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.67% (0.0727 => 0.0504, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.74% (0.1684 => 0.1301, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.61% (0.0862 => 0.0693, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: -19.56% (1.8964 => 1.5254, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.24% (0.1009 => 0.0825, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.52% (0.7686 => 0.6493, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.63% (1.0986 => 0.9379, std.dev.: 0.0125) MultiSource/Applications/spiff/spiff: -12.28% (1.0220 => 0.8965, std.dev.: 0.0073) MultiSource/Applications/treecc/treecc: -11.47% (2.4719 => 2.1884, std.dev.: 0.0437) MultiSource/Applications/hexxagon/hexxagon: -11.23% (1.1433 => 1.0149, std.dev.: 0.0492) MultiSource/Applications/Burg/burg: -11.08% (1.5979 => 1.4209, std.dev.: 0.0553) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.06% (1.2154 => 1.0810, std.dev.: 0.0031) MultiSource/Applications/aha/aha: -10.81% (0.1378 => 0.1229, std.dev.: 0.0042) MultiSource/Applications/lua/lua: -10.72% (4.6406 => 4.1430, std.dev.: 0.1306) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.19% (6.4235 => 5.7692, std.dev.: 0.1553) MultiSource/Applications/sqlite3/sqlite3: -9.35% (17.5634 => 15.9204, std.dev.: 0.3012) MultiSource/Applications/lambda-0_1_3/lambda: -8.92% (0.8653 => 0.7881, std.dev.: 0.0025) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.14% (1.1731 => 1.0776, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.98% (0.2481 => 0.2283, std.dev.: 0.0015) MultiSource/Applications/ClamAV/clamscan: -7.94% (17.4365 => 16.0528, std.dev.: 0.3725) SingleSource/Benchmarks/Shootout-C++/fibo: -7.28% (0.2006 => 0.1860, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.10% (0.2100 => 0.1951, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: -7.04% (3.7840 => 3.5177, std.dev.: 0.0413) MultiSource/Applications/lemon/lemon: -6.46% (1.3979 => 1.3076, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.20% (0.2144 => 0.2011, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.89% (1.0017 => 0.9427, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: -5.85% (0.4002 => 0.3768, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.59% (0.9550 => 0.9016, std.dev.: 0.0111) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.23% (0.7693 => 0.7291, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.85% (0.2618 => 0.2491, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -4.75% (0.7776 => 0.7407, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/matrix: -4.74% (0.2385 => 0.2272, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.64% (1.3310 => 1.2693, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.45% (0.3665 => 0.3502, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: -4.43% (0.2551 => 0.2438, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.42% (0.2577 => 0.2463, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.29% (0.9507 => 0.9099, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.23% (0.9422 => 0.9023, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists1: -4.05% (0.3206 => 0.3076, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -4.04% (0.2725 => 0.2615, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.03% (0.9127 => 0.8759, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.85% (0.9788 => 0.9411, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.71% (4.6579 => 4.4850, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.68% (0.9512 => 0.9162, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.60% (0.6135 => 0.5914, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: -3.58% (0.4689 => 0.4521, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.58% (0.5369 => 0.5177, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.53% (0.9405 => 0.9073, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.43% (0.9993 => 0.9650, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.35% (0.8990 => 0.8689, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.16% (1.0052 => 0.9734, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.08% (0.9403 => 0.9113, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.96% (14.9757 => 14.5317, std.dev.: 0.0893) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.54% (1.0860 => 1.0584, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.19% (0.9855 => 0.9639, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.14% (1.0119 => 0.9902, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.99% (1.0088 => 0.9887, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.92% (0.9488 => 0.9306, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.60% (0.8926 => 0.8783, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: -1.50% (1.2708 => 1.2518, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.48% (0.9061 => 0.8927, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -22.29% (7.9891 => 6.2080, std.dev.: 0.1554) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.78% (0.1164 => 0.0992, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.84% (1.4588 => 1.3298, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/lists1: -8.40% (0.6628 => 0.6071, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.23% (0.4081 => 0.3745, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.21% (0.3217 => 0.2953, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/nestedloop: -5.31% (0.2070 => 0.1960, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.22% (0.3201 => 0.3034, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.42% (23.3986 => 22.3654, std.dev.: 0.4007) SingleSource/Benchmarks/Shootout-C++/lists: -3.71% (17.2182 => 16.5793, std.dev.: 0.1219) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.24% (40.4729 => 39.1614, std.dev.: 0.2731) MultiSource/Applications/sqlite3/sqlite3: -3.00% (4.4730 => 4.3387, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.80% (1.4446 => 1.4042, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/mandel-2: -1.77% (0.8521 => 0.8370, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.31% (3.1921 => 3.1504, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: -1.26% (14.9448 => 14.7563, std.dev.: 0.0517) SingleSource/Benchmarks/Shootout/matrix: -1.21% (1.5825 => 1.5633, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.82% (1.2047 => 1.1225, std.dev.: 0.0777) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0070) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.71% (0.1530 => 0.1458, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -40.68% (1.9293 => 1.1444, std.dev.: 0.0421) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.65% (0.4049 => 0.3982, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.58% (0.1510 => 0.1456, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.0978 => 0.1004, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.02% (0.0590 => 0.0525, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.18% (1.1617 => 1.1480, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.80% (0.0610 => 0.0599, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.40% (0.0268 => 0.0216, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7437 => 0.7440, std.dev.: 0.0074) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.70% (0.0092 => 0.0061, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7781 => 12.7595, std.dev.: 0.2096) Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 20:30:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 22:30:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121043048.40C8F2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7810?compare_to=7808&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7810, Order: 172999, Start Time: 2013-01-21 02:57:14, End Time: 2013-01-21 04:30:59 To: 7808, Order: 172997, Start Time: 2013-01-21 01:00:18, End Time: 2013-01-21 02:33:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (100 on baseline) Performance Improvements: 0 (106 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.15% (0.0514 => 0.0890, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.62% (0.0717 => 0.1209, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.40% (0.0974 => 0.1611, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0007) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.99% (0.1132 => 0.1596, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.72% (0.6395 => 0.8743, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.90% (0.0699 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.69% (0.6260 => 0.8244, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.47% (0.5688 => 0.7478, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.46% (0.5805 => 0.7631, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.41% (0.5456 => 0.7170, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.10% (0.5849 => 0.7668, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.69% (0.5581 => 0.7294, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.61% (0.5567 => 0.7271, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.57% (0.5575 => 0.7279, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.45% (0.6395 => 0.8342, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.52% (0.5941 => 0.7695, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.94% (0.6033 => 0.7779, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.90% (0.5859 => 0.7552, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.37% (0.6440 => 0.8267, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.71% (0.6189 => 0.7904, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.63% (1.6474 => 2.1026, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.50% (0.6676 => 0.8512, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.95% (0.6230 => 0.7909, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.90% (0.6304 => 0.8000, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.82% (0.5802 => 0.7300, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.71% (0.6660 => 0.8372, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.12% (0.5705 => 0.7138, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.10% (0.5925 => 0.7412, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.01% (0.5478 => 0.6848, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.87% (0.5569 => 0.6954, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.81% (0.5857 => 0.7310, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.70% (0.5570 => 0.6946, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.68% (0.0790 => 0.0985, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.32% (0.5591 => 0.6951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.19% (0.6446 => 0.7941, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.15% (0.5863 => 0.7220, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.91% (0.7524 => 0.9248, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.72% (0.6052 => 0.7427, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.32% (0.6681 => 0.8172, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.97% (0.6194 => 0.7555, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.53% (0.6297 => 0.7653, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.96% (2.2587 => 2.7322, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.77% (0.6667 => 0.8052, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.57% (0.7339 => 0.8702, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (0.0833 => 0.0970, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.23% (1.1450 => 1.3079, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.88% (0.1081 => 0.1231, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.81% (0.4515 => 0.5048, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.46% (4.5069 => 5.0236, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.45% (0.4916 => 0.5479, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.67% (1.6364 => 1.8110, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.63% (3.5339 => 3.9095, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.24% (0.1982 => 0.2185, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.27% (0.2385 => 0.2606, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.47% (0.7021 => 0.7616, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.65% (0.2001 => 0.2154, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.36% (1.2515 => 1.3436, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.27% (0.4524 => 0.4853, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.02% (0.5329 => 0.5703, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4861 => 0.5198, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.45% (1.4642 => 1.5586, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 6.20% (9.2283 => 9.8005, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.16% (1.2784 => 1.3571, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.3255 => 0.3440, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.28% (0.3319 => 0.3461, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6750 => 0.6970, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 3.02% (5.0226 => 5.1742, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.88% (5.4682 => 5.6258, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (1.3864 => 1.4207, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 1.64% (0.8418 => 0.8556, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.45% (0.7447 => 0.7555, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.24% (1.3722 => 1.3892, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.8000, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9531 => 1.0283, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1499, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.27% (54.5751 => 56.3588, std.dev.: 0.0816) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0122) MultiSource/Benchmarks/llubenchmark/llu: 2.23% (3.7435 => 3.8271, std.dev.: 0.0074) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2825, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6043, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3489 => 10.4660, std.dev.: 0.0220) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.30% (2.4924 => 2.3604, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.7198 => 0.6858, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.45% (0.9852 => 0.9414, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -4.20% (0.3812 => 0.3652, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.18% (0.3831 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.12% (0.3880 => 0.3720, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: -4.07% (0.4033 => 0.3869, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.06% (0.3896 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3848 => 0.3693, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.98% (0.3891 => 0.3736, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.4176 => 0.4012, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.50% (0.3884 => 0.3748, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.45% (0.4199 => 0.4054, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.15% (0.4280 => 0.4145, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.14% (0.3658 => 0.3543, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.01% (0.6484 => 0.6289, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.94% (2.1713 => 2.1075, std.dev.: 0.0102) MultiSource/Applications/hexxagon/hexxagon: -2.92% (1.3148 => 1.2764, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.9542 => 0.9270, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.63% (0.4151 => 0.4042, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.55% (14.2083 => 13.8466, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: -2.52% (0.6347 => 0.6187, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.42% (0.7919 => 0.7727, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: -2.36% (0.6441 => 0.6289, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7240, std.dev.: 0.0172) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3242, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.13% (1.2210 => 1.1950, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -2.11% (0.7779 => 0.7615, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.07% (1.2221 => 1.1968, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.06% (6.7716 => 6.6321, std.dev.: 0.0100) MultiSource/Benchmarks/MallocBench/gs/gs: -2.02% (4.3330 => 4.2453, std.dev.: 0.0057) MultiSource/Applications/JM/lencod/lencod: -1.96% (16.1920 => 15.8742, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.92% (1.0544 => 1.0342, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.88% (0.7982 => 0.7832, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -1.69% (7.0961 => 6.9760, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (1.2300 => 1.2092, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/football/football: -1.60% (0.9179 => 0.9032, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -1.49% (1.5610 => 1.5378, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.35% (0.8521 => 0.8406, std.dev.: 0.0011) MultiSource/Applications/lua/lua: -1.10% (4.0594 => 4.0148, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: -1.06% (34.0927 => 33.7326, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.91% (1.8100 => 0.6713, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3105, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9164, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7589, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1984, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1283, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0927, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3546, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8191, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.78% (3.7241 => 3.6207, std.dev.: 0.0140) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.62% (7.9763 => 7.7672, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.86% (7.3040 => 7.1683, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.66% (1.3096 => 1.2878, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5886, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/whetstone: -1.05% (1.0443 => 1.0333, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 21:15:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 20 Jan 2013 23:15:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121051534.9F9B62A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7811?compare_to=7809&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7811, Order: 172999, Start Time: 2013-01-21 03:16:54, End Time: 2013-01-21 05:15:48 To: 7809, Order: 172997, Start Time: 2013-01-21 00:57:34, End Time: 2013-01-21 02:59:26 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (9 on baseline) Performance Improvements: 8 (113 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1048 (941 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: 3.45% (0.3160 => 0.3269, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.37% (0.9006 => 0.9129, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.82% (1.4589 => 1.8647, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.05% (3.6752 => 4.0446, std.dev.: 0.0908) SingleSource/Benchmarks/Shootout-C++/lists1: 3.01% (0.6071 => 0.6254, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 2.72% (1.2221 => 1.2554, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (63.4773 => 64.5247, std.dev.: 0.1666) SingleSource/Benchmarks/Shootout-C++/fibo: 1.18% (4.3092 => 4.3600, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: -3.34% (0.3894 => 0.3764, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: -2.63% (0.6606 => 0.6432, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.51% (3.4953 => 3.4424, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.26% (5.7692 => 5.6963, std.dev.: 0.0265) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.32% (0.3583 => 0.3285, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.78% (0.2883 => 0.2774, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: -3.23% (2.0660 => 1.9992, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/ffbench: -2.27% (1.4072 => 1.3752, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.15% (1.1225 => 1.1242, std.dev.: 0.0373) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.44% (0.0227 => 0.0142, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.85% (0.0435 => 0.0353, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.71% (0.0340 => 0.0307, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.91% (0.0322 => 0.0274, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0435 => 0.0433, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -37.32% (0.0209 => 0.0131, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -18.39% (0.0223 => 0.0182, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.00% (0.0253 => 0.0210, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.92% (0.1458 => 0.1430, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -1.19% (1.1444 => 1.1308, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.13% (0.3982 => 0.3937, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.47% (0.1456 => 0.1492, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.27% (0.1004 => 0.0931, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.20% (0.0269 => 0.0255, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.19% (0.0525 => 0.0547, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.18% (1.1480 => 1.1459, std.dev.: 0.0976) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -79.31% (0.0029 => 0.0006, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.51% (0.0599 => 0.0560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.22% (0.0216 => 0.0318, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.44% (0.7440 => 0.7407, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.21% (0.0061 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7595 => 12.7542, std.dev.: 0.0223) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.75% (0.0336 => 0.0483, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.32% (0.9010 => 0.9129, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320437.50% (0.0008 => 2.5643, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.70% (1.1825 => 2.4324, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.10% (3.7074 => 4.0446, std.dev.: 0.0908) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.27% (0.2562 => 0.2774, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.42% (4.1668 => 4.3095, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/pi: 2.84% (2.1390 => 2.1997, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (63.1520 => 64.5247, std.dev.: 0.1666) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.91% (0.0727 => 0.0495, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.97% (0.0676 => 0.0541, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -19.61% (1.8964 => 1.5246, std.dev.: 0.1182) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.98% (0.0862 => 0.0707, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.33% (1.0960 => 0.9061, std.dev.: 0.0260) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.42% (0.7686 => 0.6424, std.dev.: 0.0128) MultiSource/Benchmarks/Olden/bisort/bisort: -16.28% (0.0737 => 0.0617, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.65% (1.0986 => 0.9377, std.dev.: 0.0270) MultiSource/Applications/spiff/spiff: -12.43% (1.0220 => 0.8950, std.dev.: 0.0391) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.16% (0.0847 => 0.0744, std.dev.: 0.0017) SingleSource/UnitTests/Vector/constpool: -12.09% (9.8875 => 8.6921, std.dev.: 0.1594) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -11.89% (0.0976 => 0.0860, std.dev.: 0.0036) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.61% (0.4074 => 0.3601, std.dev.: 0.0048) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.55% (1.2154 => 1.0750, std.dev.: 0.0535) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.32% (6.4235 => 5.6963, std.dev.: 0.0265) MultiSource/Applications/treecc/treecc: -10.94% (2.4719 => 2.2014, std.dev.: 0.0792) MultiSource/Applications/lua/lua: -10.67% (4.6406 => 4.1454, std.dev.: 0.1094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -10.10% (0.1317 => 0.1184, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.97% (1.5131 => 1.3623, std.dev.: 0.0315) MultiSource/Applications/sqlite3/sqlite3: -9.80% (17.5634 => 15.8417, std.dev.: 0.2314) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.43% (10.2703 => 9.3013, std.dev.: 0.3741) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.89% (1.6874 => 1.5374, std.dev.: 0.0542) MultiSource/Applications/sgefa/sgefa: -8.81% (0.3598 => 0.3281, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: -8.43% (17.4365 => 15.9666, std.dev.: 0.2693) MultiSource/Applications/lambda-0_1_3/lambda: -8.26% (0.8653 => 0.7938, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.06% (0.3560 => 0.3273, std.dev.: 0.0048) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.61% (1.1731 => 1.0838, std.dev.: 0.0336) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.31% (1.1498 => 1.0657, std.dev.: 0.0164) MultiSource/Applications/lemon/lemon: -6.56% (1.3979 => 1.3062, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.43% (0.2100 => 0.1965, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.06% (0.7693 => 0.7227, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.96% (1.0017 => 0.9420, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.91% (0.2283 => 0.2148, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: -5.82% (0.5134 => 0.4835, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: -5.65% (0.1824 => 0.1721, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.58% (1.8127 => 1.7116, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.54% (0.2618 => 0.2473, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -5.43% (0.2006 => 0.1897, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.22% (0.2144 => 0.2032, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.15% (3.6295 => 3.4424, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.97% (0.3462 => 0.3290, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: -4.85% (0.7776 => 0.7399, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -4.78% (0.2385 => 0.2271, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.75% (0.3093 => 0.2946, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.73% (0.6135 => 0.5845, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: -4.57% (1.4392 => 1.3734, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.46% (1.3220 => 1.2630, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/moments: -4.42% (0.4002 => 0.3825, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: -4.40% (0.2725 => 0.2605, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.36% (0.9422 => 0.9011, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.19% (0.3981 => 0.3814, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: -4.16% (0.6711 => 0.6432, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.2551 => 0.2446, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.08% (0.9507 => 0.9119, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.89% (1.0234 => 0.9836, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.77% (0.9512 => 0.9153, std.dev.: 0.0071) MultiSource/Benchmarks/sim/sim: -3.61% (0.3715 => 0.3581, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.58% (1.0052 => 0.9692, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.50% (0.8990 => 0.8675, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.50% (0.9403 => 0.9074, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.48% (0.5369 => 0.5182, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.48% (0.9091 => 0.8775, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: -3.43% (18.9377 => 18.2875, std.dev.: 0.1804) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.31% (0.9214 => 0.8909, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -2.54% (0.4689 => 0.4570, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -2.47% (7.3529 => 7.1716, std.dev.: 0.0451) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.28% (2.4519 => 2.3960, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.15% (0.9855 => 0.9643, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -2.12% (1.0119 => 0.9904, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.04% (0.5059 => 0.4956, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.96% (16.7012 => 16.3741, std.dev.: 0.1088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.67% (0.9061 => 0.8910, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.51% (0.8846 => 0.8712, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.48% (0.8926 => 0.8794, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.39% (0.8732 => 0.8611, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.20% (0.9381 => 0.9268, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.20% (0.9612 => 0.9497, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -1.06% (9.5202 => 9.4196, std.dev.: 0.0143) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.79% (0.9372 => 0.6486, std.dev.: 0.0931) SingleSource/Benchmarks/Shootout/heapsort: -29.86% (4.4739 => 3.1379, std.dev.: 0.1835) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.19% (1.0816 => 0.7767, std.dev.: 0.0514) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.40% (4.2042 => 3.1365, std.dev.: 0.2068) MultiSource/Applications/minisat/minisat: -23.54% (7.9891 => 6.1088, std.dev.: 0.7185) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.42% (2.8778 => 2.3477, std.dev.: 0.1237) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.04% (0.1164 => 0.0954, std.dev.: 0.0039) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.58% (1.5623 => 1.2877, std.dev.: 0.0268) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.90% (1.6547 => 1.4578, std.dev.: 0.0609) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.81% (1.4235 => 1.2554, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.05% (0.4081 => 0.3671, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.63% (1.4588 => 1.3183, std.dev.: 0.0453) SingleSource/Benchmarks/Shootout/hash: -9.34% (4.5259 => 4.1033, std.dev.: 0.0662) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.98% (0.3609 => 0.3285, std.dev.: 0.0113) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.3217 => 0.2970, std.dev.: 0.0037) MultiSource/Applications/oggenc/oggenc: -6.81% (0.1704 => 0.1588, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: -6.73% (0.3654 => 0.3408, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: -6.24% (9.0650 => 8.4992, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout/ary3: -5.75% (2.2304 => 2.1022, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/lists1: -5.64% (0.6628 => 0.6254, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: -3.57% (3.5443 => 3.4178, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/ffbench: -3.45% (1.4244 => 1.3752, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -3.33% (4.4730 => 4.3241, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/lists: -3.30% (17.2182 => 16.6500, std.dev.: 0.1341) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.28% (40.4729 => 39.1473, std.dev.: 0.2481) SingleSource/Benchmarks/McGill/chomp: -2.24% (1.0425 => 1.0192, std.dev.: 0.0088) MultiSource/Benchmarks/BitBench/five11/five11: -1.95% (5.7021 => 5.5911, std.dev.: 0.0249) MultiSource/Applications/spiff/spiff: -1.85% (2.8571 => 2.8043, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -1.41% (0.8521 => 0.8401, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.2040 => 7.1069, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.34% (3.3596 => 3.3145, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.23% (3.1921 => 3.1529, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.68% (1.2047 => 1.1242, std.dev.: 0.0373) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.06% (0.0233 => 0.0142, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -21.73% (0.0451 => 0.0353, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -22.08% (0.0394 => 0.0307, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.46% (0.0328 => 0.0274, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -38.50% (0.0213 => 0.0131, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/test1: -19.82% (0.0227 => 0.0182, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.65% (0.0255 => 0.0210, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.54% (0.1530 => 0.1430, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -41.39% (1.9293 => 1.1308, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.77% (0.4049 => 0.3937, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.19% (0.1510 => 0.1492, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.0978 => 0.0931, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.61% (0.0276 => 0.0255, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.29% (0.0590 => 0.0547, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.36% (1.1617 => 1.1459, std.dev.: 0.0976) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -81.25% (0.0032 => 0.0006, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.20% (0.0610 => 0.0560, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.7437 => 0.7407, std.dev.: 0.0033) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.87% (0.0092 => 0.0102, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.19% (12.7781 => 12.7542, std.dev.: 0.0223) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 22:39:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 00:39:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121063949.0A7B02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7812?compare_to=7810&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7812, Order: 173002, Start Time: 2013-01-21 05:06:11, End Time: 2013-01-21 06:40:00 To: 7810, Order: 172999, Start Time: 2013-01-21 02:57:14, End Time: 2013-01-21 04:30:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (118 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (872 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.39% (1.1496 => 1.1656, std.dev.: 0.0015) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.35% (0.0514 => 0.0891, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.40% (0.0974 => 0.1611, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.08% (0.1132 => 0.1597, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.56% (0.6395 => 0.8733, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.90% (0.0699 => 0.0922, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.76% (0.6260 => 0.8248, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.66% (0.5688 => 0.7489, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.63% (0.5456 => 0.7182, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.56% (0.5805 => 0.7637, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.20% (0.5849 => 0.7674, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.71% (0.5581 => 0.7295, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.67% (0.5575 => 0.7285, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.61% (0.5567 => 0.7271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.59% (0.6395 => 0.8351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.49% (0.5941 => 0.7693, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.97% (0.6033 => 0.7781, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.90% (0.5859 => 0.7552, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.34% (0.6440 => 0.8265, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.73% (1.6474 => 2.1042, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.65% (0.6676 => 0.8522, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.53% (0.6189 => 0.7893, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.98% (0.6230 => 0.7911, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.81% (0.6304 => 0.7994, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.87% (0.6660 => 0.8383, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.85% (0.5802 => 0.7302, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.22% (0.5705 => 0.7144, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.08% (0.5925 => 0.7411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.05% (0.5478 => 0.6850) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.89% (0.5857 => 0.7315, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.85% (0.5569 => 0.6953, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.79% (0.5570 => 0.6951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.32% (0.5591 => 0.6951, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.22% (0.6446 => 0.7943, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.15% (0.5863 => 0.7220, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.03% (0.7524 => 0.9257, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.85% (0.0582 => 0.0715, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.74% (0.6052 => 0.7428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.39% (0.6681 => 0.8177, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.89% (0.6194 => 0.7550, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.60% (0.6297 => 0.7657, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.79% (2.2587 => 2.7282, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.61% (0.6667 => 0.8041, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.65% (0.7339 => 0.8708, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (0.0833 => 0.0970, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 14.80% (0.3357 => 0.3854, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 14.20% (1.1450 => 1.3076, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.06% (0.1081 => 0.1233, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.64% (0.4916 => 0.5488, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.46% (4.5069 => 5.0236, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.75% (1.6364 => 1.8123, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.73% (3.5339 => 3.9132, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.24% (0.1982 => 0.2185, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.2385 => 0.2611, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1230 => 0.1343, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.43% (0.7021 => 0.7613, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4524 => 0.4871, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.46% (1.2515 => 1.3448, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.13% (0.5329 => 0.5709, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.73% (1.4642 => 1.5627, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 6.58% (0.4861 => 0.5181, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.34% (1.2784 => 1.3595, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 6.23% (9.2283 => 9.8033, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.38% (0.3255 => 0.3430, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.77% (0.3834 => 0.4017, std.dev.: 0.0027) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.31% (0.3319 => 0.3462, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.14% (0.6750 => 0.6962, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.98% (5.0226 => 5.1725, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.85% (5.4682 => 5.6241, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.3864 => 1.4228, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.15% (0.8418 => 0.8599, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.43% (0.9557 => 0.9694, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3722 => 1.3897, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8113, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5465, std.dev.: 0.0860) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1027, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2830, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.55% (4.5320 => 4.6023, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.15% (79.7170 => 80.6377, std.dev.: 0.3105) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3489 => 10.4613, std.dev.: 0.0325) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.54% (0.3194 => 0.3017, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -5.14% (2.4924 => 2.3642, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.51% (0.3837 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.49% (0.7198 => 0.6875, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.45% (0.9852 => 0.9414, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.32% (0.2428 => 0.2323, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.04% (0.3812 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.99% (0.3831 => 0.3678, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3848 => 0.3697, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.89% (0.4033 => 0.3876, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.78% (0.3891 => 0.3744, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.71% (0.4176 => 0.4021, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.60% (0.3057 => 0.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.37% (0.3205 => 0.3097, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.37% (0.3059 => 0.2956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.32% (0.3884 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.25% (2.1713 => 2.1008, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -3.14% (1.3148 => 1.2735, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.01% (0.6484 => 0.6289, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.92% (0.4280 => 0.4155, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.87% (0.3658 => 0.3553, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.9542 => 0.9274, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.65% (0.6347 => 0.6179, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.55% (14.2083 => 13.8456, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference-object: -2.48% (0.6441 => 0.6281, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.38% (20.7746 => 20.2803, std.dev.: 0.0403) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.32% (0.7919 => 0.7735, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.31% (0.4321 => 0.4221, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -2.25% (17.1032 => 16.7180, std.dev.: 0.0143) SingleSource/UnitTests/ObjC++/property-reference: -2.24% (0.7779 => 0.7605, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.06% (1.2210 => 1.1959, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.04% (1.2221 => 1.1972, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.94% (6.7716 => 6.6399, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: -1.94% (4.3330 => 4.2489, std.dev.: 0.0078) MultiSource/Applications/JM/lencod/lencod: -1.92% (16.1920 => 15.8811, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.91% (1.0544 => 1.0343, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.87% (0.7982 => 0.7833, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -1.60% (7.0961 => 6.9829, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.59% (1.2300 => 1.2105, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: -1.58% (0.9179 => 0.9034, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -1.45% (1.5610 => 1.5383, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -1.36% (2.4021 => 2.3695, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.17% (34.0927 => 33.6931, std.dev.: 0.0068) MultiSource/Applications/lua/lua: -1.04% (4.0594 => 4.0172, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -64.36% (1.8100 => 0.6450, std.dev.: 0.0368) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.62% (0.1622 => 0.1028, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0236, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9174, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7575, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.33% (2.5106 => 2.1257, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3533, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7684, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/ary3: -2.49% (3.7241 => 3.6315, std.dev.: 0.0232) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.42% (1.3096 => 1.2779, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1181, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1752, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2819, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4755, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6092, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6015, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.6086 => 1.5916, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 20 23:37:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 01:37:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121073740.136462A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7813?compare_to=7811&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7813, Order: 173002, Start Time: 2013-01-21 05:32:44, End Time: 2013-01-21 07:37:54 To: 7811, Order: 172999, Start Time: 2013-01-21 03:16:54, End Time: 2013-01-21 05:15:48 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 31 (17 on baseline) Performance Improvements: 0 (17 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1033 (1029 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 57.68% (0.0957 => 0.1509, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 45.05% (0.1001 => 0.1452, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/09-vor/vor: 44.33% (0.3352 => 0.4838, std.dev.: 0.0427) MultiSource/Applications/hexxagon/hexxagon: 19.61% (1.0190 => 1.2188, std.dev.: 0.0705) MultiSource/Applications/ALAC/encode/alacconvert-encode: 18.36% (1.0750 => 1.2724, std.dev.: 0.0344) MultiSource/Applications/treecc/treecc: 10.03% (2.2014 => 2.4223, std.dev.: 0.0621) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 9.59% (1.5374 => 1.6848, std.dev.: 0.0306) MultiSource/Applications/ClamAV/clamscan: 8.81% (15.9666 => 17.3725, std.dev.: 0.1969) MultiSource/Applications/kimwitu++/kc: 8.14% (18.2875 => 19.7755, std.dev.: 0.3939) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.54% (1.3623 => 1.4650, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 7.11% (15.8395 => 16.9653, std.dev.: 0.4325) MultiSource/Applications/oggenc/oggenc: 6.49% (5.2693 => 5.6113, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.96% (0.8611 => 0.9124, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.10% (0.9413 => 0.9893, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.90% (0.9268 => 0.9722, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.74% (14.5087 => 15.1963, std.dev.: 0.1173) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.63% (0.9608 => 1.0053, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.80% (1.8711 => 1.9047, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 44.70% (0.1405 => 0.2033, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/ft/ft: 44.17% (0.7767 => 1.1198, std.dev.: 0.0584) MultiSource/Applications/minisat/minisat: 27.67% (6.1088 => 7.7994, std.dev.: 0.2859) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (1.2877 => 1.6100, std.dev.: 0.0153) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.93% (1.2554 => 1.5558, std.dev.: 0.1023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.60% (2.3477 => 2.8078, std.dev.: 0.0810) MultiSource/Applications/SPASS/SPASS: 19.28% (8.4992 => 10.1375, std.dev.: 0.2232) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.12% (0.3285 => 0.3519, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.71% (0.2774 => 0.2877, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.16% (6.8434 => 7.0597, std.dev.: 0.0267) MultiSource/Benchmarks/Olden/bh/bh: 2.33% (2.3873 => 2.4429, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/except: 2.05% (0.4987 => 0.5089, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.3241 => 4.4019, std.dev.: 0.0225) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.40% (1.1242 => 1.2074, std.dev.: 0.2239) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 58.45% (0.0142 => 0.0225, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.23% (0.0353 => 0.0435, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 10.75% (0.0307 => 0.0340, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.52% (0.0274 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 60.31% (0.0131 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: 22.53% (0.0182 => 0.0223, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 20.48% (0.0210 => 0.0253, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.96% (0.1430 => 0.1458, std.dev.: 0.0232) MultiSource/Applications/lemon/lemon: 12.29% (1.1308 => 1.2698, std.dev.: 0.3983) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.83% (0.3937 => 0.4206, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.47% (0.1492 => 0.1485, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.29% (0.0931 => 0.1064, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.63% (0.0255 => 0.0277, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.43% (0.0547 => 0.0615, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.23% (1.1459 => 1.1485, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 400.00% (0.0006 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.64% (0.0560 => 0.0614, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.31% (0.0318 => 0.0319, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (0.7407 => 0.7410, std.dev.: 0.0273) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.84% (0.0102 => 0.0110, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7542 => 12.7570, std.dev.: 0.0203) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: 47.22% (0.1025 => 0.1509, std.dev.: 0.0043) SingleSource/UnitTests/SignlessTypes/factor: 44.94% (0.0336 => 0.0487, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 42.21% (0.3402 => 0.4838, std.dev.: 0.0427) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 37.24% (0.1058 => 0.1452, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.85% (0.9588 => 1.0053, std.dev.: 0.0164) MultiSource/Applications/oggenc/oggenc: 4.78% (5.3553 => 5.6113, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.49% (0.8732 => 0.9124, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.64% (0.9381 => 0.9722, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.12% (1.8651 => 1.9047, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319825.00% (0.0008 => 2.5594, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.41% (1.1825 => 2.3580, std.dev.: 0.0382) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 41.38% (0.1438 => 0.2033, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.30% (0.2562 => 0.2877, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 11.83% (9.0650 => 10.1375, std.dev.: 0.2232) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.66% (3.7074 => 4.0283, std.dev.: 0.1048) SingleSource/Benchmarks/Misc/pi: 3.51% (2.1390 => 2.2141, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 3.05% (1.5623 => 1.6100, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0052) SingleSource/Benchmarks/SmallPT/smallpt: -23.94% (0.1888 => 0.1436, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.04% (0.1684 => 0.1296, std.dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -12.16% (9.8875 => 8.6851, std.dev.: 0.2804) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.68% (1.0960 => 0.9899, std.dev.: 0.0361) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.05% (0.1317 => 0.1211, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: -4.37% (0.4002 => 0.3827, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.24% (4.6579 => 4.5069, std.dev.: 0.0563) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.18% (1.5131 => 1.4650, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.06% (0.3665 => 0.3553, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -22.90% (4.2042 => 3.2414, std.dev.: 0.3595) MultiSource/Benchmarks/Olden/bisort/bisort: -17.80% (0.9372 => 0.7704, std.dev.: 0.0543) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.24% (1.4588 => 1.3240, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.05% (17.2182 => 16.6922, std.dev.: 0.0309) MultiSource/Applications/sqlite3/sqlite3: -1.59% (4.4730 => 4.4019, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1543, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.22% (1.2047 => 1.2074, std.dev.: 0.2239) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.71% (0.1530 => 0.1458, std.dev.: 0.0232) MultiSource/Applications/lemon/lemon: -34.18% (1.9293 => 1.2698, std.dev.: 0.3983) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.88% (0.4049 => 0.4206, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1510 => 0.1485, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -22.22% (0.0009 => 0.0007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.79% (0.0978 => 0.1064, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.24% (0.0590 => 0.0615, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.14% (1.1617 => 1.1485, std.dev.: 0.0243) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0093) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7437 => 0.7410, std.dev.: 0.0273) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 19.57% (0.0092 => 0.0110, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.17% (12.7781 => 12.7570, std.dev.: 0.0203) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 00:41:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 02:41:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121084111.59A222A6C069@llvm.org> http://llvm.org/perf/db_default/v4/nts/7814?compare_to=7812&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7814, Order: 173006, Start Time: 2013-01-21 07:03:15, End Time: 2013-01-21 08:41:21 To: 7812, Order: 173002, Start Time: 2013-01-21 05:06:11, End Time: 2013-01-21 06:40:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (100 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (893 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 7.30% (0.6450 => 0.6921, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.89% (42.1173 => 42.9149, std.dev.: 0.1198) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: 77.86% (0.0280 => 0.0498, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.54% (0.0514 => 0.0892) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.90% (0.0717 => 0.1211, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.50% (0.0974 => 0.1612, std.dev.: 0.0029) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 44.93% (0.1500 => 0.2174, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.06% (0.0599 => 0.0827, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.78% (0.6395 => 0.8747, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.60% (0.6260 => 0.8238, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.54% (0.5688 => 0.7482, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.49% (0.5456 => 0.7174, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.47% (0.0699 => 0.0919, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.47% (0.5805 => 0.7632, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.07% (0.5849 => 0.7666, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.88% (0.5567 => 0.7286, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.85% (0.6395 => 0.8368, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.62% (0.5575 => 0.7282, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.60% (0.5581 => 0.7289, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.61% (0.5941 => 0.7700, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.95% (0.5859 => 0.7555, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.87% (0.6033 => 0.7775, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.59% (0.6440 => 0.8281, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.82% (0.6189 => 0.7911, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.63% (1.6474 => 2.1025, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.62% (0.6676 => 0.8520, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.01% (0.6304 => 0.8007, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.92% (0.6230 => 0.7907, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.08% (0.5802 => 0.7315, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.92% (0.6660 => 0.8386, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.84% (0.5569 => 0.7008, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.35% (0.5925 => 0.7427, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.15% (0.5705 => 0.7140, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.89% (0.5857 => 0.7315, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.86% (0.5478 => 0.6840, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.85% (0.5570 => 0.6954, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.24% (0.5591 => 0.6946, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.26% (0.5863 => 0.7227, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.25% (0.6446 => 0.7945, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.87% (0.7524 => 0.9245, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.85% (0.0582 => 0.0715, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.77% (0.6052 => 0.7430, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.33% (0.6681 => 0.8173, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.88% (0.6194 => 0.7549, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.76% (0.6297 => 0.7667, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.67% (2.2587 => 2.7255, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.65% (0.6667 => 0.8044, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.49% (0.0693 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.54% (0.7339 => 0.8700, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.91% (0.0621 => 0.0726, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (0.0833 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.24% (1.1450 => 1.3081, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.18% (0.4515 => 0.5065, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.88% (0.4916 => 0.5500, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.57% (4.5069 => 5.0282, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.25% (1.6364 => 1.8205, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.71% (3.5339 => 3.9125, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.29% (0.1982 => 0.2186, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.2385 => 0.2611, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1230 => 0.1343, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.25% (0.7021 => 0.7600, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.85% (0.2001 => 0.2158, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 7.55% (1.2515 => 1.3460, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.09% (0.5329 => 0.5707, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.70% (1.4642 => 1.5623, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (0.4861 => 0.5186, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.52% (1.2784 => 1.3617, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 6.33% (9.2283 => 9.8120, std.dev.: 0.1843) SingleSource/Benchmarks/Shootout-C++/matrix: 5.44% (0.3255 => 0.3432, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.40% (0.3319 => 0.3465, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.05% (0.6750 => 0.6956, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.01% (5.0226 => 5.1740, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.90% (5.4682 => 5.6268, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 2.62% (1.3864 => 1.4227, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 2.00% (0.8418 => 0.8586, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 1.67% (0.7447 => 0.7571, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.9557 => 0.9701, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8081, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.48% (0.9531 => 1.0339, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4710, std.dev.: 0.1197) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2817, std.dev.: 0.1202) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6027, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6551 => 3.6962, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.01% (1.5103 => 1.5255, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.16% (2.4924 => 2.3638, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.7198 => 0.6874, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.37% (0.2428 => 0.2322, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.30% (0.9852 => 0.9428, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.21% (0.3821 => 0.3660, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-2: -3.99% (0.3831 => 0.3678, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/exceptions-4: -3.94% (0.3880 => 0.3727, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.83% (0.3891 => 0.3742, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.57% (0.3057 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -3.10% (1.3148 => 1.2741, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.06% (0.3658 => 0.3546, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.90% (0.6484 => 0.6296, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.9542 => 0.9266, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4280 => 0.4158, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.79% (0.4151 => 0.4035, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.50% (14.2083 => 13.8528, std.dev.: 0.0176) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7228, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.09% (1.2210 => 1.1955, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.07% (1.2221 => 1.1968, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.91% (6.7716 => 6.6420, std.dev.: 0.0117) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.85% (1.0544 => 1.0349, std.dev.: 0.0057) MultiSource/Applications/lambda-0_1_3/lambda: -1.77% (0.7982 => 0.7841, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: -1.73% (16.1920 => 15.9125, std.dev.: 0.0603) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.69% (1.2300 => 1.2092, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: -1.51% (0.9179 => 0.9040, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: -1.50% (4.3330 => 4.2679, std.dev.: 0.0196) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.46% (0.7919 => 0.7803, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.45% (7.0961 => 6.9933, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.43% (1.5610 => 1.5387, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -1.17% (2.4021 => 2.3741, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.76% (1.8100 => 0.6921, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3082, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9206, std.dev.: 0.4322) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1332, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3572, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.01% (4.1534 => 3.8208, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6328, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.63% (7.9763 => 7.7666, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/ary3: -2.40% (3.7241 => 3.6347, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.57% (2.7523 => 2.7092, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.54% (1.3096 => 1.2894, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4774, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6307 => 1.6121, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5903, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6042, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 01:59:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 03:59:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121095924.3DBC32A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7815?compare_to=7813&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7815, Order: 173010, Start Time: 2013-01-21 07:58:51, End Time: 2013-01-21 09:59:36 To: 7813, Order: 173002, Start Time: 2013-01-21 05:32:44, End Time: 2013-01-21 07:37:54 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (8 on baseline) Performance Improvements: 36 (71 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1023 (984 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.37% (1.4655 => 1.8666, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.87% (1.4673 => 1.5535, std.dev.: 0.0231) SingleSource/Benchmarks/Linpack/linpack-pc: 3.71% (50.9004 => 52.7896, std.dev.: 0.2232) SingleSource/Benchmarks/Shootout-C++/fibo: 1.21% (4.3264 => 4.3788, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/hash: 1.12% (4.0493 => 4.0947, std.dev.: 0.0099) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: -35.59% (0.1509 => 0.0972, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -32.58% (0.1452 => 0.0979, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/family/family: -25.71% (0.0599 => 0.0445, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: -18.35% (0.5782 => 0.4721, std.dev.: 0.0079) MultiSource/Applications/hexxagon/hexxagon: -16.29% (1.2188 => 1.0203, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -15.76% (0.1085 => 0.0914, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: -13.92% (0.1896 => 0.1632, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.37% (0.1524 => 0.1366, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.27% (0.7587 => 0.6808, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: -10.05% (1.7056 => 1.5342, std.dev.: 0.0257) MultiSource/Applications/treecc/treecc: -9.93% (2.4223 => 2.1817, std.dev.: 0.0083) MultiSource/Applications/spiff/spiff: -9.64% (0.9742 => 0.8803, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: -9.61% (0.1624 => 0.1468, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: -8.08% (0.1881 => 0.1729, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: -7.94% (0.8565 => 0.7885, std.dev.: 0.0263) MultiSource/Applications/ClamAV/clamscan: -7.78% (17.3725 => 16.0205, std.dev.: 0.2168) MultiSource/Applications/SPASS/SPASS: -7.08% (16.9653 => 15.7649, std.dev.: 0.0664) MultiSource/Applications/oggenc/oggenc: -6.95% (5.6113 => 5.2213, std.dev.: 0.0331) MultiSource/Applications/sgefa/sgefa: -6.19% (0.3492 => 0.3276, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: -6.12% (3.7189 => 3.4912, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: -5.51% (1.3808 => 1.3047, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: -5.44% (1.2879 => 1.2178, std.dev.: 0.0070) MultiSource/Applications/siod/siod: -5.21% (2.5213 => 2.3900, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: -4.50% (7.5116 => 7.1733, std.dev.: 0.0443) MultiSource/Applications/Burg/burg: -4.27% (1.4526 => 1.3906, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -30.43% (1.1198 => 0.7790, std.dev.: 0.0570) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -29.46% (0.2033 => 0.1434, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: -18.39% (10.1375 => 8.2734, std.dev.: 0.2680) SingleSource/Benchmarks/Shootout/nestedloop: -9.70% (0.2247 => 0.2029, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.00% (5.1149 => 4.8082, std.dev.: 0.1072) MultiSource/Applications/sgefa/sgefa: -3.31% (0.3630 => 0.3510, std.dev.: 0.0034) MultiSource/Applications/spiff/spiff: -2.06% (2.8514 => 2.7927, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: -1.59% (3.6940 => 3.6351, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.22% (3.8362 => 3.7893, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout/matrix: -1.08% (1.5796 => 1.5626, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.03% (1.0763 => 1.0652, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.85% (1.2074 => 1.1247, std.dev.: 0.0231) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.44% (0.0225 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0435 => 0.0437, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0340 => 0.0339, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.31% (0.0322 => 0.0323, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0435 => 0.0433, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -0.95% (0.0210 => 0.0208, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0223 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0253 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.89% (0.1458 => 0.1445, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -9.15% (1.2698 => 1.1536, std.dev.: 0.1721) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.25% (0.4206 => 0.3985, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.34% (0.1485 => 0.1490, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.67% (0.1064 => 0.0993, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.08% (0.0277 => 0.0274, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.68% (0.0615 => 0.0537, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1485 => 1.1483, std.dev.: 0.1023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.65% (0.0614 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0319 => 0.0319, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.22% (0.7410 => 0.7426, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.18% (0.0110 => 0.0079, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.17% (12.7570 => 12.7781, std.dev.: 0.4909) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.70% (0.0336 => 0.0503, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321012.50% (0.0008 => 2.5689, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.98% (1.1825 => 2.4002, std.dev.: 0.0346) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.95% (3.7074 => 4.0021, std.dev.: 0.0854) SingleSource/Benchmarks/Linpack/linpack-pc: 3.72% (50.8945 => 52.7896, std.dev.: 0.2232) SingleSource/Benchmarks/Misc/pi: 2.70% (2.1390 => 2.1967, std.dev.: 0.0078) MultiSource/Benchmarks/mafft/pairlocalalign: 1.97% (63.1520 => 64.3972, std.dev.: 0.2158) MultiSource/Applications/siod/siod: 1.28% (3.5910 => 3.6368, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0062) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0058) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -19.10% (1.8964 => 1.5342, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.45% (0.0862 => 0.0703, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.33% (0.1009 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.01% (0.0676 => 0.0561, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.82% (0.7686 => 0.6547, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.89% (1.0986 => 0.9460, std.dev.: 0.0394) MultiSource/Applications/spiff/spiff: -13.86% (1.0220 => 0.8803, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: -12.97% (1.5979 => 1.3906, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: -11.74% (2.4719 => 2.1817, std.dev.: 0.0083) MultiSource/Applications/aha/aha: -11.47% (0.1378 => 0.1220, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: -11.29% (6.4235 => 5.6986, std.dev.: 0.0166) MultiSource/Applications/hexxagon/hexxagon: -10.76% (1.1433 => 1.0203, std.dev.: 0.0127) MultiSource/Applications/sqlite3/sqlite3: -9.86% (17.5634 => 15.8313, std.dev.: 0.4243) MultiSource/Applications/siod/siod: -9.60% (2.6437 => 2.3900, std.dev.: 0.0099) MultiSource/Applications/sgefa/sgefa: -8.95% (0.3598 => 0.3276, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -8.88% (0.8653 => 0.7885, std.dev.: 0.0263) MultiSource/Benchmarks/Olden/health/health: -8.82% (0.1610 => 0.1468, std.dev.: 0.0028) MultiSource/Applications/ClamAV/clamscan: -8.12% (17.4365 => 16.0205, std.dev.: 0.2168) MultiSource/Applications/d/make_dparser: -7.74% (3.7840 => 3.4912, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.30% (0.2481 => 0.2300, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.05% (0.2283 => 0.2122, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.78% (1.3310 => 1.2408, std.dev.: 0.0149) MultiSource/Applications/lemon/lemon: -6.67% (1.3979 => 1.3047, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.43% (0.2100 => 0.1965, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.24% (1.8127 => 1.6996, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.10% (0.7693 => 0.7224, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -5.53% (0.5134 => 0.4850, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.98% (3.6295 => 3.4488, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.89% (0.6135 => 0.5835, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.88% (0.3093 => 0.2942, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.25% (0.3462 => 0.3315, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.17% (0.3981 => 0.3815, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: -4.15% (16.4479 => 15.7649, std.dev.: 0.0664) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.96% (1.2680 => 1.2178, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: -3.52% (0.6711 => 0.6475, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: -3.30% (0.9214 => 0.8910, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: -3.26% (0.4689 => 0.4536, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.59% (2.4519 => 2.3884, std.dev.: 0.0068) MultiSource/Applications/oggenc/oggenc: -2.50% (5.3553 => 5.2213, std.dev.: 0.0331) MultiSource/Applications/JM/ldecod/ldecod: -2.44% (7.3529 => 7.1733, std.dev.: 0.0443) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.89% (0.9372 => 0.6477, std.dev.: 0.0741) SingleSource/Benchmarks/Shootout/heapsort: -30.33% (4.4739 => 3.1171, std.dev.: 0.3782) MultiSource/Benchmarks/Ptrdist/ft/ft: -27.98% (1.0816 => 0.7790, std.dev.: 0.0570) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.59% (0.4081 => 0.3649, std.dev.: 0.0137) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.97% (0.1164 => 0.1048, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.57% (5.0421 => 4.5598, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout/hash: -9.53% (4.5259 => 4.0947, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.37% (1.4588 => 1.3221, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: -8.73% (9.0650 => 8.2734, std.dev.: 0.2680) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.34% (4.4540 => 4.0827, std.dev.: 0.0829) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.91% (23.3986 => 21.5473, std.dev.: 0.3065) SingleSource/Benchmarks/Shootout/nestedloop: -7.77% (0.2200 => 0.2029, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: -6.35% (0.3654 => 0.3422, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.12% (1.6547 => 1.5535, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.76% (46.0987 => 43.4418, std.dev.: 0.7165) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.43% (0.3349 => 0.3167, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: -3.33% (1.0425 => 1.0078, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: -3.32% (1.4244 => 1.3771, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.20% (1.4446 => 1.3984, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.12% (1.0995 => 1.0652, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.59% (0.5826 => 0.5675, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: -2.25% (2.8571 => 2.7927, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -2.22% (0.8521 => 0.8332, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3157, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -1.26% (1.5825 => 1.5626, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.19% (3.1921 => 3.1541, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.18% (5.5974 => 5.5314, std.dev.: 0.0254) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.64% (1.2047 => 1.1247, std.dev.: 0.0231) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0451 => 0.0437, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -5.56% (0.1530 => 0.1445, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -40.21% (1.9293 => 1.1536, std.dev.: 0.1721) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.58% (0.4049 => 0.3985, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.32% (0.1510 => 0.1490, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.53% (0.0978 => 0.0993, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.98% (0.0590 => 0.0537, std.dev.: 0.0153) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.15% (1.1617 => 1.1483, std.dev.: 0.1023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7437 => 0.7426, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.13% (0.0092 => 0.0079, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: - (12.7781 => 12.7781, std.dev.: 0.4909) Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 02:39:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 04:39:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121103911.BCBC82A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7816?compare_to=7814&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7816, Order: 173012, Start Time: 2013-01-21 09:05:18, End Time: 2013-01-21 10:39:22 To: 7814, Order: 173006, Start Time: 2013-01-21 07:03:15, End Time: 2013-01-21 08:41:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 0 (128 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.11% (78.4698 => 80.9066, std.dev.: 0.2007) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.15% (0.0514 => 0.0890, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.62% (0.0717 => 0.1209, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.50% (0.0974 => 0.1612, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.90% (0.1132 => 0.1595, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.56% (0.6395 => 0.8733, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.60% (0.6260 => 0.8238, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.51% (0.5805 => 0.7634, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.50% (0.5688 => 0.7480, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.34% (0.5456 => 0.7166, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.33% (0.0699 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.29% (0.5849 => 0.7679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.68% (0.5567 => 0.7275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.66% (0.5581 => 0.7292, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.51% (0.6395 => 0.8346, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.49% (0.5575 => 0.7275, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.52% (0.5941 => 0.7695, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.98% (0.5859 => 0.7557, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.94% (0.6033 => 0.7779, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.49% (0.6440 => 0.8275, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.70% (1.6474 => 2.1037, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.60% (0.6189 => 0.7897, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.52% (0.6676 => 0.8513, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.08% (0.6230 => 0.7917, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.00% (0.6304 => 0.8006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.96% (0.5802 => 0.7308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.87% (0.6660 => 0.8383, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.18% (0.5925 => 0.7417, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.12% (0.5705 => 0.7138, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.10% (0.5478 => 0.6853, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.01% (0.5569 => 0.6962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.00% (0.5857 => 0.7321, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.72% (0.5570 => 0.6947, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.24% (0.5591 => 0.6946, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.15% (0.6446 => 0.7938, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.13% (0.5863 => 0.7219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.01% (0.7524 => 0.9255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.77% (0.6052 => 0.7430, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.51% (0.0582 => 0.0713) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.35% (0.6681 => 0.8174, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.70% (0.6194 => 0.7538, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.61% (0.6297 => 0.7658, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.85% (2.2587 => 2.7297, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.61% (0.6667 => 0.8041, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.20% (0.0693 => 0.0833, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.10% (0.0622 => 0.0747, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.68% (0.7339 => 0.8710, std.dev.: 0.0164) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.19% (0.0634 => 0.0743, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.59% (0.0621 => 0.0724, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.45% (0.0833 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.97% (0.1146 => 0.1329, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 14.27% (1.1450 => 1.3084, std.dev.: 0.0067) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.97% (0.1081 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4515 => 0.5040, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.55% (0.4916 => 0.5484, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.46% (4.5069 => 5.0236, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.76% (3.5339 => 3.9141, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.58% (1.6364 => 1.8095, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.34% (0.1982 => 0.2187, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.35% (0.7021 => 0.7607, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 7.42% (1.2515 => 1.3444, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.92% (0.5329 => 0.5698, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 6.92% (0.4524 => 0.4837, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.54% (1.4642 => 1.5599, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.47% (0.1731 => 0.1843, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 6.44% (0.4861 => 0.5174, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.23% (1.2784 => 1.3580, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 6.22% (9.2283 => 9.8025, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/matrix: 5.22% (0.3255 => 0.3425, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.43% (0.3319 => 0.3466, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 2.92% (0.6750 => 0.6947, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.78% (5.4682 => 5.6201, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.3864 => 1.4246, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.71% (5.0226 => 5.1588, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: 1.94% (0.8418 => 0.8581, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.48% (0.7447 => 0.7557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.35% (0.9557 => 0.9686, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.28% (1.3722 => 1.3898, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8111, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.71% (0.9531 => 1.0266, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.90% (0.2081 => 0.2183, std.dev.: 0.0018) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5779, std.dev.: 0.0410) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8210 => 28.2807, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5320 => 4.6006, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (79.7170 => 80.9066, std.dev.: 0.2007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.04% (0.1281 => 0.1114, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -5.82% (0.3194 => 0.3008, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.20% (2.4924 => 2.3629, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/trivial-interface: -5.12% (0.3812 => 0.3617, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -5.08% (0.3880 => 0.3683, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -5.07% (0.3848 => 0.3653, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -5.01% (0.3896 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.97% (0.3884 => 0.3691, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.93% (0.4033 => 0.3834, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.93% (0.3831 => 0.3642, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.78% (0.3891 => 0.3705, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.74% (0.3837 => 0.3655, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.74% (0.4176 => 0.3978, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.64% (0.7198 => 0.6864, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.53% (0.2428 => 0.2318, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -4.29% (0.4199 => 0.4019, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.18% (0.9852 => 0.9440, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.03% (0.3323 => 0.3189, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.98% (0.3142 => 0.3017, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -3.90% (0.4280 => 0.4113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.73% (0.3057 => 0.2943, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.70% (0.6347 => 0.6112, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.69% (0.2903 => 0.2796, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: -3.63% (0.3059 => 0.2948, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.61% (0.3016 => 0.2907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: -3.58% (0.2849 => 0.2747, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.51% (2.1713 => 2.0950, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: -3.51% (0.6441 => 0.6215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: -3.50% (0.3026 => 0.2920, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: -3.47% (0.2939 => 0.2837, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.38% (0.3252 => 0.3142, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2708, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.12% (0.3658 => 0.3544, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.12% (0.6484 => 0.6282, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: -2.96% (0.7779 => 0.7549, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.89% (0.4151 => 0.4031, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.9542 => 0.9277, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.67% (0.3931 => 0.3826, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.60% (0.3849 => 0.3749, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.54% (14.2083 => 13.8475, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.43% (0.4321 => 0.4216, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.36% (0.7919 => 0.7732, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2978, std.dev.: 0.0511) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.27% (1.2210 => 1.1933, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: -2.24% (17.1032 => 16.7197, std.dev.: 0.0287) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.14% (1.2221 => 1.1959, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.09% (6.7716 => 6.6304, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: -2.07% (4.3330 => 4.2435, std.dev.: 0.0087) MultiSource/Applications/JM/lencod/lencod: -1.96% (16.1920 => 15.8740, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.91% (1.0544 => 1.0343, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.76% (1.2300 => 1.2084, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -1.53% (7.0961 => 6.9873, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: -1.52% (0.7982 => 0.7861, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (0.8521 => 0.8394, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/football/football: -1.48% (0.9179 => 0.9043, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: -1.43% (1.5610 => 1.5387, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -1.34% (2.4021 => 2.3700, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.28% (34.0927 => 33.6574, std.dev.: 0.0432) MultiSource/Applications/lua/lua: -1.10% (4.0594 => 4.0148, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.02% (8.0126 => 7.9312, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.44% (1.8100 => 0.6980, std.dev.: 0.0207) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -24.79% (1.3643 => 1.0261, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9198, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7597, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.13% (2.5106 => 2.1307, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3556, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.43% (0.5142 => 0.4657, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7720, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.26% (3.7241 => 3.6398, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.04% (1.6086 => 1.5758, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.96% (1.3096 => 1.2839, std.dev.: 0.0089) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1731, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4744, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.43% (1.6219 => 1.5987, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.59s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 04:20:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 06:20:47 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121122047.29BC52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7817?compare_to=7815&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7817, Order: 173014, Start Time: 2013-01-21 10:17:06, End Time: 2013-01-21 12:21:00 To: 7815, Order: 173010, Start Time: 2013-01-21 07:58:51, End Time: 2013-01-21 09:59:36 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 17 (8 on baseline) Performance Improvements: 3 (29 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (1026 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.54% (5.6986 => 6.1853, std.dev.: 0.0381) MultiSource/Applications/SIBsim4/SIBsim4: 4.63% (1.3805 => 1.4444, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 28.71% (3.3334 => 4.2905, std.dev.: 0.2791) MultiSource/Applications/minisat/minisat: 21.91% (6.2371 => 7.6039, std.dev.: 0.1786) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.87% (4.5598 => 5.4658, std.dev.: 0.2706) MultiSource/Applications/SPASS/SPASS: 9.77% (8.2734 => 9.0816, std.dev.: 0.2063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.51% (43.4418 => 47.5730, std.dev.: 1.0190) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.07% (59.0404 => 62.6241, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 5.18% (4.8082 => 5.0571, std.dev.: 0.0678) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.68% (4.2721 => 4.4722, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.54% (40.9728 => 42.8312, std.dev.: 0.4979) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.45% (21.5473 => 22.5053, std.dev.: 0.1550) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.64% (0.5848 => 0.6061, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-3: 2.14% (2.0745 => 2.1188, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel: 1.60% (1.0420 => 1.0587, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.10% (1.3221 => 1.3367, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/lowercase: 1.07% (2.5689 => 2.5964, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.52% (0.5466 => 0.5219, std.dev.: 0.0080) SingleSource/Benchmarks/Linpack/linpack-pc: -3.66% (52.7896 => 50.8590, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: -1.40% (64.3972 => 63.4957, std.dev.: 0.2573) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.39% (1.1247 => 1.1203, std.dev.: 0.1712) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0224 => 0.0225, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0437 => 0.0437, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0339 => 0.0339, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0323 => 0.0323, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.92% (0.0433 => 0.0437, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/casts: 2.40% (0.0208 => 0.0213, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0224 => 0.0225, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.35% (0.1445 => 0.1440, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 4.93% (1.1536 => 1.2105, std.dev.: 0.1726) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.35% (0.3985 => 0.3999, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.74% (0.1490 => 0.1501, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.40% (0.0993 => 0.0989, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.28% (0.0274 => 0.0202, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.30% (0.0537 => 0.0544, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.09% (1.1483 => 1.1473, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0319 => 0.0319, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (0.7426 => 0.7449, std.dev.: 0.0191) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 55.70% (0.0079 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7678, std.dev.: 0.0055) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: 4.78% (0.2113 => 0.2214, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324450.00% (0.0008 => 2.5964, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.40% (1.1825 => 2.3461, std.dev.: 0.0575) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.67% (0.2562 => 0.2861, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.39% (4.2843 => 4.4722, std.dev.: 0.0224) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.78% (0.5897 => 0.6061, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.60% (61.0379 => 62.6241, std.dev.: 0.0261) SingleSource/Benchmarks/Misc/flops-3: 1.77% (2.0819 => 2.1188, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.69% (0.1684 => 0.1285, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.63% (0.1009 => 0.0821, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -17.49% (0.7686 => 0.6342, std.dev.: 0.0451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.92% (0.0847 => 0.0746, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -11.83% (0.0862 => 0.0760, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -11.03% (1.5131 => 1.3462, std.dev.: 0.0577) MultiSource/Applications/hexxagon/hexxagon: -10.83% (1.1433 => 1.0195, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.68% (1.1498 => 1.0270, std.dev.: 0.0225) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.40% (1.2154 => 1.0890, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.20% (1.3924 => 1.2504, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -7.10% (0.2100 => 0.1951, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: -5.84% (3.7840 => 3.5629, std.dev.: 0.0423) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.80% (0.2709 => 0.2552, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.37% (0.7693 => 0.7280, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.40% (0.6135 => 0.5865, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.71% (6.4235 => 6.1853, std.dev.: 0.0381) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.15% (0.4762 => 0.4612, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: -2.96% (16.4479 => 15.9611, std.dev.: 0.1353) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.00% (0.1164 => 0.1001, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -9.61% (4.5259 => 4.0910, std.dev.: 0.1677) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.37% (1.4588 => 1.3367, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.72% (0.3201 => 0.3018, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.87% (1.4446 => 1.3887, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.82% (23.3986 => 22.5053, std.dev.: 0.1550) MultiSource/Applications/spiff/spiff: -2.37% (2.8571 => 2.7894, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: -1.65% (0.8521 => 0.8380, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.3596 => 3.3134, std.dev.: 0.0068) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.01% (1.2047 => 1.1203, std.dev.: 0.1712) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0451 => 0.0437, std.dev.: 0.0132) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.80% (0.0445 => 0.0437, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0227 => 0.0225, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.88% (0.1530 => 0.1440, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: -37.26% (1.9293 => 1.2105, std.dev.: 0.1726) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.23% (0.4049 => 0.3999, std.dev.: 0.0478) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.60% (0.1510 => 0.1501, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.12% (0.0978 => 0.0989, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -26.81% (0.0276 => 0.0202, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.80% (0.0590 => 0.0544, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.24% (1.1617 => 1.1473, std.dev.: 0.0321) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.16% (0.7437 => 0.7449, std.dev.: 0.0191) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7678, std.dev.: 0.0055) Report Time: 0.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 04:37:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 06:37:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121123713.01EA72A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7818?compare_to=7816&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7818, Order: 173019, Start Time: 2013-01-21 11:02:57, End Time: 2013-01-21 12:37:25 To: 7816, Order: 173012, Start Time: 2013-01-21 09:05:18, End Time: 2013-01-21 10:39:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (103 on baseline) Performance Improvements: 0 (108 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 77.50% (0.0280 => 0.0497, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.54% (0.0514 => 0.0892, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 68.76% (0.0717 => 0.1210, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.61% (0.0974 => 0.1613, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.99% (0.1132 => 0.1596, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 37.90% (0.0599 => 0.0826, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.75% (0.6395 => 0.8745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.74% (0.6260 => 0.8247, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.72% (0.5688 => 0.7492, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.62% (0.0699 => 0.0920, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.52% (0.5456 => 0.7176, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.44% (0.5805 => 0.7630, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.03% (0.5849 => 0.7664, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.82% (0.5567 => 0.7283, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.62% (0.6395 => 0.8353, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.60% (0.5581 => 0.7289, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.51% (0.5575 => 0.7276, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.62% (0.5941 => 0.7701, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 28.98% (0.5859 => 0.7557, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.82% (0.6033 => 0.7772, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.52% (0.6440 => 0.8277, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.67% (1.6474 => 2.1033, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.66% (0.6189 => 0.7901, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.50% (0.6676 => 0.8512, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 26.86% (0.6304 => 0.7997, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.82% (0.6230 => 0.7901, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.94% (0.5802 => 0.7307, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.81% (0.6660 => 0.8379, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.30% (0.5925 => 0.7424, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.22% (0.5705 => 0.7144, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.96% (0.5857 => 0.7319, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.86% (0.5478 => 0.6840, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.76% (0.5570 => 0.6949, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.69% (0.5569 => 0.6944, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.27% (0.5591 => 0.6948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.32% (0.5863 => 0.7230, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.02% (0.6446 => 0.7930, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.86% (0.7524 => 0.9244, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 22.79% (0.6052 => 0.7431, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.68% (0.0582 => 0.0714, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.23% (0.6681 => 0.8166, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.78% (0.6194 => 0.7543, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.68% (0.6297 => 0.7662, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.82% (0.6667 => 0.8055, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.76% (2.2587 => 2.7277, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.63% (0.0693 => 0.0836, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.26% (0.0622 => 0.0748, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.59% (0.7339 => 0.8703, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.35% (0.0634 => 0.0744, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 16.75% (0.0621 => 0.0725, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.57% (0.0833 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.06% (0.1146 => 0.1330, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3357 => 0.3856, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.30% (1.1450 => 1.3087, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1081 => 0.1234, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.59% (0.4916 => 0.5486, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.52% (4.5069 => 5.0259, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.70% (1.6364 => 1.8115, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.69% (3.5339 => 3.9117, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.49% (0.1982 => 0.2170, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.35% (0.2385 => 0.2608, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.20% (0.7021 => 0.7597, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.55% (0.2001 => 0.2152, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.46% (1.2515 => 1.3449, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4524 => 0.4856, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4861 => 0.5205, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.07% (0.5329 => 0.5706, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.51% (1.4642 => 1.5595, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.35% (0.1731 => 0.1841, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 6.28% (9.2283 => 9.8076, std.dev.: 0.0147) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.20% (1.2784 => 1.3576, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3255 => 0.3445, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.38% (0.1879 => 0.1980, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.3319 => 0.3458, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 3.24% (0.6750 => 0.6969, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.93% (0.3446 => 0.3547, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.79% (5.4682 => 5.6210, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 2.77% (5.0226 => 5.1616, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: 2.45% (1.3864 => 1.4203, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.95% (0.8418 => 0.8582, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.52% (0.7447 => 0.7560, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.51% (0.9557 => 0.9701, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.30% (1.3722 => 1.3901, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8206, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9531 => 1.0270, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.5751 => 56.5749, std.dev.: 0.0751) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0113) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2824, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6050, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2703, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4549, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.96% (0.1281 => 0.1115, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -5.18% (2.4924 => 2.3634, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3831 => 0.3650, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.69% (0.4033 => 0.3844, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.51% (0.3884 => 0.3709) SingleSource/UnitTests/ObjC/exceptions: -4.45% (0.4176 => 0.3990, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.45% (0.2428 => 0.2320, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.18% (0.9852 => 0.9440, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.07% (0.3142 => 0.3014, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4280 => 0.4125, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.34% (0.3323 => 0.3212, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -3.06% (0.3658 => 0.3546, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.02% (0.6484 => 0.6288, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: -2.85% (1.3148 => 1.2773, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.84% (2.1713 => 2.1096, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.75% (0.9542 => 0.9280, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.69% (0.6441 => 0.6268, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.47% (14.2083 => 13.8570, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.36% (0.7919 => 0.7732, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference: -2.34% (0.7779 => 0.7597, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.25% (1.2221 => 1.1946, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -2.25% (20.7746 => 20.3073, std.dev.: 0.0159) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7243, std.dev.: 0.0254) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.14% (1.2210 => 1.1949, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -2.00% (4.3330 => 4.2462, std.dev.: 0.0091) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.93% (6.7716 => 6.6407, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.88% (1.0544 => 1.0346, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: -1.82% (16.1920 => 15.8979, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.72% (1.2300 => 1.2089, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -1.67% (0.7982 => 0.7849, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.56% (7.0961 => 6.9855, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/football/football: -1.45% (0.9179 => 0.9046, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.29% (1.5610 => 1.5409, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: -1.13% (34.0927 => 33.7072, std.dev.: 0.0173) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.04% (1.8100 => 0.6871, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3086, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -24.45% (1.3643 => 1.0307, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9281, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1990, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1267, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7745, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.23% (1.3096 => 1.2804, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.7241 => 3.6515, std.dev.: 0.0105) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1736, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4693, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.53% (1.6307 => 1.6058, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5878, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6219 => 1.6041, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6700, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 06:35:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 08:35:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121143507.534B12A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7819?compare_to=7818&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7819, Order: 173034, Start Time: 2013-01-21 13:00:59, End Time: 2013-01-21 14:35:19 To: 7818, Order: 173019, Start Time: 2013-01-21 11:02:57, End Time: 2013-01-21 12:37:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (888 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.15% (1.1524 => 1.1657, std.dev.: 0.0018) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.86% (0.0974 => 0.1635, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.15% (0.6395 => 0.8771, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.24% (0.5456 => 0.7215, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.11% (0.6260 => 0.8270, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.92% (0.5805 => 0.7658, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.91% (0.5688 => 0.7503, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.60% (0.5849 => 0.7697, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.08% (0.5567 => 0.7297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.90% (0.6395 => 0.8371, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.33% (0.5941 => 0.7743, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.94% (0.5859 => 0.7613, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.20% (1.6474 => 2.1120, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.09% (0.6676 => 0.8551, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.51% (0.6304 => 0.8038, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.29% (0.6230 => 0.7930, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.90% (0.5802 => 0.7305, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.82% (0.5925 => 0.7455, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.63% (0.5705 => 0.7167, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.35% (0.5857 => 0.7342, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.22% (0.5570 => 0.6975, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.16% (0.5478 => 0.6856, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.07% (0.5569 => 0.6965, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.66% (0.5591 => 0.6970, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.64% (0.5863 => 0.7249, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.44% (0.6446 => 0.7957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.41% (0.7524 => 0.9285, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.22% (0.6052 => 0.7457, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.81% (0.6681 => 0.8205, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.22% (0.6194 => 0.7570, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.01% (0.6297 => 0.7683, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.31% (2.2587 => 2.7401, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.97% (0.6667 => 0.8065, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.98% (0.7339 => 0.8732, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.07% (0.3357 => 0.3863, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.58% (1.1450 => 1.3119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 12.47% (0.4515 => 0.5078, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.15% (4.5069 => 5.0546, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.11% (0.1230 => 0.1379, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.12% (3.5339 => 3.9269, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.01% (1.6364 => 1.8166, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.14% (0.1982 => 0.2183, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.73% (0.2385 => 0.2617, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.72% (0.7021 => 0.7633, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.25% (0.2001 => 0.2166, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.14% (1.2515 => 1.3534, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1731 => 0.1870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.69% (0.4524 => 0.4872, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.58% (0.5329 => 0.5733, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.21% (1.4642 => 1.5698, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (0.4861 => 0.5192, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 6.62% (9.2283 => 9.8389, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/ReedSolomon: 6.60% (0.1879 => 0.2003, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 5.79% (0.1761 => 0.1863, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.50% (0.3255 => 0.3434, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (5.4682 => 5.6612, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.6750 => 0.6987, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.31% (5.0226 => 5.1887, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.3864 => 1.4246, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 2.74% (0.8418 => 0.8649, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.66% (0.9557 => 0.9716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.3722 => 1.3942, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 1.39% (15.5079 => 15.7240, std.dev.: 0.0224) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (22.4056 => 22.6588, std.dev.: 0.0233) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7993, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.60% (0.9531 => 1.0351, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6522, std.dev.: 0.0677) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.79% (2.0478 => 2.1049, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2822, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6016, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.45% (0.3194 => 0.3020, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.87% (2.4924 => 2.3711, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.43% (0.7198 => 0.6879, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.82% (0.9852 => 0.9476, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.70% (0.3323 => 0.3200, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -3.17% (0.3812 => 0.3691, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.16% (0.3831 => 0.3710, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.14% (0.3880 => 0.3758, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/for-in: -3.07% (0.4033 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3896 => 0.3778, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.00% (1.3148 => 1.2753, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.98% (2.1713 => 2.1066, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.96% (0.3891 => 0.3776, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.91% (0.3848 => 0.3736, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: -2.87% (0.4176 => 0.4056, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.9542 => 0.9270, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2053, std.dev.: 0.0246) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.51% (0.6484 => 0.6321, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.28% (0.6347 => 0.6202, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.19% (14.2083 => 13.8971, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: -2.06% (17.1032 => 16.7502, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: -1.91% (0.6441 => 0.6318, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.85% (1.2210 => 1.1984, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -1.80% (0.7779 => 0.7639, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.70% (16.1920 => 15.9168, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.61% (1.2221 => 1.2024, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (6.7716 => 6.6628, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.41% (1.0544 => 1.0395, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.31% (7.0961 => 7.0033, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.17% (1.2300 => 1.2156, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: -1.14% (0.9179 => 0.9074, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.08% (1.5610 => 1.5442, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.04% (4.3330 => 4.2878, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.43% (1.8100 => 0.6800, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.93% (0.6962 => 0.3416, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3107, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9226, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7504, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1989, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1313, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3546, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (7.9763 => 7.7450, std.dev.: 0.0327) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6408, std.dev.: 0.0117) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.19% (1.3096 => 1.2809, std.dev.: 0.0038) MultiSource/Benchmarks/Bullet/bullet: -1.90% (7.3040 => 7.1653, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4765, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6102, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.09% (1.6086 => 1.5911, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 06:46:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 08:46:02 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121144602.6585D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7820?compare_to=7817&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7820, Order: 173033, Start Time: 2013-01-21 12:42:15, End Time: 2013-01-21 14:46:16 To: 7817, Order: 173014, Start Time: 2013-01-21 10:17:06, End Time: 2013-01-21 12:21:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 16 (10 on baseline) Performance Improvements: 6 (32 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1042 (1021 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.90% (1.7296 => 1.8490, std.dev.: 0.0425) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.34% (3.4897 => 3.7109, std.dev.: 0.0479) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.28% (0.6342 => 0.6740, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.39% (0.3261 => 0.3404, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 4.13% (0.4819 => 0.5018, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 3.78% (0.8251 => 0.8563, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.38% (0.9403 => 0.9721, std.dev.: 0.0095) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.13% (0.4569 => 0.4712, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.58% (0.9047 => 0.9280, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/bigfib: 2.09% (0.6550 => 0.6687, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.9180 => 0.9361, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 12.73% (1.6483 => 1.8582, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.10% (2.3461 => 2.4422, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 3.50% (3.5023 => 3.6249, std.dev.: 0.0330) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.92% (42.8312 => 43.6554, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.17% (0.8803 => 0.8906, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/viterbi/viterbi: -13.84% (0.2009 => 0.1731, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/random: -11.65% (0.2283 => 0.2017, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: -8.57% (0.1493 => 0.1365, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: -5.45% (0.2404 => 0.2273, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/JM/lencod/lencod: -2.04% (6.9773 => 6.8351, std.dev.: 0.0348) SingleSource/Benchmarks/Misc/flops-3: -1.38% (2.1188 => 2.0896, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.43% (1.1203 => 1.1251, std.dev.: 0.1245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.44% (0.0225 => 0.0224, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0437 => 0.0434, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0339 => 0.0337, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0323 => 0.0323, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0437 => 0.0436, std.dev.: 0.0153) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: -0.44% (0.0225 => 0.0224, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.14% (0.0253 => 0.0240, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.56% (0.1440 => 0.1448, std.dev.: 0.0245) MultiSource/Applications/lemon/lemon: -2.68% (1.2105 => 1.1781, std.dev.: 0.2141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.65% (0.3999 => 0.4145, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.86% (0.1501 => 0.1544, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.25% (0.0989 => 0.0947, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 31.19% (0.0202 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.04% (0.0544 => 0.0566, std.dev.: 0.0155) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.11% (1.1473 => 1.1486, std.dev.: 0.0374) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.47% (0.0613 => 0.0604, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (0.0319 => 0.0312, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (0.7449 => 0.7560, std.dev.: 0.0269) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -61.79% (0.0123 => 0.0047, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7678 => 12.7765, std.dev.: 0.0468) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.88% (0.3277 => 0.3404, std.dev.: 0.0015) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.52% (0.4596 => 0.4712, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.60% (0.9214 => 0.9361, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321300.00% (0.0008 => 2.5712, std.dev.: 0.0154) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.53% (1.1825 => 2.4422, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.41% (0.2562 => 0.2880, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (3.7074 => 4.0154, std.dev.: 0.1008) SingleSource/Benchmarks/Misc/pi: 3.29% (2.1390 => 2.2094, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.16% (42.3194 => 43.6554, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.20% (0.8800 => 0.8906, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0086) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0018) SingleSource/Benchmarks/SmallPT/smallpt: -24.42% (0.1888 => 0.1427, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.40% (0.1079 => 0.0902, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.58% (0.4074 => 0.3480, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.95% (1.0986 => 0.9454, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.31% (0.7686 => 0.6740, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.04% (1.5131 => 1.3612, std.dev.: 0.0202) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.15% (10.2703 => 9.3308, std.dev.: 0.1906) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.81% (0.7693 => 0.7015, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.63% (1.1498 => 1.0506, std.dev.: 0.0243) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.31% (0.6885 => 0.6313, std.dev.: 0.0137) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.88% (1.6874 => 1.5544, std.dev.: 0.0375) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.12% (6.4235 => 5.9659, std.dev.: 0.1744) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.18% (0.5746 => 0.5391, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.15% (0.9124 => 0.8563, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.82% (0.7693 => 0.7322, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/matrix: -4.70% (0.2385 => 0.2273, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.53% (0.3462 => 0.3305, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.44% (0.9550 => 0.9126, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.95% (1.0017 => 0.9721, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.54% (0.9405 => 0.9166, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.51% (0.9372 => 0.6513, std.dev.: 0.1032) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.19% (1.4588 => 1.3247, std.dev.: 0.0134) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.65% (0.3217 => 0.2971, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -7.30% (4.5259 => 4.1955, std.dev.: 0.0952) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.29% (1.0995 => 1.0633, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.19% (40.4729 => 39.1825, std.dev.: 0.4529) MultiSource/Applications/sqlite3/sqlite3: -2.43% (4.4730 => 4.3643, std.dev.: 0.0401) MultiSource/Benchmarks/BitBench/five11/five11: -1.79% (5.7021 => 5.5998, std.dev.: 0.0369) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.33% (3.3596 => 3.3150, std.dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.61% (1.2047 => 1.1251, std.dev.: 0.1245) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.02% (0.0445 => 0.0436, std.dev.: 0.0153) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.88% (0.0255 => 0.0240, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.36% (0.1530 => 0.1448, std.dev.: 0.0245) MultiSource/Applications/lemon/lemon: -38.94% (1.9293 => 1.1781, std.dev.: 0.2141) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.37% (0.4049 => 0.4145, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.25% (0.1510 => 0.1544, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.0978 => 0.0947, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (0.0276 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.07% (0.0590 => 0.0566, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.13% (1.1617 => 1.1486, std.dev.: 0.0374) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.42% (0.0268 => 0.0312, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.65% (0.7437 => 0.7560, std.dev.: 0.0269) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.91% (0.0092 => 0.0047, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7781 => 12.7765, std.dev.: 0.0468) Report Time: 0.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 08:32:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 10:32:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121163255.C6EDE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7821?compare_to=7819&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7821, Order: 173043, Start Time: 2013-01-21 14:58:55, End Time: 2013-01-21 16:33:08 To: 7819, Order: 173034, Start Time: 2013-01-21 13:00:59, End Time: 2013-01-21 14:35:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (889 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.07% (0.0974 => 0.1637, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 49.81% (0.0267 => 0.0400) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.92% (0.6395 => 0.8756, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.11% (0.6260 => 0.8270, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.94% (0.5688 => 0.7505, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.93% (0.5456 => 0.7198, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.68% (0.5805 => 0.7644, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.60% (0.5849 => 0.7697, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.00% (0.5581 => 0.7311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.98% (0.5575 => 0.7302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.84% (0.5567 => 0.7284, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.84% (0.6395 => 0.8367, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.05% (0.5941 => 0.7726, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.31% (0.5859 => 0.7576, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.12% (0.6033 => 0.7790, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.71% (0.6440 => 0.8289, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.48% (1.6474 => 2.1166, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.86% (0.6189 => 0.7913, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.79% (0.6676 => 0.8531, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.36% (0.6304 => 0.8029, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.19% (0.6230 => 0.7924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.04% (0.6660 => 0.8394, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.01% (0.5802 => 0.7311, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.59% (0.5705 => 0.7165, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.54% (0.5925 => 0.7438, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.26% (0.5478 => 0.6862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.20% (0.5857 => 0.7333, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.19% (0.5570 => 0.6973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.00% (0.5569 => 0.6961, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.70% (0.5591 => 0.6972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.38% (0.6446 => 0.7953, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.32% (0.5863 => 0.7230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.26% (0.7524 => 0.9274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.22% (0.6052 => 0.7457, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.65% (0.6681 => 0.8194, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.55% (0.6194 => 0.7591, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.68% (0.6297 => 0.7662, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.32% (2.2587 => 2.7403, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.70% (0.6667 => 0.8047, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.09% (0.7339 => 0.8740, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.44% (0.3834 => 0.4426, std.dev.: 0.0147) MultiSource/Applications/sgefa/sgefa: 15.25% (0.3357 => 0.3869, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 14.74% (1.1450 => 1.3138, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 13.77% (0.0864 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.36% (0.4515 => 0.5073, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4916 => 0.5510, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.06% (4.5069 => 5.0505, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.30% (3.5339 => 3.9331, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.00% (1.6364 => 1.8164, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1982 => 0.2191, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.77% (0.2385 => 0.2618, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.93% (0.7021 => 0.7648, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.15% (0.1731 => 0.1872, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.02% (1.2515 => 1.3519, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash: 7.82% (0.4524 => 0.4878, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.51% (0.5329 => 0.5729, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.10% (1.2784 => 1.3692, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.4642 => 1.5681, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4861 => 0.5198, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 6.47% (9.2283 => 9.8256, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.3255 => 0.3440, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 3.72% (0.6750 => 0.7001, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.58% (5.4682 => 5.6639, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.40% (5.0226 => 5.1936, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 2.80% (1.3864 => 1.4252, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 2.68% (0.8418 => 0.8644, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.88% (0.7447 => 0.7587, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.79% (0.9557 => 0.9728, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.3722 => 1.3957, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 1.49% (15.5079 => 15.7383, std.dev.: 0.0199) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (22.4056 => 22.6451, std.dev.: 0.0241) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8017, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.59% (0.9531 => 1.0254, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.82% (54.5751 => 56.6573, std.dev.: 0.0315) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2825, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.51% (4.5320 => 4.6006, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.74% (2.4924 => 2.3742, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.87% (0.3821 => 0.3673, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.86% (0.7198 => 0.6920, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.78% (0.9852 => 0.9480, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.43% (0.3057 => 0.2952, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.28% (0.3205 => 0.3100, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.05% (0.3831 => 0.3714, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.04% (0.3812 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3880 => 0.3763, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -2.99% (0.3848 => 0.3733, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.98% (1.3148 => 1.2756, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -2.95% (0.3896 => 0.3781, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.93% (2.1713 => 2.1077, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/for-in: -2.93% (0.4033 => 0.3915, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.81% (0.3884 => 0.3775, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.78% (0.3891 => 0.3783, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.6484 => 0.6306, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -2.71% (0.4176 => 0.4063, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.42% (0.9542 => 0.9311, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2925, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.18% (14.2083 => 13.8981, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/Hello: -2.14% (0.6347 => 0.6211, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -2.02% (17.1032 => 16.7584, std.dev.: 0.0274) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.83% (1.2210 => 1.1986, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -1.83% (0.6441 => 0.6323, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -1.77% (0.7779 => 0.7641, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.69% (1.2221 => 1.2014, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -1.63% (16.1920 => 15.9288, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (6.7716 => 6.6702, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.38% (1.0544 => 1.0399, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: -1.32% (0.7982 => 0.7877, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0140, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.14% (0.9179 => 0.9074, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -1.06% (4.3330 => 4.2872, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.33% (1.8100 => 0.6818, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3120, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.53% (1.3643 => 1.0297, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -23.48% (7.5137 => 5.7494, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9262, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3639, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1988, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1292, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3548, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1074, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.89% (1.3096 => 1.2586, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.67% (7.9763 => 7.7631, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.20% (3.7241 => 3.6423, std.dev.: 0.0223) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1726, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4733, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 09:07:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 11:07:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121170724.92D8E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7822?compare_to=7820&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7822, Order: 173045, Start Time: 2013-01-21 15:05:04, End Time: 2013-01-21 17:07:38 To: 7820, Order: 173033, Start Time: 2013-01-21 12:42:15, End Time: 2013-01-21 14:46:16 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 19 (21 on baseline) Performance Improvements: 5 (51 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1040 (991 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/EH/simple_rethrow: 90.72% (0.0194 => 0.0370, std.dev.: 0.0010) SingleSource/UnitTests/2003-08-05-CastFPToUint: 74.35% (0.0191 => 0.0333, std.dev.: 0.0014) SingleSource/Regression/C/PR1386: 72.90% (0.0155 => 0.0268, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 70.71% (0.0280 => 0.0478, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-31-LongShifts: 65.79% (0.0152 => 0.0252, std.dev.: 0.0018) SingleSource/UnitTests/Threads/tls: 63.89% (0.0216 => 0.0354, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 62.30% (0.0252 => 0.0409, std.dev.: 0.0027) SingleSource/UnitTests/2002-05-02-CastTest2: 61.38% (0.0189 => 0.0305, std.dev.: 0.0020) SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 59.32% (0.0177 => 0.0282, std.dev.: 0.0018) SingleSource/Regression/C/testtrace: 56.50% (0.0246 => 0.0385, std.dev.: 0.0018) SingleSource/UnitTests/2002-05-02-CastTest: 56.06% (0.0264 => 0.0412, std.dev.: 0.0013) SingleSource/UnitTests/2006-12-11-LoadConstants: 49.73% (0.1279 => 0.1915, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.32% (23.5040 => 25.2240, std.dev.: 0.2345) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.69% (44.5041 => 46.5930, std.dev.: 0.5159) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.67% (4.7960 => 4.9240, std.dev.: 0.0277) MultiSource/Applications/spiff/spiff: 2.65% (0.8907 => 0.9143, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.25% (1.2413 => 1.3065, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.63% (22.1170 => 22.9196, std.dev.: 0.2638) MultiSource/Benchmarks/BitBench/five11/five11: 1.73% (5.5998 => 5.6966, std.dev.: 0.0213) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -10.63% (0.0960 => 0.0858, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.81% (0.6740 => 0.6483, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: -2.45% (0.5018 => 0.4895, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists1: -6.33% (0.6512 => 0.6100, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/ary3: -4.53% (2.2440 => 2.1424, std.dev.: 0.0382) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.55% (1.1251 => 1.1189, std.dev.: 0.0257) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.34% (0.0224 => 0.0227, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.61% (0.0434 => 0.0441, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.48% (0.0337 => 0.0342, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.24% (0.0323 => 0.0327, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0436 => 0.0434, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/casts: 1.43% (0.0210 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: 1.34% (0.0224 => 0.0227, std.dev.: 0.0077) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.00% (0.0240 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.52% (0.1448 => 0.1470, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: -0.18% (1.1781 => 1.1760, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.08% (0.4145 => 0.3976, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.25% (0.1544 => 0.1432, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.12% (0.0947 => 0.0986, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.53% (0.0265 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 11.48% (0.0566 => 0.0631, std.dev.: 0.0113) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.08% (1.1486 => 1.1477, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.32% (0.0604 => 0.0612, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (0.0312 => 0.0319, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.30% (0.7560 => 0.7386, std.dev.: 0.0390) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 161.70% (0.0047 => 0.0123, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.05% (12.7765 => 12.7830, std.dev.: 0.0236) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/PR1386: 79.87% (0.0149 => 0.0268, std.dev.: 0.0001) SingleSource/Regression/C++/EH/simple_rethrow: 78.74% (0.0207 => 0.0370, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 74.45% (0.0274 => 0.0478, std.dev.: 0.0009) SingleSource/UnitTests/2003-05-31-LongShifts: 69.13% (0.0149 => 0.0252, std.dev.: 0.0018) SingleSource/UnitTests/2003-08-05-CastFPToUint: 64.85% (0.0202 => 0.0333, std.dev.: 0.0014) SingleSource/UnitTests/Threads/tls: 64.65% (0.0215 => 0.0354, std.dev.: 0.0002) SingleSource/UnitTests/2002-05-02-CastTest: 62.85% (0.0253 => 0.0412, std.dev.: 0.0013) SingleSource/Regression/C/testtrace: 59.09% (0.0242 => 0.0385, std.dev.: 0.0018) SingleSource/UnitTests/2002-05-02-CastTest2: 52.50% (0.0200 => 0.0305, std.dev.: 0.0020) SingleSource/UnitTests/2006-01-23-UnionInit: 52.04% (0.0269 => 0.0409, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 50.31% (0.1274 => 0.1915, std.dev.: 0.0070) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.94% (23.5861 => 25.2240, std.dev.: 0.2345) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.52% (44.1538 => 46.5930, std.dev.: 0.5159) MultiSource/Benchmarks/Bullet/bullet: 2.66% (33.2440 => 34.1290, std.dev.: 0.2656) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321400.00% (0.0008 => 2.5720, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 106.34% (1.1825 => 2.4400, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.26% (0.2562 => 0.2876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.65% (3.7074 => 4.0652, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/pi: 2.95% (2.1390 => 2.2021, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.21% (42.3194 => 43.2531, std.dev.: 0.0932) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.73% (7.0016 => 7.1226, std.dev.: 0.0400) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -19.92% (1.8964 => 1.5186, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.13% (0.1009 => 0.0816, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.59% (0.1079 => 0.0900, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.65% (0.7686 => 0.6483, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.03% (0.4074 => 0.3543, std.dev.: 0.0203) MultiSource/Applications/Burg/burg: -12.47% (1.5979 => 1.3987, std.dev.: 0.0486) MultiSource/Applications/hexxagon/hexxagon: -11.29% (1.1433 => 1.0142, std.dev.: 0.0160) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.97% (1.2154 => 1.0821, std.dev.: 0.0040) MultiSource/Applications/treecc/treecc: -10.92% (2.4719 => 2.2019, std.dev.: 0.0191) MultiSource/Applications/lua/lua: -10.85% (4.6406 => 4.1373, std.dev.: 0.0892) MultiSource/Applications/aha/aha: -10.81% (0.1378 => 0.1229, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: -10.54% (1.0220 => 0.9143, std.dev.: 0.0064) MultiSource/Applications/sgefa/sgefa: -10.12% (0.3598 => 0.3234, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.91% (0.7693 => 0.6931, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: -9.40% (17.5634 => 15.9116, std.dev.: 0.5716) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.23% (10.2703 => 9.3219, std.dev.: 0.1669) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.22% (1.5131 => 1.3736, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.74% (0.6885 => 0.6283, std.dev.: 0.0105) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.71% (1.1731 => 1.0709, std.dev.: 0.0127) MultiSource/Applications/ClamAV/clamscan: -8.17% (17.4365 => 16.0126, std.dev.: 0.5083) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.01% (1.6874 => 1.5522, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.43% (1.1498 => 1.0644, std.dev.: 0.0145) MultiSource/Applications/siod/siod: -7.34% (2.6437 => 2.4497, std.dev.: 0.0666) SingleSource/Benchmarks/Shootout-C++/hash2: -4.66% (0.5134 => 0.4895, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.2615 => 0.2499, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -4.08% (0.2551 => 0.2447, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.45% (0.9507 => 0.9179, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.28% (0.8990 => 0.8695, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.13% (1.3220 => 1.2806, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.98% (4.6579 => 4.5192, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.87% (0.9091 => 0.8830, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.62% (0.4762 => 0.4637, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.23% (7.2721 => 7.1102, std.dev.: 0.0359) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.02% (0.9372 => 0.6465, std.dev.: 0.1060) MultiSource/Applications/minisat/minisat: -21.07% (7.9891 => 6.3059, std.dev.: 0.1764) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.97% (0.1164 => 0.1013, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -12.72% (4.4739 => 3.9050, std.dev.: 0.0843) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.83% (0.4081 => 0.3639, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.94% (1.4588 => 1.3284, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout/hash: -8.90% (4.5259 => 4.1229, std.dev.: 0.0691) SingleSource/Benchmarks/Shootout-C++/lists1: -7.97% (0.6628 => 0.6100, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -7.75% (9.0650 => 8.3628, std.dev.: 0.2563) MultiSource/Benchmarks/Olden/health/health: -6.16% (0.3654 => 0.3429, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.43% (0.3349 => 0.3167, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.3201 => 0.3038, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: -3.58% (4.4730 => 4.3127, std.dev.: 0.0538) MultiSource/Applications/SIBsim4/SIBsim4: -3.17% (3.5443 => 3.4319, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/lists: -2.88% (17.2182 => 16.7231, std.dev.: 0.0690) MultiSource/Applications/spiff/spiff: -2.71% (2.8571 => 2.7796, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.36% (3.1921 => 3.1487, std.dev.: 0.0158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.12% (1.2047 => 1.1189, std.dev.: 0.0257) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.22% (0.0451 => 0.0441, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.20% (0.0394 => 0.0342, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.30% (0.0328 => 0.0327, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0227 => 0.0227, std.dev.: 0.0077) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.92% (0.1530 => 0.1470, std.dev.: 0.0087) MultiSource/Applications/lemon/lemon: -39.05% (1.9293 => 1.1760, std.dev.: 0.0654) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.80% (0.4049 => 0.3976, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.17% (0.1510 => 0.1432, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0978 => 0.0986, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.95% (0.0590 => 0.0631, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.21% (1.1617 => 1.1477, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.69% (0.7437 => 0.7386, std.dev.: 0.0390) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -75.00% (0.0008 => 0.0002, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7781 => 12.7830, std.dev.: 0.0236) Report Time: 0.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 10:31:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 12:31:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121183103.EF66E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7823?compare_to=7821&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7823, Order: 173054, Start Time: 2013-01-21 16:57:00, End Time: 2013-01-21 18:31:16 To: 7821, Order: 173043, Start Time: 2013-01-21 14:58:55, End Time: 2013-01-21 16:33:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (890 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.00% (0.6395 => 0.8761, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.12% (0.6260 => 0.8271, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.89% (0.5688 => 0.7502, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.76% (0.5456 => 0.7189, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.63% (0.5805 => 0.7641, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.54% (0.5849 => 0.7694, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.16% (0.5581 => 0.7320, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.02% (0.5567 => 0.7294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.96% (0.6395 => 0.8375, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.94% (0.5575 => 0.7300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.11% (0.5941 => 0.7730, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.34% (0.5859 => 0.7578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.07% (0.6033 => 0.7787, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.94% (0.6440 => 0.8304, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.34% (1.6474 => 2.1142, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.16% (0.6189 => 0.7932, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.54% (0.6304 => 0.8040, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.13% (0.6230 => 0.7920, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.22% (0.5802 => 0.7323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.04% (0.6660 => 0.8394, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.63% (0.5705 => 0.7167, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.57% (0.5925 => 0.7440, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.26% (0.5478 => 0.6862, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.23% (0.5857 => 0.7335, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.04% (0.5570 => 0.6965, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.91% (0.5569 => 0.6956, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.79% (0.5591 => 0.6977, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.62% (0.5863 => 0.7248, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.27% (0.6446 => 0.7946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.27% (0.6052 => 0.7460, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.21% (0.7524 => 0.9270, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.60% (0.6681 => 0.8191, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.51% (0.6194 => 0.7588, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.90% (0.6297 => 0.7676, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.20% (2.2587 => 2.7375, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.82% (0.6667 => 0.8055, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.01% (0.7339 => 0.8734, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.25% (0.3357 => 0.3869, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.55% (1.1450 => 1.3116, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.11% (0.1230 => 0.1379, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.02% (0.4916 => 0.5507, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.02% (4.5069 => 5.0486, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.29% (3.5339 => 3.9328, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.6364 => 1.8163, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.77% (0.2385 => 0.2618, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.7021 => 0.7638, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.36% (0.4524 => 0.4902, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 7.93% (1.2515 => 1.3508, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.49% (0.5329 => 0.5728, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.28% (0.4861 => 0.5215, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.28% (0.1731 => 0.1857, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.01% (1.4642 => 1.5669, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.75% (1.2784 => 1.3647, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 6.63% (9.2283 => 9.8399, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.30% (0.3255 => 0.3460, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.12% (0.1879 => 0.1994, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 3.90% (5.0226 => 5.2184, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6750 => 0.7009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (5.4682 => 5.6667, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 3.57% (0.3446 => 0.3569, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.79% (1.3864 => 1.4251, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.57% (0.8418 => 0.8634, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 1.99% (0.7447 => 0.7595, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.97% (0.9557 => 0.9745, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.57% (1.3722 => 1.3937, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.44% (15.5079 => 15.7310, std.dev.: 0.0169) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (22.4056 => 22.6889, std.dev.: 0.0199) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8114, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1496, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5342, std.dev.: 0.1778) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2817, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6048, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.23% (10.3489 => 10.4759, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -4.77% (2.4924 => 2.3734, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: -4.41% (0.3194 => 0.3053, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.21% (0.7198 => 0.6895, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.83% (0.9852 => 0.9475, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.82% (0.3821 => 0.3675, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.62% (0.3837 => 0.3698, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3896 => 0.3778, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.01% (0.3848 => 0.3732, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.00% (0.4033 => 0.3912, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -2.99% (0.3812 => 0.3698, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -2.98% (0.3831 => 0.3717, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -2.94% (0.3880 => 0.3766, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.93% (0.6484 => 0.6294, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.85% (0.3891 => 0.3780, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -2.78% (0.4176 => 0.4060, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.56% (1.3148 => 1.2812, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.9542 => 0.9319, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.28% (2.1713 => 2.1217, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.18% (14.2083 => 13.8980, std.dev.: 0.0038) SingleSource/UnitTests/Vector/constpool: -2.18% (20.7746 => 20.3215, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: -2.02% (17.1032 => 16.7575, std.dev.: 0.0094) SingleSource/UnitTests/ObjC++/Hello: -1.84% (0.6347 => 0.6230, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.82% (0.7919 => 0.7775, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.70% (6.7716 => 6.6563, std.dev.: 0.0130) SingleSource/UnitTests/ObjC++/property-reference-object: -1.65% (0.6441 => 0.6335, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.64% (16.1920 => 15.9266, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.64% (1.2221 => 1.2021, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (1.2210 => 1.2022, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.48% (1.0544 => 1.0388, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -1.36% (4.3330 => 4.2739, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: -1.33% (7.0961 => 7.0015, std.dev.: 0.0198) SingleSource/UnitTests/ObjC++/property-reference: -1.29% (0.7779 => 0.7679, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -1.09% (0.9179 => 0.9079, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.88% (1.8100 => 0.6537, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3129, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -25.10% (1.3643 => 1.0218, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: -23.49% (83.5423 => 63.9200, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1984, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.98% (2.5106 => 2.1345, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3575, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3982, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.54% (1.3096 => 1.2764, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.51% (7.9763 => 7.7763, std.dev.: 0.0125) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.25% (3.7241 => 3.6402, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1731, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.23% (1.6086 => 1.5888, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 11:30:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 13:30:02 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121193002.E6DDD2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7824?compare_to=7822&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7824, Order: 173058, Start Time: 2013-01-21 17:26:49, End Time: 2013-01-21 19:30:16 To: 7822, Order: 173045, Start Time: 2013-01-21 15:05:04, End Time: 2013-01-21 17:07:38 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (6 on baseline) Performance Improvements: 16 (26 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1046 (1031 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/em3d/em3d: 8.21% (0.1863 => 0.2016, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.06% (11.6088 => 11.7314, std.dev.: 0.0274) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/sumarray2d: -44.98% (0.0478 => 0.0263, std.dev.: 0.0078) SingleSource/UnitTests/2003-05-31-LongShifts: -42.06% (0.0252 => 0.0146, std.dev.: 0.0005) SingleSource/UnitTests/2002-05-02-CastTest: -41.26% (0.0412 => 0.0242, std.dev.: 0.0006) SingleSource/UnitTests/2003-08-05-CastFPToUint: -40.84% (0.0333 => 0.0197, std.dev.: 0.0003) SingleSource/UnitTests/Threads/tls: -40.68% (0.0354 => 0.0210, std.dev.: 0.0009) SingleSource/Regression/C/testtrace: -40.26% (0.0385 => 0.0230, std.dev.: 0.0014) SingleSource/UnitTests/2006-01-23-UnionInit: -38.39% (0.0409 => 0.0252, std.dev.: 0.0054) SingleSource/UnitTests/2002-05-02-CastTest2: -37.70% (0.0305 => 0.0190, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: -33.94% (0.1915 => 0.1265, std.dev.: 0.0054) SingleSource/UnitTests/2005-07-17-INT-To-FP: -32.80% (0.0311 => 0.0209, std.dev.: 0.0010) SingleSource/Regression/C/matrixTranspose: -30.14% (0.0355 => 0.0248, std.dev.: 0.0030) SingleSource/UnitTests/2003-05-31-CastToBool: -29.39% (0.0347 => 0.0245, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.93% (0.3978 => 0.3782, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: -4.42% (0.5408 => 0.5169, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.65% (4.3970 => 4.2365, std.dev.: 0.0430) SingleSource/Benchmarks/Shootout-C++/fibo: -1.04% (4.3560 => 4.3107, std.dev.: 0.0094) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.46% (1.1189 => 1.1138, std.dev.: 0.1068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.61% (0.0227 => 0.0212, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.91% (0.0441 => 0.0437, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.29% (0.0342 => 0.0341, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.53% (0.0327 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0434 => 0.0432, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -26.43% (0.0227 => 0.0167, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.79% (0.0252 => 0.0254, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -11.11% (0.0009 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.86% (0.1470 => 0.1428, std.dev.: 0.0218) MultiSource/Applications/lemon/lemon: -1.39% (1.1760 => 1.1597, std.dev.: 0.3044) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.28% (0.3976 => 0.3987, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1432 => 0.1432, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.04% (0.0986 => 0.0956, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.17% (0.0277 => 0.0271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.97% (0.0631 => 0.0587, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.30% (1.1477 => 1.1626, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.65% (0.0612 => 0.0616, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.81% (0.0319 => 0.0259, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.7386 => 0.7400, std.dev.: 0.1439) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.16% (0.0123 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.62% (12.7830 => 12.9896, std.dev.: 0.3817) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.02% (0.0336 => 0.0494, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323737.50% (0.0008 => 2.5907, std.dev.: 0.0568) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.87% (1.1825 => 2.3516, std.dev.: 0.1293) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.68% (0.2562 => 0.2810, std.dev.: 0.0054) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (0.5224 => 0.5375, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.55% (11.5523 => 11.7314, std.dev.: 0.0274) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.09% (0.0727 => 0.0501, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.68% (0.1684 => 0.1302, std.dev.: 0.0062) MultiSource/Applications/hbd/hbd: -19.19% (1.8964 => 1.5324, std.dev.: 0.1373) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.92% (0.1079 => 0.0918, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -9.06% (2.6437 => 2.4043, std.dev.: 0.0923) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.66% (1.5131 => 1.3820, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.35% (1.3924 => 1.2762, std.dev.: 0.0361) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.54% (0.6885 => 0.6366, std.dev.: 0.0138) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.25% (0.2372 => 0.2200, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.51% (0.9124 => 0.8530, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (1.3220 => 1.2745, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.38% (0.3665 => 0.3541, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -26.38% (4.4739 => 3.2937, std.dev.: 0.2899) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.54% (0.4081 => 0.3651, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/hash: -9.92% (4.5259 => 4.0771, std.dev.: 0.0988) SingleSource/Benchmarks/Shootout/ary3: -4.94% (2.2304 => 2.1202, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.90% (0.3201 => 0.3044, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.16% (1.4446 => 1.3845, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists: -3.52% (17.2182 => 16.6123, std.dev.: 0.1355) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.78% (0.5826 => 0.5664, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.78% (40.4729 => 39.3485, std.dev.: 0.4038) SingleSource/Benchmarks/Dhrystone/dry: -2.38% (0.5295 => 0.5169, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.33% (3.1921 => 3.1496, std.dev.: 0.0107) SingleSource/Benchmarks/Stanford/FloatMM: -1.20% (0.8328 => 0.8228, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.55% (1.2047 => 1.1138, std.dev.: 0.1068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.01% (0.0233 => 0.0212, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0451 => 0.0437, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -26.43% (0.0227 => 0.0167, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.39% (0.0255 => 0.0254, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.67% (0.1530 => 0.1428, std.dev.: 0.0218) MultiSource/Applications/lemon/lemon: -39.89% (1.9293 => 1.1597, std.dev.: 0.3044) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.53% (0.4049 => 0.3987, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.17% (0.1510 => 0.1432, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.0978 => 0.0956, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.81% (0.0276 => 0.0271, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0590 => 0.0587, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1617 => 1.1626, std.dev.: 0.0333) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.98% (0.0610 => 0.0616, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.36% (0.0268 => 0.0259, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (0.7437 => 0.7400, std.dev.: 0.1439) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.74% (0.0092 => 0.0049, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.66% (12.7781 => 12.9896, std.dev.: 0.3817) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 12:28:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 14:28:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121202844.215552A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7825?compare_to=7823&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7825, Order: 173064, Start Time: 2013-01-21 18:54:42, End Time: 2013-01-21 20:28:55 To: 7823, Order: 173054, Start Time: 2013-01-21 16:57:00, End Time: 2013-01-21 18:31:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0023) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.43% (0.1132 => 0.1601) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.89% (0.6395 => 0.8754, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.85% (0.6260 => 0.8254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.82% (0.5688 => 0.7498, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.71% (0.5456 => 0.7186, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.58% (0.5805 => 0.7638, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.48% (0.5849 => 0.7690, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.02% (0.5581 => 0.7312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.91% (0.5575 => 0.7298, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.81% (0.6395 => 0.8365, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.72% (0.5567 => 0.7277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.98% (0.5941 => 0.7722, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.31% (0.5859 => 0.7576, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.02% (0.6033 => 0.7784, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.60% (0.6440 => 0.8282, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.31% (1.6474 => 2.1137, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.82% (0.6676 => 0.8533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.78% (0.6189 => 0.7908, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.40% (0.6304 => 0.8031, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.06% (0.6230 => 0.7916, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.08% (0.5802 => 0.7315, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.78% (0.6660 => 0.8377, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.50% (0.5705 => 0.7160, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.50% (0.5925 => 0.7436, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.23% (0.5478 => 0.6860, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.20% (0.5857 => 0.7333, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.94% (0.5570 => 0.6959, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.73% (0.5569 => 0.6946, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.66% (0.5591 => 0.6970, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.36% (0.6446 => 0.7952, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.32% (0.5863 => 0.7230, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.28% (0.6052 => 0.7461, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.01% (0.7524 => 0.9255, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.56% (0.6681 => 0.8188, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.47% (0.6194 => 0.7586, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.66% (0.6297 => 0.7661, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.33% (2.2587 => 2.7405, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.64% (0.6667 => 0.8043, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.87% (0.7339 => 0.8724, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.64% (0.3357 => 0.3882, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.53% (1.1450 => 1.3114, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.93% (0.1230 => 0.1389, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: 12.08% (0.3834 => 0.4297, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.02% (4.5069 => 5.0485, std.dev.: 0.0062) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.98% (0.4916 => 0.5505, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 11.67% (0.4515 => 0.5042, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (0.1982 => 0.2211, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.12% (3.5339 => 3.9269, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.6364 => 1.8162, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.90% (0.2385 => 0.2621, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.60% (0.7021 => 0.7625, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4524 => 0.4890, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 7.95% (1.2515 => 1.3510, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.54% (0.5329 => 0.5731, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.08% (0.4861 => 0.5205, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.96% (1.4642 => 1.5661, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.79% (1.2784 => 1.3652, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.41% (9.2283 => 9.8195, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3255 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.86% (5.0226 => 5.2165, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (5.4682 => 5.6688, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.6750 => 0.6987, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.68% (1.3864 => 1.4235, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.61% (0.8418 => 0.8638, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.77% (0.9557 => 0.9726, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.76% (0.7447 => 0.7578, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.49% (1.3722 => 1.3926, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.39% (15.5079 => 15.7229, std.dev.: 0.0085) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.32% (22.4056 => 22.7011, std.dev.: 0.0089) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7916, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4407, std.dev.: 0.0726) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1039, std.dev.: 0.0077) MultiSource/Benchmarks/llubenchmark/llu: 2.29% (3.7435 => 3.8294, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2822, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6009, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2706, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6551 => 3.6925, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -5.05% (2.4924 => 2.3665, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.21% (0.9852 => 0.9437, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.95% (0.3821 => 0.3670, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.83% (0.3837 => 0.3690, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.61% (0.3323 => 0.3203, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.53% (0.3142 => 0.3031, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.46% (0.3812 => 0.3680, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.3831 => 0.3699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.43% (0.3057 => 0.2952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.38% (0.3848 => 0.3718, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3880 => 0.3751, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.19% (0.3891 => 0.3767, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.4033 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.16% (0.3896 => 0.3773, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.4176 => 0.4045, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.97% (1.3148 => 1.2757, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.90% (0.9542 => 0.9265, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.85% (2.1713 => 2.1094, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.81% (0.6484 => 0.6302, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.78% (0.3884 => 0.3776, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.77% (0.6347 => 0.6171, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2060, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/property: -2.57% (0.4199 => 0.4091, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.52% (0.6441 => 0.6279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.46% (0.4151 => 0.4049, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.29% (14.2083 => 13.8823, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: -1.97% (17.1032 => 16.7664, std.dev.: 0.0233) SingleSource/UnitTests/ObjC++/property-reference: -1.94% (0.7779 => 0.7628, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -1.73% (16.1920 => 15.9118, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.73% (0.7919 => 0.7782, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (6.7716 => 6.6627, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.55% (1.2221 => 1.2031, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.54% (1.0544 => 1.0382, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -1.47% (4.3330 => 4.2694, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.47% (1.2210 => 1.2031, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -1.40% (7.0961 => 6.9966, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (1.2300 => 1.2149, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.81% (1.8100 => 0.6731, std.dev.: 0.0217) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3134, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.52% (1.3643 => 1.0298, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9284, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1986, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.35% (2.5106 => 2.1251, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3536, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6337, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.46% (1.3096 => 1.2643, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7653, std.dev.: 0.0101) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -2.10% (3.7241 => 3.6459, std.dev.: 0.0214) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1754, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7073, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.48% (1.6086 => 1.5848, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7092 => 3.6633, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0073) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 13:56:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 15:56:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130121215612.4274D2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7826?compare_to=7824&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7826, Order: 173075, Start Time: 2013-01-21 19:50:09, End Time: 2013-01-21 21:56:26 To: 7824, Order: 173058, Start Time: 2013-01-21 17:26:49, End Time: 2013-01-21 19:30:16 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 30 (20 on baseline) Performance Improvements: 3 (22 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1031 (1021 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 63.11% (0.0740 => 0.1207, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 56.96% (0.0704 => 0.1105, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 19.06% (1.0512 => 1.2516, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.02% (0.9909 => 1.1496, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 14.60% (0.0719 => 0.0824, std.dev.: 0.0019) MultiSource/Applications/ALAC/decode/alacconvert-decode: 14.19% (1.0934 => 1.2486, std.dev.: 0.0276) MultiSource/Applications/ALAC/encode/alacconvert-encode: 13.68% (1.0828 => 1.2309, std.dev.: 0.0167) MultiSource/Applications/lua/lua: 12.70% (4.1522 => 4.6796, std.dev.: 0.2022) MultiSource/Applications/JM/lencod/lencod: 6.83% (16.3496 => 17.4655, std.dev.: 0.1163) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.54% (0.9269 => 0.9875, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: 6.52% (15.8594 => 16.8932, std.dev.: 0.3572) MultiSource/Applications/kimwitu++/kc: 5.79% (18.2625 => 19.3200, std.dev.: 0.2985) MultiSource/Applications/oggenc/oggenc: 4.81% (5.3232 => 5.5791, std.dev.: 0.0534) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.48% (0.9605 => 1.0035, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (0.9150 => 0.9527, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.41% (0.9649 => 0.9978, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.67% (0.8769 => 0.9003, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.06% (1.4596 => 1.8400, std.dev.: 0.0296) MultiSource/Applications/minisat/minisat: 22.06% (6.1712 => 7.5327, std.dev.: 0.2180) MultiSource/Applications/SPASS/SPASS: 14.27% (8.4030 => 9.6019, std.dev.: 0.4190) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.85% (9.2525 => 10.2565, std.dev.: 0.2494) MultiSource/Benchmarks/McCat/09-vor/vor: 9.18% (0.1285 => 0.1403, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.58% (58.4951 => 62.3441, std.dev.: 1.0517) MultiSource/Benchmarks/Bullet/bullet: 3.97% (7.1040 => 7.3860, std.dev.: 0.0949) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.71% (0.5664 => 0.5874, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (41.4373 => 42.7694, std.dev.: 0.4752) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 2.99% (0.4443 => 0.4576, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 2.23% (8.6666 => 8.8600, std.dev.: 0.0727) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.95% (4.9756 => 5.0727, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.87% (4.3758 => 4.4577, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/spiff/spiff: -3.32% (2.9010 => 2.8047, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.38% (11.7314 => 11.5693, std.dev.: 0.0494) MultiSource/Benchmarks/BitBench/five11/five11: -1.15% (5.6891 => 5.6234, std.dev.: 0.0160) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.57% (1.1138 => 1.1647, std.dev.: 0.0914) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.72% (0.0212 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0437 => 0.0436, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.47% (0.0341 => 0.0336, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0322 => 0.0321, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -0.96% (0.0209 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 32.34% (0.0167 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.12% (0.0254 => 0.0241, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 87.50% (0.0008 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 3.08% (0.1428 => 0.1472, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: 2.07% (1.1597 => 1.1837, std.dev.: 0.2642) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.00% (0.3987 => 0.4027, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.96% (0.1432 => 0.1503, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.14% (0.0956 => 0.0986, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.74% (0.0271 => 0.0273, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.71% (0.0587 => 0.0530, std.dev.: 0.0138) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.89% (1.1626 => 1.1522, std.dev.: 0.0603) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.03% (0.0029 => 0.0020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.32% (0.0616 => 0.0614, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.01% (0.0259 => 0.0316, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7400 => 0.7402, std.dev.: 0.0347) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.37% (0.0049 => 0.0040, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.42% (12.9896 => 12.8047, std.dev.: 0.0797) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 63.55% (0.0738 => 0.1207, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 53.90% (0.0718 => 0.1105, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 16.51% (0.9867 => 1.1496, std.dev.: 0.0184) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 8.85% (1.1498 => 1.2516, std.dev.: 0.0394) MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.44% (1.1731 => 1.2486, std.dev.: 0.0276) MultiSource/Applications/JM/lencod/lencod: 4.58% (16.7012 => 17.4655, std.dev.: 0.1163) MultiSource/Applications/oggenc/oggenc: 4.18% (5.3553 => 5.5791, std.dev.: 0.0534) MultiSource/Benchmarks/Bullet/bullet: 4.14% (33.2440 => 34.6187, std.dev.: 0.4269) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.08% (0.9488 => 0.9875, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.07% (0.9588 => 0.9978, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.61% (0.9685 => 1.0035, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321525.00% (0.0008 => 2.5730, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.69% (1.1825 => 2.3968, std.dev.: 0.0346) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.86% (9.0082 => 10.2565, std.dev.: 0.2494) MultiSource/Benchmarks/McCat/09-vor/vor: 8.17% (0.1297 => 0.1403, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 2.79% (0.4452 => 0.4576, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/pi: 2.18% (2.1390 => 2.1857, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.86% (4.9799 => 5.0727, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.66% (4.3851 => 4.4577, std.dev.: 0.0229) MultiSource/Applications/JM/lencod/lencod: 1.27% (6.8159 => 6.9023, std.dev.: 0.0312) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.24% (0.1009 => 0.0825, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.04% (1.0986 => 0.9663, std.dev.: 0.0165) MultiSource/Applications/ClamAV/clamscan: -5.22% (17.4365 => 16.5267, std.dev.: 0.2624) SingleSource/Benchmarks/Shootout-C++/moments: -4.65% (0.4002 => 0.3816, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.45% (1.0017 => 0.9571, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.74% (0.3981 => 0.3832, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -28.34% (0.9372 => 0.6716, std.dev.: 0.0326) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.19% (1.5623 => 1.2781, std.dev.: 0.0586) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.63% (0.4081 => 0.3647, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -9.16% (0.6628 => 0.6021, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: -8.92% (0.1704 => 0.1552, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3654 => 0.3426, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3349 => 0.3213, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.47% (3.1921 => 3.1133, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout-C++/lists: -2.44% (17.2182 => 16.7982, std.dev.: 0.0838) SingleSource/Benchmarks/McGill/chomp: -1.91% (1.0425 => 1.0226, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.82% (40.4729 => 39.7360, std.dev.: 0.2051) MultiSource/Benchmarks/BitBench/five11/five11: -1.38% (5.7021 => 5.6234, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3163, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/methcall: -1.10% (8.7416 => 8.6455, std.dev.: 0.0250) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.32% (1.2047 => 1.1647, std.dev.: 0.0914) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.49% (0.0255 => 0.0241, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.79% (0.1530 => 0.1472, std.dev.: 0.0057) MultiSource/Applications/lemon/lemon: -38.65% (1.9293 => 1.1837, std.dev.: 0.2642) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.54% (0.4049 => 0.4027, std.dev.: 0.0377) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.46% (0.1510 => 0.1503, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.82% (0.0978 => 0.0986, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0590 => 0.0530, std.dev.: 0.0138) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.82% (1.1617 => 1.1522, std.dev.: 0.0603) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.91% (0.0268 => 0.0316, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.47% (0.7437 => 0.7402, std.dev.: 0.0347) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.52% (0.0092 => 0.0040, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.21% (12.7781 => 12.8047, std.dev.: 0.0797) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 14:26:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 16:26:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130121222632.798C52A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7827?compare_to=7825&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7827, Order: 173081, Start Time: 2013-01-21 20:52:31, End Time: 2013-01-21 22:26:45 To: 7825, Order: 173064, Start Time: 2013-01-21 18:54:42, End Time: 2013-01-21 20:28:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (111 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.97% (0.6395 => 0.8759, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.04% (0.6260 => 0.8266, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.87% (0.5456 => 0.7195, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.80% (0.5805 => 0.7651, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.75% (0.5688 => 0.7494, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.54% (0.5849 => 0.7694, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.13% (0.5567 => 0.7300, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.03% (0.5581 => 0.7313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.02% (0.6395 => 0.8379, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.96% (0.5575 => 0.7301, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.31% (0.5859 => 0.7576, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.07% (0.6033 => 0.7787, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.77% (0.6440 => 0.8293, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.32% (1.6474 => 2.1140, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.07% (0.6189 => 0.7926, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.95% (0.6676 => 0.8542, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.57% (0.6304 => 0.8042, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.22% (0.6230 => 0.7926, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.18% (0.5802 => 0.7321, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.04% (0.6660 => 0.8394, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.85% (0.5705 => 0.7180, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.69% (0.5925 => 0.7447, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.35% (0.5857 => 0.7342, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.31% (0.5570 => 0.6980, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.25% (0.5478 => 0.6861, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.87% (0.5569 => 0.6954, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.79% (0.5591 => 0.6977, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.57% (0.5863 => 0.7245, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.44% (0.6446 => 0.7957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.38% (0.6052 => 0.7467, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.26% (0.7524 => 0.9274, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.68% (0.6681 => 0.8196, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.54% (0.6194 => 0.7590, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.90% (0.6297 => 0.7676, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.49% (2.2587 => 2.7442, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.73% (0.6667 => 0.8049, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.08% (0.7339 => 0.8739, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.25% (0.3357 => 0.3869, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.64% (1.1450 => 1.3126, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.04% (0.4916 => 0.5508, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.94% (4.5069 => 5.0448, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 11.65% (0.4515 => 0.5041, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.60% (0.1982 => 0.2212, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.38% (3.5339 => 3.9362, std.dev.: 0.0228) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.10% (1.6364 => 1.8180, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.85% (0.2385 => 0.2620, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.95% (0.2001 => 0.2180, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.7021 => 0.7644, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 7.94% (1.2515 => 1.3509, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.79% (0.5329 => 0.5744, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.57% (0.1731 => 0.1862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.14% (0.4524 => 0.4847, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.90% (1.4642 => 1.5652, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4861 => 0.5191, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.73% (1.2784 => 1.3644, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 6.50% (9.2283 => 9.8277, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.3319 => 0.3475, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.83% (5.4682 => 5.6775, std.dev.: 0.0038) MultiSource/Applications/oggenc/oggenc: 3.80% (5.0226 => 5.2137, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.44% (0.6750 => 0.6982, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.75% (1.3864 => 1.4245, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.51% (0.8418 => 0.8629, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 1.92% (0.7447 => 0.7590, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.9557 => 0.9734, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3722 => 1.3936, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.47% (15.5079 => 15.7357, std.dev.: 0.0175) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.33% (22.4056 => 22.7030, std.dev.: 0.0268) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7886, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9531 => 1.0281, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (54.5751 => 56.6637, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1086, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8210 => 28.2822, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.52% (4.5320 => 4.6010, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3489 => 10.4581, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.89% (0.3194 => 0.3006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.7198 => 0.6856, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (2.4924 => 2.3755, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.18% (0.3848 => 0.3687, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.15% (0.3831 => 0.3672, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: -4.15% (0.3880 => 0.3719, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.04% (0.2871 => 0.2755, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.99% (0.3057 => 0.2935) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.97% (0.9852 => 0.9461, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: -3.95% (0.4176 => 0.4011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.94% (0.3323 => 0.3192, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.89% (0.2903 => 0.2790, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.68% (0.2933 => 0.2825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.65% (0.3205 => 0.3088, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.63% (0.3142 => 0.3028, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.60% (0.3884 => 0.3744, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.58% (0.3016 => 0.2908, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: -3.57% (0.2939 => 0.2834, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.54% (0.6347 => 0.6122, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.50% (0.3025 => 0.2919, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.50% (2.1713 => 2.0954, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.41% (0.3252 => 0.3141, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.38% (0.4199 => 0.4057, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.33% (1.3148 => 1.2710, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -3.17% (0.6441 => 0.6237, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.98% (0.6484 => 0.6291, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.89% (0.7779 => 0.7554, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.55% (0.4151 => 0.4045, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2825, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.12% (14.2083 => 13.9065, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.94% (0.7919 => 0.7765, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.92% (17.1032 => 16.7754, std.dev.: 0.0176) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.82% (6.7716 => 6.6481, std.dev.: 0.0158) MultiSource/Applications/JM/lencod/lencod: -1.66% (16.1920 => 15.9235, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.62% (1.0544 => 1.0373, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: -1.55% (4.3330 => 4.2660, std.dev.: 0.0233) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.52% (1.2210 => 1.2025, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -1.40% (7.0961 => 6.9964, std.dev.: 0.0201) MultiSource/Applications/hbd/hbd: -1.35% (1.5610 => 1.5400, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.33% (1.2300 => 1.2137, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: -1.29% (0.9179 => 0.9061, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -64.85% (1.8100 => 0.6363, std.dev.: 0.0362) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3136, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.60% (1.3643 => 1.0287, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.48% (83.5423 => 63.9229, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7592, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1973, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3555, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (7.9763 => 7.7536, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/ary3: -2.46% (3.7241 => 3.6325, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1729, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.72% (1.6086 => 1.5809, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.66% (1.6307 => 1.6037, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.22% (1.6219 => 1.6021, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 16:22:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 18:22:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122002207.C04812A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7828?compare_to=7826&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7828, Order: 173092, Start Time: 2013-01-21 22:17:23, End Time: 2013-01-22 00:22:22 To: 7826, Order: 173075, Start Time: 2013-01-21 19:50:09, End Time: 2013-01-21 21:56:26 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 37 (38 on baseline) Performance Improvements: 13 (26 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1014 (999 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2005-11-29-LongSwitch: 84.83% (0.0145 => 0.0268, std.dev.: 0.0005) SingleSource/UnitTests/2009-12-07-StructReturn: 81.30% (0.0123 => 0.0223, std.dev.: 0.0015) SingleSource/UnitTests/2007-01-04-KNR-Args: 78.65% (0.0178 => 0.0318, std.dev.: 0.0018) SingleSource/UnitTests/SignlessTypes/factor: 74.80% (0.0488 => 0.0853, std.dev.: 0.0007) SingleSource/UnitTests/2002-05-02-ManyArguments: 74.71% (0.0170 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/cast2: 74.23% (0.0163 => 0.0284, std.dev.: 0.0008) SingleSource/Regression/C/PR491: 72.34% (0.0141 => 0.0243, std.dev.: 0.0005) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 71.25% (0.0160 => 0.0274, std.dev.: 0.0014) SingleSource/UnitTests/member-function-pointers: 69.61% (0.0204 => 0.0346, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/div: 61.64% (0.0318 => 0.0514, std.dev.: 0.0016) SingleSource/UnitTests/2002-08-19-CodegenBug: 61.58% (0.0190 => 0.0307, std.dev.: 0.0013) SingleSource/Regression/C++/EH/ctor_dtor_count: 58.59% (0.0198 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 54.32% (0.1169 => 0.1804, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/ccc: 49.79% (0.0233 => 0.0349, std.dev.: 0.0034) SingleSource/UnitTests/2006-12-11-LoadConstants: 47.57% (0.1278 => 0.1886, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.05% (0.9697 => 1.1156, std.dev.: 0.0534) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.51% (0.9997 => 1.0648, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 5.57% (0.2889 => 0.3050, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.14% (3.6106 => 3.7961, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.04% (0.9008 => 0.9462, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.33% (1.4307 => 1.4641, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.18% (0.7390 => 0.7551, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 52.83% (3.1479 => 4.8109, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/heapsort: 48.72% (3.3119 => 4.9256, std.dev.: 0.1194) SingleSource/Benchmarks/CoyoteBench/fftbench: 30.03% (1.6490 => 2.1442, std.dev.: 0.0641) MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.81% (2.5742 => 3.0070, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout/hash: 10.29% (4.0526 => 4.4698, std.dev.: 0.0589) SingleSource/Benchmarks/Shootout/ary3: 5.97% (2.0911 => 2.2159, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.97% (4.1722 => 4.4211, std.dev.: 0.0677) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.81% (45.3307 => 47.9624, std.dev.: 0.3323) SingleSource/Benchmarks/Linpack/linpack-pc: 3.93% (50.9027 => 52.9038, std.dev.: 0.2401) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.97% (0.5901 => 0.6076, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.82% (1.2930 => 1.3294, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.48% (22.5021 => 23.0593, std.dev.: 0.1537) SingleSource/Benchmarks/McGill/misr: 2.22% (0.4683 => 0.4787, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.30% (3.1133 => 3.1537, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/pi: 1.18% (2.1857 => 2.2116, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -38.77% (0.1207 => 0.0739, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -20.82% (0.1628 => 0.1289, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -16.52% (1.2516 => 1.0448, std.dev.: 0.0590) MultiSource/Applications/Burg/burg: -16.22% (1.6913 => 1.4169, std.dev.: 0.0969) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -14.73% (0.1086 => 0.0926, std.dev.: 0.0056) MultiSource/Applications/lua/lua: -10.62% (4.6796 => 4.1826, std.dev.: 0.1453) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -6.59% (1.1496 => 1.0738, std.dev.: 0.0101) MultiSource/Applications/treecc/treecc: -5.75% (2.3725 => 2.2360, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.86% (0.9982 => 0.9597, std.dev.: 0.0065) MultiSource/Applications/hexxagon/hexxagon: -3.51% (1.1091 => 1.0702, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.21% (0.9875 => 0.9756, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -2.84% (0.4576 => 0.4446, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.29% (5.9940 => 5.8567, std.dev.: 0.0518) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.58% (1.1647 => 1.1230, std.dev.: 0.0581) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.60% (0.0222 => 0.0230, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.52% (0.0436 => 0.0447, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.38% (0.0336 => 0.0344, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.18% (0.0321 => 0.0328, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.32% (0.0431 => 0.0441, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: 3.86% (0.0207 => 0.0215, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: 2.26% (0.0221 => 0.0226, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.56% (0.0241 => 0.0252, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 1.49% (0.1472 => 0.1494, std.dev.: 0.0153) MultiSource/Applications/lemon/lemon: 8.60% (1.1837 => 1.2855, std.dev.: 0.1320) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.66% (0.4027 => 0.3920, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.25% (0.1503 => 0.1627, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.30% (0.0986 => 0.0989, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.83% (0.0273 => 0.0278, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.94% (0.0530 => 0.0535, std.dev.: 0.0148) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.65% (1.1522 => 1.1597, std.dev.: 0.0962) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 45.00% (0.0020 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.44% (0.0614 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.63% (0.0316 => 0.0314, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.39% (0.7402 => 0.7505, std.dev.: 0.0267) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 900.00% (0.0001 => 0.0010) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 27.50% (0.0040 => 0.0051, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.24% (12.8047 => 12.7741, std.dev.: 0.0736) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 153.87% (0.0336 => 0.0853, std.dev.: 0.0007) SingleSource/UnitTests/2002-05-02-ManyArguments: 84.47% (0.0161 => 0.0297, std.dev.: 0.0001) SingleSource/UnitTests/2005-11-29-LongSwitch: 83.56% (0.0146 => 0.0268, std.dev.: 0.0005) SingleSource/UnitTests/member-function-pointers: 70.44% (0.0203 => 0.0346, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/cast2: 69.05% (0.0168 => 0.0284, std.dev.: 0.0008) SingleSource/UnitTests/2007-01-04-KNR-Args: 65.63% (0.0192 => 0.0318, std.dev.: 0.0018) SingleSource/UnitTests/2002-08-19-CodegenBug: 63.30% (0.0188 => 0.0307, std.dev.: 0.0013) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 62.13% (0.0169 => 0.0274, std.dev.: 0.0014) SingleSource/Regression/C++/EH/ctor_dtor_count: 61.03% (0.0195 => 0.0314, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/div: 60.62% (0.0320 => 0.0514, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 55.12% (0.1163 => 0.1804, std.dev.: 0.0044) SingleSource/UnitTests/2006-12-11-LoadConstants: 48.04% (0.1274 => 0.1886, std.dev.: 0.0113) SingleSource/UnitTests/SignlessTypes/ccc: 41.30% (0.0247 => 0.0349, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.83% (0.9867 => 1.0738, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.23% (1.0119 => 1.0648, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/sieve: 4.70% (0.2913 => 0.3050, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.59% (3.6295 => 3.7961, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.43% (0.9061 => 0.9462, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: 4.21% (2.5772 => 2.6858, std.dev.: 0.0387) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.76% (1.4110 => 1.4641, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.82% (0.9488 => 0.9756, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320400.00% (0.0008 => 2.5640, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.75% (1.1825 => 2.4094, std.dev.: 0.0094) SingleSource/Benchmarks/CoyoteBench/fftbench: 29.58% (1.6547 => 2.1442, std.dev.: 0.0641) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.16% (4.2042 => 4.9256, std.dev.: 0.1194) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.06% (0.2562 => 0.2871, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.21% (2.2499 => 2.4347, std.dev.: 0.0468) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.18% (3.7074 => 4.0105, std.dev.: 0.1100) SingleSource/Benchmarks/Shootout/heapsort: 7.53% (4.4739 => 4.8109, std.dev.: 0.0513) SingleSource/Benchmarks/Misc/himenobmtxpa: 6.10% (4.1668 => 4.4211, std.dev.: 0.0677) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.49% (2.8778 => 3.0070, std.dev.: 0.0313) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.04% (46.0987 => 47.9624, std.dev.: 0.3323) SingleSource/Benchmarks/Linpack/linpack-pc: 3.95% (50.8945 => 52.9038, std.dev.: 0.2401) SingleSource/Benchmarks/Misc/pi: 3.39% (2.1390 => 2.2116, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.04% (0.5897 => 0.6076, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.98% (7.0016 => 7.2099, std.dev.: 0.0620) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.06% (0.8800 => 0.8981, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.44% (1.5942 => 1.6172, std.dev.: 0.0083) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.24% (0.0808 => 0.0499, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -22.99% (0.1888 => 0.1454, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.52% (0.1009 => 0.0802, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.08% (0.0676 => 0.0547, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -13.46% (1.8964 => 1.6412, std.dev.: 0.0933) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.17% (1.0986 => 0.9539, std.dev.: 0.0220) MultiSource/Applications/lua/lua: -9.87% (4.6406 => 4.1826, std.dev.: 0.1453) MultiSource/Applications/treecc/treecc: -9.54% (2.4719 => 2.2360, std.dev.: 0.0258) MultiSource/Applications/hexxagon/hexxagon: -6.39% (1.1433 => 1.0702, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.40% (0.2481 => 0.2347, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.97% (1.0017 => 0.9519, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: -4.88% (17.4365 => 16.5857, std.dev.: 0.2217) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.04% (1.3310 => 1.2772, std.dev.: 0.0188) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.76% (1.2680 => 1.2203, std.dev.: 0.0141) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.85% (0.7693 => 0.7551, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.32% (0.1164 => 0.1009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/nestedloop: -9.27% (0.2200 => 0.1996, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.87% (1.4588 => 1.3294, std.dev.: 0.0085) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.68% (0.3217 => 0.3002, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/lists: -2.46% (17.2182 => 16.7954, std.dev.: 0.1366) MultiSource/Applications/spiff/spiff: -2.13% (2.8571 => 2.7963, std.dev.: 0.0227) MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (3.5443 => 3.4831, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/ffbench: -1.57% (1.4244 => 1.4020, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (0.8521 => 0.8402, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3596 => 3.3165, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1537, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.78% (1.2047 => 1.1230, std.dev.: 0.0581) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.29% (0.0233 => 0.0230, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.89% (0.0451 => 0.0447, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0394 => 0.0344, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0328 => 0.0328, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.90% (0.0445 => 0.0441, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/test1: -0.44% (0.0227 => 0.0226, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -2.35% (0.1530 => 0.1494, std.dev.: 0.0153) MultiSource/Applications/lemon/lemon: -33.37% (1.9293 => 1.2855, std.dev.: 0.1320) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.19% (0.4049 => 0.3920, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.75% (0.1510 => 0.1627, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.12% (0.0978 => 0.0989, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.32% (0.0590 => 0.0535, std.dev.: 0.0148) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.1617 => 1.1597, std.dev.: 0.0962) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.80% (0.0610 => 0.0599, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.16% (0.0268 => 0.0314, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.91% (0.7437 => 0.7505, std.dev.: 0.0267) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 900.00% (0.0001 => 0.0010) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.57% (0.0092 => 0.0051, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.03% (12.7781 => 12.7741, std.dev.: 0.0736) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 16:24:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 18:24:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122002415.19AFB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7829?compare_to=7827&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7829, Order: 173095, Start Time: 2013-01-21 22:50:09, End Time: 2013-01-22 00:24:24 To: 7827, Order: 173081, Start Time: 2013-01-21 20:52:31, End Time: 2013-01-21 22:26:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (114 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (873 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.22% (0.6363 => 0.6695, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.93% (0.0514 => 0.0894, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.97% (0.0974 => 0.1636, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.13% (0.1500 => 0.2177, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.08% (0.1132 => 0.1597, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.70% (0.6395 => 0.8742, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.69% (0.6260 => 0.8244, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.59% (0.5688 => 0.7485, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.58% (0.5456 => 0.7179, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.37% (0.5805 => 0.7626, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.25% (0.5849 => 0.7677, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.91% (0.5567 => 0.7288, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.80% (0.5581 => 0.7300, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.58% (0.5575 => 0.7280, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.51% (0.6395 => 0.8346, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.98% (0.5941 => 0.7722, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.05% (0.5859 => 0.7561, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.76% (0.6440 => 0.8292, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 28.74% (0.6033 => 0.7767, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.99% (1.6474 => 2.1085, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.79% (0.6676 => 0.8531, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.78% (0.6189 => 0.7908, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.30% (0.6304 => 0.8025, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.79% (0.6230 => 0.7899, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.89% (0.5802 => 0.7304, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.81% (0.6660 => 0.8379, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.43% (0.5925 => 0.7432, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.26% (0.5705 => 0.7146, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.06% (0.0790 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.05% (0.5857 => 0.7324, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 24.99% (0.5478 => 0.6847, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.92% (0.5570 => 0.6958, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.55% (0.5569 => 0.6936, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.36% (0.5591 => 0.6953, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.30% (0.5863 => 0.7229, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.16% (0.6446 => 0.7939, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.03% (0.6052 => 0.7446, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 22.93% (0.7524 => 0.9249, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.30% (0.6681 => 0.8171, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.30% (0.6194 => 0.7575, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.50% (0.6297 => 0.7651, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.09% (2.2587 => 2.7351, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.44% (0.6667 => 0.8030, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.82% (0.7339 => 0.8720, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.07% (0.0621 => 0.0727, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.72% (0.3357 => 0.3851, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 14.40% (1.1450 => 1.3099, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1081 => 0.1234, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.84% (0.4916 => 0.5498, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.68% (4.5069 => 5.0331, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.63% (0.1230 => 0.1373, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.38% (0.4515 => 0.5029, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.85% (1.6364 => 1.8139, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.72% (3.5339 => 3.9129, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1982 => 0.2189, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2385 => 0.2615, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.65% (0.7021 => 0.7628, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 7.69% (1.2515 => 1.3477, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.34% (0.5329 => 0.5720, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.21% (0.4524 => 0.4850, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.99% (0.1731 => 0.1852, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.4642 => 1.5643, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.58% (0.4861 => 0.5181, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.52% (1.2784 => 1.3617, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 6.15% (9.2283 => 9.7963, std.dev.: 0.0172) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3255 => 0.3428, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3319 => 0.3471, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.51% (5.4682 => 5.6603, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.6750 => 0.6961, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.07% (5.0226 => 5.1769, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: 2.90% (0.3446 => 0.3546, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.55% (1.3864 => 1.4218, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 2.29% (0.8418 => 0.8611, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 1.67% (0.7447 => 0.7571, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.39% (1.3722 => 1.3913, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 1.10% (15.5079 => 15.6786, std.dev.: 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.05% (22.4056 => 22.6399, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.82% (31.3723 => 55.7859, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6202, std.dev.: 0.0820) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) MultiSource/Benchmarks/llubenchmark/llu: 2.85% (3.7435 => 3.8502, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6055, std.dev.: 0.0060) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8210 => 28.2340, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2689, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.23% (79.7170 => 80.6976, std.dev.: 0.3277) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.14% (10.3489 => 10.4669, std.dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.88% (0.1281 => 0.1116, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.70% (0.3194 => 0.3012, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -4.84% (2.4924 => 2.3718, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.64% (0.3837 => 0.3659, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.49% (0.3812 => 0.3641, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.38% (0.9852 => 0.9420, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/exceptions-2: -4.36% (0.3831 => 0.3664, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4033 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.24% (0.3891 => 0.3726, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.13% (0.7198 => 0.6901, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions: -4.05% (0.4176 => 0.4007, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.82% (0.3142 => 0.3022, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.76% (0.3884 => 0.3738, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.69% (0.6347 => 0.6113, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.62% (0.2903 => 0.2798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: -3.58% (0.2849 => 0.2747, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.55% (0.4199 => 0.4050, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.47% (0.3059 => 0.2953, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (0.3025 => 0.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.42% (0.3016 => 0.2913, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.41% (0.3252 => 0.3141, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.41% (2.1713 => 2.0972, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.35% (1.3148 => 1.2707, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.20% (0.4280 => 0.4143, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.82% (0.4151 => 0.4034, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.71% (0.7779 => 0.7568, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.64% (0.6484 => 0.6313, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.57% (0.3931 => 0.3830, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.35% (14.2083 => 13.8738, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -2.32% (17.1032 => 16.7068, std.dev.: 0.0144) SingleSource/UnitTests/Vector/constpool: -2.16% (20.7746 => 20.3252, std.dev.: 0.0324) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.01% (0.7919 => 0.7760, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.97% (1.2221 => 1.1980, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8737, std.dev.: 0.0298) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.77% (6.7716 => 6.6518, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.77% (1.2210 => 1.1994, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.67% (1.0544 => 1.0368, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: -1.66% (4.3330 => 4.2612, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: -1.55% (7.0961 => 6.9861, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: -1.42% (0.7982 => 0.7869, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: -1.41% (0.9179 => 0.9050, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: -1.35% (1.5610 => 1.5399, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -1.05% (34.0927 => 33.7361, std.dev.: 0.0247) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.01% (1.8100 => 0.6695, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3087, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0260, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7528, std.dev.: 0.0075) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0833, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1990, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.05% (2.5106 => 2.1328, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.24% (4.9100 => 4.3580, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (7.9763 => 7.7971, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.3096 => 1.2823, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.7241 => 3.6515, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3040 => 7.1894, std.dev.: 0.0166) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4745, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7092 => 3.6609, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5905, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6042, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 18:21:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 20:21:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122022154.DABA12A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7830?compare_to=7829&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7830, Order: 173106, Start Time: 2013-01-22 00:47:44, End Time: 2013-01-22 02:22:06 To: 7829, Order: 173095, Start Time: 2013-01-21 22:50:09, End Time: 2013-01-22 00:24:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 0 (107 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (875 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.49% (0.6695 => 0.6862, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 85.00% (0.0280 => 0.0518, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.93% (0.0514 => 0.0894, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.18% (0.0717 => 0.1213, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.86% (0.0974 => 0.1635, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.25% (0.1132 => 0.1599, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.92% (0.6395 => 0.8756, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.05% (0.0699 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.93% (0.6260 => 0.8259, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.93% (0.5456 => 0.7198, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.87% (0.5688 => 0.7501, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.70% (0.5805 => 0.7645, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.66% (0.5849 => 0.7701, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.94% (0.5581 => 0.7308, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.92% (0.5575 => 0.7299, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.90% (0.5567 => 0.7287, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.85% (0.6395 => 0.8368, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.06% (0.5941 => 0.7727, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.34% (0.5859 => 0.7578, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.29% (0.6033 => 0.7800, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.85% (0.6440 => 0.8298, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.63% (1.6474 => 2.1190, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.03% (0.6676 => 0.8547, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.94% (0.6189 => 0.7918, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.36% (0.6304 => 0.8029, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.24% (0.6230 => 0.7927, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.11% (0.6660 => 0.8399, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.09% (0.5802 => 0.7316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.66% (0.5705 => 0.7169, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.52% (0.5925 => 0.7437, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.39% (0.5857 => 0.7344, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.24% (0.5570 => 0.6976, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.17% (0.5478 => 0.6857, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.17% (0.0445 => 0.0557, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.78% (0.5569 => 0.6949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.72% (0.5591 => 0.6973, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 24.24% (0.0693 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.44% (0.6446 => 0.7957, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.35% (0.5863 => 0.7232, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.27% (0.7524 => 0.9275, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.27% (0.6052 => 0.7460, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.69% (0.6681 => 0.8197, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.52% (0.6194 => 0.7589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.79% (0.6297 => 0.7669, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.57% (2.2587 => 2.7460, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.68% (0.6667 => 0.8046, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.01% (0.7339 => 0.8734, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.80% (1.1450 => 1.3145, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.03% (4.5069 => 5.0492, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.96% (0.4916 => 0.5504, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.83% (0.4515 => 0.5049, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.38% (0.1230 => 0.1370, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.21% (1.6364 => 1.8199, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.16% (3.5339 => 3.9284, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.15% (0.1982 => 0.2203, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.81% (0.2385 => 0.2619, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.61% (0.1731 => 0.1880, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.87% (1.2515 => 1.3500, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.79% (0.5329 => 0.5744, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.09% (1.4642 => 1.5680, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (0.4861 => 0.5192, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (1.2784 => 1.3638, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: 6.46% (9.2283 => 9.8242, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: 5.85% (0.1761 => 0.1864, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 5.19% (0.3255 => 0.3424, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.70% (0.3319 => 0.3475, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (5.4682 => 5.6885, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 3.63% (5.0226 => 5.2051, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/bigfib: 3.36% (0.6750 => 0.6977, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.63% (1.3864 => 1.4228, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.52% (0.8418 => 0.8630, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.99% (0.7447 => 0.7595, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.73% (0.9557 => 0.9722, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.62% (1.3722 => 1.3944, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.53% (15.5079 => 15.7455, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.40% (22.4056 => 22.7197, std.dev.: 0.0168) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8021, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.49% (0.9531 => 1.0340, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5905, std.dev.: 0.1647) SingleSource/Benchmarks/Misc-C++/bigfib: 3.22% (0.3328 => 0.3435, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 2.71% (3.7435 => 3.8449, std.dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.63% (2.0478 => 2.1016, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6060, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8210 => 28.2368, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.44% (79.7170 => 80.8639, std.dev.: 0.1692) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2699, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4535, std.dev.: 0.0251) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119) SingleSource/Benchmarks/Shootout-C++/objinst: -5.92% (0.3194 => 0.3005, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.61% (0.3837 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.45% (2.4924 => 2.3816, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.06% (0.3323 => 0.3188, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.02% (0.3057 => 0.2934, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.00% (0.7198 => 0.6910, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.96% (0.2903 => 0.2788, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.90% (0.9852 => 0.9468, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.74% (0.3205 => 0.3085, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.69% (0.3059 => 0.2946, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: -3.61% (0.2939 => 0.2833, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.60% (2.1713 => 2.0932, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/trivial-interface: -3.57% (0.3812 => 0.3676, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.56% (0.3142 => 0.3030, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.54% (0.3252 => 0.3137, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3880 => 0.3745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.3831 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.38% (0.3848 => 0.3718, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: -3.37% (0.4033 => 0.3897, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.37% (0.6347 => 0.6133, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.37% (1.3148 => 1.2705, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: -3.34% (0.3896 => 0.3766, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.26% (0.3891 => 0.3764, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.18% (0.4176 => 0.4043, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.11% (0.6441 => 0.6241, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.78% (0.6484 => 0.6304, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.73% (0.7779 => 0.7567, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -2.64% (0.4199 => 0.4088, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.9542 => 0.9291, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -2.59% (0.3931 => 0.3829, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2503, std.dev.: 0.0328) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.22% (14.2083 => 13.8931, std.dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: -1.86% (17.1032 => 16.7855, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.70% (6.7716 => 6.6566, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.69% (0.7919 => 0.7785, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.65% (1.2221 => 1.2019, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.65% (1.2210 => 1.2009, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: -1.62% (16.1920 => 15.9299, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.53% (1.0544 => 1.0383, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -1.35% (4.3330 => 4.2743, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: -1.34% (7.0961 => 7.0007, std.dev.: 0.0052) MultiSource/Applications/hbd/hbd: -1.28% (1.5610 => 1.5410, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.21% (0.9179 => 0.9068, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.16% (1.2300 => 1.2157, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.09% (1.8100 => 0.6862, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7580, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0789, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1971, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1291, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3553, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.62% (2.2633 => 2.1813, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7756, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2869, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3040 => 7.1901, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6086, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6002, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -1.08% (3.7092 => 3.6691, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 18:40:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 21 Jan 2013 20:40:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122024016.E2CEB2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7831?compare_to=7828&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7831, Order: 173106, Start Time: 2013-01-22 00:39:39, End Time: 2013-01-22 02:40:31 To: 7828, Order: 173092, Start Time: 2013-01-21 22:17:23, End Time: 2013-01-22 00:22:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (5 on baseline) Performance Improvements: 39 (70 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1015 (988 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.26% (1.0448 => 1.0789, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.15% (0.3237 => 0.3339, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.04% (0.6211 => 0.6400, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.97% (0.6602 => 0.6798, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.44% (0.8314 => 0.8517, std.dev.: 0.0078) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 10.96% (0.7716 => 0.8562, std.dev.: 0.0271) MultiSource/Applications/oggenc/oggenc: 6.80% (0.1558 => 0.1664, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 5.46% (1.2629 => 1.3318, std.dev.: 0.0152) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.99% (1.2439 => 1.3060, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 1.49% (3.5570 => 3.6099, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-02-ManyArguments: -47.81% (0.0297 => 0.0155, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/cast2: -46.48% (0.0284 => 0.0152, std.dev.: 0.0012) SingleSource/UnitTests/2005-11-29-LongSwitch: -45.90% (0.0268 => 0.0145, std.dev.: 0.0007) SingleSource/UnitTests/member-function-pointers: -44.51% (0.0346 => 0.0192, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: -42.91% (0.0853 => 0.0487, std.dev.: 0.0035) SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -41.24% (0.0274 => 0.0161, std.dev.: 0.0002) SingleSource/UnitTests/2007-01-04-KNR-Args: -40.57% (0.0318 => 0.0189, std.dev.: 0.0002) SingleSource/UnitTests/2002-08-19-CodegenBug: -37.46% (0.0307 => 0.0192, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ctor_dtor_count: -35.99% (0.0314 => 0.0201, std.dev.: 0.0024) SingleSource/Regression/C++/EH/simple_rethrow: -35.74% (0.0305 => 0.0196, std.dev.: 0.0014) SingleSource/UnitTests/SignlessTypes/rem: -35.42% (0.1804 => 0.1165, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: -31.97% (0.1886 => 0.1283, std.dev.: 0.0014) SingleSource/UnitTests/initp1: -21.75% (0.0607 => 0.0475, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -17.58% (0.2690 => 0.2217, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.92% (1.1156 => 0.9380, std.dev.: 0.0178) SingleSource/UnitTests/Vector/constpool: -14.60% (10.2472 => 8.7514, std.dev.: 0.5589) MultiSource/Benchmarks/NPB-serial/is/is: -11.83% (0.0879 => 0.0775, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: -9.03% (0.3411 => 0.3103, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -8.54% (3.7961 => 3.4721, std.dev.: 0.0582) MultiSource/Applications/sqlite3/sqlite3: -5.56% (16.9647 => 16.0217, std.dev.: 0.2957) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.30% (0.4038 => 0.3824, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/heapsort: -5.15% (0.2234 => 0.2119, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.12% (0.9392 => 0.8911, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -5.06% (2.5417 => 2.4131, std.dev.: 0.0465) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.26% (0.7551 => 0.7305, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.97% (0.6063 => 0.5883, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.44% (0.9404 => 0.9175, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/bigfib: -1.57% (0.6623 => 0.6519, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.62% (3.0070 => 2.5674, std.dev.: 0.1133) SingleSource/Benchmarks/Shootout-C++/lists1: -9.28% (0.6671 => 0.6052, std.dev.: 0.0146) SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.09% (4.9756 => 4.5232, std.dev.: 0.1494) MultiSource/Benchmarks/mafft/pairlocalalign: -8.48% (63.3894 => 58.0109, std.dev.: 0.1138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.49% (23.0593 => 22.0238, std.dev.: 0.2024) SingleSource/Benchmarks/Dhrystone/dry: -4.27% (0.5413 => 0.5182, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -2.71% (1.7810 => 1.7327, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.50% (1.4211 => 1.3856, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.4174 => 4.3226, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.83% (0.5789 => 0.5683, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.38% (5.0785 => 5.0083, std.dev.: 0.0184) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.40% (1.1230 => 1.1387, std.dev.: 0.0456) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.61% (0.0230 => 0.0224, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.46% (0.0447 => 0.0436, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.45% (0.0344 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.95% (0.0441 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -2.33% (0.0215 => 0.0210, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0226 => 0.0224) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.16% (0.0252 => 0.0239, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.82% (0.1494 => 0.1437, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -10.21% (1.2855 => 1.1543, std.dev.: 0.1120) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.89% (0.3920 => 0.3994, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.17% (0.1627 => 0.1494, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.75% (0.0989 => 0.0942, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.66% (0.0278 => 0.0215, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.12% (0.0535 => 0.0541, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.53% (1.1597 => 1.1535, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -24.14% (0.0029 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.18% (0.0599 => 0.0544, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.59% (0.0314 => 0.0319, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.79% (0.7505 => 0.7371, std.dev.: 0.0046) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -90.00% (0.0010 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 47.06% (0.0051 => 0.0075, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.03% (12.7741 => 12.7702, std.dev.: 0.0169) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 44.94% (0.0336 => 0.0487, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.66% (0.9588 => 0.9843, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323550.00% (0.0008 => 2.5892, std.dev.: 0.0564) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.44% (1.1825 => 2.4057, std.dev.: 0.0262) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.31% (0.2562 => 0.2775, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.64% (0.0727 => 0.0497, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.46% (0.0692 => 0.0502, std.dev.: 0.0028) SingleSource/Benchmarks/SmallPT/smallpt: -26.01% (0.1888 => 0.1397, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -20.31% (0.1684 => 0.1342, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.12% (0.1009 => 0.0806, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -18.19% (1.8964 => 1.5514, std.dev.: 0.0429) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.17% (0.0862 => 0.0714, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.74% (0.7686 => 0.6553, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.42% (1.0960 => 0.9380, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.76% (1.0986 => 0.9474, std.dev.: 0.0559) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.98% (0.4074 => 0.3545, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.64% (6.4235 => 5.7398, std.dev.: 0.1753) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.39% (1.2154 => 1.0891, std.dev.: 0.0090) MultiSource/Applications/hexxagon/hexxagon: -10.37% (1.1433 => 1.0247, std.dev.: 0.0317) MultiSource/Applications/lua/lua: -9.21% (4.6406 => 4.2132, std.dev.: 0.0504) MultiSource/Applications/sqlite3/sqlite3: -8.78% (17.5634 => 16.0217, std.dev.: 0.2957) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.25% (1.6874 => 1.5482, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -8.18% (0.8653 => 0.7945, std.dev.: 0.0268) MultiSource/Benchmarks/Olden/health/health: -7.08% (0.1610 => 0.1496, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.04% (0.6885 => 0.6400, std.dev.: 0.0050) MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.96% (1.1731 => 1.0914, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.65% (0.9124 => 0.8517, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.53% (0.2372 => 0.2217, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.21% (0.3560 => 0.3339, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.17% (1.1498 => 1.0789, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.93% (0.2884 => 0.2713, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.46% (0.5746 => 0.5432, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.42% (1.8127 => 1.7145, std.dev.: 0.0268) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.38% (0.2100 => 0.1987, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -5.23% (0.2006 => 0.1901, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.04% (0.7693 => 0.7305, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.92% (1.0017 => 0.9524, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.59% (1.2680 => 1.2098, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.34% (3.6295 => 3.4721, std.dev.: 0.0582) MultiSource/Applications/minisat/minisat: -4.13% (0.7776 => 0.7455, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.11% (0.6135 => 0.5883, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.07% (0.3093 => 0.2967, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.49% (0.9507 => 0.9175, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.47% (0.3665 => 0.3538, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -2.86% (0.6711 => 0.6519, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.18% (0.4762 => 0.4658, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.98% (0.9091 => 0.8911, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.04% (0.9372 => 0.6463, std.dev.: 0.0070) MultiSource/Applications/minisat/minisat: -22.60% (7.9891 => 6.1837, std.dev.: 0.1993) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.84% (1.0816 => 0.8562, std.dev.: 0.0271) MultiSource/Benchmarks/Fhourstones/fhourstones: -14.75% (1.5623 => 1.3318, std.dev.: 0.0152) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.69% (1.4235 => 1.2571, std.dev.: 0.0563) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.79% (2.8778 => 2.5674, std.dev.: 0.1133) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.61% (0.4081 => 0.3648, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.29% (5.0421 => 4.5232, std.dev.: 0.1494) SingleSource/Benchmarks/Shootout/hash: -10.14% (4.5259 => 4.0669, std.dev.: 0.1615) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.13% (1.4588 => 1.3256, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/lists1: -8.69% (0.6628 => 0.6052, std.dev.: 0.0146) MultiSource/Benchmarks/mafft/pairlocalalign: -8.14% (63.1520 => 58.0109, std.dev.: 0.1138) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.88% (23.3986 => 22.0238, std.dev.: 0.2024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.37% (0.3349 => 0.3169, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -4.39% (1.8123 => 1.7327, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.08% (1.4446 => 1.3856, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/lists: -3.48% (17.2182 => 16.6190, std.dev.: 0.1647) MultiSource/Applications/sqlite3/sqlite3: -3.36% (4.4730 => 4.3226, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.45% (0.5826 => 0.5683, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -2.13% (0.5295 => 0.5182, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.59% (2.4498 => 2.4109, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3155, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/matrix: -1.08% (2.9083 => 2.8768, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -1.02% (8.7416 => 8.6524, std.dev.: 0.0270) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.48% (1.2047 => 1.1387, std.dev.: 0.0456) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.27% (0.0255 => 0.0239, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -6.08% (0.1530 => 0.1437, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -40.17% (1.9293 => 1.1543, std.dev.: 0.1120) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4049 => 0.3994, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.06% (0.1510 => 0.1494, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.68% (0.0978 => 0.0942, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.10% (0.0276 => 0.0215, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.71% (1.1617 => 1.1535, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -31.25% (0.0032 => 0.0022, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -10.82% (0.0610 => 0.0544, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.89% (0.7437 => 0.7371, std.dev.: 0.0046) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.48% (0.0092 => 0.0075, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7781 => 12.7702, std.dev.: 0.0169) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 21 23:42:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 01:42:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122074206.829A02A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7832?compare_to=7830&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7832, Order: 173127, Start Time: 2013-01-22 06:08:00, End Time: 2013-01-22 07:42:19 To: 7830, Order: 173106, Start Time: 2013-01-22 00:47:44, End Time: 2013-01-22 02:22:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (109 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.98% (0.6862 => 0.7204, std.dev.: 0.0129) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.12% (0.6395 => 0.8769, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.47% (0.0699 => 0.0926, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.27% (0.6260 => 0.8280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.03% (0.5688 => 0.7510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.92% (0.5805 => 0.7658, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.91% (0.5456 => 0.7197, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.71% (0.5849 => 0.7704, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.18% (0.5581 => 0.7321, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.16% (0.5575 => 0.7312, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.06% (0.5567 => 0.7296, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.04% (0.6395 => 0.8380, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.51% (0.5859 => 0.7588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.24% (0.6033 => 0.7797, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.96% (0.6440 => 0.8305, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.51% (1.6474 => 2.1170, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.11% (0.6189 => 0.7929, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.59% (0.6304 => 0.8043, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.29% (0.6230 => 0.7930, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.09% (0.5802 => 0.7316, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.04% (0.6660 => 0.8394, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.64% (0.5705 => 0.7168, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.62% (0.5925 => 0.7443, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.34% (0.5857 => 0.7341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.25% (0.5478 => 0.6861, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.21% (0.5570 => 0.6974, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.86% (0.5591 => 0.6981, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.82% (0.5569 => 0.6951, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.57% (0.6446 => 0.7965, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.42% (0.7524 => 0.9286, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.37% (0.5863 => 0.7233, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.20% (0.6052 => 0.7456, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.86% (0.6681 => 0.8208, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.65% (0.6194 => 0.7597, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.77% (0.6297 => 0.7668, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.36% (2.2587 => 2.7412, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.74% (0.6667 => 0.8050, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.08% (0.7339 => 0.8739, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3357 => 0.3873, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.71% (1.1450 => 1.3134, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.00% (0.4916 => 0.5506, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.99% (4.5069 => 5.0475, std.dev.: 0.0113) MultiSource/Benchmarks/McCat/05-eks/eks: 11.76% (0.4515 => 0.5046, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.30% (0.1982 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.15% (1.6364 => 1.8189, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.15% (3.5339 => 3.9280, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.09% (0.7021 => 0.7659, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.48% (1.2515 => 1.3576, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.94% (0.5329 => 0.5752, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.57% (0.1731 => 0.1862, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 7.54% (0.4524 => 0.4865, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4642 => 1.5687, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 6.73% (0.4861 => 0.5188, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.69% (1.2784 => 1.3639, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 6.67% (9.2283 => 9.8440, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.3255 => 0.3433, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.82% (0.3319 => 0.3479, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (5.4682 => 5.6807, std.dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 3.75% (5.0226 => 5.2111, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 3.70% (0.6750 => 0.7000, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 2.93% (0.3446 => 0.3547, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.67% (0.8418 => 0.8643, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.65% (1.3864 => 1.4231, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 2.03% (0.7447 => 0.7598, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.5168 => 0.5271, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.91% (0.9557 => 0.9740, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3722 => 1.3954, std.dev.: 0.0064) MultiSource/Applications/SPASS/SPASS: 1.58% (15.5079 => 15.7532, std.dev.: 0.0145) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.27% (22.4056 => 22.6902, std.dev.: 0.0200) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8127, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.24% (0.9531 => 1.0316, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4010, std.dev.: 0.1378) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1119, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.67% (4.5320 => 4.6075, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8210 => 28.2329, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.67% (0.3194 => 0.3013, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -4.96% (2.4924 => 2.3687, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.56% (0.3837 => 0.3662, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.33% (0.7198 => 0.6886, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.85% (0.3323 => 0.3195, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: -3.83% (0.2871 => 0.2761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.75% (0.9852 => 0.9483, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: -3.69% (0.2849 => 0.2744, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -3.67% (0.3812 => 0.3672, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.65% (0.3831 => 0.3691, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.58% (0.3880 => 0.3741, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.56% (0.3142 => 0.3030, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: -3.56% (0.3059 => 0.2950, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.52% (0.4033 => 0.3891, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3884 => 0.3749, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: -3.44% (0.2939 => 0.2838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3896 => 0.3763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.39% (2.1713 => 2.0976, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.35% (0.3252 => 0.3143, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.34% (0.3891 => 0.3761, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.4176 => 0.4038, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.28% (0.6347 => 0.6139, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -3.17% (1.3148 => 1.2731, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.90% (0.6441 => 0.6254, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.82% (0.6484 => 0.6301, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.72% (0.9542 => 0.9282, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.72% (0.4151 => 0.4038, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -2.69% (0.4199 => 0.4086, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/parameter-passing: -2.38% (0.4280 => 0.4178, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.33% (0.7779 => 0.7598, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (14.2083 => 13.8936, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: -2.06% (17.1032 => 16.7512, std.dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -1.85% (20.7746 => 20.3894, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.82% (0.7919 => 0.7775, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.78% (1.2210 => 1.1993, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: -1.73% (16.1920 => 15.9112, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (1.2221 => 1.2016, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.59% (1.0544 => 1.0376, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.49% (6.7716 => 6.6704, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.35% (7.0961 => 7.0005, std.dev.: 0.0138) MultiSource/Benchmarks/MallocBench/gs/gs: -1.31% (4.3330 => 4.2761, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: -1.15% (0.9179 => 0.9073, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.20% (1.8100 => 0.7204, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3105, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.47% (1.3643 => 1.0305, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7560, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0853, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1312, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3532, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.08% (1.0557 => 1.0232, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (7.9763 => 7.7448, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.90% (1.3096 => 1.2716, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout/ary3: -2.37% (3.7241 => 3.6360, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1877, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4691, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6099, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.13% (1.6086 => 1.5904, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 00:02:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 02:02:07 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122080207.93A682A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7833?compare_to=7831&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7833, Order: 173127, Start Time: 2013-01-22 06:04:50, End Time: 2013-01-22 08:02:22 To: 7831, Order: 173106, Start Time: 2013-01-22 00:39:39, End Time: 2013-01-22 02:40:31 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 15 (11 on baseline) Performance Improvements: 15 (154 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (898 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.35% (1.0006 => 1.0141, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.10% (1.2098 => 1.2231, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 15.15% (1.6080 => 1.8516, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.51% (2.2367 => 2.3599, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout/nestedloop: 5.43% (0.2009 => 0.2118, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.35% (0.2073 => 0.2184, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.80% (2.6582 => 2.7591, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/pi: 2.76% (2.1454 => 2.2046, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.63% (4.1379 => 4.2466, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/flops: 2.51% (8.6369 => 8.8541, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.10% (5.4688 => 5.5836, std.dev.: 0.0333) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.62% (3.9596 => 4.0238, std.dev.: 0.0197) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.53% (4.5232 => 4.5923, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.43% (2.5674 => 2.6041, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.0078 => 5.0780, std.dev.: 0.0239) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/12-IOtest/iotest: -11.51% (0.0982 => 0.0869, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.86% (0.9380 => 0.9112, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.41% (0.8517 => 0.8312, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: -2.09% (0.8991 => 0.8803, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.97% (0.9893 => 0.9698, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.83% (0.9843 => 0.9663, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.76% (0.9024 => 0.8865, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.66% (1.4422 => 1.4183, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.54% (0.9106 => 0.8966, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -1.47% (1.4159 => 1.3951, std.dev.: 0.0056) MultiSource/Applications/hbd/hbd: -1.44% (1.5514 => 1.5291, std.dev.: 0.0061) MultiSource/Applications/lua/lua: -1.38% (4.2132 => 4.1550, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: -5.31% (1.3318 => 1.2611, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.66% (5.0083 => 4.9254, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.5672 => 1.5474, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.78% (1.1387 => 1.1184, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.16% (0.0224 => 0.0143, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.06% (0.0436 => 0.0366, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.90% (0.0339 => 0.0319, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0320 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.95% (0.0210 => 0.0208, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -10.71% (0.0224 => 0.0200, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.77% (0.0239 => 0.0248, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1437 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 0.60% (1.1543 => 1.1612, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.51% (0.3994 => 0.4134, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.07% (0.1494 => 0.1493, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.14% (0.0942 => 0.0981, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.16% (0.0215 => 0.0191, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.70% (0.0541 => 0.0561, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.94% (1.1535 => 1.1426, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 31.82% (0.0022 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.48% (0.0544 => 0.0601, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0319 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.41% (0.7371 => 0.7401, std.dev.: 0.0097) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.33% (0.0075 => 0.0076, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (12.7702 => 12.7425, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.87% (33.2440 => 33.8672, std.dev.: 0.0750) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.68% (1.8651 => 1.8964, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320587.50% (0.0008 => 2.5655, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.98% (1.1825 => 2.3766, std.dev.: 0.0215) MultiSource/Benchmarks/nbench/nbench: 20.30% (20.5117 => 24.6748, std.dev.: 1.3065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.34% (0.2562 => 0.2827, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.51% (0.2070 => 0.2184, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.89% (2.2499 => 2.3599, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/pi: 3.07% (2.1390 => 2.2046, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 2.10% (6.8159 => 6.9592, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.92% (4.1668 => 4.2466, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.25% (0.0808 => 0.0507, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0004) SingleSource/Benchmarks/SmallPT/smallpt: -30.83% (0.1888 => 0.1306, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.47% (0.0692 => 0.0495, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.10% (0.1684 => 0.1295, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.12% (0.1009 => 0.0806, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -19.37% (1.8964 => 1.5291, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.91% (0.0862 => 0.0699, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.86% (1.0960 => 0.9112, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.31% (0.1079 => 0.0903, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.53% (0.7686 => 0.6492, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -15.22% (0.1025 => 0.0869, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -14.54% (0.2372 => 0.2027, std.dev.: 0.0086) SingleSource/UnitTests/Vector/constpool: -14.09% (9.8875 => 8.4948, std.dev.: 0.3174) MultiSource/Applications/spiff/spiff: -13.86% (1.0220 => 0.8803, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.75% (0.4074 => 0.3514, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.00% (1.0986 => 0.9558, std.dev.: 0.0115) MultiSource/Applications/aha/aha: -12.70% (0.1378 => 0.1203, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: -12.69% (1.5979 => 1.3951, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: -10.88% (2.4719 => 2.2030, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.80% (6.4235 => 5.7295, std.dev.: 0.0152) MultiSource/Applications/hexxagon/hexxagon: -10.78% (1.1433 => 1.0201, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -10.46% (4.6406 => 4.1550, std.dev.: 0.0109) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.33% (1.2154 => 1.0898, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -10.09% (0.5746 => 0.5166, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.89% (1.5131 => 1.3635, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.68% (0.7693 => 0.6948, std.dev.: 0.0023) MultiSource/Applications/sgefa/sgefa: -9.26% (0.3598 => 0.3265, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -9.24% (0.2618 => 0.2376, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.22% (1.3924 => 1.2640, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.17% (10.2703 => 9.3283, std.dev.: 0.0353) MultiSource/Applications/sqlite3/sqlite3: -9.04% (17.5634 => 15.9748, std.dev.: 0.0074) MultiSource/Applications/lambda-0_1_3/lambda: -8.96% (0.8653 => 0.7878, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.90% (0.9124 => 0.8312, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -8.84% (2.6437 => 2.4100, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.58% (0.1317 => 0.1204, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.57% (1.6874 => 1.5428, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.42% (1.1498 => 1.0530, std.dev.: 0.0121) MultiSource/Applications/ClamAV/clamscan: -8.22% (17.4365 => 16.0024, std.dev.: 0.0834) MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.11% (0.2884 => 0.2650, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.98% (0.1755 => 0.1615, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -7.97% (0.1305 => 0.1201, std.dev.: 0.0033) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.63% (1.1731 => 1.0836, std.dev.: 0.0115) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.54% (0.9588 => 0.8865, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: -7.29% (3.7840 => 3.5082, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.16% (0.3560 => 0.3305, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.15% (0.6885 => 0.6393, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: -7.14% (0.1610 => 0.1495, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.05% (0.2481 => 0.2306, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.61% (0.2283 => 0.2132, std.dev.: 0.0024) MultiSource/Applications/lemon/lemon: -6.17% (1.3979 => 1.3116, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.10% (0.2100 => 0.1972, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.81% (0.7693 => 0.7246, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (0.5134 => 0.4841, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.66% (1.8127 => 1.7101, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: -5.53% (0.2006 => 0.1895, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.41% (0.6934 => 0.6559, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/moments: -5.37% (0.4002 => 0.3787, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.32% (0.2709 => 0.2565, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.96% (1.0017 => 0.9520, std.dev.: 0.0103) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.91% (1.3310 => 1.2656, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.78% (3.6295 => 3.4561, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.65% (0.9550 => 0.9106, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.64% (0.3665 => 0.3495, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: -4.59% (1.4392 => 1.3731, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.47% (5.0381 => 4.8128, std.dev.: 0.0323) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.47% (0.6135 => 0.5861, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/08-main/main: -4.46% (0.2915 => 0.2785, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -4.31% (0.7776 => 0.7441, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.31% (0.2577 => 0.2466, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.17% (0.3981 => 0.3815, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -4.16% (0.2551 => 0.2445, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.10% (1.0234 => 0.9814, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.92% (1.3220 => 1.2702, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: -3.82% (0.2725 => 0.2621, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.71% (0.3715 => 0.3577, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.67% (0.3462 => 0.3335, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.54% (1.2680 => 1.2231, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.54% (4.6579 => 4.4932, std.dev.: 0.0388) SingleSource/Benchmarks/Shootout-C++/hash: -3.45% (0.4689 => 0.4527, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/lists1: -3.40% (0.3206 => 0.3097, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: -3.28% (18.9377 => 18.3170, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.19% (0.9127 => 0.8836, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: -3.16% (16.4479 => 15.9281, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.05% (0.9405 => 0.9118, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.94% (0.4762 => 0.4622, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.90% (0.9512 => 0.9236, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: -2.89% (0.6711 => 0.6517, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: -2.89% (0.3807 => 0.3697, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.88% (0.9403 => 0.9132, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: -2.81% (4.5936 => 4.4644, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.69% (0.9214 => 0.8966, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.61% (7.2721 => 7.0826, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.45% (1.0052 => 0.9806, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.40% (0.6996 => 0.6828, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -2.36% (7.3529 => 7.1796, std.dev.: 0.0182) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.30% (14.9757 => 14.6314, std.dev.: 0.1049) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.27% (0.9091 => 0.8885, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.08% (2.4519 => 2.4008, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.90% (1.0860 => 1.0654, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: -1.78% (5.3553 => 5.2599, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.76% (0.9488 => 0.9321, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -1.72% (16.7012 => 16.4141, std.dev.: 0.0567) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.59% (0.9855 => 0.9698, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.47% (4.9104 => 4.8382, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -31.20% (4.4739 => 3.0782, std.dev.: 0.1358) MultiSource/Benchmarks/Olden/bisort/bisort: -30.55% (0.9372 => 0.6509, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: -29.09% (1.0816 => 0.7670, std.dev.: 0.0385) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.22% (4.2042 => 3.1438, std.dev.: 0.0649) MultiSource/Applications/minisat/minisat: -22.96% (7.9891 => 6.1549, std.dev.: 0.0389) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.28% (1.5623 => 1.2611, std.dev.: 0.0175) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.43% (0.0845 => 0.0740, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.16% (1.4235 => 1.2647, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.27% (0.4081 => 0.3662, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/hash: -9.93% (4.5259 => 4.0763, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.51% (2.8778 => 2.6041, std.dev.: 0.0100) SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.92% (5.0421 => 4.5923, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists1: -8.28% (0.6628 => 0.6079, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -8.16% (63.1520 => 58.0001, std.dev.: 0.0311) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.90% (4.4540 => 4.1022, std.dev.: 0.0605) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.80% (0.3217 => 0.2966, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.44% (23.3986 => 21.6578, std.dev.: 0.3669) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.37% (1.4588 => 1.3513, std.dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: -6.61% (9.0650 => 8.4655, std.dev.: 0.0551) MultiSource/Benchmarks/Olden/health/health: -6.29% (0.3654 => 0.3424, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.21% (46.0987 => 43.2352, std.dev.: 0.3390) SingleSource/Benchmarks/Shootout/ary3: -6.01% (2.2304 => 2.0964, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.94% (0.3201 => 0.3043, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ffbench: -4.61% (1.4244 => 1.3587, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.54% (1.4446 => 1.3790, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.41% (2.5170 => 2.4060, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/ary3: -3.92% (1.8123 => 1.7412, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/lists: -3.51% (17.2182 => 16.6141, std.dev.: 0.0543) MultiSource/Applications/SIBsim4/SIBsim4: -3.40% (3.5443 => 3.4238, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -3.36% (4.4730 => 4.3228, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/chomp: -2.99% (1.0425 => 1.0113, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.3406 => 0.3306, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: -2.47% (2.8571 => 2.7864, std.dev.: 0.0045) MultiSource/Benchmarks/Bullet/bullet: -2.44% (7.2040 => 7.0279, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.29% (3.0082 => 2.9392, std.dev.: 0.0068) MultiSource/Applications/lua/lua: -1.98% (29.0327 => 28.4570, std.dev.: 0.0395) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.79% (0.5826 => 0.5722, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.66% (3.7662 => 3.7037, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/five11/five11: -1.45% (5.7021 => 5.6195, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel-2: -1.41% (0.8521 => 0.8401, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.32% (5.9063 => 5.8282, std.dev.: 0.0142) MultiSource/Benchmarks/llubenchmark/llu: -1.31% (2.0298 => 2.0032, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.24% (3.3596 => 3.3179, std.dev.: 0.0138) SingleSource/Benchmarks/SmallPT/smallpt: -1.23% (14.9448 => 14.7603, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.14% (3.1921 => 3.1556, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/matrix: -1.13% (2.9083 => 2.8755, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/fibo: -1.03% (4.3512 => 4.3064, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.16% (1.2047 => 1.1184, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -38.63% (0.0233 => 0.0143, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.85% (0.0451 => 0.0366, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -19.04% (0.0394 => 0.0319, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -11.89% (0.0227 => 0.0200, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.75% (0.0255 => 0.0248, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -5.10% (0.1530 => 0.1452, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -39.81% (1.9293 => 1.1612, std.dev.: 0.0142) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.10% (0.4049 => 0.4134, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.13% (0.1510 => 0.1493, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.31% (0.0978 => 0.0981, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.64% (1.1617 => 1.1426, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.48% (0.0610 => 0.0601, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0097) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.28% (12.7781 => 12.7425, std.dev.: 0.0142) Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 03:20:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 05:20:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122112032.4A93E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7834?compare_to=7832&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7834, Order: 173135, Start Time: 2013-01-22 09:46:09, End Time: 2013-01-22 11:20:44 To: 7832, Order: 173127, Start Time: 2013-01-22 06:08:00, End Time: 2013-01-22 07:42:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 1 (109 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -5.47% (0.7204 => 0.6810, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.78% (0.1132 => 0.1605, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.08% (0.6395 => 0.8766, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.10% (0.5688 => 0.7514, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.04% (0.6260 => 0.8266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.83% (0.5849 => 0.7711, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.73% (0.5805 => 0.7647, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.11% (0.5567 => 0.7299, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.11% (0.5581 => 0.7317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.03% (0.5575 => 0.7305, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.90% (0.6395 => 0.8371, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.41% (0.5859 => 0.7582, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.27% (0.6033 => 0.7799, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.94% (0.6440 => 0.8304, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.43% (1.6474 => 2.1158, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.18% (0.6189 => 0.7933, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.18% (0.6676 => 0.8557, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.49% (0.6304 => 0.8037, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.09% (0.6230 => 0.7918, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.25% (0.5802 => 0.7325, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.11% (0.6660 => 0.8399, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.84% (0.5925 => 0.7456, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.49% (0.5705 => 0.7159, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.42% (0.5857 => 0.7346, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.23% (0.5478 => 0.6860, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.01% (0.5570 => 0.6963, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.83% (0.5569 => 0.6952, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.66% (0.5591 => 0.6970, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.46% (0.7524 => 0.9289, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.42% (0.5863 => 0.7236, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.36% (0.6446 => 0.7952, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.23% (0.6052 => 0.7458, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.77% (0.6681 => 0.8202, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.49% (0.6194 => 0.7587, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.80% (0.6297 => 0.7670, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.29% (2.2587 => 2.7395, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.76% (0.6667 => 0.8051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.09% (0.7339 => 0.8740, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3357 => 0.3858, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.70% (1.1450 => 1.3133, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.25% (0.4916 => 0.5518, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.91% (4.5069 => 5.0435, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.11% (1.6364 => 1.8182, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.08% (3.5339 => 3.9253, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.02% (0.2385 => 0.2624, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.86% (0.7021 => 0.7643, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 8.07% (1.2515 => 1.3525, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4524 => 0.4889, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.73% (0.5329 => 0.5741, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.57% (0.1731 => 0.1862, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.4642 => 1.5682, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 6.75% (0.4861 => 0.5189, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.69% (1.2784 => 1.3639, std.dev.: 0.0039) MultiSource/Benchmarks/mafft/pairlocalalign: 6.68% (9.2283 => 9.8449, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.89% (5.4682 => 5.6811, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 3.65% (5.0226 => 5.2060, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.6750 => 0.6980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.96% (0.3446 => 0.3548, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.60% (1.3864 => 1.4224, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 2.46% (0.8418 => 0.8625, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 1.99% (0.7447 => 0.7595, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.9557 => 0.9741, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.3722 => 1.3963, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 1.53% (15.5079 => 15.7449, std.dev.: 0.0229) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.29% (22.4056 => 22.6953, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8069, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.17% (0.9531 => 1.0405, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.91% (1.2783 => 1.3666, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.46% (54.5751 => 56.4630, std.dev.: 0.1125) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.99% (2.0478 => 2.1090, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6038, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9569, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8210 => 28.2384, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -5.00% (2.4924 => 2.3679, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.48% (0.3837 => 0.3665, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.18% (0.7198 => 0.6897, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.78% (0.9852 => 0.9480, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.70% (0.3812 => 0.3671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.63% (0.3880 => 0.3739, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.63% (0.3142 => 0.3028, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hello: -3.62% (0.2849 => 0.2746, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.59% (0.3896 => 0.3756, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.56% (0.3059 => 0.2950, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.55% (0.3323 => 0.3205, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.52% (0.3891 => 0.3754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.50% (0.4033 => 0.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.48% (0.2903 => 0.2802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3884 => 0.3749, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: -3.46% (0.3205 => 0.3094, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.32% (2.1713 => 2.0993, std.dev.: 0.0086) SingleSource/UnitTests/ObjC++/property-reference: -3.30% (0.7779 => 0.7522, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.29% (0.3252 => 0.3145, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: -3.18% (0.6347 => 0.6145, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.15% (1.3148 => 1.2734, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.97% (0.6441 => 0.6250, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.78% (0.9542 => 0.9277, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.58% (0.6484 => 0.6317, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -2.48% (0.4280 => 0.4174, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8920, std.dev.: 0.0151) MultiSource/Applications/sqlite3/sqlite3: -2.08% (17.1032 => 16.7479, std.dev.: 0.0195) SingleSource/UnitTests/Vector/constpool: -1.92% (20.7746 => 20.3757, std.dev.: 0.0326) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.78% (0.7919 => 0.7778, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: -1.77% (16.1920 => 15.9059, std.dev.: 0.0304) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.68% (1.2221 => 1.2016, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (1.2210 => 1.2016, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.45% (1.0544 => 1.0391, std.dev.: 0.0054) MultiSource/Applications/JM/ldecod/ldecod: -1.37% (7.0961 => 6.9987, std.dev.: 0.0075) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (6.7716 => 6.6853, std.dev.: 0.0182) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (0.7982 => 0.7882, std.dev.: 0.0018) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5419, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/football/football: -1.22% (0.9179 => 0.9067, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -1.20% (4.3330 => 4.2810, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.01% (1.2300 => 1.2176, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.38% (1.8100 => 0.6810, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3142, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/mandel-2: -24.40% (1.3643 => 1.0314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0794, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1999, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1318, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3546, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6341, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.34% (1.3096 => 1.2659, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/oourafft: -3.31% (5.5807 => 5.3962, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.37% (7.9763 => 7.7869, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.7241 => 3.6437, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0031) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3040 => 7.1904, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.48% (1.6307 => 1.6066, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6661, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 03:44:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 05:44:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122114434.D1E962A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7835?compare_to=7833&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7835, Order: 173135, Start Time: 2013-01-22 09:42:50, End Time: 2013-01-22 11:44:50 To: 7833, Order: 173127, Start Time: 2013-01-22 06:04:50, End Time: 2013-01-22 08:02:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 9 (5 on baseline) Performance Improvements: 2 (37 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1053 (1021 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: 5.55% (0.2650 => 0.2797, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/18-imp/imp: 3.27% (0.3697 => 0.3818, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.67% (0.6948 => 0.7064, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3635 => 1.3832, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.86% (0.7670 => 0.8656, std.dev.: 0.0140) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (2.4060 => 2.4951, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/ffbench: 3.58% (1.3587 => 1.4073, std.dev.: 0.0187) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.88% (2.3766 => 2.4212, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.45% (4.9254 => 4.9967, std.dev.: 0.0164) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -16.43% (24.6748 => 20.6197, std.dev.: 1.0957) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.35% (5.0780 => 5.0097, std.dev.: 0.0091) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.94% (1.1184 => 1.1289, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.64% (0.0143 => 0.0224, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.03% (0.0366 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.27% (0.0319 => 0.0339, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0429 => 0.0433, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/casts: 0.96% (0.0208 => 0.0210, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: 11.50% (0.0200 => 0.0223, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.61% (0.0248 => 0.0252, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.28% (0.1452 => 0.1456, std.dev.: 0.0165) MultiSource/Applications/lemon/lemon: 1.16% (1.1612 => 1.1747, std.dev.: 0.3748) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.48% (0.4134 => 0.4073, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.08% (0.1493 => 0.1447, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.33% (0.0981 => 0.0994, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.62% (0.0191 => 0.0196, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.25% (0.0561 => 0.0568, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.50% (1.1426 => 1.1483, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 2500.00% (0.0001 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.33% (0.0601 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.63% (0.0319 => 0.0317, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: - (0.7401 => 0.7401, std.dev.: 0.0122) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 36.84% (0.0076 => 0.0104, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.14% (12.7425 => 12.7603, std.dev.: 0.0214) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321387.50% (0.0008 => 2.5719, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.75% (1.1825 => 2.4212, std.dev.: 0.0163) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.71% (0.2562 => 0.2862, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/pi: 2.68% (2.1390 => 2.1963, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 2.40% (6.8159 => 6.9798, std.dev.: 0.0546) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -26.59% (0.1888 => 0.1386, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.39% (0.1684 => 0.1307, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.92% (0.1009 => 0.0808, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.10% (0.0862 => 0.0706, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.82% (0.7686 => 0.6547, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.63% (1.0986 => 0.9489, std.dev.: 0.0581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -13.22% (0.0847 => 0.0735, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -11.91% (1.0220 => 0.9003, std.dev.: 0.0329) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.36% (0.0889 => 0.0788, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -10.66% (0.1079 => 0.0964, std.dev.: 0.0033) MultiSource/Applications/lua/lua: -10.17% (4.6406 => 4.1688, std.dev.: 0.1801) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.19% (10.2703 => 9.3265, std.dev.: 0.1837) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.59% (1.5131 => 1.3832, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.18% (0.7693 => 0.7064, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.88% (0.2283 => 0.2126, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.65% (0.9588 => 0.8950, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.95% (0.2100 => 0.1975, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.61% (0.2618 => 0.2471, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.45% (1.3310 => 1.2584, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.94% (1.0017 => 0.9522, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.69% (5.0381 => 4.8018, std.dev.: 0.0527) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.91% (1.2680 => 1.2184, std.dev.: 0.0150) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.87% (1.0234 => 0.9838, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: -3.85% (0.3715 => 0.3572, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.63% (0.6996 => 0.6882, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -19.97% (1.0816 => 0.8656, std.dev.: 0.0140) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.54% (1.5623 => 1.2571, std.dev.: 0.0537) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.82% (1.4235 => 1.2552, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout/hash: -8.33% (4.5259 => 4.1488, std.dev.: 0.0321) MultiSource/Benchmarks/mafft/pairlocalalign: -8.10% (63.1520 => 58.0343, std.dev.: 0.1272) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.43% (0.3217 => 0.2978, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -5.39% (2.2304 => 2.1101, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/lists: -3.11% (17.2182 => 16.6828, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1537, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.29% (1.2047 => 1.1289, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0165) MultiSource/Applications/lemon/lemon: -39.11% (1.9293 => 1.1747, std.dev.: 0.3748) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.59% (0.4049 => 0.4073, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.17% (0.1510 => 0.1447, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.99% (0.0276 => 0.0196, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.73% (0.0590 => 0.0568, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.15% (1.1617 => 1.1483, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.28% (0.0268 => 0.0317, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (0.7437 => 0.7401, std.dev.: 0.0122) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 13.04% (0.0092 => 0.0104, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (12.7781 => 12.7603, std.dev.: 0.0214) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 05:17:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 07:17:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122131710.A62702A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7836?compare_to=7834&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7836, Order: 173144, Start Time: 2013-01-22 11:43:53, End Time: 2013-01-22 13:17:24 To: 7834, Order: 173135, Start Time: 2013-01-22 09:46:09, End Time: 2013-01-22 11:20:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (102 on baseline) Performance Improvements: 1 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (889 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.05% (1.2659 => 1.2918, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.51% (1.0405 => 1.0248, std.dev.: 0.0049) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.12% (0.0514 => 0.0895, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 45.20% (0.1500 => 0.2178, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.25% (0.1132 => 0.1599, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.67% (0.6395 => 0.8740, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.84% (0.6260 => 0.8253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.84% (0.5456 => 0.7193, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.70% (0.5688 => 0.7491, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.53% (0.5849 => 0.7693, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.46% (0.5805 => 0.7631, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.74% (0.5575 => 0.7289, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 30.68% (0.5567 => 0.7275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.66% (0.5581 => 0.7292, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.51% (0.6395 => 0.8346, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 29.99% (0.5941 => 0.7723, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.18% (0.0699 => 0.0903, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.06% (0.6033 => 0.7786, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.05% (0.5859 => 0.7561, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.71% (0.6440 => 0.8289, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.03% (1.6474 => 2.1092, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.83% (0.6676 => 0.8534, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 27.66% (0.6189 => 0.7901, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.16% (0.6304 => 0.8016, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.08% (0.6230 => 0.7917, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.06% (0.5802 => 0.7314, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.87% (0.6660 => 0.8383, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.47% (0.5925 => 0.7434, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.38% (0.5705 => 0.7153, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.29% (0.5857 => 0.7338, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.14% (0.5478 => 0.6855, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.06% (0.0790 => 0.0988, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.88% (0.5570 => 0.6956, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.73% (0.5569 => 0.6946, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.45% (0.5591 => 0.6958, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.32% (0.5863 => 0.7230, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.30% (0.6446 => 0.7948, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.25% (0.6052 => 0.7459, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.05% (0.7524 => 0.9258, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.47% (0.6681 => 0.8182, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.38% (0.6194 => 0.7580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.71% (0.6297 => 0.7664, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.93% (2.2587 => 2.7315, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.50% (0.6667 => 0.8034, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.82% (0.7339 => 0.8720, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.07% (0.0621 => 0.0727) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.69% (0.0833 => 0.0972, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.89% (0.3357 => 0.3857, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.54% (1.1450 => 1.3115, std.dev.: 0.0149) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.94% (4.5069 => 5.0449, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.74% (0.4916 => 0.5493, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.58% (0.4515 => 0.5038, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.25% (0.1982 => 0.2205, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.04% (1.6364 => 1.8170, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.79% (3.5339 => 3.9153, std.dev.: 0.0062) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.00% (0.1230 => 0.1353, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.81% (0.2385 => 0.2619, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.70% (0.7021 => 0.7632, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 7.76% (0.4524 => 0.4875, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.69% (1.2515 => 1.3477, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.60% (0.5329 => 0.5734, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.16% (0.1731 => 0.1855, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.06% (0.4861 => 0.5204, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.84% (1.4642 => 1.5643, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.56% (1.2784 => 1.3622, std.dev.: 0.0077) MultiSource/Benchmarks/mafft/pairlocalalign: 6.31% (9.2283 => 9.8104, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/matrix: 5.81% (0.3255 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.61% (0.3319 => 0.3472, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.06% (5.4682 => 5.6901, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.67% (0.6750 => 0.6998, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.63% (5.0226 => 5.2047, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 2.73% (1.3864 => 1.4243, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.38% (0.8418 => 0.8618, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.93% (0.9557 => 0.9741, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.81% (0.7447 => 0.7582, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3722 => 1.3931, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.39% (15.5079 => 15.7232, std.dev.: 0.0158) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.32% (22.4056 => 22.7013, std.dev.: 0.0066) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8055, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.52% (0.9531 => 1.0248, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5865, std.dev.: 0.0533) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.40% (2.0478 => 2.1174, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6043, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (27.8210 => 28.2337, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0015) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -4.47% (2.4924 => 2.3809, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.98% (0.3821 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.96% (0.7198 => 0.6913, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.95% (0.9852 => 0.9463, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.28% (0.3323 => 0.3214, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.23% (0.3812 => 0.3689, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3848 => 0.3725, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.18% (0.3831 => 0.3709, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.14% (0.3880 => 0.3758, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.12% (0.4033 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.11% (0.3896 => 0.3775, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.03% (0.3891 => 0.3773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.99% (0.6484 => 0.6290, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -2.97% (0.4176 => 0.4052, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.96% (0.3884 => 0.3769, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -2.92% (1.3148 => 1.2764, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.87% (0.6347 => 0.6165, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.84% (0.3658 => 0.3554, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.80% (2.1713 => 2.1106, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.9542 => 0.9279, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.61% (0.6441 => 0.6273, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.48% (0.4199 => 0.4095, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.46% (20.7746 => 20.2629, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: -2.20% (17.1032 => 16.7270, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.18% (14.2083 => 13.8983, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.86% (0.7919 => 0.7772, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.75% (1.0544 => 1.0359, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1997, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.73% (1.2221 => 1.2009, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -1.65% (16.1920 => 15.9244, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.63% (6.7716 => 6.6611, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.62% (4.3330 => 4.2628, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: -1.32% (7.0961 => 7.0025, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: -1.29% (0.9179 => 0.9061, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5420, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.96% (1.8100 => 0.6886, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3115, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.61% (1.3643 => 1.0286, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7473, std.dev.: 0.0084) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0781, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1976, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1293, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3527, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1749, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.36% (3.7241 => 3.6363, std.dev.: 0.0154) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.21% (7.9763 => 7.8001, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4649, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3040 => 7.1885, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.36% (1.3096 => 1.2918, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.6086 => 1.5881, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.11% (1.6219 => 1.6039, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.08% (1.6307 => 1.6131, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 06:00:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 08:00:16 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122140016.A8E2B2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7837?compare_to=7835&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7837, Order: 173144, Start Time: 2013-01-22 12:02:57, End Time: 2013-01-22 14:00:32 To: 7835, Order: 173135, Start Time: 2013-01-22 09:42:50, End Time: 2013-01-22 11:44:50 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (7 on baseline) Performance Improvements: 16 (140 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1043 (916 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.53% (0.8758 => 0.8892, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.18% (0.9187 => 0.9295, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.42% (1.4589 => 1.8444, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.64% (6.9768 => 7.4400, std.dev.: 0.1614) MultiSource/Applications/siod/siod: 2.29% (3.5400 => 3.6211, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -10.40% (9.4550 => 8.4719, std.dev.: 0.1975) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.43% (0.2527 => 0.2415, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/18-imp/imp: -3.01% (0.3818 => 0.3703, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.27% (1.9106 => 1.8672, std.dev.: 0.0131) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.91% (0.6547 => 0.6422, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -1.25% (1.5333 => 1.5142, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.15% (14.6906 => 14.5218, std.dev.: 0.0561) MultiSource/Applications/hexxagon/hexxagon: -1.10% (1.0276 => 1.0163, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -1.06% (2.4396 => 2.4138, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (0.3609 => 0.3460, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: -3.61% (8.6393 => 8.3273, std.dev.: 0.0708) MultiSource/Applications/lua/lua: -2.79% (29.2649 => 28.4495, std.dev.: 0.1004) MultiSource/Benchmarks/Ptrdist/ft/ft: -2.58% (0.8656 => 0.8433, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: -2.42% (4.4282 => 4.3209, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: -2.19% (2.8525 => 2.7901, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: -1.30% (3.4680 => 3.4230, std.dev.: 0.0040) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.27% (1.1289 => 1.1258, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -12.50% (0.0224 => 0.0196, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0432 => 0.0434, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.29% (0.0339 => 0.0340, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0319 => 0.0321, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0433 => 0.0432, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -4.29% (0.0210 => 0.0201, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -0.90% (0.0223 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.70% (0.0252 => 0.0220, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: -46.15% (0.0013 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.99% (0.1456 => 0.1427, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -1.75% (1.1747 => 1.1542, std.dev.: 0.0015) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4073 => 0.3904, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.22% (0.1447 => 0.1508, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.21% (0.0994 => 0.0972, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 40.82% (0.0196 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.10% (0.0568 => 0.0614, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.61% (1.1483 => 1.1553, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.95% (0.0615 => 0.0603, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.63% (0.0317 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7401 => 0.7406, std.dev.: 0.0493) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -66.35% (0.0104 => 0.0035, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (12.7603 => 12.7615, std.dev.: 0.0450) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.81% (0.0336 => 0.0500, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320175.00% (0.0008 => 2.5622, std.dev.: 0.0168) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.87% (1.1825 => 2.4226, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.41% (0.2562 => 0.2803, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.26% (7.0016 => 7.4400, std.dev.: 0.1614) SingleSource/Benchmarks/Misc/pi: 2.67% (2.1390 => 2.1962, std.dev.: 0.0081) MultiSource/Applications/JM/lencod/lencod: 2.10% (6.8159 => 6.9588, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.15% (0.0727 => 0.0486, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.34% (0.0692 => 0.0489, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -26.43% (0.1888 => 0.1389, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.81% (0.1684 => 0.1283, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.30% (0.0676 => 0.0532, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -20.15% (1.8964 => 1.5142, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.03% (0.1009 => 0.0817, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.59% (0.1079 => 0.0900, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.49% (1.0960 => 0.9153, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.45% (0.7686 => 0.6422, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.34% (1.0986 => 0.9411, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -14.32% (9.8875 => 8.4719, std.dev.: 0.1975) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.77% (0.4074 => 0.3513, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -13.50% (0.2481 => 0.2146, std.dev.: 0.0085) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.96% (1.2154 => 1.0579, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: -12.72% (1.0220 => 0.8920, std.dev.: 0.0074) MultiSource/Applications/Burg/burg: -12.01% (1.5979 => 1.4060, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: -11.11% (1.1433 => 1.0163, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -10.84% (2.4719 => 2.2039, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.59% (1.3924 => 1.2449, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.44% (6.4235 => 5.7527, std.dev.: 0.0320) MultiSource/Benchmarks/Ptrdist/ft/ft: -10.34% (0.2283 => 0.2047, std.dev.: 0.0046) MultiSource/Applications/lua/lua: -10.05% (4.6406 => 4.1744, std.dev.: 0.0180) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.95% (1.5131 => 1.3625, std.dev.: 0.0135) MultiSource/Applications/aha/aha: -9.51% (0.1378 => 0.1247, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.46% (10.2703 => 9.2991, std.dev.: 0.0397) MultiSource/Applications/sgefa/sgefa: -9.06% (0.3598 => 0.3272, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -9.02% (17.5634 => 15.9798, std.dev.: 0.0369) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.96% (0.7693 => 0.7004, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: -8.78% (0.8653 => 0.7893, std.dev.: 0.0088) MultiSource/Applications/siod/siod: -8.70% (2.6437 => 2.4138, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.64% (0.2372 => 0.2167, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.35% (0.1317 => 0.1207, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -8.27% (17.4365 => 15.9938, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.21% (1.6874 => 1.5488, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.14% (0.9124 => 0.8381, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -8.08% (0.5746 => 0.5282, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.66% (1.3310 => 1.2290, std.dev.: 0.0271) MultiSource/Benchmarks/Olden/tsp/tsp: -7.52% (0.1369 => 0.1266, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.30% (0.3560 => 0.3300, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.30% (0.9588 => 0.8888, std.dev.: 0.0073) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.29% (1.1731 => 1.0876, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.27% (1.1498 => 1.0662, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/health/health: -7.27% (0.1610 => 0.1493, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -7.11% (3.7840 => 3.5148, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.61% (0.6885 => 0.6430, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.53% (0.2618 => 0.2447, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -6.47% (1.3979 => 1.3075, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.29% (0.2577 => 0.2415, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/fibo: -5.88% (0.2006 => 0.1888, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.71% (0.2100 => 0.1980, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.65% (0.2709 => 0.2556, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.58% (1.8127 => 1.7116, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.05% (4.6579 => 4.4227, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.99% (0.9550 => 0.9073, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.91% (1.0017 => 0.9525, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.3462 => 0.3292, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.82% (0.2884 => 0.2745, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.78% (0.2615 => 0.2490, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.67% (5.0381 => 4.8029, std.dev.: 0.0074) MultiSource/Applications/SIBsim4/SIBsim4: -4.66% (1.4392 => 1.3722, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.36% (3.6295 => 3.4711, std.dev.: 0.0197) MultiSource/Applications/minisat/minisat: -4.35% (0.7776 => 0.7438, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.27% (1.2680 => 1.2138, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.21% (1.0234 => 0.9803, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.15% (0.5369 => 0.5146, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/08-main/main: -3.91% (0.2915 => 0.2801, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.88% (0.9507 => 0.9138, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: -3.71% (0.3715 => 0.3577, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.42% (0.9422 => 0.9100, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.36% (0.3093 => 0.2989, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.36% (0.3394 => 0.3280, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -3.27% (16.4479 => 15.9102, std.dev.: 0.0307) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.4121 => 0.3987, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: -3.23% (18.9377 => 18.3266, std.dev.: 0.0517) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.21% (7.2721 => 7.0386, std.dev.: 0.0787) MultiSource/Benchmarks/MallocBench/gs/gs: -3.20% (4.5936 => 4.4468, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.19% (0.9788 => 0.9476, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.04% (0.8990 => 0.8717, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.03% (14.9757 => 14.5218, std.dev.: 0.0561) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.03% (0.6934 => 0.6724, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.98% (0.9091 => 0.8820, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.85% (0.9214 => 0.8951, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.73% (4.8904 => 4.7567, std.dev.: 0.0334) MultiSource/Benchmarks/McCat/18-imp/imp: -2.73% (0.3807 => 0.3703, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.62% (0.9993 => 0.9731, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.57% (0.9127 => 0.8892, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.44% (0.6996 => 0.6825, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.32% (0.9405 => 0.9187, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -2.23% (7.3529 => 7.1888, std.dev.: 0.0090) MultiSource/Applications/JM/lencod/lencod: -1.95% (16.7012 => 16.3762, std.dev.: 0.0334) MultiSource/Applications/oggenc/oggenc: -1.85% (5.3553 => 5.2560, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.80% (0.7225 => 0.7095, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.76% (1.0088 => 0.9910, std.dev.: 0.0062) MultiSource/Benchmarks/nbench/nbench: -1.71% (1.2708 => 1.2491, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.55% (1.0119 => 0.9962, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.52% (2.4519 => 2.4146, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.39% (0.9685 => 0.9550, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.15% (0.9403 => 0.9295, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.34% (0.9372 => 0.6529, std.dev.: 0.0063) MultiSource/Applications/minisat/minisat: -22.38% (7.9891 => 6.2011, std.dev.: 0.0436) MultiSource/Benchmarks/Ptrdist/ft/ft: -22.03% (1.0816 => 0.8433, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.78% (1.5623 => 1.2533, std.dev.: 0.0212) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.76% (0.1164 => 0.0934, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.49% (1.4235 => 1.2599, std.dev.: 0.0226) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.89% (2.8778 => 2.5643, std.dev.: 0.0179) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.14% (0.4081 => 0.3667, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/lists1: -9.76% (0.6628 => 0.5981, std.dev.: 0.0181) SingleSource/Benchmarks/Shootout/hash: -9.72% (4.5259 => 4.0858, std.dev.: 0.1696) SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.97% (5.0421 => 4.5898, std.dev.: 0.0634) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.63% (23.3986 => 21.3784, std.dev.: 0.3499) MultiSource/Benchmarks/mafft/pairlocalalign: -8.15% (63.1520 => 58.0029, std.dev.: 0.1224) MultiSource/Applications/SPASS/SPASS: -8.14% (9.0650 => 8.3273, std.dev.: 0.0708) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.40% (0.3217 => 0.2979, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: -6.98% (0.1704 => 0.1585, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.57% (1.4588 => 1.3630, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: -6.05% (0.3654 => 0.3433, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.97% (0.3201 => 0.3042, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.16% (1.4446 => 1.3845, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (0.3609 => 0.3460, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.03% (46.0987 => 44.2406, std.dev.: 0.1074) MultiSource/Applications/SIBsim4/SIBsim4: -3.42% (3.5443 => 3.4230, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -3.40% (4.4730 => 4.3209, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.37% (0.3349 => 0.3236, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.14% (0.3406 => 0.3299, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -2.73% (17.2182 => 16.7485, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.45% (0.5826 => 0.5683, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.43% (3.0082 => 2.9351, std.dev.: 0.0084) MultiSource/Applications/spiff/spiff: -2.35% (2.8571 => 2.7901, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/five11/five11: -2.25% (5.7021 => 5.5737, std.dev.: 0.0307) MultiSource/Applications/lua/lua: -2.01% (29.0327 => 28.4495, std.dev.: 0.1004) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.79% (3.7662 => 3.6986, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.2040 => 7.0784, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -1.31% (8.7416 => 8.6267, std.dev.: 0.0292) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3171, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout/matrix: -1.21% (1.5825 => 1.5633, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: -1.05% (2.9083 => 2.8778, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.03% (5.9063 => 5.8454, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.02% (1.8634 => 1.8444, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.55% (1.2047 => 1.1258, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -15.88% (0.0233 => 0.0196, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -5.63% (0.0213 => 0.0201, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.73% (0.0255 => 0.0220, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: -53.33% (0.0015 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.73% (0.1530 => 0.1427, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -40.18% (1.9293 => 1.1542, std.dev.: 0.0015) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.58% (0.4049 => 0.3904, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.13% (0.1510 => 0.1508, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.61% (0.0978 => 0.0972, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.07% (0.0590 => 0.0614, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.55% (1.1617 => 1.1553, std.dev.: 0.0208) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0610 => 0.0603, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0493) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -61.96% (0.0092 => 0.0035, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7781 => 12.7615, std.dev.: 0.0450) Report Time: 0.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 13:21:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 15:21:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122212141.AA1BC2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7838?compare_to=7836&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7838, Order: 173182, Start Time: 2013-01-22 19:48:22, End Time: 2013-01-22 21:21:55 To: 7836, Order: 173144, Start Time: 2013-01-22 11:43:53, End Time: 2013-01-22 13:17:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (109 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.84% (0.0974 => 0.1625, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.43% (0.1132 => 0.1601, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.20% (0.6395 => 0.8774, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.15% (0.5456 => 0.7210, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.12% (0.5688 => 0.7515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.06% (0.5805 => 0.7666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.03% (0.6260 => 0.8265, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.77% (0.5849 => 0.7707, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.20% (0.5581 => 0.7322, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.19% (0.5575 => 0.7314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.13% (0.6395 => 0.8386, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.37% (0.5941 => 0.7745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.66% (0.5859 => 0.7597, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.45% (0.6033 => 0.7810, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.33% (0.0699 => 0.0904, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.94% (0.6440 => 0.8304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.43% (0.6676 => 0.8574, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.10% (1.6474 => 2.1104, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.68% (0.6304 => 0.8049, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.21% (0.6230 => 0.7925, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.30% (0.5802 => 0.7328, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.19% (0.6660 => 0.8404, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.85% (0.5705 => 0.7180, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.79% (0.5925 => 0.7453, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.56% (0.5857 => 0.7354, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.39% (0.5478 => 0.6869, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.31% (0.5570 => 0.6980, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.00% (0.5569 => 0.6961, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.74% (0.5591 => 0.6974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.83% (0.5863 => 0.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.52% (0.6446 => 0.7962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.40% (0.6052 => 0.7468, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.81% (0.6681 => 0.8205, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.42% (0.6194 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 21.95% (0.6297 => 0.7679, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.26% (2.2587 => 2.7390, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.91% (0.6667 => 0.8061, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.06% (0.7339 => 0.8738, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.07% (0.0621 => 0.0727, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.74% (1.1450 => 1.3138, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 12.18% (0.4515 => 0.5065, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.10% (0.4916 => 0.5511, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.01% (4.5069 => 5.0484, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.42% (3.5339 => 3.9373, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.06% (1.6364 => 1.8174, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.00% (0.1982 => 0.2200, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.90% (0.2385 => 0.2621, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.7021 => 0.7638, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.88% (0.5329 => 0.5749, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 7.78% (1.2515 => 1.3489, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 7.38% (0.4524 => 0.4858, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.11% (0.1731 => 0.1854, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.95% (1.4642 => 1.5660, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.85% (0.4861 => 0.5194, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.76% (1.2784 => 1.3648, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 6.57% (9.2283 => 9.8343, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.3255 => 0.3437, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.64% (0.3319 => 0.3473, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.78% (5.0226 => 5.2127, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.56% (5.4682 => 5.6631, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.6750 => 0.6984, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.13% (1.3864 => 1.4298, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.34% (0.8418 => 0.8615, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.92% (0.7447 => 0.7590, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.9557 => 0.9735, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.67% (1.3722 => 1.3951, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.65% (22.4056 => 22.7755, std.dev.: 0.0117) MultiSource/Applications/SPASS/SPASS: 1.51% (15.5079 => 15.7425, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8169, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1484, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.46% (54.5751 => 56.4611, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0063) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6059, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8210 => 28.2349, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2688, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4559, std.dev.: 0.0180) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.34% (0.1431 => 0.1326, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -5.32% (0.3194 => 0.3024, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.75% (2.4924 => 2.3740, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/trivial-interface: -4.38% (0.3812 => 0.3645, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.33% (0.3837 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3884 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.21% (0.3848 => 0.3686, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.20% (0.2428 => 0.2326, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.18% (0.3880 => 0.3718, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.4033 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.13% (0.3896 => 0.3735, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.11% (0.3891 => 0.3731, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.10% (0.3831 => 0.3674, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.98% (0.3821 => 0.3669, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.96% (0.7198 => 0.6913, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.4176 => 0.4012, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.77% (0.9852 => 0.9481, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.76% (0.3323 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.56% (0.3142 => 0.3030, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -3.55% (0.4199 => 0.4050, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -3.29% (0.4280 => 0.4139, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.24% (0.3205 => 0.3101, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.14% (0.6347 => 0.6148, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.07% (1.3148 => 1.2744, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.05% (2.1713 => 2.1050, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference-object: -2.84% (0.6441 => 0.6258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.79% (0.3658 => 0.3556, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.70% (0.6484 => 0.6309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.66% (0.7779 => 0.7572, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.58% (0.4151 => 0.4044, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.10% (0.9542 => 0.9342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.07% (0.7919 => 0.7755, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.00% (14.2083 => 13.9235, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -1.94% (20.7746 => 20.3712, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -1.87% (17.1032 => 16.7836, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.79% (1.2221 => 1.2002, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.74% (1.2210 => 1.1998, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -1.72% (4.3330 => 4.2583, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.71% (6.7716 => 6.6558, std.dev.: 0.0088) MultiSource/Applications/JM/lencod/lencod: -1.51% (16.1920 => 15.9482, std.dev.: 0.0182) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.47% (1.0544 => 1.0389, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.23% (1.2300 => 1.2149, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.23% (7.0961 => 7.0090, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/football/football: -1.12% (0.9179 => 0.9076, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.05% (2.4021 => 2.3769, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.78% (1.8100 => 0.6917, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3128, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel-2: -24.42% (1.3643 => 1.0311, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7520, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0863, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1982, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1272, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3561, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.84% (3.7241 => 3.6183, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (7.9763 => 7.7795, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.15% (1.3096 => 1.2815, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1882, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6089, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7092 => 3.6619, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6048, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 13:51:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 15:51:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130122215133.C5CA92A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7839?compare_to=7837&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7839, Order: 173182, Start Time: 2013-01-22 19:46:25, End Time: 2013-01-22 21:51:48 To: 7837, Order: 173144, Start Time: 2013-01-22 12:02:57, End Time: 2013-01-22 14:00:32 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (8 on baseline) Performance Improvements: 0 (25 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1046 (1030 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 11.67% (1.0163 => 1.1349, std.dev.: 0.0330) MultiSource/Applications/sqlite3/sqlite3: 10.03% (15.9798 => 17.5818, std.dev.: 0.1174) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.34% (1.7116 => 1.8715, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.30% (3.4711 => 3.7592, std.dev.: 0.0073) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.24% (23.6639 => 25.3770, std.dev.: 0.5728) MultiSource/Applications/lemon/lemon: 5.97% (1.3075 => 1.3856, std.dev.: 0.0145) MultiSource/Applications/d/make_dparser: 5.42% (3.5148 => 3.7053, std.dev.: 0.0135) MultiSource/Applications/SIBsim4/SIBsim4: 1.36% (1.3722 => 1.3908, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 29.80% (3.4012 => 4.4148, std.dev.: 0.1130) MultiSource/Applications/JM/ldecod/ldecod: 19.83% (0.0585 => 0.0701, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.80% (5.5136 => 6.0542, std.dev.: 0.1209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 7.33% (21.3784 => 22.9463, std.dev.: 0.0625) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.90% (41.2611 => 43.6962, std.dev.: 0.1898) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.37% (3.6986 => 3.8971, std.dev.: 0.0574) SingleSource/Benchmarks/BenchmarkGame/recursive: 4.58% (2.3873 => 2.4967, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/ffbench: 3.34% (1.3665 => 1.4121, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.24% (4.2496 => 4.3024, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.20% (5.8454 => 5.9155, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.52% (1.1258 => 1.1317, std.dev.: 0.1615) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 14.80% (0.0196 => 0.0225, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.38% (0.0434 => 0.0440, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.88% (0.0340 => 0.0343, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.93% (0.0321 => 0.0324, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/casts: 3.48% (0.0201 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0221 => 0.0223, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 15.00% (0.0220 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 7.99% (0.1427 => 0.1541, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 17.02% (1.1542 => 1.3506, std.dev.: 0.2053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.90% (0.3904 => 0.3939, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.97% (0.1508 => 0.1433, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.47% (0.0972 => 0.0996, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.56% (0.0614 => 0.0586, std.dev.: 0.0140) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.50% (1.1553 => 1.1495, std.dev.: 0.0995) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0603 => 0.0603, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.76% (0.0319 => 0.0307, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.45% (0.7406 => 0.7439, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 140.00% (0.0035 => 0.0084, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7615 => 12.7728, std.dev.: 0.0096) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.59% (23.5861 => 25.3770, std.dev.: 0.5728) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.57% (3.6295 => 3.7592, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.24% (1.8127 => 1.8715, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321162.50% (0.0008 => 2.5701, std.dev.: 0.0440) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.26% (1.1825 => 2.4035, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.05% (5.6033 => 6.0542, std.dev.: 0.1209) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.25% (42.3194 => 43.6962, std.dev.: 0.1898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.12% (11.5523 => 11.6813, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -25.43% (0.0692 => 0.0516, std.dev.: 0.0019) SingleSource/Benchmarks/SmallPT/smallpt: -24.05% (0.1888 => 0.1434, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.95% (0.1009 => 0.0838, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.54% (1.0986 => 0.9498, std.dev.: 0.0231) MultiSource/Applications/Burg/burg: -10.39% (1.5979 => 1.4319, std.dev.: 0.0504) MultiSource/Applications/sgefa/sgefa: -7.34% (0.3598 => 0.3334, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -6.96% (2.6437 => 2.4597, std.dev.: 0.0589) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.53% (4.6579 => 4.4934, std.dev.: 0.0545) MultiSource/Applications/SIBsim4/SIBsim4: -3.36% (1.4392 => 1.3908, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: -2.87% (0.4002 => 0.3887, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: -2.08% (3.7840 => 3.7053, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.23% (1.4235 => 1.2637, std.dev.: 0.0319) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.81% (0.4081 => 0.3640, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -9.17% (4.5259 => 4.1110, std.dev.: 0.1547) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.84% (1.4588 => 1.3298, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -8.01% (63.1520 => 58.0937, std.dev.: 0.2227) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.3217 => 0.2970, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: -6.13% (0.3654 => 0.3430, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.21% (2.5170 => 2.4111, std.dev.: 0.0370) MultiSource/Applications/SIBsim4/SIBsim4: -3.04% (3.5443 => 3.4364, std.dev.: 0.0298) MultiSource/Applications/spiff/spiff: -1.94% (2.8571 => 2.8017, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.93% (23.3986 => 22.9463, std.dev.: 0.0625) SingleSource/Benchmarks/Shootout-C++/methcall: -1.21% (8.7416 => 8.6362, std.dev.: 0.0294) SingleSource/Benchmarks/SmallPT/smallpt: -1.06% (14.9448 => 14.7857, std.dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.06% (1.2047 => 1.1317, std.dev.: 0.1615) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.44% (0.0451 => 0.0440, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.94% (0.0394 => 0.0343, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.22% (0.0328 => 0.0324, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0072) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.72% (0.1530 => 0.1541, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -30.00% (1.9293 => 1.3506, std.dev.: 0.2053) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.72% (0.4049 => 0.3939, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.10% (0.1510 => 0.1433, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.84% (0.0978 => 0.0996, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.68% (0.0590 => 0.0586, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.05% (1.1617 => 1.1495, std.dev.: 0.0995) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0610 => 0.0603, std.dev.: 0.0114) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.55% (0.0268 => 0.0307, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.03% (0.7437 => 0.7439, std.dev.: 0.0052) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.70% (0.0092 => 0.0084, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7781 => 12.7728, std.dev.: 0.0096) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 15:19:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 17:19:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130122231900.2BB3E2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7840?compare_to=7838&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7840, Order: 173195, Start Time: 2013-01-22 21:45:26, End Time: 2013-01-22 23:19:04 To: 7838, Order: 173182, Start Time: 2013-01-22 19:48:22, End Time: 2013-01-22 21:21:55 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (105 on baseline) Performance Improvements: 0 (114 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (873 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.71% (3.6183 => 3.6801, std.dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.25% (0.0974 => 0.1629, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.17% (0.6395 => 0.8772, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.12% (0.5688 => 0.7515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.04% (0.6260 => 0.8266, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.92% (0.5805 => 0.7658, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.83% (0.5849 => 0.7711, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.58% (0.5567 => 0.7325, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.30% (0.5581 => 0.7328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.25% (0.5575 => 0.7317, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.07% (0.6395 => 0.8382, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.42% (0.5941 => 0.7748, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.92% (0.5859 => 0.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.59% (0.6033 => 0.7818, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.35% (1.6474 => 2.1144, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.26% (0.6189 => 0.7938, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.62% (0.6304 => 0.8045, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.40% (0.6230 => 0.7937, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.32% (0.5802 => 0.7329, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.25% (0.6660 => 0.8408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.92% (0.5925 => 0.7461, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.82% (0.0790 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.77% (0.5705 => 0.7175, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.53% (0.5857 => 0.7352, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.42% (0.5570 => 0.6986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.39% (0.5478 => 0.6869, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.09% (0.5569 => 0.6966, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.90% (0.5591 => 0.6983, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.81% (0.5863 => 0.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.69% (0.6446 => 0.7973, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.40% (0.6052 => 0.7468, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.78% (0.6681 => 0.8203, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.47% (0.6194 => 0.7586, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.25% (0.6297 => 0.7698, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.25% (2.2587 => 2.7387, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.04% (0.6667 => 0.8070, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.13% (0.7339 => 0.8743, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.76% (1.1450 => 1.3140, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 13.33% (0.4515 => 0.5117, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.97% (4.5069 => 5.0463, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.41% (3.5339 => 3.9371, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.07% (1.6364 => 1.8175, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.85% (0.2385 => 0.2620, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.84% (0.1230 => 0.1351, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.25% (0.2001 => 0.2166, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 7.80% (1.2515 => 1.3491, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.69% (0.5329 => 0.5739, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.23% (0.4524 => 0.4851, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.01% (1.4642 => 1.5669, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.99% (0.1731 => 0.1852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 6.79% (0.4861 => 0.5191, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.68% (1.2784 => 1.3638, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.61% (9.2283 => 9.8387, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.58% (0.3319 => 0.3471, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 4.00% (5.0226 => 5.2234, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.53% (5.4682 => 5.6612, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 3.27% (0.6750 => 0.6971, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.92% (1.3864 => 1.4269, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: 2.04% (0.8418 => 0.8590, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 1.96% (0.7447 => 0.7593, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.76% (0.9557 => 0.9725, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3722 => 1.3954, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.58% (22.4056 => 22.7590, std.dev.: 0.0305) MultiSource/Applications/SPASS/SPASS: 1.56% (15.5079 => 15.7491, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7939, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9531 => 1.0278, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.88% (54.5751 => 56.6925, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0101) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6058, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8210 => 28.2350, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: 1.00% (7.4937 => 7.5688, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -5.09% (2.4924 => 2.3655, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.51% (0.3837 => 0.3664, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.45% (0.7198 => 0.6878, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.20% (0.2428 => 0.2326, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.88% (0.3812 => 0.3664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.87% (0.2871 => 0.2760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.86% (0.3831 => 0.3683, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.85% (0.3848 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.82% (0.3323 => 0.3196, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3896 => 0.3749, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.74% (0.4033 => 0.3882, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.73% (0.3891 => 0.3746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: -3.72% (0.2849 => 0.2743, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.69% (0.2903 => 0.2796, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.63% (0.3142 => 0.3028, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.61% (0.9852 => 0.9496, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: -3.59% (0.3205 => 0.3090, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.58% (0.3016 => 0.2908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.58% (0.2933 => 0.2828, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.54% (0.4176 => 0.4028, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -3.47% (0.3025 => 0.2920, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: -3.47% (0.3059 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: -3.40% (0.2939 => 0.2839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.37% (0.3026 => 0.2924, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.32% (0.6347 => 0.6136, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.27% (0.3884 => 0.3757, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -3.23% (1.3148 => 1.2723, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.17% (0.4199 => 0.4066, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.09% (0.6441 => 0.6242, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.06% (2.1713 => 2.1049, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.84% (0.4151 => 0.4033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.83% (0.4280 => 0.4159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.82% (0.7779 => 0.7560, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.70% (0.6484 => 0.6309, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.26% (20.7746 => 20.3059, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.08% (0.9542 => 0.9344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.00% (0.7919 => 0.7761, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9258, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: -1.85% (17.1032 => 16.7872, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/gs/gs: -1.71% (4.3330 => 4.2588, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -1.59% (0.7982 => 0.7855, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (1.2210 => 1.2016, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.57% (1.0544 => 1.0378, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.52% (6.7716 => 6.6689, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.51% (1.2221 => 1.2036, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -1.49% (16.1920 => 15.9503, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.25% (1.2300 => 1.2146, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -1.09% (7.0961 => 7.0187, std.dev.: 0.0081) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.15% (1.8100 => 0.7031, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.00% (1.3643 => 1.0232, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7558, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0784, std.dev.: 0.0382) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.83% (5.3397 => 4.1738, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1313, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3552, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1791, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7811, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4745, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6102, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/ary3: -1.18% (3.7241 => 3.6801, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.00% (1.6219 => 1.6056, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 16:13:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 18:13:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123001338.C97AE2A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7841?compare_to=7839&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7841, Order: 173198, Start Time: 2013-01-22 22:12:50, End Time: 2013-01-23 00:13:53 To: 7839, Order: 173182, Start Time: 2013-01-22 19:46:25, End Time: 2013-01-22 21:51:48 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (6 on baseline) Performance Improvements: 9 (42 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1052 (1015 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (4.2341 => 4.3719, std.dev.: 0.0428) SingleSource/Benchmarks/Linpack/linpack-pc: 2.70% (49.4880 => 50.8242, std.dev.: 0.0709) SingleSource/Benchmarks/Misc/pi: 1.30% (2.1785 => 2.2068, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -10.93% (1.1349 => 1.0109, std.dev.: 0.0247) MultiSource/Benchmarks/7zip/7zip-benchmark: -6.80% (47.7599 => 44.5144, std.dev.: 0.3016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.16% (1.3781 => 1.3483, std.dev.: 0.0090) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/lua/lua: -5.92% (30.2570 => 28.4644, std.dev.: 0.5707) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.36% (43.6962 => 41.3524, std.dev.: 0.5743) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.87% (3.8971 => 3.7075, std.dev.: 0.0713) MultiSource/Applications/SPASS/SPASS: -3.44% (8.8617 => 8.5572, std.dev.: 0.0512) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.81% (4.4439 => 4.3635, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6124 => 1.5888, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.56% (1.1317 => 1.1254, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0225 => 0.0225, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.36% (0.0440 => 0.0434, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.46% (0.0343 => 0.0338, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0324 => 0.0322, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0430 => 0.0434, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/casts: 0.96% (0.0208 => 0.0210, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0223 => 0.0223, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0253 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.88% (0.1541 => 0.1435, std.dev.: 0.0256) MultiSource/Applications/lemon/lemon: -16.17% (1.3506 => 1.1322, std.dev.: 0.2645) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.10% (0.3939 => 0.3935, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.03% (0.1433 => 0.1548, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0996 => 0.0994, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.53% (0.0586 => 0.0536, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.1495 => 1.1511, std.dev.: 0.0899) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.66% (0.0603 => 0.0613, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.95% (0.0307 => 0.0313, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7439 => 0.7408, std.dev.: 0.0256) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -29.76% (0.0084 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7728 => 12.7621, std.dev.: 0.0444) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 47.32% (0.0336 => 0.0495, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322437.50% (0.0008 => 2.5803, std.dev.: 0.0276) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.99% (1.1825 => 2.3885, std.dev.: 0.0291) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.44% (0.2562 => 0.2855, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.92% (4.1668 => 4.3719, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/pi: 3.17% (2.1390 => 2.2068, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.24% (0.0808 => 0.0499, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.32% (0.0692 => 0.0496, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.34% (0.1684 => 0.1291, std.dev.: 0.0139) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.12% (0.1009 => 0.0806, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.61% (0.1079 => 0.0889, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.52% (0.0862 => 0.0711, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.11% (1.0960 => 0.9085, std.dev.: 0.0612) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.11% (0.4074 => 0.3499, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.49% (1.0986 => 0.9504, std.dev.: 0.0208) MultiSource/Applications/hexxagon/hexxagon: -11.58% (1.1433 => 1.0109, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.89% (1.5131 => 1.3483, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.83% (0.7693 => 0.6860, std.dev.: 0.0109) MultiSource/Applications/lua/lua: -10.39% (4.6406 => 4.1583, std.dev.: 0.1499) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.70% (1.1498 => 1.0383, std.dev.: 0.0433) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.57% (1.6874 => 1.5259, std.dev.: 0.0448) MultiSource/Applications/sgefa/sgefa: -9.37% (0.3598 => 0.3261, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/health/health: -6.58% (0.1610 => 0.1504, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.56% (0.9588 => 0.8959, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/fibo: -6.33% (0.2006 => 0.1879, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: -4.87% (0.3715 => 0.3534, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -4.35% (0.2577 => 0.2465, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.33% (1.0234 => 0.9791, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.34% (1.3220 => 1.2779, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.12% (0.9372 => 0.6455, std.dev.: 0.0249) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.39% (1.5623 => 1.2593, std.dev.: 0.0306) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.32% (0.1164 => 0.1009, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.96% (1.4235 => 1.2533, std.dev.: 0.0246) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.12% (0.4081 => 0.3668, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/nestedloop: -9.55% (0.2200 => 0.1990, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: -7.82% (63.1520 => 58.2135, std.dev.: 0.4386) MultiSource/Benchmarks/Olden/health/health: -6.49% (0.3654 => 0.3417, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.61% (0.3349 => 0.3161, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: -5.60% (9.0650 => 8.5572, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.46% (2.5170 => 2.4047, std.dev.: 0.0335) MultiSource/Applications/SIBsim4/SIBsim4: -3.69% (3.5443 => 3.4135, std.dev.: 0.0465) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.56% (40.4729 => 39.0308, std.dev.: 0.5230) SingleSource/Benchmarks/Shootout-C++/lists: -3.25% (17.2182 => 16.6594, std.dev.: 0.0856) SingleSource/Benchmarks/Misc/mandel-2: -1.53% (0.8521 => 0.8391, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -1.41% (1.5825 => 1.5602, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.20% (3.1921 => 3.1537, std.dev.: 0.0053) SingleSource/Benchmarks/SmallPT/smallpt: -1.15% (14.9448 => 14.7722, std.dev.: 0.0305) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.58% (1.2047 => 1.1254, std.dev.: 0.0481) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -6.21% (0.1530 => 0.1435, std.dev.: 0.0256) MultiSource/Applications/lemon/lemon: -41.32% (1.9293 => 1.1322, std.dev.: 0.2645) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.82% (0.4049 => 0.3935, std.dev.: 0.0394) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.52% (0.1510 => 0.1548, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.64% (0.0978 => 0.0994, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.15% (0.0590 => 0.0536, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.91% (1.1617 => 1.1511, std.dev.: 0.0899) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.79% (0.0268 => 0.0313, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.39% (0.7437 => 0.7408, std.dev.: 0.0256) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -35.87% (0.0092 => 0.0059, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.13% (12.7781 => 12.7621, std.dev.: 0.0444) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 17:16:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 19:16:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123011600.6FA152A6C068@llvm.org> http://llvm.org/perf/db_default/v4/nts/7842?compare_to=7840&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7842, Order: 173204, Start Time: 2013-01-22 23:42:36, End Time: 2013-01-23 01:16:13 To: 7840, Order: 173195, Start Time: 2013-01-22 21:45:26, End Time: 2013-01-22 23:19:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (113 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (874 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.29% (0.6395 => 0.8780, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.35% (0.5688 => 0.7528, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.28% (0.5805 => 0.7679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.25% (0.6260 => 0.8279, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.98% (0.5456 => 0.7201, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.77% (0.5849 => 0.7707, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.49% (0.5567 => 0.7320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.34% (0.5575 => 0.7322, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.96% (0.6395 => 0.8375, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.33% (0.5941 => 0.7743, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.71% (0.5859 => 0.7600, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.69% (0.6033 => 0.7824, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.47% (0.0699 => 0.0905, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.05% (0.6440 => 0.8311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.24% (0.6676 => 0.8561, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.21% (1.6474 => 2.1121, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.34% (0.6230 => 0.7933, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.37% (0.5802 => 0.7332, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.14% (0.6660 => 0.8401, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.92% (0.5705 => 0.7184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.76% (0.5925 => 0.7451, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.68% (0.5857 => 0.7361, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.34% (0.5478 => 0.6866, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.21% (0.5570 => 0.6974, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.14% (0.5569 => 0.6969, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.81% (0.5591 => 0.6978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.67% (0.5863 => 0.7251, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.46% (0.7524 => 0.9289, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.38% (0.6446 => 0.7953, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.23% (0.6052 => 0.7458, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.74% (0.6681 => 0.8200, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.47% (0.6194 => 0.7586, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.20% (0.6297 => 0.7695, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.26% (2.2587 => 2.7388, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.12% (0.6667 => 0.8075, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.17% (0.7339 => 0.8746, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.85% (1.1450 => 1.3150, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.23% (0.4916 => 0.5517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.09% (4.5069 => 5.0520, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.81% (0.4515 => 0.5048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.59% (3.5339 => 3.9436, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.55% (0.1982 => 0.2211, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.38% (1.6364 => 1.8226, std.dev.: 0.0070) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1230 => 0.1363) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.09% (1.2515 => 1.3527, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.90% (0.5329 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.47% (0.4524 => 0.4862, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.45% (0.1731 => 0.1860, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.00% (1.2784 => 1.3679, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.00% (1.4642 => 1.5667, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 6.75% (9.2283 => 9.8512, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: 6.52% (0.4861 => 0.5178, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 4.85% (0.3255 => 0.3413, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.73% (0.3319 => 0.3476, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.35% (5.4682 => 5.7061, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 4.01% (5.0226 => 5.2241, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.23% (0.6750 => 0.6968, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.80% (1.3864 => 1.4252, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.27% (0.8418 => 0.8609, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 2.19% (0.7447 => 0.7610, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (22.4056 => 22.8890, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.82% (1.3722 => 1.3972, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.80% (0.9557 => 0.9729, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 1.69% (15.5079 => 15.7700, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8188, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.34% (54.5751 => 56.3996, std.dev.: 0.1644) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1073, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.50% (27.8210 => 28.2379, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2699, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.11% (3.6551 => 3.6957, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -6.04% (0.3194 => 0.3001, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.72% (0.3837 => 0.3656, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -4.49% (0.2871 => 0.2742, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.48% (0.3323 => 0.3174, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.26% (2.4924 => 2.3863, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.22% (0.3057 => 0.2928, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/heapsort: -4.21% (0.3016 => 0.2889, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.20% (0.2903 => 0.2781, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hello: -4.18% (0.2849 => 0.2730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.12% (0.3812 => 0.3655, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: -4.09% (0.2933 => 0.2813, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.07% (0.3880 => 0.3722, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.06% (0.3205 => 0.3075, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions-2: -4.02% (0.3831 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.02% (0.7198 => 0.6909, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3848 => 0.3694, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: -3.96% (0.3059 => 0.2938, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.95% (0.3896 => 0.3742, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: -3.95% (0.2939 => 0.2823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -3.90% (0.3025 => 0.2907, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -3.90% (0.3026 => 0.2908, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.71% (2.1713 => 2.0907, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.66% (0.3252 => 0.3133, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.64% (0.4176 => 0.4024, std.dev.: 0.0029) MultiSource/Applications/hexxagon/hexxagon: -3.64% (1.3148 => 1.2670, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.62% (0.9852 => 0.9495, std.dev.: 0.0050) SingleSource/UnitTests/ObjC++/Hello: -3.61% (0.6347 => 0.6118, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.35% (0.3884 => 0.3754, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: -3.35% (0.2989 => 0.2889, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -3.32% (0.6441 => 0.6227, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.24% (0.4199 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.19% (0.7779 => 0.7531, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.08% (0.4151 => 0.4023, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.04% (0.4280 => 0.4150, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (0.3621 => 0.3519, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.59% (0.6484 => 0.6316, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -2.55% (0.4321 => 0.4211, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.46% (0.9542 => 0.9307, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (14.2083 => 13.9297, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.81% (0.7919 => 0.7776, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: -1.75% (17.1032 => 16.8031, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (6.7716 => 6.6593, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.57% (1.2210 => 1.2018, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.46% (1.2221 => 1.2042, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.45% (1.0544 => 1.0391, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: -1.44% (4.3330 => 4.2704, std.dev.: 0.0073) MultiSource/Applications/JM/lencod/lencod: -1.38% (16.1920 => 15.9690, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -1.35% (20.7746 => 20.4934, std.dev.: 0.0100) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0137, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.06% (1.2300 => 1.2170, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.96% (1.8100 => 0.7066, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1681) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3114, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.29% (4.3504 => 3.2500, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0290, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7585, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0833, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1299, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.67% (4.2493 => 3.6683, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3550, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1770, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (7.9763 => 7.7789, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -1.97% (3.7241 => 3.6509, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.61% (1.6219 => 1.5958, std.dev.: 0.0086) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1876, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4750, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.49% (2.3169 => 2.2823, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.02% (1.6086 => 1.5922, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 17:34:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 19:34:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123013410.1328A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7843?compare_to=7804&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7843, Order: 173203, Start Time: 2013-01-22 23:23:00, End Time: 2013-01-23 01:34:22 To: 7804, Order: 172987, Start Time: 2013-01-20 20:01:08, End Time: 2013-01-20 22:12:32 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (217 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.36% (10.8856 => 11.1423, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.14% (80.1087 => 81.8241, std.dev.: 0.1395) SingleSource/Benchmarks/McGill/chomp: 1.20% (1.1512 => 1.1650, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ClamAV/clamscan: -1.12% (55.3276 => 54.7101, std.dev.: 0.0561) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0655 => 0.0655, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 0.04% (499.6675 => 499.8504, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44224.77% (1.1277 => 499.8504, std.dev.: 0.0033) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.48% (0.5229 => 1.6444, std.dev.: 0.0149) MultiSource/Applications/SPASS/SPASS: 20.50% (14.9895 => 18.0629, std.dev.: 0.0292) MultiSource/Applications/kimwitu++/kc: 43.54% (14.1553 => 20.3180, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 17.75% (4.1105 => 4.8403, std.dev.: 0.0277) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.92% (1.1048 => 1.7337, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.57% (7.1582 => 37.5501, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.63% (3.4629 => 6.4281, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.78% (0.6222 => 1.0875, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10275.42% (0.0720 => 7.4703, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11166800.00% (0.0001 => 11.1669, std.dev.: 0.0064) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482600.00% (0.0001 => 5.4827, std.dev.: 0.0076) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.80% (1.1194 => 10.2403, std.dev.: 0.0103) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 146.71% (22.1758 => 54.7101, std.dev.: 0.0561) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.43% (0.1463 => 0.2508, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.92% (2.9384 => 4.6110, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.38% (7.0540 => 10.8194, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.30% (1.5859 => 2.3994, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/distray/distray: 48.48% (0.1056 => 0.1568, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.66% (8.1363 => 11.9331, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.45% (2.2024 => 3.1154, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 39.37% (0.3109 => 0.4333, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 39.05% (21.9371 => 30.5036, std.dev.: 0.0305) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0012) SingleSource/UnitTests/vla: 36.90% (0.0355 => 0.0486) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.99% (4.2646 => 5.6716, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.76% (0.4615 => 0.6127, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.21% (1.5415 => 2.0380, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 29.17% (0.4299 => 0.5553, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 29.14% (1.1642 => 1.5035, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.85% (0.6675 => 0.8601, std.dev.: 0.0048) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.38% (0.5105 => 0.6503, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.11% (0.1892 => 0.2386, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.84% (0.2554 => 0.3214, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.65% (3.8922 => 4.8906, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 24.01% (1.0722 => 1.3296, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.95% (0.1566 => 0.1941, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 23.88% (0.1143 => 0.1416, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash: 23.85% (0.4289 => 0.5312, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.80% (1.4186 => 1.7562, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.30% (0.1695 => 0.2090, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 23.29% (0.4620 => 0.5696, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.47% (0.0730 => 0.0894, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 22.45% (9.4845 => 11.6138, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 22.23% (0.7115 => 0.8697, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.80% (0.1555 => 0.1894, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.52% (0.2700 => 0.3281, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.19% (0.1029 => 0.1247, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 21.17% (0.3098 => 0.3754, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.52% (1.3050 => 1.5728, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/bigfib: 20.49% (0.6456 => 0.7779, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.42% (0.7835 => 0.9435, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 20.17% (5.7591 => 6.9205, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 20.00% (0.1695 => 0.2034, std.dev.: 0.0027) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.64% (0.5860 => 0.7011, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.46% (4.9449 => 5.9073, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.41% (0.8172 => 0.9758, std.dev.: 0.0174) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.23% (0.1940 => 0.2313, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 18.71% (3.3354 => 3.9594, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.63% (0.3307 => 0.3923, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.61% (5.0018 => 5.9325, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.15% (0.5020 => 0.5931, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.78% (0.9765 => 1.1501, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 17.68% (0.7433 => 0.8747, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.62% (0.5569 => 0.6550, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 17.43% (1.1840 => 1.3904, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0046) MultiSource/Applications/lua/lua: 17.07% (3.8723 => 4.5334, std.dev.: 0.0179) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.3423 => 0.4006, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0085) MultiSource/Applications/treecc/treecc: 16.99% (2.0273 => 2.3718, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.90% (0.5981 => 0.6992, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.48% (0.3441 => 0.4008, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 16.32% (2.2969 => 2.6718, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 16.30% (0.3283 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.26% (0.8101 => 0.9418, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.91% (0.6450 => 0.7476, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.87% (0.3232 => 0.3745, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.86% (0.2049 => 0.2374, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.13% (0.3180 => 0.3661, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314) MultiSource/Benchmarks/Prolangs-C/football/football: 14.84% (0.8921 => 1.0245, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.64% (1.1861 => 1.3598, std.dev.: 0.0148) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3379 => 0.3862, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.90% (0.8067 => 0.9188, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.75% (0.2603 => 0.2961, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3865 => 0.4394, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.86% (0.4636 => 0.5232, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.42% (0.4203 => 0.4725, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.38% (1.5603 => 1.7535, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.19% (0.4103 => 0.4603, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 12.10% (0.4048 => 0.4538, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 11.71% (0.3603 => 0.4025, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.69% (0.3927 => 0.4386, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 11.67% (17.1811 => 19.1864, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: 11.66% (0.3422 => 0.3821, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.43% (0.3684 => 0.4105, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.27% (0.3886 => 0.4324, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.00% (0.3092 => 0.3432, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.78% (0.4064 => 0.4502, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.74% (0.3826 => 0.4237, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.56% (0.3427 => 0.3789, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.44% (14.3668 => 15.8661, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.30% (0.3543 => 0.3908, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 10.28% (0.3473 => 0.3830, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.25% (0.3561 => 0.3926, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.25% (0.3543 => 0.3906, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.18% (0.3497 => 0.3853, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.82% (0.2831 => 0.3109, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 9.27% (0.2871 => 0.3137, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 9.00% (0.2877 => 0.3136, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.93% (2.0665 => 2.2510, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 8.85% (0.2905 => 0.3162, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 8.60% (1.2842 => 1.3946, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.58% (0.2891 => 0.3139, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.6030 => 0.6546, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.47% (0.3650 => 0.3959, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.45% (0.7326 => 0.7945, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.35% (0.2756 => 0.2986, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.28% (0.3935 => 0.4261, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.26% (0.3052 => 0.3304, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2802 => 0.3031, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.08% (63.2438 => 68.3546, std.dev.: 0.0822) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.02% (0.2793 => 0.3017, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.00% (0.2725 => 0.2943, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.48% (10.3673 => 11.1423, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.40% (2.2022 => 2.3651, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.4879 => 0.5182, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.85% (0.3177 => 0.3363, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 3.70% (0.3131 => 0.3247, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.91% (0.3817 => 0.3928, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.09% (7.9617 => 8.1279, std.dev.: 0.0304) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4680, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4526, std.dev.: 0.0074) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 4.79% (3.1578 => 3.3090, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.15% (0.9957 => 1.0370, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9167, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.05% (3.6395 => 3.7141, std.dev.: 0.0065) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2878, std.dev.: 0.0223) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.78% (1.7254 => 1.7561, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.77% (27.8444 => 28.3363, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4539, std.dev.: 0.0279) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.79% (5.2763 => 1.1721, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -75.40% (0.8651 => 0.2128, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.58% (5.3855 => 4.4385, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.92% (5.3526 => 4.4467, std.dev.: 0.0093) MultiSource/Applications/JM/ldecod/ldecod: -13.61% (10.4361 => 9.0156, std.dev.: 0.0250) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.52% (1.7609 => 1.6109, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -7.83% (54.1659 => 49.9260, std.dev.: 0.0459) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.68% (1.9577 => 0.6524, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.95% (0.3987 => 0.2474, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.54% (10.7105 => 7.4395, std.dev.: 0.0270) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8561, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0067, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4948, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3129, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.89% (4.8142 => 4.4823, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2373 => 1.1650, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.65% (2.7294 => 2.5751, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.59% (8.1563 => 7.7004, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.40% (10.2830 => 9.8306, std.dev.: 0.0101) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0334, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -1.83% (3.6994 => 3.6318, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766) SingleSource/Benchmarks/Shootout-C++/ary3: -1.64% (3.7221 => 3.6610, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3306, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.33% (6.2999 => 6.2163, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: -1.13% (4.6441 => 4.5917, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0047) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 18:38:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 20:38:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123023843.4FF692A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7844?compare_to=7841&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7844, Order: 173208, Start Time: 2013-01-23 00:33:12, End Time: 2013-01-23 02:38:58 To: 7841, Order: 173198, Start Time: 2013-01-22 22:12:50, End Time: 2013-01-23 00:13:53 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 29 (21 on baseline) Performance Improvements: 0 (9 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1035 (1033 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.78% (0.2525 => 0.2974, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.99% (4.4823 => 5.1543, std.dev.: 0.2272) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.33% (5.7565 => 6.2934, std.dev.: 0.0342) MultiSource/Benchmarks/Olden/health/health: 8.51% (0.1504 => 0.1632, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 6.71% (16.3964 => 17.4958, std.dev.: 0.1227) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.13% (0.9961 => 1.0572, std.dev.: 0.0066) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.94% (24.2515 => 25.6924, std.dev.: 0.2499) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.70% (0.8760 => 0.9259, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.54% (0.8788 => 0.9275, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.18% (0.9097 => 0.9568, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.16% (0.8794 => 0.9248, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.60% (0.9101 => 0.9520, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.37% (0.3528 => 0.3682, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 52.48% (3.1465 => 4.7977, std.dev.: 0.1888) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.79% (2.4047 => 3.0009, std.dev.: 0.0373) SingleSource/Benchmarks/CoyoteBench/lpbench: 20.48% (4.1067 => 4.9478, std.dev.: 0.0853) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.78% (15.1278 => 16.7585, std.dev.: 0.3069) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.53% (9.0975 => 10.0555, std.dev.: 0.2882) SingleSource/Benchmarks/Shootout-C++/lists1: 7.46% (0.6096 => 0.6551, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.90% (59.8868 => 62.2248, std.dev.: 0.3605) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.90% (4.2481 => 4.4139, std.dev.: 0.0239) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.79% (39.0308 => 40.5088, std.dev.: 0.1413) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (3.4135 => 3.5277, std.dev.: 0.0317) MultiSource/Applications/JM/lencod/lencod: 2.43% (6.9450 => 7.1137, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.41% (0.5852 => 0.5993, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: 1.65% (1.6245 => 1.6513, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: 1.47% (4.3067 => 4.3700, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.34% (5.8537 => 5.9320, std.dev.: 0.0292) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.28% (2.4601 => 2.4917, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.89% (1.1254 => 1.1354, std.dev.: 0.0900) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.89% (0.0225 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0434 => 0.0433, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0338 => 0.0338, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.24% (0.0322 => 0.0326, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.69% (0.0434 => 0.0437, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0210 => 0.0210, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 0.45% (0.0223 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0251 => 0.0252, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1435 => 0.1436, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 4.70% (1.1322 => 1.1854, std.dev.: 0.2140) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.14% (0.3935 => 0.3980, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.42% (0.1548 => 0.1526, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.83% (0.0994 => 0.0946, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.26% (0.0276 => 0.0198, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.82% (0.0536 => 0.0594, std.dev.: 0.0120) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.02% (1.1511 => 1.1509, std.dev.: 0.2996) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 6.90% (0.0029 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -73.08% (0.0026 => 0.0007, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0613 => 0.0608, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.64% (0.0313 => 0.0315, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.84% (0.7408 => 0.7470, std.dev.: 0.0399) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 200.00% (0.0001 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 13.56% (0.0059 => 0.0067, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.66% (12.7621 => 12.8459, std.dev.: 0.0204) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.93% (23.5861 => 25.6924, std.dev.: 0.2499) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.17% (0.8736 => 0.9275, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: 4.76% (16.7012 => 17.4958, std.dev.: 0.1227) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.67% (0.8846 => 0.9259, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 4.48% (1.0119 => 1.0572, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.39% (0.9120 => 0.9520, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324525.00% (0.0008 => 2.5970, std.dev.: 0.0631) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.13% (1.1825 => 2.3665, std.dev.: 0.2017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.23% (2.5170 => 3.0009, std.dev.: 0.0373) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.12% (4.2042 => 4.7977, std.dev.: 0.1888) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.63% (9.0082 => 10.0555, std.dev.: 0.2882) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.09% (4.4540 => 4.9478, std.dev.: 0.0853) MultiSource/Applications/JM/lencod/lencod: 4.37% (6.8159 => 7.1137, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.02% (4.2843 => 4.4139, std.dev.: 0.0239) SingleSource/Benchmarks/Misc/pi: 2.50% (2.1390 => 2.1925, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.94% (61.0379 => 62.2248, std.dev.: 0.3605) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.71% (2.4498 => 2.4917, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/whetstone: 1.61% (1.6251 => 1.6513, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: 1.15% (4.3202 => 4.3700, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 1.08% (3.5910 => 3.6299, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -17.23% (1.8964 => 1.5697, std.dev.: 0.0263) MultiSource/Applications/hexxagon/hexxagon: -9.75% (1.1433 => 1.0318, std.dev.: 0.0160) MultiSource/Applications/sqlite3/sqlite3: -6.79% (17.5634 => 16.3708, std.dev.: 0.4460) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.03% (6.4235 => 6.2934, std.dev.: 0.0342) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -13.36% (1.4588 => 1.2639, std.dev.: 0.0504) MultiSource/Benchmarks/mafft/pairlocalalign: -7.90% (63.1520 => 58.1610, std.dev.: 0.3630) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.87% (23.3986 => 22.2598, std.dev.: 0.3103) MultiSource/Applications/spiff/spiff: -1.84% (2.8571 => 2.8044, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (3.1921 => 3.1447, std.dev.: 0.0077) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.75% (1.2047 => 1.1354, std.dev.: 0.0900) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.61% (0.0328 => 0.0326, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.80% (0.0445 => 0.0437, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: -6.14% (0.1530 => 0.1436, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: -38.56% (1.9293 => 1.1854, std.dev.: 0.2140) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.70% (0.4049 => 0.3980, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.06% (0.1510 => 0.1526, std.dev.: 0.0368) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.27% (0.0978 => 0.0946, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -28.26% (0.0276 => 0.0198, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.68% (0.0590 => 0.0594, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1617 => 1.1509, std.dev.: 0.2996) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -74.07% (0.0027 => 0.0007, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0138) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.54% (0.0268 => 0.0315, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.44% (0.7437 => 0.7470, std.dev.: 0.0399) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -62.50% (0.0008 => 0.0003, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -27.17% (0.0092 => 0.0067, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.53% (12.7781 => 12.8459, std.dev.: 0.0204) Report Time: 0.73s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 19:13:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 21:13:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123031328.4FA322A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7845?compare_to=7842&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7845, Order: 173215, Start Time: 2013-01-23 01:39:33, End Time: 2013-01-23 03:13:42 To: 7842, Order: 173204, Start Time: 2013-01-22 23:42:36, End Time: 2013-01-23 01:16:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 2 (115 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (872 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.24% (20.4934 => 20.2392, std.dev.: 0.0256) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.84% (0.7066 => 0.6936, std.dev.: 0.0023) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.34% (0.6395 => 0.8783, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 36.84% (0.0418 => 0.0572, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.14% (0.6260 => 0.8272, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.11% (0.5456 => 0.7208, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.11% (0.5805 => 0.7669, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.03% (0.5688 => 0.7510, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.82% (0.5849 => 0.7710, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.23% (0.5581 => 0.7324, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.21% (0.6395 => 0.8391, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.11% (0.5567 => 0.7299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.18% (0.5941 => 0.7734, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.78% (0.5859 => 0.7604, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.55% (0.6033 => 0.7816, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.82% (0.6440 => 0.8296, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.60% (1.6474 => 2.1185, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.32% (0.6189 => 0.7942, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.66% (0.6304 => 0.8048, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.54% (0.6230 => 0.7946, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.58% (0.5802 => 0.7344, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.92% (0.5705 => 0.7184, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.70% (0.5925 => 0.7448, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.68% (0.5478 => 0.6885, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.68% (0.5857 => 0.7361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.21% (0.5569 => 0.6973, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.21% (0.5570 => 0.6974, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.77% (0.5591 => 0.6976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.66% (0.5863 => 0.7250, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.55% (0.7524 => 0.9296, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.50% (0.6052 => 0.7474, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.47% (0.6446 => 0.7959, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.02% (0.6681 => 0.8219, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.60% (0.6194 => 0.7594, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.07% (0.6297 => 0.7687, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.49% (2.2587 => 2.7441, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.09% (0.6667 => 0.8073, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.31% (0.7339 => 0.8756, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.16% (0.3357 => 0.3866, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3160, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4916 => 0.5510, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.02% (4.5069 => 5.0486, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 11.63% (0.4515 => 0.5040, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.46% (3.5339 => 3.9389, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.18% (1.6364 => 1.8194, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.10% (0.1982 => 0.2202, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1230 => 0.1363, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.85% (0.2385 => 0.2620, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.10% (0.7021 => 0.7660, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.19% (1.2515 => 1.3540, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.01% (0.5329 => 0.5756, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.18% (1.4642 => 1.5694, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 7.07% (0.4524 => 0.4844, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (0.4861 => 0.5192, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.74% (1.2784 => 1.3646, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 6.53% (9.2283 => 9.8305, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3319 => 0.3469, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.12% (5.4682 => 5.6936, std.dev.: 0.0051) MultiSource/Applications/oggenc/oggenc: 4.08% (5.0226 => 5.2276, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.39% (0.6750 => 0.6979, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.04% (1.3864 => 1.4286, std.dev.: 0.0162) MultiSource/Applications/spiff/spiff: 2.57% (0.8418 => 0.8634, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 2.09% (0.7447 => 0.7603, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.9557 => 0.9739, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.84% (22.4056 => 22.8171, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.3722 => 1.3957, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 1.69% (15.5079 => 15.7696, std.dev.: 0.0106) MultiSource/Applications/d/make_dparser: 1.03% (3.5154 => 3.5515, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8118, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1496, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4051, std.dev.: 0.1069) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6056, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.49% (27.8210 => 28.2344, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.69% (0.3837 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (2.4924 => 2.3756, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -4.28% (0.2871 => 0.2748, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.10% (0.2903 => 0.2784, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -4.02% (0.3205 => 0.3076, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.97% (0.3880 => 0.3726, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.95% (0.2933 => 0.2817, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3831 => 0.3680, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.93% (0.2849 => 0.2737, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3812 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.90% (0.3848 => 0.3698, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.89% (0.3059 => 0.2940, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -3.87% (0.4033 => 0.3877, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.83% (0.3057 => 0.2940, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.78% (0.3891 => 0.3744, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/random: -3.78% (0.2939 => 0.2828, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.78% (0.9852 => 0.9480, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.68% (0.3016 => 0.2905, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -3.67% (0.3025 => 0.2914, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.51% (0.3252 => 0.3138, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -3.45% (1.3148 => 1.2694, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.39% (2.1713 => 2.0976, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: -3.37% (0.3026 => 0.2924, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: -3.12% (0.4199 => 0.4068, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.88% (0.6347 => 0.6164) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.87% (0.4151 => 0.4032, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.85% (0.6484 => 0.6299, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: -2.83% (0.4280 => 0.4159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.62% (0.6441 => 0.6272, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.60% (0.3849 => 0.3749, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2392, std.dev.: 0.0256) SingleSource/UnitTests/ObjC++/property-reference: -2.39% (0.7779 => 0.7593, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.39% (0.9542 => 0.9314, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.09% (14.2083 => 13.9112, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.77% (0.7919 => 0.7779, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.71% (6.7716 => 6.6561, std.dev.: 0.0114) MultiSource/Applications/JM/lencod/lencod: -1.64% (16.1920 => 15.9260, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (1.2210 => 1.2022, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.54% (1.2221 => 1.2033, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.54% (1.0544 => 1.0382, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -1.52% (17.1032 => 16.8439, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: -1.51% (4.3330 => 4.2674, std.dev.: 0.0086) MultiSource/Applications/hbd/hbd: -1.24% (1.5610 => 1.5416, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.23% (7.0961 => 7.0090, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.16% (1.2300 => 1.2157, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: -1.09% (0.9179 => 0.9079, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.68% (1.8100 => 0.6936, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3161, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.77% (1.3643 => 1.0264, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7505, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0755, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1985, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1281, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.42% (0.5142 => 0.4606, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1754, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.84% (1.3096 => 1.2724, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.57% (7.9763 => 7.7710, std.dev.: 0.0182) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -2.09% (3.7241 => 3.6461, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.66% (1.6307 => 1.6036, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3040 => 7.1889, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.47% (6.5735 => 6.4768, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6002, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.33% (3.7092 => 3.6599, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 20:00:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 22:00:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130123040036.6535A2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7846?compare_to=7802&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7846, Order: 173204, Start Time: 2013-01-23 00:25:30, End Time: 2013-01-23 04:00:50 To: 7802, Order: 172983, Start Time: 2013-01-20 17:34:26, End Time: 2013-01-20 21:08:18 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.99% (124.4257 => 129.3906, std.dev.: 0.8845) SingleSource/Benchmarks/Dhrystone/dry: 2.67% (13.2244 => 13.5772, std.dev.: 0.1065) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.72% (2.1641 => 2.2014, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 40.64% (0.0625 => 0.0879, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.27% (0.1063 => 0.1406, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.74% (0.0475 => 0.0621, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.12% (0.1106 => 0.1417, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.09% (0.2969 => 0.3803, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.42% (0.0547 => 0.0697, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.48% (0.4139 => 0.5235, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.08% (0.5900 => 0.7439, std.dev.: 0.0280) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.53% (0.4253 => 0.5339, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.81% (0.4994 => 0.6233, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.22% (0.5000 => 0.6211, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.70% (0.1620 => 0.2004, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 23.61% (1.5932 => 1.9694, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.60% (0.1021 => 0.1262, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.58% (0.1107 => 0.1368, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.0948 => 0.1160, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.27% (0.0633 => 0.0774, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226) MultiSource/Benchmarks/Olden/power/power: 22.19% (0.0604 => 0.0738, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.0642 => 0.0783, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.96% (0.3903 => 0.4760, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.94% (0.1103 => 0.1345, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.65% (0.0822 => 0.1000, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.63% (0.1549 => 0.1884, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/health/health: 21.56% (0.0821 => 0.0998) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.44% (0.0541 => 0.0657, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 21.37% (0.1619 => 0.1965, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 20.70% (0.0947 => 0.1143, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.40% (0.1088 => 0.1310, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.05% (0.3890 => 0.4670, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 20.03% (0.4029 => 0.4836, std.dev.: 0.0135) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.90% (0.1462 => 0.1753, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.61% (0.2014 => 0.2409, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.33% (0.2736 => 0.3265, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/gs/gs: 19.09% (1.8794 => 2.2381, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.08% (1.3152 => 1.5662, std.dev.: 0.0297) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.95% (0.2866 => 0.3409, std.dev.: 0.0079) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.65% (0.3271 => 0.3881, std.dev.: 0.0103) MultiSource/Applications/Burg/burg: 18.61% (0.5546 => 0.6578, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.32% (0.5026 => 0.5947, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.88% (1.6211 => 1.9110, std.dev.: 0.0225) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.80% (0.4658 => 0.5487, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/Hello: 17.66% (0.5826 => 0.6855, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.62% (3.5627 => 4.1905, std.dev.: 0.0608) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.53% (0.1968 => 0.2313, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.43% (0.2875 => 0.3376, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/property-reference-object: 17.30% (0.5889 => 0.6908, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.23% (0.2792 => 0.3273, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 17.14% (0.3004 => 0.3519, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 17.09% (0.2750 => 0.3220, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 17.07% (0.2823 => 0.3305, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 17.03% (0.2813 => 0.3292, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 17.02% (0.2714 => 0.3176, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.97% (0.2911 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 16.88% (0.2725 => 0.3185, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 16.86% (0.2811 => 0.3285, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 16.82% (0.9697 => 1.1328, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/random: 16.80% (0.2803 => 0.3274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.73% (0.2738 => 0.3196, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.69% (0.3930 => 0.4586, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 16.69% (0.2780 => 0.3244, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.65% (0.9909 => 1.1559, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.60% (0.4361 => 0.5085, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.58% (2.0673 => 2.4101, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/wc: 16.57% (0.3096 => 0.3609, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.56% (0.2729 => 0.3181, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.38% (0.3267 => 0.3802, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.31% (0.3195 => 0.3716, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.21% (0.3060 => 0.3556, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 16.20% (1.0781 => 1.2528, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 16.18% (0.3258 => 0.3785, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 16.07% (23.5202 => 27.3010, std.dev.: 0.1122) SingleSource/Benchmarks/Shootout-C++/sieve: 16.02% (0.3726 => 0.4323, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.01% (0.7171 => 0.8319, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 15.98% (0.3317 => 0.3847, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.97% (1.9694 => 2.2840, std.dev.: 0.0517) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.88% (1.9966 => 2.3136, std.dev.: 0.0503) MultiSource/Applications/ClamAV/clamscan: 15.76% (4.2109 => 4.8747, std.dev.: 0.1062) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.69% (0.3124 => 0.3614, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 15.68% (0.3348 => 0.3873, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.65% (2.7292 => 3.1562, std.dev.: 0.0301) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.64% (0.3625 => 0.4192, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 15.51% (1.4269 => 1.6482, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.47% (0.3362 => 0.3882, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 15.44% (0.3678 => 0.4246, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.42% (0.3282 => 0.3788, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.39% (4.4195 => 5.0997, std.dev.: 0.0396) SingleSource/Benchmarks/Shootout-C++/lists1: 15.39% (0.3477 => 0.4012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.22% (0.3981 => 0.4587, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 15.20% (0.2566 => 0.2956, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 15.05% (0.4146 => 0.4770, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 15.01% (0.4251 => 0.4889, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.69% (0.3690 => 0.4232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.68% (0.1090 => 0.1250, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.67% (0.3845 => 0.4409, std.dev.: 0.0032) MultiSource/Applications/treecc/treecc: 14.23% (0.7875 => 0.8996, std.dev.: 0.0157) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 14.07% (0.5012 => 0.5717, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 13.69% (5.5417 => 6.3001, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.46% (0.6435 => 0.7301, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.34% (2.1653 => 2.4541, std.dev.: 0.0389) SingleSource/UnitTests/ObjC/exceptions-4: 13.16% (0.3465 => 0.3921, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 13.13% (0.3496 => 0.3955, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.2691 => 0.3043, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 13.04% (0.3442 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 13.00% (0.3446 => 0.3894, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.99% (0.3488 => 0.3941, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 12.98% (0.3460 => 0.3909, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.93% (0.2737 => 0.3091, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 12.91% (0.3469 => 0.3917, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.82% (0.3650 => 0.4118, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 12.64% (4.6177 => 5.2015, std.dev.: 0.0618) SingleSource/UnitTests/ObjC/parameter-passing: 12.62% (0.3724 => 0.4194, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3643 => 0.4101, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 12.35% (2.1013 => 2.3609, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.98% (0.5361 => 0.6003, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 11.94% (0.6634 => 0.7426, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.90% (0.3084 => 0.3451, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 11.84% (0.3498 => 0.3912, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.57% (0.2040 => 0.2276, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.41% (0.2103 => 0.2343, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 11.36% (0.3336 => 0.3715, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: 11.14% (0.4847 => 0.5387, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.80% (0.7426 => 0.8228, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.74% (11.6398 => 12.8904, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.12% (0.1383 => 0.1523, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 10.04% (0.2391 => 0.2631, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.70% (4.6926 => 5.1479, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 9.23% (2.0346 => 2.2223, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.76% (0.5584 => 0.6073, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 7.59% (11.9555 => 12.8626, std.dev.: 0.0182) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.80% (0.3792 => 0.3936, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.77% (29.0505 => 181.5000, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0070) MultiSource/Applications/ClamAV/clamscan: 11.21% (0.2802 => 0.3116, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.80% (0.3693 => 0.4018, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6113, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.46% (0.2122 => 0.2259, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6797, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2384, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/flops-2: 4.74% (1.8057 => 1.8913, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6850, std.dev.: 0.0070) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1920, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3056, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.36% (2.0820 => 2.1104, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (2.1746 => 2.2014, std.dev.: 0.0039) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2080, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5855, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4767, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.83% (2.4764 => 2.4310, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5692, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/mandel-2: -20.89% (3.6262 => 2.8688, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -16.85% (17.2379 => 14.3329, std.dev.: 0.0567) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9738, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7921, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -7.12% (0.2402 => 0.2231, std.dev.: 0.0032) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2204, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8037, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -3.35% (14.0481 => 13.5772, std.dev.: 0.1065) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7734, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1359, std.dev.: 0.0574) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5713, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1513, std.dev.: 0.1016) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0448, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 20:15:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 22:15:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123041529.73BE12A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7847?compare_to=7843&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7847, Order: 173218, Start Time: 2013-01-23 02:04:45, End Time: 2013-01-23 04:15:43 To: 7843, Order: 173203, Start Time: 2013-01-22 23:23:00, End Time: 2013-01-23 01:34:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.73% (11.1423 => 10.9493, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.73% (81.8241 => 80.4075, std.dev.: 0.5415) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0655 => 0.0656, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8504 => 499.8530, std.dev.: 0.0068) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.00% (1.1277 => 499.8530, std.dev.: 0.0068) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.50% (0.5229 => 1.6445, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 20.14% (14.9895 => 18.0088, std.dev.: 0.0118) MultiSource/Applications/kimwitu++/kc: 43.49% (14.1553 => 20.3120, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/gs/gs: 17.71% (4.1105 => 4.8383, std.dev.: 0.0139) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.42% (1.1048 => 1.7281, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.31% (7.1582 => 37.4595, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.91% (3.4629 => 6.4033, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.78% (0.6222 => 1.0875, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10283.61% (0.0720 => 7.4762, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11159000.00% (0.0001 => 11.1591, std.dev.: 0.0173) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489800.00% (0.0001 => 5.4899, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.41% (1.1194 => 10.2247, std.dev.: 0.0367) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 148.60% (22.1758 => 55.1298, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/lowercase: 121.09% (0.0256 => 0.0566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.45% (0.0929 => 0.1825, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454) MultiSource/Benchmarks/FreeBench/neural/neural: 71.09% (0.1463 => 0.2503, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.33% (2.9384 => 4.6231, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.59% (7.0540 => 10.8344, std.dev.: 0.0105) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.95% (1.5859 => 2.3939, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.61% (8.1363 => 11.9289, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.35% (2.2024 => 3.1130, std.dev.: 0.0066) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 38.13% (0.1432 => 0.1978, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 37.93% (21.9371 => 30.2581, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457, std.dev.: 0.0002) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.00% (4.2646 => 5.6719, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.61% (0.4615 => 0.6120, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.14% (1.5415 => 2.0369, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.25% (0.2271 => 0.2958, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 29.29% (1.1642 => 1.5052, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.72% (0.6675 => 0.8592, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 26.97% (0.5105 => 0.6482, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.48% (0.1892 => 0.2393, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.10% (0.0793 => 0.1000, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.57% (0.2554 => 0.3207, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.46% (3.8922 => 4.8833, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.50% (0.1143 => 0.1423, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 24.43% (0.4289 => 0.5337, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.17% (1.0722 => 1.3314, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.01% (0.1566 => 0.1942, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.90% (0.3121 => 0.3867, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 23.83% (0.1175 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.83% (1.4186 => 1.7566, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 23.66% (0.4620 => 0.5713, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.01% (0.0730 => 0.0898, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.65% (0.1695 => 0.2079, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 22.48% (9.4845 => 11.6167, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 21.91% (0.7115 => 0.8674, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.37% (0.2700 => 0.3277, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.04% (0.1236 => 0.1496, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.57% (1.3050 => 1.5735, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 20.49% (0.6456 => 0.7779, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 20.40% (0.7835 => 0.9433, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.04% (5.7591 => 6.9130, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 19.72% (0.1151 => 0.1378, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.62% (0.5860 => 0.7010, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.35% (4.9449 => 5.9016, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.25% (0.8172 => 0.9745, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.12% (0.1940 => 0.2311, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 18.89% (0.0614 => 0.0730, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.59% (3.3354 => 3.9555, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.50% (5.0018 => 5.9272, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.23% (0.5020 => 0.5935, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.21% (0.0648 => 0.0766, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.84% (0.2758 => 0.3250, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.74% (0.9765 => 1.1497, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 17.68% (0.7433 => 0.8747, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.63% (0.5569 => 0.6551, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.47% (0.2107 => 0.2475, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 17.30% (1.1840 => 1.3888, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.20% (3.8723 => 4.5385, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 17.18% (0.3423 => 0.4011, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.05% (0.2065 => 0.2417, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 16.99% (2.0273 => 2.3718, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 16.65% (0.3232 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.37% (2.2969 => 2.6729, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.29% (0.0933 => 0.1085) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.06% (0.8101 => 0.9402, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 15.81% (0.2049 => 0.2373, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.71% (0.1044 => 0.1208, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.67% (0.6450 => 0.7461, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.06% (0.3180 => 0.3659, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.95% (0.8921 => 1.0255, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.66% (1.1861 => 1.3600, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.33% (0.3865 => 0.4419, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.19% (0.8067 => 0.9212, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.87% (0.2603 => 0.2964, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.31% (0.4636 => 0.5253, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.23% (0.4103 => 0.4646, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.87% (0.4203 => 0.4744, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 12.68% (1.5603 => 1.7581, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/sieve: 12.35% (0.3603 => 0.4048, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.35% (0.3927 => 0.4412, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 12.23% (0.4048 => 0.4543, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 12.22% (0.3422 => 0.3840, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 11.97% (0.3684 => 0.4125, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/property: 11.86% (0.3886 => 0.4347, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 11.68% (17.1811 => 19.1881, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.40% (0.2430 => 0.2707, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.40% (0.3282 => 0.3656, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.29% (0.3826 => 0.4258, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 10.93% (0.3092 => 0.3430, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.84% (0.3561 => 0.3947, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.84% (0.3543 => 0.3927, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.80% (0.4064 => 0.4503, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.74% (0.3473 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.65% (0.3427 => 0.3792, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.49% (0.2831 => 0.3128, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.47% (14.3668 => 15.8708, std.dev.: 0.0138) SingleSource/Regression/C++/ofstream_ctor: 10.02% (0.2905 => 0.3196, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2871 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.82% (0.2891 => 0.3175, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.81% (2.0665 => 2.2692, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 9.78% (0.1268 => 0.1392, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2877 => 0.3152, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.34% (0.3052 => 0.3337, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.34% (0.1114 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.29% (0.2756 => 0.3012, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.25% (1.2842 => 1.4030, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2725 => 0.2977, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/random: 9.21% (0.2802 => 0.3060, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.21% (0.3650 => 0.3986, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.17% (0.3162 => 0.3452, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.13% (0.2793 => 0.3048, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.12% (0.6030 => 0.6580, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.03% (0.2714 => 0.2959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.02% (0.7326 => 0.7987, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.98% (0.2872 => 0.3130, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.83% (0.5925 => 0.6448, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.59% (0.3935 => 0.4273, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.42% (0.3136 => 0.3400, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 7.99% (63.2438 => 68.2983, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.60% (2.2022 => 2.3696, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.4879 => 0.5173, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.61% (10.3673 => 10.9493, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/objinst: 4.25% (0.3131 => 0.3264, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.51% (0.3817 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.9617 => 8.1486, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4663, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.95% (1.1145 => 1.2923, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 15.77% (6.6465 => 7.6949, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.35% (1.1396 => 1.2462, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4496, std.dev.: 0.0073) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3128, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.04% (0.9957 => 1.0359, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9127, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.37% (3.6395 => 3.7256, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2836, std.dev.: 0.0332) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.76% (27.8444 => 28.3357, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4499, std.dev.: 0.0271) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.74% (5.2763 => 1.1746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -75.30% (0.8651 => 0.2137, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.71% (0.1622 => 0.0913) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.09% (5.3855 => 4.4650, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.48% (5.3526 => 4.4703, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -13.57% (10.4361 => 9.0198, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.29% (1.7609 => 1.6149, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -7.81% (54.1659 => 49.9382, std.dev.: 0.0272) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.94% (1.9577 => 0.6277, std.dev.: 0.0213) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -37.95% (0.3987 => 0.2474, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -37.94% (0.0506 => 0.0314) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -33.65% (1.5373 => 1.0200, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.65% (10.7105 => 7.4280, std.dev.: 0.0304) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8506, std.dev.: 0.0129) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3243, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.20% (19.9488 => 18.3139, std.dev.: 0.0182) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7038, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.26% (1.2373 => 1.1599, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.66% (2.7294 => 2.5750, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7018, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.44% (10.2830 => 9.8266, std.dev.: 0.0129) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.85% (3.6994 => 3.6311, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.73% (3.7221 => 3.6578, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.6441 => 4.5912, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0053) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0018) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 20:56:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 22:56:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123045629.631DC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7848?compare_to=7844&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7848, Order: 173222, Start Time: 2013-01-23 02:57:34, End Time: 2013-01-23 04:56:44 To: 7844, Order: 173208, Start Time: 2013-01-23 00:33:12, End Time: 2013-01-23 02:38:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (8 on baseline) Performance Improvements: 103 (118 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 957 (937 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 7.49% (58.1610 => 62.5195, std.dev.: 0.3091) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.20% (4.2322 => 4.3675, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 2.39% (4.3469 => 4.4509, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/random: 2.34% (2.4177 => 2.4742, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -21.67% (0.1952 => 0.1529, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -19.99% (0.2816 => 0.2253, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uuencode/uuencode: -19.67% (0.0610 => 0.0490, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -19.05% (0.0609 => 0.0493, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -17.22% (0.2974 => 0.2462, std.dev.: 0.0096) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -15.90% (0.1415 => 0.1190, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: -14.31% (0.1160 => 0.0994, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -12.29% (5.1543 => 4.5206, std.dev.: 0.0122) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.99% (1.4071 => 1.2524, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -10.80% (5.4220 => 4.8363, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/health/health: -10.66% (0.1632 => 0.1458, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.23% (0.1506 => 0.1352, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -9.87% (0.8218 => 0.7407, std.dev.: 0.0176) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -9.00% (0.5692 => 0.5180, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.72% (5.2327 => 4.7762, std.dev.: 0.0479) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.65% (6.2934 => 5.7488, std.dev.: 0.1098) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -8.08% (0.1398 => 0.1285, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -7.47% (2.3745 => 2.1971, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.08% (0.9345 => 0.8683, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.71% (1.0456 => 0.9754, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.48% (9.8772 => 9.2371, std.dev.: 0.0859) MultiSource/Applications/siod/siod: -6.35% (2.5756 => 2.4121, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.30% (0.2189 => 0.2051, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.28% (0.2725 => 0.2554, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.27% (0.3491 => 0.3272, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: -5.98% (17.4958 => 16.4495, std.dev.: 0.0621) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.96% (0.2918 => 0.2744, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.91% (1.0572 => 0.9947, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/methcall: -5.75% (0.2173 => 0.2048, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -5.67% (0.9275 => 0.8749, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.67% (0.9618 => 0.9073, std.dev.: 0.0065) MultiSource/Applications/sgefa/sgefa: -5.66% (0.3447 => 0.3252, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -5.33% (1.0477 => 0.9919, std.dev.: 0.0033) SingleSource/Benchmarks/Linpack/linpack-pc: -5.29% (0.2570 => 0.2434, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.23% (1.0055 => 0.9529, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -4.92% (0.2075 => 0.1973, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.87% (0.9248 => 0.8798, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: -4.71% (1.4380 => 1.3702, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.50% (0.9520 => 0.9092, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.38% (1.0134 => 0.9690, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: -4.30% (7.5019 => 7.1795, std.dev.: 0.0308) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.05% (0.9553 => 0.9166, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: -4.02% (2.6666 => 2.5595, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.94% (1.1318 => 1.0872, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.93% (1.4863 => 1.4279, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.57% (0.5569 => 0.5370, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: -3.49% (0.9132 => 0.8813, std.dev.: 0.0107) MultiSource/Benchmarks/McCat/08-main/main: -3.43% (0.2943 => 0.2842, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.30% (1.4153 => 1.3686, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.29% (1.3107 => 1.2676, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.06% (1.0017 => 0.9710, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.05% (15.0186 => 14.5605, std.dev.: 0.1486) MultiSource/Benchmarks/SciMark2-C/scimark2: -3.01% (0.3622 => 0.3513, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.91% (0.9759 => 0.9475, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.84% (1.5290 => 1.4855, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.83% (0.5124 => 0.4979, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.68% (0.9307 => 0.9058, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.54% (1.2963 => 1.2634, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -2.52% (0.9810 => 0.9563, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.51% (1.0895 => 1.0622, std.dev.: 0.0069) MultiSource/Applications/ClamAV/clamscan: -2.48% (16.3611 => 15.9557, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.41% (1.7563 => 1.7139, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -2.35% (16.3708 => 15.9866, std.dev.: 0.1016) MultiSource/Applications/hexxagon/hexxagon: -2.30% (1.0318 => 1.0081, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.24% (1.0031 => 0.9806, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.21% (0.7467 => 0.7302, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.14% (0.9152 => 0.8956, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.13% (0.9302 => 0.9104, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.11% (0.6928 => 0.6782, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.08% (0.9484 => 0.9287, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.75% (0.8554 => 0.8404, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -1.74% (16.2143 => 15.9323, std.dev.: 0.0703) MultiSource/Applications/d/make_dparser: -1.64% (3.5670 => 3.5086, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/football/football: -1.55% (0.9867 => 0.9714, std.dev.: 0.0043) MultiSource/Applications/oggenc/oggenc: -1.42% (5.3196 => 5.2439, std.dev.: 0.0247) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (7.1910 => 7.0907, std.dev.: 0.0202) MultiSource/Benchmarks/nbench/nbench: -1.22% (1.2796 => 1.2640, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.11% (0.9384 => 0.9280, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -26.49% (0.8783 => 0.6456, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -19.38% (3.0009 => 2.4192, std.dev.: 0.0374) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -15.67% (0.1193 => 0.1006, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.14% (2.7651 => 2.3464, std.dev.: 0.1185) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.16% (1.4781 => 1.2836, std.dev.: 0.0215) MultiSource/Applications/minisat/minisat: -11.89% (7.0080 => 6.1749, std.dev.: 0.1401) MultiSource/Benchmarks/Olden/perimeter/perimeter: -8.31% (0.3479 => 0.3190, std.dev.: 0.0049) MultiSource/Benchmarks/7zip/7zip-benchmark: -8.11% (10.0555 => 9.2405, std.dev.: 0.2975) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.65% (2.4433 => 2.2809, std.dev.: 0.0473) MultiSource/Applications/sgefa/sgefa: -6.08% (0.3818 => 0.3586, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -5.50% (0.6551 => 0.6191, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: -5.29% (8.8125 => 8.3465, std.dev.: 0.0607) MultiSource/Benchmarks/Olden/health/health: -5.25% (0.3600 => 0.3411, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.59% (3.8687 => 3.6911, std.dev.: 0.0133) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -4.10% (4.4139 => 4.2328, std.dev.: 0.0165) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.67% (16.7585 => 16.1431, std.dev.: 0.1038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.37% (42.7324 => 41.2941, std.dev.: 0.5086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.24% (40.5088 => 39.1972, std.dev.: 0.2042) MultiSource/Applications/SIBsim4/SIBsim4: -3.17% (3.5277 => 3.4157, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.11% (0.3407 => 0.3301, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.73% (44.8190 => 43.5955, std.dev.: 0.3006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.69% (0.5993 => 0.5832, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/whetstone: -1.79% (1.6513 => 1.6217, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.41% (5.9320 => 5.8481, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.09% (2.9671 => 2.9348, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.11% (1.1354 => 1.1228, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0223 => 0.0223, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0433 => 0.0433, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0338 => 0.0335, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.15% (0.0326 => 0.0319, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0437 => 0.0433, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/casts: -0.95% (0.0210 => 0.0208, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -0.89% (0.0224 => 0.0222, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1436 => 0.1459, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -2.07% (1.1854 => 1.1609, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.18% (0.3980 => 0.3933, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.44% (0.1526 => 0.1443, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.37% (0.0946 => 0.0933, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 32.83% (0.0198 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.11% (0.0594 => 0.0528, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.33% (1.1509 => 1.1471, std.dev.: 0.1037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0007 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.95% (0.0608 => 0.0584, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.98% (0.0315 => 0.0293, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.45% (0.7470 => 0.7362, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.37% (0.0067 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.71% (12.8459 => 12.7545, std.dev.: 0.0545) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 44.64% (0.0336 => 0.0486, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.72% (0.2879 => 0.2986, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320987.50% (0.0008 => 2.5687, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.97% (1.1825 => 2.4238, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.08% (0.2562 => 0.2769, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.82% (4.1668 => 4.3675, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/pi: 2.51% (2.1390 => 2.1927, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.18% (0.8800 => 0.8904, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.99% (0.0808 => 0.0493, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -27.65% (0.1888 => 0.1366, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.46% (0.1684 => 0.1289, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -20.19% (1.8964 => 1.5135, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.52% (0.1009 => 0.0812, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.37% (0.0862 => 0.0695, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.60% (0.7686 => 0.6410, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.37% (1.0960 => 0.9166, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.85% (0.1079 => 0.0908, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.19% (1.0986 => 0.9427, std.dev.: 0.0098) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.77% (0.4074 => 0.3513, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: -13.77% (1.0220 => 0.8813, std.dev.: 0.0107) MultiSource/Applications/aha/aha: -13.35% (0.1378 => 0.1194, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -12.65% (1.5979 => 1.3958, std.dev.: 0.0206) MultiSource/Applications/hexxagon/hexxagon: -11.83% (1.1433 => 1.0081, std.dev.: 0.0081) MultiSource/Applications/treecc/treecc: -11.12% (2.4719 => 2.1971, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.50% (6.4235 => 5.7488, std.dev.: 0.1098) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.06% (10.2703 => 9.2371, std.dev.: 0.0859) MultiSource/Applications/lua/lua: -9.97% (4.6406 => 4.1779, std.dev.: 0.0492) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.94% (1.2154 => 1.0946, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.80% (0.7693 => 0.6939, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.64% (0.1317 => 0.1190, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -9.62% (0.3598 => 0.3252, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.55% (1.5131 => 1.3686, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: -9.44% (0.1610 => 0.1458, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.26% (1.3924 => 1.2634, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.19% (0.2481 => 0.2253, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -8.98% (17.5634 => 15.9866, std.dev.: 0.1016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.77% (0.2372 => 0.2164, std.dev.: 0.0020) MultiSource/Applications/siod/siod: -8.76% (2.6437 => 2.4121, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: -8.66% (0.8653 => 0.7904, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: -8.49% (17.4365 => 15.9557, std.dev.: 0.0394) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.17% (0.9588 => 0.8805, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.09% (1.6874 => 1.5509, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.94% (1.1498 => 1.0585, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.89% (0.9124 => 0.8404, std.dev.: 0.0019) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.86% (1.1731 => 1.0809, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.30% (0.3560 => 0.3300, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -7.28% (3.7840 => 3.5086, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.99% (0.6885 => 0.6404, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -6.73% (0.2006 => 0.1871, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.54% (0.5746 => 0.5370, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -6.05% (0.2100 => 0.1973, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.91% (1.3310 => 1.2524, std.dev.: 0.0115) MultiSource/Applications/lemon/lemon: -5.58% (1.3979 => 1.3199, std.dev.: 0.0136) MultiSource/Applications/viterbi/viterbi: -5.48% (0.1824 => 0.1724, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.45% (1.8127 => 1.7139, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.15% (5.0381 => 4.7784, std.dev.: 0.0427) SingleSource/Benchmarks/Linpack/linpack-pc: -5.14% (0.2566 => 0.2434, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.08% (0.7693 => 0.7302, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.85% (0.2884 => 0.2744, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: -4.79% (1.4392 => 1.3702, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.67% (0.9550 => 0.9104, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.51% (0.2618 => 0.2500, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.19% (0.3462 => 0.3317, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.18% (1.0234 => 0.9806, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.11% (1.3220 => 1.2676, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.86% (0.9422 => 0.9058, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.53% (0.9405 => 0.9073, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.52% (0.5369 => 0.5180, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -3.48% (4.5936 => 4.4339, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.41% (0.8990 => 0.8683, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.27% (0.9127 => 0.8829, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.22% (0.9091 => 0.8798, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.20% (0.9788 => 0.9475, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: -3.13% (16.4479 => 15.9323, std.dev.: 0.0703) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4689 => 0.4545, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.03% (0.9993 => 0.9690, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: -3.01% (0.3715 => 0.3603, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.96% (1.0052 => 0.9754, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.95% (4.6579 => 4.5206, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.77% (14.9757 => 14.5605, std.dev.: 0.1486) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.77% (1.2680 => 1.2329, std.dev.: 0.0100) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.49% (7.2721 => 7.0907, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.37% (0.9512 => 0.9287, std.dev.: 0.0018) MultiSource/Applications/JM/ldecod/ldecod: -2.36% (7.3529 => 7.1795, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.19% (0.9488 => 0.9280, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.19% (0.6934 => 0.6782, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.19% (1.0860 => 1.0622, std.dev.: 0.0069) MultiSource/Applications/oggenc/oggenc: -2.08% (5.3553 => 5.2439, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.68% (1.0088 => 0.9919, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.54% (0.9685 => 0.9536, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.51% (4.9104 => 4.8363, std.dev.: 0.0172) MultiSource/Applications/JM/lencod/lencod: -1.51% (16.7012 => 16.4495, std.dev.: 0.0621) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.47% (0.9855 => 0.9710, std.dev.: 0.0043) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.11% (0.9372 => 0.6456, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: -22.71% (7.9891 => 6.1749, std.dev.: 0.1401) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.06% (1.0816 => 0.8646, std.dev.: 0.0233) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.47% (2.8778 => 2.3464, std.dev.: 0.1185) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.84% (1.5623 => 1.2836, std.dev.: 0.0215) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.92% (1.4235 => 1.2538, std.dev.: 0.0240) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -11.91% (1.4588 => 1.2850, std.dev.: 0.0373) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.24% (0.4081 => 0.3663, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/nestedloop: -10.23% (0.2200 => 0.1975, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.09% (23.3986 => 21.5059, std.dev.: 0.3352) MultiSource/Applications/SPASS/SPASS: -7.93% (9.0650 => 8.3465, std.dev.: 0.0607) MultiSource/Benchmarks/Olden/health/health: -6.65% (0.3654 => 0.3411, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/lists1: -6.59% (0.6628 => 0.6191, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.43% (46.0987 => 43.5955, std.dev.: 0.3006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.03% (0.3201 => 0.3040, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.75% (0.3349 => 0.3190, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.94% (1.4446 => 1.3877, std.dev.: 0.0206) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.89% (2.5170 => 2.4192, std.dev.: 0.0374) MultiSource/Applications/SIBsim4/SIBsim4: -3.63% (3.5443 => 3.4157, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/lists: -3.25% (17.2182 => 16.6586, std.dev.: 0.1364) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.21% (16.6791 => 16.1431, std.dev.: 0.1038) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.15% (40.4729 => 39.1972, std.dev.: 0.2042) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.08% (0.3406 => 0.3301, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.85% (0.5826 => 0.5660, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.44% (3.0082 => 2.9348, std.dev.: 0.0100) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.99% (3.7662 => 3.6911, std.dev.: 0.0133) SingleSource/Benchmarks/SmallPT/smallpt: -1.30% (14.9448 => 14.7499, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.21% (3.1921 => 3.1535, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.20% (4.2843 => 4.2328, std.dev.: 0.0165) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.80% (1.2047 => 1.1228, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0008) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1530 => 0.1459, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -39.83% (1.9293 => 1.1609, std.dev.: 0.0032) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.86% (0.4049 => 0.3933, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.1510 => 0.1443, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.0978 => 0.0933, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.51% (0.0590 => 0.0528, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.26% (1.1617 => 1.1471, std.dev.: 0.1037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -48.15% (0.0027 => 0.0014, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.26% (0.0610 => 0.0584, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.33% (0.0268 => 0.0293, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.01% (0.7437 => 0.7362, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7545, std.dev.: 0.0545) Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 21:10:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 22 Jan 2013 23:10:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123051045.3A3CE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7849?compare_to=7845&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7849, Order: 173222, Start Time: 2013-01-23 03:37:02, End Time: 2013-01-23 05:10:59 To: 7845, Order: 173215, Start Time: 2013-01-23 01:39:33, End Time: 2013-01-23 03:13:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (107 on baseline) Performance Improvements: 1 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 2.80% (9.8305 => 10.1056, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.10% (1.2157 => 1.2412, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.80% (0.7660 => 0.7522, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.42% (0.6395 => 0.8788, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.32% (0.6260 => 0.8283, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.09% (0.5688 => 0.7513, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.78% (0.5849 => 0.7708, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.49% (0.6395 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.43% (0.5575 => 0.7327, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.30% (0.5581 => 0.7328, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.42% (0.5941 => 0.7748, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.92% (0.5859 => 0.7612, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.67% (0.6033 => 0.7823, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.90% (0.6440 => 0.8301, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.64% (1.6474 => 2.1192, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.33% (0.6676 => 0.8567, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.31% (0.6189 => 0.7941, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.40% (0.6230 => 0.7937, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.58% (0.5802 => 0.7344, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.22% (0.6660 => 0.8406, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.17% (0.5705 => 0.7198, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.83% (0.5857 => 0.7370, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.79% (0.5925 => 0.7453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.39% (0.5570 => 0.6984, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.34% (0.5478 => 0.6866, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.10% (0.5569 => 0.6967, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.08% (0.5591 => 0.6993, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.91% (0.5863 => 0.7265, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.67% (0.6446 => 0.7972, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.61% (0.6052 => 0.7481, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.51% (0.7524 => 0.9293, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.89% (0.6681 => 0.8210, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.68% (0.6194 => 0.7599, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.17% (0.6297 => 0.7693, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.57% (2.2587 => 2.7460, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.10% (0.6667 => 0.8074, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.62% (0.7339 => 0.8779, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.09% (1.1450 => 1.3178, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.21% (4.5069 => 5.0574, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.14% (0.4916 => 0.5513, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.87% (0.4515 => 0.5051, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.64% (3.5339 => 3.9452, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.31% (1.6364 => 1.8215, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.85% (0.1982 => 0.2197, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1230 => 0.1363, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.51% (9.2283 => 10.1056, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 8.25% (1.2515 => 1.3548, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.98% (0.5329 => 0.5754, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.74% (0.4524 => 0.4874, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.18% (1.4642 => 1.5693, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 7.16% (0.4861 => 0.5209, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.14% (0.7021 => 0.7522, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.94% (1.2784 => 1.3671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.81% (0.3255 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.82% (0.3319 => 0.3479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (5.4682 => 5.6892, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/bigfib: 3.93% (0.6750 => 0.7015, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 3.64% (5.0226 => 5.2055, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4265, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 2.63% (0.8418 => 0.8639, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.22% (0.9557 => 0.9769, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.18% (0.7447 => 0.7609, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.90% (15.5079 => 15.8023, std.dev.: 0.0057) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (22.4056 => 22.8270, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3722 => 1.3958, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5518, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8014, std.dev.: 0.0106) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.50% (0.9531 => 1.0341, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4155, std.dev.: 0.1365) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0062) MultiSource/Benchmarks/llubenchmark/llu: 2.25% (3.7435 => 3.8277, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3817, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5320 => 4.6129, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.57% (2.4924 => 2.3784, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.25% (0.3837 => 0.3674, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.86% (0.7198 => 0.6920, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.73% (0.3812 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3848 => 0.3708, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.63% (0.9852 => 0.9494, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: -3.58% (0.3880 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.55% (0.3323 => 0.3205, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.55% (0.3891 => 0.3753, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.55% (0.4033 => 0.3890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.52% (0.3831 => 0.3696, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3896 => 0.3761, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.4176 => 0.4036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.14% (0.3884 => 0.3762, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.98% (1.3148 => 1.2756, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -2.91% (0.6347 => 0.6162, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.69% (2.1713 => 2.1129, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.65% (0.6484 => 0.6312, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2390, std.dev.: 0.0179) SingleSource/UnitTests/ObjC++/property-reference-object: -2.53% (0.6441 => 0.6278, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4280 => 0.4172, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.43% (0.4151 => 0.4050, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.39% (0.9542 => 0.9314, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.04% (0.7779 => 0.7620, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.83% (14.2083 => 13.9481, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.69% (0.7919 => 0.7785, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.46% (16.1920 => 15.9553, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -1.45% (17.1032 => 16.8557, std.dev.: 0.0220) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.41% (6.7716 => 6.6763, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.36% (1.0544 => 1.0401, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: -1.30% (4.3330 => 4.2766, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.20% (1.2210 => 1.2064, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.15% (1.2221 => 1.2081, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -1.05% (7.0961 => 7.0213, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.10% (1.8100 => 0.7041, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7542, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0747, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1279, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3555, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.56% (1.3096 => 1.2761, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.47% (7.9763 => 7.7793, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.21% (3.7241 => 3.6417, std.dev.: 0.0152) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4657, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1909, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6115, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6219 => 1.6036, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.10% (3.7092 => 3.6683, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.02% (1.6086 => 1.5922, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.25s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 22:56:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 00:56:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123065629.71FF82A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7850?compare_to=7847&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7850, Order: 173224, Start Time: 2013-01-23 04:45:49, End Time: 2013-01-23 06:56:41 To: 7847, Order: 173218, Start Time: 2013-01-23 02:04:45, End Time: 2013-01-23 04:15:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (214 on baseline) Performance Improvements: 1 (68 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 2.92% (11.6167 => 11.9561, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.18% (1.3600 => 1.3896, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 1.98% (10.9493 => 11.1666, std.dev.: 0.0105) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.59% (0.8592 => 0.8455, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.61% (0.0656 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8530 => 499.8484, std.dev.: 0.0099) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.59% (1.1277 => 499.8484, std.dev.: 0.0099) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.80% (0.5229 => 1.6461, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 20.53% (14.9895 => 18.0667, std.dev.: 0.0189) MultiSource/Applications/kimwitu++/kc: 43.78% (14.1553 => 20.3520, std.dev.: 0.0066) MultiSource/Benchmarks/MallocBench/gs/gs: 17.83% (4.1105 => 4.8435, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.51% (1.1048 => 1.7291, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 427.62% (7.1582 => 37.7681, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.71% (3.4629 => 6.4310, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.99% (0.6222 => 1.0888, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10277.08% (0.0720 => 7.4715, std.dev.: 0.0092) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 11152100.00% (0.0001 => 11.1522, std.dev.: 0.0711) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490200.00% (0.0001 => 5.4903, std.dev.: 0.0451) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.39% (1.1194 => 10.2133, std.dev.: 0.0073) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 148.80% (22.1758 => 55.1733, std.dev.: 0.0230) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.09% (0.1463 => 0.2503, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 59.64% (0.0394 => 0.0629, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.61% (2.9384 => 4.6311, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.87% (7.0540 => 10.9245, std.dev.: 0.0140) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.08% (1.5859 => 2.3959, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.98% (8.1363 => 11.9588, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.31% (2.2024 => 3.1122, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops: 39.46% (0.1432 => 0.1997, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 39.31% (0.3109 => 0.4331, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.76% (21.9371 => 30.4398, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0031) SingleSource/UnitTests/vla: 36.62% (0.0355 => 0.0485, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.06% (4.2646 => 5.6744, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.52% (0.4615 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.26% (1.5415 => 2.0388, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.25% (0.2271 => 0.2958, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 29.38% (0.4299 => 0.5562, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.37% (1.1642 => 1.5061, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.52% (0.0636 => 0.0811, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.13% (0.5105 => 0.6490, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.67% (0.6675 => 0.8455, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0014) MultiSource/Benchmarks/mafft/pairlocalalign: 26.06% (9.4845 => 11.9561, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.61% (3.8922 => 4.8888, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.02% (0.1143 => 0.1429, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 24.34% (0.4289 => 0.5333, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.29% (1.0722 => 1.3326, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.1337 => 0.1661, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.84% (1.4186 => 1.7568, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 23.59% (0.4620 => 0.5710, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.29% (0.0730 => 0.0900, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.89% (0.1695 => 0.2083, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.09% (0.7115 => 0.8687, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.89% (0.2700 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.73% (0.0672 => 0.0818, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.40% (0.3098 => 0.3761, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.92% (0.7835 => 0.9474, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.70% (1.3050 => 1.5752, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 20.60% (0.6456 => 0.7786, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.43% (5.7591 => 6.9354, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.69% (0.5860 => 0.7014, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.45% (4.9449 => 5.9068, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.29% (0.8172 => 0.9748, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bisort/bisort: 19.22% (0.0614 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.88% (3.3354 => 3.9650, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9434, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.23% (0.5020 => 0.5935, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.92% (0.7433 => 0.8765, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.78% (0.9765 => 1.1501, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.69% (0.5569 => 0.6554, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.37% (1.1840 => 1.3897, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 17.37% (3.8723 => 4.5450, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.16% (1.1861 => 1.3896, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.13% (2.0273 => 2.3745, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 17.12% (0.3423 => 0.4009, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.94% (0.5981 => 0.6994, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.58% (2.2969 => 2.6778, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.51% (0.3441 => 0.4009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.49% (0.3232 => 0.3765, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.18% (0.0933 => 0.1084, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.13% (0.8101 => 0.9408, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.74% (0.6450 => 0.7465, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320) MultiSource/Benchmarks/McCat/09-vor/vor: 15.25% (0.3180 => 0.3665, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.8921 => 1.0266, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.38% (0.8067 => 0.9227, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary2: 14.35% (0.3379 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.10% (0.3865 => 0.4410, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.11% (0.4636 => 0.5244, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.06% (0.4203 => 0.4752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.92% (0.4103 => 0.4633, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 12.65% (1.5603 => 1.7577, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 12.52% (0.3603 => 0.4054, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 12.13% (0.4048 => 0.4539, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.07% (0.3422 => 0.3835, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 12.02% (0.3927 => 0.4399, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.86% (17.1811 => 19.2187, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/lists1: 11.70% (0.3684 => 0.4115, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.56% (0.2430 => 0.2711, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.19% (0.3826 => 0.4254, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 11.00% (0.3828 => 0.4249, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.80% (0.4064 => 0.4503, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (14.3668 => 15.9045, std.dev.: 0.0155) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.50% (0.3694 => 0.4082, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.38% (0.3497 => 0.3860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.67% (2.0665 => 2.2664, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.52% (0.1114 => 0.1220, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.51% (0.2871 => 0.3144, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.43% (0.2905 => 0.3179, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.21% (0.2877 => 0.3142, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.10% (1.2842 => 1.4010, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.06% (0.2891 => 0.3153, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.05% (0.2872 => 0.3132, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.01% (0.3650 => 0.3979, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.91% (0.6030 => 0.6567, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.78% (0.2756 => 0.2998, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7326 => 0.7966, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.57% (0.2802 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.52% (63.2438 => 68.6325, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.49% (0.2793 => 0.3030, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.46% (0.3935 => 0.4268, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.46% (0.5925 => 0.6426, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.40% (0.2714 => 0.2942, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.3136 => 0.3392, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.81% (2.2022 => 2.3742, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 7.71% (10.3673 => 11.1666, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.23% (0.4879 => 0.5183, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.31% (7.9617 => 8.1458, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4781, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2453, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.55% (4.2280 => 4.4626, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.83% (0.9957 => 1.0338, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9220, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.97% (3.6395 => 3.7111, std.dev.: 0.0121) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2864, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2416, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.61% (5.2763 => 1.1813, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.30% (0.8651 => 0.2137, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.73% (5.3855 => 4.4846, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.08% (5.3526 => 4.4919, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: -13.40% (10.4361 => 9.0377, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.26% (1.7609 => 1.6155, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9028, std.dev.: 0.0506) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.73% (1.9577 => 0.6513, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4124, std.dev.: 0.0127) MultiSource/Benchmarks/PAQ8p/paq8p: -24.95% (85.0658 => 63.8397, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0036, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0919, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.34% (0.2161 => 0.1743, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.34% (19.9488 => 18.2842, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7041, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2373 => 1.1659, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6992, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -4.67% (10.2830 => 9.8024, std.dev.: 0.0256) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6561, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.51% (3.6994 => 3.6435, std.dev.: 0.0180) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.6441 => 4.5853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2313, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8566, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0000) Report Time: 1.43s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 23:07:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 01:07:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123070747.608E12A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7851?compare_to=7849&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7851, Order: 173224, Start Time: 2013-01-23 05:34:19, End Time: 2013-01-23 07:08:01 To: 7849, Order: 173222, Start Time: 2013-01-23 03:37:02, End Time: 2013-01-23 05:10:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 1 (100 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.18% (3.8277 => 3.7442, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.45% (0.6395 => 0.8790, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.08% (0.0418 => 0.0573) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.35% (0.5456 => 0.7221, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.33% (0.6260 => 0.8284, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.31% (0.5688 => 0.7526, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.23% (0.5805 => 0.7676, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.90% (0.5849 => 0.7715, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.49% (0.6395 => 0.8409, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.35% (0.5575 => 0.7323, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.27% (0.5581 => 0.7326, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.26% (0.5567 => 0.7307, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.26% (0.5941 => 0.7739, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.89% (0.6033 => 0.7836) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.70% (0.5859 => 0.7599, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.91% (0.6440 => 0.8302, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.66% (1.6474 => 2.1195, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.56% (0.6230 => 0.7947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.51% (0.6304 => 0.8038, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.46% (0.5802 => 0.7337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.35% (0.6660 => 0.8415, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.99% (0.5705 => 0.7188, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.87% (0.5925 => 0.7458, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.68% (0.5857 => 0.7361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.52% (0.5478 => 0.6876, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.28% (0.5570 => 0.6978, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.26% (0.5569 => 0.6976, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.95% (0.5591 => 0.6986, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.81% (0.5863 => 0.7259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.80% (0.6446 => 0.7980, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.56% (0.6052 => 0.7478, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.47% (0.7524 => 0.9290, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.11% (0.6681 => 0.8225, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.72% (0.6194 => 0.7601, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.26% (2.2587 => 2.7614, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.11% (0.6297 => 0.7689, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.16% (0.6667 => 0.8078, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.42% (0.7339 => 0.8764, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 15.17% (1.1450 => 1.3187) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.28% (4.5069 => 5.0603, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.00% (0.4916 => 0.5506, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.67% (0.4515 => 0.5042, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.54% (3.5339 => 3.9416, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.29% (1.6364 => 1.8212, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.89% (0.1230 => 0.1364, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.70% (0.1982 => 0.2194, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.60% (9.2283 => 10.1141, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 8.28% (1.2515 => 1.3551, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.92% (0.5329 => 0.5751, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 7.71% (0.4524 => 0.4873, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.45% (0.1731 => 0.1860, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.18% (0.7021 => 0.7525, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4861 => 0.5207, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.4642 => 1.5681, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.80% (1.2784 => 1.3653, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3255 => 0.3445, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.73% (0.3319 => 0.3476, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6750 => 0.7035, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.10% (5.4682 => 5.6924, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 3.64% (5.0226 => 5.2052, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.3864 => 1.4246, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 2.42% (0.8418 => 0.8622, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 2.27% (0.7447 => 0.7616, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.9557 => 0.9764, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (22.4056 => 22.8460, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.76% (1.3722 => 1.3964, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 1.73% (15.5079 => 15.7755, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8024, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.40% (0.9531 => 1.0332, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3671, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5797, std.dev.: 0.1424) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0031) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3831, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.91% (4.5320 => 4.6184, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.60% (2.4924 => 2.3778, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.25% (0.3837 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.99% (0.7198 => 0.6911, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.73% (0.3812 => 0.3670, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.71% (0.3831 => 0.3689, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.63% (0.9852 => 0.9494, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/exceptions-3: -3.61% (0.3848 => 0.3709, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.61% (0.3880 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.59% (0.3896 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.55% (0.3891 => 0.3753, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.55% (0.4033 => 0.3890, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.38% (0.4176 => 0.4035, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.28% (0.3205 => 0.3100, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.21% (0.3142 => 0.3041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.97% (2.1713 => 2.1069, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.92% (1.3148 => 1.2764, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -2.82% (0.6347 => 0.6168, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.73% (0.6484 => 0.6307, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2423, std.dev.: 0.0318) SingleSource/UnitTests/ObjC++/property-reference-object: -2.56% (0.6441 => 0.6276, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4280 => 0.4171, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: -2.43% (0.4151 => 0.4050, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.41% (0.9542 => 0.9312, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.38% (0.7779 => 0.7594, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.92% (14.2083 => 13.9349, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.76% (0.7919 => 0.7780, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.52% (17.1032 => 16.8429, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: -1.51% (16.1920 => 15.9473, std.dev.: 0.0149) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.48% (6.7716 => 6.6715, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.44% (1.0544 => 1.0392, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -1.34% (4.3330 => 4.2751, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.24% (1.2221 => 1.2070, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.21% (1.2210 => 1.2062, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (7.0961 => 7.0148, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.94% (1.8100 => 0.6888, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0271, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0794, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1981, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1304, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6341, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.34% (7.9763 => 7.7897, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6387, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3040 => 7.1850, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.20% (1.6219 => 1.6024, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.15% (1.6307 => 1.6119, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 22 23:15:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 01:15:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123071529.CE5142A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7852?compare_to=7848&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7852, Order: 173224, Start Time: 2013-01-23 05:13:56, End Time: 2013-01-23 07:15:45 To: 7848, Order: 173222, Start Time: 2013-01-23 02:57:34, End Time: 2013-01-23 04:56:44 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (3 on baseline) Performance Improvements: 0 (28 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1062 (1032 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.27% (0.6598 => 0.6814, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.26% (3.4757 => 3.5195, std.dev.: 0.0139) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.17% (1.1228 => 1.1097, std.dev.: 0.1457) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0223 => 0.0224, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0433 => 0.0432, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0335 => 0.0336, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0319 => 0.0318, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/casts: -0.96% (0.0208 => 0.0206, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.64% (0.1459 => 0.1483, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 3.04% (1.1609 => 1.1962, std.dev.: 0.3817) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.45% (0.3933 => 0.3990, std.dev.: 0.0793) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.21% (0.1443 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.89% (0.0933 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.93% (0.0263 => 0.0229, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.98% (0.0528 => 0.0549, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.64% (1.1471 => 1.1544, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.94% (0.0584 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.53% (0.0293 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.60% (0.7362 => 0.7406, std.dev.: 0.0018) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 144.00% (0.0050 => 0.0122, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7545 => 12.7464, std.dev.: 0.2866) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324012.50% (0.0008 => 2.5929, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.51% (1.1825 => 2.3119, std.dev.: 0.0720) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.32% (0.2562 => 0.2852, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.15% (0.0727 => 0.0486, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0046) SingleSource/Benchmarks/SmallPT/smallpt: -27.28% (0.1888 => 0.1373, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -25.89% (0.1684 => 0.1248, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.38% (0.0676 => 0.0545, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.88% (1.0986 => 0.9461, std.dev.: 0.0262) MultiSource/Applications/hexxagon/hexxagon: -10.57% (1.1433 => 1.0225, std.dev.: 0.0238) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.38% (1.3924 => 1.2478, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.46% (6.4235 => 5.8159, std.dev.: 0.1209) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.16% (0.7693 => 0.7296, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.18% (1.3220 => 1.2668, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.67% (0.7225 => 0.7104, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -10.63% (1.4588 => 1.3037, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/nestedloop: -8.95% (0.2200 => 0.2003, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.56% (23.3986 => 21.3947, std.dev.: 0.6036) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.44% (0.3201 => 0.2963, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.83% (1.4446 => 1.3893, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists: -3.38% (17.2182 => 16.6360, std.dev.: 0.1048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.71% (0.5826 => 0.5668, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.33% (3.5669 => 3.5195, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3152, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ReedSolomon: -1.29% (8.6447 => 8.5332, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1543, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/fibo: -1.07% (4.3512 => 4.3045, std.dev.: 0.0080) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.89% (1.2047 => 1.1097, std.dev.: 0.1457) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.07% (0.1530 => 0.1483, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -38.00% (1.9293 => 1.1962, std.dev.: 0.3817) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.46% (0.4049 => 0.3990, std.dev.: 0.0793) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.64% (0.1510 => 0.1440, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.84% (0.0978 => 0.0960, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.03% (0.0276 => 0.0229, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.95% (0.0590 => 0.0549, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.63% (1.1617 => 1.1544, std.dev.: 0.0424) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0018) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.25% (12.7781 => 12.7464, std.dev.: 0.2866) Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 00:40:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 02:40:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130123084018.7B6192A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7853?compare_to=7846&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7853, Order: 173224, Start Time: 2013-01-23 04:52:59, End Time: 2013-01-23 08:40:31 To: 7846, Order: 173204, Start Time: 2013-01-23 00:25:30, End Time: 2013-01-23 04:00:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (757 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.93% (0.1753 => 0.1857, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 54.88% (0.0625 => 0.0968, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 43.10% (0.0239 => 0.0342, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 42.90% (0.1063 => 0.1519, std.dev.: 0.0087) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 41.67% (0.0240 => 0.0340, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 36.21% (0.0475 => 0.0647, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 36.07% (0.2969 => 0.4040, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.02% (0.5900 => 0.8025, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 33.09% (0.1106 => 0.1472, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 31.81% (0.0415 => 0.0547, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.66% (0.0897 => 0.1181, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.95% (0.0714 => 0.0935, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 30.79% (0.1549 => 0.2026, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 30.08% (0.4994 => 0.6496, std.dev.: 0.0221) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.88% (0.5000 => 0.6494, std.dev.: 0.0241) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.36% (0.1107 => 0.1432, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.83% (0.0822 => 0.1059, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.02% (0.1462 => 0.1857, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.77% (0.4139 => 0.5247, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.93% (0.1620 => 0.2040, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.91% (0.4253 => 0.5355, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.47% (0.3271 => 0.4104, std.dev.: 0.0170) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.13% (0.3903 => 0.4884, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.12% (0.3890 => 0.4867, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 24.95% (0.0541 => 0.0676, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.78% (0.0452 => 0.0564, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 24.21% (0.0599 => 0.0744, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.12% (0.2736 => 0.3396, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/em3d/em3d: 23.95% (0.0948 => 0.1175, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.75% (0.1103 => 0.1365, std.dev.: 0.0065) MultiSource/Applications/oggenc/oggenc: 23.39% (1.5932 => 1.9658, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.43% (0.0584 => 0.0715, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.93% (0.1003 => 0.1223, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.81% (0.0642 => 0.0782, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.43% (1.3152 => 1.5970, std.dev.: 0.0559) MultiSource/Benchmarks/Olden/health/health: 21.32% (0.0821 => 0.0996, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/05-eks/eks: 21.12% (0.1619 => 0.1961, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 20.68% (0.4029 => 0.4862, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.45% (0.2866 => 0.3452, std.dev.: 0.0149) MultiSource/Applications/viterbi/viterbi: 20.17% (0.0947 => 0.1138, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.13% (0.1088 => 0.1307, std.dev.: 0.0056) MultiSource/Applications/sgefa/sgefa: 19.93% (0.0808 => 0.0969, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 19.79% (0.1218 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.45% (0.1090 => 0.1302, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.40% (0.1160 => 0.1385, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.36% (0.2014 => 0.2404, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.27% (1.9694 => 2.3490, std.dev.: 0.0584) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.26% (0.4658 => 0.5555, std.dev.: 0.0243) MultiSource/Benchmarks/McCat/09-vor/vor: 19.14% (0.1505 => 0.1793, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.03% (1.9966 => 2.3766, std.dev.: 0.0558) MultiSource/Applications/Burg/burg: 18.97% (0.5546 => 0.6598, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 18.91% (1.8794 => 2.2348, std.dev.: 0.0981) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.85% (0.1968 => 0.2339, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/bh/bh: 18.61% (0.1284 => 0.1523, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.60% (0.5026 => 0.5961, std.dev.: 0.0222) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.53% (0.0572 => 0.0678) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.98% (1.6211 => 1.9126, std.dev.: 0.0631) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.46% (3.5627 => 4.1849, std.dev.: 0.1453) SingleSource/UnitTests/ObjC++/Hello: 17.39% (0.5826 => 0.6839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 17.15% (0.5889 => 0.6899, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.15% (0.2811 => 0.3293, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 17.08% (0.9697 => 1.1353, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: 17.03% (0.2813 => 0.3292, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.00% (0.3930 => 0.4598, std.dev.: 0.0156) MultiSource/Benchmarks/McCat/18-imp/imp: 16.96% (0.1421 => 0.1662, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.94% (0.2911 => 0.3404, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/objinst: 16.93% (0.2823 => 0.3301, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.88% (0.3004 => 0.3511, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 16.88% (0.2714 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 16.84% (0.2750 => 0.3213, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.73% (0.2792 => 0.3259, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 16.69% (0.2780 => 0.3244, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.67% (0.3060 => 0.3570, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.65% (0.2738 => 0.3194, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 16.65% (1.0781 => 1.2576, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/random: 16.63% (0.2803 => 0.3269, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.56% (2.0673 => 2.4096, std.dev.: 0.0451) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.51% (0.4361 => 0.5081, std.dev.: 0.0264) MultiSource/Applications/hexxagon/hexxagon: 16.48% (0.9909 => 1.1542, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.42% (0.2729 => 0.3177, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 16.27% (0.7171 => 0.8338, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.24% (0.3195 => 0.3714, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.15% (4.4195 => 5.1333, std.dev.: 0.0956) SingleSource/Benchmarks/Shootout-C++/ary3: 16.07% (0.3267 => 0.3792, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.06% (0.2566 => 0.2978, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/wc: 16.05% (0.3096 => 0.3593, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 16.05% (0.2075 => 0.2408, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary: 16.02% (0.3258 => 0.3780, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 16.00% (23.5202 => 27.2830, std.dev.: 0.0858) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.72% (0.3625 => 0.4195, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.71% (0.3317 => 0.3838, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 15.69% (4.2109 => 4.8714, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.68% (0.3362 => 0.3889, std.dev.: 0.0109) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.65% (0.3124 => 0.3613, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/sieve: 15.62% (0.3726 => 0.4308, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.47% (0.3348 => 0.3866, std.dev.: 0.0044) MultiSource/Applications/lua/lua: 15.39% (1.4269 => 1.6465, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.39% (0.3282 => 0.3787, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/lists1: 15.36% (0.3477 => 0.4011, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.30% (0.0673 => 0.0776, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.28% (2.7292 => 3.1461, std.dev.: 0.0985) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.18% (0.2068 => 0.2382, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: 15.17% (0.3678 => 0.4236, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 15.01% (0.4251 => 0.4889, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 14.93% (0.4146 => 0.4765, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.88% (0.3690 => 0.4239, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.75% (0.3981 => 0.4568, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 14.58% (0.7875 => 0.9023, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.41% (0.3845 => 0.4399, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.40% (0.1028 => 0.1176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 14.23% (0.5012 => 0.5725, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 13.84% (5.5417 => 6.3089, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: 13.59% (2.1653 => 2.4596, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.57% (0.6435 => 0.7308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 13.24% (0.3496 => 0.3959, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 13.17% (0.3446 => 0.3900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 13.17% (0.3469 => 0.3926, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 13.13% (0.3442 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.12% (0.3460 => 0.3914, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 12.93% (0.2691 => 0.3039, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.85% (0.3643 => 0.4111, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.82% (0.2737 => 0.3088, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.81% (0.3724 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 12.44% (4.6177 => 5.1923, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 12.39% (2.1013 => 2.3617, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.11% (0.5361 => 0.6010, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.04% (0.3498 => 0.3919, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.93% (0.3084 => 0.3452, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.70% (0.2103 => 0.2349, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 11.68% (0.6634 => 0.7409, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 11.51% (0.3336 => 0.3720, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.47% (0.2040 => 0.2274, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 11.26% (0.4847 => 0.5393, std.dev.: 0.0160) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.96% (0.7426 => 0.8240, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.83% (11.6398 => 12.9005, std.dev.: 0.0417) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.22% (4.6926 => 5.1724, std.dev.: 0.0048) MultiSource/Applications/lemon/lemon: 10.00% (0.2391 => 0.2630, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.62% (0.5584 => 0.6121, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 9.39% (2.0346 => 2.2257, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 7.69% (11.9555 => 12.8752, std.dev.: 0.0089) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3792 => 0.3941, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.80% (29.0505 => 181.5088, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0275) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 15.75% (0.5917 => 0.6849, std.dev.: 0.0289) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6095, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6785, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2372, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6807, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8859, std.dev.: 0.0081) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.07% (3.3991 => 3.5035, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: 3.00% (0.6276 => 0.6464, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1948, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.46% (1.0927 => 1.1086, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2880, std.dev.: 0.0146) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.43% (1.0142 => 1.0287, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.30% (2.0820 => 2.1091, std.dev.: 0.0075) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2094, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0016) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5929, std.dev.: 0.0247) MultiSource/Applications/sqlite3/sqlite3: 1.06% (10.3705 => 10.4802, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.83% (2.4764 => 2.4063, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5664, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.53% (17.2379 => 14.2165, std.dev.: 0.0733) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.79% (0.2402 => 0.2215, std.dev.: 0.0015) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9743, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8020, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9594, std.dev.: 0.0122) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.25% (14.0481 => 13.4504, std.dev.: 0.2069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2258, std.dev.: 0.0090) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7959, std.dev.: 0.0062) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1610, std.dev.: 0.0558) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5712, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.44% (5.5810 => 5.5006, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (105.3826 => 104.1026, std.dev.: 0.0894) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0474, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 01:09:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 03:09:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123090932.036EC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7854?compare_to=7851&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7854, Order: 173231, Start Time: 2013-01-23 07:31:34, End Time: 2013-01-23 09:09:45 To: 7851, Order: 173224, Start Time: 2013-01-23 05:34:19, End Time: 2013-01-23 07:08:01 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 0 (81 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (904 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.88% (3.7442 => 3.8893, std.dev.: 0.0277) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.22% (0.6395 => 0.8775, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.09% (0.6260 => 0.8269, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.02% (0.5805 => 0.7664, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.82% (0.5688 => 0.7498, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.78% (0.5456 => 0.7190, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.61% (0.5849 => 0.7698, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.17% (0.5567 => 0.7302, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.13% (0.6395 => 0.8386, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.12% (0.5581 => 0.7318, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.96% (0.5575 => 0.7301, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.53% (0.5859 => 0.7589, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.21% (0.6033 => 0.7795, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.94% (0.6440 => 0.8304, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.70% (1.6474 => 2.1202, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.89% (0.6676 => 0.8538, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.49% (0.6304 => 0.8037, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.27% (0.6230 => 0.7929, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.32% (0.5802 => 0.7329, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.08% (0.6660 => 0.8397, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.99% (0.5705 => 0.7188, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.97% (0.5925 => 0.7464, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.34% (0.5857 => 0.7341, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.23% (0.5478 => 0.6860, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.17% (0.5570 => 0.6972, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: 24.99% (0.3834 => 0.4792, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.92% (0.5569 => 0.6957, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.84% (0.5591 => 0.6980, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.59% (0.5863 => 0.7246, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.49% (0.6446 => 0.7960, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.37% (0.7524 => 0.9282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.22% (0.6052 => 0.7457, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.11% (0.6681 => 0.8225, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.51% (0.6194 => 0.7588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.23% (0.6297 => 0.7697, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.87% (2.2587 => 2.7527, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.88% (0.6667 => 0.8059, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.20% (0.7339 => 0.8748, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.61% (0.3357 => 0.3881, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.80% (1.1450 => 1.3145, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.17% (4.5069 => 5.0555, std.dev.: 0.0021) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.95% (0.1230 => 0.1377, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 11.87% (0.4515 => 0.5051, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.44% (1.6364 => 1.8236, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.34% (3.5339 => 3.9345, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.49% (0.1982 => 0.2190, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (9.2283 => 10.1171, std.dev.: 0.1796) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.95% (0.2001 => 0.2180, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 8.26% (1.2515 => 1.3549, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.13% (0.5329 => 0.5762, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1731 => 0.1870, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.61% (0.7021 => 0.7555, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.49% (0.4861 => 0.5225, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.18% (1.4642 => 1.5693, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.91% (1.2784 => 1.3667, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.33% (5.4682 => 5.7049, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 4.06% (0.6750 => 0.7024, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 3.64% (5.0226 => 5.2056, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 2.81% (1.3864 => 1.4254, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 2.74% (0.8418 => 0.8649, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.58% (0.9557 => 0.9804, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.47% (0.7447 => 0.7631, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.22% (22.4056 => 22.9032, std.dev.: 0.1638) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5168 => 0.5281, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.11% (15.5079 => 15.8347, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3960, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.18% (1.2300 => 1.2445, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7934, std.dev.: 0.0209) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.17% (0.9531 => 1.0310, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.28% (1.2783 => 1.3714, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 3.89% (3.7435 => 3.8893, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5908, std.dev.: 0.1254) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1065, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3839, std.dev.: 0.1317) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5320 => 4.6139, std.dev.: 0.0024) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2699, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.61% (0.7198 => 0.6866, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.55% (0.3821 => 0.3647, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -4.53% (2.4924 => 2.3794, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.91% (0.3837 => 0.3687, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.73% (0.3831 => 0.3688, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.69% (0.9852 => 0.9488, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.46% (0.3323 => 0.3208, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.14% (0.3884 => 0.3762, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.92% (0.9542 => 0.9263, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.68% (0.6484 => 0.6310, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.62% (2.1713 => 2.1144, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -2.56% (1.3148 => 1.2812, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.02% (14.2083 => 13.9211, std.dev.: 0.0188) MultiSource/Applications/sqlite3/sqlite3: -1.68% (17.1032 => 16.8153, std.dev.: 0.0106) MultiSource/Applications/JM/lencod/lencod: -1.62% (16.1920 => 15.9294, std.dev.: 0.0293) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.26% (1.2210 => 1.2056, std.dev.: 0.0051) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (0.7982 => 0.7882, std.dev.: 0.0023) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.7716 => 6.6941, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.07% (1.2221 => 1.2090, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.26% (1.8100 => 0.6831, std.dev.: 0.0221) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0221, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7579, std.dev.: 0.0213) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0788, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1978, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1314, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0916, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3544, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7685, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4735, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5990, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.39% (1.6307 => 1.6080, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 01:33:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 03:33:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123093308.057202A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7855?compare_to=7852&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7855, Order: 173231, Start Time: 2013-01-23 07:33:01, End Time: 2013-01-23 09:33:22 To: 7852, Order: 173224, Start Time: 2013-01-23 05:13:56, End Time: 2013-01-23 07:15:45 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 9 (6 on baseline) Performance Improvements: 4 (75 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1051 (982 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 11.27% (0.1065 => 0.1185, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.01% (1.0636 => 1.0956, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (4.8160 => 4.8658, std.dev.: 0.0156) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/pi: 11.88% (1.9793 => 2.2144, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.88% (14.9905 => 16.4715, std.dev.: 0.4483) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.73% (2.3119 => 2.4212, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.71% (21.3947 => 21.9753, std.dev.: 0.2080) SingleSource/Benchmarks/Misc/ffbench: 1.32% (1.3838 => 1.4021, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/random: 1.27% (2.4459 => 2.4769, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.71% (8.9725 => 8.7292, std.dev.: 0.0935) MultiSource/Applications/SIBsim4/SIBsim4: -1.57% (1.3939 => 1.3720, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -17.40% (0.0908 => 0.0750, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.99% (2.7818 => 2.6709, std.dev.: 0.0396) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.84% (1.1097 => 1.1190, std.dev.: 0.0797) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.16% (0.0224 => 0.0199, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0432 => 0.0434, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.54% (0.0336 => 0.0267, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.31% (0.0318 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0206 => 0.0208, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -13.12% (0.0221 => 0.0192, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0252 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.03% (0.1483 => 0.1438, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -6.68% (1.1962 => 1.1163, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: - (0.3990 => 0.3990, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.60% (0.1440 => 0.1463, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.06% (0.0960 => 0.0999, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.68% (0.0229 => 0.0242, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.55% (0.0549 => 0.0563, std.dev.: 0.0175) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1544 => 1.1466, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.67% (0.0030 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.08% (0.0607 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0318 => 0.0318, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.23% (0.7406 => 0.7423, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -68.03% (0.0122 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7464 => 12.7454, std.dev.: 0.0251) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 45.83% (0.0336 => 0.0490, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321400.00% (0.0008 => 2.5720, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.75% (1.1825 => 2.4212, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.36% (0.2562 => 0.2853, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/pi: 3.53% (2.1390 => 2.2144, std.dev.: 0.0038) MultiSource/Applications/siod/siod: 1.22% (3.5910 => 3.6349, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.81% (0.0727 => 0.0503, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -24.17% (0.1684 => 0.1277, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: -19.23% (1.8964 => 1.5317, std.dev.: 0.0408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.14% (0.0862 => 0.0697, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.63% (0.1009 => 0.0821, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.68% (0.1079 => 0.0899, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.02% (0.7686 => 0.6455, std.dev.: 0.0083) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.38% (0.4074 => 0.3488, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: -13.57% (1.0220 => 0.8833, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -11.76% (1.0986 => 0.9694, std.dev.: 0.0287) SingleSource/UnitTests/Vector/constpool: -11.71% (9.8875 => 8.7292, std.dev.: 0.0935) MultiSource/Applications/ALAC/encode/alacconvert-encode: -11.65% (1.2154 => 1.0738, std.dev.: 0.0199) MultiSource/Applications/treecc/treecc: -11.49% (2.4719 => 2.1879, std.dev.: 0.0516) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.25% (0.0889 => 0.0789, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -11.03% (0.1378 => 0.1226, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -10.93% (1.1433 => 1.0183, std.dev.: 0.0123) MultiSource/Applications/lua/lua: -10.37% (4.6406 => 4.1595, std.dev.: 0.0274) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.20% (0.2372 => 0.2130, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.05% (1.5131 => 1.3611, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.04% (10.2703 => 9.2390, std.dev.: 0.2638) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.58% (0.7693 => 0.6956, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: -9.16% (17.5634 => 15.9554, std.dev.: 0.2975) MultiSource/Applications/sgefa/sgefa: -8.70% (0.3598 => 0.3285, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.63% (1.6874 => 1.5418, std.dev.: 0.0215) MultiSource/Applications/lambda-0_1_3/lambda: -8.48% (0.8653 => 0.7919, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: -8.39% (17.4365 => 15.9740, std.dev.: 0.2502) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.09% (0.9124 => 0.8386, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: -7.95% (0.1610 => 0.1482, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.58% (0.3560 => 0.3290, std.dev.: 0.0020) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.48% (1.1731 => 1.0854, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.33% (1.1498 => 1.0655, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.29% (0.6885 => 0.6383, std.dev.: 0.0064) MultiSource/Applications/d/make_dparser: -7.20% (3.7840 => 3.5116, std.dev.: 0.0888) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.79% (0.2283 => 0.2128, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/fibo: -6.38% (0.2006 => 0.1878, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -6.18% (1.3979 => 1.3115, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.85% (0.5746 => 0.5410, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.51% (1.8127 => 1.7128, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.04% (0.7693 => 0.7305, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: -4.67% (1.4392 => 1.3720, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.22% (0.6135 => 0.5876, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: -4.21% (0.7776 => 0.7449, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.92% (0.2577 => 0.2476, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.80% (0.9422 => 0.9064, std.dev.: 0.0122) MultiSource/Benchmarks/sim/sim: -3.63% (0.3715 => 0.3580, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.59% (1.0234 => 0.9867, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.42% (5.0381 => 4.8658, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash: -3.22% (0.4689 => 0.4538, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.46% (1.2680 => 1.2368, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.59% (0.6996 => 0.6885, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.87% (0.9372 => 0.6479, std.dev.: 0.0159) MultiSource/Applications/minisat/minisat: -21.98% (7.9891 => 6.2333, std.dev.: 0.1250) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.66% (1.0816 => 0.8581, std.dev.: 0.0499) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.49% (0.1164 => 0.0972, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.17% (0.4081 => 0.3666, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.16% (1.6547 => 1.4866, std.dev.: 0.0252) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.21% (0.3217 => 0.2953, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.28% (0.3201 => 0.2968, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.08% (23.3986 => 21.9753, std.dev.: 0.2080) MultiSource/Applications/SIBsim4/SIBsim4: -3.62% (3.5443 => 3.4159, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/lists: -3.24% (17.2182 => 16.6602, std.dev.: 0.0468) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.85% (0.5826 => 0.5660, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: -2.36% (2.8571 => 2.7897, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.35% (1.0995 => 1.0737, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -1.99% (4.4730 => 4.3839, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: -1.57% (1.4244 => 1.4021, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: -1.52% (8.7416 => 8.6091, std.dev.: 0.0492) SingleSource/Benchmarks/Misc/ReedSolomon: -1.47% (8.6447 => 8.5176, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: -1.43% (63.1520 => 62.2506, std.dev.: 0.2311) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.43% (3.1921 => 3.1466, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/mandel-2: -1.42% (0.8521 => 0.8400, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -1.15% (1.5825 => 1.5643, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.11% (1.2047 => 1.1190, std.dev.: 0.0797) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.59% (0.0233 => 0.0199, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -32.23% (0.0394 => 0.0267, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -15.42% (0.0227 => 0.0192, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.01% (0.1530 => 0.1438, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: -42.14% (1.9293 => 1.1163, std.dev.: 0.0519) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.46% (0.4049 => 0.3990, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.11% (0.1510 => 0.1463, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.15% (0.0978 => 0.0999, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.32% (0.0276 => 0.0242, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.58% (0.0590 => 0.0563, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.30% (1.1617 => 1.1466, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.88% (0.0032 => 0.0001, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.54% (0.0610 => 0.0564, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.19% (0.7437 => 0.7423, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -57.61% (0.0092 => 0.0039, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.26% (12.7781 => 12.7454, std.dev.: 0.0251) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 01:40:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 03:40:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123094036.17C082A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7856?compare_to=7850&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7856, Order: 173231, Start Time: 2013-01-23 07:27:02, End Time: 2013-01-23 09:40:49 To: 7850, Order: 173224, Start Time: 2013-01-23 04:45:49, End Time: 2013-01-23 06:56:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (213 on baseline) Performance Improvements: 0 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (661 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.37% (0.0652 => 0.0674, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8484 => 499.7681, std.dev.: 0.0465) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44217.47% (1.1277 => 499.7681, std.dev.: 0.0465) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.05% (0.5229 => 1.6474, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 20.66% (14.9895 => 18.0864, std.dev.: 0.0245) MultiSource/Applications/kimwitu++/kc: 44.01% (14.1553 => 20.3857, std.dev.: 0.0211) MultiSource/Benchmarks/MallocBench/gs/gs: 18.16% (4.1105 => 4.8568, std.dev.: 0.0265) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.83% (1.1048 => 1.7327, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.17% (7.1582 => 37.8073, std.dev.: 0.0617) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.64% (3.4629 => 6.4287, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.35% (0.6222 => 1.0910, std.dev.: 0.0027) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10284.58% (0.0720 => 7.4769, std.dev.: 0.0280) MultiSource/Applications/SIBsim4/SIBsim4: 3835400.00% (0.0001 => 3.8355, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11174400.00% (0.0001 => 11.1745, std.dev.: 0.2847) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486300.00% (0.0001 => 5.4864, std.dev.: 0.0030) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.93% (1.1194 => 10.3537, std.dev.: 0.3232) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.56% (22.1758 => 55.3426, std.dev.: 0.0296) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 71.22% (0.1463 => 0.2505, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.28% (2.9384 => 4.6214, std.dev.: 0.1088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.32% (7.0540 => 10.8858, std.dev.: 0.0049) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.31% (1.5859 => 2.3996, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 49.24% (0.1056 => 0.1576, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.22% (8.1363 => 11.9784, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.62% (2.2024 => 3.1190, std.dev.: 0.0137) MultiSource/Applications/sgefa/sgefa: 39.53% (0.3109 => 0.4338, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/04-bisect/bisect: 39.45% (0.1062 => 0.1481, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 38.97% (21.9371 => 30.4864, std.dev.: 0.1856) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0010) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.00% (0.4615 => 0.6184, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.27% (4.2646 => 5.6836, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.32% (1.5415 => 2.0397, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 30.59% (0.4299 => 0.5614, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.38% (0.2271 => 0.2961, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 29.69% (1.1642 => 1.5098, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.78% (0.5105 => 0.6523, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.71% (0.1584 => 0.2023, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.35% (0.0479 => 0.0610, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.30% (0.6675 => 0.8497, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.80% (0.1892 => 0.2399, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 26.32% (9.4845 => 11.9811, std.dev.: 0.0137) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 26.27% (0.2554 => 0.3225, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.23% (0.0793 => 0.1001, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.90% (3.8922 => 4.9003, std.dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.81% (0.1906 => 0.2398, std.dev.: 0.0072) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.46% (0.1143 => 0.1434, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: 24.74% (0.0485 => 0.0605, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 24.41% (0.4289 => 0.5336, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 24.31% (1.0722 => 1.3329, std.dev.: 0.0055) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.22% (0.3121 => 0.3877, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.01% (1.4186 => 1.7592, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.70% (0.0730 => 0.0903, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 23.61% (0.4620 => 0.5711, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.19% (0.1695 => 0.2088, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 22.92% (0.7115 => 0.8746, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 22.38% (0.0648 => 0.0793, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 22.07% (0.1151 => 0.1405, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.00% (0.2700 => 0.3294, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/em3d/em3d: 21.47% (0.1695 => 0.2059, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.43% (0.3098 => 0.3762, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.1236 => 0.1499, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 21.21% (0.7835 => 0.9497, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.04% (0.0675 => 0.0817, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.73% (1.3050 => 1.5755, std.dev.: 0.0028) MultiSource/Applications/oggenc/oggenc: 20.65% (5.7591 => 6.9486, std.dev.: 0.0288) SingleSource/Benchmarks/Misc-C++/bigfib: 20.65% (0.6456 => 0.7789, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.62% (0.0834 => 0.1006, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.30% (0.8172 => 0.9831, std.dev.: 0.0535) MultiSource/Benchmarks/Olden/mst/mst: 20.29% (0.1163 => 0.1399, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.10% (0.1940 => 0.2330, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.71% (0.5860 => 0.7015, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.69% (4.9449 => 5.9184, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.40% (0.2758 => 0.3293, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 19.11% (3.3354 => 3.9727, std.dev.: 0.0149) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.97% (5.0018 => 5.9507, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.89% (0.2107 => 0.2505, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.75% (0.3307 => 0.3927, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.5569 => 0.6601, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.51% (0.5020 => 0.5949, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 18.17% (0.3423 => 0.4045, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 18.01% (0.7433 => 0.8772, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.96% (0.9765 => 1.1519, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0053) MultiSource/Applications/lua/lua: 17.90% (3.8723 => 4.5654, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 17.83% (1.1840 => 1.3951, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.48% (0.2065 => 0.2426, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.45% (1.1861 => 1.3931, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 17.28% (2.0273 => 2.3777, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0051) MultiSource/Applications/siod/siod: 16.77% (2.2969 => 2.6820, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.74% (0.3441 => 0.4017, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.43% (0.3232 => 0.3763, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.34% (0.8101 => 0.9425, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.94% (0.6450 => 0.7478, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.26% (0.8921 => 1.0282, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.86% (0.8067 => 0.9266, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3379 => 0.3868, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.10% (0.2603 => 0.2970, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.87% (0.3865 => 0.4401, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.62% (0.4103 => 0.4662, std.dev.: 0.0118) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.57% (0.4636 => 0.5265, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.87% (0.4203 => 0.4744, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 12.87% (1.5603 => 1.7611, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/moments: 12.15% (0.4048 => 0.4540, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3603 => 0.4039, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 12.07% (17.1811 => 19.2545, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/lists: 12.04% (0.3422 => 0.3834, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.04% (0.3282 => 0.3677, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 11.75% (0.3684 => 0.4117, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.56% (0.2430 => 0.2711, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/parameter-passing: 11.48% (0.3927 => 0.4378, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.42% (0.3092 => 0.3445, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.08% (0.3826 => 0.4250, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.85% (0.3427 => 0.3799, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.85% (0.4064 => 0.4505, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.72% (14.3668 => 15.9074, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.08% (0.3543 => 0.3900, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/strcat: 10.03% (0.2831 => 0.3115, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.96% (0.1114 => 0.1225, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/trivial-interface: 9.96% (0.3473 => 0.3819, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.96% (0.3694 => 0.4062, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.73% (1.2842 => 1.4092, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.59% (2.0665 => 2.2647, std.dev.: 0.0619) SingleSource/Benchmarks/Shootout-C++/except: 9.37% (0.2871 => 0.3140, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.89% (0.3162 => 0.3443, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.82% (0.2891 => 0.3146, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.71% (0.2756 => 0.2996, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.68% (63.2438 => 68.7302, std.dev.: 0.0768) SingleSource/Benchmarks/Shootout-C++/wc: 8.62% (0.3052 => 0.3315, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.57% (0.2872 => 0.3118, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.42% (0.2802 => 0.3038, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.6030 => 0.6535, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/Hello: 7.97% (0.5925 => 0.6397, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.2022 => 2.3765, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.68% (0.3177 => 0.3421, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.27% (0.4879 => 0.5185, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: 6.15% (10.3673 => 11.0053, std.dev.: 0.1639) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (7.9617 => 8.1612, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8961, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4725, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.63% (0.2944 => 0.3257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1484, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.63% (4.2280 => 4.4661, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1066, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.34% (3.6395 => 3.7246, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2786, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2390, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5763, std.dev.: 0.0192) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1779, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -75.01% (0.8651 => 0.2162, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (5.3855 => 4.4880, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.07% (5.3526 => 4.4926, std.dev.: 0.0398) MultiSource/Applications/JM/ldecod/ldecod: -13.18% (10.4361 => 9.0607, std.dev.: 0.0553) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.06% (1.7609 => 1.6189, std.dev.: 0.0046) SingleSource/UnitTests/Vector/constpool: -7.87% (54.1659 => 49.9015, std.dev.: 0.0237) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.55% (1.9577 => 0.6744, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.69% (0.3987 => 0.2564, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -33.56% (1.5373 => 1.0214, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4357, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8583, std.dev.: 0.4524) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.29% (2.6546 => 2.0099, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7329, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -11.15% (9.5636 => 8.4975, std.dev.: 0.0206) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9126, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0314) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.45% (19.9488 => 18.2640, std.dev.: 0.0899) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0171) SingleSource/Benchmarks/McGill/chomp: -6.91% (1.2373 => 1.1518, std.dev.: 0.0112) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4817, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.01% (1.6805 => 1.5795, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7039, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8382, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1542, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0334, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3282, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.30% (4.6441 => 4.5838, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0026) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 03:07:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 05:07:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123110742.4CDCA2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7857?compare_to=7854&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7857, Order: 173241, Start Time: 2013-01-23 09:33:43, End Time: 2013-01-23 11:07:56 To: 7854, Order: 173231, Start Time: 2013-01-23 07:31:34, End Time: 2013-01-23 09:09:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (110 on baseline) Performance Improvements: 2 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.40% (6.1358 => 6.2219, std.dev.: 0.0128) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -16.55% (0.4792 => 0.3999, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -3.50% (3.8893 => 3.7530, std.dev.: 0.0443) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.43% (0.1132 => 0.1601, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.26% (0.6395 => 0.8778, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.07% (0.5456 => 0.7206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.01% (0.6260 => 0.8264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.99% (0.5805 => 0.7662, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.98% (0.5688 => 0.7507, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.71% (0.5849 => 0.7704, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.36% (0.5581 => 0.7331, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.24% (0.5567 => 0.7306, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.14% (0.5575 => 0.7311, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.12% (0.6395 => 0.8385, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.66% (0.5859 => 0.7597, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.91% (0.6440 => 0.8302, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.72% (1.6474 => 2.1206, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.15% (0.6189 => 0.7931, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.95% (0.6676 => 0.8542, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.46% (0.6304 => 0.8035, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.35% (0.6230 => 0.7934, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.37% (0.5802 => 0.7332, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.29% (0.6660 => 0.8411, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.01% (0.5925 => 0.7466, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.84% (0.5705 => 0.7179, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.32% (0.5857 => 0.7340, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.23% (0.5478 => 0.6860, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.12% (0.5569 => 0.6968, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.03% (0.5570 => 0.6964, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.97% (0.5591 => 0.6987, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (0.6446 => 0.7975, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.61% (0.5863 => 0.7247, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.38% (0.7524 => 0.9283, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.15% (0.6052 => 0.7453, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.99% (0.6681 => 0.8217, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.51% (0.6194 => 0.7588, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.20% (0.6297 => 0.7695, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.88% (2.2587 => 2.7530, std.dev.: 0.0152) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.85% (0.6667 => 0.8057, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.23% (0.7339 => 0.8750, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 15.22% (0.3357 => 0.3868, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.90% (1.1450 => 1.3156, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.31% (0.4916 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.21% (4.5069 => 5.0574, std.dev.: 0.0109) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.03% (0.1230 => 0.1378, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.65% (0.4515 => 0.5041, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.41% (3.5339 => 3.9370, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.28% (1.6364 => 1.8210, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.60% (0.1982 => 0.2192, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.19% (0.2385 => 0.2628, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.53% (9.2283 => 10.1074, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 8.40% (0.4524 => 0.4904, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.39% (1.2515 => 1.3565, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.20% (0.1731 => 0.1873, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.18% (0.5329 => 0.5765, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.2001 => 0.2162, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (0.4861 => 0.5229, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.7021 => 0.7550, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.30% (1.4642 => 1.5711, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.12% (1.2784 => 1.3694, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3255 => 0.3443, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (5.4682 => 5.7073, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 4.15% (0.6750 => 0.7030, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.65% (5.0226 => 5.2059, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3446 => 0.3562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.76% (1.3864 => 1.4247, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.54% (0.9557 => 0.9800, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 2.42% (0.8418 => 0.8622, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.38% (0.7447 => 0.7624, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (22.4056 => 22.8903, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.01% (0.5168 => 0.5272, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.01% (15.5079 => 15.8193, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3722 => 1.3954, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7956, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.74% (0.9531 => 1.0269, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (0.2380 => 0.2543, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1478, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5640, std.dev.: 0.0748) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0040) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3843, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6109, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.26% (5.1955 => 5.2610, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4536, std.dev.: 0.0273) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.13% (0.3194 => 0.3030, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.59% (2.4924 => 2.3781, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.83% (0.3837 => 0.3690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: -3.71% (0.3831 => 0.3689, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.68% (0.9852 => 0.9489, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.66% (0.3848 => 0.3707, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.50% (0.4033 => 0.3892, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.4176 => 0.4033, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.41% (0.3142 => 0.3035, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.09% (0.3884 => 0.3764, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: -3.07% (0.6347 => 0.6152, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1765, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.9542 => 0.9270, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -2.81% (1.3148 => 1.2778, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.80% (2.1713 => 2.1104, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: -2.73% (0.6441 => 0.6265, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.70% (0.6484 => 0.6309, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.15% (0.7779 => 0.7612, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.03% (14.2083 => 13.9205, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -1.78% (17.1032 => 16.7980, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.62% (0.7919 => 0.7791, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: -1.58% (16.1920 => 15.9356, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.50% (1.0544 => 1.0386, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.45% (6.7716 => 6.6731, std.dev.: 0.0042) MultiSource/Applications/lambda-0_1_3/lambda: -1.42% (0.7982 => 0.7869, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -1.27% (7.0961 => 7.0061, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.24% (1.2210 => 1.2059, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.16% (1.2221 => 1.2079, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: -1.10% (4.3330 => 4.2854, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.51% (1.8100 => 0.6967, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3101, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.73% (1.3643 => 1.0269, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7561, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0817, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.10% (4.1024 => 3.1959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.34% (2.5106 => 2.1255, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.93% (0.4092 => 0.3522, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3558, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1783, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.89% (1.3096 => 1.2718, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (7.9763 => 7.7835, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4644, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.59% (1.6307 => 1.6048, std.dev.: 0.0094) MultiSource/Benchmarks/Bullet/bullet: -1.54% (7.3040 => 7.1917, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.44% (1.6086 => 1.5854, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5997, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -1.20% (3.7092 => 3.6648, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 03:54:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 05:54:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123115455.392BB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7858?compare_to=7855&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7858, Order: 173242, Start Time: 2013-01-23 09:52:59, End Time: 2013-01-23 11:55:10 To: 7855, Order: 173231, Start Time: 2013-01-23 07:33:01, End Time: 2013-01-23 09:33:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 12 (6 on baseline) Performance Improvements: 0 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1052 (1008 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.13% (1.7128 => 1.8520, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.01% (2.4146 => 2.6081, std.dev.: 0.0479) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.61% (0.2130 => 0.2292, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.32% (3.4652 => 3.7189, std.dev.: 0.0379) SingleSource/Benchmarks/Shootout-C++/hash2: 2.26% (0.4827 => 0.4936, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 8.75% (1.7364 => 1.8883, std.dev.: 0.0350) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.90% (0.5842 => 0.6070, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.66% (59.4620 => 61.6385, std.dev.: 0.3637) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.20% (2.3743 => 2.4502, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.97% (21.9753 => 22.6271, std.dev.: 0.0893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.33% (3.5134 => 3.5600, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.12% (1.2333 => 1.2471, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.71% (1.1190 => 1.1381, std.dev.: 0.1071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.08% (0.0199 => 0.0231, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.00% (0.0434 => 0.0447, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.58% (0.0267 => 0.0354, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.58% (0.0319 => 0.0340, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.31% (0.0428 => 0.0455, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: 10.10% (0.0208 => 0.0229, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: 22.40% (0.0192 => 0.0235, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0253 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -46.15% (0.0013 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.60% (0.1438 => 0.1461, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: 3.31% (1.1163 => 1.1533, std.dev.: 0.1975) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.30% (0.3990 => 0.3978, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.17% (0.1463 => 0.1524, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.10% (0.0999 => 0.0978, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 14.05% (0.0242 => 0.0276, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.24% (0.0563 => 0.0556, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.1466 => 1.1470, std.dev.: 0.1035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2800.00% (0.0001 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1000.00% (0.0001 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.62% (0.0564 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.83% (0.0318 => 0.0309, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.94% (0.7423 => 0.7493, std.dev.: 0.0220) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 217.95% (0.0039 => 0.0124, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.12% (12.7454 => 12.7604, std.dev.: 0.0690) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.37% (2.4519 => 2.6081, std.dev.: 0.0479) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319500.00% (0.0008 => 2.5568, std.dev.: 0.0093) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.38% (1.1825 => 2.3932, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/pi: 3.28% (2.1390 => 2.2092, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.93% (0.5897 => 0.6070, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.41% (1.2298 => 1.2471, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.48% (0.0808 => 0.0489, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0025) SingleSource/Benchmarks/SmallPT/smallpt: -25.11% (0.1888 => 0.1414, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.15% (0.1684 => 0.1311, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.42% (0.1009 => 0.0803, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.63% (0.0862 => 0.0710, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.68% (0.1079 => 0.0899, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.57% (0.7686 => 0.6489, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.44% (1.0986 => 0.9400, std.dev.: 0.0284) MultiSource/Benchmarks/SciMark2-C/scimark2: -13.70% (0.4074 => 0.3516, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -12.77% (1.0220 => 0.8915, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.48% (0.7693 => 0.6887, std.dev.: 0.0172) MultiSource/Applications/Burg/burg: -10.07% (1.5979 => 1.4370, std.dev.: 0.0445) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.89% (1.5131 => 1.3635, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.91% (1.6874 => 1.5370, std.dev.: 0.0324) MultiSource/Benchmarks/Olden/health/health: -8.88% (0.1610 => 0.1467, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.59% (1.1498 => 1.0510, std.dev.: 0.0254) MultiSource/Applications/sqlite3/sqlite3: -8.43% (17.5634 => 16.0825, std.dev.: 0.4231) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.02% (0.6885 => 0.6333, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.92% (0.9124 => 0.8401, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.78% (0.3560 => 0.3283, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.48% (0.5746 => 0.5316, std.dev.: 0.0089) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.31% (0.9588 => 0.8887, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -7.03% (0.2618 => 0.2434, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: -6.63% (3.7840 => 3.5331, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.70% (1.0017 => 0.9446, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.06% (1.2680 => 1.2165, std.dev.: 0.0154) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.92% (0.2577 => 0.2476, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.92% (0.2884 => 0.2771, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -3.86% (0.5134 => 0.4936, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: -3.84% (4.5936 => 4.4174, std.dev.: 0.0500) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (1.0234 => 0.9859, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.40% (0.8990 => 0.8684, std.dev.: 0.0092) MultiSource/Benchmarks/sim/sim: -3.28% (0.3715 => 0.3593, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.22% (1.0052 => 0.9728, std.dev.: 0.0111) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.79% (0.9372 => 0.6486, std.dev.: 0.0057) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.00% (0.4081 => 0.3673, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.47% (1.4588 => 1.3352, std.dev.: 0.0476) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.3217 => 0.2970, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/nestedloop: -7.27% (0.2200 => 0.2040, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/hash: -5.36% (4.5259 => 4.2832, std.dev.: 0.0896) MultiSource/Benchmarks/Olden/health/health: -5.31% (0.3654 => 0.3460, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.57% (0.3349 => 0.3196, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.30% (23.3986 => 22.6271, std.dev.: 0.0893) SingleSource/Benchmarks/McGill/chomp: -2.15% (1.0425 => 1.0201, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.43% (3.1921 => 3.1463, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3596 => 3.3197, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.53% (1.2047 => 1.1381, std.dev.: 0.1071) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.86% (0.0233 => 0.0231, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.89% (0.0451 => 0.0447, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.15% (0.0394 => 0.0354, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.66% (0.0328 => 0.0340, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.25% (0.0445 => 0.0455, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: 7.51% (0.0213 => 0.0229, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: 3.52% (0.0227 => 0.0235, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -53.33% (0.0015 => 0.0007, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.51% (0.1530 => 0.1461, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -40.22% (1.9293 => 1.1533, std.dev.: 0.1975) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.75% (0.4049 => 0.3978, std.dev.: 0.0378) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.93% (0.1510 => 0.1524, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0978 => 0.0978, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.76% (0.0590 => 0.0556, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.27% (1.1617 => 1.1470, std.dev.: 0.1035) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -59.26% (0.0027 => 0.0011, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.30% (0.0268 => 0.0309, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.75% (0.7437 => 0.7493, std.dev.: 0.0220) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.78% (0.0092 => 0.0124, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (12.7781 => 12.7604, std.dev.: 0.0690) Report Time: 0.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 04:22:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 06:22:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123122228.88D7F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7859?compare_to=7856&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7859, Order: 173243, Start Time: 2013-01-23 10:11:32, End Time: 2013-01-23 12:22:42 To: 7856, Order: 173231, Start Time: 2013-01-23 07:27:02, End Time: 2013-01-23 09:40:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.12% (0.0674 => 0.0653, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7681 => 499.8382, std.dev.: 0.0094) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44223.69% (1.1277 => 499.8382, std.dev.: 0.0094) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.30% (0.5229 => 1.6487, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 20.89% (14.9895 => 18.1212, std.dev.: 0.0346) MultiSource/Applications/kimwitu++/kc: 44.51% (14.1553 => 20.4555, std.dev.: 0.0344) MultiSource/Benchmarks/MallocBench/gs/gs: 18.27% (4.1105 => 4.8616, std.dev.: 0.0203) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.02% (1.1048 => 1.7348, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.45% (7.1582 => 37.8994, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.43% (3.4629 => 6.4560, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.78% (0.6222 => 1.0937, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10277.64% (0.0720 => 7.4719, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11190200.00% (0.0001 => 11.1903, std.dev.: 0.0464) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483400.00% (0.0001 => 5.4835, std.dev.: 0.0042) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.99% (1.1194 => 10.3319, std.dev.: 0.0072) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.57% (22.1758 => 55.3437, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.18% (0.1463 => 0.2519, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.28% (2.9384 => 4.6216, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.99% (7.0540 => 10.8625, std.dev.: 0.0227) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.75% (1.5859 => 2.4066, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.27% (8.1363 => 11.9822, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.38% (2.2024 => 3.1358, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 40.01% (0.3109 => 0.4353, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.50% (21.9371 => 30.3826, std.dev.: 0.0150) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.45% (4.2646 => 5.6911, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.30% (0.4615 => 0.6152, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.65% (1.5415 => 2.0448, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.82% (0.2271 => 0.2971, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 30.21% (1.1642 => 1.5159, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 30.01% (0.4299 => 0.5589, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.95% (0.5105 => 0.6532, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.34% (0.6675 => 0.8500, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.64% (0.1584 => 0.2006, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 26.51% (0.2554 => 0.3231, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.48% (0.0793 => 0.1003, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 26.37% (9.4845 => 11.9855, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.35% (3.8922 => 4.9179, std.dev.: 0.0018) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.98% (0.1143 => 0.1440, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.98% (0.1655 => 0.2085, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 25.16% (0.4289 => 0.5368, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.09% (0.3121 => 0.3904, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.55% (0.1906 => 0.2374, std.dev.: 0.0036) MultiSource/Applications/lemon/lemon: 24.55% (1.0722 => 1.3354, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.38% (0.1337 => 0.1663, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.34% (1.4186 => 1.7639, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.97% (0.0730 => 0.0905, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 23.87% (0.4620 => 0.5723, std.dev.: 0.0139) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.60% (0.1695 => 0.2095, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 22.88% (0.7115 => 0.8743, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 22.12% (0.1555 => 0.1899, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.93% (0.2700 => 0.3292, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 21.37% (0.3098 => 0.3760, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 21.05% (0.6456 => 0.7815, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 20.94% (0.7835 => 0.9476, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/mst/mst: 20.89% (0.1163 => 0.1406, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 20.87% (5.7591 => 6.9608, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.87% (1.3050 => 1.5773, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.78% (0.0953 => 0.1151, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.86% (4.9449 => 5.9268, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.52% (0.8172 => 0.9767, std.dev.: 0.0041) MultiSource/Applications/d/make_dparser: 19.22% (3.3354 => 3.9764, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.12% (5.0018 => 5.9582, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.05% (0.3307 => 0.3937, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0029) MultiSource/Applications/lambda-0_1_3/lambda: 18.44% (0.7433 => 0.8804, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.31% (0.2758 => 0.3263, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.96% (0.5569 => 0.6569, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.92% (0.9765 => 1.1515, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.87% (0.2065 => 0.2434, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 17.84% (2.0273 => 2.3890, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 17.84% (1.1840 => 1.3952, std.dev.: 0.0049) MultiSource/Applications/lua/lua: 17.67% (3.8723 => 4.5565, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.66% (0.2107 => 0.2479, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 17.56% (0.3423 => 0.4024, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.44% (1.1861 => 1.3930, std.dev.: 0.0028) MultiSource/Applications/siod/siod: 17.02% (2.2969 => 2.6879, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.00% (0.5981 => 0.6998, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.95% (0.1044 => 0.1221, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.86% (0.3441 => 0.4021, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.44% (0.8101 => 0.9433, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.19% (0.6450 => 0.7494, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 16.15% (0.2049 => 0.2380, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.60% (0.3180 => 0.3676, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.38% (0.8921 => 1.0293, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.90% (0.8067 => 0.9269, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary2: 14.56% (0.3379 => 0.3871, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.05% (0.3865 => 0.4408, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.48% (0.4636 => 0.5261, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.36% (0.4103 => 0.4651, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.87% (0.4203 => 0.4744, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7604, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/moments: 12.40% (0.4048 => 0.4550, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.33% (0.3422 => 0.3844, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/sieve: 12.27% (0.3603 => 0.4045, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 12.14% (17.1811 => 19.2666, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.81% (0.3684 => 0.4119, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.65% (0.2430 => 0.2713, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.27% (0.3826 => 0.4257, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.12% (0.4064 => 0.4516, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.94% (14.3668 => 15.9390, std.dev.: 0.0203) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.24% (0.2831 => 0.3121, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.17% (0.3561 => 0.3923, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.14% (0.1114 => 0.1227, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.02% (0.3543 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.98% (0.3516 => 0.3867, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.58% (2.0665 => 2.2645, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/except: 9.54% (0.2871 => 0.3145, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2877 => 0.3149, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 9.29% (0.2905 => 0.3175, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.07% (1.2842 => 1.4007, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.04% (0.3162 => 0.3448, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 8.75% (0.3052 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.74% (0.2872 => 0.3123, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7495, std.dev.: 0.0709) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.61% (0.6030 => 0.6549, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.60% (0.2756 => 0.2993, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3935 => 0.4271, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.49% (0.7326 => 0.7948, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/fibo: 8.44% (0.2725 => 0.2955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.41% (0.2793 => 0.3028, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.61% (2.2022 => 2.3697, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.54% (0.4879 => 0.5198, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: 6.07% (10.3673 => 10.9969, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: 3.99% (0.3131 => 0.3256, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (7.9617 => 8.1601, std.dev.: 0.0181) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4728, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1484, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.67% (4.2280 => 4.4677, std.dev.: 0.0052) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.50% (0.9957 => 1.0305, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.6802 => 8.9206, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.32% (1.0313 => 1.0552, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.31% (3.6395 => 3.7237, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2829, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2432, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 1.30% (2.2771 => 2.3066, std.dev.: 0.0112) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1701, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1774, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/salsa20: -75.01% (0.8651 => 0.2162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.87% (5.3855 => 4.4769, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.27% (5.3526 => 4.4817, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: -13.40% (10.4361 => 9.0381, std.dev.: 0.0154) SingleSource/UnitTests/Vector/constpool: -7.94% (54.1659 => 49.8645, std.dev.: 0.0282) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.93% (1.7609 => 1.6212, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.68% (1.9577 => 0.6719, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3054, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel-2: -33.54% (1.5373 => 1.0217, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4341, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8518, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0060, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1248, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7322, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4944, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2787, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.73% (1.2373 => 1.1540, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7015, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8402, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0334, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.89% (3.6994 => 3.6296, std.dev.: 0.0165) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.40% (3.7221 => 3.6701, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.31% (4.6441 => 4.5831, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0031) Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 05:05:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 07:05:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123130540.A87B32A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7860?compare_to=7857&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7860, Order: 173247, Start Time: 2013-01-23 11:31:34, End Time: 2013-01-23 13:05:54 To: 7857, Order: 173241, Start Time: 2013-01-23 09:33:43, End Time: 2013-01-23 11:07:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (100 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.69% (0.0974 => 0.1643, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.96% (0.1132 => 0.1607, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.58% (0.6395 => 0.8798, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.35% (0.6260 => 0.8285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.20% (0.5805 => 0.7674, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.15% (0.5456 => 0.7210, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.10% (0.5688 => 0.7514, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.80% (0.5849 => 0.7709, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.45% (0.5581 => 0.7336, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.35% (0.5575 => 0.7323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.35% (0.6395 => 0.8400, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.60% (0.5941 => 0.7759, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.78% (0.5859 => 0.7604, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.55% (0.6033 => 0.7816, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.15% (0.6440 => 0.8317, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.99% (1.6474 => 2.1250, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.57% (0.6189 => 0.7957, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.45% (0.6230 => 0.7940, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.58% (0.5802 => 0.7344, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.38% (0.6660 => 0.8417, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.24% (0.5925 => 0.7480, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.96% (0.5705 => 0.7186, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.64% (0.5857 => 0.7359, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.36% (0.5478 => 0.6867, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.26% (0.5569 => 0.6976, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.21% (0.5570 => 0.6974, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.95% (0.5591 => 0.6986, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.84% (0.5863 => 0.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.70% (0.6446 => 0.7974, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.59% (0.7524 => 0.9299, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.46% (0.6052 => 0.7472, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.19% (0.6681 => 0.8230, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.76% (2.2587 => 2.7727, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.52% (0.6297 => 0.7715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.51% (0.6194 => 0.7588, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.13% (0.6667 => 0.8076, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.55% (0.7339 => 0.8774, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.07% (1.1450 => 1.3176, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.25% (0.4916 => 0.5518, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.20% (4.5069 => 5.0569, std.dev.: 0.0077) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.95% (0.1230 => 0.1377, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 11.81% (0.4515 => 0.5048, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.56% (3.5339 => 3.9424, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.54% (1.6364 => 1.8253, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1982 => 0.2191, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 9.88% (9.2283 => 10.1398, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.59% (0.1731 => 0.1897, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.43% (1.2515 => 1.3570, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.39% (0.5329 => 0.5776, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 8.29% (0.4524 => 0.4899, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.66% (0.7021 => 0.7559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.41% (0.4861 => 0.5221, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.22% (1.4642 => 1.5699, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.97% (1.2784 => 1.3675, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 6.81% (0.1879 => 0.2007, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 6.02% (0.1761 => 0.1867, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3255 => 0.3439, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.56% (5.4682 => 5.7175, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.80% (5.0226 => 5.2137, std.dev.: 0.0154) MultiSource/Applications/spiff/spiff: 3.16% (0.8418 => 0.8684, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3446 => 0.3552, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.80% (1.3864 => 1.4252, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.65% (0.9557 => 0.9810, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.62% (0.7447 => 0.7642, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.52% (0.5168 => 0.5298, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.29% (22.4056 => 22.9178, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 2.11% (15.5079 => 15.8345, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.74% (1.3722 => 1.3961, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 1.06% (3.5154 => 3.5528, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.8001, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (0.2380 => 0.2543, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1478, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4741, std.dev.: 0.1244) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.82% (2.0478 => 2.1056, std.dev.: 0.0112) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3811, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.85% (4.5320 => 4.6159, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2692, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3489 => 10.4529, std.dev.: 0.0094) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (2.4924 => 2.3755, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.50% (0.3821 => 0.3649, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.56% (0.9852 => 0.9501, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.52% (0.3323 => 0.3206, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.3142 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.40% (0.3057 => 0.2953, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.36% (0.3812 => 0.3684, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -3.32% (0.3831 => 0.3704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.30% (0.3880 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.27% (0.3848 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.23% (0.3896 => 0.3770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.20% (0.4033 => 0.3904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.16% (0.3891 => 0.3768, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.99% (0.4176 => 0.4051, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.96% (2.1713 => 2.1071, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.9542 => 0.9269, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.82% (0.6347 => 0.6168, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.77% (1.3148 => 1.2784, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.6484 => 0.6306, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.70% (0.3884 => 0.3779, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.54% (20.7746 => 20.2474, std.dev.: 0.0228) SingleSource/UnitTests/ObjC++/property-reference-object: -2.47% (0.6441 => 0.6282, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.38% (0.4199 => 0.4099, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.10% (14.2083 => 13.9102, std.dev.: 0.0191) SingleSource/UnitTests/ObjC++/property-reference: -1.95% (0.7779 => 0.7627, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.66% (17.1032 => 16.8187, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.64% (0.7919 => 0.7789, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: -1.50% (16.1920 => 15.9498, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.47% (1.0544 => 1.0389, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.7716 => 6.6809, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: -1.28% (7.0961 => 7.0054, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: -1.26% (4.3330 => 4.2783, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.19% (1.2210 => 1.2065, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.04% (1.2221 => 1.2094, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.65% (1.8100 => 0.6760, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3139, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.07% (1.3643 => 1.0223, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7566, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0798, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1997, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.89% (5.3397 => 4.1710, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1268, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3566, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.46% (0.5142 => 0.4604, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3982, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.93% (1.3096 => 1.2712, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.74% (7.9763 => 7.7581, std.dev.: 0.0176) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1180, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4637, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.51% (7.3040 => 7.1935, std.dev.: 0.0203) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7092 => 3.6592, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.16% (1.6307 => 1.6118, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 05:06:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 07:06:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130123130609.A75242A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7861?compare_to=7853&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7861, Order: 173240, Start Time: 2013-01-23 09:31:58, End Time: 2013-01-23 13:06:24 To: 7853, Order: 173224, Start Time: 2013-01-23 04:52:59, End Time: 2013-01-23 08:40:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (180 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.60% (0.0625 => 0.0910, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.56% (0.1063 => 0.1441, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.09% (0.2969 => 0.3803, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0547 => 0.0696, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.58% (0.1106 => 0.1400, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.48% (0.4139 => 0.5235, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.32% (0.5900 => 0.7453, std.dev.: 0.0294) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.51% (0.4253 => 0.5338, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.39% (0.0642 => 0.0805, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.09% (0.4994 => 0.6247, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: 24.56% (1.5932 => 1.9845, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.94% (0.1107 => 0.1372, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.86% (0.5000 => 0.6193, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.64% (0.1620 => 0.2003, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.24% (0.1549 => 0.1909, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.95% (0.0584 => 0.0718, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 22.47% (0.0948 => 0.1161, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.42% (0.1619 => 0.1982, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.23% (0.1003 => 0.1226, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.75% (0.3903 => 0.4752, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: 21.69% (0.0604 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.26% (0.0541 => 0.0656) MultiSource/Benchmarks/Olden/health/health: 21.19% (0.0821 => 0.0995, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 20.38% (0.0947 => 0.1140, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 19.91% (0.0698 => 0.0837, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 19.87% (0.1218 => 0.1460, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.84% (0.1462 => 0.1752, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 19.80% (0.0808 => 0.0968, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.78% (0.2866 => 0.3433, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.66% (0.2014 => 0.2410, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.59% (0.3890 => 0.4652, std.dev.: 0.0113) MultiSource/Applications/spiff/spiff: 19.43% (0.4029 => 0.4812, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.30% (0.2736 => 0.3264, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/09-vor/vor: 19.27% (0.1505 => 0.1795, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.08% (0.3271 => 0.3895, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/gs/gs: 18.96% (1.8794 => 2.2357, std.dev.: 0.0405) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.73% (1.3152 => 1.5616, std.dev.: 0.0297) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.71% (0.0572 => 0.0679, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: 18.50% (0.5546 => 0.6572, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.18% (0.0605 => 0.0715, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.0573 => 0.0677, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.06% (0.5826 => 0.6878, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 18.02% (0.5889 => 0.6950, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 17.85% (0.2813 => 0.3315, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.77% (0.2875 => 0.3386, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.70% (1.6211 => 1.9080, std.dev.: 0.0160) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.70% (0.0582 => 0.0685, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/strcat: 17.67% (0.2750 => 0.3236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 17.61% (0.2714 => 0.3192, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.60% (3.5627 => 4.1897, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout-C++/except: 17.54% (0.2811 => 0.3304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 17.53% (0.2823 => 0.3318, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.50% (0.4658 => 0.5473, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.41% (0.1160 => 0.1362, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.38% (0.1968 => 0.2310, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 17.37% (0.2780 => 0.3263, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 17.37% (0.1284 => 0.1507, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: 17.33% (0.9909 => 1.1626, std.dev.: 0.0106) MultiSource/Applications/hbd/hbd: 17.29% (0.9697 => 1.1374, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.21% (0.5026 => 0.5891, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.20% (0.2738 => 0.3209, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.19% (0.2792 => 0.3272, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 17.14% (0.2725 => 0.3192, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.03% (2.0673 => 2.4193, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.01% (0.4361 => 0.5103, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.93% (0.2729 => 0.3191, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 16.68% (0.1421 => 0.1658, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.63% (0.3060 => 0.3569, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.54% (0.3930 => 0.4580, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 16.41% (0.3096 => 0.3604, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 16.30% (0.3258 => 0.3789, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 16.27% (1.0781 => 1.2535, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.22% (1.9966 => 2.3205, std.dev.: 0.0406) SingleSource/Benchmarks/Shootout-C++/ary2: 16.22% (0.3317 => 0.3855, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.08% (1.9694 => 2.2860, std.dev.: 0.0399) MultiSource/Benchmarks/Bullet/bullet: 16.06% (23.5202 => 27.2974, std.dev.: 0.0596) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.06% (0.3625 => 0.4207, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference: 16.04% (0.7171 => 0.8321, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.01% (0.3124 => 0.3624, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.97% (0.3362 => 0.3899, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 15.89% (4.2109 => 4.8799, std.dev.: 0.0937) SingleSource/Benchmarks/Shootout-C++/sieve: 15.83% (0.3726 => 0.4316, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 15.71% (0.3348 => 0.3874, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.70% (0.3477 => 0.4023, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.69% (0.3282 => 0.3797, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.50% (0.3678 => 0.4248, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.36% (1.4269 => 1.6461, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash2: 15.31% (0.4251 => 0.4902, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.31% (4.4195 => 5.0961, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout-C++/hash: 15.29% (0.4146 => 0.4780, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 15.12% (0.2566 => 0.2954, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.10% (0.3981 => 0.4582, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.10% (2.7292 => 3.1412, std.dev.: 0.0351) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.01% (0.3690 => 0.4244, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.64% (0.3845 => 0.4408, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 14.29% (0.7875 => 0.9000, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 14.23% (0.5012 => 0.5725, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.01% (0.1028 => 0.1172, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 13.54% (5.5417 => 6.2922, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.43% (0.6435 => 0.7299, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 13.33% (0.3496 => 0.3962, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 13.29% (0.3460 => 0.3920, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 13.28% (0.3442 => 0.3899, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-2: 13.23% (0.3446 => 0.3902, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 13.23% (0.3469 => 0.3928, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 13.19% (0.3465 => 0.3922, std.dev.: 0.0000) MultiSource/Applications/JM/ldecod/ldecod: 13.19% (2.1653 => 2.4508, std.dev.: 0.0398) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.16% (0.3488 => 0.3947, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 13.08% (0.2691 => 0.3043, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/property: 13.07% (0.3650 => 0.4127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.97% (0.2737 => 0.3092, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.89% (0.3724 => 0.4204, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 12.74% (4.6177 => 5.2058, std.dev.: 0.0655) MultiSource/Benchmarks/Prolangs-C/football/football: 12.72% (0.2075 => 0.2339, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: 12.71% (0.3643 => 0.4106, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.43% (0.2068 => 0.2325, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: 12.16% (2.1013 => 2.3568, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 11.84% (0.3498 => 0.3912, std.dev.: 0.0079) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.80% (0.3084 => 0.3448, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.58% (0.5361 => 0.5982, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.27% (0.2103 => 0.2340, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 11.21% (0.3336 => 0.3710, std.dev.: 0.0068) MultiSource/Applications/siod/siod: 11.18% (0.6634 => 0.7376, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.13% (0.2040 => 0.2267, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.62% (11.6398 => 12.8759, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 10.33% (0.2391 => 0.2638, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.23% (0.7426 => 0.8186, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.98% (0.1383 => 0.1521, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.91% (4.6926 => 5.1576, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: 9.02% (2.0346 => 2.2182, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.90% (0.5584 => 0.6081, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 7.55% (11.9555 => 12.8579, std.dev.: 0.0257) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.98% (0.3792 => 0.3943, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5290, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0090) MultiSource/Applications/ClamAV/clamscan: 9.60% (0.2802 => 0.3071, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.48% (0.3693 => 0.4006, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 6.83% (0.2122 => 0.2267, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6732, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2394, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-2: 5.06% (1.8057 => 1.8971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6914, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0094) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2912, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3050, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 1.29% (4.0317 => 4.0836, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2086, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5870, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.20% (2.4764 => 2.3971, std.dev.: 0.0229) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5806, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.89% (17.2379 => 14.3258, std.dev.: 0.0677) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7994, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -6.70% (0.2402 => 0.2241, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.39% (14.0481 => 13.4317, std.dev.: 0.2049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2269, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8066, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1764, std.dev.: 0.0407) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6293 => 0.6176, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5694, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.04% (105.3826 => 104.2907, std.dev.: 0.0248) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 06:15:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 08:15:26 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123141526.D69022A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7862?compare_to=7858&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7862, Order: 173252, Start Time: 2013-01-23 12:13:30, End Time: 2013-01-23 14:15:42 To: 7858, Order: 173242, Start Time: 2013-01-23 09:52:59, End Time: 2013-01-23 11:55:10 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (6 on baseline) Performance Improvements: 9 (50 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1052 (1007 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.75% (0.8790 => 0.8944, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 1.37% (4.2262 => 4.2841, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/mandel: 1.12% (1.0541 => 1.0659, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -7.09% (2.6081 => 2.4232, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.98% (1.8520 => 1.7227, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.57% (3.7189 => 3.4745, std.dev.: 0.0461) SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.85% (6.1370 => 5.7780, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.00% (0.5275 => 0.5011, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/bigfib: -2.75% (0.6703 => 0.6519, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.11% (0.9138 => 0.9037, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.74% (1.0948 => 1.0758, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.23% (0.9009 => 0.8898, std.dev.: 0.0031) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.08% (1.1381 => 1.1372, std.dev.: 0.0277) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.46% (0.0231 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.68% (0.0447 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -4.24% (0.0354 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.59% (0.0340 => 0.0321, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.84% (0.0455 => 0.0433, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -8.73% (0.0229 => 0.0209, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -5.53% (0.0235 => 0.0222, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.80% (0.0251 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 85.71% (0.0007 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.10% (0.1461 => 0.1477, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 8.27% (1.1533 => 1.2487, std.dev.: 0.0606) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.46% (0.3978 => 0.4235, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.31% (0.1524 => 0.1504, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (0.0978 => 0.1001, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.14% (0.0556 => 0.0579, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.13% (1.1470 => 1.1485, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 136.36% (0.0011 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.81% (0.0607 => 0.0618, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.06% (0.0309 => 0.0247, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.73% (0.7493 => 0.7438, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.16% (0.0124 => 0.0068, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.24% (12.7604 => 12.7916, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 2.93% (33.2440 => 34.2187, std.dev.: 0.2766) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.38% (0.8736 => 0.8944, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322187.50% (0.0008 => 2.5783, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.03% (1.1825 => 2.3772, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.83% (0.2562 => 0.2865, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.82% (4.1668 => 4.2841, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0022) SingleSource/Benchmarks/SmallPT/smallpt: -27.12% (0.1888 => 0.1376, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.61% (0.1009 => 0.0791, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.60% (0.0676 => 0.0530, std.dev.: 0.0057) MultiSource/Applications/hbd/hbd: -18.37% (1.8964 => 1.5480, std.dev.: 0.0421) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.05% (0.0862 => 0.0715, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.68% (0.7686 => 0.6481, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.84% (1.0986 => 0.9465, std.dev.: 0.0188) MultiSource/Applications/hexxagon/hexxagon: -11.03% (1.1433 => 1.0172, std.dev.: 0.0078) MultiSource/Applications/treecc/treecc: -10.45% (2.4719 => 2.2136, std.dev.: 0.0956) MultiSource/Applications/aha/aha: -10.38% (0.1378 => 0.1235, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.05% (6.4235 => 5.7780, std.dev.: 0.0222) MultiSource/Applications/lua/lua: -9.41% (4.6406 => 4.2037, std.dev.: 0.0359) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.89% (10.2703 => 9.3574, std.dev.: 0.3304) MultiSource/Applications/sqlite3/sqlite3: -8.79% (17.5634 => 16.0196, std.dev.: 0.3949) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.76% (0.7693 => 0.7019, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.38% (1.3924 => 1.2757, std.dev.: 0.0434) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.28% (1.6874 => 1.5477, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.13% (1.1498 => 1.0563, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.02% (0.6885 => 0.6333, std.dev.: 0.0060) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.18% (1.1731 => 1.0889, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: -5.36% (0.5134 => 0.4859, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/moments: -5.35% (0.4002 => 0.3788, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.24% (0.2100 => 0.1990, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.10% (0.3665 => 0.3478, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.96% (1.8127 => 1.7227, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.59% (0.3093 => 0.2951, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (3.6295 => 3.4745, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout-C++/lists: -4.26% (0.2725 => 0.2609, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: -3.28% (0.3206 => 0.3101, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.21% (0.9127 => 0.8834, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.99% (0.8990 => 0.8721, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/bigfib: -2.86% (0.6711 => 0.6519, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.52% (1.0052 => 0.9799, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.92% (0.9214 => 0.9037, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.50% (0.9788 => 0.9641, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.29% (0.9061 => 0.8944, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.84% (1.4235 => 1.2692, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/hash: -9.92% (4.5259 => 4.0770, std.dev.: 0.1268) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.63% (23.3986 => 21.3797, std.dev.: 0.5752) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.28% (0.4081 => 0.3743, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/ary3: -5.99% (2.2304 => 2.0968, std.dev.: 0.0422) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.15% (0.3201 => 0.3036, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.85% (1.4446 => 1.3890, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.99% (0.3406 => 0.3304, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists: -2.99% (17.2182 => 16.7029, std.dev.: 0.0787) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.0995 => 1.0758, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: -2.08% (63.1520 => 61.8369, std.dev.: 0.4160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.92% (0.5826 => 0.5714, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.48% (3.1921 => 3.1447, std.dev.: 0.0105) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.60% (1.2047 => 1.1372, std.dev.: 0.0277) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0024) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.46% (0.1530 => 0.1477, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: -35.28% (1.9293 => 1.2487, std.dev.: 0.0606) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.59% (0.4049 => 0.4235, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1510 => 0.1504, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (0.0978 => 0.1001, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.86% (0.0590 => 0.0579, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.14% (1.1617 => 1.1485, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.31% (0.0610 => 0.0618, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.84% (0.0268 => 0.0247, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.7437 => 0.7438, std.dev.: 0.0044) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.09% (0.0092 => 0.0068, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.11% (12.7781 => 12.7916, std.dev.: 0.0080) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 07:03:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 09:03:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123150331.B7B542A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7863?compare_to=7860&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7863, Order: 173259, Start Time: 2013-01-23 13:29:32, End Time: 2013-01-23 15:03:46 To: 7860, Order: 173247, Start Time: 2013-01-23 11:31:34, End Time: 2013-01-23 13:05:54 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.00% (0.0280 => 0.0518, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.48% (0.0974 => 0.1641, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.28% (0.6395 => 0.8779, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.19% (0.0699 => 0.0931, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.12% (0.6260 => 0.8271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.97% (0.5805 => 0.7661, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.86% (0.5688 => 0.7500, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.85% (0.5456 => 0.7194, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.63% (0.5849 => 0.7699, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.27% (0.5567 => 0.7308, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.25% (0.5581 => 0.7325, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.09% (0.5575 => 0.7308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.01% (0.6395 => 0.8378, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.37% (0.5941 => 0.7745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.49% (0.5859 => 0.7587, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.49% (0.6033 => 0.7812, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.10% (0.6440 => 0.8314, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.61% (1.6474 => 2.1188, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.34% (0.6189 => 0.7943, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.91% (0.6676 => 0.8539, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.27% (0.6230 => 0.7929, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.37% (0.5802 => 0.7332, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.17% (0.6660 => 0.8403, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.16% (0.5925 => 0.7475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.70% (0.5705 => 0.7171, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.23% (0.5857 => 0.7335, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.05% (0.5478 => 0.6850, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.01% (0.5570 => 0.6963, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.87% (0.5569 => 0.6954, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.72% (0.5591 => 0.6973, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.62% (0.5863 => 0.7248, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.52% (0.6446 => 0.7962, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.38% (0.7524 => 0.9283, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.30% (0.6052 => 0.7462, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.99% (0.6681 => 0.8217, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.42% (0.6194 => 0.7583, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.42% (0.6297 => 0.7709, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.63% (2.2587 => 2.7472, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.79% (0.6667 => 0.8053, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.28% (0.7339 => 0.8754, std.dev.: 0.0143) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.16% (0.3357 => 0.3866, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 14.77% (1.1450 => 1.3141, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.36% (0.1230 => 0.1382, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.01% (4.5069 => 5.0481, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.96% (0.4916 => 0.5504, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.96% (0.1982 => 0.2219, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 11.50% (0.4515 => 0.5034, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.42% (3.5339 => 3.9375, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.15% (1.6364 => 1.8189, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.81% (0.2385 => 0.2619, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.50% (9.2283 => 10.1050, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.90% (0.1731 => 0.1885, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.33% (1.2515 => 1.3557, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.01% (0.5329 => 0.5756, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.67% (0.4524 => 0.4871, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.55% (0.7021 => 0.7551, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 7.20% (0.4861 => 0.5211, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.07% (1.4642 => 1.5677, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.73% (1.2784 => 1.3645, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.55% (0.1879 => 0.2002, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.91% (0.1761 => 0.1865, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.3255 => 0.3447, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.3319 => 0.3483, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (5.4682 => 5.6969, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 3.88% (0.6750 => 0.7012, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 3.38% (5.0226 => 5.1922, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/ary3: 2.93% (0.3446 => 0.3547, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4264, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 2.42% (0.8418 => 0.8622, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.9557 => 0.9775, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 2.27% (0.7447 => 0.7616, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.01% (22.4056 => 22.8565, std.dev.: 0.0098) MultiSource/Applications/SPASS/SPASS: 1.80% (15.5079 => 15.7874, std.dev.: 0.0091) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8158, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.39% (0.9531 => 1.0331, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.40% (54.5751 => 56.4303, std.dev.: 0.1987) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.80% (2.0478 => 2.1052, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3831, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.81% (4.5320 => 4.6140, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.03% (0.7198 => 0.6836, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.67% (2.4924 => 2.3761, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/exceptions-3: -4.63% (0.3848 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/synchronized: -4.54% (0.3896 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.49% (0.4033 => 0.3852, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.4176 => 0.3999, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.14% (0.3837 => 0.3678, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.99% (0.3884 => 0.3729, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.59% (0.9852 => 0.9498, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.57% (0.4199 => 0.4049, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.55% (0.2871 => 0.2769, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.43% (0.3323 => 0.3209, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.22% (0.4280 => 0.4142, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.15% (0.6441 => 0.6238, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.00% (2.1713 => 2.1061, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.9542 => 0.9259, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.88% (0.6484 => 0.6297, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: -2.83% (1.3148 => 1.2776, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: -2.47% (0.7779 => 0.7587, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2703, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.36% (14.2083 => 13.8733, std.dev.: 0.0209) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.94% (6.7716 => 6.6403, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -1.73% (17.1032 => 16.8072, std.dev.: 0.0104) MultiSource/Applications/JM/lencod/lencod: -1.73% (16.1920 => 15.9118, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.68% (0.7919 => 0.7786, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.55% (1.0544 => 1.0381, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.44% (1.2210 => 1.2034, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.38% (7.0961 => 6.9985, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: -1.16% (4.3330 => 4.2828, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/football/football: -1.15% (0.9179 => 0.9073, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.04% (1.5610 => 1.5448, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.71% (1.3643 => 1.0272, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7484, std.dev.: 0.0070) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0684, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.46% (0.0757 => 0.0587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1288, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3536, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.29% (5.5807 => 5.3973, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.90% (7.9763 => 7.7450, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.85% (1.3096 => 1.2723, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4659, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3040 => 7.1874, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.39% (1.6219 => 1.5994, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6105, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 07:03:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 09:03:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123150345.A9E1F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7864?compare_to=7859&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7864, Order: 173256, Start Time: 2013-01-23 12:52:58, End Time: 2013-01-23 15:03:59 To: 7859, Order: 173243, Start Time: 2013-01-23 10:11:32, End Time: 2013-01-23 12:22:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (10.9969 => 10.8716, std.dev.: 0.0168) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0653 => 0.0653, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8382 => 499.8490, std.dev.: 0.0079) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.64% (1.1277 => 499.8490, std.dev.: 0.0079) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.86% (0.5229 => 1.6464, std.dev.: 0.0049) MultiSource/Applications/SPASS/SPASS: 20.75% (14.9895 => 18.1004, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 44.16% (14.1553 => 20.4065, std.dev.: 0.0282) MultiSource/Benchmarks/MallocBench/gs/gs: 18.61% (4.1105 => 4.8755, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.60% (1.1048 => 1.7301, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 429.08% (7.1582 => 37.8726, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.88% (3.4629 => 6.4368, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.83% (0.6222 => 1.0878, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10281.11% (0.0720 => 7.4744, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11162300.00% (0.0001 => 11.1624, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483000.00% (0.0001 => 5.4831, std.dev.: 0.0176) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.06% (1.1194 => 10.3104, std.dev.: 0.0183) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 149.72% (22.1758 => 55.3765, std.dev.: 0.0756) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457) MultiSource/Benchmarks/FreeBench/neural/neural: 71.09% (0.1463 => 0.2503, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.78% (2.9384 => 4.6069, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.59% (7.0540 => 10.8339, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.31% (1.5859 => 2.3996, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.34% (8.1363 => 11.9880, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.70% (2.2024 => 3.1209, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.40% (0.3109 => 0.4334, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.47% (21.9371 => 30.3757, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.85% (0.1062 => 0.1464, std.dev.: 0.0009) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.28% (0.4615 => 0.6151, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.10% (4.2646 => 5.6761, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.29% (1.5415 => 2.0393, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.73% (0.0479 => 0.0631, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: 29.75% (1.1642 => 1.5106, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.15% (0.5105 => 0.6542, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.00% (0.1125 => 0.1440, std.dev.: 0.0024) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.82% (0.1143 => 0.1461, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.65% (0.1584 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.38% (0.1892 => 0.2410, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.13% (0.6675 => 0.8486, std.dev.: 0.0118) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.31% (0.2554 => 0.3226, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 26.08% (9.4845 => 11.9576, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.92% (3.8922 => 4.9009, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.16% (0.1566 => 0.1960, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.80% (0.3121 => 0.3895, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.66% (0.0730 => 0.0910, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 23.97% (1.0722 => 1.3292, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 23.97% (0.4289 => 0.5317, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.97% (1.4186 => 1.7586, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.78% (0.1337 => 0.1655, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.33% (0.4620 => 0.5698, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.24% (0.1695 => 0.2089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.46% (0.7115 => 0.8713, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.11% (0.2700 => 0.3297, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/messages-2: 22.05% (0.0662 => 0.0808, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 21.84% (0.1163 => 0.1417, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.74% (0.7835 => 0.9538, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.63% (0.0675 => 0.0821, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761) MultiSource/Benchmarks/Olden/em3d/em3d: 21.53% (0.1695 => 0.2060, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.52% (0.1236 => 0.1502, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 20.82% (0.3098 => 0.3743, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.67% (1.3050 => 1.5748, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 20.58% (5.7591 => 6.9444, std.dev.: 0.0065) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.42% (0.6456 => 0.7774, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.41% (0.5860 => 0.7056, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.35% (0.1032 => 0.1242, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.06% (0.8172 => 0.9811, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.85% (0.1940 => 0.2325, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.66% (0.0834 => 0.0998, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.62% (4.9449 => 5.9149, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.18% (0.2758 => 0.3287, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.14% (0.0648 => 0.0772) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.86% (5.0018 => 5.9450, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.83% (0.0770 => 0.0915, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.80% (0.5020 => 0.5964, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 18.80% (3.3354 => 3.9625, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.72% (0.3307 => 0.3926, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 18.58% (0.7433 => 0.8814, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.08% (0.1117 => 0.1319, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.06% (0.5569 => 0.6575, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.92% (0.9765 => 1.1515, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.80% (0.2107 => 0.2482, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.47% (1.1840 => 1.3909, std.dev.: 0.0108) MultiSource/Applications/lua/lua: 17.39% (3.8723 => 4.5458, std.dev.: 0.0230) MultiSource/Applications/treecc/treecc: 17.37% (2.0273 => 2.3795, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 17.32% (0.3423 => 0.4016, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.27% (0.5981 => 0.7014, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.18% (1.1861 => 1.3899, std.dev.: 0.0029) MultiSource/Applications/siod/siod: 17.05% (2.2969 => 2.6885, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.71% (0.3441 => 0.4016, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.58% (0.8101 => 0.9444, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 16.20% (0.3283 => 0.3815, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.12% (0.6450 => 0.7490, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3232 => 0.3743, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 15.71% (0.2049 => 0.2371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814) MultiSource/Benchmarks/McCat/09-vor/vor: 15.60% (0.3180 => 0.3676, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.82% (0.8921 => 1.0243, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.74% (0.8067 => 0.9256, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.82% (0.3865 => 0.4399, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 13.79% (0.3379 => 0.3845, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953) MultiSource/Benchmarks/sim/sim: 12.93% (0.3387 => 0.3825, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.86% (0.4636 => 0.5232, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 12.74% (1.5603 => 1.7591, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.62% (0.4103 => 0.4621, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.30% (0.4203 => 0.4720, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 12.22% (0.3927 => 0.4407, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/property: 11.81% (0.3886 => 0.4345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 11.78% (0.4048 => 0.4525, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 11.60% (17.1811 => 19.1745, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/lists: 11.60% (0.3422 => 0.3819, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.52% (0.2430 => 0.2710, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.45% (0.3092 => 0.3446, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: 11.24% (0.3684 => 0.4098, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions: 11.10% (0.3828 => 0.4253, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.06% (0.3826 => 0.4249, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.88% (0.4064 => 0.4506, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.86% (0.3694 => 0.4095, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.68% (0.3473 => 0.3844, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.67% (0.3543 => 0.3921, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.61% (0.3497 => 0.3868, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.56% (0.3427 => 0.3789, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.49% (0.3516 => 0.3885, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.33% (14.3668 => 15.8503, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.96% (0.1114 => 0.1225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.71% (0.2831 => 0.3106, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.17% (0.6030 => 0.6583, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.07% (2.0665 => 2.2540, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7326 => 0.7984, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 8.86% (0.5925 => 0.6450, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 8.85% (0.2871 => 0.3125, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.77% (63.2438 => 68.7875, std.dev.: 0.0227) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.69% (0.2877 => 0.3127, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.68% (0.3650 => 0.3967, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.61% (1.2842 => 1.3948, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.57% (0.3162 => 0.3433, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.37% (0.2891 => 0.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3935 => 0.4254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.3052 => 0.3298, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.02% (0.2756 => 0.2977, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.01% (0.2872 => 0.3102, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.92% (0.2802 => 0.3024, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 7.85% (0.2725 => 0.2939, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.77% (0.2793 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 7.66% (0.2714 => 0.2922, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.14% (2.2022 => 2.3595, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.4879 => 0.5182, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.86% (10.3673 => 10.8716, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/objinst: 3.48% (0.3131 => 0.3240, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.28% (7.9617 => 8.1432, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4734, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.08% (1.1396 => 1.2431, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4564, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3102, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0075) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.28% (0.9957 => 1.0284, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9080, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2807, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.64% (3.6395 => 3.6992, std.dev.: 0.0194) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2409, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4543, std.dev.: 0.0222) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1694, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.88% (5.2763 => 1.1672, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.14% (5.3855 => 4.4623, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.57% (5.3526 => 4.4659, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -13.69% (10.4361 => 9.0069, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.50% (1.7609 => 1.6112, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -7.98% (54.1659 => 49.8429, std.dev.: 0.0244) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.71% (1.9577 => 0.6713, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3043, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.69% (1.5373 => 1.0194, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.69% (10.7105 => 7.4239, std.dev.: 0.0307) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8590, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.31% (2.6546 => 2.0093, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4226, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.12% (3.1443 => 2.7317, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2884, std.dev.: 0.0049) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7033, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.76% (1.2373 => 1.1537, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.29% (0.2497 => 0.2340, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.61% (8.1563 => 7.6989, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -4.50% (10.2830 => 9.8200, std.dev.: 0.0124) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5858, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2353, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8595, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.14% (0.2116 => 0.0653, std.dev.: 0.0011) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 08:38:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 10:38:51 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123163851.CBB012A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7865?compare_to=7862&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7865, Order: 173262, Start Time: 2013-01-23 14:34:44, End Time: 2013-01-23 16:39:08 To: 7862, Order: 173252, Start Time: 2013-01-23 12:13:30, End Time: 2013-01-23 14:15:42 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 15 (9 on baseline) Performance Improvements: 1 (21 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1048 (1033 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.64% (0.2934 => 0.3657, std.dev.: 0.0184) MultiSource/Applications/sqlite3/sqlite3: 7.42% (16.0196 => 17.2079, std.dev.: 0.1953) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.44% (14.6030 => 15.2513, std.dev.: 0.1663) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Fhourstones/fhourstones: 27.44% (1.2616 => 1.6078, std.dev.: 0.0236) MultiSource/Applications/minisat/minisat: 18.68% (6.2669 => 7.4374, std.dev.: 0.3777) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.85% (44.9715 => 49.4023, std.dev.: 0.1498) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.98% (1.0758 => 1.1294, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 2.72% (3.4385 => 3.5320, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.69% (0.4022 => 0.4130, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 2.58% (2.1590 => 2.2146, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.20% (2.3772 => 2.4295, std.dev.: 0.0141) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.18% (16.3413 => 16.6981, std.dev.: 0.1299) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.45% (3.7396 => 3.7938, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.39% (5.1815 => 5.2535, std.dev.: 0.0196) SingleSource/Benchmarks/Misc/ffbench: 1.05% (1.3987 => 1.4134, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.21% (1.3554 => 1.3255, std.dev.: 0.0103) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 5.45% (1.1372 => 1.1992, std.dev.: 0.1511) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0223 => 0.0222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0435 => 0.0433, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.88% (0.0339 => 0.0336, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0321 => 0.0319, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0433 => 0.0434, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -10.05% (0.0209 => 0.0188, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.30% (0.0253 => 0.0232, std.dev.: 0.0069) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1477 => 0.1475, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: 3.76% (1.2487 => 1.2956, std.dev.: 0.3121) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.15% (0.4235 => 0.4326, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.26% (0.1504 => 0.1485, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.1001 => 0.0979, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.94% (0.0263 => 0.0276, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.49% (0.0579 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.40% (1.1485 => 1.1531, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.27% (0.0618 => 0.0604, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.40% (0.0247 => 0.0248, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.43% (0.7438 => 0.7406, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.35% (0.0068 => 0.0090, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7916 => 12.7627, std.dev.: 0.0399) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.75% (0.0336 => 0.0483, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.19% (0.2993 => 0.3657, std.dev.: 0.0184) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.24% (1.4110 => 1.5131, std.dev.: 0.0268) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319500.00% (0.0008 => 2.5568, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.45% (1.1825 => 2.4295, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.24% (0.2562 => 0.2850, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.17% (46.0987 => 49.4023, std.dev.: 0.1498) SingleSource/Benchmarks/Misc/pi: 3.53% (2.1390 => 2.2146, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.72% (1.0995 => 1.1294, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.75% (0.0676 => 0.0556, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.94% (0.0862 => 0.0716, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.35% (1.0986 => 0.9410, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.66% (0.7686 => 0.6713, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.33% (0.1079 => 0.0946, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.47% (6.4235 => 5.8795, std.dev.: 0.2023) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.67% (0.3665 => 0.3494, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.93% (0.9422 => 0.9052, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.13% (0.9403 => 0.9109, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: -2.85% (0.3715 => 0.3609, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -30.07% (4.4739 => 3.1285, std.dev.: 0.3418) SingleSource/Benchmarks/Shootout/hash: -10.42% (4.5259 => 4.0544, std.dev.: 0.0781) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.14% (1.4588 => 1.3255, std.dev.: 0.0103) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.52% (0.3217 => 0.2975, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.27% (1.4446 => 1.3829, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/lists: -3.54% (17.2182 => 16.6093, std.dev.: 0.1385) SingleSource/Benchmarks/Stanford/FloatMM: -1.46% (0.8328 => 0.8206, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.17% (3.1921 => 3.1547, std.dev.: 0.0083) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.46% (1.2047 => 1.1992, std.dev.: 0.1511) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -11.74% (0.0213 => 0.0188, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0009) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0069) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.59% (0.1530 => 0.1475, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: -32.85% (1.9293 => 1.2956, std.dev.: 0.3121) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.84% (0.4049 => 0.4326, std.dev.: 0.0145) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1510 => 0.1485, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.10% (0.0978 => 0.0979, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.27% (0.0590 => 0.0553, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.74% (1.1617 => 1.1531, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0077) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.46% (0.0268 => 0.0248, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.42% (0.7437 => 0.7406, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.17% (0.0092 => 0.0090, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7627, std.dev.: 0.0399) Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 09:01:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 11:01:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123170153.D1C472A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7866?compare_to=7863&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7866, Order: 173264, Start Time: 2013-01-23 15:27:23, End Time: 2013-01-23 17:02:07 To: 7863, Order: 173259, Start Time: 2013-01-23 13:29:32, End Time: 2013-01-23 15:03:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.13% (0.0315 => 0.0706, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.00% (0.0280 => 0.0518, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.45% (0.0974 => 0.1631, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.22% (0.6395 => 0.8775, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.76% (0.0699 => 0.0928, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.95% (0.6260 => 0.8260, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.95% (0.5456 => 0.7199, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.93% (0.5688 => 0.7504, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.85% (0.5805 => 0.7654, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.61% (0.5849 => 0.7698, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.28% (0.5581 => 0.7327, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.21% (0.5575 => 0.7315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.17% (0.5567 => 0.7302, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.74% (0.6395 => 0.8361, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.40% (0.5941 => 0.7747, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.65% (0.5859 => 0.7596, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.32% (0.6033 => 0.7802, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.68% (1.6474 => 2.1199, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.44% (0.6304 => 0.8034, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.22% (0.6230 => 0.7926, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.39% (0.5802 => 0.7333, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.13% (0.6660 => 0.8400, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.08% (0.5925 => 0.7470, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.64% (0.5705 => 0.7168, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.39% (0.5857 => 0.7344, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.17% (0.5478 => 0.6857, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.98% (0.5569 => 0.6960, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.87% (0.5570 => 0.6955, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.70% (0.5591 => 0.6972, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.49% (0.5863 => 0.7240, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.34% (0.7524 => 0.9280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.31% (0.6052 => 0.7463, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.25% (0.6446 => 0.7945, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.80% (0.6681 => 0.8204, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.36% (0.6194 => 0.7579, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.36% (0.6297 => 0.7705, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.67% (2.2587 => 2.7481, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.74% (0.0622 => 0.0751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.73% (0.6667 => 0.8049, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.17% (0.7339 => 0.8746, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.10% (0.3834 => 0.4528, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.23% (0.1146 => 0.1332, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.74% (1.1450 => 1.3138, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.44% (0.1230 => 0.1383, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.96% (0.4916 => 0.5504, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.91% (4.5069 => 5.0438, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/05-eks/eks: 11.47% (0.4515 => 0.5033, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.34% (3.5339 => 3.9348, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.18% (1.6364 => 1.8194, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.65% (0.1982 => 0.2193, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.90% (0.2385 => 0.2621, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 9.39% (9.2283 => 10.0951, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.84% (0.1731 => 0.1884, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.19% (1.2515 => 1.3540, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.88% (0.5329 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.78% (0.4524 => 0.4876, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.24% (0.4861 => 0.5213, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.4642 => 1.5682, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 6.55% (0.1879 => 0.2002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3255 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.74% (0.1761 => 0.1862, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.76% (0.3319 => 0.3477, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (5.4682 => 5.6974, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.75% (0.6750 => 0.7003, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 3.33% (5.0226 => 5.1901, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: 2.93% (0.3446 => 0.3547, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.59% (0.8418 => 0.8636, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 2.59% (1.3864 => 1.4223, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.24% (0.9557 => 0.9771, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 2.23% (0.7447 => 0.7613, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (22.4056 => 22.8471, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 1.70% (15.5079 => 15.7723, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.53% (1.3722 => 1.3932, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.80% (31.3723 => 55.7805, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5534, std.dev.: 0.0397) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3828, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.79% (4.5320 => 4.6133, std.dev.: 0.0050) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.18% (10.3489 => 10.4706, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330) SingleSource/Benchmarks/Shootout-C++/objinst: -5.29% (0.3194 => 0.3025, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.03% (0.7198 => 0.6836, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/trivial-interface: -4.77% (0.3812 => 0.3630, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.76% (2.4924 => 2.3738, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.66% (0.3880 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.65% (0.3848 => 0.3669, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/for-in: -4.46% (0.4033 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.45% (0.3891 => 0.3718, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.26% (0.4176 => 0.3998, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.17% (0.3837 => 0.3677, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.16% (0.3821 => 0.3662, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.12% (0.3884 => 0.3724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9852 => 0.9491, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.50% (0.6347 => 0.6125, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -3.29% (0.4280 => 0.4139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.26% (0.6441 => 0.6231, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.25% (0.3323 => 0.3215, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.06% (2.1713 => 2.1049, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -2.99% (1.3148 => 1.2755, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.9542 => 0.9266, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -2.88% (0.7779 => 0.7555, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.82% (0.6484 => 0.6301, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.42% (20.7746 => 20.2716, std.dev.: 0.0218) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.37% (14.2083 => 13.8712, std.dev.: 0.0172) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.97% (6.7716 => 6.6380, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: -1.77% (17.1032 => 16.8000, std.dev.: 0.0153) MultiSource/Applications/JM/lencod/lencod: -1.69% (16.1920 => 15.9176, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.59% (1.0544 => 1.0376, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.52% (1.2210 => 1.2025, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.45% (0.7919 => 0.7804, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.45% (1.2221 => 1.2044, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.43% (7.0961 => 6.9945, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/football/football: -1.18% (0.9179 => 0.9071, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -1.08% (4.3330 => 4.2860, std.dev.: 0.0042) MultiSource/Applications/hbd/hbd: -1.04% (1.5610 => 1.5448, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.64% (1.8100 => 0.6763, std.dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.01% (1.3643 => 1.0231, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0780, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1967, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1284, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.19% (1.0557 => 1.0220, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7589, std.dev.: 0.0354) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.23% (3.7241 => 3.6412, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4692, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1909, std.dev.: 0.0215) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.49% (1.6219 => 1.5978, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.28% (1.6086 => 1.5880, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.27% (3.7092 => 3.6622, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6105, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 09:31:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 11:31:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130123173135.5B4482A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7867?compare_to=7861&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7867, Order: 173259, Start Time: 2013-01-23 13:57:36, End Time: 2013-01-23 17:31:49 To: 7861, Order: 173240, Start Time: 2013-01-23 09:31:58, End Time: 2013-01-23 13:06:24 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (182 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.83% (2.3971 => 2.4409, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (1.5616 => 1.5815, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 11.58% (106.3560 => 118.6675, std.dev.: 0.0406) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.71% (2.1666 => 2.2037, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.34% (1.1626 => 1.1470, std.dev.: 0.0016) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.20% (0.0625 => 0.0895, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.46% (0.2969 => 0.3814, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.85% (0.1106 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.72% (0.4139 => 0.5245, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.47% (0.5900 => 0.7462, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.01% (0.4994 => 0.6293, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.96% (0.4253 => 0.5357, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.68% (0.0475 => 0.0597, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.02% (0.1107 => 0.1384, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.91% (1.5932 => 1.9900, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.74% (0.5000 => 0.6237, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 24.37% (0.0599 => 0.0745, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.26% (0.1620 => 0.2013, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.86% (0.0897 => 0.1111, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.70% (0.1021 => 0.1263, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.77% (0.0584 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.68% (0.0948 => 0.1163, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.43% (0.0642 => 0.0786, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.34% (0.1549 => 0.1895, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.33% (0.1003 => 0.1227, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.22% (0.0495 => 0.0605) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.12% (0.1103 => 0.1347, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.03% (0.3903 => 0.4763, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.01% (0.1604 => 0.1957, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.90% (0.0822 => 0.1002, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.63% (0.0541 => 0.0658, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 21.44% (0.0821 => 0.0997, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.43% (0.1619 => 0.1966, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 20.59% (0.0947 => 0.1142, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.40% (0.4029 => 0.4851, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.39% (0.3271 => 0.3938, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.25% (1.3152 => 1.5815, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.18% (0.3890 => 0.4675, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.13% (0.1088 => 0.1307, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.11% (0.1462 => 0.1756, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 19.95% (0.1218 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.81% (0.2014 => 0.2413, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 19.63% (0.0698 => 0.0835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.44% (0.2736 => 0.3268, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 19.34% (0.1505 => 0.1796, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 19.17% (0.5546 => 0.6609, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.12% (0.2866 => 0.3414, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 18.70% (1.8794 => 2.2308, std.dev.: 0.0077) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.68% (0.0605 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.32% (0.0573 => 0.0678, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.20% (1.6211 => 1.9161, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.03% (3.5627 => 4.2050, std.dev.: 0.0125) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.80% (0.4658 => 0.5487, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 17.60% (0.1284 => 0.1510, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.59% (0.5026 => 0.5910, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.59% (0.1160 => 0.1364, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 17.51% (0.5826 => 0.6846, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.35% (0.0582 => 0.0683, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference-object: 17.22% (0.5889 => 0.6903, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 17.15% (0.9697 => 1.1360, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.1421 => 0.1663, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.99% (1.9694 => 2.3040, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.97% (0.4361 => 0.5101, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.92% (0.3930 => 0.4595, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 16.87% (0.2875 => 0.3360, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 16.79% (1.0781 => 1.2591, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 16.58% (0.2823 => 0.3291, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 16.51% (0.2750 => 0.3204, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 16.49% (0.2813 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.47% (1.9966 => 2.3255, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/except: 16.36% (0.2811 => 0.3271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.36% (0.2714 => 0.3158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.33% (0.2738 => 0.3185, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.30% (0.2803 => 0.3260, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.30% (0.2792 => 0.3247, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 16.29% (0.2725 => 0.3169, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.28% (2.7292 => 3.1735, std.dev.: 0.0150) MultiSource/Applications/ClamAV/clamscan: 16.26% (4.2109 => 4.8958, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 16.22% (0.2780 => 0.3231, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.16% (0.2729 => 0.3170, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 16.12% (0.7171 => 0.8327, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.08% (0.2911 => 0.3379, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.05% (2.0673 => 2.3991, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.96% (0.3195 => 0.3705, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 15.81% (0.3004 => 0.3479, std.dev.: 0.0062) MultiSource/Applications/hexxagon/hexxagon: 15.75% (0.9909 => 1.1470, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 15.73% (0.3096 => 0.3583, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 15.71% (23.5202 => 27.2156, std.dev.: 0.0414) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.61% (4.4195 => 5.1096, std.dev.: 0.0289) SingleSource/Benchmarks/Shootout-C++/ary3: 15.58% (0.3267 => 0.3776, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3258 => 0.3760, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.39% (0.3060 => 0.3531, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.33% (1.4269 => 1.6456, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary2: 15.16% (0.3317 => 0.3820, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 15.14% (0.3726 => 0.4290, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.05% (0.1090 => 0.1254, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 15.04% (0.3477 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.98% (0.3124 => 0.3592, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.93% (0.3362 => 0.3864, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 14.90% (0.3348 => 0.3847, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 14.81% (0.3282 => 0.3768, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 14.76% (0.3678 => 0.4221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.76% (0.3625 => 0.4160, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 14.64% (0.3469 => 0.3977, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 14.61% (0.4251 => 0.4872, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 14.60% (0.3446 => 0.3949, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 14.60% (0.3460 => 0.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.55% (0.3690 => 0.4227, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-4: 14.55% (0.3465 => 0.3969, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 14.38% (0.4146 => 0.4742, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 14.36% (0.3650 => 0.4174, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 14.35% (0.7875 => 0.9005, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.24% (0.3981 => 0.4548, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.18% (0.3724 => 0.4252, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.05% (0.3643 => 0.4155, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 13.69% (2.1653 => 2.4618, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 13.67% (0.5012 => 0.5697, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 13.62% (5.5417 => 6.2967, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.58% (0.3845 => 0.4367, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.25% (0.2075 => 0.2350, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 13.19% (0.2691 => 0.3046, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 13.16% (4.6177 => 5.2252, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (2.1013 => 2.3735, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.74% (0.6435 => 0.7255, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.09% (0.2737 => 0.3068, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.09% (0.2068 => 0.2318, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.96% (0.2040 => 0.2284, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.84% (0.3498 => 0.3912, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.75% (0.5361 => 0.5991, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.26% (0.6634 => 0.7381, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.22% (0.3084 => 0.3430, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.06% (0.4847 => 0.5383, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 10.94% (0.3336 => 0.3701, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.94% (0.2103 => 0.2333, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.29% (11.6398 => 12.8381, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: 10.08% (0.2391 => 0.2632, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.07% (0.7426 => 0.8174, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 9.34% (2.0346 => 2.2247, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.32% (4.6926 => 5.1299, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.12% (0.5584 => 0.6093, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 7.06% (11.9555 => 12.7994, std.dev.: 0.0205) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.20% (0.3792 => 0.3989, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.61% (29.0505 => 181.4525, std.dev.: 0.0389) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0062) MultiSource/Applications/ClamAV/clamscan: 9.06% (0.2802 => 0.3056, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3693 => 0.3999, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6105, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6770, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2417, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.97% (1.8057 => 1.8955, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6757, std.dev.: 0.0082) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1905, std.dev.: 0.0092) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3063, std.dev.: 0.0133) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.34% (2.1746 => 2.2037, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2092, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4793, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5829, std.dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.43% (2.4764 => 2.4409, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5766, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.89% (17.2379 => 14.3262, std.dev.: 0.0236) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7907, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/ary2: -7.33% (0.2402 => 0.2226, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2175, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8064, std.dev.: 0.0068) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.84% (0.6293 => 0.6114, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.23% (197.4719 => 193.0590, std.dev.: 0.0580) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5797, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2089, std.dev.: 0.0659) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0425, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 09:45:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 11:45:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123174522.7ECE42A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7868?compare_to=7864&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7868, Order: 173264, Start Time: 2013-01-23 15:34:28, End Time: 2013-01-23 17:45:36 To: 7864, Order: 173256, Start Time: 2013-01-23 12:52:58, End Time: 2013-01-23 15:03:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1331 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0653 => 0.0654, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8490 => 499.8428, std.dev.: 0.0151) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44224.09% (1.1277 => 499.8428, std.dev.: 0.0151) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 213.69% (0.5229 => 1.6403, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.42% (14.9895 => 18.0504, std.dev.: 0.0103) MultiSource/Applications/kimwitu++/kc: 43.78% (14.1553 => 20.3520, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 18.26% (4.1105 => 4.8612, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.22% (1.1048 => 1.7259, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.13% (7.1582 => 37.8046, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.32% (3.4629 => 6.4176, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.43% (0.6222 => 1.0853, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10282.64% (0.0720 => 7.4755, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11146500.00% (0.0001 => 11.1466, std.dev.: 0.0730) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848200.00% (0.0001 => 9.8483, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488200.00% (0.0001 => 5.4883, std.dev.: 0.0317) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.62% (1.1194 => 10.3054, std.dev.: 0.0253) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.36% (22.1758 => 55.2971, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 70.75% (0.1463 => 0.2498, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.79% (2.9384 => 4.6072, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.46% (7.0540 => 10.8253, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.09% (1.5859 => 2.3962, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.09% (8.1363 => 11.9673, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.38% (2.2024 => 3.1137, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 39.11% (0.3109 => 0.4325, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 38.05% (21.9371 => 30.2850, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0013) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.78% (4.2646 => 5.6624, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.65% (0.4615 => 0.6122, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.18% (1.5415 => 2.0376, std.dev.: 0.0115) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.25% (0.2271 => 0.2958, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 30.01% (0.4299 => 0.5589, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.66% (1.1642 => 1.5095, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.56% (0.1125 => 0.1435, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Oscar: 27.36% (0.0636 => 0.0810, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.25% (0.5105 => 0.6496, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.06% (0.1892 => 0.2404, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.86% (0.1143 => 0.1450, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.73% (0.6675 => 0.8459, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.62% (0.2554 => 0.3234, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.26% (0.1584 => 0.2000, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 25.69% (9.4845 => 11.9207, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.62% (3.8922 => 4.8893, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: 25.44% (0.1655 => 0.2076, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.00% (0.3121 => 0.3870, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.97% (0.0730 => 0.0905, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.90% (1.4186 => 1.7576, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 23.88% (0.1566 => 0.1940, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: 23.81% (0.4289 => 0.5310, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 23.75% (1.0722 => 1.3268, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.05% (0.4620 => 0.5685, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.95% (0.1695 => 0.2084, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 22.12% (0.7115 => 0.8689, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.93% (0.2700 => 0.3292, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 21.86% (0.1555 => 0.1895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.39% (0.7835 => 0.9511, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.38% (0.1029 => 0.1249, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/em3d/em3d: 21.36% (0.1695 => 0.2057, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.90% (0.0842 => 0.1018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.79% (0.3098 => 0.3742, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.45% (5.7591 => 6.9366, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.31% (1.3050 => 1.5701, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 20.07% (0.6456 => 0.7752, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.95% (0.8172 => 0.9802, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.73% (0.5860 => 0.7016, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.66% (0.0834 => 0.0998) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.40% (4.9449 => 5.9042, std.dev.: 0.0205) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 18.68% (3.3354 => 3.9584, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.59% (5.0018 => 5.9315, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.26% (0.2065 => 0.2442, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.14% (0.3307 => 0.3907, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.12% (0.5569 => 0.6578, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.11% (0.5020 => 0.5929, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 17.69% (0.7433 => 0.8748, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.60% (0.9765 => 1.1484, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 17.25% (3.8723 => 4.5403, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.16% (1.1861 => 1.3896, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.12% (1.1840 => 1.3867, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 17.05% (2.0273 => 2.3729, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.92% (0.5981 => 0.6993, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.66% (0.8101 => 0.9451, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.49% (2.2969 => 2.6756, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.36% (0.3441 => 0.4004, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.08% (0.6450 => 0.7487, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 15.87% (0.3283 => 0.3804, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.50% (0.3232 => 0.3733, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 15.41% (0.3180 => 0.3670, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 15.37% (0.2049 => 0.2364, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.52% (0.8921 => 1.0216, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.26% (0.8067 => 0.9217, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.61% (0.3379 => 0.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.38% (0.3865 => 0.4382, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.37% (0.0838 => 0.0950, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 12.81% (0.3387 => 0.3821, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.64% (0.4636 => 0.5222, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 12.43% (1.5603 => 1.7543, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.41% (0.4103 => 0.4612, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.97% (0.4203 => 0.4706, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.47% (17.1811 => 19.1516, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout-C++/lists: 11.46% (0.3422 => 0.3814, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.43% (0.3684 => 0.4105, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.35% (0.3603 => 0.4012, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/bh/bh: 11.32% (0.3092 => 0.3442, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.28% (0.2430 => 0.2704, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.09% (0.3282 => 0.3646, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.95% (0.3826 => 0.4245, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 10.61% (0.3828 => 0.4234, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.48% (0.4064 => 0.4490, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.30% (0.3427 => 0.3780, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.13% (0.3543 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.08% (14.3668 => 15.8149, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/trivial-interface: 10.08% (0.3473 => 0.3823, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.98% (0.3497 => 0.3846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.86% (0.1268 => 0.1393, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.50% (0.2831 => 0.3100, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.10% (2.0665 => 2.2545, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 8.67% (0.2871 => 0.3120, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 8.65% (0.2877 => 0.3126, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.64% (0.7326 => 0.7959, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: 8.58% (1.2842 => 1.3944, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.54% (0.5925 => 0.6431, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.52% (63.2438 => 68.6293, std.dev.: 0.0119) SingleSource/Regression/C++/ofstream_ctor: 8.40% (0.2905 => 0.3149, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.25% (0.3650 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.13% (0.2891 => 0.3126, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.06% (0.3935 => 0.4252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 7.96% (0.3052 => 0.3295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.91% (0.2756 => 0.2974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 7.85% (0.2802 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.83% (0.2872 => 0.3097, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 7.71% (0.2725 => 0.2935, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.70% (0.2793 => 0.3008, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.52% (0.2714 => 0.2918, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.37% (0.3136 => 0.3367, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (2.2022 => 2.3535, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.29% (0.4879 => 0.5186, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.01% (0.3177 => 0.3368, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: 4.57% (10.3673 => 10.8413, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.83% (0.3817 => 0.3925, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.14% (7.9617 => 8.1323, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4731, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2436, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4273, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4490, std.dev.: 0.0141) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (3.1578 => 3.3101, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.56% (0.3316 => 0.3434, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.24% (0.9957 => 1.0280, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9055, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.44% (3.6395 => 3.7283, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.72% (9.1159 => 9.2728, std.dev.: 0.0309) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2389, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4550, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5768, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.86% (5.2763 => 1.1681, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.08% (5.3855 => 4.4659, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.49% (5.3526 => 4.4701, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -13.71% (10.4361 => 9.0052, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.63% (1.7609 => 1.6089, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -7.93% (54.1659 => 49.8714, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.52% (1.9577 => 0.6555, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3091, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.43% (1.5373 => 1.0234, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.51% (10.7105 => 7.4424, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8548, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0055, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4945, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.12% (19.9488 => 18.3281, std.dev.: 0.0285) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7053, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.64% (1.2373 => 1.1551, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.29% (0.2497 => 0.2340, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.59% (8.1563 => 7.7005, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.59% (1.5835 => 1.5108, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8289, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0119) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.6441 => 4.5842, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7221 => 3.6809, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2303, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8561, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout/ary3: -1.07% (3.6994 => 3.6597, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0031) Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 11:00:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 13:00:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123190005.87BEE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7869?compare_to=7866&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7869, Order: 173272, Start Time: 2013-01-23 17:25:47, End Time: 2013-01-23 19:00:19 To: 7866, Order: 173264, Start Time: 2013-01-23 15:27:23, End Time: 2013-01-23 17:02:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.27% (0.5805 => 0.7678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.22% (0.6260 => 0.8277, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.07% (0.5688 => 0.7512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.98% (0.5456 => 0.7201, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.70% (0.5849 => 0.7703, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.50% (0.5581 => 0.7339, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.40% (0.5567 => 0.7315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.32% (0.5575 => 0.7321, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.29% (0.6395 => 0.8396, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.50% (0.5941 => 0.7753, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.77% (0.5859 => 0.7603, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.55% (0.6033 => 0.7816, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.08% (0.6440 => 0.8313, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.89% (1.6474 => 2.1233, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.44% (0.6189 => 0.7949, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.10% (0.6676 => 0.8552, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.58% (0.6230 => 0.7948, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.53% (0.5802 => 0.7341, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.45% (0.5925 => 0.7492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.05% (0.5705 => 0.7191, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.47% (0.5857 => 0.7349, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.30% (0.5478 => 0.6864, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.19% (0.5570 => 0.6973, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.18% (0.5591 => 0.6999, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.09% (0.5569 => 0.6966, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.79% (0.5863 => 0.7258, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (0.6446 => 0.7975, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.44% (0.7524 => 0.9288, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.43% (0.6052 => 0.7470, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.02% (0.6681 => 0.8219, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.76% (0.6194 => 0.7604, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.58% (0.6297 => 0.7719, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.79% (2.2587 => 2.7509, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.01% (0.6667 => 0.8068, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.35% (0.7339 => 0.8759, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 15.03% (1.1450 => 1.3171, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.17% (0.1230 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (4.5069 => 5.0714, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4916 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.57% (3.5339 => 3.9426, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.37% (1.6364 => 1.8224, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.95% (0.1982 => 0.2199, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (9.2283 => 10.1133, std.dev.: 0.0115) MultiSource/Applications/Burg/burg: 8.61% (1.2515 => 1.3593, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.14% (0.5329 => 0.5763, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.91% (0.1731 => 0.1868, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.48% (0.7021 => 0.7546, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.43% (0.4524 => 0.4860, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.4642 => 1.5720, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.95% (1.2784 => 1.3672, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 6.93% (0.4861 => 0.5198, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.3255 => 0.3436, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.12% (0.3319 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.36% (5.4682 => 5.7064, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 3.94% (0.6750 => 0.7016, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.63% (5.0226 => 5.2048, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: 2.99% (0.3446 => 0.3549, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.98% (0.8418 => 0.8669, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 2.81% (1.3864 => 1.4254, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.27% (0.7447 => 0.7616, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.25% (0.9557 => 0.9772, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.25% (22.4056 => 22.9094, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5168 => 0.5283, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 2.06% (15.5079 => 15.8278, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.3722 => 1.3973, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8153, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.06% (11.6767 => 12.1503, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4523, std.dev.: 0.1394) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0054) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3816, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.5320 => 4.6109, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.56% (79.7170 => 80.9600, std.dev.: 0.2008) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.28% (10.3489 => 10.4818, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.57% (0.3194 => 0.3016, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.45% (0.7198 => 0.6878, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -4.39% (2.4924 => 2.3829, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.38% (0.3837 => 0.3669, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.07% (0.3812 => 0.3657, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.02% (0.3831 => 0.3677, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.78% (0.3891 => 0.3744, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.4033 => 0.3881, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.73% (0.3323 => 0.3199, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.63% (0.9852 => 0.9494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.62% (0.2903 => 0.2798, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: -3.37% (0.3059 => 0.2956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.32% (2.1713 => 2.0992, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: -3.23% (0.6347 => 0.6142, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.11% (0.3252 => 0.3151, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.04% (0.9542 => 0.9252, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -3.03% (1.3148 => 1.2749, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -3.01% (0.6441 => 0.6247, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/property: -3.00% (0.4199 => 0.4073, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.50% (0.6484 => 0.6322, std.dev.: 0.0033) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2830, std.dev.: 0.0232) SingleSource/UnitTests/ObjC++/property-reference: -2.25% (0.7779 => 0.7604, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.93% (14.2083 => 13.9335, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: -1.69% (17.1032 => 16.8149, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.66% (6.7716 => 6.6593, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -1.47% (16.1920 => 15.9541, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.30% (1.0544 => 1.0407, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.15% (1.2210 => 1.2069, std.dev.: 0.0014) MultiSource/Applications/JM/ldecod/ldecod: -1.09% (7.0961 => 7.0191, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.07% (1.2221 => 1.2090, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.08% (1.8100 => 0.7045, std.dev.: 0.0236) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3160, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7590, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0841, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1967, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9703 => 2.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1269, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3558, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (7.9763 => 7.7855, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.23% (3.7241 => 3.6411, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4675, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1923, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6075, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7092 => 3.6638, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 11:33:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 13:33:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123193357.7C1692A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7870?compare_to=7865&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7870, Order: 173270, Start Time: 2013-01-23 16:57:21, End Time: 2013-01-23 19:34:12 To: 7865, Order: 173262, Start Time: 2013-01-23 14:34:44, End Time: 2013-01-23 16:39:08 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 54 (53 on baseline) Performance Improvements: 2 (8 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1008 (1002 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 57.12% (0.9520 => 1.4958, std.dev.: 0.1111) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 55.64% (0.8781 => 1.3667, std.dev.: 0.1727) MultiSource/Benchmarks/Olden/voronoi/voronoi: 53.76% (0.2831 => 0.4353, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 51.75% (0.8776 => 1.3318, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.33% (0.8756 => 1.2988, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 47.61% (0.2283 => 0.3370, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 47.36% (0.8664 => 1.2767, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 46.89% (0.9935 => 1.4594, std.dev.: 0.1000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 46.11% (0.9410 => 1.3749, std.dev.: 0.1416) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.73% (1.0026 => 1.4611, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 45.70% (0.9237 => 1.3458, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 44.46% (0.9632 => 1.3914, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 44.20% (0.9506 => 1.3708, std.dev.: 0.0872) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 44.05% (0.9063 => 1.3055, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C++/office/office: 41.39% (0.2172 => 0.3071, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/bc/bc: 39.91% (1.2958 => 1.8129, std.dev.: 0.1090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.08% (0.9177 => 1.2672, std.dev.: 0.0700) SingleSource/Benchmarks/McGill/chomp: 38.01% (0.1710 => 0.2360, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.42% (0.0486 => 0.0663, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.79% (0.9052 => 1.2111, std.dev.: 0.0700) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 31.92% (0.2992 => 0.3947, std.dev.: 0.0208) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.22% (7.2481 => 9.4383, std.dev.: 0.6990) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.91% (0.9456 => 1.2284, std.dev.: 0.0813) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 29.58% (0.0933 => 0.1209, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.78% (0.1141 => 0.1458, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 27.10% (2.5762 => 3.2743, std.dev.: 0.2038) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0965 => 0.1117, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.81% (0.7102 => 0.8083, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/hash2: 4.99% (0.4825 => 0.5066, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 4.90% (0.2142 => 0.2247, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 48.59% (0.0284 => 0.0422, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 32.56% (3.1540 => 4.1810, std.dev.: 0.3449) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 23.35% (0.0968 => 0.1194, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 16.78% (19.4765 => 22.7443, std.dev.: 0.5250) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 10.88% (0.1590 => 0.1763, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.70% (6.6126 => 7.0557, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 6.32% (39.1819 => 41.6579, std.dev.: 0.8018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.12% (5.9003 => 6.2026, std.dev.: 0.1139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.76% (4.7961 => 5.0246, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.76% (5.6904 => 5.9615, std.dev.: 0.0735) SingleSource/Benchmarks/Shootout-C++/hash: 4.73% (0.6157 => 0.6448, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.20% (4.9871 => 5.1967, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.69% (11.3585 => 11.7778, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.49% (4.9647 => 5.1379, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.09% (4.7946 => 4.9429, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.01% (4.8621 => 5.0084, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.76% (5.8992 => 6.0619, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.62% (5.5605 => 5.7064, std.dev.: 0.0538) MultiSource/Benchmarks/Olden/em3d/em3d: 2.08% (4.8918 => 4.9934, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.86% (4.7308 => 4.8188, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 1.63% (3.5977 => 3.6565, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.47% (5.8646 => 5.9507, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.29% (9.7615 => 9.8877, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.05% (11.6113 => 11.7336, std.dev.: 0.0139) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.85% (1.1294 => 1.0859, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/except: -2.90% (0.5143 => 0.4994, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 20.01% (1.1992 => 1.4392, std.dev.: 0.2169) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.21% (0.0222 => 0.0238, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.70% (0.0433 => 0.0449, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.95% (0.0336 => 0.0356, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 6.90% (0.0319 => 0.0341, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0434 => 0.0432, std.dev.: 0.0175) SingleSource/UnitTests/Vector/Altivec/casts: 13.30% (0.0188 => 0.0213, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: 19.00% (0.0221 => 0.0263, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 7.76% (0.0232 => 0.0250, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 87.50% (0.0008 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 19.05% (0.1475 => 0.1756, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -9.02% (1.2956 => 1.1788, std.dev.: 0.6071) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.06% (0.4326 => 0.4280, std.dev.: 0.3898) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.16% (0.1485 => 0.1532, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.25% (0.0979 => 0.1001, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0276 => 0.0279, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.42% (0.0553 => 0.0583, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.1531 => 1.1538, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.83% (0.0604 => 0.0609, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.92% (0.0248 => 0.0285, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.78% (0.7406 => 0.7464, std.dev.: 0.0978) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 36.67% (0.0090 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.03% (12.7627 => 12.7662, std.dev.: 0.4553) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 56.55% (0.0336 => 0.0526, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 56.44% (0.8736 => 1.3667, std.dev.: 0.1727) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 54.45% (0.9685 => 1.4958, std.dev.: 0.1111) MultiSource/Benchmarks/Olden/voronoi/voronoi: 50.94% (0.2884 => 0.4353, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 49.58% (0.2253 => 0.3370, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 46.50% (0.9091 => 1.3318, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 44.84% (1.0088 => 1.4611, std.dev.: 0.0959) SingleSource/Benchmarks/Misc/lowercase: 44.49% (0.0254 => 0.0367, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 44.22% (1.0119 => 1.4594, std.dev.: 0.1000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.09% (0.9405 => 1.3458, std.dev.: 0.0310) MultiSource/Benchmarks/Ptrdist/bc/bc: 42.97% (1.2680 => 1.8129, std.dev.: 0.1090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.61% (0.9612 => 1.3708, std.dev.: 0.0872) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 42.30% (0.9127 => 1.2988, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 42.15% (0.9788 => 1.3914, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 42.01% (0.8990 => 1.2767, std.dev.: 0.0691) MultiSource/Benchmarks/Prolangs-C++/office/office: 41.39% (0.2172 => 0.3071, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 38.41% (0.0479 => 0.0663, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 37.10% (0.2879 => 0.3947, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 36.70% (0.9550 => 1.3055, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 33.22% (0.9512 => 1.2672, std.dev.: 0.0700) SingleSource/Benchmarks/McGill/chomp: 31.62% (0.1793 => 0.2360, std.dev.: 0.0216) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 29.79% (7.2721 => 9.4383, std.dev.: 0.6990) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 28.71% (0.9867 => 1.2700, std.dev.: 0.1050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 28.54% (0.9422 => 1.2111, std.dev.: 0.0700) MultiSource/Benchmarks/PAQ8p/paq8p: 27.05% (2.5772 => 3.2743, std.dev.: 0.2038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 23.87% (0.0976 => 0.1209, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.14% (0.1184 => 0.1458, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 22.63% (1.0017 => 1.2284, std.dev.: 0.0813) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.03% (14.9757 => 18.1254, std.dev.: 1.1690) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.99% (0.0963 => 0.1117, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.88% (0.7225 => 0.8083, std.dev.: 0.0157) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322600.00% (0.0008 => 2.5816, std.dev.: 0.0221) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.44% (1.1825 => 2.3938, std.dev.: 0.0298) MultiSource/Benchmarks/Prolangs-C++/city/city: 38.82% (0.0304 => 0.0422, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 18.10% (0.1011 => 0.1194, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.18% (0.2562 => 0.2874, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 10.88% (20.5117 => 22.7443, std.dev.: 0.5250) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 10.39% (0.1597 => 0.1763, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.36% (6.6336 => 7.0557, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.51% (4.8076 => 5.0246, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.49% (5.7056 => 5.9615, std.dev.: 0.0735) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.87% (5.0033 => 5.1967, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.43% (11.3868 => 11.7778, std.dev.: 0.0959) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.26% (4.9757 => 5.1379, std.dev.: 0.0529) SingleSource/Benchmarks/Shootout-C++/hash: 3.10% (0.6254 => 0.6448, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.76% (5.8991 => 6.0619, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.74% (4.8112 => 4.9429, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.69% (4.8773 => 5.0084, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/em3d/em3d: 2.05% (4.8932 => 4.9934, std.dev.: 0.0192) MultiSource/Applications/siod/siod: 1.82% (3.5910 => 3.6565, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.57% (11.5523 => 11.7336, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.51% (4.7473 => 4.8188, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.28% (5.8755 => 5.9507, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.47% (1.1498 => 1.0639, std.dev.: 0.0254) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.83% (0.1164 => 0.1003, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.95% (1.4588 => 1.3283, std.dev.: 0.0239) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.55% (0.3217 => 0.2974, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.99% (23.3986 => 22.2318, std.dev.: 0.4240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -1.99% (0.5826 => 0.5710, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: -1.42% (63.1520 => 62.2538, std.dev.: 0.3371) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 19.47% (1.2047 => 1.4392, std.dev.: 0.2169) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.15% (0.0233 => 0.0238, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.44% (0.0451 => 0.0449, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.64% (0.0394 => 0.0356, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.96% (0.0328 => 0.0341, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0175) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: 15.86% (0.0227 => 0.0263, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.96% (0.0255 => 0.0250, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 14.77% (0.1530 => 0.1756, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -38.90% (1.9293 => 1.1788, std.dev.: 0.6071) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.71% (0.4049 => 0.4280, std.dev.: 0.3898) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1510 => 0.1532, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.35% (0.0978 => 0.1001, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0276 => 0.0279, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.19% (0.0590 => 0.0583, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.68% (1.1617 => 1.1538, std.dev.: 0.0352) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.36% (0.7437 => 0.7464, std.dev.: 0.0978) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (12.7781 => 12.7662, std.dev.: 0.4553) Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 12:18:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 14:18:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123201827.EBB782A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7871?compare_to=7868&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7871, Order: 173278, Start Time: 2013-01-23 18:16:03, End Time: 2013-01-23 20:18:40 To: 7868, Order: 173264, Start Time: 2013-01-23 15:34:28, End Time: 2013-01-23 17:45:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 17 (13 on baseline) New Passes: 0 (11 on baseline) Performance Regressions: 1 (214 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (145 on baseline) Existing Failures: 4 (8 on baseline) Unchanged Tests: 1081 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/SPASS/SPASS: -5.23% (18.0504 => 17.1063, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -17.92% (3.9584 => 3.2492, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -88.11% (19.1516 => 2.2772, std.dev.: 0.0022) MultiSource/Benchmarks/7zip/7zip-benchmark: -33.70% (49.4227 => 32.7659, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: -5.35% (68.6293 => 64.9566, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: -1.59% (4.8612 => 4.7839, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: -97.43% (10.8413 => 0.2781, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -85.27% (37.8046 => 5.5678, std.dev.: 0.0027) SingleSource/Regression/C++/pointer_method2: -17.91% (0.0268 => 0.0220, std.dev.: 0.0003) New Failures - Execution Time ----------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/SPASS/SPASS: -100.00% (11.1466 => 0.0001) MultiSource/Applications/d/make_dparser: -99.66% (0.0293 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.5842 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.4424 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.84% (0.0636 => 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (63.8548 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.98% (0.5750 => 0.0001) SingleSource/Regression/C++/pointer_method2: -50.00% (0.0002 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.59% (0.6555 => 0.6725, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (10.4892 => 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.31% (0.0654 => 0.0652, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8428 => 499.8358, std.dev.: 0.0171) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/PAQ8p/paq8p SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/d/make_dparser: -2.58% (3.3354 => 3.2492, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -86.75% (17.1811 => 2.2772, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 2.71% (63.2438 => 64.9566, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: -97.32% (10.3673 => 0.2781, std.dev.: 0.0004) SingleSource/Regression/C++/pointer_method2: 5.26% (0.0209 => 0.0220, std.dev.: 0.0003) New Failures - Execution Time ----------------------------- MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/PAQ8p/paq8p SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/d/make_dparser: -99.66% (0.0294 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (4.6441 => 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -100.00% (10.7105 => 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.47% (1.1277 => 499.8358, std.dev.: 0.0171) MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (85.0658 => 0.0001) SingleSource/Regression/C++/pointer_method2: -50.00% (0.0002 => 0.0001) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.32% (0.5229 => 1.6436, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 43.66% (14.1553 => 20.3357, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.07% (1.1048 => 1.7243, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 84.80% (3.4629 => 6.3995, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 74.33% (0.6222 => 1.0847, std.dev.: 0.0093) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10284.44% (0.0720 => 7.4768, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848700.00% (0.0001 => 9.8488, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484000.00% (0.0001 => 5.4841, std.dev.: 0.0109) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.03% (1.1194 => 10.2316, std.dev.: 0.0142) SingleSource/UnitTests/SignlessTypes/factor: 165.88% (0.0296 => 0.0787) MultiSource/Applications/ClamAV/clamscan: 148.54% (22.1758 => 55.1167, std.dev.: 0.0221) SingleSource/Benchmarks/Misc/lowercase: 121.48% (0.0256 => 0.0567, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.45% (0.0929 => 0.1825, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 70.95% (0.1463 => 0.2501, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.18% (2.9384 => 4.6186, std.dev.: 0.0023) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.48% (7.0540 => 10.7560, std.dev.: 0.0096) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.01% (1.5859 => 2.3948, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.99% (8.1363 => 11.9594, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.39% (2.2024 => 3.1140, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 39.53% (0.1432 => 0.1998, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 39.21% (0.3109 => 0.4328, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610) MultiSource/Applications/JM/lencod/lencod: 37.97% (21.9371 => 30.2668, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.85% (0.1062 => 0.1464, std.dev.: 0.0009) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.59% (0.4615 => 0.6165, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.81% (4.2646 => 5.6637, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.14% (1.5415 => 2.0369, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.69% (0.2271 => 0.2968, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 30.40% (0.4299 => 0.5606, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 29.35% (1.1642 => 1.5059, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: 27.68% (0.0719 => 0.0918, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.34% (0.1584 => 0.2017, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.19% (0.5105 => 0.6493, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.17% (0.1892 => 0.2406, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.12% (0.1143 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.86% (0.0793 => 0.1006, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.71% (0.6675 => 0.8458, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 25.99% (9.4845 => 11.9494, std.dev.: 0.0094) MultiSource/Benchmarks/McCat/08-main/main: 25.96% (0.2554 => 0.3217, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/chomp: 25.74% (0.1655 => 0.2081, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.57% (3.8922 => 4.8875, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.14% (0.1566 => 0.1944, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.09% (0.3121 => 0.3873, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 23.91% (0.1175 => 0.1456, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 23.85% (0.4289 => 0.5312, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.84% (0.0730 => 0.0904, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 23.83% (1.0722 => 1.3277, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.70% (1.4186 => 1.7548, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.34% (0.1337 => 0.1649, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: 23.03% (0.4620 => 0.5684, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.71% (0.1695 => 0.2080, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 22.05% (0.7115 => 0.8684, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 21.77% (0.1695 => 0.2064, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.52% (0.2700 => 0.3281, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 21.49% (0.7835 => 0.9519, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 21.11% (0.1151 => 0.1394, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.90% (0.0842 => 0.1018, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 20.53% (0.3098 => 0.3734, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.41% (1.3050 => 1.5713, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 20.33% (5.7591 => 6.9302, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/mst/mst: 20.29% (0.1163 => 0.1399, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 19.95% (0.6456 => 0.7744, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.80% (0.8172 => 0.9790, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.73% (0.5860 => 0.7016, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.54% (0.1940 => 0.2319, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.24% (4.9449 => 5.8965, std.dev.: 0.0168) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.58% (5.0018 => 5.9312, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.35% (0.5020 => 0.5941, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.20% (0.3307 => 0.3909, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 17.77% (0.7433 => 0.8754, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.61% (0.9765 => 1.1485, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.55% (0.1510 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.54% (0.5569 => 0.6546, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 17.29% (2.0273 => 2.3779, std.dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 17.08% (1.1840 => 1.3862, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/18-imp/imp: 17.06% (0.3423 => 0.4007, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 17.04% (3.8723 => 4.5323, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.97% (0.5981 => 0.6996, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.95% (1.1861 => 1.3871, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.83% (0.8101 => 0.9464, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 16.46% (2.2969 => 2.6750, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.19% (0.3441 => 0.3998, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.95% (0.6450 => 0.7479, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 15.87% (0.3283 => 0.3804, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ReedSolomon: 15.57% (0.2049 => 0.2368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 15.53% (0.3232 => 0.3734, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 15.31% (0.3180 => 0.3667, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.03% (0.1144 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.63% (0.8921 => 1.0226, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.55% (0.8067 => 0.9241, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.91% (0.2603 => 0.2965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 13.55% (0.3379 => 0.3837, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.37% (0.0838 => 0.0950, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.32% (0.3865 => 0.4380, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 12.92% (0.4636 => 0.5235, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 12.84% (0.3387 => 0.3822, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.48% (0.4103 => 0.4615, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 12.32% (1.5603 => 1.7526, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: 12.15% (0.3927 => 0.4404, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.73% (0.3886 => 0.4342, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/moments: 11.56% (0.4048 => 0.4516, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 11.49% (0.3603 => 0.4017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.40% (0.3422 => 0.3812, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.23% (0.2430 => 0.2703, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.13% (0.3092 => 0.3436, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 11.07% (0.3684 => 0.4092, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.05% (0.3828 => 0.4251, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.79% (0.3826 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 10.76% (0.3282 => 0.3635, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.56% (0.3561 => 0.3937, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.56% (0.3543 => 0.3917, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.56% (0.3543 => 0.3917, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.53% (0.3694 => 0.4083, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.47% (0.3497 => 0.3863, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.44% (0.3516 => 0.3883, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.39% (0.3427 => 0.3783, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.16% (0.4064 => 0.4477, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.03% (14.3668 => 15.8080, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.61% (0.1114 => 0.1221, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 9.33% (0.2831 => 0.3095, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.27% (2.0665 => 2.2581, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: 8.83% (0.7326 => 0.7973, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 8.67% (0.2871 => 0.3120, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 8.63% (1.2842 => 1.3950, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 8.56% (0.6030 => 0.6546) SingleSource/Benchmarks/Shootout-C++/methcall: 8.52% (0.2877 => 0.3122, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.33% (0.2905 => 0.3147, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.27% (0.3650 => 0.3952, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.25% (0.3162 => 0.3423, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.23% (0.2891 => 0.3129, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.98% (0.2756 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 7.96% (0.3052 => 0.3295, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.85% (0.3935 => 0.4244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.80% (0.2872 => 0.3096, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 7.78% (0.2802 => 0.3020, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.73% (0.2793 => 0.3009, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 7.63% (0.2725 => 0.2933, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.30% (0.3136 => 0.3365, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.67% (0.3177 => 0.3389, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.65% (2.2022 => 2.3487, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.46% (0.4879 => 0.5194, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.40% (0.1625 => 0.1729, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.35% (0.3131 => 0.3236, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (7.9617 => 8.1518, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4747, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4275, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4574, std.dev.: 0.0110) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1578 => 3.3098, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.29% (0.9957 => 1.0285, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (8.6802 => 8.8927, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.39% (1.0313 => 1.0559, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7206, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2913, std.dev.: 0.0167) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2396, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.21% (10.3460 => 10.4715, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.84% (5.2763 => 1.1690, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -75.32% (0.8651 => 0.2135, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.50% (5.3855 => 4.4429, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.71% (5.3526 => 4.4582, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -13.76% (10.4361 => 9.0000, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.41% (1.7609 => 1.6128, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.90% (54.1659 => 49.8875, std.dev.: 0.0421) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.65% (1.9577 => 0.6725, std.dev.: 0.0025) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3069, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.65% (1.5373 => 1.0200, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0036, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1269, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7328, std.dev.: 0.0019) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4931, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9124, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.27% (19.9488 => 18.2986, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.82% (1.2373 => 1.1653, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6997, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8168, std.dev.: 0.0134) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0086) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.6994 => 3.6253, std.dev.: 0.0105) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3303, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6666, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2309, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8563, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Compile Time -------------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/SPASS/SPASS: 14.12% (14.9895 => 17.1063, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/gs/gs: 16.38% (4.1105 => 4.7839, std.dev.: 0.0101) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -22.22% (7.1582 => 5.5678, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 MultiSource/Applications/SPASS/SPASS: - (0.0001 => 0.0001) MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: - (0.0001 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0001 => 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 12:57:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 14:57:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123205732.7E42C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7872?compare_to=7869&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7872, Order: 173283, Start Time: 2013-01-23 19:23:48, End Time: 2013-01-23 20:57:46 To: 7869, Order: 173272, Start Time: 2013-01-23 17:25:47, End Time: 2013-01-23 19:00:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (110 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.38% (0.0974 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.43% (0.1132 => 0.1601, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.22% (0.6395 => 0.8775, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.90% (0.0699 => 0.0929, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.13% (0.5805 => 0.7670, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.06% (0.6260 => 0.8267, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.01% (0.5688 => 0.7509, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.00% (0.5456 => 0.7202, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.70% (0.5849 => 0.7703, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.53% (0.5575 => 0.7333, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.45% (0.5581 => 0.7336, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.26% (0.5567 => 0.7307, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.06% (0.6395 => 0.8381, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.75% (0.5859 => 0.7602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.52% (0.6033 => 0.7814, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.22% (0.6440 => 0.8322, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.83% (1.6474 => 2.1224, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.26% (0.6189 => 0.7938, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.79% (0.6304 => 0.8056, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.48% (0.6230 => 0.7942, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.47% (0.5802 => 0.7338, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.26% (0.6660 => 0.8409, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.16% (0.5925 => 0.7475, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.85% (0.5705 => 0.7180, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.61% (0.5857 => 0.7357, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.37% (0.5478 => 0.6868, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.26% (0.5569 => 0.6976, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.13% (0.5570 => 0.6970, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.92% (0.5591 => 0.6984, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.67% (0.5863 => 0.7251, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.67% (0.6446 => 0.7972, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.47% (0.7524 => 0.9290, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.38% (0.6052 => 0.7467, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.05% (0.6681 => 0.8221, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.59% (0.6194 => 0.7593, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.50% (0.6297 => 0.7714, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.80% (2.2587 => 2.7510, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.88% (0.6667 => 0.8059, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.29% (0.7339 => 0.8755, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.25% (0.3357 => 0.3869, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3160, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.77% (0.0864 => 0.0983, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.17% (0.1230 => 0.1392) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.18% (4.5069 => 5.0557, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.12% (0.4916 => 0.5512, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 11.74% (0.4515 => 0.5045, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.47% (3.5339 => 3.9392, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.24% (1.6364 => 1.8204, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.20% (0.1982 => 0.2204, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.94% (0.2385 => 0.2622, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (9.2283 => 10.0908, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.01% (0.1731 => 0.1887, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.46% (1.2515 => 1.3574, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.14% (0.5329 => 0.5763, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.09% (0.4524 => 0.4890, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.7021 => 0.7552, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.41% (0.4861 => 0.5221, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.4642 => 1.5692, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.89% (1.2784 => 1.3665, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.18% (0.3255 => 0.3456, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 5.96% (0.1761 => 0.1866, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.03% (0.3319 => 0.3486, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.40% (5.4682 => 5.7090, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++/bigfib: 4.03% (0.6750 => 0.7022, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 3.55% (5.0226 => 5.2010, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 3.45% (0.3446 => 0.3565, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.36% (0.3394 => 0.3508, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.94% (0.9557 => 0.9838, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 2.73% (0.8418 => 0.8648, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 2.38% (0.7447 => 0.7624, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (22.4056 => 22.9170, std.dev.: 0.0161) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5168 => 0.5279, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.89% (15.5079 => 15.8012, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.69% (1.3722 => 1.3954, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8119, std.dev.: 0.0096) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.51% (0.9531 => 1.0342, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1496, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6119, std.dev.: 0.0273) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1033, std.dev.: 0.0056) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3822, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6134, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.34% (5.1955 => 5.2651, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4564, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.13% (0.1431 => 0.1329, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.93% (0.7198 => 0.6843, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -4.56% (2.4924 => 2.3788, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/exceptions-2: -4.31% (0.3831 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3812 => 0.3648, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: -4.29% (0.3848 => 0.3683) SingleSource/UnitTests/ObjC/exceptions-4: -4.28% (0.3880 => 0.3714, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.21% (0.3896 => 0.3732, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.17% (0.4033 => 0.3865, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions: -3.93% (0.4176 => 0.4012, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.86% (0.3837 => 0.3689, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.68% (0.3884 => 0.3741, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.63% (0.9852 => 0.9494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.41% (0.3142 => 0.3035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.36% (0.4199 => 0.4058, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.16% (0.3323 => 0.3218, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.9542 => 0.9259, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.88% (0.6347 => 0.6164, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/parameter-passing: -2.87% (0.4280 => 0.4157, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.84% (0.6484 => 0.6300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.69% (2.1713 => 2.1130, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference-object: -2.64% (0.6441 => 0.6271, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.56% (1.3148 => 1.2812, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/property-reference: -2.31% (0.7779 => 0.7599, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2973, std.dev.: 0.0231) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.15% (14.2083 => 13.9023, std.dev.: 0.0241) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.85% (6.7716 => 6.6461, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -1.72% (17.1032 => 16.8089, std.dev.: 0.0179) MultiSource/Applications/JM/lencod/lencod: -1.53% (16.1920 => 15.9448, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.38% (0.7919 => 0.7810, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.25% (1.0544 => 1.0412, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: -1.23% (7.0961 => 7.0088, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.10% (1.2221 => 1.2086, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.10% (1.2210 => 1.2076, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: -1.04% (4.3330 => 4.2878, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.66% (1.8100 => 0.6939, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3115, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7503, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0850, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.18% (2.5106 => 2.1296, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3555, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/richards_benchmark: -9.09% (1.2842 => 1.1675, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1761, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.83% (1.3096 => 1.2725, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout/ary3: -2.72% (3.7241 => 3.6227, std.dev.: 0.0128) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7772, std.dev.: 0.0122) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1193, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.60% (7.3040 => 7.1873, std.dev.: 0.0212) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.37% (1.6086 => 1.5866, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6001, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.17% (1.6307 => 1.6116, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7092 => 3.6712, std.dev.: 0.0039) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 13:57:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 15:57:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130123215725.B11D02A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7873?compare_to=7867&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7873, Order: 173277, Start Time: 2013-01-23 18:23:22, End Time: 2013-01-23 21:57:40 To: 7867, Order: 173259, Start Time: 2013-01-23 13:57:36, End Time: 2013-01-23 17:31:49 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (181 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/whetstone: 1.38% (2.7815 => 2.8198, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.04% (1.5815 => 1.5651, std.dev.: 0.0046) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.24% (0.0625 => 0.0889, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.11% (0.1063 => 0.1415, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.56% (0.2969 => 0.3817, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.89% (0.4253 => 0.5439, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0547 => 0.0696, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.82% (0.4139 => 0.5249, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.44% (0.5900 => 0.7460, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.25% (0.4994 => 0.6305, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.11% (0.0475 => 0.0599, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.74% (0.1620 => 0.2037, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.49% (0.0714 => 0.0896, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.18% (0.5000 => 0.6259, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1021 => 0.1269, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 24.21% (1.5932 => 1.9789, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.08% (0.0897 => 0.1113, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.56% (0.1549 => 0.1914, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 22.78% (0.0948 => 0.1164, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.67% (0.1107 => 0.1358, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.53% (0.1003 => 0.1229, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.32% (0.1604 => 0.1962, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.09% (0.3903 => 0.4765, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.02% (0.0495 => 0.0604, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.99% (0.1619 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.81% (0.0541 => 0.0659, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.32% (0.4029 => 0.4888, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 20.80% (0.0947 => 0.1144, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.48% (0.2866 => 0.3453, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.40% (0.1088 => 0.1310, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.36% (0.3890 => 0.4682, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.31% (0.1462 => 0.1759, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 20.20% (0.1218 => 0.1464, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 20.17% (0.0808 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.11% (0.2014 => 0.2419, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.2736 => 0.3278, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 19.53% (0.1505 => 0.1799, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 19.42% (0.5546 => 0.6623, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.14% (0.3271 => 0.3897, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.01% (0.0605 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.00% (1.3152 => 1.5651, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: 18.70% (1.8794 => 2.2308, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.26% (3.5627 => 4.2134, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/Hello: 18.25% (0.5826 => 0.6889, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.23% (1.6211 => 1.9166, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.10% (0.1160 => 0.1370, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.01% (0.4658 => 0.5497, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.01% (0.5026 => 0.5931, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.89% (0.1968 => 0.2320, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 17.88% (0.5889 => 0.6942, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 17.86% (0.9697 => 1.1429, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: 17.83% (0.1284 => 0.1513, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.70% (0.0582 => 0.0685, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.53% (0.2875 => 0.3379, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.43% (0.4361 => 0.5121, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.1421 => 0.1668, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.36% (0.2811 => 0.3299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.30% (0.2792 => 0.3275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 17.29% (0.2823 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 17.28% (0.2813 => 0.3299, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/fibo: 17.21% (0.2725 => 0.3194, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 17.17% (0.7171 => 0.8402, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.12% (0.3930 => 0.4603, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 17.09% (0.2803 => 0.3282, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.03% (0.2566 => 0.3003, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.02% (0.2750 => 0.3218, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 16.95% (0.2714 => 0.3174, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.93% (0.2729 => 0.3191, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.91% (0.2738 => 0.3201, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.90% (0.2911 => 0.3403, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.79% (2.0673 => 2.4145, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.79% (1.9694 => 2.3000, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 16.75% (1.0781 => 1.2587, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 16.73% (0.2780 => 0.3245, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 16.68% (0.3004 => 0.3505, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.58% (1.9966 => 2.3276, std.dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.56% (2.7292 => 3.1811, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.46% (0.3195 => 0.3721, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 16.44% (0.3096 => 0.3605, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.34% (0.9909 => 1.1528, std.dev.: 0.0038) MultiSource/Applications/ClamAV/clamscan: 16.25% (4.2109 => 4.8953, std.dev.: 0.0098) MultiSource/Benchmarks/Bullet/bullet: 16.24% (23.5202 => 27.3389, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary3: 16.19% (0.3267 => 0.3796, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.11% (0.3060 => 0.3553, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.04% (0.3317 => 0.3849, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.01% (4.4195 => 5.1271, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary: 15.96% (0.3258 => 0.3778, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.75% (0.3124 => 0.3616, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 15.70% (0.3726 => 0.4311, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 15.62% (0.3348 => 0.3871, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.58% (0.3678 => 0.4251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.56% (0.3477 => 0.4018, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.54% (1.4269 => 1.6487, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.47% (0.3362 => 0.3882, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.45% (0.3282 => 0.3789, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.26% (0.3625 => 0.4178, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.08% (0.3488 => 0.4014, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 15.03% (0.4251 => 0.4890, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-3: 15.03% (0.3460 => 0.3980, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.01% (0.3465 => 0.3985, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: 14.97% (0.3446 => 0.3962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.95% (0.4146 => 0.4766, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.95% (0.1090 => 0.1253, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 14.93% (0.3469 => 0.3987, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.90% (0.3442 => 0.3955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.88% (0.3690 => 0.4239, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.85% (0.3981 => 0.4572, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.75% (0.3845 => 0.4412, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 14.71% (0.3650 => 0.4187, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 14.53% (0.7875 => 0.9019, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions: 14.52% (0.3643 => 0.4172, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.37% (0.3724 => 0.4259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 13.99% (0.5012 => 0.5713, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 13.87% (5.5417 => 6.3102, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/football/football: 13.49% (0.2075 => 0.2355, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.42% (0.1028 => 0.1166, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.36% (0.6435 => 0.7295, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 13.31% (2.1653 => 2.4535, std.dev.: 0.0202) MultiSource/Benchmarks/mafft/pairlocalalign: 13.14% (2.1013 => 2.3775, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.97% (0.2737 => 0.3092, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 12.86% (4.6177 => 5.2117, std.dev.: 0.0347) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.38% (0.2068 => 0.2324, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 12.19% (0.6634 => 0.7443, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.77% (0.3084 => 0.3447, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.71% (0.5361 => 0.5989, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 11.64% (0.3498 => 0.3905, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 11.21% (0.3336 => 0.3710, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.84% (0.2103 => 0.2331, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 10.79% (0.4847 => 0.5370, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.41% (0.1383 => 0.1527, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.27% (11.6398 => 12.8355, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.09% (0.7426 => 0.8175, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.44% (4.6926 => 5.1358, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: 9.09% (2.0346 => 2.2195, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.85% (0.5584 => 0.6078, std.dev.: 0.0019) MultiSource/Applications/kimwitu++/kc: 7.57% (11.9555 => 12.8607, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5107, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.80% (0.3693 => 0.4055, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6757, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2427, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6886, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5022, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2066, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.51% (7.1849 => 7.2936, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3080, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0813, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2062, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4781, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5773, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5729, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.71% (17.2379 => 14.3576, std.dev.: 0.0588) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7939, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9583, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -7.16% (0.2402 => 0.2230, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2188, std.dev.: 0.0149) SingleSource/Benchmarks/Dhrystone/dry: -3.75% (14.0481 => 13.5210, std.dev.: 0.0917) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7993, std.dev.: 0.0107) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.73% (0.6293 => 0.6121, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1261, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5786, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1971, std.dev.: 0.0884) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0038) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 14:11:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 16:11:31 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130123221131.893142A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7874?compare_to=7870&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7874, Order: 173284, Start Time: 2013-01-23 20:03:14, End Time: 2013-01-23 22:11:47 To: 7870, Order: 173270, Start Time: 2013-01-23 16:57:21, End Time: 2013-01-23 19:34:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (18 on baseline) Performance Improvements: 79 (13 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 971 (1032 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 69.16% (0.0227 => 0.0384, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build: 57.38% (0.0183 => 0.0288, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 42.13% (0.2357 => 0.3350, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.33% (1.7760 => 2.1193, std.dev.: 0.1099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.18% (5.8276 => 6.4793, std.dev.: 0.1226) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary2: 125.58% (0.0086 => 0.0194, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 25.19% (0.6678 => 0.8360, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/flops: 20.86% (7.3708 => 8.9087, std.dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.21% (0.9117 => 1.0868, std.dev.: 0.0626) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.38% (2.9585 => 3.2064, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/pi: 3.68% (2.1333 => 2.2118, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 3.51% (51.0881 => 52.8835, std.dev.: 0.4568) MultiSource/Benchmarks/Olden/tsp/tsp: 2.76% (1.5071 => 1.5487, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.56% (4.3948 => 4.4635, std.dev.: 0.0226) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/voronoi/voronoi: -36.30% (0.4353 => 0.2773, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -34.86% (1.4958 => 0.9743, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -34.17% (1.3667 => 0.8997, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -31.98% (1.3318 => 0.9059, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -30.90% (1.5827 => 1.0936, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -30.83% (1.5912 => 1.1007, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -30.52% (1.3914 => 0.9668, std.dev.: 0.0239) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -30.25% (0.1494 => 0.1042, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: -29.89% (1.8129 => 1.2710, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -29.89% (1.2988 => 0.9106, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -29.67% (1.3749 => 0.9669, std.dev.: 0.0560) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.70% (0.2115 => 0.1508, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -28.63% (1.3458 => 0.9605, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -28.60% (1.3708 => 0.9788, std.dev.: 0.0499) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -27.96% (1.2767 => 0.9197, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -27.79% (1.4594 => 1.0538, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -27.73% (1.4611 => 1.0560, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -27.18% (1.3055 => 0.9507, std.dev.: 0.0899) SingleSource/Benchmarks/McGill/chomp: -25.81% (0.2360 => 0.1751, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -25.19% (0.1032 => 0.0772, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -24.45% (0.3947 => 0.2982, std.dev.: 0.0311) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -24.04% (9.4383 => 7.1698, std.dev.: 0.6844) MultiSource/Benchmarks/Prolangs-C++/family/family: -23.93% (0.0560 => 0.0426, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -23.61% (0.0970 => 0.0741, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -23.23% (1.2672 => 0.9728, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -22.93% (0.0663 => 0.0511, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -22.50% (0.1209 => 0.0937, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: -22.18% (0.0717 => 0.0558, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -22.03% (1.2111 => 0.9443, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -21.29% (0.2945 => 0.2318, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -20.50% (1.2700 => 1.0097, std.dev.: 0.0318) MultiSource/Benchmarks/PAQ8p/paq8p: -20.49% (3.2743 => 2.6035, std.dev.: 0.1280) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -19.68% (1.2284 => 0.9866, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: -19.13% (0.9346 => 0.7558, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -17.63% (1.0842 => 0.8931, std.dev.: 0.0169) SingleSource/Benchmarks/McGill/queens: -17.17% (0.0600 => 0.0497, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -15.05% (18.1254 => 15.3975, std.dev.: 0.4347) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -14.63% (1.1610 => 0.9911, std.dev.: 0.0589) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -14.35% (1.0826 => 0.9272, std.dev.: 0.0569) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -14.12% (1.1080 => 0.9516, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.59% (1.0092 => 0.8720, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -13.08% (1.1887 => 1.0332, std.dev.: 0.0486) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -12.52% (0.3290 => 0.2878, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -12.20% (1.0507 => 0.9225, std.dev.: 0.0208) MultiSource/Benchmarks/sim/sim: -10.49% (0.4118 => 0.3686, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.24% (1.0025 => 0.9399, std.dev.: 0.0209) SingleSource/Benchmarks/Misc/ReedSolomon: -5.83% (0.2145 => 0.2020, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.32% (0.9822 => 0.9299, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.08% (1.0373 => 0.9846, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: -5.06% (0.2825 => 0.2682, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.72% (1.0900 => 1.0603, std.dev.: 0.0054) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Prolangs-C++/primes/primes: -26.06% (1.1937 => 0.8826, std.dev.: 0.0559) MultiSource/Benchmarks/llubenchmark/llu: -13.27% (2.4002 => 2.0817, std.dev.: 0.0688) MultiSource/Benchmarks/nbench/nbench: -9.77% (22.7443 => 20.5223, std.dev.: 0.7889) MultiSource/Benchmarks/Prolangs-C++/life/life: -8.53% (2.8239 => 2.5830, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.12% (7.0557 => 6.6241, std.dev.: 0.0530) MultiSource/Applications/SIBsim4/SIBsim4: -5.86% (3.6998 => 3.4830, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.77% (6.2026 => 5.9069, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.67% (3.7447 => 3.5700, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.46% (3.6798 => 3.5156, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.16% (5.9615 => 5.7136, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.12% (5.0246 => 4.8175, std.dev.: 0.0728) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.83% (5.1967 => 4.9976, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.83% (3.2922 => 3.1661, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.36% (5.1199 => 4.9480, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.31% (11.7778 => 11.3878, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -3.00% (7.0175 => 6.8071, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.74% (4.9429 => 4.8077, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.71% (5.0084 => 4.8729, std.dev.: 0.0025) MultiSource/Applications/lua/lua: -2.56% (30.3472 => 29.5700, std.dev.: 0.0867) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.35% (5.4982 => 5.3689, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.27% (6.0344 => 5.8973, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.22% (5.7064 => 5.5797, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.50% (11.7336 => 11.5572, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.41% (4.8188 => 4.7510, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.32% (1.4695 => 1.4501, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.20% (9.8877 => 9.7687, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/em3d/em3d: -1.15% (4.9934 => 4.9358, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.13% (5.0996 => 5.0420, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -22.14% (1.4392 => 1.1205, std.dev.: 0.0937) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.94% (0.0238 => 0.0231, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.71% (0.0449 => 0.0533, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.43% (0.0356 => 0.0386, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.23% (0.0341 => 0.0330, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.25% (0.0432 => 0.0459, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/casts: 35.21% (0.0213 => 0.0288, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/test1: -9.13% (0.0263 => 0.0239, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.20% (0.0250 => 0.0253, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -26.67% (0.0015 => 0.0011, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -8.43% (0.1756 => 0.1608, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 4.74% (1.1788 => 1.2347, std.dev.: 0.0689) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -6.75% (0.4280 => 0.3991, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.37% (0.1532 => 0.1553, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.30% (0.1001 => 0.1004, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.38% (0.0279 => 0.0294, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.32% (0.0583 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.1538 => 1.1521, std.dev.: 0.0320) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -15.38% (0.0026 => 0.0022, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0609 => 0.0613, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.93% (0.0285 => 0.0319, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.10% (0.7464 => 0.7546, std.dev.: 0.1519) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -65.85% (0.0123 => 0.0042, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.01% (12.7662 => 12.7676, std.dev.: 0.0902) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/simple: 66.23% (0.0231 => 0.0384, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 40.46% (0.2385 => 0.3350, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 16.91% (1.8127 => 2.1193, std.dev.: 0.1099) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.05% (0.9998 => 1.0603, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.96% (0.9381 => 0.9846, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.68% (1.0088 => 1.0560, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.27% (0.9512 => 0.9728, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320900.00% (0.0008 => 2.5680, std.dev.: 0.1016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.68% (1.1825 => 2.3849, std.dev.: 0.0300) MultiSource/Benchmarks/Olden/mst/mst: 53.92% (0.1491 => 0.2295, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.40% (0.2562 => 0.2854, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.59% (3.0082 => 3.2064, std.dev.: 0.0364) SingleSource/Benchmarks/Linpack/linpack-pc: 3.91% (50.8945 => 52.8835, std.dev.: 0.4568) SingleSource/Benchmarks/Misc/pi: 3.40% (2.1390 => 2.2118, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 3.13% (1.5017 => 1.5487, std.dev.: 0.0157) MultiSource/Applications/lua/lua: 1.85% (29.0327 => 29.5700, std.dev.: 0.0867) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.79% (4.3851 => 4.4635, std.dev.: 0.0226) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.36% (1.2298 => 1.2465, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.38% (0.0808 => 0.0506, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -24.28% (0.0692 => 0.0524, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.73% (0.1684 => 0.1318, std.dev.: 0.0131) MultiSource/Applications/hbd/hbd: -18.95% (1.8964 => 1.5370, std.dev.: 0.1080) MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.89% (0.1009 => 0.0889, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: -6.51% (0.8653 => 0.8090, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -10.80% (0.9372 => 0.8360, std.dev.: 0.0350) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.65% (1.4588 => 1.3326, std.dev.: 0.0464) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.3217 => 0.2970, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: -5.50% (0.3654 => 0.3453, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.00% (0.3201 => 0.3041, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: -2.60% (17.2182 => 16.7705, std.dev.: 0.1599) MultiSource/Applications/SIBsim4/SIBsim4: -1.73% (3.5443 => 3.4830, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.99% (1.2047 => 1.1205, std.dev.: 0.0937) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.86% (0.0233 => 0.0231, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.18% (0.0451 => 0.0533, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.03% (0.0394 => 0.0386, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.61% (0.0328 => 0.0330, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.15% (0.0445 => 0.0459, std.dev.: 0.0179) SingleSource/UnitTests/Vector/Altivec/casts: 35.21% (0.0213 => 0.0288, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/test1: 5.29% (0.0227 => 0.0239, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -26.67% (0.0015 => 0.0011, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 5.10% (0.1530 => 0.1608, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -36.00% (1.9293 => 1.2347, std.dev.: 0.0689) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.43% (0.4049 => 0.3991, std.dev.: 0.0302) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1510 => 0.1553, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.66% (0.0978 => 0.1004, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 6.52% (0.0276 => 0.0294, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.44% (0.0590 => 0.0552, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.83% (1.1617 => 1.1521, std.dev.: 0.0320) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -18.52% (0.0027 => 0.0022, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.47% (0.7437 => 0.7546, std.dev.: 0.1519) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7676, std.dev.: 0.0902) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 14:55:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 16:55:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130123225530.5EF352A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7875?compare_to=7872&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7875, Order: 173290, Start Time: 2013-01-23 21:21:21, End Time: 2013-01-23 22:55:45 To: 7872, Order: 173283, Start Time: 2013-01-23 19:23:48, End Time: 2013-01-23 20:57:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 75.10% (0.0514 => 0.0900, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.40% (0.0974 => 0.1650, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.58% (0.6395 => 0.8798, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.76% (0.0699 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.52% (0.5688 => 0.7538, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.52% (0.6260 => 0.8296, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.45% (0.5805 => 0.7689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.39% (0.5456 => 0.7223, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.87% (0.5849 => 0.7713, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.70% (0.5581 => 0.7350, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.48% (0.5575 => 0.7330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.45% (0.5567 => 0.7318, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.45% (0.6395 => 0.8406, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.53% (0.5941 => 0.7755, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.23% (0.5859 => 0.7630, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.67% (0.6033 => 0.7823, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.25% (0.6440 => 0.8324, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.15% (1.6474 => 2.1276, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.53% (0.6189 => 0.7955, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.93% (0.6304 => 0.8065, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.75% (0.6230 => 0.7959, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.55% (0.6660 => 0.8428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.49% (0.5705 => 0.7216, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.14% (0.5925 => 0.7474, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.82% (0.0790 => 0.0994, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.64% (0.5857 => 0.7359, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.61% (0.5478 => 0.6881, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.57% (0.5570 => 0.6994, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.46% (0.5569 => 0.6987, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.24% (0.5591 => 0.7002, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.07% (0.5863 => 0.7274, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.67% (0.7524 => 0.9305, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.66% (0.6446 => 0.7971, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.61% (0.6052 => 0.7481, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.16% (0.6681 => 0.8228, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.01% (0.6194 => 0.7619, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.34% (0.6297 => 0.7704, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.78% (2.2587 => 2.7506, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.37% (0.6667 => 0.8092, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.39% (0.7339 => 0.8762, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 15.46% (0.3357 => 0.3876, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 15.16% (1.1450 => 1.3186, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.00% (0.0864 => 0.0985, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.09% (0.1230 => 0.1391, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.62% (0.4515 => 0.5085, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.37% (4.5069 => 5.0644, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.72% (3.5339 => 3.9479, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.33% (1.6364 => 1.8218, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.15% (0.1982 => 0.2203, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.74% (9.2283 => 10.1275, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.55% (0.1731 => 0.1879, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.33% (1.2515 => 1.3557, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4524 => 0.4879, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.40% (1.4642 => 1.5725, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.32% (0.7021 => 0.7535, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.17% (1.2784 => 1.3700, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 6.97% (0.1879 => 0.2010, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 6.81% (0.4861 => 0.5192, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 6.42% (0.1761 => 0.1874, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3255 => 0.3428, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.24% (0.3319 => 0.3493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.16% (5.4682 => 5.6957, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 3.87% (5.0226 => 5.2171, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 3.63% (0.6750 => 0.6995, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 3.13% (1.3864 => 1.4298, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.89% (0.8418 => 0.8661, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 2.22% (0.7447 => 0.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.15% (0.9557 => 0.9762, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.3722 => 1.3994, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.97% (22.4056 => 22.8459, std.dev.: 0.0159) MultiSource/Applications/SPASS/SPASS: 1.94% (15.5079 => 15.8090, std.dev.: 0.0221) MultiSource/Applications/d/make_dparser: 1.05% (3.5154 => 3.5523, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8120, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5125, std.dev.: 0.4408) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.12% (2.0478 => 2.1117, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3835, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6134, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4534, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.76% (0.3194 => 0.3010, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.59% (2.4924 => 2.3780, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.29% (0.7198 => 0.6889, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.22% (0.3837 => 0.3675, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.18% (0.6347 => 0.6082, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.05% (0.3831 => 0.3676, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.04% (0.3812 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3848 => 0.3696, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.94% (0.3323 => 0.3192, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -3.94% (0.2871 => 0.2758, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3896 => 0.3743, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.88% (0.6441 => 0.6191, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.87% (0.4033 => 0.3877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.86% (0.3057 => 0.2939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.82% (0.2903 => 0.2792, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: -3.69% (0.3059 => 0.2946, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.62% (0.4176 => 0.4025, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.56% (0.3205 => 0.3091, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -3.48% (0.7779 => 0.7508, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -3.44% (0.3025 => 0.2921, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.40% (2.1713 => 2.0975, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.35% (0.9852 => 0.9522, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.35% (0.3884 => 0.3754, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.17% (0.3252 => 0.3149, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.08% (1.3148 => 1.2743, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.00% (0.4199 => 0.4073, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2062, std.dev.: 0.0290) SingleSource/UnitTests/ObjC/parameter-passing: -2.73% (0.4280 => 0.4163, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.44% (0.6484 => 0.6326, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.10% (14.2083 => 13.9106, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.01% (0.9542 => 0.9350, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.56% (17.1032 => 16.8362, std.dev.: 0.0219) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.49% (0.7919 => 0.7801, std.dev.: 0.0031) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.38% (6.7716 => 6.6779, std.dev.: 0.0107) MultiSource/Applications/JM/lencod/lencod: -1.30% (16.1920 => 15.9807, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (1.2210 => 1.2061, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.20% (1.0544 => 1.0417, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.12% (1.2221 => 1.2084, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -1.07% (4.3330 => 4.2866, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.60% (1.8100 => 0.6950, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0259) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0267, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7563, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0816, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1972, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.00% (0.3418 => 0.2837, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.30% (2.5106 => 2.1264, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3535, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -2.25% (3.7241 => 3.6404, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.23% (7.9763 => 7.7986, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3040 => 7.1898, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4718, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6012, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.6086 => 1.5882, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6676, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 15:01:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 17:01:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130123230115.C6C5B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7876?compare_to=7871&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7876, Order: 173288, Start Time: 2013-01-23 20:49:22, End Time: 2013-01-23 23:01:29 To: 7871, Order: 173278, Start Time: 2013-01-23 18:16:03, End Time: 2013-01-23 20:18:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 17 (17 on baseline) Performance Regressions: 4 (222 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1078 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/SPASS/SPASS: 6.08% (17.1063 => 18.1469, std.dev.: 0.0266) MultiSource/Applications/d/make_dparser: 22.34% (3.2492 => 3.9751, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 743.21% (2.2772 => 19.2016, std.dev.: 0.0046) MultiSource/Benchmarks/7zip/7zip-benchmark: 51.61% (32.7659 => 49.6765, std.dev.: 0.0244) MultiSource/Benchmarks/Bullet/bullet: 6.01% (64.9566 => 68.8593, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 2.40% (4.7839 => 4.8988, std.dev.: 0.0130) MultiSource/Benchmarks/PAQ8p/paq8p: 3924.81% (0.2781 => 11.1930, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 573.80% (5.5678 => 37.5156, std.dev.: 0.0036) SingleSource/Regression/C++/pointer_method2: 31.36% (0.0220 => 0.0289, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/SPASS/SPASS MultiSource/Applications/d/make_dparser MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Regression/C++/pointer_method2 MultiSource/Applications/SPASS/SPASS: 11146200.00% (0.0001 => 11.1463, std.dev.: 0.0675) MultiSource/Applications/d/make_dparser: 29200.00% (0.0001 => 0.0293, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 4585500.00% (0.0001 => 4.5856, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 7435600.00% (0.0001 => 7.4357, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 63839800.00% (0.0001 => 63.8399, std.dev.: 0.0127) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0003) SingleSource/Regression/C++/pointer_method2: 100.00% (0.0001 => 0.0002) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.20% (10.2316 => 10.4571, std.dev.: 0.0048) MultiSource/Applications/lambda-0_1_3/lambda: 1.22% (0.8754 => 0.8861, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.12% (20.3357 => 20.5643, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 10490700.00% (0.0001 => 10.4908, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.73% (0.6725 => 0.6474, std.dev.: 0.0048) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1330 => 0.1329, std.dev.: 0.0014) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.46% (0.0652 => 0.0655, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8358 => 499.8406, std.dev.: 0.0073) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.90% (1.1277 => 499.8406, std.dev.: 0.0073) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.84% (0.5229 => 1.6463, std.dev.: 0.0072) MultiSource/Applications/SPASS/SPASS: 21.06% (14.9895 => 18.1469, std.dev.: 0.0266) MultiSource/Applications/kimwitu++/kc: 45.28% (14.1553 => 20.5643, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/gs/gs: 19.18% (4.1105 => 4.8988, std.dev.: 0.0130) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.19% (1.1048 => 1.7366, std.dev.: 0.0065) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.09% (7.1582 => 37.5156, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.56% (3.4629 => 6.4605, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.97% (0.6222 => 1.0949, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10284.17% (0.0720 => 7.4766, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11146200.00% (0.0001 => 11.1463, std.dev.: 0.0675) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 66300.00% (0.0001 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484600.00% (0.0001 => 5.4847, std.dev.: 0.0055) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 834.17% (1.1194 => 10.4571, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/factor: 165.54% (0.0296 => 0.0786) MultiSource/Applications/ClamAV/clamscan: 149.93% (22.1758 => 55.4232, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.57% (0.1463 => 0.2510, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 63.20% (0.0231 => 0.0377, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 61.42% (0.0394 => 0.0636, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.83% (2.9384 => 4.6084, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.91% (7.0540 => 10.8567, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.12% (1.5859 => 2.4124, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.34% (8.1363 => 11.9881, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.74% (0.0439 => 0.0631, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.11% (2.2024 => 3.1299, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.11% (0.1062 => 0.1488, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 40.11% (0.3109 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.61% (21.9371 => 30.4065, std.dev.: 0.0155) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.58% (4.2646 => 5.6966, std.dev.: 0.0136) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.40% (0.0479 => 0.0639, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.30% (0.4615 => 0.6152, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.04% (1.5415 => 2.0508, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 32.80% (0.0814 => 0.1081, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.79% (0.2271 => 0.2993, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.23% (0.1143 => 0.1500, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 30.64% (0.4299 => 0.5616, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 30.17% (1.1642 => 1.5154, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.29% (0.5105 => 0.6549, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.28% (0.1584 => 0.2032, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 28.14% (0.0636 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.12% (0.0793 => 0.1016, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.00% (0.1125 => 0.1440, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.60% (0.6675 => 0.8517, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.25% (0.1655 => 0.2106, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.01% (0.1892 => 0.2403, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 26.59% (0.2554 => 0.3233, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.48% (0.0457 => 0.0578, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 26.28% (9.4845 => 11.9773, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.16% (0.0730 => 0.0921, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.04% (3.8922 => 4.9057, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 25.58% (0.4289 => 0.5386, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.31% (0.1695 => 0.2124, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.83% (0.3121 => 0.3896, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.78% (0.1566 => 0.1954, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 24.77% (0.1175 => 0.1466, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.66% (0.1906 => 0.2376, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.49% (1.0722 => 1.3348, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.47% (1.4186 => 1.7658, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.23% (0.1337 => 0.1661, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash2: 23.96% (0.4620 => 0.5727, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.21% (0.0672 => 0.0828, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 23.08% (0.7115 => 0.8757, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 22.66% (0.0662 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.54% (0.1695 => 0.2077, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 22.39% (0.0527 => 0.0645, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.33% (0.1236 => 0.1512, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.30% (0.2700 => 0.3302, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.16% (0.1029 => 0.1257, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 22.12% (0.1555 => 0.1899, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.07% (0.0675 => 0.0824, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 21.86% (0.7835 => 0.9548, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.50% (0.0842 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.40% (0.3098 => 0.3761, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.07% (1.3050 => 1.5799, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 21.03% (0.6456 => 0.7814, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.93% (0.1032 => 0.1248, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 20.85% (0.1151 => 0.1391, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.73% (0.8172 => 0.9866, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.60% (5.7591 => 6.9454, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.44% (0.5860 => 0.7058, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.36% (0.1940 => 0.2335, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 20.20% (0.0614 => 0.0738, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.74% (0.2107 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.68% (4.9449 => 5.9180, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.42% (0.5020 => 0.5995, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.29% (0.0648 => 0.0773, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 19.21% (0.7433 => 0.8861, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 19.18% (3.3354 => 3.9751, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.18% (5.0018 => 5.9611, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.14% (0.2758 => 0.3286, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.14% (0.3307 => 0.3940, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 19.05% (0.3423 => 0.4075, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.70% (0.0770 => 0.0914, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.32% (0.9765 => 1.1554, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.18% (0.0770 => 0.0910, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.17% (0.5569 => 0.6581, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 18.17% (0.0567 => 0.0670, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 18.00% (2.0273 => 2.3922, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 17.77% (1.1840 => 1.3944, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.72% (0.2065 => 0.2431, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 17.72% (3.8723 => 4.5586, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.56% (1.1861 => 1.3944, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.56% (0.5981 => 0.7031, std.dev.: 0.0031) MultiSource/Applications/siod/siod: 17.45% (2.2969 => 2.6977, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.34% (0.1044 => 0.1225, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.09% (0.3441 => 0.4029, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.01% (0.8101 => 0.9479, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.93% (0.6450 => 0.7542, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 16.89% (0.2049 => 0.2395, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.55% (0.3232 => 0.3767, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735) SingleSource/UnitTests/SignlessTypes/rem: 15.91% (0.1144 => 0.1326, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 15.79% (0.3180 => 0.3682, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.77% (0.0704 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.44% (0.8921 => 1.0298, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.42% (0.0759 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 15.21% (0.3379 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.12% (0.8067 => 0.9287, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.37% (0.2603 => 0.2977, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.31% (0.3865 => 0.4418, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.00% (0.4636 => 0.5285, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.87% (0.4103 => 0.4672, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 13.02% (1.5603 => 1.7634, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.92% (0.4203 => 0.4746, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.4048 => 0.4554, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.39% (0.3422 => 0.3846, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.39% (0.3092 => 0.3475, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.30% (0.3603 => 0.4046, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.02% (0.2430 => 0.2722, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 11.97% (0.3684 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.97% (0.3927 => 0.4397, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.76% (0.4064 => 0.4542, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 11.76% (17.1811 => 19.2016, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 11.58% (0.3886 => 0.4336, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.50% (0.3826 => 0.4266, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.23% (0.3427 => 0.3812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.04% (0.1114 => 0.1237, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.60% (14.3668 => 15.8901, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2831 => 0.3131, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.33% (0.3543 => 0.3909, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 10.28% (0.2871 => 0.3166, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.22% (0.3543 => 0.3905, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 10.19% (0.3561 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.19% (0.3473 => 0.3827, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.18% (0.3516 => 0.3874, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.15% (0.3497 => 0.3852, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.98% (0.2905 => 0.3195, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.77% (0.6030 => 0.6619, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 9.66% (0.2877 => 0.3155, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.63% (2.0665 => 2.2655, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.54% (0.2756 => 0.3019, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5925 => 0.6485, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.45% (0.7326 => 0.8018, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 9.45% (1.2842 => 1.4055, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.34% (0.2793 => 0.3054, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.33% (0.3162 => 0.3457, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.28% (0.2725 => 0.2978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.13% (0.2891 => 0.3155, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 9.11% (0.3052 => 0.3330, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.10% (0.2714 => 0.2961, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.04% (0.3650 => 0.3980, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.88% (63.2438 => 68.8593, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2802 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2872 => 0.3122, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.61% (0.3935 => 0.4274, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.23% (0.3136 => 0.3394, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 7.96% (10.3673 => 11.1930, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.53% (2.2022 => 2.3680, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.02% (0.1625 => 0.1739, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.50% (0.4879 => 0.5196, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.12% (0.3817 => 0.3936, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.51% (7.9617 => 8.1613, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4732, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.05% (1.1396 => 1.2427, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4256, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4516, std.dev.: 0.0131) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3138, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1057, std.dev.: 0.0027) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.23% (0.9957 => 1.0279, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (8.6802 => 8.9134, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.44% (1.0313 => 1.0565, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7163, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.00% (9.1159 => 9.2979, std.dev.: 0.0092) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.81% (0.8333 => 0.8484, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2430, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4534, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5755, std.dev.: 0.0075) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1702, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.74% (5.2763 => 1.1745, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -74.73% (0.8651 => 0.2186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.98% (5.3855 => 4.4710, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.42% (5.3526 => 4.4737, std.dev.: 0.0082) MultiSource/Applications/JM/ldecod/ldecod: -13.35% (10.4361 => 9.0426, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.23% (1.7609 => 1.6159, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -8.07% (54.1659 => 49.7944, std.dev.: 0.0266) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.93% (1.9577 => 0.6474, std.dev.: 0.0048) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0227, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4357, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: -24.95% (85.0658 => 63.8399, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0055, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -18.56% (0.2161 => 0.1760, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4230, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4937, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.20% (0.9540 => 0.8567, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.51% (19.9488 => 18.2507, std.dev.: 0.0347) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.04% (0.3463 => 0.3254) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.48% (8.1563 => 7.7090, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.54% (10.2830 => 9.8166, std.dev.: 0.0114) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6770, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3278, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7221 => 3.6713, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/ary3: -1.28% (3.6994 => 3.6520, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5856, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8589, std.dev.: 0.0183) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.05% (0.2116 => 0.0655, std.dev.: 0.0008) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 16:37:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 18:37:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124003756.27D4F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7877?compare_to=7874&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7877, Order: 173297, Start Time: 2013-01-23 22:31:47, End Time: 2013-01-24 00:38:12 To: 7874, Order: 173284, Start Time: 2013-01-23 20:03:14, End Time: 2013-01-23 22:11:47 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (23 on baseline) Performance Improvements: 16 (21 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1030 (1019 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 72.60% (0.0208 => 0.0359, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.84% (0.6509 => 0.8126, std.dev.: 0.0464) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.78% (1.3608 => 1.5756, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 13.08% (1.5965 => 1.8053, std.dev.: 0.0160) MultiSource/Benchmarks/Bullet/bullet: 10.50% (33.6006 => 37.1282, std.dev.: 0.2282) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.25% (23.6877 => 25.6423, std.dev.: 0.3051) MultiSource/Benchmarks/Olden/bh/bh: 6.18% (0.3300 => 0.3504, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/city/city: 5.35% (1.6276 => 1.7146, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.70% (0.9399 => 0.9653, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.11% (0.5073 => 0.5180, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.67% (0.9106 => 0.9258, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 47.73% (0.0859 => 0.1269, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/heapsort: 28.76% (3.6749 => 4.7317, std.dev.: 0.0838) SingleSource/Benchmarks/Shootout-C++/lists1: 7.62% (0.6128 => 0.6595, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.52% (0.8826 => 0.9137, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.89% (2.5139 => 2.5866, std.dev.: 0.0089) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.78% (1.3146 => 1.3380, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.59% (1.8493 => 1.8787, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/simple: -42.19% (0.0384 => 0.0222, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -30.66% (0.3350 => 0.2323, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -19.46% (0.0822 => 0.0662, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -17.48% (2.1193 => 1.7488, std.dev.: 0.0609) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -15.07% (0.1075 => 0.0913, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -12.24% (0.2295 => 0.2014, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/random: -8.31% (0.2239 => 0.2053, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.88% (0.6522 => 0.6073, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.83% (0.3207 => 0.2988, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -6.53% (0.8209 => 0.7673, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.38% (0.9197 => 0.8886, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -7.11% (2.9561 => 2.7458, std.dev.: 0.0396) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.64% (2.4069 => 2.2711, std.dev.: 0.0522) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.43% (2.5151 => 2.4540, std.dev.: 0.0125) SingleSource/UnitTests/Vector/multiplies: -1.77% (0.5754 => 0.5652, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -1.72% (7.0873 => 6.9657, std.dev.: 0.0265) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.45% (1.1205 => 1.2376, std.dev.: 0.1189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.73% (0.0231 => 0.0235, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.95% (0.0533 => 0.0448, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.29% (0.0386 => 0.0354, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.03% (0.0330 => 0.0340, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.70% (0.0459 => 0.0442, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: -10.42% (0.0288 => 0.0258, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/test1: -4.18% (0.0239 => 0.0229, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.30% (0.0253 => 0.0232, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 18.18% (0.0011 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -10.32% (0.1608 => 0.1442, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -7.14% (1.2347 => 1.1465, std.dev.: 0.4166) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.05% (0.3991 => 0.4033, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.32% (0.1553 => 0.1558, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.50% (0.1004 => 0.0999, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.44% (0.0294 => 0.0278, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.60% (0.0552 => 0.0605, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.22% (1.1521 => 1.1661, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 40.00% (0.0030 => 0.0042, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.73% (0.0022 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 40.46% (0.0613 => 0.0861, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.63% (0.0319 => 0.0321, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.94% (0.7546 => 0.7475, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 64.29% (0.0042 => 0.0069, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.04% (12.7676 => 12.7730, std.dev.: 0.0849) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/compare: 72.60% (0.0208 => 0.0359, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.81% (1.4805 => 1.7146, std.dev.: 0.0268) MultiSource/Benchmarks/Bullet/bullet: 11.68% (33.2440 => 37.1282, std.dev.: 0.2282) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.72% (23.5861 => 25.6423, std.dev.: 0.3051) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.17% (2.4519 => 2.6277, std.dev.: 0.0521) MultiSource/Benchmarks/Olden/bh/bh: 7.06% (0.3273 => 0.3504, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.99% (1.6874 => 1.8053, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.15% (0.2253 => 0.2369, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.99% (0.9381 => 0.9849, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.88% (1.0860 => 1.1281, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.39% (0.5059 => 0.5180, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321837.50% (0.0008 => 2.5755, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.22% (1.1825 => 2.3794, std.dev.: 0.0734) MultiSource/Benchmarks/MallocBench/gs/gs: 64.59% (0.0771 => 0.1269, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.58% (0.2562 => 0.3166, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout-C++/ary3: 6.00% (1.8123 => 1.9210, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/heapsort: 5.76% (4.4739 => 4.7317, std.dev.: 0.0838) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 3.83% (0.8800 => 0.9137, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/pi: 3.34% (2.1390 => 2.2104, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.81% (1.3014 => 1.3380, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 2.20% (6.8159 => 6.9657, std.dev.: 0.0265) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.10% (2.5334 => 2.5866, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.01% (1.2298 => 1.2545, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -27.17% (0.1888 => 0.1375, std.dev.: 0.0160) MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.76% (0.1009 => 0.0850, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -14.97% (0.0862 => 0.0733, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -12.99% (1.0220 => 0.8892, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -11.86% (1.0986 => 0.9683, std.dev.: 0.0164) MultiSource/Applications/Burg/burg: -11.72% (1.5979 => 1.4107, std.dev.: 0.0423) MultiSource/Applications/aha/aha: -11.47% (0.1378 => 0.1220, std.dev.: 0.0034) MultiSource/Applications/treecc/treecc: -10.41% (2.4719 => 2.2145, std.dev.: 0.0571) MultiSource/Applications/sgefa/sgefa: -9.09% (0.3598 => 0.3271, std.dev.: 0.0073) MultiSource/Applications/ClamAV/clamscan: -7.42% (17.4365 => 16.1429, std.dev.: 0.4380) MultiSource/Applications/d/make_dparser: -6.18% (3.7840 => 3.5502, std.dev.: 0.0567) MultiSource/Applications/SIBsim4/SIBsim4: -3.15% (1.4392 => 1.3938, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.86% (0.1164 => 0.1026, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/nestedloop: -9.18% (0.2200 => 0.1998, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.57% (1.4588 => 1.3484, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.38% (23.3986 => 22.1402, std.dev.: 0.4025) SingleSource/Benchmarks/Misc/mandel-2: -2.31% (0.8521 => 0.8324, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.82% (1.4446 => 1.4183, std.dev.: 0.0089) MultiSource/Benchmarks/mafft/pairlocalalign: -1.41% (63.1520 => 62.2613, std.dev.: 0.3048) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3596 => 3.3144, std.dev.: 0.0092) MultiSource/Benchmarks/BitBench/five11/five11: -1.25% (5.7021 => 5.6308, std.dev.: 0.0252) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.73% (1.2047 => 1.2376, std.dev.: 0.1189) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.86% (0.0233 => 0.0235, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.67% (0.0451 => 0.0448, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.15% (0.0394 => 0.0354, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.66% (0.0328 => 0.0340, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.67% (0.0445 => 0.0442, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: 21.13% (0.0213 => 0.0258, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/test1: 0.88% (0.0227 => 0.0229, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -40.57% (1.9293 => 1.1465, std.dev.: 0.4166) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.40% (0.4049 => 0.4033, std.dev.: 0.0479) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.18% (0.1510 => 0.1558, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.15% (0.0978 => 0.0999, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.54% (0.0590 => 0.0605, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.38% (1.1617 => 1.1661, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 31.25% (0.0032 => 0.0042, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 41.15% (0.0610 => 0.0861, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.78% (0.0268 => 0.0321, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.51% (0.7437 => 0.7475, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0092 => 0.0069, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7781 => 12.7730, std.dev.: 0.0849) Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 16:53:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 18:53:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124005333.369CC2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7878?compare_to=7875&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7878, Order: 173303, Start Time: 2013-01-23 23:19:18, End Time: 2013-01-24 00:53:46 To: 7875, Order: 173290, Start Time: 2013-01-23 21:21:21, End Time: 2013-01-23 22:55:45 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 1 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -7.79% (0.4443 => 0.4097, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.93% (0.0514 => 0.0894, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.58% (0.0974 => 0.1642, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 47.94% (0.0267 => 0.0395, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.27% (0.1500 => 0.2179, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.26% (0.6395 => 0.8778, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.23% (0.5805 => 0.7676, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.19% (0.0699 => 0.0924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.01% (0.5688 => 0.7509, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.91% (0.5456 => 0.7197, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.71% (0.6260 => 0.8245, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.49% (0.5849 => 0.7691, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.12% (0.5575 => 0.7310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.11% (0.5567 => 0.7299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 30.96% (0.6395 => 0.8375, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.93% (0.5581 => 0.7307, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.61% (0.5859 => 0.7594, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.19% (0.6033 => 0.7794, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.98% (0.6440 => 0.8306, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.48% (1.6474 => 2.1166, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.21% (0.6189 => 0.7935, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.59% (0.6304 => 0.8043, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.95% (0.6230 => 0.7909, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.53% (0.5802 => 0.7341, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.08% (0.6660 => 0.8397, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.91% (0.5925 => 0.7460, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.84% (0.5705 => 0.7179, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.42% (0.5857 => 0.7346, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.24% (0.5570 => 0.6976, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.06% (0.5478 => 0.6851, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.94% (0.5569 => 0.6958, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.81% (0.0790 => 0.0986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.58% (0.5591 => 0.6965, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.69% (0.5863 => 0.7252, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.31% (0.7524 => 0.9278, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.25% (0.6446 => 0.7945, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.02% (0.6052 => 0.7445, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.51% (0.6681 => 0.8185, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.39% (0.6194 => 0.7581, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.09% (0.6297 => 0.7688, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.14% (2.2587 => 2.7362, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.80% (0.6667 => 0.8054, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.21% (0.7339 => 0.8749, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 15.16% (0.3357 => 0.3866, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.74% (1.1450 => 1.3138, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.85% (0.1230 => 0.1388, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.08% (0.4916 => 0.5510, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 11.89% (0.4515 => 0.5052, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.86% (4.5069 => 5.0415, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.23% (3.5339 => 3.9309, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1982 => 0.2201, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.99% (1.6364 => 1.8163, std.dev.: 0.0084) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.64% (0.2385 => 0.2615, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 9.31% (9.2283 => 10.0873, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.49% (0.1731 => 0.1878, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.30% (1.2515 => 1.3554, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4524 => 0.4879, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.75% (0.5329 => 0.5742, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.97% (1.4642 => 1.5662, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.94% (0.7021 => 0.7508, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.86% (0.3834 => 0.4097, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 6.69% (0.4861 => 0.5186, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.66% (1.2784 => 1.3635, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.60% (0.1879 => 0.2003, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.79% (0.1761 => 0.1863, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.28% (0.3255 => 0.3427, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.02% (5.4682 => 5.6881, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/bigfib: 3.66% (0.6750 => 0.6997, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.42% (5.0226 => 5.1946, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.74% (1.3864 => 1.4244, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 2.51% (0.8418 => 0.8629, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 2.01% (0.7447 => 0.7597, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.78% (0.9557 => 0.9727, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.72% (22.4056 => 22.7908, std.dev.: 0.0221) MultiSource/Applications/SPASS/SPASS: 1.57% (15.5079 => 15.7518, std.dev.: 0.0126) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3722 => 1.3919, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7965, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9531 => 1.0288, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.89% (54.5751 => 56.6961, std.dev.: 0.0682) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.21% (2.0478 => 2.1135, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3809, std.dev.: 0.0024) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6136, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.27% (0.1431 => 0.1327, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -5.51% (0.3194 => 0.3018, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.77% (0.7198 => 0.6855, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -4.71% (2.4924 => 2.3749, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/exceptions-2: -4.54% (0.3831 => 0.3657, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.46% (0.3812 => 0.3642, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.41% (0.3880 => 0.3709, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.40% (0.3837 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.34% (0.3848 => 0.3681, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.32% (0.3821 => 0.3656, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4033 => 0.3860, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.21% (0.3891 => 0.3727, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.05% (0.4176 => 0.4007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.96% (0.3057 => 0.2936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.73% (0.2871 => 0.2764, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.72% (0.2903 => 0.2795, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.69% (0.3142 => 0.3026, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.64% (0.3323 => 0.3202, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.63% (0.9852 => 0.9494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.62% (0.3205 => 0.3089, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: -3.50% (0.3059 => 0.2952, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.41% (0.4199 => 0.4056, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.39% (0.6347 => 0.6132, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -3.23% (1.3148 => 1.2723, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.23% (2.1713 => 2.1012, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: -3.18% (0.6441 => 0.6236, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.06% (0.4280 => 0.4149, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.88% (0.6484 => 0.6297, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.9542 => 0.9286, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.65% (20.7746 => 20.2238, std.dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference: -2.65% (0.7779 => 0.7573, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.52% (14.2083 => 13.8501, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: -1.85% (17.1032 => 16.7865, std.dev.: 0.0083) MultiSource/Applications/JM/lencod/lencod: -1.73% (16.1920 => 15.9119, std.dev.: 0.0088) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.64% (6.7716 => 6.6608, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.56% (1.0544 => 1.0379, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.50% (1.2221 => 1.2038, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -1.22% (1.5610 => 1.5419, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/football/football: -1.19% (0.9179 => 0.9070, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0138, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/gs/gs: -1.15% (4.3330 => 4.2831, std.dev.: 0.0122) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6941, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0132) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3099, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.40% (1.3643 => 1.0314, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7595, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -23.28% (83.5423 => 64.0904, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1974, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.82% (5.3397 => 4.1747, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1283, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0926, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3565, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.25% (0.5142 => 0.4615, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3991, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.72% (7.9763 => 7.7591, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.70% (1.3096 => 1.2742, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/ary3: -2.41% (3.7241 => 3.6343, std.dev.: 0.0159) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.59% (7.3040 => 7.1882, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6085, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 17:43:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 19:43:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124014329.6E6BE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7879?compare_to=7876&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7879, Order: 173303, Start Time: 2013-01-23 23:32:08, End Time: 2013-01-24 01:43:42 To: 7876, Order: 173288, Start Time: 2013-01-23 20:49:22, End Time: 2013-01-23 23:01:29 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (218 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.40% (11.1930 => 11.4621, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.02% (1.6159 => 1.6324, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.30% (0.9866 => 0.9738, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0655 => 0.0652, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8406 => 499.8718, std.dev.: 0.0032) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 44226.66% (1.1277 => 499.8718, std.dev.: 0.0032) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.57% (0.5229 => 1.6501, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 20.65% (14.9895 => 18.0855, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 44.01% (14.1553 => 20.3855, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/gs/gs: 18.00% (4.1105 => 4.8505, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.15% (1.1048 => 1.7362, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.89% (7.1582 => 37.5728, std.dev.: 0.0204) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.41% (3.4629 => 6.4207, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.49% (0.6222 => 1.0919, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10280.83% (0.0720 => 7.4742, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 11148000.00% (0.0001 => 11.1481, std.dev.: 0.0171) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485500.00% (0.0001 => 5.4856, std.dev.: 0.0168) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 828.08% (1.1194 => 10.3889, std.dev.: 0.0088) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.77% (22.1758 => 55.3875, std.dev.: 0.0460) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.52% (0.0929 => 0.1835, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 66.03% (0.0730 => 0.1212, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.70% (2.9384 => 4.6338, std.dev.: 0.0133) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.23% (7.0540 => 10.8086, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.62% (1.5859 => 2.4046, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 49.43% (0.1056 => 0.1578, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.45% (8.1363 => 11.9968, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.96% (0.0439 => 0.0632) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.85% (2.2024 => 3.1242, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 39.88% (0.3109 => 0.4349, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 39.59% (0.1432 => 0.1999, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 38.99% (21.9371 => 30.4903, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.25% (4.2646 => 5.6825, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.78% (0.4615 => 0.6128, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.48% (1.5415 => 2.0422, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.21% (0.2271 => 0.2957, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.80% (1.1642 => 1.5111, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 29.68% (0.4299 => 0.5575, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.52% (0.5105 => 0.6510, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.24% (0.6675 => 0.8493, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.14% (0.0479 => 0.0609, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 26.89% (0.1655 => 0.2100, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 26.46% (9.4845 => 11.9943, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.26% (3.8922 => 4.9144, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.11% (0.1892 => 0.2386, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.10% (0.0793 => 0.1000, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.46% (0.1143 => 0.1434, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 24.55% (0.4289 => 0.5342, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 24.54% (1.0722 => 1.3353, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.31% (0.1695 => 0.2107, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.22% (0.3121 => 0.3877, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.88% (1.4186 => 1.7573, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/tsp/tsp: 23.74% (0.1175 => 0.1454, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.38% (0.4620 => 0.5700, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 22.78% (0.7115 => 0.8736, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.81% (0.2700 => 0.3289, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.61% (0.1555 => 0.1891, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.24% (0.3098 => 0.3756, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.88% (1.3050 => 1.5775, std.dev.: 0.0106) MultiSource/Applications/oggenc/oggenc: 20.83% (5.7591 => 6.9586, std.dev.: 0.0174) MultiSource/Applications/spiff/spiff: 20.69% (0.7835 => 0.9456, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 20.48% (0.6456 => 0.7778, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.44% (0.0675 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.43% (0.0842 => 0.1014, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 20.42% (0.1151 => 0.1386, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.08% (4.9449 => 5.9377, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.93% (0.5860 => 0.7028, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.88% (0.1695 => 0.2032, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.86% (0.1163 => 0.1394, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.16% (0.8172 => 0.9738, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 19.07% (3.3354 => 3.9715, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.97% (5.0018 => 5.9507, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.75% (0.5020 => 0.5961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.32% (0.3307 => 0.3913, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.20% (0.2758 => 0.3260, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 18.14% (0.7433 => 0.8781, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 18.10% (1.1840 => 1.3983, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.82% (0.9765 => 1.1505, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.67% (0.1268 => 0.1492, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.61% (0.2107 => 0.2478, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.60% (0.5569 => 0.6549, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.49% (1.1861 => 1.3936, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 17.37% (3.8723 => 4.5448, std.dev.: 0.0135) MultiSource/Applications/treecc/treecc: 17.33% (2.0273 => 2.3786, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 17.33% (0.2049 => 0.2404, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.27% (0.0834 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.09% (0.3423 => 0.4008, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.99% (0.5981 => 0.6997, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.74% (2.2969 => 2.6815, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.65% (0.6450 => 0.7524, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.42% (0.3441 => 0.4006, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.36% (0.3283 => 0.3820, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.20% (0.8101 => 0.9413, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 15.87% (0.3232 => 0.3745, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.77% (0.0818 => 0.0947, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.35% (0.8921 => 1.0290, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.28% (0.3180 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3379 => 0.3877, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.27% (0.8067 => 0.9218, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0068) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.4636 => 0.5258, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.89% (0.4103 => 0.4632, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.75% (1.5603 => 1.7592, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.35% (0.4203 => 0.4722, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 12.34% (0.3282 => 0.3687, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 12.13% (0.4048 => 0.4539, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 11.94% (17.1811 => 19.2324, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/sieve: 11.74% (0.3603 => 0.4026, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.69% (0.2430 => 0.2714, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 11.66% (0.3422 => 0.3821, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.54% (0.3684 => 0.4109, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 11.35% (0.3092 => 0.3443, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.04% (0.1268 => 0.1408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.02% (0.4064 => 0.4512, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.76% (0.3886 => 0.4304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (10.3673 => 11.4621, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.51% (14.3668 => 15.8772, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/exceptions: 9.98% (0.3828 => 0.4210, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.96% (0.1114 => 0.1225, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 9.82% (0.2871 => 0.3153, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: 9.53% (0.3473 => 0.3804, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.53% (0.3694 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.52% (0.3497 => 0.3830, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3561 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.46% (0.3543 => 0.3878, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.41% (0.3516 => 0.3847, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.26% (2.0665 => 2.2579, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2756 => 0.3007, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.06% (0.2793 => 0.3046, std.dev.: 0.0048) MultiSource/Applications/hexxagon/hexxagon: 9.03% (1.2842 => 1.4001, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 9.01% (63.2438 => 68.9397, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2905 => 0.3161, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.81% (0.2725 => 0.2965, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.66% (0.2714 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.64% (0.6030 => 0.6551, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.46% (0.2802 => 0.3039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.42% (0.3052 => 0.3309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.36% (0.2872 => 0.3112, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 8.18% (0.7326 => 0.7925, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.13% (0.3935 => 0.4255, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.84% (0.3136 => 0.3382, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.72% (2.2022 => 2.3721, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.78% (0.4879 => 0.5210, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.85% (0.2266 => 0.2376, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 3.80% (0.3131 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.76% (7.9617 => 8.1817, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4739, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.53% (4.2280 => 4.4620, std.dev.: 0.0080) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.89% (0.9957 => 1.0245, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.49% (8.6802 => 8.8961, std.dev.: 0.0113) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7128, std.dev.: 0.0074) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.90% (9.1159 => 9.2894, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2379, std.dev.: 0.0057) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.25% (10.3460 => 10.4751, std.dev.: 0.0240) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1698, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1795, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -74.66% (0.8651 => 0.2192, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.60% (5.3855 => 4.4913, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.32% (5.3526 => 4.4793, std.dev.: 0.0058) MultiSource/Applications/JM/ldecod/ldecod: -13.18% (10.4361 => 9.0605, std.dev.: 0.0093) SingleSource/UnitTests/Vector/constpool: -8.03% (54.1659 => 49.8169, std.dev.: 0.0153) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.30% (1.7609 => 1.6324, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.71% (1.9577 => 0.6517, std.dev.: 0.0166) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.46% (1.5373 => 1.0229, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4340, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8534, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0044, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -11.14% (9.5636 => 8.4983, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.13% (19.9488 => 18.3267, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: -6.00% (1.2373 => 1.1631, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.64% (8.1563 => 7.6960, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.62% (1.5835 => 1.5104, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -4.58% (10.2830 => 9.8119, std.dev.: 0.0113) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3303, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/ary3: -1.59% (3.6994 => 3.6404, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.6441 => 4.5849, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.20% (3.7221 => 3.6774, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2261, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0027) Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 18:22:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 20:22:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130124022257.1A6462A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7880?compare_to=7873&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7880, Order: 173297, Start Time: 2013-01-23 22:49:12, End Time: 2013-01-24 02:23:10 To: 7873, Order: 173277, Start Time: 2013-01-23 18:23:22, End Time: 2013-01-23 21:57:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (180 on baseline) Performance Improvements: 1 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.15% (1.5651 => 1.5831, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/whetstone: -1.16% (2.8198 => 2.7871, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 41.28% (0.0625 => 0.0883, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 32.83% (0.1063 => 0.1412, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.33% (0.2969 => 0.3810, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.87% (0.0547 => 0.0694, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 26.76% (0.1106 => 0.1402, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.59% (0.4253 => 0.5384, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.55% (0.4139 => 0.5238, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.43% (0.4994 => 0.6314, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.47% (0.0475 => 0.0596, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.30% (0.0415 => 0.0520, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.22% (0.5900 => 0.7388, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.07% (0.0714 => 0.0893, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0584 => 0.0730, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.92% (0.0642 => 0.0802, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.63% (0.1620 => 0.2019, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.12% (0.5000 => 0.6206, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: 24.05% (1.5932 => 1.9763, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 24.04% (0.0599 => 0.0743, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.97% (0.0897 => 0.1112, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.84% (0.0541 => 0.0670, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.21% (0.1021 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.79% (0.1549 => 0.1902, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.26% (0.0584 => 0.0714, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.12% (0.0633 => 0.0773, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.03% (0.1003 => 0.1224, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.86% (0.1107 => 0.1349, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.85% (0.3903 => 0.4756, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 21.85% (0.0604 => 0.0736, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.85% (0.1103 => 0.1344, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.84% (0.0948 => 0.1155, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 21.82% (0.1604 => 0.1954, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.82% (0.0495 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.53% (0.0822 => 0.0999) MultiSource/Benchmarks/McCat/05-eks/eks: 21.19% (0.1619 => 0.1962, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 21.07% (0.0821 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.39% (0.2736 => 0.3294, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.37% (1.3152 => 1.5831, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 20.15% (0.4029 => 0.4841, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.11% (0.1462 => 0.1756, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.10% (0.3890 => 0.4672, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 20.06% (0.0947 => 0.1137, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 19.94% (0.1088 => 0.1305, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.66% (0.3271 => 0.3914, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 19.62% (0.1218 => 0.1457, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.50% (0.2866 => 0.3425, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.46% (0.2014 => 0.2406, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.17% (0.0605 => 0.0721, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 19.07% (0.1505 => 0.1792, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 19.05% (0.0698 => 0.0831, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 18.97% (1.8794 => 2.2360, std.dev.: 0.0069) MultiSource/Applications/Burg/burg: 18.95% (0.5546 => 0.6597, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.36% (0.0572 => 0.0677, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.98% (0.0573 => 0.0676, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 17.90% (0.5826 => 0.6869, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.88% (0.4658 => 0.5491, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.73% (0.1968 => 0.2317, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.66% (3.5627 => 4.1917, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 17.64% (1.6211 => 1.9071, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/bh/bh: 17.52% (0.1284 => 0.1509, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.46% (0.2875 => 0.3377, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.41% (0.5026 => 0.5901, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.39% (1.9694 => 2.3118, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 17.35% (0.5889 => 0.6911, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 17.16% (0.9697 => 1.1361, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.16% (0.1160 => 0.1359, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 17.11% (0.2566 => 0.3005, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.08% (0.4361 => 0.5106, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.91% (0.2792 => 0.3264, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 16.89% (0.1421 => 0.1661, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 16.87% (0.7171 => 0.8381, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 16.72% (0.2811 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 16.70% (0.2725 => 0.3180, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.67% (0.3930 => 0.4585, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.65% (0.2714 => 0.3166, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 16.64% (0.2813 => 0.3281, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.62% (0.2738 => 0.3193, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 16.61% (0.2823 => 0.3292, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 16.59% (0.2911 => 0.3394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2780 => 0.3240, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 16.45% (0.2803 => 0.3264, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 16.44% (1.0781 => 1.2553, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.42% (4.4195 => 5.1453, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.39% (0.3362 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.34% (0.2729 => 0.3175, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 16.33% (0.9909 => 1.1527, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.29% (2.0673 => 2.4040, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.28% (0.3195 => 0.3715, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.22% (0.3267 => 0.3797, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 16.21% (0.3258 => 0.3786, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 16.18% (0.3004 => 0.3490, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 16.01% (0.3348 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 16.01% (0.3317 => 0.3848, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 15.89% (0.3096 => 0.3588, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 15.87% (4.2109 => 4.8791, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 15.85% (0.3060 => 0.3545, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.76% (1.9966 => 2.3113, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 15.60% (23.5202 => 27.1893, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 15.51% (0.3726 => 0.4304, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.46% (2.7292 => 3.1510, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.43% (0.3124 => 0.3606, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.27% (0.3282 => 0.3783, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.23% (0.1090 => 0.1256, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 15.17% (1.4269 => 1.6433, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/lists1: 15.07% (0.3477 => 0.4001, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.06% (0.3625 => 0.4171, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 15.01% (0.3678 => 0.4230, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 14.91% (0.4251 => 0.4885, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 14.79% (0.4146 => 0.4759, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.72% (0.3981 => 0.4567, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.69% (0.3845 => 0.4410, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.53% (0.3690 => 0.4226, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: 14.26% (0.7875 => 0.8998, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.81% (0.1028 => 0.1170, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 13.81% (0.5012 => 0.5704, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 13.74% (5.5417 => 6.3033, std.dev.: 0.0173) SingleSource/UnitTests/ObjC/synchronized: 13.55% (0.3469 => 0.3939) SingleSource/UnitTests/ObjC/for-in: 13.53% (0.3496 => 0.3969, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 13.51% (0.3465 => 0.3933, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 13.49% (0.3446 => 0.3911, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.42% (0.3488 => 0.3956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 13.36% (0.3442 => 0.3902, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 13.35% (0.3460 => 0.3922, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.26% (0.6435 => 0.7288, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.25% (0.2075 => 0.2350, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 13.15% (0.3650 => 0.4130, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.06% (2.1653 => 2.4480, std.dev.: 0.0259) SingleSource/UnitTests/ObjC/exceptions: 13.04% (0.3643 => 0.4118, std.dev.: 0.0064) SingleSource/UnitTests/ObjC/parameter-passing: 13.02% (0.3724 => 0.4209, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 12.64% (2.1013 => 2.3669, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 12.62% (4.6177 => 5.2003, std.dev.: 0.0439) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.57% (0.2068 => 0.2328, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.46% (0.2737 => 0.3078, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.29% (0.1383 => 0.1553, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 12.04% (0.6634 => 0.7433, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.01% (0.5361 => 0.6005, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.96% (0.2040 => 0.2284, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 11.86% (0.3498 => 0.3913, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.64% (0.3084 => 0.3443, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 11.48% (0.3336 => 0.3719, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 11.26% (0.4847 => 0.5393, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.22% (0.2103 => 0.2339, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.72% (0.7426 => 0.8222, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.45% (11.6398 => 12.8564, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 10.12% (0.2391 => 0.2633, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.76% (4.6926 => 5.1505, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 9.48% (2.0346 => 2.2275, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (0.5584 => 0.6103, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 7.55% (11.9555 => 12.8587, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.22% (0.3792 => 0.3952, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5318, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0099) MultiSource/Applications/ClamAV/clamscan: 8.92% (0.2802 => 0.3052, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.80% (0.3693 => 0.4018, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2398, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6724, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-2: 4.70% (1.8057 => 1.8905, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6811, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 3.08% (0.6276 => 0.6469, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2096, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.52% (7.1849 => 7.2941, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3086, std.dev.: 0.0158) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0814, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2077, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5882, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4793, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.52% (2.4764 => 2.4141, std.dev.: 0.0072) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5560, std.dev.: 0.0204) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.90% (17.2379 => 14.1518, std.dev.: 0.1260) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary2: -8.53% (0.2402 => 0.2197, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9788, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7960, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9586, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.73% (41.7953 => 40.2374, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std.dev.: 0.0032) SingleSource/Benchmarks/Dhrystone/dry: -3.42% (14.0481 => 13.5682, std.dev.: 0.1801) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1397, std.dev.: 0.0536) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.86% (0.6293 => 0.6176, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5714, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1770, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0439, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 18:51:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 20:51:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124025116.5BFD92A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7881?compare_to=7878&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7881, Order: 173311, Start Time: 2013-01-24 01:17:13, End Time: 2013-01-24 02:51:29 To: 7878, Order: 173303, Start Time: 2013-01-23 23:19:18, End Time: 2013-01-24 00:53:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (114 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (866 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 85.00% (0.0280 => 0.0518, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.79% (0.0974 => 0.1644, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 48.69% (0.0267 => 0.0397, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.65% (0.6395 => 0.8803, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.54% (0.5688 => 0.7539, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.44% (0.5805 => 0.7688, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.32% (0.6260 => 0.8283, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.94% (0.5849 => 0.7717, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.70% (0.5567 => 0.7332, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.61% (0.5575 => 0.7337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.49% (0.6395 => 0.8409, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.58% (0.5941 => 0.7758, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.35% (0.5859 => 0.7637, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.79% (0.6033 => 0.7830, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.21% (0.6440 => 0.8321, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.97% (1.6474 => 2.1246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.60% (0.6189 => 0.7959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.11% (0.6304 => 0.8076, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.43% (0.6230 => 0.7939, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.06% (0.5705 => 0.7192, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.94% (0.5925 => 0.7462, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.71% (0.5857 => 0.7363, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.58% (0.5478 => 0.6879, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.48% (0.5570 => 0.6989, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.18% (0.5569 => 0.6971, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.17% (0.0445 => 0.0557, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.08% (0.5591 => 0.6993, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.41% (0.5863 => 0.7294, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.88% (0.6446 => 0.7985, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.63% (0.7524 => 0.9302, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.58% (0.6052 => 0.7479, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.22% (0.6681 => 0.8232, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.93% (0.6194 => 0.7614, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.55% (0.6297 => 0.7717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.80% (2.2587 => 2.7510, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.33% (0.6667 => 0.8089, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.51% (0.7339 => 0.8771, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.14% (0.1146 => 0.1331, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 14.91% (1.1450 => 1.3157, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.66% (0.0864 => 0.0982, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.41% (0.1230 => 0.1395, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.02% (0.4916 => 0.5507, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.98% (4.5069 => 5.0467, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.72% (3.5339 => 3.9479, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.09% (1.6364 => 1.8178, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1982 => 0.2189, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.60% (0.2385 => 0.2614, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 9.27% (9.2283 => 10.0835, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.95% (0.1731 => 0.1886, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.48% (1.2515 => 1.3576, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.05% (0.5329 => 0.5758, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.65% (0.2001 => 0.2154, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.45% (0.4524 => 0.4861, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.10% (1.4642 => 1.5682, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (1.2784 => 1.3654, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 6.60% (0.1879 => 0.2003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 6.46% (0.4861 => 0.5175, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 4.67% (0.3255 => 0.3407, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.29% (5.4682 => 5.7029, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.41% (0.6750 => 0.6980, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.26% (5.0226 => 5.1862, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: 2.65% (1.3864 => 1.4232, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.58% (0.8418 => 0.8635, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5168 => 0.5273, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 2.03% (0.7447 => 0.7598, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (22.4056 => 22.8279, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.86% (0.9557 => 0.9735, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.75% (15.5079 => 15.7791, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3722 => 1.3958, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.15% (18.2933 => 18.5028, std.dev.: 0.0214) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2300 => 1.2429, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8027, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.89% (0.9531 => 1.0283, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4769, std.dev.: 0.1752) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3817, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6138, std.dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 1.67% (3.7435 => 3.8062, std.dev.: 0.0229) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.16% (10.3489 => 10.4694, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (79.7170 => 80.5633, std.dev.: 0.0933) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -6.11% (0.3194 => 0.2999, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.21% (0.7198 => 0.6823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.14% (0.3831 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -5.05% (0.3880 => 0.3684, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.04% (0.3848 => 0.3654, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.95% (0.3896 => 0.3703, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.88% (0.3891 => 0.3701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.84% (0.4033 => 0.3838, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.67% (0.3837 => 0.3658, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.60% (0.4176 => 0.3984, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.54% (2.4924 => 2.3792, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.51% (0.3884 => 0.3709, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -4.45% (0.3057 => 0.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: -4.28% (0.2871 => 0.2748, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -4.24% (0.2903 => 0.2780, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.18% (0.3323 => 0.3184, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: -4.01% (0.2939 => 0.2821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.99% (0.3205 => 0.3077, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.91% (0.4199 => 0.4035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.83% (2.1713 => 2.0881, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -3.80% (0.3025 => 0.2910, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: -3.69% (0.3059 => 0.2946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: -3.67% (0.3026 => 0.2915, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.63% (0.3142 => 0.3028, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.57% (0.4280 => 0.4127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.54% (0.3252 => 0.3137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.51% (0.6347 => 0.6124, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -3.45% (1.3148 => 1.2694, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: -3.45% (0.2989 => 0.2886, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.35% (0.9852 => 0.9522, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.24% (0.6441 => 0.6232, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.88% (0.6484 => 0.6297, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -2.87% (0.3621 => 0.3517, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.73% (0.3849 => 0.3744, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.9542 => 0.9285, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.64% (14.2083 => 13.8329, std.dev.: 0.0115) SingleSource/UnitTests/ObjC++/property-reference: -2.60% (0.7779 => 0.7577, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: -2.35% (0.4248 => 0.4148, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.35% (0.4427 => 0.4323, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.33% (20.7746 => 20.2897, std.dev.: 0.0511) MultiSource/Applications/sqlite3/sqlite3: -1.95% (17.1032 => 16.7696, std.dev.: 0.0130) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.71% (6.7716 => 6.6560, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.68% (16.1920 => 15.9207, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.60% (1.2221 => 1.2026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.59% (1.2210 => 1.2016, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -1.58% (1.5610 => 1.5364, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.42% (1.0544 => 1.0394, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -1.37% (7.0961 => 6.9986, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.29% (0.7919 => 0.7817, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: -1.05% (4.3330 => 4.2876, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.99% (1.8100 => 0.7060, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3100, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.20% (1.3643 => 1.0341, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0784, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.95% (2.5106 => 2.1353, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3549, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.98% (1.3096 => 1.2706, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.69% (7.9763 => 7.7618, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout/ary3: -2.48% (3.7241 => 3.6316, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1906, std.dev.: 0.0099) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.39% (1.6219 => 1.5994, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 19:02:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 21:02:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124030252.EE8722A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7882?compare_to=7877&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7882, Order: 173311, Start Time: 2013-01-24 00:58:42, End Time: 2013-01-24 03:03:09 To: 7877, Order: 173297, Start Time: 2013-01-23 22:31:47, End Time: 2013-01-24 00:38:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (6 on baseline) Performance Improvements: 32 (27 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1030 (1030 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 6.53% (1.5332 => 1.6333, std.dev.: 0.0237) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 7.38% (47.3538 => 50.8466, std.dev.: 1.3394) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/DuffsDevice: -31.58% (0.0323 => 0.0221, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -25.51% (0.4716 => 0.3513, std.dev.: 0.0461) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -25.34% (0.2143 => 0.1600, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -23.48% (0.1001 => 0.0766, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -22.42% (0.3640 => 0.2824, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -20.37% (0.4133 => 0.3291, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.71% (0.8126 => 0.6606, std.dev.: 0.0444) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -17.91% (0.4993 => 0.4099, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -14.71% (1.5241 => 1.2999, std.dev.: 0.0593) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.70% (1.2588 => 1.0737, std.dev.: 0.0404) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -14.62% (0.7556 => 0.6451, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/loader/loader: -13.51% (0.3849 => 0.3329, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -13.06% (0.8252 => 0.7174, std.dev.: 0.0359) MultiSource/Benchmarks/nbench/nbench: -8.62% (1.3966 => 1.2762, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/bh/bh: -8.48% (0.3504 => 0.3207, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.10% (1.0247 => 0.9622, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/oourafft: -5.25% (0.2361 => 0.2237, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (0.9308 => 0.8865, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.62% (1.0322 => 0.9948, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3206 => 0.3093, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.50% (0.9441 => 0.9111, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.59% (0.9806 => 0.9552, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.21% (0.6073 => 0.5939, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -38.14% (0.1269 => 0.0785, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/mst/mst: -30.49% (0.2181 => 0.1516, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.32% (0.3166 => 0.2871, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -7.82% (1.9210 => 1.7708, std.dev.: 0.0540) SingleSource/Benchmarks/Shootout-C++/lists1: -7.81% (0.6595 => 0.6080, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.57% (0.9137 => 0.8902, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -2.52% (2.5866 => 2.5215, std.dev.: 0.0237) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.33% (1.3380 => 1.3068, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.24% (1.2545 => 1.2264, std.dev.: 0.0102) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -8.72% (1.2376 => 1.1297, std.dev.: 0.2075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.68% (0.0235 => 0.0224, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.23% (0.0448 => 0.0438, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.95% (0.0354 => 0.0340, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.29% (0.0340 => 0.0322, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.58% (0.0442 => 0.0435, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: -19.38% (0.0258 => 0.0208, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: -2.18% (0.0229 => 0.0224, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.19% (0.0232 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.39% (0.1442 => 0.1462, std.dev.: 0.0144) MultiSource/Applications/lemon/lemon: 3.38% (1.1465 => 1.1853, std.dev.: 0.3020) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.88% (0.4033 => 0.3957, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.10% (0.1558 => 0.1463, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0999 => 0.0997, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.11% (0.0278 => 0.0236, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.98% (0.0605 => 0.0593, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.37% (1.1661 => 1.1501, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -28.57% (0.0042 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -29.38% (0.0861 => 0.0608, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.74% (0.0321 => 0.0309, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.68% (0.7475 => 0.7424, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.13% (0.0069 => 0.0042, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.11% (12.7730 => 12.7874, std.dev.: 0.0801) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.49% (0.0336 => 0.0509, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.32% (0.9588 => 0.9810, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320612.50% (0.0008 => 2.5657, std.dev.: 0.0250) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 99.02% (1.1825 => 2.3534, std.dev.: 0.0332) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 12.06% (0.2562 => 0.2871, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/pi: 2.92% (2.1390 => 2.2015, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.60% (0.0727 => 0.0490, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.19% (0.0692 => 0.0490, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.17% (0.0862 => 0.0714, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.64% (0.1079 => 0.0921, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.15% (1.0960 => 0.9409, std.dev.: 0.0445) MultiSource/Applications/hbd/hbd: -13.87% (1.8964 => 1.6333, std.dev.: 0.0237) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.95% (6.4235 => 5.7843, std.dev.: 0.1689) MultiSource/Applications/lua/lua: -8.10% (4.6406 => 4.2648, std.dev.: 0.0576) MultiSource/Applications/siod/siod: -6.70% (2.6437 => 2.4665, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout-C++/hello: -5.71% (0.1928 => 0.1818, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -5.32% (0.5134 => 0.4861, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.67% (1.0017 => 0.9649, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/lists1: -3.52% (0.3206 => 0.3093, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.19% (0.6135 => 0.5939, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.13% (0.9405 => 0.9111, std.dev.: 0.0069) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.40% (0.9372 => 0.6523, std.dev.: 0.0885) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.00% (0.4081 => 0.3673, std.dev.: 0.0120) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.40% (1.4588 => 1.3216, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/nestedloop: -9.23% (0.2200 => 0.1997, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: -8.27% (0.6628 => 0.6080, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: -6.43% (0.3654 => 0.3419, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.00% (0.3201 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.27% (17.2182 => 16.6557, std.dev.: 0.0659) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.15% (0.5826 => 0.5701, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: -1.52% (1.5825 => 1.5584, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/mandel-2: -1.36% (0.8521 => 0.8405, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: -1.13% (8.6447 => 8.5471, std.dev.: 0.0260) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.23% (1.2047 => 1.1297, std.dev.: 0.2075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0027) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.44% (0.1530 => 0.1462, std.dev.: 0.0144) MultiSource/Applications/lemon/lemon: -38.56% (1.9293 => 1.1853, std.dev.: 0.3020) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.27% (0.4049 => 0.3957, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.11% (0.1510 => 0.1463, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.94% (0.0978 => 0.0997, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.49% (0.0276 => 0.0236, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.51% (0.0590 => 0.0593, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.00% (1.1617 => 1.1501, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.30% (0.0268 => 0.0309, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.17% (0.7437 => 0.7424, std.dev.: 0.0010) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7781 => 12.7874, std.dev.: 0.0801) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 20:25:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 22:25:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124042514.2B7472A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7883?compare_to=7879&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7883, Order: 173314, Start Time: 2013-01-24 02:14:10, End Time: 2013-01-24 04:25:28 To: 7879, Order: 173303, Start Time: 2013-01-23 23:32:08, End Time: 2013-01-24 01:43:42 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (219 on baseline) Performance Improvements: 2 (68 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (650 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 3.35% (3.7481 => 3.8737, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.33% (79.8424 => 80.9035, std.dev.: 0.3433) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.36% (11.4621 => 11.1919, std.dev.: 0.0086) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.27% (1.3286 => 1.2984, std.dev.: 0.0052) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.31% (0.0652 => 0.0654, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8718 => 499.8440, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44224.20% (1.1277 => 499.8440, std.dev.: 0.0102) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.30% (0.5229 => 1.6487, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 20.95% (14.9895 => 18.1293, std.dev.: 0.0150) MultiSource/Applications/kimwitu++/kc: 44.54% (14.1553 => 20.4607, std.dev.: 0.0217) MultiSource/Benchmarks/MallocBench/gs/gs: 18.61% (4.1105 => 4.8756, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.16% (1.1048 => 1.7363, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.74% (7.1582 => 37.6337, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.48% (3.4629 => 6.4575, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.72% (0.6222 => 1.0933, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10278.33% (0.0720 => 7.4724, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 3834700.00% (0.0001 => 3.8348, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11153500.00% (0.0001 => 11.1536, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849000.00% (0.0001 => 9.8491, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487400.00% (0.0001 => 5.4875, std.dev.: 0.0110) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.03% (1.1194 => 10.3212, std.dev.: 0.0237) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.20% (22.1758 => 55.2619, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.31% (2.9384 => 4.6223, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.61% (7.0540 => 10.9062, std.dev.: 0.0065) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.01% (1.5859 => 2.4107, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 49.43% (0.1056 => 0.1578) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.88% (8.1363 => 11.9506, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.13% (2.2024 => 3.1303, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 40.11% (0.3109 => 0.4356, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 39.18% (0.1432 => 0.1993, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 39.15% (21.9371 => 30.5261, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0009) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.29% (0.1062 => 0.1458, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.39% (4.2646 => 5.6887, std.dev.: 0.0091) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.72% (0.4615 => 0.6125, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.46% (1.5415 => 2.0419, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 30.05% (1.1642 => 1.5141, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 29.47% (0.4299 => 0.5566, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.01% (0.5105 => 0.6535, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.91% (0.1143 => 0.1462) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.69% (0.6675 => 0.8523, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.02% (0.1584 => 0.2012, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.86% (0.0793 => 0.1006, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 26.75% (0.1555 => 0.1971, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.74% (0.1892 => 0.2398, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 26.23% (9.4845 => 11.9722, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.22% (3.8922 => 4.9127, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/08-main/main: 26.08% (0.2554 => 0.3220, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.98% (0.1655 => 0.2085, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.79% (0.0730 => 0.0911, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.60% (1.0722 => 1.3360, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.28% (1.4186 => 1.7631, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 24.20% (0.4289 => 0.5327, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.19% (0.3121 => 0.3876, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.72% (0.1695 => 0.2097, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 23.61% (0.4620 => 0.5711, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 23.49% (0.7115 => 0.8786, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.30% (0.2700 => 0.3302, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.19% (0.1029 => 0.1247, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 21.04% (5.7591 => 6.9707, std.dev.: 0.0107) SingleSource/Benchmarks/Misc-C++/bigfib: 21.00% (0.6456 => 0.7812, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.91% (1.3050 => 1.5779, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.86% (0.7835 => 0.9469, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 20.82% (0.3098 => 0.3743, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 20.29% (0.1163 => 0.1399, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.88% (0.5860 => 0.7025, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.78% (4.9449 => 5.9229, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.69% (0.1940 => 0.2322, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.35% (0.8172 => 0.9753, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 19.10% (3.3354 => 3.9725, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.02% (5.0018 => 5.9529, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.99% (0.3307 => 0.3935, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.69% (0.7433 => 0.8822, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.00% (0.9765 => 1.1523, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 17.94% (1.1840 => 1.3964, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.94% (0.5569 => 0.6568, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.77% (2.0273 => 2.3875, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.69% (1.1861 => 1.3959, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 17.66% (3.8723 => 4.5560, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 17.35% (0.3423 => 0.4017, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 17.25% (2.2969 => 2.6932, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.17% (0.5981 => 0.7008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.95% (0.1044 => 0.1221, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.56% (0.2065 => 0.2407, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.42% (0.8101 => 0.9431, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.39% (0.3283 => 0.3821, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.23% (0.6450 => 0.7497, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 15.96% (0.2049 => 0.2376, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 15.81% (0.3232 => 0.3743, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.57% (0.3180 => 0.3675, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.8921 => 1.0292, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.32% (0.8067 => 0.9303, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 14.03% (0.3379 => 0.3853, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.70% (0.4636 => 0.5271, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.72% (1.5603 => 1.7588, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.70% (0.4103 => 0.4624, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.63% (0.4203 => 0.4734, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.06% (0.4048 => 0.4536, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 12.04% (0.3282 => 0.3677, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 11.95% (0.3422 => 0.3831, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.94% (17.1811 => 19.2325, std.dev.: 0.0202) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.81% (0.2430 => 0.2717, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.75% (0.3684 => 0.4117, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.74% (0.3092 => 0.3455, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Puzzle: 11.12% (0.1268 => 0.1409, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 10.98% (0.3927 => 0.4358, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.85% (0.3427 => 0.3799, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (14.3668 => 15.9040, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.4064 => 0.4498, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.59% (0.1114 => 0.1232, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.52% (0.3886 => 0.4295, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.77% (0.3828 => 0.4202, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2831 => 0.3105, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.23% (0.3543 => 0.3870, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.23% (2.0665 => 2.2572, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.15% (0.3497 => 0.3817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.06% (0.2871 => 0.3131, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 8.94% (1.2842 => 1.3990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.79% (0.2877 => 0.3130, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.77% (0.3650 => 0.3970, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 8.75% (63.2438 => 68.7753, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.51% (0.3162 => 0.3431, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.16% (0.2756 => 0.2981, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.13% (0.3935 => 0.4255, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 8.06% (0.3052 => 0.3298, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.04% (0.2872 => 0.3103, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.99% (0.2802 => 0.3026, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/fibo: 7.96% (0.2725 => 0.2942, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 7.95% (10.3673 => 11.1919, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.88% (0.2793 => 0.3013, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.88% (0.3136 => 0.3383, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.81% (0.7326 => 0.7898, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 7.77% (0.2714 => 0.2925, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.75% (2.2022 => 2.3728, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 7.61% (0.5925 => 0.6376, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.83% (0.4879 => 0.5212, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.33% (0.3177 => 0.3378, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 3.74% (0.3131 => 0.3248, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.39% (7.9617 => 8.1523, std.dev.: 0.0224) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4664, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4496, std.dev.: 0.0160) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.03% (0.9957 => 1.0259, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9059, std.dev.: 0.0094) MultiSource/Benchmarks/llubenchmark/llu: 2.53% (3.7781 => 3.8737, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.02% (0.8333 => 0.8501, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7114, std.dev.: 0.0120) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2906, std.dev.: 0.0092) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.47% (1.0785 => 1.0944, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2391, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4545, std.dev.: 0.0283) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.45% (6.6874 => 0.1707, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.75% (5.2763 => 1.1739, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -75.01% (0.8651 => 0.2162, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.78% (5.3855 => 4.4817, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.09% (5.3526 => 4.4914, std.dev.: 0.0099) MultiSource/Applications/JM/ldecod/ldecod: -13.25% (10.4361 => 9.0535, std.dev.: 0.0071) SingleSource/UnitTests/Vector/constpool: -8.14% (54.1659 => 49.7550, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.52% (1.7609 => 1.6285, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.98% (1.9577 => 0.6660, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3087, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0201, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.53% (1.1492 => 0.7639, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4356, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8474, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0062, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1269, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-6: -15.89% (1.6925 => 1.4236, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4909, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.38% (19.9488 => 18.2779, std.dev.: 0.0221) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.90% (1.2373 => 1.1643, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7081, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.96% (0.8614 => 0.8187, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -4.32% (10.2830 => 9.8384, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.6994 => 3.6284, std.dev.: 0.0188) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -1.56% (3.7221 => 3.6639, std.dev.: 0.0174) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.6441 => 4.5852, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2352, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0019) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 20:49:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 22:49:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124044903.725DB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7884?compare_to=7881&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7884, Order: 173318, Start Time: 2013-01-24 03:14:53, End Time: 2013-01-24 04:49:18 To: 7881, Order: 173311, Start Time: 2013-01-24 01:17:13, End Time: 2013-01-24 02:51:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 1 (106 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.97% (0.7060 => 0.6921, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.00% (0.1500 => 0.2175, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 41.57% (0.0267 => 0.0378, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.25% (0.1132 => 0.1599, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 36.95% (0.6395 => 0.8758, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.30% (0.5805 => 0.7680, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.19% (0.0699 => 0.0924, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.00% (0.5688 => 0.7508, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.73% (0.6260 => 0.8246, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.48% (0.5849 => 0.7690, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.34% (0.6395 => 0.8399, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.12% (0.5581 => 0.7318, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.12% (0.5575 => 0.7310, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.09% (0.5567 => 0.7298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.13% (0.5941 => 0.7731, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.80% (0.5859 => 0.7605, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.22% (0.6033 => 0.7796, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.94% (0.6440 => 0.8304, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.38% (1.6474 => 2.1150, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.82% (0.6676 => 0.8533, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.43% (0.6304 => 0.8033, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.13% (0.6230 => 0.7920, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.44% (0.5802 => 0.7336, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.32% (0.6660 => 0.8413, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.85% (0.5705 => 0.7180, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.65% (0.5925 => 0.7445, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.41% (0.5857 => 0.7345, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.23% (0.5478 => 0.6860, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.15% (0.5570 => 0.6971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.98% (0.5569 => 0.6960, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.75% (0.5591 => 0.6975, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.28% (0.0622 => 0.0773, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.93% (0.5863 => 0.7266, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.57% (0.6446 => 0.7965, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.33% (0.6052 => 0.7464, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.23% (0.7524 => 0.9272, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.68% (0.6681 => 0.8196, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.54% (0.6194 => 0.7590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.17% (0.6297 => 0.7693, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.12% (2.2587 => 2.7358, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.74% (0.6667 => 0.8050, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.05% (0.7339 => 0.8737, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334) MultiSource/Applications/sgefa/sgefa: 15.07% (0.3357 => 0.3863, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.54% (1.1450 => 1.3115, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.98% (0.4916 => 0.5505, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.82% (4.5069 => 5.0396, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 11.56% (0.4515 => 0.5037, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1230 => 0.1371, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.17% (3.5339 => 3.9286, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.91% (1.6364 => 1.8150, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.54% (0.1982 => 0.2191, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.69% (0.2385 => 0.2616, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.10% (9.2283 => 10.0680, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash: 8.44% (0.4524 => 0.4906, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: 8.11% (1.2515 => 1.3530, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.73% (0.5329 => 0.5741, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.57% (0.1731 => 0.1862, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.95% (1.4642 => 1.5659, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.92% (0.7021 => 0.7507, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 6.91% (0.4861 => 0.5197, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.59% (1.2784 => 1.3626, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.44% (0.3255 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.43% (0.1879 => 0.1981, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.88% (0.3319 => 0.3481, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (5.4682 => 5.6888, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.6750 => 0.6992, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 3.10% (5.0226 => 5.1782, std.dev.: 0.0135) MultiSource/Applications/SIBsim4/SIBsim4: 2.51% (1.3864 => 1.4212, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 2.41% (0.8418 => 0.8621, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.06% (0.9557 => 0.9754, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.93% (0.7447 => 0.7591, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.76% (22.4056 => 22.7999, std.dev.: 0.0077) MultiSource/Applications/SPASS/SPASS: 1.56% (15.5079 => 15.7492, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.48% (1.3722 => 1.3925, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.13% (18.2933 => 18.4995, std.dev.: 0.0243) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.94% (31.3723 => 55.8228, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1479, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6321, std.dev.: 0.1105) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3822, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.77% (4.5320 => 4.6121, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -5.42% (0.3194 => 0.3021, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.02% (0.7198 => 0.6837, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -5.00% (2.4924 => 2.3679, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.45% (0.3821 => 0.3651, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.27% (0.3837 => 0.3673, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3812 => 0.3654, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.07% (0.3831 => 0.3675, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.97% (0.4033 => 0.3873, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3848 => 0.3696, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.94% (0.3884 => 0.3731, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3896 => 0.3743, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.81% (0.9852 => 0.9477, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.79% (0.3323 => 0.3197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.57% (0.3057 => 0.2948, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.42% (0.3016 => 0.2913, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: -3.37% (0.3059 => 0.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: -3.31% (0.3205 => 0.3099, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.15% (2.1713 => 2.1030, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C++/office/office: -3.08% (0.3252 => 0.3152, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -3.05% (1.3148 => 1.2747, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/property: -2.98% (0.4199 => 0.4074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.92% (20.7746 => 20.1688, std.dev.: 0.0181) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.9542 => 0.9278, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -2.73% (0.4280 => 0.4163, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.66% (0.6347 => 0.6178, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.59% (14.2083 => 13.8407, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.56% (0.6484 => 0.6318, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -2.52% (0.6441 => 0.6279, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7239, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/property-reference: -2.03% (0.7779 => 0.7621, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: -1.97% (16.1920 => 15.8735, std.dev.: 0.0107) MultiSource/Applications/JM/ldecod/ldecod: -1.62% (7.0961 => 6.9810, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (6.7716 => 6.6621, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.61% (1.2221 => 1.2024, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (1.2210 => 1.2022, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.51% (1.0544 => 1.0385, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -1.32% (1.5610 => 1.5404, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/football/football: -1.30% (0.9179 => 0.9060, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: -1.11% (4.3330 => 4.2850, std.dev.: 0.0107) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.76% (1.8100 => 0.6921, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -24.35% (1.3643 => 1.0321, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7524, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0817, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1992, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1330, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3528, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.89% (2.2633 => 2.1752, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (7.9763 => 7.7501, std.dev.: 0.0200) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.74% (1.3096 => 1.2737, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.60% (1.6219 => 1.5797, std.dev.: 0.0128) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6427, std.dev.: 0.0175) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1734, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4730, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6060, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7092 => 3.6629, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 21:21:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 23 Jan 2013 23:21:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124052110.3628F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7885?compare_to=7882&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7885, Order: 173318, Start Time: 2013-01-24 03:20:22, End Time: 2013-01-24 05:21:27 To: 7882, Order: 173311, Start Time: 2013-01-24 00:58:42, End Time: 2013-01-24 03:03:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (8 on baseline) Performance Improvements: 10 (62 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1052 (993 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/himenobmtxpa: 3.35% (4.1741 => 4.3140, std.dev.: 0.0265) SingleSource/Benchmarks/Shootout-C++/matrix: 1.14% (2.8793 => 2.9122, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/08-main/main: -8.71% (0.3065 => 0.2798, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.7479 => 0.7141, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: -2.22% (0.8097 => 0.7917, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.85% (0.8968 => 0.8802, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.77% (0.9649 => 0.9478, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.66% (0.9810 => 0.9647, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.62% (14.8649 => 14.6242, std.dev.: 0.0686) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.62% (1.9195 => 1.8885, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SIBsim4/SIBsim4: -1.56% (3.4707 => 3.4167, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/chomp: -1.04% (1.0216 => 1.0110, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.37% (1.1297 => 1.1255, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.34% (0.0224 => 0.0227, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0438 => 0.0438, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.76% (0.0340 => 0.0346, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.24% (0.0322 => 0.0326, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.92% (0.0435 => 0.0439, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/casts: 0.48% (0.0208 => 0.0209, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: 1.79% (0.0224 => 0.0228, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0251 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.03% (0.1462 => 0.1447, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -0.02% (1.1853 => 1.1851, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.56% (0.3957 => 0.3935, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.37% (0.1463 => 0.1443, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.51% (0.0997 => 0.0962, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 11.44% (0.0236 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.69% (0.0593 => 0.0603, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.39% (1.1501 => 1.1546, std.dev.: 0.0617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.14% (0.0608 => 0.0621, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.24% (0.0309 => 0.0319, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.38% (0.7424 => 0.7452, std.dev.: 0.0342) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 78.57% (0.0042 => 0.0075, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.00% (12.7874 => 12.7879, std.dev.: 0.0383) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 55.06% (0.0336 => 0.0521, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.25% (1.8651 => 1.8885, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320100.00% (0.0008 => 2.5616, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.57% (1.1825 => 2.3717, std.dev.: 0.1211) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 14.13% (0.2562 => 0.2924, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.53% (4.1668 => 4.3140, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/pi: 3.51% (2.1390 => 2.2140, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 2.32% (6.8159 => 6.9741, std.dev.: 0.0206) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.84% (0.0808 => 0.0478, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.81% (0.0727 => 0.0503, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.76% (0.0692 => 0.0493, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.62% (0.1684 => 0.1303, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.43% (0.1009 => 0.0813, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: -19.41% (1.8964 => 1.5283, std.dev.: 0.0923) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.21% (0.0862 => 0.0705, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.70% (0.1079 => 0.0888, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.72% (1.0960 => 0.9128, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.52% (0.7686 => 0.6570, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.08% (1.0986 => 0.9439, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.99% (0.0847 => 0.0737, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -12.78% (1.0220 => 0.8914, std.dev.: 0.0213) MultiSource/Applications/Burg/burg: -12.54% (1.5979 => 1.3976, std.dev.: 0.0611) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.63% (1.2154 => 1.0862, std.dev.: 0.0454) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.33% (0.2372 => 0.2127, std.dev.: 0.0042) MultiSource/Applications/treecc/treecc: -10.06% (2.4719 => 2.2233, std.dev.: 0.0167) MultiSource/Applications/lua/lua: -9.94% (4.6406 => 4.1795, std.dev.: 0.1460) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -9.79% (1.5131 => 1.3650, std.dev.: 0.0555) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.11% (0.1317 => 0.1197, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -8.51% (0.8653 => 0.7917, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: -7.95% (0.1610 => 0.1482, std.dev.: 0.0048) MultiSource/Applications/ClamAV/clamscan: -7.54% (17.4365 => 16.1210, std.dev.: 0.1119) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.44% (1.3924 => 1.2888, std.dev.: 0.0029) MultiSource/Applications/sqlite3/sqlite3: -7.37% (17.5634 => 16.2683, std.dev.: 0.4861) MultiSource/Applications/d/make_dparser: -6.33% (3.7840 => 3.5444, std.dev.: 0.0343) MultiSource/Applications/viterbi/viterbi: -6.14% (0.1824 => 0.1712, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -6.11% (1.3979 => 1.3125, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.77% (0.2618 => 0.2467, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.38% (1.0017 => 0.9478, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.05% (0.3462 => 0.3287, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.05% (0.9550 => 0.9068, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.76% (0.2709 => 0.2580, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: -4.70% (1.4392 => 1.3716, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.33% (0.3093 => 0.2959, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.10% (4.6579 => 4.4668, std.dev.: 0.0647) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.84% (1.3220 => 1.2712, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.64% (0.9507 => 0.9161, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.63% (0.9127 => 0.8796, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.84% (0.6135 => 0.5961, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.67% (0.9405 => 0.9154, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: -2.54% (16.4479 => 16.0295, std.dev.: 0.1412) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.54% (0.9993 => 0.9739, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.35% (14.9757 => 14.6242, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.03% (0.9488 => 0.9295, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.72% (0.9372 => 0.6493, std.dev.: 0.0935) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.74% (2.8778 => 2.3386, std.dev.: 0.1209) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.52% (0.1164 => 0.0995, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: -5.61% (0.3654 => 0.3449, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.19% (0.3201 => 0.3035, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.51% (23.3986 => 22.3430, std.dev.: 0.4077) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.27% (0.3349 => 0.3206, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.88% (1.4446 => 1.3885, std.dev.: 0.0067) MultiSource/Applications/SIBsim4/SIBsim4: -3.60% (3.5443 => 3.4167, std.dev.: 0.0135) SingleSource/Benchmarks/McGill/chomp: -3.02% (1.0425 => 1.0110, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.99% (40.4729 => 39.2627, std.dev.: 0.2846) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.76% (0.5826 => 0.5665, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/mandel-2: -2.07% (0.8521 => 0.8345, std.dev.: 0.0028) MultiSource/Applications/lua/lua: -2.03% (29.0327 => 28.4437, std.dev.: 0.1567) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.47% (3.3596 => 3.3103, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1544, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.57% (1.2047 => 1.1255, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.18% (0.0394 => 0.0346, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.61% (0.0328 => 0.0326, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.35% (0.0445 => 0.0439, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: 0.44% (0.0227 => 0.0228, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.42% (0.1530 => 0.1447, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: -38.57% (1.9293 => 1.1851, std.dev.: 0.0383) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.82% (0.4049 => 0.3935, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.1510 => 0.1443, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.64% (0.0978 => 0.0962, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.20% (0.0590 => 0.0603, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.61% (1.1617 => 1.1546, std.dev.: 0.0617) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.80% (0.0610 => 0.0621, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.20% (0.7437 => 0.7452, std.dev.: 0.0342) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.48% (0.0092 => 0.0075, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.08% (12.7781 => 12.7879, std.dev.: 0.0383) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 22:46:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 00:46:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124064658.0ABF22A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7886?compare_to=7884&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7886, Order: 173321, Start Time: 2013-01-24 05:12:46, End Time: 2013-01-24 06:47:12 To: 7884, Order: 173318, Start Time: 2013-01-24 03:14:53, End Time: 2013-01-24 04:49:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (111 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.79% (3.7449 => 3.8494, std.dev.: 0.0297) SingleSource/Benchmarks/Dhrystone/fldry: 1.94% (0.6921 => 0.7055, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.45% (1.5797 => 1.6026, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.97% (0.0974 => 0.1636, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.29% (0.6395 => 0.8780, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.47% (0.0699 => 0.0926, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.33% (0.5688 => 0.7527, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.25% (0.5805 => 0.7677, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.07% (0.5456 => 0.7206, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.01% (0.6260 => 0.8264, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.76% (0.5567 => 0.7335, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.75% (0.5849 => 0.7706, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.67% (0.6395 => 0.8420, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.34% (0.5575 => 0.7322, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.30% (0.5581 => 0.7328, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.50% (0.5941 => 0.7753, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.65% (0.6033 => 0.7822, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.10% (0.6440 => 0.8314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.31% (1.6474 => 2.1137, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.16% (0.6676 => 0.8556, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.53% (0.6230 => 0.7945, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.58% (0.5802 => 0.7344, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.53% (0.6660 => 0.8427, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.99% (0.5705 => 0.7188, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.96% (0.5925 => 0.7463, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.80% (0.5857 => 0.7368, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.63% (0.5478 => 0.6882, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.61% (0.5569 => 0.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.31% (0.5570 => 0.6980, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.79% (0.5591 => 0.6977, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.08% (0.5863 => 0.7275, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.86% (0.6446 => 0.7984, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.82% (0.7524 => 0.9316, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.69% (0.6052 => 0.7486, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.14% (0.6681 => 0.8227, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.73% (0.6194 => 0.7602, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.47% (0.6297 => 0.7712, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.41% (2.2587 => 2.7422, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.98% (0.6667 => 0.8066, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.61% (0.7339 => 0.8778, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 15.87% (0.0731 => 0.0847, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.01% (0.3357 => 0.3861, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.57% (1.1450 => 1.3118, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.91% (0.4515 => 0.5098, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.15% (4.5069 => 5.0546, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.00% (0.4916 => 0.5506, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.37% (1.6364 => 1.8224, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.31% (3.5339 => 3.9336, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.60% (0.1982 => 0.2192, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.48% (9.2283 => 10.1029, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.19% (0.1731 => 0.1890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4524 => 0.4905, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.22% (0.5329 => 0.5767, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 8.15% (1.2515 => 1.3535, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.7021 => 0.7554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.43% (0.4861 => 0.5222, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.03% (1.4642 => 1.5672, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 6.92% (0.1879 => 0.2009, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (1.2784 => 1.3655, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.3255 => 0.3451, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.79% (0.1761 => 0.1863, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.54% (5.4682 => 5.7166, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/bigfib: 4.16% (0.6750 => 0.7031, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.22% (0.3446 => 0.3557, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.05% (5.0226 => 5.1757, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.03% (0.3394 => 0.3497, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4264, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.79% (0.8418 => 0.8653, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.34% (0.9557 => 0.9781, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 2.20% (0.7447 => 0.7611, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (22.4056 => 22.8673, std.dev.: 0.0081) MultiSource/Applications/SPASS/SPASS: 1.73% (15.5079 => 15.7759, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.60% (1.3722 => 1.3941, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8095, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.08% (0.9531 => 1.0301, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.79% (54.5751 => 56.6410, std.dev.: 0.1230) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 2.83% (3.7435 => 3.8494, std.dev.: 0.0297) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.0478 => 2.1003, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3807, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6115, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2693, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6551 => 3.6933, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.86% (0.7198 => 0.6848, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -4.05% (2.4924 => 2.3915, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -4.01% (0.3812 => 0.3659, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.91% (0.3142 => 0.3019, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.89% (0.9852 => 0.9469, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.84% (0.3831 => 0.3684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.82% (0.3848 => 0.3701, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.79% (0.3880 => 0.3733, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.75% (0.3891 => 0.3745, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/synchronized: -3.67% (0.3896 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.4033 => 0.3886, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.54% (0.3837 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.54% (0.4176 => 0.4028, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.30% (0.3884 => 0.3756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.10% (0.4199 => 0.4069, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.96% (0.6347 => 0.6159, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.84% (1.3148 => 1.2775, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4280 => 0.4160, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.78% (0.6484 => 0.6304, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.77% (0.9542 => 0.9278, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.69% (0.6441 => 0.6268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.61% (2.1713 => 2.1146, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2412, std.dev.: 0.0320) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8907, std.dev.: 0.0188) MultiSource/Applications/sqlite3/sqlite3: -2.07% (17.1032 => 16.7495, std.dev.: 0.0133) SingleSource/UnitTests/ObjC++/property-reference: -1.92% (0.7779 => 0.7630, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.73% (0.7919 => 0.7782, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -1.65% (4.3330 => 4.2615, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.56% (1.0544 => 1.0379, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.49% (16.1920 => 15.9504, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.45% (6.7716 => 6.6733, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -1.40% (0.7982 => 0.7870, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.39% (1.2210 => 1.2040, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -1.30% (7.0961 => 7.0038, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.26% (1.2221 => 1.2067, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: -1.15% (0.9179 => 0.9073, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.02% (1.8100 => 0.7055, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3141, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.19% (1.3643 => 1.0207, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0771, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1974, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1272, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3568, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.29% (0.5142 => 0.4613, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1735, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3983, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.66% (1.3096 => 1.2747, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.60% (7.9763 => 7.7692, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.80% (3.7241 => 3.6569, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.71% (6.5735 => 6.4611, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: -1.66% (7.3040 => 7.1831, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0065) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6105, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.19% (1.6219 => 1.6026, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5900, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 22:48:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 00:48:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130124064819.986D42A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7887?compare_to=7880&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7887, Order: 173318, Start Time: 2013-01-24 03:14:24, End Time: 2013-01-24 06:48:34 To: 7880, Order: 173297, Start Time: 2013-01-23 22:49:12, End Time: 2013-01-24 02:23:10 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 7 (182 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (755 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.07% (12.8564 => 12.9934, std.dev.: 0.0171) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (2.4480 => 2.4735, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 1.01% (1.9763 => 1.9962, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.85% (100.5527 => 118.5034, std.dev.: 0.0474) SingleSource/Benchmarks/Shootout-C++/ary: 6.07% (0.2157 => 0.2288, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.02% (124.5751 => 127.0879, std.dev.: 0.4574) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.82% (14.6202 => 14.8868, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.04% (0.0625 => 0.0894, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.58% (0.1063 => 0.1420, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.60% (0.2969 => 0.3818, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.61% (0.0547 => 0.0698, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.16% (0.4139 => 0.5263, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.09% (0.4253 => 0.5405, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.03% (0.1106 => 0.1405, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.46% (0.5900 => 0.7461, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.33% (0.0714 => 0.0902, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.25% (0.4994 => 0.6305, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.68% (0.0584 => 0.0734, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.30% (1.5932 => 1.9962, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 24.71% (0.0599 => 0.0747, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.68% (0.5000 => 0.6234, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.95% (0.1549 => 0.1920, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.90% (0.1021 => 0.1265, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 23.00% (0.0948 => 0.1166, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.73% (0.1003 => 0.1231, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 22.58% (0.1107 => 0.1357, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.48% (0.1103 => 0.1351, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.39% (0.3903 => 0.4777, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.19% (0.1604 => 0.1960, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.90% (0.0822 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 21.87% (0.1619 => 0.1973, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.81% (0.0541 => 0.0659, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 21.80% (0.0821 => 0.1000, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 20.91% (0.0947 => 0.1145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.87% (0.2736 => 0.3307, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.84% (1.3152 => 1.5893, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.59% (0.1088 => 0.1312, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.52% (0.2866 => 0.3454, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.40% (0.4029 => 0.4851, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.38% (0.1462 => 0.1760, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 20.36% (0.1218 => 0.1466, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 20.13% (0.1505 => 0.1808, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.13% (0.3890 => 0.4673, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 20.06% (0.0698 => 0.0838, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.96% (0.2014 => 0.2416, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 19.71% (0.5546 => 0.6639, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.69% (0.3271 => 0.3915, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.50% (0.0605 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 19.26% (1.8794 => 2.2413, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.67% (0.0573 => 0.0680, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.54% (0.5026 => 0.5958, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.23% (1.6211 => 1.9167, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.23% (0.4658 => 0.5507, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.16% (3.5627 => 4.2096, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: 18.15% (0.1284 => 0.1517, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.12% (1.9694 => 2.3263, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 17.87% (0.5826 => 0.6867, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.84% (0.1160 => 0.1367, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.67% (0.2875 => 0.3383, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.66% (0.4361 => 0.5131, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 17.61% (0.2823 => 0.3320, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 17.51% (0.5889 => 0.6920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.49% (0.2813 => 0.3305, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.47% (4.4195 => 5.1917, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: 17.21% (0.9697 => 1.1366, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/strcat: 17.16% (0.2750 => 0.3222, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 17.15% (0.2811 => 0.3293, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.12% (0.3930 => 0.4603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (0.2725 => 0.3191, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.08% (0.7171 => 0.8396, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 17.02% (0.2714 => 0.3176, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.02% (1.0781 => 1.2616, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.02% (0.2738 => 0.3204, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.01% (0.2792 => 0.3267, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.00% (0.2911 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 16.95% (0.2803 => 0.3278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 16.87% (0.2780 => 0.3249, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.76% (2.0673 => 2.4138, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.75% (0.2729 => 0.3186, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.68% (0.2566 => 0.2994, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 16.58% (0.3004 => 0.3502, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 16.57% (0.9909 => 1.1551, std.dev.: 0.0140) MultiSource/Benchmarks/Bullet/bullet: 16.50% (23.5202 => 27.4021, std.dev.: 0.0222) MultiSource/Applications/ClamAV/clamscan: 16.48% (4.2109 => 4.9049, std.dev.: 0.0320) SingleSource/Benchmarks/Shootout-C++/ary3: 16.44% (0.3267 => 0.3804, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.38% (1.9966 => 2.3236, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.33% (2.7292 => 3.1749, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/wc: 16.31% (0.3096 => 0.3601, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.24% (0.3060 => 0.3557, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary: 16.18% (0.3258 => 0.3785, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 16.01% (0.3317 => 0.3848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 15.97% (0.3726 => 0.4321, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.88% (0.3124 => 0.3620, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.79% (0.3362 => 0.3893, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.79% (1.4269 => 1.6522, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists: 15.74% (0.3348 => 0.3875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.65% (0.3477 => 0.4021, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.63% (0.3282 => 0.3795, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.59% (0.3625 => 0.4190, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.58% (0.3678 => 0.4251, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.50% (0.1090 => 0.1259, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 15.36% (0.4251 => 0.4904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.34% (0.4146 => 0.4782, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.27% (0.3981 => 0.4589, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.20% (0.3690 => 0.4251, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.95% (0.3845 => 0.4420, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 14.95% (0.7875 => 0.9052, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.59% (0.1028 => 0.1178, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 14.57% (0.5012 => 0.5742, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 14.23% (2.1653 => 2.4735, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/football/football: 14.12% (0.2075 => 0.2368, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 13.92% (5.5417 => 6.3133, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/exceptions-2: 13.84% (0.3446 => 0.3923, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.78% (0.6435 => 0.7322, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 13.77% (0.3465 => 0.3942, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 13.73% (0.3488 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 13.70% (0.3460 => 0.3934, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/synchronized: 13.69% (0.3469 => 0.3944, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 13.68% (0.2691 => 0.3059, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/for-in: 13.67% (0.3496 => 0.3974, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 13.65% (0.3442 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 13.51% (0.3650 => 0.4143, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.37% (0.3724 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.37% (0.3643 => 0.4130, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 13.29% (4.6177 => 5.2316, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.23% (0.1383 => 0.1566, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.23% (0.2737 => 0.3099, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 13.11% (2.1013 => 2.3767, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.86% (0.2068 => 0.2334, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.78% (0.5361 => 0.6046, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 12.46% (0.3498 => 0.3934, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.26% (0.3084 => 0.3462, std.dev.: 0.0043) MultiSource/Applications/siod/siod: 12.26% (0.6634 => 0.7447, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 11.99% (0.3336 => 0.3736, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.98% (0.2103 => 0.2355, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 11.72% (0.4847 => 0.5415, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.63% (11.6398 => 12.9934, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.22% (0.7426 => 0.8259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.63% (4.6926 => 5.1914, std.dev.: 0.0146) MultiSource/Applications/lemon/lemon: 10.41% (0.2391 => 0.2640, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.15% (0.5584 => 0.6151, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.87% (2.0346 => 2.2355, std.dev.: 0.0021) MultiSource/Applications/kimwitu++/kc: 8.29% (11.9555 => 12.9467, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.51% (0.3792 => 0.3963, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5163, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0301) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 7.82% (0.2122 => 0.2288, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.63% (0.3693 => 0.3938, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6108, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2386, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6699, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6855, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/flops-2: 4.53% (1.8057 => 1.8875, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1911, std.dev.: 0.0567) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.49% (7.1849 => 7.2920, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.26% (1.0142 => 1.0270, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0817, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.12% (10.3705 => 10.4866, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.09% (3.1722 => 3.2069, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5844, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5762, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.01% (17.2379 => 14.3056, std.dev.: 0.0827) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1019, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -8.20% (0.2402 => 0.2205, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9747, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8011, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -7.23% (2.1113 => 1.9587, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2277, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -3.72% (3.3665 => 3.2414, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8019, std.dev.: 0.0119) SingleSource/Benchmarks/Dhrystone/dry: -3.40% (14.0481 => 13.5704, std.dev.: 0.1067) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0044) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1865, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1553, std.dev.: 0.0398) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0026) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.62s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 23:06:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 01:06:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124070658.AA2952A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7888?compare_to=7883&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7888, Order: 173319, Start Time: 2013-01-24 04:55:57, End Time: 2013-01-24 07:07:13 To: 7883, Order: 173314, Start Time: 2013-01-24 02:14:10, End Time: 2013-01-24 04:25:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (225 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (645 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0654 => 0.0651, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8440 => 499.8480, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.55% (1.1277 => 499.8480, std.dev.: 0.0062) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.62% (0.5229 => 1.6504, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 21.51% (14.9895 => 18.2140, std.dev.: 0.0063) MultiSource/Applications/kimwitu++/kc: 45.19% (14.1553 => 20.5524, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/gs/gs: 18.81% (4.1105 => 4.8838, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.43% (1.1048 => 1.7393, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.59% (7.1582 => 37.6230, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.86% (3.4629 => 6.4707, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.15% (0.6222 => 1.0960, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10276.53% (0.0720 => 7.4711, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11151600.00% (0.0001 => 11.1517, std.dev.: 0.0041) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848900.00% (0.0001 => 9.8490, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489000.00% (0.0001 => 5.4891, std.dev.: 0.0168) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.24% (1.1194 => 10.2564, std.dev.: 0.0099) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 148.62% (22.1758 => 55.1336, std.dev.: 0.0426) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.52% (0.0929 => 0.1835, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.98% (0.1463 => 0.2516, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205) SingleSource/Benchmarks/Stanford/IntMM: 61.42% (0.0394 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.38% (2.9384 => 4.6245, std.dev.: 0.0092) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.67% (7.0540 => 10.8402, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.29% (1.5859 => 2.4152, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 49.34% (0.1056 => 0.1577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.07% (8.1363 => 11.9657, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.70% (2.2024 => 3.1428, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/flops: 40.01% (0.1432 => 0.2005, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 39.82% (0.3109 => 0.4347, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.64% (0.0439 => 0.0613, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.52% (21.9371 => 30.6067, std.dev.: 0.0003) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.94% (4.2646 => 5.7121, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/exptree: 33.29% (0.0814 => 0.1085, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.26% (0.4615 => 0.6150, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.88% (1.5415 => 2.0484, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.13% (0.2271 => 0.2978, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.27% (0.1143 => 0.1489, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.24% (1.1642 => 1.5162, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 29.98% (0.4299 => 0.5588, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.32% (0.0730 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.72% (0.5105 => 0.6571, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 28.30% (0.0636 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.88% (0.6675 => 0.8536, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.74% (0.0793 => 0.1013, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.40% (0.1584 => 0.2018, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.90% (0.1892 => 0.2401, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 26.59% (0.2554 => 0.3233, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 26.53% (9.4845 => 12.0004, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.27% (3.8922 => 4.9148, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 26.22% (0.1655 => 0.2089, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 25.02% (1.0722 => 1.3405, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.90% (0.1566 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.80% (0.3121 => 0.3895, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 24.78% (0.4289 => 0.5352, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.63% (1.4186 => 1.7680, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.48% (0.1695 => 0.2110, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 24.05% (0.4620 => 0.5731, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.51% (0.0672 => 0.0830, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 23.09% (0.7115 => 0.8758, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 22.81% (0.0662 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 22.77% (0.0527 => 0.0647, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.57% (0.1236 => 0.1515, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 22.51% (0.1555 => 0.1905, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.37% (0.2700 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.07% (0.0675 => 0.0824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.79% (0.7835 => 0.9542, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.37% (0.1151 => 0.1397, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.35% (0.0871 => 0.1057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.26% (0.0842 => 0.1021, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.22% (0.1032 => 0.1251, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 21.21% (0.6456 => 0.7825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.15% (1.3050 => 1.5810, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 21.05% (5.7591 => 6.9714, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/em3d/em3d: 20.88% (0.1695 => 0.2049, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.78% (0.0953 => 0.1151, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.41% (0.1940 => 0.2336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.39% (0.5860 => 0.7055, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.97% (4.9449 => 5.9325, std.dev.: 0.0071) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.80% (0.8172 => 0.9790, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.40% (0.5020 => 0.5994, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 19.29% (3.3354 => 3.9788, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.26% (0.3307 => 0.3944, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.25% (0.1044 => 0.1245, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 19.23% (0.7433 => 0.8862, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.17% (5.0018 => 5.9605, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.78% (0.2758 => 0.3276, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.54% (0.1510 => 0.1790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.44% (0.9765 => 1.1566, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.39% (0.5569 => 0.6593, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 18.34% (0.0567 => 0.0671, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 18.26% (1.1840 => 1.4002, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 18.26% (2.0273 => 2.3974, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 18.24% (0.0592 => 0.0700, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 18.14% (3.8723 => 4.5749, std.dev.: 0.0119) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.05% (0.0770 => 0.0909, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.04% (0.2107 => 0.2487, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.85% (1.1861 => 1.3978, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: 17.82% (0.3423 => 0.4033, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 17.76% (2.2969 => 2.7049, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.68% (0.2065 => 0.2430, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.47% (0.0933 => 0.1096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.34% (0.5981 => 0.7018, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.12% (0.3441 => 0.4030, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.70% (0.8101 => 0.9454, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.64% (0.6450 => 0.7523, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 16.26% (0.3180 => 0.3697, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.25% (0.2049 => 0.2382, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.66% (0.8921 => 1.0318, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 15.56% (0.1144 => 0.1322, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.42% (0.0759 => 0.0876, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.20% (0.8067 => 0.9293, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.56% (0.2603 => 0.2982, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.47% (0.3379 => 0.3868, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3865 => 0.4412, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.06% (0.4103 => 0.4680, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.93% (0.4636 => 0.5282, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 13.49% (0.3387 => 0.3844, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.89% (1.5603 => 1.7615, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.85% (0.4203 => 0.4743, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 12.48% (0.4048 => 0.4553, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 12.35% (0.3603 => 0.4048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.22% (0.3422 => 0.3840, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 12.00% (17.1811 => 19.2436, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.98% (0.2430 => 0.2721, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.97% (0.3826 => 0.4284, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 11.92% (0.3684 => 0.4123, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1268 => 0.1414, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.49% (0.1114 => 0.1242, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 11.48% (0.3886 => 0.4332, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.23% (0.3427 => 0.3812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.96% (14.3668 => 15.9421, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions: 10.79% (0.3828 => 0.4241, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 10.10% (0.2831 => 0.3117, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.00% (0.3561 => 0.3917, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.71% (0.3162 => 0.3469, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.60% (0.1625 => 0.1781, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (2.0665 => 2.2635, std.dev.: 0.0076) MultiSource/Applications/hexxagon/hexxagon: 9.50% (1.2842 => 1.4062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.37% (0.2871 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.28% (0.2877 => 0.3144, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.96% (0.3650 => 0.3977, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.92% (0.6030 => 0.6568, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2905 => 0.3164, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.90% (0.3136 => 0.3415, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.64% (10.3673 => 11.2627, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (0.3935 => 0.4271, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.53% (0.2756 => 0.2991, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 8.52% (63.2438 => 68.6331, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/wc: 8.52% (0.3052 => 0.3312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.37% (0.2725 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.27% (0.7326 => 0.7932, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.23% (0.2793 => 0.3023, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.18% (0.2714 => 0.2936, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.44% (2.2022 => 2.3660, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.50% (0.2266 => 0.2368, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 3.93% (0.3131 => 0.3254, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.68% (7.9617 => 8.1754, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4711, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4271, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.51% (4.2280 => 4.4608, std.dev.: 0.0084) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.79% (3.1578 => 3.3090, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.45% (0.9957 => 1.0301, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.32% (8.6802 => 8.8820, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.02% (3.6395 => 3.7131, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 1.95% (9.1159 => 9.2933, std.dev.: 0.0134) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2197, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: 1.84% (2.2771 => 2.3190, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2391, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.20% (10.3460 => 10.4700, std.dev.: 0.0228) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5795, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1696, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.70% (5.2763 => 1.1768, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.31% (0.8651 => 0.2136, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.24% (5.3855 => 4.4570, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.66% (5.3526 => 4.4609, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -13.26% (10.4361 => 9.0518, std.dev.: 0.0058) SingleSource/UnitTests/Vector/constpool: -8.02% (54.1659 => 49.8197, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.71% (1.7609 => 1.6252, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.05% (1.9577 => 0.6647, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -33.54% (1.5373 => 1.0217, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4373, std.dev.: 0.0049) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8543, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.78% (2.5528 => 2.1245, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7332, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4907, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2666, std.dev.: 0.0199) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.40% (1.2373 => 1.1581, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.29% (0.2497 => 0.2340, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7080, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5054, std.dev.: 0.0054) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.58% (10.2830 => 9.8119, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0026) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.57% (3.6994 => 3.6414, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.3135 => 2.2782, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.25% (4.6441 => 4.5860, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2286, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0019) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 23 23:43:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 01:43:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124074306.40C3C2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7889?compare_to=7885&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7889, Order: 173321, Start Time: 2013-01-24 05:40:33, End Time: 2013-01-24 07:43:23 To: 7885, Order: 173318, Start Time: 2013-01-24 03:20:22, End Time: 2013-01-24 05:21:27 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (8 on baseline) Performance Improvements: 1 (30 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1053 (1025 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.88% (0.2127 => 0.2252, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.35% (0.2244 => 0.2364, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.37% (1.3650 => 1.3837, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.69% (1.4590 => 1.8776, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 5.13% (4.7233 => 4.9655, std.dev.: 0.0161) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.90% (1.2456 => 1.3066, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 2.82% (0.5823 => 0.5987, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.23% (2.7292 => 2.7900, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 1.76% (1.3901 => 1.4145, std.dev.: 0.0073) MultiSource/Benchmarks/mafft/pairlocalalign: 1.75% (61.4865 => 62.5646, std.dev.: 0.2807) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/lists: -1.27% (16.8504 => 16.6362, std.dev.: 0.0720) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.34% (1.1255 => 1.1744, std.dev.: 0.0350) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.64% (0.0227 => 0.0221, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0438 => 0.0440, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.02% (0.0346 => 0.0339, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.23% (0.0326 => 0.0322, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.28% (0.0439 => 0.0429, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/casts: -1.91% (0.0209 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -3.51% (0.0228 => 0.0220, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.80% (0.0251 => 0.0249, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.21% (0.1447 => 0.1479, std.dev.: 0.0276) MultiSource/Applications/lemon/lemon: -0.11% (1.1851 => 1.1838, std.dev.: 0.3967) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.79% (0.3935 => 0.4163, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.47% (0.1443 => 0.1493, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.35% (0.0962 => 0.0949, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.70% (0.0263 => 0.0278, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.66% (0.0603 => 0.0607, std.dev.: 0.0149) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.32% (1.1546 => 1.1509, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -36.67% (0.0030 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.09% (0.0621 => 0.0608, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.97% (0.0319 => 0.0284, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7452 => 0.7451, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.33% (0.0075 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.20% (12.7879 => 12.7626, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 50.30% (0.0336 => 0.0505, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320000.00% (0.0008 => 2.5608, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 97.16% (1.1825 => 2.3314, std.dev.: 0.0462) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.94% (0.2562 => 0.2868, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.85% (7.0016 => 7.3410, std.dev.: 0.1220) SingleSource/Benchmarks/Misc/pi: 3.66% (2.1390 => 2.2173, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.76% (4.1668 => 4.2820, std.dev.: 0.0444) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.71% (2.7432 => 2.7900, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.34% (0.0808 => 0.0474, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.87% (0.1684 => 0.1282, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.10% (0.0862 => 0.0706, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -16.22% (0.0783 => 0.0656, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.57% (0.1079 => 0.0911, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.02% (1.0986 => 0.9446, std.dev.: 0.0582) MultiSource/Benchmarks/SciMark2-C/scimark2: -11.95% (0.4074 => 0.3587, std.dev.: 0.0157) MultiSource/Applications/aha/aha: -11.54% (0.1378 => 0.1219, std.dev.: 0.0052) MultiSource/Applications/spiff/spiff: -11.22% (1.0220 => 0.9073, std.dev.: 0.0262) MultiSource/Applications/Burg/burg: -11.01% (1.5979 => 1.4220, std.dev.: 0.0637) MultiSource/Applications/treecc/treecc: -9.81% (2.4719 => 2.2293, std.dev.: 0.0776) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.55% (1.5131 => 1.3837, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.13% (0.2481 => 0.2304, std.dev.: 0.0066) MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.66% (1.1731 => 1.0950, std.dev.: 0.0236) MultiSource/Applications/siod/siod: -5.89% (2.6437 => 2.4879, std.dev.: 0.0459) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.66% (1.3310 => 1.2557, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/fibo: -5.48% (0.2006 => 0.1896, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.06% (0.2372 => 0.2252, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.06% (0.1164 => 0.1012, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: -10.01% (4.5259 => 4.0729, std.dev.: 0.1461) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.51% (1.4588 => 1.3201, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/nestedloop: -9.18% (0.2200 => 0.1998, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.92% (23.3986 => 21.5463, std.dev.: 0.5168) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.46% (0.3217 => 0.2977, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.56% (0.3201 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -3.38% (17.2182 => 16.6362, std.dev.: 0.0720) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.23% (1.4446 => 1.3980, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.55% (3.1921 => 3.1426, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (0.8521 => 0.8402, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.52% (1.2047 => 1.1744, std.dev.: 0.0350) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.44% (0.0451 => 0.0440, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0046) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.35% (0.0255 => 0.0249, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.33% (0.1530 => 0.1479, std.dev.: 0.0276) MultiSource/Applications/lemon/lemon: -38.64% (1.9293 => 1.1838, std.dev.: 0.3967) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.82% (0.4049 => 0.4163, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.13% (0.1510 => 0.1493, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.97% (0.0978 => 0.0949, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.88% (0.0590 => 0.0607, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.93% (1.1617 => 1.1509, std.dev.: 0.0083) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.63% (0.0032 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (0.0268 => 0.0284, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (0.7437 => 0.7451, std.dev.: 0.0037) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.35% (0.0092 => 0.0088, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7626, std.dev.: 0.0054) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 00:48:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 02:48:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124084837.B33662A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7890?compare_to=7886&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7890, Order: 173325, Start Time: 2013-01-24 07:10:34, End Time: 2013-01-24 08:48:51 To: 7886, Order: 173321, Start Time: 2013-01-24 05:12:46, End Time: 2013-01-24 06:47:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (105 on baseline) Performance Improvements: 0 (84 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (903 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707) SingleSource/Benchmarks/Misc/lowercase: 85.71% (0.0280 => 0.0520, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.12% (0.0514 => 0.0895, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.17% (0.0974 => 0.1638) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.87% (0.1132 => 0.1606, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.54% (0.6395 => 0.8796, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.52% (0.5805 => 0.7693, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.28% (0.5688 => 0.7524, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.19% (0.0699 => 0.0924, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.16% (0.6260 => 0.8273, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.91% (0.5456 => 0.7197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.82% (0.6395 => 0.8430, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.76% (0.5567 => 0.7335, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.66% (0.5849 => 0.7701, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.46% (0.5575 => 0.7329, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.48% (0.5941 => 0.7752, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.92% (0.5859 => 0.7612, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.54% (0.6033 => 0.7815, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.11% (0.6440 => 0.8315, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.55% (0.6189 => 0.7956, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.34% (1.6474 => 2.1142, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.13% (0.6676 => 0.8554, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.82% (0.6304 => 0.8058, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.35% (0.6230 => 0.7934, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.61% (0.5802 => 0.7346, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.44% (0.6660 => 0.8421, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.19% (0.5705 => 0.7199, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.91% (0.5925 => 0.7460, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (0.5857 => 0.7372, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.67% (0.5570 => 0.7000, std.dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.54% (0.5478 => 0.6877, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.48% (0.5569 => 0.6988, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.93% (0.5591 => 0.6985, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.10% (0.5863 => 0.7276, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.78% (0.6446 => 0.7979, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.75% (0.7524 => 0.9311, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.65% (0.6052 => 0.7483, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.08% (0.6681 => 0.8223, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.93% (0.6194 => 0.7614, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.49% (0.6297 => 0.7713, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.47% (2.2587 => 2.7436, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.31% (0.6667 => 0.8088, std.dev.: 0.0197) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.78% (0.7339 => 0.8791, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 15.56% (0.0707 => 0.0817, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.01% (0.3357 => 0.3861, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 14.79% (1.1450 => 1.3143, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 13.54% (0.0864 => 0.0981, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 12.49% (0.4515 => 0.5079, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.47% (0.4916 => 0.5529, std.dev.: 0.0157) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.22% (4.5069 => 5.0577, std.dev.: 0.0945) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.27% (1.6364 => 1.8209, std.dev.: 0.0509) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.21% (3.5339 => 3.9301, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0087) MultiSource/Benchmarks/mafft/pairlocalalign: 9.45% (9.2283 => 10.1001, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.07% (0.1731 => 0.1888, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.53% (0.4524 => 0.4910, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 8.47% (1.2515 => 1.3575, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4861 => 0.5220, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.35% (0.7021 => 0.7537, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.19% (1.4642 => 1.5695, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.96% (1.2784 => 1.3674, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.08% (0.3255 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.79% (0.1761 => 0.1863, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.55% (5.4682 => 5.7168, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 3.97% (0.6750 => 0.7018, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3.26% (1.3864 => 1.4316, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.23% (5.0226 => 5.1848, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/ary3: 3.13% (0.3446 => 0.3554, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.04% (0.8418 => 0.8674, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 2.98% (0.3394 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.36% (0.9557 => 0.9783, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (22.4056 => 22.8722, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5168 => 0.5273, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 1.89% (15.5079 => 15.8004, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8211, std.dev.: 0.0355) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.97% (0.9531 => 1.0291, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0061) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.56% (54.5751 => 56.5163, std.dev.: 0.1291) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (27.8210 => 28.3846, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.82% (4.5320 => 4.6146, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2709, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.03% (0.7198 => 0.6836, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -4.27% (2.4924 => 2.3859, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.09% (0.3812 => 0.3656, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.02% (0.3831 => 0.3677, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.92% (0.3848 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.88% (0.3891 => 0.3740, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3896 => 0.3746, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.79% (0.4033 => 0.3880, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.75% (0.3837 => 0.3693, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.69% (0.4176 => 0.4022, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.63% (0.3884 => 0.3743, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.22% (0.4199 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4280 => 0.4156) SingleSource/UnitTests/ObjC++/Hello: -2.87% (0.6347 => 0.6165, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.67% (0.6441 => 0.6269, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2420, std.dev.: 0.0109) MultiSource/Applications/hexxagon/hexxagon: -2.56% (1.3148 => 1.2812, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.45% (2.1713 => 2.1182, std.dev.: 0.0188) SingleSource/UnitTests/ObjC++/property-reference: -2.19% (0.7779 => 0.7609, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -2.04% (17.1032 => 16.7540, std.dev.: 0.0130) MultiSource/Applications/JM/lencod/lencod: -1.37% (16.1920 => 15.9705, std.dev.: 0.0164) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0137, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6924, std.dev.: 0.0120) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.29% (4.3504 => 3.2501, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/mandel-2: -24.45% (1.3643 => 1.0307, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7518, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0795, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3454 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1967, std.dev.: 0.0192) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0019) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1300, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0169) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.06% (4.1534 => 3.8186, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7627, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.73% (1.3096 => 1.2870, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4656, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.56% (7.3040 => 7.1901, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.39% (1.6307 => 1.6080, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6020, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 01:49:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 03:49:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124094945.C66562A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7891?compare_to=7888&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7891, Order: 173325, Start Time: 2013-01-24 07:37:53, End Time: 2013-01-24 09:50:00 To: 7888, Order: 173319, Start Time: 2013-01-24 04:55:57, End Time: 2013-01-24 07:07:13 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (216 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -3.34% (11.2627 => 10.8862, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.11% (10.8402 => 10.7197, std.dev.: 0.0193) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/power/power: -1.72% (499.8480 => 491.2518, std.dev.: 4.0559) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 43462.28% (1.1277 => 491.2518, std.dev.: 4.0559) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.71% (0.5229 => 1.6456, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 20.48% (14.9895 => 18.0588, std.dev.: 0.0354) MultiSource/Applications/kimwitu++/kc: 44.30% (14.1553 => 20.4268, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 18.21% (4.1105 => 4.8589, std.dev.: 0.0234) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.68% (1.1048 => 1.7310, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.25% (7.1582 => 37.3840, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.52% (3.4629 => 6.4244, std.dev.: 0.0577) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.31% (0.6222 => 1.0908, std.dev.: 0.0096) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10283.19% (0.0720 => 7.4759, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 3835800.00% (0.0001 => 3.8359) MultiSource/Applications/SPASS/SPASS: 11165600.00% (0.0001 => 11.1657, std.dev.: 0.0170) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483300.00% (0.0001 => 5.4834, std.dev.: 0.1088) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 810.43% (1.1194 => 10.1914, std.dev.: 0.0032) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.88% (22.1758 => 54.9689, std.dev.: 0.0665) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.45% (0.0929 => 0.1825, std.dev.: 0.0022) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.57% (0.1463 => 0.2510, std.dev.: 0.0015) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.51% (2.9384 => 4.6282, std.dev.: 0.0202) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.97% (7.0540 => 10.7197, std.dev.: 0.0193) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.48% (1.5859 => 2.4023, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/distray/distray: 48.58% (0.1056 => 0.1569, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.76% (8.1363 => 11.9408, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.83% (2.2024 => 3.1236, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 39.53% (0.3109 => 0.4338, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 38.49% (21.9371 => 30.3802, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0010) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.29% (4.2646 => 5.6841, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.76% (0.4615 => 0.6127, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.07% (1.5415 => 2.0359, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 29.70% (1.1642 => 1.5100, std.dev.: 0.0082) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.54% (0.5105 => 0.6511, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.40% (0.0730 => 0.0930, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.30% (0.1143 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0793 => 0.1009, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.86% (0.6675 => 0.8468, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.77% (0.1584 => 0.2008, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.74% (0.1892 => 0.2398, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.67% (0.1125 => 0.1425, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 26.07% (9.4845 => 11.9572, std.dev.: 0.0153) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.69% (3.8922 => 4.8922, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 25.14% (0.1655 => 0.2071, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.97% (0.1566 => 0.1957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash: 24.81% (0.4289 => 0.5353, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.35% (0.3121 => 0.3881, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.31% (0.1337 => 0.1662, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 24.18% (1.0722 => 1.3315, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.07% (1.4186 => 1.7601, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 23.59% (0.4620 => 0.5710, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.19% (0.1695 => 0.2088, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 22.42% (0.1151 => 0.1409, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 22.29% (0.7115 => 0.8701, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.00% (0.2700 => 0.3294, std.dev.: 0.0101) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 21.17% (0.3098 => 0.3754, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.05% (0.7835 => 0.9484, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/em3d/em3d: 20.88% (0.1695 => 0.2049, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.80% (1.3050 => 1.5764, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 20.69% (0.6456 => 0.7792, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 20.41% (5.7591 => 6.9343, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.25% (0.8172 => 0.9827, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.20% (0.5860 => 0.7044, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.47% (4.9449 => 5.9076, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.32% (0.2065 => 0.2464, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.75% (5.0018 => 5.9398, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.71% (0.5020 => 0.5959, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.63% (0.3307 => 0.3923, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 18.42% (3.3354 => 3.9497, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.35% (0.2758 => 0.3264, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 18.22% (0.7433 => 0.8787, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.12% (0.9765 => 1.1534, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.10% (0.5569 => 0.6577, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 18.00% (0.3423 => 0.4039, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.71% (1.1861 => 1.3961, std.dev.: 0.0342) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0048) MultiSource/Benchmarks/nbench/nbench: 17.62% (1.1840 => 1.3926, std.dev.: 0.0119) MultiSource/Applications/lua/lua: 17.62% (3.8723 => 4.5545, std.dev.: 0.0124) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.61% (0.2107 => 0.2478, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 17.44% (2.0273 => 2.3808, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.35% (0.5981 => 0.7019, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.71% (2.2969 => 2.6808, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.71% (0.3441 => 0.4016, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: 16.63% (0.3283 => 0.3829, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.40% (0.6450 => 0.7508, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.37% (0.8101 => 0.9427, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: 16.34% (0.3232 => 0.3760, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.57% (0.2049 => 0.2368, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/09-vor/vor: 15.41% (0.3180 => 0.3670, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.11% (0.8921 => 1.0269, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/rem: 15.03% (0.1144 => 0.1316) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.63% (0.8067 => 0.9247, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.50% (0.3379 => 0.3869, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.06% (0.2603 => 0.2969, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.00% (0.3865 => 0.4406, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.93% (0.4636 => 0.5282, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.65% (0.4103 => 0.4663, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.24% (1.5603 => 1.7669, std.dev.: 0.0086) MultiSource/Benchmarks/sim/sim: 13.14% (0.3387 => 0.3832, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.56% (0.4203 => 0.4731, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 12.20% (0.4048 => 0.4542, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 12.16% (0.3603 => 0.4041, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 12.04% (0.3422 => 0.3834, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.00% (0.3826 => 0.4285, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.98% (0.2430 => 0.2721, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 11.64% (0.3684 => 0.4113, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 11.61% (0.3282 => 0.3663, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 11.53% (17.1811 => 19.1616, std.dev.: 0.0105) MultiSource/Benchmarks/Olden/bh/bh: 11.45% (0.3092 => 0.3446, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.85% (0.4064 => 0.4505, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions: 10.50% (0.3828 => 0.4230, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.34% (14.3668 => 15.8520, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/strcat: 10.21% (0.2831 => 0.3120, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.17% (0.1268 => 0.1397, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.14% (0.1114 => 0.1227, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.11% (0.3561 => 0.3921, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.05% (0.3543 => 0.3899, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 9.54% (0.2905 => 0.3182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 9.44% (0.2871 => 0.3142, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7326 => 0.8014, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.37% (2.0665 => 2.2601, std.dev.: 0.0128) MultiSource/Applications/hexxagon/hexxagon: 9.26% (1.2842 => 1.4031, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 9.25% (0.2877 => 0.3143, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.20% (0.3162 => 0.3453, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.89% (0.2891 => 0.3148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.79% (0.3650 => 0.3971, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.68% (0.1625 => 0.1766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.61% (0.3136 => 0.3406, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2802 => 0.3041, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 8.52% (0.3052 => 0.3312, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 8.51% (0.2714 => 0.2945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.38% (0.2793 => 0.3027, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.34% (0.3935 => 0.4263, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 8.29% (0.6030 => 0.6530, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 8.22% (0.5925 => 0.6412, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.13% (63.2438 => 68.3849, std.dev.: 0.0601) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.18% (2.2022 => 2.3603, std.dev.: 0.0090) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.83% (0.3177 => 0.3394, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.35% (0.4879 => 0.5189, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: 5.01% (10.3673 => 10.8862, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/objinst: 3.86% (0.3131 => 0.3252, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1557, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4718, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4268, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4478, std.dev.: 0.0149) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.87% (0.4162 => 0.4323, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.3316 => 0.3431, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (8.6802 => 8.8932, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7228, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7570, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2782, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2382, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4498, std.dev.: 0.0033) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.83% (5.2763 => 1.1700, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.63% (5.3855 => 4.4361, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.12% (5.3526 => 4.4360, std.dev.: 0.0092) MultiSource/Applications/JM/ldecod/ldecod: -13.55% (10.4361 => 9.0216, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.92% (1.7609 => 1.6215, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9080, std.dev.: 0.0272) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.75% (1.9577 => 0.6705, std.dev.: 0.0038) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.69% (0.3987 => 0.2564, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3083, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0190, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4329, std.dev.: 0.0191) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8600, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.60% (2.6546 => 2.0016, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.73% (2.9695 => 2.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4214, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7359, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4940, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0109) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.47% (19.9488 => 18.2584, std.dev.: 0.0131) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.85% (1.2373 => 1.1525, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.99% (1.6805 => 1.5799, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (8.1563 => 7.6952, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8379, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -2.04% (3.6994 => 3.6240, std.dev.: 0.0177) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3135 => 2.2785) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.6441 => 4.5849, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: -1.20% (3.7221 => 3.6776, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0153) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0037) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 02:01:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 04:01:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124100140.B20512A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7892?compare_to=7889&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7892, Order: 173326, Start Time: 2013-01-24 08:00:51, End Time: 2013-01-24 10:01:56 To: 7889, Order: 173321, Start Time: 2013-01-24 05:40:33, End Time: 2013-01-24 07:43:23 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (6 on baseline) Performance Improvements: 3 (58 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1055 (999 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 4.49% (9.2890 => 9.7057, std.dev.: 0.0562) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 4.07% (2.3314 => 2.4263, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.03% (1.3201 => 1.3601, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (4.2820 => 4.3658, std.dev.: 0.0315) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.22% (4.3446 => 4.3978, std.dev.: 0.0120) MultiSource/Applications/siod/siod: 1.21% (3.5839 => 3.6273, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.44% (0.5717 => 0.5406, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.83% (2.7900 => 2.7389, std.dev.: 0.0131) MultiSource/Applications/spiff/spiff: -1.17% (2.8198 => 2.7869, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.50% (1.1744 => 1.1216, std.dev.: 0.1990) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.36% (0.0221 => 0.0218, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.73% (0.0440 => 0.0428, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.88% (0.0339 => 0.0336, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0322 => 0.0319, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0429 => 0.0429, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -0.91% (0.0220 => 0.0218, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.80% (0.0249 => 0.0251, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.58% (0.1479 => 0.1426, std.dev.: 0.0195) MultiSource/Applications/lemon/lemon: -4.24% (1.1838 => 1.1336, std.dev.: 0.3372) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.00% (0.4163 => 0.3955, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.22% (0.1493 => 0.1445, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.11% (0.0949 => 0.0969, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.52% (0.0278 => 0.0271, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.78% (0.0607 => 0.0578, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.22% (1.1509 => 1.1484, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -10.53% (0.0019 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0608 => 0.0604, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.15% (0.0284 => 0.0310, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.20% (0.7451 => 0.7436, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.00% (0.0088 => 0.0044, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (12.7626 => 12.7553, std.dev.: 0.0556) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.13% (0.0336 => 0.0491, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323437.50% (0.0008 => 2.5883, std.dev.: 0.0717) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.18% (1.1825 => 2.4263, std.dev.: 0.0147) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.74% (9.0082 => 9.7057, std.dev.: 0.0562) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.78% (4.1668 => 4.3658, std.dev.: 0.0315) MultiSource/Applications/siod/siod: 1.01% (3.5910 => 3.6273, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.72% (0.0808 => 0.0479, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.01% (0.0727 => 0.0487, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.19% (0.0692 => 0.0490, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -26.27% (0.1888 => 0.1392, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.99% (0.1684 => 0.1280, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.83% (0.1009 => 0.0819, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -18.33% (0.0862 => 0.0704, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.20% (1.0960 => 0.9185, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.18% (0.7686 => 0.6519, std.dev.: 0.0416) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.78% (0.4074 => 0.3472, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.30% (1.0986 => 0.9415, std.dev.: 0.0247) MultiSource/Applications/Burg/burg: -12.86% (1.5979 => 1.3924, std.dev.: 0.0417) MultiSource/Applications/spiff/spiff: -12.86% (1.0220 => 0.8906, std.dev.: 0.0131) MultiSource/Applications/treecc/treecc: -12.18% (2.4719 => 2.1708, std.dev.: 0.0315) MultiSource/Applications/aha/aha: -12.12% (0.1378 => 0.1211, std.dev.: 0.0010) MultiSource/Applications/lua/lua: -10.66% (4.6406 => 4.1460, std.dev.: 0.0519) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.48% (6.4235 => 5.7501, std.dev.: 0.1960) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.49% (0.1317 => 0.1192, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -9.39% (0.3598 => 0.3260, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.24% (1.3924 => 1.2637, std.dev.: 0.0416) MultiSource/Applications/siod/siod: -8.94% (2.6437 => 2.4074, std.dev.: 0.0401) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.86% (1.5131 => 1.3790, std.dev.: 0.0365) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.93% (1.1498 => 1.0586, std.dev.: 0.0123) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.90% (0.2481 => 0.2285, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.72% (0.2372 => 0.2189, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: -7.27% (3.7840 => 3.5088, std.dev.: 0.0373) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.00% (1.1731 => 1.0910, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.52% (0.6885 => 0.6436, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.92% (0.5746 => 0.5406, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.35% (1.8127 => 1.7157, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hello: -5.24% (0.1928 => 0.1827, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.84% (0.2709 => 0.2578, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (0.5134 => 0.4890, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6135 => 0.5885, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.96% (1.3220 => 1.2829, std.dev.: 0.0132) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.75% (0.1164 => 0.1004, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.38% (2.8778 => 2.5791, std.dev.: 0.0402) SingleSource/Benchmarks/Shootout/hash: -9.80% (4.5259 => 4.0822, std.dev.: 0.1707) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -8.19% (23.3986 => 21.4811, std.dev.: 0.3733) SingleSource/Benchmarks/Shootout-C++/lists1: -7.88% (0.6628 => 0.6106, std.dev.: 0.0176) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -6.77% (1.4588 => 1.3601, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.94% (0.3349 => 0.3150, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.01% (46.0987 => 44.2492, std.dev.: 0.4540) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.39% (40.4729 => 39.1001, std.dev.: 0.4789) SingleSource/Benchmarks/Shootout-C++/lists: -3.11% (17.2182 => 16.6835, std.dev.: 0.0833) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.02% (0.5826 => 0.5650, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.89% (1.4446 => 1.4028, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/recursive: -2.51% (2.4498 => 2.3884, std.dev.: 0.0160) MultiSource/Applications/spiff/spiff: -2.46% (2.8571 => 2.7869, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.08% (42.3194 => 41.4411, std.dev.: 0.2880) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.66% (3.5669 => 3.5077, std.dev.: 0.0124) MultiSource/Benchmarks/BitBench/five11/five11: -1.51% (5.7021 => 5.6160, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: -1.26% (1.4244 => 1.4065, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.18% (3.1921 => 3.1544, std.dev.: 0.0045) MultiSource/Applications/aha/aha: -1.07% (3.5321 => 3.4942, std.dev.: 0.0089) SingleSource/Benchmarks/SmallPT/smallpt: -1.07% (14.9448 => 14.7849, std.dev.: 0.0392) SingleSource/Benchmarks/Shootout-C++/methcall: -1.05% (8.7416 => 8.6496, std.dev.: 0.0167) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.90% (1.2047 => 1.1216, std.dev.: 0.1990) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.44% (0.0233 => 0.0218, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -3.96% (0.0227 => 0.0218, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -6.80% (0.1530 => 0.1426, std.dev.: 0.0195) MultiSource/Applications/lemon/lemon: -41.24% (1.9293 => 1.1336, std.dev.: 0.3372) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.32% (0.4049 => 0.3955, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.30% (0.1510 => 0.1445, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.92% (0.0978 => 0.0969, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.81% (0.0276 => 0.0271, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0590 => 0.0578, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.14% (1.1617 => 1.1484, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0610 => 0.0604, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.67% (0.0268 => 0.0310, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.01% (0.7437 => 0.7436, std.dev.: 0.0070) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -52.17% (0.0092 => 0.0044, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.18% (12.7781 => 12.7553, std.dev.: 0.0556) Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 02:46:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 04:46:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124104642.6E1342A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7893?compare_to=7890&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7893, Order: 173331, Start Time: 2013-01-24 09:12:45, End Time: 2013-01-24 10:46:56 To: 7890, Order: 173325, Start Time: 2013-01-24 07:10:34, End Time: 2013-01-24 08:48:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (104 on baseline) Performance Improvements: 0 (103 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.21% (0.0280 => 0.0499, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.12% (0.0514 => 0.0895, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.71% (0.0974 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.20% (0.1500 => 0.2178, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.31% (0.6395 => 0.8781, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.11% (0.5805 => 0.7669, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.96% (0.5688 => 0.7506, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.74% (0.6260 => 0.8247, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.62% (0.5456 => 0.7181, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.58% (0.5849 => 0.7696, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.44% (0.5567 => 0.7317, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.43% (0.6395 => 0.8405, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.07% (0.5575 => 0.7307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.91% (0.5581 => 0.7306, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.15% (0.5941 => 0.7732, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.70% (0.5859 => 0.7599, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.39% (0.6033 => 0.7806, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.18% (0.0699 => 0.0903, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.87% (0.6440 => 0.8299, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.36% (0.6189 => 0.7944, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.99% (1.6474 => 2.1085, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.60% (0.6304 => 0.8044, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.84% (0.6230 => 0.7902, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.17% (0.6660 => 0.8403, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.15% (0.5802 => 0.7319, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.57% (0.5705 => 0.7164, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.42% (0.5925 => 0.7431, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.32% (0.5569 => 0.6979, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.30% (0.5478 => 0.6864, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.25% (0.5857 => 0.7336, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.19% (0.5570 => 0.6973, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.34% (0.5591 => 0.6952, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.73% (0.5863 => 0.7254, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.55% (0.7524 => 0.9296, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.30% (0.6052 => 0.7462, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.24% (0.6446 => 0.7944, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.87% (0.6681 => 0.8209, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.34% (0.6194 => 0.7578, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.04% (0.6297 => 0.7685, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.94% (2.2587 => 2.7317, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.56% (0.6667 => 0.8038, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.21% (0.7339 => 0.8749, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.23% (0.0621 => 0.0728, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 14.95% (0.3357 => 0.3859, std.dev.: 0.0086) MultiSource/Applications/lemon/lemon: 14.35% (1.1450 => 1.3093, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.97% (0.1081 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.90% (4.5069 => 5.0434, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.86% (1.6364 => 1.8304, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.76% (0.4916 => 0.5494, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/05-eks/eks: 11.67% (0.4515 => 0.5042, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.06% (3.5339 => 3.9249, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.29% (0.1982 => 0.2186, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.42% (9.2283 => 10.0976, std.dev.: 0.0049) MultiSource/Applications/Burg/burg: 7.94% (1.2515 => 1.3509, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 7.91% (0.4524 => 0.4882, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.85% (0.2001 => 0.2158, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.84% (0.5329 => 0.5747, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.25% (0.7021 => 0.7530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (0.4861 => 0.5212, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.78% (1.4642 => 1.5634, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/matrix: 6.05% (0.3255 => 0.3452, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.73% (0.3319 => 0.3476, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.42% (5.4682 => 5.7100, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 3.84% (0.6750 => 0.7009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.19% (0.3446 => 0.3556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 2.98% (0.3394 => 0.3495, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 2.75% (5.0226 => 5.1606, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 2.61% (1.3864 => 1.4226, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 2.39% (0.8418 => 0.8619, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.21% (0.9557 => 0.9768, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.03% (0.7447 => 0.7598, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.83% (22.4056 => 22.8148, std.dev.: 0.0165) MultiSource/Applications/SPASS/SPASS: 1.52% (15.5079 => 15.7437, std.dev.: 0.0367) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.44% (1.3722 => 1.3920, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7918, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.45% (0.9531 => 1.0336, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5751 => 56.4239, std.dev.: 0.1223) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0121) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3834, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.77% (4.5320 => 4.6121, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.80% (0.1281 => 0.1117, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.20% (0.1431 => 0.1328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.85% (0.3194 => 0.3039, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.82% (0.7198 => 0.6851, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.58% (0.3821 => 0.3646, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -4.29% (2.4924 => 2.3854, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/trivial-interface: -4.04% (0.3812 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.91% (0.3884 => 0.3732, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.90% (0.3848 => 0.3698, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.88% (0.9852 => 0.9470, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.80% (0.3891 => 0.3743, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.80% (0.3896 => 0.3748, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.78% (0.3837 => 0.3692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.76% (0.3880 => 0.3734, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.76% (0.3831 => 0.3687, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -3.74% (0.4033 => 0.3882, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.69% (0.3142 => 0.3026, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions: -3.64% (0.4176 => 0.4024, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.25% (0.3323 => 0.3215, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -3.22% (0.4199 => 0.4064, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -2.94% (0.4280 => 0.4154, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.93% (0.6347 => 0.6161, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.9542 => 0.9275, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.79% (0.3658 => 0.3556, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.78% (1.3148 => 1.2783, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.72% (0.6441 => 0.6266, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.71% (0.6484 => 0.6308, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.51% (2.1713 => 2.1167, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.44% (14.2083 => 13.8620, std.dev.: 0.0108) MultiSource/Applications/sqlite3/sqlite3: -2.19% (17.1032 => 16.7279, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.89% (0.7919 => 0.7769, std.dev.: 0.0028) SingleSource/UnitTests/Vector/constpool: -1.84% (20.7746 => 20.3915, std.dev.: 0.0252) MultiSource/Benchmarks/MallocBench/gs/gs: -1.72% (4.3330 => 4.2584, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: -1.68% (16.1920 => 15.9192, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.66% (1.0544 => 1.0369, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.65% (6.7716 => 6.6599, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.58% (1.2221 => 1.2028, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: -1.58% (0.7982 => 0.7856, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.53% (1.2210 => 1.2023, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: -1.39% (0.9179 => 0.9051, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -1.36% (7.0961 => 6.9993, std.dev.: 0.0110) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.12% (1.8100 => 0.7037, std.dev.: 0.0211) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0267, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0734, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1984, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1289, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3543, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.00% (4.1534 => 3.8210, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.69% (1.3096 => 1.2744, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.64% (7.9763 => 7.7654, std.dev.: 0.0212) SingleSource/Benchmarks/Shootout/ary3: -2.46% (3.7241 => 3.6325, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4673, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.55% (7.3040 => 7.1906, std.dev.: 0.0304) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.47% (1.6219 => 1.5980, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6579, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5883, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6102, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 03:25:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 05:25:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130124112539.58D902A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7894?compare_to=7887&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7894, Order: 173325, Start Time: 2013-01-24 07:40:34, End Time: 2013-01-24 11:25:54 To: 7887, Order: 173318, Start Time: 2013-01-24 03:14:24, End Time: 2013-01-24 06:48:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (185 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (753 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 26.93% (0.4181 => 0.5307, std.dev.: 0.0349) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.61% (2.4138 => 2.4527, std.dev.: 0.0089) MultiSource/Applications/hbd/hbd: 1.40% (1.1366 => 1.1525, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.07% (2.3767 => 2.4021, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 11.94% (0.3527 => 0.3948, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.05% (0.3938 => 0.4058, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.08% (0.0625 => 0.0913, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.03% (0.1063 => 0.1446, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 30.35% (0.1107 => 0.1443, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.17% (0.2969 => 0.3835, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.57% (0.1106 => 0.1422, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.97% (0.0547 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.83% (0.5900 => 0.7542, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.71% (0.4139 => 0.5286, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.65% (0.4253 => 0.5429, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.45% (0.0714 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.75% (0.4994 => 0.6330, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.51% (0.0415 => 0.0525, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.96% (0.5000 => 0.6298, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.75% (0.0897 => 0.1128, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 25.38% (0.0599 => 0.0751, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.31% (0.1620 => 0.2030, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.07% (0.1021 => 0.1277, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 25.03% (1.5932 => 1.9920, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 24.39% (0.0947 => 0.1178, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.13% (0.1003 => 0.1245, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.48% (0.1103 => 0.1362, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.38% (0.1604 => 0.1979, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.36% (0.0642 => 0.0792, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.24% (0.0822 => 0.1013, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 22.96% (0.4029 => 0.4954, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/health/health: 22.78% (0.0821 => 0.1008, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.65% (0.3903 => 0.4787, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.54% (0.1619 => 0.1984, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.08% (0.0462 => 0.0564) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.83% (0.3890 => 0.4739, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 21.53% (0.0808 => 0.0982, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.23% (1.3152 => 1.5944, std.dev.: 0.0249) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 21.10% (0.1218 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.05% (0.1088 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.02% (0.2736 => 0.3311, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.01% (0.1090 => 0.1319, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.00% (0.1462 => 0.1769, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.95% (0.2014 => 0.2436, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.77% (0.0698 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 20.47% (0.1505 => 0.1813, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.21% (0.3271 => 0.3932, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.08% (0.0513 => 0.0616, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 20.02% (1.8794 => 2.2556, std.dev.: 0.0287) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.96% (0.2866 => 0.3438, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685) MultiSource/Applications/Burg/burg: 19.53% (0.5546 => 0.6629, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.48% (0.2875 => 0.3435, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.29% (3.5627 => 4.2501, std.dev.: 0.0548) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.21% (0.1968 => 0.2346, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.15% (0.4658 => 0.5550, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.09% (0.2792 => 0.3325, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/strcat: 19.02% (0.2750 => 0.3273, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.99% (1.6211 => 1.9290, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/objinst: 18.99% (0.2823 => 0.3359, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 18.86% (0.2725 => 0.3239, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 18.85% (0.9697 => 1.1525, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.85% (0.2738 => 0.3254, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hello: 18.83% (0.2714 => 0.3225, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/except: 18.75% (0.2811 => 0.3338, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 18.70% (0.3096 => 0.3675, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 18.70% (0.2813 => 0.3339, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 18.69% (0.2803 => 0.3327, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 18.69% (0.1284 => 0.1524) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.69% (0.2729 => 0.3239, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.64% (2.0673 => 2.4527, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 18.56% (0.2780 => 0.3296, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.52% (0.2911 => 0.3450, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 18.51% (0.9909 => 1.1743, std.dev.: 0.0108) SingleSource/UnitTests/ObjC++/Hello: 18.43% (0.5826 => 0.6900, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 18.37% (0.1421 => 0.1682, std.dev.: 0.0050) MultiSource/Applications/ClamAV/clamscan: 18.37% (4.2109 => 4.9843, std.dev.: 0.0696) SingleSource/Regression/C++/ofstream_ctor: 18.28% (0.3004 => 0.3553, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 18.17% (0.3258 => 0.3850, std.dev.: 0.0058) SingleSource/UnitTests/ObjC++/property-reference-object: 18.15% (0.5889 => 0.6958, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 18.06% (0.3267 => 0.3857, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.00% (0.3195 => 0.3770, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.97% (0.5026 => 0.5929, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.96% (0.3930 => 0.4636, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.86% (0.4361 => 0.5140, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 17.86% (1.0781 => 1.2706, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.78% (0.3060 => 0.3604, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.73% (0.3124 => 0.3678, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.69% (2.7292 => 3.2120, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.64% (1.9694 => 2.3168, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout-C++/ary2: 17.64% (0.3317 => 0.3902, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.54% (1.9966 => 2.3469, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout-C++/sieve: 17.50% (0.3726 => 0.4378, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.49% (0.3282 => 0.3856, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 17.35% (0.3348 => 0.3929, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.31% (0.3362 => 0.3944, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.22% (4.4195 => 5.1804, std.dev.: 0.0400) SingleSource/UnitTests/ObjC++/property-reference: 17.19% (0.7171 => 0.8404, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 17.09% (0.2691 => 0.3151, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.08% (0.3625 => 0.4244, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.02% (0.0605 => 0.0708, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 16.80% (0.3678 => 0.4296, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/lists1: 16.80% (0.3477 => 0.4061, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 16.67% (1.4269 => 1.6648, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.63% (0.3981 => 0.4643, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 16.55% (0.7875 => 0.9178, std.dev.: 0.0139) MultiSource/Benchmarks/Bullet/bullet: 16.52% (23.5202 => 27.4066, std.dev.: 0.0803) SingleSource/Benchmarks/Shootout-C++/hash: 16.52% (0.4146 => 0.4831, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.50% (0.3690 => 0.4299, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.45% (0.2566 => 0.2988, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 16.44% (0.4251 => 0.4950, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.20% (0.3845 => 0.4468, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 15.76% (0.5012 => 0.5802, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/for-in: 15.70% (0.3496 => 0.4045, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 15.70% (0.3465 => 0.4009, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/exceptions-2: 15.70% (0.3446 => 0.3987, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 15.64% (0.3460 => 0.4001, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.60% (0.3442 => 0.3979, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.54% (0.3469 => 0.4008, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 15.42% (2.1653 => 2.4992, std.dev.: 0.0292) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.12% (0.3643 => 0.4194, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 15.04% (0.0758 => 0.0872, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 14.79% (4.6177 => 5.3008, std.dev.: 0.0488) MultiSource/Applications/SPASS/SPASS: 14.72% (5.5417 => 6.3572, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/football/football: 14.70% (0.2075 => 0.2380, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.56% (0.6435 => 0.7372, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 14.31% (2.1013 => 2.4021, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.01% (0.1028 => 0.1172, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.92% (0.2040 => 0.2324, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.70% (0.2737 => 0.3112, std.dev.: 0.0040) MultiSource/Applications/lambda-0_1_3/lambda: 13.12% (0.3498 => 0.3957, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 12.93% (0.6634 => 0.7492, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.46% (0.5361 => 0.6029, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.46% (0.2103 => 0.2365, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.22% (0.1383 => 0.1552, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 11.75% (0.3336 => 0.3728, std.dev.: 0.0059) MultiSource/Benchmarks/PAQ8p/paq8p: 11.66% (0.4847 => 0.5412, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.04% (0.7426 => 0.8246, std.dev.: 0.0176) MultiSource/Applications/lemon/lemon: 10.96% (0.2391 => 0.2653, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.94% (11.6398 => 12.9127, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: 10.76% (2.0346 => 2.2536, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.37% (4.6926 => 5.1790, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.87% (0.5584 => 0.6135, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 8.25% (11.9555 => 12.9415, std.dev.: 0.0259) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.14% (0.3792 => 0.4025, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.65% (29.0505 => 181.4632, std.dev.: 0.0306) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 82.61% (0.2162 => 0.3948, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.43% (0.0734 => 0.0928, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.20% (0.5917 => 0.6698, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.88% (0.3693 => 0.4058, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 8.99% (0.2802 => 0.3054, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6122, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6746, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2415, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6858, std.dev.: 0.0636) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8891, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 3.08% (0.6276 => 0.6469, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2116, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3148, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2868, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.20% (3.1722 => 3.2103, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.12% (12.4025 => 12.5410, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0254) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4785, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.86% (2.4764 => 2.4304, std.dev.: 0.0133) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5623, std.dev.: 0.0146) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.15% (17.2379 => 14.2815, std.dev.: 0.1338) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -11.03% (0.2402 => 0.2137, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9791, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7997, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9592, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2133, std.dev.: 0.0190) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8076, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.81% (0.6293 => 0.6116, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1769, std.dev.: 0.0497) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5792, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0448, std.dev.: 0.0006) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 04:22:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 06:22:09 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124122209.CA2A72A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7895?compare_to=7892&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7895, Order: 173331, Start Time: 2013-01-24 10:21:10, End Time: 2013-01-24 12:22:26 To: 7892, Order: 173326, Start Time: 2013-01-24 08:00:51, End Time: 2013-01-24 10:01:56 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (5 on baseline) Performance Improvements: 3 (73 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1058 (985 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.86% (0.8754 => 0.8917, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.3884 => 2.4567, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.16% (1.5887 => 1.6071, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.82% (0.6865 => 0.6740, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.35% (0.9856 => 0.9624, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ks/ks: -1.58% (1.1764 => 1.1578, std.dev.: 0.0015) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.08% (1.1216 => 1.1207, std.dev.: 0.0144) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.92% (0.0218 => 0.0220, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0428 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0336 => 0.0338, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.94% (0.0319 => 0.0316, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0429 => 0.0429, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 2.75% (0.0218 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.17% (0.0251 => 0.0233, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.98% (0.1426 => 0.1440, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -0.49% (1.1336 => 1.1281, std.dev.: 0.4000) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.25% (0.3955 => 0.3945, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.39% (0.1445 => 0.1494, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0969 => 0.0966, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.85% (0.0271 => 0.0276, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.92% (0.0578 => 0.0538, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.51% (1.1484 => 1.1543, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.59% (0.0017 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.17% (0.0604 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.32% (0.0310 => 0.0309, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.13% (0.7436 => 0.7426, std.dev.: 0.0102) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 79.55% (0.0044 => 0.0079, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.27% (12.7553 => 12.7900, std.dev.: 0.4898) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 46.13% (0.0336 => 0.0491, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322637.50% (0.0008 => 2.5819, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.44% (1.1825 => 2.3111, std.dev.: 0.0730) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.64% (0.2562 => 0.2809, std.dev.: 0.0047) MultiSource/Applications/JM/lencod/lencod: 2.11% (6.8159 => 6.9596, std.dev.: 0.0405) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.84% (0.0808 => 0.0478, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.43% (0.0727 => 0.0484, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -30.49% (0.0692 => 0.0481, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.16% (0.1684 => 0.1294, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: -19.74% (1.8964 => 1.5220, std.dev.: 0.0833) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.37% (0.0862 => 0.0695, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.03% (0.1009 => 0.0817, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.90% (1.0960 => 0.9217, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.74% (0.7686 => 0.6553, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.68% (1.0986 => 0.9373, std.dev.: 0.0236) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.99% (0.0847 => 0.0737, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -12.86% (1.0220 => 0.8906, std.dev.: 0.0489) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.07% (1.2154 => 1.0687, std.dev.: 0.0501) MultiSource/Applications/aha/aha: -11.61% (0.1378 => 0.1218, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -11.06% (1.1433 => 1.0168, std.dev.: 0.0243) MultiSource/Applications/lua/lua: -10.95% (4.6406 => 4.1324, std.dev.: 0.1161) MultiSource/Applications/treecc/treecc: -10.81% (2.4719 => 2.2047, std.dev.: 0.0617) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -10.75% (0.2372 => 0.2117, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.10% (1.5131 => 1.3603, std.dev.: 0.0361) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.72% (6.4235 => 5.7989, std.dev.: 0.1905) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.43% (1.3924 => 1.2611, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.36% (10.2703 => 9.3094, std.dev.: 0.1086) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.26% (0.1210 => 0.1098, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.79% (1.6874 => 1.5390, std.dev.: 0.0382) MultiSource/Applications/siod/siod: -8.72% (2.6437 => 2.4133, std.dev.: 0.0814) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.58% (0.1317 => 0.1204, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -8.45% (0.3598 => 0.3294, std.dev.: 0.0068) MultiSource/Applications/ClamAV/clamscan: -8.44% (17.4365 => 15.9657, std.dev.: 0.4004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.10% (0.2481 => 0.2280, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: -7.64% (0.1610 => 0.1487, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.00% (0.9588 => 0.8917, std.dev.: 0.0059) MultiSource/Applications/d/make_dparser: -6.93% (3.7840 => 3.5216, std.dev.: 0.0711) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.21% (1.3310 => 1.2484, std.dev.: 0.0056) MultiSource/Applications/viterbi/viterbi: -6.20% (0.1824 => 0.1711, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.86% (0.2884 => 0.2715, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.35% (0.2615 => 0.2475, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.93% (0.2618 => 0.2489, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.62% (5.0381 => 4.8055, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout-C++/hash2: -4.62% (0.5134 => 0.4897, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.57% (1.0234 => 0.9766, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.40% (1.3220 => 1.2638, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.89% (4.6579 => 4.4767, std.dev.: 0.0159) MultiSource/Benchmarks/sim/sim: -3.53% (0.3715 => 0.3584, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.52% (4.8904 => 4.7182, std.dev.: 0.0379) MultiSource/Benchmarks/MallocBench/gs/gs: -3.41% (4.5936 => 4.4369, std.dev.: 0.0296) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.86% (7.2721 => 7.0639, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.80% (0.6934 => 0.6740, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.74% (14.9757 => 14.5655, std.dev.: 0.0566) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.13% (4.9104 => 4.8057, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.87% (0.9372 => 0.6479, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.48% (0.1164 => 0.0914, std.dev.: 0.0058) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.36% (1.5623 => 1.2599, std.dev.: 0.0280) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.79% (1.4235 => 1.2556, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.46% (0.4081 => 0.3654, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.92% (0.3609 => 0.3287, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.92% (1.4588 => 1.3287, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/lists1: -8.36% (0.6628 => 0.6074, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/hash: -8.07% (4.5259 => 4.1605, std.dev.: 0.1208) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.13% (46.0987 => 42.8119, std.dev.: 0.8753) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.91% (23.3986 => 22.0157, std.dev.: 0.3290) MultiSource/Benchmarks/Olden/health/health: -5.61% (0.3654 => 0.3449, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.55% (0.3349 => 0.3163, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.25% (0.3201 => 0.3033, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: -3.73% (1.4244 => 1.3713, std.dev.: 0.0156) MultiSource/Applications/SIBsim4/SIBsim4: -3.44% (3.5443 => 3.4224, std.dev.: 0.0468) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.41% (40.4729 => 39.0928, std.dev.: 0.4440) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.3406 => 0.3306, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/lists: -2.73% (17.2182 => 16.7485, std.dev.: 0.0263) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.69% (0.5826 => 0.5669, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.08% (1.4446 => 1.4146, std.dev.: 0.0076) MultiSource/Benchmarks/mafft/pairlocalalign: -1.83% (63.1520 => 61.9987, std.dev.: 0.3567) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3154, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.97% (1.2047 => 1.1207, std.dev.: 0.0144) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.10% (0.0451 => 0.0428, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.66% (0.0328 => 0.0316, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (0.0255 => 0.0233, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.88% (0.1530 => 0.1440, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -41.53% (1.9293 => 1.1281, std.dev.: 0.4000) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.57% (0.4049 => 0.3945, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.06% (0.1510 => 0.1494, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.23% (0.0978 => 0.0966, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.81% (0.0590 => 0.0538, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.64% (1.1617 => 1.1543, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0610 => 0.0603, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.30% (0.0268 => 0.0309, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.15% (0.7437 => 0.7426, std.dev.: 0.0102) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -14.13% (0.0092 => 0.0079, std.dev.: 0.0047) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.09% (12.7781 => 12.7900, std.dev.: 0.4898) Report Time: 0.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 04:32:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 06:32:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124123220.3096E2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7896?compare_to=7891&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7896, Order: 173331, Start Time: 2013-01-24 10:20:56, End Time: 2013-01-24 12:32:35 To: 7891, Order: 173325, Start Time: 2013-01-24 07:37:53, End Time: 2013-01-24 09:50:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.20% (10.1914 => 10.3138, std.dev.: 0.0357) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.15% (0.0652 => 0.0666, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 1.75% (491.2518 => 499.8536, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44225.05% (1.1277 => 499.8536, std.dev.: 0.0025) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.45% (0.5229 => 1.6495, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 20.57% (14.9895 => 18.0735, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 44.45% (14.1553 => 20.4477, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 18.34% (4.1105 => 4.8643, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.90% (1.1048 => 1.7334, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.44% (7.1582 => 37.4686, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.07% (3.4629 => 6.4434, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.23% (0.6222 => 1.0903, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10279.31% (0.0720 => 7.4731, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11153900.00% (0.0001 => 11.1540, std.dev.: 0.0155) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 64500.00% (0.0001 => 0.0646, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574400.00% (0.0001 => 0.5745, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488200.00% (0.0001 => 5.4883, std.dev.: 0.0286) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.37% (1.1194 => 10.3138, std.dev.: 0.0357) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.82% (22.1758 => 55.3993, std.dev.: 0.0330) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.69% (2.9384 => 4.6336, std.dev.: 0.0199) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.98% (7.0540 => 10.7915, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.52% (1.5859 => 2.4029, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.99% (8.1363 => 11.9595, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.93% (2.2024 => 3.1258, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 40.37% (0.3109 => 0.4364, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 39.25% (0.1432 => 0.1994, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 39.01% (21.9371 => 30.4938, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.15% (4.2646 => 5.6784, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.63% (0.4615 => 0.6121, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.47% (1.5415 => 2.0421, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/exptree: 32.43% (0.0814 => 0.1078, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.04% (0.2271 => 0.2976, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: 29.54% (1.1642 => 1.5081, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/05-eks/eks: 29.50% (0.4299 => 0.5567, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.19% (0.5105 => 0.6544, std.dev.: 0.0137) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.08% (0.0730 => 0.0935, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.03% (0.1584 => 0.2028, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.21% (0.1143 => 0.1454, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.15% (0.6675 => 0.8487, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.99% (0.0793 => 0.1007, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.74% (0.1892 => 0.2398, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.27% (3.8922 => 4.9146, std.dev.: 0.0043) MultiSource/Benchmarks/mafft/pairlocalalign: 26.17% (9.4845 => 11.9670, std.dev.: 0.0128) MultiSource/Benchmarks/McCat/08-main/main: 26.00% (0.2554 => 0.3218, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.14% (0.1655 => 0.2071, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.68% (0.1337 => 0.1667, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.61% (0.3121 => 0.3889, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.26% (1.4186 => 1.7627, std.dev.: 0.0134) MultiSource/Applications/lemon/lemon: 24.25% (1.0722 => 1.3322, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 24.13% (0.4289 => 0.5324, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 23.70% (0.4620 => 0.5715, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.42% (0.1695 => 0.2092, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.74% (0.2700 => 0.3314, std.dev.: 0.0016) MultiSource/Applications/minisat/minisat: 22.52% (0.7115 => 0.8717, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 22.38% (0.1032 => 0.1263, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 22.24% (0.1151 => 0.1407, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803) MultiSource/Applications/spiff/spiff: 21.63% (0.7835 => 0.9530, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.60% (0.1236 => 0.1503, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 21.42% (0.1695 => 0.2058, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.75% (1.3050 => 1.5758, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 20.65% (0.6456 => 0.7789, std.dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 20.45% (5.7591 => 6.9370, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.30% (0.8172 => 0.9831, std.dev.: 0.0140) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.26% (0.1940 => 0.2333, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.15% (0.5860 => 0.7041, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.15% (0.0953 => 0.1145, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.97% (4.9449 => 5.9325, std.dev.: 0.0143) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 19.13% (0.7433 => 0.8855, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.86% (5.0018 => 5.9452, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/health/health: 18.77% (0.1268 => 0.1506, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 18.71% (3.3354 => 3.9596, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.59% (0.5020 => 0.5953, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.37% (0.5569 => 0.6592, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.23% (0.0834 => 0.0986, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.96% (0.9765 => 1.1519, std.dev.: 0.0036) MultiSource/Benchmarks/nbench/nbench: 17.95% (1.1840 => 1.3965, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.92% (0.2065 => 0.2435, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.2107 => 0.2481, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 17.57% (3.8723 => 4.5528, std.dev.: 0.0121) MultiSource/Applications/treecc/treecc: 17.44% (2.0273 => 2.3808, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.33% (1.1861 => 1.3916, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.24% (0.5981 => 0.7012, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/18-imp/imp: 17.21% (0.3423 => 0.4012, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.12% (0.3441 => 0.4030, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.70% (0.8101 => 0.9454, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 16.68% (2.2969 => 2.6801, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.3283 => 0.3824, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.06% (0.3232 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.03% (0.6450 => 0.7484, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.46% (0.8921 => 1.0300, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/09-vor/vor: 15.41% (0.3180 => 0.3670, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.80% (0.8067 => 0.9261, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 14.06% (0.3379 => 0.3854, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 13.76% (0.3387 => 0.3853, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 13.54% (1.5603 => 1.7715, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.21% (0.4103 => 0.4645, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.20% (0.4636 => 0.5248, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.40% (0.4203 => 0.4724, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.10% (0.3092 => 0.3466, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 12.01% (0.4048 => 0.4534, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.99% (0.3603 => 0.4035, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.93% (0.2430 => 0.2720, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.82% (0.3282 => 0.3670, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 11.77% (17.1811 => 19.2031, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.58% (0.3826 => 0.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.45% (0.3684 => 0.4106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 11.19% (0.3886 => 0.4321, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.65% (0.4064 => 0.4497, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1268 => 0.1402, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.44% (14.3668 => 15.8671, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.23% (0.1114 => 0.1228, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 9.99% (0.3543 => 0.3897, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.96% (0.3543 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.93% (0.2831 => 0.3112, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.90% (0.3516 => 0.3864, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.51% (0.2871 => 0.3144, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.34% (2.0665 => 2.2596, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 9.19% (0.2905 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.04% (0.2877 => 0.3137, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.03% (1.2842 => 1.4001, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.79% (0.3162 => 0.3440, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7517, std.dev.: 0.0470) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.66% (0.3650 => 0.3966, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.54% (0.6030 => 0.6545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.42% (0.2756 => 0.2988, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: 8.41% (0.7326 => 0.7942, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 8.34% (0.5925 => 0.6419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.32% (0.3052 => 0.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.32% (0.2802 => 0.3035, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.21% (0.3935 => 0.4258, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.13% (0.2793 => 0.3020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.07% (0.2714 => 0.2933, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.86% (2.2022 => 2.3753, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 5.39% (10.3673 => 10.9263, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/objinst: 3.67% (0.3131 => 0.3246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0038) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1557, std.dev.: 0.0135) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4692, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4516, std.dev.: 0.0108) SingleSource/Regression/C/uint64_to_float: 5.14% (0.5413 => 0.5691, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (3.1578 => 3.3106, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.47% (0.3316 => 0.3431, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1051, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.99% (0.9957 => 1.0255, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9230, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7230, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 1.76% (9.1159 => 9.2760, std.dev.: 0.0198) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2393, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4544, std.dev.: 0.0145) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1695, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.80% (5.2763 => 1.1711, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.93% (0.8651 => 0.2169, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.97% (5.3855 => 4.4714, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.39% (5.3526 => 4.4751, std.dev.: 0.0078) MultiSource/Applications/JM/ldecod/ldecod: -13.22% (10.4361 => 9.0563, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9107, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.65% (1.7609 => 1.6262, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.78% (1.9577 => 0.6504, std.dev.: 0.0136) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0201, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4346, std.dev.: 0.0108) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8544, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.71% (1.6925 => 1.4266, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7339, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4913, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.21% (0.9540 => 0.8566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (19.9488 => 18.3033, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: -6.41% (1.2373 => 1.1580, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.99% (1.6805 => 1.5798, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.47% (8.1563 => 7.7105, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.75% (1.5835 => 1.5083, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.61% (10.2830 => 9.8090, std.dev.: 0.0168) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: -2.18% (3.6994 => 3.6188, std.dev.: 0.0240) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.65% (3.7221 => 3.6608, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.30% (4.6441 => 4.5838, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2325, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0022) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 04:44:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 06:44:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124124453.A55CE2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7897?compare_to=7893&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7897, Order: 173338, Start Time: 2013-01-24 11:10:36, End Time: 2013-01-24 12:45:08 To: 7893, Order: 173331, Start Time: 2013-01-24 09:12:45, End Time: 2013-01-24 10:46:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 6 (108 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1098 (888 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.26% (0.3742 => 0.3939, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.42% (0.4252 => 0.4355, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 1.71% (0.7551 => 0.7680, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 1.40% (1.5528 => 1.5746, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.25% (1.2783 => 1.2943, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (2.1167 => 2.1382, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 72.52% (0.0717 => 0.1237, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0011) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.76% (0.6395 => 0.8810, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.56% (0.5688 => 0.7540, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.30% (0.6260 => 0.8282, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.26% (0.5456 => 0.7216, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.06% (0.5567 => 0.7352, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.04% (0.5849 => 0.7723, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.98% (0.6395 => 0.8440, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.89% (0.5575 => 0.7353, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.66% (0.5581 => 0.7348, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.21% (0.5859 => 0.7629, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.95% (0.6033 => 0.7840, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.43% (0.6440 => 0.8335, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.81% (0.6189 => 0.7972, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.55% (1.6474 => 2.1177, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.05% (0.6304 => 0.8072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.59% (0.6230 => 0.7949, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.82% (0.5802 => 0.7358, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.79% (0.6660 => 0.8444, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.33% (0.5925 => 0.7485, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.19% (0.5705 => 0.7199, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.02% (0.5857 => 0.7381, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.86% (0.5569 => 0.7009, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.78% (0.5478 => 0.6890, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.75% (0.5570 => 0.7004, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.20% (0.5591 => 0.7000, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.42% (0.5863 => 0.7295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.20% (0.6446 => 0.8006, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.96% (0.6052 => 0.7502, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.92% (0.7524 => 0.9324, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.36% (0.6681 => 0.8242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.05% (0.6194 => 0.7622, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.68% (0.6297 => 0.7725, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.43% (2.2587 => 2.7428, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.37% (0.6667 => 0.8092, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.87% (0.7339 => 0.8797, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.66% (1.1450 => 1.3129, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (4.5069 => 5.0659, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/05-eks/eks: 11.92% (0.4515 => 0.5053, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.46% (1.6364 => 1.8240, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.43% (3.5339 => 3.9379, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.39% (0.1982 => 0.2188, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.53% (9.2283 => 10.1080, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: 9.08% (0.4524 => 0.4935, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.90% (0.1731 => 0.1885, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.41% (0.4861 => 0.5270, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5329 => 0.5772, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.29% (1.2515 => 1.3553, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.62% (0.7021 => 0.7556, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.19% (0.3255 => 0.3489, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.4642 => 1.5686, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.83% (1.2784 => 1.3657, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.66% (5.4682 => 5.7231, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary3: 4.38% (0.3446 => 0.3597, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 4.33% (0.3394 => 0.3541, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.11% (5.0226 => 5.1789, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.3864 => 1.4279, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.9557 => 0.9843, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 2.84% (0.8418 => 0.8657, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/BoolLiteralTest: 2.74% (0.3834 => 0.3939, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 2.35% (0.7447 => 0.7622, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.20% (22.4056 => 22.8982, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5168 => 0.5273, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 1.98% (15.5079 => 15.8145, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3959, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8109, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.36% (0.9531 => 1.0328, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5751 => 56.3698, std.dev.: 0.1184) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3812, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.78% (4.5320 => 4.6126, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.23% (10.3489 => 10.4762, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.40% (0.3821 => 0.3653, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.38% (0.7198 => 0.6883, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (2.4924 => 2.3953, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.73% (0.9852 => 0.9485, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -3.60% (0.3194 => 0.3079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.56% (0.3142 => 0.3030, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.50% (0.3884 => 0.3748, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.47% (0.3831 => 0.3698, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: -3.43% (0.3848 => 0.3716, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.42% (0.4033 => 0.3895, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.39% (0.3891 => 0.3759, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.39% (0.3896 => 0.3764, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.30% (0.3880 => 0.3752, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions: -3.26% (0.4176 => 0.4040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.89% (0.3837 => 0.3726, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.76% (0.4199 => 0.4083, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4280 => 0.4172, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.50% (20.7746 => 20.2551, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.50% (0.6484 => 0.6322, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.43% (0.9542 => 0.9310, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.05% (14.2083 => 13.9171, std.dev.: 0.0095) MultiSource/Applications/sqlite3/sqlite3: -1.99% (17.1032 => 16.7635, std.dev.: 0.0157) SingleSource/UnitTests/ObjC++/Hello: -1.75% (0.6347 => 0.6236, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.66% (0.6441 => 0.6334, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.57% (0.7919 => 0.7795, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -1.56% (1.3148 => 1.2943, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.52% (2.1713 => 2.1382, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -1.46% (16.1920 => 15.9558, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.42% (1.2221 => 1.2047, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.39% (1.0544 => 1.0397, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/gs/gs: -1.33% (4.3330 => 4.2753, std.dev.: 0.0107) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (6.7716 => 6.6909, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -1.08% (7.0961 => 7.0195, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.15% (1.8100 => 0.6851, std.dev.: 0.0241) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3096, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.65% (1.3643 => 1.0280, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0765, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1994, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3561, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.68% (0.5142 => 0.4644, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1074, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.66% (3.7241 => 3.6251, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.61% (7.9763 => 7.7679, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.79% (1.3096 => 1.2862, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3040 => 7.1809, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.47% (1.6086 => 1.5849, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6099, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7092 => 3.6619, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 06:42:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 08:42:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124144236.353AB2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7898?compare_to=7897&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7898, Order: 173341, Start Time: 2013-01-24 13:08:51, End Time: 2013-01-24 14:42:51 To: 7897, Order: 173338, Start Time: 2013-01-24 11:10:36, End Time: 2013-01-24 12:45:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (888 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.12% (0.0514 => 0.0895, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.25% (0.1132 => 0.1599, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.26% (0.6395 => 0.8778, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.09% (0.5805 => 0.7668, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.03% (0.5688 => 0.7510, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.01% (0.6260 => 0.8264, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.90% (0.0699 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.78% (0.5456 => 0.7190, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.60% (0.5567 => 0.7326, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.60% (0.5849 => 0.7697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.35% (0.6395 => 0.8400, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.23% (0.5575 => 0.7316, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.12% (0.5581 => 0.7318, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.42% (0.5941 => 0.7748, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.68% (0.5859 => 0.7598, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.47% (0.6033 => 0.7811, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.02% (0.6440 => 0.8309, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.34% (0.6189 => 0.7943, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.13% (1.6474 => 2.1108, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.94% (0.6676 => 0.8541, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.79% (0.6304 => 0.8056, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.05% (0.6230 => 0.7915, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.49% (0.5802 => 0.7339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.23% (0.6660 => 0.8407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.96% (0.5925 => 0.7463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.63% (0.5705 => 0.7167, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.61% (0.5857 => 0.7357, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.30% (0.5478 => 0.6864, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.28% (0.5570 => 0.6978, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.26% (0.5569 => 0.6976, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.94% (0.0790 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.61% (0.5591 => 0.6967, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.84% (0.5863 => 0.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.67% (0.6446 => 0.7972, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.61% (0.6052 => 0.7481, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.48% (0.7524 => 0.9291, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.77% (0.6681 => 0.8202, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.57% (0.6194 => 0.7592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.49% (0.6297 => 0.7713, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.13% (2.2587 => 2.7360, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.88% (0.6667 => 0.8059, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.31% (0.7339 => 0.8756, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.69% (0.0833 => 0.0972, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 14.92% (0.3357 => 0.3858, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 14.52% (1.1450 => 1.3112, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.31% (4.5069 => 5.0617, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4515 => 0.5055, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.80% (0.4916 => 0.5496, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.38% (1.6364 => 1.8226, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.10% (3.5339 => 3.9260, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.09% (0.1982 => 0.2182, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.02% (0.2385 => 0.2624, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.32% (9.2283 => 10.0883, std.dev.: 0.0260) SingleSource/Benchmarks/Shootout-C++/hash: 8.78% (0.4524 => 0.4921, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 8.35% (0.4861 => 0.5267, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.11% (1.2515 => 1.3530, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.92% (0.5329 => 0.5751, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.90% (0.2001 => 0.2159, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.68% (0.1731 => 0.1864, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.38% (0.7021 => 0.7539, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3255 => 0.3486, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.83% (1.2784 => 1.3657, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.81% (1.4642 => 1.5639, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.70% (0.6750 => 0.7067, std.dev.: 0.0099) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.55% (0.3319 => 0.3470, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 4.47% (0.3446 => 0.3600, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.36% (5.4682 => 5.7064, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3394 => 0.3539, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 2.91% (5.0226 => 5.1688, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.9557 => 0.9826, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.70% (1.3864 => 1.4239, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 2.51% (0.8418 => 0.8629, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 2.32% (0.7447 => 0.7620, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.07% (22.4056 => 22.8693, std.dev.: 0.0198) MultiSource/Applications/SPASS/SPASS: 1.59% (15.5079 => 15.7547, std.dev.: 0.0237) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.56% (1.3722 => 1.3936, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7953, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.13% (0.9531 => 1.0306, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.70% (54.5751 => 56.5934, std.dev.: 0.0537) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1119, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3826, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.80% (4.5320 => 4.6138, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.54% (79.7170 => 80.9462, std.dev.: 0.2990) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.7198 => 0.6867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.29% (0.3821 => 0.3657, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -4.11% (2.4924 => 2.3899, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.06% (0.9852 => 0.9452, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -3.76% (0.3194 => 0.3074, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.3831 => 0.3699, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.43% (0.3880 => 0.3747, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3884 => 0.3751, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.39% (0.3891 => 0.3759, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.25% (0.3848 => 0.3723, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.23% (0.4176 => 0.4041, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.21% (0.3896 => 0.3771, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.96% (20.7746 => 20.1607, std.dev.: 0.0430) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.95% (0.3837 => 0.3724, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.87% (0.3658 => 0.3553, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.71% (0.6484 => 0.6308, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.58% (0.9542 => 0.9296, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8895, std.dev.: 0.0232) SingleSource/UnitTests/ObjC++/Hello: -2.03% (0.6347 => 0.6218, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.95% (17.1032 => 16.7696, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.93% (0.7919 => 0.7766, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -1.92% (1.3148 => 1.2895, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.82% (4.3330 => 4.2543, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: -1.77% (0.6441 => 0.6327, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.70% (1.0544 => 1.0365, std.dev.: 0.0054) MultiSource/Applications/JM/lencod/lencod: -1.52% (16.1920 => 15.9451, std.dev.: 0.0114) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.48% (6.7716 => 6.6714, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.42% (1.2221 => 1.2047, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.40% (2.1713 => 2.1408, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.33% (1.2210 => 1.2048, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: -1.33% (7.0961 => 7.0020, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/football/football: -1.30% (0.9179 => 0.9060, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.67% (1.8100 => 0.6757, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3125, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.63% (1.3643 => 1.0283, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7545, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0810, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.01% (4.1024 => 3.1993, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0011) SingleSource/UnitTests/Vector/multiplies: -15.36% (2.5106 => 2.1250, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3534, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.46% (2.2633 => 2.1850, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7742, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4660, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3040 => 7.1854, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.22% (1.6086 => 1.5890, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.19% (3.7092 => 3.6649, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6114, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 06:43:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 08:43:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124144353.73F412A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7899?compare_to=7895&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7899, Order: 173341, Start Time: 2013-01-24 12:41:14, End Time: 2013-01-24 14:44:10 To: 7895, Order: 173331, Start Time: 2013-01-24 10:21:10, End Time: 2013-01-24 12:22:26 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 23 (11 on baseline) Performance Improvements: 4 (38 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1037 (1014 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ks/ks: 41.42% (0.1637 => 0.2315, std.dev.: 0.0154) MultiSource/Applications/minisat/minisat: 18.35% (0.7421 => 0.8783, std.dev.: 0.0489) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.63% (4.8055 => 5.2684, std.dev.: 0.1316) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.16% (0.6792 => 0.7414, std.dev.: 0.0214) MultiSource/Benchmarks/nbench/nbench: 6.97% (1.2586 => 1.3463, std.dev.: 0.0199) MultiSource/Applications/sqlite3/sqlite3: 6.82% (15.9649 => 17.0544, std.dev.: 0.2245) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 4.66% (1.8928 => 1.9810, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.53% (0.9254 => 0.9673, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.35% (0.7085 => 0.7322, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.32% (0.9109 => 0.9411, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 30.31% (0.8637 => 1.1255, std.dev.: 0.0584) MultiSource/Applications/minisat/minisat: 26.77% (6.2432 => 7.9148, std.dev.: 0.1873) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.07% (2.3426 => 2.9532, std.dev.: 0.1283) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 18.30% (1.5683 => 1.8553, std.dev.: 0.0183) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.25% (1.2556 => 1.4848, std.dev.: 0.0222) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.79% (1.2457 => 1.3054, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.05% (4.1122 => 4.2787, std.dev.: 0.0331) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.92% (2.3111 => 2.4017, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.11% (39.0928 => 40.3080, std.dev.: 0.1221) SingleSource/Benchmarks/Misc/pi: 2.93% (2.1532 => 2.2162, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 2.32% (3.5517 => 3.6342, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 1.47% (61.9987 => 62.9118, std.dev.: 0.1378) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.46% (1.5495 => 1.5721, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.83% (24.2651 => 23.5783, std.dev.: 0.2299) SingleSource/UnitTests/Vector/constpool: -2.66% (8.8414 => 8.6066, std.dev.: 0.0807) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/CoyoteBench/lpbench: -8.84% (4.5290 => 4.1285, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout-C++/ary3: -1.53% (1.7659 => 1.7388, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.60% (1.1207 => 1.1611, std.dev.: 0.2530) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0220 => 0.0219, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.93% (0.0428 => 0.0432, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0338 => 0.0339, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0316 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0429 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0206 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -1.79% (0.0224 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.87% (0.0233 => 0.0210, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.22% (0.1440 => 0.1472, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 0.52% (1.1281 => 1.1340, std.dev.: 0.3634) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.94% (0.3945 => 0.4495, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.95% (0.1494 => 0.1420, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.41% (0.0966 => 0.0970, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.74% (0.0538 => 0.0542, std.dev.: 0.0168) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.62% (1.1543 => 1.1472, std.dev.: 0.0419) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.32% (0.0603 => 0.0583, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.29% (0.0309 => 0.0313, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (0.7426 => 0.7410, std.dev.: 0.1520) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 46.84% (0.0079 => 0.0116, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.24% (12.7900 => 12.8204, std.dev.: 0.0187) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.81% (0.0336 => 0.0500, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 34.91% (0.1716 => 0.2315, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.21% (1.8651 => 1.9810, std.dev.: 0.0235) MultiSource/Benchmarks/nbench/nbench: 5.94% (1.2708 => 1.3463, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.95% (0.9488 => 0.9673, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319975.00% (0.0008 => 2.5606, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.10% (1.1825 => 2.4017, std.dev.: 0.0118) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.31% (1.4235 => 1.4848, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/pi: 3.61% (2.1390 => 2.2162, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.69% (4.1668 => 4.2787, std.dev.: 0.0331) MultiSource/Applications/siod/siod: 1.20% (3.5910 => 3.6342, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -12.95% (9.8875 => 8.6066, std.dev.: 0.0807) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.53% (1.0986 => 0.9609, std.dev.: 0.0371) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.36% (6.4235 => 5.7580, std.dev.: 0.1197) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.21% (1.0960 => 0.9951, std.dev.: 0.0339) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.76% (0.2372 => 0.2188, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hello: -6.17% (0.1928 => 0.1809, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -6.10% (0.5134 => 0.4821, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.62% (0.2100 => 0.1982, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.24% (0.7693 => 0.7290, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout-C++/spellcheck: -5.15% (0.3981 => 0.3776, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.00% (0.3462 => 0.3289, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -4.19% (0.2551 => 0.2444, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash: -4.18% (0.4689 => 0.4493, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: -4.17% (0.2665 => 0.2554, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.94% (0.3093 => 0.2971, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -3.85% (0.2725 => 0.2620, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: -3.59% (0.3206 => 0.3091, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: -3.11% (0.6711 => 0.6502, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.53% (0.9403 => 0.9165, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -29.43% (4.4739 => 3.1571, std.dev.: 0.1171) SingleSource/Benchmarks/Shootout-C++/heapsort: -21.59% (4.2042 => 3.2966, std.dev.: 0.1210) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.02% (0.4081 => 0.3672, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/hash: -9.98% (4.5259 => 4.0741, std.dev.: 0.0367) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.45% (1.6547 => 1.5149, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/lists1: -8.03% (0.6628 => 0.6096, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.31% (4.4540 => 4.1285, std.dev.: 0.0210) SingleSource/Benchmarks/Shootout/ary3: -6.13% (2.2304 => 2.0936, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/nestedloop: -5.18% (0.2200 => 0.2086, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.97% (0.3201 => 0.3042, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -4.06% (1.8123 => 1.7388, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: -2.46% (1.4244 => 1.3893, std.dev.: 0.0136) MultiSource/Benchmarks/Bullet/bullet: -2.44% (7.2040 => 7.0282, std.dev.: 0.0411) SingleSource/Benchmarks/Misc/mandel-2: -1.60% (0.8521 => 0.8385, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.51% (3.3596 => 3.3090, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: -1.31% (8.6447 => 8.5311, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/matrix: -1.07% (2.9083 => 2.8771, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -1.06% (8.7416 => 8.6489, std.dev.: 0.0264) SingleSource/Benchmarks/Shootout/matrix: -1.03% (1.5825 => 1.5662, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.62% (1.2047 => 1.1611, std.dev.: 0.2530) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.01% (0.0233 => 0.0219, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.65% (0.0255 => 0.0210, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.79% (0.1530 => 0.1472, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: -41.22% (1.9293 => 1.1340, std.dev.: 0.3634) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.02% (0.4049 => 0.4495, std.dev.: 0.0387) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.96% (0.1510 => 0.1420, std.dev.: 0.0261) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.82% (0.0978 => 0.0970, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.14% (0.0590 => 0.0542, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.25% (1.1617 => 1.1472, std.dev.: 0.0419) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.43% (0.0610 => 0.0583, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.79% (0.0268 => 0.0313, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.36% (0.7437 => 0.7410, std.dev.: 0.1520) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 26.09% (0.0092 => 0.0116, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.33% (12.7781 => 12.8204, std.dev.: 0.0187) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 07:14:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 09:14:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124151442.71DF32A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7900?compare_to=7896&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7900, Order: 173341, Start Time: 2013-01-24 13:03:13, End Time: 2013-01-24 15:14:57 To: 7896, Order: 173331, Start Time: 2013-01-24 10:20:56, End Time: 2013-01-24 12:32:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.75% (0.1330 => 0.1340, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0666 => 0.0668, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8536 => 499.8452, std.dev.: 0.0093) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 44224.31% (1.1277 => 499.8452, std.dev.: 0.0093) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.53% (0.5229 => 1.6499, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 20.86% (14.9895 => 18.1162, std.dev.: 0.0054) MultiSource/Applications/kimwitu++/kc: 45.08% (14.1553 => 20.5359, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 18.60% (4.1105 => 4.8749, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.06% (1.1048 => 1.7352, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.42% (7.1582 => 37.6106, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.73% (3.4629 => 6.4318, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.33% (0.6222 => 1.0909, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10279.44% (0.0720 => 7.4732, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3836100.00% (0.0001 => 3.8362, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 11142300.00% (0.0001 => 11.1424, std.dev.: 0.0181) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489800.00% (0.0001 => 5.4899, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.76% (1.1194 => 10.3070, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.74% (22.1758 => 55.3815, std.dev.: 0.0359) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.41% (2.9384 => 4.6252, std.dev.: 0.0191) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.65% (7.0540 => 10.7681, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.84% (1.5859 => 2.4081, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 48.77% (0.1056 => 0.1571, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.93% (8.1363 => 11.9548, std.dev.: 0.0174) SingleSource/UnitTests/vla: 43.10% (0.0355 => 0.0508, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.19% (2.2024 => 3.1317, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 40.24% (0.3109 => 0.4360, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 39.64% (0.1062 => 0.1483, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 38.96% (21.9371 => 30.4838, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.22% (4.2646 => 5.6815, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.63% (0.4615 => 0.6121, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.42% (1.5415 => 2.0413, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.26% (0.0793 => 0.1033, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.18% (0.1143 => 0.1488, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 30.05% (0.4299 => 0.5591, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 29.89% (1.1642 => 1.5122, std.dev.: 0.0082) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.44% (0.0479 => 0.0620, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.32% (0.0730 => 0.0944, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.33% (0.5105 => 0.6551, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.16% (0.1584 => 0.2030, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.64% (0.1892 => 0.2415, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.22% (0.6675 => 0.8492, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 26.94% (0.2554 => 0.3242, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.11% (3.8922 => 4.9084, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 26.00% (9.4845 => 11.9507, std.dev.: 0.0099) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.86% (0.1566 => 0.1971, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.56% (0.1655 => 0.2078, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.51% (1.4186 => 1.7663, std.dev.: 0.0083) MultiSource/Applications/aha/aha: 24.50% (0.1151 => 0.1433, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 24.40% (1.0722 => 1.3338, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 24.27% (0.4289 => 0.5330, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.26% (0.3121 => 0.3878, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.78% (0.1695 => 0.2098, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.77% (0.1906 => 0.2359, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.64% (0.1032 => 0.1276, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 23.20% (0.4620 => 0.5692, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.11% (0.2700 => 0.3324, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 23.02% (0.1555 => 0.1913, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 22.99% (0.7115 => 0.8751, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/messages-2: 22.36% (0.0662 => 0.0810, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 22.36% (0.1163 => 0.1423, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.93% (0.1236 => 0.1507, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762) MultiSource/Applications/spiff/spiff: 21.72% (0.7835 => 0.9537, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0886 => 0.1075, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.01% (1.3050 => 1.5792, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 20.55% (0.6456 => 0.7783, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.50% (5.7591 => 6.9396, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/matrix: 20.50% (0.3098 => 0.3733, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.48% (0.8172 => 0.9846, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.14% (0.0834 => 0.1002, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.10% (0.1940 => 0.2330, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.83% (0.5860 => 0.7022, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.74% (0.0770 => 0.0922, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.69% (4.9449 => 5.9186, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 19.60% (0.7433 => 0.8890, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.16% (0.1044 => 0.1244, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.2107 => 0.2503, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.78% (5.0018 => 5.9411, std.dev.: 0.0102) MultiSource/Applications/d/make_dparser: 18.75% (3.3354 => 3.9607, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.61% (0.5020 => 0.5954, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.53% (0.2758 => 0.3269, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.45% (0.3307 => 0.3917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.5569 => 0.6591, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.08% (0.9765 => 1.1531, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.91% (0.3423 => 0.4036, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0006) MultiSource/Applications/lua/lua: 17.80% (3.8723 => 4.5616, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.80% (1.1861 => 1.3972, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 17.73% (1.1840 => 1.3939, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 17.58% (2.0273 => 2.3837, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 17.31% (2.2969 => 2.6944, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.29% (0.5981 => 0.7015, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.06% (0.3441 => 0.4028, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.71% (0.2065 => 0.2410, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.63% (0.8101 => 0.9448, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.48% (0.6450 => 0.7513, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 15.66% (0.3180 => 0.3678, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 15.66% (0.3283 => 0.3797, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 15.52% (0.2049 => 0.2367, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.49% (0.8921 => 1.0303, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 15.35% (0.3232 => 0.3728, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.26% (0.8067 => 0.9298, std.dev.: 0.0051) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 13.47% (0.3379 => 0.3834, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.33% (1.5603 => 1.7683, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.31% (0.4636 => 0.5253, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.25% (0.3865 => 0.4377, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.92% (0.4103 => 0.4633, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 12.81% (0.3092 => 0.3488, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.57% (0.1114 => 0.1254, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.02% (0.2430 => 0.2722, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 11.94% (0.3282 => 0.3674, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.90% (0.4203 => 0.4703, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.66% (17.1811 => 19.1837, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/moments: 11.51% (0.4048 => 0.4514, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3603 => 0.4013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 11.28% (0.3422 => 0.3808, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.27% (0.3826 => 0.4257, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 11.18% (0.3684 => 0.4096, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.85% (0.3427 => 0.3799, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.26% (0.4064 => 0.4481, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.25% (14.3668 => 15.8400, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/parameter-passing: 10.08% (0.3927 => 0.4323, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 9.60% (0.3886 => 0.4259, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.17% (0.1625 => 0.1774, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.11% (0.2831 => 0.3089, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.86% (0.3162 => 0.3442, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 8.83% (0.3828 => 0.4166, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.82% (1.2842 => 1.3975, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.77% (2.0665 => 2.2478, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 8.67% (63.2438 => 68.7255, std.dev.: 0.0307) SingleSource/Benchmarks/Shootout-C++/except: 8.53% (0.2871 => 0.3116, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.33% (0.3650 => 0.3954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.27% (0.2877 => 0.3115, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.3136 => 0.3395, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.23% (0.3694 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3543 => 0.3832, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 8.14% (0.3561 => 0.3851, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.12% (0.2905 => 0.3141, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.12% (0.3473 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.11% (0.3516 => 0.3801, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.07% (0.3543 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.92% (0.2891 => 0.3120, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.83% (0.2872 => 0.3097, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 7.67% (0.3052 => 0.3286, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.65% (0.3935 => 0.4236, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 7.49% (0.2802 => 0.3012, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3655, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 7.38% (0.2725 => 0.2926, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.30% (0.2793 => 0.2997, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 7.08% (0.7326 => 0.7845, std.dev.: 0.0049) SingleSource/UnitTests/ObjC++/property-reference-object: 6.92% (0.6030 => 0.6447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.84% (0.5925 => 0.6330, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 4.85% (10.3673 => 10.8700, std.dev.: 0.0116) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.01% (7.9617 => 8.1220, std.dev.: 0.0182) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4655, std.dev.: 0.0067) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6978, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.34% (1.1396 => 1.2460, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4261, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4557, std.dev.: 0.0125) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3127, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9091, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.39% (3.6395 => 3.7264, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0026) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 1.82% (2.2771 => 2.3185, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.73% (9.1159 => 9.2740, std.dev.: 0.0335) MultiSource/Benchmarks/Olden/tsp/tsp: 1.47% (1.0785 => 1.0944, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2392, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4498, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1710, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -74.97% (0.8651 => 0.2165, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.02% (5.3855 => 4.4688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.61% (5.3526 => 4.4635, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -13.51% (10.4361 => 9.0263, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.06% (1.7609 => 1.6189, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9447, std.dev.: 0.0156) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.29% (1.9577 => 0.6600, std.dev.: 0.0091) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3062, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0211, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4350, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8541, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0040, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.14% (0.6223 => 0.5032, std.dev.: 0.0047) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.16% (9.5636 => 8.4964, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.37% (19.9488 => 18.2800, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.27% (1.2373 => 1.1597, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6970, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.76% (0.4808 => 0.4579, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-5: -4.55% (1.5835 => 1.5114, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.48% (10.2830 => 9.8221, std.dev.: 0.0118) MultiSource/Applications/siod/siod: -3.84% (3.2827 => 3.1568, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9551, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3350, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7221 => 3.6764, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.6441 => 4.5874, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -9.76% (0.1485 => 0.1340, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.43% (0.2116 => 0.0668, std.dev.: 0.0016) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 07:51:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 09:51:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130124155158.D6C9F2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7901?compare_to=7894&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7901, Order: 173338, Start Time: 2013-01-24 12:17:11, End Time: 2013-01-24 15:52:13 To: 7894, Order: 173325, Start Time: 2013-01-24 07:40:34, End Time: 2013-01-24 11:25:54 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (188 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.35% (1.9920 => 2.0189, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.22% (0.2105 => 0.2236, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.58% (0.6698 => 0.6871, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.75% (54.0292 => 54.9771, std.dev.: 0.0379) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 48.48% (0.0625 => 0.0928, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.82% (0.1063 => 0.1465, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.12% (0.0331 => 0.0434, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.97% (0.0584 => 0.0759, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.77% (0.2969 => 0.3853, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.61% (0.5900 => 0.7588, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.57% (0.1106 => 0.1422, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.34% (0.0547 => 0.0702, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.24% (0.4139 => 0.5308, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.45% (0.0714 => 0.0910, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 27.23% (0.0415 => 0.0528, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.16% (0.0475 => 0.0604, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.15% (0.4994 => 0.6350, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.06% (0.4253 => 0.5404, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 26.72% (1.5932 => 2.0189, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.30% (0.1620 => 0.2046, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.08% (0.5000 => 0.6304, std.dev.: 0.0160) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.05% (0.1021 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 25.88% (0.0599 => 0.0754, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.20% (0.0897 => 0.1123, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.84% (0.1107 => 0.1382, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.79% (0.1549 => 0.1933, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.66% (0.0584 => 0.0728, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 24.58% (0.0948 => 0.1181, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.49% (0.0633 => 0.0788) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.30% (0.0642 => 0.0798, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.03% (0.1003 => 0.1244, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 24.01% (0.0808 => 0.1002, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.93% (0.1103 => 0.1367, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.84% (0.0495 => 0.0613) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.75% (0.1604 => 0.1985, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.60% (0.0822 => 0.1016, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 23.51% (0.0604 => 0.0746, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 23.51% (0.0821 => 0.1014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.44% (0.3903 => 0.4818, std.dev.: 0.0074) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.29% (0.0541 => 0.0667, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 23.29% (0.1619 => 0.1996, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.23% (0.0452 => 0.0557, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 22.74% (0.4029 => 0.4945, std.dev.: 0.0105) MultiSource/Applications/viterbi/viterbi: 22.60% (0.0947 => 0.1161) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.51% (0.0462 => 0.0566, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 22.09% (0.1218 => 0.1487, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.85% (0.3890 => 0.4740, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.82% (0.1462 => 0.1781, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.75% (0.2014 => 0.2452, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.74% (0.3271 => 0.3982, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.65% (1.3152 => 1.5999, std.dev.: 0.0309) MultiSource/Applications/aha/aha: 21.62% (0.0481 => 0.0585, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.60% (0.1088 => 0.1323, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.46% (0.2866 => 0.3481, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/mst/mst: 21.35% (0.0698 => 0.0847, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.09% (0.2736 => 0.3313, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/09-vor/vor: 20.93% (0.1505 => 0.1820, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.80% (0.0572 => 0.0691, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.27% (0.0513 => 0.0617, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 20.21% (0.2875 => 0.3456, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 20.07% (0.0573 => 0.0688, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 20.01% (3.5627 => 4.2755, std.dev.: 0.0831) MultiSource/Applications/Burg/burg: 20.00% (0.5546 => 0.6655, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.84% (0.2792 => 0.3346, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 19.82% (0.2750 => 0.3295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 19.78% (0.2811 => 0.3367) MultiSource/Benchmarks/MallocBench/gs/gs: 19.74% (1.8794 => 2.2503, std.dev.: 0.0484) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.65% (0.2911 => 0.3483, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.64% (0.4658 => 0.5573, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hello: 19.57% (0.2714 => 0.3245, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.56% (0.1968 => 0.2353, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.56% (1.6211 => 1.9382, std.dev.: 0.0281) SingleSource/Benchmarks/Shootout-C++/matrix: 19.53% (0.2780 => 0.3323, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 19.52% (0.2823 => 0.3374, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 19.48% (0.2813 => 0.3361, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 19.48% (0.2803 => 0.3349, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.44% (0.5026 => 0.6003, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.43% (0.2738 => 0.3270, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 19.41% (0.2725 => 0.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.38% (0.2729 => 0.3258, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 19.36% (0.9697 => 1.1574, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.31% (0.1160 => 0.1384, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.24% (0.0582 => 0.0694, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 19.24% (0.3004 => 0.3582, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 19.24% (0.1284 => 0.1531, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 19.15% (0.9909 => 1.1807, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.13% (2.0673 => 2.4628, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/Hello: 19.02% (0.5826 => 0.6934, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/wc: 18.99% (0.3096 => 0.3684, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 18.86% (0.1421 => 0.1689, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.75% (0.5889 => 0.6993, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 18.66% (1.0781 => 1.2793, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.64% (0.4361 => 0.5174, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 18.64% (0.3267 => 0.3876, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 18.63% (0.3258 => 0.3865, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.56% (0.3195 => 0.3788, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.45% (0.3930 => 0.4655, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.41% (0.3124 => 0.3699, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.40% (0.3060 => 0.3623, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.33% (1.9694 => 2.3303, std.dev.: 0.0452) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.25% (2.7292 => 3.2274, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/ary2: 18.24% (0.3317 => 0.3922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.22% (0.3282 => 0.3880, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 18.17% (0.3726 => 0.4403, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 17.98% (4.2109 => 4.9680, std.dev.: 0.1019) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.88% (0.3362 => 0.3963, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.80% (1.9966 => 2.3519, std.dev.: 0.0463) SingleSource/UnitTests/ObjC++/property-reference: 17.72% (0.7171 => 0.8442, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 17.71% (0.3348 => 0.3941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 17.57% (0.3477 => 0.4088, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.55% (4.4195 => 5.1951, std.dev.: 0.0465) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.52% (0.0605 => 0.0711, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 17.48% (0.3678 => 0.4321, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.41% (0.3625 => 0.4256, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 17.24% (0.4251 => 0.4984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.21% (0.3981 => 0.4666, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.06% (0.3845 => 0.4501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.02% (0.3690 => 0.4318, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.00% (0.7875 => 0.9214, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash: 16.98% (0.4146 => 0.4850, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 16.84% (1.4269 => 1.6672, std.dev.: 0.0030) MultiSource/Benchmarks/nbench/nbench: 16.80% (0.2566 => 0.2997, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: 16.64% (23.5202 => 27.4329, std.dev.: 0.0865) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.61% (0.1090 => 0.1271, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.57% (0.3488 => 0.4066, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 16.53% (0.3460 => 0.4032, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 16.48% (0.3465 => 0.4036, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 16.47% (0.3442 => 0.4009, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 16.45% (0.3496 => 0.4071, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 16.42% (0.3446 => 0.4012, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/synchronized: 16.32% (0.3469 => 0.4035, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 16.04% (0.5012 => 0.5816, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 16.00% (0.3650 => 0.4234, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 15.89% (0.3643 => 0.4222, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 15.79% (0.3724 => 0.4312, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 15.43% (2.1653 => 2.4994, std.dev.: 0.0303) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 15.30% (0.0758 => 0.0874, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 15.18% (5.5417 => 6.3829, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.16% (0.0673 => 0.0775, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 15.10% (4.6177 => 5.3150, std.dev.: 0.0528) MultiSource/Applications/SIBsim4/SIBsim4: 15.05% (0.2691 => 0.3096, std.dev.: 0.0047) MultiSource/Benchmarks/mafft/pairlocalalign: 15.05% (2.1013 => 2.4175, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.93% (0.6435 => 0.7396, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.53% (0.1383 => 0.1584, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.49% (0.1028 => 0.1177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.07% (0.2737 => 0.3122, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.92% (0.2040 => 0.2324, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.78% (0.2068 => 0.2353, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 13.26% (0.3498 => 0.3962, std.dev.: 0.0073) MultiSource/Applications/siod/siod: 13.22% (0.6634 => 0.7511, std.dev.: 0.0163) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.0804 => 0.0907, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.78% (0.3084 => 0.3478, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.46% (0.5361 => 0.6029, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.03% (0.2103 => 0.2356, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.01% (0.4847 => 0.5429, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 11.96% (0.3336 => 0.3735, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.21% (11.6398 => 12.9441, std.dev.: 0.0080) MultiSource/Applications/lemon/lemon: 11.08% (0.2391 => 0.2656, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.93% (0.7426 => 0.8238, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 10.61% (2.0346 => 2.2504, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.44% (4.6926 => 5.1827, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.76% (0.5584 => 0.6129, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 8.57% (11.9555 => 12.9798, std.dev.: 0.0224) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.86% (0.3792 => 0.4052, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.62% (29.0505 => 181.4546, std.dev.: 0.0407) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.12% (0.5917 => 0.6871, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 7.82% (0.2802 => 0.3021, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.26% (0.3693 => 0.3961, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.61% (3.3903 => 3.6144, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 5.37% (0.2122 => 0.2236, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6748, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2405, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6834, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.45% (1.8057 => 1.8861, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 2.96% (0.6276 => 0.6462, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2101, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2910, std.dev.: 0.0016) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2096, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4813, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5845, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.08% (2.4764 => 2.4249, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.90% (25.4195 => 16.5489, std.dev.: 0.0201) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.79% (17.2379 => 14.3443, std.dev.: 0.0199) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary2: -9.83% (0.2402 => 0.2166, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9783, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7913, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2170, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8087, std.dev.: 0.0100) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7735, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1808, std.dev.: 0.0285) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.13% (0.6293 => 0.6159, std.dev.: 0.0037) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5707, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1394, std.dev.: 0.0491) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0443, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 08:40:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 10:40:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124164030.08EFE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/7902?compare_to=7898&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7902, Order: 173349, Start Time: 2013-01-24 15:06:25, End Time: 2013-01-24 16:40:44 To: 7898, Order: 173341, Start Time: 2013-01-24 13:08:51, End Time: 2013-01-24 14:42:51 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (889 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.12% (0.0514 => 0.0895, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.07% (0.0974 => 0.1637, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.25% (0.1132 => 0.1599, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.19% (0.6395 => 0.8773, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.02% (0.5805 => 0.7664, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.01% (0.5688 => 0.7509, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.87% (0.6260 => 0.8255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.73% (0.5456 => 0.7187, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.53% (0.5567 => 0.7322, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.51% (0.5849 => 0.7692, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.37% (0.6395 => 0.8401, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.17% (0.5575 => 0.7313, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.98% (0.5581 => 0.7310, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.40% (0.5941 => 0.7747, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.70% (0.5859 => 0.7599, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.54% (0.6033 => 0.7815, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.96% (0.6440 => 0.8305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.28% (0.6189 => 0.7939, std.dev.: 0.0130) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.20% (1.6474 => 2.1120, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.01% (0.6676 => 0.8546, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.60% (0.6304 => 0.8044, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.06% (0.6230 => 0.7916, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.46% (0.5802 => 0.7337, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.19% (0.6660 => 0.8404, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.76% (0.5925 => 0.7451, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.68% (0.5705 => 0.7170, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.62% (0.0445 => 0.0559) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.51% (0.5857 => 0.7351, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.30% (0.5478 => 0.6864, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.28% (0.5570 => 0.6978, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.21% (0.5569 => 0.6973, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.19% (0.0790 => 0.0989) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.52% (0.5591 => 0.6962, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.79% (0.5863 => 0.7258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.78% (0.6446 => 0.7979, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.51% (0.6052 => 0.7475, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.39% (0.7524 => 0.9284, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.71% (0.6681 => 0.8198, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.44% (0.6194 => 0.7584, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.33% (0.6297 => 0.7703, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.08% (2.2587 => 2.7348, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.76% (0.6667 => 0.8051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.29% (0.7339 => 0.8755, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.82% (0.0634 => 0.0747, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.23% (0.0621 => 0.0728, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.98% (0.3357 => 0.3860, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 14.54% (1.1450 => 1.3115, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.19% (0.0864 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.18% (4.5069 => 5.0558, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4916 => 0.5502, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 11.58% (0.4515 => 0.5038, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.32% (1.6364 => 1.8217, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.25% (3.5339 => 3.9315, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.09% (0.1982 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.90% (0.2385 => 0.2621, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.32% (9.2283 => 10.0883, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.01% (0.1731 => 0.1887, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.97% (0.4524 => 0.4930, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.31% (0.4861 => 0.5265, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 8.18% (1.2515 => 1.3539, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.88% (0.5329 => 0.5749, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.7021 => 0.7544, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 7.10% (0.3255 => 0.3486, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.90% (1.4642 => 1.5652, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (1.2784 => 1.3654, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 4.56% (0.6750 => 0.7058, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.52% (0.3319 => 0.3469, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 4.41% (0.3446 => 0.3598, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.38% (5.4682 => 5.7076, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 4.27% (0.3394 => 0.3539, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 2.89% (5.0226 => 5.1680, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.75% (0.9557 => 0.9820, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.71% (1.3864 => 1.4240, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.59% (0.8418 => 0.8636, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.22% (0.7447 => 0.7612, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (22.4056 => 22.8727, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3722 => 1.3958, std.dev.: 0.0078) MultiSource/Applications/SPASS/SPASS: 1.66% (15.5079 => 15.7648, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8034, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.25% (0.9531 => 1.0317, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1491, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5477, std.dev.: 0.0436) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1062, std.dev.: 0.0094) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3809, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6102, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2680, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.7198 => 0.6867, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.27% (0.3821 => 0.3658, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.07% (2.4924 => 2.3909, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.03% (0.9852 => 0.9455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -3.85% (0.3194 => 0.3071, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.59% (0.3812 => 0.3675, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.41% (0.3896 => 0.3763, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.38% (0.3880 => 0.3749, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.37% (0.3831 => 0.3702, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -3.35% (0.3848 => 0.3719, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.34% (0.3891 => 0.3761, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.26% (0.4176 => 0.4040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.97% (0.3837 => 0.3723, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.94% (0.3884 => 0.3770, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.89% (20.7746 => 20.1742, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.84% (0.6484 => 0.6300, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -2.79% (0.4199 => 0.4082, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8908, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -2.10% (0.6347 => 0.6214, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.02% (0.7919 => 0.7759, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.94% (17.1032 => 16.7707, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference-object: -1.82% (0.6441 => 0.6324, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -1.76% (1.3148 => 1.2916, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: -1.72% (4.3330 => 4.2585, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/property-reference: -1.56% (0.7779 => 0.7658, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.56% (1.0544 => 1.0380, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.50% (16.1920 => 15.9493, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.48% (2.1713 => 2.1392, std.dev.: 0.0036) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6729, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.43% (1.2221 => 1.2046, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.35% (7.0961 => 7.0003, std.dev.: 0.0155) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.32% (1.2210 => 1.2049, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (0.7982 => 0.7879, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: -1.24% (0.9179 => 0.9065, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.17% (1.8100 => 0.6848, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.72% (0.6962 => 0.3431, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3100, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.95% (1.3643 => 1.0239, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7514, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0783, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1977, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3556, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.66% (2.2633 => 2.1804, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -3.05% (3.7241 => 3.6107, std.dev.: 0.0260) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.99% (7.9763 => 7.8179, std.dev.: 0.0052) MultiSource/Benchmarks/Bullet/bullet: -1.62% (7.3040 => 7.1860, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4711, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.33% (1.6219 => 1.6003, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5886, std.dev.: 0.0061) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 09:06:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 11:06:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124170644.4A7652A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7903?compare_to=7899&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7903, Order: 173349, Start Time: 2013-01-24 15:04:00, End Time: 2013-01-24 17:07:01 To: 7899, Order: 173341, Start Time: 2013-01-24 12:41:14, End Time: 2013-01-24 14:44:10 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (5 on baseline) Performance Improvements: 30 (48 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1031 (1010 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.05% (21.4036 => 22.4839, std.dev.: 0.3154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.20% (59.1274 => 61.0204, std.dev.: 0.4519) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.86% (40.7846 => 41.9517, std.dev.: 0.4390) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/ks/ks: -28.16% (0.2315 => 0.1663, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -26.82% (0.1335 => 0.0977, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -24.21% (0.0661 => 0.0501, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -22.97% (0.2765 => 0.2130, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -16.89% (0.2789 => 0.2318, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: -15.19% (0.8783 => 0.7449, std.dev.: 0.0268) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.45% (0.1100 => 0.0941, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.66% (0.0883 => 0.0780, std.dev.: 0.0007) MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.21% (1.2125 => 1.0766, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.72% (0.7835 => 0.6995, std.dev.: 0.0272) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.11% (1.4020 => 1.2602, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -10.06% (10.3549 => 9.3131, std.dev.: 0.1243) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.73% (1.1802 => 1.0654, std.dev.: 0.0343) MultiSource/Benchmarks/MallocBench/espresso/espresso: -9.08% (5.2684 => 4.7902, std.dev.: 0.1429) MultiSource/Applications/hexxagon/hexxagon: -7.70% (1.1333 => 1.0460, std.dev.: 0.0232) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.08% (0.7414 => 0.6889, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.05% (0.9619 => 0.8941, std.dev.: 0.0200) MultiSource/Applications/lua/lua: -6.07% (4.4340 => 4.1649, std.dev.: 0.0855) MultiSource/Benchmarks/MallocBench/gs/gs: -5.96% (4.6983 => 4.4183, std.dev.: 0.0868) MultiSource/Applications/hbd/hbd: -5.53% (1.6839 => 1.5908, std.dev.: 0.0344) MultiSource/Applications/JM/lencod/lencod: -4.65% (17.4174 => 16.6073, std.dev.: 0.1868) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.26% (0.2867 => 0.2745, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.85% (1.2741 => 1.2378, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.72% (1.0048 => 0.9775, std.dev.: 0.0104) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -31.16% (1.1255 => 0.7748, std.dev.: 0.0575) MultiSource/Applications/minisat/minisat: -21.58% (7.9148 => 6.2067, std.dev.: 0.3110) MultiSource/Benchmarks/Olden/mst/mst: -15.07% (0.1692 => 0.1437, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -14.87% (1.4848 => 1.2640, std.dev.: 0.0369) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.76% (2.5169 => 2.4727, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.37% (2.4282 => 2.3949, std.dev.: 0.0121) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.65% (1.1611 => 1.1303, std.dev.: 0.0702) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.46% (0.0219 => 0.0220, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.47% (0.0339 => 0.0344, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.32% (0.0317 => 0.0318, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0428 => 0.0429, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: -0.97% (0.0207 => 0.0205, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 5.00% (0.0220 => 0.0231, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.52% (0.0210 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.09% (0.1472 => 0.1456, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: 9.91% (1.1340 => 1.2464, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.97% (0.4495 => 0.4092, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.69% (0.1420 => 0.1515, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.62% (0.0970 => 0.0964, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.25% (0.0267 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.96% (0.0542 => 0.0596, std.dev.: 0.0109) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.30% (1.1472 => 1.1506, std.dev.: 0.0934) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.63% (0.0583 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.95% (0.0313 => 0.0285, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.12% (0.7410 => 0.7327, std.dev.: 0.1676) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.93% (0.0116 => 0.0101, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.56% (12.8204 => 12.7483, std.dev.: 0.1146) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 49.70% (0.0336 => 0.0503, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321075.00% (0.0008 => 2.5694, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.32% (1.1825 => 2.4042, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/pi: 3.27% (2.1390 => 2.2090, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 3.12% (6.8159 => 7.0285, std.dev.: 0.0631) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.61% (0.0692 => 0.0494, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: -23.29% (0.1009 => 0.0774, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: -16.11% (1.8964 => 1.5908, std.dev.: 0.0344) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.01% (0.0862 => 0.0724, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -12.84% (0.1378 => 0.1201, std.dev.: 0.0037) MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.34% (1.2154 => 1.0654, std.dev.: 0.0343) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.79% (6.4235 => 5.7301, std.dev.: 0.0662) MultiSource/Applications/lua/lua: -10.25% (4.6406 => 4.1649, std.dev.: 0.0855) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.32% (10.2703 => 9.3131, std.dev.: 0.1243) MultiSource/Applications/hexxagon/hexxagon: -8.51% (1.1433 => 1.0460, std.dev.: 0.0232) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.23% (1.1731 => 1.0766, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/health/health: -8.20% (0.1610 => 0.1478, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.59% (0.1317 => 0.1217, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.75% (0.9588 => 0.8941, std.dev.: 0.0200) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.70% (0.2283 => 0.2130, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.57% (0.2481 => 0.2318, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: -6.03% (0.1824 => 0.1714, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.61% (1.0017 => 0.9455, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.23% (0.7693 => 0.7291, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.82% (0.2884 => 0.2745, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -4.81% (0.2100 => 0.1999, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.56% (0.3462 => 0.3304, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.49% (1.0234 => 0.9775, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.40% (0.6135 => 0.5865, std.dev.: 0.0057) MultiSource/Applications/ClamAV/clamscan: -4.25% (17.4365 => 16.6958, std.dev.: 0.1641) MultiSource/Applications/SIBsim4/SIBsim4: -3.83% (1.4392 => 1.3841, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -3.43% (17.5634 => 16.9603, std.dev.: 0.1904) SingleSource/Benchmarks/Misc-C++/bigfib: -3.37% (0.6711 => 0.6485, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.75% (0.9214 => 0.8961, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.38% (1.2680 => 1.2378, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.30% (0.8990 => 0.8783, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.36% (0.9372 => 0.6527, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.37% (1.0816 => 0.7748, std.dev.: 0.0575) MultiSource/Applications/minisat/minisat: -22.31% (7.9891 => 6.2067, std.dev.: 0.3110) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.20% (1.4235 => 1.2640, std.dev.: 0.0369) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.17% (0.4081 => 0.3666, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.57% (1.4588 => 1.3483, std.dev.: 0.0364) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.43% (0.3217 => 0.2978, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: -5.67% (0.3654 => 0.3447, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.91% (23.3986 => 22.4839, std.dev.: 0.3154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.75% (1.4446 => 1.3904, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.52% (0.3349 => 0.3231, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/mandel-2: -2.41% (0.8521 => 0.8316, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3162, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.16% (3.1921 => 3.1550, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.18% (1.2047 => 1.1303, std.dev.: 0.0702) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0394 => 0.0344, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0127) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/test1: 1.76% (0.0227 => 0.0231, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0032) MultiSource/Applications/lemon/lemon: -35.40% (1.9293 => 1.2464, std.dev.: 0.0543) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.06% (0.4049 => 0.4092, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.33% (0.1510 => 0.1515, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.43% (0.0978 => 0.0964, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.02% (0.0590 => 0.0596, std.dev.: 0.0109) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.96% (1.1617 => 1.1506, std.dev.: 0.0934) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.48% (0.7437 => 0.7327, std.dev.: 0.1676) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 9.78% (0.0092 => 0.0101, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7483, std.dev.: 0.1146) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 09:57:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 11:57:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124175709.142872A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7904?compare_to=7900&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7904, Order: 173350, Start Time: 2013-01-24 15:45:44, End Time: 2013-01-24 17:57:24 To: 7900, Order: 173341, Start Time: 2013-01-24 13:03:13, End Time: 2013-01-24 15:14:57 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.67% (0.1340 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.40% (0.0668 => 0.0652, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8452 => 499.8341, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44223.32% (1.1277 => 499.8341, std.dev.: 0.0081) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.15% (0.5229 => 1.6479, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.79% (14.9895 => 18.1053, std.dev.: 0.0226) MultiSource/Applications/kimwitu++/kc: 44.88% (14.1553 => 20.5085, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/gs/gs: 18.65% (4.1105 => 4.8770, std.dev.: 0.0064) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.72% (1.1048 => 1.7314, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.92% (7.1582 => 37.5751, std.dev.: 0.0183) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.77% (3.4629 => 6.4329, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.30% (0.6222 => 1.0907, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10287.08% (0.0720 => 7.4787, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11152900.00% (0.0001 => 11.1530, std.dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490200.00% (0.0001 => 5.4903, std.dev.: 0.0281) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.37% (1.1194 => 10.3026, std.dev.: 0.0034) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.62% (22.1758 => 55.3544, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.12% (0.0929 => 0.1822, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0030) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.49% (2.9384 => 4.6277, std.dev.: 0.0019) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.77% (7.0540 => 10.7767, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.84% (1.5859 => 2.4081, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.83% (8.1363 => 11.9462, std.dev.: 0.0119) SingleSource/UnitTests/vla: 43.10% (0.0355 => 0.0508, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.28% (2.2024 => 3.1336, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/flops: 40.57% (0.1432 => 0.2013, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 40.30% (0.3109 => 0.4362, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.99% (21.9371 => 30.4895, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.30% (4.2646 => 5.6849, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.86% (1.5415 => 2.0481, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.59% (0.4615 => 0.6119, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.43% (0.2271 => 0.2962, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.10% (0.1143 => 0.1487, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.58% (1.1642 => 1.5086, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 29.45% (0.4299 => 0.5565, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.34% (0.5105 => 0.6552, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.62% (0.0793 => 0.1012, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.28% (0.6675 => 0.8496, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.89% (0.1584 => 0.2010, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.03% (0.0730 => 0.0920, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.8922 => 4.9042, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 25.97% (9.4845 => 11.9475, std.dev.: 0.0302) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.51% (0.1125 => 0.1412, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.71% (0.1566 => 0.1953, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.54% (1.4186 => 1.7667, std.dev.: 0.0079) MultiSource/Applications/lemon/lemon: 24.40% (1.0722 => 1.3338, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.22% (0.3121 => 0.3877, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash: 24.06% (0.4289 => 0.5321, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.03% (0.1906 => 0.2364, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.89% (0.1695 => 0.2100, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0842 => 0.1041, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.12% (0.4620 => 0.5688, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.85% (0.2700 => 0.3317, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 22.57% (0.7115 => 0.8721, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 22.42% (0.1151 => 0.1409, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 22.36% (0.1163 => 0.1423, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/messages-2: 22.21% (0.0662 => 0.0809, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.84% (0.1236 => 0.1506, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: 21.54% (0.1555 => 0.1890, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.38% (0.7835 => 0.9510, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.22% (0.0886 => 0.1074, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.78% (0.0871 => 0.1052, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.70% (1.3050 => 1.5752, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 20.49% (0.6456 => 0.7779, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 20.43% (0.3098 => 0.3731, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.39% (5.7591 => 6.9332, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 20.18% (0.1695 => 0.2037, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 19.63% (0.7433 => 0.8892, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.49% (0.8172 => 0.9765, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.43% (4.9449 => 5.9055, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.79% (5.0018 => 5.9414, std.dev.: 0.0076) MultiSource/Applications/d/make_dparser: 18.72% (3.3354 => 3.9598, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.70% (0.2107 => 0.2501, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.69% (0.5020 => 0.5958, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.53% (0.5569 => 0.6601, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.48% (0.3307 => 0.3918, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.15% (0.1510 => 0.1784, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.08% (0.9765 => 1.1531, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668) MultiSource/Applications/lua/lua: 17.75% (3.8723 => 4.5597, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 17.71% (1.1840 => 1.3937, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 17.64% (2.0273 => 2.3850, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.36% (1.1861 => 1.3920, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 17.21% (2.2969 => 2.6921, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.15% (0.1044 => 0.1223, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.14% (0.5981 => 0.7006, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.74% (0.3441 => 0.4017, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.28% (0.8101 => 0.9420, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.6450 => 0.7492, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 15.76% (0.2049 => 0.2372, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 15.66% (0.3283 => 0.3797, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 15.47% (0.8921 => 1.0301, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 15.41% (0.3232 => 0.3730, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.84% (0.8067 => 0.9264, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 13.41% (0.3379 => 0.3832, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.27% (0.3865 => 0.4378, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 13.23% (0.3387 => 0.3835, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.16% (0.4636 => 0.5246, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.03% (1.5603 => 1.7636, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.80% (0.4103 => 0.4628, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.10% (0.2430 => 0.2724, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.99% (0.4203 => 0.4707, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.71% (17.1811 => 19.1929, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout-C++/moments: 11.49% (0.4048 => 0.4513, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sieve: 11.38% (0.3603 => 0.4013, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.28% (0.3422 => 0.3808, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 11.18% (0.3684 => 0.4096, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.91% (0.3427 => 0.3801, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.64% (0.3826 => 0.4233, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.59% (0.1114 => 0.1232, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Puzzle: 10.49% (0.1268 => 0.1401, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.26% (0.4064 => 0.4481, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.25% (14.3668 => 15.8389, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/parameter-passing: 10.11% (0.3927 => 0.4324, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 9.60% (0.3886 => 0.4259, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/strcat: 9.29% (0.2831 => 0.3094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 8.83% (0.3828 => 0.4166, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 8.79% (2.0665 => 2.2481, std.dev.: 0.0058) MultiSource/Applications/hexxagon/hexxagon: 8.60% (1.2842 => 1.3947, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 8.60% (63.2438 => 68.6824, std.dev.: 0.0494) SingleSource/Benchmarks/Shootout-C++/except: 8.53% (0.2871 => 0.3116, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 8.40% (0.2905 => 0.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 8.31% (0.2877 => 0.3116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 8.26% (0.3694 => 0.3999, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.24% (0.3543 => 0.3835, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.16% (0.3650 => 0.3948, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.16% (0.2891 => 0.3127, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.16% (0.3543 => 0.3832, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.13% (0.3162 => 0.3419, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/trivial-interface: 8.06% (0.3473 => 0.3753, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 8.00% (0.3561 => 0.3846, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 7.98% (0.3497 => 0.3776, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 7.94% (0.3516 => 0.3795, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 7.80% (0.3052 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.75% (0.3935 => 0.4240, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 7.66% (0.2756 => 0.2967, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.59% (0.2872 => 0.3090, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 7.57% (0.2802 => 0.3014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.52% (0.2793 => 0.3003, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (0.2725 => 0.2929, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.37% (2.2022 => 2.3645, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.37% (0.3136 => 0.3367, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hello: 7.26% (0.2714 => 0.2911, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 7.17% (0.7326 => 0.7851, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/property-reference-object: 7.03% (0.6030 => 0.6454, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 6.80% (0.5925 => 0.6328, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.65% (0.1625 => 0.1733, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.82% (0.3177 => 0.3362, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.84% (10.3673 => 10.8694, std.dev.: 0.0144) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.06% (7.9617 => 8.1259, std.dev.: 0.0099) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4732, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4276, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4490, std.dev.: 0.0045) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3120, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.57% (0.9957 => 1.0312, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9076, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (3.6395 => 3.7239, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.82% (9.1159 => 9.2814, std.dev.: 0.0236) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2371, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.21% (10.3460 => 10.4714, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5755, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1685, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.88% (5.2763 => 1.1672, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/salsa20: -74.95% (0.8651 => 0.2167, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.19% (5.3855 => 4.4597, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.62% (5.3526 => 4.4629, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: -13.59% (10.4361 => 9.0174, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.19% (1.7609 => 1.6167, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9692, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.95% (1.9577 => 0.6665, std.dev.: 0.0094) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0227, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4324, std.dev.: 0.0113) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8489, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0920, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1248, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4223, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.13% (3.1443 => 2.7313, std.dev.: 0.0025) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.32% (19.9488 => 18.2881, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.81% (1.2373 => 1.1530, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.07% (1.6805 => 1.5785, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7048, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0047) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8376, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5854, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/ary3: -1.06% (3.6994 => 3.6603, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0058) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0009) Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 10:38:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 12:38:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124183832.52E5B2A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7905?compare_to=7902&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7905, Order: 173356, Start Time: 2013-01-24 17:04:19, End Time: 2013-01-24 18:38:48 To: 7902, Order: 173349, Start Time: 2013-01-24 15:06:25, End Time: 2013-01-24 16:40:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (107 on baseline) Performance Improvements: 1 (98 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 1.20% (3.6107 => 3.6541, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -5.98% (0.4131 => 0.3884, std.dev.: 0.0064) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 85.36% (0.0280 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 73.74% (0.0514 => 0.0893, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.97% (0.0974 => 0.1636, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 49.44% (0.0267 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.17% (0.1132 => 0.1598, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.31% (0.6395 => 0.8781, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.47% (0.0699 => 0.0926, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.18% (0.5805 => 0.7673, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.07% (0.5688 => 0.7512, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.93% (0.6260 => 0.8259, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.84% (0.5456 => 0.7193, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.56% (0.5849 => 0.7695, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.51% (0.5567 => 0.7321, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.35% (0.6395 => 0.8400, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.26% (0.5575 => 0.7318, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.07% (0.5581 => 0.7315, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.78% (0.5859 => 0.7604, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.85% (0.6440 => 0.8298, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.26% (0.6189 => 0.7938, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.99% (1.6474 => 2.1085, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.98% (0.6676 => 0.8544, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.70% (0.6304 => 0.8050, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.06% (0.6230 => 0.7916, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.35% (0.5802 => 0.7331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.20% (0.6660 => 0.8405, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.66% (0.5705 => 0.7169, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.62% (0.5925 => 0.7443, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.61% (0.5857 => 0.7357, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.39% (0.0445 => 0.0558, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.25% (0.5569 => 0.6975, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.25% (0.5478 => 0.6861, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.15% (0.5570 => 0.6971, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.06% (0.0790 => 0.0988, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.59% (0.5591 => 0.6966, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.76% (0.5863 => 0.7256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.58% (0.6446 => 0.7966, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.50% (0.6052 => 0.7474, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.48% (0.7524 => 0.9291, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.02% (0.0582 => 0.0716, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.63% (0.6681 => 0.8193, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.46% (0.6194 => 0.7585, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.25% (0.6297 => 0.7698, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.14% (2.2587 => 2.7362, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.90% (0.0622 => 0.0752, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.78% (0.0693 => 0.0837, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.74% (0.6667 => 0.8050, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.31% (0.7339 => 0.8756, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.67% (0.0634 => 0.0746, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.07% (0.0621 => 0.0727, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.81% (0.0833 => 0.0973, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.32% (0.1146 => 0.1333, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3357 => 0.3856, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.41% (1.1450 => 1.3100, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.17% (4.5069 => 5.0556, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/05-eks/eks: 12.09% (0.4515 => 0.5061, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.72% (0.4916 => 0.5492, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.27% (1.6364 => 1.8209, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.05% (3.5339 => 3.9245, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.34% (0.1982 => 0.2187, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.13% (9.2283 => 10.0707, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.78% (0.1731 => 0.1883, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.07% (0.4524 => 0.4889, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 7.87% (1.2515 => 1.3500, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (0.4861 => 0.5231, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.21% (0.7021 => 0.7527, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.75% (1.4642 => 1.5631, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.74% (1.2784 => 1.3646, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.51% (0.3255 => 0.3467, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.64% (0.3319 => 0.3473, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.18% (5.4682 => 5.6967, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6750 => 0.7032, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.60% (0.3446 => 0.3570, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.78% (1.3864 => 1.4250, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 2.76% (5.0226 => 5.1610, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.33% (0.9557 => 0.9780, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.14% (0.7447 => 0.7606, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (22.4056 => 22.8087, std.dev.: 0.0095) MultiSource/Applications/SPASS/SPASS: 1.62% (15.5079 => 15.7599, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.54% (1.3722 => 1.3934, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7950, std.dev.: 0.0136) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9531 => 1.0284, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.42% (54.5751 => 56.4435, std.dev.: 0.0672) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1018, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (27.8210 => 28.3854, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.75% (4.5320 => 4.6113, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0050) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4573, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.72% (0.1281 => 0.1118, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.53% (0.7198 => 0.6872, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.08% (0.3821 => 0.3665, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.06% (0.9852 => 0.9452, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -4.05% (2.4924 => 2.3914, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.69% (0.3142 => 0.3026, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/trivial-interface: -3.65% (0.3812 => 0.3673, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3848 => 0.3713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3831 => 0.3697, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3880 => 0.3745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.47% (0.4033 => 0.3893, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3896 => 0.3761, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.32% (0.3891 => 0.3762, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.30% (0.4176 => 0.4038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -3.03% (20.7746 => 20.1458, std.dev.: 0.0576) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.86% (0.3884 => 0.3773, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.6484 => 0.6306, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.49% (1.3148 => 1.2820, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.38% (2.1713 => 2.1196, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.22% (14.2083 => 13.8922, std.dev.: 0.0173) MultiSource/Applications/sqlite3/sqlite3: -2.00% (17.1032 => 16.7615, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.96% (0.7919 => 0.7764, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.85% (4.3330 => 4.2530, std.dev.: 0.0168) SingleSource/UnitTests/ObjC++/Hello: -1.70% (0.6347 => 0.6239, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.66% (16.1920 => 15.9234, std.dev.: 0.0219) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.48% (1.2221 => 1.2040, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (6.7716 => 6.6738, std.dev.: 0.0230) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.42% (1.2210 => 1.2037, std.dev.: 0.0061) MultiSource/Applications/lambda-0_1_3/lambda: -1.42% (0.7982 => 0.7869, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: -1.41% (0.9179 => 0.9050, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: -1.38% (0.7779 => 0.7672, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: -1.37% (7.0961 => 6.9987, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.14% (1.8100 => 0.7033, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7488, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0796, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1991, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.37% (2.5106 => 2.1248, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3548, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.29% (0.5142 => 0.4613, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.28% (1.3096 => 1.2666, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.23% (1.0557 => 1.0216, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (7.9763 => 7.7552, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.88% (3.7241 => 3.6541, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.58% (1.6219 => 1.5962, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.55% (1.6307 => 1.6055, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.3040 => 7.1927, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.34% (3.7092 => 3.6594, std.dev.: 0.0172) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 11:24:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 13:24:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124192452.080F32A6C06A@llvm.org> http://llvm.org/perf/db_default/v4/nts/7906?compare_to=7903&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7906, Order: 173360, Start Time: 2013-01-24 17:26:51, End Time: 2013-01-24 19:25:09 To: 7903, Order: 173349, Start Time: 2013-01-24 15:04:00, End Time: 2013-01-24 17:07:01 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (7 on baseline) Performance Improvements: 23 (139 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1033 (917 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.30% (1.0654 => 1.0899, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.39% (1.0432 => 1.0577, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: 1.08% (2.5642 => 2.5920, std.dev.: 0.0079) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sgefa/sgefa: 20.48% (0.3511 => 0.4230, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.39% (2.4127 => 2.6392, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.73% (6.8713 => 7.1964, std.dev.: 0.0680) SingleSource/Benchmarks/Misc/flops: 2.26% (8.6649 => 8.8611, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: 1.99% (0.5174 => 0.5277, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (0.8393 => 0.7855, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -6.01% (16.9603 => 15.9408, std.dev.: 0.0421) MultiSource/Applications/hbd/hbd: -5.27% (1.5908 => 1.5070, std.dev.: 0.0182) MultiSource/Applications/ClamAV/clamscan: -4.19% (16.6958 => 15.9964, std.dev.: 0.0626) MultiSource/Applications/hexxagon/hexxagon: -3.59% (1.0460 => 1.0084, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -3.47% (7.4349 => 7.1766, std.dev.: 0.0267) MultiSource/Benchmarks/McCat/18-imp/imp: -3.31% (0.3892 => 0.3763, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/football/football: -3.16% (0.9953 => 0.9638, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: -2.80% (5.4191 => 5.2676, std.dev.: 0.0283) MultiSource/Applications/lemon/lemon: -2.47% (1.3410 => 1.3079, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: -1.81% (2.2157 => 2.1757, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.71% (0.9911 => 0.9742, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.50% (0.9205 => 0.9067, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.45% (0.8923 => 0.8794, std.dev.: 0.0040) MultiSource/Applications/JM/lencod/lencod: -1.29% (16.6073 => 16.3927, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.28% (1.0112 => 0.9983, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.48% (2.6415 => 2.3647, std.dev.: 0.0953) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.20% (5.0140 => 4.8032, std.dev.: 0.0800) MultiSource/Applications/SPASS/SPASS: -2.47% (8.6799 => 8.4652, std.dev.: 0.0551) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.45% (61.0204 => 59.5244, std.dev.: 0.5403) SingleSource/Benchmarks/Misc/himenobmtxpa: -2.23% (4.2368 => 4.1424, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.08% (22.4839 => 22.0171, std.dev.: 0.1364) MultiSource/Applications/SIBsim4/SIBsim4: -1.66% (3.4753 => 3.4176, std.dev.: 0.0085) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.60% (1.1303 => 1.1235, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0220 => 0.0220, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0431 => 0.0429, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.91% (0.0344 => 0.0334, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.63% (0.0318 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0429 => 0.0426, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -5.63% (0.0231 => 0.0218, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.43% (0.0230 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 3.43% (0.1456 => 0.1506, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -10.08% (1.2464 => 1.1208, std.dev.: 0.0354) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.91% (0.4092 => 0.3932, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.58% (0.1515 => 0.1491, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.77% (0.0964 => 0.1010, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0273 => 0.0275, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.51% (0.0596 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.37% (1.1506 => 1.1548, std.dev.: 0.0368) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.42% (0.0285 => 0.0309, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.09% (0.7327 => 0.7407, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.40% (0.0101 => 0.0040, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.11% (12.7483 => 12.7622, std.dev.: 0.0256) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320412.50% (0.0008 => 2.5641, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 107.51% (1.1825 => 2.4538, std.dev.: 0.0775) MultiSource/Applications/sgefa/sgefa: 20.34% (0.3515 => 0.4230, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.40% (0.2562 => 0.2854, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/pi: 3.58% (2.1390 => 2.2155, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.78% (7.0016 => 7.1964, std.dev.: 0.0680) MultiSource/Applications/siod/siod: 1.07% (3.5910 => 3.6294, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.61% (0.0808 => 0.0496, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0007) SingleSource/Benchmarks/SmallPT/smallpt: -26.22% (0.1888 => 0.1393, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.40% (0.1684 => 0.1290, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.93% (0.0676 => 0.0521, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -20.53% (1.8964 => 1.5070, std.dev.: 0.0182) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.52% (0.1009 => 0.0802, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -19.37% (0.0862 => 0.0695, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.98% (0.1079 => 0.0885, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.69% (0.7686 => 0.6403, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.36% (1.0960 => 0.9277, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.26% (0.4074 => 0.3493, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.19% (1.0986 => 0.9427, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -13.21% (1.0220 => 0.8870, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: -12.30% (1.5979 => 1.4014, std.dev.: 0.0112) MultiSource/Applications/treecc/treecc: -11.98% (2.4719 => 2.1757, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.92% (0.0847 => 0.0746, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -11.80% (1.1433 => 1.0084, std.dev.: 0.0105) MultiSource/Applications/aha/aha: -11.32% (0.1378 => 0.1222, std.dev.: 0.0007) MultiSource/Applications/lua/lua: -11.00% (4.6406 => 4.1300, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.63% (0.7693 => 0.6875, std.dev.: 0.0095) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.33% (1.2154 => 1.0899, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.01% (1.5131 => 1.3617, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.87% (10.2703 => 9.2569, std.dev.: 0.0838) MultiSource/Applications/siod/siod: -9.32% (2.6437 => 2.3973, std.dev.: 0.0227) MultiSource/Applications/sqlite3/sqlite3: -9.24% (17.5634 => 15.9408, std.dev.: 0.0421) MultiSource/Applications/lambda-0_1_3/lambda: -9.22% (0.8653 => 0.7855, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: -9.03% (0.3598 => 0.3273, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.01% (1.6874 => 1.5353, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.83% (1.3924 => 1.2694, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -8.55% (0.6885 => 0.6296, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: -8.39% (0.1610 => 0.1475, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: -8.26% (17.4365 => 15.9964, std.dev.: 0.0626) MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.09% (1.1731 => 1.0782, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.06% (0.3560 => 0.3273, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -8.01% (0.9124 => 0.8393, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.01% (1.1498 => 1.0577, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.82% (0.1317 => 0.1214, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.62% (0.2283 => 0.2109, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.54% (0.5746 => 0.5313, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.25% (0.2372 => 0.2200, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: -7.18% (3.7840 => 3.5122, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.17% (0.2481 => 0.2303, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -6.44% (1.3979 => 1.3079, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.06% (0.9588 => 0.9007, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: -6.03% (0.1824 => 0.1714, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.81% (0.2618 => 0.2466, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.52% (0.2100 => 0.1984, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.45% (1.8127 => 1.7139, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.36% (1.0017 => 0.9480, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: -5.29% (0.1928 => 0.1826, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.15% (0.4002 => 0.3796, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash2: -5.14% (0.5134 => 0.4870, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.94% (1.3310 => 1.2653, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.89% (0.7693 => 0.7317, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: -4.79% (4.5936 => 4.3735, std.dev.: 0.0469) MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.76% (5.0381 => 4.7983, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.66% (0.9550 => 0.9105, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/except: -4.65% (0.2172 => 0.2071, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.51% (1.0234 => 0.9772, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: -4.44% (0.7776 => 0.7431, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: -4.41% (1.4392 => 1.3757, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.15% (4.6579 => 4.4645, std.dev.: 0.0250) SingleSource/Benchmarks/Shootout-C++/ary: -4.12% (0.2551 => 0.2446, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.07% (0.6135 => 0.5885, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.02% (0.2884 => 0.2768, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.91% (0.9507 => 0.9135, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: -3.88% (0.3715 => 0.3571, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.87% (0.5369 => 0.5161, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.85% (3.6295 => 3.4896, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.85% (0.9422 => 0.9059, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: -3.73% (18.9377 => 18.2322, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.65% (0.9127 => 0.8794, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.59% (0.9405 => 0.9067, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (1.3220 => 1.2745, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.31% (0.8990 => 0.8692, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: -3.31% (16.4479 => 15.9033, std.dev.: 0.0464) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.21% (1.2680 => 1.2273, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.20% (0.9512 => 0.9208, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.08% (0.9403 => 0.9113, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.08% (1.0052 => 0.9742, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -3.07% (0.9091 => 0.8812, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.99% (0.3981 => 0.3862, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.92% (0.9993 => 0.9701, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.84% (0.9788 => 0.9510, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.65% (7.2721 => 7.0793, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.65% (14.9757 => 14.5788, std.dev.: 0.0712) MultiSource/Applications/JM/ldecod/ldecod: -2.40% (7.3529 => 7.1766, std.dev.: 0.0267) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.32% (0.6996 => 0.6834, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.23% (0.4762 => 0.4656, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.08% (1.0860 => 1.0634, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.00% (4.8904 => 4.7924, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.97% (0.9685 => 0.9494, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.87% (4.9104 => 4.8188, std.dev.: 0.0325) MultiSource/Applications/JM/lencod/lencod: -1.85% (16.7012 => 16.3927, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.82% (1.0119 => 0.9935, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: -1.64% (5.3553 => 5.2676, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/football/football: -1.24% (0.9759 => 0.9638, std.dev.: 0.0026) MultiSource/Benchmarks/nbench/nbench: -1.05% (1.2708 => 1.2575, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.04% (1.0088 => 0.9983, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.18% (0.9372 => 0.6450, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.62% (1.0816 => 0.7721, std.dev.: 0.0398) MultiSource/Applications/minisat/minisat: -22.46% (7.9891 => 6.1948, std.dev.: 0.0077) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.16% (1.5623 => 1.2629, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.83% (2.8778 => 2.3647, std.dev.: 0.0953) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.18% (1.4235 => 1.2644, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: -9.99% (0.1491 => 0.1342, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -9.55% (4.5259 => 4.0936, std.dev.: 0.1584) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.77% (1.6547 => 1.5096, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout-C++/lists1: -8.45% (0.6628 => 0.6068, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.43% (0.4081 => 0.3737, std.dev.: 0.0093) MultiSource/Applications/SPASS/SPASS: -6.62% (9.0650 => 8.4652, std.dev.: 0.0551) MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3654 => 0.3426, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.07% (46.0987 => 43.2987, std.dev.: 0.5063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.90% (23.3986 => 22.0171, std.dev.: 0.1364) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.44% (0.3201 => 0.3027, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.54% (0.3349 => 0.3197, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/ary3: -4.16% (2.2304 => 2.1376, std.dev.: 0.0359) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.79% (1.4446 => 1.3899, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.74% (1.0995 => 1.0584, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: -3.57% (3.5443 => 3.4176, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.52% (40.4729 => 39.0469, std.dev.: 0.1929) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.35% (0.3406 => 0.3292, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: -2.96% (63.1520 => 61.2836, std.dev.: 0.3188) SingleSource/Benchmarks/McGill/chomp: -2.94% (1.0425 => 1.0118, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/lists: -2.82% (17.2182 => 16.7323, std.dev.: 0.1450) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.48% (61.0379 => 59.5244, std.dev.: 0.5403) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.45% (4.0355 => 3.9365, std.dev.: 0.0275) MultiSource/Applications/spiff/spiff: -2.39% (2.8571 => 2.7887, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.35% (0.5826 => 0.5689, std.dev.: 0.0035) MultiSource/Applications/lua/lua: -2.27% (29.0327 => 28.3732, std.dev.: 0.1753) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.17% (3.0082 => 2.9429, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: -1.52% (8.6447 => 8.5133, std.dev.: 0.0398) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.51% (3.7662 => 3.7092, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/mandel-2: -1.46% (0.8521 => 0.8397, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.17% (3.1921 => 3.1549, std.dev.: 0.0067) MultiSource/Applications/aha/aha: -1.01% (3.5321 => 3.4964, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.74% (1.2047 => 1.1235, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.66% (0.0328 => 0.0316, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.27% (0.0445 => 0.0426, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -3.96% (0.0227 => 0.0218, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.57% (0.1530 => 0.1506, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -41.91% (1.9293 => 1.1208, std.dev.: 0.0354) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.89% (0.4049 => 0.3932, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.26% (0.1510 => 0.1491, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.27% (0.0978 => 0.1010, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0590 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.59% (1.1617 => 1.1548, std.dev.: 0.0368) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.30% (0.0268 => 0.0309, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.7437 => 0.7407, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionBitfields: -62.50% (0.0008 => 0.0003, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.52% (0.0092 => 0.0040, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (12.7781 => 12.7622, std.dev.: 0.0256) Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 12:19:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 14:19:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130124201953.47A712A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7907?compare_to=7901&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7907, Order: 173355, Start Time: 2013-01-24 16:45:12, End Time: 2013-01-24 20:20:09 To: 7901, Order: 173338, Start Time: 2013-01-24 12:17:11, End Time: 2013-01-24 15:52:13 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (188 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.37% (1.1574 => 1.1416, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (2.4628 => 2.4362, std.dev.: 0.0089) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.88% (0.0625 => 0.0943, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 44.21% (0.1063 => 0.1533, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 39.76% (0.0415 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 30.79% (0.1549 => 0.2026, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 30.11% (0.1106 => 0.1439, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.47% (0.2969 => 0.3844, std.dev.: 0.0143) SingleSource/UnitTests/Vector/SSE/sse_shift: 28.69% (0.0352 => 0.0453, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.15% (0.0547 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.91% (0.4253 => 0.5440, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.86% (0.4139 => 0.5292, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.78% (0.5900 => 0.7539, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.87% (0.4994 => 0.6336, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.79% (0.1620 => 0.2054, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.64% (0.0642 => 0.0813, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.59% (1.5932 => 2.0169, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.44% (0.5000 => 0.6322, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.95% (0.3903 => 0.4916, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 25.71% (0.0599 => 0.0753, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.31% (0.0897 => 0.1124, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.24% (0.1462 => 0.1831, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.17% (0.1021 => 0.1278, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 24.74% (0.2866 => 0.3575, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.12% (0.1107 => 0.1374, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 23.97% (0.1619 => 0.2007, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.75% (0.1103 => 0.1365, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.75% (0.1604 => 0.1985, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 23.34% (0.0604 => 0.0745) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.33% (0.1003 => 0.1237, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.99% (0.0822 => 0.1011, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 22.78% (0.0821 => 0.1008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.34% (0.0582 => 0.0712, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.08% (0.2736 => 0.3340, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.07% (0.3271 => 0.3993, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 21.96% (0.0947 => 0.1155, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.77% (0.4029 => 0.4906, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 21.41% (0.0808 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 21.33% (0.1505 => 0.1826, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.19% (1.3152 => 1.5939, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.14% (0.1088 => 0.1318, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 21.10% (0.1218 => 0.1475, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.00% (0.4658 => 0.5636, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/mst/mst: 20.92% (0.0698 => 0.0844, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.90% (0.2014 => 0.2435, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.59% (0.3890 => 0.4691, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/gs/gs: 20.39% (1.8794 => 2.2626, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 20.36% (3.5627 => 4.2880, std.dev.: 0.0520) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.08% (0.0513 => 0.0616, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 19.73% (0.5546 => 0.6640, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.36% (1.6211 => 1.9350, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.36% (0.1968 => 0.2349, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.97% (0.1160 => 0.1380, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 18.85% (0.1284 => 0.1526, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.66% (1.0781 => 1.2793, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 18.66% (0.5826 => 0.6913, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.54% (0.2875 => 0.3408, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.46% (0.5026 => 0.5954, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.39% (0.4361 => 0.5163, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/18-imp/imp: 18.37% (0.1421 => 0.1682, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 18.29% (0.5889 => 0.6966, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.27% (0.2792 => 0.3302, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 18.22% (0.2075 => 0.2453, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 18.18% (0.2750 => 0.3250, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 18.14% (0.2811 => 0.3321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 18.12% (0.2803 => 0.3311, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 18.10% (0.2823 => 0.3334) SingleSource/Benchmarks/Shootout-C++/matrix: 18.09% (0.2780 => 0.3283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 17.98% (0.2714 => 0.3202, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 17.96% (0.9909 => 1.1689, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: 17.95% (0.2813 => 0.3318, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.93% (0.2911 => 0.3433, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 17.92% (0.7171 => 0.8456, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.90% (0.2738 => 0.3228, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.86% (0.3930 => 0.4632, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.84% (2.0673 => 2.4362, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/fibo: 17.83% (0.2725 => 0.3211, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.78% (0.3060 => 0.3604, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 17.78% (0.3004 => 0.3538, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.77% (0.2729 => 0.3214, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.73% (0.9697 => 1.1416, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 17.67% (4.2109 => 4.9549, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.62% (1.9694 => 2.3164, std.dev.: 0.0390) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.48% (2.7292 => 3.2064, std.dev.: 0.0205) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.46% (0.3195 => 0.3753, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.46% (1.9966 => 2.3453, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.43% (4.4195 => 5.1900, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wc: 17.41% (0.3096 => 0.3635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 17.20% (0.3267 => 0.3829, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 17.10% (0.3258 => 0.3815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.90% (0.3124 => 0.3652, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 16.87% (0.2566 => 0.2999, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 16.82% (0.3317 => 0.3875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 16.72% (0.3726 => 0.4349, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.61% (23.5202 => 27.4264, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.58% (0.3282 => 0.3826, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.54% (0.3362 => 0.3918, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: 16.46% (0.3348 => 0.3899, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.44% (1.4269 => 1.6615, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 16.36% (0.3477 => 0.4046, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.33% (0.3845 => 0.4473, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.22% (0.3625 => 0.4213, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 16.18% (0.3678 => 0.4273, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.03% (0.3981 => 0.4619, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.03% (0.7875 => 0.9137, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.93% (0.3690 => 0.4278, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.93% (0.3465 => 0.4017, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 15.90% (0.4251 => 0.4927, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.87% (0.4146 => 0.4804, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.68% (0.3496 => 0.4044, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.26% (0.3446 => 0.3972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.19% (0.3469 => 0.3996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.17% (0.3460 => 0.3985, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 15.11% (0.3442 => 0.3962, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 15.02% (0.5012 => 0.5765, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 14.91% (0.0758 => 0.0871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.85% (0.3650 => 0.4192, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.84% (2.1653 => 2.4867, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.80% (0.0804 => 0.0923, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 14.80% (5.5417 => 6.3619, std.dev.: 0.0094) MultiSource/Applications/SIBsim4/SIBsim4: 14.75% (0.2691 => 0.3088, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions: 14.74% (0.3643 => 0.4180, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.63% (0.3724 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 14.38% (2.1013 => 2.4034, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.19% (0.6435 => 0.7348, std.dev.: 0.0053) MultiSource/Applications/JM/lencod/lencod: 14.18% (4.6177 => 5.2723, std.dev.: 0.0132) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.11% (0.1028 => 0.1173, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.82% (0.2040 => 0.2322, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.67% (0.1383 => 0.1572, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.66% (0.2737 => 0.3111, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.54% (0.2068 => 0.2348, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.80% (0.5361 => 0.6047, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 12.49% (0.3498 => 0.3935, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.26% (0.3084 => 0.3462, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 12.26% (0.6634 => 0.7447, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 12.14% (0.3336 => 0.3741, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.98% (0.2103 => 0.2355, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 11.62% (0.4847 => 0.5410, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.27% (0.7426 => 0.8263, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 11.04% (0.2391 => 0.2655, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.85% (11.6398 => 12.9030, std.dev.: 0.0279) MultiSource/Applications/sqlite3/sqlite3: 10.65% (2.0346 => 2.2513, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.18% (4.6926 => 5.1701, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.99% (0.5584 => 0.6142, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.33% (11.9555 => 12.9513, std.dev.: 0.0146) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.93% (0.3792 => 0.4017, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5218, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0293) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0088) MultiSource/Applications/ClamAV/clamscan: 8.49% (0.2802 => 0.3040, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.99% (0.3693 => 0.3988, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 5.84% (0.2122 => 0.2246, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2408, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6734, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-2: 4.92% (1.8057 => 1.8945, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6806, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: 3.08% (0.6276 => 0.6469, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1896, std.dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3015, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2858, std.dev.: 0.0030) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0824, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.12% (3.1722 => 3.2078, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5389, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5924, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4771, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5850, std.dev.: 0.0123) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.68% (17.2379 => 14.1908, std.dev.: 0.1299) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9768, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8031, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.62% (14.0481 => 13.3989, std.dev.: 0.1587) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2257, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8071, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1234, std.dev.: 0.0647) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5715, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1323, std.dev.: 0.0675) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 12:36:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 14:36:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124203637.4D2BC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7908?compare_to=7905&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7908, Order: 173360, Start Time: 2013-01-24 19:02:29, End Time: 2013-01-24 20:36:53 To: 7905, Order: 173356, Start Time: 2013-01-24 17:04:19, End Time: 2013-01-24 18:38:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (106 on baseline) Performance Improvements: 3 (83 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (903 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.30% (1.5663 => 1.5459, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.65% (0.3256 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: -1.58% (3.8218 => 3.7614, std.dev.: 0.0152) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.32% (0.0514 => 0.0896, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 45.27% (0.1500 => 0.2179, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.11% (0.6395 => 0.8768, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.33% (0.0699 => 0.0925, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.87% (0.5688 => 0.7501, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.83% (0.5805 => 0.7653, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.68% (0.6260 => 0.8243, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.56% (0.5456 => 0.7178, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.46% (0.5849 => 0.7689, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.29% (0.5567 => 0.7309, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.20% (0.6395 => 0.8390, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.03% (0.5575 => 0.7305, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.77% (0.5581 => 0.7298, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.11% (0.5941 => 0.7730, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.48% (0.5859 => 0.7586, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.27% (0.6033 => 0.7799, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.70% (0.6440 => 0.8288, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.07% (1.6474 => 2.1099, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.00% (0.6189 => 0.7922, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.77% (0.6676 => 0.8530, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.46% (0.6304 => 0.8035, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.13% (0.6230 => 0.7920, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.28% (0.6660 => 0.8410, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.18% (0.5802 => 0.7321, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.67% (0.5925 => 0.7446, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.42% (0.5705 => 0.7155, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.32% (0.0790 => 0.0990, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.28% (0.5478 => 0.6863, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.25% (0.5569 => 0.6975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.20% (0.5857 => 0.7333, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.99% (0.5570 => 0.6962, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.38% (0.5591 => 0.6954, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.61% (0.5863 => 0.7247, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.35% (0.6052 => 0.7465, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.31% (0.7524 => 0.9278, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.27% (0.6446 => 0.7946, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.72% (0.6681 => 0.8199, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.42% (0.6194 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.03% (0.6297 => 0.7684, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.07% (2.2587 => 2.7345, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.65% (0.6667 => 0.8044, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.20% (0.7339 => 0.8748, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 14.86% (0.3357 => 0.3856, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 14.46% (1.1450 => 1.3106, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.49% (4.5069 => 5.0698, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.06% (0.4916 => 0.5509, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4515 => 0.5056, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.39% (1.6364 => 1.8228, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.12% (3.5339 => 3.9270, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.44% (0.1982 => 0.2189, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.10% (0.2385 => 0.2626, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.20% (9.2283 => 10.0775, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash: 8.78% (0.4524 => 0.4921, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.45% (0.2001 => 0.2170, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.25% (1.2515 => 1.3547, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 7.74% (0.4861 => 0.5237, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.69% (0.5329 => 0.5739, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.23% (1.4642 => 1.5700, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.18% (0.7021 => 0.7525, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.85% (1.2784 => 1.3660, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.64% (0.3255 => 0.3471, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.21% (0.3319 => 0.3492, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6750 => 0.7025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (5.4682 => 5.6845, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.89% (0.3446 => 0.3580, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3394 => 0.3518, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 2.98% (5.0226 => 5.1725, std.dev.: 0.0106) MultiSource/Applications/spiff/spiff: 2.95% (0.8418 => 0.8666, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 2.72% (1.3864 => 1.4241, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.27% (0.9557 => 0.9774, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.15% (0.7447 => 0.7607, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 1.85% (15.5079 => 15.7949, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.3722 => 1.3952, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.60% (22.4056 => 22.7635, std.dev.: 0.0154) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.2300 => 1.2436, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8144, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0149) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.6767 => 12.1386, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5751 => 56.4361, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0074) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2455, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5968, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (5.1955 => 5.2677, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.28% (0.7198 => 0.6890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -4.08% (2.4924 => 2.3906, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.89% (0.9852 => 0.9469, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.9542 => 0.9279, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.70% (0.6484 => 0.6309, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2743, std.dev.: 0.0293) MultiSource/Applications/hexxagon/hexxagon: -2.23% (1.3148 => 1.2855, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -2.23% (17.1032 => 16.7225, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.17% (14.2083 => 13.9001, std.dev.: 0.0079) SingleSource/UnitTests/ObjC++/Hello: -2.00% (0.6347 => 0.6220, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.94% (2.1713 => 2.1292, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference-object: -1.71% (0.6441 => 0.6331, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.65% (0.7919 => 0.7788, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: -1.48% (4.3330 => 4.2688, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: -1.47% (16.1920 => 15.9534, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: -1.45% (0.7779 => 0.7666, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.42% (1.0544 => 1.0394, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.24% (6.7716 => 6.6876, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (1.2210 => 1.2061, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0138, std.dev.: 0.0066) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.52% (1.8100 => 0.6965, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3139, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -24.94% (1.3643 => 1.0241, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0804, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1973, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.83% (0.6299 => 0.5050, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1330, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0918, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3531, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.16% (0.3273 => 0.3137, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.42% (7.9763 => 7.7831, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.24% (3.1919 => 3.1203, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.68% (7.3040 => 7.1814, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.46% (6.5735 => 6.4772, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6219 => 1.5983, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7092 => 3.6606, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6101, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 12:38:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 14:38:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124203850.AC1902A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7909?compare_to=7904&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7909, Order: 173360, Start Time: 2013-01-24 18:28:13, End Time: 2013-01-24 20:39:05 To: 7904, Order: 173350, Start Time: 2013-01-24 15:45:44, End Time: 2013-01-24 17:57:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.1530 => 1.1649, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.55% (10.8694 => 10.7006, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.47% (0.3259 => 0.3146, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.99% (0.0652 => 0.0665, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8341 => 499.8551, std.dev.: 0.0063) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.18% (1.1277 => 499.8551, std.dev.: 0.0063) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.29% (0.5229 => 1.6434, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 20.71% (14.9895 => 18.0944, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 44.34% (14.1553 => 20.4319, std.dev.: 0.0253) MultiSource/Benchmarks/MallocBench/gs/gs: 18.16% (4.1105 => 4.8571, std.dev.: 0.0066) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.44% (1.1048 => 1.7283, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.38% (7.1582 => 37.3217, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.58% (3.4629 => 6.4264, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.78% (0.6222 => 1.0937, std.dev.: 0.0132) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10283.33% (0.0720 => 7.4760, std.dev.: 0.0141) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11161800.00% (0.0001 => 11.1619, std.dev.: 0.0595) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0102) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 811.64% (1.1194 => 10.2049, std.dev.: 0.1364) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.13% (22.1758 => 55.0239, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.77% (0.0929 => 0.1828, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 71.43% (0.1463 => 0.2508, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.52% (0.0730 => 0.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.69% (2.9384 => 4.6336, std.dev.: 0.0202) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.66% (7.0540 => 10.7685, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.05% (1.5859 => 2.4113, std.dev.: 0.0142) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.34% (8.1363 => 11.9068, std.dev.: 0.0078) SingleSource/UnitTests/vla: 43.38% (0.0355 => 0.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.24% (2.2024 => 3.1327, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 39.87% (0.1432 => 0.2003, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.46% (21.9371 => 30.3734, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.13% (4.2646 => 5.6774, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.76% (0.4615 => 0.6127, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.35% (1.5415 => 2.0402, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.38% (0.2271 => 0.2961, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 29.57% (1.1642 => 1.5085, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.54% (0.4299 => 0.5569, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.27% (0.5105 => 0.6548, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.91% (0.1143 => 0.1462, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.31% (0.6675 => 0.8498, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.96% (0.1892 => 0.2402, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 26.15% (9.4845 => 11.9649, std.dev.: 0.0128) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.04% (0.1125 => 0.1418, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.91% (3.8922 => 4.9007, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 24.64% (0.4289 => 0.5346, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.53% (0.1337 => 0.1665, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.52% (0.0730 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 24.32% (1.0722 => 1.3330, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.29% (0.3121 => 0.3879, std.dev.: 0.0045) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.10% (1.4186 => 1.7605, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.95% (0.1695 => 0.2101, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.85% (0.4620 => 0.5722, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.56% (0.7115 => 0.8720, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.17% (0.1236 => 0.1510, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 21.98% (0.1151 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.70% (0.2700 => 0.3286, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.60% (0.0662 => 0.0805, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.43% (0.3098 => 0.3762, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.90% (0.0871 => 0.1053, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 20.90% (0.6456 => 0.7805, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.82% (1.3050 => 1.5767, std.dev.: 0.0088) MultiSource/Applications/spiff/spiff: 20.79% (0.7835 => 0.9464, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 20.49% (5.7591 => 6.9394, std.dev.: 0.0136) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/em3d/em3d: 20.18% (0.1695 => 0.2037, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.71% (0.5860 => 0.7015, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.69% (0.1940 => 0.2322, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.37% (4.9449 => 5.9029, std.dev.: 0.0112) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.32% (0.8172 => 0.9751, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.06% (0.0834 => 0.0993, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.98% (0.5020 => 0.5973, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.85% (0.0886 => 0.1053, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 18.75% (3.3354 => 3.9609, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.75% (0.3307 => 0.3927, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.74% (5.0018 => 5.9389, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 18.34% (0.7433 => 0.8796, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.31% (0.2758 => 0.3263, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.02% (0.9765 => 1.1525, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.92% (0.5569 => 0.6567, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 17.62% (1.1840 => 1.3926, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 17.51% (2.0273 => 2.3822, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.48% (0.1510 => 0.1774, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.33% (3.8723 => 4.5433, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/18-imp/imp: 17.32% (0.3423 => 0.4016, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.28% (0.1117 => 0.1310, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.19% (1.1861 => 1.3900, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.17% (0.5981 => 0.7008, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.88% (0.3441 => 0.4022, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.85% (2.2969 => 2.6839, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.83% (0.0933 => 0.1090, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.76% (0.2065 => 0.2411, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 16.57% (0.3283 => 0.3827, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.36% (0.8101 => 0.9426, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 16.34% (0.3232 => 0.3760, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.12% (0.6450 => 0.7490, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 15.20% (0.8921 => 1.0277, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/09-vor/vor: 15.19% (0.3180 => 0.3663, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.39% (0.8067 => 0.9228, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.36% (0.3865 => 0.4420, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.29% (0.3379 => 0.3862, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.91% (0.4636 => 0.5281, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 13.39% (1.5603 => 1.7693, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 13.26% (0.3387 => 0.3836, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.06% (0.4103 => 0.4639, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.73% (0.4203 => 0.4738, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.38% (0.4048 => 0.4549, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.32% (0.3603 => 0.4047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.19% (0.3422 => 0.3839, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 12.05% (0.3684 => 0.4128, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.65% (0.2430 => 0.2713, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.39% (17.1811 => 19.1384, std.dev.: 0.0113) MultiSource/Benchmarks/Olden/bh/bh: 11.35% (0.3092 => 0.3443, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/oourafft: 11.27% (0.3282 => 0.3652, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.24% (0.3826 => 0.4256, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.4064 => 0.4513, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.50% (0.3427 => 0.3787, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.33% (14.3668 => 15.8509, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.32% (0.1114 => 0.1229, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 10.04% (0.3886 => 0.4276, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2877 => 0.3150, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.48% (0.3828 => 0.4191, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.42% (2.0665 => 2.2611, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 9.12% (0.2905 => 0.3170, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.08% (0.3162 => 0.3449, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 9.04% (1.2842 => 1.4003, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.93% (0.3650 => 0.3976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 8.90% (0.3561 => 0.3878, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.81% (0.3543 => 0.3855, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.80% (0.3694 => 0.4019, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.79% (0.3516 => 0.3825, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.67% (0.3473 => 0.3774, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.64% (0.3497 => 0.3799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2872 => 0.3119, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.52% (0.2793 => 0.3031, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.41% (0.3935 => 0.4266, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.35% (0.3136 => 0.3398, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.24% (63.2438 => 68.4573, std.dev.: 0.0120) SingleSource/UnitTests/ObjC++/property-reference: 7.82% (0.7326 => 0.7899, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 7.43% (0.6030 => 0.6478, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.22% (2.2022 => 2.3611, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 6.87% (0.5925 => 0.6332, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.98% (0.4879 => 0.5171, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 4.12% (0.3131 => 0.3260, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: 3.21% (10.3673 => 10.7006, std.dev.: 0.0060) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.02% (7.9617 => 8.1224, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4753, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 6.64% (11.6436 => 12.4165, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (4.2280 => 4.4621, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3117, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.51% (2.0360 => 2.1075, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.38% (0.9957 => 1.0294, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (8.6802 => 8.8930, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.30% (3.6395 => 3.7231, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.00% (0.8333 => 0.8500, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.91% (9.1159 => 9.2897, std.dev.: 0.0159) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3050, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.12% (6.5088 => 6.5819, std.dev.: 0.0056) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.76% (5.2763 => 1.1734, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.77% (5.3855 => 4.4284, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.17% (5.3526 => 4.4337, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -13.77% (10.4361 => 8.9994, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.12% (1.7609 => 1.6180, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9207, std.dev.: 0.0180) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.30% (1.9577 => 0.6598, std.dev.: 0.0141) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.10% (4.5009 => 2.5611, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4318, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8515, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.39% (2.6546 => 2.0072, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -20.27% (0.2161 => 0.1723, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -18.91% (0.6223 => 0.5046, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1246, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4238, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0018) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4950, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.33% (19.9488 => 18.2873, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (0.2497 => 0.2347) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6973, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.59% (10.2830 => 9.8108, std.dev.: 0.0175) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6702, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/ary3: -1.35% (3.6994 => 3.6495, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2316, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0081) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0009) Report Time: 1.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 13:47:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 15:47:30 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130124214730.E3D302A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7910?compare_to=7906&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7910, Order: 173361, Start Time: 2013-01-24 19:45:07, End Time: 2013-01-24 21:47:47 To: 7906, Order: 173360, Start Time: 2013-01-24 17:26:51, End Time: 2013-01-24 19:25:09 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (7 on baseline) Performance Improvements: 1 (38 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1057 (1018 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 17.51% (20.4776 => 24.0631, std.dev.: 0.8311) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.79% (15.2269 => 16.8693, std.dev.: 0.0888) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.94% (2.3647 => 2.5998, std.dev.: 0.0499) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.95% (4.8032 => 5.0411, std.dev.: 0.0187) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.18% (1.0584 => 1.1026, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.24% (8.5380 => 8.7290, std.dev.: 0.0394) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: -2.78% (0.3737 => 0.3633, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.32% (1.1235 => 1.1271, std.dev.: 0.0569) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0220 => 0.0221, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0429 => 0.0429, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.06% (0.0334 => 0.0267, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -23.10% (0.0316 => 0.0243, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0426 => 0.0427, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -16.97% (0.0218 => 0.0181, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.37% (0.0229 => 0.0219, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1506 => 0.1507, std.dev.: 0.0262) MultiSource/Applications/lemon/lemon: 8.68% (1.1208 => 1.2181, std.dev.: 0.1077) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.27% (0.3932 => 0.4100, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.16% (0.1491 => 0.1429, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.24% (0.1010 => 0.0947, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.55% (0.0275 => 0.0268, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.34% (0.0587 => 0.0589, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.68% (1.1548 => 1.1626, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.33% (0.0600 => 0.0608, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.77% (0.0309 => 0.0285, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.07% (0.7407 => 0.7412, std.dev.: 0.0431) SingleSource/Regression/C/2003-05-21-UnionBitfields: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 102.50% (0.0040 => 0.0081, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7622 => 12.7644, std.dev.: 0.2353) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 321250.00% (0.0008 => 2.5708, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.95% (1.1825 => 2.3999, std.dev.: 0.0300) MultiSource/Applications/sgefa/sgefa: 22.08% (0.3515 => 0.4291, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 17.31% (20.5117 => 24.0631, std.dev.: 0.8311) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.94% (0.2562 => 0.2868, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/pi: 3.48% (2.1390 => 2.2134, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.23% (4.9799 => 5.0411, std.dev.: 0.0187) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0808 => 0.0505, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.26% (0.0727 => 0.0507, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.31% (0.0692 => 0.0503, std.dev.: 0.0008) SingleSource/Benchmarks/SmallPT/smallpt: -23.68% (0.1888 => 0.1441, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.98% (0.1684 => 0.1297, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.08% (0.0676 => 0.0547, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: -18.85% (1.8964 => 1.5390, std.dev.: 0.0685) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.75% (0.0862 => 0.0709, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.60% (1.0986 => 0.9492, std.dev.: 0.0431) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.88% (0.1079 => 0.0940, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.05% (0.4074 => 0.3583, std.dev.: 0.0084) MultiSource/Applications/lua/lua: -8.55% (4.6406 => 4.2440, std.dev.: 0.1114) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -8.28% (0.1317 => 0.1208, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.76% (1.1498 => 1.0721, std.dev.: 0.0256) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.49% (0.6885 => 0.6438, std.dev.: 0.0173) MultiSource/Applications/ClamAV/clamscan: -6.13% (17.4365 => 16.3673, std.dev.: 0.3701) SingleSource/Benchmarks/Shootout-C++/fibo: -5.38% (0.2006 => 0.1898, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.05% (0.2100 => 0.1994, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/moments: -4.67% (0.4002 => 0.3815, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.47% (0.3665 => 0.3538, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.30% (0.3093 => 0.2991, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.87% (0.9372 => 0.6479, std.dev.: 0.0782) SingleSource/Benchmarks/Shootout/heapsort: -30.42% (4.4739 => 3.1131, std.dev.: 0.2056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.89% (0.1164 => 0.1014, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.53% (1.4235 => 1.2594, std.dev.: 0.0376) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.98% (0.4081 => 0.3633, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/hash: -10.64% (4.5259 => 4.0445, std.dev.: 0.1117) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.66% (2.8778 => 2.5998, std.dev.: 0.0499) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.05% (0.3217 => 0.2958, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.49% (1.4588 => 1.3496, std.dev.: 0.0295) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.12% (0.3201 => 0.3037, std.dev.: 0.0033) MultiSource/Benchmarks/mafft/pairlocalalign: -3.02% (63.1520 => 61.2432, std.dev.: 0.4551) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.97% (40.4729 => 39.2699, std.dev.: 0.3886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.92% (1.4446 => 1.4024, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: -1.89% (1.4244 => 1.3975, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: -1.43% (1.5825 => 1.5598, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3161, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/FloatMM: -1.28% (0.8328 => 0.8221, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.44% (1.2047 => 1.1271, std.dev.: 0.0569) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.88% (0.0451 => 0.0429, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -32.23% (0.0394 => 0.0267, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -25.91% (0.0328 => 0.0243, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.04% (0.0445 => 0.0427, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/test1: -20.26% (0.0227 => 0.0181, std.dev.: 0.0034) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.12% (0.0255 => 0.0219, std.dev.: 0.0042) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.50% (0.1530 => 0.1507, std.dev.: 0.0262) MultiSource/Applications/lemon/lemon: -36.86% (1.9293 => 1.2181, std.dev.: 0.1077) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.26% (0.4049 => 0.4100, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.36% (0.1510 => 0.1429, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.17% (0.0978 => 0.0947, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.90% (0.0276 => 0.0268, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0590 => 0.0589, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.08% (1.1617 => 1.1626, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.34% (0.7437 => 0.7412, std.dev.: 0.0431) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.96% (0.0092 => 0.0081, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7644, std.dev.: 0.2353) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 14:34:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 16:34:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130124223422.98D492A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7911?compare_to=7908&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7911, Order: 173365, Start Time: 2013-01-24 21:00:23, End Time: 2013-01-24 22:34:38 To: 7908, Order: 173360, Start Time: 2013-01-24 19:02:29, End Time: 2013-01-24 20:36:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (80 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (898 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 75.10% (0.0514 => 0.0900, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.57% (0.0717 => 0.1223, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.25% (0.0974 => 0.1629, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.69% (0.6395 => 0.8805, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.19% (0.0699 => 0.0931, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.71% (0.5805 => 0.7704, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.45% (0.5688 => 0.7534, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.28% (0.6260 => 0.8281, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.17% (0.5456 => 0.7211, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.10% (0.5567 => 0.7354, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.07% (0.5849 => 0.7725, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.99% (0.6395 => 0.8441, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.64% (0.5575 => 0.7339, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.45% (0.5581 => 0.7336, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.84% (0.5941 => 0.7773, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.26% (0.5859 => 0.7632, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.85% (0.6033 => 0.7834, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.39% (0.6440 => 0.8333, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.77% (1.6474 => 2.1214, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.76% (0.6189 => 0.7969, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.28% (0.6676 => 0.8564, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.20% (0.6304 => 0.8082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.48% (0.6230 => 0.7942, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.94% (0.5802 => 0.7365, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.70% (0.6660 => 0.8438, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.24% (0.5925 => 0.7480, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.13% (0.5705 => 0.7196, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.95% (0.0790 => 0.0995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.89% (0.5570 => 0.7012, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (0.5857 => 0.7372, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.74% (0.5478 => 0.6888, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.06% (0.5591 => 0.6992, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.36% (0.5863 => 0.7291, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.93% (0.6052 => 0.7500, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.91% (0.6446 => 0.7987, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.78% (0.7524 => 0.9313, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.16% (0.6681 => 0.8228, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.99% (0.6194 => 0.7618, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.79% (0.6297 => 0.7732, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.68% (2.2587 => 2.7483, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.28% (0.6667 => 0.8086, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.65% (0.7339 => 0.8781, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.36% (0.1146 => 0.1345, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 15.73% (0.3357 => 0.3885, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.81% (1.1450 => 1.3146, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.77% (4.5069 => 5.0826, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.67% (0.4916 => 0.5539, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.54% (0.4515 => 0.5081, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.74% (1.6364 => 1.8285, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.53% (3.5339 => 3.9415, std.dev.: 0.0219) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.80% (0.1982 => 0.2196, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.52% (0.2385 => 0.2636, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.63% (9.2283 => 10.1172, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout-C++/hash: 9.50% (0.4524 => 0.4954, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.95% (0.2001 => 0.2180, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.79% (1.2515 => 1.3615, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.70% (0.1230 => 0.1337, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.5329 => 0.5777, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.38% (0.1731 => 0.1876, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.25% (0.4861 => 0.5262, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.68% (0.7021 => 0.7560, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.55% (1.4642 => 1.5747, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/matrix: 7.50% (0.3255 => 0.3499, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.34% (1.2784 => 1.3722, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.60% (0.3319 => 0.3505, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 4.70% (0.6750 => 0.7067, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.50% (0.3446 => 0.3601, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.43% (5.4682 => 5.7107, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 4.39% (0.3394 => 0.3543, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.39% (5.0226 => 5.1927, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.3864 => 1.4296, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.03% (0.8418 => 0.8673, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.79% (0.9557 => 0.9824, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 2.51% (0.7447 => 0.7634, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.19% (0.5168 => 0.5281, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.11% (15.5079 => 15.8357, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.3722 => 1.4011, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (22.4056 => 22.8427, std.dev.: 0.0141) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2300 => 1.2429, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8071, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.86% (0.2380 => 0.2567, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.66% (0.9531 => 1.0261, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6767 => 12.1375, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4687, std.dev.: 0.0443) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.41% (2.0478 => 2.1176, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.63% (3.7435 => 3.8045, std.dev.: 0.0234) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2474, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0062) MultiSource/Applications/sqlite3/sqlite3: 1.40% (4.5320 => 4.5954, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.7198 => 0.6869, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3821 => 0.3674, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.76% (2.4924 => 2.3986, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/objinst: -3.60% (0.3194 => 0.3079, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.43% (0.9852 => 0.9514, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.81% (0.3837 => 0.3729, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2171, std.dev.: 0.0398) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.9542 => 0.9319, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.11% (0.6484 => 0.6347, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.89% (14.2083 => 13.9396, std.dev.: 0.0214) SingleSource/UnitTests/ObjC++/Hello: -1.89% (0.6347 => 0.6227, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -1.79% (17.1032 => 16.7965, std.dev.: 0.0069) SingleSource/UnitTests/ObjC++/property-reference-object: -1.77% (0.6441 => 0.6327, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -1.64% (1.3148 => 1.2932, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.20% (2.1713 => 2.1452, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.12% (16.1920 => 16.0105, std.dev.: 0.0109) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.08% (6.7716 => 6.6987, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.98% (1.8100 => 0.6882, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -33.89% (8.0445 => 5.3183, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.78% (1.3643 => 1.0262, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: -23.35% (7.5137 => 5.7592, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0793, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1976, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.81% (0.6299 => 0.5051, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1284, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3578, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (7.9763 => 7.7554, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.12% (3.7241 => 3.6450, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: -1.69% (7.3040 => 7.1808, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.62% (1.6219 => 1.5956, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.50% (1.6086 => 1.5844, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.27% (1.3096 => 1.2930, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.05% (1.6307 => 1.6135, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 15:20:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 17:20:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130124232025.81DDE2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7912?compare_to=7909&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7912, Order: 173365, Start Time: 2013-01-24 21:09:35, End Time: 2013-01-24 23:20:41 To: 7909, Order: 173360, Start Time: 2013-01-24 18:28:13, End Time: 2013-01-24 20:39:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (215 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.95% (0.4023 => 0.4182, std.dev.: 0.0015) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0417 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0665 => 0.0664, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8551 => 499.8376, std.dev.: 0.0156) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44223.63% (1.1277 => 499.8376, std.dev.: 0.0156) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.15% (0.5229 => 1.6427, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.41% (14.9895 => 18.0482, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: 43.84% (14.1553 => 20.3613, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 17.72% (4.1105 => 4.8387, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.23% (1.1048 => 1.7260, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.58% (7.1582 => 37.3355, std.dev.: 0.0101) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.10% (3.4629 => 6.4099, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.97% (0.6222 => 1.0949, std.dev.: 0.0081) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10283.89% (0.0720 => 7.4764, std.dev.: 0.0028) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11177400.00% (0.0001 => 11.1775, std.dev.: 0.0512) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848800.00% (0.0001 => 9.8489, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489000.00% (0.0001 => 5.4891, std.dev.: 0.0015) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.86% (1.1194 => 10.2969, std.dev.: 0.0101) SingleSource/UnitTests/SignlessTypes/factor: 163.18% (0.0296 => 0.0779, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.55% (22.1758 => 55.3397, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.02% (0.1463 => 0.2502, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.43% (2.9384 => 4.6258, std.dev.: 0.0089) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.40% (7.0540 => 10.7501, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.33% (1.5859 => 2.4000, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.72% (8.1363 => 11.9376, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.28% (0.0439 => 0.0629) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.65% (2.2024 => 3.1196, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 39.31% (0.3109 => 0.4331, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 38.52% (21.9371 => 30.3873, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.93% (4.2646 => 5.6690, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.65% (0.4615 => 0.6122, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.35% (1.5415 => 2.0402, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/05-eks/eks: 29.70% (0.4299 => 0.5576, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.38% (0.0793 => 0.1026, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 29.27% (1.1642 => 1.5050, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.18% (0.1125 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 27.82% (0.0719 => 0.0919, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.60% (0.5105 => 0.6514, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 27.14% (0.1555 => 0.1977, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.03% (0.6675 => 0.8479, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.66% (0.2554 => 0.3235, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.31% (0.1566 => 0.1978, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.25% (0.1143 => 0.1443, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 25.73% (9.4845 => 11.9244, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.59% (3.8922 => 4.8884, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/hash: 25.48% (0.4289 => 0.5382, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.38% (0.1655 => 0.2075, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.59% (0.0675 => 0.0841, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.42% (0.1695 => 0.2109, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.97% (0.3121 => 0.3869, std.dev.: 0.0027) MultiSource/Applications/lemon/lemon: 23.90% (1.0722 => 1.3285, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 23.81% (0.4620 => 0.5720, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.79% (1.4186 => 1.7561, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.59% (0.0886 => 0.1095, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.92% (0.0842 => 0.1035, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 22.81% (0.7115 => 0.8738, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.50% (0.3098 => 0.3764, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.38% (0.1029 => 0.1249, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.1236 => 0.1499, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.22% (0.2700 => 0.3273, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 21.20% (0.7835 => 0.9496, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/messages-2: 21.15% (0.0662 => 0.0802, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 20.77% (0.6456 => 0.7797, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.61% (1.3050 => 1.5739, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.23% (5.7591 => 6.9242, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 20.12% (0.1695 => 0.2036, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.62% (0.5860 => 0.7010, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.57% (0.8172 => 0.9771, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.43% (4.9449 => 5.9057, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.92% (0.5020 => 0.5970, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.83% (5.0018 => 5.9437, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 18.44% (3.3354 => 3.9505, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.17% (0.2758 => 0.3259, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.99% (0.0834 => 0.0984, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 17.87% (0.7433 => 0.8761, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.78% (0.5569 => 0.6559, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.60% (0.9765 => 1.1484, std.dev.: 0.0030) MultiSource/Applications/treecc/treecc: 17.52% (2.0273 => 2.3824, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.51% (0.2107 => 0.2476, std.dev.: 0.0033) MultiSource/Benchmarks/nbench/nbench: 17.36% (1.1840 => 1.3895, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.35% (0.1510 => 0.1772, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.21% (3.8723 => 4.5389, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/18-imp/imp: 17.12% (0.3423 => 0.4009, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.05% (0.5981 => 0.7001, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.95% (1.1861 => 1.3871, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.65% (0.3232 => 0.3770, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 16.42% (2.2969 => 2.6740, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.40% (0.2049 => 0.2385, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.31% (0.8101 => 0.9422, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.19% (0.3441 => 0.3998, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 15.91% (0.3180 => 0.3686, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.80% (0.6450 => 0.7469, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.71% (0.1044 => 0.1208, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.15% (0.3379 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 14.83% (0.8921 => 1.0244, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.34% (0.8067 => 0.9224, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3865 => 0.4412, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.00% (0.4636 => 0.5285, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.79% (0.2603 => 0.2962, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.72% (0.0838 => 0.0953, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.13% (1.5603 => 1.7652, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.99% (0.4103 => 0.4636, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 12.92% (0.4048 => 0.4571, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.85% (0.4203 => 0.4743, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 12.61% (0.3387 => 0.3814, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 12.52% (0.3603 => 0.4054, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 12.48% (0.3422 => 0.3849, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 12.05% (0.3684 => 0.4128, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/oourafft: 11.67% (0.3282 => 0.3665, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.60% (0.2430 => 0.2712, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.52% (0.4064 => 0.4532, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.37% (0.3826 => 0.4261, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.20% (17.1811 => 19.1057, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2831 => 0.3129, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 10.38% (0.2871 => 0.3169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.15% (0.3427 => 0.3775, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.10% (14.3668 => 15.8183, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/synchronized: 10.03% (0.3561 => 0.3918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.91% (0.2877 => 0.3162, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.87% (0.1114 => 0.1224, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.84% (2.0665 => 2.2699, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.65% (0.3543 => 0.3885, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.58% (0.2725 => 0.2986, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.53% (0.3516 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.52% (0.2793 => 0.3059, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.41% (0.2891 => 0.3163, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2714 => 0.2969, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.37% (1.2842 => 1.4045, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.32% (0.3650 => 0.3990, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.31% (0.3052 => 0.3336, std.dev.: 0.0010) SingleSource/Regression/C++/ofstream_ctor: 9.29% (0.2905 => 0.3175, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.18% (0.2756 => 0.3009, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.14% (0.3162 => 0.3451, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 8.99% (0.2802 => 0.3054, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.95% (0.2872 => 0.3129, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.72% (0.3935 => 0.4278, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.69% (63.2438 => 68.7419, std.dev.: 0.0557) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.61% (0.3136 => 0.3406, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/Hello: 8.27% (0.5925 => 0.6415, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.09% (2.2022 => 2.3583, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.79% (0.3177 => 0.3361, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 2.63% (10.3673 => 10.6398, std.dev.: 0.0118) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.21% (7.9617 => 8.1375, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4736, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6959, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.31% (1.1396 => 1.2457, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.64% (11.6436 => 12.4169, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.33% (4.2280 => 4.4532, std.dev.: 0.0113) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3135, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.30% (0.9957 => 1.0286, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9164, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.33% (3.6395 => 3.7243, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.74% (9.1159 => 9.2748, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3063, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4577, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.86% (5.2763 => 1.1684, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -74.73% (0.8651 => 0.2186, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.35% (5.3855 => 4.4512, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.76% (5.3526 => 4.4553, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: -13.86% (10.4361 => 8.9898, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.93% (1.7609 => 1.6213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9755, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.26% (1.9577 => 0.6410, std.dev.: 0.0327) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0211, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4347, std.dev.: 0.0195) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8561, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0039, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -18.91% (0.6223 => 0.5046, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.79% (2.5528 => 2.1243, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4926, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.30% (19.9488 => 18.2929, std.dev.: 0.1114) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.89% (4.8142 => 4.4823, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2373 => 1.1603, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (0.2497 => 0.2347) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.52% (8.1563 => 7.7061, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.03% (1.5835 => 1.5038, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8322, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3283, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -1.55% (3.7221 => 3.6644, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.44% (3.6994 => 3.6460, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2266, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0069) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0001) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 16:12:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 18:12:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125001243.559502A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7913?compare_to=7910&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7913, Order: 173374, Start Time: 2013-01-24 22:08:03, End Time: 2013-01-25 00:13:00 To: 7910, Order: 173361, Start Time: 2013-01-24 19:45:07, End Time: 2013-01-24 21:47:47 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 25 (19 on baseline) Performance Improvements: 1 (18 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1038 (1026 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.62% (1.2907 => 1.5052, std.dev.: 0.0329) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.22% (1.7248 => 1.8665, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 7.90% (1.2459 => 1.3443, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.36% (0.9612 => 1.0319, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/methcall: 5.96% (0.2048 => 0.2170, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.77% (23.7621 => 25.1341, std.dev.: 0.5232) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.04% (4.5464 => 4.7754, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.98% (0.8832 => 0.9272, std.dev.: 0.0082) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.77% (0.4616 => 0.4836, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.60% (0.9101 => 0.9520, std.dev.: 0.0079) SingleSource/Benchmarks/Linpack/linpack-pc: 4.45% (0.2518 => 0.2630, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.97% (0.3403 => 0.3538, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.13% (0.9570 => 0.9774, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 41.90% (1.4777 => 2.0968, std.dev.: 0.0284) MultiSource/Benchmarks/Olden/mst/mst: 41.00% (0.1439 => 0.2029, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/bisort/bisort: 36.63% (0.6479 => 0.8852, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/ary3: 9.02% (1.7324 => 1.8887, std.dev.: 0.0269) SingleSource/Benchmarks/Shootout-C++/hash: 7.16% (0.6143 => 0.6583, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.60% (22.0395 => 23.0524, std.dev.: 0.1504) SingleSource/Benchmarks/Dhrystone/fldry: 4.38% (0.6558 => 0.6845, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.18% (4.2862 => 4.4223, std.dev.: 0.0390) MultiSource/Benchmarks/Olden/tsp/tsp: 3.17% (1.5025 => 1.5502, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/except: 2.52% (0.4921 => 0.5045, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: 2.04% (2.3178 => 2.3651, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 1.98% (3.5497 => 3.6199, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -13.04% (24.0631 => 20.9264, std.dev.: 1.1203) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.12% (1.1271 => 1.1623, std.dev.: 0.0396) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.49% (0.0429 => 0.0474, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 25.84% (0.0267 => 0.0336, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 31.28% (0.0243 => 0.0319, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.47% (0.0427 => 0.0425, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0206 => 0.0206, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: 22.10% (0.0181 => 0.0221, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.48% (0.0219 => 0.0207, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.60% (0.1507 => 0.1516, std.dev.: 0.0201) MultiSource/Applications/lemon/lemon: -3.18% (1.2181 => 1.1794, std.dev.: 0.2720) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.71% (0.4100 => 0.4071, std.dev.: 0.1554) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.77% (0.1429 => 0.1418, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.70% (0.0947 => 0.0982, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.61% (0.0268 => 0.0275, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.81% (0.0589 => 0.0635, std.dev.: 0.0103) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.65% (1.1626 => 1.1551, std.dev.: 0.0258) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0608 => 0.0605, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.07% (0.0285 => 0.0308, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.69% (0.7412 => 0.7463, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.21% (0.0081 => 0.0046, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7644 => 12.7671, std.dev.: 0.0103) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.10% (1.3924 => 1.5052, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.89% (0.9564 => 1.0319, std.dev.: 0.0215) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.56% (23.5861 => 25.1341, std.dev.: 0.5232) SingleSource/UnitTests/Vectorizer/gcc-loops: 5.22% (0.4596 => 0.4836, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.86% (0.3374 => 0.3538, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.97% (1.8127 => 1.8665, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.69% (0.9612 => 0.9774, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319687.50% (0.0008 => 2.5583, std.dev.: 0.0213) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 93.56% (1.1825 => 2.2889, std.dev.: 0.1050) MultiSource/Benchmarks/Olden/mst/mst: 36.08% (0.1491 => 0.2029, std.dev.: 0.0147) SingleSource/Benchmarks/CoyoteBench/fftbench: 26.72% (1.6547 => 2.0968, std.dev.: 0.0284) MultiSource/Applications/sgefa/sgefa: 21.22% (0.3515 => 0.4261, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.90% (0.2562 => 0.2867, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary3: 4.22% (1.8123 => 1.8887, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/pi: 3.77% (2.1390 => 2.2196, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 3.23% (1.5017 => 1.5502, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.22% (4.2843 => 4.4223, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/flops-8: 1.64% (2.3269 => 2.3651, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.87% (0.0692 => 0.0513, std.dev.: 0.0029) SingleSource/Benchmarks/SmallPT/smallpt: -24.05% (0.1888 => 0.1434, std.dev.: 0.0032) MultiSource/Applications/hbd/hbd: -17.38% (1.8964 => 1.5668, std.dev.: 0.1202) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.17% (0.0862 => 0.0714, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -12.61% (1.0986 => 0.9601, std.dev.: 0.0249) MultiSource/Applications/aha/aha: -8.35% (0.1378 => 0.1263, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hello: -5.76% (0.1928 => 0.1817, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.12% (1.4588 => 1.3257, std.dev.: 0.0164) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.55% (0.3217 => 0.2974, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -3.54% (17.2182 => 16.6085, std.dev.: 0.0907) MultiSource/Benchmarks/mafft/pairlocalalign: -2.89% (63.1520 => 61.3289, std.dev.: 0.1372) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.46% (1.4446 => 1.4091, std.dev.: 0.0094) MultiSource/Applications/spiff/spiff: -2.03% (2.8571 => 2.7992, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.99% (3.1921 => 3.1285, std.dev.: 0.0150) SingleSource/Benchmarks/Misc/mandel-2: -1.43% (0.8521 => 0.8399, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -1.33% (1.5825 => 1.5614, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/ReedSolomon: -1.24% (8.6447 => 8.5372, std.dev.: 0.0299) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -3.52% (1.2047 => 1.1623, std.dev.: 0.0396) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.10% (0.0451 => 0.0474, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.49% (0.0445 => 0.0425, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -18.82% (0.0255 => 0.0207, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.92% (0.1530 => 0.1516, std.dev.: 0.0201) MultiSource/Applications/lemon/lemon: -38.87% (1.9293 => 1.1794, std.dev.: 0.2720) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.54% (0.4049 => 0.4071, std.dev.: 0.1554) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.09% (0.1510 => 0.1418, std.dev.: 0.0188) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.41% (0.0978 => 0.0982, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.63% (0.0590 => 0.0635, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.57% (1.1617 => 1.1551, std.dev.: 0.0258) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0610 => 0.0605, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.93% (0.0268 => 0.0308, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.35% (0.7437 => 0.7463, std.dev.: 0.0072) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.00% (0.0092 => 0.0046, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (12.7781 => 12.7671, std.dev.: 0.0103) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 16:32:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 18:32:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125003212.ED1322A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7914?compare_to=7911&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7914, Order: 173378, Start Time: 2013-01-24 22:58:19, End Time: 2013-01-25 00:32:28 To: 7911, Order: 173365, Start Time: 2013-01-24 21:00:23, End Time: 2013-01-24 22:34:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (90 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (891 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.47% (0.1500 => 0.2182, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.78% (0.1132 => 0.1605, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.33% (0.6395 => 0.8782, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.33% (0.0699 => 0.0932, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.11% (0.5805 => 0.7669, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.00% (0.5688 => 0.7508, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.78% (0.5456 => 0.7190, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.73% (0.6260 => 0.8246, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.69% (0.5567 => 0.7331, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.53% (0.5849 => 0.7693, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.34% (0.6395 => 0.8399, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.19% (0.5575 => 0.7314, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.94% (0.5581 => 0.7308, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.26% (0.5941 => 0.7739, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.60% (0.5859 => 0.7593, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.36% (0.6033 => 0.7804, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.96% (0.6440 => 0.8305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.37% (0.6189 => 0.7945, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.25% (1.6474 => 2.1128, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.73% (0.6676 => 0.8527, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.63% (0.6304 => 0.8046, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.93% (0.6230 => 0.7908, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.22% (0.5802 => 0.7323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.16% (0.6660 => 0.8402, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.73% (0.5705 => 0.7173, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.70% (0.0790 => 0.0993, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.59% (0.5925 => 0.7441, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.44% (0.5857 => 0.7347, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.32% (0.5478 => 0.6865, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.26% (0.5570 => 0.6977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.16% (0.5569 => 0.6970, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.50% (0.5591 => 0.6961, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.83% (0.5863 => 0.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.50% (0.7524 => 0.9292, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.36% (0.6446 => 0.7952, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.31% (0.6052 => 0.7463, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.77% (0.6681 => 0.8202, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.47% (0.6194 => 0.7586, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.12% (0.6297 => 0.7690, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.28% (2.2587 => 2.7394, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.91% (0.6667 => 0.8061, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.19% (0.7339 => 0.8747, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 14.83% (0.3357 => 0.3855, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.38% (1.1450 => 1.3096, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/05-eks/eks: 12.36% (0.4515 => 0.5073, std.dev.: 0.0031) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.20% (4.5069 => 5.0566, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.40% (1.6364 => 1.8229, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.03% (3.5339 => 3.9236, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.00% (0.1982 => 0.2200, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.35% (9.2283 => 10.0916, std.dev.: 0.0081) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1230 => 0.1344, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.91% (0.4524 => 0.4927, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.80% (0.2001 => 0.2177, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.32% (1.2515 => 1.3556, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 8.13% (0.4861 => 0.5256, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.74% (0.1731 => 0.1865, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.67% (0.5329 => 0.5738, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4642 => 1.5688, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.11% (0.7021 => 0.7520, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 7.04% (0.3255 => 0.3484, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.96% (1.2784 => 1.3674, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3319 => 0.3495, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 4.44% (0.3446 => 0.3599, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.39% (0.6750 => 0.7046, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.29% (5.4682 => 5.7029, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary: 4.24% (0.3394 => 0.3538, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.09% (0.3834 => 0.3991, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 3.21% (5.0226 => 5.1836, std.dev.: 0.0065) MultiSource/Applications/spiff/spiff: 3.14% (0.8418 => 0.8682, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.60% (1.3864 => 1.4224, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.9557 => 0.9798, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.09% (0.7447 => 0.7603, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 1.84% (15.5079 => 15.7933, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.73% (1.3722 => 1.3959, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.69% (22.4056 => 22.7848, std.dev.: 0.0150) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8164, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 3.94% (11.6767 => 12.1372, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.65% (54.5751 => 56.5674, std.dev.: 0.0871) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.18% (2.0478 => 2.1129, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2479, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: 1.41% (4.5320 => 4.5959, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.33% (5.1955 => 5.2647, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -4.51% (2.4924 => 2.3799, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.43% (0.7198 => 0.6879, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3821 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.78% (0.9852 => 0.9480, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -3.63% (0.3194 => 0.3078, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.05% (0.3837 => 0.3720, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2406, std.dev.: 0.0679) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.53% (0.9542 => 0.9301, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.28% (0.6484 => 0.6336, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -2.22% (17.1032 => 16.7232, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.14% (14.2083 => 13.9042, std.dev.: 0.0087) SingleSource/UnitTests/ObjC++/Hello: -2.03% (0.6347 => 0.6218, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.85% (0.6441 => 0.6322, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -1.81% (1.3148 => 1.2910, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -1.68% (0.7779 => 0.7648, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.68% (0.7919 => 0.7786, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/gs/gs: -1.51% (4.3330 => 4.2674, std.dev.: 0.0146) MultiSource/Applications/lambda-0_1_3/lambda: -1.43% (0.7982 => 0.7868, std.dev.: 0.0025) MultiSource/Applications/JM/lencod/lencod: -1.43% (16.1920 => 15.9608, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (2.1713 => 2.1411, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: -1.34% (0.9179 => 0.9056, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.31% (1.0544 => 1.0406, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.16% (6.7716 => 6.6929, std.dev.: 0.0101) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (7.0961 => 7.0200, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (1.2221 => 1.2093, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.98% (1.8100 => 0.6881, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3128, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -24.13% (1.3643 => 1.0351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7573, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0753, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1971, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.84% (0.6299 => 0.5049, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1298, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.78% (0.5142 => 0.4639, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.03% (2.2633 => 2.1722, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.88% (0.3273 => 0.3146, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7811, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -1.69% (3.7241 => 3.6612, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.67% (1.6219 => 1.5948, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4681, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: -1.53% (7.3040 => 7.1920, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2821, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.50% (1.6307 => 1.6063, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.26% (1.3096 => 1.2931, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5898, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6666, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 16:48:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 18:48:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125004847.32AEE2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7915?compare_to=7907&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7915, Order: 173361, Start Time: 2013-01-24 21:13:19, End Time: 2013-01-25 00:49:02 To: 7907, Order: 173355, Start Time: 2013-01-24 16:45:12, End Time: 2013-01-24 20:20:09 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (187 on baseline) Performance Improvements: 2 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (751 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.24% (2.3164 => 2.3915, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.60% (0.4691 => 0.4813, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.40% (3.2064 => 3.2512, std.dev.: 0.0134) SingleSource/UnitTests/Vector/constpool: 1.17% (2.4268 => 2.4551, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/gs/gs: 1.04% (2.2626 => 2.2862, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (2.1619 => 2.2014, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.98% (0.1533 => 0.1426, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: -1.19% (2.0169 => 1.9929, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.15% (0.1063 => 0.1426, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.41% (0.0714 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.39% (0.1106 => 0.1431, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.03% (0.2969 => 0.3831, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.98% (0.4139 => 0.5297, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.97% (0.0547 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.42% (0.5900 => 0.7518, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0415 => 0.0526, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.74% (0.0475 => 0.0602, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.53% (0.4994 => 0.6319, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.48% (0.0642 => 0.0812, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.89% (0.4253 => 0.5354, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.80% (0.5000 => 0.6290, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.62% (0.1620 => 0.2035, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.17% (0.1021 => 0.1278, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.09% (1.5932 => 1.9929, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.48% (0.1107 => 0.1378, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 24.21% (0.1619 => 0.2011, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.21% (0.1549 => 0.1924, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.06% (0.1604 => 0.1990, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 24.05% (0.0948 => 0.1176, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.85% (0.0633 => 0.0784, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.73% (0.1003 => 0.1241, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.73% (0.3890 => 0.4813, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.44% (0.3903 => 0.4818, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.39% (0.1103 => 0.1361, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 22.85% (0.0604 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.73% (0.2736 => 0.3358, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/health/health: 22.66% (0.0821 => 0.1007, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.37% (0.0541 => 0.0662, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.30% (0.2866 => 0.3505, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.26% (0.3271 => 0.3999, std.dev.: 0.0094) MultiSource/Applications/sgefa/sgefa: 22.15% (0.0808 => 0.0987, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.04% (1.3152 => 1.6051, std.dev.: 0.0205) MultiSource/Applications/spiff/spiff: 22.04% (0.4029 => 0.4917, std.dev.: 0.0136) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.86% (0.0947 => 0.1154, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 21.82% (0.0582 => 0.0709, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/gs/gs: 21.65% (1.8794 => 2.2862, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.43% (1.9694 => 2.3915, std.dev.: 0.0153) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.15% (0.2014 => 0.2440, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.15% (0.4658 => 0.5643, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.14% (0.1088 => 0.1318, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 21.06% (0.0698 => 0.0845, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 21.02% (0.1218 => 0.1474, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.86% (0.1462 => 0.1767, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.27% (0.5026 => 0.6045, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 20.07% (1.6211 => 1.9465, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 19.67% (0.5546 => 0.6637, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.65% (3.5627 => 4.2626, std.dev.: 0.0595) SingleSource/UnitTests/ObjC++/Hello: 19.60% (0.5826 => 0.6968, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.40% (0.4361 => 0.5207, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.16% (0.1968 => 0.2345, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.13% (2.7292 => 3.2512, std.dev.: 0.0134) SingleSource/UnitTests/ObjC++/property-reference-object: 19.12% (0.5889 => 0.7015, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 18.77% (0.1284 => 0.1525, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.71% (0.1160 => 0.1377, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.47% (1.9966 => 2.3653, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.43% (0.2875 => 0.3405, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 18.30% (0.1421 => 0.1681, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 18.28% (0.7171 => 0.8482, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.19% (0.2738 => 0.3236, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 18.06% (0.9697 => 1.1448, std.dev.: 0.0037) MultiSource/Applications/ClamAV/clamscan: 18.04% (4.2109 => 4.9704, std.dev.: 0.0327) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.02% (0.3930 => 0.4638, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 17.97% (1.0781 => 1.2718, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 17.55% (0.2803 => 0.3295, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.55% (0.2729 => 0.3208, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 17.54% (0.2811 => 0.3304, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.53% (4.4195 => 5.1943, std.dev.: 0.0288) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.51% (0.2792 => 0.3281, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 17.46% (0.2714 => 0.3188, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 17.46% (0.2823 => 0.3316, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 17.35% (0.2813 => 0.3301, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 17.22% (0.9909 => 1.1615, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.15% (0.3195 => 0.3743, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.14% (0.2911 => 0.3410, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.14% (2.0673 => 2.4216, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/wc: 17.09% (0.3096 => 0.3625, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 17.02% (0.7875 => 0.9215, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary: 16.91% (0.3258 => 0.3809, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 16.70% (0.3317 => 0.3871, std.dev.: 0.0072) SingleSource/Regression/C++/ofstream_ctor: 16.68% (0.3004 => 0.3505, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 16.56% (0.2566 => 0.2991, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 16.55% (1.4269 => 1.6630, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 16.50% (0.3267 => 0.3806, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.37% (0.3060 => 0.3561, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.25% (0.3625 => 0.4214, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 16.23% (0.4146 => 0.4819, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 16.13% (0.3726 => 0.4327, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 16.07% (23.5202 => 27.2992, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.06% (0.3362 => 0.3902, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.01% (0.3124 => 0.3624, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.3845 => 0.4458, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.91% (0.3488 => 0.4043, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 15.89% (0.3348 => 0.3880, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 15.84% (0.3465 => 0.4014, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.82% (0.3446 => 0.3991, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.79% (0.3496 => 0.4048, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.75% (0.3282 => 0.3799, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.72% (0.3460 => 0.4004, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.71% (0.3469 => 0.4014, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 15.70% (0.3477 => 0.4023, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 15.66% (0.3442 => 0.3981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.61% (0.2075 => 0.2399, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 15.50% (0.4251 => 0.4910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.50% (0.3678 => 0.4248, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.45% (0.3690 => 0.4260, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.41% (0.1090 => 0.1258, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.35% (0.3981 => 0.4592, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 15.35% (0.2691 => 0.3104, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: 15.32% (0.3650 => 0.4209, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.21% (0.3643 => 0.4197, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.17% (0.3724 => 0.4289, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.16% (0.0673 => 0.0775, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 14.89% (2.1653 => 2.4878, std.dev.: 0.0236) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 14.62% (0.5012 => 0.5745, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 14.54% (5.5417 => 6.3477, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.22% (0.2068 => 0.2362, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 14.20% (4.6177 => 5.2736, std.dev.: 0.0341) MultiSource/Benchmarks/mafft/pairlocalalign: 14.10% (2.1013 => 2.3976, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.82% (0.6435 => 0.7324, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.45% (0.1383 => 0.1569, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.33% (0.2040 => 0.2312, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.23% (0.2737 => 0.3099, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 12.55% (0.3498 => 0.3937, std.dev.: 0.0063) MultiSource/Applications/siod/siod: 12.09% (0.6634 => 0.7436, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.00% (0.3084 => 0.3454, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.96% (0.5361 => 0.6002, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (0.4847 => 0.5420, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 11.66% (0.3336 => 0.3725, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.55% (0.2103 => 0.2346, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 10.71% (0.2391 => 0.2647, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.44% (0.7426 => 0.8201, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.33% (11.6398 => 12.8423, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: 10.17% (2.0346 => 2.2415, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.76% (0.5584 => 0.6129, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.67% (4.6926 => 5.1464, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 8.20% (11.9555 => 12.9357, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.36% (0.3792 => 0.4033, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5250, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0303) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.10% (0.3693 => 0.4066, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6107, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 5.98% (0.2122 => 0.2249, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 5.20% (15.4430 => 16.2465, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6777, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8910, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6862, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 3.00% (0.6276 => 0.6464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1978, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.50% (7.1849 => 7.2929, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3043, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0816, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (2.1746 => 2.2014, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4811, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.04% (3.1722 => 3.2052, std.dev.: 0.0022) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5820, std.dev.: 0.0158) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5919, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.17% (17.2379 => 14.2780, std.dev.: 0.0600) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9793, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7954, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.49% (0.2402 => 0.2246, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2122, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8116, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7740, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1847, std.dev.: 0.0375) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5738, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.00% (105.3826 => 104.3237, std.dev.: 0.0163) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 18:02:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 20:02:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125020211.2B41D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7916?compare_to=7912&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7916, Order: 173383, Start Time: 2013-01-24 23:51:25, End Time: 2013-01-25 02:02:26 To: 7912, Order: 173365, Start Time: 2013-01-24 21:09:35, End Time: 2013-01-24 23:20:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (220 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.03% (10.6398 => 10.7495, std.dev.: 0.0130) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.84% (0.6410 => 0.6720, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.72% (0.0415 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0664 => 0.0666, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8376 => 499.8237, std.dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 44222.40% (1.1277 => 499.8237, std.dev.: 0.0178) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.94% (0.5229 => 1.6468, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 20.75% (14.9895 => 18.0992, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 44.40% (14.1553 => 20.4399, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/gs/gs: 18.29% (4.1105 => 4.8622, std.dev.: 0.0127) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.76% (1.1048 => 1.7319, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.50% (7.1582 => 37.2584, std.dev.: 0.0186) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.38% (3.4629 => 6.4196, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.84% (0.6222 => 1.0941, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10285.14% (0.0720 => 7.4773, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 3835700.00% (0.0001 => 3.8358, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11161400.00% (0.0001 => 11.1615, std.dev.: 0.0333) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848000.00% (0.0001 => 9.8481, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490000.00% (0.0001 => 5.4901, std.dev.: 0.0100) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 822.32% (1.1194 => 10.3244, std.dev.: 0.0078) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783) MultiSource/Applications/ClamAV/clamscan: 149.61% (22.1758 => 55.3523, std.dev.: 0.0322) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.21% (0.0730 => 0.1206, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 61.68% (0.0394 => 0.0637, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.50% (2.9384 => 4.6279, std.dev.: 0.0037) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.28% (7.0540 => 10.8126, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.90% (1.5859 => 2.4090, std.dev.: 0.0158) MultiSource/Benchmarks/FreeBench/distray/distray: 48.58% (0.1056 => 0.1569, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.97% (8.1363 => 11.9578, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.74% (0.0439 => 0.0631) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.21% (2.2024 => 3.1321, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 39.88% (0.3109 => 0.4349, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0003) SingleSource/UnitTests/vla: 38.59% (0.0355 => 0.0492, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.38% (21.9371 => 30.3560, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.85% (0.1062 => 0.1464, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.42% (4.2646 => 5.6900, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.24% (0.4615 => 0.6149, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.27% (1.5415 => 2.0390, std.dev.: 0.0115) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.65% (0.2271 => 0.2967, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.92% (0.1143 => 0.1485, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.91% (0.4299 => 0.5585, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 29.77% (1.1642 => 1.5108, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 28.51% (0.0719 => 0.0924, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.19% (0.5105 => 0.6544, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.74% (0.0793 => 0.1013, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.55% (0.6675 => 0.8514, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 27.19% (0.1655 => 0.2105, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.08% (0.1584 => 0.2013, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.80% (0.1892 => 0.2399, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 26.26% (9.4845 => 11.9753, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.11% (3.8922 => 4.9083, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 26.04% (0.2554 => 0.3219, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 25.20% (0.4289 => 0.5370, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.02% (0.3121 => 0.3902, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.84% (0.1695 => 0.2116, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.78% (0.1566 => 0.1954, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.46% (0.1337 => 0.1664, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 24.41% (1.0722 => 1.3339, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.40% (1.4186 => 1.7647, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 23.74% (0.4620 => 0.5717, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.92% (0.0672 => 0.0826, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 22.59% (0.7115 => 0.8722, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.09% (0.1236 => 0.1509, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0041) SingleSource/UnitTests/ObjC/messages-2: 22.05% (0.0662 => 0.0808, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.87% (0.1029 => 0.1254, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.78% (0.0675 => 0.0822, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.67% (0.2700 => 0.3285, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.24% (0.0871 => 0.1056, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.20% (0.7835 => 0.9496, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.11% (1.3050 => 1.5805, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 20.94% (0.1151 => 0.1392, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.69% (5.7591 => 6.9504, std.dev.: 0.0112) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.67% (0.0953 => 0.1150, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.59% (0.6456 => 0.7785, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.05% (0.1940 => 0.2329, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.91% (0.5860 => 0.7027, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.84% (4.9449 => 5.9258, std.dev.: 0.0082) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.73% (0.8172 => 0.9784, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.12% (0.5020 => 0.5980, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.10% (5.0018 => 5.9573, std.dev.: 0.0103) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 18.78% (3.3354 => 3.9618, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.75% (0.3307 => 0.3927, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.42% (0.2758 => 0.3266, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 18.42% (0.7433 => 0.8802, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.35% (0.0834 => 0.0987, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.13% (0.9765 => 1.1535, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 17.99% (0.0567 => 0.0669, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.5569 => 0.6570, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.89% (0.2107 => 0.2484, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.85% (1.1840 => 1.3954, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.70% (2.0273 => 2.3861, std.dev.: 0.0132) MultiSource/Applications/lua/lua: 17.50% (3.8723 => 4.5500, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 17.41% (0.3423 => 0.4019, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.38% (1.1861 => 1.3922, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.35% (0.5981 => 0.7019, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0044) MultiSource/Applications/siod/siod: 16.94% (2.2969 => 2.6859, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.80% (0.3441 => 0.4019, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.55% (0.8101 => 0.9442, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.50% (0.6450 => 0.7514, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 16.48% (0.3283 => 0.3824, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.06% (0.3232 => 0.3751, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.77% (0.0704 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.55% (0.0759 => 0.0877) SingleSource/UnitTests/SignlessTypes/rem: 15.47% (0.1144 => 0.1321, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.8921 => 1.0297, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 15.40% (0.0818 => 0.0944, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.65% (0.8067 => 0.9249, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.44% (0.2603 => 0.2979, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.40% (0.4636 => 0.5257, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.29% (0.3387 => 0.3837, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.94% (0.4103 => 0.4634, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7603, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.61% (0.4203 => 0.4733, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 12.22% (0.3422 => 0.3840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.77% (0.2430 => 0.2716, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.54% (0.3684 => 0.4109, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.51% (0.3092 => 0.3448, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 11.35% (17.1811 => 19.1315, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.20% (0.4064 => 0.4519, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.17% (0.3886 => 0.4320, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.16% (0.3826 => 0.4253, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.65% (0.3427 => 0.3792, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.50% (0.1114 => 0.1231, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 10.40% (0.3828 => 0.4226, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.23% (14.3668 => 15.8368, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/except: 9.86% (0.2871 => 0.3154, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.85% (0.3694 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.82% (0.3543 => 0.3891, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.82% (0.3543 => 0.3891, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 9.82% (0.2831 => 0.3109, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.21% (2.0665 => 2.2568, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.03% (0.2725 => 0.2971, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.96% (0.2756 => 0.3003, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 8.80% (1.2842 => 1.3972, std.dev.: 0.0130) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7526, std.dev.: 0.0104) SingleSource/Regression/C++/ofstream_ctor: 8.71% (0.2905 => 0.3158, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.66% (0.2793 => 0.3035, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.63% (0.3162 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.61% (0.2891 => 0.3140, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.60% (0.3650 => 0.3964, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.29% (0.3052 => 0.3305, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.18% (0.2872 => 0.3107, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.16% (0.3935 => 0.4256, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 8.14% (0.2802 => 0.3030, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 8.03% (0.2714 => 0.2932, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.83% (2.2022 => 2.3747, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.78% (0.6030 => 0.6499, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7326 => 0.7881, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 7.32% (0.5925 => 0.6359, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.46% (0.1625 => 0.1730, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 3.69% (10.3673 => 10.7495, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (7.9617 => 8.1499, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4760, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2944 => 0.3144, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.65% (11.6436 => 12.4182, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (4.2280 => 4.4623, std.dev.: 0.0049) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.53% (0.3316 => 0.3433, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (2.0360 => 2.1044, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.45% (8.6802 => 8.8925, std.dev.: 0.0205) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (3.6395 => 3.7223, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2874, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3057, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4569, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.89% (5.2763 => 1.1665, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -74.75% (0.8651 => 0.2184, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.09% (0.1622 => 0.0923, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.38% (5.3855 => 4.4496, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.73% (5.3526 => 4.4573, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -13.62% (10.4361 => 9.0144, std.dev.: 0.0084) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9194, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.80% (1.7609 => 1.6236, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.67% (1.9577 => 0.6720, std.dev.: 0.0066) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.32% (0.3987 => 0.2539, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3074, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.51% (1.5373 => 1.0222, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4172, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8530, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0076, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -18.91% (0.6223 => 0.5046, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7353, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.43% (19.9488 => 18.2675, std.dev.: 0.1190) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.54% (1.2373 => 1.1564, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (0.2497 => 0.2347, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6998, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.12% (0.4808 => 0.4562, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -4.30% (10.2830 => 9.8407, std.dev.: 0.0109) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0032) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.74% (3.6994 => 3.6352, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6704, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2350, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0014) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 18:30:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 20:30:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125023007.B123C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7917?compare_to=7914&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7917, Order: 173401, Start Time: 2013-01-25 00:56:13, End Time: 2013-01-25 02:30:23 To: 7914, Order: 173378, Start Time: 2013-01-24 22:58:19, End Time: 2013-01-25 00:32:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (107 on baseline) Performance Improvements: 2 (102 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.54% (2.1411 => 2.1082, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -1.09% (1.2910 => 1.2769, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.51% (0.0514 => 0.0897, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.26% (0.6395 => 0.8778, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.21% (0.5805 => 0.7675, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.19% (0.0699 => 0.0924, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.16% (0.5688 => 0.7517, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.92% (0.6260 => 0.8258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.74% (0.5456 => 0.7188, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.54% (0.5849 => 0.7694, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.49% (0.5567 => 0.7320, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.42% (0.6395 => 0.8404, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.14% (0.5581 => 0.7319, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.85% (0.5859 => 0.7608, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.55% (0.6033 => 0.7816, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.87% (0.6440 => 0.8299, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.18% (1.6474 => 2.1116, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.79% (0.6676 => 0.8531, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.65% (0.6304 => 0.8047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.14% (0.6230 => 0.7921, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.35% (0.5802 => 0.7331, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.28% (0.6660 => 0.8410, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.87% (0.5705 => 0.7181, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.79% (0.5925 => 0.7453, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.48% (0.5478 => 0.6874, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.44% (0.0790 => 0.0991, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.44% (0.5570 => 0.6987, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.42% (0.5857 => 0.7346, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.28% (0.5569 => 0.6977, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.77% (0.5591 => 0.6976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.86% (0.5863 => 0.7262, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.67% (0.6446 => 0.7972, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.45% (0.6052 => 0.7471, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.43% (0.7524 => 0.9287, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.77% (0.6681 => 0.8202, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.54% (0.6194 => 0.7590, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.22% (0.6297 => 0.7696, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.25% (2.2587 => 2.7386, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.85% (0.6667 => 0.8057, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.27% (0.7339 => 0.8753, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 15.49% (0.3357 => 0.3877, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 14.38% (1.1450 => 1.3096, std.dev.: 0.0144) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.34% (0.1081 => 0.1236, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.20% (4.5069 => 5.0568, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4916 => 0.5502, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.78% (0.4515 => 0.5047, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.19% (3.5339 => 3.9295, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.16% (1.6364 => 1.8190, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.49% (0.1982 => 0.2190, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.2385 => 0.2625, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 9.31% (9.2283 => 10.0878, std.dev.: 0.0066) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.54% (0.1230 => 0.1335, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.20% (0.2001 => 0.2165, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.18% (1.2515 => 1.3539, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 7.91% (0.4524 => 0.4882, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.73% (0.5329 => 0.5741, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.49% (1.4642 => 1.5738, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.06% (0.7021 => 0.7517, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.02% (0.4861 => 0.5202, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.92% (1.2784 => 1.3669, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.87% (0.3255 => 0.3446, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3319 => 0.3488, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.88% (5.4682 => 5.6806, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.73% (0.6750 => 0.7002, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.06% (5.0226 => 5.1763, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: 2.95% (0.3394 => 0.3494, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.73% (0.8418 => 0.8648, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 2.66% (1.3864 => 1.4233, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.14% (0.7447 => 0.7606, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.90% (0.9557 => 0.9739, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 1.80% (15.5079 => 15.7871, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.61% (1.3722 => 1.3943, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.43% (22.4056 => 22.7270, std.dev.: 0.0186) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7974, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.27% (1.2783 => 1.3712, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (0.2380 => 0.2543, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6767 => 12.1374, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5388, std.dev.: 0.1495) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0082) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2476, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (5.1955 => 5.2711, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5971, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3489 => 10.4643, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -4.60% (2.4924 => 2.3777, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.43% (0.7198 => 0.6879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.09% (0.3837 => 0.3680, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.08% (0.3821 => 0.3665, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.82% (0.9852 => 0.9476, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.70% (0.3812 => 0.3671, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.63% (0.3880 => 0.3739, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.61% (0.3848 => 0.3709, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.60% (0.3884 => 0.3744, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.60% (0.3831 => 0.3693, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.60% (0.3142 => 0.3029, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.57% (0.4033 => 0.3889, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.43% (0.3323 => 0.3209, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.40% (0.6347 => 0.6131, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.35% (0.4176 => 0.4036, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.30% (0.3057 => 0.2956, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.20% (0.6441 => 0.6235, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.95% (0.4199 => 0.4075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.91% (2.1713 => 2.1082, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -2.88% (1.3148 => 1.2769, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.74% (20.7746 => 20.2050, std.dev.: 0.0314) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.68% (0.6484 => 0.6310, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: -2.66% (0.4280 => 0.4166, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.47% (0.9542 => 0.9306, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.33% (14.2083 => 13.8768, std.dev.: 0.0105) MultiSource/Applications/sqlite3/sqlite3: -2.18% (17.1032 => 16.7307, std.dev.: 0.0251) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.79% (0.7919 => 0.7777, std.dev.: 0.0022) MultiSource/Applications/JM/lencod/lencod: -1.63% (16.1920 => 15.9278, std.dev.: 0.0202) MultiSource/Applications/lambda-0_1_3/lambda: -1.59% (0.7982 => 0.7855, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.44% (1.0544 => 1.0392, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.40% (1.2221 => 1.2050, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (6.7716 => 6.6772, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.38% (1.2210 => 1.2041, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.37% (0.9179 => 0.9053, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -1.31% (7.0961 => 7.0030, std.dev.: 0.0133) MultiSource/Applications/hbd/hbd: -1.24% (1.5610 => 1.5417, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.55% (1.8100 => 0.6960, std.dev.: 0.0413) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.72% (0.6962 => 0.3431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.39% (1.3643 => 1.0315, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7565, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0787, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1982, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.83% (0.6299 => 0.5050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1293, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3542, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.63% (1.3096 => 1.2752, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (7.9763 => 7.7857, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -1.85% (3.7241 => 3.6551, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3040 => 7.1866, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4757, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6703, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 18:38:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 20:38:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125023854.0E6242A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7918?compare_to=7913&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7918, Order: 173397, Start Time: 2013-01-25 00:34:29, End Time: 2013-01-25 02:39:11 To: 7913, Order: 173374, Start Time: 2013-01-24 22:08:03, End Time: 2013-01-25 00:13:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (8 on baseline) Performance Improvements: 10 (18 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1050 (1037 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.73% (0.8945 => 0.9189, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.32% (0.9014 => 0.9223, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.74% (1.0015 => 1.0189, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/multiplies: 1.82% (0.5564 => 0.5665, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.71% (0.1519 => 0.1326, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: -10.73% (0.1463 => 0.1306, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.95% (0.9304 => 0.8750, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout-C++/hash: -5.66% (0.4821 => 0.4548, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/methcall: -5.35% (0.2170 => 0.2054, std.dev.: 0.0033) MultiSource/Applications/oggenc/oggenc: -4.32% (5.5595 => 5.3192, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/SPASS/SPASS: -8.69% (9.4499 => 8.6287, std.dev.: 0.0960) SingleSource/Benchmarks/Stanford/Puzzle: -7.61% (0.1774 => 0.1639, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: -1.81% (2.3651 => 2.3223, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.30% (4.4170 => 4.3595, std.dev.: 0.0181) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.81% (1.1623 => 1.1529, std.dev.: 0.0651) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.75% (0.0474 => 0.0442, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0336 => 0.0336, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0319 => 0.0319, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.94% (0.0425 => 0.0446, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: 3.40% (0.0206 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.80% (0.0207 => 0.0219, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -35.71% (0.0014 => 0.0009, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.85% (0.1516 => 0.1488, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -0.65% (1.1794 => 1.1717, std.dev.: 0.4085) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.75% (0.4071 => 0.3959, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.67% (0.1418 => 0.1470, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.46% (0.0982 => 0.1016, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.09% (0.0275 => 0.0278, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.65% (0.0635 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.26% (1.1551 => 1.1928, std.dev.: 0.0803) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.50% (0.0605 => 0.0608, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.14% (0.0308 => 0.0286, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.63% (0.7463 => 0.7585, std.dev.: 0.0076) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0046 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.19% (12.7671 => 12.7910, std.dev.: 0.0863) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.27% (0.9588 => 1.0189, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.27% (0.8926 => 0.9307, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.59% (0.8990 => 0.9223, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320375.00% (0.0008 => 2.5638, std.dev.: 0.0440) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 93.34% (1.1825 => 2.2863, std.dev.: 0.0692) SingleSource/Benchmarks/Shootout-C++/ary3: 7.10% (1.8123 => 1.9410, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/pi: 2.98% (2.1390 => 2.2028, std.dev.: 0.0058) MultiSource/Applications/JM/lencod/lencod: 2.28% (6.8159 => 6.9715, std.dev.: 0.0419) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0102) SingleSource/Benchmarks/SmallPT/smallpt: -26.22% (0.1888 => 0.1393, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.14% (0.0692 => 0.0518, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.26% (0.1684 => 0.1326, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.23% (0.0676 => 0.0546, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.78% (6.4235 => 5.8597, std.dev.: 0.0654) MultiSource/Applications/sqlite3/sqlite3: -8.28% (17.5634 => 16.1090, std.dev.: 0.4056) MultiSource/Applications/ClamAV/clamscan: -8.07% (17.4365 => 16.0292, std.dev.: 0.4362) MultiSource/Applications/viterbi/viterbi: -5.87% (0.1824 => 0.1717, std.dev.: 0.0020) MultiSource/Applications/SIBsim4/SIBsim4: -3.84% (1.4392 => 1.3839, std.dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.95% (1.4235 => 1.2676, std.dev.: 0.0535) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.57% (1.4588 => 1.3483, std.dev.: 0.0207) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.22% (0.3201 => 0.3034, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: -4.81% (9.0650 => 8.6287, std.dev.: 0.0960) MultiSource/Applications/SIBsim4/SIBsim4: -3.41% (3.5443 => 3.4234, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/mandel-2: -2.10% (0.8521 => 0.8342, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.38% (3.3596 => 3.3132, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/methcall: -1.02% (8.7416 => 8.6523, std.dev.: 0.0240) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.30% (1.2047 => 1.1529, std.dev.: 0.0651) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.00% (0.0451 => 0.0442, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.22% (0.0445 => 0.0446, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0213 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.12% (0.0255 => 0.0219, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -2.75% (0.1530 => 0.1488, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -39.27% (1.9293 => 1.1717, std.dev.: 0.4085) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.22% (0.4049 => 0.3959, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.65% (0.1510 => 0.1470, std.dev.: 0.0239) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.89% (0.0978 => 0.1016, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.68% (1.1617 => 1.1928, std.dev.: 0.0803) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.72% (0.0268 => 0.0286, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.99% (0.7437 => 0.7585, std.dev.: 0.0076) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.70% (0.0092 => 0.0061, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.10% (12.7781 => 12.7910, std.dev.: 0.0863) Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 20:27:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 22:27:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125042756.1B41A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7919?compare_to=7917&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7919, Order: 173412, Start Time: 2013-01-25 02:53:52, End Time: 2013-01-25 04:28:12 To: 7917, Order: 173401, Start Time: 2013-01-25 00:56:13, End Time: 2013-01-25 02:30:23 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.76% (0.0315 => 0.0708, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.74% (0.0974 => 0.1624, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.39% (0.6395 => 0.8786) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.17% (0.5688 => 0.7518, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.93% (0.6260 => 0.8259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.93% (0.5456 => 0.7198, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.62% (0.6395 => 0.8417, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.61% (0.5849 => 0.7698, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.60% (0.5567 => 0.7326, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.30% (0.5575 => 0.7320, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.07% (0.5581 => 0.7315, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.57% (0.6033 => 0.7817, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.07% (0.6440 => 0.8312, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.28% (0.6189 => 0.7939, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.27% (1.6474 => 2.1132, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.09% (0.6676 => 0.8551, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.82% (0.6304 => 0.8058, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.27% (0.6230 => 0.7929, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.54% (0.5802 => 0.7342, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.35% (0.6660 => 0.8415, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.08% (0.5705 => 0.7193, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.96% (0.5925 => 0.7463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.68% (0.5857 => 0.7361, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.56% (0.5478 => 0.6878, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.55% (0.5570 => 0.6993, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.43% (0.5569 => 0.6985, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.83% (0.5591 => 0.6979, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.93% (0.5863 => 0.7266, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.79% (0.6052 => 0.7492, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.58% (0.6446 => 0.7966, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.52% (0.7524 => 0.9294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.87% (0.6681 => 0.8209, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.72% (0.6194 => 0.7601, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.31% (0.6297 => 0.7702, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.34% (2.2587 => 2.7407, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.03% (0.6667 => 0.8069, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.53% (0.7339 => 0.8772, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.45% (1.1450 => 1.3105, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.32% (4.5069 => 5.0622, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4916 => 0.5520, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4515 => 0.5055, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.81% (0.1982 => 0.2216, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.27% (1.6364 => 1.8208, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.02% (3.5339 => 3.9234, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.08% (0.1230 => 0.1354, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.37% (9.2283 => 10.0928, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash: 9.06% (0.4524 => 0.4934, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.39% (1.2515 => 1.3565, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.96% (0.5329 => 0.5753, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.86% (0.1731 => 0.1867, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (0.4861 => 0.5236, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.13% (1.4642 => 1.5686, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.78% (1.2784 => 1.3651, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 6.48% (0.3255 => 0.3466, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3319 => 0.3495, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6750 => 0.7036, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (5.4682 => 5.6850, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 3.83% (0.3446 => 0.3578, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.79% (5.0226 => 5.2129, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3394 => 0.3517, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.99% (0.8418 => 0.8670, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 2.66% (1.3864 => 1.4233, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.47% (0.9557 => 0.9793, std.dev.: 0.0038) MultiSource/Applications/minisat/minisat: 2.22% (0.7447 => 0.7612, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.97% (0.5168 => 0.5270, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.89% (22.4056 => 22.8280, std.dev.: 0.0216) MultiSource/Applications/SPASS/SPASS: 1.88% (15.5079 => 15.8000, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.72% (1.3722 => 1.3958, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8157, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.96% (0.9531 => 1.0290, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.85% (0.2380 => 0.2543, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 3.96% (11.6767 => 12.1386, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5567, std.dev.: 0.0778) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2471, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0085) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5320 => 4.5934, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.04% (3.6551 => 3.6930, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.77% (0.7198 => 0.6855, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -4.48% (0.3194 => 0.3051, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.28% (2.4924 => 2.3858, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.03% (0.3821 => 0.3667, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.90% (0.9852 => 0.9468, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.54% (0.3837 => 0.3701, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.44% (0.3812 => 0.3681, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.29% (0.3831 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.23% (0.3896 => 0.3770, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.22% (0.4033 => 0.3903, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3848 => 0.3725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.19% (0.3891 => 0.3767, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.07% (0.4176 => 0.4048, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.88% (20.7746 => 20.1758, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.86% (0.9542 => 0.9269, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.60% (0.4199 => 0.4090, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.56% (0.6484 => 0.6318, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -2.47% (0.6347 => 0.6190, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.34% (1.3148 => 1.2840, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -2.34% (0.4280 => 0.4180, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -2.27% (0.6441 => 0.6295, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8920, std.dev.: 0.0222) MultiSource/Applications/sqlite3/sqlite3: -2.17% (17.1032 => 16.7322, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.11% (2.1713 => 2.1255, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.86% (0.7779 => 0.7634, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: -1.56% (16.1920 => 15.9386, std.dev.: 0.0079) MultiSource/Applications/lambda-0_1_3/lambda: -1.49% (0.7982 => 0.7863, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.48% (0.7919 => 0.7802, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: -1.38% (4.3330 => 4.2734, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/football/football: -1.36% (0.9179 => 0.9054, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: -1.22% (7.0961 => 7.0098, std.dev.: 0.0102) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (6.7716 => 6.6918, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.05% (1.2221 => 1.2093, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.66% (1.8100 => 0.6940, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.29% (1.3643 => 1.0193, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0724, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1998, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.81% (0.6299 => 0.5051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3557, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1725, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.08% (1.3096 => 1.2692, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (7.9763 => 7.7570, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/ary3: -2.53% (3.7241 => 3.6298, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.61% (7.3040 => 7.1866, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.50% (2.3169 => 2.2822, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.40% (1.6307 => 1.6079, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6680, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 20:43:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 22:43:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125044353.49C532A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7920?compare_to=7916&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7920, Order: 173412, Start Time: 2013-01-25 02:33:11, End Time: 2013-01-25 04:44:09 To: 7916, Order: 173383, Start Time: 2013-01-24 23:51:25, End Time: 2013-01-25 02:02:26 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (219 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.22% (37.2584 => 37.7126, std.dev.: 0.0309) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0666 => 0.0665, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8237 => 499.8451, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44224.30% (1.1277 => 499.8451, std.dev.: 0.0081) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.96% (0.5229 => 1.6469, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 20.86% (14.9895 => 18.1168, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 44.42% (14.1553 => 20.4431, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/gs/gs: 18.17% (4.1105 => 4.8572, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.73% (1.1048 => 1.7315, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 426.84% (7.1582 => 37.7126, std.dev.: 0.0309) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.95% (3.4629 => 6.4391, std.dev.: 0.0233) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.88% (0.6222 => 1.0943, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10282.08% (0.0720 => 7.4751, std.dev.: 0.0046) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11152600.00% (0.0001 => 11.1527, std.dev.: 0.0172) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63800.00% (0.0001 => 0.0639) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574500.00% (0.0001 => 0.5746, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0025) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.00% (1.1194 => 10.2313, std.dev.: 0.0085) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 148.44% (22.1758 => 55.0933, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.88% (0.0929 => 0.1829, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.63% (0.1463 => 0.2511, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.49% (2.9384 => 4.6278, std.dev.: 0.0210) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.00% (1.5859 => 2.4106, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.88% (7.0540 => 10.7136, std.dev.: 0.0086) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.73% (8.1363 => 11.9382, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.48% (2.2024 => 3.1379, std.dev.: 0.0098) MultiSource/Applications/sgefa/sgefa: 39.92% (0.3109 => 0.4350, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.86% (0.0439 => 0.0614, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: 38.55% (0.1432 => 0.1984, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.35% (21.9371 => 30.3490, std.dev.: 0.0016) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.27% (4.2646 => 5.6836, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.81% (0.4615 => 0.6129, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.66% (1.5415 => 2.0449, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.56% (0.2271 => 0.2965, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.01% (0.0793 => 0.1031, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 29.87% (1.1642 => 1.5119, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 29.68% (0.4299 => 0.5575, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 28.96% (0.1143 => 0.1474, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.23% (0.5105 => 0.6546, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.51% (0.6675 => 0.8511, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 27.01% (0.1655 => 0.2102, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.96% (0.1584 => 0.2011, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/08-main/main: 26.66% (0.2554 => 0.3235, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.64% (0.1892 => 0.2396, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 26.10% (9.4845 => 11.9595, std.dev.: 0.0100) MultiSource/Applications/viterbi/viterbi: 26.05% (0.1555 => 0.1960, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.03% (3.8922 => 4.9055, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.01% (0.1695 => 0.2119, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.90% (0.1566 => 0.1956, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.74% (0.0675 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.48% (0.3121 => 0.3885, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 24.45% (1.0722 => 1.3344, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.26% (1.4186 => 1.7628, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 24.20% (0.4289 => 0.5327, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.93% (0.0886 => 0.1098, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.68% (0.4620 => 0.5714, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 23.32% (0.7115 => 0.8774, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 22.21% (0.0662 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.44% (0.2700 => 0.3279, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 21.24% (0.7835 => 0.9499, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.13% (0.0871 => 0.1055) SingleSource/Benchmarks/Shootout-C++/matrix: 21.01% (0.3098 => 0.3749, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.90% (1.3050 => 1.5778, std.dev.: 0.0088) SingleSource/Benchmarks/Misc-C++/bigfib: 20.86% (0.6456 => 0.7803, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 20.59% (0.1151 => 0.1388, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.41% (5.7591 => 6.9347, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.26% (0.1940 => 0.2333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.25% (0.0953 => 0.1146, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.90% (0.8172 => 0.9798, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.83% (0.5860 => 0.7022, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.57% (4.9449 => 5.9125, std.dev.: 0.0058) MultiSource/Applications/lambda-0_1_3/lambda: 19.01% (0.7433 => 0.8846, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.92% (0.5020 => 0.5970, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.87% (0.3307 => 0.3931, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.72% (5.0018 => 5.9381, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: 18.70% (3.3354 => 3.9592, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.42% (0.2758 => 0.3266, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.11% (0.9765 => 1.1533, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 18.06% (0.1268 => 0.1497, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 18.03% (2.0273 => 2.3928, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.01% (0.1510 => 0.1782, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.5569 => 0.6570, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 17.97% (1.1840 => 1.3968, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 17.88% (0.3423 => 0.4035, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.65% (1.1861 => 1.3954, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.58% (3.8723 => 4.5531, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.24% (0.5981 => 0.7012, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.09% (0.2065 => 0.2418, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.04% (0.0933 => 0.1092, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 16.98% (0.2049 => 0.2397, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.94% (2.2969 => 2.6860, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.65% (0.3441 => 0.4014, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.44% (0.8101 => 0.9433, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 16.33% (0.3283 => 0.3819, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 16.13% (0.3180 => 0.3693, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.12% (0.6450 => 0.7490, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 16.03% (0.3232 => 0.3750, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814) MultiSource/Benchmarks/Prolangs-C/football/football: 15.27% (0.8921 => 1.0283, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.60% (0.8067 => 0.9245, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.33% (0.2603 => 0.2976, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.79% (0.3865 => 0.4398, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.42% (0.4636 => 0.5258, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 13.20% (0.3387 => 0.3834, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.82% (0.4103 => 0.4629, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 12.61% (1.5603 => 1.7571, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.44% (0.4203 => 0.4726, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 12.06% (0.4048 => 0.4536, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.97% (0.3282 => 0.3675, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists: 11.95% (0.3422 => 0.3831, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 11.82% (0.3603 => 0.4029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.78% (0.3684 => 0.4118, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.73% (0.2430 => 0.2715, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.49% (17.1811 => 19.1555, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/bh/bh: 11.38% (0.3092 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.34% (0.4064 => 0.4525, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 11.12% (0.1268 => 0.1409, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.08% (0.3927 => 0.4362, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.00% (0.3826 => 0.4247, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.85% (0.3427 => 0.3799, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.71% (0.3886 => 0.4302, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.59% (0.1114 => 0.1232, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.32% (14.3668 => 15.8490, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/exceptions: 9.90% (0.3828 => 0.4207, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.86% (0.2831 => 0.3110, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.68% (0.2871 => 0.3149, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.46% (0.3543 => 0.3878, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.36% (0.3473 => 0.3798, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/synchronized: 9.35% (0.3561 => 0.3894, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.33% (0.3516 => 0.3844, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.29% (0.3497 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.13% (2.0665 => 2.2552, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 9.00% (0.2877 => 0.3136, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.93% (0.2756 => 0.3002, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 8.85% (1.2842 => 1.3979, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.81% (0.2725 => 0.2965, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.70% (0.2793 => 0.3036, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.60% (0.3162 => 0.3434, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 8.55% (0.2714 => 0.2946, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.55% (0.3650 => 0.3962, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 8.54% (0.2905 => 0.3153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.51% (0.2891 => 0.3137, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 8.42% (63.2438 => 68.5672, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/wc: 8.29% (0.3052 => 0.3305, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 8.17% (0.2802 => 0.3031, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.16% (0.3935 => 0.4256, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.11% (0.2872 => 0.3105, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.75% (0.3136 => 0.3379, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 7.46% (0.6030 => 0.6480, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.36% (0.7326 => 0.7865, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.01% (2.2022 => 2.3565, std.dev.: 0.0119) SingleSource/UnitTests/ObjC++/Hello: 6.97% (0.5925 => 0.6338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.58% (0.1625 => 0.1732, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.98% (0.4879 => 0.5171, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.3131 => 0.3243, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.08% (10.3673 => 10.6861, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (7.9617 => 8.1395, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4769, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2944 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.64% (11.6436 => 12.4166, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.54% (4.2280 => 4.4624, std.dev.: 0.0083) SingleSource/Regression/C/uint64_to_float: 5.15% (0.5413 => 0.5692, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1051, std.dev.: 0.0021) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9182, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7167, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.80% (9.1159 => 9.2802, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3056, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.39% (1.0785 => 1.0935, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5823, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4528, std.dev.: 0.0055) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1679, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -78.01% (5.2763 => 1.1600, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.63% (5.3855 => 4.4360, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.96% (5.3526 => 4.4449, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -13.74% (10.4361 => 9.0022, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.25% (1.7609 => 1.6156, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.86% (54.1659 => 49.9078, std.dev.: 0.0287) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.53% (1.9577 => 0.6748, std.dev.: 0.0224) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -33.78% (1.5373 => 1.0180, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4327, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8564, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0068, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -18.91% (0.6223 => 0.5046, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4248, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.42% (19.9488 => 18.2692, std.dev.: 0.0450) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (0.2497 => 0.2347) SingleSource/Benchmarks/McGill/chomp: -5.91% (1.2373 => 1.1642, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7013, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.98% (1.5835 => 1.5047, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.29% (10.2830 => 9.8421, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/ary3: -1.59% (3.6994 => 3.6405, std.dev.: 0.0126) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2784, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.47% (3.7221 => 3.6672, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2205, std.dev.: 0.0113) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0016) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 20:56:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 22:56:40 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125045640.898F82A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7921?compare_to=7918&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7921, Order: 173412, Start Time: 2013-01-25 02:56:22, End Time: 2013-01-25 04:56:58 To: 7918, Order: 173397, Start Time: 2013-01-25 00:34:29, End Time: 2013-01-25 02:39:11 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (8 on baseline) Performance Improvements: 28 (67 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (988 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 6.44% (2.2863 => 2.4336, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.68% (4.3595 => 4.4326, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.10% (0.2396 => 0.2178, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.13% (0.2974 => 0.2762, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.13% (0.9921 => 0.9214, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -7.08% (0.9556 => 0.8879, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.93% (0.9223 => 0.8676, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -5.67% (0.9300 => 0.8773, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.44% (1.0367 => 0.9803, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -5.34% (1.0303 => 0.9753, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.28% (0.9994 => 0.9466, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.22% (1.0189 => 0.9657, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.12% (0.9623 => 0.9130, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.66% (1.0030 => 0.9563, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: -4.54% (1.3178 => 1.2580, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.29% (1.0085 => 0.9652, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.89% (1.0380 => 0.9976, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.87% (0.9189 => 0.8833, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.15% (0.9209 => 0.8919, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.97% (0.9340 => 0.9063, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.48% (0.9430 => 0.9196, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.09% (0.9328 => 0.9133, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.67% (1.2600 => 1.2390, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/five11/five11: -2.75% (5.7427 => 5.5850, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.44% (0.9052 => 0.8831, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -2.07% (1.8819 => 1.8429, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/ffbench: -1.80% (1.3958 => 1.3707, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.27% (5.7270 => 5.6542, std.dev.: 0.0273) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.16% (2.5405 => 2.5111, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.10% (1.4123 => 1.3968, std.dev.: 0.0053) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.99% (1.1529 => 1.1300, std.dev.: 0.0215) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -24.77% (0.0222 => 0.0167, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.74% (0.0442 => 0.0368, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.01% (0.0336 => 0.0299, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0319 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.14% (0.0446 => 0.0432, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -11.76% (0.0221 => 0.0195, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.57% (0.0219 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -77.78% (0.0009 => 0.0002, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 0.60% (0.1488 => 0.1497, std.dev.: 0.0325) MultiSource/Applications/lemon/lemon: -0.48% (1.1717 => 1.1661, std.dev.: 0.3324) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.99% (0.3959 => 0.3998, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.95% (0.1470 => 0.1484, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.66% (0.1016 => 0.0989, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.24% (0.0278 => 0.0269, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.85% (0.0561 => 0.0545, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.95% (1.1928 => 1.1457, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0608 => 0.0611, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.39% (0.0286 => 0.0310, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.25% (0.7585 => 0.7414, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 24.59% (0.0061 => 0.0076, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.61% (12.7910 => 12.7132, std.dev.: 0.1238) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 48.51% (0.0336 => 0.0499, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.14% (1.4805 => 1.4974, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320987.50% (0.0008 => 2.5687, std.dev.: 0.0423) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 105.80% (1.1825 => 2.4336, std.dev.: 0.0155) MultiSource/Applications/sgefa/sgefa: 18.98% (0.3515 => 0.4182, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.28% (0.2562 => 0.2851, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 2.35% (6.8159 => 6.9758, std.dev.: 0.0535) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.08% (4.3851 => 4.4326, std.dev.: 0.0089) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.49% (0.0808 => 0.0497, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0014) SingleSource/Benchmarks/SmallPT/smallpt: -26.32% (0.1888 => 0.1391, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.39% (0.1684 => 0.1307, std.dev.: 0.0038) MultiSource/Applications/hbd/hbd: -19.55% (1.8964 => 1.5257, std.dev.: 0.0883) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.23% (0.1009 => 0.0815, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.05% (0.0676 => 0.0554, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.40% (0.0862 => 0.0712, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.93% (1.0960 => 0.9214, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.60% (1.0986 => 0.9492, std.dev.: 0.0162) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.47% (0.4074 => 0.3566, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.64% (6.4235 => 5.7398, std.dev.: 0.2508) MultiSource/Applications/aha/aha: -10.52% (0.1378 => 0.1233, std.dev.: 0.0050) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.42% (1.2154 => 1.0887, std.dev.: 0.0102) MultiSource/Applications/lua/lua: -9.98% (4.6406 => 4.1775, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.73% (1.3924 => 1.2708, std.dev.: 0.0458) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.61% (10.2703 => 9.3865, std.dev.: 0.3218) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.18% (0.2372 => 0.2178, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/health/health: -7.64% (0.1610 => 0.1487, std.dev.: 0.0012) MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.35% (1.1731 => 1.0869, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.78% (0.2283 => 0.2151, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.50% (1.0017 => 0.9466, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.28% (0.9588 => 0.9082, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.91% (0.3462 => 0.3292, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.52% (0.9422 => 0.8996, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.23% (0.2884 => 0.2762, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.16% (0.6135 => 0.5880, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.08% (1.3220 => 1.2680, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.05% (1.0234 => 0.9820, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.98% (0.9512 => 0.9133, std.dev.: 0.0063) MultiSource/Benchmarks/sim/sim: -3.88% (0.3715 => 0.3571, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.49% (0.8990 => 0.8676, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.27% (0.9507 => 0.9196, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.29% (1.2680 => 1.2390, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.06% (0.9855 => 0.9652, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.57% (0.6996 => 0.6886, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.05% (0.9372 => 0.6462, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout/heapsort: -29.71% (4.4739 => 3.1445, std.dev.: 0.3372) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.37% (1.0816 => 0.7748, std.dev.: 0.0573) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.89% (1.5623 => 1.2672, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.00% (0.1164 => 0.1001, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.86% (1.4235 => 1.2547, std.dev.: 0.0247) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.78% (0.4081 => 0.3641, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: -10.53% (4.5259 => 4.0493, std.dev.: 0.1075) SingleSource/Benchmarks/Shootout-C++/lists1: -8.84% (0.6628 => 0.6042, std.dev.: 0.0072) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.42% (4.4540 => 4.0790, std.dev.: 0.0913) SingleSource/Benchmarks/Shootout/nestedloop: -8.41% (0.2200 => 0.2015, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.33% (0.3217 => 0.2949, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.25% (1.4588 => 1.3385, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/ary3: -6.21% (2.2304 => 2.0918, std.dev.: 0.0210) MultiSource/Benchmarks/Olden/health/health: -6.16% (0.3654 => 0.3429, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.44% (0.3201 => 0.3027, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.40% (0.3349 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: -3.77% (1.4244 => 1.3707, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: -3.60% (17.2182 => 16.5975, std.dev.: 0.1252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.31% (1.4446 => 1.3968, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.71% (42.3194 => 41.1717, std.dev.: 0.4418) MultiSource/Benchmarks/mafft/pairlocalalign: -2.61% (63.1520 => 61.5028, std.dev.: 0.4156) SingleSource/Benchmarks/Misc/mandel-2: -2.52% (0.8521 => 0.8306, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.15% (3.0082 => 2.9435, std.dev.: 0.0181) MultiSource/Benchmarks/BitBench/five11/five11: -2.05% (5.7021 => 5.5850, std.dev.: 0.0205) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.47% (3.7662 => 3.7107, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.40% (3.1921 => 3.1474, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3162, std.dev.: 0.0032) SingleSource/Benchmarks/SmallPT/smallpt: -1.12% (14.9448 => 14.7770, std.dev.: 0.0198) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.20% (1.2047 => 1.1300, std.dev.: 0.0215) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -28.33% (0.0233 => 0.0167, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.40% (0.0451 => 0.0368, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.11% (0.0394 => 0.0299, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/test1: -14.10% (0.0227 => 0.0195, std.dev.: 0.0018) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -86.67% (0.0015 => 0.0002, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: -2.16% (0.1530 => 0.1497, std.dev.: 0.0325) MultiSource/Applications/lemon/lemon: -39.56% (1.9293 => 1.1661, std.dev.: 0.3324) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.26% (0.4049 => 0.3998, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.72% (0.1510 => 0.1484, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.12% (0.0978 => 0.0989, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.63% (0.0590 => 0.0545, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.38% (1.1617 => 1.1457, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 15.67% (0.0268 => 0.0310, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.31% (0.7437 => 0.7414, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.51% (12.7781 => 12.7132, std.dev.: 0.1238) Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 21:17:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 24 Jan 2013 23:17:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125051741.286E62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7922?compare_to=7915&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7922, Order: 173403, Start Time: 2013-01-25 01:42:53, End Time: 2013-01-25 05:17:56 To: 7915, Order: 173361, Start Time: 2013-01-24 21:13:19, End Time: 2013-01-25 00:49:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (182 on baseline) Performance Improvements: 5 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (754 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 2.77% (13.2720 => 13.6396, std.dev.: 0.0897) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.05% (54.1876 => 54.7539, std.dev.: 0.0507) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.39% (0.4813 => 0.4698, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/gs/gs: -2.13% (2.2862 => 2.2375, std.dev.: 0.0170) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.97% (0.6045 => 0.5926, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: -1.51% (0.9215 => 0.9076, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.49% (2.3653 => 2.3300, std.dev.: 0.0111) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.84% (0.0625 => 0.0899, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.62% (0.1063 => 0.1431, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.66% (0.1106 => 0.1423, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.46% (0.2969 => 0.3814, std.dev.: 0.0160) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.59% (0.4139 => 0.5281, std.dev.: 0.0097) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.06% (0.0547 => 0.0695, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.47% (0.0714 => 0.0903, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.31% (0.5900 => 0.7452, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.26% (0.4253 => 0.5370, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 26.07% (1.5932 => 2.0086, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.84% (0.1107 => 0.1393, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.58% (0.5000 => 0.6279, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.54% (0.0415 => 0.0521, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.51% (0.0584 => 0.0733, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.37% (0.1549 => 0.1942, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.27% (0.4994 => 0.6256, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 24.54% (0.0599 => 0.0746, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.45% (0.0822 => 0.1023, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.44% (0.1620 => 0.2016, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 23.55% (0.0947 => 0.1170, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.12% (0.0584 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.89% (0.0948 => 0.1165, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.83% (0.1003 => 0.1232, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.75% (0.0633 => 0.0777, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.67% (0.1103 => 0.1353) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.59% (0.0642 => 0.0787, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.57% (0.1604 => 0.1966, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.47% (0.3903 => 0.4780, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 22.05% (0.0821 => 0.1002, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.00% (0.0541 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.96% (0.1462 => 0.1783, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 21.93% (0.1619 => 0.1974, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.32% (0.2866 => 0.3477, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.27% (0.2736 => 0.3318, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: 21.25% (0.4029 => 0.4885, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.79% (0.3271 => 0.3951, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.77% (0.3890 => 0.4698, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.59% (0.1088 => 0.1312, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 20.53% (0.1218 => 0.1468, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.31% (0.2014 => 0.2423, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 20.20% (0.0698 => 0.0839, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.95% (1.3152 => 1.5776, std.dev.: 0.0147) MultiSource/Benchmarks/McCat/09-vor/vor: 19.93% (0.1505 => 0.1805, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 19.51% (0.5546 => 0.6628, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 19.45% (0.5826 => 0.6959, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.42% (1.9694 => 2.3519, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.36% (0.4658 => 0.5560, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 19.05% (1.8794 => 2.2375, std.dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference-object: 18.92% (0.5889 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.78% (0.2875 => 0.3415, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.62% (0.2792 => 0.3312, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.55% (3.5627 => 4.2235, std.dev.: 0.0687) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.50% (0.1968 => 0.2332, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.46% (1.6211 => 1.9204, std.dev.: 0.0150) MultiSource/Applications/hbd/hbd: 18.34% (0.9697 => 1.1475, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/strcat: 18.29% (0.2750 => 0.3253, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 18.21% (0.2811 => 0.3323, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.17% (2.7292 => 3.2250, std.dev.: 0.0152) MultiSource/Applications/d/make_dparser: 18.11% (1.0781 => 1.2733, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: 18.00% (0.7171 => 0.8462, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 18.00% (0.2823 => 0.3331, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 17.99% (0.2813 => 0.3319, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 17.99% (0.2780 => 0.3280, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.92% (0.2729 => 0.3218, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 17.91% (0.1284 => 0.1514, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.91% (0.5026 => 0.5926, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.90% (0.2911 => 0.3432, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.82% (0.2738 => 0.3226, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 17.80% (0.2714 => 0.3197, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.79% (0.4361 => 0.5137, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/random: 17.77% (0.2803 => 0.3301, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 17.76% (0.2725 => 0.3209, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.70% (0.0582 => 0.0685, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.68% (2.0673 => 2.4327, std.dev.: 0.0041) SingleSource/Regression/C++/ofstream_ctor: 17.64% (0.3004 => 0.3534, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.63% (0.3930 => 0.4623, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.43% (0.3195 => 0.3752, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.39% (0.3060 => 0.3592, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/wc: 17.31% (0.3096 => 0.3632, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.29% (0.3267 => 0.3832, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 17.26% (0.9909 => 1.1619, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 17.22% (0.3258 => 0.3819, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 17.11% (4.2109 => 4.9312, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.94% (0.3625 => 0.4239, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.78% (4.4195 => 5.1609, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary2: 16.70% (0.3317 => 0.3871, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.70% (1.9966 => 2.3300, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/sieve: 16.69% (0.3726 => 0.4348, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 16.55% (0.3348 => 0.3902, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.53% (23.5202 => 27.4090, std.dev.: 0.0308) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.52% (0.3124 => 0.3640, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.48% (0.3362 => 0.3916, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.42% (0.3282 => 0.3821, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 16.29% (0.3678 => 0.4277, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 16.25% (0.3477 => 0.4042, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.15% (0.1090 => 0.1266, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.03% (0.3981 => 0.4619, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 16.02% (0.4251 => 0.4932, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.81% (0.2068 => 0.2395, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 15.75% (1.4269 => 1.6517, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.69% (0.3690 => 0.4269, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 15.68% (0.4146 => 0.4796, std.dev.: 0.0054) MultiSource/Benchmarks/nbench/nbench: 15.67% (0.2566 => 0.2968, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.65% (0.3488 => 0.4034, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 15.58% (0.3465 => 0.4005, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.55% (0.3446 => 0.3982, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.46% (0.3460 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.45% (0.3496 => 0.4036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.40% (0.3442 => 0.3972, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.39% (0.3469 => 0.4003, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.25% (0.7875 => 0.9076, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/property: 15.15% (0.3650 => 0.4203, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.14% (0.3845 => 0.4427, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 15.04% (0.2075 => 0.2387, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 14.96% (0.3643 => 0.4188, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 14.92% (0.5012 => 0.5760, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 14.90% (0.3724 => 0.4279, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 14.75% (0.2691 => 0.3088, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 14.50% (2.1653 => 2.4793, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 14.02% (5.5417 => 6.3188, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.97% (0.6435 => 0.7334, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.91% (0.1028 => 0.1171, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 13.86% (4.6177 => 5.2575, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.2737 => 0.3107, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.49% (2.1013 => 2.3847, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.94% (0.1383 => 0.1562, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.50% (0.2040 => 0.2295, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.38% (0.3498 => 0.3931, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.3084 => 0.3459, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 11.95% (0.6634 => 0.7427, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 11.66% (0.3336 => 0.3725, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.60% (0.5361 => 0.5983, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.55% (0.2103 => 0.2346, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 11.39% (0.4847 => 0.5399, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.74% (11.6398 => 12.8899, std.dev.: 0.0145) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.67% (0.7426 => 0.8218, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.01% (2.0346 => 2.2383, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.78% (4.6926 => 5.1516, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.12% (0.5584 => 0.6093, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 8.30% (11.9555 => 12.9481, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5101, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.97% (0.3693 => 0.4098, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 9.14% (0.2802 => 0.3058, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6787, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2390, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-2: 5.02% (1.8057 => 1.8964, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6880, std.dev.: 0.0051) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1906, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3067, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0815, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2087, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.02% (50.0626 => 50.5749, std.dev.: 0.0170) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.01% (2.1746 => 2.1965, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.28% (2.4764 => 2.4448, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5753, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.32% (17.2379 => 14.2531, std.dev.: 0.0805) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.49% (0.2402 => 0.2150, std.dev.: 0.0056) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9755, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7908, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9581, std.dev.: 0.0024) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2097, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7955, std.dev.: 0.0088) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.91% (14.0481 => 13.6396, std.dev.: 0.0897) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1013, std.dev.: 0.0487) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1793, std.dev.: 0.0152) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0480, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 22:26:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 00:26:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125062608.C26AA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7923?compare_to=7919&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7923, Order: 173414, Start Time: 2013-01-25 04:52:03, End Time: 2013-01-25 06:26:24 To: 7919, Order: 173412, Start Time: 2013-01-25 02:53:52, End Time: 2013-01-25 04:28:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (98 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 1.09% (1.0193 => 1.0304, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.91% (0.0974 => 0.1616, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.33% (0.1500 => 0.2180, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.34% (0.1132 => 0.1600, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.28% (0.6395 => 0.8779, std.dev.: 0.0046) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 32.62% (0.0699 => 0.0927, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.25% (0.5805 => 0.7677, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.98% (0.5688 => 0.7507, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.76% (0.6260 => 0.8248, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.71% (0.5456 => 0.7186, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.48% (0.6395 => 0.8408, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.46% (0.5849 => 0.7689, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.44% (0.5567 => 0.7317, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 30.96% (0.5575 => 0.7301, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 30.91% (0.5581 => 0.7306, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.20% (0.5941 => 0.7735, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.65% (0.5859 => 0.7596, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.34% (0.6033 => 0.7803, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.79% (0.6440 => 0.8294, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.18% (1.6474 => 2.1117, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.13% (0.6189 => 0.7930, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.76% (0.6676 => 0.8529, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.52% (0.6304 => 0.8039, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.98% (0.6230 => 0.7911, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.23% (0.5802 => 0.7324, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.14% (0.6660 => 0.8401, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.78% (0.5705 => 0.7176, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 25.64% (0.5925 => 0.7444, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.34% (0.5857 => 0.7341, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.26% (0.5478 => 0.6862, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.25% (0.5569 => 0.6975, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.22% (0.5570 => 0.6975, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.59% (0.5591 => 0.6966, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.76% (0.5863 => 0.7256, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.51% (0.6052 => 0.7475, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.44% (0.6446 => 0.7957, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.42% (0.7524 => 0.9286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.75% (0.6681 => 0.8201, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.46% (0.6194 => 0.7585, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.11% (0.6297 => 0.7689, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.30% (2.2587 => 2.7399, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.88% (0.6667 => 0.8059, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.23% (0.7339 => 0.8750, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 14.75% (0.3357 => 0.3852, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.34% (1.1450 => 1.3092, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.21% (0.4916 => 0.5516, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.15% (4.5069 => 5.0544, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.37% (1.6364 => 1.8224, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1982 => 0.2201, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.80% (3.5339 => 3.9154, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 9.21% (9.2283 => 10.0781, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash: 8.86% (0.4524 => 0.4925, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.70% (0.2001 => 0.2175, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.33% (1.2515 => 1.3558, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4861 => 0.5253, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.71% (0.5329 => 0.5740, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 7.16% (0.3255 => 0.3488, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.01% (1.4642 => 1.5669, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.95% (0.7021 => 0.7509, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (1.2784 => 1.3655, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.3319 => 0.3491, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: 4.21% (0.3446 => 0.3591, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 4.15% (0.6750 => 0.7030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.92% (0.3394 => 0.3527, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.55% (5.4682 => 5.6624, std.dev.: 0.0016) MultiSource/Applications/oggenc/oggenc: 2.93% (5.0226 => 5.1697, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 2.82% (0.8418 => 0.8655, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 2.42% (1.3864 => 1.4199, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.23% (0.9557 => 0.9770, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.12% (0.7447 => 0.7605, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.75% (1.3722 => 1.3962, std.dev.: 0.0083) MultiSource/Applications/SPASS/SPASS: 1.67% (15.5079 => 15.7662, std.dev.: 0.0176) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.49% (22.4056 => 22.7385, std.dev.: 0.0206) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.96% (31.3723 => 55.8302, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.81% (0.2380 => 0.2542) MultiSource/Benchmarks/nbench/nbench: 3.95% (11.6767 => 12.1377, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.31% (54.5751 => 56.3828, std.dev.: 0.1084) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.55% (2.0478 => 2.1000, std.dev.: 0.0126) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2460, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2703, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.40% (4.5320 => 4.5955, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.15% (10.3489 => 10.4680, std.dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.57% (0.1281 => 0.1120, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.06% (0.1431 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.21% (0.7198 => 0.6823, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.42% (0.3821 => 0.3652, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -4.26% (2.4924 => 2.3861, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.12% (0.9852 => 0.9446, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.07% (0.3194 => 0.3064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.18% (0.3837 => 0.3715, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.92% (0.9542 => 0.9263, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.80% (20.7746 => 20.1929, std.dev.: 0.0359) SingleSource/UnitTests/ObjC/trivial-interface: -2.68% (0.3812 => 0.3710, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -2.64% (0.3831 => 0.3730, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.63% (0.4033 => 0.3927, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -2.60% (0.3880 => 0.3779, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.59% (0.3896 => 0.3795, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.58% (0.6484 => 0.6317, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.57% (0.3884 => 0.3784, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.57% (0.3891 => 0.3791, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -2.54% (0.4176 => 0.4070, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -2.24% (17.1032 => 16.7196, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.24% (14.2083 => 13.8898, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -2.08% (1.3148 => 1.2874, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -1.94% (0.6347 => 0.6224, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.79% (0.7919 => 0.7777, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.68% (2.1713 => 2.1349, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.66% (0.6441 => 0.6334, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -1.59% (4.3330 => 4.2643, std.dev.: 0.0152) MultiSource/Applications/lambda-0_1_3/lambda: -1.57% (0.7982 => 0.7857, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.54% (16.1920 => 15.9434, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/football/football: -1.42% (0.9179 => 0.9049, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: -1.34% (0.7779 => 0.7675, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.33% (1.0544 => 1.0404, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: -1.29% (7.0961 => 7.0044, std.dev.: 0.0069) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.27% (6.7716 => 6.6853, std.dev.: 0.0067) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.18% (1.2210 => 1.2066, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.18% (1.2221 => 1.2077, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.45% (1.8100 => 0.6797, std.dev.: 0.0178) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3143, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.47% (1.3643 => 1.0304, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0863, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2237 => 0.9590, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.84% (0.6299 => 0.5049, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1673, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8191, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.03% (1.0557 => 1.0237, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.02% (1.3096 => 1.2700, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.71% (7.9763 => 7.7605, std.dev.: 0.0280) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6427, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.57% (7.3040 => 7.1892, std.dev.: 0.0074) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4739, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.51% (2.3169 => 2.2820, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6074, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6219 => 1.6040, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6694, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 23:17:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 01:17:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125071706.221302A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7924?compare_to=7921&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7924, Order: 173414, Start Time: 2013-01-25 05:14:10, End Time: 2013-01-25 07:17:24 To: 7921, Order: 173412, Start Time: 2013-01-25 02:56:22, End Time: 2013-01-25 04:56:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 20 (17 on baseline) Performance Improvements: 0 (32 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (1014 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 26.38% (0.0599 => 0.0757, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.04% (0.0954 => 0.1107, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 11.46% (1.0719 => 1.1947, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 11.24% (0.6377 => 0.7094, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 8.05% (0.8943 => 0.9663, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 8.04% (1.2390 => 1.3386, std.dev.: 0.0233) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.40% (0.6753 => 0.7253, std.dev.: 0.0134) MultiSource/Applications/lemon/lemon: 7.29% (1.3216 => 1.4179, std.dev.: 0.0212) MultiSource/Applications/minisat/minisat: 6.96% (0.7473 => 0.7993, std.dev.: 0.0029) MultiSource/Applications/ClamAV/clamscan: 5.25% (16.1061 => 16.9524, std.dev.: 0.0640) MultiSource/Applications/sqlite3/sqlite3: 5.22% (15.9904 => 16.8247, std.dev.: 0.2739) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.41% (0.2561 => 0.2674, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.47% (0.8972 => 0.9104, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 28.45% (6.1685 => 7.9233, std.dev.: 0.1275) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.73% (0.0784 => 0.0923, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.90% (15.1763 => 16.8301, std.dev.: 0.3054) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 5.83% (0.5850 => 0.6191, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.38% (4.8425 => 5.0544, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.66% (3.7107 => 3.8465, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/flops: 2.26% (8.6614 => 8.8575, std.dev.: 0.0216) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.37% (1.1300 => 1.1342, std.dev.: 0.2336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 32.93% (0.0167 => 0.0222, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.66% (0.0368 => 0.0433, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.38% (0.0299 => 0.0339, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0322 => 0.0320, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: 14.87% (0.0195 => 0.0224, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.87% (0.0229 => 0.0231, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 550.00% (0.0002 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.07% (0.1497 => 0.1528, std.dev.: 0.0188) MultiSource/Applications/lemon/lemon: 21.10% (1.1661 => 1.4121, std.dev.: 0.3891) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.80% (0.3998 => 0.3966, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 8.69% (0.1484 => 0.1613, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.93% (0.0989 => 0.1018, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.49% (0.0269 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.77% (0.0545 => 0.0571, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.74% (1.1457 => 1.1542, std.dev.: 0.0997) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0611 => 0.0608, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.87% (0.0310 => 0.0322, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.09% (0.7414 => 0.7407, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.58% (0.0076 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.50% (12.7132 => 12.7769, std.dev.: 0.4707) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 51.19% (0.0336 => 0.0508, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 19.03% (0.0636 => 0.0757, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.95% (0.0963 => 0.1107, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.57% (1.2680 => 1.3386, std.dev.: 0.0233) MultiSource/Applications/minisat/minisat: 2.79% (0.7776 => 0.7993, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.15% (0.8912 => 0.9104, std.dev.: 0.0042) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 319812.50% (0.0008 => 2.5593, std.dev.: 0.0150) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 104.61% (1.1825 => 2.4195, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.54% (0.2562 => 0.2832, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.98% (3.7074 => 4.0403, std.dev.: 0.0563) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.71% (2.2499 => 2.4009, std.dev.: 0.0485) MultiSource/Benchmarks/nbench/nbench: 5.86% (20.5117 => 21.7133, std.dev.: 0.3487) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.99% (0.5897 => 0.6191, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 4.14% (1.2298 => 1.2807, std.dev.: 0.0188) MultiSource/Applications/JM/lencod/lencod: 3.05% (6.8159 => 7.0238, std.dev.: 0.0498) SingleSource/Benchmarks/Misc/pi: 2.93% (2.1390 => 2.2017, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.50% (4.9799 => 5.0544, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.72% (0.0808 => 0.0479, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.30% (0.0727 => 0.0514, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.19% (0.0692 => 0.0490, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.38% (0.1684 => 0.1324, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.40% (1.0960 => 0.9272, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.15% (1.0986 => 0.9432, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.51% (0.1079 => 0.0944, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -10.05% (1.1433 => 1.0284, std.dev.: 0.0421) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.90% (0.2372 => 0.2161, std.dev.: 0.0063) MultiSource/Applications/spiff/spiff: -5.45% (1.0220 => 0.9663, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hello: -5.29% (0.1928 => 0.1826, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.14% (0.2100 => 0.1992, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.03% (1.0017 => 0.9513, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: -4.36% (0.5134 => 0.4910, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -4.21% (17.5634 => 16.8247, std.dev.: 0.2739) SingleSource/Benchmarks/Shootout-C++/ary: -4.00% (0.2551 => 0.2449, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.95% (0.3665 => 0.3557, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: -2.78% (17.4365 => 16.9524, std.dev.: 0.0640) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -26.10% (4.4739 => 3.3063, std.dev.: 0.3215) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.44% (1.4235 => 1.2749, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout/nestedloop: -10.18% (0.2200 => 0.1976, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/hash: -10.16% (4.5259 => 4.0662, std.dev.: 0.0392) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.83% (0.3217 => 0.2965, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.79% (1.4588 => 1.3452, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: -7.79% (0.6628 => 0.6112, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: -3.64% (63.1520 => 60.8552, std.dev.: 0.6209) MultiSource/Benchmarks/BitBench/five11/five11: -2.62% (5.7021 => 5.5529, std.dev.: 0.0480) MultiSource/Applications/SIBsim4/SIBsim4: -2.20% (3.5443 => 3.4664, std.dev.: 0.0257) MultiSource/Applications/spiff/spiff: -1.92% (2.8571 => 2.8023, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/mandel-2: -1.51% (0.8521 => 0.8392, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3168, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.85% (1.2047 => 1.1342, std.dev.: 0.2336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0117) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.13% (0.1530 => 0.1528, std.dev.: 0.0188) MultiSource/Applications/lemon/lemon: -26.81% (1.9293 => 1.4121, std.dev.: 0.3891) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.05% (0.4049 => 0.3966, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.82% (0.1510 => 0.1613, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.09% (0.0978 => 0.1018, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (0.0276 => 0.0265, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.22% (0.0590 => 0.0571, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.65% (1.1617 => 1.1542, std.dev.: 0.0997) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0140) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.15% (0.0268 => 0.0322, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.40% (0.7437 => 0.7407, std.dev.: 0.0040) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.48% (0.0092 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.01% (12.7781 => 12.7769, std.dev.: 0.4707) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 24 23:25:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 01:25:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125072514.733EF2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7925?compare_to=7920&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7925, Order: 173414, Start Time: 2013-01-25 05:14:39, End Time: 2013-01-25 07:25:30 To: 7920, Order: 173412, Start Time: 2013-01-25 02:33:11, End Time: 2013-01-25 04:44:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (219 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0665 => 0.0664, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8451 => 499.8482, std.dev.: 0.0108) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.57% (1.1277 => 499.8482, std.dev.: 0.0108) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.76% (0.5229 => 1.6459, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 20.86% (14.9895 => 18.1163, std.dev.: 0.0117) MultiSource/Applications/kimwitu++/kc: 44.46% (14.1553 => 20.4483, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/gs/gs: 18.19% (4.1105 => 4.8580, std.dev.: 0.0173) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.77% (1.1048 => 1.7320, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.28% (7.1582 => 37.3857, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.74% (3.4629 => 6.4321, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.96% (0.6222 => 1.0948, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10280.97% (0.0720 => 7.4743, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11146900.00% (0.0001 => 11.1470, std.dev.: 0.0262) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574400.00% (0.0001 => 0.5745, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486900.00% (0.0001 => 5.4870, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.56% (1.1194 => 10.2264, std.dev.: 0.0044) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.18% (22.1758 => 55.0350, std.dev.: 0.0145) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.66% (0.0929 => 0.1827, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.91% (0.1463 => 0.2515, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.39% (2.9384 => 4.6247, std.dev.: 0.0126) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.82% (7.0540 => 10.7799, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.97% (1.5859 => 2.4101, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.89% (8.1363 => 11.9514, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.37% (2.2024 => 3.1355, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 38.99% (21.9371 => 30.4903, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0002) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.24% (4.2646 => 5.6823, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.81% (0.4615 => 0.6129, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.49% (1.5415 => 2.0423, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.74% (0.2271 => 0.2969, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 29.78% (1.1642 => 1.5109, std.dev.: 0.0089) MultiSource/Benchmarks/McCat/05-eks/eks: 29.45% (0.4299 => 0.5565, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 28.14% (0.0636 => 0.0815, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.97% (0.5105 => 0.6533, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.40% (0.6675 => 0.8504, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.86% (0.0793 => 0.1006, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.77% (0.1143 => 0.1449, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.77% (0.1584 => 0.2008, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 26.77% (0.1655 => 0.2098, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.59% (0.1892 => 0.2395, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 26.17% (9.4845 => 11.9666, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/08-main/main: 26.04% (0.2554 => 0.3219, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.94% (3.8922 => 4.9019, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.43% (0.1695 => 0.2126, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 24.78% (0.4289 => 0.5352, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.39% (1.4186 => 1.7646, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.38% (0.0730 => 0.0908, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.38% (0.3121 => 0.3882, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 24.36% (1.0722 => 1.3334, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.24% (0.1906 => 0.2368, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 24.09% (0.4620 => 0.5733, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.66% (0.7115 => 0.8727, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.67% (0.1029 => 0.1252, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.59% (0.2700 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 21.53% (0.3098 => 0.3765, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 21.48% (0.6456 => 0.7843, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 21.01% (0.0871 => 0.1054, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.95% (1.3050 => 1.5784, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 20.75% (0.7835 => 0.9461, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.56% (5.7591 => 6.9431, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 20.41% (0.1695 => 0.2041, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.41% (0.1940 => 0.2336, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 20.33% (0.1151 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.88% (0.5860 => 0.7025, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.68% (4.9449 => 5.9182, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.57% (0.8172 => 0.9771, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.26% (0.3307 => 0.3944, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.20% (0.5020 => 0.5984, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 18.91% (3.3354 => 3.9660, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.85% (5.0018 => 5.9445, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.47% (0.0834 => 0.0988, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 18.23% (0.7433 => 0.8788, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.15% (0.5569 => 0.6580, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.06% (0.9765 => 1.1529, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.77% (1.1840 => 1.3944, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.75% (0.2107 => 0.2481, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.68% (0.1510 => 0.1777, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 17.56% (3.8723 => 4.5523, std.dev.: 0.0139) MultiSource/Applications/treecc/treecc: 17.52% (2.0273 => 2.3825, std.dev.: 0.0124) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.38% (1.1861 => 1.3922, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 17.35% (0.3423 => 0.4017, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.12% (0.5981 => 0.7005, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.99% (2.2969 => 2.6871, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary3: 16.91% (0.3283 => 0.3838, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.65% (0.3441 => 0.4014, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.57% (0.1044 => 0.1217, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 16.52% (0.3232 => 0.3766, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.37% (0.8101 => 0.9427, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.14% (0.6450 => 0.7491, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.77% (0.0704 => 0.0815, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.38% (0.3180 => 0.3669, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.13% (0.8921 => 1.0271, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 14.62% (0.3379 => 0.3873, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.49% (0.3865 => 0.4425, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.37% (0.8067 => 0.9226, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.4636 => 0.5286, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.04% (0.4103 => 0.4638, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.90% (0.4203 => 0.4745, std.dev.: 0.0113) MultiSource/Applications/hbd/hbd: 12.82% (1.5603 => 1.7603, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 12.71% (0.3422 => 0.3857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.57% (0.4048 => 0.4557, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 12.41% (0.3603 => 0.4050, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 12.21% (0.3684 => 0.4134, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.79% (0.3826 => 0.4277, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 11.66% (0.3927 => 0.4385, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 11.65% (17.1811 => 19.1832, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.65% (0.2430 => 0.2713, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.61% (0.4064 => 0.4536, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.52% (0.3282 => 0.3660, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 11.48% (0.3092 => 0.3447, std.dev.: 0.0103) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.77% (0.3427 => 0.3796, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.41% (0.1114 => 0.1230, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.41% (14.3668 => 15.8618, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/except: 10.34% (0.2871 => 0.3168, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2831 => 0.3123, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.27% (0.3543 => 0.3907, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 10.26% (0.3694 => 0.4073, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.16% (0.3473 => 0.3826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.09% (0.3497 => 0.3850, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.85% (2.0665 => 2.2700, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 9.59% (0.2877 => 0.3153, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.55% (0.2891 => 0.3167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 9.26% (0.2905 => 0.3174, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.21% (1.2842 => 1.4025, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.12% (0.3650 => 0.3983, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/random: 8.82% (0.2802 => 0.3049, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 8.81% (0.3052 => 0.3321, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.81% (0.2872 => 0.3125, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.79% (0.3935 => 0.4281, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.77% (0.2725 => 0.2964, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hello: 8.66% (0.2714 => 0.2949, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 8.36% (63.2438 => 68.5295, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.35% (0.3136 => 0.3398, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.07% (0.7326 => 0.7917, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/property-reference-object: 8.04% (0.6030 => 0.6515, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/Hello: 7.76% (0.5925 => 0.6385, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.14% (2.2022 => 2.3594, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.52% (0.1625 => 0.1731, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.4879 => 0.5173, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.80% (0.3817 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 2.62% (10.3673 => 10.6393, std.dev.: 0.0133) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (7.9617 => 8.1596, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4757, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.08% (1.1396 => 1.2431, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.93% (0.2944 => 0.3148, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.64% (11.6436 => 12.4173, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4510, std.dev.: 0.0170) SingleSource/Regression/C/uint64_to_float: 5.17% (0.5413 => 0.5693) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3142, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.48% (0.9957 => 1.0304, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.35% (2.0360 => 2.1042, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9160, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.33% (3.6395 => 3.7243, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.16% (1.0313 => 1.0536, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.99% (0.8333 => 0.8499, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2198, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.86% (9.1159 => 9.2850, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3073, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.95% (5.2763 => 1.1633, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.25% (5.3855 => 4.4563, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.63% (5.3526 => 4.4623, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: -13.72% (10.4361 => 9.0042, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6196, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -7.95% (54.1659 => 49.8594, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.37% (1.9577 => 0.6584, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.29% (0.3987 => 0.2540) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3059, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.40% (1.5373 => 1.0239, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4304, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8516, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0074, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.95% (2.6778 => 2.0901, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -18.90% (0.6223 => 0.5047, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.80% (1.6925 => 1.4251, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7346, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4949, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -8.46% (19.9488 => 18.2617, std.dev.: 0.0155) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.49% (1.2373 => 1.1570, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.01% (0.2497 => 0.2347, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.51% (8.1563 => 7.7070, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -4.69% (10.2830 => 9.8004, std.dev.: 0.0129) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-5: -4.53% (1.5835 => 1.5117, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768) SingleSource/Benchmarks/Shootout-C++/ary3: -1.77% (3.7221 => 3.6563, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3279, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.52% (2.3135 => 2.2783, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.41% (3.6994 => 3.6474, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: -1.14% (6.2999 => 6.2282, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0082) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0019) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 00:27:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 02:27:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125082725.C28E62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7926?compare_to=7923&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7926, Order: 173420, Start Time: 2013-01-25 06:50:08, End Time: 2013-01-25 08:27:41 To: 7923, Order: 173414, Start Time: 2013-01-25 04:52:03, End Time: 2013-01-25 06:26:24 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (106 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (891 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.12% (20.1929 => 20.4181, std.dev.: 0.0067) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 7.32% (0.5693 => 0.6110, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2247 => 18.5000, std.dev.: 0.0286) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0091) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.27% (0.1500 => 0.2179, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0026) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.61% (0.6395 => 0.8800, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.05% (0.0699 => 0.0930, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.35% (0.5805 => 0.7683, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.30% (0.5688 => 0.7525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.12% (0.6260 => 0.8271, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.00% (0.5456 => 0.7202, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.83% (0.5567 => 0.7339, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.80% (0.5849 => 0.7709, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.56% (0.6395 => 0.8413, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.52% (0.5575 => 0.7332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.41% (0.5581 => 0.7334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.53% (0.5941 => 0.7755, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.12% (0.5859 => 0.7624, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.65% (0.6033 => 0.7822, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.22% (0.6440 => 0.8322, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.58% (0.6189 => 0.7958, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.22% (1.6474 => 2.1123, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.13% (0.6676 => 0.8554, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.95% (0.6304 => 0.8066, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.26% (0.6230 => 0.7928, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.66% (0.5802 => 0.7349, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.37% (0.6660 => 0.8416, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.11% (0.5925 => 0.7472, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.08% (0.5705 => 0.7193, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.67% (0.5570 => 0.7000, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.50% (0.5478 => 0.6875, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.47% (0.5857 => 0.7349, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.35% (0.5569 => 0.6981, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.86% (0.5591 => 0.6981, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.17% (0.5863 => 0.7280, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.95% (0.6446 => 0.7990, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.78% (0.7524 => 0.9313, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.68% (0.6052 => 0.7485, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.19% (0.6681 => 0.8230, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.84% (0.6194 => 0.7609, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.57% (0.6297 => 0.7718, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.22% (2.2587 => 2.7381, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.92% (0.6667 => 0.8062, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.50% (0.7339 => 0.8770, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 14.31% (1.1450 => 1.3089, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.63% (0.4916 => 0.5537, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.21% (4.5069 => 5.0572, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 11.83% (0.4515 => 0.5049, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.37% (1.6364 => 1.8225, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.95% (3.5339 => 3.9210, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.95% (0.1982 => 0.2199, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 9.41% (9.2283 => 10.0965, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 8.62% (0.4524 => 0.4914, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.25% (1.2515 => 1.3547, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.66% (0.5329 => 0.5737, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (0.4861 => 0.5228, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.45% (0.1731 => 0.1860, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.19% (1.4642 => 1.5695, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.18% (0.7021 => 0.7525, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.89% (1.2784 => 1.3665, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 6.45% (0.3255 => 0.3465, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.3319 => 0.3490, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/bigfib: 4.28% (0.6750 => 0.7039, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/ary3: 3.86% (0.3446 => 0.3579, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.68% (5.4682 => 5.6695, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.45% (0.3394 => 0.3511, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.11% (5.0226 => 5.1788, std.dev.: 0.0126) MultiSource/Applications/SIBsim4/SIBsim4: 2.81% (1.3864 => 1.4253, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 2.70% (0.8418 => 0.8645, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.9557 => 0.9753, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.68% (1.3722 => 1.3953, std.dev.: 0.0085) MultiSource/Applications/SPASS/SPASS: 1.65% (15.5079 => 15.7638, std.dev.: 0.0347) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.50% (22.4056 => 22.7406, std.dev.: 0.0201) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7990, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.95% (0.9531 => 1.0289, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6767 => 12.1657, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4711, std.dev.: 0.6714) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2455, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (18.2231 => 18.5000, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3489 => 10.4583, std.dev.: 0.0268) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.40% (0.7198 => 0.6809, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -4.54% (0.3194 => 0.3049, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.48% (0.3821 => 0.3650, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: -4.47% (2.4924 => 2.3811, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3812 => 0.3665, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.85% (0.9852 => 0.9473, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.74% (0.3848 => 0.3704, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.74% (0.3880 => 0.3735, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.67% (0.3896 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.4033 => 0.3885, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.3142 => 0.3034, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -3.38% (0.4176 => 0.4035, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.19% (0.3884 => 0.3760, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.93% (0.9542 => 0.9262, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/property: -2.86% (0.4199 => 0.4079, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.84% (0.6441 => 0.6258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.66% (0.4280 => 0.4166, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.42% (0.7779 => 0.7591, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.28% (0.6484 => 0.6336, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.23% (14.2083 => 13.8909, std.dev.: 0.0072) MultiSource/Applications/sqlite3/sqlite3: -2.14% (17.1032 => 16.7376, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.08% (2.1713 => 2.1262, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -1.75% (16.1920 => 15.9089, std.dev.: 0.0196) SingleSource/UnitTests/Vector/constpool: -1.72% (20.7746 => 20.4181, std.dev.: 0.0067) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.53% (6.7716 => 6.6679, std.dev.: 0.0131) MultiSource/Applications/JM/ldecod/ldecod: -1.50% (7.0961 => 6.9900, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/gs/gs: -1.44% (4.3330 => 4.2705, std.dev.: 0.0167) MultiSource/Applications/lambda-0_1_3/lambda: -1.38% (0.7982 => 0.7872, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: -1.33% (0.9179 => 0.9057, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.23% (1.2210 => 1.2060, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.16% (1.0544 => 1.0422, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.23% (1.8100 => 0.6656, std.dev.: 0.0313) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3149, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0777, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1964, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0058) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1272, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7251, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3574, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0200) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.75% (2.2633 => 2.1785, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.29% (5.5807 => 5.3973, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.05% (1.0557 => 1.0235, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (7.9763 => 7.7519, std.dev.: 0.0251) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2794, std.dev.: 0.0097) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1193, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.20% (3.7241 => 3.6420, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: -1.63% (7.3040 => 7.1853, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7092 => 3.6559, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 01:39:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 03:39:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125093941.7DDAD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7927?compare_to=7924&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7927, Order: 173428, Start Time: 2013-01-25 07:36:58, End Time: 2013-01-25 09:39:58 To: 7924, Order: 173414, Start Time: 2013-01-25 05:14:10, End Time: 2013-01-25 07:17:24 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (6 on baseline) Performance Improvements: 16 (45 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (1012 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 25.53% (1.5272 => 1.9171, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 1.96% (28.8865 => 29.4517, std.dev.: 0.1895) SingleSource/Benchmarks/Dhrystone/fldry: 1.91% (0.6652 => 0.6779, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 1.03% (1.6187 => 1.6353, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Ptrdist/anagram/anagram: -16.58% (0.1224 => 0.1021, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: -8.52% (0.9663 => 0.8840, std.dev.: 0.0115) MultiSource/Applications/minisat/minisat: -6.24% (0.7993 => 0.7494, std.dev.: 0.0189) MultiSource/Applications/lemon/lemon: -5.05% (1.4179 => 1.3463, std.dev.: 0.0209) MultiSource/Applications/Burg/burg: -3.79% (1.4623 => 1.4069, std.dev.: 0.0187) MultiSource/Applications/siod/siod: -3.31% (2.5122 => 2.4290, std.dev.: 0.0232) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.60% (1.2891 => 1.2685, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -21.11% (16.8301 => 13.2772, std.dev.: 0.5535) MultiSource/Applications/sgefa/sgefa: -17.63% (0.4300 => 0.3542, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.07% (2.6365 => 2.4238, std.dev.: 0.0301) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.84% (4.0403 => 3.7639, std.dev.: 0.0783) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.14% (0.6191 => 0.5873, std.dev.: 0.0068) MultiSource/Applications/SIBsim4/SIBsim4: -5.09% (3.4664 => 3.2900, std.dev.: 0.0350) SingleSource/Benchmarks/Misc/himenobmtxpa: -3.39% (4.2910 => 4.1457, std.dev.: 0.0492) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.19% (1.2807 => 1.2399, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash: -1.98% (0.6272 => 0.6148, std.dev.: 0.0017) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.05% (1.1342 => 1.1461, std.dev.: 0.1184) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.90% (0.0222 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.18% (0.0339 => 0.0335, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.70% (0.0431 => 0.0428, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0205 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -3.12% (0.0224 => 0.0217, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.43% (0.0231 => 0.0232, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1528 => 0.1510, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: -12.18% (1.4121 => 1.2401, std.dev.: 0.2157) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.46% (0.3966 => 0.4024, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.54% (0.1613 => 0.1443, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.83% (0.1018 => 0.0979, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.15% (0.0265 => 0.0276, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.53% (0.0571 => 0.0574, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.91% (1.1542 => 1.1762, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0608 => 0.0608, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.01% (0.0322 => 0.0293, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.30% (0.7407 => 0.7385, std.dev.: 0.0353) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -3.85% (0.0052 => 0.0050, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.10% (12.7769 => 12.7641, std.dev.: 0.0133) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322350.00% (0.0008 => 2.5796, std.dev.: 0.0082) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 101.07% (1.1825 => 2.3776, std.dev.: 0.0400) SingleSource/Regression/C/uint64_to_float: 24.51% (1.5397 => 1.9171, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.48% (0.2562 => 0.2856, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/pi: 3.28% (2.1390 => 2.2091, std.dev.: 0.0069) MultiSource/Applications/JM/lencod/lencod: 3.13% (6.8159 => 7.0295, std.dev.: 0.0531) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.46% (0.0727 => 0.0491, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -26.69% (0.1888 => 0.1384, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.20% (0.1684 => 0.1327, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.41% (1.0960 => 0.9381, std.dev.: 0.0211) MultiSource/Applications/spiff/spiff: -13.50% (1.0220 => 0.8840, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.17% (1.0986 => 0.9539, std.dev.: 0.0087) MultiSource/Applications/aha/aha: -12.34% (0.1378 => 0.1208, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: -11.95% (1.5979 => 1.4069, std.dev.: 0.0187) MultiSource/Applications/treecc/treecc: -10.98% (2.4719 => 2.2005, std.dev.: 0.0844) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.35% (1.3924 => 1.2761, std.dev.: 0.0270) MultiSource/Applications/siod/siod: -8.12% (2.6437 => 2.4290, std.dev.: 0.0232) MultiSource/Applications/sgefa/sgefa: -7.75% (0.3598 => 0.3319, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: -7.45% (17.4365 => 16.1379, std.dev.: 0.3863) MultiSource/Applications/d/make_dparser: -6.59% (3.7840 => 3.5346, std.dev.: 0.0442) SingleSource/Benchmarks/Shootout-C++/hash2: -5.22% (0.5134 => 0.4866, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/ary: -4.43% (0.2551 => 0.2438, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.38% (0.9550 => 0.9132, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.36% (0.3462 => 0.3311, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.05% (1.3220 => 1.2685, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.89% (0.3981 => 0.3826, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.61% (5.0381 => 4.8564, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.50% (0.9422 => 0.9092, std.dev.: 0.0056) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.23% (7.2721 => 7.0370, std.dev.: 0.0852) SingleSource/Benchmarks/Shootout-C++/hash: -2.92% (0.4689 => 0.4552, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.71% (0.9488 => 0.9326, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.40% (16.6791 => 13.2772, std.dev.: 0.5535) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/hash: -10.19% (4.5259 => 4.0648, std.dev.: 0.0775) SingleSource/Benchmarks/Shootout/nestedloop: -9.23% (0.2200 => 0.1997, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists1: -8.52% (0.6628 => 0.6063, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.88% (1.4588 => 1.3439, std.dev.: 0.0109) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: -7.17% (3.5443 => 3.2900, std.dev.: 0.0350) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.70% (2.5170 => 2.4238, std.dev.: 0.0301) MultiSource/Benchmarks/mafft/pairlocalalign: -3.43% (63.1520 => 60.9869, std.dev.: 0.5247) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6333, std.dev.: 0.1646) SingleSource/Benchmarks/McGill/chomp: -3.18% (1.0425 => 1.0094, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.39% (0.5826 => 0.5687, std.dev.: 0.0048) MultiSource/Applications/spiff/spiff: -2.05% (2.8571 => 2.7986, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash: -1.69% (0.6254 => 0.6148, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.17% (2.4498 => 2.4212, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.16% (3.1921 => 3.1552, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -1.09% (2.9083 => 2.8765, std.dev.: 0.0043) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.86% (1.2047 => 1.1461, std.dev.: 0.1184) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.43% (0.0451 => 0.0431, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -4.41% (0.0227 => 0.0217, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1530 => 0.1510, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: -35.72% (1.9293 => 1.2401, std.dev.: 0.2157) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.62% (0.4049 => 0.4024, std.dev.: 0.0276) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.44% (0.1510 => 0.1443, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.10% (0.0978 => 0.0979, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.71% (0.0590 => 0.0574, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.25% (1.1617 => 1.1762, std.dev.: 0.0197) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.33% (0.0268 => 0.0293, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.70% (0.7437 => 0.7385, std.dev.: 0.0353) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.11% (12.7781 => 12.7641, std.dev.: 0.0133) Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 02:00:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 04:00:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125100016.E5EFC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7928?compare_to=7922&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7928, Order: 173416, Start Time: 2013-01-25 06:11:45, End Time: 2013-01-25 10:00:30 To: 7922, Order: 173403, Start Time: 2013-01-25 01:42:53, End Time: 2013-01-25 05:17:56 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (179 on baseline) Performance Improvements: 0 (19 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (760 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 1.05% (27.4090 => 27.6960, std.dev.: 0.0793) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.84% (0.0695 => 0.0819, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.76% (0.0642 => 0.0756, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 14.63% (0.3526 => 0.4042, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: 4.82% (0.2159 => 0.2263, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 48.96% (0.0625 => 0.0931, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.55% (0.2969 => 0.4173, std.dev.: 0.0185) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.12% (0.1063 => 0.1447, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/loader/loader: 32.73% (0.1549 => 0.2056, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.12% (0.0331 => 0.0434, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.98% (0.0547 => 0.0711, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.74% (0.0390 => 0.0506, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 29.11% (0.0584 => 0.0754, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.81% (0.5900 => 0.7600, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 28.31% (0.4994 => 0.6408, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.14% (0.4253 => 0.5450, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.12% (0.1106 => 0.1417, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.95% (0.4139 => 0.5296, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 27.88% (0.3271 => 0.4183, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 27.23% (0.0415 => 0.0528, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.88% (0.1462 => 0.1855, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 26.62% (1.5932 => 2.0173, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.22% (0.5000 => 0.6311, std.dev.: 0.0363) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.11% (0.1107 => 0.1396, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.06% (0.2736 => 0.3449, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.86% (0.1620 => 0.2039, std.dev.: 0.0141) MultiSource/Benchmarks/Olden/tsp/tsp: 25.71% (0.0599 => 0.0753, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.60% (0.3903 => 0.4902, std.dev.: 0.0316) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.47% (0.1021 => 0.1281, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.08% (0.0897 => 0.1122, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.49% (0.0584 => 0.0727, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 24.21% (0.1619 => 0.2011, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.17% (0.0633 => 0.0786, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/em3d/em3d: 24.16% (0.0948 => 0.1177, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.03% (0.1003 => 0.1244, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.83% (0.0642 => 0.0795, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: 23.51% (0.0604 => 0.0746, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 23.26% (0.0821 => 0.1012, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.24% (0.0822 => 0.1013, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 23.17% (0.2866 => 0.3530, std.dev.: 0.0189) MultiSource/Applications/spiff/spiff: 23.13% (0.4029 => 0.4961, std.dev.: 0.0208) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.74% (0.0541 => 0.0664, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.64% (1.3152 => 1.6129, std.dev.: 0.0501) MultiSource/Benchmarks/McCat/09-vor/vor: 22.33% (0.1505 => 0.1841, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 22.18% (0.0947 => 0.1157, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 22.04% (0.0481 => 0.0587, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 22.01% (0.3890 => 0.4746, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.75% (1.9694 => 2.3977, std.dev.: 0.0602) MultiSource/Benchmarks/McCat/08-main/main: 21.51% (0.1218 => 0.1480, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.42% (0.1088 => 0.1321, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.35% (0.2014 => 0.2444, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 21.16% (0.0808 => 0.0979, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 21.06% (0.0698 => 0.0845, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/gs/gs: 21.01% (1.8794 => 2.2742, std.dev.: 0.1479) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.78% (0.4658 => 0.5626, std.dev.: 0.0268) SingleSource/UnitTests/ObjC++/Hello: 20.68% (0.5826 => 0.7031, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 20.31% (0.5889 => 0.7085, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.18% (0.1090 => 0.1310, std.dev.: 0.0039) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.08% (0.0513 => 0.0616, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.04% (2.7292 => 3.2760, std.dev.: 0.0737) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.96% (1.6211 => 1.9446, std.dev.: 0.0931) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.83% (0.0605 => 0.0725, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 19.74% (0.5546 => 0.6641, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.74% (3.5627 => 4.2658, std.dev.: 0.1628) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.72% (0.0573 => 0.0686, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.69% (0.2875 => 0.3441, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.59% (0.2792 => 0.3339, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.54% (0.4361 => 0.5213, std.dev.: 0.0307) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.36% (0.1968 => 0.2349, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/except: 19.35% (0.2811 => 0.3355, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.24% (0.5026 => 0.5993, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/matrix: 19.17% (0.2780 => 0.3313, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 19.12% (0.7171 => 0.8542, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.10% (0.2738 => 0.3261, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 19.09% (0.2714 => 0.3232, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.05% (0.2729 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 19.05% (0.2725 => 0.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 19.02% (0.2750 => 0.3273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 19.02% (0.2803 => 0.3336, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 19.00% (0.1284 => 0.1528, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.88% (0.1160 => 0.1379, std.dev.: 0.0056) MultiSource/Applications/treecc/treecc: 18.79% (0.7875 => 0.9355, std.dev.: 0.0225) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 18.68% (0.9697 => 1.1508, std.dev.: 0.0385) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.67% (2.0673 => 2.4532, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/objinst: 18.63% (0.2823 => 0.3349, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 18.63% (0.2813 => 0.3337, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 18.56% (0.9909 => 1.1748, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout-C++/wc: 18.54% (0.3096 => 0.3670, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 18.51% (0.3004 => 0.3560, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.48% (0.2911 => 0.3449, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 18.09% (0.3267 => 0.3858, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 18.06% (1.0781 => 1.2728, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/ary: 18.02% (0.3258 => 0.3845, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.01% (0.3060 => 0.3611, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.97% (0.3195 => 0.3769, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 17.75% (23.5202 => 27.6960, std.dev.: 0.0793) SingleSource/Benchmarks/Shootout-C++/sieve: 17.74% (0.3726 => 0.4387, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.61% (1.9966 => 2.3482, std.dev.: 0.0879) SingleSource/Benchmarks/Shootout-C++/ary2: 17.61% (0.3317 => 0.3901, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 17.54% (0.2075 => 0.2439, std.dev.: 0.0120) MultiSource/Applications/ClamAV/clamscan: 17.52% (4.2109 => 4.9487, std.dev.: 0.1793) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.41% (0.3124 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.25% (0.3282 => 0.3848, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.22% (0.3362 => 0.3941, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 17.20% (0.3477 => 0.4075, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.19% (4.4195 => 5.1790, std.dev.: 0.1228) MultiSource/Applications/JM/ldecod/ldecod: 17.18% (2.1653 => 2.5373, std.dev.: 0.0512) MultiSource/Applications/lua/lua: 17.15% (1.4269 => 1.6716, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout-C++/lists: 17.08% (0.3348 => 0.3920, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.07% (0.2566 => 0.3004, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.98% (0.3981 => 0.4657, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 16.98% (0.4146 => 0.4850, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.97% (0.3625 => 0.4240, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.86% (0.3488 => 0.4076, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 16.75% (0.3678 => 0.4294, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.72% (0.3690 => 0.4307, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 16.35% (0.2691 => 0.3131, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 16.33% (0.4251 => 0.4945, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 16.28% (0.3465 => 0.4029, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 16.24% (0.3442 => 0.4001, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 16.23% (0.3469 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 16.22% (0.3446 => 0.4005, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 16.21% (0.3460 => 0.4021, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 16.16% (0.3496 => 0.4061, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.3845 => 0.4458, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 15.89% (0.3650 => 0.4230, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.67% (0.3643 => 0.4214, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.60% (0.0673 => 0.0778, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 15.55% (0.3724 => 0.4303, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 15.50% (0.5012 => 0.5789, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 15.00% (5.5417 => 6.3728, std.dev.: 0.1187) MultiSource/Applications/JM/lencod/lencod: 14.82% (4.6177 => 5.3020, std.dev.: 0.1155) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.75% (0.6435 => 0.7384, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.49% (0.1028 => 0.1177, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 14.16% (2.1013 => 2.3989, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.14% (0.2737 => 0.3124, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.93% (0.2068 => 0.2356, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.68% (0.2040 => 0.2319, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.16% (0.1383 => 0.1565, std.dev.: 0.0036) MultiSource/Applications/siod/siod: 12.86% (0.6634 => 0.7487, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.61% (0.3084 => 0.3473, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.56% (0.0804 => 0.0905, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.48% (0.5361 => 0.6030, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 12.08% (0.3336 => 0.3739, std.dev.: 0.0134) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.08% (0.2103 => 0.2357, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 11.88% (0.4847 => 0.5423, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.38% (0.7426 => 0.8271, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.22% (11.6398 => 12.9463, std.dev.: 0.0046) MultiSource/Applications/lemon/lemon: 10.58% (0.2391 => 0.2644, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 10.38% (2.0346 => 2.2458, std.dev.: 0.0130) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.18% (4.6926 => 5.1705, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.29% (0.5584 => 0.6103, std.dev.: 0.0029) MultiSource/Applications/kimwitu++/kc: 8.61% (11.9555 => 12.9844, std.dev.: 0.1863) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.78% (0.3792 => 0.4049, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5259, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 86.96% (0.2162 => 0.4042, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 17.84% (0.0695 => 0.0819, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.39% (0.0644 => 0.0756, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.71% (0.5917 => 0.6906, std.dev.: 0.0279) MultiSource/Applications/ClamAV/clamscan: 10.49% (0.2802 => 0.3096, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.72% (0.3693 => 0.4052, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/ary: 6.64% (0.2122 => 0.2263, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6094, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2433, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6702, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6810, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/flops-2: 4.68% (1.8057 => 1.8902, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1939, std.dev.: 0.0069) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3143, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2862, std.dev.: 0.0219) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0812, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2086, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6860, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4780, std.dev.: 0.0386) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5574, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.87% (17.2379 => 14.3301, std.dev.: 0.0768) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9741, std.dev.: 0.0269) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8010, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: -7.16% (2.1113 => 1.9601, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2257, std.dev.: 0.0148) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8088, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.13% (0.6293 => 0.6096, std.dev.: 0.0027) MultiSource/Applications/siod/siod: -2.97% (6.9842 => 6.7765, std.dev.: 0.0154) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1816, std.dev.: 0.0310) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5794, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0216) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (105.3826 => 104.0276, std.dev.: 0.1023) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0426, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 02:09:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 04:09:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125100918.20D122A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7929?compare_to=7925&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7929, Order: 173428, Start Time: 2013-01-25 07:56:06, End Time: 2013-01-25 10:09:33 To: 7925, Order: 173414, Start Time: 2013-01-25 05:14:39, End Time: 2013-01-25 07:25:30 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 6 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1094 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/nbench/nbench: 1.14% (1.3944 => 1.4103, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/gs/gs: 1.06% (4.8580 => 4.9093, std.dev.: 0.0161) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 7.41% (0.5693 => 0.6115, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.08% (53.2811 => 56.5213, std.dev.: 0.8314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.77% (28.4088 => 29.7625, std.dev.: 0.0480) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2617 => 18.5475, std.dev.: 0.0387) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1330 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.67% (0.0664 => 0.0695, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8482 => 499.7495, std.dev.: 0.0565) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44215.82% (1.1277 => 499.7495, std.dev.: 0.0565) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.22% (0.5229 => 1.6535, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 21.34% (14.9895 => 18.1885, std.dev.: 0.0244) MultiSource/Applications/kimwitu++/kc: 45.25% (14.1553 => 20.5611, std.dev.: 0.0207) MultiSource/Benchmarks/MallocBench/gs/gs: 19.43% (4.1105 => 4.9093, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.09% (1.1048 => 1.7355, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.09% (7.1582 => 37.5151, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.90% (3.4629 => 6.4721, std.dev.: 0.1759) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.84% (0.6222 => 1.1003, std.dev.: 0.0215) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.14% (0.0720 => 7.4449, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3835100.00% (0.0001 => 3.8352, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11163300.00% (0.0001 => 11.1634, std.dev.: 0.0219) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850100.00% (0.0001 => 9.8502, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487000.00% (0.0001 => 5.4871, std.dev.: 0.2515) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.81% (1.1194 => 10.2180, std.dev.: 0.0107) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 148.18% (22.1758 => 55.0368, std.dev.: 0.0728) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.52% (0.0929 => 0.1835, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.91% (0.1463 => 0.2515, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 63.45% (0.0394 => 0.0644, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.32% (2.9384 => 4.6226, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.41% (1.5859 => 2.4171, std.dev.: 0.0575) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.18% (7.0540 => 10.7347, std.dev.: 0.0234) MultiSource/Benchmarks/FreeBench/distray/distray: 48.67% (0.1056 => 0.1570, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.94% (8.1363 => 11.9558, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.86% (2.2024 => 3.1464, std.dev.: 0.0832) MultiSource/Applications/sgefa/sgefa: 40.33% (0.3109 => 0.4363, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0015) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.87% (21.9371 => 30.4639, std.dev.: 0.0343) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.14% (0.1062 => 0.1467, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.76% (4.2646 => 5.7043, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.20% (0.4615 => 0.6147, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 33.17% (0.0814 => 0.1084, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.64% (1.5415 => 2.0447, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.87% (0.2271 => 0.2972, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: 30.60% (1.1642 => 1.5204, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.01% (0.0793 => 0.1031, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.01% (0.1143 => 0.1486, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.23% (0.0479 => 0.0619, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.66% (0.5105 => 0.6568, std.dev.: 0.0217) MultiSource/Benchmarks/NPB-serial/is/is: 28.65% (0.0719 => 0.0925, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.96% (0.6675 => 0.8541, std.dev.: 0.0187) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.27% (0.1584 => 0.2016, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 27.25% (0.2554 => 0.3250, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.11% (0.1892 => 0.2405, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 26.70% (0.0457 => 0.0579, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.49% (0.1125 => 0.1423, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 26.43% (9.4845 => 11.9912, std.dev.: 0.0254) SingleSource/Benchmarks/McGill/chomp: 26.34% (0.1655 => 0.2091, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.32% (3.8922 => 4.9165, std.dev.: 0.1332) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.03% (0.0730 => 0.0920, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.98% (0.0408 => 0.0514, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.76% (0.3121 => 0.3925, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 25.53% (0.4289 => 0.5384, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 24.96% (1.0722 => 1.3398, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.90% (0.1566 => 0.1956, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.74% (0.0675 => 0.0842, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.63% (1.4186 => 1.7680, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.61% (0.1337 => 0.1666, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.48% (0.1695 => 0.2110, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/hash2: 24.48% (0.4620 => 0.5751, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.40% (0.1906 => 0.2371, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.87% (0.0842 => 0.1043, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 23.47% (0.7115 => 0.8785, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.36% (0.0672 => 0.0829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.90% (0.1236 => 0.1519, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/15-trie/trie: 22.58% (0.0527 => 0.0646, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.57% (0.1555 => 0.1906, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/lists: 22.36% (0.0626 => 0.0766) SingleSource/UnitTests/ObjC/messages-2: 22.36% (0.0662 => 0.0810) MultiSource/Applications/aha/aha: 22.33% (0.1151 => 0.1408, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 22.30% (0.1695 => 0.2073, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.29% (0.1117 => 0.1366, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.26% (0.2700 => 0.3301, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/mst/mst: 22.18% (0.1163 => 0.1421, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0042) MultiSource/Applications/spiff/spiff: 21.95% (0.7835 => 0.9555, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 21.69% (0.3098 => 0.3770, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.40% (0.5860 => 0.7114, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/bigfib: 21.38% (0.6456 => 0.7836, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.26% (1.3050 => 1.5824, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.12% (0.1032 => 0.1250, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.99% (0.0953 => 0.1153, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 20.82% (5.7591 => 6.9582, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 20.52% (0.0614 => 0.0740, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.41% (0.1940 => 0.2336, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.32% (0.0871 => 0.1048) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.08% (0.8172 => 0.9813, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.03% (4.9449 => 5.9354, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.76% (0.2758 => 0.3303, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.75% (0.0886 => 0.1061, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 19.57% (3.3354 => 3.9880, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.54% (0.5020 => 0.6001, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.50% (0.3307 => 0.3952, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.29% (0.5569 => 0.6643, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.24% (5.0018 => 5.9642, std.dev.: 0.0156) MultiSource/Benchmarks/nbench/nbench: 19.11% (1.1840 => 1.4103, std.dev.: 0.0050) MultiSource/Applications/lambda-0_1_3/lambda: 19.05% (0.7433 => 0.8849, std.dev.: 0.0142) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.70% (0.0770 => 0.0914, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 18.64% (0.3423 => 0.4061, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.59% (0.0834 => 0.0989, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.56% (0.9765 => 1.1577, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/health/health: 18.53% (0.1268 => 0.1503, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: 18.34% (0.0567 => 0.0671, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 18.24% (3.8723 => 4.5788, std.dev.: 0.0120) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.14% (1.1861 => 1.4013, std.dev.: 0.0015) MultiSource/Applications/treecc/treecc: 18.00% (2.0273 => 2.3922, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.94% (0.2107 => 0.2485, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.68% (0.2065 => 0.2430, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.62% (0.1044 => 0.1228, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.47% (0.0933 => 0.1096, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 17.45% (2.2969 => 2.6977, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.25% (0.5981 => 0.7013, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.15% (0.3441 => 0.4031, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.07% (0.8101 => 0.9484, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.94% (0.3283 => 0.3839, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/09-vor/vor: 16.92% (0.3180 => 0.3718, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.68% (0.6450 => 0.7526, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 16.65% (0.3232 => 0.3770) SingleSource/Benchmarks/Misc/ReedSolomon: 16.54% (0.2049 => 0.2388, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: 16.27% (0.0633 => 0.0736, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.91% (0.0704 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.66% (0.8067 => 0.9330, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/rem: 15.65% (0.1144 => 0.1323) MultiSource/Benchmarks/Prolangs-C/football/football: 15.60% (0.8921 => 1.0313, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.42% (0.0759 => 0.0876, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.39% (0.3865 => 0.4460, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.75% (0.2603 => 0.2987, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.68% (0.3379 => 0.3875, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.4636 => 0.5293, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.97% (0.3387 => 0.3860, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.53% (0.4103 => 0.4658, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.13% (0.2430 => 0.2749, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.05% (1.5603 => 1.7639, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.99% (0.4203 => 0.4749, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists: 12.65% (0.3422 => 0.3855, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/sieve: 12.55% (0.3603 => 0.4055, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/lists1: 12.30% (0.3684 => 0.4137, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/bh/bh: 12.13% (0.3092 => 0.3467, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.97% (0.3826 => 0.4284, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 11.88% (17.1811 => 19.2227, std.dev.: 0.0193) SingleSource/UnitTests/ObjC/parameter-passing: 11.64% (0.3927 => 0.4384, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.40% (0.1114 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.35% (0.3427 => 0.3816, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 11.33% (0.3282 => 0.3654, std.dev.: 0.0090) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 11.25% (0.3886 => 0.4323, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.74% (0.2831 => 0.3135, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67% (14.3668 => 15.8995, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.94% (0.3543 => 0.3895, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 9.94% (0.3694 => 0.4061, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/exceptions-4: 9.88% (0.3543 => 0.3893, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.88% (2.0665 => 2.2706, std.dev.: 0.0066) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2877 => 0.3152, std.dev.: 0.0092) MultiSource/Applications/hexxagon/hexxagon: 9.50% (1.2842 => 1.4062, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.23% (0.3162 => 0.3454, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.21% (0.3650 => 0.3986, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.00% (0.2756 => 0.3004, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2802 => 0.3053, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.87% (0.3935 => 0.4284, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.74% (0.2793 => 0.3037, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/fibo: 8.59% (0.2725 => 0.2959, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 8.52% (63.2438 => 68.6337, std.dev.: 0.0838) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/property-reference: 8.19% (0.7326 => 0.7926, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference-object: 7.98% (0.6030 => 0.6511, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.71% (0.5925 => 0.6382, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.51% (0.1625 => 0.1747, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.10% (2.2022 => 2.3586, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.21% (0.4879 => 0.5182, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 3.29% (10.3673 => 10.7082, std.dev.: 0.0072) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.66% (7.9617 => 8.1738, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.65% (0.3817 => 0.3918, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0277) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4740, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.11% (1.1145 => 1.2940, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0190) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3863, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4634, std.dev.: 0.0273) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.43% (0.9957 => 1.0299, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9103, std.dev.: 0.0095) MultiSource/Benchmarks/Olden/bisort/bisort: 2.10% (0.8333 => 0.8508, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0012) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2881, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3060, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4510, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0095) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.92% (5.2763 => 1.1648, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -75.38% (0.8651 => 0.2130, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.65% (5.3855 => 4.4352, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.04% (5.3526 => 4.4407, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: -13.32% (10.4361 => 9.0461, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.92% (1.7609 => 1.6214, std.dev.: 0.0043) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9583, std.dev.: 0.0447) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.58% (1.9577 => 0.6542, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.77% (0.3987 => 0.2561, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3062, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0196, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4313, std.dev.: 0.0027) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8462, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0083, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.65% (3.3453 => 2.5875, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1267, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0519) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.17% (0.9540 => 0.8570, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.02% (19.9488 => 18.5475, std.dev.: 0.0387) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -5.86% (1.2373 => 1.1648, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.61% (8.1563 => 7.6990, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8017, std.dev.: 0.0643) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0010) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.82% (3.7221 => 3.6542, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0587) SingleSource/Benchmarks/Shootout/ary3: -1.47% (3.6994 => 3.6451, std.dev.: 0.0204) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5802, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2354, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.16% (0.2116 => 0.0695, std.dev.: 0.0020) Report Time: 1.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 02:25:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 04:25:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125102533.39D752A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7930?compare_to=7926&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7930, Order: 173434, Start Time: 2013-01-25 08:51:45, End Time: 2013-01-25 10:25:49 To: 7926, Order: 173420, Start Time: 2013-01-25 06:50:08, End Time: 2013-01-25 08:27:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (108 on baseline) Performance Improvements: 0 (98 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.12% (76.9245 => 77.7897, std.dev.: 0.0290) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.78% (0.1132 => 0.1605, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.80% (0.6395 => 0.8812, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.67% (0.5688 => 0.7546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.52% (0.5805 => 0.7693, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.30% (0.6260 => 0.8282, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.06% (0.5849 => 0.7724, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.87% (0.6395 => 0.8433, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.64% (0.5575 => 0.7339, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.61% (0.5581 => 0.7345, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.90% (0.5941 => 0.7777, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.12% (0.5859 => 0.7624, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.05% (0.6033 => 0.7846, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.43% (0.6440 => 0.8335, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.97% (1.6474 => 2.1246, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.87% (0.6189 => 0.7976, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.95% (0.6304 => 0.8066, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.62% (0.6230 => 0.7951, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.87% (0.5802 => 0.7361, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.82% (0.6660 => 0.8446, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.18% (0.5925 => 0.7476, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.13% (0.5705 => 0.7196, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.00% (0.5857 => 0.7380, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.92% (0.5478 => 0.6898, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.80% (0.5569 => 0.7006, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.66% (0.5570 => 0.6999, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.00% (0.5591 => 0.6989, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.29% (0.5863 => 0.7287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.06% (0.6446 => 0.7997, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.03% (0.6052 => 0.7506, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.95% (0.7524 => 0.9326, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.27% (0.6681 => 0.8236, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.89% (0.6194 => 0.7612, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.73% (0.6297 => 0.7728, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.99% (2.2587 => 2.7555, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.27% (0.6667 => 0.8085, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.76% (0.7339 => 0.8789, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.76% (1.1450 => 1.3140, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.50% (4.5069 => 5.0701, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.25% (0.4916 => 0.5518, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 12.14% (0.4515 => 0.5063, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.67% (3.5339 => 3.9464, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.56% (1.6364 => 1.8255, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.25% (0.1982 => 0.2205, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.19% (0.2385 => 0.2628, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (9.2283 => 10.1133, std.dev.: 0.0119) MultiSource/Applications/Burg/burg: 8.36% (1.2515 => 1.3561, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.5329 => 0.5773, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.30% (0.2001 => 0.2167, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.15% (0.1731 => 0.1872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.11% (0.4524 => 0.4891, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 7.92% (0.4861 => 0.5246, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.69% (0.7021 => 0.7561, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.56% (1.4642 => 1.5749, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.81% (1.2784 => 1.3655, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (0.3255 => 0.3459, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (5.4682 => 5.7130, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/bigfib: 4.40% (0.6750 => 0.7047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.66% (0.3446 => 0.3572, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2006, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 2.83% (1.3864 => 1.4257, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 2.52% (0.8418 => 0.8630, std.dev.: 0.0047) MultiSource/Applications/minisat/minisat: 2.48% (0.7447 => 0.7632, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.48% (0.9557 => 0.9794, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.17% (0.5168 => 0.5280, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.09% (22.4056 => 22.8747, std.dev.: 0.0105) MultiSource/Applications/SPASS/SPASS: 1.99% (15.5079 => 15.8172, std.dev.: 0.0320) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.3722 => 1.3971, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.94% (31.3723 => 55.8252, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0050) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6767 => 12.1654, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6030, std.dev.: 0.1060) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (18.2231 => 18.5053, std.dev.: 0.0265) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2479, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (5.1955 => 5.2678, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.53% (0.7198 => 0.6872, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -3.74% (2.4924 => 2.3993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.73% (0.3831 => 0.3688, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -3.70% (0.3896 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.4033 => 0.3887, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.61% (0.9852 => 0.9496, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.60% (0.3884 => 0.3744, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference: -2.92% (0.7779 => 0.7552, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.88% (0.6484 => 0.6297, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.75% (0.6441 => 0.6264, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/parameter-passing: -2.59% (0.4280 => 0.4169, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.58% (0.9542 => 0.9296, std.dev.: 0.0020) SingleSource/UnitTests/Vector/constpool: -2.52% (20.7746 => 20.2506, std.dev.: 0.0086) MultiSource/Applications/hexxagon/hexxagon: -2.43% (1.3148 => 1.2828, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.34% (2.1713 => 2.1206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.14% (14.2083 => 13.9038, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: -1.93% (17.1032 => 16.7728, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.67% (0.7919 => 0.7787, std.dev.: 0.0022) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.63% (6.7716 => 6.6609, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.45% (1.0544 => 1.0391, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.42% (16.1920 => 15.9621, std.dev.: 0.0153) MultiSource/Benchmarks/MallocBench/gs/gs: -1.39% (4.3330 => 4.2727, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.28% (1.2221 => 1.2065, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.27% (1.2210 => 1.2055, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: -1.27% (7.0961 => 7.0061, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/football/football: -1.13% (0.9179 => 0.9075, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.09% (1.8100 => 0.6862, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3096, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0244, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0736, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1980, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.31% (2.5106 => 2.1262, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3559, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6346, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.06% (1.0557 => 1.0234, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.53% (7.9763 => 7.7742, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.18% (1.3096 => 1.2811, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -1.67% (7.3040 => 7.1821, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4728, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.51% (1.6219 => 1.5974, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.12% (1.6086 => 1.5906, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6680, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/whetstone: -1.04% (1.0443 => 1.0334, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 04:00:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 06:00:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125120056.9B1BE2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7931?compare_to=7927&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7931, Order: 173434, Start Time: 2013-01-25 09:58:37, End Time: 2013-01-25 12:01:15 To: 7927, Order: 173428, Start Time: 2013-01-25 07:36:58, End Time: 2013-01-25 09:39:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (15 on baseline) Performance Improvements: 1 (36 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (1012 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 7.70% (4.4968 => 4.8429, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.60% (7.0370 => 7.5720, std.dev.: 0.1045) MultiSource/Benchmarks/Prolangs-C/football/football: 6.61% (0.9717 => 1.0359, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 6.22% (3.5346 => 3.7546, std.dev.: 0.0316) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.20% (14.6164 => 15.3758, std.dev.: 0.1601) MultiSource/Applications/minisat/minisat: 4.35% (0.7494 => 0.7820, std.dev.: 0.0107) MultiSource/Applications/lua/lua: 3.30% (4.2167 => 4.3557, std.dev.: 0.0422) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 32.48% (0.8681 => 1.1501, std.dev.: 0.0379) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.30% (1.4606 => 1.8593, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.64% (43.3193 => 48.7937, std.dev.: 0.8970) SingleSource/Benchmarks/Shootout-C++/ary3: 11.74% (1.7336 => 1.9371, std.dev.: 0.0148) MultiSource/Benchmarks/nbench/nbench: 5.18% (20.8653 => 21.9460, std.dev.: 0.0637) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.34% (41.4036 => 43.1993, std.dev.: 0.3156) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.54% (0.5873 => 0.6081, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.16% (0.5687 => 0.5810, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/methcall: 1.26% (8.3089 => 8.4132, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.08% (1.2399 => 1.2533, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.03% (5.5226 => 5.5796, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.89% (0.9971 => 0.9683, std.dev.: 0.0028) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.13% (1.1461 => 1.1331, std.dev.: 0.0748) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.36% (0.0220 => 0.0223, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.93% (0.0431 => 0.0435, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0335 => 0.0338, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0319 => 0.0321, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.40% (0.0428 => 0.0434, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/casts: 1.46% (0.0205 => 0.0208, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: 2.30% (0.0217 => 0.0222, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0232 => 0.0232, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.99% (0.1510 => 0.1495, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -3.02% (1.2401 => 1.2027, std.dev.: 0.2480) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.31% (0.4024 => 0.4117, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.46% (0.1443 => 0.1464, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.94% (0.0979 => 0.0998, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0574 => 0.0539, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.1762 => 1.1780, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0608 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.53% (0.0293 => 0.0318, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.69% (0.7385 => 0.7510, std.dev.: 0.0301) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 48.00% (0.0050 => 0.0074, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.02% (12.7641 => 12.7663, std.dev.: 0.5113) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: 6.15% (0.9759 => 1.0359, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 4.71% (1.4110 => 1.4775, std.dev.: 0.0242) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.12% (7.2721 => 7.5720, std.dev.: 0.1045) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.97% (4.6579 => 4.8429, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320937.50% (0.0008 => 2.5683, std.dev.: 0.0619) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.91% (1.1825 => 2.3994, std.dev.: 0.0299) SingleSource/Regression/C/uint64_to_float: 22.36% (1.5397 => 1.8840, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 11.67% (0.2562 => 0.2861, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 6.99% (20.5117 => 21.9460, std.dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/ary3: 6.89% (1.8123 => 1.9371, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.85% (46.0987 => 48.7937, std.dev.: 0.8970) MultiSource/Applications/JM/lencod/lencod: 3.30% (6.8159 => 7.0407, std.dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.12% (0.5897 => 0.6081, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.08% (42.3194 => 43.1993, std.dev.: 0.3156) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.91% (1.2298 => 1.2533, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -29.05% (0.0692 => 0.0491, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.22% (0.1684 => 0.1293, std.dev.: 0.0095) MultiSource/Applications/hbd/hbd: -17.80% (1.8964 => 1.5589, std.dev.: 0.1273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.05% (0.0862 => 0.0715, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.25% (1.0960 => 0.9289, std.dev.: 0.0492) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.26% (1.0986 => 0.9419, std.dev.: 0.0244) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.28% (1.2154 => 1.0904, std.dev.: 0.0470) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -9.78% (0.2372 => 0.2140, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.64% (0.1317 => 0.1190, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.87% (6.4235 => 5.8536, std.dev.: 0.2192) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.11% (1.6874 => 1.5506, std.dev.: 0.0467) MultiSource/Applications/hexxagon/hexxagon: -7.63% (1.1433 => 1.0561, std.dev.: 0.0300) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.84% (0.6885 => 0.6414, std.dev.: 0.0175) MultiSource/Applications/lambda-0_1_3/lambda: -6.43% (0.8653 => 0.8097, std.dev.: 0.0173) MultiSource/Applications/lua/lua: -6.14% (4.6406 => 4.3557, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.49% (1.0017 => 0.9467, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.26% (0.3462 => 0.3280, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -5.15% (0.4002 => 0.3796, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.67% (1.0052 => 0.9683, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.66% (0.9422 => 0.9077, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.40% (1.3220 => 1.2770, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/reversefile: -2.92% (0.3665 => 0.3558, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.84% (0.9403 => 0.9136, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.15% (0.8926 => 0.8823, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.64% (16.6791 => 13.4031, std.dev.: 0.1969) MultiSource/Applications/minisat/minisat: -15.49% (7.9891 => 6.7517, std.dev.: 0.4429) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.30% (1.4588 => 1.3232, std.dev.: 0.0237) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.05% (0.3217 => 0.2958, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: -7.70% (3.5443 => 3.2714, std.dev.: 0.0484) SingleSource/Benchmarks/Misc/ffbench: -4.66% (1.4244 => 1.3580, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout/ary3: -4.31% (2.2304 => 2.1342, std.dev.: 0.0255) SingleSource/Benchmarks/Shootout-C++/lists: -3.14% (17.2182 => 16.6784, std.dev.: 0.0598) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3168, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.24% (3.1921 => 3.1525, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-7: -1.04% (1.7446 => 1.7264, std.dev.: 0.0057) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.94% (1.2047 => 1.1331, std.dev.: 0.0748) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0118) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0075) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0030) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.29% (0.1530 => 0.1495, std.dev.: 0.0056) MultiSource/Applications/lemon/lemon: -37.66% (1.9293 => 1.2027, std.dev.: 0.2480) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.68% (0.4049 => 0.4117, std.dev.: 0.0573) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.05% (0.1510 => 0.1464, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.04% (0.0978 => 0.0998, std.dev.: 0.0099) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.64% (0.0590 => 0.0539, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.40% (1.1617 => 1.1780, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0610 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.66% (0.0268 => 0.0318, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.98% (0.7437 => 0.7510, std.dev.: 0.0301) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.09% (12.7781 => 12.7663, std.dev.: 0.5113) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 04:22:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 06:22:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125122231.1DD2E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7932?compare_to=7930&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7932, Order: 173436, Start Time: 2013-01-25 10:49:04, End Time: 2013-01-25 12:22:48 To: 7930, Order: 173434, Start Time: 2013-01-25 08:51:45, End Time: 2013-01-25 10:25:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.21% (1.0263 => 1.0387, std.dev.: 0.0028) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.76% (0.6395 => 0.8810, std.dev.: 0.0080) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.61% (0.5805 => 0.7698, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.58% (0.5688 => 0.7541, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.44% (0.6260 => 0.8291, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.05% (0.5567 => 0.7351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.01% (0.5849 => 0.7721, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.98% (0.6395 => 0.8440, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.62% (0.5575 => 0.7338, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.45% (0.5581 => 0.7336, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.11% (0.5859 => 0.7623, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.95% (0.6033 => 0.7840, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.04% (1.6474 => 2.1258, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.78% (0.6189 => 0.7970, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.30% (0.6676 => 0.8565, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.20% (0.6304 => 0.8082, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.64% (0.6230 => 0.7952, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.76% (0.6660 => 0.8442, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.73% (0.5802 => 0.7353, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.17% (0.5705 => 0.7198, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.14% (0.5925 => 0.7474, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (0.5857 => 0.7372, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.76% (0.5478 => 0.6889, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.75% (0.5570 => 0.7004, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.73% (0.5569 => 0.7002, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.99% (0.5591 => 0.6988, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.36% (0.5863 => 0.7291, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.12% (0.6446 => 0.8001, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.99% (0.7524 => 0.9329, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.88% (0.6052 => 0.7497, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.20% (0.6681 => 0.8231, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.09% (0.6194 => 0.7624, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.82% (0.6297 => 0.7734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.93% (2.2587 => 2.7541, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.33% (0.6667 => 0.8089, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.66% (0.7339 => 0.8782, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3357 => 0.3873, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 14.75% (1.1450 => 1.3139, std.dev.: 0.0075) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.42% (4.5069 => 5.0666, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/05-eks/eks: 12.09% (0.4515 => 0.5061, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.04% (0.4916 => 0.5508, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.78% (3.5339 => 3.9502, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.58% (1.6364 => 1.8259, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.35% (0.1982 => 0.2207, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 9.53% (9.2283 => 10.1078, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.5329 => 0.5777, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.38% (1.2515 => 1.3564, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.32% (0.1731 => 0.1875, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.31% (0.4524 => 0.4900, std.dev.: 0.0119) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.83% (0.7021 => 0.7571, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4861 => 0.5235, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.4642 => 1.5692, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.90% (1.2784 => 1.3666, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.21% (0.3255 => 0.3457, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.00% (0.3319 => 0.3485, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.58% (5.4682 => 5.7187, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 4.37% (0.6750 => 0.7045, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.53% (5.0226 => 5.1997, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.33% (0.3394 => 0.3507, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.95% (1.3864 => 1.4273, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.60% (0.8418 => 0.8637, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.9557 => 0.9792, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.46% (0.7447 => 0.7630, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.14% (22.4056 => 22.8840, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5168 => 0.5276, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.02% (15.5079 => 15.8206, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.3722 => 1.3970, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8045, std.dev.: 0.0131) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.98% (0.9531 => 1.0387, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 7.68% (0.5692 => 0.6129, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.91% (1.2783 => 1.3666, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1645, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5616, std.dev.: 0.0900) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.96% (2.0478 => 2.1085, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5071, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2475, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2692, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4543, std.dev.: 0.0101) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.60% (0.7198 => 0.6867, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.29% (0.3194 => 0.3057, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.06% (0.3821 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.78% (0.3812 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.76% (0.3831 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4002, std.dev.: 0.0221) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.4033 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.66% (0.3884 => 0.3742, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.57% (0.3891 => 0.3752, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.55% (0.9852 => 0.9502, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.4176 => 0.4034, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: -3.03% (0.6347 => 0.6155, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.97% (0.7779 => 0.7548, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -2.86% (0.4199 => 0.4079, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.75% (0.6484 => 0.6306, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.73% (0.6441 => 0.6265, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.62% (20.7746 => 20.2302, std.dev.: 0.0211) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.54% (0.9542 => 0.9300, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.43% (1.3148 => 1.2829, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.12% (14.2083 => 13.9069, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.89% (2.1713 => 2.1302, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -1.74% (17.1032 => 16.8054, std.dev.: 0.0046) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.63% (6.7716 => 6.6610, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.57% (0.7919 => 0.7795, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -1.40% (16.1920 => 15.9647, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/gs/gs: -1.34% (4.3330 => 4.2749, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.30% (1.0544 => 1.0407, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.28% (1.2210 => 1.2054, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -1.25% (7.0961 => 7.0071, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.25% (1.2221 => 1.2068, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -1.15% (0.9179 => 0.9073, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.21% (1.8100 => 0.6840, std.dev.: 0.0167) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.13% (1.3643 => 1.0215, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0814, std.dev.: 0.0933) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1989, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.32% (0.3418 => 0.2826, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -14.98% (2.5106 => 2.1344, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7265, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.78% (0.5142 => 0.4639, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4007, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.81% (3.7241 => 3.6195, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (7.9763 => 7.7813, std.dev.: 0.0093) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0016) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3040 => 7.1797, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4695, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.26% (3.7092 => 3.6625, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.18% (1.6307 => 1.6115, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 04:51:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 06:51:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125125129.7EA172A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7933?compare_to=7929&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7933, Order: 173436, Start Time: 2013-01-25 10:40:22, End Time: 2013-01-25 12:51:46 To: 7929, Order: 173428, Start Time: 2013-01-25 07:56:06, End Time: 2013-01-25 10:09:33 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (219 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (652 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.30% (10.7347 => 10.8745, std.dev.: 0.0180) MultiSource/Benchmarks/PAQ8p/paq8p: 1.30% (10.7082 => 10.8476, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.18% (1.9004 => 1.9228, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/nbench/nbench: -1.13% (1.4103 => 1.3944, std.dev.: 0.0025) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.23% (0.1332 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.17% (0.0695 => 0.0666, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7495 => 499.8321, std.dev.: 0.0176) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.14% (1.1277 => 499.8321, std.dev.: 0.0176) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.36% (0.5229 => 1.6490, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 20.87% (14.9895 => 18.1182, std.dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: 44.52% (14.1553 => 20.4574, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 18.19% (4.1105 => 4.8580, std.dev.: 0.0216) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.03% (1.1048 => 1.7349, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.33% (7.1582 => 37.5329, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.46% (3.4629 => 6.4569, std.dev.: 0.0280) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.41% (0.6222 => 1.0914, std.dev.: 0.0015) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.33% (0.0720 => 7.4436, std.dev.: 0.0018) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 11149900.00% (0.0001 => 11.1500, std.dev.: 0.0433) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491000.00% (0.0001 => 5.4911, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.61% (1.1194 => 10.2381, std.dev.: 0.0376) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.56% (22.1758 => 55.1200, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.70% (0.1463 => 0.2512, std.dev.: 0.0011) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.71% (2.9384 => 4.6341, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.16% (7.0540 => 10.8745, std.dev.: 0.0180) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.98% (1.5859 => 2.4103, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.05% (8.1363 => 11.9644, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.28% (2.2024 => 3.1335, std.dev.: 0.0078) MultiSource/Applications/sgefa/sgefa: 39.72% (0.3109 => 0.4344, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 39.06% (21.9371 => 30.5050, std.dev.: 0.0226) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.48% (0.1062 => 0.1460, std.dev.: 0.0004) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.37% (4.2646 => 5.6876, std.dev.: 0.0163) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.74% (0.4615 => 0.6126, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.72% (1.5415 => 2.0459, std.dev.: 0.0098) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.56% (0.2271 => 0.2965, std.dev.: 0.0037) MultiSource/Applications/Burg/burg: 29.72% (1.1642 => 1.5102, std.dev.: 0.0080) MultiSource/Benchmarks/McCat/05-eks/eks: 29.54% (0.4299 => 0.5569, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.03% (0.5105 => 0.6536, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.36% (0.6675 => 0.8501, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.30% (0.1143 => 0.1455, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.24% (0.0793 => 0.1009, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.96% (0.1584 => 0.2011, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.59% (0.1892 => 0.2395, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 26.50% (9.4845 => 11.9975, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.19% (0.2554 => 0.3223, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.05% (3.8922 => 4.9061, std.dev.: 0.0081) SingleSource/Benchmarks/McGill/chomp: 25.68% (0.1655 => 0.2080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.79% (0.0730 => 0.0911) MultiSource/Applications/lemon/lemon: 24.71% (1.0722 => 1.3371, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 24.68% (0.1175 => 0.1465, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.45% (0.3121 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.33% (1.4186 => 1.7638, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 24.22% (0.4289 => 0.5328, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.83% (0.1695 => 0.2099, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 23.55% (0.4620 => 0.5708, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.52% (0.0842 => 0.1040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825) MultiSource/Applications/minisat/minisat: 22.70% (0.7115 => 0.8730, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.26% (0.2700 => 0.3301, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.90% (0.0662 => 0.0807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.60% (0.1236 => 0.1503, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 21.28% (5.7591 => 6.9849, std.dev.: 0.0047) MultiSource/Applications/spiff/spiff: 20.94% (0.7835 => 0.9476, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.91% (1.3050 => 1.5779, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.88% (0.0953 => 0.1152, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 20.82% (0.3098 => 0.3743, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/bigfib: 20.77% (0.6456 => 0.7797, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.05% (0.5860 => 0.7035, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.91% (4.9449 => 5.9296, std.dev.: 0.0158) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.65% (0.8172 => 0.9778, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 19.10% (3.3354 => 3.9725, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.09% (5.0018 => 5.9568, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.06% (0.5020 => 0.5977, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.82% (0.0834 => 0.0991, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.75% (0.3307 => 0.3927, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 18.59% (0.7433 => 0.8815, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.35% (0.2758 => 0.3264, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.08% (0.1510 => 0.1783, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.06% (0.5569 => 0.6575, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.04% (0.2107 => 0.2487, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.03% (0.9765 => 1.1526, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 17.80% (3.8723 => 4.5614, std.dev.: 0.0123) MultiSource/Benchmarks/nbench/nbench: 17.77% (1.1840 => 1.3944, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 17.62% (0.3423 => 0.4026, std.dev.: 0.0064) MultiSource/Applications/treecc/treecc: 17.52% (2.0273 => 2.3825, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.46% (1.1861 => 1.3932, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.34% (0.5981 => 0.7018, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.14% (0.2065 => 0.2419, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.99% (2.2969 => 2.6871, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.86% (0.1044 => 0.1220, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.80% (0.3441 => 0.4019, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.62% (0.8101 => 0.9447, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 16.39% (0.3283 => 0.3821, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.17% (0.6450 => 0.7493, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 15.96% (0.2049 => 0.2376, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 15.78% (0.3232 => 0.3742, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 15.75% (0.3180 => 0.3681, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.19% (0.8921 => 1.0276, std.dev.: 0.0030) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.65% (0.8067 => 0.9249, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.16% (0.0798 => 0.0911, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.14% (0.2603 => 0.2971, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 13.91% (0.3379 => 0.3849, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.79% (0.3387 => 0.3854, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.69% (0.3865 => 0.4394, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.19% (1.5603 => 1.7661, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.16% (0.4636 => 0.5246, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.60% (0.4103 => 0.4620, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 12.46% (0.3282 => 0.3691, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.44% (0.4203 => 0.4726, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.14% (0.2430 => 0.2725, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 12.04% (17.1811 => 19.2496, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: 11.93% (0.4048 => 0.4531, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.89% (0.3422 => 0.3829, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 11.77% (0.3603 => 0.4027, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 11.54% (0.3684 => 0.4109, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 11.48% (0.3092 => 0.3447, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.14% (0.3886 => 0.4319, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.03% (0.3427 => 0.3805, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.82% (0.3826 => 0.4240, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.63% (0.4064 => 0.4496, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.59% (0.1114 => 0.1232, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.57% (14.3668 => 15.8858, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 10.48% (0.3828 => 0.4229, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 9.93% (0.3473 => 0.3818, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.92% (0.3497 => 0.3844, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2831 => 0.3105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.00% (2.0665 => 2.2525, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 8.95% (0.2871 => 0.3128, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2877 => 0.3134, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: 8.71% (1.2842 => 1.3960, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.58% (0.3650 => 0.3963, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.54% (0.3162 => 0.3432, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.50% (0.2905 => 0.3152, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.47% (63.2438 => 68.6037, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.47% (0.2891 => 0.3136, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.16% (0.3052 => 0.3301, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.13% (0.3935 => 0.4255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.13% (0.2756 => 0.2980, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.11% (0.2872 => 0.3105, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.07% (0.2802 => 0.3028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.91% (2.2022 => 2.3763, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/fibo: 7.85% (0.2725 => 0.2939, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 7.74% (0.2714 => 0.2924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 7.60% (0.6030 => 0.6488, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.58% (0.7326 => 0.7881, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.53% (0.3136 => 0.3372, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 7.27% (0.5925 => 0.6356, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.42% (0.4879 => 0.5192, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.34% (0.1625 => 0.1728, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 4.63% (10.3673 => 10.8476, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/objinst: 3.55% (0.3131 => 0.3242, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.70% (7.9617 => 8.1763, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.62% (0.3817 => 0.3917, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4749, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3862, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4539, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3133, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.92% (0.9957 => 1.0347, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9101, std.dev.: 0.0218) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.09% (3.6395 => 3.7157, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.77% (9.1159 => 9.2769, std.dev.: 0.0264) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3050, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.50% (1.0785 => 1.0947, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4578, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1697, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1709, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -75.32% (0.8651 => 0.2135, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.89% (5.3855 => 4.4761, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.34% (5.3526 => 4.4782, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: -13.14% (10.4361 => 9.0651, std.dev.: 0.0078) SingleSource/UnitTests/Vector/constpool: -7.92% (54.1659 => 49.8734, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.63% (1.7609 => 1.6265, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.39% (1.9577 => 0.6580, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.33% (1.1492 => 0.7662, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.18% (1.5373 => 1.0273, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4132, std.dev.: 0.0104) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8483, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0048, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0023) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -16.12% (1.6925 => 1.4196, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7329, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4920, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.76% (19.9488 => 18.6005, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.05% (0.2497 => 0.2346) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: -6.04% (1.2373 => 1.1626, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7046, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -4.42% (10.2830 => 9.8286, std.dev.: 0.0120) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.60% (3.6994 => 3.6403, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -1.42% (4.6441 => 4.5780, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7221 => 3.6735, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0063) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0019) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 06:15:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 08:15:24 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125141524.8D9FB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7934?compare_to=7931&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7934, Order: 173439, Start Time: 2013-01-25 12:18:32, End Time: 2013-01-25 14:15:42 To: 7931, Order: 173434, Start Time: 2013-01-25 09:58:37, End Time: 2013-01-25 12:01:15 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (12 on baseline) Performance Improvements: 63 (156 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 990 (895 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.19% (0.3224 => 0.3359, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.24% (1.8710 => 1.9316, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.13% (0.9289 => 0.9487, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.11% (0.8931 => 0.9119, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.75% (0.9031 => 0.9189, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.11% (0.9928 => 1.0038, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.83% (1.2452 => 1.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.03% (4.7751 => 4.9676, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops: 2.33% (8.6564 => 8.8582, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.06% (13.4031 => 13.6787, std.dev.: 0.0490) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.30% (2.5714 => 2.6047, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -19.39% (0.0815 => 0.0657, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -15.61% (0.0865 => 0.0730, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -11.63% (2.7319 => 2.4142, std.dev.: 0.0062) SingleSource/Benchmarks/SmallPT/smallpt: -10.51% (0.1560 => 0.1396, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -9.33% (0.9850 => 0.8931, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/tsp/tsp: -7.71% (0.1413 => 0.1304, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.54% (0.4043 => 0.3738, std.dev.: 0.0098) MultiSource/Applications/treecc/treecc: -7.47% (2.3819 => 2.2040, std.dev.: 0.0281) MultiSource/Applications/Burg/burg: -7.09% (1.5065 => 1.3997, std.dev.: 0.0244) MultiSource/Benchmarks/Ptrdist/ks/ks: -6.91% (0.1781 => 0.1658, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.71% (0.2326 => 0.2170, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: -6.53% (3.7546 => 3.5093, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/football/football: -5.74% (1.0359 => 0.9764, std.dev.: 0.0030) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.72% (7.5720 => 7.1392, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.52% (4.8429 => 4.5754, std.dev.: 0.0206) MultiSource/Applications/sgefa/sgefa: -4.60% (0.3435 => 0.3277, std.dev.: 0.0040) MultiSource/Applications/minisat/minisat: -4.40% (0.7820 => 0.7476, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: -4.32% (16.6592 => 15.9387, std.dev.: 0.1036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.84% (0.2631 => 0.2530, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: -3.83% (16.7679 => 16.1251, std.dev.: 0.0672) MultiSource/Benchmarks/nbench/nbench: -3.76% (1.3160 => 1.2665, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -3.50% (4.3557 => 4.2033, std.dev.: 0.0371) MultiSource/Applications/kimwitu++/kc: -3.46% (18.9581 => 18.3028, std.dev.: 0.0994) MultiSource/Benchmarks/Ptrdist/bc/bc: -3.31% (1.2785 => 1.2362, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.20% (15.3758 => 14.8836, std.dev.: 0.0288) MultiSource/Applications/JM/ldecod/ldecod: -2.85% (7.3888 => 7.1780, std.dev.: 0.0520) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.84% (0.7086 => 0.6885, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: -2.79% (16.4414 => 15.9830, std.dev.: 0.0629) MultiSource/Applications/hexxagon/hexxagon: -2.64% (1.0561 => 1.0282, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.22% (2.4797 => 2.4246, std.dev.: 0.0184) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.15% (5.8536 => 5.7278, std.dev.: 0.0121) MultiSource/Applications/JM/lencod/lencod: -1.74% (16.6830 => 16.3924, std.dev.: 0.0790) MultiSource/Applications/SIBsim4/SIBsim4: -1.51% (1.3912 => 1.3702, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.36% (0.9096 => 0.8972, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.05% (1.7338 => 1.7156, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -26.34% (1.1501 => 0.8472, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/mst/mst: -20.35% (0.1887 => 0.1503, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -16.67% (0.0660 => 0.0550, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: -10.69% (0.7270 => 0.6493, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: -10.13% (1.9371 => 1.7408, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.81% (0.1590 => 0.1434, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.39% (48.7937 => 44.2096, std.dev.: 0.1571) MultiSource/Applications/minisat/minisat: -8.32% (6.7517 => 6.1900, std.dev.: 0.0483) SingleSource/Benchmarks/CoyoteBench/lpbench: -6.23% (4.3592 => 4.0876, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/hash: -4.60% (0.6429 => 0.6133, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.56% (43.1993 => 41.2286, std.dev.: 0.5867) MultiSource/Benchmarks/FreeBench/distray/distray: -4.31% (0.2434 => 0.2329, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/lists1: -4.08% (0.6275 => 0.6019, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.86% (2.4592 => 2.3642, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.82% (0.6081 => 0.5849, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.49% (22.7811 => 21.9862, std.dev.: 0.2573) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -3.32% (1.2533 => 1.2117, std.dev.: 0.0138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.23% (3.0297 => 2.9318, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/tsp/tsp: -2.32% (1.5313 => 1.4957, std.dev.: 0.0047) SingleSource/Benchmarks/McGill/chomp: -2.30% (1.0299 => 1.0062, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: -2.20% (0.4818 => 0.4712, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.07% (0.5810 => 0.5690, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: -2.00% (1.2955 => 1.2696, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/ary3: -1.97% (2.1342 => 2.0922, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.51% (5.9164 => 5.8270, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.42% (4.5990 => 4.5337, std.dev.: 0.0163) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.33% (2.5915 => 2.5570, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: -1.10% (2.9115 => 2.8794, std.dev.: 0.0111) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.85% (1.1331 => 1.1235, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.98% (0.0223 => 0.0145, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0435 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0338 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0321 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.38% (0.0434 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.96% (0.0208 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.12% (0.0232 => 0.0183, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1495 => 0.1496, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -4.48% (1.2027 => 1.1488, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.12% (0.4117 => 0.4122, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.25% (0.1464 => 0.1431, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.20% (0.0998 => 0.0976, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.34% (0.0267 => 0.0186, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.09% (0.0539 => 0.0588, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1780 => 1.1837, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -56.67% (0.0030 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.55% (0.0615 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -26.10% (0.0318 => 0.0235, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.34% (0.7510 => 0.7334, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 35.14% (0.0074 => 0.0100, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (12.7663 => 12.7734, std.dev.: 0.0411) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.75% (0.0336 => 0.0483, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.57% (1.8651 => 1.9316, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 3.00% (1.4110 => 1.4534, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.99% (0.9010 => 0.9189, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (9.5202 => 9.6666, std.dev.: 0.0518) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 322462.50% (0.0008 => 2.5805, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 103.52% (1.1825 => 2.4066, std.dev.: 0.0200) SingleSource/Regression/C/uint64_to_float: 24.23% (1.5397 => 1.9128, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.38% (0.2562 => 0.2828, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.22% (2.2499 => 2.3674, std.dev.: 0.0185) MultiSource/Applications/JM/lencod/lencod: 3.09% (6.8159 => 7.0263, std.dev.: 0.0332) SingleSource/Benchmarks/Misc/pi: 2.83% (2.1390 => 2.1995, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -40.85% (0.0727 => 0.0430, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-3: -30.48% (0.0374 => 0.0260, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.46% (0.0692 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/SmallPT/smallpt: -26.06% (0.1888 => 0.1396, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.93% (0.0676 => 0.0521, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -22.57% (0.1684 => 0.1304, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.93% (0.1009 => 0.0818, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: -17.99% (1.8964 => 1.5553, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.52% (0.0862 => 0.0711, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.81% (0.7686 => 0.6548, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/ffbench: -14.36% (0.0801 => 0.0686, std.dev.: 0.0042) SingleSource/UnitTests/Vector/constpool: -13.93% (9.8875 => 8.5101, std.dev.: 0.0789) MultiSource/Benchmarks/VersaBench/dbms/dbms: -13.44% (1.0960 => 0.9487, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -13.17% (1.0986 => 0.9539, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -13.14% (0.1317 => 0.1144, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: -12.61% (1.0220 => 0.8931, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -12.49% (0.0889 => 0.0778, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: -12.40% (1.5979 => 1.3997, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.05% (0.1079 => 0.0949, std.dev.: 0.0007) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.89% (1.2154 => 1.0831, std.dev.: 0.0305) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.85% (0.4074 => 0.3632, std.dev.: 0.0071) MultiSource/Applications/treecc/treecc: -10.84% (2.4719 => 2.2040, std.dev.: 0.0281) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.83% (6.4235 => 5.7278, std.dev.: 0.0121) MultiSource/Applications/aha/aha: -10.81% (0.1378 => 0.1229, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.59% (0.7693 => 0.6878, std.dev.: 0.0121) MultiSource/Applications/hexxagon/hexxagon: -10.07% (1.1433 => 1.0282, std.dev.: 0.0092) MultiSource/Applications/lua/lua: -9.42% (4.6406 => 4.2033, std.dev.: 0.0371) MultiSource/Applications/sqlite3/sqlite3: -9.25% (17.5634 => 15.9387, std.dev.: 0.1036) MultiSource/Applications/sgefa/sgefa: -8.92% (0.3598 => 0.3277, std.dev.: 0.0040) MultiSource/Applications/siod/siod: -8.68% (2.6437 => 2.4142, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.68% (1.3924 => 1.2716, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.45% (1.5131 => 1.3853, std.dev.: 0.0111) MultiSource/Applications/lambda-0_1_3/lambda: -8.15% (0.8653 => 0.7948, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -8.12% (0.1305 => 0.1199, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.68% (10.2703 => 9.4813, std.dev.: 0.0782) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.57% (1.6874 => 1.5596, std.dev.: 0.0177) MultiSource/Applications/ClamAV/clamscan: -7.52% (17.4365 => 16.1251, std.dev.: 0.0672) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.38% (0.2372 => 0.2197, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: -7.26% (3.7840 => 3.5093, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.07% (0.9124 => 0.8479, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.91% (0.2618 => 0.2437, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.84% (0.5746 => 0.5353, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/fibo: -6.68% (0.2006 => 0.1872, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.37% (1.1498 => 1.0766, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.25% (0.6885 => 0.6455, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.18% (0.3462 => 0.3248, std.dev.: 0.0034) MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.17% (1.1731 => 1.1007, std.dev.: 0.0180) MultiSource/Applications/lemon/lemon: -6.09% (1.3979 => 1.3128, std.dev.: 0.0306) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.04% (0.3560 => 0.3345, std.dev.: 0.0020) MultiSource/Applications/viterbi/viterbi: -6.03% (0.1824 => 0.1714, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hello: -6.02% (0.1928 => 0.1812, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: -6.00% (0.4002 => 0.3762, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.98% (0.2709 => 0.2547, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: -5.79% (0.2385 => 0.2247, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (0.5134 => 0.4841, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.36% (1.8127 => 1.7156, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.29% (1.0017 => 0.9487, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -5.19% (0.2100 => 0.1991, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.17% (1.3310 => 1.2622, std.dev.: 0.0219) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.12% (0.7693 => 0.7299, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.99% (0.3665 => 0.3482, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.95% (0.2283 => 0.2170, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.89% (0.9588 => 0.9119, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.89% (0.9550 => 0.9083, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.85% (0.2884 => 0.2744, std.dev.: 0.0039) MultiSource/Applications/SIBsim4/SIBsim4: -4.79% (1.4392 => 1.3702, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.65% (0.3981 => 0.3796, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: -4.60% (0.2172 => 0.2072, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -4.59% (0.2551 => 0.2434, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -4.35% (0.2665 => 0.2549, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: -4.26% (0.2725 => 0.2609, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.14% (0.3093 => 0.2965, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.04% (0.6135 => 0.5887, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -3.98% (0.2915 => 0.2799, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.91% (1.0234 => 0.9834, std.dev.: 0.0062) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.87% (3.6295 => 3.4891, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -3.86% (0.7776 => 0.7476, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.74% (0.9422 => 0.9070, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: -3.71% (0.4689 => 0.4515, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: -3.53% (0.3715 => 0.3584, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.49% (1.3220 => 1.2758, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/lists1: -3.49% (0.3206 => 0.3094, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.49% (0.8990 => 0.8676, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: -3.35% (18.9377 => 18.3028, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.34% (0.9127 => 0.8822, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.30% (0.9507 => 0.9193, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: -3.00% (0.6711 => 0.6510, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.94% (1.0052 => 0.9756, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.94% (0.9512 => 0.9232, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.90% (0.9091 => 0.8827, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.85% (0.5369 => 0.5216, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: -2.83% (16.4479 => 15.9830, std.dev.: 0.0629) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.79% (0.9405 => 0.9143, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.74% (0.9403 => 0.9145, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.63% (0.9214 => 0.8972, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.51% (1.2680 => 1.2362, std.dev.: 0.0087) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.43% (5.0381 => 4.9158, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.41% (0.9993 => 0.9752, std.dev.: 0.0083) MultiSource/Applications/JM/ldecod/ldecod: -2.38% (7.3529 => 7.1780, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.35% (0.9788 => 0.9558, std.dev.: 0.0029) MultiSource/Applications/JM/lencod/lencod: -1.85% (16.7012 => 16.3924, std.dev.: 0.0790) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.83% (7.2721 => 7.1392, std.dev.: 0.0495) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.77% (4.6579 => 4.5754, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.40% (0.9855 => 0.9717, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.34% (1.0119 => 0.9983, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.25% (0.9488 => 0.9369, std.dev.: 0.0034) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -30.72% (0.9372 => 0.6493, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/heapsort: -30.04% (4.4739 => 3.1299, std.dev.: 0.1140) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.23% (4.2042 => 3.1433, std.dev.: 0.1017) MultiSource/Applications/minisat/minisat: -22.52% (7.9891 => 6.1900, std.dev.: 0.0483) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.67% (1.0816 => 0.8472, std.dev.: 0.0114) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.74% (1.5623 => 1.2696, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.99% (16.6791 => 13.6787, std.dev.: 0.0490) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -15.60% (1.4235 => 1.2014, std.dev.: 0.0392) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.04% (1.6547 => 1.4721, std.dev.: 0.0386) SingleSource/Benchmarks/Shootout/hash: -10.22% (4.5259 => 4.0634, std.dev.: 0.0233) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.17% (0.4081 => 0.3666, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.08% (5.0421 => 4.5337, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.66% (1.4588 => 1.3179, std.dev.: 0.0226) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.49% (2.8778 => 2.6047, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/lists1: -9.19% (0.6628 => 0.6019, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.23% (4.4540 => 4.0876, std.dev.: 0.0306) MultiSource/Applications/SIBsim4/SIBsim4: -7.82% (3.5443 => 3.2670, std.dev.: 0.0144) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.21% (0.3217 => 0.2985, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -6.20% (2.2304 => 2.0922, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/health/health: -6.05% (0.3654 => 0.3433, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.04% (23.3986 => 21.9862, std.dev.: 0.2573) MultiSource/Applications/SPASS/SPASS: -5.26% (9.0650 => 8.5878, std.dev.: 0.0372) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.06% (0.3201 => 0.3039, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.24% (0.3609 => 0.3456, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.10% (46.0987 => 44.2096, std.dev.: 0.1571) SingleSource/Benchmarks/Shootout-C++/ary3: -3.95% (1.8123 => 1.7408, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.76% (1.4446 => 1.3903, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/recursive: -3.49% (2.4498 => 2.3642, std.dev.: 0.0267) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.48% (2.5170 => 2.4293, std.dev.: 0.0294) SingleSource/Benchmarks/McGill/chomp: -3.48% (1.0425 => 1.0062, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/lists: -3.40% (17.2182 => 16.6329, std.dev.: 0.0535) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.62% (40.4729 => 39.4111, std.dev.: 0.0532) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.54% (3.0082 => 2.9318, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.33% (0.5826 => 0.5690, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel-2: -2.09% (0.8521 => 0.8343, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: -1.93% (0.6254 => 0.6133, std.dev.: 0.0029) MultiSource/Applications/lua/lua: -1.89% (29.0327 => 28.4828, std.dev.: 0.1556) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.65% (3.7662 => 3.7041, std.dev.: 0.0116) SingleSource/Benchmarks/SmallPT/smallpt: -1.64% (14.9448 => 14.6993, std.dev.: 0.0279) MultiSource/Benchmarks/Bullet/bullet: -1.52% (7.2040 => 7.0948, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.46% (3.1921 => 3.1455, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3596 => 3.3143, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.34% (5.9063 => 5.8270, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/ReedSolomon: -1.33% (8.6447 => 8.5300, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/methcall: -1.12% (8.7416 => 8.6439, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/fibo: -1.11% (4.3512 => 4.3029, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/matrix: -1.07% (1.5825 => 1.5656, std.dev.: 0.0049) MultiSource/Applications/aha/aha: -1.05% (3.5321 => 3.4951, std.dev.: 0.0061) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.74% (1.2047 => 1.1235, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.77% (0.0233 => 0.0145, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.82% (0.0445 => 0.0428, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -28.24% (0.0255 => 0.0183, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.22% (0.1530 => 0.1496, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -40.46% (1.9293 => 1.1488, std.dev.: 0.0456) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.80% (0.4049 => 0.4122, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.23% (0.1510 => 0.1431, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.20% (0.0978 => 0.0976, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -32.61% (0.0276 => 0.0186, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.34% (0.0590 => 0.0588, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.89% (1.1617 => 1.1837, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -59.38% (0.0032 => 0.0013, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.77% (0.0610 => 0.0587, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.31% (0.0268 => 0.0235, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.38% (0.7437 => 0.7334, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.70% (0.0092 => 0.0100, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7781 => 12.7734, std.dev.: 0.0411) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 06:19:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 08:19:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125141938.2BF0E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7935?compare_to=7932&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7935, Order: 173439, Start Time: 2013-01-25 12:46:15, End Time: 2013-01-25 14:19:53 To: 7932, Order: 173436, Start Time: 2013-01-25 10:49:04, End Time: 2013-01-25 12:22:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (109 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.49% (0.6840 => 0.7079, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.90% (0.0514 => 0.0899) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 41.95% (0.0267 => 0.0379, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.80% (0.6395 => 0.8812, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.79% (0.5688 => 0.7553, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.51% (0.5456 => 0.7230, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.41% (0.6260 => 0.8289, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.16% (0.5849 => 0.7730, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.96% (0.6395 => 0.8439, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.92% (0.5567 => 0.7344, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.70% (0.5575 => 0.7342, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.57% (0.5581 => 0.7343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.70% (0.5941 => 0.7765, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.28% (0.5859 => 0.7633, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.99% (0.6033 => 0.7842, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.76% (0.0699 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.27% (0.6440 => 0.8325, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.04% (1.6474 => 2.1258, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.97% (0.6189 => 0.7982, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.43% (0.6676 => 0.8574, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.08% (0.6304 => 0.8074, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.59% (0.6230 => 0.7949, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.89% (0.5802 => 0.7362, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.83% (0.6660 => 0.8447, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.30% (0.5925 => 0.7483, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.21% (0.5705 => 0.7200, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.97% (0.5857 => 0.7378, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.92% (0.5478 => 0.6898, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.88% (0.5569 => 0.7010, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.67% (0.5570 => 0.7000, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.09% (0.5591 => 0.6994, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.27% (0.5863 => 0.7286, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.98% (0.7524 => 0.9328, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.98% (0.6052 => 0.7503, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.92% (0.6446 => 0.7988, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.20% (0.6681 => 0.8231, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.02% (0.6194 => 0.7620, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.71% (0.6297 => 0.7727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.98% (2.2587 => 2.7552, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.15% (0.6667 => 0.8077, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.72% (0.7339 => 0.8786, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.79% (1.1450 => 1.3143, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (4.5069 => 5.0718, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 12.23% (0.4515 => 0.5067, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.04% (0.4916 => 0.5508, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.74% (3.5339 => 3.9488, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.73% (1.6364 => 1.8284, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.30% (0.1982 => 0.2206, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.55% (9.2283 => 10.1098, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.48% (0.5329 => 0.5781, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168) SingleSource/Benchmarks/Shootout-C++/hash: 8.27% (0.4524 => 0.4898, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.25% (1.2515 => 1.3547, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.09% (0.1731 => 0.1871, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.86% (0.4861 => 0.5243, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.68% (0.7021 => 0.7560, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.21% (1.4642 => 1.5697, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.84% (1.2784 => 1.3659, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.18% (0.3255 => 0.3456, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.3319 => 0.3483, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.62% (5.4682 => 5.7210, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 4.47% (0.6750 => 0.7052, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.50% (5.0226 => 5.1983, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary: 3.24% (0.3394 => 0.3504, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.08% (1.3864 => 1.4291, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.54% (0.7447 => 0.7636, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.49% (0.8418 => 0.8628, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.9557 => 0.9788, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.05% (22.4056 => 22.8653, std.dev.: 0.0136) MultiSource/Applications/SPASS/SPASS: 2.01% (15.5079 => 15.8192, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.5168 => 0.5271, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.3722 => 1.3983, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8047, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (0.9531 => 1.0295, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6767 => 12.1641, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.52% (54.5751 => 56.4974, std.dev.: 0.1103) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1021, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.63% (18.2231 => 18.5193, std.dev.: 0.0151) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2466, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.64% (0.7198 => 0.6864, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.03% (0.3821 => 0.3667, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.74% (0.3880 => 0.3735, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.73% (2.4924 => 2.3995, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.71% (0.3884 => 0.3740, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.69% (0.3848 => 0.3706, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.4033 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.57% (0.3891 => 0.3752, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.49% (0.9852 => 0.9508, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.34% (0.3142 => 0.3037, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.96% (0.6347 => 0.6159, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.89% (0.7779 => 0.7554, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.75% (0.6441 => 0.6264, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.70% (0.6484 => 0.6309, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2361, std.dev.: 0.0212) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.55% (0.9542 => 0.9299, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -2.40% (1.3148 => 1.2833, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.32% (2.1713 => 2.1210, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.10% (14.2083 => 13.9101, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.87% (17.1032 => 16.7835, std.dev.: 0.0217) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.65% (0.7919 => 0.7788, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.57% (6.7716 => 6.6656, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/gs/gs: -1.39% (4.3330 => 4.2726, std.dev.: 0.0056) MultiSource/Applications/JM/lencod/lencod: -1.37% (16.1920 => 15.9694, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.30% (1.0544 => 1.0407, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -1.28% (7.0961 => 7.0054, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.28% (1.2221 => 1.2065, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.22% (1.2210 => 1.2061, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: -1.09% (0.9179 => 0.9079, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.89% (1.8100 => 0.7079, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3158, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/mandel-2: -24.98% (1.3643 => 1.0235, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0775, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1976, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1286, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3558, std.dev.: 0.0107) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.00% (4.1534 => 3.8212, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1744, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4010, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.15% (1.0557 => 1.0224, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (7.9763 => 7.7520, std.dev.: 0.0223) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.35% (1.3096 => 1.2788, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: -2.35% (3.7241 => 3.6367, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.33% (3.1919 => 3.1176, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.49% (6.5735 => 6.4758, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.45% (7.3040 => 7.1982, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: -1.43% (3.7092 => 3.6563, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.23% (1.6307 => 1.6106, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5907, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.10% (1.6219 => 1.6040, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 06:27:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 08:27:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125142714.713662A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7936?compare_to=7928&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7936, Order: 173435, Start Time: 2013-01-25 10:52:30, End Time: 2013-01-25 14:27:31 To: 7928, Order: 173416, Start Time: 2013-01-25 06:11:45, End Time: 2013-01-25 10:00:30 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (186 on baseline) Performance Improvements: 3 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (752 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.49% (3.2760 => 3.1945, std.dev.: 0.0168) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.08% (0.0756 => 0.0642, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.25% (2.2118 => 2.1620, std.dev.: 0.0014) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 47.68% (0.0625 => 0.0923, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.06% (0.1063 => 0.1457, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.24% (0.2969 => 0.3837, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.39% (0.1106 => 0.1420, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.97% (0.0547 => 0.0700, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.49% (0.4139 => 0.5277, std.dev.: 0.0121) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.37% (0.5900 => 0.7515, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.30% (0.4253 => 0.5414, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0021) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.18% (0.5000 => 0.6309, std.dev.: 0.0174) MultiSource/Applications/oggenc/oggenc: 25.88% (1.5932 => 2.0055, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.85% (0.4994 => 0.6285, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.31% (0.1620 => 0.2030, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.97% (0.0897 => 0.1121, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.78% (0.1021 => 0.1274, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.82% (0.1549 => 0.1918, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.40% (0.1107 => 0.1366, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.33% (0.1003 => 0.1237, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.19% (0.1604 => 0.1976, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.06% (0.3903 => 0.4803, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.03% (0.1103 => 0.1357, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.01% (0.3890 => 0.4785, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 22.85% (0.0604 => 0.0742, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.44% (0.1462 => 0.1790, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/05-eks/eks: 22.24% (0.1619 => 0.1979, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 21.86% (0.0947 => 0.1154, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.65% (0.0462 => 0.0562) MultiSource/Applications/spiff/spiff: 21.20% (0.4029 => 0.4883, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.05% (0.1088 => 0.1317, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 21.02% (0.1218 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.00% (1.3152 => 1.5914, std.dev.: 0.0172) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.75% (0.2014 => 0.2432, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.64% (0.3271 => 0.3946, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/mst/mst: 20.63% (0.0698 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.61% (0.2736 => 0.3300, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.59% (0.2866 => 0.3456, std.dev.: 0.0064) SingleSource/UnitTests/ObjC++/Hello: 20.44% (0.5826 => 0.7017, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 20.33% (0.1505 => 0.1811, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference-object: 20.19% (0.5889 => 0.7078, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 19.95% (1.8794 => 2.2544, std.dev.: 0.0244) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.92% (0.1968 => 0.2360, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.69% (0.2875 => 0.3441, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.60% (0.4658 => 0.5571, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.49% (0.0513 => 0.0613, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.46% (0.5026 => 0.6004, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 19.44% (0.5546 => 0.6624, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/strcat: 19.35% (0.2750 => 0.3282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.34% (0.2792 => 0.3332, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 19.32% (0.9697 => 1.1570, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/except: 19.28% (0.2811 => 0.3353, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 19.24% (0.7171 => 0.8551, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 19.17% (0.2780 => 0.3313, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 19.13% (0.2813 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 18.99% (0.2823 => 0.3359, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.97% (3.5627 => 4.2385, std.dev.: 0.0834) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.96% (0.2738 => 0.3257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 18.94% (0.2714 => 0.3228, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 18.94% (0.2725 => 0.3241, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.93% (0.2911 => 0.3462, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 18.91% (0.3004 => 0.3572, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.91% (0.2729 => 0.3245, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 18.87% (0.2803 => 0.3332, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.82% (0.3060 => 0.3636, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.82% (2.0673 => 2.4564, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.73% (1.6211 => 1.9247, std.dev.: 0.0193) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.71% (0.1160 => 0.1377, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bh/bh: 18.69% (0.1284 => 0.1524, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 18.60% (0.9909 => 1.1752, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 18.48% (0.3096 => 0.3668, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.47% (0.3195 => 0.3785, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 18.39% (0.3258 => 0.3857, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 18.34% (23.5202 => 27.8335, std.dev.: 0.0681) SingleSource/Benchmarks/Shootout-C++/ary3: 18.24% (0.3267 => 0.3863, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 18.09% (0.3317 => 0.3917, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.02% (0.1421 => 0.1677, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.91% (0.3930 => 0.4634, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.82% (0.4361 => 0.5138, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.73% (0.3124 => 0.3678, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.69% (1.9966 => 2.3497, std.dev.: 0.0480) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.64% (0.3362 => 0.3955, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 17.63% (0.3726 => 0.4383, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.58% (0.3282 => 0.3859, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 17.57% (1.0781 => 1.2675, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.46% (0.3625 => 0.4258, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.34% (1.9694 => 2.3109, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout-C++/lists: 17.29% (0.3348 => 0.3927, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 17.24% (4.2109 => 4.9369, std.dev.: 0.0682) SingleSource/Benchmarks/Shootout-C++/lists1: 17.20% (0.3477 => 0.4075, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 17.16% (0.3678 => 0.4309, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.12% (4.4195 => 5.1763, std.dev.: 0.0159) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.05% (2.7292 => 3.1945, std.dev.: 0.0168) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.91% (0.3845 => 0.4495, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.86% (0.3981 => 0.4652, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 16.79% (0.4146 => 0.4842, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.64% (0.3690 => 0.4304, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 16.63% (0.4251 => 0.4958, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.42% (0.1090 => 0.1269, std.dev.: 0.0027) MultiSource/Applications/lua/lua: 16.37% (1.4269 => 1.6605, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 16.33% (0.2566 => 0.2985, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.88% (0.3488 => 0.4042, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 15.54% (0.5012 => 0.5791, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.45% (0.0673 => 0.0777, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3465 => 0.4000, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.44% (0.3446 => 0.3978, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.33% (0.3496 => 0.4032, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.32% (0.3460 => 0.3990, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.31% (0.7875 => 0.9081, std.dev.: 0.0111) SingleSource/UnitTests/ObjC/synchronized: 15.28% (0.3469 => 0.3999, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.22% (0.3442 => 0.3966, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 15.07% (2.1653 => 2.4917, std.dev.: 0.0190) SingleSource/UnitTests/ObjC/property: 15.04% (0.3650 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 15.02% (0.3643 => 0.4190, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.80% (0.3724 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.79% (0.1028 => 0.1180, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.75% (0.6435 => 0.7384, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 14.68% (0.0804 => 0.0922, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 14.57% (5.5417 => 6.3494, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 14.31% (0.2691 => 0.3076, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 14.27% (0.2075 => 0.2371, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 14.22% (4.6177 => 5.2743, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.18% (0.2737 => 0.3125, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.17% (0.2068 => 0.2361, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 13.75% (2.1013 => 2.3902, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.63% (0.2040 => 0.2318, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 13.38% (0.3498 => 0.3966, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.38% (0.1383 => 0.1568, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.81% (0.3084 => 0.3479, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.57% (0.5361 => 0.6035, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 12.51% (0.6634 => 0.7464, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.17% (0.2103 => 0.2359, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 12.17% (0.3336 => 0.3742, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 12.07% (0.4847 => 0.5432, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.39% (0.7426 => 0.8272, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.01% (11.6398 => 12.9214, std.dev.: 0.0211) MultiSource/Applications/lemon/lemon: 10.71% (0.2391 => 0.2647, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 10.39% (2.0346 => 2.2460, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.13% (4.6926 => 5.1678, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.47% (0.5584 => 0.6113, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 8.67% (11.9555 => 12.9915, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.96% (0.3792 => 0.4018, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5304, std.dev.: 0.0079) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0292) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0300, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.18% (0.3693 => 0.4069, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 9.35% (0.2802 => 0.3064, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6118, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6799, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2413, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/ary: 5.09% (0.2122 => 0.2230, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8919, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6857, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2100, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3025, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2871, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0789, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.17% (3.1722 => 3.2092, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5399, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5998, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4759, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5446, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.34% (17.2379 => 14.2497, std.dev.: 0.0658) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9789, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7949, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.33% (0.2402 => 0.2250, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2199, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8062, std.dev.: 0.0072) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1110, std.dev.: 0.0534) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.94% (0.6293 => 0.6171, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5716, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0966, std.dev.: 0.1046) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0482, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 07:32:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 09:32:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125153252.53DCC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7937?compare_to=7933&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7937, Order: 173439, Start Time: 2013-01-25 13:22:06, End Time: 2013-01-25 15:33:09 To: 7933, Order: 173436, Start Time: 2013-01-25 10:40:22, End Time: 2013-01-25 12:51:46 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (220 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0666 => 0.0666, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8321 => 499.7393, std.dev.: 0.0498) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44214.92% (1.1277 => 499.7393, std.dev.: 0.0498) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.28% (0.5229 => 1.6486, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: 21.00% (14.9895 => 18.1377, std.dev.: 0.0204) MultiSource/Applications/kimwitu++/kc: 44.58% (14.1553 => 20.4655, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/gs/gs: 18.27% (4.1105 => 4.8614, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.94% (1.1048 => 1.7339, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.43% (7.1582 => 37.5401, std.dev.: 0.0196) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.45% (3.4629 => 6.4567, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.70% (0.6222 => 1.0932, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.22% (0.0720 => 7.4392, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3833000.00% (0.0001 => 3.8331, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 11157800.00% (0.0001 => 11.1579, std.dev.: 0.0250) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574600.00% (0.0001 => 0.5747, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487700.00% (0.0001 => 5.4878, std.dev.: 0.0230) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 814.36% (1.1194 => 10.2354, std.dev.: 0.0125) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 148.51% (22.1758 => 55.1092, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.77% (0.1463 => 0.2513, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.75% (2.9384 => 4.6354, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.21% (7.0540 => 10.8778, std.dev.: 0.0024) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.17% (1.5859 => 2.4133, std.dev.: 0.0156) MultiSource/Benchmarks/FreeBench/distray/distray: 48.48% (0.1056 => 0.1568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.09% (8.1363 => 11.9680, std.dev.: 0.0064) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.44% (2.2024 => 3.1371, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 39.76% (0.3109 => 0.4345, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.13% (21.9371 => 30.5200, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.49% (4.2646 => 5.6929, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.83% (0.4615 => 0.6130, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.65% (1.5415 => 2.0448, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.60% (0.2271 => 0.2966, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 29.78% (1.1642 => 1.5109, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 29.73% (0.4299 => 0.5577, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.33% (0.5105 => 0.6551, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.18% (0.0479 => 0.0614, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.39% (0.6675 => 0.8503, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.30% (0.1143 => 0.1455, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.96% (0.1584 => 0.2011, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.85% (0.1892 => 0.2400, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.49% (0.1125 => 0.1423, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 26.45% (9.4845 => 11.9934, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 26.39% (0.2554 => 0.3228, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.10% (3.8922 => 4.9082, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.07% (0.0730 => 0.0913, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 24.71% (0.4289 => 0.5349, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 24.70% (1.0722 => 1.3370, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.45% (0.3121 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.38% (1.4186 => 1.7644, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.07% (0.1695 => 0.2103, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.86% (0.1337 => 0.1656, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 23.59% (0.4620 => 0.5710, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.68% (0.7115 => 0.8729, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 22.25% (0.1555 => 0.1901, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.2700 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 22.01% (0.0527 => 0.0643, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.88% (0.0626 => 0.0763) SingleSource/UnitTests/ObjC/messages-2: 21.75% (0.0662 => 0.0806, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.68% (0.1236 => 0.1504, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.63% (0.0675 => 0.0821, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 21.37% (5.7591 => 6.9898, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.93% (1.3050 => 1.5781, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 20.91% (0.6456 => 0.7806, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.88% (0.0953 => 0.1152, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.86% (0.7835 => 0.9469, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 20.85% (0.3098 => 0.3744, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.45% (0.1032 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.29% (0.1163 => 0.1399, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.00% (0.5860 => 0.7032, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.86% (4.9449 => 5.9272, std.dev.: 0.0117) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.54% (0.8172 => 0.9769, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.21% (5.0018 => 5.9628, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.15% (3.3354 => 3.9741, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.10% (0.5020 => 0.5979, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.84% (0.3307 => 0.3930, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.49% (0.7433 => 0.8807, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.42% (0.2758 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.15% (0.9765 => 1.1537, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.11% (0.0834 => 0.0985, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.99% (0.5569 => 0.6571, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.88% (3.8723 => 4.5645, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 17.74% (1.1840 => 1.3940, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 17.63% (2.0273 => 2.3848, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/18-imp/imp: 17.62% (0.3423 => 0.4026, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.49% (1.1861 => 1.3936, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.34% (0.5981 => 0.7018, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.19% (0.2065 => 0.2420, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.98% (2.2969 => 2.6870, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.56% (0.3441 => 0.4011, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.54% (0.8101 => 0.9441, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.39% (0.6450 => 0.7507, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 16.20% (0.3283 => 0.3815, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.96% (0.2049 => 0.2376, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.77% (0.0704 => 0.0815) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318) MultiSource/Benchmarks/Prolangs-C/football/football: 15.19% (0.8921 => 1.0276, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.65% (0.8067 => 0.9249, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 14.00% (0.3379 => 0.3852, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.76% (0.3865 => 0.4397, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.74% (0.4636 => 0.5273, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 13.10% (0.3282 => 0.3712, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.01% (1.5603 => 1.7633, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.70% (0.4103 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.47% (0.4203 => 0.4727, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.20% (0.4048 => 0.4542, std.dev.: 0.0082) MultiSource/Applications/sqlite3/sqlite3: 12.04% (17.1811 => 19.2501, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.3603 => 0.4031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 11.84% (0.3422 => 0.3827, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.75% (0.1268 => 0.1417, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 11.64% (0.3684 => 0.4113, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 11.61% (0.3927 => 0.4383, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.61% (0.3092 => 0.3451, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.50% (0.3826 => 0.4266, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/property: 11.40% (0.3886 => 0.4329, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.68% (0.1114 => 0.1233, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.68% (0.4064 => 0.4498, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.60% (14.3668 => 15.8892, std.dev.: 0.0107) SingleSource/UnitTests/ObjC/exceptions: 10.55% (0.3828 => 0.4232, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.08% (0.3543 => 0.3900, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.04% (0.3694 => 0.4065, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.02% (0.3543 => 0.3898) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 9.93% (0.3516 => 0.3865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.87% (0.3497 => 0.3842, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 9.68% (0.2831 => 0.3105, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.17% (2.0665 => 2.2559, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 8.99% (0.2871 => 0.3129, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.92% (0.1625 => 0.1770, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/methcall: 8.86% (0.2877 => 0.3132, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 8.79% (1.2842 => 1.3971, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.60% (0.3650 => 0.3964, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.57% (0.2905 => 0.3154, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.51% (0.2891 => 0.3137, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.50% (63.2438 => 68.6165, std.dev.: 0.0176) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.48% (0.3162 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 8.26% (0.2725 => 0.2950, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.20% (0.2756 => 0.2982, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wc: 8.13% (0.3052 => 0.3300, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.11% (0.3935 => 0.4254, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.08% (0.2872 => 0.3104, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 8.07% (0.2802 => 0.3028, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.91% (0.2793 => 0.3014, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.90% (2.2022 => 2.3761, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 7.89% (0.2714 => 0.2928, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.74% (0.6030 => 0.6497, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.65% (0.3136 => 0.3376, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: 7.62% (0.7326 => 0.7884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.38% (0.5925 => 0.6362, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.44% (0.4879 => 0.5193, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 4.62% (10.3673 => 10.8461, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/objinst: 3.58% (0.3131 => 0.3243, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.70% (0.3817 => 0.3920, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.65% (7.9617 => 8.1729, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8963, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4735, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.91% (1.1145 => 1.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.14% (1.1396 => 1.2438, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3857, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.27% (4.2280 => 4.4507, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (3.1578 => 3.3094, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.38% (0.9957 => 1.0294, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9055, std.dev.: 0.0168) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7109, std.dev.: 0.0113) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2828, std.dev.: 0.0502) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3034, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5765, std.dev.: 0.0073) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1706, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.32% (0.8651 => 0.2135, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.16% (0.1622 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.93% (5.3855 => 4.4738, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.32% (5.3526 => 4.4790, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: -13.21% (10.4361 => 9.0576, std.dev.: 0.0152) SingleSource/UnitTests/Vector/constpool: -7.89% (54.1659 => 49.8936, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.62% (1.7609 => 1.6267, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.81% (1.9577 => 0.6693, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3064, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.31% (1.5373 => 1.0252, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4127, std.dev.: 0.0034) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8505, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0043, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4255, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -12.97% (3.1443 => 2.7366, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.18% (0.9540 => 0.8569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7051, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5766, std.dev.: 0.0513) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: -5.58% (1.2373 => 1.1682, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7038, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.01% (1.5835 => 1.5041, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8328, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0079) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5787, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7221 => 3.6720, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2311, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0009) Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 08:53:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 10:53:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125165341.718672A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7938?compare_to=7935&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7938, Order: 173446, Start Time: 2013-01-25 15:19:52, End Time: 2013-01-25 16:53:58 To: 7935, Order: 173439, Start Time: 2013-01-25 12:46:15, End Time: 2013-01-25 14:19:53 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (98 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 4.41% (0.3717 => 0.3881, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 74.71% (0.0514 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.75% (0.6395 => 0.8809, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.61% (0.5688 => 0.7543, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.49% (0.5805 => 0.7691, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.33% (0.5456 => 0.7220, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.27% (0.6260 => 0.8280, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.06% (0.5567 => 0.7352, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.04% (0.5849 => 0.7723, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.85% (0.6395 => 0.8432, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.80% (0.5575 => 0.7348, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.71% (0.5581 => 0.7351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.14% (0.5859 => 0.7625, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.02% (0.6033 => 0.7844, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.61% (0.0699 => 0.0906, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.57% (0.6440 => 0.8344, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.92% (0.6189 => 0.7979, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.87% (1.6474 => 2.1230, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.14% (0.6304 => 0.8078, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.67% (0.6230 => 0.7954, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.76% (0.6660 => 0.8442, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.75% (0.5802 => 0.7354, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.13% (0.5705 => 0.7196, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.08% (0.5925 => 0.7470, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.88% (0.5857 => 0.7373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.85% (0.5570 => 0.7010, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.76% (0.5478 => 0.6889, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.64% (0.5569 => 0.6997, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.57% (0.0790 => 0.0992, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.95% (0.5591 => 0.6986, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.36% (0.5863 => 0.7291, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.08% (0.6446 => 0.7998, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.95% (0.7524 => 0.9326, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.88% (0.6052 => 0.7497, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.20% (0.6681 => 0.8231, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.86% (0.6194 => 0.7610, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.73% (0.6297 => 0.7728, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.96% (2.2587 => 2.7546, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.27% (0.6667 => 0.8085, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (0.7339 => 0.8777, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.34% (0.3357 => 0.3872, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 14.76% (1.1450 => 1.3140, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (4.5069 => 5.0659, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.12% (0.4916 => 0.5512, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 12.09% (0.4515 => 0.5061, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.70% (3.5339 => 3.9472, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.61% (1.6364 => 1.8264, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.25% (0.1982 => 0.2205, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.57% (9.2283 => 10.1111, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 8.62% (0.4524 => 0.4914, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5329 => 0.5772, std.dev.: 0.0088) MultiSource/Applications/Burg/burg: 8.17% (1.2515 => 1.3538, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1731 => 0.1870, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.71% (0.7021 => 0.7562, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4861 => 0.5235, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.26% (1.4642 => 1.5705, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.87% (1.2784 => 1.3662, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.18% (0.3255 => 0.3456, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.07% (0.1879 => 0.1993, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3319 => 0.3488, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.48% (5.4682 => 5.7130, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 4.25% (0.6750 => 0.7037, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2006, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.96% (1.3864 => 1.4274, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.51% (0.8418 => 0.8629, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 2.48% (0.7447 => 0.7632, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.45% (0.9557 => 0.9791, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.08% (22.4056 => 22.8710, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5168 => 0.5273, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.03% (15.5079 => 15.8221, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.82% (1.3722 => 1.3972, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7930, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.75% (0.9531 => 1.0270, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 7.48% (0.5692 => 0.6118, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1646, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5620, std.dev.: 0.0477) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.0478 => 2.1074, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 1.92% (3.7435 => 3.8153, std.dev.: 0.0215) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.54% (18.2231 => 18.5036, std.dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2485, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4547, std.dev.: 0.0285) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.63% (0.7198 => 0.6865, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.08% (0.3821 => 0.3665, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.76% (0.3831 => 0.3687, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.73% (2.4924 => 2.3994, std.dev.: 0.0152) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.60% (0.3891 => 0.3751, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.56% (0.9852 => 0.9501, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.52% (0.4176 => 0.4029, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3896 => 0.3759, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.50% (0.4033 => 0.3892, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.17% (0.3884 => 0.3761, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.03% (0.6347 => 0.6155, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.91% (0.4199 => 0.4077, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.87% (0.7779 => 0.7556, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.69% (0.6441 => 0.6268, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.64% (0.4280 => 0.4167, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.64% (0.6484 => 0.6313, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.9542 => 0.9291, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.57% (20.7746 => 20.2401, std.dev.: 0.0334) MultiSource/Applications/hexxagon/hexxagon: -2.44% (1.3148 => 1.2827, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.39% (2.1713 => 2.1195, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9092, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -1.88% (17.1032 => 16.7824, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.62% (6.7716 => 6.6620, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.53% (0.7919 => 0.7798, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.50% (16.1920 => 15.9498, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.38% (1.0544 => 1.0399, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: -1.36% (4.3330 => 4.2739, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.32% (1.2210 => 1.2049, std.dev.: 0.0048) MultiSource/Applications/JM/ldecod/ldecod: -1.31% (7.0961 => 7.0032, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.24% (1.2221 => 1.2070, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: -1.09% (0.9179 => 0.9079, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: -1.03% (1.5610 => 1.5449, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.27% (1.8100 => 0.7011, std.dev.: 0.0188) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3144, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.67% (1.3643 => 1.0277, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7472, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0820, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1989, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0918, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3538, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.49% (0.5142 => 0.4654, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8193, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1795, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7612, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.11% (1.3096 => 1.2820, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6475, std.dev.: 0.0157) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3040 => 7.1775, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.66% (6.5735 => 6.4644, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.18% (1.6086 => 1.5896, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 09:19:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 11:19:19 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125171919.E06702A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7939?compare_to=7934&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7939, Order: 173446, Start Time: 2013-01-25 15:16:53, End Time: 2013-01-25 17:19:38 To: 7934, Order: 173439, Start Time: 2013-01-25 12:18:32, End Time: 2013-01-25 14:15:42 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (6 on baseline) Performance Improvements: 0 (45 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1058 (1012 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/ffbench: 15.89% (0.0686 => 0.0795, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 14.54% (5.3634 => 6.1431, std.dev.: 0.2089) SingleSource/Benchmarks/Shootout-C++/lists1: 2.33% (0.6019 => 0.6159, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 2.31% (1.9128 => 1.9570, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/mandel: 1.41% (1.0460 => 1.0608, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: 1.11% (14.6993 => 14.8625, std.dev.: 0.0421) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.12% (1.1235 => 1.1222, std.dev.: 0.0714) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.79% (0.0145 => 0.0223, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0432 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0337 => 0.0336, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0320 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.17% (0.0428 => 0.0433, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0206 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 25.68% (0.0183 => 0.0230, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.40% (0.1496 => 0.1490, std.dev.: 0.0240) MultiSource/Applications/lemon/lemon: -1.89% (1.1488 => 1.1271, std.dev.: 0.3043) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.69% (0.4122 => 0.3970, std.dev.: 0.1541) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.80% (0.1431 => 0.1514, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.92% (0.0976 => 0.0967, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 44.09% (0.0186 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.91% (0.0588 => 0.0565, std.dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.43% (1.1837 => 1.1786, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 53.85% (0.0013 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.69% (0.0026 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.92% (0.0587 => 0.0610, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 21.28% (0.0235 => 0.0285, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.12% (0.7334 => 0.7416, std.dev.: 0.0093) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.00% (0.0100 => 0.0123, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7734 => 12.7683, std.dev.: 0.0477) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320912.50% (0.0008 => 2.5681, std.dev.: 0.0178) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 100.86% (1.1825 => 2.3752, std.dev.: 0.0432) SingleSource/Regression/C/uint64_to_float: 27.10% (1.5397 => 1.9570, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.63% (5.6033 => 6.1431, std.dev.: 0.2089) SingleSource/Benchmarks/Misc/pi: 3.30% (2.1390 => 2.2096, std.dev.: 0.0037) MultiSource/Applications/JM/lencod/lencod: 3.18% (6.8159 => 7.0328, std.dev.: 0.0571) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0017) SingleSource/Benchmarks/SmallPT/smallpt: -25.26% (0.1888 => 0.1411, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.72% (0.1009 => 0.0810, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.17% (0.0862 => 0.0714, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.77% (0.1079 => 0.0898, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.32% (0.7686 => 0.6432, std.dev.: 0.0279) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.26% (1.0960 => 0.9287, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.07% (1.0986 => 0.9440, std.dev.: 0.0300) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.86% (0.4074 => 0.3550, std.dev.: 0.0123) MultiSource/Applications/Burg/burg: -10.92% (1.5979 => 1.4234, std.dev.: 0.0364) MultiSource/Applications/treecc/treecc: -10.50% (2.4719 => 2.2124, std.dev.: 0.0505) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -10.27% (1.5131 => 1.3577, std.dev.: 0.0278) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -9.42% (0.1317 => 0.1193, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.31% (10.2703 => 9.3146, std.dev.: 0.1955) SingleSource/UnitTests/Vector/constpool: -8.96% (9.8875 => 9.0014, std.dev.: 0.2612) MultiSource/Applications/d/make_dparser: -6.90% (3.7840 => 3.5228, std.dev.: 0.0932) SingleSource/Benchmarks/Shootout-C++/moments: -6.32% (0.4002 => 0.3749, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.09% (0.2709 => 0.2544, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: -5.32% (0.2385 => 0.2258, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.85% (0.3462 => 0.3294, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.72% (0.3665 => 0.3492, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.48% (0.9588 => 0.9158, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.16% (4.6579 => 4.4639, std.dev.: 0.0750) SingleSource/Benchmarks/Shootout-C++/hash2: -4.09% (0.5134 => 0.4924, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: -4.08% (0.2551 => 0.2447, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.77% (1.3220 => 1.2722, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.89% (0.9214 => 0.9040, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -31.20% (0.9372 => 0.6448, std.dev.: 0.1111) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.70% (16.6791 => 13.5604, std.dev.: 0.1895) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.47% (2.8778 => 2.3464, std.dev.: 0.1750) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.18% (0.1164 => 0.0999, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/treeadd/treeadd: -11.20% (0.4081 => 0.3624, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout/hash: -10.36% (4.5259 => 4.0571, std.dev.: 0.1337) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.81% (1.4588 => 1.3157, std.dev.: 0.0168) MultiSource/Applications/SIBsim4/SIBsim4: -7.96% (3.5443 => 3.2621, std.dev.: 0.0860) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.40% (0.3217 => 0.2979, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: -7.08% (0.6628 => 0.6159, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.09% (0.3201 => 0.3038, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.60% (23.3986 => 22.3212, std.dev.: 0.3099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.03% (1.4446 => 1.3864, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: -3.21% (17.2182 => 16.6649, std.dev.: 0.0856) MultiSource/Benchmarks/mafft/pairlocalalign: -2.91% (63.1520 => 61.3158, std.dev.: 0.4307) SingleSource/Benchmarks/Misc/mandel-2: -1.95% (0.8521 => 0.8355, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: -1.10% (5.7021 => 5.6392, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout/matrix: -1.09% (1.5825 => 1.5652, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.85% (1.2047 => 1.1222, std.dev.: 0.0714) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0000) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1530 => 0.1490, std.dev.: 0.0240) MultiSource/Applications/lemon/lemon: -41.58% (1.9293 => 1.1271, std.dev.: 0.3043) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.95% (0.4049 => 0.3970, std.dev.: 0.1541) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.26% (0.1510 => 0.1514, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.12% (0.0978 => 0.0967, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.90% (0.0276 => 0.0268, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.24% (0.0590 => 0.0565, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.45% (1.1617 => 1.1786, std.dev.: 0.0089) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -11.11% (0.0027 => 0.0024, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.28% (0.7437 => 0.7416, std.dev.: 0.0093) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.08% (12.7781 => 12.7683, std.dev.: 0.0477) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 10:14:09 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 12:14:09 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125181409.0BB072A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7940?compare_to=7937&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7940, Order: 173448, Start Time: 2013-01-25 16:03:31, End Time: 2013-01-25 18:14:25 To: 7937, Order: 173439, Start Time: 2013-01-25 13:22:06, End Time: 2013-01-25 15:33:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.36% (10.8461 => 11.2105, std.dev.: 0.0096) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0666 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7393 => 499.8363, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.52% (1.1277 => 499.8363, std.dev.: 0.0113) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.80% (0.5229 => 1.6513, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 20.85% (14.9895 => 18.1142, std.dev.: 0.0130) MultiSource/Applications/kimwitu++/kc: 43.92% (14.1553 => 20.3716, std.dev.: 0.0121) MultiSource/Benchmarks/MallocBench/gs/gs: 17.78% (4.1105 => 4.8414, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.74% (1.1048 => 1.7317, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.47% (7.1582 => 37.4711, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.92% (3.4629 => 6.4381, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.81% (0.6222 => 1.0939, std.dev.: 0.0033) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.86% (0.0720 => 7.4411, std.dev.: 0.0034) MultiSource/Applications/SIBsim4/SIBsim4: 3833100.00% (0.0001 => 3.8332, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11183900.00% (0.0001 => 11.1840, std.dev.: 0.0147) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574700.00% (0.0001 => 0.5748, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850400.00% (0.0001 => 9.8505, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484700.00% (0.0001 => 5.4848, std.dev.: 0.0016) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.43% (1.1194 => 10.2585, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.61% (22.1758 => 55.1323, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/lowercase: 121.88% (0.0256 => 0.0568, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 65.07% (0.0730 => 0.1205, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.83% (2.9384 => 4.6378, std.dev.: 0.0009) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.54% (7.0540 => 10.8305, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.54% (1.5859 => 2.4033, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.15% (8.1363 => 11.9722, std.dev.: 0.0048) SingleSource/UnitTests/vla: 43.10% (0.0355 => 0.0508, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.90% (2.2024 => 3.1251, std.dev.: 0.0064) MultiSource/Applications/JM/lencod/lencod: 39.76% (21.9371 => 30.6585, std.dev.: 0.0180) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.48% (4.2646 => 5.6926, std.dev.: 0.0131) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.55% (0.4615 => 0.6117, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.48% (1.5415 => 2.0422, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.68% (0.4299 => 0.5575, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 29.51% (1.1642 => 1.5078, std.dev.: 0.0024) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.82% (0.5105 => 0.6525, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.39% (0.6675 => 0.8503, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.38% (0.1892 => 0.2410, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.93% (0.0479 => 0.0608, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.54% (0.0746 => 0.0944, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 26.44% (9.4845 => 11.9925, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.98% (0.0793 => 0.0999) MultiSource/Benchmarks/McCat/08-main/main: 25.96% (0.2554 => 0.3217, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.77% (3.8922 => 4.8953, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 25.32% (0.1655 => 0.2074, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 24.49% (1.0722 => 1.3348, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.48% (0.4289 => 0.5339, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.45% (0.1906 => 0.2372, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.41% (0.1143 => 0.1422, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.38% (0.1337 => 0.1663, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.19% (0.3121 => 0.3876, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.12% (1.4186 => 1.7608, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.94% (0.4620 => 0.5726, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.42% (0.1695 => 0.2092, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.74% (0.0730 => 0.0896, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.66% (0.7115 => 0.8727, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820) MultiSource/Applications/viterbi/viterbi: 21.99% (0.1555 => 0.1897, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.74% (0.2700 => 0.3287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.30% (0.3098 => 0.3758, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.25% (0.0527 => 0.0639) MultiSource/Applications/oggenc/oggenc: 21.23% (5.7591 => 6.9820, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.20% (0.1236 => 0.1498, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 20.92% (0.7835 => 0.9474, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.88% (0.0953 => 0.1152, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.85% (1.3050 => 1.5771, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 20.77% (0.6456 => 0.7797, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.26% (0.0834 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.98% (0.0871 => 0.1045, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.85% (4.9449 => 5.9267, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.81% (0.5860 => 0.7021, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.63% (0.8172 => 0.9776, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.43% (0.1940 => 0.2317, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.04% (3.3354 => 3.9705, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.04% (5.0018 => 5.9542, std.dev.: 0.0136) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.69% (0.3307 => 0.3925, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.18% (0.0770 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.09% (0.2758 => 0.3257, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.99% (0.1117 => 0.1318, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 17.99% (0.7433 => 0.8770, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.92% (0.5569 => 0.6567, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.80% (1.1840 => 1.3948, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.78% (0.9765 => 1.1501, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 17.47% (3.8723 => 4.5488, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 17.44% (0.3423 => 0.4020, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.30% (1.1861 => 1.3913, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 17.29% (2.0273 => 2.3779, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.05% (0.2065 => 0.2417, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.02% (0.5981 => 0.6999, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.60% (0.3283 => 0.3828, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.59% (0.3441 => 0.4012, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 16.50% (2.2969 => 2.6759, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.45% (0.8101 => 0.9434, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 16.15% (0.3232 => 0.3754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 16.01% (0.2049 => 0.2377, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.97% (0.6450 => 0.7480, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.91% (0.0704 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.90% (0.1044 => 0.1210, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.44% (0.3180 => 0.3671, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.16% (0.8921 => 1.0273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.40% (0.8067 => 0.9229, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 14.32% (0.3379 => 0.3863, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.97% (0.3865 => 0.4405, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.57% (0.4636 => 0.5265, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 12.94% (1.5603 => 1.7622, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.70% (0.4103 => 0.4624, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.61% (0.4203 => 0.4733, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 12.30% (0.4048 => 0.4546, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.10% (0.3603 => 0.4039, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 12.07% (0.3422 => 0.3835, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 12.07% (0.3282 => 0.3678, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 11.90% (17.1811 => 19.2265, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/lists1: 11.86% (0.3684 => 0.4121, std.dev.: 0.0086) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.69% (0.2430 => 0.2714, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 11.54% (0.3927 => 0.4380, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 11.29% (0.3092 => 0.3441, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.11% (0.3826 => 0.4251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.09% (0.3886 => 0.4317, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.91% (0.3427 => 0.3801, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.80% (0.4064 => 0.4503, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.80% (14.3668 => 15.9185, std.dev.: 0.0191) SingleSource/UnitTests/ObjC/exceptions: 10.66% (0.3828 => 0.4236, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 10.24% (0.3497 => 0.3855, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.16% (0.3543 => 0.3903, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.11% (0.3473 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.10% (0.3543 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.08% (0.3561 => 0.3920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.07% (0.2831 => 0.3116, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.69% (0.1114 => 0.1222, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.62% (2.0665 => 2.2654, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 9.58% (0.2871 => 0.3146, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.28% (0.2877 => 0.3144, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.23% (0.3650 => 0.3987, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.13% (1.2842 => 1.4015, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.82% (0.3162 => 0.3441, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.82% (0.2891 => 0.3146, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 8.81% (0.2905 => 0.3161, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 8.64% (63.2438 => 68.7098, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.64% (0.2756 => 0.2994, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.58% (0.3052 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2802 => 0.3041, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 8.40% (0.2725 => 0.2954, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2872 => 0.3113, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.2793 => 0.3026, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.14% (0.2714 => 0.2935, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 8.13% (10.3673 => 11.2105, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.04% (0.3136 => 0.3388, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 7.93% (0.6030 => 0.6508, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.89% (2.2022 => 2.3759, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 7.64% (0.7326 => 0.7886, std.dev.: 0.0018) SingleSource/UnitTests/ObjC++/Hello: 7.32% (0.5925 => 0.6359, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.14% (0.3177 => 0.3372, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (7.9617 => 8.1574, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4729, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.90% (1.1145 => 1.2917, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.07% (1.1396 => 1.2430, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3861, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (4.2280 => 4.4570, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3117, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.50% (0.3316 => 0.3432, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.36% (0.9957 => 1.0292, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.72% (8.6802 => 8.9162, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (3.6395 => 3.7160, std.dev.: 0.0104) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2811, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3061, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3460 => 10.4615, std.dev.: 0.0124) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5799, std.dev.: 0.0035) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1692, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.72% (5.2763 => 1.1758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.33% (0.8651 => 0.2134, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.18% (5.3855 => 4.4603, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.58% (5.3526 => 4.4650, std.dev.: 0.0045) MultiSource/Applications/JM/ldecod/ldecod: -13.14% (10.4361 => 9.0646, std.dev.: 0.0165) SingleSource/UnitTests/Vector/constpool: -7.95% (54.1659 => 49.8606, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.71% (1.7609 => 1.6251, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.06% (1.9577 => 0.6645, std.dev.: 0.0081) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.73% (0.6962 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3071, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.77% (1.5373 => 1.0181, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4198, std.dev.: 0.0072) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8463, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0083, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.93% (2.6778 => 2.0905, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.95% (1.6925 => 1.4225, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4947, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.93% (19.9488 => 18.5668, std.dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.97% (1.2373 => 1.1634, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7017, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -4.47% (10.2830 => 9.8229, std.dev.: 0.0117) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.47% (0.4808 => 0.4593, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0082) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.72% (3.6994 => 3.6357, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.6441 => 4.5803, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7221 => 3.6761, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0141) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0000) Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 10:51:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 12:51:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125185104.909AD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7941?compare_to=7938&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7941, Order: 173458, Start Time: 2013-01-25 17:17:35, End Time: 2013-01-25 18:51:21 To: 7938, Order: 173446, Start Time: 2013-01-25 15:19:52, End Time: 2013-01-25 16:53:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (92 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 75.29% (0.0514 => 0.0901, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.57% (0.0717 => 0.1223, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.90% (0.6395 => 0.8819, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 33.76% (0.0699 => 0.0935, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.66% (0.5805 => 0.7701, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.42% (0.5456 => 0.7225, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.40% (0.5688 => 0.7531, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.32% (0.6260 => 0.8283, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.02% (0.5849 => 0.7722, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.79% (0.5567 => 0.7337, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.70% (0.5575 => 0.7342, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.60% (0.6395 => 0.8416, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.67% (0.5941 => 0.7763, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.04% (0.5859 => 0.7619, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.94% (0.6033 => 0.7839, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.24% (0.6440 => 0.8323, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.95% (1.6474 => 2.1244, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.70% (0.6189 => 0.7965, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.86% (0.6304 => 0.8060, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.43% (0.6230 => 0.7939, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.77% (0.6660 => 0.8443, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.47% (0.5802 => 0.7338, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.14% (0.5925 => 0.7474, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.13% (0.5705 => 0.7196, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 25.95% (0.0790 => 0.0995, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.79% (0.5569 => 0.7005, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.59% (0.5857 => 0.7356, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.58% (0.5478 => 0.6879, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.44% (0.5570 => 0.6987, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.84% (0.5591 => 0.6980, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.7524 => 0.9335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.02% (0.5863 => 0.7271, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.96% (0.6052 => 0.7502, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.78% (0.6446 => 0.7979, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.13% (0.6681 => 0.8226, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.80% (0.6194 => 0.7606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.69% (0.6297 => 0.7726, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.85% (2.2587 => 2.7523, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.18% (0.6667 => 0.8079, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.54% (0.7339 => 0.8773, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.36% (0.0621 => 0.0735) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.22% (0.3357 => 0.3868, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3160, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.82% (0.0731 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.63% (4.5069 => 5.0762, std.dev.: 0.0105) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.45% (0.4916 => 0.5528, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.31% (0.4515 => 0.5071, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.72% (1.6364 => 1.8282, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (3.5339 => 3.9422, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.22% (0.1230 => 0.1368, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 9.83% (9.2283 => 10.1357, std.dev.: 0.0065) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 8.53% (1.2515 => 1.3582, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/hash: 8.38% (0.4524 => 0.4903, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.28% (0.5329 => 0.5770) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.15% (0.1731 => 0.1872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.4642 => 1.5750, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.53% (0.7021 => 0.7550, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.53% (0.4861 => 0.5227, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.04% (1.2784 => 1.3684, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.24% (0.3255 => 0.3458, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3319 => 0.3498, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.47% (5.4682 => 5.7128, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++/bigfib: 4.18% (0.6750 => 0.7032, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.59% (5.0226 => 5.2030, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 3.14% (0.8418 => 0.8682, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.02% (1.3864 => 1.4283, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 2.98% (0.3394 => 0.3495, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.47% (0.7447 => 0.7631, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 2.30% (15.5079 => 15.8641, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.28% (0.9557 => 0.9775, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.18% (22.4056 => 22.8934, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5168 => 0.5279, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.3722 => 1.3999, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.59% (0.6293 => 0.6393, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 1.20% (18.2933 => 18.5127, std.dev.: 0.0127) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7938, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0034) SingleSource/Regression/C/uint64_to_float: 7.45% (0.5692 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1653, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.5751 => 56.6843, std.dev.: 0.0500) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5126, std.dev.: 0.0183) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2461, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2701, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.94% (0.1281 => 0.1128, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.86% (0.7198 => 0.6848, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.03% (0.3821 => 0.3667, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.75% (0.3837 => 0.3693, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.53% (2.4924 => 2.4044, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.48% (0.9852 => 0.9509, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.21% (0.3142 => 0.3041, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.10% (0.3323 => 0.3220, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.10% (0.3812 => 0.3694) SingleSource/UnitTests/ObjC/exceptions-3: -3.09% (0.3848 => 0.3729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.07% (0.4033 => 0.3909, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.03% (0.3896 => 0.3778, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.03% (0.3831 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.02% (0.3880 => 0.3763, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.01% (0.3891 => 0.3774, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -3.00% (0.7779 => 0.7546, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.85% (0.4176 => 0.4057, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.71% (0.9542 => 0.9283, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.69% (20.7746 => 20.2168, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.67% (2.1713 => 2.1133, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -2.49% (1.3148 => 1.2821, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.17% (0.6484 => 0.6343, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (14.2083 => 13.9303, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -1.88% (17.1032 => 16.7816, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: -1.32% (16.1920 => 15.9785, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (6.7716 => 6.6845, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.10% (1.2221 => 1.2087, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (1.2210 => 1.2079, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.01% (1.0544 => 1.0437, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.02% (1.8100 => 0.6875, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.91% (8.0445 => 5.3163, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -24.88% (1.3643 => 1.0248, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7543, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0729, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.71% (2.9703 => 2.3253, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1333, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0926, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3543, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.35% (7.9763 => 7.7889, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.24% (3.1919 => 3.1203, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3040 => 7.1769, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4676, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5898, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6049, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6709, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 10:54:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 12:54:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125185429.340932A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7942?compare_to=7936&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7942, Order: 173439, Start Time: 2013-01-25 15:19:44, End Time: 2013-01-25 18:54:44 To: 7936, Order: 173435, Start Time: 2013-01-25 10:52:30, End Time: 2013-01-25 14:27:31 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.85% (0.6700 => 0.6891, std.dev.: 0.0008) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 51.84% (0.0625 => 0.0949, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.54% (0.1063 => 0.1462, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.93% (0.1106 => 0.1437, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.97% (0.2969 => 0.3829, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.27% (0.4139 => 0.5309, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.14% (0.4253 => 0.5450, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.79% (0.0547 => 0.0699, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.56% (0.5900 => 0.7526, std.dev.: 0.0163) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.95% (0.0475 => 0.0603, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.41% (0.4994 => 0.6313, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 25.78% (1.5932 => 2.0040, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 25.63% (0.0714 => 0.0897, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.32% (0.5000 => 0.6266, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.07% (0.1021 => 0.1277, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.94% (0.1620 => 0.2024, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.78% (0.3903 => 0.4870, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.75% (0.0897 => 0.1119, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.14% (0.1549 => 0.1923, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.49% (0.1107 => 0.1367, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.13% (0.1003 => 0.1235, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.11% (0.0541 => 0.0666, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.07% (0.1604 => 0.1974, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 22.85% (0.0604 => 0.0742, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.75% (0.0822 => 0.1009, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 22.54% (0.1619 => 0.1984, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 22.53% (0.0821 => 0.1006, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.35% (0.0452 => 0.0553, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.82% (0.2736 => 0.3333, std.dev.: 0.0063) MultiSource/Applications/viterbi/viterbi: 21.75% (0.0947 => 0.1153, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.65% (0.0462 => 0.0562, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.45% (1.3152 => 1.5973, std.dev.: 0.0122) MultiSource/Applications/aha/aha: 21.41% (0.0481 => 0.0584, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.14% (0.1088 => 0.1318, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.07% (0.1462 => 0.1770, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.94% (0.3271 => 0.3956, std.dev.: 0.0086) MultiSource/Benchmarks/McCat/08-main/main: 20.94% (0.1218 => 0.1473, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 20.92% (0.0808 => 0.0977, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.90% (0.2014 => 0.2435, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.77% (0.0698 => 0.0843, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.59% (0.3890 => 0.4691, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 20.58% (0.4029 => 0.4858, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: 20.55% (0.5826 => 0.7023, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 20.27% (0.1505 => 0.1810, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: 20.17% (0.5889 => 0.7077, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.92% (0.2866 => 0.3437, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.72% (0.2875 => 0.3442, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.69% (0.0513 => 0.0614, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 19.67% (0.2811 => 0.3364, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 19.64% (0.5546 => 0.6635, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.59% (0.2792 => 0.3339, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 19.53% (0.2750 => 0.3287, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 19.48% (0.9697 => 1.1586, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/gs/gs: 19.45% (1.8794 => 2.2449, std.dev.: 0.0086) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 19.24% (0.2780 => 0.3315, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 19.23% (0.2803 => 0.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 19.23% (0.2725 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.20% (0.2911 => 0.3470, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 19.19% (0.7171 => 0.8547, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 19.16% (0.2823 => 0.3364, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 19.16% (0.2813 => 0.3352, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 19.12% (0.2714 => 0.3233, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.10% (3.5627 => 4.2433, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.99% (0.2738 => 0.3258, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.97% (1.6211 => 1.9287, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.97% (2.0673 => 2.4594, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 18.91% (0.3004 => 0.3572, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.91% (0.2729 => 0.3245, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.90% (0.1968 => 0.2340, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.86% (0.3060 => 0.3637, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.85% (0.4658 => 0.5536, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/bh/bh: 18.85% (0.1284 => 0.1526, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 18.78% (0.9909 => 1.1770, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 18.67% (0.3267 => 0.3877, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.59% (0.3195 => 0.3789, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 18.57% (0.3096 => 0.3671, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 18.41% (23.5202 => 27.8491, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 18.29% (0.3258 => 0.3854, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.27% (0.5026 => 0.5944, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/18-imp/imp: 18.16% (0.1421 => 0.1679, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 18.15% (1.0781 => 1.2738, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 18.15% (0.3317 => 0.3919, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.02% (0.3930 => 0.4638, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.86% (0.4361 => 0.5140, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.77% (0.3124 => 0.3679, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.73% (0.3282 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.73% (1.9694 => 2.3185, std.dev.: 0.0345) SingleSource/Benchmarks/Shootout-C++/sieve: 17.71% (0.3726 => 0.4386, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.70% (0.3362 => 0.3957, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 17.44% (0.3348 => 0.3932, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 17.37% (0.3477 => 0.4081, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.35% (0.3625 => 0.4254, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/moments: 17.35% (0.3678 => 0.4316, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.26% (1.9966 => 2.3412, std.dev.: 0.0316) MultiSource/Applications/ClamAV/clamscan: 17.25% (4.2109 => 4.9373, std.dev.: 0.0215) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.13% (2.7292 => 3.1966, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.01% (0.3981 => 0.4658, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.99% (0.3690 => 0.4317, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.99% (4.4195 => 5.1702, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash: 16.93% (0.4146 => 0.4848, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 16.75% (0.4251 => 0.4963, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.68% (0.2566 => 0.2994, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.42% (0.1090 => 0.1269, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.28% (0.3845 => 0.4471, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 16.19% (1.4269 => 1.6579, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 15.68% (0.2691 => 0.3113, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 15.66% (0.5012 => 0.5797, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.60% (0.0673 => 0.0778) SingleSource/UnitTests/ObjC/exceptions-2: 15.55% (0.3446 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.44% (0.3465 => 0.4000, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.43% (0.3442 => 0.3973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.40% (0.3488 => 0.4025, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 15.39% (0.7875 => 0.9087, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/synchronized: 15.28% (0.3469 => 0.3999, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/for-in: 15.27% (0.3496 => 0.4030, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.12% (0.3650 => 0.4202, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 14.91% (0.3643 => 0.4186, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 14.88% (0.3724 => 0.4278, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.86% (0.6435 => 0.7391, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.69% (0.1028 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.64% (0.0758 => 0.0869, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 14.53% (4.6177 => 5.2887, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 14.52% (2.1653 => 2.4797, std.dev.: 0.0124) MultiSource/Applications/SPASS/SPASS: 14.52% (5.5417 => 6.3463, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C/football/football: 14.36% (0.2075 => 0.2373, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.26% (0.2068 => 0.2363, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.14% (0.2737 => 0.3124, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 13.71% (2.1013 => 2.3894, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.58% (0.2040 => 0.2317, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.23% (0.1383 => 0.1566, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.3498 => 0.3956, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.94% (0.3084 => 0.3483, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.37% (0.5361 => 0.6024, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 12.32% (0.3336 => 0.3747, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.27% (0.2103 => 0.2361, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 12.24% (0.6634 => 0.7446, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 11.99% (0.4847 => 0.5428, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.28% (0.7426 => 0.8264, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.04% (11.6398 => 12.9251, std.dev.: 0.0187) MultiSource/Applications/lemon/lemon: 10.71% (0.2391 => 0.2647, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.53% (2.0346 => 2.2488, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.19% (4.6926 => 5.1709, std.dev.: 0.0158) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.58% (0.5584 => 0.6119, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 8.72% (11.9555 => 12.9978, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.85% (0.3792 => 0.4014, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5107, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.46% (0.5917 => 0.6891, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.24% (0.3693 => 0.4071, std.dev.: 0.0035) MultiSource/Applications/ClamAV/clamscan: 8.74% (0.2802 => 0.3047, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6100, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6730, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2373, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/flops-2: 4.71% (1.8057 => 1.8908, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6849, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5024, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 3.00% (0.6276 => 0.6464, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2070, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3072, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2071, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4797, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.47% (2.4764 => 2.4400, std.dev.: 0.0075) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5919, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/mandel-2: -20.89% (3.6262 => 2.8688, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -17.12% (17.2379 => 14.2875, std.dev.: 0.0563) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -7.73% (28.1477 => 25.9731, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8109, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -6.20% (0.2402 => 0.2253, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -4.82% (1.5554 => 1.4805, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -3.84% (14.0481 => 13.5083, std.dev.: 0.1909) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2182, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7986, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7723, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.19% (0.6293 => 0.6155, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2329, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5688, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1472, std.dev.: 0.0847) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0461, std.dev.: 0.0044) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 11:42:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 13:42:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125194254.41A122A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7943?compare_to=7939&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7943, Order: 173460, Start Time: 2013-01-25 17:39:38, End Time: 2013-01-25 19:43:12 To: 7939, Order: 173446, Start Time: 2013-01-25 15:16:53, End Time: 2013-01-25 17:19:38 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 19 (13 on baseline) Performance Improvements: 3 (33 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1042 (1017 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 15.34% (0.1147 => 0.1323, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 11.15% (33.6200 => 37.3696, std.dev.: 0.3470) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.08% (23.6777 => 26.3003, std.dev.: 0.1004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.66% (0.3813 => 0.4029, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.29% (0.3292 => 0.3466, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 5.23% (0.2486 => 0.2616, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 4.31% (0.2601 => 0.2713, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 4.03% (0.4511 => 0.4693, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.89% (0.9040 => 0.9392, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.78% (0.5893 => 0.6116, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.10% (1.8791 => 1.9186, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.71% (1.3577 => 1.3809, std.dev.: 0.0086) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 38.97% (3.1285 => 4.3477, std.dev.: 0.1601) SingleSource/Benchmarks/Shootout-C++/lists1: 6.36% (0.6159 => 0.6551, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: 5.96% (4.0571 => 4.2988, std.dev.: 0.0601) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.71% (2.3964 => 2.4852, std.dev.: 0.0167) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.68% (0.5215 => 0.5355, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 2.38% (1.0057 => 1.0296, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.69% (13.5604 => 13.7896, std.dev.: 0.0684) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.37% (6.1431 => 5.4447, std.dev.: 0.1672) MultiSource/Benchmarks/nbench/nbench: -9.66% (23.5203 => 21.2484, std.dev.: 0.4153) SingleSource/Regression/C/uint64_to_float: -2.58% (1.9570 => 1.9065, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.43% (1.1222 => 1.1270, std.dev.: 0.0739) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0223 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0432 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0336 => 0.0336, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0319 => 0.0319, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0433 => 0.0433, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 3.17% (0.0221 => 0.0228, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.22% (0.0230 => 0.0218, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 1.34% (0.1490 => 0.1510, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: 2.68% (1.1271 => 1.1573, std.dev.: 0.3494) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.30% (0.3970 => 0.3982, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.12% (0.1514 => 0.1497, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.24% (0.0967 => 0.0979, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.36% (0.0268 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.95% (0.0565 => 0.0576, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.70% (1.1786 => 1.1869, std.dev.: 0.0734) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -25.00% (0.0020 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 8.33% (0.0024 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.93% (0.0285 => 0.0319, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.98% (0.7416 => 0.7563, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -34.15% (0.0123 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.15% (12.7683 => 12.7493, std.dev.: 0.0456) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 43.15% (0.0336 => 0.0481, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 12.41% (33.2440 => 37.3696, std.dev.: 0.3470) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.51% (23.5861 => 26.3003, std.dev.: 0.1004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 9.34% (0.1210 => 0.1323, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.87% (1.8651 => 1.9186, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 320025.00% (0.0008 => 2.5610, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 95.33% (1.1825 => 2.3098, std.dev.: 0.0592) SingleSource/Regression/C/uint64_to_float: 23.82% (1.5397 => 1.9065, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 10.69% (0.2562 => 0.2836, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 4.40% (6.8159 => 7.1159, std.dev.: 0.0382) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.98% (2.2499 => 2.3394, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/pi: 2.56% (2.1390 => 2.1938, std.dev.: 0.0107) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.51% (0.5224 => 0.5355, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.48% (0.0808 => 0.0489, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.29% (0.0727 => 0.0485, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -26.01% (0.1888 => 0.1397, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -23.99% (0.1684 => 0.1280, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.64% (0.0676 => 0.0550, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -17.52% (0.0862 => 0.0711, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.31% (0.1079 => 0.0903, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.86% (0.7686 => 0.6467, std.dev.: 0.0076) MultiSource/Applications/aha/aha: -12.84% (0.1378 => 0.1201, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.30% (0.4074 => 0.3573, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.66% (0.7693 => 0.6950, std.dev.: 0.0078) MultiSource/Applications/Burg/burg: -9.29% (1.5979 => 1.4494, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.74% (1.5131 => 1.3809, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: -8.64% (0.3598 => 0.3287, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.48% (1.3924 => 1.2743, std.dev.: 0.0301) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.08% (1.1498 => 1.0569, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.99% (1.6874 => 1.5525, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.23% (10.2703 => 9.5275, std.dev.: 0.2743) MultiSource/Applications/d/make_dparser: -6.19% (3.7840 => 3.5499, std.dev.: 0.0693) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.16% (0.6885 => 0.6461, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.32% (16.6791 => 13.7896, std.dev.: 0.0684) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.89% (0.1164 => 0.1014, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -7.75% (1.4588 => 1.3458, std.dev.: 0.0126) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.09% (0.3217 => 0.2989, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -6.82% (3.5443 => 3.3025, std.dev.: 0.0347) SingleSource/Benchmarks/Shootout/hash: -5.02% (4.5259 => 4.2988, std.dev.: 0.0601) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.57% (1.4446 => 1.3931, std.dev.: 0.0041) MultiSource/Benchmarks/mafft/pairlocalalign: -3.22% (63.1520 => 61.1164, std.dev.: 0.0959) MultiSource/Applications/spiff/spiff: -2.57% (2.8571 => 2.7836, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/lists: -2.36% (17.2182 => 16.8124, std.dev.: 0.0649) SingleSource/Benchmarks/Misc/mandel-2: -1.65% (0.8521 => 0.8380, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -1.09% (14.9448 => 14.7825, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.07% (3.1921 => 3.1579, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.45% (1.2047 => 1.1270, std.dev.: 0.0739) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: 0.44% (0.0227 => 0.0228, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -14.51% (0.0255 => 0.0218, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1530 => 0.1510, std.dev.: 0.0092) MultiSource/Applications/lemon/lemon: -40.01% (1.9293 => 1.1573, std.dev.: 0.3494) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.65% (0.4049 => 0.3982, std.dev.: 0.0547) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.86% (0.1510 => 0.1497, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.10% (0.0978 => 0.0979, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.37% (0.0590 => 0.0576, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.17% (1.1617 => 1.1869, std.dev.: 0.0734) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.12% (0.0032 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.69% (0.7437 => 0.7563, std.dev.: 0.0139) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.96% (0.0092 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.23% (12.7781 => 12.7493, std.dev.: 0.0456) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 12:48:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 14:48:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125204810.07E5D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7944?compare_to=7941&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7944, Order: 173468, Start Time: 2013-01-25 19:14:39, End Time: 2013-01-25 20:48:26 To: 7941, Order: 173458, Start Time: 2013-01-25 17:17:35, End Time: 2013-01-25 18:51:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.53% (0.0974 => 0.1622, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.83% (0.6395 => 0.8814, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.56% (0.5688 => 0.7540, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.51% (0.5805 => 0.7692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.22% (0.6260 => 0.8277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.99% (0.5849 => 0.7720, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.88% (0.5567 => 0.7342, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.62% (0.6395 => 0.8417, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.57% (0.5581 => 0.7343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.53% (0.5575 => 0.7333, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.82% (0.5941 => 0.7772, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.23% (0.5859 => 0.7630, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.99% (0.6033 => 0.7842, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.35% (0.6440 => 0.8330, std.dev.: 0.0110) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.92% (1.6474 => 2.1238, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.83% (0.6189 => 0.7973, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.90% (0.6304 => 0.8063, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.40% (0.6230 => 0.7937, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.77% (0.6660 => 0.8443, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.40% (0.5802 => 0.7334, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.16% (0.5925 => 0.7475, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.96% (0.5705 => 0.7186, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.75% (0.5857 => 0.7365, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.70% (0.5569 => 0.7000, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.48% (0.5478 => 0.6874, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.40% (0.5570 => 0.6985, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.04% (0.5591 => 0.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.99% (0.7524 => 0.9329, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.93% (0.5863 => 0.7266, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.79% (0.6052 => 0.7492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.64% (0.6446 => 0.7970, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.50% (0.6681 => 0.8251, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.88% (0.6194 => 0.7611, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.47% (0.6297 => 0.7712, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.87% (2.2587 => 2.7526, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.21% (0.6667 => 0.8081, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.66% (0.7339 => 0.8782, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 15.28% (0.3357 => 0.3870, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.00% (1.1450 => 1.3167, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.82% (0.0731 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.85% (4.5069 => 5.0862, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/05-eks/eks: 12.34% (0.4515 => 0.5072, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.1982 => 0.2217, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.73% (1.6364 => 1.8284, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (3.5339 => 3.9421, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.30% (0.1230 => 0.1369) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.94% (9.2283 => 10.1456, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 8.68% (1.2515 => 1.3601, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.53% (0.4524 => 0.4910, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.26% (0.5329 => 0.5769, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.15% (0.1731 => 0.1872, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4861 => 0.5235, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.58% (0.7021 => 0.7553, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.4642 => 1.5750, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.05% (1.2784 => 1.3685, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.45% (0.3255 => 0.3465, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3319 => 0.3499, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.55% (5.4682 => 5.7170, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/bigfib: 4.22% (0.6750 => 0.7035, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.90% (5.0226 => 5.2185, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary3: 3.57% (0.3446 => 0.3569, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.27% (0.3394 => 0.3505, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.09% (1.3864 => 1.4292, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.05% (0.8418 => 0.8675, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.70% (0.7447 => 0.7648, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.52% (0.9557 => 0.9798, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.39% (15.5079 => 15.8778, std.dev.: 0.0098) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (22.4056 => 22.9083, std.dev.: 0.0127) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5168 => 0.5274, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.04% (1.3722 => 1.4002, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.25% (18.2933 => 18.5214, std.dev.: 0.0195) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.2300 => 1.2438, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5519, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8039, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.73% (0.9531 => 1.0268, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6767 => 12.1656, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5321, std.dev.: 0.0260) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1013, std.dev.: 0.0036) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5074, std.dev.: 0.0148) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2486, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3489 => 10.4608, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: 1.03% (4.5320 => 4.5786, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.7198 => 0.6869, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.70% (0.3837 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.50% (2.4924 => 2.4052, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.43% (0.9852 => 0.9514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.94% (0.3812 => 0.3700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.81% (0.3880 => 0.3771, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -2.78% (0.4033 => 0.3921, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -2.77% (0.3896 => 0.3788, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -2.75% (0.3848 => 0.3742, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.73% (0.6347 => 0.6174, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.70% (0.7779 => 0.7569, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.70% (0.3891 => 0.3786, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.54% (0.4176 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.9542 => 0.9304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.49% (2.1713 => 2.1172, std.dev.: 0.0111) SingleSource/UnitTests/ObjC++/property-reference-object: -2.42% (0.6441 => 0.6285, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.33% (1.3148 => 1.2841, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.30% (20.7746 => 20.2958, std.dev.: 0.0722) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.25% (0.6484 => 0.6338, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.97% (14.2083 => 13.9284, std.dev.: 0.0142) MultiSource/Applications/sqlite3/sqlite3: -1.76% (17.1032 => 16.8019, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.7716 => 6.6834, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: -1.24% (16.1920 => 15.9919, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.95% (1.8100 => 0.6887, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3115, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.49% (1.3643 => 1.0302, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0687, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -15.84% (1.0217 => 0.8599) SingleSource/UnitTests/Vector/multiplies: -15.02% (2.5106 => 2.1336, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3563, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.80% (0.5142 => 0.4638, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1806, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -2.93% (3.7241 => 3.6151, std.dev.: 0.0202) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.49% (1.3096 => 1.2770, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7812, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.70% (7.3040 => 7.1796, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4672, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7092 => 3.6575, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.01% (1.6219 => 1.6055, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 12:55:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 14:55:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125205528.333E62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7945?compare_to=7940&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7945, Order: 173464, Start Time: 2013-01-25 18:44:49, End Time: 2013-01-25 20:55:41 To: 7940, Order: 173448, Start Time: 2013-01-25 16:03:31, End Time: 2013-01-25 18:14:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (213 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (659 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0665 => 0.0665, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8363 => 499.8415, std.dev.: 0.0134) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.98% (1.1277 => 499.8415, std.dev.: 0.0134) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.61% (0.5229 => 1.6503, std.dev.: 0.0052) MultiSource/Applications/SPASS/SPASS: 20.60% (14.9895 => 18.0769, std.dev.: 0.0164) MultiSource/Applications/kimwitu++/kc: 43.82% (14.1553 => 20.3579, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/gs/gs: 17.89% (4.1105 => 4.8458, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.71% (1.1048 => 1.7313, std.dev.: 0.0056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.31% (7.1582 => 37.3161, std.dev.: 0.0167) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.37% (3.4629 => 6.4192, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.25% (0.6222 => 1.0904, std.dev.: 0.0053) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.22% (0.0720 => 7.4464, std.dev.: 0.0419) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 11180000.00% (0.0001 => 11.1801, std.dev.: 0.0161) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485500.00% (0.0001 => 5.4856, std.dev.: 0.0235) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 823.16% (1.1194 => 10.3338, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/factor: 163.51% (0.0296 => 0.0780, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.45% (22.1758 => 55.3171, std.dev.: 0.0946) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.66% (0.0929 => 0.1827, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.43% (0.1463 => 0.2508, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.32% (2.9384 => 4.6522, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.79% (7.0540 => 10.8486, std.dev.: 0.0023) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.31% (1.5859 => 2.3997, std.dev.: 0.0173) MultiSource/Benchmarks/FreeBench/distray/distray: 48.58% (0.1056 => 0.1569, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.95% (8.1363 => 11.9562, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.51% (2.2024 => 3.1167, std.dev.: 0.0100) MultiSource/Applications/sgefa/sgefa: 39.59% (0.3109 => 0.4340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.90% (0.1432 => 0.1989, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.72% (0.0439 => 0.0609, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.69% (21.9371 => 30.4254, std.dev.: 0.1198) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 36.91% (0.1062 => 0.1454, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.33% (4.2646 => 5.6860, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.37% (1.5415 => 2.0405, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.18% (0.4615 => 0.6100, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 29.61% (0.4299 => 0.5572, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 29.23% (1.1642 => 1.5045, std.dev.: 0.0058) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.72% (0.5105 => 0.6520, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.33% (0.6675 => 0.8499, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.33% (0.1892 => 0.2409, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 26.72% (0.0479 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 26.30% (9.4845 => 11.9785, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.06% (3.8922 => 4.9064, std.dev.: 0.0162) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.04% (0.1125 => 0.1418, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.85% (0.0793 => 0.0998, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.80% (0.2554 => 0.3213, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077) MultiSource/Applications/lemon/lemon: 24.43% (1.0722 => 1.3341, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 24.41% (0.1143 => 0.1422, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 24.18% (0.4289 => 0.5326, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.15% (1.4186 => 1.7612, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.03% (0.3121 => 0.3871, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 23.64% (0.4620 => 0.5712, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.36% (0.1695 => 0.2091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.26% (0.1337 => 0.1648, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.60% (0.0730 => 0.0895, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 22.47% (0.7115 => 0.8714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.81% (0.2700 => 0.3289, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.67% (0.1555 => 0.1892, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.21% (0.0660 => 0.0800, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.06% (0.0527 => 0.0638, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.01% (0.3098 => 0.3749, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.99% (0.1029 => 0.1245, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 20.99% (5.7591 => 6.9679, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.95% (0.1236 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 20.69% (0.0662 => 0.0799, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.64% (1.3050 => 1.5743, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/bigfib: 20.55% (0.6456 => 0.7783, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.33% (0.7835 => 0.9428, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.31% (0.0842 => 0.1013, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 19.95% (0.1163 => 0.1395, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.86% (0.1032 => 0.1237, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 19.82% (0.1695 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.78% (0.0834 => 0.0999, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.64% (0.5860 => 0.7011, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 19.64% (0.1151 => 0.1377, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.62% (4.9449 => 5.9153, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.52% (0.0871 => 0.1041, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.33% (0.1940 => 0.2315, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.31% (0.8172 => 0.9750, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.88% (5.0018 => 5.9461, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 18.82% (3.3354 => 3.9630, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.74% (0.0886 => 0.1052, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.60% (0.3307 => 0.3922, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.57% (0.5020 => 0.5952, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.06% (0.0648 => 0.0765) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.89% (0.7433 => 0.8763, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.80% (0.2758 => 0.3249, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.77% (0.9765 => 1.1500, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 17.74% (0.1268 => 0.1493, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.68% (0.1510 => 0.1777, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.60% (0.5569 => 0.6549, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 17.58% (1.1840 => 1.3922, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 17.21% (3.8723 => 4.5387, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.10% (0.5981 => 0.7004, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.10% (1.1861 => 1.3889, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 17.06% (2.0273 => 2.3732, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/18-imp/imp: 17.03% (0.3423 => 0.4006, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 16.69% (0.3283 => 0.3831, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 16.58% (2.2969 => 2.6778, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.51% (0.0933 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.49% (0.0770 => 0.0897, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.39% (0.3441 => 0.4005, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.31% (0.8101 => 0.9422, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.28% (0.1044 => 0.1214, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.09% (0.3232 => 0.3752, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.88% (0.6450 => 0.7474, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 15.81% (0.2049 => 0.2373, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811) MultiSource/Benchmarks/McCat/09-vor/vor: 15.13% (0.3180 => 0.3661, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 14.99% (0.8921 => 1.0258, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.57% (0.8067 => 0.9242, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.36% (0.0759 => 0.0868, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 14.15% (0.3379 => 0.3857, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.33% (0.4636 => 0.5254, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 13.29% (1.5603 => 1.7677, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.54% (0.4203 => 0.4730, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.43% (0.4103 => 0.4613, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.07% (0.3603 => 0.4038, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 12.07% (0.3422 => 0.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.03% (0.4048 => 0.4535, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 11.97% (0.3282 => 0.3675, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 11.93% (17.1811 => 19.2300, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.60% (0.2430 => 0.2712, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 11.59% (0.3684 => 0.4111, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.90% (0.3826 => 0.4243, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.80% (0.3427 => 0.3797, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.75% (0.4064 => 0.4501, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.56% (14.3668 => 15.8835, std.dev.: 0.0211) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 9.89% (0.2831 => 0.3111, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 9.74% (0.3828 => 0.4201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 9.47% (0.2871 => 0.3143, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.23% (0.3694 => 0.4035, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/trivial-interface: 9.21% (0.3473 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.21% (2.0665 => 2.2569, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.20% (0.3543 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 9.14% (0.3543 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.09% (0.3497 => 0.3815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.07% (0.3516 => 0.3835, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 8.92% (0.2905 => 0.3164, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.82% (0.3162 => 0.3441, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 8.75% (63.2438 => 68.7787, std.dev.: 0.0276) MultiSource/Applications/hexxagon/hexxagon: 8.74% (1.2842 => 1.3964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2872 => 0.3122, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.68% (0.3650 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.68% (0.2891 => 0.3142, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 8.39% (0.3052 => 0.3308, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.39% (0.3935 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.35% (0.2756 => 0.2986, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 8.16% (10.3673 => 11.2136, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/fibo: 8.15% (0.2725 => 0.2947, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 7.95% (0.2793 => 0.3015, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.94% (0.3136 => 0.3385, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.89% (0.6030 => 0.6506, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.74% (2.2022 => 2.3726, std.dev.: 0.0042) SingleSource/UnitTests/ObjC++/property-reference: 7.73% (0.7326 => 0.7892, std.dev.: 0.0057) SingleSource/UnitTests/ObjC++/Hello: 7.48% (0.5925 => 0.6368, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.76% (0.4879 => 0.5209, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 3.77% (0.3131 => 0.3249, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.29% (7.9617 => 8.1440, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4701, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3854, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.10% (4.2280 => 4.4435, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3103, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.67% (0.9957 => 1.0322, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9111, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.58% (3.6395 => 3.7335, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0050) MultiSource/Applications/aha/aha: 1.90% (3.1595 => 3.2196, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.69% (9.1159 => 9.2699, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3043, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.72% (5.2763 => 1.1758, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -74.97% (0.8651 => 0.2165, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.28% (0.1622 => 0.0920, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.90% (5.3855 => 4.4751, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.34% (5.3526 => 4.4782, std.dev.: 0.0105) MultiSource/Applications/JM/ldecod/ldecod: -13.42% (10.4361 => 9.0355, std.dev.: 0.0031) SingleSource/UnitTests/Vector/constpool: -7.73% (54.1659 => 49.9773, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.41% (1.7609 => 1.6305, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.78% (1.9577 => 0.6699, std.dev.: 0.0072) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3053, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4171, std.dev.: 0.0111) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8538, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0038, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -20.18% (0.2161 => 0.1725, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.19% (0.9540 => 0.8568, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.66% (1.2373 => 1.1549, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.59% (19.9488 => 18.6347, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.62% (8.1563 => 7.6980, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5784, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5079, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.76% (0.4808 => 0.4579, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.65% (10.2830 => 9.8050, std.dev.: 0.0136) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/ary3: -1.81% (3.6994 => 3.6325, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (3.7221 => 3.6615, std.dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: -1.28% (4.6441 => 4.5845, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0011) Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 14:13:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 16:13:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130125221310.86E6E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7946?compare_to=7943&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7946, Order: 173472, Start Time: 2013-01-25 20:05:29, End Time: 2013-01-25 22:13:28 To: 7943, Order: 173460, Start Time: 2013-01-25 17:39:38, End Time: 2013-01-25 19:43:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 36 (31 on baseline) Performance Improvements: 2 (9 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1026 (1023 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 44.68% (0.3339 => 0.4831, std.dev.: 0.0353) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.31% (0.2509 => 0.3169, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 24.74% (0.2930 => 0.3655, std.dev.: 0.0187) MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.10% (0.9463 => 1.1744, std.dev.: 0.0731) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 17.81% (0.1280 => 0.1508, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 17.81% (4.1705 => 4.9133, std.dev.: 0.1543) MultiSource/Applications/ClamAV/clamscan: 17.52% (16.2325 => 19.0770, std.dev.: 0.5896) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.30% (4.7987 => 5.6287, std.dev.: 0.1254) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 16.49% (0.9265 => 1.0793, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.84% (0.9529 => 1.0848, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.56% (0.9571 => 1.0582, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.78% (1.0637 => 1.1677, std.dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: 8.20% (16.2418 => 17.5735, std.dev.: 0.1246) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.85% (0.8806 => 0.9497, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.67% (5.9323 => 6.3277, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.55% (0.9556 => 1.0086, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.47% (0.9095 => 0.9502, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.98% (0.8843 => 0.9195, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.76% (0.2796 => 0.2901, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.65% (0.9177 => 0.9512, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/hash: 2.34% (0.4693 => 0.4803, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 34.40% (0.0747 => 0.1004, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 27.68% (6.3428 => 8.0987, std.dev.: 0.1750) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.46% (4.8073 => 6.0310, std.dev.: 0.1275) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.12% (2.6209 => 2.9385, std.dev.: 0.0712) SingleSource/Benchmarks/CoyoteBench/lpbench: 11.17% (4.5718 => 5.0824, std.dev.: 0.0909) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.77% (2.9462 => 3.2636, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/moments: 10.39% (0.1001 => 0.1105, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 9.86% (1.7452 => 1.9172, std.dev.: 0.0108) MultiSource/Applications/lua/lua: 4.05% (28.5274 => 29.6822, std.dev.: 0.1103) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.00% (42.0250 => 43.7055, std.dev.: 0.2359) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.28% (2.6971 => 2.7856, std.dev.: 0.0242) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.85% (1.5356 => 1.5640, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: 1.81% (4.3196 => 4.3979, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/lowercase: 1.27% (2.5610 => 2.5935, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.13% (6.9292 => 7.0074, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.89% (0.4029 => 0.3832, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.13% (1.3458 => 1.3172, std.dev.: 0.0096) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.39% (1.1270 => 1.1314, std.dev.: 0.2863) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.80% (0.0222 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0433 => 0.0433, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.79% (0.0336 => 0.0342, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.25% (0.0319 => 0.0323, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0433 => 0.0429, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0207 => 0.0206, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -3.07% (0.0228 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 44.04% (0.0218 => 0.0314, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 10.46% (0.1510 => 0.1668, std.dev.: 0.0172) MultiSource/Applications/lemon/lemon: 66.52% (1.1573 => 1.9271, std.dev.: 0.0804) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.44% (0.3982 => 0.4079, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.34% (0.1497 => 0.1447, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.41% (0.0979 => 0.1032, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.08% (0.0576 => 0.0611, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.67% (1.1869 => 1.1790, std.dev.: 0.1390) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.00% (0.0015 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0609 => 0.0607, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0319 => 0.0319, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.18% (0.7563 => 0.7474, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.15% (0.0081 => 0.0042, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.07% (12.7493 => 12.7576, std.dev.: 0.0381) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: 35.70% (0.3560 => 0.4831, std.dev.: 0.0353) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 22.12% (0.2993 => 0.3655, std.dev.: 0.0187) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.05% (0.2618 => 0.3169, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 15.10% (4.8904 => 5.6287, std.dev.: 0.1254) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.80% (0.0935 => 0.1036, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 9.41% (17.4365 => 19.0770, std.dev.: 0.5896) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.79% (0.9010 => 0.9802, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.11% (0.9788 => 1.0582, std.dev.: 0.0150) MultiSource/Benchmarks/mafft/pairlocalalign: 7.83% (9.5202 => 10.2658, std.dev.: 0.1294) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.52% (1.0860 => 1.1677, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.36% (0.8846 => 0.9497, std.dev.: 0.0079) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.85% (23.5861 => 25.2027, std.dev.: 0.5499) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.84% (0.9588 => 1.0244, std.dev.: 0.0252) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.94% (0.2791 => 0.2901, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.47% (0.9214 => 0.9534, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.01% (0.8926 => 0.9195, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash: 2.43% (0.4689 => 0.4803, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 324087.50% (0.0008 => 2.5935, std.dev.: 0.0119) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 98.27% (1.1825 => 2.3445, std.dev.: 0.0581) SingleSource/Regression/C/uint64_to_float: 23.53% (1.5397 => 1.9020, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.61% (5.0421 => 6.0310, std.dev.: 0.1275) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.82% (0.0845 => 0.1004, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.11% (4.4540 => 5.0824, std.dev.: 0.0909) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.51% (9.0082 => 10.0446, std.dev.: 0.3867) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.49% (3.0082 => 3.2636, std.dev.: 0.0408) SingleSource/Benchmarks/Shootout-C++/ary3: 5.79% (1.8123 => 1.9172, std.dev.: 0.0108) MultiSource/Applications/JM/lencod/lencod: 4.63% (6.8159 => 7.1318, std.dev.: 0.0714) MultiSource/Benchmarks/Bullet/bullet: 4.55% (7.2040 => 7.5321, std.dev.: 0.0720) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (42.3194 => 43.7055, std.dev.: 0.2359) MultiSource/Applications/lua/lua: 2.24% (29.0327 => 29.6822, std.dev.: 0.1103) SingleSource/Benchmarks/Shootout/fib2: 1.80% (4.3202 => 4.3979, std.dev.: 0.0231) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.45% (0.1684 => 0.1508, std.dev.: 0.0042) MultiSource/Applications/aha/aha: -9.87% (0.1378 => 0.1242, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.43% (1.1498 => 1.0759, std.dev.: 0.0286) MultiSource/Applications/d/make_dparser: -3.87% (3.7840 => 3.6376, std.dev.: 0.0383) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.82% (0.7693 => 0.7476, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.49% (6.4235 => 6.3277, std.dev.: 0.0134) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.21% (16.6791 => 13.8085, std.dev.: 0.1483) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -9.71% (1.4588 => 1.3172, std.dev.: 0.0096) MultiSource/Benchmarks/mafft/pairlocalalign: -2.90% (63.1520 => 61.3214, std.dev.: 0.1553) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.08% (1.2047 => 1.1314, std.dev.: 0.2863) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.44% (0.0233 => 0.0218, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.20% (0.0394 => 0.0342, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 23.14% (0.0255 => 0.0314, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.02% (0.1530 => 0.1668, std.dev.: 0.0172) MultiSource/Applications/lemon/lemon: -0.11% (1.9293 => 1.9271, std.dev.: 0.0804) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4049 => 0.4079, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.17% (0.1510 => 0.1447, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.52% (0.0978 => 0.1032, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.56% (0.0590 => 0.0611, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.49% (1.1617 => 1.1790, std.dev.: 0.1390) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0141) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 19.03% (0.0268 => 0.0319, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.7437 => 0.7474, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -54.35% (0.0092 => 0.0042, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.16% (12.7781 => 12.7576, std.dev.: 0.0381) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 14:45:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 16:45:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130125224551.AC6DC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7947?compare_to=7944&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7947, Order: 173484, Start Time: 2013-01-25 21:11:59, End Time: 2013-01-25 22:46:07 To: 7944, Order: 173468, Start Time: 2013-01-25 19:14:39, End Time: 2013-01-25 20:48:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (90 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.76% (0.8599 => 0.8448, std.dev.: 0.0000) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.78% (0.1132 => 0.1605, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.76% (0.6395 => 0.8810, std.dev.: 0.0017) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.42% (0.5688 => 0.7532, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.27% (0.5805 => 0.7678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.12% (0.6260 => 0.8271, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.87% (0.5849 => 0.7713, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.83% (0.5567 => 0.7339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.70% (0.6395 => 0.8422, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.57% (0.5575 => 0.7335, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.39% (0.5581 => 0.7333, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.84% (0.6033 => 0.7833, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.66% (0.5859 => 0.7597, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.29% (0.6440 => 0.8326, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.87% (1.6474 => 2.1230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.60% (0.6189 => 0.7959, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.75% (0.0699 => 0.0893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.19% (0.6230 => 0.7924, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.47% (0.5802 => 0.7338, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.40% (0.6660 => 0.8418, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.11% (0.5925 => 0.7472, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.87% (0.5705 => 0.7181, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.68% (0.5857 => 0.7361, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.39% (0.5478 => 0.6869, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.39% (0.5570 => 0.6984, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.21% (0.5569 => 0.6973, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.66% (0.5591 => 0.6970, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.98% (0.5863 => 0.7269, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.98% (0.7524 => 0.9328, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.69% (0.6052 => 0.7486, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.64% (0.6446 => 0.7970, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.99% (0.6681 => 0.8217, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.75% (0.6194 => 0.7603, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.44% (0.6297 => 0.7710, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.80% (2.2587 => 2.7510, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.21% (0.6667 => 0.8081, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.57% (0.7339 => 0.8775, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.28% (0.3357 => 0.3870, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.92% (1.1450 => 1.3158, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.50% (4.5069 => 5.0704, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.33% (0.4916 => 0.5522, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.03% (0.4515 => 0.5058, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.96% (0.1982 => 0.2219, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.75% (1.6364 => 1.8287, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.49% (3.5339 => 3.9398, std.dev.: 0.0072) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.06% (0.1230 => 0.1366, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 9.70% (9.2283 => 10.1232, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 8.69% (0.4524 => 0.4917, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.2001 => 0.2172, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.45% (1.2515 => 1.3572, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.24% (0.5329 => 0.5768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.20% (0.1731 => 0.1873, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.56% (0.7021 => 0.7552, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (0.4861 => 0.5226, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.45% (1.4642 => 1.5733, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.92% (1.2784 => 1.3669, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 6.51% (0.3255 => 0.3467, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.3319 => 0.3491, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.43% (5.4682 => 5.7102, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++/bigfib: 4.12% (0.6750 => 0.7028, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 3.92% (5.0226 => 5.2194, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/BoolLiteralTest: 3.81% (0.3834 => 0.3980, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3446 => 0.3563, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.3864 => 1.4278, std.dev.: 0.0111) MultiSource/Applications/spiff/spiff: 2.93% (0.8418 => 0.8665, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.59% (0.7447 => 0.7640, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.53% (0.9557 => 0.9799, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.22% (15.5079 => 15.8518, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.17% (22.4056 => 22.8927, std.dev.: 0.0233) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5168 => 0.5274, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.3722 => 1.3999, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.10% (18.2933 => 18.4942, std.dev.: 0.0235) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2300 => 1.2427, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8153, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.74% (0.9531 => 1.0269, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1646, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5339, std.dev.: 0.0709) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0098) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5116, std.dev.: 0.0085) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2496, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (79.7170 => 80.9071, std.dev.: 0.1807) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2706, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6551 => 3.6941, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4569, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.96% (0.7198 => 0.6841, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.60% (2.4924 => 2.4027, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.46% (0.9852 => 0.9511, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.31% (0.3812 => 0.3686, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.28% (0.3142 => 0.3039) SingleSource/UnitTests/ObjC/exceptions-2: -3.21% (0.3831 => 0.3708, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.12% (0.4033 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.12% (0.3880 => 0.3759, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.12% (0.3848 => 0.3728, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.06% (0.3891 => 0.3772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.00% (0.3896 => 0.3779, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -2.95% (0.4176 => 0.4053, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -2.76% (0.7779 => 0.7564, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.63% (0.3884 => 0.3782, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.61% (0.9542 => 0.9293, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.56% (0.6441 => 0.6276, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.46% (2.1713 => 2.1179, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.41% (20.7746 => 20.2738, std.dev.: 0.0067) MultiSource/Applications/hexxagon/hexxagon: -2.26% (1.3148 => 1.2851, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.22% (0.6484 => 0.6340, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.08% (14.2083 => 13.9121, std.dev.: 0.0162) MultiSource/Applications/sqlite3/sqlite3: -1.72% (17.1032 => 16.8098, std.dev.: 0.0038) MultiSource/Applications/JM/lencod/lencod: -1.41% (16.1920 => 15.9645, std.dev.: 0.0204) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (6.7716 => 6.6772, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.13% (1.0544 => 1.0425, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: -1.06% (7.0961 => 7.0209, std.dev.: 0.0077) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.93% (1.8100 => 0.7071, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.46% (1.3643 => 1.0306, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0754, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1978, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1280, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.81% (0.4092 => 0.3527, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3532, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.67% (0.5142 => 0.4645, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.70% (0.9021 => 0.8417, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.85% (2.2633 => 2.1762, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.77% (7.9763 => 7.7556, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.08% (3.7241 => 3.6467, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.58% (7.3040 => 7.1887, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.54% (1.6307 => 1.6056, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.49% (1.6086 => 1.5846, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5997, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6680, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 15:26:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 17:26:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130125232650.B5D492A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7948?compare_to=7942&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7948, Order: 173468, Start Time: 2013-01-25 19:51:55, End Time: 2013-01-25 23:27:07 To: 7942, Order: 173439, Start Time: 2013-01-25 15:19:44, End Time: 2013-01-25 18:54:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (189 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (747 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.0749 => 54.7451, std.dev.: 0.0755) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.90% (0.1063 => 0.1434, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.37% (0.2969 => 0.3841, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.42% (0.0475 => 0.0610, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.15% (0.0547 => 0.0701, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.01% (0.0714 => 0.0914, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.94% (0.1106 => 0.1415, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.69% (0.4139 => 0.5285, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.65% (0.4253 => 0.5429, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.17% (0.5900 => 0.7503, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.15% (0.4994 => 0.6350, std.dev.: 0.0150) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0415 => 0.0526, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 26.17% (1.5932 => 2.0102, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.62% (0.5000 => 0.6281, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.43% (0.0822 => 0.1031, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.12% (0.1620 => 0.2027, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.08% (0.0897 => 0.1122, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.98% (0.1021 => 0.1276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.47% (0.1549 => 0.1928, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 23.73% (0.0948 => 0.1173, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.73% (0.1003 => 0.1241, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.67% (0.1107 => 0.1369, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.13% (0.1604 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.85% (0.3903 => 0.4795, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.74% (0.0541 => 0.0664, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 22.66% (0.0821 => 0.1007, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 22.48% (0.1619 => 0.1983, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.35% (0.0452 => 0.0553, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.34% (0.0582 => 0.0712, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.65% (0.0947 => 0.1152, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.42% (0.2866 => 0.3480, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.23% (0.1088 => 0.1319, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.20% (0.1462 => 0.1772, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 21.02% (0.1218 => 0.1474, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.83% (1.3152 => 1.5892, std.dev.: 0.0297) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.80% (0.2014 => 0.2433, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 20.77% (0.0698 => 0.0843, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.62% (0.3890 => 0.4692, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.61% (0.2736 => 0.3300, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 20.58% (0.4029 => 0.4858, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/09-vor/vor: 20.47% (0.1505 => 0.1813, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 20.22% (1.8794 => 2.2594, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.97% (0.1968 => 0.2361, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 19.84% (0.5826 => 0.6982, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.83% (0.0605 => 0.0725, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.81% (0.3271 => 0.3919, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.71% (0.4658 => 0.5576, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 19.65% (0.5889 => 0.7046, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 19.62% (0.5546 => 0.6634, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.62% (0.2875 => 0.3439, std.dev.: 0.0102) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685) SingleSource/Benchmarks/Shootout-C++/strcat: 19.42% (0.2750 => 0.3284, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.27% (0.2792 => 0.3330, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 19.20% (0.9697 => 1.1559, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 19.13% (0.2823 => 0.3363, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 19.10% (0.2811 => 0.3348, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 19.05% (0.2714 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 19.01% (0.2725 => 0.3243, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.97% (3.5627 => 4.2384, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.96% (0.2738 => 0.3257, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 18.95% (0.2813 => 0.3346, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 18.94% (0.2803 => 0.3334, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.94% (1.6211 => 1.9282, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 18.88% (0.2780 => 0.3305, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.87% (0.2729 => 0.3244, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 18.84% (0.7171 => 0.8522, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.76% (0.2911 => 0.3457, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 18.69% (0.9909 => 1.1761, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.63% (2.0673 => 2.4524, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.62% (0.5026 => 0.5962, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.62% (0.1160 => 0.1376, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 18.54% (0.1284 => 0.1522, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 18.48% (0.3004 => 0.3559, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.47% (0.3195 => 0.3785, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 18.44% (0.3096 => 0.3667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 18.40% (0.3267 => 0.3868, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 18.32% (23.5202 => 27.8300, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.12% (2.7292 => 3.2238, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 18.11% (0.3258 => 0.3848, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.10% (0.3060 => 0.3614, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 18.02% (0.1421 => 0.1677, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.94% (0.3362 => 0.3965, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 17.82% (0.3317 => 0.3908, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.76% (0.3930 => 0.4628, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.75% (0.4361 => 0.5135, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: 17.73% (1.0781 => 1.2692, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.67% (0.3124 => 0.3676, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.64% (1.9694 => 2.3168, std.dev.: 0.0369) SingleSource/Benchmarks/Shootout-C++/sieve: 17.55% (0.3726 => 0.4380, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.55% (0.3282 => 0.3858, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.46% (0.3625 => 0.4258, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists: 17.32% (0.3348 => 0.3928, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 17.26% (0.3477 => 0.4077, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 17.20% (4.2109 => 4.9351, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.11% (1.9966 => 2.3383, std.dev.: 0.0298) MultiSource/Benchmarks/nbench/nbench: 17.11% (0.2566 => 0.3005, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 17.05% (0.3678 => 0.4305, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.96% (4.4195 => 5.1690, std.dev.: 0.0335) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.88% (0.1090 => 0.1274, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.80% (0.3690 => 0.4310, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 16.69% (0.4146 => 0.4838, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.65% (0.3981 => 0.4644, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 16.61% (0.4251 => 0.4957, std.dev.: 0.0135) MultiSource/Applications/lua/lua: 16.33% (1.4269 => 1.6599, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.10% (0.3845 => 0.4464, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/bigfib: 15.74% (0.5012 => 0.5801, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.60% (0.0673 => 0.0778, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.17% (0.3488 => 0.4017, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 15.14% (0.7875 => 0.9067, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions-2: 15.06% (0.3446 => 0.3965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 15.01% (0.3465 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.00% (0.3460 => 0.3979, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.98% (0.6435 => 0.7399, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 14.94% (2.1653 => 2.4888, std.dev.: 0.0172) SingleSource/UnitTests/ObjC/synchronized: 14.93% (0.3469 => 0.3987, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 14.90% (0.3442 => 0.3955, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.90% (0.3496 => 0.4017, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 14.89% (0.2075 => 0.2384, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.88% (0.1028 => 0.1181, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 14.77% (0.3650 => 0.4189, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.63% (0.3643 => 0.4176, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.53% (0.3724 => 0.4265, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 14.37% (5.5417 => 6.3379, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.36% (0.2737 => 0.3130, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 14.31% (4.6177 => 5.2787, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 14.27% (0.2691 => 0.3075, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.78% (0.2068 => 0.2353, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.58% (2.1013 => 2.3866, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.30% (0.1383 => 0.1567, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.09% (0.2040 => 0.2307, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 13.06% (0.3498 => 0.3955, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.0804 => 0.0907, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.74% (0.3084 => 0.3477, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.63% (0.5361 => 0.6038, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 12.20% (0.3336 => 0.3743, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.13% (0.2103 => 0.2358, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 12.04% (0.6634 => 0.7433, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 11.84% (0.4847 => 0.5421, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.07% (0.7426 => 0.8248, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.03% (11.6398 => 12.9241, std.dev.: 0.0131) MultiSource/Applications/lemon/lemon: 10.71% (0.2391 => 0.2647, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.22% (2.0346 => 2.2425, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.11% (4.6926 => 5.1669, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.63% (0.5584 => 0.6122, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 8.66% (11.9555 => 12.9909, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.54% (0.3792 => 0.4002, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.65% (29.0505 => 181.4637, std.dev.: 0.0317) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.86% (0.3693 => 0.4094, std.dev.: 0.0026) MultiSource/Applications/ClamAV/clamscan: 9.56% (0.2802 => 0.3070, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6086, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 6.08% (0.2122 => 0.2251, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6719, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2378, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6836, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-2: 4.65% (1.8057 => 1.8896, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2019, std.dev.: 0.0032) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3067, std.dev.: 0.0030) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.45% (1.0142 => 1.0289, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2841, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 1.21% (4.0317 => 4.0803, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2074, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5860, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4781, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.30% (2.4764 => 2.4441, std.dev.: 0.0074) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5572, std.dev.: 0.0213) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.59% (17.2379 => 14.3782, std.dev.: 0.0573) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9733, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7919, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: -5.25% (0.2402 => 0.2276, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -4.21% (14.0481 => 13.4565, std.dev.: 0.1993) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2135, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8035, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.13% (197.4719 => 193.2616, std.dev.: 0.0205) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.13% (0.6293 => 0.6159, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5730, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1618, std.dev.: 0.0352) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0452, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 15:37:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 17:37:10 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130125233710.7253D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7949?compare_to=7945&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7949, Order: 173487, Start Time: 2013-01-25 21:26:26, End Time: 2013-01-25 23:37:25 To: 7945, Order: 173464, Start Time: 2013-01-25 18:44:49, End Time: 2013-01-25 20:55:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (215 on baseline) Performance Improvements: 2 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.46% (11.2136 => 11.0497, std.dev.: 0.0116) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.88% (0.8568 => 0.8407, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0665 => 0.0664, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8415 => 499.8506, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 44224.78% (1.1277 => 499.8506, std.dev.: 0.0082) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.03% (0.5229 => 1.6473, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: 20.76% (14.9895 => 18.1009, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 43.97% (14.1553 => 20.3792, std.dev.: 0.0169) MultiSource/Benchmarks/MallocBench/gs/gs: 17.97% (4.1105 => 4.8490, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.63% (1.1048 => 1.7305, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.28% (7.1582 => 37.3143, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.73% (3.4629 => 6.4316, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.46% (0.6222 => 1.0917, std.dev.: 0.0022) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10231.94% (0.0720 => 7.4390, std.dev.: 0.0055) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11162900.00% (0.0001 => 11.1630, std.dev.: 0.0520) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574800.00% (0.0001 => 0.5749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482900.00% (0.0001 => 5.4830, std.dev.: 0.0313) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 815.79% (1.1194 => 10.2514, std.dev.: 0.0500) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 148.58% (22.1758 => 55.1239, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.56% (0.0929 => 0.1826, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.64% (2.9384 => 4.6322, std.dev.: 0.0017) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.81% (7.0540 => 10.8495, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.59% (1.5859 => 2.4040, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/distray/distray: 48.39% (0.1056 => 0.1567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.04% (8.1363 => 11.9638, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.28% (0.0439 => 0.0629, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.83% (2.2024 => 3.1237, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 39.53% (0.3109 => 0.4338, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 39.24% (21.9371 => 30.5460, std.dev.: 0.0214) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0004) SingleSource/UnitTests/vla: 37.18% (0.0355 => 0.0487, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.20% (4.2646 => 5.6806, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.46% (1.5415 => 2.0418, std.dev.: 0.0098) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.44% (0.4615 => 0.6112, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.69% (0.0479 => 0.0626, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 29.51% (1.1642 => 1.5077, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/05-eks/eks: 29.50% (0.4299 => 0.5567, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.80% (0.1125 => 0.1449, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.64% (0.5105 => 0.6516, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.21% (0.6675 => 0.8491, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.74% (0.1892 => 0.2398, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0033) SingleSource/Benchmarks/McGill/chomp: 26.47% (0.1655 => 0.2093, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 26.34% (9.4845 => 11.9826, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.27% (0.0746 => 0.0942, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.95% (3.8922 => 4.9024, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/08-main/main: 25.72% (0.2554 => 0.3211, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.02% (0.1143 => 0.1429, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 24.88% (0.4289 => 0.5356, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.48% (0.1695 => 0.2110, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 24.42% (1.0722 => 1.3340, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.26% (0.3121 => 0.3878, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.02% (1.4186 => 1.7594, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 23.72% (0.4620 => 0.5716, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 22.88% (0.0730 => 0.0897, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.54% (0.7115 => 0.8719, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.44% (0.1555 => 0.1904, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.02% (0.0672 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.93% (0.2700 => 0.3292, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.16% (0.7835 => 0.9493, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 21.05% (0.3098 => 0.3750, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 21.00% (0.0662 => 0.0801) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.89% (0.0675 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 20.87% (0.1236 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.73% (1.3050 => 1.5755, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.69% (5.7591 => 6.9505, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 20.68% (0.6456 => 0.7791, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.14% (0.8172 => 0.9818, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.03% (0.1163 => 0.1396, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 19.94% (0.1695 => 0.2033, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 19.90% (0.1151 => 0.1380, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.83% (0.5860 => 0.7022, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.66% (4.9449 => 5.9170, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.48% (0.1940 => 0.2318, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 19.38% (0.0614 => 0.0733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.08% (0.5020 => 0.5978, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.07% (0.0886 => 0.1055) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.87% (5.0018 => 5.9456, std.dev.: 0.0111) MultiSource/Applications/d/make_dparser: 18.85% (3.3354 => 3.9641, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.78% (0.3307 => 0.3928, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.71% (0.0834 => 0.0990, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.2758 => 0.3262, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.17% (0.1117 => 0.1320, std.dev.: 0.0037) MultiSource/Applications/lambda-0_1_3/lambda: 18.05% (0.7433 => 0.8775, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 17.90% (0.0648 => 0.0764, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.88% (0.5569 => 0.6565, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.88% (0.9765 => 1.1511, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 17.69% (1.1840 => 1.3935, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 17.47% (3.8723 => 4.5487, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 17.44% (2.0273 => 2.3808, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/18-imp/imp: 17.21% (0.3423 => 0.4012, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.20% (0.5981 => 0.7010, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.19% (1.1861 => 1.3900, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ReedSolomon: 17.03% (0.2049 => 0.2398, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.00% (0.2065 => 0.2416, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.97% (0.3441 => 0.4025, std.dev.: 0.0070) MultiSource/Applications/siod/siod: 16.69% (2.2969 => 2.6802, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.62% (0.0770 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.54% (0.3283 => 0.3826, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.51% (0.0933 => 0.1087, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.39% (0.8101 => 0.9429, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 16.21% (0.3232 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.6450 => 0.7486, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.38% (0.3180 => 0.3669, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.09% (0.8921 => 1.0267, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.77% (0.3379 => 0.3878, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.47% (0.8067 => 0.9234, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.02% (0.2603 => 0.2968, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.87% (0.3865 => 0.4401, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.72% (0.4636 => 0.5272, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.29% (0.3387 => 0.3837, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.01% (0.4203 => 0.4750, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 12.90% (1.5603 => 1.7616, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.55% (0.4103 => 0.4618, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: 12.52% (0.3282 => 0.3693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 12.24% (0.3684 => 0.4135, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 12.21% (0.3603 => 0.4043, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 12.10% (0.4048 => 0.4538, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 12.06% (17.1811 => 19.2539, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout-C++/lists: 12.01% (0.3422 => 0.3833, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.81% (0.2430 => 0.2717, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.17% (0.4064 => 0.4518, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 11.13% (0.3092 => 0.3436, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.06% (0.3427 => 0.3806, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 10.93% (0.3826 => 0.4244, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.81% (0.3886 => 0.4306, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67% (14.3668 => 15.8995, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.10% (0.2831 => 0.3117, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.79% (0.3543 => 0.3890, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.65% (0.3473 => 0.3808, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.32% (2.0665 => 2.2590, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.18% (0.2756 => 0.3009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.18% (0.2877 => 0.3141, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 9.16% (0.2905 => 0.3171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 8.92% (1.2842 => 1.3988, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.92% (0.3162 => 0.3444, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.88% (0.2793 => 0.3041, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.82% (0.3650 => 0.3972, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 8.81% (0.2714 => 0.2953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.67% (0.2872 => 0.3121, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 8.60% (63.2438 => 68.6811, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wc: 8.45% (0.3052 => 0.3310, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.28% (0.3935 => 0.4261, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.13% (0.3136 => 0.3391, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 7.73% (0.6030 => 0.6496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.66% (0.7326 => 0.7887, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.64% (2.2022 => 2.3704, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.52% (0.3177 => 0.3416, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 7.39% (0.5925 => 0.6363, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (10.3673 => 11.0497, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.52% (0.4879 => 0.5197, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.09% (0.3131 => 0.3259, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.23% (7.9617 => 8.1390, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4728, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6967, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3857, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.88% (4.2280 => 4.4764, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: 4.80% (3.1578 => 3.3093, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1063, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.97% (0.9957 => 1.0253, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.81% (8.6802 => 8.9245, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.35% (3.6395 => 3.7252, std.dev.: 0.0066) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.66% (9.1159 => 9.2671, std.dev.: 0.0280) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3047, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.14% (6.5088 => 6.5833, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.72% (5.2763 => 1.1758, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -75.14% (0.8651 => 0.2151, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.22% (5.3855 => 4.4580, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.63% (5.3526 => 4.4627, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -13.36% (10.4361 => 9.0422, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -8.00% (54.1659 => 49.8328, std.dev.: 0.0246) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.67% (1.7609 => 1.6259, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.03% (1.9577 => 0.6651, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3075, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.45% (1.5373 => 1.0230, std.dev.: 0.0029) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4131, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8506, std.dev.: 0.0072) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0055, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.96% (1.6925 => 1.4224, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7342, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.88% (0.9540 => 0.8407, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4948, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.15% (3.2416 => 2.9125, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5578, std.dev.: 0.1070) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.91% (4.8142 => 4.4816, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.16% (1.2373 => 1.1611, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7078, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.93% (1.5835 => 1.5055, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8295, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.87% (3.2827 => 3.1555, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -2.00% (3.7221 => 3.6476, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/ary3: -1.99% (3.6994 => 3.6256, std.dev.: 0.0155) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5788, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2310, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8571, std.dev.: 0.0007) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0001) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 16:41:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 18:41:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126004125.D64DA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7950?compare_to=7946&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7950, Order: 173504, Start Time: 2013-01-25 22:35:34, End Time: 2013-01-26 00:41:43 To: 7946, Order: 173472, Start Time: 2013-01-25 20:05:29, End Time: 2013-01-25 22:13:28 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 15 (28 on baseline) Performance Improvements: 20 (24 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1029 (1011 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Towers: 58.52% (0.0487 => 0.0772, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Queens: 56.99% (0.0465 => 0.0730, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.41% (0.1751 => 0.2301, std.dev.: 0.0086) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 30.93% (0.1219 => 0.1596, std.dev.: 0.0125) MultiSource/Applications/JM/ldecod/ldecod: 7.57% (7.4343 => 7.9973, std.dev.: 0.1176) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.41% (1.0052 => 1.0797, std.dev.: 0.0232) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.07% (25.2027 => 26.4795, std.dev.: 0.2360) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Towers: 57.60% (0.0250 => 0.0394, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bisort/bisort: 36.79% (0.6883 => 0.9415, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/heapsort: 32.47% (3.6834 => 4.8793, std.dev.: 0.0796) MultiSource/Applications/SPASS/SPASS: 13.02% (8.9250 => 10.0870, std.dev.: 0.1615) SingleSource/Benchmarks/Misc/ffbench: 2.96% (1.3905 => 1.4316, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.94% (0.4018 => 0.4136, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.68% (1.3789 => 1.4021, std.dev.: 0.0088) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.66% (1.2247 => 1.2450, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/loader/loader: -31.61% (0.4831 => 0.3304, std.dev.: 0.0120) SingleSource/Regression/C/bigstack: -23.22% (0.0491 => 0.0377, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -22.99% (0.3271 => 0.2519, std.dev.: 0.0256) MultiSource/Benchmarks/FreeBench/distray/distray: -21.19% (0.1265 => 0.0997, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -19.59% (0.3655 => 0.2939, std.dev.: 0.0122) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -14.52% (5.6287 => 4.8115, std.dev.: 0.2856) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.76% (1.2616 => 1.1006, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -10.57% (1.1793 => 1.0546, std.dev.: 0.0463) MultiSource/Applications/ClamAV/clamscan: -9.73% (19.0770 => 17.2210, std.dev.: 0.4398) MultiSource/Applications/lua/lua: -9.17% (4.9133 => 4.4629, std.dev.: 0.1064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -8.97% (1.0793 => 0.9825, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: -6.90% (0.3872 => 0.3605, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.16% (1.1677 => 1.0958, std.dev.: 0.0193) MultiSource/Applications/SIBsim4/SIBsim4: -5.04% (1.6018 => 1.5211, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.07% (1.0244 => 1.0134, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -5.37% (3.2636 => 3.0884, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.66% (0.3773 => 0.3635, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.39% (0.4278 => 0.4133, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -1.42% (43.7055 => 43.0854, std.dev.: 0.2236) SingleSource/Benchmarks/Misc/ReedSolomon: -1.26% (8.6446 => 8.5357, std.dev.: 0.0315) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.16% (1.1314 => 1.2124, std.dev.: 0.1064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.05% (0.0218 => 0.0229, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.92% (0.0433 => 0.0437, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 4.39% (0.0342 => 0.0357, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.62% (0.0323 => 0.0325, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.43% (0.0429 => 0.0448, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/casts: 1.94% (0.0206 => 0.0210, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 1.81% (0.0221 => 0.0225, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -26.11% (0.0314 => 0.0232, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -10.55% (0.1668 => 0.1492, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: -14.28% (1.9271 => 1.6519, std.dev.: 0.0863) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.25% (0.4079 => 0.4028, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.41% (0.1447 => 0.1453, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.52% (0.1032 => 0.0975, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0278 => 0.0278, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.80% (0.0611 => 0.0600, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.62% (1.1790 => 1.1863, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0018 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -65.38% (0.0026 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0607 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.66% (0.0319 => 0.0285, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.30% (0.7474 => 0.7721, std.dev.: 0.0209) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 85.71% (0.0042 => 0.0078, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.12% (12.7576 => 12.7725, std.dev.: 0.0123) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Stanford/Queens: 67.43% (0.0436 => 0.0730, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Towers: 52.57% (0.0506 => 0.0772, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/factor: 50.00% (0.0336 => 0.0504, std.dev.: 0.0053) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.98% (0.1798 => 0.2301, std.dev.: 0.0086) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.27% (23.5861 => 26.4795, std.dev.: 0.2360) MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.26% (1.0960 => 1.2304, std.dev.: 0.0499) MultiSource/Benchmarks/Bullet/bullet: 9.82% (33.2440 => 36.5092, std.dev.: 1.0714) MultiSource/Applications/JM/ldecod/ldecod: 8.76% (7.3529 => 7.9973, std.dev.: 0.1176) MultiSource/Applications/oggenc/oggenc: 7.60% (5.3553 => 5.7623, std.dev.: 0.1321) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.41% (1.0052 => 1.0797, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.70% (0.8912 => 0.9420, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.69% (0.9588 => 1.0134, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 5.69% (1.4392 => 1.5211, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.91% (0.9381 => 0.9842, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.65% (0.9564 => 1.0009, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.34% (0.9507 => 0.9825, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 323862.50% (0.0008 => 2.5917, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 102.77% (1.1825 => 2.3977, std.dev.: 0.0223) SingleSource/Benchmarks/Stanford/Towers: 96.02% (0.0201 => 0.0394, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 23.29% (1.5397 => 1.8983, std.dev.: 0.0102) SingleSource/Benchmarks/Misc-C++/stepanov_container: 18.27% (5.0421 => 5.9634, std.dev.: 0.0350) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.06% (4.2042 => 4.8793, std.dev.: 0.0796) MultiSource/Applications/SPASS/SPASS: 11.27% (9.0650 => 10.0870, std.dev.: 0.1615) MultiSource/Applications/JM/lencod/lencod: 5.11% (6.8159 => 7.1642, std.dev.: 0.1024) MultiSource/Benchmarks/Bullet/bullet: 4.74% (7.2040 => 7.5452, std.dev.: 0.0859) MultiSource/Applications/lua/lua: 1.91% (29.0327 => 29.5877, std.dev.: 0.0784) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.81% (42.3194 => 43.0854, std.dev.: 0.2236) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.24% (1.2298 => 1.2450, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.63% (0.0808 => 0.0512, std.dev.: 0.0025) SingleSource/Benchmarks/SmallPT/smallpt: -25.42% (0.1888 => 0.1408, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: -25.14% (0.0692 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -21.56% (0.1684 => 0.1321, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.16% (0.0676 => 0.0560, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.51% (10.2703 => 9.3964, std.dev.: 0.1239) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -7.34% (1.6874 => 1.5636, std.dev.: 0.0234) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.09% (0.6885 => 0.6397, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.86% (0.9124 => 0.8498, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.04% (0.2481 => 0.2356, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.52% (5.0381 => 4.8610, std.dev.: 0.0419) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.28% (1.3220 => 1.2918, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.76% (16.6791 => 13.8838, std.dev.: 0.1716) SingleSource/Benchmarks/Shootout/nestedloop: -9.55% (0.2200 => 0.1990, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/hash: -8.78% (4.5259 => 4.1286, std.dev.: 0.1508) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -8.69% (1.4588 => 1.3320, std.dev.: 0.0488) SingleSource/Benchmarks/Shootout-C++/lists1: -6.99% (0.6628 => 0.6165, std.dev.: 0.0178) MultiSource/Applications/SIBsim4/SIBsim4: -5.29% (3.5443 => 3.3568, std.dev.: 0.0434) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.87% (0.3201 => 0.3045, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.94% (1.4446 => 1.4021, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: -2.80% (63.1520 => 61.3848, std.dev.: 0.0923) SingleSource/Benchmarks/Shootout-C++/lists: -2.35% (17.2182 => 16.8141, std.dev.: 0.0421) SingleSource/Benchmarks/Misc/mandel-2: -1.31% (0.8521 => 0.8409, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ReedSolomon: -1.26% (8.6447 => 8.5357, std.dev.: 0.0315) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.64% (1.2047 => 1.2124, std.dev.: 0.1064) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.72% (0.0233 => 0.0229, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.10% (0.0451 => 0.0437, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.39% (0.0394 => 0.0357, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0098) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.67% (0.0445 => 0.0448, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0227 => 0.0225, std.dev.: 0.0067) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0018) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.48% (0.1530 => 0.1492, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: -14.38% (1.9293 => 1.6519, std.dev.: 0.0863) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4049 => 0.4028, std.dev.: 0.0265) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.77% (0.1510 => 0.1453, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.31% (0.0978 => 0.0975, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.69% (0.0590 => 0.0600, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.12% (1.1617 => 1.1863, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -66.67% (0.0027 => 0.0009, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.34% (0.0268 => 0.0285, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.82% (0.7437 => 0.7721, std.dev.: 0.0209) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.22% (0.0092 => 0.0078, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.04% (12.7781 => 12.7725, std.dev.: 0.0123) Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 16:43:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 18:43:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126004312.283692A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7951?compare_to=7947&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7951, Order: 173515, Start Time: 2013-01-25 23:09:38, End Time: 2013-01-26 00:43:29 To: 7947, Order: 173484, Start Time: 2013-01-25 21:11:59, End Time: 2013-01-25 22:46:07 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (108 on baseline) Performance Improvements: 0 (102 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/ofstream_ctor: 3.66% (0.2982 => 0.3091, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4393 => 0.4527, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.26% (0.0514 => 0.0870, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.76% (0.6395 => 0.8810, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.38% (0.5688 => 0.7530, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.28% (0.5805 => 0.7679, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.24% (0.6260 => 0.8278, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.89% (0.5456 => 0.7196, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.74% (0.6395 => 0.8425, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.65% (0.5567 => 0.7329, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.60% (0.5849 => 0.7697, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.52% (0.5575 => 0.7332, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.18% (0.5581 => 0.7321, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.40% (0.5941 => 0.7747, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.92% (0.5859 => 0.7612, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.62% (0.6033 => 0.7820, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.99% (0.6440 => 0.8307, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.83% (1.6474 => 2.1223, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.74% (0.6189 => 0.7968, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.76% (0.6304 => 0.8054, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.51% (0.6230 => 0.7944, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.65% (0.5802 => 0.7348, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.55% (0.6660 => 0.8428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.21% (0.5925 => 0.7478, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.21% (0.5705 => 0.7200, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.93% (0.5857 => 0.7376, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.43% (0.5478 => 0.6871, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.30% (0.5570 => 0.6979, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.92% (0.5591 => 0.6984, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.29% (0.5863 => 0.7287, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.83% (0.6052 => 0.7494, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.78% (0.7524 => 0.9313, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.66% (0.6446 => 0.7971, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.95% (0.6681 => 0.8214, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.81% (0.6194 => 0.7607, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.47% (0.6297 => 0.7712, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.41% (0.0790 => 0.0967, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.37% (2.2587 => 2.7414, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.34% (0.6667 => 0.8090, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 20.92% (0.0693 => 0.0838, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.78% (0.7339 => 0.8791, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.39% (0.0621 => 0.0729, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.07% (0.3357 => 0.3863, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 14.65% (1.1450 => 1.3127, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.16% (4.5069 => 5.0551, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.86% (0.4916 => 0.5499, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 11.85% (0.4515 => 0.5050, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.44% (3.5339 => 3.9382, std.dev.: 0.0279) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.16% (1.6364 => 1.8191, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1982 => 0.2201, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.15% (0.2385 => 0.2627, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.28% (9.2283 => 10.0848, std.dev.: 0.0158) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.11% (0.1230 => 0.1342, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.27% (0.4524 => 0.4898, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.25% (0.2001 => 0.2166, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 7.93% (1.2515 => 1.3508, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.64% (0.5329 => 0.5736, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.34% (0.1731 => 0.1858, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.24% (0.4861 => 0.5213, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.14% (1.4642 => 1.5688, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.05% (0.7021 => 0.7516, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.64% (1.2784 => 1.3633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.93% (0.3255 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 5.48% (0.6750 => 0.7120, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (5.4682 => 5.6773, std.dev.: 0.0041) MultiSource/Applications/oggenc/oggenc: 3.21% (5.0226 => 5.1837, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 3.16% (0.3446 => 0.3555, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.75% (1.3864 => 1.4245, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 2.66% (0.8418 => 0.8642, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.26% (0.4427 => 0.4527, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.07% (0.7447 => 0.7601, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.85% (0.9557 => 0.9734, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.77% (22.4056 => 22.8029, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 1.61% (15.5079 => 15.7582, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.52% (1.3722 => 1.3930, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8192, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0081) SingleSource/Regression/C/uint64_to_float: 7.29% (0.5692 => 0.6107, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1651, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5323, std.dev.: 0.0845) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0126) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5074, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2457, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2681, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.38% (79.7170 => 80.8152, std.dev.: 0.4151) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.65% (0.1281 => 0.1119, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.11% (0.7198 => 0.6830, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: -4.95% (0.3194 => 0.3036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.80% (0.3812 => 0.3629, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.78% (0.3831 => 0.3648, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.68% (0.3891 => 0.3709, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.51% (0.4033 => 0.3851, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.32% (0.3821 => 0.3656, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -4.22% (2.4924 => 2.3873, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.20% (0.3884 => 0.3721, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.88% (0.3837 => 0.3688, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.87% (0.9852 => 0.9471, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/property: -3.86% (0.4199 => 0.4037, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: -3.64% (0.6347 => 0.6116, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.55% (0.4280 => 0.4128, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.40% (0.6441 => 0.6222, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.28% (0.3142 => 0.3039, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.96% (0.7779 => 0.7549, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.74% (2.1713 => 2.1117, std.dev.: 0.0035) MultiSource/Applications/hexxagon/hexxagon: -2.70% (1.3148 => 1.2793, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.59% (0.6484 => 0.6316, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.56% (0.9542 => 0.9298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.32% (14.2083 => 13.8785, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3146, std.dev.: 0.0110) MultiSource/Applications/sqlite3/sqlite3: -1.97% (17.1032 => 16.7656, std.dev.: 0.0106) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.94% (6.7716 => 6.6402, std.dev.: 0.0050) MultiSource/Applications/JM/lencod/lencod: -1.64% (16.1920 => 15.9269, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.63% (0.7919 => 0.7790, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.47% (1.0544 => 1.0389, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -1.45% (7.0961 => 6.9934, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.42% (1.2221 => 1.2048, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -1.39% (4.3330 => 4.2726, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.35% (1.2210 => 1.2045, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: -1.27% (0.9179 => 0.9062, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -1.15% (1.5610 => 1.5431, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0103) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.77% (1.3643 => 1.0263, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0775, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.82% (5.3397 => 4.1744, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0102) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1301, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3544, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.29% (0.5142 => 0.4613, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.65% (2.2633 => 2.1806, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.80% (7.9763 => 7.7531, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -2.16% (3.7241 => 3.6435, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.97% (1.3096 => 1.2838, std.dev.: 0.0061) MultiSource/Benchmarks/Bullet/bullet: -1.71% (7.3040 => 7.1793, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.69% (1.6219 => 1.5945, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4747, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6091, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6656, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.07% (1.6086 => 1.5914, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 18:18:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 20:18:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126021829.44C3A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7952?compare_to=7949&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7952, Order: 173529, Start Time: 2013-01-26 00:08:05, End Time: 2013-01-26 02:18:44 To: 7949, Order: 173487, Start Time: 2013-01-25 21:26:26, End Time: 2013-01-25 23:37:25 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (215 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/ofstream_ctor: 3.50% (0.3171 => 0.3282, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.37% (0.4750 => 0.4910, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 1.57% (0.7791 => 0.7913, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.03% (1.2993 => 1.3127, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.66% (11.0497 => 10.7562, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1330 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0664 => 0.0665, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8506 => 499.8532, std.dev.: 0.0027) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 44225.02% (1.1277 => 499.8532, std.dev.: 0.0027) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.48% (0.5229 => 1.6444, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 20.61% (14.9895 => 18.0782, std.dev.: 0.0123) MultiSource/Applications/kimwitu++/kc: 43.95% (14.1553 => 20.3770, std.dev.: 0.0168) MultiSource/Benchmarks/MallocBench/gs/gs: 17.90% (4.1105 => 4.8464, std.dev.: 0.0085) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.38% (1.1048 => 1.7277, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 419.40% (7.1582 => 37.1799, std.dev.: 0.0185) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.20% (3.4629 => 6.4132, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.18% (0.6222 => 1.0900, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.92% (0.0720 => 7.4397, std.dev.: 0.0063) MultiSource/Applications/SIBsim4/SIBsim4: 3833000.00% (0.0001 => 3.8331, std.dev.: 0.0043) MultiSource/Applications/SPASS/SPASS: 11165100.00% (0.0001 => 11.1652, std.dev.: 0.0166) MultiSource/Applications/kimwitu++/kc: 52000.00% (0.0001 => 0.0521, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849000.00% (0.0001 => 9.8491, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485100.00% (0.0001 => 5.4852, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.53% (1.1194 => 10.2149, std.dev.: 0.0401) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785) MultiSource/Applications/ClamAV/clamscan: 148.11% (22.1758 => 55.0200, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.95% (0.0929 => 0.1839, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.09% (0.1463 => 0.2503, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.52% (2.9384 => 4.6286, std.dev.: 0.0014) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.39% (7.0540 => 10.7493, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.38% (1.5859 => 2.4008, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 48.30% (0.1056 => 0.1566, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.80% (8.1363 => 11.9440, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.61% (2.2024 => 3.1188, std.dev.: 0.0070) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 38.20% (21.9371 => 30.3178, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops: 38.20% (0.1432 => 0.1979, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.85% (0.1062 => 0.1464, std.dev.: 0.0001) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.17% (4.2646 => 5.6790, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.48% (0.4615 => 0.6114, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.24% (1.5415 => 2.0385, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.96% (0.4299 => 0.5587, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 29.42% (1.1642 => 1.5067, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 28.39% (0.0479 => 0.0615, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.27% (0.1125 => 0.1443, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.50% (0.5105 => 0.6509, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.48% (0.1892 => 0.2412, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.19% (0.6675 => 0.8490, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.99% (0.0793 => 0.1007, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.86% (0.1143 => 0.1450, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 26.14% (9.4845 => 11.9634, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 25.80% (0.1655 => 0.2082, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.72% (3.8922 => 4.8933, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.61% (0.1906 => 0.2375, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.42% (0.3121 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 24.15% (0.4289 => 0.5325, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 24.07% (1.0722 => 1.3303, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.97% (1.4186 => 1.7587, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.71% (0.1337 => 0.1654, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 23.48% (0.4620 => 0.5705, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.13% (0.1695 => 0.2087, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 22.57% (0.6456 => 0.7913, std.dev.: 0.0012) MultiSource/Applications/viterbi/viterbi: 22.44% (0.1555 => 0.1904, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 22.28% (0.7115 => 0.8700, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.78% (0.2700 => 0.3288, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.67% (0.1029 => 0.1252, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.44% (0.1236 => 0.1501, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.21% (0.3098 => 0.3755, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 20.97% (0.7835 => 0.9478, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.75% (1.3050 => 1.5758, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.67% (0.0953 => 0.1150, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 20.50% (5.7591 => 6.9398, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 20.41% (0.1695 => 0.2041, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 20.07% (0.1151 => 0.1382, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.06% (0.1032 => 0.1239, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.06% (0.8172 => 0.9811, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.90% (0.5860 => 0.7026, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1940 => 0.2323, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.46% (4.9449 => 5.9074, std.dev.: 0.0148) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.19% (0.0886 => 0.1056, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.76% (0.5020 => 0.5962, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.71% (5.0018 => 5.9376, std.dev.: 0.0020) MultiSource/Applications/d/make_dparser: 18.59% (3.3354 => 3.9556, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.54% (0.3307 => 0.3920, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 18.30% (0.1268 => 0.1500, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.24% (0.2758 => 0.3261, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.97% (0.5569 => 0.6570, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.96% (0.9765 => 1.1519, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 17.92% (0.7433 => 0.8765, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.80% (0.2107 => 0.2482, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.48% (0.2065 => 0.2426, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.42% (2.0273 => 2.3804, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 17.40% (1.1840 => 1.3900, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/18-imp/imp: 17.38% (0.3423 => 0.4018, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 17.36% (3.8723 => 4.5446, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.10% (0.5981 => 0.7004, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.10% (1.1861 => 1.3889, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.82% (0.4203 => 0.4910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.62% (0.3441 => 0.4013, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 16.60% (2.2969 => 2.6782, std.dev.: 0.0171) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.57% (0.8101 => 0.9443, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 16.33% (0.3283 => 0.3819, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.19% (0.1044 => 0.1213, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.06% (0.6450 => 0.7486, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 16.00% (0.3232 => 0.3749, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.71% (0.2049 => 0.2371, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.48% (0.0704 => 0.0813, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.41% (0.3180 => 0.3670, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 15.01% (0.8921 => 1.0260, std.dev.: 0.0076) SingleSource/UnitTests/SignlessTypes/rem: 14.95% (0.1144 => 0.1315, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.35% (0.8067 => 0.9225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 14.09% (0.3379 => 0.3855, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.08% (0.0838 => 0.0956, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.83% (0.2603 => 0.2963, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.71% (0.3865 => 0.4395, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.59% (0.4636 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.05% (0.3387 => 0.3829, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 12.98% (0.2905 => 0.3282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.67% (0.4103 => 0.4623, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 12.57% (1.5603 => 1.7564, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 12.08% (0.4048 => 0.4537, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 11.89% (0.3422 => 0.3829, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 11.89% (0.3927 => 0.4394, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 11.88% (0.3603 => 0.4031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 11.75% (0.3684 => 0.4117, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 11.47% (17.1811 => 19.1512, std.dev.: 0.0162) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.22% (0.3092 => 0.3439, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.21% (0.3826 => 0.4255, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/oourafft: 11.06% (0.3282 => 0.3645, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.45% (0.3427 => 0.3785, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.42% (0.3561 => 0.3932, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.41% (0.3516 => 0.3882, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.39% (0.3543 => 0.3911, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.33% (14.3668 => 15.8516, std.dev.: 0.0072) SingleSource/UnitTests/ObjC/exceptions-4: 10.33% (0.3543 => 0.3909, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.32% (0.3497 => 0.3858, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.96% (0.1114 => 0.1225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 9.75% (0.2831 => 0.3107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.65% (0.2871 => 0.3148, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.31% (2.0665 => 2.2589, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 8.97% (0.2877 => 0.3135, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 8.94% (1.2842 => 1.3990, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.82% (0.3162 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.77% (0.3650 => 0.3970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.65% (0.2891 => 0.3141, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.39% (0.2872 => 0.3113, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.31% (0.2756 => 0.2985, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.27% (63.2438 => 68.4756, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/random: 8.24% (0.2802 => 0.3033, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (0.3935 => 0.4257, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 8.11% (0.2725 => 0.2946, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.06% (0.2793 => 0.3018, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 7.96% (0.2714 => 0.2930, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 7.81% (0.3136 => 0.3381, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 7.16% (0.6030 => 0.6462, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 7.11% (0.7326 => 0.7847, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.90% (2.2022 => 2.3541, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.74% (0.3177 => 0.3391, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 6.65% (0.5925 => 0.6319, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.82% (0.4879 => 0.5163, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 3.75% (10.3673 => 10.7562, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/objinst: 3.64% (0.3131 => 0.3245, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.38% (7.9617 => 8.1511, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4687, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.91% (1.1145 => 1.2918, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.15% (1.1396 => 1.2439, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3856, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4531, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (3.1578 => 3.3106, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (2.0360 => 2.1044, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (8.6802 => 8.9025, std.dev.: 0.0264) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.51% (1.0313 => 1.0572, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.98% (9.1159 => 9.2966, std.dev.: 0.0280) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.96% (3.6395 => 3.7108, std.dev.: 0.0071) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (1.7254 => 1.7560, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3056, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.13% (6.5088 => 6.5825, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.77% (5.2763 => 1.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.37% (0.8651 => 0.2131, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.60% (5.3855 => 4.4376, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.02% (5.3526 => 4.4414, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -13.67% (10.4361 => 9.0092, std.dev.: 0.0108) SingleSource/UnitTests/Vector/constpool: -7.98% (54.1659 => 49.8458, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.96% (1.7609 => 1.6207, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.48% (1.9577 => 0.6563, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3088, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.57% (10.7105 => 7.4359, std.dev.: 0.0139) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8529, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4228, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7330, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.93% (0.9540 => 0.8402, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4915, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6113, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/chomp: -6.57% (1.2373 => 1.1560, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7053, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.36% (10.2830 => 9.8343, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0072) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -1.56% (3.7221 => 3.6641, std.dev.: 0.0103) MultiSource/Applications/sqlite3/sqlite3: -1.37% (4.6441 => 4.5807, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: -1.06% (6.2999 => 6.2334, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8584, std.dev.: 0.0087) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0001) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 18:40:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 20:40:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126024026.F38192A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7953?compare_to=7951&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7953, Order: 173540, Start Time: 2013-01-26 01:06:58, End Time: 2013-01-26 02:40:42 To: 7951, Order: 173515, Start Time: 2013-01-25 23:09:38, End Time: 2013-01-26 00:43:29 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.92% (0.6914 => 0.7185, std.dev.: 0.0031) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.43% (0.0974 => 0.1621, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.52% (0.1132 => 0.1602, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.03% (0.6395 => 0.8827, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.79% (0.5688 => 0.7553, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.59% (0.5805 => 0.7697, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.35% (0.5456 => 0.7221, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.28% (0.5567 => 0.7364, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.07% (0.5849 => 0.7725, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.96% (0.6395 => 0.8439, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.70% (0.5575 => 0.7342, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.54% (0.5581 => 0.7341, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.15% (0.6033 => 0.7852, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.13% (0.6189 => 0.7992, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.13% (0.6440 => 0.8316, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.93% (1.6474 => 2.1240, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.49% (0.6676 => 0.8578, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.24% (0.6304 => 0.8084, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.77% (0.6230 => 0.7960, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.59% (0.6660 => 0.8431, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.19% (0.5925 => 0.7477, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.08% (0.5705 => 0.7193, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.95% (0.5857 => 0.7377, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.80% (0.5569 => 0.7006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.63% (0.5478 => 0.6882, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.58% (0.5570 => 0.6995, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.25% (0.5591 => 0.7003, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.22% (0.5863 => 0.7283, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.05% (0.6446 => 0.7996, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.04% (0.7524 => 0.9333, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.03% (0.6052 => 0.7506, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.44% (0.6681 => 0.8247, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.05% (0.6194 => 0.7622, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.74% (0.6297 => 0.7729, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.62% (2.2587 => 2.7470, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.33% (0.6667 => 0.8089, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.85% (0.7339 => 0.8796, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.93% (0.1146 => 0.1340, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.22% (0.3357 => 0.3868, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 14.99% (1.1450 => 1.3166, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.64% (4.5069 => 5.0765, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.39% (0.4916 => 0.5525, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.03% (0.4515 => 0.5058, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.56% (3.5339 => 3.9424, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.45% (0.1982 => 0.2209, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.40% (1.6364 => 1.8230, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.14% (0.1230 => 0.1367, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 9.56% (9.2283 => 10.1104, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash: 8.66% (0.4524 => 0.4916, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.63% (1.2515 => 1.3595, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.20% (0.2001 => 0.2165, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.11% (0.5329 => 0.5761, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.86% (0.1731 => 0.1867, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 7.82% (0.4861 => 0.5241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.34% (1.4642 => 1.5716, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.73% (1.2784 => 1.3644, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.11% (0.3255 => 0.3454, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.84% (0.6750 => 0.7144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.33% (0.3319 => 0.3496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (5.4682 => 5.6889, std.dev.: 0.0026) MultiSource/Applications/oggenc/oggenc: 3.69% (5.0226 => 5.2079, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.30% (0.3394 => 0.3506, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 2.88% (1.3864 => 1.4263, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.72% (0.8418 => 0.8647, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.42% (0.4427 => 0.4534, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.41% (22.4056 => 22.9455, std.dev.: 0.0205) MultiSource/Applications/minisat/minisat: 2.38% (0.7447 => 0.7624, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.26% (0.9557 => 0.9773, std.dev.: 0.0053) MultiSource/Applications/SPASS/SPASS: 1.99% (15.5079 => 15.8172, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.79% (1.3722 => 1.3968, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.2300 => 1.2448, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8106, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.98% (0.9531 => 1.0292, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1650, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5751 => 56.4377, std.dev.: 0.0689) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1035, std.dev.: 0.0070) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2478, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2231 => 18.4981, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.18% (10.3489 => 10.4715, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.04% (0.7198 => 0.6835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -4.26% (2.4924 => 2.3863, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/exceptions-4: -4.02% (0.3880 => 0.3724, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -4.01% (0.3812 => 0.3659, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.98% (0.3821 => 0.3669, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.97% (0.4033 => 0.3873, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: -3.95% (0.3848 => 0.3696, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3831 => 0.3680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3896 => 0.3743, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.91% (0.3891 => 0.3739, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.74% (0.4176 => 0.4020, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.73% (0.9852 => 0.9485, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.65% (0.3837 => 0.3697, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3884 => 0.3752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.12% (0.6347 => 0.6149, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.10% (0.3323 => 0.3220, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: -3.07% (0.4199 => 0.4070, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.97% (0.6441 => 0.6250, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.80% (0.9542 => 0.9275, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.62% (0.6484 => 0.6314, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.53% (2.1713 => 2.1164, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference: -2.46% (0.7779 => 0.7588, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.45% (1.3148 => 1.2826, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -2.15% (20.7746 => 20.3286, std.dev.: 0.0274) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.06% (14.2083 => 13.9162, std.dev.: 0.0165) MultiSource/Applications/sqlite3/sqlite3: -1.91% (17.1032 => 16.7771, std.dev.: 0.0161) MultiSource/Applications/JM/lencod/lencod: -1.50% (16.1920 => 15.9490, std.dev.: 0.0092) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.37% (6.7716 => 6.6787, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.33% (1.0544 => 1.0404, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -1.18% (7.0961 => 7.0125, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.15% (1.2210 => 1.2069, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/gs/gs: -1.07% (4.3330 => 4.2866, std.dev.: 0.0085) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.30% (1.8100 => 0.7185, std.dev.: 0.0031) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3105, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.19% (1.3643 => 1.0343, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7551, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0748, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1971, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1267, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3565, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.22% (7.9763 => 7.7993, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/ary3: -2.22% (3.7241 => 3.6416, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.01% (1.3096 => 1.2833, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: -1.82% (7.3040 => 7.1709, std.dev.: 0.0225) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4664, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7092 => 3.6570, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.12% (1.6307 => 1.6124, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.05% (1.6219 => 1.6049, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 19:10:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 21:10:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126031027.BC4C22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7954?compare_to=7950&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7954, Order: 173537, Start Time: 2013-01-26 01:02:39, End Time: 2013-01-26 03:10:46 To: 7950, Order: 173504, Start Time: 2013-01-25 22:35:34, End Time: 2013-01-26 00:41:43 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 94 (93 on baseline) Performance Improvements: 44 (48 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 926 (922 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 265.28% (0.0504 => 0.1841, std.dev.: 0.0343) SingleSource/Regression/C/sumarray2d: 90.61% (0.0277 => 0.0528, std.dev.: 0.0012) SingleSource/UnitTests/2002-05-19-DivTest: 66.67% (0.0159 => 0.0265, std.dev.: 0.0005) SingleSource/Regression/C/test_indvars: 59.34% (0.0273 => 0.0435, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/neural/neural: 58.97% (0.1645 => 0.2615, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 41.63% (0.8947 => 1.2672, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.60% (0.8830 => 1.2503, std.dev.: 0.0234) MultiSource/Benchmarks/Olden/mst/mst: 41.52% (0.1315 => 0.1861, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.65% (0.8996 => 1.2653, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.17% (0.9131 => 1.2799, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.86% (0.9325 => 1.3042, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 39.78% (0.9247 => 1.2925, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.87% (0.9319 => 1.2941, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 38.16% (0.9595 => 1.3256, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.72% (0.9461 => 1.3030, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.40% (1.0075 => 1.3843, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.24% (1.0041 => 1.3780, std.dev.: 0.0961) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.20% (1.0060 => 1.3802, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 36.66% (0.9237 => 1.2623, std.dev.: 0.1275) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 35.13% (1.0116 => 1.3670, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 34.00% (1.1006 => 1.4748, std.dev.: 0.0942) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 33.79% (1.0009 => 1.3391, std.dev.: 0.1125) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.73% (1.0546 => 1.4103, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 33.58% (0.9842 => 1.3147, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.11% (1.0174 => 1.3543, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.38% (1.0134 => 1.3415, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.25% (0.9330 => 1.2339, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 32.05% (0.9316 => 1.2302, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 31.47% (1.0958 => 1.4406, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.97% (0.9109 => 1.1930, std.dev.: 0.0468) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.87% (0.9974 => 1.3053, std.dev.: 0.0827) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 30.06% (0.9934 => 1.2920, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 29.85% (0.9515 => 1.2355, std.dev.: 0.0901) MultiSource/Applications/sgefa/sgefa: 29.42% (0.3396 => 0.4395, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.39% (0.9212 => 1.1919, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.33% (0.9420 => 1.2183, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.52% (0.9322 => 1.1981, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 28.26% (0.9200 => 1.1800, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 28.19% (0.9945 => 1.2748, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 27.74% (0.9825 => 1.2550, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.01% (1.0471 => 1.3195, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.18% (1.0797 => 1.3516, std.dev.: 0.0845) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 20.10% (0.0796 => 0.0956, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.64% (0.0762 => 0.0904, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.97% (0.1314 => 0.1537, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 16.88% (1.2761 => 1.4915, std.dev.: 0.0665) SingleSource/Benchmarks/Shootout-C++/matrix: 16.55% (0.2272 => 0.2648, std.dev.: 0.0137) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 16.47% (0.2356 => 0.2744, std.dev.: 0.0149) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.84% (4.8610 => 5.5824, std.dev.: 0.2303) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14.39% (1.4366 => 1.6433, std.dev.: 0.0237) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.21% (4.8806 => 5.5742, std.dev.: 0.0377) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.91% (3.7438 => 4.2644, std.dev.: 0.1394) SingleSource/Benchmarks/Shootout-C++/objinst: 11.73% (0.2233 => 0.2495, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.12% (0.1966 => 0.2165, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.76% (1.7730 => 1.9460, std.dev.: 0.0652) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 8.42% (9.3964 => 10.1876, std.dev.: 0.1263) SingleSource/Benchmarks/McGill/chomp: 6.54% (0.1866 => 0.1988, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 5.02% (5.7623 => 6.0515, std.dev.: 0.0513) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 3.91% (0.4710 => 0.4894, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.88% (0.5309 => 0.5462, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 2.65% (17.3703 => 17.8298, std.dev.: 0.1144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 499.20% (2.1526 => 12.8983, std.dev.: 0.3663) SingleSource/Benchmarks/Shootout/matrix: 364.30% (1.5587 => 7.2370, std.dev.: 0.0924) MultiSource/Applications/sgefa/sgefa: 252.25% (0.3579 => 1.2607, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.39% (4.8277 => 15.9500, std.dev.: 0.1169) SingleSource/Benchmarks/Shootout-C++/ary: 170.24% (0.0205 => 0.0554, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary2: 161.18% (0.0170 => 0.0444, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 143.69% (0.0293 => 0.0714, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 76.32% (0.1571 => 0.2770, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 69.38% (2.3977 => 4.0612, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/matrix: 65.82% (2.8700 => 4.7589, std.dev.: 0.0211) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 38.35% (1.3320 => 1.8428, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.49% (3.1360 => 4.1236, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.29% (1.6448 => 2.1101, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 24.85% (5.7056 => 7.1236, std.dev.: 0.1698) SingleSource/Benchmarks/Misc/salsa20: 21.64% (7.4529 => 9.0654, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.95% (4.8052 => 5.8118, std.dev.: 0.0889) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 19.44% (0.2870 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.37% (5.1656 => 5.8561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.12% (4.9955 => 5.6510, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 9.32% (8.5357 => 9.3312, std.dev.: 0.0203) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.60% (0.6257 => 0.6795, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 8.45% (7.1642 => 7.7694, std.dev.: 0.0476) SingleSource/Benchmarks/Linpack/linpack-pc: 7.29% (49.1427 => 52.7250, std.dev.: 0.9342) SingleSource/Benchmarks/McGill/chomp: 7.22% (1.0371 => 1.1120, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.05% (4.7431 => 5.0774, std.dev.: 0.0041) MultiSource/Benchmarks/nbench/nbench: 6.51% (21.6931 => 23.1047, std.dev.: 0.4394) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.87% (40.1344 => 42.4922, std.dev.: 0.1657) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.37% (4.1874 => 4.4124, std.dev.: 0.0637) SingleSource/Benchmarks/Misc/pi: 4.47% (2.1094 => 2.2037, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.22% (5.0201 => 5.2321, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.21% (4.7276 => 4.8792, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.80% (2.8758 => 2.9563, std.dev.: 0.0257) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.21% (2.5597 => 2.5906, std.dev.: 0.0118) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Stanford/Towers: -34.97% (0.0772 => 0.0502, std.dev.: 0.0068) MultiSource/Benchmarks/VersaBench/dbms/dbms: -23.68% (1.2304 => 0.9390, std.dev.: 0.0859) MultiSource/Benchmarks/Fhourstones/fhourstones: -23.34% (0.2301 => 0.1764, std.dev.: 0.0054) MultiSource/Applications/viterbi/viterbi: -20.49% (0.2196 => 0.1746, std.dev.: 0.0160) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.89% (6.3416 => 5.7778, std.dev.: 0.1027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.69% (26.4795 => 24.1794, std.dev.: 0.6704) MultiSource/Benchmarks/Bullet/bullet: -7.14% (36.5092 => 33.9008, std.dev.: 0.6756) MultiSource/Applications/lambda-0_1_3/lambda: -6.00% (0.8712 => 0.8189, std.dev.: 0.0198) MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.27% (1.2305 => 1.1657, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/hash: -3.31% (0.4710 => 0.4554, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/lowercase: -66.81% (2.5917 => 0.8603, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.73% (11.5616 => 3.9617, std.dev.: 0.0945) SingleSource/Benchmarks/Misc/fp-convert: -61.98% (15.6694 => 5.9572, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.91% (0.4136 => 0.1782, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.80% (0.4576 => 0.2343, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Towers: -47.46% (0.0394 => 0.0207, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.74% (11.3658 => 6.3944, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.73% (5.3949 => 3.6290, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.88% (0.4459 => 0.3082, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.90% (0.5526 => 0.3984, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.18% (5.2594 => 3.8824, std.dev.: 0.1185) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.35% (4.4568 => 3.3271, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.47% (0.5759 => 0.4350, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.97% (5.0274 => 3.8224, std.dev.: 0.0341) SingleSource/Benchmarks/Shootout-C++/heapsort: -20.52% (4.8793 => 3.8783, std.dev.: 0.3755) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -19.37% (0.5885 => 0.4745, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.52% (5.8832 => 4.7939, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.21% (7.0787 => 5.9310, std.dev.: 0.1988) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -13.03% (5.3673 => 4.6679, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.37% (5.6959 => 4.9915, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.36% (3.1631 => 2.7720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.29% (9.7694 => 8.5687, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/09-vor/vor: -11.38% (0.1502 => 0.1331, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.58% (4.5484 => 4.2491, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.23% (5.5888 => 5.2408, std.dev.: 0.0021) MultiSource/Benchmarks/Bullet/bullet: -5.90% (7.5452 => 7.1004, std.dev.: 0.0983) SingleSource/Benchmarks/McGill/queens: -5.62% (1.7444 => 1.6463, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.53% (3.5186 => 3.3593, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/hash2: -4.53% (3.6763 => 3.5099, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.93% (8.7476 => 8.5784, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/whetstone: -1.73% (1.6321 => 1.6038, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.56% (85.2946 => 83.9631, std.dev.: 0.1342) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (3.7438 => 3.7026, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/mandel: -1.10% (1.0636 => 1.0519, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.03% (1.2124 => 1.2249, std.dev.: 0.0658) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.62% (0.0229 => 0.0235, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.06% (0.0437 => 0.0446, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.52% (0.0357 => 0.0348, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.77% (0.0325 => 0.0334, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.45% (0.0448 => 0.0450, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 7.14% (0.0210 => 0.0225, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 1.33% (0.0225 => 0.0228, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0232 => 0.0232, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.69% (0.1492 => 0.1547, std.dev.: 0.0238) MultiSource/Applications/lemon/lemon: -23.64% (1.6519 => 1.2614, std.dev.: 0.2724) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.85% (0.4028 => 0.4183, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.99% (0.1453 => 0.1511, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.28% (0.0975 => 0.0670, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0278 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.50% (0.0600 => 0.0609, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.77% (1.1863 => 1.3378, std.dev.: 0.0255) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 72.22% (0.0018 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 200.00% (0.0009 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0608 => 0.0612, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.81% (0.0285 => 0.0277, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 118.96% (0.7721 => 1.6906, std.dev.: 0.0405) SingleSource/Regression/C/2003-05-21-UnionBitfields: 900.00% (0.0001 => 0.0010) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -26.92% (0.0078 => 0.0057, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 162.99% (12.7725 => 33.5900, std.dev.: 0.5752) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 447.92% (0.0336 => 0.1841, std.dev.: 0.0343) SingleSource/Regression/C/sumarray2d: 92.70% (0.0274 => 0.0528, std.dev.: 0.0012) SingleSource/UnitTests/2002-05-19-DivTest: 63.58% (0.0162 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 59.65% (0.1638 => 0.2615, std.dev.: 0.0344) SingleSource/Regression/C/test_indvars: 57.04% (0.0277 => 0.0435, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.28% (0.8893 => 1.2653, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.72% (0.9120 => 1.2925, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.42% (0.8926 => 1.2623, std.dev.: 0.1275) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.25% (0.9061 => 1.2799, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.90% (0.9612 => 1.3543, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 40.78% (0.9788 => 1.3780, std.dev.: 0.0961) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.14% (0.9381 => 1.3147, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.01% (0.9564 => 1.3391, std.dev.: 0.1125) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.91% (0.9588 => 1.3415, std.dev.: 0.0467) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 39.80% (1.0088 => 1.4103, std.dev.: 0.0493) MultiSource/Benchmarks/Olden/mst/mst: 39.40% (0.1335 => 0.1861, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.39% (0.9091 => 1.2672, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.08% (0.8990 => 1.2503, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.71% (0.9855 => 1.3670, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.42% (0.9422 => 1.3042, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.05% (0.9998 => 1.3802, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.63% (0.9403 => 1.2941, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.13% (0.9010 => 1.2355, std.dev.: 0.0901) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.98% (0.9512 => 1.3030, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.80% (1.0119 => 1.3843, std.dev.: 0.0453) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.70% (0.8912 => 1.2183, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.44% (0.8736 => 1.1919, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.71% (1.0867 => 1.4748, std.dev.: 0.0942) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.14% (0.8732 => 1.1800, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.86% (0.8846 => 1.1930, std.dev.: 0.0468) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.46% (1.0052 => 1.3516, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.73% (0.9867 => 1.3195, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.65% (1.0860 => 1.4406, std.dev.: 0.0845) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.34% (1.0017 => 1.3256, std.dev.: 0.0584) SingleSource/Benchmarks/Stanford/IntMM: 32.25% (0.0431 => 0.0570, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.09% (0.9488 => 1.2533, std.dev.: 0.0646) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.01% (0.9507 => 1.2550, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.63% (0.9685 => 1.2748, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 31.27% (0.9127 => 1.1981, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.20% (0.9405 => 1.2339, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.62% (0.9993 => 1.3053, std.dev.: 0.0827) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.82% (0.9550 => 1.2302, std.dev.: 0.0436) MultiSource/Applications/sgefa/sgefa: 22.15% (0.3598 => 0.4395, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 18.76% (0.0805 => 0.0956, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.60% (1.0986 => 1.2920, std.dev.: 0.0214) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.49% (3.6295 => 4.2644, std.dev.: 0.1394) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 16.46% (1.4110 => 1.6433, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/objinst: 16.05% (0.2150 => 0.2495, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.45% (0.0783 => 0.0904, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.39% (0.1332 => 0.1537, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.52% (4.9104 => 5.5742, std.dev.: 0.0377) MultiSource/Applications/oggenc/oggenc: 13.00% (5.3553 => 6.0515, std.dev.: 0.0513) SingleSource/Benchmarks/McGill/chomp: 10.88% (0.1793 => 0.1988, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.74% (0.1955 => 0.2165, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.72% (1.8651 => 2.0091, std.dev.: 0.0449) MultiSource/Applications/minisat/minisat: 3.01% (0.7776 => 0.8010, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.77% (0.4762 => 0.4894, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107437.50% (0.0008 => 0.8603, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/ary3: 478.30% (2.2304 => 12.8983, std.dev.: 0.3663) SingleSource/Benchmarks/Shootout/matrix: 357.31% (1.5825 => 7.2370, std.dev.: 0.0924) MultiSource/Applications/sgefa/sgefa: 258.66% (0.3515 => 1.2607, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/ary2: 244.19% (0.0129 => 0.0444, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.44% (1.1825 => 4.0612, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.02% (4.8185 => 15.9500, std.dev.: 0.1169) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 213.16% (0.0228 => 0.0714, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 138.79% (0.0232 => 0.0554, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 85.78% (0.1491 => 0.2770, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 63.63% (2.9083 => 4.7589, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.80% (0.2562 => 0.3428, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.94% (3.1254 => 4.1236, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.52% (1.6547 => 2.1101, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 27.13% (5.6033 => 7.1236, std.dev.: 0.1698) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.32% (1.4588 => 1.8428, std.dev.: 0.0319) SingleSource/Regression/C/uint64_to_float: 21.80% (1.5397 => 1.8753, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/salsa20: 21.69% (7.4497 => 9.0654, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.80% (4.8112 => 5.8118, std.dev.: 0.0889) MultiSource/Applications/JM/lencod/lencod: 13.99% (6.8159 => 7.7694, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8561, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.95% (5.0033 => 5.6510, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 12.64% (20.5117 => 23.1047, std.dev.: 0.4394) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.58% (3.7074 => 4.0996, std.dev.: 0.1152) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.40% (0.6211 => 0.6795, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: 7.94% (8.6447 => 9.3312, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.27% (2.2499 => 2.4134, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.95% (4.7473 => 5.0774, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 6.67% (1.0425 => 1.1120, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.47% (4.1836 => 4.4124, std.dev.: 0.0637) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.99% (40.4729 => 42.4922, std.dev.: 0.1657) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (5.0310 => 5.2321, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.25% (4.7254 => 4.8792, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/pi: 3.02% (2.1390 => 2.2037, std.dev.: 0.0069) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.73% (2.8778 => 2.9563, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.18% (4.8076 => 4.8643, std.dev.: 0.0077) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.05% (0.0727 => 0.0494, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.70% (0.1684 => 0.1386, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.53% (0.7686 => 0.6646, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.05% (6.4235 => 5.7778, std.dev.: 0.1027) MultiSource/Applications/aha/aha: -8.06% (0.1378 => 0.1267, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.84% (0.3560 => 0.3281, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/hash2: -6.43% (0.5134 => 0.4804, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.94% (0.5746 => 0.5462, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/hash: -2.88% (0.4689 => 0.4554, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.71% (11.5523 => 3.9617, std.dev.: 0.0945) SingleSource/Benchmarks/Misc/fp-convert: -61.94% (15.6525 => 5.9572, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -57.02% (0.4146 => 0.1782, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.82% (0.4578 => 0.2343, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.84% (11.3868 => 6.3944, std.dev.: 0.0850) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.82% (5.4023 => 3.6290, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.77% (0.4452 => 0.3082, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.50% (0.5495 => 0.3984, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8824, std.dev.: 0.1185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.33% (0.5826 => 0.4350, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.18% (4.4467 => 3.3271, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8224, std.dev.: 0.0341) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -19.54% (0.5897 => 0.4745, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.41% (5.8755 => 4.7939, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.29% (7.0016 => 5.9310, std.dev.: 0.1988) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.17% (16.6791 => 14.3150, std.dev.: 0.2023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.16% (3.1921 => 2.7720, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.95% (5.3626 => 4.6679, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.56% (9.7992 => 8.5687, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.52% (5.7056 => 4.9915, std.dev.: 0.0306) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.12% (0.4081 => 0.3668, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: -7.79% (0.6628 => 0.6112, std.dev.: 0.0148) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.65% (0.3217 => 0.2971, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2491, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.37% (5.5974 => 5.2408, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/nestedloop: -5.68% (0.2200 => 0.2075, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/queens: -5.62% (1.7443 => 1.6463, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash2: -4.54% (3.6768 => 3.5099, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3593, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/lists: -2.64% (17.2182 => 16.7636, std.dev.: 0.0745) MultiSource/Applications/spiff/spiff: -2.59% (2.8571 => 2.7830, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5784, std.dev.: 0.0113) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.57% (85.3042 => 83.9631, std.dev.: 0.1342) SingleSource/Benchmarks/Misc/mandel-2: -1.40% (0.8521 => 0.8402, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.31% (1.6251 => 1.6038, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -1.28% (14.9448 => 14.7532, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7489, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (3.7450 => 3.7026, std.dev.: 0.0130) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.68% (1.2047 => 1.2249, std.dev.: 0.0658) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.86% (0.0233 => 0.0235, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.11% (0.0451 => 0.0446, std.dev.: 0.0116) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.68% (0.0394 => 0.0348, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.83% (0.0328 => 0.0334, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.12% (0.0445 => 0.0450, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/casts: 5.63% (0.0213 => 0.0225, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 0.44% (0.0227 => 0.0228, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 1.11% (0.1530 => 0.1547, std.dev.: 0.0238) MultiSource/Applications/lemon/lemon: -34.62% (1.9293 => 1.2614, std.dev.: 0.2724) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.31% (0.4049 => 0.4183, std.dev.: 0.0289) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.07% (0.1510 => 0.1511, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.49% (0.0978 => 0.0670, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.22% (0.0590 => 0.0609, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.16% (1.1617 => 1.3378, std.dev.: 0.0255) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.36% (0.0268 => 0.0277, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 127.32% (0.7437 => 1.6906, std.dev.: 0.0405) SingleSource/Regression/C/2003-05-21-UnionBitfields: 25.00% (0.0008 => 0.0010) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.04% (0.0092 => 0.0057, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 162.87% (12.7781 => 33.5900, std.dev.: 0.5752) Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 20:01:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 22:01:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130126040126.54CCB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7955?compare_to=7948&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7955, Order: 173526, Start Time: 2013-01-26 00:26:47, End Time: 2013-01-26 04:01:43 To: 7948, Order: 173468, Start Time: 2013-01-25 19:51:55, End Time: 2013-01-25 23:27:07 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (188 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (748 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/exceptions-3: 2.56% (0.3979 => 0.4081, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.13% (2.0601 => 2.1039, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.62% (127.4785 => 129.5395, std.dev.: 0.6620) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.60% (0.0625 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.59% (0.1063 => 0.1452, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.24% (0.2969 => 0.3837, std.dev.: 0.0140) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.52% (0.0547 => 0.0703, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.48% (0.1106 => 0.1421, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 28.36% (0.1107 => 0.1421, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.15% (0.4139 => 0.5304, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.64% (0.5900 => 0.7531, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.16% (0.0475 => 0.0604, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.97% (0.4994 => 0.6341, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: 26.78% (1.5932 => 2.0198, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.54% (0.0584 => 0.0739, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.29% (0.4253 => 0.5371, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.86% (0.1620 => 0.2039, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.82% (0.5000 => 0.6291, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.56% (0.1021 => 0.1282, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.85% (0.1549 => 0.1934, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 24.26% (0.0948 => 0.1178, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.85% (0.0633 => 0.0784, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.73% (0.1003 => 0.1241, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.68% (0.0642 => 0.0794, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.32% (0.1604 => 0.1978, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.24% (0.0822 => 0.1013, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744) MultiSource/Benchmarks/Olden/health/health: 23.14% (0.0821 => 0.1011, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 23.04% (0.1619 => 0.1992, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.01% (0.0452 => 0.0556, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.83% (0.3903 => 0.4794, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.64% (0.1462 => 0.1793, std.dev.: 0.0045) MultiSource/Applications/viterbi/viterbi: 22.07% (0.0947 => 0.1156, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.82% (0.2736 => 0.3333, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 21.72% (0.4029 => 0.4904, std.dev.: 0.0109) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.65% (0.0462 => 0.0562, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.42% (0.1088 => 0.1321, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.40% (0.2014 => 0.2445, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.37% (0.3271 => 0.3970, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/08-main/main: 21.26% (0.1218 => 0.1477, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 21.20% (0.0698 => 0.0846, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.18% (0.3890 => 0.4714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.14% (0.2866 => 0.3472, std.dev.: 0.0074) MultiSource/Applications/sgefa/sgefa: 20.92% (0.0808 => 0.0977, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 20.73% (0.1505 => 0.1817, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 20.70% (0.5546 => 0.6694, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.63% (0.0572 => 0.0690, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.33% (0.4658 => 0.5605, std.dev.: 0.0067) SingleSource/UnitTests/ObjC++/Hello: 20.32% (0.5826 => 0.7010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.99% (0.2792 => 0.3350, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.91% (1.3152 => 1.5771, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.83% (0.2875 => 0.3445, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 19.77% (0.5889 => 0.7053, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 19.75% (0.2714 => 0.3250, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.72% (0.0573 => 0.0686) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.69% (0.0513 => 0.0614, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 19.66% (1.8794 => 2.2488, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout-C++/matrix: 19.60% (0.2780 => 0.3325, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.58% (0.2738 => 0.3274, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 19.38% (0.2750 => 0.3283, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.27% (0.2729 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.24% (3.5627 => 4.2481, std.dev.: 0.0789) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.21% (0.1968 => 0.2346, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 19.16% (0.2823 => 0.3364, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: 19.08% (0.2725 => 0.3245, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.07% (1.6211 => 1.9302, std.dev.: 0.0182) SingleSource/Benchmarks/Shootout-C++/methcall: 19.05% (0.2813 => 0.3349, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/random: 19.05% (0.2803 => 0.3337, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 19.03% (0.2811 => 0.3346, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.03% (0.2911 => 0.3465, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 19.01% (0.9697 => 1.1540, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/property-reference: 18.99% (0.7171 => 0.8533, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.94% (0.5026 => 0.5978, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.89% (2.0673 => 2.4578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 18.85% (0.3258 => 0.3872, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/bh/bh: 18.77% (0.1284 => 0.1525, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 18.58% (0.3004 => 0.3562, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 18.51% (0.3096 => 0.3669, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 18.44% (0.9909 => 1.1736, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 18.43% (0.3267 => 0.3869, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 18.36% (0.3317 => 0.3926, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.31% (0.3195 => 0.3780, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.27% (0.3060 => 0.3619, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 18.23% (0.1421 => 0.1680, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.07% (0.3930 => 0.4640, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 17.98% (1.0781 => 1.2719, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-3: 17.95% (0.3460 => 0.4081, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.88% (0.3625 => 0.4273, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.86% (0.4361 => 0.5140, std.dev.: 0.0057) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.73% (2.7292 => 3.2130, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/sieve: 17.69% (0.3726 => 0.4385, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 17.64% (23.5202 => 27.6691, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.61% (0.3124 => 0.3674, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 17.56% (0.3446 => 0.4051, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.52% (0.3362 => 0.3951, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-4: 17.52% (0.3465 => 0.4072, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.50% (1.9966 => 2.3461, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.48% (1.9694 => 2.3136, std.dev.: 0.0174) SingleSource/UnitTests/ObjC/synchronized: 17.47% (0.3469 => 0.4075, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 17.44% (0.4146 => 0.4869, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 17.43% (0.3442 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.43% (0.3488 => 0.4096, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 17.39% (0.3496 => 0.4104, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 17.37% (0.3678 => 0.4317, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.37% (0.3282 => 0.3852, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 17.35% (0.3348 => 0.3929, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.34% (4.2109 => 4.9409, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/lists1: 17.23% (0.3477 => 0.4076, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 17.20% (0.4251 => 0.4982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 16.96% (0.3650 => 0.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.86% (0.3981 => 0.4652, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 16.85% (0.3643 => 0.4257, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.83% (0.3690 => 0.4311, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 16.81% (0.3724 => 0.4350, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.64% (4.4195 => 5.1549, std.dev.: 0.0087) MultiSource/Applications/lua/lua: 16.37% (1.4269 => 1.6605, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 16.21% (0.2566 => 0.2982, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.15% (0.2068 => 0.2402, std.dev.: 0.0077) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.15% (0.3845 => 0.4466, std.dev.: 0.0028) MultiSource/Applications/treecc/treecc: 16.00% (0.7875 => 0.9135, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++/bigfib: 15.68% (0.5012 => 0.5798, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.45% (0.0673 => 0.0777, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.00% (0.6435 => 0.7400, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 14.99% (5.5417 => 6.3724, std.dev.: 0.0117) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.88% (0.1028 => 0.1181, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 14.84% (2.1653 => 2.4867, std.dev.: 0.0198) MultiSource/Applications/SIBsim4/SIBsim4: 14.64% (0.2691 => 0.3085, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.43% (0.2737 => 0.3132, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0028) MultiSource/Applications/JM/lencod/lencod: 13.91% (4.6177 => 5.2601, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: 13.88% (2.1013 => 2.3929, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.55% (0.3084 => 0.3502, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.37% (0.5361 => 0.6078, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.84% (0.3498 => 0.3947, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 12.81% (0.6634 => 0.7484, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 12.74% (0.3336 => 0.3761, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.45% (0.2040 => 0.2294, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.36% (0.2103 => 0.2363, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 11.78% (0.4847 => 0.5418, std.dev.: 0.0022) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.33% (11.6398 => 12.9583, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.27% (0.7426 => 0.8263, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.51% (4.6926 => 5.1858, std.dev.: 0.0160) MultiSource/Applications/lemon/lemon: 10.50% (0.2391 => 0.2642, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 10.16% (2.0346 => 2.2413, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.67% (0.5584 => 0.6124, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 8.63% (11.9555 => 12.9868, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.83% (0.3792 => 0.4089, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.69% (29.0505 => 181.4742, std.dev.: 0.0273) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0284) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0089) MultiSource/Applications/ClamAV/clamscan: 9.49% (0.2802 => 0.3068, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.29% (0.3693 => 0.4036, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.44% (3.3903 => 3.6088, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6755, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2384, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6771, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8885, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5023, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.14% (15.8721 => 16.2116, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3044, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.40% (7.1849 => 7.2853, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.19% (1.0927 => 1.1057, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 1.19% (4.0317 => 4.0795, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2074, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4829, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5908, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.05% (2.0820 => 2.1039, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.51% (2.4764 => 2.4142, std.dev.: 0.0119) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5831, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.32% (17.2379 => 14.2527, std.dev.: 0.0936) SingleSource/UnitTests/Vector/multiplies: -11.36% (2.3713 => 2.1020, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -8.91% (0.2402 => 0.2188, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8017, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9590, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2317, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8062, std.dev.: 0.0088) SingleSource/Benchmarks/Dhrystone/dry: -3.49% (14.0481 => 13.5583, std.dev.: 0.0271) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.91% (0.6293 => 0.6110, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1652, std.dev.: 0.0333) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1980, std.dev.: 0.0091) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0448, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.35s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 20:37:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 22:37:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126043750.ACD0B2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7956?compare_to=7953&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7956, Order: 173556, Start Time: 2013-01-26 03:04:09, End Time: 2013-01-26 04:38:06 To: 7953, Order: 173540, Start Time: 2013-01-26 01:06:58, End Time: 2013-01-26 02:40:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (114 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.72% (80.0891 => 81.4678, std.dev.: 0.1392) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.87% (0.6395 => 0.8817, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.39% (0.5805 => 0.7685, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.30% (0.6260 => 0.8282, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.30% (0.5688 => 0.7525, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.04% (0.5456 => 0.7204, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.85% (0.5567 => 0.7340, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.61% (0.5849 => 0.7698, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.51% (0.6395 => 0.8410, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.37% (0.5581 => 0.7332, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.37% (0.5575 => 0.7324, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.48% (0.5941 => 0.7752, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.10% (0.6033 => 0.7849, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.89% (0.5859 => 0.7610, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.13% (0.6440 => 0.8316, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.72% (1.6474 => 2.1205, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.47% (0.6189 => 0.7951, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.27% (0.6676 => 0.8563, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.32% (0.6230 => 0.7932, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.63% (0.5802 => 0.7347, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.24% (0.5925 => 0.7480, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.12% (0.5705 => 0.7195, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.73% (0.5857 => 0.7364, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.46% (0.5570 => 0.6988, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.37% (0.5569 => 0.6982, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.28% (0.5478 => 0.6863, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.97% (0.5591 => 0.6987, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.98% (0.5863 => 0.7269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.86% (0.7524 => 0.9319, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.72% (0.6446 => 0.7975, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.69% (0.6052 => 0.7486, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.89% (0.6681 => 0.8210, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.68% (0.6194 => 0.7599, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.47% (0.6297 => 0.7712, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.67% (2.2587 => 2.7481, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.34% (0.6667 => 0.8090, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.50% (0.7339 => 0.8770, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3160, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.45% (4.5069 => 5.0680, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.27% (0.4916 => 0.5519, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.83% (0.4515 => 0.5049, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.47% (3.5339 => 3.9392, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.43% (1.6364 => 1.8235, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.30% (0.1982 => 0.2206, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.31% (0.2385 => 0.2631, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.84% (0.1230 => 0.1351, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.46% (9.2283 => 10.1017, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 8.67% (1.2515 => 1.3600, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 8.53% (0.4524 => 0.4910, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4861 => 0.5220, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.31% (1.4642 => 1.5712, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.88% (1.2784 => 1.3664, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 6.45% (0.3255 => 0.3465, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.6750 => 0.7137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.3319 => 0.3494, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.23% (5.4682 => 5.6995, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 3.71% (0.3446 => 0.3574, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.62% (0.3394 => 0.3517, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 3.55% (5.0226 => 5.2009, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4427 => 0.4547, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.70% (0.8418 => 0.8645, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 2.39% (0.7447 => 0.7625, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (22.4056 => 22.9082, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.18% (0.9557 => 0.9765, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 1.99% (15.5079 => 15.8170, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.95% (0.5168 => 0.5269, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.77% (1.3722 => 1.3965, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8062, std.dev.: 0.0085) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.65% (0.9531 => 1.0355, std.dev.: 0.0043) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6767 => 12.1638, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.68% (54.5751 => 56.5813, std.dev.: 0.0571) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (79.7170 => 81.4678, std.dev.: 0.1392) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2482, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.53% (18.2231 => 18.5013, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2692, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.52% (0.7198 => 0.6873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.99% (0.3831 => 0.3678, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.99% (0.3812 => 0.3660, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3880 => 0.3728, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (2.4924 => 2.3952, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3896 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3821 => 0.3674) SingleSource/UnitTests/ObjC/for-in: -3.84% (0.4033 => 0.3878, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: -3.79% (0.3848 => 0.3702, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.78% (0.3891 => 0.3744, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.62% (0.9852 => 0.9495, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.62% (0.3837 => 0.3698, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -3.57% (0.4176 => 0.4027, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.35% (0.3884 => 0.3754, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.95% (0.4199 => 0.4075, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.87% (0.9542 => 0.9268, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.65% (0.6484 => 0.6312, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: -2.64% (0.4280 => 0.4167, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.55% (0.6441 => 0.6277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.45% (2.1713 => 2.1181, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.40% (1.3148 => 1.2833, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9257, std.dev.: 0.0136) SingleSource/UnitTests/Vector/constpool: -1.94% (20.7746 => 20.3706, std.dev.: 0.0451) MultiSource/Applications/sqlite3/sqlite3: -1.90% (17.1032 => 16.7782, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: -1.52% (16.1920 => 15.9459, std.dev.: 0.0272) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.47% (6.7716 => 6.6721, std.dev.: 0.0096) MultiSource/Applications/JM/ldecod/ldecod: -1.21% (7.0961 => 7.0103, std.dev.: 0.0158) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.19% (1.2210 => 1.2065, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.17% (1.0544 => 1.0421, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.14% (1.2221 => 1.2082, std.dev.: 0.0014) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -59.96% (1.8100 => 0.7247, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3118, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.62% (1.3643 => 1.0284, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -23.52% (7.5137 => 5.7467, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0818, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/ary2: -23.02% (0.0756 => 0.0582, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1973, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.16% (2.5106 => 2.1300, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.61% (4.7378 => 4.0928, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3575, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.03% (0.3273 => 0.3141, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1726, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.51% (7.9763 => 7.7760, std.dev.: 0.0140) SingleSource/Benchmarks/Shootout/ary3: -2.51% (3.7241 => 3.6307, std.dev.: 0.0208) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.85% (7.3040 => 7.1692, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4713, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 21:00:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 23:00:08 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126050008.E60EA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7957?compare_to=7952&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7957, Order: 173554, Start Time: 2013-01-26 02:49:18, End Time: 2013-01-26 05:00:24 To: 7952, Order: 173529, Start Time: 2013-01-26 00:08:05, End Time: 2013-01-26 02:18:44 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (215 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (656 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.78% (10.7562 => 11.1628, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.29% (10.2149 => 10.3468, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.01% (4.4376 => 4.4824, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1329 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.30% (0.0665 => 0.0663, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8532 => 499.8537, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 44225.06% (1.1277 => 499.8537, std.dev.: 0.0033) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.05% (0.5229 => 1.6526, std.dev.: 0.0031) MultiSource/Applications/SPASS/SPASS: 20.79% (14.9895 => 18.1062, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 44.30% (14.1553 => 20.4256, std.dev.: 0.0107) MultiSource/Benchmarks/MallocBench/gs/gs: 18.38% (4.1105 => 4.8659, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.82% (1.1048 => 1.7326, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.56% (7.1582 => 37.4057, std.dev.: 0.0193) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.60% (3.4629 => 6.4273, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.43% (0.6222 => 1.0915, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.44% (0.0720 => 7.4444, std.dev.: 0.0065) MultiSource/Applications/SIBsim4/SIBsim4: 3832800.00% (0.0001 => 3.8329, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11164900.00% (0.0001 => 11.1650, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850500.00% (0.0001 => 9.8506, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484800.00% (0.0001 => 5.4849, std.dev.: 0.0178) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.32% (1.1194 => 10.3468, std.dev.: 0.0088) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783) MultiSource/Applications/ClamAV/clamscan: 149.10% (22.1758 => 55.2391, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 61.68% (0.0394 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.00% (2.9384 => 4.6133, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.26% (7.0540 => 10.8108, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.46% (1.5859 => 2.4020, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 48.86% (0.1056 => 0.1572, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.29% (8.1363 => 11.9839, std.dev.: 0.0116) SingleSource/UnitTests/vla: 42.82% (0.0355 => 0.0507, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.96% (2.2024 => 3.1266, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.85% (0.3109 => 0.4348, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: 38.29% (21.9371 => 30.3378, std.dev.: 0.0169) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.31% (4.2646 => 5.6850, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.94% (1.5415 => 2.0492, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.42% (0.4615 => 0.6111, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.47% (0.2271 => 0.2963, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 29.85% (1.1642 => 1.5117, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/05-eks/eks: 29.24% (0.4299 => 0.5556, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.58% (0.5105 => 0.6513, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.24% (0.6675 => 0.8493, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.53% (0.1892 => 0.2394, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.36% (0.0793 => 0.1002, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.33% (0.1584 => 0.2001, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.31% (0.1125 => 0.1421, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 26.22% (9.4845 => 11.9717, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.15% (3.8922 => 4.9101, std.dev.: 0.0107) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.90% (0.1143 => 0.1439, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.74% (0.0746 => 0.0938, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 25.39% (0.4289 => 0.5378, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 24.46% (1.0722 => 1.3345, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.46% (0.1337 => 0.1664, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.46% (0.1566 => 0.1949, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.32% (0.3121 => 0.3880, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1906 => 0.2369, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.24% (1.4186 => 1.7625, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 23.92% (0.4620 => 0.5725, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.30% (0.1695 => 0.2090, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 22.99% (0.6456 => 0.7940, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 22.74% (0.7115 => 0.8733, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.17% (0.1236 => 0.1510, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.93% (0.2700 => 0.3292, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 21.71% (0.7835 => 0.9536, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.44% (0.0527 => 0.0640, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.84% (1.3050 => 1.5769, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 20.79% (5.7591 => 6.9565, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.67% (0.0842 => 0.1016, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.5860 => 0.7031, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.86% (0.0886 => 0.1062, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.81% (0.8172 => 0.9791, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.74% (4.9449 => 5.9211, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.59% (0.1940 => 0.2320, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 19.12% (3.3354 => 3.9732, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.98% (5.0018 => 5.9511, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.72% (0.3307 => 0.3926, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.69% (0.5020 => 0.5958, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.59% (0.0834 => 0.0989, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 18.57% (0.7433 => 0.8813, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.35% (0.5569 => 0.6591, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.03% (0.9765 => 1.1526, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 17.75% (1.1840 => 1.3942, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 17.64% (3.8723 => 4.5552, std.dev.: 0.0079) MultiSource/Applications/treecc/treecc: 17.59% (2.0273 => 2.3839, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.27% (0.3423 => 0.4014, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.25% (1.1861 => 1.3907, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.23% (0.4203 => 0.4927, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.09% (0.5981 => 0.7003, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 17.00% (0.3283 => 0.3841, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.83% (0.3232 => 0.3776, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 16.81% (2.2969 => 2.6831, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.75% (0.0770 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.54% (0.3441 => 0.4010, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.42% (0.8101 => 0.9431, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.40% (0.0933 => 0.1086, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.38% (0.1044 => 0.1215, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.97% (0.6450 => 0.7480, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 15.86% (0.2049 => 0.2374, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.45% (0.8921 => 1.0299, std.dev.: 0.0050) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.22% (0.3180 => 0.3664, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3379 => 0.3877, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.62% (0.8067 => 0.9246, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.49% (0.0759 => 0.0869, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.41% (0.3865 => 0.4422, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 14.08% (0.2905 => 0.3314, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.00% (0.4636 => 0.5285, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 13.36% (1.5603 => 1.7687, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.26% (0.4103 => 0.4647, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.4048 => 0.4554, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 12.41% (0.3603 => 0.4050, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/lists: 12.36% (0.3422 => 0.3845, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.03% (17.1811 => 19.2475, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists1: 12.02% (0.3684 => 0.4127, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.81% (0.2430 => 0.2717, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 11.68% (0.3092 => 0.3453, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.53% (0.3826 => 0.4267, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 11.43% (0.3927 => 0.4376, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3427 => 0.3810, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.12% (0.3282 => 0.3647, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.07% (0.4064 => 0.4514, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 10.89% (0.3886 => 0.4309, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.81% (0.2831 => 0.3137, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.73% (0.1268 => 0.1404, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.67% (14.3668 => 15.9002, std.dev.: 0.0209) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.05% (2.0665 => 2.2741, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/exceptions-4: 9.96% (0.3543 => 0.3896, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.96% (0.3473 => 0.3819, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 9.96% (0.2871 => 0.3157, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.88% (0.3694 => 0.4059, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.86% (0.3561 => 0.3912, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.84% (0.3497 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.78% (0.3516 => 0.3860, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.70% (0.2877 => 0.3156, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.62% (1.2842 => 1.4078, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3650 => 0.3993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.34% (0.2891 => 0.3161, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.27% (0.3162 => 0.3455, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.11% (0.2756 => 0.3007, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.08% (0.3052 => 0.3329, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.03% (0.2802 => 0.3055, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.98% (0.2872 => 0.3130, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.98% (63.2438 => 68.9215, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/fibo: 8.95% (0.2725 => 0.2969, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.92% (0.3935 => 0.4286, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 8.73% (0.2714 => 0.2951, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.42% (0.3136 => 0.3400, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 8.33% (0.7326 => 0.7936, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 7.67% (10.3673 => 11.1628, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.04% (2.2022 => 2.3572, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.40% (7.9617 => 8.1526, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4765, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.90% (1.1145 => 1.2917, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6957, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 13.10% (0.5413 => 0.6122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2944 => 0.3144, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (4.2280 => 4.4651, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.3316 => 0.3445, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1067, std.dev.: 0.0098) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.57% (8.6802 => 8.9036, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7153, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2882, std.dev.: 0.0129) MultiSource/Benchmarks/Olden/bisort/bisort: 1.84% (0.8333 => 0.8486, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3033, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5790, std.dev.: 0.0079) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4545, std.dev.: 0.0294) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1710, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.77% (5.3855 => 4.4824, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.21% (5.3526 => 4.4849, std.dev.: 0.0062) MultiSource/Applications/JM/ldecod/ldecod: -13.40% (10.4361 => 9.0378, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.15% (1.7609 => 1.6173, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 49.9983, std.dev.: 0.0102) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.90% (1.9577 => 0.6285, std.dev.: 0.0214) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3083, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4213, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8555, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0053, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -20.31% (0.2161 => 0.1722, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.89% (0.9540 => 0.8406, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.89% (1.8329 => 1.7066, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.73% (19.9488 => 18.6065, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.94% (1.2373 => 1.1638, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.68% (8.1563 => 7.6927, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.46% (10.2830 => 9.8240, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3296, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/ary3: -1.59% (3.6994 => 3.6406, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5794, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2261, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0016) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.67% (0.2116 => 0.0663, std.dev.: 0.0012) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 21:31:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 25 Jan 2013 23:31:03 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126053103.7C0C52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7958?compare_to=7954&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7958, Order: 173556, Start Time: 2013-01-26 03:28:44, End Time: 2013-01-26 05:31:22 To: 7954, Order: 173537, Start Time: 2013-01-26 01:02:39, End Time: 2013-01-26 03:10:46 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (84 on baseline) Performance Improvements: 42 (80 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1018 (899 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 15.98% (1.6104 => 1.8678, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 1.69% (3.5602 => 3.6202, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/methcall: 1.09% (8.3347 => 8.4256, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/mandel: 1.05% (1.0519 => 1.0629, std.dev.: 0.0024) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/2002-05-19-DivTest: -44.15% (0.0265 => 0.0148, std.dev.: 0.0016) SingleSource/UnitTests/2007-01-04-KNR-Args: -35.86% (0.0290 => 0.0186, std.dev.: 0.0011) SingleSource/Regression/C/test_indvars: -34.25% (0.0435 => 0.0286, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/shr: -25.67% (0.0413 => 0.0307, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -18.38% (0.3977 => 0.3246, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/health/health: -14.66% (0.1753 => 0.1496, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -14.37% (0.0870 => 0.0745, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -14.27% (0.3049 => 0.2614, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: -13.43% (0.2495 => 0.2160, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: -12.11% (1.7381 => 1.5276, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -11.81% (0.0948 => 0.0836, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -11.62% (5.5742 => 4.9266, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/methcall: -10.57% (0.2317 => 0.2072, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/factor: -10.21% (0.1841 => 0.1653, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -9.02% (17.8298 => 16.2213, std.dev.: 0.2623) MultiSource/Applications/oggenc/oggenc: -8.08% (6.0515 => 5.5624, std.dev.: 0.1009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.13% (0.9604 => 0.8919, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: -7.01% (1.1081 => 1.0304, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -6.86% (1.4103 => 1.3135, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.45% (1.3780 => 1.2891, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.04% (1.6433 => 1.5440, std.dev.: 0.0093) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4054 => 0.3861, std.dev.: 0.0070) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.24% (1.1767 => 1.1268, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/wordfreq: -4.13% (0.3609 => 0.3460, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -4.11% (0.4554 => 0.4367, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.82% (0.4113 => 0.3956, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: -3.33% (1.3223 => 1.2783, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: -2.38% (16.6969 => 16.2989, std.dev.: 0.1020) MultiSource/Applications/Burg/burg: -1.87% (1.4731 => 1.4455, std.dev.: 0.0083) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.68% (5.5824 => 5.4887, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -33.76% (12.8983 => 8.5435, std.dev.: 1.4730) SingleSource/Benchmarks/CoyoteBench/fftbench: -29.34% (2.1101 => 1.4911, std.dev.: 0.1723) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.34% (4.0996 => 3.7167, std.dev.: 0.0725) MultiSource/Benchmarks/Olden/health/health: -9.25% (0.3818 => 0.3465, std.dev.: 0.0113) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -7.81% (42.4922 => 39.1747, std.dev.: 0.5461) MultiSource/Applications/SPASS/SPASS: -7.80% (9.0700 => 8.3625, std.dev.: 0.1253) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.91% (0.3368 => 0.3169, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.23% (3.7857 => 3.5878, std.dev.: 0.0635) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.96% (2.4736 => 2.4251, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.75% (4.4748 => 4.3964, std.dev.: 0.0229) SingleSource/Benchmarks/Misc/lowercase: -1.57% (0.8603 => 0.8468, std.dev.: 0.0042) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.02% (2.4856 => 2.4602, std.dev.: 0.0063) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.70% (1.2249 => 1.2163, std.dev.: 0.0366) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.96% (0.0235 => 0.0221, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.24% (0.0446 => 0.0436, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -21.26% (0.0348 => 0.0274, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.49% (0.0334 => 0.0309, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -21.33% (0.0450 => 0.0354, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/casts: -8.00% (0.0225 => 0.0207, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -2.63% (0.0228 => 0.0222, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.86% (0.0232 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.94% (0.1547 => 0.1517, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: -9.70% (1.2614 => 1.1391, std.dev.: 0.0550) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.06% (0.4183 => 0.4013, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.49% (0.1511 => 0.1428, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.03% (0.0670 => 0.0643, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.32% (0.0609 => 0.0534, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.70% (1.3378 => 1.3150, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -45.16% (0.0031 => 0.0017, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.47% (0.0612 => 0.0603, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.96% (0.0277 => 0.0360, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.99% (1.6906 => 1.7412, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: -90.00% (0.0010 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.79% (0.0057 => 0.0048, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.66% (33.5900 => 34.4842, std.dev.: 0.1167) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 391.96% (0.0336 => 0.1653, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 113.65% (0.0293 => 0.0626, std.dev.: 0.0016) SingleSource/Regression/C/sumarray2d: 87.96% (0.0274 => 0.0515, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 60.26% (0.1638 => 0.2625, std.dev.: 0.0118) SingleSource/Regression/C/sumarray: 52.45% (0.0265 => 0.0404, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.34% (0.9120 => 1.2890, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.85% (0.8926 => 1.2572, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.48% (0.9612 => 1.3503, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.13% (0.9061 => 1.2697, std.dev.: 0.0610) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.54% (0.9381 => 1.3090, std.dev.: 0.0487) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.34% (0.9564 => 1.3326, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.15% (0.9588 => 1.3342, std.dev.: 0.1041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.13% (0.9403 => 1.3082, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.33% (0.9091 => 1.2576, std.dev.: 0.1038) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.05% (0.9855 => 1.3605, std.dev.: 0.0743) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.70% (0.9998 => 1.3767, std.dev.: 0.0536) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.59% (0.9422 => 1.2964, std.dev.: 0.0676) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.50% (0.9010 => 1.2299, std.dev.: 0.1137) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 35.94% (0.9512 => 1.2931, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.67% (1.0119 => 1.3728, std.dev.: 0.0880) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.64% (0.8912 => 1.2088, std.dev.: 0.0814) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.43% (0.8736 => 1.1831, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.06% (1.0867 => 1.4677, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.77% (1.0052 => 1.3547, std.dev.: 0.0493) SingleSource/Benchmarks/McGill/exptree: 34.58% (0.0859 => 0.1156, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 34.57% (0.0431 => 0.0580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.23% (0.8732 => 1.1721, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.85% (0.8846 => 1.1840, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.68% (0.9867 => 1.3092, std.dev.: 0.1172) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 31.95% (1.0017 => 1.3217, std.dev.: 0.1202) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.9788 => 1.2891, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.23% (0.9488 => 1.2451, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.20% (1.0088 => 1.3135, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.11% (0.9685 => 1.2601, std.dev.: 0.0862) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.94% (0.9127 => 1.1860, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.42% (0.9993 => 1.2933, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.32% (0.9550 => 1.2255, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.14% (1.0860 => 1.3916, std.dev.: 0.0442) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.11% (0.0738 => 0.0879, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 17.87% (0.3598 => 0.4241, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.04% (0.0642 => 0.0745, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.89% (0.0963 => 0.1116, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.83% (3.6295 => 4.1315, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.72% (1.0986 => 1.2493, std.dev.: 0.0252) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.44% (0.1332 => 0.1511, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 12.17% (9.5202 => 10.6785, std.dev.: 0.2854) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.53% (0.1240 => 0.1383, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 10.86% (0.2385 => 0.2644, std.dev.: 0.0043) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.44% (0.4596 => 0.5076, std.dev.: 0.0117) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1793 => 0.1978, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.43% (1.4110 => 1.5440, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.94% (5.0381 => 5.4887, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.66% (1.8651 => 2.0080, std.dev.: 0.0161) SingleSource/Regression/C++/ofstream_ctor: 5.14% (0.2042 => 0.2147, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 105750.00% (0.0008 => 0.8468, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 355.21% (1.5825 => 7.2037, std.dev.: 0.0665) SingleSource/Benchmarks/Shootout/ary3: 283.05% (2.2304 => 8.5435, std.dev.: 1.4730) MultiSource/Applications/sgefa/sgefa: 256.13% (0.3515 => 1.2518, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.28% (1.1825 => 4.0238, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.85% (4.8185 => 15.9419, std.dev.: 0.0666) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 216.67% (0.0228 => 0.0722, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary2: 178.29% (0.0129 => 0.0359, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 145.69% (0.0232 => 0.0570, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 62.90% (2.9083 => 4.7377, std.dev.: 0.1108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.72% (0.2562 => 0.3426) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.66% (3.1254 => 4.1150, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.66% (1.4588 => 1.8477, std.dev.: 0.0589) SingleSource/Benchmarks/Misc/salsa20: 21.92% (7.4497 => 9.0826, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.57% (5.6033 => 6.8117, std.dev.: 0.3447) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.49% (4.8112 => 5.7968, std.dev.: 0.0092) SingleSource/Regression/C/uint64_to_float: 15.78% (1.5397 => 1.7826, std.dev.: 0.0725) MultiSource/Applications/JM/lencod/lencod: 13.22% (6.8159 => 7.7172, std.dev.: 0.1660) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8555, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6499, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.19% (0.6211 => 0.6782, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.98% (3.6477 => 3.9752, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 8.06% (8.6447 => 9.3418, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.97% (4.7473 => 5.0780, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 5.83% (1.0425 => 1.1033, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.23% (4.1836 => 4.4023, std.dev.: 0.0063) SingleSource/Benchmarks/Linpack/linpack-pc: 4.89% (50.8945 => 53.3849, std.dev.: 0.2811) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (5.0310 => 5.2291, std.dev.: 0.0490) SingleSource/Benchmarks/Misc/pi: 3.53% (2.1390 => 2.2146, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8627, std.dev.: 0.0066) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0029) SingleSource/Benchmarks/SmallPT/smallpt: -27.07% (0.1888 => 0.1377, std.dev.: 0.0049) MultiSource/Applications/hbd/hbd: -19.45% (1.8964 => 1.5276, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.52% (0.1684 => 0.1389, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.79% (1.0960 => 0.9120, std.dev.: 0.0636) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.19% (0.7686 => 0.6672, std.dev.: 0.0277) MultiSource/Applications/spiff/spiff: -11.70% (1.0220 => 0.9024, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: -10.12% (2.4719 => 2.2217, std.dev.: 0.0107) MultiSource/Applications/hexxagon/hexxagon: -9.87% (1.1433 => 1.0304, std.dev.: 0.0176) MultiSource/Applications/Burg/burg: -9.54% (1.5979 => 1.4455, std.dev.: 0.0083) MultiSource/Applications/aha/aha: -9.22% (0.1378 => 0.1251, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: -8.73% (0.5134 => 0.4686, std.dev.: 0.0116) MultiSource/Applications/lua/lua: -8.27% (4.6406 => 4.2566, std.dev.: 0.0726) MultiSource/Applications/sqlite3/sqlite3: -7.64% (17.5634 => 16.2213, std.dev.: 0.2623) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.55% (10.2703 => 9.4950, std.dev.: 0.2891) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.36% (1.0234 => 0.9481, std.dev.: 0.0074) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.29% (1.2154 => 1.1268, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: -7.21% (17.4365 => 16.1791, std.dev.: 0.4421) MultiSource/Applications/lambda-0_1_3/lambda: -7.15% (0.8653 => 0.8034, std.dev.: 0.0112) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.98% (0.9588 => 0.8919, std.dev.: 0.0144) SingleSource/Benchmarks/Shootout-C++/hash: -6.87% (0.4689 => 0.4367, std.dev.: 0.0047) MultiSource/Applications/lemon/lemon: -6.67% (1.3979 => 1.3047, std.dev.: 0.0133) MultiSource/Applications/d/make_dparser: -5.56% (3.7840 => 3.5736, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout-C++/fibo: -5.13% (0.2006 => 0.1903, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.82% (1.3924 => 1.3392, std.dev.: 0.0146) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.13% (1.1731 => 1.1364, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.16% (7.2721 => 7.1147, std.dev.: 0.0491) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.49% (0.7225 => 0.7117, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.83% (11.5523 => 3.9476, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -61.88% (15.6525 => 5.9661, std.dev.: 0.0627) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.27% (0.4146 => 0.1813, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.69% (0.4578 => 0.2349, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.02% (11.3868 => 6.3743, std.dev.: 0.2513) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.84% (5.4023 => 3.6281, std.dev.: 0.0208) MultiSource/Benchmarks/Olden/bisort/bisort: -31.08% (0.9372 => 0.6459, std.dev.: 0.0899) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.53% (0.4452 => 0.3093, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/heapsort: -30.16% (4.4739 => 3.1244, std.dev.: 0.1984) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.53% (0.5495 => 0.3982, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.21% (5.2605 => 3.8816, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3286, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.85% (0.5826 => 0.4378, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.54% (0.5897 => 0.4450, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8231, std.dev.: 0.1746) MultiSource/Applications/minisat/minisat: -22.99% (7.9891 => 6.1528, std.dev.: 0.1777) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7926, std.dev.: 0.0262) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.70% (16.6791 => 14.0609, std.dev.: 0.2060) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.58% (7.0016 => 5.9111, std.dev.: 0.2274) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.24% (3.1921 => 2.7694, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.50% (5.7056 => 4.9925, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.31% (9.7992 => 8.5933, std.dev.: 0.0177) SingleSource/Benchmarks/Shootout/hash: -10.40% (4.5259 => 4.0551, std.dev.: 0.0352) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.00% (0.4081 => 0.3673, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/nestedloop: -8.68% (0.2200 => 0.2009, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.80% (0.3217 => 0.2966, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: -7.75% (9.0650 => 8.3625, std.dev.: 0.1253) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2277, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.44% (4.5424 => 4.2499, std.dev.: 0.0468) SingleSource/Benchmarks/McGill/queens: -5.71% (1.7443 => 1.6447, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.63% (4.9799 => 4.6996, std.dev.: 0.0470) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.17% (23.3986 => 22.1893, std.dev.: 0.3841) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (3.6768 => 3.5001, std.dev.: 0.0376) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.74% (3.7662 => 3.5878, std.dev.: 0.0635) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3593, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.70% (3.5691 => 3.4370, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.65% (2.5170 => 2.4251, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (5.8973 => 5.6840, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: -2.88% (3.5443 => 3.4423, std.dev.: 0.0361) MultiSource/Applications/spiff/spiff: -2.54% (2.8571 => 2.7844, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/ffbench: -2.53% (1.4244 => 1.3884, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.75% (8.7327 => 8.5800, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.2040 => 7.0803, std.dev.: 0.0351) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.70% (85.3042 => 83.8576, std.dev.: 0.1516) SingleSource/Benchmarks/Misc/whetstone: -1.54% (1.6251 => 1.6000, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.36% (8.8249 => 8.7052, std.dev.: 0.0234) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3154, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/FloatMM: -1.30% (0.8328 => 0.8220, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (3.7450 => 3.6987, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7488, std.dev.: 0.0244) SingleSource/Benchmarks/SmallPT/smallpt: -1.10% (14.9448 => 14.7799, std.dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.96% (1.2047 => 1.2163, std.dev.: 0.0366) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -30.46% (0.0394 => 0.0274, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.79% (0.0328 => 0.0309, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.45% (0.0445 => 0.0354, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.85% (0.1530 => 0.1517, std.dev.: 0.0084) MultiSource/Applications/lemon/lemon: -40.96% (1.9293 => 1.1391, std.dev.: 0.0550) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4049 => 0.4013, std.dev.: 0.0365) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.43% (0.1510 => 0.1428, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.25% (0.0978 => 0.0643, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.49% (0.0590 => 0.0534, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.20% (1.1617 => 1.3150, std.dev.: 0.0159) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0610 => 0.0603, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.33% (0.0268 => 0.0360, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.13% (0.7437 => 1.7412, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.83% (0.0092 => 0.0048, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.87% (12.7781 => 34.4842, std.dev.: 0.1167) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 22:34:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 00:34:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126063457.8A69F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7959?compare_to=7956&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7959, Order: 173558, Start Time: 2013-01-26 05:01:33, End Time: 2013-01-26 06:35:15 To: 7956, Order: 173556, Start Time: 2013-01-26 03:04:09, End Time: 2013-01-26 04:38:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 1 (93 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -4.21% (0.7247 => 0.6942, std.dev.: 0.0083) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.78% (0.6395 => 0.8811, std.dev.: 0.0064) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.59% (0.5688 => 0.7542, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.22% (0.6260 => 0.8277, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.18% (0.5456 => 0.7212, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.90% (0.5849 => 0.7715, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.72% (0.5567 => 0.7333, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.61% (0.5575 => 0.7337, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.55% (0.5581 => 0.7342, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.48% (0.6395 => 0.8408, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.31% (0.5941 => 0.7742, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.09% (0.5859 => 0.7622, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.97% (0.6033 => 0.7841, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.16% (0.6440 => 0.8318, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.75% (1.6474 => 2.1210, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.57% (0.6189 => 0.7957, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.84% (0.6304 => 0.8059, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.51% (0.6230 => 0.7944, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.58% (0.5802 => 0.7344, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.58% (0.6660 => 0.8430, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.12% (0.5705 => 0.7195, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.11% (0.5925 => 0.7472, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.80% (0.5857 => 0.7368, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.53% (0.5569 => 0.6991, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.45% (0.5478 => 0.6872, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.42% (0.5570 => 0.6986, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.92% (0.5591 => 0.6984, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.94% (0.7524 => 0.9325, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.93% (0.5863 => 0.7266, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.86% (0.6446 => 0.7984, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.63% (0.6052 => 0.7482, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.11% (0.6681 => 0.8225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.84% (0.6194 => 0.7609, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.55% (0.6297 => 0.7717, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.65% (2.2587 => 2.7478, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.25% (0.6667 => 0.8084, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.57% (0.7339 => 0.8775, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.25% (0.3357 => 0.3869, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.89% (1.1450 => 1.3155, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.58% (4.5069 => 5.0738, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.31% (0.4916 => 0.5521, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.12% (0.4515 => 0.5062, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.52% (3.5339 => 3.9410, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.49% (1.6364 => 1.8245, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.67% (0.1230 => 0.1349, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.57% (9.2283 => 10.1110, std.dev.: 0.0092) MultiSource/Applications/Burg/burg: 8.69% (1.2515 => 1.3602, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 8.47% (0.4524 => 0.4907, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.09% (0.5329 => 0.5760, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.68% (0.1731 => 0.1864, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.44% (1.4642 => 1.5731, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.38% (0.7021 => 0.7539, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4861 => 0.5207, std.dev.: 0.0116) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.98% (1.2784 => 1.3676, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 6.14% (0.3255 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.69% (0.6750 => 0.7134, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3319 => 0.3495, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (5.4682 => 5.6998, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 3.58% (5.0226 => 5.2022, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.42% (0.3446 => 0.3564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.24% (0.3394 => 0.3504, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.86% (1.3864 => 1.4261, std.dev.: 0.0103) MultiSource/Applications/spiff/spiff: 2.85% (0.8418 => 0.8658, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.51% (0.4427 => 0.4538, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (22.4056 => 22.9205, std.dev.: 0.0167) MultiSource/Applications/minisat/minisat: 2.28% (0.7447 => 0.7617, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.09% (0.9557 => 0.9757, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.00% (15.5079 => 15.8177, std.dev.: 0.0144) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.88% (1.3722 => 1.3980, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.22% (1.2300 => 1.2450, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.00% (3.5154 => 3.5506, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8149, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0059) SingleSource/Regression/C/uint64_to_float: 7.50% (0.5692 => 0.6119, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1643, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5127, std.dev.: 0.0863) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2231 => 18.5095, std.dev.: 0.0128) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2476, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2682, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4543, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.02% (3.6551 => 3.6922, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.95% (0.7198 => 0.6842, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.18% (0.3831 => 0.3671, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3848 => 0.3690, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.99% (0.3880 => 0.3725, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.96% (0.3837 => 0.3685, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.96% (0.3891 => 0.3737, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.89% (0.4033 => 0.3876, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.85% (2.4924 => 2.3965, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.4176 => 0.4019, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.59% (0.9852 => 0.9498, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.58% (0.3884 => 0.3745, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.19% (0.4199 => 0.4065, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.12% (0.6441 => 0.6240, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.07% (0.3323 => 0.3221, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.9542 => 0.9274, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.80% (0.4280 => 0.4160, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.78% (2.1713 => 2.1110, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.74% (0.7779 => 0.7566, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.62% (1.3148 => 1.2803, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.39% (0.6484 => 0.6329, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.08% (20.7746 => 20.3419, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.93% (14.2083 => 13.9335, std.dev.: 0.0175) MultiSource/Applications/sqlite3/sqlite3: -1.77% (17.1032 => 16.8007, std.dev.: 0.0040) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6726, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -1.43% (16.1920 => 15.9611, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: -1.20% (7.0961 => 7.0112, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.19% (1.0544 => 1.0418, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.07% (1.2221 => 1.2090, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (1.2210 => 1.2085, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/gs/gs: -1.02% (4.3330 => 4.2890, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6942, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3088, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.41% (0.2151 => 0.1583, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0225, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7504, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0755, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1972, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9586, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1311, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3561, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.51% (0.8545 => 0.8160, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3980, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7811, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1738, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.47% (1.6307 => 1.6067, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.32% (3.7092 => 3.6604, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.30% (1.6219 => 1.6008, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 23:41:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 01:41:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126074120.5187C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7960?compare_to=7957&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7960, Order: 173559, Start Time: 2013-01-26 05:30:49, End Time: 2013-01-26 07:41:37 To: 7957, Order: 173554, Start Time: 2013-01-26 02:49:18, End Time: 2013-01-26 05:00:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (217 on baseline) Performance Improvements: 1 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.16% (80.3496 => 81.2830, std.dev.: 0.3125) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.71% (11.1628 => 10.9715, std.dev.: 0.0045) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0663 => 0.0664, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8537 => 499.7651, std.dev.: 0.0495) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44217.20% (1.1277 => 499.7651, std.dev.: 0.0495) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.47% (0.5229 => 1.6496, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 20.50% (14.9895 => 18.0626, std.dev.: 0.0316) MultiSource/Applications/kimwitu++/kc: 44.40% (14.1553 => 20.4403, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 17.95% (4.1105 => 4.8483, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.62% (1.1048 => 1.7303, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.78% (7.1582 => 37.3502, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.72% (3.4629 => 6.4314, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.57% (0.6222 => 1.0924, std.dev.: 0.0066) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10231.94% (0.0720 => 7.4390, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11155600.00% (0.0001 => 11.1557, std.dev.: 0.0487) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850400.00% (0.0001 => 9.8505, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487300.00% (0.0001 => 5.4874, std.dev.: 0.0560) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.39% (1.1194 => 10.3588, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 149.14% (22.1758 => 55.2482, std.dev.: 0.0149) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.77% (0.0929 => 0.1828, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.70% (0.1463 => 0.2512, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 65.62% (0.0730 => 0.1209, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.15% (0.0394 => 0.0631, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.86% (2.9384 => 4.6092, std.dev.: 0.0033) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.16% (7.0540 => 10.8040, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.46% (1.5859 => 2.4020, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.03% (8.1363 => 11.9629, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.90% (2.2024 => 3.1251, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 39.63% (0.3109 => 0.4341, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.69% (0.1432 => 0.1986, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 37.65% (21.9371 => 30.1968, std.dev.: 0.0269) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0009) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.37% (4.2646 => 5.6876, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.45% (1.5415 => 2.0417, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.39% (0.4615 => 0.6110, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 32.19% (0.0814 => 0.1076, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.52% (0.2271 => 0.2964, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 29.68% (1.1642 => 1.5097, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 29.54% (0.4299 => 0.5569, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.44% (0.5105 => 0.6506, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.19% (0.6675 => 0.8490, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.11% (0.0793 => 0.1008, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.39% (0.1584 => 0.2002, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.33% (0.1143 => 0.1444, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.27% (0.1892 => 0.2389, std.dev.: 0.0028) MultiSource/Benchmarks/mafft/pairlocalalign: 26.00% (9.4845 => 11.9504, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/08-main/main: 26.00% (0.2554 => 0.3218, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.96% (3.8922 => 4.9026, std.dev.: 0.0165) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 24.74% (0.4289 => 0.5350, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.45% (0.1906 => 0.2372, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 24.27% (1.0722 => 1.3324, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.27% (0.1566 => 0.1946, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.26% (0.3121 => 0.3878, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 24.20% (0.4620 => 0.5738, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 24.17% (0.1175 => 0.1459, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.08% (1.4186 => 1.7602, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.70% (0.0730 => 0.0903, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.42% (0.1695 => 0.2092, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 22.97% (0.6456 => 0.7939, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 22.54% (0.7115 => 0.8719, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.32% (0.0672 => 0.0822, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.78% (0.2700 => 0.3288, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.76% (0.1236 => 0.1505, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 21.72% (0.3098 => 0.3771, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.45% (0.0662 => 0.0804, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 21.34% (0.7835 => 0.9507, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.19% (0.0675 => 0.0818, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.84% (1.3050 => 1.5770, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.55% (0.1163 => 0.1402, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.30% (5.7591 => 6.9280, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.24% (0.1695 => 0.2038, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 20.16% (0.1151 => 0.1383, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.98% (0.5860 => 0.7031, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.90% (0.1940 => 0.2326, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.80% (4.9449 => 5.9238, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.75% (0.8172 => 0.9786, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.99% (5.0018 => 5.9514, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.87% (0.3307 => 0.3931, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 18.83% (3.3354 => 3.9633, std.dev.: 0.0095) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.71% (0.5020 => 0.5959, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.49% (0.2758 => 0.3268, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 18.26% (0.7433 => 0.8790, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 18.14% (0.1268 => 0.1498, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.08% (0.1117 => 0.1319, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.99% (0.9765 => 1.1522, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.96% (0.5569 => 0.6569, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 17.65% (1.1840 => 1.3930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.56% (0.4203 => 0.4941, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.51% (2.0273 => 2.3823, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.41% (0.3423 => 0.4019, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.40% (3.8723 => 4.5461, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.32% (0.5981 => 0.7017, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.19% (0.2065 => 0.2420, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 17.15% (0.3283 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.09% (1.1861 => 1.3888, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.76% (0.1044 => 0.1219, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 16.71% (0.3232 => 0.3772, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 16.67% (2.2969 => 2.6798, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.61% (0.0933 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.45% (0.3441 => 0.4007, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.37% (0.8101 => 0.9427, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.05% (0.6450 => 0.7485, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 15.67% (0.2049 => 0.2370, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.44% (0.3180 => 0.3671, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.8921 => 1.0266, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.74% (0.3379 => 0.3877, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.62% (0.0759 => 0.0870, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.40% (0.8067 => 0.9229, std.dev.: 0.0017) SingleSource/Regression/C++/ofstream_ctor: 14.25% (0.2905 => 0.3319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.20% (0.3865 => 0.4414, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.61% (0.4636 => 0.5267, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.31% (0.4103 => 0.4649, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 13.26% (0.3387 => 0.3836, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.04% (1.5603 => 1.7637, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/sieve: 12.52% (0.3603 => 0.4054, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.45% (0.4048 => 0.4552, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.42% (0.3422 => 0.3847, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.18% (0.2430 => 0.2726, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 12.05% (0.3684 => 0.4128, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 11.88% (17.1811 => 19.2222, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.53% (0.3826 => 0.4267, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.34% (0.4064 => 0.4525, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 11.20% (0.3927 => 0.4367, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 11.19% (0.3092 => 0.3438, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 11.06% (0.3282 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.77% (0.3427 => 0.3796, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 10.67% (0.2831 => 0.3133, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.42% (14.3668 => 15.8638, std.dev.: 0.0196) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.21% (0.3828 => 0.4219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.16% (2.0665 => 2.2764, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2871 => 0.3158, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.96% (0.1114 => 0.1225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.87% (0.2877 => 0.3161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.71% (0.3543 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.65% (0.3543 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.61% (0.3516 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.58% (0.3497 => 0.3832, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.44% (1.2842 => 1.4054, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3650 => 0.3993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.30% (0.2891 => 0.3160, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.23% (0.3162 => 0.3454, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.12% (0.2872 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.03% (0.2756 => 0.3005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.01% (0.3052 => 0.3327, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.00% (0.3935 => 0.4289) SingleSource/Benchmarks/Shootout-C++/random: 8.96% (0.2802 => 0.3053, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.88% (0.2725 => 0.2967, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.84% (0.2793 => 0.3040, std.dev.: 0.0055) SingleSource/UnitTests/ObjC++/property-reference: 8.76% (0.7326 => 0.7968, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7545, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hello: 8.70% (0.2714 => 0.2950, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.42% (0.3136 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.78% (2.2022 => 2.3516, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.31% (0.4879 => 0.5187, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.95% (0.3177 => 0.3366, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.83% (10.3673 => 10.9715, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (7.9617 => 8.1493, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4741, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (1.1145 => 1.2946, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 13.12% (0.5413 => 0.6123, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3867, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.13% (4.2280 => 4.4449, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3114, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.54% (0.9957 => 1.0309, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.51% (8.6802 => 8.8978, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.47% (3.6395 => 3.7295, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2912, std.dev.: 0.0044) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3047, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.36% (1.0785 => 1.0932, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3460 => 10.4634, std.dev.: 0.0242) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5789, std.dev.: 0.0062) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.85% (5.2763 => 1.1687, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.04% (0.8651 => 0.2159, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -43.53% (0.1622 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.03% (5.3855 => 4.4683, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.53% (5.3526 => 4.4680, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -13.50% (10.4361 => 9.0273, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.90% (1.7609 => 1.6218, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9519, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.69% (1.9577 => 0.6325, std.dev.: 0.0241) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0202, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.77% (10.7105 => 7.4154, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8555, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0045, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.50% (0.2161 => 0.1718, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -16.07% (1.6925 => 1.4205, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7357, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.90% (0.9540 => 0.8405, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4956, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.71% (19.9488 => 18.6100, std.dev.: 0.0075) SingleSource/Benchmarks/McGill/chomp: -6.45% (1.2373 => 1.1575, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.13% (0.2497 => 0.2344, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6999, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.01% (0.4808 => 0.4567, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -4.28% (10.2830 => 9.8428, std.dev.: 0.0085) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Shootout/ary3: -2.14% (3.6994 => 3.6203, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.65% (3.7221 => 3.6607, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3303, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.29% (4.6441 => 4.5843, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2357, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.62% (0.2116 => 0.0664, std.dev.: 0.0001) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Fri Jan 25 23:50:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 01:50:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126075046.092C52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7961?compare_to=7958&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7961, Order: 173559, Start Time: 2013-01-26 05:48:33, End Time: 2013-01-26 07:51:05 To: 7958, Order: 173556, Start Time: 2013-01-26 03:28:44, End Time: 2013-01-26 05:31:22 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (95 on baseline) Performance Improvements: 1 (113 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1052 (855 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.63% (0.9024 => 0.9171, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: 1.01% (2.2217 => 2.2442, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.60% (5.9111 => 6.4194, std.dev.: 0.0299) SingleSource/Regression/C/uint64_to_float: 6.18% (1.7826 => 1.8927, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/bigfib: 5.64% (0.3407 => 0.3599, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.77% (4.1161 => 4.2712, std.dev.: 0.0566) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.87% (4.7430 => 4.8789, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 2.20% (1.3884 => 1.4189, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/tsp/tsp: 2.00% (1.4819 => 1.5115, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/five11/five11: 1.12% (5.5975 => 5.6603, std.dev.: 0.0229) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.00% (4.0238 => 4.0641, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.21% (1.3916 => 1.3747, std.dev.: 0.0030) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.30% (1.2163 => 1.2200, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0436 => 0.0433, std.dev.: 0.0149) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 23.36% (0.0274 => 0.0338, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.59% (0.0309 => 0.0317, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 22.60% (0.0354 => 0.0434, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0207 => 0.0206, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0222 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1517 => 0.1533, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: 4.33% (1.1391 => 1.1884, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.30% (0.4013 => 0.4025, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.87% (0.1428 => 0.1469, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.33% (0.0643 => 0.0658, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.37% (0.0534 => 0.0536, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.33% (1.3150 => 1.3193, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0017 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0603 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.89% (0.0360 => 0.0374) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.34% (1.7412 => 1.7471, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 14.58% (0.0048 => 0.0055, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.43% (34.4842 => 34.3373, std.dev.: 0.1103) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 391.67% (0.0336 => 0.1652, std.dev.: 0.0017) SingleSource/Regression/C/sumarray2d: 94.89% (0.0274 => 0.0534, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/neural/neural: 59.65% (0.1638 => 0.2615, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.50% (0.8926 => 1.2630, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.47% (0.8893 => 1.2581, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.09% (0.9120 => 1.2867, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.40% (0.9061 => 1.2722, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.39% (0.9612 => 1.3494, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.16% (0.9564 => 1.3405, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.92% (0.9588 => 1.3416, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.62% (0.9381 => 1.3098, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.62% (0.8990 => 1.2462, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.30% (0.9091 => 1.2573, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.10% (0.9855 => 1.3610, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.79% (0.9998 => 1.3776, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.47% (0.9422 => 1.2952, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.02% (0.9403 => 1.2884, std.dev.: 0.0101) SingleSource/Benchmarks/Stanford/IntMM: 36.66% (0.0431 => 0.0589, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.45% (0.9010 => 1.2294, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.17% (0.8736 => 1.1896, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.08% (0.9512 => 1.2944, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.86% (1.0119 => 1.3748, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.61% (0.8912 => 1.2086, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.17% (1.0867 => 1.4689, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/exptree: 34.92% (0.0859 => 0.1159, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.42% (1.0052 => 1.3512, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.36% (0.8732 => 1.1732, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.81% (0.8846 => 1.1837, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.59% (0.9867 => 1.3083, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.58% (1.0017 => 1.3281, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.79% (0.9788 => 1.2900, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.62% (0.9507 => 1.2513, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.01% (0.9488 => 1.2430, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.32% (1.0088 => 1.3147, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.24% (0.9685 => 1.2614, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.22% (0.9127 => 1.1885, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.53% (0.9993 => 1.2944, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.48% (0.9405 => 1.2178, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.55% (0.9550 => 1.2277, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.58% (1.0860 => 1.3747, std.dev.: 0.0030) MultiSource/Applications/sgefa/sgefa: 20.12% (0.3598 => 0.4322, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.43% (0.0669 => 0.0799, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.38% (0.0738 => 0.0881, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.51% (0.0642 => 0.0748, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.41% (0.0963 => 0.1121, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 14.29% (0.0707 => 0.0808, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.26% (0.1332 => 0.1522, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.89% (3.6295 => 4.1335, std.dev.: 0.1695) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.84% (1.0986 => 1.2507, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.06% (0.1240 => 0.1402, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 12.83% (9.5202 => 10.7415, std.dev.: 0.4449) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.22% (0.2577 => 0.2892, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 10.60% (0.1793 => 0.1983, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.39% (0.5369 => 0.5927, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.42% (1.4110 => 1.5439, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.75% (5.0381 => 5.4787, std.dev.: 0.0582) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.44% (0.1955 => 0.2120, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 8.11% (0.2566 => 0.2774, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.08% (1.8651 => 1.9972, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.91% (0.2879 => 0.3078, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.10% (0.2372 => 0.2493, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.72% (5.3553 => 5.5547, std.dev.: 0.0663) MultiSource/Benchmarks/McCat/05-eks/eks: 3.29% (0.4776 => 0.4933, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/football/football: 1.93% (0.9759 => 0.9947, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106900.00% (0.0008 => 0.8560, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout/matrix: 357.08% (1.5825 => 7.2333, std.dev.: 0.0239) SingleSource/Benchmarks/Shootout/ary3: 283.77% (2.2304 => 8.5595, std.dev.: 2.2851) MultiSource/Applications/sgefa/sgefa: 259.37% (0.3515 => 1.2632, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.69% (1.1825 => 4.0641, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 227.83% (4.8185 => 15.7967, std.dev.: 0.1454) SingleSource/Benchmarks/Shootout-C++/ary2: 189.92% (0.0129 => 0.0374, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 188.60% (0.0228 => 0.0658, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary: 141.81% (0.0232 => 0.0561, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 63.18% (2.9083 => 4.7458, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.49% (0.2562 => 0.3420, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.40% (3.1254 => 4.1068, std.dev.: 0.0084) SingleSource/Regression/C/uint64_to_float: 22.93% (1.5397 => 1.8927, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/salsa20: 21.83% (7.4497 => 9.0763, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 21.81% (1.4588 => 1.7770, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.20% (5.6033 => 6.7910, std.dev.: 0.4008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (4.8112 => 5.7941, std.dev.: 0.0141) MultiSource/Applications/JM/lencod/lencod: 13.28% (6.8159 => 7.7212, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.22% (5.1752 => 5.8593, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6498, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (3.6477 => 3.9750, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.89% (0.6211 => 0.6763, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 7.74% (8.6447 => 9.3139, std.dev.: 0.1018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (4.7473 => 5.0811, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.34% (4.1836 => 4.4070, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (5.0310 => 5.2309, std.dev.: 0.0109) SingleSource/Benchmarks/Linpack/linpack-pc: 3.89% (50.8945 => 52.8767, std.dev.: 0.2040) SingleSource/Benchmarks/Misc/pi: 3.58% (2.1390 => 2.2155, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.25% (4.7254 => 4.8789, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.66% (2.7640 => 2.8099, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8622, std.dev.: 0.0139) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.94% (0.0727 => 0.0473, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.62% (0.0692 => 0.0487, std.dev.: 0.0008) SingleSource/Benchmarks/SmallPT/smallpt: -25.79% (0.1888 => 0.1401, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.71% (0.1009 => 0.0800, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.71% (0.0676 => 0.0536, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -19.36% (1.8964 => 1.5292, std.dev.: 0.0180) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.18% (0.1684 => 0.1361, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.20% (0.1079 => 0.0915, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.09% (1.0960 => 0.9306, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.73% (0.7686 => 0.6554, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -13.34% (0.0862 => 0.0747, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.31% (0.4074 => 0.3654, std.dev.: 0.0100) MultiSource/Applications/spiff/spiff: -10.26% (1.0220 => 0.9171, std.dev.: 0.0046) MultiSource/Applications/hexxagon/hexxagon: -10.15% (1.1433 => 1.0272, std.dev.: 0.0067) MultiSource/Applications/Burg/burg: -9.54% (1.5979 => 1.4454, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.54% (0.7693 => 0.6959, std.dev.: 0.0147) MultiSource/Applications/treecc/treecc: -9.21% (2.4719 => 2.2442, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -8.75% (0.5134 => 0.4685, std.dev.: 0.0038) MultiSource/Applications/lua/lua: -8.59% (4.6406 => 4.2418, std.dev.: 0.0526) MultiSource/Applications/aha/aha: -8.56% (0.1378 => 0.1260, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -7.51% (17.5634 => 16.2440, std.dev.: 0.1479) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.49% (0.6885 => 0.6369, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.46% (0.2481 => 0.2296, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.26% (10.2703 => 9.5250, std.dev.: 0.0777) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.24% (1.0234 => 0.9493, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash: -7.17% (0.4689 => 0.4353, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.11% (0.9124 => 0.8475, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/health/health: -7.02% (0.1610 => 0.1497, std.dev.: 0.0018) MultiSource/Applications/siod/siod: -6.92% (2.6437 => 2.4607, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.79% (1.1498 => 1.0717, std.dev.: 0.0228) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.65% (1.2154 => 1.1346, std.dev.: 0.0254) MultiSource/Applications/ClamAV/clamscan: -6.63% (17.4365 => 16.2799, std.dev.: 0.1365) MultiSource/Applications/lambda-0_1_3/lambda: -6.41% (0.8653 => 0.8098, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -6.32% (1.3979 => 1.3096, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/fibo: -5.63% (0.2006 => 0.1893, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.61% (0.2283 => 0.2155, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.49% (0.9588 => 0.9062, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.08% (0.3560 => 0.3379, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.95% (0.2709 => 0.2575, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: -4.66% (3.7840 => 3.6076, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.46% (1.6874 => 1.6121, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.41% (1.5131 => 1.4464, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.36% (0.3394 => 0.3246, std.dev.: 0.0043) MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.35% (1.1731 => 1.1221, std.dev.: 0.0121) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.09% (0.2615 => 0.2508, std.dev.: 0.0036) MultiSource/Benchmarks/sim/sim: -3.63% (0.3715 => 0.3580, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.18% (1.3924 => 1.3481, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.49% (0.7225 => 0.7045, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.04% (14.9757 => 14.6695, std.dev.: 0.0295) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.02% (7.2721 => 7.1249, std.dev.: 0.0309) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.97% (1.3220 => 1.2959, std.dev.: 0.0099) MultiSource/Applications/kimwitu++/kc: -1.78% (18.9377 => 18.6006, std.dev.: 0.1103) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.80% (11.5523 => 3.9505, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -62.10% (15.6525 => 5.9328, std.dev.: 0.2439) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.42% (0.4146 => 0.1807, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.71% (0.4578 => 0.2348, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.08% (11.3868 => 6.3673, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.86% (5.4023 => 3.6270, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: -30.89% (0.9372 => 0.6477, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.80% (0.4452 => 0.3081, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.28% (0.5495 => 0.3996, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.19% (5.2605 => 3.8826, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.11% (4.4467 => 3.3300, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.01% (0.5826 => 0.4369, std.dev.: 0.0427) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.64% (0.5897 => 0.4444, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8230, std.dev.: 0.0161) MultiSource/Applications/minisat/minisat: -22.37% (7.9891 => 6.2016, std.dev.: 0.0417) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.28% (1.0816 => 0.8623, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.88% (1.5623 => 1.2674, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.56% (5.8755 => 4.7852, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.83% (16.6791 => 13.7060, std.dev.: 0.2935) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.23% (3.1921 => 2.7699, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.90% (5.3626 => 4.6707, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.54% (9.7992 => 8.5701, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.36% (5.7056 => 5.0006, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.72% (1.4235 => 1.2566, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.34% (2.8778 => 2.5801, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/lists1: -9.82% (0.6628 => 0.5977, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/nestedloop: -8.55% (0.2200 => 0.2012, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.32% (7.0016 => 6.4194, std.dev.: 0.0299) MultiSource/Applications/SPASS/SPASS: -8.11% (9.0650 => 8.3300, std.dev.: 0.1662) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.32% (4.2843 => 3.9709, std.dev.: 0.1164) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2280, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.43% (4.5424 => 4.2505, std.dev.: 0.0748) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.72% (4.9799 => 4.6950, std.dev.: 0.0497) SingleSource/Benchmarks/McGill/queens: -5.61% (1.7443 => 1.6465, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.96% (23.3986 => 22.2371, std.dev.: 0.1176) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.87% (0.3349 => 0.3186, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (3.6768 => 3.4984, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.48% (3.5127 => 3.3553, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.40% (1.4446 => 1.3810, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.74% (3.5691 => 3.4357, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (5.8973 => 5.6841, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/lists: -3.50% (17.2182 => 16.6151, std.dev.: 0.1012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.37% (2.5170 => 2.4322, std.dev.: 0.0043) MultiSource/Applications/SIBsim4/SIBsim4: -3.16% (3.5443 => 3.4322, std.dev.: 0.0306) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.06% (40.4729 => 39.2332, std.dev.: 0.1117) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.02% (0.3406 => 0.3303, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.11% (3.0082 => 2.9446, std.dev.: 0.0191) MultiSource/Applications/spiff/spiff: -2.08% (2.8571 => 2.7978, std.dev.: 0.0174) SingleSource/Benchmarks/Misc/mandel-2: -1.80% (0.8521 => 0.8368, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5765, std.dev.: 0.0065) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.71% (85.3042 => 83.8475, std.dev.: 0.0676) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.64% (3.5669 => 3.5085, std.dev.: 0.0052) MultiSource/Applications/lua/lua: -1.20% (29.0327 => 28.6843, std.dev.: 0.0846) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.17% (8.8249 => 8.7214, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (3.7450 => 3.7020, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.12% (6.8262 => 6.7499, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.27% (1.2047 => 1.2200, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0149) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.35% (0.0328 => 0.0317, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0084) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.20% (0.1530 => 0.1533, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -38.40% (1.9293 => 1.1884, std.dev.: 0.0054) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.59% (0.4049 => 0.4025, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.72% (0.1510 => 0.1469, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.72% (0.0978 => 0.0658, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.15% (0.0590 => 0.0536, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.57% (1.1617 => 1.3193, std.dev.: 0.0153) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.92% (0.7437 => 1.7471, std.dev.: 0.0062) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.22% (0.0092 => 0.0055, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.72% (12.7781 => 34.3373, std.dev.: 0.1103) Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 00:37:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 02:37:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126083733.4496B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/7962?compare_to=7959&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7962, Order: 173561, Start Time: 2013-01-26 06:58:57, End Time: 2013-01-26 08:37:50 To: 7959, Order: 173558, Start Time: 2013-01-26 05:01:33, End Time: 2013-01-26 06:35:15 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (108 on baseline) Performance Improvements: 0 (82 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (902 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.94% (0.0974 => 0.1626, std.dev.: 0.0140) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.98% (0.6395 => 0.8824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.45% (0.5688 => 0.7534, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.38% (0.6260 => 0.8287, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.13% (0.5456 => 0.7209, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.85% (0.5849 => 0.7712, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.76% (0.5567 => 0.7335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.67% (0.6395 => 0.8420, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.44% (0.5575 => 0.7328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.43% (0.5581 => 0.7335, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.37% (0.5941 => 0.7745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.87% (0.6033 => 0.7835, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.85% (0.5859 => 0.7608, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.24% (0.6440 => 0.8323, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.82% (1.6474 => 2.1222, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.57% (0.6189 => 0.7957, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.22% (0.6676 => 0.8560, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.81% (0.6304 => 0.8057, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.56% (0.6230 => 0.7947, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.67% (0.6660 => 0.8436, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.59% (0.5802 => 0.7345, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.35% (0.5705 => 0.7208, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.14% (0.5925 => 0.7474, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.76% (0.5857 => 0.7366, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.60% (0.5570 => 0.6996, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.52% (0.5569 => 0.6990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.43% (0.5478 => 0.6871, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.24% (0.5591 => 0.7002, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.15% (0.7524 => 0.9341, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.05% (0.6446 => 0.7996, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.86% (0.5863 => 0.7262, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.61% (0.6052 => 0.7481, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.08% (0.6681 => 0.8223, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.93% (0.6194 => 0.7614, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.36% (0.6297 => 0.7705, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.76% (2.2587 => 2.7501, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.37% (0.6667 => 0.8092, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.51% (0.7339 => 0.8771, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 15.31% (0.3357 => 0.3871, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 15.03% (1.1450 => 1.3171, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.57% (4.5069 => 5.0735, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4916 => 0.5520, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4515 => 0.5056, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.57% (3.5339 => 3.9429, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8247, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.76% (0.1230 => 0.1350, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 9.57% (9.2283 => 10.1119, std.dev.: 0.1186) MultiSource/Applications/Burg/burg: 8.51% (1.2515 => 1.3580, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 8.33% (0.4524 => 0.4901, std.dev.: 0.0116) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.07% (0.5329 => 0.5759, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.80% (0.1731 => 0.1866, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.40% (1.4642 => 1.5725, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4861 => 0.5216, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.19% (0.7021 => 0.7526, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.83% (1.2784 => 1.3657, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 5.70% (0.6750 => 0.7135, std.dev.: 0.0058) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3319 => 0.3502, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.24% (5.4682 => 5.7001, std.dev.: 0.0063) MultiSource/Applications/oggenc/oggenc: 3.62% (5.0226 => 5.2046, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3.11% (1.3864 => 1.4295, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 3.02% (0.8418 => 0.8672, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 2.44% (0.7447 => 0.7629, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.26% (22.4056 => 22.9112, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.12% (0.9557 => 0.9760, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 2.05% (15.5079 => 15.8260, std.dev.: 0.0273) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.3722 => 1.3983, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2300 => 1.2425, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8031, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.63% (0.9531 => 1.0258, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.27% (0.2380 => 0.2553, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1649, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.5751 => 56.3212, std.dev.: 0.1472) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0148) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.62% (18.2231 => 18.5180, std.dev.: 0.0100) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2481, std.dev.: 0.0995) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.12% (3.6551 => 3.6961, std.dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.95% (0.7198 => 0.6842, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: -4.10% (0.3880 => 0.3721, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.09% (0.3884 => 0.3725, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-3: -4.08% (0.3848 => 0.3691, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/for-in: -4.02% (0.4033 => 0.3871, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: -3.95% (0.3896 => 0.3742, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3821 => 0.3672, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.86% (0.3837 => 0.3689, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.81% (2.4924 => 2.3975, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.55% (0.9852 => 0.9502, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: -3.07% (0.6441 => 0.6243, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (0.9542 => 0.9271, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.77% (2.1713 => 2.1111, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -2.57% (1.3148 => 1.2810, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.47% (0.6484 => 0.6324, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.93% (14.2083 => 13.9341, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -1.87% (17.1032 => 16.7839, std.dev.: 0.0258) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6727, std.dev.: 0.0123) MultiSource/Applications/JM/lencod/lencod: -1.34% (16.1920 => 15.9755, std.dev.: 0.0271) MultiSource/Applications/JM/ldecod/ldecod: -1.19% (7.0961 => 7.0116, std.dev.: 0.0070) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (1.2210 => 1.2079, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.45% (1.8100 => 0.6978, std.dev.: 0.0302) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0112) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3127, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0266, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0285) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0859, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.70% (3.3454 => 2.5861, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1736, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1277, std.dev.: 0.0227) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.37% (4.9100 => 4.3516, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1760, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.02% (1.0557 => 1.0238, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.18% (7.9763 => 7.8023, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -1.84% (7.3040 => 7.1698, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4660, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.58% (1.6307 => 1.6050, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.57% (1.6219 => 1.5964, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 00:41:47 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 02:41:47 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130126084147.48EFA2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/7963?compare_to=7955&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7963, Order: 173558, Start Time: 2013-01-26 04:55:50, End Time: 2013-01-26 08:42:04 To: 7955, Order: 173526, Start Time: 2013-01-26 00:26:47, End Time: 2013-01-26 04:01:43 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (162 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (776 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.88% (0.0625 => 0.0943, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.50% (0.1063 => 0.1451, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.79% (0.0475 => 0.0626, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.20% (0.2969 => 0.3836, std.dev.: 0.0271) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0074) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.79% (0.0547 => 0.0699, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 27.44% (1.5932 => 2.0303, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.37% (0.1107 => 0.1410, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.35% (0.4139 => 0.5271, std.dev.: 0.0351) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.03% (0.5900 => 0.7495, std.dev.: 0.0522) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.59% (0.4994 => 0.6322, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.04% (0.5000 => 0.6302, std.dev.: 0.0380) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.86% (0.0584 => 0.0735, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.61% (0.4253 => 0.5342, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.30% (0.0897 => 0.1115, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.82% (0.1549 => 0.1918, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 23.21% (0.0948 => 0.1168, std.dev.: 0.0067) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.83% (0.1003 => 0.1232, std.dev.: 0.0086) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.69% (0.1604 => 0.1968, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.63% (0.0495 => 0.0607, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.57% (0.1103 => 0.1352, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.47% (0.3903 => 0.4780, std.dev.: 0.0258) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.38% (0.0822 => 0.1006, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/power/power: 22.35% (0.0604 => 0.0739, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 22.30% (0.1619 => 0.1980, std.dev.: 0.0112) MultiSource/Benchmarks/Olden/health/health: 22.29% (0.0821 => 0.1004, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.98% (0.3890 => 0.4745, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.13% (0.2736 => 0.3314, std.dev.: 0.0133) MultiSource/Applications/viterbi/viterbi: 21.01% (0.0947 => 0.1146, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.59% (0.1088 => 0.1312, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 20.44% (0.1218 => 0.1467, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 20.30% (0.0808 => 0.0972, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.26% (0.2014 => 0.2422, std.dev.: 0.0109) MultiSource/Applications/spiff/spiff: 20.20% (0.4029 => 0.4843, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.17% (1.3152 => 1.5805, std.dev.: 0.0747) MultiSource/Benchmarks/McCat/09-vor/vor: 19.80% (0.1505 => 0.1803, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.46% (0.1968 => 0.2351, std.dev.: 0.0073) SingleSource/UnitTests/ObjC++/Hello: 19.45% (0.5826 => 0.6959, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.40% (0.5026 => 0.6001, std.dev.: 0.0190) SingleSource/UnitTests/ObjC++/property-reference-object: 19.21% (0.5889 => 0.7020, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 18.97% (0.5546 => 0.6598, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.84% (0.0605 => 0.0719, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 18.81% (0.2813 => 0.3342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.75% (0.2875 => 0.3414, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 18.62% (0.9697 => 1.1503, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.48% (3.5627 => 4.2211, std.dev.: 0.1606) SingleSource/Benchmarks/Shootout-C++/objinst: 18.46% (0.2823 => 0.3344, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.43% (1.9694 => 2.3323, std.dev.: 0.0788) SingleSource/UnitTests/ObjC++/property-reference: 18.34% (0.7171 => 0.8486, std.dev.: 0.0082) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.32% (1.6211 => 1.9181, std.dev.: 0.0924) SingleSource/Benchmarks/Shootout-C++/matrix: 18.31% (0.2780 => 0.3289, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 18.25% (0.2750 => 0.3252, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.19% (0.2792 => 0.3300, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 18.18% (0.2811 => 0.3322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 18.13% (0.2725 => 0.3219, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 18.05% (0.2803 => 0.3309, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.02% (0.1160 => 0.1369, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/bh/bh: 17.99% (0.1284 => 0.1515, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/18-imp/imp: 17.95% (0.1421 => 0.1676, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hello: 17.94% (0.2714 => 0.3201, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.93% (0.2738 => 0.3229, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.93% (0.2911 => 0.3433, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.0582 => 0.0686, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.85% (0.2729 => 0.3216, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 17.79% (0.9909 => 1.1672, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.79% (2.0673 => 2.4350, std.dev.: 0.0108) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.79% (0.3930 => 0.4629, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/wc: 17.64% (0.3096 => 0.3642, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.61% (0.3004 => 0.3533, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 17.57% (0.3267 => 0.3841, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.50% (0.3195 => 0.3754, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 17.43% (0.3258 => 0.3826, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 17.34% (1.0781 => 1.2650, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.27% (1.9966 => 2.3414, std.dev.: 0.0878) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.19% (0.3060 => 0.3586, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 17.18% (0.3317 => 0.3887, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 17.08% (4.2109 => 4.9303, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: 17.05% (23.5202 => 27.5306, std.dev.: 0.0601) SingleSource/Benchmarks/Shootout-C++/lists1: 17.00% (0.3477 => 0.4068, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.92% (0.3362 => 0.3931, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 16.88% (0.3348 => 0.3913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 16.77% (0.3726 => 0.4351, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 16.75% (0.3678 => 0.4294, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.68% (0.3124 => 0.3645, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.65% (4.4195 => 5.1553, std.dev.: 0.0995) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.58% (0.3625 => 0.4226, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.58% (0.3282 => 0.3826, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.44% (2.7292 => 3.1779, std.dev.: 0.1026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: 16.18% (0.4146 => 0.4817, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 16.11% (0.4251 => 0.4936, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.10% (0.3690 => 0.4284, std.dev.: 0.0028) MultiSource/Applications/lua/lua: 16.04% (1.4269 => 1.6558, std.dev.: 0.0569) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.93% (0.3981 => 0.4615, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.47% (0.3845 => 0.4440, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 15.29% (0.3446 => 0.3973, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.28% (0.7875 => 0.9078, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/exceptions-4: 15.18% (0.3465 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.12% (0.3460 => 0.3983, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 15.07% (0.3496 => 0.4023, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.05% (0.3488 => 0.4013, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: 15.02% (0.3442 => 0.3959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 15.02% (0.3469 => 0.3990, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 14.84% (0.5012 => 0.5756, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 14.82% (0.3650 => 0.4191, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.79% (0.1028 => 0.1180, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.66% (0.3643 => 0.4177, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.50% (0.3724 => 0.4264, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 14.30% (5.5417 => 6.3342, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.20% (0.6435 => 0.7349, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: 13.90% (2.1653 => 2.4662, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.74% (0.2737 => 0.3113, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.06% (0.2068 => 0.2338, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 13.00% (4.6177 => 5.2178, std.dev.: 0.0339) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (2.1013 => 2.3735, std.dev.: 0.0026) MultiSource/Applications/lambda-0_1_3/lambda: 12.64% (0.3498 => 0.3940, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.58% (0.3084 => 0.3472, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.92% (0.5361 => 0.6000, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 11.89% (0.6634 => 0.7423, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 11.87% (0.3336 => 0.3732, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.84% (0.2103 => 0.2352, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.57% (0.2040 => 0.2276, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: 11.47% (0.4847 => 0.5403, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.98% (11.6398 => 12.9174, std.dev.: 0.0184) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.71% (0.7426 => 0.8221, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.05% (4.6926 => 5.1640, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.63% (0.5584 => 0.6122, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 9.35% (2.0346 => 2.2249, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 8.11% (11.9555 => 12.9252, std.dev.: 0.1545) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.75% (0.3792 => 0.4010, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5169, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0300) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.61% (0.3693 => 0.4085, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: 9.96% (0.2802 => 0.3081, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6761, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops-2: 4.89% (1.8057 => 1.8940, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6882, std.dev.: 0.0055) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2045, std.dev.: 0.0046) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3043, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2885, std.dev.: 0.0187) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.41% (1.0142 => 1.0285, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0800, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6860, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2062, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4811, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.73% (2.4764 => 2.4089, std.dev.: 0.0234) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5855, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.57% (17.2379 => 14.2094, std.dev.: 0.1026) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -10.32% (0.2402 => 0.2154, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7947, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: -7.19% (2.1113 => 1.9596, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2167, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0030) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8004, std.dev.: 0.0069) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -3.01% (14.0481 => 13.6247, std.dev.: 0.0312) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1387, std.dev.: 0.0376) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.78% (10.7630 => 10.5711, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4985, std.dev.: 0.0195) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1415, std.dev.: 0.0392) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0418, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 02:09:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 04:09:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126100936.C5E0C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7964?compare_to=7961&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7964, Order: 173563, Start Time: 2013-01-26 08:08:41, End Time: 2013-01-26 10:09:55 To: 7961, Order: 173559, Start Time: 2013-01-26 05:48:33, End Time: 2013-01-26 07:51:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (98 on baseline) Performance Improvements: 2 (127 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1057 (838 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.58% (0.6959 => 0.7069, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.01% (1.6121 => 1.6284, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.99% (0.3306 => 0.3537, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.41% (1.7770 => 1.8732, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.11% (1.8572 => 1.8778, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/ffbench: -2.09% (1.4189 => 1.3892, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.67% (44.4257 => 43.6857, std.dev.: 0.1954) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.34% (1.2200 => 1.2036, std.dev.: 0.0193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0222 => 0.0224, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0433 => 0.0433, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0338 => 0.0340, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.21% (0.0317 => 0.0324, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0434 => 0.0431, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0206 => 0.0207, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.09% (0.0230 => 0.0216, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -3.07% (0.1533 => 0.1486, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -4.76% (1.1884 => 1.1318, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.72% (0.4025 => 0.3996, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1469 => 0.1469, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.62% (0.0658 => 0.0621, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.89% (0.0536 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.27% (1.3193 => 1.3158, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.59% (0.0017 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0607 => 0.0612, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.27% (0.0374 => 0.0373, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.22% (1.7471 => 1.7433, std.dev.: 0.0149) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 70.91% (0.0055 => 0.0094, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.54% (34.3373 => 33.1231, std.dev.: 0.6885) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 387.20% (0.0336 => 0.1637, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 117.06% (0.0293 => 0.0636, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 91.24% (0.0274 => 0.0524, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 59.83% (0.1638 => 0.2618, std.dev.: 0.0012) SingleSource/Regression/C/sumarray: 52.83% (0.0265 => 0.0405, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.14% (0.9120 => 1.2872, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.05% (0.8893 => 1.2544, std.dev.: 0.0440) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.03% (0.8926 => 1.2588, std.dev.: 0.0908) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.51% (0.9612 => 1.3506, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.46% (0.9061 => 1.2727, std.dev.: 0.1288) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.47% (0.9564 => 1.3339, std.dev.: 0.0868) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.44% (0.9381 => 1.3081, std.dev.: 0.1006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.27% (0.9588 => 1.3353, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.82% (0.8990 => 1.2480, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.30% (0.9091 => 1.2573, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.26% (0.9855 => 1.3626, std.dev.: 0.1052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.64% (0.9422 => 1.2968, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.57% (0.9998 => 1.3754, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.24% (0.9403 => 1.2905, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.63% (0.9010 => 1.2310, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.90% (1.0119 => 1.3752, std.dev.: 0.1038) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.90% (0.8736 => 1.1872, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.74% (0.8912 => 1.2097, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.08% (1.0867 => 1.4679, std.dev.: 0.0584) SingleSource/Benchmarks/Stanford/IntMM: 35.03% (0.0431 => 0.0582, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.00% (1.0052 => 1.3570, std.dev.: 0.0968) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.53% (0.8732 => 1.1747, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.02% (0.8846 => 1.1855, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.54% (0.9867 => 1.3078, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.41% (1.0017 => 1.3264, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.67% (0.9788 => 1.2888, std.dev.: 0.0133) SingleSource/Benchmarks/McGill/exptree: 31.66% (0.0859 => 0.1131, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.37% (0.9488 => 1.2464, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.29% (0.9507 => 1.2482, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.68% (0.9127 => 1.1927, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.52% (1.0088 => 1.3167, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.30% (0.9685 => 1.2620, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.30% (0.9405 => 1.2161, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.54% (0.9550 => 1.2276, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.45% (1.0860 => 1.3733, std.dev.: 0.0249) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.00% (0.0738 => 0.0893, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 19.07% (0.3598 => 0.4284, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.97% (0.0738 => 0.0878, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.74% (0.0669 => 0.0781, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.61% (0.0963 => 0.1123, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.20% (0.0783 => 0.0902, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.53% (0.0805 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.91% (1.0986 => 1.2514, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.87% (3.6295 => 4.1330, std.dev.: 0.0498) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.36% (0.1332 => 0.1510, std.dev.: 0.0049) MultiSource/Benchmarks/mafft/pairlocalalign: 12.18% (9.5202 => 10.6801, std.dev.: 0.2953) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 11.21% (0.1240 => 0.1379, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 10.34% (0.2050 => 0.2262, std.dev.: 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.20% (0.4596 => 0.5065, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2385 => 0.2618, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.59% (0.5369 => 0.5884, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.48% (1.4110 => 1.5447, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 9.26% (0.1793 => 0.1959, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.90% (0.1955 => 0.2129, std.dev.: 0.0030) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.69% (5.0381 => 5.4759, std.dev.: 0.0485) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.42% (0.2577 => 0.2794, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: 8.11% (0.2566 => 0.2774, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.48% (1.8651 => 2.0046, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.26% (0.2879 => 0.3088, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.16% (2.4519 => 2.5785, std.dev.: 0.0276) MultiSource/Applications/oggenc/oggenc: 3.59% (5.3553 => 5.5474, std.dev.: 0.0364) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107025.00% (0.0008 => 0.8570, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 335.26% (1.5825 => 6.8880, std.dev.: 0.1823) SingleSource/Benchmarks/Shootout/ary3: 270.03% (2.2304 => 8.2531, std.dev.: 1.9058) MultiSource/Applications/sgefa/sgefa: 259.09% (0.3515 => 1.2622, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.38% (1.1825 => 4.0723, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.94% (4.8185 => 15.8499, std.dev.: 0.0944) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 221.05% (0.0228 => 0.0732, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary2: 187.60% (0.0129 => 0.0371, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 141.81% (0.0232 => 0.0561, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 63.54% (2.9083 => 4.7561, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.48% (3.1254 => 4.1093, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.11% (0.2562 => 0.3359, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.41% (1.4588 => 1.8732, std.dev.: 0.0177) SingleSource/Regression/C/uint64_to_float: 24.00% (1.5397 => 1.9092, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.03% (5.6033 => 6.8938, std.dev.: 0.0959) SingleSource/Benchmarks/Misc/salsa20: 21.80% (7.4497 => 9.0740, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.52% (4.8112 => 5.7984, std.dev.: 0.0169) MultiSource/Applications/JM/lencod/lencod: 13.22% (6.8159 => 7.7170, std.dev.: 0.1811) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8567, std.dev.: 0.0542) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6504, std.dev.: 0.1209) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.86% (0.6211 => 0.6761, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (3.6477 => 3.9688, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 8.00% (8.6447 => 9.3359, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (4.7473 => 5.0682, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (4.1836 => 4.4058, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/chomp: 5.27% (1.0425 => 1.0974, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.86% (5.0310 => 5.2251, std.dev.: 0.0273) SingleSource/Benchmarks/Misc/pi: 3.41% (2.1390 => 2.2119, std.dev.: 0.0037) SingleSource/Benchmarks/Linpack/linpack-pc: 3.37% (50.8945 => 52.6095, std.dev.: 0.5171) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.24% (4.7254 => 4.8785, std.dev.: 0.0085) MultiSource/Applications/siod/siod: 1.22% (3.5910 => 3.6349, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.08% (4.8076 => 4.8595, std.dev.: 0.0108) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.35% (0.0808 => 0.0482, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -34.94% (0.0727 => 0.0473, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.62% (0.0692 => 0.0487, std.dev.: 0.0013) SingleSource/Benchmarks/SmallPT/smallpt: -25.85% (0.1888 => 0.1400, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.53% (0.0676 => 0.0544, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -18.85% (1.8964 => 1.5389, std.dev.: 0.0147) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.24% (0.1009 => 0.0825, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.40% (0.1684 => 0.1391, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.05% (0.1079 => 0.0895, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.58% (1.0960 => 0.9252, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.23% (0.7686 => 0.6592, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.76% (0.0862 => 0.0752, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: -11.53% (1.0220 => 0.9042, std.dev.: 0.0116) MultiSource/Applications/aha/aha: -11.47% (0.1378 => 0.1220, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.41% (0.4074 => 0.3650, std.dev.: 0.0052) MultiSource/Applications/treecc/treecc: -10.22% (2.4719 => 2.2193, std.dev.: 0.0210) MultiSource/Applications/hexxagon/hexxagon: -10.13% (1.1433 => 1.0275, std.dev.: 0.0047) MultiSource/Applications/Burg/burg: -9.69% (1.5979 => 1.4431, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.51% (6.4235 => 5.8129, std.dev.: 0.1231) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.93% (0.1366 => 0.1244, std.dev.: 0.0005) MultiSource/Applications/lua/lua: -8.72% (4.6406 => 4.2358, std.dev.: 0.0095) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.67% (0.2481 => 0.2266, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: -8.34% (0.5134 => 0.4706, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.11% (0.7693 => 0.7069, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: -7.93% (0.4689 => 0.4317, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: -7.58% (17.5634 => 16.2320, std.dev.: 0.0909) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.54% (1.2154 => 1.1238, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.52% (10.2703 => 9.4980, std.dev.: 0.0783) MultiSource/Applications/siod/siod: -7.44% (2.6437 => 2.4470, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.37% (1.0234 => 0.9480, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: -7.29% (0.8653 => 0.8022, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.26% (1.1498 => 1.0663, std.dev.: 0.0125) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.94% (0.3560 => 0.3313, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.90% (0.6885 => 0.6410, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/health/health: -6.83% (0.1610 => 0.1500, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: -6.83% (1.3979 => 1.3024, std.dev.: 0.0104) MultiSource/Applications/ClamAV/clamscan: -6.71% (17.4365 => 16.2658, std.dev.: 0.0546) SingleSource/Benchmarks/Shootout-C++/fibo: -5.88% (0.2006 => 0.1888, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: -5.62% (3.7840 => 3.5715, std.dev.: 0.0258) SingleSource/Benchmarks/Shootout-C++/hello: -5.55% (0.1928 => 0.1821, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.30% (0.2283 => 0.2162, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.29% (0.9588 => 0.9081, std.dev.: 0.0097) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.02% (0.2709 => 0.2573, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.93% (0.2618 => 0.2489, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.84% (0.5746 => 0.5468, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: -4.72% (0.4002 => 0.3813, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -4.52% (0.3715 => 0.3547, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.10% (1.5131 => 1.4510, std.dev.: 0.0163) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.88% (0.2884 => 0.2772, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.88% (0.3093 => 0.2973, std.dev.: 0.0009) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.66% (1.1731 => 1.1302, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.50% (1.6874 => 1.6284, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.49% (0.3665 => 0.3537, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.16% (1.3924 => 1.3484, std.dev.: 0.0027) MultiSource/Applications/kimwitu++/kc: -2.28% (18.9377 => 18.5058, std.dev.: 0.0600) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.16% (14.9757 => 14.6517, std.dev.: 0.0677) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.80% (1.3220 => 1.2982, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.74% (0.7225 => 0.7099, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: -1.09% (16.4479 => 16.2693, std.dev.: 0.0333) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.92% (11.5523 => 3.9370, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/fp-convert: -62.23% (15.6525 => 5.9123, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.20% (0.4146 => 0.1816, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.34% (0.4578 => 0.2365, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.05% (11.3868 => 6.3705, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.95% (5.4023 => 3.6221, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.33% (0.4452 => 0.3057, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: -31.11% (0.9372 => 0.6456, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/heapsort: -29.08% (4.4739 => 3.1727, std.dev.: 0.4970) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.68% (0.5495 => 0.4029, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.13% (5.2605 => 3.8857, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.47% (4.2042 => 3.1335, std.dev.: 0.1739) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.30% (0.5826 => 0.4352, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.02% (4.4467 => 3.3340, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.77% (0.5897 => 0.4495, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8231, std.dev.: 0.0034) MultiSource/Applications/minisat/minisat: -22.75% (7.9891 => 6.1717, std.dev.: 0.0313) SingleSource/Benchmarks/Shootout-C++/ary3: -22.71% (1.8123 => 1.4008, std.dev.: 0.0185) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.49% (1.0816 => 0.8600, std.dev.: 0.0051) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.84% (16.6791 => 13.3699, std.dev.: 0.4562) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.53% (1.5623 => 1.2572, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.38% (5.8755 => 4.7955, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.02% (7.0016 => 5.8098, std.dev.: 0.2614) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.00% (0.1164 => 0.1001, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.97% (3.1921 => 2.7780, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6748, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.48% (9.7992 => 8.5762, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9945, std.dev.: 0.0236) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.83% (1.4235 => 1.2551, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.57% (2.8778 => 2.5735, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.38% (5.0421 => 4.5187, std.dev.: 0.0798) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -8.81% (9.0650 => 8.2668, std.dev.: 0.1655) SingleSource/Benchmarks/Shootout-C++/lists1: -8.65% (0.6628 => 0.6055, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.26% (4.2843 => 3.9731, std.dev.: 0.0256) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.26% (23.3986 => 21.6993, std.dev.: 0.4194) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.63% (5.5974 => 5.2262, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/health/health: -6.60% (0.3654 => 0.3413, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.57% (4.5424 => 4.2439, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.42% (4.9799 => 4.7102, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/queens: -5.35% (1.7443 => 1.6510, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.26% (0.3349 => 0.3173, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.23% (46.0987 => 43.6857, std.dev.: 0.1954) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (3.6768 => 3.5016, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.36% (3.5127 => 3.3596, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.22% (3.7662 => 3.6072, std.dev.: 0.0174) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.97% (1.0995 => 1.0559, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4365, std.dev.: 0.0440) SingleSource/Benchmarks/Shootout-C++/lists: -3.55% (17.2182 => 16.6062, std.dev.: 0.0899) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.50% (40.4729 => 39.0571, std.dev.: 0.2103) MultiSource/Applications/SIBsim4/SIBsim4: -3.20% (3.5443 => 3.4308, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.95% (42.3194 => 41.0689, std.dev.: 0.1393) SingleSource/Benchmarks/Misc/ffbench: -2.47% (1.4244 => 1.3892, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/mandel-2: -2.28% (0.8521 => 0.8327, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.91% (3.0082 => 2.9506, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.81% (61.0379 => 59.9330, std.dev.: 0.1067) SingleSource/Benchmarks/Shootout-C++/hash: -1.76% (0.6254 => 0.6144, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (8.7327 => 8.5840, std.dev.: 0.0087) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.68% (85.3042 => 83.8747, std.dev.: 0.3082) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.8249 => 8.6818, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/whetstone: -1.45% (1.6251 => 1.6015, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.44% (3.3596 => 3.3111, std.dev.: 0.0093) SingleSource/Benchmarks/SmallPT/smallpt: -1.39% (14.9448 => 14.7364, std.dev.: 0.0547) MultiSource/Benchmarks/BitBench/five11/five11: -1.37% (5.7021 => 5.6241, std.dev.: 0.0263) MultiSource/Applications/lua/lua: -1.28% (29.0327 => 28.6618, std.dev.: 0.0374) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (3.7450 => 3.7018, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/methcall: -1.10% (8.7416 => 8.6455, std.dev.: 0.0123) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.09% (1.2047 => 1.2036, std.dev.: 0.0193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.22% (0.0328 => 0.0324, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -15.29% (0.0255 => 0.0216, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.88% (0.1530 => 0.1486, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -41.34% (1.9293 => 1.1318, std.dev.: 0.0306) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.31% (0.4049 => 0.3996, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.72% (0.1510 => 0.1469, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.50% (0.0978 => 0.0621, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.17% (0.0590 => 0.0589, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.27% (1.1617 => 1.3158, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.41% (0.7437 => 1.7433, std.dev.: 0.0149) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.17% (0.0092 => 0.0094, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 159.22% (12.7781 => 33.1231, std.dev.: 0.6885) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 02:27:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 04:27:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126102705.71F352A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7965?compare_to=7960&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7965, Order: 173563, Start Time: 2013-01-26 08:15:54, End Time: 2013-01-26 10:27:22 To: 7960, Order: 173559, Start Time: 2013-01-26 05:30:49, End Time: 2013-01-26 07:41:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (218 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.30% (0.0664 => 0.0666, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7651 => 499.8580, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.44% (1.1277 => 499.8580, std.dev.: 0.0035) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.66% (0.5229 => 1.6506, std.dev.: 0.0036) MultiSource/Applications/SPASS/SPASS: 20.53% (14.9895 => 18.0664, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 44.43% (14.1553 => 20.4438, std.dev.: 0.0246) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8501, std.dev.: 0.0281) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.57% (1.1048 => 1.7298, std.dev.: 0.0030) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.03% (7.1582 => 37.3680, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.75% (3.4629 => 6.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.76% (0.6222 => 1.0936, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.25% (0.0720 => 7.4457, std.dev.: 0.0021) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 11159600.00% (0.0001 => 11.1597, std.dev.: 0.0186) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487000.00% (0.0001 => 5.4871, std.dev.: 0.0053) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.34% (1.1194 => 10.3582, std.dev.: 0.0310) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.09% (22.1758 => 55.2366, std.dev.: 0.0465) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.09% (0.0929 => 0.1831, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 71.43% (0.1463 => 0.2508, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456) SingleSource/Benchmarks/CoyoteBench/almabench: 65.89% (0.0730 => 0.1211, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.80% (2.9384 => 4.6075, std.dev.: 0.0029) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.37% (7.0540 => 10.8184, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.46% (1.5859 => 2.4020, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.10% (8.1363 => 11.9683, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.84% (2.2024 => 3.1239, std.dev.: 0.0080) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 37.67% (21.9371 => 30.2015, std.dev.: 0.0273) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0011) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.35% (4.2646 => 5.6870, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.42% (0.4615 => 0.6111, std.dev.: 0.0025) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.30% (1.5415 => 2.0394, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.47% (0.2271 => 0.2963, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 29.57% (1.1642 => 1.5085, std.dev.: 0.0087) MultiSource/Benchmarks/NPB-serial/is/is: 29.35% (0.0719 => 0.0930, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 29.33% (0.4299 => 0.5560, std.dev.: 0.0022) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.70% (0.5105 => 0.6519, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.16% (0.6675 => 0.8488, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.99% (0.0793 => 0.1007, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.43% (0.1892 => 0.2392, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.33% (0.1143 => 0.1444) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.22% (0.1125 => 0.1420, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 26.01% (9.4845 => 11.9514, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.95% (3.8922 => 4.9022, std.dev.: 0.0119) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 25.50% (0.1655 => 0.2077, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.95% (0.4289 => 0.5359, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 24.45% (1.0722 => 1.3344, std.dev.: 0.0168) MultiSource/Benchmarks/Olden/tsp/tsp: 24.43% (0.1175 => 0.1462, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.34% (0.1906 => 0.2370, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.20% (0.1566 => 0.1945, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.18% (1.4186 => 1.7616, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.16% (0.3121 => 0.3875, std.dev.: 0.0082) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.07% (0.1695 => 0.2103, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.01% (0.1337 => 0.1658, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 24.00% (0.4620 => 0.5729, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 23.09% (0.6456 => 0.7947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.62% (0.0672 => 0.0824, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 22.53% (0.7115 => 0.8718, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.22% (0.2700 => 0.3300, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 21.86% (0.1555 => 0.1895, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 21.79% (0.3098 => 0.3773, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 21.37% (0.1151 => 0.1397, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.36% (0.1236 => 0.1500, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.25% (0.0626 => 0.0759, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0019) MultiSource/Applications/spiff/spiff: 20.94% (0.7835 => 0.9476, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.87% (1.3050 => 1.5773, std.dev.: 0.0057) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 20.38% (5.7591 => 6.9328, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 20.29% (0.1163 => 0.1399, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.23% (0.8172 => 0.9825, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.93% (0.5860 => 0.7028, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.92% (4.9449 => 5.9297, std.dev.: 0.0126) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.79% (0.1940 => 0.2324, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.01% (5.0018 => 5.9528, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.94% (0.5020 => 0.5971, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.93% (0.3307 => 0.3933, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 18.84% (3.3354 => 3.9637, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.38% (0.2758 => 0.3265, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 18.20% (0.7433 => 0.8786, std.dev.: 0.0043) MultiSource/Benchmarks/nbench/nbench: 18.07% (1.1840 => 1.3979, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.01% (0.5569 => 0.6572, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.99% (0.9765 => 1.1522, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.80% (0.2107 => 0.2482, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0050) MultiSource/Applications/treecc/treecc: 17.54% (2.0273 => 2.3828, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.49% (0.4203 => 0.4938, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 17.48% (3.8723 => 4.5493, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.35% (0.5981 => 0.7019, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.24% (0.2065 => 0.2421, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.21% (1.1861 => 1.3902, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/18-imp/imp: 17.21% (0.3423 => 0.4012, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 17.15% (0.3283 => 0.3846, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.83% (2.2969 => 2.6835, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 16.77% (0.3232 => 0.3774, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.68% (0.3441 => 0.4015, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.60% (0.8101 => 0.9446, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.03% (0.6450 => 0.7484, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 15.67% (0.2049 => 0.2370, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 15.13% (0.8921 => 1.0271, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 15.06% (0.3379 => 0.3888, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.95% (0.8067 => 0.9273, std.dev.: 0.0076) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.26% (0.3865 => 0.4416, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.18% (0.2603 => 0.2972, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 14.11% (0.2905 => 0.3315, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.61% (0.4636 => 0.5267, std.dev.: 0.0032) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.45% (0.4103 => 0.4655, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 13.00% (1.5603 => 1.7632, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/sieve: 12.55% (0.3603 => 0.4055, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 12.52% (0.4048 => 0.4555, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.42% (0.3422 => 0.3847, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.19% (0.3684 => 0.4133, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 11.92% (17.1811 => 19.2298, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.77% (0.2430 => 0.2716, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.66% (0.3826 => 0.4272, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/parameter-passing: 11.23% (0.3927 => 0.4368, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.07% (0.4064 => 0.4514, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 11.06% (0.3282 => 0.3645, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/strcat: 10.81% (0.2831 => 0.3137, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 10.78% (0.3886 => 0.4305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.74% (0.3427 => 0.3795, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.50% (14.3668 => 15.8748, std.dev.: 0.0106) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.16% (0.3828 => 0.4217, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.07% (0.2871 => 0.3160, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.05% (0.1114 => 0.1226, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.00% (2.0665 => 2.2732, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 9.73% (0.2877 => 0.3157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.68% (0.3543 => 0.3886, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 9.66% (0.3694 => 0.4051, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3497 => 0.3833, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.60% (0.3561 => 0.3903, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.56% (0.3516 => 0.3852, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.55% (1.2842 => 1.4068, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.44% (0.2891 => 0.3164, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (0.2756 => 0.3016, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.42% (0.3650 => 0.3994, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.36% (0.3162 => 0.3458, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 9.14% (0.3052 => 0.3331, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.14% (0.2714 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.09% (0.2872 => 0.3133, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.06% (0.2802 => 0.3056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 8.92% (0.2725 => 0.2968, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.88% (0.2793 => 0.3041, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.82% (0.3935 => 0.4282, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.80% (0.7326 => 0.7971, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7516, std.dev.: 0.0968) SingleSource/UnitTests/ObjC++/Hello: 8.66% (0.5925 => 0.6438, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.55% (0.3136 => 0.3404, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.78% (2.2022 => 2.3516, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.33% (0.4879 => 0.5188, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 5.86% (10.3673 => 10.9748, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/objinst: 4.44% (0.3131 => 0.3270, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.36% (7.9617 => 8.1499, std.dev.: 0.0229) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4750, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3860, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.76% (4.2280 => 4.4716, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3103, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.69% (8.6802 => 8.9140, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7097, std.dev.: 0.0123) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2715, std.dev.: 0.0284) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3055, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5766, std.dev.: 0.0046) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1706, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.04% (0.8651 => 0.2159, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.06% (5.3855 => 4.4668, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.59% (5.3526 => 4.4647, std.dev.: 0.0176) MultiSource/Applications/JM/ldecod/ldecod: -13.46% (10.4361 => 9.0309, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.89% (1.7609 => 1.6220, std.dev.: 0.0044) SingleSource/UnitTests/Vector/constpool: -7.79% (54.1659 => 49.9471, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.46% (1.9577 => 0.6567, std.dev.: 0.0109) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.56% (1.5373 => 1.0214, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.77% (10.7105 => 7.4151, std.dev.: 0.0107) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8509, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0049, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029) SingleSource/UnitTests/Vector/multiplies: -16.62% (2.5528 => 2.1284, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.94% (0.9540 => 0.8401, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4936, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7049, std.dev.: 0.0179) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.81% (19.9488 => 18.5906, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.80% (1.2373 => 1.1655, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7033, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5068, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.46% (10.2830 => 9.8245, std.dev.: 0.0107) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0079) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -1.50% (3.6994 => 3.6439, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -1.33% (4.6441 => 4.5824, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0034) Report Time: 1.58s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 02:36:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 04:36:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126103616.2D9A02A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7966?compare_to=7962&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7966, Order: 173567, Start Time: 2013-01-26 09:01:51, End Time: 2013-01-26 10:36:33 To: 7962, Order: 173561, Start Time: 2013-01-26 06:58:57, End Time: 2013-01-26 08:37:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (114 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/lists: 1.76% (6.1401 => 6.2481, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.31% (79.8502 => 80.8973, std.dev.: 0.3535) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 45.32% (0.0267 => 0.0388, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.08% (0.6395 => 0.8830, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.54% (0.5688 => 0.7539, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.43% (0.6260 => 0.8290, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.39% (0.5805 => 0.7685, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.09% (0.5456 => 0.7207, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.83% (0.5567 => 0.7339, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.80% (0.5849 => 0.7709, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.64% (0.5575 => 0.7339, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.60% (0.6395 => 0.8416, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.48% (0.5581 => 0.7338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.52% (0.5941 => 0.7754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.02% (0.5859 => 0.7618, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.90% (0.6033 => 0.7837, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.44% (0.6440 => 0.8336, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.72% (1.6474 => 2.1205, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.60% (0.6189 => 0.7959, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.81% (0.6304 => 0.8057, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.40% (0.6230 => 0.7937, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.35% (0.5925 => 0.7486, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.24% (0.5705 => 0.7202, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.88% (0.5857 => 0.7373, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.62% (0.5570 => 0.6997, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.48% (0.5569 => 0.6988, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.45% (0.5478 => 0.6872, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.99% (0.5591 => 0.6988, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.18% (0.0699 => 0.0868, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.02% (0.5863 => 0.7271, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.99% (0.7524 => 0.9329, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.81% (0.6446 => 0.7981, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.74% (0.6052 => 0.7489, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.93% (0.6681 => 0.8213, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.72% (0.6194 => 0.7601, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.55% (0.6297 => 0.7717, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.61% (2.2587 => 2.7469, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.39% (0.6667 => 0.8093, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.73% (0.7339 => 0.8787, std.dev.: 0.0169) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 15.19% (0.3357 => 0.3867, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 14.98% (1.1450 => 1.3165, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.54% (4.5069 => 5.0722, std.dev.: 0.0149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.41% (0.4916 => 0.5526, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4515 => 0.5056, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.60% (3.5339 => 3.9440, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.51% (1.6364 => 1.8248, std.dev.: 0.0115) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.50% (0.1982 => 0.2210, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.76% (0.1230 => 0.1350, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.62% (9.2283 => 10.1162, std.dev.: 0.0052) MultiSource/Applications/Burg/burg: 8.65% (1.2515 => 1.3598, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.60% (0.2001 => 0.2173, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.05% (0.5329 => 0.5758, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 7.87% (0.4524 => 0.4880, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.80% (0.1731 => 0.1866, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.37% (1.4642 => 1.5721, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.24% (0.7021 => 0.7529, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.14% (0.4861 => 0.5208, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.87% (1.2784 => 1.3662, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 6.17% (0.1879 => 0.1995, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.14% (0.3255 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.56% (0.6750 => 0.7125, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.24% (0.3319 => 0.3493, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.33% (5.4682 => 5.7047, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 3.56% (5.0226 => 5.2012, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.40% (0.8418 => 0.8704, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/ary: 3.39% (0.3394 => 0.3509, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 2.97% (1.3864 => 1.4276, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4427 => 0.4540, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 2.31% (0.7447 => 0.7619, std.dev.: 0.0037) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.29% (22.4056 => 22.9181, std.dev.: 0.0170) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.13% (0.9557 => 0.9761, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 1.99% (15.5079 => 15.8167, std.dev.: 0.0319) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.81% (1.3722 => 1.3970, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.13% (1.2300 => 1.2439, std.dev.: 0.0032) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8026, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.68% (0.9531 => 1.0358, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 7.50% (0.5692 => 0.6119, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1644, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4213, std.dev.: 0.1322) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0083) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5127, std.dev.: 0.0147) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2471, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.48% (79.7170 => 80.8973, std.dev.: 0.3535) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2683, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.90% (0.7198 => 0.6845, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: -4.88% (0.3194 => 0.3038, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.17% (0.3812 => 0.3653, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3848 => 0.3690, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.07% (0.3880 => 0.3722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.07% (0.3884 => 0.3726, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -4.00% (0.3896 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3831 => 0.3679, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.91% (0.3837 => 0.3687, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.91% (0.3891 => 0.3739, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3963, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -3.71% (0.4176 => 0.4021, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.60% (0.9852 => 0.9497, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: -3.32% (0.6347 => 0.6136, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: -3.14% (0.4199 => 0.4067, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: -3.09% (0.7779 => 0.7539, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference-object: -3.00% (0.6441 => 0.6248, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.85% (0.9542 => 0.9270, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: -2.76% (0.4280 => 0.4162, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.72% (2.1713 => 2.1123, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -2.58% (1.3148 => 1.2809, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.41% (0.6484 => 0.6328, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -2.13% (20.7746 => 20.3327, std.dev.: 0.0307) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.95% (14.2083 => 13.9318, std.dev.: 0.0089) MultiSource/Applications/sqlite3/sqlite3: -1.86% (17.1032 => 16.7853, std.dev.: 0.0186) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6729, std.dev.: 0.0126) MultiSource/Applications/JM/lencod/lencod: -1.42% (16.1920 => 15.9622, std.dev.: 0.0245) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.24% (1.0544 => 1.0413, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -1.21% (7.0961 => 7.0101, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: -1.11% (4.3330 => 4.2851, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.06% (1.2221 => 1.2092, std.dev.: 0.0045) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.02% (1.2210 => 1.2086, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.34% (1.8100 => 0.6816, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.29% (4.3504 => 3.2500) SingleSource/Benchmarks/Misc/mandel-2: -24.63% (1.3643 => 1.0283, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7561, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0726, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.09% (4.1024 => 3.1962, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1268, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3576, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8191, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.03% (0.3273 => 0.3141, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7647, std.dev.: 0.0181) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.55% (1.3096 => 1.2762, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/ary3: -2.44% (3.7241 => 3.6334, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1745, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6104, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6022, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5899, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 04:29:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 06:29:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126122915.2DED52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7967?compare_to=7964&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7967, Order: 173567, Start Time: 2013-01-26 10:27:04, End Time: 2013-01-26 12:29:34 To: 7964, Order: 173563, Start Time: 2013-01-26 08:08:41, End Time: 2013-01-26 10:09:55 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 1 (93 on baseline) Performance Improvements: 4 (79 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1059 (891 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/matrix: 3.76% (6.8880 => 7.1469, std.dev.: 0.0565) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.49% (24.4092 => 24.0456, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -3.03% (9.5790 => 9.2888, std.dev.: 0.0631) SingleSource/Benchmarks/CoyoteBench/lpbench: -1.93% (4.1686 => 4.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/hash: -1.15% (4.0902 => 4.0431, std.dev.: 0.0093) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.44% (1.2036 => 1.2330, std.dev.: 0.1506) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0224 => 0.0223, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -24.41% (0.0340 => 0.0257, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0324 => 0.0323, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0431 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -6.28% (0.0207 => 0.0194, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0221 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -38.43% (0.0216 => 0.0133, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 3.70% (0.1486 => 0.1541, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 1.25% (1.1318 => 1.1460, std.dev.: 0.3805) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.50% (0.3996 => 0.4056, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.09% (0.1469 => 0.1453, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.29% (0.0621 => 0.0613, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.75% (0.0267 => 0.0277, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.74% (0.0589 => 0.0611, std.dev.: 0.0155) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.34% (1.3158 => 1.3203, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.75% (0.0612 => 0.0534, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.27% (0.0373 => 0.0372, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.34% (1.7433 => 1.7666, std.dev.: 0.0054) SingleSource/Regression/C/2003-05-21-UnionBitfields: 500.00% (0.0001 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -10.64% (0.0094 => 0.0084, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.99% (33.1231 => 33.7829, std.dev.: 0.4742) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 394.94% (0.0336 => 0.1663, std.dev.: 0.0007) SingleSource/Regression/C/sumarraymalloc: 108.87% (0.0293 => 0.0612, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 84.31% (0.0274 => 0.0505, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 58.73% (0.1638 => 0.2600, std.dev.: 0.0045) SingleSource/Regression/C/sumarray: 55.09% (0.0265 => 0.0411, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.79% (0.9120 => 1.2931, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.38% (0.8926 => 1.2620, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.34% (0.8893 => 1.2569, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.50% (0.9061 => 1.2731, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.21% (0.9612 => 1.3477, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.72% (0.9381 => 1.3107, std.dev.: 0.0305) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.49% (0.9564 => 1.3341, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.18% (0.9588 => 1.3345, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.59% (0.8990 => 1.2459, std.dev.: 0.0534) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.47% (0.9091 => 1.2588, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.15% (0.9998 => 1.3812, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.14% (0.9855 => 1.3614, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.59% (0.9422 => 1.2964, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.16% (0.9403 => 1.2897, std.dev.: 0.1183) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.29% (0.9010 => 1.2280, std.dev.: 0.0958) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.17% (1.0867 => 1.4798, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.15% (0.9512 => 1.2951, std.dev.: 0.0585) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.88% (1.0119 => 1.3750, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.83% (0.8736 => 1.1866, std.dev.: 0.0889) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.72% (0.8912 => 1.2095, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.71% (0.8732 => 1.1763, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.48% (1.0052 => 1.3518, std.dev.: 0.0154) SingleSource/Benchmarks/McGill/exptree: 34.11% (0.0859 => 0.1152, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.77% (0.8846 => 1.1833, std.dev.: 0.0244) SingleSource/Benchmarks/Stanford/IntMM: 33.64% (0.0431 => 0.0576, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.76% (0.9867 => 1.3099, std.dev.: 0.0479) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.55% (1.0017 => 1.3278, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.9788 => 1.2891, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.35% (0.9507 => 1.2487, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.11% (0.9488 => 1.2440, std.dev.: 0.0232) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.67% (1.0088 => 1.3182, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.55% (0.9685 => 1.2644, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.37% (0.9127 => 1.1899, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.78% (0.9405 => 1.2206, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.23% (0.9550 => 1.2341, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.18% (0.9993 => 1.2909, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.45% (1.0860 => 1.3733, std.dev.: 0.0242) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.59% (0.0963 => 0.1142, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: 17.32% (0.3598 => 0.4221, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.21% (0.0738 => 0.0865, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.89% (0.0669 => 0.0782, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.00% (1.0986 => 1.2524, std.dev.: 0.0480) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.59% (3.6295 => 4.1229, std.dev.: 0.1686) MultiSource/Benchmarks/mafft/pairlocalalign: 12.47% (9.5202 => 10.7073, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.47% (1.4110 => 1.5728, std.dev.: 0.0335) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.14% (0.2577 => 0.2864, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 10.59% (0.2050 => 0.2267, std.dev.: 0.0034) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.23% (0.4596 => 0.5066, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 10.02% (0.2385 => 0.2624, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 9.70% (0.1793 => 0.1967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.00% (0.1955 => 0.2131, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.72% (0.2879 => 0.3130, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 6.51% (0.2566 => 0.2733, std.dev.: 0.0053) MultiSource/Applications/oggenc/oggenc: 3.51% (5.3553 => 5.5434, std.dev.: 0.0386) SingleSource/Benchmarks/Misc-C++/bigfib: 3.40% (0.6711 => 0.6939, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.95% (23.5861 => 24.0456, std.dev.: 0.0024) MultiSource/Benchmarks/Bullet/bullet: 1.85% (33.2440 => 33.8574, std.dev.: 0.0926) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.82% (44.1538 => 44.9576, std.dev.: 0.1278) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106075.00% (0.0008 => 0.8494, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/matrix: 351.62% (1.5825 => 7.1469, std.dev.: 0.0565) SingleSource/Benchmarks/Shootout/ary3: 264.40% (2.2304 => 8.1275, std.dev.: 0.2015) MultiSource/Applications/sgefa/sgefa: 257.30% (0.3515 => 1.2559, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.41% (1.1825 => 4.0726, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.76% (4.8185 => 15.7451, std.dev.: 0.1563) SingleSource/Benchmarks/Shootout-C++/ary2: 201.55% (0.0129 => 0.0389, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 198.25% (0.0228 => 0.0680, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary: 143.10% (0.0232 => 0.0564, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 62.52% (2.9083 => 4.7266, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.58% (3.1254 => 4.1123, std.dev.: 0.0301) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.90% (1.4588 => 1.8658, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.11% (5.6033 => 7.0666, std.dev.: 0.3377) SingleSource/Regression/C/uint64_to_float: 24.88% (1.5397 => 1.9228, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/salsa20: 21.88% (7.4497 => 9.0797, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.38% (4.8112 => 5.7916, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8566, std.dev.: 0.0084) MultiSource/Applications/JM/lencod/lencod: 13.15% (6.8159 => 7.7119, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6500, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.00% (0.6211 => 0.6770, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.64% (3.6477 => 3.9629, std.dev.: 0.0516) SingleSource/Benchmarks/Misc/ReedSolomon: 8.02% (8.6447 => 9.3384, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.84% (4.7473 => 5.0721, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 5.28% (1.0425 => 1.0975, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.20% (4.1836 => 4.4010, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (5.0310 => 5.2294, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/pi: 3.50% (2.1390 => 2.2138, std.dev.: 0.0023) SingleSource/Benchmarks/Linpack/linpack-pc: 3.24% (50.8945 => 52.5440, std.dev.: 0.5679) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (4.7254 => 4.8744, std.dev.: 0.0033) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.11% (9.0082 => 9.2888, std.dev.: 0.0631) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.86% (0.0808 => 0.0494, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.60% (0.0692 => 0.0501, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -26.91% (0.1888 => 0.1380, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -20.50% (1.8964 => 1.5077, std.dev.: 0.0387) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.60% (0.0676 => 0.0557, std.dev.: 0.0014) MultiSource/Applications/spiff/spiff: -13.05% (1.0220 => 0.8886, std.dev.: 0.0260) SingleSource/UnitTests/Vector/constpool: -12.92% (9.8875 => 8.6103, std.dev.: 0.1990) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.41% (0.0862 => 0.0755, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -11.78% (1.5979 => 1.4096, std.dev.: 0.0533) MultiSource/Applications/hexxagon/hexxagon: -11.12% (1.1433 => 1.0162, std.dev.: 0.0086) MultiSource/Applications/aha/aha: -10.89% (0.1378 => 0.1228, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: -10.87% (2.4719 => 2.2033, std.dev.: 0.0596) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.50% (6.4235 => 5.8133, std.dev.: 0.2300) SingleSource/Benchmarks/Shootout-C++/hash2: -8.63% (0.5134 => 0.4691, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -8.46% (0.8653 => 0.7921, std.dev.: 0.0193) MultiSource/Applications/sqlite3/sqlite3: -7.57% (17.5634 => 16.2335, std.dev.: 0.4305) MultiSource/Applications/ClamAV/clamscan: -7.44% (17.4365 => 16.1399, std.dev.: 0.1609) MultiSource/Applications/siod/siod: -7.32% (2.6437 => 2.4501, std.dev.: 0.0560) SingleSource/Benchmarks/Shootout-C++/hash: -7.08% (0.4689 => 0.4357, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.70% (0.3462 => 0.3230, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: -6.63% (0.2006 => 0.1873, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: -6.02% (3.7840 => 3.5562, std.dev.: 0.0406) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.84% (0.2481 => 0.2336, std.dev.: 0.0020) MultiSource/Applications/ALAC/encode/alacconvert-encode: -5.73% (1.2154 => 1.1457, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/moments: -5.55% (0.4002 => 0.3780, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/except: -4.79% (0.2172 => 0.2068, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.60% (0.2283 => 0.2178, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.55% (0.3665 => 0.3535, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.49% (0.3093 => 0.2985, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -2.69% (0.3715 => 0.3615, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.85% (11.5523 => 3.9453, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/fp-convert: -62.07% (15.6525 => 5.9364, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.83% (0.4146 => 0.1790, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.34% (0.4578 => 0.2365, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.16% (11.3868 => 6.3587, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.81% (5.4023 => 3.6297, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.82% (0.4452 => 0.3080, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout/heapsort: -29.53% (4.4739 => 3.1527, std.dev.: 0.3185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.24% (0.5495 => 0.3998, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.15% (5.2605 => 3.8851, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.33% (0.5826 => 0.4350, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3287, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.35% (4.2042 => 3.1804, std.dev.: 0.3858) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8230, std.dev.: 0.0667) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.38% (0.5897 => 0.4518, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary3: -22.99% (1.8123 => 1.3957, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7929, std.dev.: 0.0256) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.95% (16.6791 => 13.6853, std.dev.: 0.3094) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.99% (7.0016 => 5.8120, std.dev.: 0.1682) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.25% (3.1921 => 2.7691, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.94% (5.3626 => 4.6689, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9945, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.29% (9.7992 => 8.5948, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/hash: -10.67% (4.5259 => 4.0431, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout/nestedloop: -9.91% (0.2200 => 0.1982, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/lists1: -9.17% (0.6628 => 0.6020, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.22% (4.4540 => 4.0880, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.44% (4.2843 => 3.9656, std.dev.: 0.1043) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.75% (5.5974 => 5.2194, std.dev.: 0.0894) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.41% (4.5424 => 4.2514, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.19% (4.9799 => 4.6714, std.dev.: 0.0395) SingleSource/Benchmarks/McGill/queens: -5.79% (1.7443 => 1.6433, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -4.83% (3.6768 => 3.4993, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.47% (3.5127 => 3.3557, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (5.8973 => 5.6803, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.61% (3.5691 => 3.4401, std.dev.: 0.0063) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.48% (40.4729 => 39.0635, std.dev.: 0.3523) SingleSource/Benchmarks/Shootout-C++/lists: -3.22% (17.2182 => 16.6639, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: -3.16% (3.5443 => 3.4323, std.dev.: 0.0432) MultiSource/Applications/spiff/spiff: -2.20% (2.8571 => 2.7942, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/hash: -2.17% (0.6254 => 0.6118, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -1.82% (0.8521 => 0.8366, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.78% (8.7327 => 8.5769, std.dev.: 0.0077) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8616, std.dev.: 0.0948) MultiSource/Benchmarks/Bullet/bullet: -1.46% (7.2040 => 7.0987, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.33% (3.7450 => 3.6951, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.18% (6.8262 => 6.7455, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.07% (8.8249 => 8.7309, std.dev.: 0.0097) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.6251 => 1.6085, std.dev.: 0.0048) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.35% (1.2047 => 1.2330, std.dev.: 0.1506) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -34.77% (0.0394 => 0.0257, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -8.92% (0.0213 => 0.0194, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -47.84% (0.0255 => 0.0133, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.72% (0.1530 => 0.1541, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -40.60% (1.9293 => 1.1460, std.dev.: 0.3805) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.17% (0.4049 => 0.4056, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.77% (0.1510 => 0.1453, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.32% (0.0978 => 0.0613, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.56% (0.0590 => 0.0611, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.65% (1.1617 => 1.3203, std.dev.: 0.0238) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.46% (0.0610 => 0.0534, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.81% (0.0268 => 0.0372, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.54% (0.7437 => 1.7666, std.dev.: 0.0054) SingleSource/Regression/C/2003-05-21-UnionBitfields: -25.00% (0.0008 => 0.0006, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.70% (0.0092 => 0.0084, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 164.38% (12.7781 => 33.7829, std.dev.: 0.4742) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 05:09:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 07:09:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126130918.5916D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7968?compare_to=7965&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7968, Order: 173567, Start Time: 2013-01-26 10:58:03, End Time: 2013-01-26 13:09:36 To: 7965, Order: 173563, Start Time: 2013-01-26 08:15:54, End Time: 2013-01-26 10:27:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (219 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/spiff/spiff: 1.25% (0.9476 => 0.9594, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.19% (0.6567 => 0.6711, std.dev.: 0.0026) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1330 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.45% (0.0666 => 0.0689, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8580 => 499.8559, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44225.25% (1.1277 => 499.8559, std.dev.: 0.0035) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.62% (0.5229 => 1.6556, std.dev.: 0.0288) MultiSource/Applications/SPASS/SPASS: 20.79% (14.9895 => 18.1062, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 44.50% (14.1553 => 20.4542, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 18.24% (4.1105 => 4.8604, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.92% (1.1048 => 1.7337, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.21% (7.1582 => 37.3806, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.72% (3.4629 => 6.4312, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.60% (0.6222 => 1.0926, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.00% (0.0720 => 7.4412, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 3833200.00% (0.0001 => 3.8333, std.dev.: 0.0051) MultiSource/Applications/SPASS/SPASS: 11154800.00% (0.0001 => 11.1549, std.dev.: 0.0139) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576000.00% (0.0001 => 0.5761, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488700.00% (0.0001 => 5.4888, std.dev.: 0.0039) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.84% (1.1194 => 10.3527, std.dev.: 0.0075) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 149.30% (22.1758 => 55.2844, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.88% (0.0929 => 0.1829, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457) SingleSource/Benchmarks/CoyoteBench/almabench: 65.75% (0.0730 => 0.1210, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.00% (2.9384 => 4.6134, std.dev.: 0.0162) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.38% (7.0540 => 10.8192, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.49% (1.5859 => 2.4025, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.10% (8.1363 => 11.9684, std.dev.: 0.0174) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.84% (2.2024 => 3.1238, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 39.69% (0.3109 => 0.4343, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 37.79% (21.9371 => 30.2263, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0019) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.47% (4.2646 => 5.6920, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.59% (1.5415 => 2.0438, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.57% (0.4615 => 0.6118, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 32.31% (0.0814 => 0.1077, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.56% (0.2271 => 0.2965, std.dev.: 0.0045) MultiSource/Applications/Burg/burg: 29.67% (1.1642 => 1.5096, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/05-eks/eks: 29.57% (0.4299 => 0.5570, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.51% (0.0793 => 0.1027, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.09% (0.1125 => 0.1441, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.64% (0.1892 => 0.2415, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.54% (0.5105 => 0.6511, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.31% (0.6675 => 0.8498, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 26.77% (0.1655 => 0.2098, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 26.59% (0.2554 => 0.3233, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.45% (0.1584 => 0.2003, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.25% (0.1143 => 0.1443, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.16% (0.0730 => 0.0921, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 26.11% (9.4845 => 11.9613, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.02% (3.8922 => 4.9051, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.01% (0.0746 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 25.83% (0.4289 => 0.5397, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.61% (0.1566 => 0.1967, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.51% (0.3121 => 0.3886, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: 24.43% (1.0722 => 1.3341, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.16% (1.4186 => 1.7613, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 24.07% (0.4620 => 0.5732, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.93% (0.1337 => 0.1657, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.48% (0.1695 => 0.2093, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 23.41% (0.1555 => 0.1919, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 22.99% (0.6456 => 0.7940, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 22.70% (0.7115 => 0.8730, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 22.45% (0.7835 => 0.9594, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.87% (0.1029 => 0.1254, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.81% (0.2700 => 0.3289, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 21.72% (0.3098 => 0.3771, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.52% (0.1236 => 0.1502, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 21.41% (0.0626 => 0.0760, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.33% (0.0675 => 0.0819, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.08% (0.1940 => 0.2349, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.05% (1.3050 => 1.5797, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/em3d/em3d: 20.59% (0.1695 => 0.2044, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 20.50% (0.1151 => 0.1387, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 20.46% (0.1163 => 0.1401, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 20.40% (5.7591 => 6.9341, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.36% (0.5860 => 0.7053, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.30% (0.8172 => 0.9831, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.84% (4.9449 => 5.9260, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.07% (0.2758 => 0.3284, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.05% (5.0018 => 5.9546, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.99% (0.3307 => 0.3935, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 18.91% (3.3354 => 3.9662, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.89% (0.1117 => 0.1328, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.86% (0.5020 => 0.5967, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.62% (0.5569 => 0.6606, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 18.35% (0.7433 => 0.8797, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.16% (0.9765 => 1.1538, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.66% (1.1840 => 1.3931, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.66% (0.2107 => 0.2479, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.64% (1.1861 => 1.3953, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 17.63% (3.8723 => 4.5550, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 17.62% (2.0273 => 2.3846, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.61% (0.4203 => 0.4943, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.30% (0.5981 => 0.7016, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.29% (0.2065 => 0.2422, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/18-imp/imp: 17.18% (0.3423 => 0.4011, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 17.09% (0.3283 => 0.3844, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 17.07% (2.2969 => 2.6890, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901) SingleSource/Benchmarks/Shootout-C++/ary: 16.89% (0.3232 => 0.3778, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 16.79% (0.2049 => 0.2393, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.1044 => 0.1218, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.65% (0.3441 => 0.4014, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.50% (0.8101 => 0.9438, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.34% (0.6450 => 0.7504, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.57% (0.3180 => 0.3675, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 15.27% (0.3379 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 15.21% (0.1144 => 0.1318, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.11% (0.8921 => 1.0269, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.04% (0.0818 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.69% (0.8067 => 0.9252, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.49% (0.3865 => 0.4425, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.48% (0.2603 => 0.2980, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 14.39% (0.2905 => 0.3323, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.4103 => 0.4689, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.28% (0.4636 => 0.5298, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: 13.25% (1.5603 => 1.7670, std.dev.: 0.0104) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.63% (0.2430 => 0.2737, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.60% (0.3603 => 0.4057, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 12.52% (0.4048 => 0.4555, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 12.51% (0.3422 => 0.3850, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.42% (0.3826 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.08% (0.3684 => 0.4129, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 11.93% (17.1811 => 19.2314, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/oourafft: 11.79% (0.3282 => 0.3669, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/parameter-passing: 11.28% (0.3927 => 0.4370, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 11.09% (0.3092 => 0.3435, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.07% (0.4064 => 0.4514, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 10.83% (0.3886 => 0.4307, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.70% (0.2831 => 0.3134, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.68% (0.3427 => 0.3793, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.66% (0.2871 => 0.3177, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.50% (0.1114 => 0.1231, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.50% (14.3668 => 15.8749, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 10.27% (0.3828 => 0.4221, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.14% (2.0665 => 2.2760, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3162 => 0.3478, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2756 => 0.3025, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 9.73% (0.2877 => 0.3157, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 9.73% (0.3473 => 0.3811) MultiSource/Applications/hexxagon/hexxagon: 9.69% (1.2842 => 1.4087, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.68% (0.3543 => 0.3886, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 9.67% (0.3516 => 0.3856, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.65% (0.3543 => 0.3885, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.61% (0.3694 => 0.4049, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3497 => 0.3833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.58% (0.2725 => 0.2986, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.56% (0.2793 => 0.3060, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.51% (0.3650 => 0.3997, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.40% (0.2714 => 0.2969, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.30% (0.2891 => 0.3160, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.28% (0.3136 => 0.3427, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 9.14% (0.3052 => 0.3331, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.09% (0.2872 => 0.3133, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: 9.04% (0.6030 => 0.6575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.99% (0.2802 => 0.3054, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.85% (0.7326 => 0.7974, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.80% (0.1625 => 0.1768, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.79% (0.3935 => 0.4281, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 8.77% (63.2438 => 68.7921, std.dev.: 0.0697) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.92% (0.3177 => 0.3397, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.84% (2.2022 => 2.3528, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.23% (0.4879 => 0.5183, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: 5.86% (10.3673 => 10.9744, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.94% (0.2266 => 0.2378, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.44% (7.9617 => 8.1556, std.dev.: 0.0167) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.90% (32.5116 => 59.4645, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.91% (1.1145 => 1.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6969, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2944 => 0.3144, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3855, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.56% (4.2280 => 4.4629, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3129, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.53% (0.9957 => 1.0308, std.dev.: 0.0082) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (8.6802 => 8.9155, std.dev.: 0.0105) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7228, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 2.07% (9.1159 => 9.3042, std.dev.: 0.0059) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3044, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.22% (10.3460 => 10.4719, std.dev.: 0.0201) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5857, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.84% (5.2763 => 1.1694, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -75.04% (0.8651 => 0.2159, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.13% (5.3855 => 4.4627, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.50% (5.3526 => 4.4693, std.dev.: 0.0112) MultiSource/Applications/JM/ldecod/ldecod: -13.41% (10.4361 => 9.0367, std.dev.: 0.0176) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.8950, std.dev.: 0.0227) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.75% (1.7609 => 1.6244, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.72% (1.9577 => 0.6711, std.dev.: 0.0026) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -44.90% (0.0628 => 0.0346, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.61% (1.5373 => 1.0206, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.39% (1.1492 => 0.7655, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4168, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8507, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9695 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4242, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.84% (0.9540 => 0.8410, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4954, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5820, std.dev.: 0.0498) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.87% (1.2373 => 1.1647, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7032, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -4.45% (10.2830 => 9.8255, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/flops-5: -4.40% (1.5835 => 1.5138, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3308, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -1.59% (3.7221 => 3.6629, std.dev.: 0.0190) MultiSource/Applications/sqlite3/sqlite3: -1.44% (4.6441 => 4.5774, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/ary3: -1.22% (3.6994 => 3.6543, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2337, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8574, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0021) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 05:18:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 07:18:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130126131815.B4CC22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7969?compare_to=7963&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7969, Order: 173567, Start Time: 2013-01-26 09:34:20, End Time: 2013-01-26 13:18:33 To: 7963, Order: 173558, Start Time: 2013-01-26 04:55:50, End Time: 2013-01-26 08:42:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (187 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.98% (0.6322 => 0.6637, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 3.75% (4.9303 => 5.1151, std.dev.: 0.0217) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.03% (3.1779 => 3.2106, std.dev.: 0.0094) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.09% (0.0696 => 0.0808, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 51.20% (0.0625 => 0.0945, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 43.93% (0.0239 => 0.0344, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.38% (0.1063 => 0.1471, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.90% (0.4994 => 0.6637, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.60% (0.0415 => 0.0542, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.62% (0.0547 => 0.0709, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.56% (0.2969 => 0.3817, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.22% (0.4139 => 0.5307, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.87% (0.0714 => 0.0913, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.63% (0.5900 => 0.7530, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.18% (0.5000 => 0.6359, std.dev.: 0.0123) MultiSource/Applications/oggenc/oggenc: 26.89% (1.5932 => 2.0216, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.77% (0.0452 => 0.0573, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.62% (0.4253 => 0.5385, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 26.21% (0.1549 => 0.1955, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.68% (0.0584 => 0.0734, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.47% (0.1107 => 0.1389, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.69% (0.1620 => 0.2020, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.66% (0.0584 => 0.0728, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 24.29% (0.0947 => 0.1177, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.21% (0.1103 => 0.1370, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.11% (0.3890 => 0.4828, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 23.11% (0.4029 => 0.4960, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.03% (0.1003 => 0.1234, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.82% (0.1604 => 0.1970, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.75% (0.0822 => 0.1009, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.61% (0.2866 => 0.3514, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.44% (0.3903 => 0.4779, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/health/health: 22.29% (0.0821 => 0.1004, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.24% (1.3152 => 1.6077, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/05-eks/eks: 22.24% (0.1619 => 0.1979, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.82% (0.1462 => 0.1781, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.81% (0.0541 => 0.0659, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 21.47% (4.2109 => 5.1151, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.33% (0.0572 => 0.0694, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.16% (0.2736 => 0.3315, std.dev.: 0.0081) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.77% (0.1088 => 0.1314, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 20.61% (0.1218 => 0.1469, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.35% (0.5026 => 0.6049, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: 20.34% (0.0698 => 0.0840, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.26% (0.2014 => 0.2422, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 20.16% (0.5546 => 0.6664, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.96% (0.3271 => 0.3924, std.dev.: 0.0142) MultiSource/Benchmarks/MallocBench/gs/gs: 19.87% (1.8794 => 2.2528, std.dev.: 0.0254) MultiSource/Benchmarks/McCat/09-vor/vor: 19.80% (0.1505 => 0.1803, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.64% (0.4658 => 0.5573, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.50% (0.0605 => 0.0723, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.31% (0.5826 => 0.6951, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/property-reference-object: 19.15% (0.5889 => 0.7017, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.02% (3.5627 => 4.2404, std.dev.: 0.0672) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.01% (1.6211 => 1.9292, std.dev.: 0.0166) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.71% (1.9694 => 2.3378, std.dev.: 0.0342) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.69% (0.2729 => 0.3239, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.62% (0.1090 => 0.1293, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.62% (0.1160 => 0.1376, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.61% (0.2875 => 0.3410, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 18.47% (0.9697 => 1.1488, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.35% (1.9966 => 2.3630, std.dev.: 0.0304) MultiSource/Benchmarks/Olden/bh/bh: 18.30% (0.1284 => 0.1519, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.30% (0.4361 => 0.5159, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 18.27% (0.2813 => 0.3327, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 18.21% (0.2811 => 0.3323, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.21% (0.0582 => 0.0688, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/strcat: 18.15% (0.2750 => 0.3249, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.14% (0.1968 => 0.2325, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 18.13% (0.2714 => 0.3206, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 18.07% (0.2823 => 0.3333, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.91% (0.2792 => 0.3292, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.75% (0.2738 => 0.3224, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 17.73% (0.2803 => 0.3300, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/matrix: 17.70% (0.2780 => 0.3272, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.64% (2.7292 => 3.2106, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 17.59% (0.9909 => 1.1652, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.59% (0.2911 => 0.3423, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.56% (0.3930 => 0.4620, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 17.49% (1.0781 => 1.2667, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.49% (2.0673 => 2.4289, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 17.43% (0.3258 => 0.3826, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.41% (4.4195 => 5.1891, std.dev.: 0.0163) SingleSource/Regression/C++/ofstream_ctor: 17.41% (0.3004 => 0.3527, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.37% (0.3195 => 0.3750, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 17.27% (0.3317 => 0.3890, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 17.23% (0.3267 => 0.3830, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.19% (0.3362 => 0.3940, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 17.18% (0.3096 => 0.3628, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 17.11% (0.7171 => 0.8398, std.dev.: 0.0049) MultiSource/Benchmarks/nbench/nbench: 16.87% (0.2566 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 16.86% (0.4146 => 0.4845, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.83% (0.3060 => 0.3575, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.73% (23.5202 => 27.4541, std.dev.: 0.0695) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.66% (0.3625 => 0.4229, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 16.61% (0.3726 => 0.4345, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 16.52% (0.3348 => 0.3901, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.52% (0.3124 => 0.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 16.50% (0.3678 => 0.4285, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.49% (0.2068 => 0.2409, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists1: 16.48% (0.3477 => 0.4050, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.33% (0.3282 => 0.3818, std.dev.: 0.0089) MultiSource/Applications/lua/lua: 16.05% (1.4269 => 1.6559, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 15.88% (0.4251 => 0.4926, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.80% (0.3690 => 0.4273, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.75% (0.3981 => 0.4608, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 15.53% (0.3496 => 0.4039, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.30% (0.0673 => 0.0776, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.21% (0.3845 => 0.4430, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-4: 15.09% (0.3465 => 0.3988, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 15.07% (0.7875 => 0.9062, std.dev.: 0.0195) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.98% (0.1028 => 0.1182, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 14.95% (2.1653 => 2.4890, std.dev.: 0.0330) SingleSource/Benchmarks/Misc-C++/bigfib: 14.94% (0.5012 => 0.5761, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 14.86% (0.3460 => 0.3974, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 14.85% (0.3469 => 0.3984, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 14.76% (0.3442 => 0.3950, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 14.57% (5.5417 => 6.3493, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/property: 14.52% (0.3650 => 0.4180, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 14.47% (0.3643 => 0.4170, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.23% (0.3724 => 0.4254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.17% (0.6435 => 0.7347, std.dev.: 0.0059) MultiSource/Applications/JM/lencod/lencod: 13.94% (4.6177 => 5.2613, std.dev.: 0.0605) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.81% (0.2737 => 0.3115, std.dev.: 0.0082) MultiSource/Applications/SIBsim4/SIBsim4: 13.45% (0.2691 => 0.3053, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 13.09% (2.1013 => 2.3763, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.94% (0.3084 => 0.3483, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 12.63% (0.6634 => 0.7472, std.dev.: 0.0071) MultiSource/Applications/lambda-0_1_3/lambda: 12.55% (0.3498 => 0.3937, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: 12.44% (0.3336 => 0.3751, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.22% (0.5361 => 0.6016, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: 11.57% (0.4847 => 0.5408, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.14% (0.7426 => 0.8253, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.98% (11.6398 => 12.9176, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.05% (0.5584 => 0.6145, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.94% (4.6926 => 5.1590, std.dev.: 0.0155) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.37% (2.0346 => 2.2253, std.dev.: 0.0050) MultiSource/Applications/kimwitu++/kc: 8.29% (11.9555 => 12.9470, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.62% (0.3792 => 0.4005, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5234, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.18% (0.2162 => 0.3528, std.dev.: 0.0268) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 16.26% (0.0695 => 0.0808, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 11.85% (0.2802 => 0.3134, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.45% (0.3693 => 0.4079, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6784, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2378, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6822, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.45% (1.8057 => 1.8860, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1949, std.dev.: 0.0454) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3170, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2838, std.dev.: 0.0051) MultiSource/Applications/spiff/spiff: 1.28% (4.0317 => 4.0832, std.dev.: 0.0019) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2095, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5988, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4787, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.04% (1.2197 => 1.2324, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2451 => 1.2578, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.42% (2.4764 => 2.4164, std.dev.: 0.0140) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.70% (25.4195 => 16.6002, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.72% (17.2379 => 14.1828, std.dev.: 0.0900) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9753, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7996, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -6.66% (0.2402 => 0.2242, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -3.88% (14.0481 => 13.5030, std.dev.: 0.1361) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2086, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8043, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7732, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1208, std.dev.: 0.1020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5705, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4997, std.dev.: 0.0056) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1885, std.dev.: 0.0855) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0045) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 05:21:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 07:21:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126132119.0F36A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7970?compare_to=7966&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7970, Order: 173568, Start Time: 2013-01-26 11:46:51, End Time: 2013-01-26 13:21:36 To: 7966, Order: 173567, Start Time: 2013-01-26 09:01:51, End Time: 2013-01-26 10:36:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.04% (0.0974 => 0.1627, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.87% (0.6395 => 0.8817, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.51% (0.5688 => 0.7537, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.24% (0.6260 => 0.8278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.87% (0.5849 => 0.7713, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.85% (0.5567 => 0.7340, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.63% (0.5581 => 0.7346, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.61% (0.5575 => 0.7337, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.60% (0.6395 => 0.8416, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.40% (0.5941 => 0.7747, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.18% (0.5859 => 0.7627, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.92% (0.6033 => 0.7838, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.38% (0.6440 => 0.8332, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.76% (1.6474 => 2.1212, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.62% (0.6189 => 0.7960, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.27% (0.6676 => 0.8563, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.93% (0.6304 => 0.8065, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.58% (0.6230 => 0.7948, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.68% (0.5802 => 0.7350, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.49% (0.6660 => 0.8424, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.19% (0.5925 => 0.7477, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.17% (0.5705 => 0.7198, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.75% (0.5857 => 0.7365, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.46% (0.5569 => 0.6987, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.46% (0.5570 => 0.6988, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.32% (0.5478 => 0.6865, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.09% (0.5591 => 0.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.46% (0.0699 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.11% (0.6446 => 0.8000, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.08% (0.5863 => 0.7275, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.00% (0.7524 => 0.9330, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.65% (0.6052 => 0.7483, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.04% (0.6681 => 0.8220, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.89% (0.6194 => 0.7612, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.36% (0.6297 => 0.7705, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.76% (2.2587 => 2.7502, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.31% (0.6667 => 0.8088, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.59% (0.7339 => 0.8777, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.93% (0.1146 => 0.1340, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 15.22% (0.3357 => 0.3868, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 15.17% (1.1450 => 1.3187, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.60% (4.5069 => 5.0749, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.41% (0.4916 => 0.5526, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/05-eks/eks: 11.96% (0.4515 => 0.5055, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.56% (1.6364 => 1.8255, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (3.5339 => 3.9419, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.40% (0.1982 => 0.2208, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (9.2283 => 10.1295, std.dev.: 0.0081) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.76% (0.1230 => 0.1350, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.63% (1.2515 => 1.3595, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.25% (0.2001 => 0.2166, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.96% (0.5329 => 0.5753, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 7.87% (0.4524 => 0.4880, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.68% (0.1731 => 0.1864, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.59% (1.4642 => 1.5753, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.38% (0.7021 => 0.7539, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.12% (0.4861 => 0.5207, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.92% (1.2784 => 1.3669, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/ReedSolomon: 6.33% (0.1879 => 0.1998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.14% (0.3255 => 0.3455, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.67% (0.6750 => 0.7133, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3319 => 0.3498, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.29% (5.4682 => 5.7026, std.dev.: 0.0066) MultiSource/Applications/oggenc/oggenc: 3.59% (5.0226 => 5.2030, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary3: 3.45% (0.3446 => 0.3565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.27% (0.3394 => 0.3505, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 2.84% (1.3864 => 1.4258, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 2.77% (0.8418 => 0.8651, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.53% (0.4427 => 0.4539, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.51% (0.7447 => 0.7634, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.33% (22.4056 => 22.9276, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 2.20% (15.5079 => 15.8487, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.05% (0.9557 => 0.9753, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.88% (1.3722 => 1.3980, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5520, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8071, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9531 => 1.0288, std.dev.: 0.0017) SingleSource/Regression/C/uint64_to_float: 7.45% (0.5692 => 0.6116, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1644, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.53% (2.0478 => 2.1200, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.36% (54.5751 => 56.4067, std.dev.: 0.1169) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2468, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (18.2231 => 18.5002, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2693, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.88% (0.7198 => 0.6847, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: -4.20% (0.3812 => 0.3652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.12% (0.3831 => 0.3673, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.07% (0.3880 => 0.3722, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.06% (0.3896 => 0.3738, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3848 => 0.3693, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.94% (0.3884 => 0.3731, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.90% (0.3821 => 0.3672, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.86% (0.3837 => 0.3689, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.78% (2.4924 => 2.3982, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions: -3.74% (0.4176 => 0.4020, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.59% (0.9852 => 0.9498, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.21% (0.3142 => 0.3041, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: -3.18% (0.6347 => 0.6145, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.17% (0.4199 => 0.4066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.16% (0.7779 => 0.7533, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/property-reference-object: -2.93% (0.6441 => 0.6252, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.9542 => 0.9273, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.81% (2.1713 => 2.1102, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -2.68% (1.3148 => 1.2795, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.30% (0.6484 => 0.6335, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.94% (14.2083 => 13.9326, std.dev.: 0.0109) SingleSource/UnitTests/Vector/constpool: -1.86% (20.7746 => 20.3878, std.dev.: 0.0188) MultiSource/Applications/sqlite3/sqlite3: -1.71% (17.1032 => 16.8101, std.dev.: 0.0131) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.42% (6.7716 => 6.6752, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: -1.41% (16.1920 => 15.9639, std.dev.: 0.0245) MultiSource/Applications/JM/ldecod/ldecod: -1.17% (7.0961 => 7.0128, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.09% (1.2221 => 1.2088, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.68% (1.8100 => 0.6936, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.80% (1.3643 => 1.0260, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7578, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0748, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1971, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.72% (2.9703 => 2.3252, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1315, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.81% (0.4092 => 0.3527, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0926, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3536, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.64% (0.5142 => 0.4595, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (1.7753 => 1.6987, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.02% (1.3096 => 1.2701, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.60% (7.9763 => 7.7693, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.00% (3.7241 => 3.6498, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1720, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7092 => 3.6608, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6101, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.17% (1.6219 => 1.6029, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 06:48:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 08:48:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126144841.CA4082A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7971?compare_to=7967&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7971, Order: 173569, Start Time: 2013-01-26 12:46:56, End Time: 2013-01-26 14:49:00 To: 7967, Order: 173567, Start Time: 2013-01-26 10:27:04, End Time: 2013-01-26 12:29:34 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (92 on baseline) Performance Improvements: 2 (85 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++/Large/ray: 3.31% (0.3230 => 0.3337, std.dev.: 0.0033) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.75% (1.4589 => 1.8492, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout/heapsort: 4.29% (3.1527 => 3.2880, std.dev.: 0.0416) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.93% (13.6853 => 14.0862, std.dev.: 0.1246) SingleSource/Benchmarks/Dhrystone/fldry: 2.62% (0.6598 => 0.6771, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.98% (15.7451 => 16.0574, std.dev.: 0.0166) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.18% (0.3130 => 0.2968, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.90% (41.5356 => 39.9169, std.dev.: 0.5168) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -2.12% (1.2330 => 1.2068, std.dev.: 0.0290) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0223 => 0.0225, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.75% (0.0435 => 0.0410, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.63% (0.0257 => 0.0328, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.41% (0.0323 => 0.0312, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0430 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 8.25% (0.0194 => 0.0210, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -18.18% (0.0220 => 0.0180, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 69.92% (0.0133 => 0.0226, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.73% (0.1541 => 0.1499, std.dev.: 0.0112) MultiSource/Applications/lemon/lemon: 0.68% (1.1460 => 1.1538, std.dev.: 0.3534) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.34% (0.4056 => 0.3961, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.76% (0.1453 => 0.1442, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.01% (0.0613 => 0.0656, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.24% (0.0611 => 0.0579, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.42% (1.3203 => 1.3148, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.33% (0.0030 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.30% (0.0534 => 0.0605, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.84% (0.0372 => 0.0354, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.98% (1.7666 => 1.7493, std.dev.: 0.0067) SingleSource/Regression/C/2003-05-21-UnionBitfields: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -66.67% (0.0003 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -4.76% (0.0084 => 0.0080, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.46% (33.7829 => 34.2750, std.dev.: 0.0698) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 396.73% (0.0336 => 0.1669, std.dev.: 0.0025) SingleSource/Regression/C/sumarraymalloc: 118.09% (0.0293 => 0.0639, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.88% (0.0274 => 0.0460, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 60.13% (0.1638 => 0.2623, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 55.47% (0.0265 => 0.0412, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.94% (0.8893 => 1.2623, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.88% (0.9120 => 1.2939, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.55% (0.8926 => 1.2635, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.91% (0.9612 => 1.3544, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.64% (0.9061 => 1.2743, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.96% (0.9564 => 1.3386, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.94% (0.9588 => 1.3417, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.84% (0.9381 => 1.3118, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.09% (0.8990 => 1.2504, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.77% (0.9091 => 1.2616, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.64% (0.9855 => 1.3663, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.29% (0.9998 => 1.3826, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.96% (0.9422 => 1.2999, std.dev.: 0.0536) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.56% (0.9403 => 1.2935, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.78% (0.9010 => 1.2324, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.59% (0.9512 => 1.2992, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.12% (0.8912 => 1.2131, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.03% (0.8736 => 1.1884, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.45% (1.0867 => 1.4719, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.80% (1.0052 => 1.3550, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.70% (0.8732 => 1.1762, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.58% (0.8846 => 1.1905, std.dev.: 0.0078) SingleSource/Benchmarks/Stanford/IntMM: 34.57% (0.0431 => 0.0580, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 33.76% (0.0859 => 0.1149, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.14% (0.9867 => 1.3137, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.35% (1.0017 => 1.3258, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.73% (0.9507 => 1.2524, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.62% (0.9488 => 1.2488, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.17% (1.0088 => 1.3232, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.43% (0.9685 => 1.2632, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.16% (0.9127 => 1.1880, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.99% (0.9405 => 1.2226, std.dev.: 0.1080) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.88% (0.9993 => 1.2979, std.dev.: 0.0816) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.32% (0.9550 => 1.2255, std.dev.: 0.0591) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.95% (1.0860 => 1.3787, std.dev.: 0.1006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.51% (0.0738 => 0.0882, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.98% (0.0669 => 0.0796, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.69% (0.0963 => 0.1143, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.22% (1.0986 => 1.2548, std.dev.: 0.0561) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.97% (3.6295 => 4.1365, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.42% (0.0805 => 0.0913, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.31% (0.1240 => 0.1405, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.28% (0.0783 => 0.0887, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 12.87% (9.5202 => 10.7454, std.dev.: 0.0878) SingleSource/Benchmarks/Misc/ReedSolomon: 10.93% (0.2050 => 0.2274, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 10.90% (0.2385 => 0.2645, std.dev.: 0.0007) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.81% (0.4596 => 0.5093, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 9.76% (0.1793 => 0.1968, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.31% (1.4110 => 1.5424, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.21% (0.1955 => 0.2135, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.09% (2.4519 => 2.6012, std.dev.: 0.0027) SingleSource/Regression/C++/ofstream_ctor: 5.09% (0.2042 => 0.2146, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.05% (1.8127 => 1.8861, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 4.04% (0.6711 => 0.6982, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.94% (0.7693 => 0.7842, std.dev.: 0.0020) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106287.50% (0.0008 => 0.8511, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/matrix: 354.17% (1.5825 => 7.1872, std.dev.: 0.0458) SingleSource/Benchmarks/Shootout/ary3: 290.79% (2.2304 => 8.7161, std.dev.: 1.2443) MultiSource/Applications/sgefa/sgefa: 259.46% (0.3515 => 1.2635, std.dev.: 0.0118) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.15% (1.1825 => 4.0459, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 233.24% (4.8185 => 16.0574, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout-C++/ary2: 194.57% (0.0129 => 0.0380, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 188.16% (0.0228 => 0.0657, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 133.19% (0.0232 => 0.0541, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: 62.93% (2.9083 => 4.7384, std.dev.: 0.0933) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.65% (0.2562 => 0.3424, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.91% (3.1254 => 4.1228, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.16% (1.4588 => 1.8258, std.dev.: 0.0511) SingleSource/Regression/C/uint64_to_float: 24.01% (1.5397 => 1.9094, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/salsa20: 21.89% (7.4497 => 9.0807, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.53% (4.8112 => 5.7990, std.dev.: 0.0271) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.84% (5.6033 => 6.7148, std.dev.: 0.3537) MultiSource/Applications/JM/lencod/lencod: 13.26% (6.8159 => 7.7194, std.dev.: 0.1011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8561, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6500, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.89% (3.6477 => 3.9721, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.86% (0.6211 => 0.6761, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/ReedSolomon: 8.05% (8.6447 => 9.3410, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 7.60% (20.5117 => 22.0706, std.dev.: 0.5251) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.00% (4.7473 => 5.0796, std.dev.: 0.0450) SingleSource/Benchmarks/McGill/chomp: 5.53% (1.0425 => 1.1002, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.35% (4.1836 => 4.4074, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (5.0310 => 5.2300, std.dev.: 0.0084) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.88% (9.0082 => 9.3580, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.23% (4.7254 => 4.8780, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/pi: 3.21% (2.1390 => 2.2077, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (2.5681 => 2.5970, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.12% (0.0808 => 0.0500, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.22% (0.0727 => 0.0500, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.48% (0.0692 => 0.0488, std.dev.: 0.0021) SingleSource/Benchmarks/SmallPT/smallpt: -26.75% (0.1888 => 0.1383, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -21.89% (0.0676 => 0.0528, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.81% (0.1009 => 0.0799, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.31% (0.7686 => 0.6663, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -13.23% (0.0862 => 0.0748, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -12.48% (9.8875 => 8.6538, std.dev.: 0.1434) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.23% (6.4235 => 5.8308, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.86% (0.1366 => 0.1245, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -8.73% (0.5134 => 0.4686, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.23% (0.7693 => 0.7060, std.dev.: 0.0176) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.22% (0.2481 => 0.2277, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -7.88% (0.4074 => 0.3753, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/hash: -6.72% (0.4689 => 0.4374, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/fibo: -5.78% (0.2006 => 0.1890, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -5.60% (0.4002 => 0.3778, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: -4.83% (0.2172 => 0.2067, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.91% (0.3093 => 0.2972, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists1: -3.87% (0.3206 => 0.3082, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: -3.85% (0.2725 => 0.2620, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.61% (0.3462 => 0.3337, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.52% (0.3665 => 0.3536, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9426, std.dev.: 0.0571) SingleSource/Benchmarks/Misc/fp-convert: -62.11% (15.6525 => 5.9306, std.dev.: 0.0212) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.56% (0.4146 => 0.1801, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.34% (0.4578 => 0.2365, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.04% (11.3868 => 6.3720, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.84% (5.4023 => 3.6281, std.dev.: 0.0437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.36% (0.4452 => 0.3056, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: -30.82% (0.9372 => 0.6484, std.dev.: 0.0602) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.04% (0.5495 => 0.4009, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/heapsort: -26.51% (4.4739 => 3.2880, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.15% (5.2605 => 3.8847, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.30% (0.5826 => 0.4352, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.09% (4.4467 => 3.3309, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.04% (4.2042 => 3.1514, std.dev.: 0.1059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.18% (0.5897 => 0.4471, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -22.74% (1.8123 => 1.4001, std.dev.: 0.0128) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.64% (1.0816 => 0.8584, std.dev.: 0.0432) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.13% (1.5623 => 1.2634, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.50% (5.8755 => 4.7883, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.55% (16.6791 => 14.0862, std.dev.: 0.1246) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.92% (0.1164 => 0.1002, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.22% (3.1921 => 2.7700, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.85% (7.0016 => 6.1020, std.dev.: 0.1501) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6744, std.dev.: 0.1120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.60% (9.7992 => 8.5644, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9935, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.73% (0.4081 => 0.3643, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.33% (5.0421 => 4.5211, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout/hash: -9.90% (4.5259 => 4.0779, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/lists1: -8.66% (0.6628 => 0.6054, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: -8.29% (1.6547 => 1.5175, std.dev.: 0.0436) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.08% (4.4540 => 4.0941, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.32% (4.2843 => 3.9707, std.dev.: 0.0200) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.27% (0.3217 => 0.2983, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2276, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.55% (4.5424 => 4.2447, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.3654 => 0.3420, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.91% (4.9799 => 4.6857, std.dev.: 0.0298) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.68% (42.3194 => 39.9169, std.dev.: 0.5168) SingleSource/Benchmarks/McGill/queens: -5.61% (1.7443 => 1.6464, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.20% (3.7662 => 3.5703, std.dev.: 0.0642) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.12% (23.3986 => 22.2002, std.dev.: 0.3439) SingleSource/Benchmarks/Shootout-C++/hash2: -4.93% (3.6768 => 3.4955, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.67% (1.4446 => 1.3771, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.29% (3.5127 => 3.3620, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.92% (3.5691 => 3.4293, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (5.8973 => 5.6847, std.dev.: 0.0141) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.57% (2.5170 => 2.4271, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/lists: -3.11% (17.2182 => 16.6825, std.dev.: 0.0456) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.34% (3.5669 => 3.4833, std.dev.: 0.0223) SingleSource/Benchmarks/Misc/whetstone: -1.90% (1.6251 => 1.5942, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5763, std.dev.: 0.0064) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8950, std.dev.: 0.0600) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.56% (8.8249 => 8.6872, std.dev.: 0.0285) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3596 => 3.3158, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.24% (6.8262 => 6.7416, std.dev.: 0.0057) MultiSource/Benchmarks/Bullet/bullet: -1.21% (7.2040 => 7.1167, std.dev.: 0.0337) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (3.7450 => 3.7026, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.02% (2.7432 => 2.7152, std.dev.: 0.0107) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.17% (1.2047 => 1.2068, std.dev.: 0.0290) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.09% (0.0451 => 0.0410, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -16.75% (0.0394 => 0.0328, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.88% (0.0328 => 0.0312, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -20.70% (0.0227 => 0.0180, std.dev.: 0.0020) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.37% (0.0255 => 0.0226, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.03% (0.1530 => 0.1499, std.dev.: 0.0112) MultiSource/Applications/lemon/lemon: -40.20% (1.9293 => 1.1538, std.dev.: 0.3534) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.17% (0.4049 => 0.3961, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.50% (0.1510 => 0.1442, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.92% (0.0978 => 0.0656, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.86% (0.0590 => 0.0579, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.18% (1.1617 => 1.3148, std.dev.: 0.0223) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0610 => 0.0605, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.09% (0.0268 => 0.0354, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.22% (0.7437 => 1.7493, std.dev.: 0.0067) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.04% (0.0092 => 0.0080, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.23% (12.7781 => 34.2750, std.dev.: 0.0698) Report Time: 0.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 07:19:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 09:19:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126151939.ADF192A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7972?compare_to=7970&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7972, Order: 173569, Start Time: 2013-01-26 13:45:29, End Time: 2013-01-26 15:19:58 To: 7970, Order: 173568, Start Time: 2013-01-26 11:46:51, End Time: 2013-01-26 13:21:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 0 (92 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.86% (0.6395 => 0.8816, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.52% (0.5805 => 0.7693, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.49% (0.5688 => 0.7536, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.35% (0.6260 => 0.8285, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.29% (0.5456 => 0.7218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.95% (0.5849 => 0.7718, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.85% (0.5567 => 0.7340, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.65% (0.6395 => 0.8419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.57% (0.5575 => 0.7335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.52% (0.5941 => 0.7754, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.97% (0.5859 => 0.7615, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.92% (0.6033 => 0.7838, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.32% (0.6440 => 0.8328, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.57% (1.6474 => 2.1180, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.52% (0.6189 => 0.7954, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.79% (0.6304 => 0.8056, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.46% (0.6230 => 0.7941, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.61% (0.5802 => 0.7346, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.56% (0.6660 => 0.8429, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.26% (0.5705 => 0.7203, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.21% (0.5925 => 0.7478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.82% (0.5857 => 0.7369, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.75% (0.5569 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.50% (0.5478 => 0.6875, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.48% (0.5570 => 0.6989, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.04% (0.5591 => 0.6991, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.18% (0.0699 => 0.0868, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.15% (0.7524 => 0.9341, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.84% (0.5863 => 0.7261, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.75% (0.6446 => 0.7977, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.73% (0.6052 => 0.7488, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.41% (0.6681 => 0.8245, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.75% (0.6194 => 0.7603, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.49% (0.6297 => 0.7713, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.56% (2.2587 => 2.7457, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.27% (0.6667 => 0.8085, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.48% (0.7339 => 0.8769, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.13% (0.3357 => 0.3865, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3152, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.57% (4.5069 => 5.0733, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.23% (0.4916 => 0.5517, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.14% (0.4515 => 0.5063, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.60% (0.1982 => 0.2212, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.42% (3.5339 => 3.9375, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.41% (1.6364 => 1.8231, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.27% (0.2385 => 0.2630, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 9.59% (9.2283 => 10.1133, std.dev.: 0.0064) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.51% (0.1230 => 0.1347, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.78% (0.4524 => 0.4921, std.dev.: 0.0102) MultiSource/Applications/Burg/burg: 8.53% (1.2515 => 1.3582, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.81% (0.5329 => 0.5745, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.63% (0.1731 => 0.1863, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (0.4861 => 0.5230, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.34% (1.4642 => 1.5716, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.29% (0.7021 => 0.7533, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.86% (1.2784 => 1.3661, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3255 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.73% (0.6750 => 0.7137, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3319 => 0.3498, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.31% (5.4682 => 5.7037, std.dev.: 0.0047) MultiSource/Applications/oggenc/oggenc: 3.61% (5.0226 => 5.2039, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 3.57% (0.3446 => 0.3569, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.39% (0.3394 => 0.3509, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 3.28% (0.8418 => 0.8694, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 2.89% (1.3864 => 1.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.62% (0.4427 => 0.4543, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.34% (0.7447 => 0.7621, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.17% (22.4056 => 22.8910, std.dev.: 0.0166) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.9557 => 0.9763, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 1.92% (15.5079 => 15.8055, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.89% (1.3722 => 1.3982, std.dev.: 0.0040) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8117, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.23% (0.9531 => 1.0315, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1644, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4784, std.dev.: 0.0578) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0080) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2231 => 18.5096, std.dev.: 0.0019) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2488, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.49% (79.7170 => 80.9058, std.dev.: 0.3107) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2688, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4571, std.dev.: 0.0133) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.35% (0.7198 => 0.6885, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -4.06% (2.4924 => 2.3913, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -3.93% (0.3812 => 0.3662, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.84% (0.3831 => 0.3684, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.84% (0.3884 => 0.3735, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3896 => 0.3747, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.81% (0.3880 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.4033 => 0.3881, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.77% (0.3848 => 0.3703, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3821 => 0.3681, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.65% (0.3837 => 0.3697, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.61% (0.9852 => 0.9496, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.60% (0.3891 => 0.3751, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.4176 => 0.4031, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.77% (0.6347 => 0.6171, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.73% (0.7779 => 0.7567, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.64% (0.6484 => 0.6313, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.59% (0.4280 => 0.4169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.58% (0.6441 => 0.6275, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.40% (1.3148 => 1.2832, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.31% (2.1713 => 2.1211, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9136, std.dev.: 0.0176) SingleSource/UnitTests/Vector/constpool: -1.96% (20.7746 => 20.3668, std.dev.: 0.0115) MultiSource/Applications/sqlite3/sqlite3: -1.82% (17.1032 => 16.7914, std.dev.: 0.0102) MultiSource/Applications/JM/lencod/lencod: -1.41% (16.1920 => 15.9642, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.38% (6.7716 => 6.6783, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.35% (0.7919 => 0.7812, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.24% (1.0544 => 1.0413, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: -1.20% (7.0961 => 7.0109, std.dev.: 0.0077) MultiSource/Benchmarks/MallocBench/gs/gs: -1.11% (4.3330 => 4.2850, std.dev.: 0.0047) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.06% (1.2210 => 1.2080, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.34% (1.8100 => 0.6998, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3162, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7523, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0799, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1998, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3571, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.22% (0.3273 => 0.3135, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.40% (1.0557 => 1.0198, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1195, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.25% (7.9763 => 7.7965, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1730, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4659, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.47% (1.6307 => 1.6067, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7092 => 3.6591, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6019, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 07:51:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 09:51:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126155105.BBDC12A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7973?compare_to=7968&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7973, Order: 173569, Start Time: 2013-01-26 13:40:21, End Time: 2013-01-26 15:51:23 To: 7968, Order: 173567, Start Time: 2013-01-26 10:58:03, End Time: 2013-01-26 13:09:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (218 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (653 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.13% (4.6111 => 4.6630, std.dev.: 0.0075) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1332 => 0.1330, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.34% (0.0689 => 0.0666, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8559 => 499.8432, std.dev.: 0.0136) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.13% (1.1277 => 499.8432, std.dev.: 0.0136) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.39% (0.5229 => 1.6492, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 20.58% (14.9895 => 18.0741, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 44.43% (14.1553 => 20.4443, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 18.04% (4.1105 => 4.8521, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.69% (1.1048 => 1.7311, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.02% (7.1582 => 37.3670, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.71% (3.4629 => 6.4308, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.52% (0.6222 => 1.0921, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.72% (0.0720 => 7.4374, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 3833000.00% (0.0001 => 3.8331, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11186600.00% (0.0001 => 11.1867, std.dev.: 0.0407) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575000.00% (0.0001 => 0.5751, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490300.00% (0.0001 => 5.4904, std.dev.: 0.0443) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.10% (1.1194 => 10.3556, std.dev.: 0.0563) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 149.10% (22.1758 => 55.2398, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 87.65% (0.0243 => 0.0456) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.75% (0.0730 => 0.1210, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.81% (2.9384 => 4.6078, std.dev.: 0.0116) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.17% (7.0540 => 10.8049, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.34% (1.5859 => 2.4001, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 49.05% (0.1056 => 0.1574, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.21% (8.1363 => 11.9776, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.92% (2.2024 => 3.1257, std.dev.: 0.0071) MultiSource/Applications/sgefa/sgefa: 39.76% (0.3109 => 0.4345, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.62% (0.1432 => 0.1985, std.dev.: 0.0004) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 37.66% (21.9371 => 30.1992, std.dev.: 0.0243) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.41% (4.2646 => 5.6895, std.dev.: 0.0078) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.61% (0.4615 => 0.6120, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.45% (1.5415 => 2.0417, std.dev.: 0.0096) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.65% (0.2271 => 0.2967, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.63% (1.1642 => 1.5092, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 29.40% (0.4299 => 0.5563, std.dev.: 0.0035) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 27.83% (0.0636 => 0.0813, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.77% (0.0479 => 0.0612, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.52% (0.5105 => 0.6510, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.24% (0.6675 => 0.8493, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.59% (0.1892 => 0.2395, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.33% (0.1143 => 0.1444) MultiSource/Benchmarks/mafft/pairlocalalign: 26.07% (9.4845 => 11.9568, std.dev.: 0.0094) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.97% (3.8922 => 4.9031, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/08-main/main: 25.88% (0.2554 => 0.3215, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 25.62% (0.1655 => 0.2079, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 25.16% (0.4289 => 0.5368, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.58% (0.3121 => 0.3888, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.55% (0.1906 => 0.2374, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.52% (0.1566 => 0.1950, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 24.45% (1.0722 => 1.3344, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.34% (0.1175 => 0.1461, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.11% (1.4186 => 1.7606, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: 24.09% (0.4620 => 0.5733, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.56% (0.0730 => 0.0902, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.30% (0.1695 => 0.2090, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 22.97% (0.6456 => 0.7939, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.76% (0.0457 => 0.0561, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 22.52% (0.7115 => 0.8717, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.47% (0.0672 => 0.0823, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.06% (0.1555 => 0.1898, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 22.05% (0.3098 => 0.3781, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.89% (0.2700 => 0.3291, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.78% (0.0675 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.44% (0.1236 => 0.1501, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.85% (1.3050 => 1.5771, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 20.80% (0.7835 => 0.9465, std.dev.: 0.0052) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.35% (5.7591 => 6.9308, std.dev.: 0.0123) MultiSource/Applications/aha/aha: 20.24% (0.1151 => 0.1384, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.24% (0.1695 => 0.2038, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1032 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.12% (0.8172 => 0.9816, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.03% (0.5860 => 0.7034, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.78% (4.9449 => 5.9231, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1940 => 0.2323, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bisort/bisort: 19.71% (0.0614 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.08% (0.3307 => 0.3938, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.00% (5.0018 => 5.9521, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.84% (0.5020 => 0.5966, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 18.84% (3.3354 => 3.9638, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.67% (0.2758 => 0.3273, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 18.16% (0.7433 => 0.8783, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.04% (0.9765 => 1.1527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.01% (0.5569 => 0.6572, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.88% (0.1510 => 0.1780, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 17.66% (1.1840 => 1.3931, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.63% (0.0834 => 0.0981, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 17.51% (2.0273 => 2.3823, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 17.51% (3.8723 => 4.5503, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.46% (0.4203 => 0.4937, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.43% (0.2065 => 0.2425, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.29% (0.3423 => 0.4015, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.22% (1.1861 => 1.3903, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.20% (0.5981 => 0.7010, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary3: 17.12% (0.3283 => 0.3845, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 16.84% (2.2969 => 2.6838, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/ReedSolomon: 16.84% (0.2049 => 0.2394, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.77% (0.3232 => 0.3774, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.72% (0.0933 => 0.1089, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.70% (0.8101 => 0.9454, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.68% (0.3441 => 0.4015, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.48% (0.1044 => 0.1216, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.03% (0.6450 => 0.7484, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 15.54% (0.3379 => 0.3904, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 15.47% (0.3180 => 0.3672, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942) SingleSource/UnitTests/SignlessTypes/rem: 15.12% (0.1144 => 0.1317, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 15.03% (0.8921 => 1.0262, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.91% (0.0704 => 0.0809, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.52% (0.8067 => 0.9238, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.41% (0.3865 => 0.4422, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.21% (0.2603 => 0.2973, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 14.04% (0.2905 => 0.3313, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.02% (0.4636 => 0.5286, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.40% (0.4103 => 0.4653, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.29% (0.3387 => 0.3837, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 12.99% (1.5603 => 1.7630, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists: 12.59% (0.3422 => 0.3853, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.52% (0.3603 => 0.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.4048 => 0.4554, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.13% (0.3684 => 0.4131, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 11.85% (17.1811 => 19.2178, std.dev.: 0.0171) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.73% (0.2430 => 0.2715, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.68% (0.3826 => 0.4273, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/strcat: 11.41% (0.2831 => 0.3154, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.26% (0.3927 => 0.4369, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.12% (0.4064 => 0.4516, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.06% (0.3092 => 0.3434, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.88% (0.3427 => 0.3800, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/property: 10.86% (0.3886 => 0.4308, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/except: 10.66% (0.2871 => 0.3177, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.45% (14.3668 => 15.8684, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/Puzzle: 10.41% (0.1268 => 0.1400, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.32% (0.3828 => 0.4223, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.05% (0.1114 => 0.1226, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.01% (2.0665 => 2.2733, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 9.79% (0.3473 => 0.3813, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 9.77% (0.2877 => 0.3158, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 9.74% (0.3543 => 0.3888, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 9.72% (0.3694 => 0.4053, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.71% (0.3543 => 0.3887, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 9.67% (0.3516 => 0.3856, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.66% (0.3561 => 0.3905, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.61% (0.3497 => 0.3833, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.56% (0.2793 => 0.3060, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/fibo: 9.54% (0.2725 => 0.2985, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.52% (0.3162 => 0.3463, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.45% (0.3650 => 0.3995, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.43% (0.2714 => 0.2970, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 9.43% (1.2842 => 1.4053, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.27% (0.2891 => 0.3159, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.12% (0.2872 => 0.3134, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.06% (0.2802 => 0.3056, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.04% (0.3052 => 0.3328, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 9.00% (0.6030 => 0.6573, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.92% (0.3935 => 0.4286, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.75% (0.7326 => 0.7967, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: 8.71% (63.2438 => 68.7518, std.dev.: 0.0306) SingleSource/UnitTests/ObjC++/Hello: 8.59% (0.5925 => 0.6434, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.48% (0.3136 => 0.3402, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.87% (2.2022 => 2.3536, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.28% (0.1625 => 0.1727, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.25% (0.4879 => 0.5184, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.04% (0.3177 => 0.3369, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 5.85% (10.3673 => 10.9734, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.9617 => 8.1485, std.dev.: 0.0054) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4732, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 13.04% (0.5413 => 0.6119, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3858, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.74% (4.2280 => 4.4705, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3139, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.01% (0.9957 => 1.0356, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9235, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7165, std.dev.: 0.0099) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 1.96% (0.8333 => 0.8496, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.88% (9.1159 => 9.2875, std.dev.: 0.0260) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (27.8444 => 28.3053, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4534, std.dev.: 0.0321) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1684, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.84% (5.2763 => 1.1692, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -75.03% (0.8651 => 0.2160, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.46% (0.1622 => 0.0917, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.07% (5.3855 => 4.4660, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.59% (5.3526 => 4.4645, std.dev.: 0.0059) MultiSource/Applications/JM/ldecod/ldecod: -13.64% (10.4361 => 9.0127, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.88% (1.7609 => 1.6222, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.84% (54.1659 => 49.9181, std.dev.: 0.0228) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.69% (1.9577 => 0.6522, std.dev.: 0.0125) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.69% (0.6962 => 0.3433, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3050, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0208, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.84% (10.7105 => 7.4076, std.dev.: 0.0118) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8552, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0039, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4257, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7343, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.98% (0.9540 => 0.8397, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4950, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5738, std.dev.: 0.1130) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.45% (1.2373 => 1.1575, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7016, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-5: -4.94% (1.5835 => 1.5052, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.31% (10.2830 => 9.8403, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.69% (3.6994 => 3.6370, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: -1.40% (4.6441 => 4.5790, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7221 => 3.6760, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0093) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.53% (0.2116 => 0.0666, std.dev.: 0.0011) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 09:09:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 11:09:39 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126170939.0BBD42A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7974?compare_to=7971&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7974, Order: 173572, Start Time: 2013-01-26 15:06:07, End Time: 2013-01-26 17:09:58 To: 7971, Order: 173569, Start Time: 2013-01-26 12:46:56, End Time: 2013-01-26 14:49:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 3 (90 on baseline) Performance Improvements: 1 (75 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1060 (898 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: 8.71% (0.6484 => 0.7049, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: 8.31% (49.1894 => 53.2769, std.dev.: 0.0494) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.23% (1.8258 => 1.8665, std.dev.: 0.0148) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.89% (1.0471 => 1.0273, std.dev.: 0.0037) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.34% (1.2068 => 1.2230, std.dev.: 0.0665) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.89% (0.0225 => 0.0223, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.34% (0.0410 => 0.0436, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.66% (0.0328 => 0.0340, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.21% (0.0312 => 0.0322, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.93% (0.0430 => 0.0434, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -1.90% (0.0210 => 0.0206, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: 23.33% (0.0180 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -23.89% (0.0226 => 0.0172, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.73% (0.1499 => 0.1510, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -1.31% (1.1538 => 1.1387, std.dev.: 0.0161) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.16% (0.3961 => 0.4007, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.66% (0.1442 => 0.1418, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.37% (0.0656 => 0.0665, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.56% (0.0579 => 0.0541, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.15% (1.3148 => 1.3168, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0605 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.28% (0.0354 => 0.0353, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.02% (1.7493 => 1.6964, std.dev.: 0.0234) SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -12.50% (0.0080 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (34.2750 => 33.2834, std.dev.: 0.6919) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 399.40% (0.0336 => 0.1678, std.dev.: 0.0016) SingleSource/Regression/C/sumarraymalloc: 111.26% (0.0293 => 0.0619, std.dev.: 0.0015) SingleSource/Regression/C/sumarray2d: 82.85% (0.0274 => 0.0501, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 60.44% (0.1638 => 0.2628, std.dev.: 0.0015) SingleSource/Regression/C/sumarray: 52.45% (0.0265 => 0.0404, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.00% (0.8926 => 1.2675, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.77% (0.9120 => 1.2929, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.66% (0.8893 => 1.2598, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.78% (0.9061 => 1.2756, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.62% (0.9612 => 1.3516, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.16% (0.9564 => 1.3405, std.dev.: 0.1033) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.84% (0.9588 => 1.3408, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.75% (0.9381 => 1.3110, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.12% (0.9422 => 1.3108, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.89% (0.8990 => 1.2486, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.72% (0.9091 => 1.2611, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.65% (0.9855 => 1.3664, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.15% (0.9998 => 1.3812, std.dev.: 0.1251) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.47% (0.9403 => 1.2926, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.64% (0.9512 => 1.2997, std.dev.: 0.0993) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.62% (1.0119 => 1.3825, std.dev.: 0.0619) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.60% (0.9010 => 1.2308, std.dev.: 0.1017) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.40% (0.8736 => 1.1916, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.07% (0.8912 => 1.2127, std.dev.: 0.0468) SingleSource/Benchmarks/Stanford/IntMM: 35.96% (0.0431 => 0.0586, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.53% (1.0867 => 1.4728, std.dev.: 0.0335) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.93% (0.8732 => 1.1782, std.dev.: 0.0727) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.70% (1.0052 => 1.3540, std.dev.: 0.0612) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.22% (0.8846 => 1.1873, std.dev.: 0.1021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.70% (1.0088 => 1.3488, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.86% (0.9867 => 1.3109, std.dev.: 0.0714) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.58% (1.0017 => 1.3281, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.41% (0.9788 => 1.2960, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.94% (0.9507 => 1.2544, std.dev.: 0.1163) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.55% (0.9488 => 1.2481, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.98% (0.9127 => 1.1955, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.36% (0.9685 => 1.2625, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.08% (0.9993 => 1.2999, std.dev.: 0.0940) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.88% (0.9405 => 1.2215, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.58% (0.9550 => 1.2279, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.90% (1.0860 => 1.3781, std.dev.: 0.0791) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.04% (0.0963 => 0.1156, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.68% (0.0669 => 0.0794, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.70% (1.0986 => 1.2601, std.dev.: 0.0220) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.44% (0.1240 => 0.1419, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.92% (0.0783 => 0.0892, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.88% (3.6295 => 4.1333, std.dev.: 0.1793) MultiSource/Benchmarks/mafft/pairlocalalign: 12.97% (9.5202 => 10.7548, std.dev.: 0.4697) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.91% (0.1332 => 0.1504, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.81% (0.5369 => 0.6003, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout-C++/matrix: 11.61% (0.2385 => 0.2662, std.dev.: 0.0079) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.51% (0.4596 => 0.5079, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.86% (0.2577 => 0.2831, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.46% (5.0381 => 5.5148, std.dev.: 0.1781) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.26% (0.1955 => 0.2136, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.03% (1.8651 => 2.0148, std.dev.: 0.0559) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2042 => 0.2179, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.88% (5.3553 => 5.5629, std.dev.: 0.0753) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.95% (0.7693 => 0.7843, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106025.00% (0.0008 => 0.8490, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/matrix: 353.29% (1.5825 => 7.1733, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout/ary3: 280.82% (2.2304 => 8.4938, std.dev.: 2.3469) MultiSource/Applications/sgefa/sgefa: 258.26% (0.3515 => 1.2593, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.03% (1.1825 => 4.0682, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 225.75% (4.8185 => 15.6961, std.dev.: 0.1872) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 210.96% (0.0228 => 0.0709, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 199.22% (0.0129 => 0.0386, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 140.52% (0.0232 => 0.0558, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 62.13% (2.9083 => 4.7152, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.49% (0.2562 => 0.3420, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.31% (3.1254 => 4.1039, std.dev.: 0.0163) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.95% (1.4588 => 1.8665, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: 24.76% (1.5397 => 1.9210, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 24.22% (5.6033 => 6.9602, std.dev.: 0.3016) SingleSource/Benchmarks/Misc/salsa20: 21.78% (7.4497 => 9.0726, std.dev.: 0.0637) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.60% (4.8112 => 5.8023, std.dev.: 0.0270) MultiSource/Applications/JM/lencod/lencod: 13.24% (6.8159 => 7.7180, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.02% (5.1752 => 5.8488, std.dev.: 0.0508) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6502, std.dev.: 0.0582) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.89% (0.6211 => 0.6763, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.79% (3.6477 => 3.9682, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/ReedSolomon: 7.82% (8.6447 => 9.3205, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.99% (4.7473 => 5.0790, std.dev.: 0.0287) SingleSource/Benchmarks/McGill/chomp: 6.14% (1.0425 => 1.1065, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.14% (4.1836 => 4.3987, std.dev.: 0.0065) SingleSource/Benchmarks/Linpack/linpack-pc: 4.68% (50.8945 => 53.2769, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2296, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/pi: 3.22% (2.1390 => 2.2078, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8767, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.25% (4.8076 => 4.8677, std.dev.: 0.0061) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.78% (0.0808 => 0.0527, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.89% (0.0692 => 0.0499, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.23% (0.1009 => 0.0815, std.dev.: 0.0017) MultiSource/Applications/hbd/hbd: -18.35% (1.8964 => 1.5485, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.69% (0.1684 => 0.1403, std.dev.: 0.0037) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.24% (0.4074 => 0.3657, std.dev.: 0.0157) MultiSource/Applications/hexxagon/hexxagon: -10.15% (1.1433 => 1.0273, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: -9.81% (2.4719 => 2.2295, std.dev.: 0.0705) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.47% (6.4235 => 5.8155, std.dev.: 0.2150) MultiSource/Applications/lua/lua: -8.68% (4.6406 => 4.2376, std.dev.: 0.1492) SingleSource/Benchmarks/Shootout-C++/hash2: -8.47% (0.5134 => 0.4699, std.dev.: 0.0079) MultiSource/Applications/ALAC/encode/alacconvert-encode: -8.05% (1.2154 => 1.1176, std.dev.: 0.0077) MultiSource/Applications/sqlite3/sqlite3: -7.35% (17.5634 => 16.2730, std.dev.: 0.3158) MultiSource/Applications/lambda-0_1_3/lambda: -7.18% (0.8653 => 0.8032, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.90% (1.0234 => 0.9528, std.dev.: 0.0239) MultiSource/Applications/ClamAV/clamscan: -6.54% (17.4365 => 16.2966, std.dev.: 0.2872) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.1610 => 0.1506, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -6.37% (1.3979 => 1.3089, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.87% (0.9588 => 0.9121, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/moments: -4.75% (0.4002 => 0.3812, std.dev.: 0.0039) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.85% (1.1731 => 1.1279, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.33% (0.3093 => 0.2990, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.79% (11.5523 => 3.9517, std.dev.: 0.0404) SingleSource/Benchmarks/Misc/fp-convert: -62.42% (15.6525 => 5.8827, std.dev.: 0.0903) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.42% (0.4146 => 0.1807, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.82% (0.4578 => 0.2343, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.17% (11.3868 => 6.3577, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.95% (5.4023 => 3.6222, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.22% (0.4452 => 0.3062, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/heapsort: -29.58% (4.4739 => 3.1505, std.dev.: 0.2112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.37% (0.5495 => 0.3991, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.18% (5.2605 => 3.8834, std.dev.: 0.0333) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.50% (4.2042 => 3.1323, std.dev.: 0.2571) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.16% (0.5826 => 0.4360, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.01% (4.4467 => 3.3345, std.dev.: 0.0444) MultiSource/Benchmarks/Olden/bisort/bisort: -24.79% (0.9372 => 0.7049, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.88% (0.5897 => 0.4489, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.53% (4.9921 => 3.8176, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.41% (5.8755 => 4.7940, std.dev.: 0.0673) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.06% (16.6791 => 13.8344, std.dev.: 0.2858) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.57% (0.1164 => 0.1006, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.05% (7.0016 => 6.0879, std.dev.: 0.1302) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.01% (3.1921 => 2.7768, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6752, std.dev.: 0.2019) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.70% (9.7992 => 8.5547, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9939, std.dev.: 0.0211) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.66% (0.4081 => 0.3646, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: -9.05% (0.6628 => 0.6028, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout/nestedloop: -8.86% (0.2200 => 0.2005, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.40% (4.4540 => 4.0799, std.dev.: 0.0687) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.96% (0.3217 => 0.2961, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2284, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.44% (4.5424 => 4.2498, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/health/health: -5.99% (0.3654 => 0.3435, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.69% (4.9799 => 4.6966, std.dev.: 0.0912) SingleSource/Benchmarks/McGill/queens: -5.39% (1.7443 => 1.6502, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.33% (23.3986 => 22.1506, std.dev.: 0.0513) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (3.6768 => 3.5000, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.63% (0.3349 => 0.3194, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.29% (3.5127 => 3.3621, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.71% (3.5691 => 3.4366, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (5.8973 => 5.6807, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout-C++/lists: -3.43% (17.2182 => 16.6283, std.dev.: 0.1365) MultiSource/Applications/SIBsim4/SIBsim4: -3.26% (3.5443 => 3.4288, std.dev.: 0.0198) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.35% (1.0995 => 1.0737, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.82% (8.7327 => 8.5737, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/whetstone: -1.72% (1.6251 => 1.5972, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8997, std.dev.: 0.0525) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (8.8249 => 8.6886, std.dev.: 0.0398) SingleSource/Benchmarks/Shootout-C++/methcall: -1.31% (8.7416 => 8.6268, std.dev.: 0.0364) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.26% (3.3596 => 3.3173, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7483, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7024, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.04% (6.6336 => 6.5645, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/flops-7: -1.01% (1.7446 => 1.7269, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.52% (1.2047 => 1.2230, std.dev.: 0.0665) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0015) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -32.55% (0.0255 => 0.0172, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1530 => 0.1510, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: -40.98% (1.9293 => 1.1387, std.dev.: 0.0161) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.04% (0.4049 => 0.4007, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.09% (0.1510 => 0.1418, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.00% (0.0978 => 0.0665, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.35% (1.1617 => 1.3168, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.72% (0.0268 => 0.0353, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 128.10% (0.7437 => 1.6964, std.dev.: 0.0234) SingleSource/Regression/C/2003-05-21-UnionBitfields: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -23.91% (0.0092 => 0.0070, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 160.47% (12.7781 => 33.2834, std.dev.: 0.6919) Report Time: 0.87s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 09:17:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 11:17:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126171732.75B8E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7975?compare_to=7972&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7975, Order: 173572, Start Time: 2013-01-26 15:43:57, End Time: 2013-01-26 17:17:50 To: 7972, Order: 173569, Start Time: 2013-01-26 13:45:29, End Time: 2013-01-26 15:19:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.84% (0.0974 => 0.1625, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.20% (0.6395 => 0.8838, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.83% (0.5805 => 0.7711, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.54% (0.6260 => 0.8297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.44% (0.5456 => 0.7226, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.07% (0.5849 => 0.7725, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.99% (0.5567 => 0.7348, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.88% (0.5581 => 0.7360, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.87% (0.5575 => 0.7352, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.71% (0.6395 => 0.8423, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.85% (0.5941 => 0.7774, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.38% (0.5859 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.25% (0.6033 => 0.7858, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.63% (0.6440 => 0.8348, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.85% (1.6474 => 2.1227, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.76% (0.6189 => 0.7969, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.62% (0.6676 => 0.8587, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.06% (0.6304 => 0.8073, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.61% (0.6230 => 0.7950, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.75% (0.5802 => 0.7354, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.67% (0.6660 => 0.8436, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.40% (0.5705 => 0.7211, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.36% (0.5925 => 0.7487, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.90% (0.5857 => 0.7374, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.58% (0.5478 => 0.6879, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.57% (0.5570 => 0.6994, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.17% (0.5591 => 0.6998, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.46% (0.0699 => 0.0870, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.26% (0.7524 => 0.9349, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.17% (0.6446 => 0.8004, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.08% (0.5863 => 0.7275, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.84% (0.6052 => 0.7495, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.38% (0.6681 => 0.8243, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.05% (0.6194 => 0.7622, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.60% (0.6297 => 0.7720, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.70% (2.2587 => 2.7488, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.58% (0.6667 => 0.8106, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.74% (0.7339 => 0.8788, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.93% (0.1146 => 0.1340, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.40% (0.3357 => 0.3874, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (4.5069 => 5.0813, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4916 => 0.5520, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.61% (3.5339 => 3.9443, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.59% (1.6364 => 1.8260, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.20% (0.1982 => 0.2204, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 9.85% (9.2283 => 10.1374, std.dev.: 0.0078) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.59% (0.1230 => 0.1348, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.58% (1.2515 => 1.3589, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 8.47% (0.4524 => 0.4907, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.92% (0.5329 => 0.5751, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.51% (0.1731 => 0.1861, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.43% (0.7021 => 0.7543, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.40% (1.4642 => 1.5725, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/hash2: 7.34% (0.4861 => 0.5218, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.99% (1.2784 => 1.3678, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: 5.99% (0.3255 => 0.3450, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.61% (0.6750 => 0.7129, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3319 => 0.3499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.09% (5.4682 => 5.6920, std.dev.: 0.0144) MultiSource/Applications/oggenc/oggenc: 3.53% (5.0226 => 5.2000, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary3: 3.34% (0.3446 => 0.3561, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.3864 => 1.4297, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 3.01% (0.8418 => 0.8671, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.39% (0.4427 => 0.4533, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.28% (0.7447 => 0.7617, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.16% (0.9557 => 0.9763, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.03% (22.4056 => 22.8606, std.dev.: 0.0076) MultiSource/Applications/SPASS/SPASS: 2.00% (15.5079 => 15.8176, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.91% (1.3722 => 1.3984, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8124, std.dev.: 0.0103) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9531 => 1.0298, std.dev.: 0.0069) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.97% (1.2783 => 1.3674, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.19% (11.6767 => 12.1654, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.35% (54.5751 => 56.4051, std.dev.: 0.1238) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.71% (2.0478 => 2.1032, std.dev.: 0.0027) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2472, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.49% (18.2231 => 18.4943, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.57% (0.7198 => 0.6869, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.08% (0.3821 => 0.3665, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/trivial-interface: -4.04% (0.3812 => 0.3658, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3880 => 0.3729, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3831 => 0.3682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.89% (0.3884 => 0.3733, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.85% (0.3848 => 0.3700, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.81% (0.3837 => 0.3691, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.75% (0.3891 => 0.3745, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.72% (0.4033 => 0.3883, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.72% (2.4924 => 2.3998, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -3.70% (0.3896 => 0.3752, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.54% (0.4176 => 0.4028, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.26% (0.9852 => 0.9531, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.19% (0.3323 => 0.3217, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.98% (0.6347 => 0.6158, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.98% (0.4199 => 0.4074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.71% (20.7746 => 20.2110, std.dev.: 0.0263) SingleSource/UnitTests/ObjC++/property-reference-object: -2.70% (0.6441 => 0.6267, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.70% (1.3148 => 1.2793, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: -2.66% (0.4280 => 0.4166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.65% (2.1713 => 2.1138, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference: -2.46% (0.7779 => 0.7588, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.41% (0.9542 => 0.9312, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.41% (0.6484 => 0.6328, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.87% (14.2083 => 13.9433, std.dev.: 0.0065) MultiSource/Applications/sqlite3/sqlite3: -1.80% (17.1032 => 16.7961, std.dev.: 0.0243) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.7716 => 6.6793, std.dev.: 0.0013) MultiSource/Applications/JM/lencod/lencod: -1.25% (16.1920 => 15.9896, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.19% (1.2221 => 1.2075, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.12% (1.0544 => 1.0426, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.07% (1.2210 => 1.2079, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (7.0961 => 7.0234, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: -1.02% (4.3330 => 4.2889, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.96% (1.8100 => 0.7067, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.72% (6.6713 => 3.4209, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3126, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7560, std.dev.: 0.0019) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0837, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.03% (4.1024 => 3.1985, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0016) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1278, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3533, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.16% (0.3273 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.81% (2.2633 => 2.1771, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.07% (1.0557 => 1.0233, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.59% (1.3096 => 1.2757, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.54% (7.9763 => 7.7740, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1722, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.7241 => 3.6618, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4740, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7092 => 3.6567, std.dev.: 0.0165) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5997, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.17% (1.6307 => 1.6116, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.10% (1.6086 => 1.5909, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 09:48:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 11:48:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130126174823.B578C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7976?compare_to=7969&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7976, Order: 173569, Start Time: 2013-01-26 14:14:07, End Time: 2013-01-26 17:48:41 To: 7969, Order: 173567, Start Time: 2013-01-26 09:34:20, End Time: 2013-01-26 13:18:33 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (183 on baseline) Performance Improvements: 5 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1097 (753 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 10.99% (116.2041 => 128.9702, std.dev.: 1.1388) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.48% (2.0274 => 2.0980, std.dev.: 0.0185) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.19% (0.4828 => 0.4674, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.44% (1.6077 => 1.5684, std.dev.: 0.0104) MultiSource/Applications/spiff/spiff: -2.06% (0.4960 => 0.4858, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.77% (2.3378 => 2.2964, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.24% (5.1891 => 5.1249, std.dev.: 0.0013) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.32% (0.0625 => 0.0902, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.71% (0.1063 => 0.1432, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.13% (0.2969 => 0.3834, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.02% (0.1106 => 0.1427, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.78% (0.4139 => 0.5289, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.61% (0.0547 => 0.0698, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.56% (0.5900 => 0.7526, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.03% (0.0584 => 0.0736, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.73% (0.4994 => 0.6279, std.dev.: 0.0176) MultiSource/Applications/oggenc/oggenc: 25.66% (1.5932 => 2.0020, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.49% (0.4253 => 0.5337, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.32% (0.5000 => 0.6266, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.06% (0.1620 => 0.2026, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.30% (0.0897 => 0.1115, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.22% (0.1107 => 0.1364, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.13% (0.1003 => 0.1235, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.11% (0.0822 => 0.1012, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.03% (0.0495 => 0.0609, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.88% (0.1604 => 0.1971, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.70% (0.3903 => 0.4789, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 22.68% (0.0604 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 22.66% (0.0821 => 0.1007, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 22.54% (0.1619 => 0.1984, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.53% (0.1549 => 0.1898, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.54% (0.0947 => 0.1151, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.76% (0.2736 => 0.3304, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.68% (0.1088 => 0.1313, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 20.61% (0.1218 => 0.1469, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 20.58% (0.4029 => 0.4858, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.56% (0.2014 => 0.2428, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 20.42% (0.0808 => 0.0973, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.15% (0.3890 => 0.4674, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/09-vor/vor: 20.07% (0.1505 => 0.1807, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.61% (0.2866 => 0.3428, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.54% (0.3271 => 0.3910, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 19.40% (0.5826 => 0.6956, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.25% (1.3152 => 1.5684, std.dev.: 0.0104) MultiSource/Applications/Burg/burg: 19.22% (0.5546 => 0.6612, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference-object: 18.93% (0.5889 => 0.7004, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.83% (3.5627 => 4.2337, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.71% (1.6211 => 1.9244, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 18.69% (1.8794 => 2.2307, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.46% (0.4658 => 0.5518, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.43% (0.2875 => 0.3405, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.39% (0.1968 => 0.2330, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/bh/bh: 18.30% (0.1284 => 0.1519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 18.27% (0.2813 => 0.3327, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.23% (0.2792 => 0.3301, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/strcat: 18.18% (0.2750 => 0.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 18.17% (0.2823 => 0.3336, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 18.00% (0.2811 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.88% (0.2780 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 17.87% (0.2725 => 0.3212, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 17.87% (0.2714 => 0.3199, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.82% (0.2738 => 0.3226, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.77% (0.2729 => 0.3214, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 17.77% (0.9697 => 1.1420, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/random: 17.73% (0.2803 => 0.3300, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.72% (0.3195 => 0.3761, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.66% (0.2911 => 0.3425, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.58% (2.0673 => 2.4308, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 17.51% (0.3096 => 0.3638, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 17.48% (0.3004 => 0.3529, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.46% (0.3930 => 0.4616, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.40% (0.4361 => 0.5120, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.33% (0.5026 => 0.5897, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 17.29% (0.3267 => 0.3832, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 17.29% (0.9909 => 1.1622, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 17.19% (0.3258 => 0.3818, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 17.12% (0.7171 => 0.8399, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: 16.98% (1.0781 => 1.2612, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.96% (0.3060 => 0.3579, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.95% (2.7292 => 3.1917, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary2: 16.88% (0.3317 => 0.3877, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.65% (0.3124 => 0.3644, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/sieve: 16.64% (0.3726 => 0.4346, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 16.64% (0.3678 => 0.4290, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.61% (1.9966 => 2.3283, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.60% (1.9694 => 2.2964, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/lists1: 16.59% (0.3477 => 0.4054, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.55% (4.2109 => 4.9080, std.dev.: 0.0996) SingleSource/Benchmarks/Shootout-C++/lists: 16.52% (0.3348 => 0.3901, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.48% (0.3362 => 0.3916, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.41% (0.3625 => 0.4220, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.33% (0.3282 => 0.3818, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.30% (23.5202 => 27.3548, std.dev.: 0.0302) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.96% (4.4195 => 5.1249, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 15.93% (1.4269 => 1.6542, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 15.93% (0.4251 => 0.4928, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 15.92% (0.4146 => 0.4806, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.80% (0.3690 => 0.4273, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.77% (0.3981 => 0.4609, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3446 => 0.3989, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/for-in: 15.62% (0.3496 => 0.4042, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 15.61% (0.3460 => 0.4000, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 15.60% (0.3469 => 0.4010, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.56% (0.3465 => 0.4004, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 15.51% (0.3442 => 0.3976, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.48% (0.3488 => 0.4028, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.40% (0.3845 => 0.4437, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/property: 15.29% (0.3650 => 0.4208, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.98% (0.1028 => 0.1182, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 14.96% (0.3643 => 0.4188, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.92% (0.5012 => 0.5760, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 14.78% (0.7875 => 0.9039, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 14.22% (5.5417 => 6.3299, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.00% (0.6435 => 0.7336, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.81% (0.2737 => 0.3115, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.72% (2.1653 => 2.4624, std.dev.: 0.0142) MultiSource/Applications/SIBsim4/SIBsim4: 13.45% (0.2691 => 0.3053, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.30% (0.2068 => 0.2343, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 13.25% (4.6177 => 5.2296, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C/football/football: 13.20% (0.2075 => 0.2349, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 13.15% (2.1013 => 2.3776, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.71% (0.3084 => 0.3476, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 12.35% (0.3498 => 0.3930, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.35% (0.5361 => 0.6023, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 11.86% (0.6634 => 0.7421, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.72% (0.3336 => 0.3727, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 11.35% (0.4847 => 0.5397, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.88% (0.7426 => 0.8234, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.83% (11.6398 => 12.9003, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.95% (4.6926 => 5.1595, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.92% (0.5584 => 0.6138, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 9.76% (0.1383 => 0.1518, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 9.74% (0.2391 => 0.2624, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.31% (2.0346 => 2.2240, std.dev.: 0.0084) MultiSource/Applications/kimwitu++/kc: 8.12% (11.9555 => 12.9257, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.04% (0.3792 => 0.4021, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5121, std.dev.: 0.0147) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0098) MultiSource/Applications/ClamAV/clamscan: 9.17% (0.2802 => 0.3059, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.99% (0.3693 => 0.4025, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.46% (3.3903 => 3.6093, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2394, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 4.76% (0.2122 => 0.2223, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6911, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8870, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.07% (15.8721 => 16.2003, std.dev.: 0.0043) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3119, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2873, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0800, std.dev.: 0.0026) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2090, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5883, std.dev.: 0.0113) MultiSource/Applications/sqlite3/sqlite3: 1.02% (10.3705 => 10.4764, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.85% (2.4764 => 2.4057, std.dev.: 0.0115) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5657, std.dev.: 0.0233) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691) SingleSource/Benchmarks/Dhrystone/fldry: -17.90% (17.2379 => 14.1531, std.dev.: 0.0824) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9764, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7993, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary2: -7.49% (0.2402 => 0.2222, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9576, std.dev.: 0.0101) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -4.52% (14.0481 => 13.4135, std.dev.: 0.0878) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2292, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8094, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0060) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7737, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1216, std.dev.: 0.0360) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5761, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1608, std.dev.: 0.0461) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0453, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 10:32:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 12:32:59 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126183259.622312A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7977?compare_to=7973&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7977, Order: 173577, Start Time: 2013-01-26 16:22:02, End Time: 2013-01-26 18:33:17 To: 7973, Order: 173569, Start Time: 2013-01-26 13:40:21, End Time: 2013-01-26 15:51:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (225 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (646 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.67% (0.8783 => 0.8930, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.05% (2.3536 => 2.3784, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/gs/gs: 1.01% (4.8521 => 4.9010, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.41% (0.6522 => 0.6679, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 1.95% (0.1330 => 0.1356, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.60% (0.0666 => 0.0690, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8432 => 499.8559, std.dev.: 0.0009) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.25% (1.1277 => 499.8559, std.dev.: 0.0009) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.20% (0.5229 => 1.6534, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 21.34% (14.9895 => 18.1876, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 45.58% (14.1553 => 20.6078, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/gs/gs: 19.23% (4.1105 => 4.9010, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.00% (1.1048 => 1.7345, std.dev.: 0.0038) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.32% (7.1582 => 37.5319, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.69% (3.4629 => 6.4648, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.47% (0.6222 => 1.0980, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10232.78% (0.0720 => 7.4396, std.dev.: 0.0072) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11155000.00% (0.0001 => 11.1551, std.dev.: 0.0096) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576100.00% (0.0001 => 0.5762, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487600.00% (0.0001 => 5.4877, std.dev.: 0.0445) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.93% (1.1194 => 10.3537, std.dev.: 0.0115) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 149.13% (22.1758 => 55.2474, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 61.17% (0.0394 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.69% (2.9384 => 4.6043, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.93% (7.0540 => 10.8584, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.02% (1.5859 => 2.4109, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/distray/distray: 49.43% (0.1056 => 0.1578, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.37% (8.1363 => 11.9905, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.39% (2.2024 => 3.1360, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 40.56% (0.3109 => 0.4370, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 39.04% (0.1432 => 0.1991, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.49% (21.9371 => 30.3809, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.14% (0.1062 => 0.1467, std.dev.: 0.0001) SingleSource/UnitTests/vla: 38.03% (0.0355 => 0.0490, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.85% (4.2646 => 5.7082, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.07% (1.5415 => 2.0512, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.91% (0.4615 => 0.6134, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.04% (0.2271 => 0.2976, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.71% (0.1143 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.64% (0.0793 => 0.1036, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.36% (1.1642 => 1.5177, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 29.89% (0.4299 => 0.5584, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.86% (0.0730 => 0.0948) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622) MultiSource/Benchmarks/NPB-serial/is/is: 28.65% (0.0719 => 0.0925, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.33% (0.5105 => 0.6551, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 27.96% (0.2554 => 0.3268, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.67% (0.6675 => 0.8522, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.31% (0.1655 => 0.2107, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.15% (0.1584 => 0.2014, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.06% (0.1892 => 0.2404, std.dev.: 0.0019) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 27.02% (0.1125 => 0.1429, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 26.37% (9.4845 => 11.9853, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.30% (3.8922 => 4.9160, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: 25.79% (0.4289 => 0.5395, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.91% (1.0722 => 1.3393, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.90% (0.1566 => 0.1956, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 24.85% (0.1175 => 0.1467, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.83% (0.3121 => 0.3896, std.dev.: 0.0055) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.61% (0.1906 => 0.2375, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 24.59% (0.4620 => 0.5756, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.57% (1.4186 => 1.7671, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.31% (0.1337 => 0.1662, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.07% (0.1695 => 0.2103, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.99% (0.0842 => 0.1044, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 23.88% (0.6456 => 0.7998, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 23.73% (0.1555 => 0.1924, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.36% (0.0672 => 0.0829, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 23.19% (0.7115 => 0.8765, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/messages-2: 23.11% (0.0662 => 0.0815) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.96% (0.2700 => 0.3320, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 22.58% (0.0527 => 0.0646) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.57% (0.1236 => 0.1515, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.52% (0.0675 => 0.0827, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.23% (0.0886 => 0.1083, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.16% (0.1029 => 0.1257, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: 22.12% (0.0660 => 0.0806, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 21.93% (0.1163 => 0.1418, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 21.81% (0.7835 => 0.9544, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 21.79% (0.3098 => 0.3773, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.05% (1.3050 => 1.5797, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 21.03% (0.1151 => 0.1393, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.99% (0.0953 => 0.1153, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 20.95% (5.7591 => 6.9655, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.93% (0.1032 => 0.1248, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.46% (0.1940 => 0.2337, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.36% (4.9449 => 5.9518, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.31% (0.5860 => 0.7050, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.26% (0.8172 => 0.9828, std.dev.: 0.0016) MultiSource/Applications/lambda-0_1_3/lambda: 20.14% (0.7433 => 0.8930, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.09% (0.0871 => 0.1046, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.54% (0.1044 => 0.1248, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.47% (0.3307 => 0.3951, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 19.42% (3.3354 => 3.9833, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.40% (5.0018 => 5.9723, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.32% (0.0528 => 0.0630) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.20% (0.5020 => 0.5984, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.14% (0.2758 => 0.3286, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.82% (0.0834 => 0.0991, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.70% (0.0770 => 0.0914, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.48% (0.5569 => 0.6598, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.41% (0.1510 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.32% (0.9765 => 1.1554, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 18.29% (0.3423 => 0.4049, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 18.21% (3.8723 => 4.5775, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.13% (0.2107 => 0.2489, std.dev.: 0.0019) MultiSource/Applications/treecc/treecc: 18.10% (2.0273 => 2.3942, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.08% (0.1117 => 0.1319, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.01% (0.2065 => 0.2437, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 18.01% (1.1840 => 1.3972, std.dev.: 0.0086) MultiSource/Benchmarks/BitBench/five11/five11: 17.99% (0.0567 => 0.0669, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.96% (0.4203 => 0.4958, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 17.72% (2.2969 => 2.7038, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.69% (1.1861 => 1.3959, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.49% (0.5981 => 0.7027, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.38% (0.3441 => 0.4039, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 17.36% (0.3283 => 0.3853, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 17.36% (0.3232 => 0.3793, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.92% (0.8101 => 0.9472, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/ReedSolomon: 16.89% (0.2049 => 0.2395, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.43% (0.6450 => 0.7510, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/09-vor/vor: 16.26% (0.3180 => 0.3697, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 15.54% (0.3379 => 0.3904, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.8921 => 1.0297, std.dev.: 0.0035) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.36% (0.8067 => 0.9306, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.91% (0.0798 => 0.0917, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.70% (0.3865 => 0.4433, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.56% (0.4636 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.44% (0.2603 => 0.2979, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.44% (0.0838 => 0.0959, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 14.35% (0.2905 => 0.3322, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.4103 => 0.4689, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.63% (1.5603 => 1.7730, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 13.58% (0.3387 => 0.3847, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sieve: 12.93% (0.3603 => 0.4069, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.89% (0.3826 => 0.4319, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 12.82% (0.4048 => 0.4567, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 12.71% (0.3422 => 0.3857, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 12.58% (0.3282 => 0.3695, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 12.43% (0.3684 => 0.4142, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.22% (0.2430 => 0.2727, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/parameter-passing: 12.20% (0.3927 => 0.4406, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.05% (17.1811 => 19.2520, std.dev.: 0.0184) MultiSource/Benchmarks/Olden/bh/bh: 11.90% (0.3092 => 0.3460, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 11.66% (0.3886 => 0.4339, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.49% (0.4064 => 0.4531, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.29% (0.3427 => 0.3814, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.22% (0.1114 => 0.1239, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.11% (14.3668 => 15.9628, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/strcat: 10.95% (0.2831 => 0.3141, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.83% (0.2871 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.51% (0.3473 => 0.3838, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.47% (0.3543 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 10.36% (0.3561 => 0.3930, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.35% (0.3497 => 0.3859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.32% (0.3516 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.28% (2.0665 => 2.2789, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 10.08% (0.2877 => 0.3167, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 10.05% (1.2842 => 1.4133, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.05% (0.2756 => 0.3033, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.97% (0.1625 => 0.1787, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.84% (0.3650 => 0.4009, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.76% (0.2725 => 0.2991, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.74% (0.3162 => 0.3470, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.69% (0.3136 => 0.3440, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.67% (0.2793 => 0.3063, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hello: 9.58% (0.2714 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.55% (0.2891 => 0.3167, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.31% (0.3052 => 0.3336, std.dev.: 0.0070) SingleSource/UnitTests/ObjC++/property-reference-object: 9.29% (0.6030 => 0.6590, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.24% (0.2802 => 0.3061, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 9.10% (0.7326 => 0.7993, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.05% (0.3935 => 0.4291, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.00% (0.5925 => 0.6458, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.95% (63.2438 => 68.9017, std.dev.: 0.0220) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (2.2022 => 2.3784, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.70% (0.4879 => 0.5206, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.23% (0.3177 => 0.3375, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 5.83% (10.3673 => 10.9714, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.99% (0.2266 => 0.2379, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 4.69% (0.3131 => 0.3278, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.07% (0.3817 => 0.3934, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.60% (7.9617 => 8.1688, std.dev.: 0.0126) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4775, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 12.91% (0.5413 => 0.6112, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.26% (1.1396 => 1.2451, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.90% (0.2944 => 0.3147, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3860, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.23% (4.2280 => 4.4491, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1060, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.21% (0.9957 => 1.0277, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8956, std.dev.: 0.0259) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.36% (3.6395 => 3.7255, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bisort/bisort: 2.09% (0.8333 => 0.8507, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/minisat/minisat: 2.01% (9.1159 => 9.2994, std.dev.: 0.0177) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3026, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.13% (10.3460 => 10.4628, std.dev.: 0.0257) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5739, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1692, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.87% (5.2763 => 1.1675, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -74.97% (0.8651 => 0.2165, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.05% (5.3855 => 4.4673, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.48% (5.3526 => 4.4704, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -13.07% (10.4361 => 9.0725, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.79% (1.7609 => 1.6237, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 49.9981, std.dev.: 0.0157) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.88% (1.9577 => 0.6679, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0196, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/mandel: -33.50% (1.1492 => 0.7642, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4207, std.dev.: 0.0101) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8549, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0064, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0902, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -12.93% (3.1443 => 2.7376, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.95% (0.9540 => 0.8400, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4939, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.03% (1.8329 => 1.7040, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.79% (19.9488 => 18.5950, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/chomp: -6.35% (1.2373 => 1.1587, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6997, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8174, std.dev.: 0.0151) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0095) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.78% (3.7221 => 3.6557, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3301, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.38% (4.6441 => 4.5801, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -8.69% (0.1485 => 0.1356, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.39% (0.2116 => 0.0690, std.dev.: 0.0011) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 11:14:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 13:14:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126191456.A4FA52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7978?compare_to=7975&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7978, Order: 173582, Start Time: 2013-01-26 17:41:19, End Time: 2013-01-26 19:15:14 To: 7975, Order: 173572, Start Time: 2013-01-26 15:43:57, End Time: 2013-01-26 17:17:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.31% (80.0610 => 81.1081, std.dev.: 0.1415) SingleSource/Benchmarks/Misc/mandel-2: 1.21% (1.0227 => 1.0351, std.dev.: 0.0019) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.94% (0.0974 => 0.1626, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.08% (0.6395 => 0.8830, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.83% (0.5805 => 0.7711, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.65% (0.6260 => 0.8304, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.59% (0.5456 => 0.7234, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.13% (0.5849 => 0.7728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.06% (0.5567 => 0.7352, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.87% (0.5575 => 0.7352, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.75% (0.5581 => 0.7353, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.70% (0.6395 => 0.8422, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.67% (0.5941 => 0.7763, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.30% (0.6033 => 0.7861, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.26% (0.5859 => 0.7632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.44% (0.6440 => 0.8336, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.71% (0.6676 => 0.8593, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.69% (1.6474 => 2.1200, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.68% (0.6189 => 0.7964, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.05% (0.6304 => 0.8072, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.74% (0.6230 => 0.7958, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.83% (0.6660 => 0.8447, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.70% (0.5802 => 0.7351, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.42% (0.5705 => 0.7212, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.31% (0.5925 => 0.7484, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (0.5857 => 0.7372, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.84% (0.5569 => 0.7008, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.68% (0.5478 => 0.6885, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.64% (0.5570 => 0.6998, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.24% (0.5591 => 0.7002, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.32% (0.0699 => 0.0869, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.28% (0.7524 => 0.9351, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.22% (0.6446 => 0.8007, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.96% (0.5863 => 0.7268, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.91% (0.6052 => 0.7499, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.26% (0.6681 => 0.8235, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.04% (0.6194 => 0.7621, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.57% (0.6297 => 0.7718, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.41% (2.2587 => 2.7423, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.34% (0.6667 => 0.8090, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.80% (0.7339 => 0.8792, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.52% (0.3357 => 0.3878, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 14.87% (1.1450 => 1.3153, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.60% (4.5069 => 5.0748, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/05-eks/eks: 12.54% (0.4515 => 0.5081, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.54% (1.6364 => 1.8252, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.51% (3.5339 => 3.9408, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.25% (0.1982 => 0.2205, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.76% (9.2283 => 10.1291, std.dev.: 0.0092) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.35% (0.1230 => 0.1345, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.91% (0.4524 => 0.4927, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.70% (0.2001 => 0.2175, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.50% (1.2515 => 1.3579, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.94% (0.5329 => 0.5752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (0.4861 => 0.5236, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.45% (0.1731 => 0.1860, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.38% (1.4642 => 1.5723, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.38% (0.7021 => 0.7539, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.06% (1.2784 => 1.3687, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 6.51% (0.3255 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.88% (0.6750 => 0.7147, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.08% (5.4682 => 5.6914, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/ary3: 3.95% (0.3446 => 0.3582, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.77% (0.3394 => 0.3522, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.47% (5.0226 => 5.1967, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.22% (0.8418 => 0.8689, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3.01% (1.3864 => 1.4281, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.96% (0.4427 => 0.4558, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.40% (0.7447 => 0.7626, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.9557 => 0.9776, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.93% (0.5168 => 0.5268, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.92% (22.4056 => 22.8353, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 1.89% (15.5079 => 15.8014, std.dev.: 0.0161) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.86% (1.3722 => 1.3977, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8202, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.36% (0.9531 => 1.0328, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1644, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.48% (54.5751 => 56.4722, std.dev.: 0.1213) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.92% (2.0478 => 2.1075, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.75% (79.7170 => 81.1081, std.dev.: 0.1415) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2478, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2231 => 18.4979, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4567, std.dev.: 0.0228) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.38% (0.7198 => 0.6883, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.85% (2.4924 => 2.3965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.54% (0.3812 => 0.3677, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3880 => 0.3745, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.45% (0.3831 => 0.3699, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.43% (0.3848 => 0.3716, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3884 => 0.3751, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.37% (0.3142 => 0.3036, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.32% (0.4033 => 0.3899, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.29% (0.3891 => 0.3763, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.28% (0.3837 => 0.3711, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.28% (0.9852 => 0.9529, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/synchronized: -3.26% (0.3896 => 0.3769, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.18% (0.4176 => 0.4043, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2268, std.dev.: 0.0247) SingleSource/UnitTests/ObjC/property: -2.57% (0.4199 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.48% (0.9542 => 0.9305, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.38% (0.6484 => 0.6330, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: -2.27% (0.6347 => 0.6203, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.27% (1.3148 => 1.2850, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -2.03% (0.6441 => 0.6310, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.01% (14.2083 => 13.9221, std.dev.: 0.0137) MultiSource/Applications/sqlite3/sqlite3: -1.95% (17.1032 => 16.7690, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.93% (2.1713 => 2.1295, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference: -1.58% (0.7779 => 0.7656, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (6.7716 => 6.6741, std.dev.: 0.0097) MultiSource/Applications/JM/lencod/lencod: -1.29% (16.1920 => 15.9830, std.dev.: 0.0157) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.29% (0.7919 => 0.7817, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.23% (1.0544 => 1.0414, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.18% (1.2210 => 1.2066, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (7.0961 => 7.0142, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/gs/gs: -1.15% (4.3330 => 4.2833, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.09% (1.2221 => 1.2088, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.31% (1.8100 => 0.7003, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.13% (1.3643 => 1.0351, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0717, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1979, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1287, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3563, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3985, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (7.9763 => 7.7498, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout/ary3: -2.42% (3.7241 => 3.6338, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1193, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.86% (7.3040 => 7.1680, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.67% (1.6307 => 1.6034, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4720, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.34% (1.6219 => 1.6001, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.28% (1.6086 => 1.5880, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: -1.18% (3.7092 => 3.6654, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 11:32:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 13:32:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126193225.E3EE52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7979?compare_to=7974&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7979, Order: 173580, Start Time: 2013-01-26 17:29:16, End Time: 2013-01-26 19:32:45 To: 7974, Order: 173572, Start Time: 2013-01-26 15:06:07, End Time: 2013-01-26 17:09:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (87 on baseline) Performance Improvements: 0 (58 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1058 (918 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.11% (5.8155 => 6.1710, std.dev.: 0.1182) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.18% (0.2990 => 0.3145, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.27% (1.3825 => 1.4001, std.dev.: 0.0045) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.95% (4.5002 => 5.8481, std.dev.: 0.1409) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.05% (1.0737 => 1.1172, std.dev.: 0.0156) SingleSource/Benchmarks/BenchmarkGame/recursive: 1.62% (2.3971 => 2.4360, std.dev.: 0.0074) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.36% (1.2230 => 1.2186, std.dev.: 0.0754) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.35% (0.0223 => 0.0226, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0436 => 0.0435, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0340 => 0.0342, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0322 => 0.0322, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0434 => 0.0436, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0206 => 0.0208, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0222 => 0.0224, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 33.72% (0.0172 => 0.0230, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.73% (0.1510 => 0.1521, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: 3.29% (1.1387 => 1.1762, std.dev.: 0.1922) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.35% (0.4007 => 0.4061, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.85% (0.1418 => 0.1430, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.93% (0.0665 => 0.0579, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -27.88% (0.0269 => 0.0194, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.25% (0.0541 => 0.0564, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.15% (1.3168 => 1.3148, std.dev.: 0.0558) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.99% (0.0606 => 0.0612, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.98% (0.0353 => 0.0360, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.92% (1.6964 => 1.7629, std.dev.: 0.0061) SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.57% (0.0070 => 0.0076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.58% (33.2834 => 34.1411, std.dev.: 0.1657) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.21% (0.0336 => 0.1674, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 120.48% (0.0293 => 0.0646, std.dev.: 0.0020) SingleSource/Regression/C/sumarray2d: 92.34% (0.0274 => 0.0527, std.dev.: 0.0059) MultiSource/Benchmarks/FreeBench/neural/neural: 58.55% (0.1638 => 0.2597, std.dev.: 0.0058) SingleSource/Regression/C/sumarray: 53.21% (0.0265 => 0.0406, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.79% (0.8893 => 1.2609, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.64% (0.9612 => 1.3614, std.dev.: 0.1042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.58% (0.8926 => 1.2637, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.52% (0.9120 => 1.2907, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.89% (0.9564 => 1.3475, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.83% (0.9061 => 1.2761, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.03% (0.9381 => 1.3136, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.51% (0.9588 => 1.3376, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.91% (0.8990 => 1.2488, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.88% (0.9091 => 1.2626, std.dev.: 0.0674) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.79% (0.9855 => 1.3678, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 38.36% (1.0119 => 1.4001, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.19% (0.9998 => 1.3816, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.12% (0.9422 => 1.3014, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.62% (0.9403 => 1.2940, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.24% (0.9010 => 1.2365, std.dev.: 0.0352) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.82% (0.9512 => 1.3014, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.95% (0.8912 => 1.2116, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.87% (0.8736 => 1.1870, std.dev.: 0.0781) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.68% (1.0867 => 1.4744, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.22% (1.0052 => 1.3592, std.dev.: 0.0409) SingleSource/Benchmarks/Stanford/IntMM: 35.03% (0.0431 => 0.0582, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.79% (0.8732 => 1.1770, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.20% (0.8846 => 1.1871, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.02% (0.9867 => 1.3125, std.dev.: 0.0898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.91% (0.9788 => 1.2911, std.dev.: 0.0161) SingleSource/Benchmarks/McGill/exptree: 31.90% (0.0859 => 0.1133, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.67% (0.9488 => 1.2493, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.61% (1.0088 => 1.3277, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.33% (0.9685 => 1.2719, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.03% (0.9405 => 1.2323, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.95% (0.9993 => 1.2986, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.92% (0.9550 => 1.2312, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.06% (1.0860 => 1.3907, std.dev.: 0.0323) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 23.48% (0.0805 => 0.0994, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.97% (0.0738 => 0.0878, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 18.01% (0.3598 => 0.4246, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.55% (1.0986 => 1.2585, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.35% (0.1240 => 0.1418, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.14% (3.6295 => 4.1426, std.dev.: 0.1674) MultiSource/Benchmarks/mafft/pairlocalalign: 12.84% (9.5202 => 10.7425, std.dev.: 0.0646) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.45% (0.4596 => 0.5168, std.dev.: 0.0071) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.86% (0.1332 => 0.1490, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 11.57% (0.2385 => 0.2661, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 11.22% (0.2050 => 0.2280, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.72% (0.5369 => 0.5891, std.dev.: 0.0164) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.56% (1.4110 => 1.5459, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.36% (0.1955 => 0.2138, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1793 => 0.1951, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.2879 => 0.3080, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107175.00% (0.0008 => 0.8582, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/matrix: 356.95% (1.5825 => 7.2312, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/ary3: 341.19% (2.2304 => 9.8402, std.dev.: 1.7678) MultiSource/Applications/sgefa/sgefa: 259.17% (0.3515 => 1.2625, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.97% (1.1825 => 4.0675, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.90% (4.8185 => 15.8962, std.dev.: 0.2353) SingleSource/Benchmarks/Shootout-C++/ary2: 202.33% (0.0129 => 0.0390, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 197.37% (0.0228 => 0.0678, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary: 149.14% (0.0232 => 0.0578, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 63.84% (2.9083 => 4.7650, std.dev.: 0.0516) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.36% (0.2562 => 0.3391, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.48% (3.1254 => 4.1094, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.32% (1.4588 => 1.8574, std.dev.: 0.0125) SingleSource/Regression/C/uint64_to_float: 22.41% (1.5397 => 1.8848, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/salsa20: 21.92% (7.4497 => 9.0824, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.45% (4.8112 => 5.7949, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.42% (5.6033 => 6.6355, std.dev.: 0.2750) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.99% (5.0421 => 5.8481, std.dev.: 0.1409) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.18% (5.1752 => 5.8574, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 13.13% (6.8159 => 7.7106, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.80% (5.0033 => 5.6435, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.94% (3.6477 => 3.9737, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.92% (0.6211 => 0.6765, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.97% (4.7473 => 5.0782, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.94% (4.1836 => 4.4320, std.dev.: 0.0388) SingleSource/Benchmarks/McGill/chomp: 5.41% (1.0425 => 1.0989, std.dev.: 0.0150) SingleSource/Benchmarks/Linpack/linpack-pc: 4.59% (50.8945 => 53.2328, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.17% (5.0310 => 5.2406, std.dev.: 0.0243) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.84% (9.0082 => 9.3544, std.dev.: 0.1323) SingleSource/Benchmarks/Misc/pi: 3.82% (2.1390 => 2.2207, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.16% (4.7254 => 4.8745, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.18% (4.8076 => 4.8643, std.dev.: 0.0159) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.86% (0.0808 => 0.0494, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.46% (0.0692 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -26.85% (0.1888 => 0.1381, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.74% (0.1079 => 0.0920, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -11.39% (0.1378 => 0.1221, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.22% (0.1366 => 0.1240, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -9.07% (1.1433 => 1.0396, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/hash2: -7.97% (0.5134 => 0.4725, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash: -6.10% (0.4689 => 0.4403, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hello: -5.24% (0.1928 => 0.1827, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.10% (1.0234 => 0.9712, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.85% (11.5523 => 3.9455, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/fp-convert: -62.11% (15.6525 => 5.9307, std.dev.: 0.1334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.17% (0.4146 => 0.1817, std.dev.: 0.0139) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.38% (0.4578 => 0.2363, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.94% (11.3868 => 6.3829, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.96% (5.4023 => 3.6219, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.02% (0.4452 => 0.3071, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bisort/bisort: -30.38% (0.9372 => 0.6525, std.dev.: 0.0949) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.18% (5.2605 => 3.8834, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.51% (0.5495 => 0.4093, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.11% (4.4467 => 3.3303, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.89% (0.5826 => 0.4376, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.61% (0.5897 => 0.4446, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8231, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7925, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.14% (16.6791 => 13.6527, std.dev.: 0.4544) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.00% (1.5623 => 1.2811, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.86% (7.0016 => 5.8210, std.dev.: 0.2389) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.10% (3.1921 => 2.7739, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6749, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.49% (9.7992 => 8.5752, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9942, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.10% (1.4235 => 1.2655, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.56% (0.4081 => 0.3650, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/lists1: -9.44% (0.6628 => 0.6002, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.36% (0.3217 => 0.2948, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.58% (4.2843 => 3.9596, std.dev.: 0.1005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.57% (5.5974 => 5.2299, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.46% (4.9799 => 4.6580, std.dev.: 0.0693) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.37% (4.5424 => 4.2532, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: -5.68% (1.7443 => 1.6453, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (3.6768 => 3.4986, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.45% (3.5127 => 3.3565, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4363, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (5.8973 => 5.6821, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: -3.22% (3.5443 => 3.4302, std.dev.: 0.0357) SingleSource/Benchmarks/Shootout-C++/lists: -2.64% (17.2182 => 16.7644, std.dev.: 0.0371) MultiSource/Applications/spiff/spiff: -2.30% (2.8571 => 2.7915, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5783, std.dev.: 0.0050) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.68% (85.3042 => 83.8721, std.dev.: 0.0801) SingleSource/Benchmarks/Misc/whetstone: -1.65% (1.6251 => 1.5983, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.61% (3.5669 => 3.5093, std.dev.: 0.0148) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.61% (8.8249 => 8.6825, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.15% (6.8262 => 6.7480, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7024, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.03% (6.6336 => 6.5652, std.dev.: 0.0187) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.15% (1.2047 => 1.2186, std.dev.: 0.0754) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.00% (0.0233 => 0.0226, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.20% (0.0394 => 0.0342, std.dev.: 0.0064) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.02% (0.0445 => 0.0436, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.59% (0.1530 => 0.1521, std.dev.: 0.0244) MultiSource/Applications/lemon/lemon: -39.03% (1.9293 => 1.1762, std.dev.: 0.1922) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.30% (0.4049 => 0.4061, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.30% (0.1510 => 0.1430, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.80% (0.0978 => 0.0579, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -29.71% (0.0276 => 0.0194, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.41% (0.0590 => 0.0564, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.18% (1.1617 => 1.3148, std.dev.: 0.0558) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.33% (0.0268 => 0.0360, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.04% (0.7437 => 1.7629, std.dev.: 0.0061) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.18% (12.7781 => 34.1411, std.dev.: 0.1657) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 13:12:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 15:12:42 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126211242.0C8A92A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7980?compare_to=7978&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7980, Order: 173585, Start Time: 2013-01-26 19:38:53, End Time: 2013-01-26 21:12:59 To: 7978, Order: 173582, Start Time: 2013-01-26 17:41:19, End Time: 2013-01-26 19:15:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (92 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.04% (0.0974 => 0.1627, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 45.67% (0.1500 => 0.2185, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.22% (0.6395 => 0.8839, std.dev.: 0.0045) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.82% (0.5688 => 0.7555, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.65% (0.6260 => 0.8304, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.55% (0.5456 => 0.7232, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.04% (0.5849 => 0.7723, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.03% (0.5567 => 0.7350, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.91% (0.5575 => 0.7354, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.89% (0.5581 => 0.7361, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.71% (0.6395 => 0.8423, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.63% (0.5941 => 0.7761, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.24% (0.5859 => 0.7631, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.53% (0.6440 => 0.8342, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.83% (1.6474 => 2.1223, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.73% (0.6676 => 0.8594, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.71% (0.6189 => 0.7966, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.05% (0.6304 => 0.8072, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.64% (0.6230 => 0.7952, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.91% (0.6660 => 0.8452, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.70% (0.5802 => 0.7351, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.43% (0.5705 => 0.7213, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.26% (0.5925 => 0.7481, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.83% (0.5857 => 0.7370, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.76% (0.5570 => 0.7005, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.50% (0.5478 => 0.6875, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.31% (0.5591 => 0.7006, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.34% (0.7524 => 0.9355, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.09% (0.6446 => 0.7999, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.95% (0.5863 => 0.7267, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.78% (0.6052 => 0.7491, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.33% (0.6681 => 0.8240, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.86% (0.6194 => 0.7610, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.55% (0.6297 => 0.7717, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.47% (2.2587 => 2.7437, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.43% (0.6667 => 0.8096, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.68% (0.7339 => 0.8783, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 15.52% (0.3357 => 0.3878, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 14.93% (1.1450 => 1.3159, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.69% (4.5069 => 5.0790, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 12.49% (0.4515 => 0.5079, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.33% (0.4916 => 0.5522, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.60% (3.5339 => 3.9440, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.50% (1.6364 => 1.8246, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.30% (0.1982 => 0.2206, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.52% (0.2385 => 0.2636, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 9.84% (9.2283 => 10.1363, std.dev.: 0.0127) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.43% (0.1230 => 0.1346, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 9.04% (0.4524 => 0.4933, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.53% (1.2515 => 1.3583, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash2: 7.80% (0.4861 => 0.5240, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.52% (0.7021 => 0.7549, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.49% (1.4642 => 1.5739, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.39% (0.1731 => 0.1859, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.24% (1.2784 => 1.3709, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/matrix: 6.57% (0.3255 => 0.3469, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6750 => 0.7148, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.75% (0.1879 => 0.1987, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.48% (0.3319 => 0.3501, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 4.12% (0.3446 => 0.3588, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.03% (5.4682 => 5.6888, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.80% (0.3394 => 0.3523, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.47% (5.0226 => 5.1969, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.21% (0.8418 => 0.8688, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 3.17% (1.3864 => 1.4304, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.82% (0.4427 => 0.4552, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.9557 => 0.9788, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: 2.31% (0.7447 => 0.7619, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5168 => 0.5275, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 2.00% (15.5079 => 15.8184, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.94% (1.3722 => 1.3988, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.88% (22.4056 => 22.8268, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2300 => 1.2425, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8051, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.51% (0.9531 => 1.0247, std.dev.: 0.0040) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1651, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5046, std.dev.: 0.1529) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0092) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.69% (18.2231 => 18.5319, std.dev.: 0.0160) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2464, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2690, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.46% (0.7198 => 0.6877, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.89% (2.4924 => 2.3954, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/trivial-interface: -3.54% (0.3812 => 0.3677, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3880 => 0.3748, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.40% (0.3884 => 0.3752, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3831 => 0.3701, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-3: -3.38% (0.3848 => 0.3718, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.37% (0.3142 => 0.3036, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.37% (0.4033 => 0.3897, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.37% (0.9852 => 0.9520, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.36% (0.3896 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.34% (0.3891 => 0.3761, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.18% (0.3837 => 0.3715, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.14% (0.4176 => 0.4045, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.67% (20.7746 => 20.2205, std.dev.: 0.0250) SingleSource/UnitTests/ObjC/property: -2.57% (0.4199 => 0.4091, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.45% (0.9542 => 0.9308, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.34% (0.6484 => 0.6332, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/Hello: -2.16% (0.6347 => 0.6210, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.03% (2.1713 => 2.1272, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -2.02% (1.3148 => 1.2883, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.96% (0.6441 => 0.6315, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.94% (14.2083 => 13.9325, std.dev.: 0.0091) MultiSource/Applications/sqlite3/sqlite3: -1.93% (17.1032 => 16.7727, std.dev.: 0.0219) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.36% (6.7716 => 6.6797, std.dev.: 0.0083) SingleSource/UnitTests/ObjC++/property-reference: -1.32% (0.7779 => 0.7676, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: -1.32% (16.1920 => 15.9790, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.16% (1.0544 => 1.0422, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -1.16% (4.3330 => 4.2829, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.15% (1.2221 => 1.2080, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.09% (1.2210 => 1.2077, std.dev.: 0.0032) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.33% (1.8100 => 0.6819, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.33% (1.3643 => 1.0323, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7508, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0823, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1972, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1293, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.38% (4.9100 => 4.3513, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.77% (0.9021 => 0.8410, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3982, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.72% (7.9763 => 7.7591, std.dev.: 0.0216) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.22% (3.7241 => 3.6414, std.dev.: 0.0163) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1746, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4734, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.39% (1.6219 => 1.5994, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.08% (1.6307 => 1.6131, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 13:14:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 15:14:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126211441.A6C182A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7981?compare_to=7977&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7981, Order: 173584, Start Time: 2013-01-26 19:03:37, End Time: 2013-01-26 21:14:59 To: 7977, Order: 173577, Start Time: 2013-01-26 16:22:02, End Time: 2013-01-26 18:33:17 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (223 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -1.92% (0.1356 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0690 => 0.0690, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8559 => 499.8354, std.dev.: 0.0178) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.44% (1.1277 => 499.8354, std.dev.: 0.0178) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.80% (0.5229 => 1.6513, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 21.13% (14.9895 => 18.1573, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 45.50% (14.1553 => 20.5966, std.dev.: 0.0104) MultiSource/Benchmarks/MallocBench/gs/gs: 18.97% (4.1105 => 4.8902, std.dev.: 0.0049) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.76% (1.1048 => 1.7319, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.77% (7.1582 => 37.5642, std.dev.: 0.0202) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.96% (3.4629 => 6.4742, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.15% (0.6222 => 1.0960, std.dev.: 0.0002) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.97% (0.0720 => 7.4419, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11158800.00% (0.0001 => 11.1589, std.dev.: 0.0445) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849200.00% (0.0001 => 9.8493, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495700.00% (0.0001 => 5.4958, std.dev.: 0.0011) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 827.45% (1.1194 => 10.3819, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 148.70% (22.1758 => 55.1508, std.dev.: 0.0330) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.42% (0.0929 => 0.1834, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 64.66% (0.0730 => 0.1202, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.94% (2.9384 => 4.6115, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.53% (7.0540 => 10.9004, std.dev.: 0.0034) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.00% (1.5859 => 2.4106, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.89% (8.1363 => 11.9513, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.35% (2.2024 => 3.1352, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 39.95% (0.3109 => 0.4351, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.99% (21.9371 => 30.4909, std.dev.: 0.0238) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0002) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.85% (0.1062 => 0.1464, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.72% (4.2646 => 5.7025, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.90% (1.5415 => 2.0486, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.85% (0.4615 => 0.6131, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.97% (0.1143 => 0.1497, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.65% (0.2271 => 0.2967, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 30.18% (1.1642 => 1.5155, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 29.87% (0.4299 => 0.5583, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 28.93% (0.0719 => 0.0927, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.27% (0.5105 => 0.6548, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.49% (0.6675 => 0.8510, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.43% (0.1892 => 0.2411, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.08% (0.1584 => 0.2013, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.99% (0.0730 => 0.0927, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946) MultiSource/Benchmarks/McCat/08-main/main: 26.66% (0.2554 => 0.3235, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 26.44% (9.4845 => 11.9921, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.13% (3.8922 => 4.9091, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 25.04% (0.4289 => 0.5363, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.97% (0.1566 => 0.1957, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 24.81% (1.0722 => 1.3382, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.80% (0.3121 => 0.3895, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.55% (0.1906 => 0.2374, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.53% (0.1337 => 0.1665, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.50% (1.4186 => 1.7661, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.31% (0.1695 => 0.2107, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 24.20% (0.4620 => 0.5738, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 23.73% (0.6456 => 0.7988, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.66% (0.0672 => 0.0831, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 23.30% (0.7115 => 0.8773, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 22.96% (0.0662 => 0.0814, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.63% (0.2700 => 0.3311, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/15-trie/trie: 22.58% (0.0527 => 0.0646, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.57% (0.1236 => 0.1515, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.38% (0.1555 => 0.1903, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765) SingleSource/Benchmarks/Misc/whetstone: 22.12% (0.0660 => 0.0806, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.07% (0.0675 => 0.0824, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (0.3098 => 0.3775, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.38% (0.0842 => 0.1022, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 21.29% (0.1151 => 0.1396, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.14% (0.7835 => 0.9491, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 21.06% (5.7591 => 6.9717, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.00% (1.3050 => 1.5791, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.83% (0.1032 => 0.1247, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 20.72% (0.1163 => 0.1404, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 20.71% (0.1695 => 0.2046, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.67% (0.0953 => 0.1150, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 20.52% (0.0614 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.33% (0.8172 => 0.9833, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.31% (0.1940 => 0.2334, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.15% (0.5860 => 0.7041, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.03% (4.9449 => 5.9355, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.66% (0.0834 => 0.0998, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.66% (0.3307 => 0.3957, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.64% (0.0886 => 0.1060, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 19.32% (3.3354 => 3.9797, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.19% (5.0018 => 5.9618, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.13% (0.0528 => 0.0629, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.12% (0.5020 => 0.5980, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 19.12% (0.7433 => 0.8854, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.78% (0.2758 => 0.3276, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.38% (0.9765 => 1.1560, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.26% (0.5569 => 0.6586, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 18.17% (0.0567 => 0.0670, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.08% (0.2107 => 0.2488, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 18.08% (3.8723 => 4.5723, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.06% (0.4203 => 0.4962, std.dev.: 0.0023) MultiSource/Benchmarks/nbench/nbench: 18.02% (1.1840 => 1.3973, std.dev.: 0.0103) MultiSource/Applications/treecc/treecc: 17.99% (2.0273 => 2.3920, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/18-imp/imp: 17.94% (0.3423 => 0.4037, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.91% (0.1117 => 0.1317, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 17.66% (2.2969 => 2.7025, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.62% (0.1044 => 0.1228, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.58% (0.2065 => 0.2428, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.54% (1.1861 => 1.3941, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.41% (0.5981 => 0.7022, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.32% (0.3441 => 0.4037, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.27% (0.0770 => 0.0903, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 17.08% (0.2049 => 0.2399, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 17.03% (0.3283 => 0.3842, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.84% (0.8101 => 0.9465, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 16.62% (0.3232 => 0.3769, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.29% (0.6450 => 0.7501, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 16.04% (0.3180 => 0.3690, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 15.73% (0.1144 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.45% (0.3865 => 0.4462, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 15.42% (0.8921 => 1.0297, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 15.42% (0.3379 => 0.3900, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.19% (0.8067 => 0.9292, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.56% (0.2603 => 0.2982, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0025) SingleSource/Regression/C++/ofstream_ctor: 14.22% (0.2905 => 0.3318, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.11% (0.4636 => 0.5290, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.72% (0.4103 => 0.4666, std.dev.: 0.0039) MultiSource/Benchmarks/sim/sim: 13.40% (0.3387 => 0.3841, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 13.09% (1.5603 => 1.7645, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 12.97% (0.4048 => 0.4573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.91% (0.3603 => 0.4068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.51% (0.3422 => 0.3850, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 12.49% (0.3282 => 0.3692, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.24% (0.3684 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.22% (0.2430 => 0.2727, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 12.08% (17.1811 => 19.2562, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.84% (0.3826 => 0.4279, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/parameter-passing: 11.82% (0.3927 => 0.4391, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.67% (0.1114 => 0.1244, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 11.64% (0.3092 => 0.3452, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.37% (0.4064 => 0.4526, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 11.32% (0.3886 => 0.4326, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.15% (0.3427 => 0.3809, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.83% (14.3668 => 15.9228, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/except: 10.76% (0.2871 => 0.3180, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2831 => 0.3131, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.58% (0.3828 => 0.4233, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.99% (0.3543 => 0.3897, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.99% (0.3473 => 0.3820, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 9.99% (0.3694 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.94% (0.3543 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 9.91% (0.3561 => 0.3914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.87% (0.2877 => 0.3161, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.84% (0.3516 => 0.3862, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.80% (2.0665 => 2.2690, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 9.78% (0.3497 => 0.3839, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.59% (1.2842 => 1.4074, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: 9.58% (0.2725 => 0.2986, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3162 => 0.3461, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.42% (0.2793 => 0.3056, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.40% (0.3650 => 0.3993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.37% (0.2891 => 0.3162, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.36% (0.2756 => 0.3014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.27% (0.3052 => 0.3335, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.23% (0.2872 => 0.3137, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.95% (0.3935 => 0.4287, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.92% (0.2802 => 0.3052, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: 8.81% (0.6030 => 0.6561, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.71% (0.3136 => 0.3409, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 8.61% (63.2438 => 68.6918, std.dev.: 0.3398) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7326 => 0.7954, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/Hello: 8.42% (0.5925 => 0.6424, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.98% (2.2022 => 2.3779, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.20% (0.1625 => 0.1742, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 6.83% (10.3673 => 11.0757, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.60% (0.4879 => 0.5201, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.07% (0.3177 => 0.3370, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.54% (0.3131 => 0.3273, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.67% (0.3817 => 0.3919, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (7.9617 => 8.1594, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4746, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3862, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4430, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3115, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1067, std.dev.: 0.0126) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9060, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7219, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2197, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2716, std.dev.: 0.0161) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3045, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.30% (10.3460 => 10.4801, std.dev.: 0.0257) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1689, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.83% (5.2763 => 1.1698, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.22% (0.8651 => 0.2144, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -42.85% (0.1622 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.29% (5.3855 => 4.4542, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.78% (5.3526 => 4.4545, std.dev.: 0.0077) MultiSource/Applications/JM/ldecod/ldecod: -13.23% (10.4361 => 9.0558, std.dev.: 0.0104) SingleSource/UnitTests/Vector/constpool: -7.88% (54.1659 => 49.8969, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.86% (1.7609 => 1.6225, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.10% (1.9577 => 0.6637, std.dev.: 0.0101) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3061, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.54% (1.5373 => 1.0217, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.72% (10.7105 => 7.4200, std.dev.: 0.1077) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8510, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0919, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -20.27% (0.2161 => 0.1723, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0017) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -15.75% (1.6925 => 1.4260, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.87% (0.9540 => 0.8408, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4921, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9124, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.89% (4.8142 => 4.4823, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5815, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -5.86% (1.2373 => 1.1648, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7050, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5088, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.58% (10.2830 => 9.8123, std.dev.: 0.0115) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3296, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/ary3: -1.38% (3.6994 => 3.6482, std.dev.: 0.0056) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.6441 => 4.5813, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: -1.23% (6.2999 => 6.2225, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0048) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.39% (0.2116 => 0.0690, std.dev.: 0.0008) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 13:50:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 15:50:54 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130126215054.14BC32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7982?compare_to=7979&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7982, Order: 173585, Start Time: 2013-01-26 19:50:13, End Time: 2013-01-26 21:51:13 To: 7979, Order: 173580, Start Time: 2013-01-26 17:29:16, End Time: 2013-01-26 19:32:45 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (107 on baseline) Performance Improvements: 13 (121 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (835 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.81% (0.6397 => 0.6513, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.71% (0.5891 => 0.5992, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.50% (1.3504 => 1.3706, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 12.16% (0.7722 => 0.8661, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.85% (5.8210 => 6.1033, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.88% (4.2232 => 4.3024, std.dev.: 0.0273) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -9.28% (0.1498 => 0.1359, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.21% (6.1710 => 5.7879, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.18% (0.3145 => 0.2982, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: -4.02% (0.7213 => 0.6923, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.69% (0.9712 => 0.9451, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: -1.65% (0.7892 => 0.7762, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -23.24% (5.8481 => 4.4892, std.dev.: 0.0436) SingleSource/Benchmarks/Shootout/nestedloop: -6.89% (0.2075 => 0.1932, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.77% (44.7436 => 43.0550, std.dev.: 0.3853) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.63% (1.1172 => 1.0766, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.11% (2.8017 => 2.7145, std.dev.: 0.0245) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.85% (0.3612 => 0.3509, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -1.26% (7.2312 => 7.1398, std.dev.: 0.0317) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.34% (1.2186 => 1.2144, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.58% (0.0226 => 0.0184, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0435 => 0.0436, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.58% (0.0342 => 0.0344, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.24% (0.0322 => 0.0326, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0436 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: 1.34% (0.0224 => 0.0227, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0230 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.59% (0.1521 => 0.1512, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: -1.50% (1.1762 => 1.1585, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.81% (0.4061 => 0.4028, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.28% (0.1430 => 0.1434, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.70% (0.0579 => 0.0612, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.27% (0.0194 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.60% (0.0564 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.3148 => 1.3155, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.58% (0.0612 => 0.0584, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.83% (0.0360 => 0.0363, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.13% (1.7629 => 1.7429, std.dev.: 0.0126) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 10.53% (0.0076 => 0.0084, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.77% (34.1411 => 34.4029, std.dev.: 0.3389) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 376.49% (0.0336 => 0.1601, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 110.58% (0.0293 => 0.0617, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 90.88% (0.0274 => 0.0523, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 60.07% (0.1638 => 0.2622, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 58.49% (0.0265 => 0.0420, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.69% (0.8893 => 1.2689, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.50% (0.9120 => 1.2905, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.47% (0.8990 => 1.2718, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.41% (0.8926 => 1.2622, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.21% (0.9061 => 1.2795, std.dev.: 0.0488) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.65% (0.9612 => 1.3519, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.52% (0.9381 => 1.3182, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.18% (0.9855 => 1.3815, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.03% (0.9564 => 1.3392, std.dev.: 0.0462) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.97% (0.9091 => 1.2725, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.90% (0.9588 => 1.3414, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.72% (0.9422 => 1.3070, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.16% (0.9403 => 1.2991, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.97% (1.0119 => 1.3961, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.77% (0.9998 => 1.3774, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.58% (0.9512 => 1.3087, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.37% (0.9010 => 1.2377, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.42% (0.8912 => 1.2158, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/IntMM: 36.19% (0.0431 => 0.0587, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.10% (0.8736 => 1.1890, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.00% (1.0052 => 1.3671, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.41% (1.0867 => 1.4715, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.50% (0.8846 => 1.1898, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/exptree: 34.46% (0.0859 => 0.1155, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.10% (0.8732 => 1.1710, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.35% (0.9867 => 1.3158, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.91% (1.0017 => 1.3314, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.44% (0.9507 => 1.2591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.99% (0.9488 => 1.2523, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.64% (0.9788 => 1.2885, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.74% (1.0088 => 1.3189, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.54% (0.9685 => 1.2643, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.93% (0.9405 => 1.2220, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.83% (0.9127 => 1.1850, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.76% (0.9993 => 1.2967, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.38% (0.9550 => 1.2260, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.54% (1.0860 => 1.3742, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0738 => 0.0897, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.24% (0.0738 => 0.0880, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 18.18% (0.3598 => 0.4252, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.0963 => 0.1137, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.19% (0.0669 => 0.0784, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.13% (1.0986 => 1.2538, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.03% (0.1240 => 0.1414, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.91% (0.0805 => 0.0917, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.68% (3.6295 => 4.1261, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.36% (0.1332 => 0.1510, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.77% (0.0783 => 0.0883, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 12.74% (9.5202 => 10.7333, std.dev.: 0.2693) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.60% (0.5369 => 0.5992, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: 10.90% (0.2385 => 0.2645, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/ReedSolomon: 10.83% (0.2050 => 0.2272, std.dev.: 0.0004) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.44% (0.4596 => 0.5076, std.dev.: 0.0149) SingleSource/Benchmarks/McGill/chomp: 10.37% (0.1793 => 0.1979, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.06% (1.4110 => 1.5529, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.31% (0.1955 => 0.2137, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.89% (0.2577 => 0.2806, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.46% (5.0381 => 5.4645, std.dev.: 0.0849) SingleSource/Benchmarks/Linpack/linpack-pc: 8.14% (0.2566 => 0.2775, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.74% (1.8651 => 2.0094, std.dev.: 0.0167) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.47% (0.2879 => 0.3094, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.45% (2.4519 => 2.5856, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.19% (0.2372 => 0.2495, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.80% (1.8127 => 1.8815, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 3.39% (5.3553 => 5.5370, std.dev.: 0.0383) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.6711 => 0.6923, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.65% (0.7693 => 0.7820, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106787.50% (0.0008 => 0.8551, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 351.17% (1.5825 => 7.1398, std.dev.: 0.0317) SingleSource/Benchmarks/Shootout/ary3: 285.67% (2.2304 => 8.6020, std.dev.: 1.3456) MultiSource/Applications/sgefa/sgefa: 258.49% (0.3515 => 1.2601, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.37% (1.1825 => 4.0722, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.30% (4.8185 => 15.8673, std.dev.: 0.0560) SingleSource/Benchmarks/Shootout-C++/ary2: 202.33% (0.0129 => 0.0390, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 188.16% (0.0228 => 0.0657, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 142.24% (0.0232 => 0.0562, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 62.41% (2.9083 => 4.7233, std.dev.: 0.1242) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.68% (0.2562 => 0.3425, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.63% (3.1254 => 4.1140, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 29.20% (1.4588 => 1.8847, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.40% (5.6033 => 6.9143, std.dev.: 0.1225) SingleSource/Regression/C/uint64_to_float: 22.57% (1.5397 => 1.8872, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/salsa20: 21.93% (7.4497 => 9.0835, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.17% (4.8112 => 5.7817, std.dev.: 0.0178) MultiSource/Applications/JM/lencod/lencod: 13.19% (6.8159 => 7.7148, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8567, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.96% (5.0033 => 5.6518, std.dev.: 0.0253) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.81% (3.6477 => 3.9691, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.66% (0.6211 => 0.6749, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/ReedSolomon: 8.13% (8.6447 => 9.3476, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.98% (4.7473 => 5.0786, std.dev.: 0.0028) MultiSource/Benchmarks/nbench/nbench: 6.70% (20.5117 => 21.8862, std.dev.: 0.4812) SingleSource/Benchmarks/McGill/chomp: 5.66% (1.0425 => 1.1015, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.58% (3.7074 => 3.9144, std.dev.: 0.0529) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (4.1836 => 4.4058, std.dev.: 0.0045) SingleSource/Benchmarks/Linpack/linpack-pc: 4.56% (50.8945 => 53.2173, std.dev.: 0.1024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.06% (5.0310 => 5.2352, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/pi: 3.52% (2.1390 => 2.2142, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.25% (4.1668 => 4.3024, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.22% (4.7254 => 4.8775, std.dev.: 0.0105) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (2.5681 => 2.5986, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.16% (4.8076 => 4.8636, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.37% (0.0808 => 0.0498, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.09% (0.0727 => 0.0501, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.48% (0.0692 => 0.0488, std.dev.: 0.0007) SingleSource/Benchmarks/SmallPT/smallpt: -26.06% (0.1888 => 0.1396, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.89% (0.1009 => 0.0778, std.dev.: 0.0021) MultiSource/Applications/hbd/hbd: -18.77% (1.8964 => 1.5405, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.64% (0.0676 => 0.0550, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.58% (0.1684 => 0.1388, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.10% (1.0960 => 0.9305, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.99% (0.1079 => 0.0928, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.87% (0.7686 => 0.6620, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.65% (0.0862 => 0.0753, std.dev.: 0.0017) MultiSource/Applications/aha/aha: -12.19% (0.1378 => 0.1210, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: -11.94% (1.0220 => 0.9000, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops: -10.46% (0.1109 => 0.0993, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: -10.40% (1.5979 => 1.4317, std.dev.: 0.0068) MultiSource/Applications/hexxagon/hexxagon: -10.15% (1.1433 => 1.0272, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: -10.08% (2.4719 => 2.2227, std.dev.: 0.0194) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.89% (6.4235 => 5.7879, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.37% (0.1366 => 0.1238, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.30% (0.4074 => 0.3695, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.51% (0.7693 => 0.7038, std.dev.: 0.0048) MultiSource/Applications/lua/lua: -8.40% (4.6406 => 4.2508, std.dev.: 0.0164) MultiSource/Applications/siod/siod: -7.67% (2.6437 => 2.4410, std.dev.: 0.0181) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.65% (1.0234 => 0.9451, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: -7.52% (17.5634 => 16.2432, std.dev.: 0.1569) MultiSource/Applications/lambda-0_1_3/lambda: -7.45% (0.8653 => 0.8008, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -6.85% (0.4689 => 0.4368, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.83% (0.9124 => 0.8501, std.dev.: 0.0111) MultiSource/Applications/lemon/lemon: -6.75% (1.3979 => 1.3035, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/health/health: -6.71% (0.1610 => 0.1502, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.66% (10.2703 => 9.5867, std.dev.: 0.1286) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.50% (1.2154 => 1.1364, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -6.48% (17.4365 => 16.3067, std.dev.: 0.0706) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.40% (0.2283 => 0.2137, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.25% (0.2481 => 0.2326, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.12% (0.3560 => 0.3342, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.08% (0.9588 => 0.9005, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -5.50% (1.1498 => 1.0866, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.40% (0.6885 => 0.6513, std.dev.: 0.0019) MultiSource/Applications/d/make_dparser: -5.39% (3.7840 => 3.5801, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.43% (0.2709 => 0.2589, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.10% (0.3462 => 0.3320, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.63% (0.3665 => 0.3532, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.59% (0.3093 => 0.2982, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: -3.28% (0.3715 => 0.3593, std.dev.: 0.0029) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.12% (1.1731 => 1.1365, std.dev.: 0.0037) MultiSource/Applications/kimwitu++/kc: -2.43% (18.9377 => 18.4782, std.dev.: 0.0922) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.57% (1.3924 => 1.3706, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.55% (14.9757 => 14.7434, std.dev.: 0.0785) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.81% (11.5523 => 3.9502, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/fp-convert: -61.81% (15.6525 => 5.9779, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.32% (0.4146 => 0.1811, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.17% (0.4578 => 0.2373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3749, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.88% (5.4023 => 3.6258, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: -30.84% (0.9372 => 0.6482, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.62% (0.4452 => 0.3089, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/heapsort: -29.36% (4.4739 => 3.1604, std.dev.: 0.2427) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.25% (5.2605 => 3.8794, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.17% (0.5495 => 0.4057, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.05% (4.4467 => 3.3326, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.55% (0.5897 => 0.4449, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.41% (0.5826 => 0.4404, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: -22.81% (7.9891 => 6.1667, std.dev.: 0.0715) SingleSource/Benchmarks/Shootout-C++/ary3: -22.61% (1.8123 => 1.4026, std.dev.: 0.0260) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.92% (1.0816 => 0.8661, std.dev.: 0.0241) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.67% (0.1164 => 0.0935, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.07% (1.5623 => 1.2644, std.dev.: 0.0697) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.54% (5.8755 => 4.7862, std.dev.: 0.0152) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.26% (16.6791 => 13.6340, std.dev.: 0.3218) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.97% (3.1921 => 2.7781, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.83% (7.0016 => 6.1033, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.81% (5.3626 => 4.6756, std.dev.: 0.0231) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.61% (9.7992 => 8.5632, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.38% (5.7056 => 4.9995, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout/nestedloop: -12.18% (0.2200 => 0.1932, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.99% (1.4235 => 1.2528, std.dev.: 0.0550) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.65% (1.6547 => 1.4620, std.dev.: 0.0524) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.97% (5.0421 => 4.4892, std.dev.: 0.0436) SingleSource/Benchmarks/Shootout/hash: -10.71% (4.5259 => 4.0414, std.dev.: 0.0227) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.25% (2.8778 => 2.5827, std.dev.: 0.0364) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.22% (0.4081 => 0.3664, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: -8.52% (9.0650 => 8.2926, std.dev.: 0.0454) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.74% (0.3217 => 0.2968, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.32% (4.2843 => 3.9705, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.74% (5.5974 => 5.2201, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.60% (46.0987 => 43.0550, std.dev.: 0.3853) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2490, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3654 => 0.3426, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.07% (4.9799 => 4.6775, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: -5.38% (1.7443 => 1.6504, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.29% (0.3349 => 0.3172, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.83% (23.3986 => 22.2693, std.dev.: 0.0807) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (3.6768 => 3.5001, std.dev.: 0.0182) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.80% (3.7662 => 3.5853, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.80% (1.4446 => 1.3753, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.26% (3.5127 => 3.3631, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.68% (5.8973 => 5.6800, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.55% (40.4729 => 39.0348, std.dev.: 0.1827) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.32% (2.5170 => 2.4334, std.dev.: 0.0184) MultiSource/Applications/SIBsim4/SIBsim4: -2.99% (3.5443 => 3.4384, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.77% (0.3609 => 0.3509, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.45% (3.0082 => 2.9345, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/mandel-2: -2.26% (0.8521 => 0.8328, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: -2.23% (2.8571 => 2.7933, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.13% (3.5669 => 3.4910, std.dev.: 0.0288) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.08% (1.0995 => 1.0766, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.91% (61.0379 => 59.8739, std.dev.: 0.4130) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5783, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.70% (85.3042 => 83.8525, std.dev.: 0.2310) MultiSource/Benchmarks/BitBench/five11/five11: -1.61% (5.7021 => 5.6105, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.42% (8.8249 => 8.6992, std.dev.: 0.0085) SingleSource/Benchmarks/SmallPT/smallpt: -1.37% (14.9448 => 14.7397, std.dev.: 0.0357) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3156, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.30% (1.6251 => 1.6040, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.24% (5.9063 => 5.8331, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.24% (6.8262 => 6.7416, std.dev.: 0.0292) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (3.7450 => 3.7016, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-6: -1.07% (2.4234 => 2.3975, std.dev.: 0.0042) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.81% (1.2047 => 1.2144, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -21.03% (0.0233 => 0.0184, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0096) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0394 => 0.0344, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.61% (0.0328 => 0.0326, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0227 => 0.0227, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1530 => 0.1512, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: -39.95% (1.9293 => 1.1585, std.dev.: 0.0453) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.52% (0.4049 => 0.4028, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.03% (0.1510 => 0.1434, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.42% (0.0978 => 0.0612, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.88% (0.0590 => 0.0573, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.24% (1.1617 => 1.3155, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.26% (0.0610 => 0.0584, std.dev.: 0.0091) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.45% (0.0268 => 0.0363, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.36% (0.7437 => 1.7429, std.dev.: 0.0126) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -8.70% (0.0092 => 0.0084, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.23% (12.7781 => 34.4029, std.dev.: 0.3389) Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 14:13:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 16:13:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130126221328.E72D02A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7983?compare_to=7976&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7983, Order: 173582, Start Time: 2013-01-26 18:39:53, End Time: 2013-01-26 22:13:47 To: 7976, Order: 173569, Start Time: 2013-01-26 14:14:07, End Time: 2013-01-26 17:48:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (750 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 1.17% (2.2307 => 2.2568, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.01% (1.5684 => 1.5842, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -4.04% (128.9702 => 123.7592, std.dev.: 1.3819) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.00% (0.0625 => 0.0900, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.90% (0.1063 => 0.1434, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.42% (0.0331 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.74% (0.2969 => 0.3852, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.34% (0.0547 => 0.0702, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.10% (0.4139 => 0.5302, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.79% (0.0475 => 0.0607, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.51% (0.5900 => 0.7523, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.89% (0.0714 => 0.0906, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.28% (0.5000 => 0.6314, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.10% (0.4253 => 0.5363, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.05% (0.4994 => 0.6295, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.99% (0.1620 => 0.2041, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 25.60% (1.5932 => 2.0010, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 25.54% (0.0599 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.47% (0.1021 => 0.1281, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.08% (0.0897 => 0.1122, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.03% (0.1107 => 0.1373, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.01% (0.0633 => 0.0785) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.99% (0.0642 => 0.0796, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 23.95% (0.0948 => 0.1175, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.64% (0.0495 => 0.0612, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.53% (0.1003 => 0.1239, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.38% (0.1604 => 0.1979, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.37% (0.1549 => 0.1911, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 23.34% (0.0604 => 0.0745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.26% (0.3903 => 0.4811, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.11% (0.0822 => 0.1012, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 23.04% (0.1619 => 0.1992, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 22.90% (0.0821 => 0.1009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.79% (0.0452 => 0.0555, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 22.07% (0.0947 => 0.1156, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 22.06% (0.1505 => 0.1837, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 21.41% (0.0808 => 0.0981, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.32% (0.1088 => 0.1320, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.28% (0.2866 => 0.3476, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.25% (0.2014 => 0.2442, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 21.20% (0.0698 => 0.0846, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.14% (0.1462 => 0.1771, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 21.10% (0.1218 => 0.1475, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.97% (0.4029 => 0.4874, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.77% (0.3890 => 0.4698, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.76% (0.2736 => 0.3304, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.45% (1.3152 => 1.5842, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.28% (0.0572 => 0.0688, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.18% (0.3271 => 0.3931, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 20.08% (1.8794 => 2.2568, std.dev.: 0.0077) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.80% (1.6211 => 1.9420, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 19.71% (0.5546 => 0.6639, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.41% (3.5627 => 4.2542, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 19.22% (0.5826 => 0.6946, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.02% (0.4658 => 0.5544, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference-object: 18.98% (0.5889 => 0.7007, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.88% (0.1160 => 0.1379) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.85% (0.1968 => 0.2339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/bh/bh: 18.69% (0.1284 => 0.1524, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 18.52% (0.9697 => 1.1493, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 18.44% (0.1421 => 0.1683, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.05% (0.2875 => 0.3394, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.93% (0.5026 => 0.5927, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.86% (0.3930 => 0.4632, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.84% (0.4361 => 0.5139, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 17.72% (0.2811 => 0.3309, std.dev.: 0.0078) MultiSource/Applications/d/make_dparser: 17.68% (1.0781 => 1.2687, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.65% (1.9966 => 2.3490, std.dev.: 0.0378) SingleSource/Benchmarks/Shootout-C++/random: 17.45% (0.2803 => 0.3292, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 17.42% (0.2813 => 0.3303, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 17.39% (0.2823 => 0.3314, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.36% (0.2725 => 0.3198, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.35% (0.2750 => 0.3227, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.32% (1.9694 => 2.3105, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hello: 17.32% (0.2714 => 0.3184, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.30% (0.2792 => 0.3275, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 17.28% (4.2109 => 4.9384, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.22% (0.2729 => 0.3199, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.20% (0.2738 => 0.3209, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 17.09% (0.2780 => 0.3255, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.08% (2.7292 => 3.1954, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.05% (2.0673 => 2.4198, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.00% (0.2911 => 0.3406, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.00% (0.7171 => 0.8390, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/wc: 16.86% (0.3096 => 0.3618, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.81% (0.3195 => 0.3732, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 16.74% (0.9909 => 1.1568, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 16.67% (1.4269 => 1.6648, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary: 16.67% (0.3258 => 0.3801, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.66% (4.4195 => 5.1556, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/ary3: 16.56% (0.3267 => 0.3808, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.41% (0.3060 => 0.3562, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.28% (0.3317 => 0.3857, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 16.17% (0.2566 => 0.2981, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.04% (0.3124 => 0.3625, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.03% (0.3362 => 0.3901, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 16.02% (0.3726 => 0.4323, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 15.99% (0.3477 => 0.4033, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 15.91% (0.3678 => 0.4263, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.85% (23.5202 => 27.2479, std.dev.: 0.0354) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.81% (0.3625 => 0.4198, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.80% (0.3348 => 0.3877, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.66% (0.3282 => 0.3796, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.53% (0.3465 => 0.4003, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.52% (0.3460 => 0.3997, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.48% (0.3469 => 0.4006, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3446 => 0.3979, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.45% (0.3488 => 0.4027, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 15.45% (0.3496 => 0.4036, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/trivial-interface: 15.37% (0.3442 => 0.3971, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.36% (0.4146 => 0.4783, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 15.34% (0.7875 => 0.9083, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash2: 15.31% (0.4251 => 0.4902, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.31% (0.3690 => 0.4255, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.30% (0.0673 => 0.0776, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.22% (0.3981 => 0.4587, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 14.96% (0.3724 => 0.4281, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 14.91% (0.3643 => 0.4186, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.62% (0.3845 => 0.4407, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 14.47% (5.5417 => 6.3437, std.dev.: 0.0149) MultiSource/Applications/JM/ldecod/ldecod: 14.38% (2.1653 => 2.4767, std.dev.: 0.0172) SingleSource/Benchmarks/Misc-C++/bigfib: 14.33% (0.5012 => 0.5730, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 14.12% (0.2691 => 0.3071, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/football/football: 14.07% (0.2075 => 0.2367, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 13.82% (2.1013 => 2.3917, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.80% (0.6435 => 0.7323, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 13.79% (4.6177 => 5.2544, std.dev.: 0.0418) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.55% (0.2737 => 0.3108, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.01% (0.2068 => 0.2337, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.78% (0.3084 => 0.3478, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 12.72% (0.3498 => 0.3943, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.50% (0.5361 => 0.6031, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.45% (0.2040 => 0.2294, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 12.15% (0.6634 => 0.7440, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.03% (0.2103 => 0.2356, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: 11.95% (0.4847 => 0.5426, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 11.87% (0.3336 => 0.3732, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.14% (0.7426 => 0.8253, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.88% (11.6398 => 12.9065, std.dev.: 0.0149) MultiSource/Applications/lemon/lemon: 10.79% (0.2391 => 0.2649, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.77% (0.1383 => 0.1532) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.08% (0.5584 => 0.6147, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 9.97% (2.0346 => 2.2374, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.96% (4.6926 => 5.1599, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 8.03% (11.9555 => 12.9151, std.dev.: 0.0133) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.99% (0.3792 => 0.4019, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5251, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.74% (0.5917 => 0.6730, std.dev.: 0.0078) MultiSource/Applications/ClamAV/clamscan: 9.46% (0.2802 => 0.3067, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.40% (0.3693 => 0.4040, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2445, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.14% (12.0509 => 12.6708, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/flops-2: 5.01% (1.8057 => 1.8961, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 4.81% (0.2122 => 0.2224, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6848, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.00% (15.8721 => 16.1899, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3031, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2081, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4825, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5874, std.dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5565, std.dev.: 0.0241) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.60% (17.2379 => 14.2038, std.dev.: 0.1032) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7922, std.dev.: 0.0094) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -5.37% (14.0481 => 13.2933, std.dev.: 0.2716) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -4.79% (0.2402 => 0.2287, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2136, std.dev.: 0.0172) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8122, std.dev.: 0.0037) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.65% (0.6293 => 0.6126, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1805, std.dev.: 0.0312) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5754, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4984, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1228, std.dev.: 0.0657) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0479, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 15:10:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 17:10:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130126231007.686FB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7984?compare_to=7980&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7984, Order: 173587, Start Time: 2013-01-26 21:36:33, End Time: 2013-01-26 23:10:25 To: 7980, Order: 173585, Start Time: 2013-01-26 19:38:53, End Time: 2013-01-26 21:12:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (113 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.94% (0.0974 => 0.1626, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.53% (0.1500 => 0.2183, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.28% (0.6395 => 0.8843, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.72% (0.5688 => 0.7549, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.66% (0.5805 => 0.7701, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.54% (0.6260 => 0.8297, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.44% (0.5456 => 0.7226, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.99% (0.5849 => 0.7720, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.90% (0.5567 => 0.7343, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.78% (0.5575 => 0.7347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.73% (0.6395 => 0.8424, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.70% (0.5581 => 0.7350, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.60% (0.5941 => 0.7759, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.18% (0.5859 => 0.7627, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.12% (0.6033 => 0.7850, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.64% (1.6474 => 2.1192, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.63% (0.6189 => 0.7961, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.55% (0.6676 => 0.8582, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.92% (0.6304 => 0.8064, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.61% (0.6230 => 0.7950, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.04% (0.0699 => 0.0888, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.61% (0.6660 => 0.8432, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.45% (0.5925 => 0.7492, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.33% (0.5705 => 0.7207, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.87% (0.5857 => 0.7372, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.61% (0.5569 => 0.6995, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.58% (0.5570 => 0.6995, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.37% (0.5478 => 0.6868, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.13% (0.5591 => 0.6996, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.20% (0.7524 => 0.9345, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.07% (0.5863 => 0.7274, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.88% (0.6446 => 0.7985, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.78% (0.6052 => 0.7491, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.26% (0.6681 => 0.8235, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.86% (0.6194 => 0.7610, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.57% (0.6297 => 0.7718, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.52% (2.2587 => 2.7447, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.33% (0.6667 => 0.8089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.57% (0.7339 => 0.8775, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.71% (0.0621 => 0.0731) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.46% (0.3357 => 0.3876, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 14.85% (1.1450 => 1.3150, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.47% (4.5069 => 5.0687, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/05-eks/eks: 12.36% (0.4515 => 0.5073, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.46% (1.6364 => 1.8239, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.43% (3.5339 => 3.9377, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.20% (0.1982 => 0.2204, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.76% (9.2283 => 10.1287, std.dev.: 0.0068) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.43% (0.1230 => 0.1346) SingleSource/Benchmarks/Shootout-C++/hash: 8.64% (0.4524 => 0.4915, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.44% (1.2515 => 1.3571, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.77% (0.5329 => 0.5743, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 7.59% (0.4861 => 0.5230, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.57% (0.1731 => 0.1862, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.38% (0.3834 => 0.4117, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.31% (0.7021 => 0.7534, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.30% (1.4642 => 1.5711, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.85% (1.2784 => 1.3660, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3255 => 0.3462, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 5.69% (0.6750 => 0.7134, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.3319 => 0.3494, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.90% (5.4682 => 5.6817, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 3.74% (0.3446 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3394 => 0.3518, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.42% (5.0226 => 5.1946, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.3864 => 1.4278, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.64% (0.8418 => 0.8640, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.60% (0.4427 => 0.4542, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 2.20% (0.7447 => 0.7611, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.17% (0.9557 => 0.9764, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 1.86% (15.5079 => 15.7968, std.dev.: 0.0067) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.78% (22.4056 => 22.8045, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.77% (1.3722 => 1.3965, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8137, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.03% (1.2783 => 1.3682, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1643, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5252, std.dev.: 0.1117) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1039, std.dev.: 0.0078) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5130, std.dev.: 0.0135) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2464, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2693, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.15% (10.3489 => 10.4679, std.dev.: 0.0353) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.56% (0.7198 => 0.6870, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -4.48% (0.3194 => 0.3051, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (2.4924 => 2.3953, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/trivial-interface: -3.62% (0.3812 => 0.3674, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.54% (0.3837 => 0.3701, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3884 => 0.3747, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.51% (0.3848 => 0.3713, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.49% (0.3896 => 0.3760, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.47% (0.4033 => 0.3893, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.47% (0.3891 => 0.3756, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.45% (0.3880 => 0.3746, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.41% (0.3142 => 0.3035, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.37% (0.9852 => 0.9520, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.26% (0.4176 => 0.4040, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.13% (0.3831 => 0.3711, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.82% (0.6347 => 0.6168, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.79% (20.7746 => 20.1941, std.dev.: 0.0324) SingleSource/UnitTests/ObjC/property: -2.76% (0.4199 => 0.4083, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.53% (0.6441 => 0.6278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.49% (0.9542 => 0.9304, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.39% (1.3148 => 1.2834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.38% (0.6484 => 0.6330, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: -2.34% (0.4280 => 0.4180, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.33% (2.1713 => 2.1208, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.02% (14.2083 => 13.9208, std.dev.: 0.0161) MultiSource/Applications/sqlite3/sqlite3: -1.92% (17.1032 => 16.7743, std.dev.: 0.0059) SingleSource/UnitTests/ObjC++/property-reference: -1.86% (0.7779 => 0.7634, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.53% (6.7716 => 6.6678, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -1.37% (16.1920 => 15.9700, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.33% (0.7919 => 0.7814, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.22% (4.3330 => 4.2800, std.dev.: 0.0040) MultiSource/Applications/JM/ldecod/ldecod: -1.09% (7.0961 => 7.0190, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.04% (1.8100 => 0.6871, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.38% (1.3643 => 1.0317, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7507, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0866, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1331, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3550, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1724, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.30% (5.5807 => 5.3965, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.27% (1.0557 => 1.0212, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.26% (7.9763 => 7.7964, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.14% (1.3096 => 1.2816, std.dev.: 0.0063) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1754, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/ary3: -1.75% (3.7241 => 3.6591, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4741, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.51% (1.6219 => 1.5974, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.37% (1.6086 => 1.5865, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6689, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.02% (1.6307 => 1.6141, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 15:56:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 17:56:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130126235627.953C62A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7985?compare_to=7981&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7985, Order: 173587, Start Time: 2013-01-26 21:45:34, End Time: 2013-01-26 23:56:45 To: 7981, Order: 173584, Start Time: 2013-01-26 19:03:37, End Time: 2013-01-26 21:14:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (223 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (649 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1330 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.62% (0.0690 => 0.0665, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8354 => 499.8451, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.30% (1.1277 => 499.8451, std.dev.: 0.0115) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.39% (0.5229 => 1.6544, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 21.15% (14.9895 => 18.1597, std.dev.: 0.0156) MultiSource/Applications/kimwitu++/kc: 45.42% (14.1553 => 20.5850, std.dev.: 0.0113) MultiSource/Benchmarks/MallocBench/gs/gs: 18.67% (4.1105 => 4.8778, std.dev.: 0.0142) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.91% (1.1048 => 1.7335, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 425.17% (7.1582 => 37.5930, std.dev.: 0.0300) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.09% (3.4629 => 6.4788, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.08% (0.6222 => 1.0956, std.dev.: 0.0053) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.58% (0.0720 => 7.4409, std.dev.: 0.0109) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11158200.00% (0.0001 => 11.1583, std.dev.: 0.0431) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 574900.00% (0.0001 => 0.5750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490500.00% (0.0001 => 5.4906, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.68% (1.1194 => 10.2725, std.dev.: 0.0469) SingleSource/UnitTests/SignlessTypes/factor: 163.51% (0.0296 => 0.0780, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.95% (22.1758 => 54.9839, std.dev.: 0.0181) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.42% (0.0929 => 0.1834, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 71.50% (0.1463 => 0.2509, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 61.17% (0.0394 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.76% (2.9384 => 4.6062, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.29% (7.0540 => 10.8833, std.dev.: 0.0030) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.96% (1.5859 => 2.4099, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/distray/distray: 49.43% (0.1056 => 0.1578) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.02% (8.1363 => 11.9617, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.68% (2.2024 => 3.1423) MultiSource/Applications/sgefa/sgefa: 40.05% (0.3109 => 0.4354, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.08% (21.9371 => 30.5092, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0000) SingleSource/UnitTests/vla: 38.31% (0.0355 => 0.0491, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.95% (0.1062 => 0.1465, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.74% (4.2646 => 5.7034, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/exptree: 33.05% (0.0814 => 0.1083, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.89% (1.5415 => 2.0485, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.72% (0.4615 => 0.6125, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.06% (0.1143 => 0.1498) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.69% (0.2271 => 0.2968, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.64% (0.0793 => 0.1036, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.30% (1.1642 => 1.5170, std.dev.: 0.0048) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.85% (0.0479 => 0.0622, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 29.80% (0.4299 => 0.5580, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.97% (0.5105 => 0.6584) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 28.91% (0.1892 => 0.2439, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 28.65% (0.0719 => 0.0925, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.41% (0.1584 => 0.2034, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.72% (0.6675 => 0.8525, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 27.27% (0.1555 => 0.1979, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 27.09% (0.2554 => 0.3246, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.93% (0.1125 => 0.1428, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.85% (0.0730 => 0.0926, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 26.39% (9.4845 => 11.9870, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.29% (3.8922 => 4.9153, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.05% (0.1566 => 0.1974, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 25.69% (0.4289 => 0.5391, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.33% (0.0675 => 0.0846, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 24.93% (1.0722 => 1.3395, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.75% (0.0408 => 0.0509, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.74% (0.3121 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.66% (0.1906 => 0.2376, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 24.60% (0.1175 => 0.1464, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.51% (1.4186 => 1.7663, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.42% (0.1695 => 0.2109, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.38% (0.1337 => 0.1663, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 24.07% (0.4620 => 0.5732, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.81% (0.0886 => 0.1097, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 23.67% (0.6456 => 0.7984, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0842 => 0.1041, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 23.40% (0.7115 => 0.8780, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.36% (0.0672 => 0.0829, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 22.96% (0.0662 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.82% (0.1236 => 0.1518, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.67% (0.2700 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 22.61% (0.1163 => 0.1426, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 22.58% (0.0527 => 0.0646, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.10% (0.0457 => 0.0558, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 21.97% (0.0660 => 0.0805, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 21.95% (0.1695 => 0.2067, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 21.66% (0.3098 => 0.3769, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.57% (0.1029 => 0.1251, std.dev.: 0.0021) MultiSource/Applications/spiff/spiff: 21.31% (0.7835 => 0.9505, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 21.29% (0.1151 => 0.1396, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 21.11% (5.7591 => 6.9751, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.03% (1.3050 => 1.5795, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.67% (0.0953 => 0.1150, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.52% (0.1940 => 0.2338, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.37% (4.9449 => 5.9523, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.27% (0.5860 => 0.7048, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.14% (0.8172 => 0.9818, std.dev.: 0.0021) MultiSource/Applications/lambda-0_1_3/lambda: 20.13% (0.7433 => 0.8929, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.98% (0.0871 => 0.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.66% (0.3307 => 0.3957, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.60% (0.5020 => 0.6004, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.32% (0.0528 => 0.0630, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 19.32% (3.3354 => 3.9797, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.31% (5.0018 => 5.9677, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.18% (0.0834 => 0.0994, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.17% (0.2107 => 0.2511, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.71% (0.2758 => 0.3274, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.70% (0.0770 => 0.0914, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.48% (0.1510 => 0.1789, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.41% (0.5569 => 0.6594, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.37% (0.9765 => 1.1559, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 18.32% (0.3423 => 0.4050, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 18.13% (1.1840 => 1.3986, std.dev.: 0.0007) MultiSource/Applications/treecc/treecc: 18.11% (2.0273 => 2.3945, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 18.07% (3.8723 => 4.5720, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/five11/five11: 17.99% (0.0567 => 0.0669, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.96% (0.4203 => 0.4958, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.72% (0.1044 => 0.1229, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 17.71% (2.2969 => 2.7037, std.dev.: 0.0121) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.60% (1.1861 => 1.3948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.49% (0.5981 => 0.7027, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.36% (0.0933 => 0.1095, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.34% (0.2065 => 0.2423, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.29% (0.3441 => 0.4036, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.11% (0.3232 => 0.3785, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.87% (0.3283 => 0.3837, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.83% (0.8101 => 0.9464, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 16.70% (0.3180 => 0.3711, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.47% (0.6450 => 0.7512, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 15.57% (0.8921 => 1.0310, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 15.28% (0.0818 => 0.0943) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.25% (0.8067 => 0.9297, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.20% (0.0704 => 0.0811, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.15% (0.0759 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 15.12% (0.3379 => 0.3890, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.56% (0.2603 => 0.2982, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.46% (0.3865 => 0.4424, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.06% (0.4636 => 0.5288, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 13.84% (0.2905 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.82% (0.4103 => 0.4670, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.67% (0.3387 => 0.3850, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 13.35% (1.5603 => 1.7686, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/moments: 12.82% (0.4048 => 0.4567, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sieve: 12.77% (0.3603 => 0.4063, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.42% (0.3422 => 0.3847, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.29% (0.3092 => 0.3472, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.22% (0.2430 => 0.2727, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 12.11% (17.1811 => 19.2624, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/oourafft: 12.07% (0.3282 => 0.3678, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 12.02% (0.3684 => 0.4127, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 11.94% (0.3927 => 0.4396, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.66% (0.3826 => 0.4272, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 11.63% (0.3886 => 0.4338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.58% (0.1114 => 0.1243, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.36% (0.1268 => 0.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.27% (0.4064 => 0.4522, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3427 => 0.3810, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.85% (14.3668 => 15.9251, std.dev.: 0.0184) SingleSource/UnitTests/ObjC/exceptions: 10.68% (0.3828 => 0.4237, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.55% (0.2871 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.22% (0.3473 => 0.3828, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.14% (0.3561 => 0.3922, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.13% (0.3543 => 0.3902, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.12% (0.3694 => 0.4068, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.10% (0.3543 => 0.3901, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.04% (0.3516 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3497 => 0.3847, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 9.98% (0.2877 => 0.3164, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3162 => 0.3477, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.63% (2.0665 => 2.2655, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 9.44% (1.2842 => 1.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.43% (0.2725 => 0.2982, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.32% (0.3650 => 0.3990, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.29% (0.2714 => 0.2966, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2793 => 0.3051, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.02% (0.2872 => 0.3131, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 9.00% (63.2438 => 68.9354, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/wc: 8.94% (0.3052 => 0.3325, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.89% (0.2756 => 0.3001, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.84% (0.3935 => 0.4283, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 8.82% (0.2802 => 0.3049, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.52% (0.6030 => 0.6544, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.45% (0.3136 => 0.3401, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: 8.31% (0.7326 => 0.7935, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: 8.12% (0.5925 => 0.6406, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.92% (2.2022 => 2.3766, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.32% (0.1625 => 0.1744, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 6.92% (10.3673 => 11.0847, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.62% (0.4879 => 0.5202, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.17% (0.3177 => 0.3373, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.16% (0.2266 => 0.2383, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 4.28% (0.3131 => 0.3265, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.78% (0.3817 => 0.3923, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (7.9617 => 8.1671, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4770, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3858, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.46% (4.2280 => 4.4588, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3119, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.52% (0.9957 => 1.0307, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.36% (2.0360 => 2.1045, std.dev.: 0.0161) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9120, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7217, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.84% (9.1159 => 9.2833, std.dev.: 0.0272) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3050, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5854, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4543, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1687, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.78% (5.2763 => 1.1725, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.19% (0.8651 => 0.2146, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.03% (0.1622 => 0.0924, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.24% (5.3855 => 4.4568, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.69% (5.3526 => 4.4592, std.dev.: 0.0071) MultiSource/Applications/JM/ldecod/ldecod: -13.17% (10.4361 => 9.0619, std.dev.: 0.0144) SingleSource/UnitTests/Vector/constpool: -7.93% (54.1659 => 49.8728, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.86% (1.7609 => 1.6225, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.89% (1.9577 => 0.6677, std.dev.: 0.0055) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5617, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3077, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -33.66% (1.5373 => 1.0198, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -30.71% (10.7105 => 7.4215, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8517, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0064, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.65% (2.5528 => 2.1277, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -16.00% (1.6925 => 1.4217, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.18% (0.9540 => 0.8378, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4913, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5955, std.dev.: 0.0196) SingleSource/Benchmarks/McGill/chomp: -6.25% (1.2373 => 1.1600, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6975, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.51% (2.7294 => 2.5789, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.82% (1.5835 => 1.5072, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -4.32% (10.2830 => 9.8386, std.dev.: 0.0063) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3302, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: -1.34% (4.6441 => 4.5821, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7221 => 3.6732, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8567, std.dev.: 0.0072) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0030) Report Time: 1.51s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 16:14:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 18:14:21 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127001421.0B82D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7986?compare_to=7982&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7986, Order: 173589, Start Time: 2013-01-26 22:11:36, End Time: 2013-01-27 00:14:40 To: 7982, Order: 173585, Start Time: 2013-01-26 19:50:13, End Time: 2013-01-26 21:51:13 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (88 on baseline) Performance Improvements: 0 (77 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1060 (898 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.93% (1.4593 => 1.8815, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.53% (3.4910 => 3.5793, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.62% (0.8790 => 0.8932, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/fib2: 1.31% (4.3066 => 4.3629, std.dev.: 0.0186) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.48% (1.2144 => 1.2202, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 22.83% (0.0184 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.46% (0.0436 => 0.0434, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.74% (0.0344 => 0.0338, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.23% (0.0326 => 0.0322, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0435 => 0.0432, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.35% (0.0230 => 0.0220, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.39% (0.1512 => 0.1491, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 3.05% (1.1585 => 1.1938, std.dev.: 0.1729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.01% (0.4028 => 0.3947, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.25% (0.1434 => 0.1495, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.37% (0.0612 => 0.0651, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.71% (0.0573 => 0.0546, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.14% (1.3155 => 1.3173, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.74% (0.0584 => 0.0600, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.55% (0.0363 => 0.0365, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.19% (1.7429 => 1.7636, std.dev.: 0.0061) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.43% (0.0084 => 0.0066, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.22% (34.4029 => 34.3285, std.dev.: 0.1382) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.00% (0.0336 => 0.1680, std.dev.: 0.0030) SingleSource/Regression/C/sumarraymalloc: 116.38% (0.0293 => 0.0634, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/neural/neural: 61.60% (0.1638 => 0.2647, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.47% (0.8926 => 1.2628, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.33% (0.9120 => 1.2889, std.dev.: 0.0567) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.22% (0.8893 => 1.2559, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.54% (0.9061 => 1.2734, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.40% (0.9612 => 1.3495, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.67% (0.9588 => 1.3392, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.67% (0.9381 => 1.3102, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.55% (0.9564 => 1.3347, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.73% (0.9855 => 1.3672, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.61% (0.9091 => 1.2601, std.dev.: 0.0767) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.09% (0.8990 => 1.2414, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.89% (0.9998 => 1.3786, std.dev.: 0.1040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.65% (0.9422 => 1.2969, std.dev.: 0.0519) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.16% (0.9403 => 1.2897, std.dev.: 0.0410) SingleSource/Benchmarks/Stanford/IntMM: 36.89% (0.0431 => 0.0590, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.35% (0.9512 => 1.2970, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.05% (1.0119 => 1.3767, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.94% (0.8912 => 1.2115, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.70% (0.8736 => 1.1855, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.12% (1.0867 => 1.4683, std.dev.: 0.0973) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.72% (0.8732 => 1.1764, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.62% (1.0052 => 1.3532, std.dev.: 0.0591) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.20% (0.8846 => 1.1871, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.15% (0.9507 => 1.2659, std.dev.: 0.0926) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.40% (1.0017 => 1.3263, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.83% (0.9867 => 1.3008, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.81% (0.9788 => 1.2902, std.dev.: 0.0311) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.39% (0.9488 => 1.2466, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.34% (0.9685 => 1.2623, std.dev.: 0.0539) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.30% (1.0088 => 1.3145, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.94% (0.9127 => 1.1860, std.dev.: 0.0770) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.40% (0.9993 => 1.2931, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.30% (0.9405 => 1.2161, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.56% (1.0860 => 1.3744, std.dev.: 0.0569) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.09% (0.0738 => 0.0901, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.98% (0.0669 => 0.0796, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.34% (0.0738 => 0.0866, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.89% (0.0805 => 0.0941, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.61% (0.0963 => 0.1123, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.49% (0.1332 => 0.1525, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.05% (0.0783 => 0.0893, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.99% (1.0986 => 1.2523, std.dev.: 0.0476) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.69% (3.6295 => 4.1262, std.dev.: 0.1771) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.15% (0.1240 => 0.1403, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 13.08% (9.5202 => 10.7653, std.dev.: 0.3952) SingleSource/Benchmarks/Shootout-C++/matrix: 11.28% (0.2385 => 0.2654, std.dev.: 0.0065) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.07% (0.4596 => 0.5105, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/ReedSolomon: 10.83% (0.2050 => 0.2272, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.44% (1.4110 => 1.5442, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.03% (0.5369 => 0.5854, std.dev.: 0.0115) SingleSource/Benchmarks/Linpack/linpack-pc: 8.11% (0.2566 => 0.2774, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.36% (0.2879 => 0.3091, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.07% (1.8651 => 1.9970, std.dev.: 0.0493) SingleSource/Benchmarks/Misc-C++/bigfib: 4.20% (0.6711 => 0.6993, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.61% (0.7693 => 0.7817, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107375.00% (0.0008 => 0.8598, std.dev.: 0.0359) SingleSource/Benchmarks/Shootout/matrix: 356.61% (1.5825 => 7.2259, std.dev.: 0.0335) SingleSource/Benchmarks/Shootout/ary3: 287.54% (2.2304 => 8.6436, std.dev.: 1.9462) MultiSource/Applications/sgefa/sgefa: 257.30% (0.3515 => 1.2559, std.dev.: 0.0144) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.14% (1.1825 => 4.0695, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.68% (4.8185 => 15.9340, std.dev.: 0.0737) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 218.42% (0.0228 => 0.0726, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary2: 199.22% (0.0129 => 0.0386, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 150.00% (0.0232 => 0.0580, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 64.51% (2.9083 => 4.7845, std.dev.: 0.0247) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.61% (0.2562 => 0.3423, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.25% (3.1254 => 4.1020, std.dev.: 0.0327) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.71% (1.4588 => 1.8776, std.dev.: 0.0233) SingleSource/Regression/C/uint64_to_float: 23.47% (1.5397 => 1.9010, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/salsa20: 22.11% (7.4497 => 9.0969, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.05% (5.6033 => 6.8386, std.dev.: 0.4409) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.52% (4.8112 => 5.7984, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.21% (5.1752 => 5.8591, std.dev.: 0.0559) MultiSource/Applications/JM/lencod/lencod: 13.17% (6.8159 => 7.7137, std.dev.: 0.1146) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6503, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.03% (3.6477 => 3.9772, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 8.15% (8.6447 => 9.3490, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.82% (4.7473 => 5.0713, std.dev.: 0.0056) SingleSource/Benchmarks/McGill/chomp: 6.39% (1.0425 => 1.1091, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.20% (4.1836 => 4.4010, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (5.0310 => 5.2282, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.16% (4.7254 => 4.8747, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.50% (0.8800 => 0.8932, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.16% (2.5681 => 2.5978, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8627, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.60% (0.0727 => 0.0490, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.18% (0.0692 => 0.0497, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -25.32% (0.1888 => 0.1410, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.82% (0.0676 => 0.0542, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.43% (0.1009 => 0.0813, std.dev.: 0.0043) MultiSource/Applications/hbd/hbd: -19.06% (1.8964 => 1.5350, std.dev.: 0.1291) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -18.23% (0.1684 => 0.1377, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.42% (0.1079 => 0.0891, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.98% (1.0960 => 0.9209, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.07% (0.7686 => 0.6528, std.dev.: 0.0220) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.18% (0.0862 => 0.0757, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -10.08% (2.4719 => 2.2228, std.dev.: 0.0750) MultiSource/Applications/aha/aha: -9.65% (0.1378 => 0.1245, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.00% (0.7693 => 0.7001, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.64% (0.1366 => 0.1248, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.60% (0.1210 => 0.1106, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: -7.40% (0.5134 => 0.4754, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -7.38% (2.6437 => 2.4485, std.dev.: 0.0643) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.26% (0.2481 => 0.2301, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.05% (0.9124 => 0.8481, std.dev.: 0.0226) MultiSource/Applications/ClamAV/clamscan: -6.60% (17.4365 => 16.2856, std.dev.: 0.2826) SingleSource/Benchmarks/Shootout-C++/fibo: -4.99% (0.2006 => 0.1906, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.94% (0.2615 => 0.2512, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.85% (1.3220 => 1.2976, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9433, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/fp-convert: -61.92% (15.6525 => 5.9597, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.25% (0.4146 => 0.1814, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.54% (0.4578 => 0.2356, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3757, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6274, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.05% (0.4452 => 0.3114, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.57% (0.5495 => 0.4035, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.34% (5.2605 => 3.8748, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.06% (4.4467 => 3.3323, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.30% (0.5826 => 0.4410, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.62% (0.5897 => 0.4504, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.39% (4.9921 => 3.8243, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.46% (5.8755 => 4.7911, std.dev.: 0.0086) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.99% (1.5623 => 1.2812, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.66% (7.0016 => 5.7653, std.dev.: 0.3099) SingleSource/Benchmarks/Shootout-C++/ary3: -17.36% (1.8123 => 1.4977, std.dev.: 0.1134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.27% (16.6791 => 13.9651, std.dev.: 0.4431) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.66% (0.1164 => 0.1005, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.11% (3.1921 => 2.7737, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6749, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.75% (9.7992 => 8.5496, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9940, std.dev.: 0.0091) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.11% (1.4235 => 1.2653, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0042) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.15% (2.8778 => 2.5856, std.dev.: 0.0630) SingleSource/Benchmarks/Misc-C++/stepanov_container: -10.07% (5.0421 => 4.5346, std.dev.: 0.1516) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.39% (0.3217 => 0.2947, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists1: -8.39% (0.6628 => 0.6072, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout/nestedloop: -8.36% (0.2200 => 0.2016, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.57% (5.5974 => 5.2296, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2488, std.dev.: 0.0356) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.31% (4.9799 => 4.6655, std.dev.: 0.0470) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.76% (0.3349 => 0.3156, std.dev.: 0.0074) SingleSource/Benchmarks/McGill/queens: -5.21% (1.7443 => 1.6535, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.57% (3.7662 => 3.5941, std.dev.: 0.0372) SingleSource/Benchmarks/Shootout-C++/hash2: -4.50% (3.6768 => 3.5112, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.5127 => 3.3590, std.dev.: 0.0182) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4364, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (5.8973 => 5.6817, std.dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.62% (40.4729 => 39.0083, std.dev.: 0.4866) SingleSource/Benchmarks/Misc/ffbench: -3.30% (1.4244 => 1.3774, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: -3.24% (17.2182 => 16.6611, std.dev.: 0.1015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.74% (8.7327 => 8.5811, std.dev.: 0.0046) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8610, std.dev.: 0.0969) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.41% (8.8249 => 8.7002, std.dev.: 0.0318) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.28% (3.3596 => 3.3166, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (3.7450 => 3.6997, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7488, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.06% (6.6336 => 6.5636, std.dev.: 0.0115) SingleSource/Benchmarks/SmallPT/smallpt: -1.03% (14.9448 => 14.7914, std.dev.: 0.0281) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.29% (1.2047 => 1.2202, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.00% (0.0233 => 0.0226, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.73% (0.0255 => 0.0220, std.dev.: 0.0063) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.55% (0.1530 => 0.1491, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -38.12% (1.9293 => 1.1938, std.dev.: 0.1729) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.52% (0.4049 => 0.3947, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1510 => 0.1495, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.44% (0.0978 => 0.0651, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0590 => 0.0546, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.39% (1.1617 => 1.3173, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.19% (0.0268 => 0.0365, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.14% (0.7437 => 1.7636, std.dev.: 0.0061) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -28.26% (0.0092 => 0.0066, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.65% (12.7781 => 34.3285, std.dev.: 0.1382) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 17:08:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 19:08:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127010803.B404E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7987?compare_to=7984&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7987, Order: 173595, Start Time: 2013-01-26 23:34:08, End Time: 2013-01-27 01:08:21 To: 7984, Order: 173587, Start Time: 2013-01-26 21:36:33, End Time: 2013-01-26 23:10:25 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (118 on baseline) Performance Improvements: 0 (94 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.48% (79.1481 => 80.3201, std.dev.: 0.4419) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.45% (0.0974 => 0.1631, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.44% (0.6395 => 0.8853, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.07% (0.5688 => 0.7569, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.89% (0.5805 => 0.7714, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.76% (0.6260 => 0.8311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.72% (0.5456 => 0.7241, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.21% (0.5849 => 0.7733, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.19% (0.5567 => 0.7359, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.12% (0.6395 => 0.8449, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.06% (0.5581 => 0.7370, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.95% (0.5575 => 0.7356, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.47% (0.6033 => 0.7871, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.35% (0.5859 => 0.7637, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.12% (1.6474 => 2.1272, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.94% (0.6189 => 0.7980, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.86% (0.6676 => 0.8603, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.24% (0.6304 => 0.8084, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.96% (0.6230 => 0.7972, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.90% (0.0699 => 0.0894, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.06% (0.5802 => 0.7372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.83% (0.6660 => 0.8447, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.66% (0.5705 => 0.7226, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.58% (0.5925 => 0.7500, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.31% (0.5857 => 0.7398, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 26.05% (0.5570 => 0.7021, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.89% (0.5569 => 0.7011, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.85% (0.5478 => 0.6894, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.59% (0.5591 => 0.7022, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.44% (0.5863 => 0.7296, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.39% (0.7524 => 0.9359, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.20% (0.6446 => 0.8006, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.17% (0.6052 => 0.7515, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.30% (0.6681 => 0.8238, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.30% (0.6194 => 0.7637, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.82% (0.6297 => 0.7734, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.94% (2.2587 => 2.7543, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.60% (0.6667 => 0.8107, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.99% (0.7339 => 0.8806, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.67% (0.3357 => 0.3883, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.95% (0.0731 => 0.0833, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (4.5069 => 5.0818, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/05-eks/eks: 12.40% (0.4515 => 0.5075, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.27% (0.4916 => 0.5519, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.79% (0.1230 => 0.1375) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.76% (3.5339 => 3.9494, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.68% (1.6364 => 1.8276, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.45% (0.1982 => 0.2209, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 9.74% (9.2283 => 10.1271, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 8.81% (1.2515 => 1.3618, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.38% (0.4524 => 0.4903, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.35% (0.5329 => 0.5774, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.26% (0.1731 => 0.1874, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 7.88% (0.4861 => 0.5244, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.60% (1.4642 => 1.5755, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.59% (0.7021 => 0.7554, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.03% (1.2784 => 1.3683, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.42% (0.3255 => 0.3464, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6750 => 0.7171, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.51% (0.3319 => 0.3502, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.59% (5.4682 => 5.7194, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 3.87% (5.0226 => 5.2170, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: 3.77% (0.3446 => 0.3576, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.48% (0.3394 => 0.3512, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.05% (0.8418 => 0.8675, std.dev.: 0.0016) MultiSource/Applications/SIBsim4/SIBsim4: 3.05% (1.3864 => 1.4287, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.85% (0.4427 => 0.4553, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.51% (0.7447 => 0.7634, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.49% (0.9557 => 0.9795, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.48% (22.4056 => 22.9604, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 2.10% (15.5079 => 15.8331, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5168 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.3722 => 1.3999, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.23% (18.2933 => 18.5175, std.dev.: 0.0159) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.11% (1.2300 => 1.2436, std.dev.: 0.0052) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5521, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.82% (31.3723 => 55.7861, std.dev.: 0.0147) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.62% (0.9531 => 1.0257, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1648, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.5751 => 56.5716, std.dev.: 0.0458) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1040, std.dev.: 0.0063) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5136, std.dev.: 0.0197) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2454, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4575, std.dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.49% (0.7198 => 0.6875, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.35% (0.3194 => 0.3055, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (2.4924 => 2.3951, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-3: -3.77% (0.3848 => 0.3703, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: -3.70% (0.3812 => 0.3671, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -3.67% (0.3896 => 0.3753, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: -3.66% (0.3880 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.63% (0.3831 => 0.3692, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.57% (0.4033 => 0.3889, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.41% (0.3142 => 0.3035, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.36% (0.9852 => 0.9521, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.28% (0.3837 => 0.3711, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.24% (0.3884 => 0.3758, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -2.83% (0.4199 => 0.4080, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: -2.55% (0.6347 => 0.6185, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.45% (0.4280 => 0.4175, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2824, std.dev.: 0.0425) MultiSource/Applications/hexxagon/hexxagon: -2.30% (1.3148 => 1.2846, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.27% (0.6441 => 0.6295, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.24% (0.6484 => 0.6339, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.17% (2.1713 => 2.1242, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.15% (14.2083 => 13.9026, std.dev.: 0.0053) MultiSource/Applications/sqlite3/sqlite3: -1.88% (17.1032 => 16.7812, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -1.84% (0.7779 => 0.7636, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.46% (6.7716 => 6.6730, std.dev.: 0.0041) MultiSource/Applications/JM/lencod/lencod: -1.36% (16.1920 => 15.9719, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (7.0961 => 7.0199, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.04% (1.0544 => 1.0434, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.04% (1.2210 => 1.2083, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.43% (1.8100 => 0.6982, std.dev.: 0.0110) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3111, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0290, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0045) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0783, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.02% (4.1024 => 3.1990, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1332, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3570, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7624, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.45% (1.3096 => 1.2775, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.29% (3.1919 => 3.1187, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.84% (7.3040 => 7.1695, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.54% (3.7092 => 3.6520, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4761, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6110, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.10% (4.8776 => 4.8240, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.04% (1.6219 => 1.6050, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 18:37:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 20:37:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127023756.D83802A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7988?compare_to=7985&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7988, Order: 173595, Start Time: 2013-01-27 00:27:09, End Time: 2013-01-27 02:38:14 To: 7985, Order: 173587, Start Time: 2013-01-26 21:45:34, End Time: 2013-01-26 23:56:45 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (220 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0665 => 0.0665, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8451 => 499.8439, std.dev.: 0.0142) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 44224.19% (1.1277 => 499.8439, std.dev.: 0.0142) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 216.22% (0.5229 => 1.6535, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 21.12% (14.9895 => 18.1553, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 45.06% (14.1553 => 20.5336, std.dev.: 0.0201) MultiSource/Benchmarks/MallocBench/gs/gs: 18.59% (4.1105 => 4.8746, std.dev.: 0.0150) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.99% (1.1048 => 1.7344, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.09% (7.1582 => 37.3725, std.dev.: 0.0212) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.02% (3.4629 => 6.4763, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.97% (0.6222 => 1.0949, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.56% (0.0720 => 7.4416, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3833200.00% (0.0001 => 3.8333, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11175300.00% (0.0001 => 11.1754, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63600.00% (0.0001 => 0.0637, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5490200.00% (0.0001 => 5.4903, std.dev.: 0.0024) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.26% (1.1194 => 10.2230, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.53% (22.1758 => 54.8908, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.31% (0.0929 => 0.1833, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.36% (0.1463 => 0.2507, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457) SingleSource/Benchmarks/CoyoteBench/almabench: 64.79% (0.0730 => 0.1203, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.01% (2.9384 => 4.6135, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.12% (7.0540 => 10.8719, std.dev.: 0.0110) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.14% (1.5859 => 2.4128, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 48.28% (0.0232 => 0.0344) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.83% (8.1363 => 11.9467, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.49% (2.2024 => 3.1381, std.dev.: 0.0025) MultiSource/Applications/sgefa/sgefa: 40.14% (0.3109 => 0.4357, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.41% (0.0439 => 0.0612) SingleSource/Benchmarks/Misc/flops: 38.27% (0.1432 => 0.1980, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.20% (21.9371 => 30.3170, std.dev.: 0.0084) SingleSource/UnitTests/vla: 38.03% (0.0355 => 0.0490, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.76% (0.1062 => 0.1463, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.73% (4.2646 => 5.7030, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.87% (0.4615 => 0.6132, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 32.80% (0.0814 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.74% (1.5415 => 2.0462, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.78% (0.2271 => 0.2970, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.36% (0.1143 => 0.1490, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 30.32% (1.1642 => 1.5172, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/05-eks/eks: 29.84% (0.4299 => 0.5582, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 28.46% (0.0636 => 0.0817) MultiSource/Benchmarks/NPB-serial/is/is: 28.37% (0.0719 => 0.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.27% (0.5105 => 0.6548, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.99% (0.0793 => 0.1015, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.69% (0.6675 => 0.8523, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.38% (0.1892 => 0.2410, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 27.37% (0.1655 => 0.2108, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.02% (0.1584 => 0.2012, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 26.42% (9.4845 => 11.9906, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.41% (0.0746 => 0.0943, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.19% (3.8922 => 4.9116, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.16% (0.0730 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 26.16% (0.2554 => 0.3222, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 24.98% (1.0722 => 1.3400, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 24.88% (0.4289 => 0.5356, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.78% (0.1566 => 0.1954, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 24.68% (0.1175 => 0.1465, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.64% (0.3121 => 0.3890, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.55% (0.1906 => 0.2374, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.45% (1.4186 => 1.7654, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.38% (0.1337 => 0.1663, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.37% (0.1695 => 0.2108, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 24.05% (0.4620 => 0.5731, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 23.53% (0.6456 => 0.7975, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.36% (0.0672 => 0.0829, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 23.33% (0.7115 => 0.8775, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 22.77% (0.0527 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.63% (0.2700 => 0.3311, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 22.51% (0.0662 => 0.0811, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.19% (0.1555 => 0.1900, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.17% (0.1236 => 0.1510, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 22.04% (0.0626 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.93% (0.0675 => 0.0823, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 21.88% (0.0457 => 0.0557, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 21.82% (0.0660 => 0.0804, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.48% (0.1029 => 0.1250, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 21.47% (0.7835 => 0.9517, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: 21.34% (0.3098 => 0.3759, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.26% (0.0842 => 0.1021, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.12% (1.3050 => 1.5806, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 21.11% (0.1151 => 0.1394, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 20.94% (5.7591 => 6.9649, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/em3d/em3d: 20.77% (0.1695 => 0.2047, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 20.64% (0.1163 => 0.1403, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 20.62% (0.0485 => 0.0585, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.31% (0.5860 => 0.7050, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.26% (0.1940 => 0.2333, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.91% (4.9449 => 5.9294, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.81% (0.8172 => 0.9791, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 19.55% (3.3354 => 3.9874, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.54% (0.0834 => 0.0997, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.53% (0.0886 => 0.1059, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.50% (0.5020 => 0.5999, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.41% (0.3307 => 0.3949, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 19.20% (0.7433 => 0.8860, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.18% (5.0018 => 5.9612, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.83% (0.0648 => 0.0770, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.82% (0.2758 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.44% (0.0770 => 0.0912, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 18.38% (0.1268 => 0.1501, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.37% (0.9765 => 1.1559, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.28% (0.1510 => 0.1786, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.5569 => 0.6583, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 18.16% (3.8723 => 4.5756, std.dev.: 0.0097) MultiSource/Applications/treecc/treecc: 18.07% (2.0273 => 2.3937, std.dev.: 0.0027) MultiSource/Benchmarks/nbench/nbench: 18.05% (1.1840 => 1.3977, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.04% (0.2107 => 0.2487, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.73% (0.1117 => 0.1315, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.68% (0.4203 => 0.4946, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 17.62% (0.3423 => 0.4026, std.dev.: 0.0025) MultiSource/Applications/siod/siod: 17.60% (2.2969 => 2.7011, std.dev.: 0.0064) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.55% (1.1861 => 1.3943, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.53% (0.1044 => 0.1227, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.42% (0.5981 => 0.7023, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.19% (0.2065 => 0.2420, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.14% (0.0770 => 0.0902, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 17.13% (0.2049 => 0.2400, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.08% (0.3232 => 0.3784, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.91% (0.3441 => 0.4023, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 16.84% (0.3283 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.84% (0.8101 => 0.9465, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.6450 => 0.7500, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 15.96% (0.0633 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 15.91% (0.3180 => 0.3686, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: 15.65% (0.1144 => 0.1323, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.40% (0.8921 => 1.0295, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 15.16% (0.0818 => 0.0942, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 15.09% (0.3379 => 0.3889, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.07% (0.8067 => 0.9283, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.06% (0.0704 => 0.0810, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.02% (0.0759 => 0.0873, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.48% (0.2603 => 0.2980, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.20% (0.3865 => 0.4414, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.11% (0.4636 => 0.5290, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 13.87% (0.2905 => 0.3308, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.55% (0.3387 => 0.3846, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.48% (0.4103 => 0.4656, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.16% (1.5603 => 1.7657, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 12.80% (0.4048 => 0.4566, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.55% (0.3603 => 0.4055, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 12.40% (0.3282 => 0.3689, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.26% (0.2430 => 0.2728, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 12.26% (17.1811 => 19.2867, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout-C++/lists: 12.24% (0.3422 => 0.3841, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 12.02% (0.3684 => 0.4127, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.79% (0.3826 => 0.4277, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bh/bh: 11.64% (0.3092 => 0.3452, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 11.59% (0.3927 => 0.4382, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.40% (0.1114 => 0.1241, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.29% (0.3427 => 0.3814, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.20% (0.4064 => 0.4519, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.96% (0.3886 => 0.4312, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.78% (14.3668 => 15.9150, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/except: 10.41% (0.2871 => 0.3170, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 10.24% (0.3828 => 0.4220, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.82% (0.3473 => 0.3814, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.77% (0.3543 => 0.3889, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.74% (0.3543 => 0.3888, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: 9.73% (0.2877 => 0.3157, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-2: 9.72% (0.3497 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 9.64% (0.3694 => 0.4050, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/synchronized: 9.63% (0.3561 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.61% (2.0665 => 2.2650, std.dev.: 0.0106) SingleSource/UnitTests/ObjC/exceptions-3: 9.58% (0.3516 => 0.3853, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.52% (0.3162 => 0.3463, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 9.34% (1.2842 => 1.4042, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.25% (0.2725 => 0.2977, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.13% (0.2793 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.03% (0.2714 => 0.2959, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.99% (0.2891 => 0.3151, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.82% (0.3935 => 0.4282, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.77% (0.2872 => 0.3124, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.74% (0.2756 => 0.2997, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 8.51% (63.2438 => 68.6230, std.dev.: 0.0299) SingleSource/UnitTests/ObjC++/property-reference-object: 8.37% (0.6030 => 0.6535, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.35% (0.3136 => 0.3398, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 7.95% (0.5925 => 0.6396, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 7.84% (10.3673 => 11.1806, std.dev.: 0.0225) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.77% (2.2022 => 2.3733, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.64% (0.4879 => 0.5203, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.20% (0.3177 => 0.3374, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.08% (0.2266 => 0.2381, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.31% (0.3131 => 0.3266, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.58% (7.9617 => 8.1675, std.dev.: 0.0158) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4736, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.14% (1.1145 => 1.2944, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6959, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 13.14% (0.5413 => 0.6124, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.86% (0.2944 => 0.3146, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3850, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4527, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3112, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.3316 => 0.3445, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.82% (0.4162 => 0.4321, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.23% (0.9957 => 1.0279, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (8.6802 => 8.9142, std.dev.: 0.0071) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.09% (3.6395 => 3.7155, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2831, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3052, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1691, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.72% (5.2763 => 1.1756, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.27% (0.8651 => 0.2139) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.47% (5.3855 => 4.4446, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.97% (5.3526 => 4.4445, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: -13.20% (10.4361 => 9.0582, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.89% (1.7609 => 1.6219, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.61% (54.1659 => 50.0415, std.dev.: 0.0184) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.83% (1.9577 => 0.6689, std.dev.: 0.0104) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3068, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.34% (1.5373 => 1.0248, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -30.70% (10.7105 => 7.4219, std.dev.: 0.0252) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8500, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0054, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.39% (0.2161 => 0.1742, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7330, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4944, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.94% (1.8329 => 1.7057, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.88% (19.9488 => 18.5771, std.dev.: 0.0256) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.16% (1.2373 => 1.1611, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.69% (8.1563 => 7.6921, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-5: -4.68% (1.5835 => 1.5094, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -4.59% (10.2830 => 9.8106, std.dev.: 0.0172) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -1.76% (3.6994 => 3.6343, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: -1.39% (4.6441 => 4.5795, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.22% (6.2999 => 6.2229, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0034) Report Time: 1.76s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 18:40:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 20:40:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130127024016.F2BBC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7989?compare_to=7983&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7989, Order: 173592, Start Time: 2013-01-26 23:06:32, End Time: 2013-01-27 02:40:34 To: 7983, Order: 173582, Start Time: 2013-01-26 18:39:53, End Time: 2013-01-26 22:13:47 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (183 on baseline) Performance Improvements: 3 (23 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (752 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.32% (123.7592 => 130.3374, std.dev.: 0.5179) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.05% (0.5363 => 0.5253, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.15% (1.5842 => 1.5660, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (2.1016 => 2.0517, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.60% (0.0625 => 0.0910, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.56% (0.1063 => 0.1441, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.17% (0.2969 => 0.3835, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.97% (0.0547 => 0.0700, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.78% (0.4139 => 0.5289, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.67% (0.1106 => 0.1412, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.17% (0.4994 => 0.6351, std.dev.: 0.0143) MultiSource/Applications/oggenc/oggenc: 26.63% (1.5932 => 2.0174, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.61% (0.5900 => 0.7470, std.dev.: 0.0222) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.05% (0.0714 => 0.0900, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.86% (0.0584 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.78% (0.5000 => 0.6289, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.25% (0.1620 => 0.2029, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 23.78% (0.1619 => 0.2004, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.58% (0.1107 => 0.1368, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.51% (0.4253 => 0.5253, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.14% (0.3903 => 0.4806, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.13% (0.1003 => 0.1235, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.94% (0.1103 => 0.1356, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.69% (0.1604 => 0.1968, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.53% (0.1549 => 0.1898, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 21.46% (0.1505 => 0.1828, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.44% (0.0947 => 0.1150, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.77% (0.1088 => 0.1314, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 20.77% (0.1218 => 0.1471, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.69% (0.2866 => 0.3459, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.63% (0.0698 => 0.0842, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 20.58% (0.4029 => 0.4858, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.52% (0.1462 => 0.1762, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.41% (0.2014 => 0.2425, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.36% (0.2736 => 0.3293, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.08% (0.3890 => 0.4671, std.dev.: 0.0122) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686) SingleSource/UnitTests/ObjC++/Hello: 19.62% (0.5826 => 0.6969, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 19.44% (0.5889 => 0.7034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.32% (0.4658 => 0.5558, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/gs/gs: 19.32% (1.8794 => 2.2425, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.20% (0.0573 => 0.0683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.07% (1.3152 => 1.5660, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: 18.97% (0.5546 => 0.6598, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.80% (1.6211 => 1.9258, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.73% (3.5627 => 4.2300, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.65% (0.3271 => 0.3881, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 18.30% (0.1284 => 0.1519, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.19% (0.2875 => 0.3398, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.09% (0.4361 => 0.5150, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.0582 => 0.0687, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.03% (0.5026 => 0.5932, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/methcall: 17.95% (0.2813 => 0.3318, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.85% (0.9697 => 1.1428, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 17.82% (0.2823 => 0.3326, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/18-imp/imp: 17.80% (0.1421 => 0.1674, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.76% (0.2714 => 0.3196, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.66% (0.2792 => 0.3285, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.63% (0.3930 => 0.4623, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 17.54% (0.2811 => 0.3304, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.50% (0.2725 => 0.3202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.49% (0.7171 => 0.8425, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/strcat: 17.45% (0.2750 => 0.3230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.42% (0.2738 => 0.3215, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.37% (0.2729 => 0.3203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.34% (0.2803 => 0.3289, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 17.16% (0.2780 => 0.3257, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 17.11% (1.0781 => 1.2626, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.09% (2.0673 => 2.4207, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: 16.99% (0.3096 => 0.3622, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.98% (0.3004 => 0.3514, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.88% (1.9694 => 2.3019, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.87% (0.3195 => 0.3734, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 16.80% (0.9909 => 1.1574, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.76% (0.2566 => 0.2996, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.73% (4.2109 => 4.9155, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary3: 16.65% (0.3267 => 0.3811, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.58% (1.9966 => 2.3276, std.dev.: 0.0377) SingleSource/Benchmarks/Shootout-C++/ary: 16.54% (0.3258 => 0.3797, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.54% (2.7292 => 3.1807, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.50% (0.3060 => 0.3565, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 16.21% (1.4269 => 1.6582, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/moments: 16.15% (0.3678 => 0.4272, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 16.13% (0.3726 => 0.4327, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.10% (0.3124 => 0.3627, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 16.10% (0.3317 => 0.3851, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 16.08% (0.3477 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.97% (0.3362 => 0.3899, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.92% (0.3348 => 0.3881, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.88% (4.4195 => 5.1214, std.dev.: 0.0436) SingleSource/UnitTests/ObjC/exceptions-2: 15.84% (0.3446 => 0.3992, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.84% (0.3282 => 0.3802, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.83% (0.3625 => 0.4199, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 15.83% (0.3469 => 0.4018, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.75% (0.4146 => 0.4799, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions-4: 15.67% (0.3465 => 0.4008, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.66% (0.3460 => 0.4002, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.60% (0.1090 => 0.1260, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/for-in: 15.59% (0.3496 => 0.4041, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 15.59% (23.5202 => 27.1865, std.dev.: 0.0554) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.57% (0.3488 => 0.4031, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.54% (0.3442 => 0.3977, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/hash2: 15.53% (0.4251 => 0.4911, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.50% (0.3690 => 0.4262, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.47% (0.3981 => 0.4597, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 15.29% (0.3650 => 0.4208, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/exceptions: 15.10% (0.3643 => 0.4193, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.04% (0.3724 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.01% (0.3845 => 0.4422, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 14.83% (0.7875 => 0.9043, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 14.51% (0.5012 => 0.5739, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 14.09% (5.5417 => 6.3225, std.dev.: 0.0036) MultiSource/Applications/SIBsim4/SIBsim4: 13.79% (0.2691 => 0.3062, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.77% (0.6435 => 0.7321, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 13.66% (2.1653 => 2.4610, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.63% (0.2737 => 0.3110, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.32% (0.0758 => 0.0859, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 13.23% (2.1013 => 2.3794, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: 13.20% (4.6177 => 5.2271, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.06% (0.2068 => 0.2338, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 13.01% (0.2075 => 0.2345, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.94% (0.0804 => 0.0908, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.48% (0.3084 => 0.3469, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 12.41% (0.3498 => 0.3932, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.40% (0.5361 => 0.6026, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 11.95% (0.6634 => 0.7427, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.89% (0.2103 => 0.2353, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.76% (0.2040 => 0.2280, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 11.75% (0.3336 => 0.3728, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 11.43% (0.4847 => 0.5401, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.12% (0.7426 => 0.8252, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.85% (11.6398 => 12.9028, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.13% (4.6926 => 5.1678, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.05% (0.1383 => 0.1522, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.01% (0.5584 => 0.6143, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 9.79% (0.2391 => 0.2625, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 9.29% (2.0346 => 2.2237, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.01% (11.9555 => 12.9129, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.09% (0.3792 => 0.4023, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5161, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0102) MultiSource/Applications/ClamAV/clamscan: 9.60% (0.2802 => 0.3071, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.56% (0.3693 => 0.4009, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6811, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2447, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.88% (1.8057 => 1.8939, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6915, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5013, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 2.71% (0.6276 => 0.6446, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1995, std.dev.: 0.0111) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3070, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2881, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0787, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2089, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5881, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4789, std.dev.: 0.0052) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.77% (2.4764 => 2.4078, std.dev.: 0.0166) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5675, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.48% (17.2379 => 14.2243, std.dev.: 0.1341) SingleSource/UnitTests/Vector/multiplies: -11.33% (2.3713 => 2.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -9.33% (0.2402 => 0.2178, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8045, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -4.07% (14.0481 => 13.4764, std.dev.: 0.1218) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2239, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.69% (11.2080 => 10.7939, std.dev.: 0.0147) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7742, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.24% (0.6293 => 0.6152, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.14% (197.4719 => 193.2414, std.dev.: 0.0738) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5742, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.46% (2.0820 => 2.0517, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1488, std.dev.: 0.0521) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 19:04:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 21:04:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127030452.6F90C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7990?compare_to=7986&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7990, Order: 173597, Start Time: 2013-01-27 00:38:19, End Time: 2013-01-27 03:05:12 To: 7986, Order: 173589, Start Time: 2013-01-26 22:11:36, End Time: 2013-01-27 00:14:40 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 31 (85 on baseline) Performance Improvements: 1 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1032 (929 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 38.45% (0.1017 => 0.1408, std.dev.: 0.0098) MultiSource/Benchmarks/Olden/power/power: 36.90% (0.1366 => 0.1870, std.dev.: 0.0153) MultiSource/Benchmarks/Olden/em3d/em3d: 22.96% (0.1908 => 0.2346, std.dev.: 0.0060) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.06% (5.4800 => 6.2506, std.dev.: 0.1781) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 12.39% (0.1106 => 0.1243, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 12.37% (16.8237 => 18.9055, std.dev.: 0.1384) MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.76% (0.9209 => 1.0292, std.dev.: 0.0380) MultiSource/Applications/ClamAV/clamscan: 11.01% (16.2856 => 18.0792, std.dev.: 0.2958) MultiSource/Benchmarks/Ptrdist/bc/bc: 10.57% (1.2578 => 1.3908, std.dev.: 0.0485) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 9.91% (4.9213 => 5.4092, std.dev.: 0.0753) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.74% (2.5884 => 2.7887, std.dev.: 0.0346) MultiSource/Applications/kimwitu++/kc: 7.71% (18.5381 => 19.9674, std.dev.: 0.4596) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.34% (1.8818 => 2.0012, std.dev.: 0.0434) MultiSource/Applications/minisat/minisat: 3.49% (0.7738 => 0.8008, std.dev.: 0.0094) MultiSource/Applications/siod/siod: 3.36% (2.4485 => 2.5308, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.80% (0.7817 => 0.8036, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 92.56% (0.1424 => 0.2742, std.dev.: 0.0226) MultiSource/Benchmarks/Ptrdist/ft/ft: 40.67% (0.8679 => 1.2209, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout/ary3: 35.88% (8.6436 => 11.7447, std.dev.: 0.5653) MultiSource/Benchmarks/Olden/bisort/bisort: 33.99% (0.6451 => 0.8644, std.dev.: 0.0277) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.40% (1.2812 => 1.6195, std.dev.: 0.0423) SingleSource/Benchmarks/Misc/pi: 24.60% (1.7679 => 2.2028, std.dev.: 0.0643) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.55% (1.2653 => 1.5000, std.dev.: 0.0137) MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.68% (0.6762 => 0.7890, std.dev.: 0.0431) MultiSource/Benchmarks/llubenchmark/llu: 10.99% (2.0342 => 2.2577, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 5.71% (3.5941 => 3.7995, std.dev.: 0.0515) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.88% (4.6655 => 4.7998, std.dev.: 0.0415) MultiSource/Benchmarks/Olden/bh/bh: 2.28% (2.3903 => 2.4449, std.dev.: 0.0089) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.28% (1.3710 => 1.4022, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/flops-6: 1.35% (2.4024 => 2.4349, std.dev.: 0.0121) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.31% (5.8314 => 5.9077, std.dev.: 0.0257) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -5.08% (0.6459 => 0.6131, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 13.75% (1.2202 => 1.3880, std.dev.: 0.0817) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.21% (0.0226 => 0.0221, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.98% (0.0434 => 0.0369, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.30% (0.0338 => 0.0337, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.93% (0.0322 => 0.0319, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.23% (0.0432 => 0.0431, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0207 => 0.0207, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 5.00% (0.0220 => 0.0231, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.84% (0.1491 => 0.1593, std.dev.: 0.0236) MultiSource/Applications/lemon/lemon: 1.31% (1.1938 => 1.2094, std.dev.: 0.3432) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.99% (0.3947 => 0.4065, std.dev.: 0.1357) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.67% (0.1495 => 0.1505, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.76% (0.0651 => 0.0682, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 5.70% (0.0263 => 0.0278, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 7.51% (0.0546 => 0.0587, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.56% (1.3173 => 1.3905, std.dev.: 0.1364) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 7.69% (0.0026 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.33% (0.0600 => 0.0620, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.29% (0.0365 => 0.0377, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (1.7636 => 1.7552, std.dev.: 0.0950) SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.42% (0.0066 => 0.0094, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.26% (34.3285 => 34.4191, std.dev.: 0.0916) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 408.04% (0.0336 => 0.1707, std.dev.: 0.0121) SingleSource/Regression/C/sumarraymalloc: 117.06% (0.0293 => 0.0636, std.dev.: 0.0057) SingleSource/Regression/C/sumarray2d: 90.88% (0.0274 => 0.0523, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: 75.15% (0.1638 => 0.2869, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.27% (0.8893 => 1.2652, std.dev.: 0.1210) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.12% (0.9120 => 1.2961, std.dev.: 0.0752) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 42.03% (0.2577 => 0.3660, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.91% (0.9612 => 1.3640, std.dev.: 0.1345) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.26% (0.9061 => 1.2800, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.12% (0.9381 => 1.3238, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.40% (0.9564 => 1.3428, std.dev.: 0.0925) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.99% (0.8990 => 1.2585, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 39.81% (1.0119 => 1.4147, std.dev.: 0.0684) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.50% (0.9855 => 1.3748, std.dev.: 0.0877) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.30% (0.9091 => 1.2664, std.dev.: 0.0906) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.28% (0.9010 => 1.2549, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.01% (0.9403 => 1.3071, std.dev.: 0.1029) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.57% (0.9998 => 1.3854, std.dev.: 0.1224) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.50% (0.9422 => 1.3049, std.dev.: 0.1115) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.24% (0.8912 => 1.2231, std.dev.: 0.0480) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.20% (0.9512 => 1.3050, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.72% (1.0867 => 1.4749, std.dev.: 0.0801) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.97% (1.0052 => 1.3567, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 34.94% (0.9507 => 1.2829, std.dev.: 0.1237) SingleSource/Benchmarks/McGill/exptree: 34.23% (0.0859 => 0.1153, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.13% (0.9867 => 1.3235, std.dev.: 0.0782) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.13% (1.0017 => 1.3336, std.dev.: 0.0582) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 33.08% (0.1058 => 0.1408, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.34% (0.9788 => 1.2953, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.01% (0.9488 => 1.2525, std.dev.: 0.1159) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.60% (1.0088 => 1.3276, std.dev.: 0.0733) MultiSource/Benchmarks/Olden/power/power: 30.31% (0.1435 => 0.1870, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.12% (0.9405 => 1.2238, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.22% (1.0860 => 1.3816, std.dev.: 0.0360) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.07% (5.0381 => 6.2506, std.dev.: 0.1781) MultiSource/Benchmarks/Olden/em3d/em3d: 21.74% (0.1927 => 0.2346, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.04% (0.0963 => 0.1156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 18.51% (3.6295 => 4.3012, std.dev.: 0.0968) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.73% (1.0986 => 1.2824, std.dev.: 0.0328) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.74% (2.4519 => 2.7887, std.dev.: 0.0346) MultiSource/Applications/JM/lencod/lencod: 13.20% (16.7012 => 18.9055, std.dev.: 0.1384) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.00% (1.4110 => 1.5945, std.dev.: 0.0469) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.61% (4.8904 => 5.4092, std.dev.: 0.0753) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.40% (1.8127 => 2.0012, std.dev.: 0.0434) SingleSource/Benchmarks/McGill/chomp: 10.32% (0.1793 => 0.1978, std.dev.: 0.0055) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.49% (0.4596 => 0.5032, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.31% (0.1955 => 0.2137, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.51% (0.3374 => 0.3526, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.46% (0.7693 => 0.8036, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107637.50% (0.0008 => 0.8619, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout/ary3: 426.57% (2.2304 => 11.7447, std.dev.: 0.5653) SingleSource/Benchmarks/Shootout/matrix: 357.27% (1.5825 => 7.2363, std.dev.: 0.0246) MultiSource/Applications/sgefa/sgefa: 257.78% (0.3515 => 1.2576, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.66% (1.1825 => 4.0638, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.81% (4.8185 => 15.9400, std.dev.: 0.0304) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 208.77% (0.0228 => 0.0704, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/ary2: 197.67% (0.0129 => 0.0384, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 144.83% (0.0232 => 0.0568, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/mst/mst: 83.90% (0.1491 => 0.2742, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/matrix: 62.59% (2.9083 => 4.7285, std.dev.: 0.0383) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.76% (0.2562 => 0.3427, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.50% (3.1254 => 4.1099, std.dev.: 0.0175) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 29.20% (1.4588 => 1.8847, std.dev.: 0.0287) MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.03% (0.6211 => 0.7890, std.dev.: 0.0431) SingleSource/Regression/C/uint64_to_float: 24.50% (1.5397 => 1.9170, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.65% (5.6033 => 6.9283, std.dev.: 0.3662) SingleSource/Benchmarks/Misc/salsa20: 22.65% (7.4497 => 9.1367, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.32% (4.8112 => 5.7890, std.dev.: 0.0600) MultiSource/Applications/JM/lencod/lencod: 15.25% (6.8159 => 7.8555, std.dev.: 0.0817) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.24% (5.1752 => 5.8602, std.dev.: 0.0532) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.88% (1.0816 => 1.2209, std.dev.: 0.0067) MultiSource/Benchmarks/llubenchmark/llu: 11.23% (2.0298 => 2.2577, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (3.6477 => 3.9755, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/ReedSolomon: 8.41% (8.6447 => 9.3714, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.07% (4.7473 => 5.0831, std.dev.: 0.0294) SingleSource/Benchmarks/McGill/chomp: 5.79% (1.0425 => 1.1029, std.dev.: 0.0138) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.37% (1.4235 => 1.5000, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.37% (4.1836 => 4.4083, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.29% (5.0310 => 5.2468, std.dev.: 0.0460) SingleSource/Benchmarks/Linpack/linpack-pc: 3.40% (50.8945 => 52.6239, std.dev.: 0.2426) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.21% (4.7254 => 4.8771, std.dev.: 0.0461) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.03% (2.2499 => 2.3181, std.dev.: 0.0251) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.51% (2.5681 => 2.6069, std.dev.: 0.0144) MultiSource/Benchmarks/Olden/bh/bh: 1.36% (2.4120 => 2.4449, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.30% (4.8076 => 4.8702, std.dev.: 0.0205) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -35.89% (0.0808 => 0.0518, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.30% (0.0727 => 0.0514, std.dev.: 0.0048) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.60% (0.0692 => 0.0501, std.dev.: 0.0007) SingleSource/Benchmarks/SmallPT/smallpt: -23.83% (0.1888 => 0.1438, std.dev.: 0.0106) SingleSource/UnitTests/Vector/constpool: -10.28% (9.8875 => 8.8710, std.dev.: 0.3589) MultiSource/Applications/spiff/spiff: -8.60% (1.0220 => 0.9341, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.37% (0.6885 => 0.6515, std.dev.: 0.0077) MultiSource/Applications/siod/siod: -4.27% (2.6437 => 2.5308, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/hash: -4.09% (0.4689 => 0.4497, std.dev.: 0.0059) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.83% (11.5523 => 3.9473, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/fp-convert: -61.76% (15.6525 => 5.9854, std.dev.: 0.0486) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.89% (0.4146 => 0.1829, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.97% (0.4578 => 0.2336, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.82% (11.3868 => 6.3967, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6274, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.28% (0.4452 => 0.3104, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -25.91% (5.2605 => 3.8974, std.dev.: 0.0594) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.04% (0.5495 => 0.4119, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.82% (4.4467 => 3.3431, std.dev.: 0.0423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.10% (0.5826 => 0.4422, std.dev.: 0.0203) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.72% (0.5897 => 0.4498, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.30% (4.9921 => 3.8288, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.39% (5.8755 => 4.7949, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.21% (7.0016 => 5.8666, std.dev.: 0.0851) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.93% (16.6791 => 14.0226, std.dev.: 0.0487) MultiSource/Applications/minisat/minisat: -14.56% (7.9891 => 6.8259, std.dev.: 0.4319) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.16% (3.1921 => 2.7720, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.75% (5.3626 => 4.6787, std.dev.: 0.0937) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.67% (9.7992 => 8.5575, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -11.66% (5.7056 => 5.0402, std.dev.: 0.0471) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.65% (0.4081 => 0.3687, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.62% (2.8778 => 2.6297, std.dev.: 0.0385) SingleSource/Benchmarks/Shootout-C++/lists1: -8.04% (0.6628 => 0.6095, std.dev.: 0.0140) MultiSource/Benchmarks/Olden/bisort/bisort: -7.77% (0.9372 => 0.8644, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.58% (5.5974 => 5.2290, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.20% (4.5424 => 4.2608, std.dev.: 0.0230) SingleSource/Benchmarks/McGill/queens: -5.30% (1.7443 => 1.6518, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/hash2: -4.79% (3.6768 => 3.5006, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.30% (3.5127 => 3.3615, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (5.8973 => 5.6825, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.62% (4.9799 => 4.7998, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/lists: -3.14% (17.2182 => 16.6781, std.dev.: 0.1248) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.94% (1.4446 => 1.4022, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.72% (8.7327 => 8.5825, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.57% (85.3042 => 83.9690, std.dev.: 0.3853) MultiSource/Applications/spiff/spiff: -1.51% (2.8571 => 2.8139, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.26% (8.8249 => 8.7136, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (3.7450 => 3.6986, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.10% (6.8262 => 6.7512, std.dev.: 0.0279) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 15.22% (1.2047 => 1.3880, std.dev.: 0.0817) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -18.18% (0.0451 => 0.0369, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0056) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 4.12% (0.1530 => 0.1593, std.dev.: 0.0236) MultiSource/Applications/lemon/lemon: -37.31% (1.9293 => 1.2094, std.dev.: 0.3432) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.40% (0.4049 => 0.4065, std.dev.: 0.1357) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.33% (0.1510 => 0.1505, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.27% (0.0978 => 0.0682, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0590 => 0.0587, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.70% (1.1617 => 1.3905, std.dev.: 0.1364) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.64% (0.0610 => 0.0620, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.67% (0.0268 => 0.0377, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.01% (0.7437 => 1.7552, std.dev.: 0.0950) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 2.17% (0.0092 => 0.0094, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.36% (12.7781 => 34.4191, std.dev.: 0.0916) Report Time: 1.06s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 19:05:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 21:05:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127030541.BADCD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7991?compare_to=7987&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7991, Order: 173598, Start Time: 2013-01-27 01:31:59, End Time: 2013-01-27 03:05:59 To: 7987, Order: 173595, Start Time: 2013-01-26 23:34:08, End Time: 2013-01-27 01:08:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.57% (0.0717 => 0.1223, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.74% (0.0974 => 0.1624, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.96% (0.1132 => 0.1607, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.36% (0.6395 => 0.8848, std.dev.: 0.0079) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.73% (0.5805 => 0.7705, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.65% (0.6260 => 0.8304, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.48% (0.5456 => 0.7228, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.11% (0.5849 => 0.7727, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.96% (0.5575 => 0.7357, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.88% (0.6395 => 0.8434, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.80% (0.5581 => 0.7356, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.77% (0.5941 => 0.7769, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.31% (0.5859 => 0.7635, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.25% (0.6033 => 0.7858, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.43% (0.6440 => 0.8335, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.06% (1.6474 => 2.1262, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.58% (0.6189 => 0.7958, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.54% (0.6676 => 0.8581, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.08% (0.6304 => 0.8074, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.77% (0.6230 => 0.7960, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.75% (0.0699 => 0.0893, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.80% (0.5802 => 0.7357, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.77% (0.6660 => 0.8443, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.52% (0.5705 => 0.7218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.38% (0.5925 => 0.7488, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.97% (0.5857 => 0.7378, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.89% (0.5570 => 0.7012, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.76% (0.5478 => 0.6889, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.71% (0.5569 => 0.7001, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.36% (0.5591 => 0.7009, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.24% (0.7524 => 0.9348, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.22% (0.6446 => 0.8007, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.07% (0.6052 => 0.7509, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.05% (0.5863 => 0.7273, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.33% (0.6681 => 0.8240, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.96% (0.6194 => 0.7616, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.63% (0.6297 => 0.7722, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.99% (2.2587 => 2.7555, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.51% (0.6667 => 0.8101, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.81% (0.7339 => 0.8793, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.93% (0.1146 => 0.1340, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.49% (0.3357 => 0.3877, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.19% (1.1450 => 1.3189, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.62% (4.5069 => 5.0755, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.37% (0.4916 => 0.5524, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 12.34% (0.4515 => 0.5072, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.73% (3.5339 => 3.9483, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.67% (1.6364 => 1.8274, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.54% (0.1230 => 0.1372, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.05% (0.1982 => 0.2201, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.71% (9.2283 => 10.1242, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 8.68% (1.2515 => 1.3601, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.47% (0.4524 => 0.4907, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5329 => 0.5772, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.20% (0.1731 => 0.1873, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.71% (0.4861 => 0.5236, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.59% (1.4642 => 1.5753, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.55% (0.7021 => 0.7551, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.04% (1.2784 => 1.3684, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.45% (0.3255 => 0.3465, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.24% (0.6750 => 0.7171, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.63% (0.3319 => 0.3506, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.54% (5.4682 => 5.7163, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3446 => 0.3577, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.55% (5.0226 => 5.2009, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 3.51% (0.3394 => 0.3513, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.20% (0.8418 => 0.8687, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 2.98% (1.3864 => 1.4277, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.76% (0.4427 => 0.4549, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.59% (0.7447 => 0.7640, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.57% (0.9557 => 0.9803, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (22.4056 => 22.9292, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5168 => 0.5279, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.01% (1.3722 => 1.3998, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 2.00% (15.5079 => 15.8188, std.dev.: 0.0224) MultiSource/Applications/kimwitu++/kc: 1.26% (18.2933 => 18.5238, std.dev.: 0.0133) MultiSource/Applications/treecc/treecc: 1.07% (2.1401 => 2.1631, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8015, std.dev.: 0.0140) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.05% (0.9531 => 1.0298, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1650, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.41% (54.5751 => 56.4384, std.dev.: 0.0746) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.89% (2.0478 => 2.1070, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.65% (18.2231 => 18.5243, std.dev.: 0.0234) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2465, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.37% (79.7170 => 80.8072, std.dev.: 0.3431) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (3.6551 => 3.6936, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4567, std.dev.: 0.0171) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.20% (0.7198 => 0.6896, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.86% (2.4924 => 2.3962, std.dev.: 0.0142) SingleSource/UnitTests/ObjC/trivial-interface: -3.80% (0.3812 => 0.3667, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-4: -3.79% (0.3880 => 0.3733, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.76% (0.3831 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.67% (0.4033 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.64% (0.3896 => 0.3754, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3848 => 0.3708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.60% (0.3891 => 0.3751, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: -3.42% (0.4176 => 0.4033, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.32% (0.9852 => 0.9525, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.22% (0.3884 => 0.3759, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.08% (0.3837 => 0.3719, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -2.87% (0.6347 => 0.6165, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -2.67% (0.4199 => 0.4087, std.dev.: 0.0000) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2353, std.dev.: 0.0264) SingleSource/UnitTests/ObjC++/property-reference-object: -2.58% (0.6441 => 0.6275, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.45% (0.4280 => 0.4175, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.9542 => 0.9316, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.34% (1.3148 => 1.2840, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.19% (0.6484 => 0.6342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.16% (2.1713 => 2.1243, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference: -2.16% (0.7779 => 0.7611, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9137, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.89% (17.1032 => 16.7806, std.dev.: 0.0108) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.51% (6.7716 => 6.6694, std.dev.: 0.0142) MultiSource/Applications/JM/lencod/lencod: -1.34% (16.1920 => 15.9757, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.20% (1.2210 => 1.2064, std.dev.: 0.0007) MultiSource/Applications/JM/ldecod/ldecod: -1.11% (7.0961 => 7.0176, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.03% (1.0544 => 1.0435, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.03% (1.2221 => 1.2095, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.22% (1.8100 => 0.6838, std.dev.: 0.0123) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3082, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel-2: -24.77% (1.3643 => 1.0264, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0766, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.08% (4.1024 => 3.1964, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1315, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3548, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6999, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.12% (0.3273 => 0.3138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1736, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3990, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.25% (1.3096 => 1.2671, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.48% (7.9763 => 7.7784, std.dev.: 0.0189) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6407, std.dev.: 0.0177) MultiSource/Benchmarks/Bullet/bullet: -1.83% (7.3040 => 7.1702, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.24% (1.6086 => 1.5886, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary3: -1.16% (3.7092 => 3.6661, std.dev.: 0.0120) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.14% (1.6219 => 1.6034, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 21:03:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 23:03:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127050329.5FCB92A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7992?compare_to=7991&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7992, Order: 173605, Start Time: 2013-01-27 03:29:42, End Time: 2013-01-27 05:03:46 To: 7991, Order: 173598, Start Time: 2013-01-27 01:31:59, End Time: 2013-01-27 03:05:59 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.17% (0.6395 => 0.8836, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.82% (0.5688 => 0.7555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.64% (0.5805 => 0.7700, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.61% (0.5456 => 0.7235, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.56% (0.6260 => 0.8298, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.23% (0.5567 => 0.7361, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.13% (0.5849 => 0.7728, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.82% (0.5575 => 0.7349, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.76% (0.6395 => 0.8426, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.64% (0.5581 => 0.7347, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.21% (0.5859 => 0.7629, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.13% (0.6033 => 0.7851, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.25% (1.6474 => 2.1293, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.91% (0.6189 => 0.7978, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.71% (0.6676 => 0.8593, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.95% (0.6304 => 0.8066, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.74% (0.6230 => 0.7958, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.89% (0.5802 => 0.7362, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.77% (0.6660 => 0.8443, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.50% (0.5925 => 0.7495, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.35% (0.5705 => 0.7208, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.09% (0.5857 => 0.7385, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.84% (0.5569 => 0.7008, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.66% (0.5570 => 0.6999, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.59% (0.5478 => 0.6880, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.18% (0.5591 => 0.6999, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.30% (0.7524 => 0.9352, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.27% (0.5863 => 0.7286, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.16% (0.6052 => 0.7514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.11% (0.6446 => 0.8000, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.25% (0.6681 => 0.8234, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.94% (0.6194 => 0.7615, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.73% (0.6297 => 0.7728, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.10% (2.2587 => 2.7579, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.63% (0.6667 => 0.8109, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.69% (0.7339 => 0.8784, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.61% (0.3357 => 0.3881, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.29% (1.1450 => 1.3201, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (4.5069 => 5.0810, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.67% (0.4916 => 0.5539, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.43% (0.4515 => 0.5076, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.88% (3.5339 => 3.9538, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.74% (1.6364 => 1.8285, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.25% (0.1982 => 0.2205, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.65% (0.1230 => 0.1361, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 9.91% (9.2283 => 10.1427, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 8.79% (1.2515 => 1.3615, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.70% (0.2001 => 0.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.64% (0.4524 => 0.4915, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.29% (0.5329 => 0.5771, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.97% (0.1731 => 0.1869, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.66% (1.4642 => 1.5764, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.62% (0.7021 => 0.7556, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.39% (0.4861 => 0.5220, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.02% (1.2784 => 1.3681, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.93% (0.3255 => 0.3448, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 5.79% (0.6750 => 0.7141, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.63% (0.3319 => 0.3506, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (5.4682 => 5.7096, std.dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 3.67% (5.0226 => 5.2070, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.27% (0.8418 => 0.8693, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 3.23% (1.3864 => 1.4312, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.13% (0.3446 => 0.3554, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.56% (0.7447 => 0.7638, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.42% (0.9557 => 0.9788, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.37% (0.4427 => 0.4532, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.36% (0.5168 => 0.5290, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.29% (22.4056 => 22.9194, std.dev.: 0.0139) MultiSource/Applications/SPASS/SPASS: 2.25% (15.5079 => 15.8570, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.00% (1.3722 => 1.3996, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.2300 => 1.2453, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.10% (2.1401 => 2.1637, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.08% (18.2933 => 18.4904, std.dev.: 0.0145) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5519, std.dev.: 0.0059) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8022, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.17% (11.6767 => 12.1639, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.0478 => 2.1127, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.05% (54.5751 => 56.2403, std.dev.: 0.2133) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5075, std.dev.: 0.0213) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0056) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3489 => 10.4600, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.32% (0.7198 => 0.6887, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.91% (2.4924 => 2.3949, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.37% (0.3142 => 0.3036, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.27% (0.3057 => 0.2957, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.26% (0.9852 => 0.9531, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.25% (0.3812 => 0.3688, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: -3.24% (0.3831 => 0.3707, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.20% (0.3880 => 0.3756, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.17% (0.4033 => 0.3905, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.14% (0.3884 => 0.3762, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: -3.11% (0.3896 => 0.3775, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.07% (0.3323 => 0.3221, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.07% (0.3848 => 0.3730, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.90% (0.3891 => 0.3778, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.90% (0.6441 => 0.6254, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -2.85% (0.4176 => 0.4057, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.84% (0.6347 => 0.6167, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.67% (2.1713 => 2.1134, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -2.55% (1.3148 => 1.2813, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.27% (0.6484 => 0.6337, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.21% (20.7746 => 20.3157, std.dev.: 0.0367) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (14.2083 => 13.9305, std.dev.: 0.0200) MultiSource/Applications/sqlite3/sqlite3: -1.90% (17.1032 => 16.7788, std.dev.: 0.0178) SingleSource/UnitTests/ObjC++/property-reference: -1.86% (0.7779 => 0.7634, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.30% (16.1920 => 15.9814, std.dev.: 0.0099) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (6.7716 => 6.6888, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.06% (1.2221 => 1.2091, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.03% (1.0544 => 1.0435, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.66% (1.8100 => 0.6939, std.dev.: 0.0337) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3132, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7537, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0775, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.05% (4.1024 => 3.1977, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1309, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3558, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.94% (1.2842 => 1.1694, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6340, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.64% (5.2027 => 4.8051, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.06% (0.3273 => 0.3140, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.01% (1.3096 => 1.2702, std.dev.: 0.0151) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.59% (3.7241 => 3.6278, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.50% (7.9763 => 7.7769, std.dev.: 0.0148) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.24% (3.1919 => 3.1203, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.83% (7.3040 => 7.1704, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5861, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.36% (1.6219 => 1.5999, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6088, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7092 => 3.6607, std.dev.: 0.0098) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 21:19:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 23:19:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127051933.34B792A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7993?compare_to=7988&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7993, Order: 173603, Start Time: 2013-01-27 03:08:46, End Time: 2013-01-27 05:19:50 To: 7988, Order: 173595, Start Time: 2013-01-27 00:27:09, End Time: 2013-01-27 02:38:14 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (220 on baseline) Performance Improvements: 3 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (651 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.25% (10.2230 => 10.3505, std.dev.: 0.0203) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.09% (11.1806 => 10.9464, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.15% (1.1756 => 1.1621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.11% (10.8719 => 10.7514, std.dev.: 0.0194) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0665 => 0.0665, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8439 => 499.8572, std.dev.: 0.0050) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.37% (1.1277 => 499.8572, std.dev.: 0.0050) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.85% (0.5229 => 1.6516, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 20.70% (14.9895 => 18.0926, std.dev.: 0.0089) MultiSource/Applications/kimwitu++/kc: 45.11% (14.1553 => 20.5411, std.dev.: 0.0195) MultiSource/Benchmarks/MallocBench/gs/gs: 18.53% (4.1105 => 4.8723, std.dev.: 0.0189) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.70% (1.1048 => 1.7312, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 422.20% (7.1582 => 37.3799, std.dev.: 0.0145) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.89% (3.4629 => 6.4717, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.00% (0.6222 => 1.0951, std.dev.: 0.0010) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.94% (0.0720 => 7.4426, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11151500.00% (0.0001 => 11.1516, std.dev.: 0.0138) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0080) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5480100.00% (0.0001 => 5.4802, std.dev.: 0.0095) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 824.65% (1.1194 => 10.3505, std.dev.: 0.0203) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.12% (22.1758 => 55.2445, std.dev.: 0.0208) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.09% (0.0929 => 0.1831, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.02% (2.9384 => 4.6140, std.dev.: 0.0167) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.42% (7.0540 => 10.7514, std.dev.: 0.0194) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.70% (1.5859 => 2.4058, std.dev.: 0.0189) MultiSource/Benchmarks/FreeBench/distray/distray: 48.96% (0.1056 => 0.1573, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.75% (8.1363 => 11.9402, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.18% (2.2024 => 3.1313, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: 39.92% (0.3109 => 0.4350, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 38.76% (0.1432 => 0.1987, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 38.28% (21.9371 => 30.3357, std.dev.: 0.0151) SingleSource/UnitTests/vla: 38.03% (0.0355 => 0.0490, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.57% (0.1062 => 0.1461, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.42% (4.2646 => 5.6898, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/exptree: 32.80% (0.0814 => 0.1081, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.53% (1.5415 => 2.0429, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.48% (0.4615 => 0.6114, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.47% (0.2271 => 0.2963, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 30.22% (1.1642 => 1.5160, std.dev.: 0.0075) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.48% (0.1143 => 0.1480, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 29.17% (0.4299 => 0.5553, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.35% (0.1584 => 0.2033, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.29% (0.5105 => 0.6549, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 28.23% (0.0719 => 0.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 27.99% (0.0636 => 0.0814, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.46% (0.6675 => 0.8508, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.01% (0.1655 => 0.2102, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.69% (0.1892 => 0.2397, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 26.27% (0.2554 => 0.3225, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.14% (0.0746 => 0.0941, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.09% (3.8922 => 4.9078, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.03% (0.0730 => 0.0920, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.96% (0.1125 => 0.1417, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 25.93% (9.4845 => 11.9442, std.dev.: 0.0097) MultiSource/Applications/lemon/lemon: 24.73% (1.0722 => 1.3374, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 24.69% (0.4289 => 0.5348, std.dev.: 0.0060) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.58% (0.1566 => 0.1951, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 24.51% (0.1175 => 0.1463, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.45% (0.3121 => 0.3884, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.23% (1.4186 => 1.7623, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.13% (0.1906 => 0.2366, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.08% (0.1337 => 0.1659, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.07% (0.1695 => 0.2103, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 23.96% (0.4620 => 0.5727, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 23.60% (0.7115 => 0.8794, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 23.39% (0.6456 => 0.7966, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.36% (0.0672 => 0.0829, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 22.66% (0.0662 => 0.0812, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.52% (0.0675 => 0.0827, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.37% (0.2700 => 0.3304, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.33% (0.1236 => 0.1512, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 22.20% (0.0527 => 0.0644, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.93% (0.1555 => 0.1896, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 21.67% (0.0660 => 0.0803, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 21.59% (0.1695 => 0.2061, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.28% (0.1029 => 0.1248, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.24% (0.7835 => 0.9499, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.02% (0.0842 => 0.1019, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.86% (1.3050 => 1.5772, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 20.85% (0.1151 => 0.1391, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 20.55% (0.1163 => 0.1402, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 20.55% (5.7591 => 6.9426, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.03% (0.5860 => 0.7034, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.80% (0.8172 => 0.9790, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.75% (4.9449 => 5.9214, std.dev.: 0.0135) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.66% (0.3307 => 0.3957, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.32% (0.5020 => 0.5990, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.30% (0.0886 => 0.1057, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 19.25% (0.7433 => 0.8864, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.13% (0.0528 => 0.0629) MultiSource/Applications/d/make_dparser: 19.08% (3.3354 => 3.9718, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.95% (5.0018 => 5.9497, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.78% (0.2758 => 0.3276, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.47% (0.0834 => 0.0988) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.31% (0.0770 => 0.0911, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 18.22% (0.1268 => 0.1499, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.11% (0.9765 => 1.1533, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.97% (0.3423 => 0.4038, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.95% (0.1510 => 0.1781, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.94% (0.5569 => 0.6568, std.dev.: 0.0038) MultiSource/Benchmarks/nbench/nbench: 17.89% (1.1840 => 1.3958, std.dev.: 0.0037) MultiSource/Applications/lua/lua: 17.86% (3.8723 => 4.5639, std.dev.: 0.0130) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 17.77% (2.0273 => 2.3875, std.dev.: 0.0112) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.70% (0.2107 => 0.2480, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.68% (0.4203 => 0.4946, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.55% (0.1117 => 0.1313, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.53% (0.1044 => 0.1227, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.47% (0.0933 => 0.1096, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.38% (0.2065 => 0.2424, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 17.34% (2.2969 => 2.6951, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 17.30% (0.3232 => 0.3791, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.29% (1.1861 => 1.3912, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.20% (0.5981 => 0.7010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.03% (0.3283 => 0.3842, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.01% (0.0770 => 0.0901) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.80% (0.3441 => 0.4019, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 16.64% (0.2049 => 0.2390, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.63% (0.8101 => 0.9448, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.14% (0.6450 => 0.7491, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/09-vor/vor: 15.97% (0.3180 => 0.3688, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 15.38% (0.1144 => 0.1320) SingleSource/Benchmarks/Shootout-C++/ary2: 15.15% (0.3379 => 0.3891, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.14% (0.8921 => 1.0272, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.70% (0.8067 => 0.9253, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.39% (0.3865 => 0.4421, std.dev.: 0.0049) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.35% (0.0704 => 0.0805, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.32% (0.0838 => 0.0958, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.17% (0.4636 => 0.5293, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.77% (0.4103 => 0.4668, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 13.67% (0.2905 => 0.3302, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.35% (0.3387 => 0.3839, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 13.16% (1.5603 => 1.7657, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.79% (0.3603 => 0.4064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.45% (0.3422 => 0.3848, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 12.40% (0.4048 => 0.4550, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 12.19% (0.3282 => 0.3682, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 12.13% (0.3684 => 0.4131, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.10% (17.1811 => 19.2603, std.dev.: 0.0175) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.10% (0.2430 => 0.2724, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bh/bh: 12.00% (0.3092 => 0.3463, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.58% (0.3826 => 0.4269, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.31% (0.1114 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.12% (0.3427 => 0.3808, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.05% (0.4064 => 0.4513, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.65% (14.3668 => 15.8974, std.dev.: 0.0195) SingleSource/UnitTests/ObjC/parameter-passing: 10.62% (0.3927 => 0.4344, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 10.53% (0.2831 => 0.3129, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.31% (0.2871 => 0.3167, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 10.14% (0.3886 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.02% (0.1268 => 0.1395, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.66% (2.0665 => 2.2662, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 9.56% (0.2877 => 0.3152, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.46% (0.3828 => 0.4190, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.46% (0.3162 => 0.3461, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 9.34% (1.2842 => 1.4041, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2725 => 0.2976, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.17% (0.2891 => 0.3156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.17% (0.2793 => 0.3049, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.95% (0.2714 => 0.2957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.91% (0.2872 => 0.3128, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 8.85% (0.3694 => 0.4021, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 8.84% (0.3473 => 0.3780, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 8.81% (0.3543 => 0.3855, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: 8.79% (0.3561 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 8.76% (0.3516 => 0.3824, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.75% (0.3543 => 0.3853, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.74% (0.3935 => 0.4279, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.67% (0.2756 => 0.2995, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.66% (63.2438 => 68.7234, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.62% (0.3052 => 0.3315, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 8.61% (0.3497 => 0.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.32% (0.3136 => 0.3397, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.19% (0.6030 => 0.6524, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.09% (0.7326 => 0.7919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 7.80% (0.5925 => 0.6387, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.42% (2.2022 => 2.3656, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.83% (0.1625 => 0.1736, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.66% (0.4879 => 0.5204, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.26% (0.3177 => 0.3376, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.59% (10.3673 => 10.9464, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.72% (0.2266 => 0.2373, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.38% (0.3131 => 0.3268, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.30% (7.9617 => 8.1450, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4766, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.91% (1.1145 => 1.2918, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.83% (0.2944 => 0.3145, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.37% (11.6436 => 12.3858, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4479, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3113, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.80% (0.4162 => 0.4320, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.68% (0.9957 => 1.0323, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.61% (8.6802 => 8.9067, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (3.6395 => 3.7150, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2842, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3046, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4513, std.dev.: 0.0089) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5743, std.dev.: 0.0053) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.98% (5.2763 => 1.1621, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.32% (5.3855 => 4.4529, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.82% (5.3526 => 4.4521, std.dev.: 0.0006) MultiSource/Applications/JM/ldecod/ldecod: -13.46% (10.4361 => 9.0318, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.32% (1.7609 => 1.6144, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -7.46% (54.1659 => 50.1233, std.dev.: 0.0360) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.63% (1.9577 => 0.6533, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3075, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.37% (1.5373 => 1.0243, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -30.75% (10.7105 => 7.4173, std.dev.: 0.0179) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8474, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9590, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597) MultiSource/Benchmarks/FreeBench/mason/mason: -20.13% (0.2161 => 0.1726, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.82% (2.5528 => 2.1234, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -16.41% (1.6925 => 1.4147, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7340, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.08% (0.9540 => 0.8388, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4947, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.97% (1.8329 => 1.7052, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5820, std.dev.: 0.0254) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.32% (1.2373 => 1.1591, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7031, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.02% (1.5835 => 1.5040, std.dev.: 0.0040) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.41% (10.2830 => 9.8294, std.dev.: 0.0106) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3292, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.41% (4.6441 => 4.5785, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.39% (3.7221 => 3.6704, std.dev.: 0.0174) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2204, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8587, std.dev.: 0.0092) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0019) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 21:27:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sat, 26 Jan 2013 23:27:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127052755.9A9AA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7994?compare_to=7990&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7994, Order: 173605, Start Time: 2013-01-27 03:24:40, End Time: 2013-01-27 05:28:16 To: 7990, Order: 173597, Start Time: 2013-01-27 00:38:19, End Time: 2013-01-27 03:05:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (85 on baseline) Performance Improvements: 34 (68 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1022 (910 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.02% (0.3687 => 0.3946, std.dev.: 0.0081) SingleSource/Benchmarks/Stanford/Puzzle: 6.67% (0.1650 => 0.1760, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.60% (0.4209 => 0.4487, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 3.43% (4.0362 => 4.1746, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/except: 2.18% (0.4908 => 0.5015, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.94% (5.8648 => 5.9787, std.dev.: 0.0325) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.51% (0.9727 => 0.9874, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.49% (1.4022 => 1.4231, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/health/health: -27.41% (0.2003 => 0.1454, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -27.06% (0.1408 => 0.1027, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/power/power: -26.26% (0.1870 => 0.1379, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.55% (0.0951 => 0.0708, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: -24.93% (0.4581 => 0.3439, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -23.25% (0.1299 => 0.0997, std.dev.: 0.0069) MultiSource/Benchmarks/FreeBench/mason/mason: -22.58% (0.1014 => 0.0785, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -22.51% (0.3660 => 0.2836, std.dev.: 0.0138) MultiSource/Benchmarks/McCat/05-eks/eks: -20.75% (0.6270 => 0.4969, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/em3d/em3d: -17.60% (0.2346 => 0.1933, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: -8.42% (0.3588 => 0.3286, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -8.11% (2.7887 => 2.5626, std.dev.: 0.0400) MultiSource/Benchmarks/McCat/18-imp/imp: -7.69% (0.4096 => 0.3781, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: -7.58% (17.6366 => 16.2997, std.dev.: 0.4908) MultiSource/Benchmarks/FreeBench/neural/neural: -7.15% (0.2869 => 0.2664, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -6.39% (1.3946 => 1.3055, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -6.24% (2.0012 => 1.8764, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.53% (10.0234 => 9.4688, std.dev.: 0.1145) SingleSource/Benchmarks/Shootout-C++/ary2: -5.42% (0.2807 => 0.2655, std.dev.: 0.0033) MultiSource/Benchmarks/sim/sim: -3.76% (0.3778 => 0.3636, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -3.61% (0.5646 => 0.5442, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: -3.07% (0.4497 => 0.4359, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.92% (0.8036 => 0.7801, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -47.12% (0.2742 => 0.1450, std.dev.: 0.0451) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.49% (0.1033 => 0.0904, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: -11.79% (2.2577 => 1.9916, std.dev.: 0.0617) MultiSource/Benchmarks/MallocBench/espresso/espresso: -9.66% (0.7890 => 0.7128, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.84% (3.7995 => 3.6157, std.dev.: 0.0673) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.14% (1.1198 => 1.0734, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/mandel: -3.44% (1.0981 => 1.0603, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.49% (4.1100 => 4.0076, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/bh/bh: -2.28% (2.4449 => 2.3891, std.dev.: 0.0178) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.73% (3.5725 => 3.5107, std.dev.: 0.0175) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.33% (0.8334 => 0.8223, std.dev.: 0.0036) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -12.56% (1.3880 => 1.2137, std.dev.: 0.0365) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0221 => 0.0220, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.62% (0.0369 => 0.0434, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0337 => 0.0337, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0319 => 0.0318, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0431 => 0.0432, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: -1.45% (0.0207 => 0.0204, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.87% (0.0231 => 0.0229, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -5.40% (0.1593 => 0.1507, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -6.49% (1.2094 => 1.1309, std.dev.: 0.0532) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.22% (0.4065 => 0.3934, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.86% (0.1505 => 0.1477, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.26% (0.0682 => 0.0612, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0278 => 0.0276, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.18% (0.0587 => 0.0539, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.02% (1.3905 => 1.3908, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -7.14% (0.0028 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.52% (0.0620 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.80% (0.0377 => 0.0374, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.65% (1.7552 => 1.7438, std.dev.: 0.0304) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.70% (0.0094 => 0.0083, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.12% (34.4191 => 33.3459, std.dev.: 0.6505) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 388.99% (0.0336 => 0.1643, std.dev.: 0.0082) SingleSource/Regression/C/sumarraymalloc: 111.60% (0.0293 => 0.0620, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/neural/neural: 62.64% (0.1638 => 0.2664, std.dev.: 0.0031) SingleSource/Regression/C/sumarray: 58.11% (0.0265 => 0.0419, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.28% (0.8893 => 1.2564, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.15% (0.9120 => 1.2873, std.dev.: 0.0380) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.08% (0.8926 => 1.2593, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.49% (0.9061 => 1.2730, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.47% (0.9612 => 1.3502, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.44% (0.9564 => 1.3336, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.43% (0.9381 => 1.3080, std.dev.: 0.0797) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.08% (0.9588 => 1.3335, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.91% (0.9091 => 1.2628, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.80% (0.8990 => 1.2478, std.dev.: 0.0830) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.32% (0.9855 => 1.3631, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.66% (0.9422 => 1.2970, std.dev.: 0.0859) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.31% (0.9998 => 1.3728, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 36.80% (0.9403 => 1.2863, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.59% (0.9010 => 1.2307, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.33% (0.9512 => 1.2968, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.99% (1.0119 => 1.3761, std.dev.: 0.0623) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.87% (0.8736 => 1.1870, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.75% (0.8912 => 1.2098, std.dev.: 0.0388) SingleSource/Benchmarks/Stanford/IntMM: 35.27% (0.0431 => 0.0583, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 34.91% (1.0867 => 1.4661, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.60% (0.8732 => 1.1753, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.45% (1.0052 => 1.3515, std.dev.: 0.0745) SingleSource/Benchmarks/McGill/exptree: 34.34% (0.0859 => 0.1154, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.09% (0.8846 => 1.1862, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.07% (0.9867 => 1.3130, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.17% (1.0017 => 1.3239, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.59% (0.9788 => 1.2880, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.59% (0.9488 => 1.2485, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.36% (0.9507 => 1.2488, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.24% (1.0088 => 1.3139, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.14% (0.9685 => 1.2604, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.74% (0.9127 => 1.1841, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.41% (0.9405 => 1.2171, std.dev.: 0.0525) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.91% (0.9993 => 1.2882, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.01% (0.9550 => 1.2225, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.27% (1.0860 => 1.3713, std.dev.: 0.0757) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.68% (0.0963 => 0.1114, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.88% (1.0986 => 1.2511, std.dev.: 0.0447) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.24% (3.6295 => 4.1100, std.dev.: 0.0824) MultiSource/Benchmarks/mafft/pairlocalalign: 12.20% (9.5202 => 10.6817, std.dev.: 0.1076) SingleSource/Benchmarks/Misc/ReedSolomon: 11.27% (0.2050 => 0.2281, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/matrix: 10.65% (0.2385 => 0.2639, std.dev.: 0.0044) SingleSource/UnitTests/Vectorizer/gcc-loops: 9.49% (0.4596 => 0.5032, std.dev.: 0.0100) SingleSource/Benchmarks/McGill/chomp: 9.26% (0.1793 => 0.1959, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.44% (0.1955 => 0.2120, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.51% (2.4519 => 2.5626, std.dev.: 0.0400) MultiSource/Benchmarks/McCat/05-eks/eks: 4.04% (0.4776 => 0.4969, std.dev.: 0.0055) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106337.50% (0.0008 => 0.8515, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 355.54% (1.5825 => 7.2089, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout/ary3: 282.77% (2.2304 => 8.5372, std.dev.: 2.2379) MultiSource/Applications/sgefa/sgefa: 258.95% (0.3515 => 1.2617, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.89% (1.1825 => 4.0310, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.76% (4.8185 => 15.9376, std.dev.: 0.0810) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 186.40% (0.0228 => 0.0653, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary2: 178.29% (0.0129 => 0.0359, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 137.50% (0.0232 => 0.0551, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 63.05% (2.9083 => 4.7421, std.dev.: 0.1386) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.34% (5.6033 => 7.4153, std.dev.: 0.2102) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.76% (3.1254 => 4.1180, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 30.95% (0.2562 => 0.3355, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.58% (1.4588 => 1.8611, std.dev.: 0.0512) SingleSource/Benchmarks/Misc/salsa20: 21.82% (7.4497 => 9.0754, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.35% (4.8112 => 5.7905, std.dev.: 0.1029) SingleSource/Regression/C/uint64_to_float: 16.02% (1.5397 => 1.7864, std.dev.: 0.0553) MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.76% (0.6211 => 0.7128, std.dev.: 0.0178) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.10% (5.1752 => 5.8534, std.dev.: 0.0129) MultiSource/Applications/JM/lencod/lencod: 13.08% (6.8159 => 7.7075, std.dev.: 0.2292) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (3.6477 => 3.9756, std.dev.: 0.0294) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.32% (0.1622 => 0.1757, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 8.09% (8.6447 => 9.3442, std.dev.: 0.0170) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.83% (0.4161 => 0.4487, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (4.1836 => 4.4048, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.61% (1.1060 => 1.1570, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 4.27% (4.0036 => 4.1746, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2287, std.dev.: 0.0145) SingleSource/Benchmarks/Linpack/linpack-pc: 3.57% (50.8945 => 52.7096, std.dev.: 0.5397) SingleSource/Benchmarks/Misc/pi: 3.26% (2.1390 => 2.2088, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.00% (0.9680 => 0.9874, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.11% (4.8076 => 4.8611, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (2.5681 => 2.5954, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.10% (0.0808 => 0.0484, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.16% (0.0727 => 0.0515, std.dev.: 0.0029) SingleSource/Benchmarks/SmallPT/smallpt: -28.44% (0.1888 => 0.1351, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.83% (0.1009 => 0.0819, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.01% (0.7686 => 0.6302, std.dev.: 0.0241) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.96% (0.1079 => 0.0896, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -14.04% (0.0862 => 0.0741, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: -10.48% (1.1433 => 1.0235, std.dev.: 0.0439) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.09% (6.4235 => 5.7755, std.dev.: 0.1771) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.71% (0.7693 => 0.6946, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.76% (0.3560 => 0.3248, std.dev.: 0.0108) MultiSource/Applications/siod/siod: -8.34% (2.6437 => 2.4232, std.dev.: 0.0828) SingleSource/Benchmarks/Shootout-C++/hash2: -8.02% (0.5134 => 0.4722, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.83% (0.9124 => 0.8410, std.dev.: 0.0173) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.80% (10.2703 => 9.4688, std.dev.: 0.1145) MultiSource/Applications/lambda-0_1_3/lambda: -7.62% (0.8653 => 0.7994, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: -7.04% (0.4689 => 0.4359, std.dev.: 0.0029) MultiSource/Applications/lemon/lemon: -6.61% (1.3979 => 1.3055, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/fibo: -5.93% (0.2006 => 0.1887, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.29% (1.6874 => 1.5981, std.dev.: 0.0332) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.29% (0.5746 => 0.5442, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -5.00% (0.4002 => 0.3802, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/lists: -4.70% (0.2725 => 0.2597, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.08% (1.5131 => 1.4514, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.01% (0.3665 => 0.3518, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/lists1: -3.34% (0.3206 => 0.3099, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.12% (0.4762 => 0.4661, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.92% (0.7225 => 0.7086, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.94% (11.5523 => 3.9342, std.dev.: 0.0564) SingleSource/Benchmarks/Misc/fp-convert: -61.83% (15.6525 => 5.9750, std.dev.: 0.1301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.89% (0.4146 => 0.1829, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.21% (0.4578 => 0.2371, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3750, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.84% (5.4023 => 3.6281, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.00% (0.4452 => 0.3072, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.75% (0.5495 => 0.4025, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.34% (5.2605 => 3.8747, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.32% (0.5826 => 0.4351, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3282, std.dev.: 0.0266) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.65% (4.2042 => 3.2100, std.dev.: 0.1803) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.41% (4.9921 => 3.8236, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7918, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -17.69% (9.7992 => 8.0660, std.dev.: 0.2630) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.75% (16.6791 => 14.2187, std.dev.: 0.2322) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.14% (7.0016 => 6.0113, std.dev.: 0.1791) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.38% (3.1921 => 2.7649, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6746, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9933, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: -8.40% (0.6628 => 0.6071, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/nestedloop: -8.05% (0.2200 => 0.2023, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2277, std.dev.: 0.0736) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2486, std.dev.: 0.0742) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.70% (4.9799 => 4.6958, std.dev.: 0.0434) SingleSource/Benchmarks/McGill/queens: -5.47% (1.7443 => 1.6488, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (3.5127 => 3.3224, std.dev.: 0.0339) SingleSource/Benchmarks/Shootout-C++/hash2: -4.86% (3.6768 => 3.4980, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.44% (23.3986 => 22.3593, std.dev.: 0.3542) SingleSource/Benchmarks/Shootout-C++/lists: -3.39% (17.2182 => 16.6350, std.dev.: 0.0897) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.37% (1.0995 => 1.0734, std.dev.: 0.0054) MultiSource/Applications/spiff/spiff: -1.96% (2.8571 => 2.8012, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -1.94% (7.2040 => 7.0645, std.dev.: 0.0392) SingleSource/Benchmarks/Misc/mandel-2: -1.80% (0.8521 => 0.8368, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.75% (8.7327 => 8.5795, std.dev.: 0.0280) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.68% (85.3042 => 83.8727, std.dev.: 0.0956) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.58% (3.5669 => 3.5107, std.dev.: 0.0175) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.49% (1.4446 => 1.4231, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (3.7450 => 3.7016, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7489, std.dev.: 0.0208) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.75% (1.2047 => 1.2137, std.dev.: 0.0365) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.58% (0.0233 => 0.0220, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0094) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/casts: -4.23% (0.0213 => 0.0204, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.50% (0.1530 => 0.1507, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -41.38% (1.9293 => 1.1309, std.dev.: 0.0532) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.84% (0.4049 => 0.3934, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.19% (0.1510 => 0.1477, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.42% (0.0978 => 0.0612, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.64% (0.0590 => 0.0539, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.72% (1.1617 => 1.3908, std.dev.: 0.0186) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.03% (0.0610 => 0.0561, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.48% (0.7437 => 1.7438, std.dev.: 0.0304) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -9.78% (0.0092 => 0.0083, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 160.96% (12.7781 => 33.3459, std.dev.: 0.6505) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 23:00:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 01:00:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127070044.ABD832A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7995?compare_to=7992&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7995, Order: 173608, Start Time: 2013-01-27 05:27:09, End Time: 2013-01-27 07:01:02 To: 7992, Order: 173605, Start Time: 2013-01-27 03:29:42, End Time: 2013-01-27 05:03:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (120 on baseline) Performance Improvements: 0 (88 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 8.97% (0.4068 => 0.4433, std.dev.: 0.0104) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.71% (1.2702 => 1.2919, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 87.14% (0.0280 => 0.0524, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.30% (0.0974 => 0.1649, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.60% (0.1500 => 0.2199, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.17% (0.6395 => 0.8836, std.dev.: 0.0078) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.95% (0.5805 => 0.7718, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.81% (0.5688 => 0.7554, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.49% (0.6260 => 0.8294, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.35% (0.5456 => 0.7221, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.23% (0.5567 => 0.7361, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.07% (0.5849 => 0.7725, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.01% (0.6395 => 0.8442, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.84% (0.5575 => 0.7350, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.71% (0.5581 => 0.7351, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.79% (0.5941 => 0.7770, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.28% (0.6033 => 0.7860, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.28% (0.5859 => 0.7633, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.63% (0.6440 => 0.8348, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.13% (1.6474 => 2.1273, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.87% (0.6189 => 0.7976, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.73% (0.6676 => 0.8594, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.97% (0.6304 => 0.8067, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.69% (0.6230 => 0.7955, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.98% (0.6660 => 0.8457, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.96% (0.5802 => 0.7366, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.52% (0.0445 => 0.0563, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.50% (0.5925 => 0.7495, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.42% (0.5705 => 0.7212, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.12% (0.5857 => 0.7387, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.82% (0.5569 => 0.7007, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.73% (0.5570 => 0.7003, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.67% (0.5478 => 0.6884, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.31% (0.5591 => 0.7006, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.18% (0.0699 => 0.0875, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.40% (0.7524 => 0.9360, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.12% (0.6052 => 0.7512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.12% (0.5863 => 0.7277, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.09% (0.6446 => 0.7999, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.71% (0.6681 => 0.8265, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.02% (0.6194 => 0.7620, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.77% (0.6297 => 0.7731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.08% (2.2587 => 2.7575, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.54% (0.6667 => 0.8103, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.88% (0.7339 => 0.8798, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.79% (0.3357 => 0.3887, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.62% (0.3834 => 0.4433, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 15.34% (1.1450 => 1.3207, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.58% (0.0864 => 0.0990, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (4.5069 => 5.0831, std.dev.: 0.0093) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.63% (0.4916 => 0.5537, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 12.45% (0.4515 => 0.5077, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.94% (1.6364 => 1.8318, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.80% (3.5339 => 3.9510, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.20% (0.1982 => 0.2204, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.52% (0.2385 => 0.2636, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.00% (0.1230 => 0.1353, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.93% (9.2283 => 10.1448, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.24% (0.1731 => 0.1891, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.82% (1.2515 => 1.3619, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.73% (0.4524 => 0.4919, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.41% (0.5329 => 0.5777, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.7021 => 0.7569, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.76% (0.4861 => 0.5238, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.63% (1.4642 => 1.5759, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.13% (1.2784 => 1.3695, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 7.08% (0.1879 => 0.2012, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1761 => 0.1876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (0.3255 => 0.3459, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.01% (0.6750 => 0.7156, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.72% (0.3319 => 0.3509, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.56% (5.4682 => 5.7175, std.dev.: 0.0235) MultiSource/Applications/oggenc/oggenc: 3.80% (5.0226 => 5.2137, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.39% (1.3864 => 1.4334, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.33% (0.8418 => 0.8698, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 3.27% (0.3394 => 0.3505, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.78% (0.9557 => 0.9823, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 2.66% (0.7447 => 0.7645, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.64% (0.4427 => 0.4544, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5168 => 0.5304, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.47% (22.4056 => 22.9587, std.dev.: 0.0088) MultiSource/Applications/SPASS/SPASS: 2.24% (15.5079 => 15.8551, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.14% (1.3722 => 1.4016, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.20% (1.2300 => 1.2447, std.dev.: 0.0025) MultiSource/Applications/d/make_dparser: 1.15% (3.5154 => 3.5558, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8053, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.18% (11.6767 => 12.1650, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.84% (54.5751 => 56.6735, std.dev.: 0.0315) SingleSource/Benchmarks/Misc-C++/bigfib: 3.13% (0.3328 => 0.3432, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.87% (2.0478 => 2.1066, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.53% (27.8210 => 28.2470, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (18.2231 => 18.5001, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2707, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.06% (79.7170 => 80.5641, std.dev.: 0.1001) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.89% (0.7198 => 0.6918, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.74% (2.4924 => 2.3991, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.69% (0.3821 => 0.3680, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.46% (0.3812 => 0.3680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.39% (0.3831 => 0.3701, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.37% (0.3884 => 0.3753, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.34% (0.3837 => 0.3709, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.27% (0.3848 => 0.3722, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.22% (0.4033 => 0.3903, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.19% (0.3891 => 0.3767, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.18% (0.9852 => 0.9539, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.17% (0.3880 => 0.3757, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: -3.16% (0.4176 => 0.4044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.16% (0.3896 => 0.3773, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.73% (0.6347 => 0.6174, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -2.69% (0.6441 => 0.6268, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.53% (20.7746 => 20.2480, std.dev.: 0.0750) MultiSource/Applications/hexxagon/hexxagon: -2.46% (1.3148 => 1.2825, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.34% (2.1713 => 2.1204, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.28% (0.6484 => 0.6336, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.08% (0.9542 => 0.9344, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.90% (14.2083 => 13.9385, std.dev.: 0.0170) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7779 => 0.7646, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: -1.67% (17.1032 => 16.8168, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (6.7716 => 6.6912, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: -1.08% (16.1920 => 16.0176, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.06% (1.0544 => 1.0432, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.93% (1.8100 => 0.6890, std.dev.: 0.0239) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0278, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0041) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0744, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1970, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1270, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3538, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.09% (0.3273 => 0.3139, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.87% (2.2633 => 2.1756, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.28% (5.5807 => 5.3976, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7779, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1724, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4731, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7092 => 3.6557, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.42% (1.6307 => 1.6075, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.26% (1.6219 => 1.6014, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 23:06:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 01:06:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130127070658.7BA252A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7996?compare_to=7989&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 7996, Order: 173603, Start Time: 2013-01-27 03:33:21, End Time: 2013-01-27 07:07:16 To: 7989, Order: 173592, Start Time: 2013-01-26 23:06:32, End Time: 2013-01-27 02:40:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (181 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.03% (2.4078 => 2.4327, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.36% (54.0883 => 54.8215, std.dev.: 0.0463) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.90% (0.6143 => 0.6026, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.08% (0.0625 => 0.0913, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.94% (0.1063 => 0.1445, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.63% (0.2969 => 0.3819, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.01% (0.0714 => 0.0914, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.98% (0.4139 => 0.5297, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.42% (0.0547 => 0.0697, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 26.75% (1.5932 => 2.0194, std.dev.: 0.0113) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.74% (0.0475 => 0.0602, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.68% (0.5900 => 0.7474, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.49% (0.4994 => 0.6317, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.88% (0.0541 => 0.0681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.77% (0.4253 => 0.5349, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.37% (0.1620 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.34% (0.5000 => 0.6267, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.17% (0.1021 => 0.1278, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.17% (0.0584 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 24.71% (0.0599 => 0.0747, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.48% (0.1107 => 0.1378, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.97% (0.0584 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.97% (0.0897 => 0.1112, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.69% (0.1549 => 0.1916, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/05-eks/eks: 23.66% (0.1619 => 0.2002, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.03% (0.1003 => 0.1234, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.99% (0.0822 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.94% (0.1103 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 22.78% (0.0821 => 0.1008, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.76% (0.1604 => 0.1969, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.34% (0.3903 => 0.4775, std.dev.: 0.0067) MultiSource/Applications/viterbi/viterbi: 21.54% (0.0947 => 0.1151, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 21.40% (0.1505 => 0.1827, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.71% (0.2014 => 0.2431, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 20.69% (0.1218 => 0.1470, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.50% (0.1088 => 0.1311, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.45% (0.1462 => 0.1761, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/mst/mst: 20.34% (0.0698 => 0.0840, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 20.30% (0.4029 => 0.4847, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.20% (0.2866 => 0.3445, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.15% (0.3890 => 0.4674, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.92% (0.2736 => 0.3281, std.dev.: 0.0104) SingleSource/UnitTests/ObjC++/Hello: 19.45% (0.5826 => 0.6959, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 19.41% (0.5889 => 0.7032, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.40% (1.3152 => 1.5703, std.dev.: 0.0071) MultiSource/Benchmarks/MallocBench/gs/gs: 19.28% (1.8794 => 2.2418, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.97% (3.5627 => 4.2386, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.96% (1.6211 => 1.9284, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 18.88% (0.5546 => 0.6593, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.86% (0.3271 => 0.3888, std.dev.: 0.0133) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.50% (0.1968 => 0.2332, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.33% (0.4658 => 0.5512, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.21% (0.0582 => 0.0688, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 18.13% (0.2813 => 0.3323, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 18.10% (0.2823 => 0.3334, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.98% (0.2875 => 0.3392, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.93% (0.5026 => 0.5927, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/bh/bh: 17.91% (0.1284 => 0.1514, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.78% (0.9697 => 1.1421, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.70% (0.4361 => 0.5133, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.67% (0.2750 => 0.3236, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.66% (0.2792 => 0.3285, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.61% (0.2811 => 0.3306, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.59% (0.2780 => 0.3269, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.52% (1.0781 => 1.2670, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/property-reference: 17.49% (0.7171 => 0.8425, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.48% (0.3930 => 0.4617, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 17.36% (0.2725 => 0.3198, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 17.30% (0.2803 => 0.3288, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.28% (0.2911 => 0.3414, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.26% (0.2729 => 0.3200) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.24% (0.2738 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.16% (2.0673 => 2.4220, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 17.08% (0.3004 => 0.3517, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.06% (0.3195 => 0.3740, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.05% (2.7292 => 3.1946, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.90% (1.9694 => 2.3022, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 16.83% (0.3096 => 0.3617, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.79% (4.2109 => 4.9177, std.dev.: 0.0218) MultiSource/Applications/hexxagon/hexxagon: 16.78% (0.9909 => 1.1572, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.65% (1.9966 => 2.3291, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: 16.65% (0.3267 => 0.3811, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 16.63% (0.3469 => 0.4046, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 16.63% (0.3446 => 0.4019, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 16.57% (0.3258 => 0.3798, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.57% (0.3060 => 0.3567, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-4: 16.42% (0.3465 => 0.4034, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 16.39% (0.3496 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.37% (0.3488 => 0.4059, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 16.37% (0.3678 => 0.4280, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/trivial-interface: 16.33% (0.3442 => 0.4004, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.31% (0.3317 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 16.30% (0.3460 => 0.4024, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 16.29% (0.2566 => 0.2984, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 16.28% (0.3477 => 0.4043, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.17% (0.3124 => 0.3629, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 16.14% (0.3650 => 0.4239, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.12% (4.4195 => 5.1318, std.dev.: 0.0226) SingleSource/Benchmarks/Shootout-C++/sieve: 16.10% (0.3726 => 0.4326, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.97% (0.3362 => 0.3899, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.97% (0.3282 => 0.3806, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 15.95% (0.3348 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 15.87% (0.3724 => 0.4315, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 15.87% (23.5202 => 27.2521, std.dev.: 0.0350) SingleSource/UnitTests/ObjC/exceptions: 15.87% (0.3643 => 0.4221, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 15.85% (1.4269 => 1.6530, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 15.78% (0.3625 => 0.4197, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.58% (0.3845 => 0.4444, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.42% (0.3981 => 0.4595, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.39% (0.3690 => 0.4258, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 15.36% (0.4251 => 0.4904, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.29% (0.4146 => 0.4780, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 14.68% (0.7875 => 0.9031, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 14.49% (0.5012 => 0.5738, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 13.93% (5.5417 => 6.3139, std.dev.: 0.0069) MultiSource/Applications/JM/ldecod/ldecod: 13.77% (2.1653 => 2.4635, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 13.58% (4.6177 => 5.2446, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.52% (0.1028 => 0.1167, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 13.42% (0.2691 => 0.3052, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.35% (0.6435 => 0.7294, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 13.34% (2.1013 => 2.3817, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.30% (0.2737 => 0.3101, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 13.25% (0.2075 => 0.2350, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.96% (0.2068 => 0.2336, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.13% (0.3084 => 0.3458, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.81% (0.2040 => 0.2281, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.52% (0.3498 => 0.3901, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.46% (0.2103 => 0.2344, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 11.24% (0.3336 => 0.3711, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 11.18% (0.6634 => 0.7376, std.dev.: 0.0082) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.14% (0.5361 => 0.5958, std.dev.: 0.0071) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.10% (11.6398 => 12.9321, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: 11.04% (0.4847 => 0.5382, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.34% (0.1383 => 0.1526, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.95% (0.7426 => 0.8165, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.66% (4.6926 => 5.1458, std.dev.: 0.0140) MultiSource/Applications/lemon/lemon: 9.49% (0.2391 => 0.2618, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.11% (2.0346 => 2.2199, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.92% (0.5584 => 0.6026, std.dev.: 0.0038) MultiSource/Applications/kimwitu++/kc: 7.64% (11.9555 => 12.8692, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.01% (0.3792 => 0.4058, std.dev.: 0.0028) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.62% (29.0505 => 181.4545, std.dev.: 0.0336) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.53% (0.3693 => 0.4008, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6111, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2390, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6711, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6828, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-2: 4.44% (1.8057 => 1.8859, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5014, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.04% (15.8721 => 16.1956, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3088, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2900, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0799, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2082, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5851, std.dev.: 0.0274) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.01% (10.3705 => 10.4756, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.76% (2.4764 => 2.4327, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5862, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.28% (17.2379 => 14.2585, std.dev.: 0.0987) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -8.08% (0.2402 => 0.2208, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9782, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7963, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -6.16% (14.0481 => 13.1821, std.dev.: 0.2231) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2135, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2415, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8054, std.dev.: 0.0090) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1357, std.dev.: 0.0573) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5706, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1762, std.dev.: 0.0644) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0460, std.dev.: 0.0054) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sat Jan 26 23:46:59 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 01:46:59 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127074659.BA5E72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7997?compare_to=7994&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 7997, Order: 173608, Start Time: 2013-01-27 05:45:25, End Time: 2013-01-27 07:47:20 To: 7994, Order: 173605, Start Time: 2013-01-27 03:24:40, End Time: 2013-01-27 05:28:16 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 11 (73 on baseline) Performance Improvements: 11 (85 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1042 (905 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.83% (0.6558 => 0.6809, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.54% (0.3245 => 0.3360, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.65% (1.9877 => 2.0205, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.61% (1.0591 => 1.0762, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.20% (1.4586 => 1.8554, std.dev.: 0.0175) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.20% (0.7724 => 0.8666, std.dev.: 0.0229) MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.06% (2.3605 => 2.5744, std.dev.: 0.0684) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.48% (1.4979 => 1.5949, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.29% (8.0660 => 8.5730, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.96% (4.8406 => 5.0809, std.dev.: 0.0398) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.46% (4.0929 => 4.2345, std.dev.: 0.0278) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.82% (0.4487 => 0.4136, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.99% (0.3946 => 0.3670, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.19% (0.7128 => 0.6758, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.94% (1.1570 => 1.0999, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/mason/mason: -4.27% (0.5572 => 0.5334, std.dev.: 0.0079) MultiSource/Benchmarks/Olden/health/health: -3.86% (0.3549 => 0.3412, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: -3.67% (4.1746 => 4.0214, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.41% (1.4231 => 1.3888, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.16% (0.9874 => 0.9661, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.93% (5.9787 => 5.8633, std.dev.: 0.0332) MultiSource/Benchmarks/Olden/em3d/em3d: -1.00% (4.9420 => 4.8925, std.dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.14% (1.2137 => 1.2120, std.dev.: 0.0840) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.36% (0.0220 => 0.0195, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0434 => 0.0433, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -17.80% (0.0337 => 0.0277, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0318 => 0.0321, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0432 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -16.67% (0.0204 => 0.0170, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0221 => 0.0220, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.44% (0.0229 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.40% (0.1507 => 0.1513, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: 1.26% (1.1309 => 1.1451, std.dev.: 0.3286) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.35% (0.3934 => 0.4105, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.39% (0.1477 => 0.1527, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.29% (0.0612 => 0.0598, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.11% (0.0539 => 0.0533, std.dev.: 0.0074) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.47% (1.3908 => 1.3147, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -48.28% (0.0029 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -69.23% (0.0026 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.46% (0.0561 => 0.0586, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.60% (0.0374 => 0.0368, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.08% (1.7438 => 1.7452, std.dev.: 0.0126) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -37.35% (0.0083 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.88% (33.3459 => 33.9744, std.dev.: 0.3451) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.60% (0.0336 => 0.1682, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 109.56% (0.0293 => 0.0614, std.dev.: 0.0017) SingleSource/Regression/C/sumarray2d: 85.40% (0.0274 => 0.0508, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 60.44% (0.1638 => 0.2628, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 58.49% (0.0265 => 0.0420, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.80% (0.8893 => 1.2699, std.dev.: 0.1322) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.98% (0.9588 => 1.3613, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.96% (0.9061 => 1.2772, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.53% (0.9612 => 1.3508, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.97% (0.9998 => 1.3994, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.87% (0.9381 => 1.3121, std.dev.: 0.0660) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.63% (0.9564 => 1.3354, std.dev.: 0.1066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.97% (0.8990 => 1.2493, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.58% (0.9091 => 1.2598, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.22% (0.9855 => 1.3622, std.dev.: 0.1055) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.54% (0.9422 => 1.2959, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.20% (0.9403 => 1.2901, std.dev.: 0.1209) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.84% (0.9010 => 1.2329, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.34% (0.9512 => 1.2969, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.03% (1.0119 => 1.3765, std.dev.: 0.0836) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.00% (0.8736 => 1.1881, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.88% (0.8732 => 1.1865, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.81% (1.0867 => 1.4758, std.dev.: 0.1445) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.96% (1.0052 => 1.3566, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.73% (0.8846 => 1.1918, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.78% (0.9867 => 1.3101, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.63% (0.9685 => 1.2845, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.07% (0.9405 => 1.2421, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.45% (0.9507 => 1.2497, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.62% (0.9127 => 1.1922, std.dev.: 0.0725) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.87% (0.9993 => 1.2978, std.dev.: 0.0833) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.80% (1.0860 => 1.3771, std.dev.: 0.0843) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.09% (0.0738 => 0.0901, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.94% (0.0669 => 0.0789, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 17.57% (0.3598 => 0.4230, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.61% (0.0963 => 0.1123, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1240 => 0.1420, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.67% (0.0783 => 0.0890, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 12.26% (9.5202 => 10.6875, std.dev.: 0.0363) SingleSource/Benchmarks/Shootout-C++/matrix: 10.61% (0.2385 => 0.2638, std.dev.: 0.0021) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.49% (0.4596 => 0.5078, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 10.34% (0.2050 => 0.2262, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.24% (0.2577 => 0.2841, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.90% (0.1955 => 0.2129, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.69% (5.0381 => 5.4760, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.33% (1.8651 => 2.0205, std.dev.: 0.0115) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106400.00% (0.0008 => 0.8520, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: 349.25% (1.5825 => 7.1094, std.dev.: 0.0515) SingleSource/Benchmarks/Shootout/ary3: 264.62% (2.2304 => 8.1325, std.dev.: 1.7066) MultiSource/Applications/sgefa/sgefa: 258.58% (0.3515 => 1.2604, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.40% (1.1825 => 4.0607, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 227.96% (4.8185 => 15.8028, std.dev.: 0.1275) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 188.60% (0.0228 => 0.0658, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 182.95% (0.0129 => 0.0365, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 144.40% (0.0232 => 0.0567, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/matrix: 62.58% (2.9083 => 4.7282, std.dev.: 0.0699) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.86% (0.2562 => 0.3404, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.14% (3.1254 => 4.0986, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.41% (5.6033 => 6.9152, std.dev.: 0.3632) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 22.78% (1.4588 => 1.7911, std.dev.: 0.0400) SingleSource/Benchmarks/Misc/salsa20: 21.91% (7.4497 => 9.0818, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.41% (4.8112 => 5.7930, std.dev.: 0.1926) SingleSource/Regression/C/uint64_to_float: 15.26% (1.5397 => 1.7747, std.dev.: 0.0782) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8559, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6498, std.dev.: 0.0855) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (3.6477 => 3.9756, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.81% (0.6211 => 0.6758, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 8.12% (8.6447 => 9.3465, std.dev.: 0.0384) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (4.7473 => 5.0809, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.39% (4.1836 => 4.4090, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2297, std.dev.: 0.0589) SingleSource/Benchmarks/Misc/pi: 3.36% (2.1390 => 2.2108, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8631, std.dev.: 0.0122) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.87% (0.0808 => 0.0502, std.dev.: 0.0036) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.46% (0.0692 => 0.0502, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -25.74% (0.1888 => 0.1402, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: -19.53% (1.8964 => 1.5261, std.dev.: 0.0581) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.79% (0.0676 => 0.0549, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.14% (0.1009 => 0.0826, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.61% (0.1079 => 0.0889, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.19% (0.7686 => 0.6595, std.dev.: 0.0214) MultiSource/Benchmarks/VersaBench/dbms/dbms: -12.41% (1.0960 => 0.9600, std.dev.: 0.0326) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.30% (0.0862 => 0.0756, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -9.69% (1.5979 => 1.4431, std.dev.: 0.0188) MultiSource/Applications/treecc/treecc: -9.58% (2.4719 => 2.2351, std.dev.: 0.0494) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.50% (0.4074 => 0.3687, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: -7.64% (0.1610 => 0.1487, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -7.55% (2.6437 => 2.4440, std.dev.: 0.0283) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.51% (0.9124 => 0.8439, std.dev.: 0.0088) MultiSource/Applications/sqlite3/sqlite3: -7.43% (17.5634 => 16.2576, std.dev.: 0.5044) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.25% (1.0234 => 0.9492, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.23% (10.2703 => 9.5279, std.dev.: 0.0416) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.03% (0.6885 => 0.6401, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.83% (0.2283 => 0.2127, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -6.82% (1.3979 => 1.3025, std.dev.: 0.0341) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.54% (0.3560 => 0.3327, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.40% (1.1498 => 1.0762, std.dev.: 0.0063) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.04% (0.9588 => 0.9009, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/fibo: -6.03% (0.2006 => 0.1885, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.93% (0.5746 => 0.5405, std.dev.: 0.0084) MultiSource/Applications/d/make_dparser: -5.70% (3.7840 => 3.5685, std.dev.: 0.0659) MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.41% (0.2884 => 0.2728, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.70% (0.2618 => 0.2495, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -4.70% (0.4002 => 0.3814, std.dev.: 0.0058) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.79% (11.5523 => 3.9517, std.dev.: 0.0535) SingleSource/Benchmarks/Misc/fp-convert: -61.98% (15.6525 => 5.9504, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.32% (0.4146 => 0.1811, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.41% (0.4578 => 0.2362, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.10% (11.3868 => 6.3647, std.dev.: 0.0653) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.84% (5.4023 => 3.6281, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: -31.23% (0.9372 => 0.6445, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.23% (0.4452 => 0.3106, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -30.04% (4.4739 => 3.1298, std.dev.: 0.4138) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.37% (0.5495 => 0.4046, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.18% (5.2605 => 3.8834, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.06% (4.4467 => 3.3325, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.82% (0.5826 => 0.4380, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.54% (0.5897 => 0.4450, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.39% (4.9921 => 3.8246, std.dev.: 0.0200) SingleSource/Benchmarks/Shootout-C++/ary3: -23.24% (1.8123 => 1.3912, std.dev.: 0.1093) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.10% (0.1164 => 0.0930, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/ft/ft: -19.88% (1.0816 => 0.8666, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.38% (5.8755 => 4.7954, std.dev.: 0.0976) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.42% (16.6791 => 14.2743, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.31% (7.0016 => 6.0697, std.dev.: 0.1320) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.25% (0.0845 => 0.0733, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.19% (3.1921 => 2.7712, std.dev.: 0.0537) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.51% (9.7992 => 8.5730, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9938, std.dev.: 0.0172) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.54% (2.8778 => 2.5744, std.dev.: 0.0684) SingleSource/Benchmarks/Shootout/hash: -10.29% (4.5259 => 4.0601, std.dev.: 0.1006) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.07% (0.4081 => 0.3670, std.dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.58% (0.3217 => 0.2973, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.39% (4.2843 => 3.9676, std.dev.: 0.0186) MultiSource/Benchmarks/Olden/health/health: -6.62% (0.3654 => 0.3412, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2272, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2484, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.58% (4.9799 => 4.7020, std.dev.: 0.0715) SingleSource/Benchmarks/McGill/queens: -5.35% (1.7443 => 1.6509, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (3.6768 => 3.5015, std.dev.: 0.0278) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.70% (3.7662 => 3.5892, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.58% (23.3986 => 22.3279, std.dev.: 0.3719) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.35% (3.5127 => 3.3598, std.dev.: 0.0512) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.86% (1.4446 => 1.3888, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4361, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (5.8973 => 5.6820, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/lists: -3.49% (17.2182 => 16.6177, std.dev.: 0.1480) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.12% (0.3201 => 0.3101, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.99% (0.3406 => 0.3304, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: -2.21% (2.8571 => 2.7940, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.00% (3.5669 => 3.4956, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5762, std.dev.: 0.0066) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (85.3042 => 83.8826, std.dev.: 0.2691) SingleSource/Benchmarks/Misc/whetstone: -1.63% (1.6251 => 1.5986, std.dev.: 0.0084) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.8249 => 8.6822, std.dev.: 0.0361) SingleSource/Benchmarks/Stanford/FloatMM: -1.32% (0.8328 => 0.8218, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.07% (5.9063 => 5.8431, std.dev.: 0.0158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.61% (1.2047 => 1.2120, std.dev.: 0.0840) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.31% (0.0233 => 0.0195, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -29.70% (0.0394 => 0.0277, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/casts: -20.19% (0.0213 => 0.0170, std.dev.: 0.0046) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.11% (0.1530 => 0.1513, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: -40.65% (1.9293 => 1.1451, std.dev.: 0.3286) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.38% (0.4049 => 0.4105, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.13% (0.1510 => 0.1527, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.85% (0.0978 => 0.0598, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.80% (0.0276 => 0.0191, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.66% (0.0590 => 0.0533, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.17% (1.1617 => 1.3147, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -53.12% (0.0032 => 0.0015, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.93% (0.0610 => 0.0586, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.31% (0.0268 => 0.0368, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.66% (0.7437 => 1.7452, std.dev.: 0.0126) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.48% (0.0092 => 0.0052, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.88% (12.7781 => 33.9744, std.dev.: 0.3451) Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 00:01:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 02:01:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127080122.835322A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/7998?compare_to=7993&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 7998, Order: 173608, Start Time: 2013-01-27 05:50:21, End Time: 2013-01-27 08:01:40 To: 7993, Order: 173603, Start Time: 2013-01-27 03:08:46, End Time: 2013-01-27 05:19:50 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.58% (0.6533 => 0.6767, std.dev.: 0.0082) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.95% (10.9464 => 10.7324, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.20% (10.3505 => 10.2260, std.dev.: 0.0082) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0665 => 0.0665, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8572 => 499.8291, std.dev.: 0.0143) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44222.88% (1.1277 => 499.8291, std.dev.: 0.0143) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.07% (0.5229 => 1.6475, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 20.61% (14.9895 => 18.0792, std.dev.: 0.0078) MultiSource/Applications/kimwitu++/kc: 45.00% (14.1553 => 20.5245, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/gs/gs: 18.29% (4.1105 => 4.8625, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.36% (1.1048 => 1.7275, std.dev.: 0.0029) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 421.83% (7.1582 => 37.3539, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.75% (3.4629 => 6.4668, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.94% (0.6222 => 1.0947, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10229.44% (0.0720 => 7.4372, std.dev.: 0.0064) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11159500.00% (0.0001 => 11.1596, std.dev.: 0.0270) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494200.00% (0.0001 => 5.4943, std.dev.: 0.0212) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.53% (1.1194 => 10.2260, std.dev.: 0.0082) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.25% (22.1758 => 54.8294, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/lowercase: 123.05% (0.0256 => 0.0571, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.77% (0.0929 => 0.1828, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 86.83% (0.0243 => 0.0454, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 71.29% (0.1463 => 0.2506) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.72% (2.9384 => 4.6050, std.dev.: 0.0018) SingleSource/Regression/C/sumarray: 53.25% (0.0231 => 0.0354, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.11% (7.0540 => 10.7295, std.dev.: 0.0460) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.89% (1.5859 => 2.4088, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 48.01% (0.1056 => 0.1563, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.41% (0.0232 => 0.0342, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.30% (8.1363 => 11.9034, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.20% (2.2024 => 3.1319, std.dev.: 0.0062) MultiSource/Applications/sgefa/sgefa: 39.79% (0.3109 => 0.4346, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0000) SingleSource/UnitTests/vla: 37.75% (0.0355 => 0.0489, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 37.71% (21.9371 => 30.2091, std.dev.: 0.0199) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 37.08% (0.1432 => 0.1963, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.19% (4.2646 => 5.6799, std.dev.: 0.0157) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.48% (0.4615 => 0.6114, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.12% (1.5415 => 2.0366, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.10% (0.1143 => 0.1487, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 29.75% (1.1642 => 1.5106, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/05-eks/eks: 29.52% (0.4299 => 0.5568, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.44% (0.0479 => 0.0620, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 28.30% (0.0636 => 0.0816, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.17% (0.5105 => 0.6543, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.74% (0.0793 => 0.1013, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.58% (0.6675 => 0.8516, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.02% (0.1584 => 0.2012, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 26.95% (0.1655 => 0.2101, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.49% (0.1125 => 0.1423, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.48% (0.1892 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.30% (0.0730 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 26.03% (9.4845 => 11.9532, std.dev.: 0.2204) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.8922 => 4.9042, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 25.84% (0.2554 => 0.3214, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.60% (0.0746 => 0.0937, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 24.99% (0.4289 => 0.5361, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.52% (0.1566 => 0.1950, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 24.52% (1.0722 => 1.3351, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.32% (0.3121 => 0.3880, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/tsp/tsp: 24.26% (0.1175 => 0.1460, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.16% (1.4186 => 1.7614, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 23.96% (0.4620 => 0.5727, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.89% (0.1695 => 0.2100, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.64% (0.1337 => 0.1653, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 23.33% (0.6456 => 0.7962, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 23.04% (0.7115 => 0.8754, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 22.66% (0.0662 => 0.0812, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.09% (0.1236 => 0.1509, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.07% (0.0675 => 0.0824, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.80% (0.1555 => 0.1894, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/lists: 21.73% (0.0626 => 0.0762, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.70% (0.2700 => 0.3286, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 21.43% (0.3098 => 0.3762, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 21.21% (0.7835 => 0.9497, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.90% (0.0842 => 0.1018, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.84% (1.3050 => 1.5769, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 20.76% (0.1151 => 0.1390, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.36% (0.0953 => 0.1147, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 20.28% (5.7591 => 6.9273, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.25% (0.1032 => 0.1241, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.12% (0.1163 => 0.1397, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 20.03% (0.0614 => 0.0737, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.98% (0.0871 => 0.1045, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.95% (0.1940 => 0.2327, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.86% (0.5860 => 0.7024, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.65% (4.9449 => 5.9165, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.46% (0.5020 => 0.5997, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.42% (0.8172 => 0.9759, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.41% (0.3307 => 0.3949, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 18.86% (0.7433 => 0.8835, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.78% (5.0018 => 5.9411, std.dev.: 0.0079) MultiSource/Applications/d/make_dparser: 18.70% (3.3354 => 3.9590, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.56% (0.2758 => 0.3270, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.05% (0.5569 => 0.6574, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.02% (0.9765 => 1.1525, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.90% (0.1268 => 0.1495, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/five11/five11: 17.81% (0.0567 => 0.0668, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.75% (0.1510 => 0.1778, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.66% (2.0273 => 2.3854, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 17.65% (3.8723 => 4.5559, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 17.57% (1.1840 => 1.3920, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.51% (0.4203 => 0.4939, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.42% (0.2107 => 0.2474, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.37% (0.1117 => 0.1311, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 17.28% (2.2969 => 2.6938, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 17.24% (0.3423 => 0.4013, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.15% (0.0933 => 0.1093, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.15% (0.1044 => 0.1223, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.04% (0.5981 => 0.7000, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 16.98% (1.1861 => 1.3875, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.90% (0.2065 => 0.2414, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.88% (0.0770 => 0.0900, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.80% (0.3232 => 0.3775, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 16.64% (0.2049 => 0.2390, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.62% (0.3441 => 0.4013, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.43% (0.8101 => 0.9432, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.16% (0.6450 => 0.7492, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 15.60% (0.3180 => 0.3676, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.26% (0.8921 => 1.0282, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary2: 15.03% (0.3379 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.50% (0.8067 => 0.9237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.28% (0.3865 => 0.4417, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.25% (0.2603 => 0.2974, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.04% (0.4636 => 0.5287, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0000) SingleSource/Regression/C++/ofstream_ctor: 13.67% (0.2905 => 0.3302, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.50% (0.4103 => 0.4657, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 13.17% (0.3387 => 0.3833, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 13.07% (1.5603 => 1.7643, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 12.57% (0.3603 => 0.4056, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.50% (0.4048 => 0.4554, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists: 12.33% (0.3422 => 0.3844, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 12.00% (0.3684 => 0.4126, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.98% (0.2430 => 0.2721, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 11.86% (17.1811 => 19.2188, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3826 => 0.4263, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 11.35% (0.3092 => 0.3443, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.31% (0.1114 => 0.1240, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 11.15% (0.3282 => 0.3648, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.15% (0.4064 => 0.4517, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/parameter-passing: 10.72% (0.3927 => 0.4348, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.56% (0.3427 => 0.3789, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/except: 10.55% (0.2871 => 0.3174, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2831 => 0.3123, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.21% (14.3668 => 15.8343, std.dev.: 0.0131) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.75% (2.0665 => 2.2680, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 9.52% (0.2877 => 0.3151, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.36% (0.3162 => 0.3458, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 9.35% (0.3828 => 0.4186, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.24% (0.2793 => 0.3051, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 9.24% (1.2842 => 1.4028, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.18% (0.3650 => 0.3985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.17% (0.2725 => 0.2975, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.06% (0.2714 => 0.2960, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.06% (0.2891 => 0.3153, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.95% (0.3543 => 0.3860, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 8.73% (0.3561 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 8.72% (0.3694 => 0.4016, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 8.72% (0.3052 => 0.3318, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.71% (0.2756 => 0.2996, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.70% (0.2872 => 0.3122, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.70% (0.3473 => 0.3775, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.67% (0.3935 => 0.4276, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.64% (0.2802 => 0.3044, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 8.62% (0.3516 => 0.3819, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 8.61% (0.3543 => 0.3848, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.51% (0.3136 => 0.3403, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 8.32% (63.2438 => 68.5033, std.dev.: 0.0250) SingleSource/UnitTests/ObjC++/property-reference-object: 7.99% (0.6030 => 0.6512, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.92% (0.7326 => 0.7906, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 7.53% (0.5925 => 0.6371, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.14% (0.1625 => 0.1741, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.90% (2.2022 => 2.3541, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.03% (0.4879 => 0.5173, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.92% (0.3177 => 0.3365, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/objinst: 4.02% (0.3131 => 0.3257, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 3.52% (10.3673 => 10.7324, std.dev.: 0.0095) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.94% (7.9617 => 8.1163, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4765, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: 9.25% (1.1396 => 1.2450, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 6.79% (0.2944 => 0.3144, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.38% (11.6436 => 12.3862, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.48% (4.2280 => 4.4598, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3124, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.3316 => 0.3445) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9226, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.07% (3.6395 => 3.7148, std.dev.: 0.0054) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.75% (9.1159 => 9.2753, std.dev.: 0.0258) MultiSource/Benchmarks/mafft/pairlocalalign: 1.65% (27.8444 => 28.3051, std.dev.: 0.0648) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4578, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1688, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.92% (5.2763 => 1.1648, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -75.45% (0.8651 => 0.2124, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.91% (5.3855 => 4.4208, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.44% (5.3526 => 4.4189, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: -13.72% (10.4361 => 9.0041, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.02% (1.7609 => 1.6197, std.dev.: 0.0024) SingleSource/UnitTests/Vector/constpool: -7.61% (54.1659 => 50.0412, std.dev.: 0.0155) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.43% (1.9577 => 0.6767, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3074, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.74% (10.7105 => 7.4180, std.dev.: 0.0094) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8593, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.31% (2.6546 => 2.0093, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.56% (0.0756 => 0.0593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.12% (0.6223 => 0.5033, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4220, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7337, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.94% (0.9540 => 0.8401, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4949, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.06% (1.8329 => 1.7035, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5800, std.dev.: 0.0251) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.09% (0.2497 => 0.2345, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: -6.00% (1.2373 => 1.1631, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6992, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8145, std.dev.: 0.0140) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.53% (0.4808 => 0.4590, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.71% (3.7221 => 3.6585, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3279, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: -1.52% (3.6994 => 3.6430, std.dev.: 0.0155) MultiSource/Applications/sqlite3/sqlite3: -1.33% (4.6441 => 4.5822, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2317, std.dev.: 0.0070) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.57% (0.2116 => 0.0665, std.dev.: 0.0001) Report Time: 1.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 01:00:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 03:00:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127090055.785642A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/7999?compare_to=7995&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 7999, Order: 173610, Start Time: 2013-01-27 07:24:25, End Time: 2013-01-27 09:01:12 To: 7995, Order: 173608, Start Time: 2013-01-27 05:27:09, End Time: 2013-01-27 07:01:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (116 on baseline) Performance Improvements: 1 (81 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (895 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.66% (0.3139 => 0.3254, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.11% (3.6677 => 3.6271, std.dev.: 0.0140) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.22% (0.0717 => 0.1242, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.51% (0.0974 => 0.1651, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 50.56% (0.0267 => 0.0402, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.67% (0.1500 => 0.2200, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.57% (0.0599 => 0.0836) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.23% (0.6395 => 0.8840, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.75% (0.5805 => 0.7706, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.70% (0.6260 => 0.8307, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.64% (0.5456 => 0.7237, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.01% (0.5849 => 0.7721, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.99% (0.6395 => 0.8441, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.99% (0.5567 => 0.7348, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.79% (0.5581 => 0.7355, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.78% (0.5575 => 0.7347, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.72% (0.5941 => 0.7766, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.23% (0.5859 => 0.7630, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.15% (0.6033 => 0.7852, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.08% (1.6474 => 2.1265, std.dev.: 0.0676) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.76% (0.6189 => 0.7969, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.62% (0.6676 => 0.8587, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.98% (0.6304 => 0.8068, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.72% (0.6230 => 0.7957, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.94% (0.6660 => 0.8454, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.92% (0.5802 => 0.7364, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.54% (0.5705 => 0.7219, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.48% (0.5925 => 0.7494, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.04% (0.5857 => 0.7382, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.87% (0.5570 => 0.7011, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.70% (0.5569 => 0.7000, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.61% (0.5478 => 0.6881, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.33% (0.5591 => 0.7007, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.26% (0.7524 => 0.9349, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.12% (0.6446 => 0.8001, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.12% (0.5863 => 0.7277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.09% (0.6052 => 0.7510, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.44% (0.6681 => 0.8247, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.17% (0.6194 => 0.7629, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.77% (0.6297 => 0.7731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.23% (2.2587 => 2.7608, std.dev.: 0.0791) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.52% (0.6667 => 0.8102, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/BoolLiteralTest: 21.10% (0.3834 => 0.4643, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.78% (0.7339 => 0.8791, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.43% (0.0566 => 0.0676, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 18.68% (0.0680 => 0.0807, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 15.76% (0.3357 => 0.3886, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 15.34% (1.1450 => 1.3207, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 14.70% (0.0864 => 0.0991, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 13.00% (0.4515 => 0.5102, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.97% (4.5069 => 5.0913, std.dev.: 0.0097) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.84% (0.4916 => 0.5547, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.03% (1.6364 => 1.8332, std.dev.: 0.0092) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.1982 => 0.2217, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.84% (3.5339 => 3.9524, std.dev.: 0.0897) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.65% (0.1230 => 0.1361, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.52% (0.2385 => 0.2636, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 9.93% (9.2283 => 10.1449, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.36% (0.1731 => 0.1893, std.dev.: 0.0038) MultiSource/Applications/Burg/burg: 9.13% (1.2515 => 1.3657, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash: 8.82% (0.4524 => 0.4923, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.59% (0.3319 => 0.3604, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.45% (0.2001 => 0.2170, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.33% (0.5329 => 0.5773, std.dev.: 0.0164) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.85% (1.4642 => 1.5792, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 7.78% (0.4861 => 0.5239, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.31% (1.2784 => 1.3719, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 7.08% (0.1879 => 0.2012, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 6.48% (0.3255 => 0.3466, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1761 => 0.1875, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.40% (5.4682 => 5.7086, std.dev.: 0.0925) MultiSource/Applications/oggenc/oggenc: 3.95% (5.0226 => 5.2209, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 3.71% (1.3864 => 1.4378, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (0.3446 => 0.3573, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3394 => 0.3515, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.37% (0.8418 => 0.8702, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.85% (0.4427 => 0.4553, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 2.66% (0.7447 => 0.7645, std.dev.: 0.0057) MultiSource/Applications/SPASS/SPASS: 2.40% (15.5079 => 15.8808, std.dev.: 0.0100) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (22.4056 => 22.9313, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.3722 => 1.4034, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.92% (0.6293 => 0.6414, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.62% (1.2300 => 1.2499, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 1.43% (2.1401 => 2.1707, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 1.18% (3.5154 => 3.5569, std.dev.: 0.0048) MultiSource/Applications/kimwitu++/kc: 1.15% (18.2933 => 18.5042, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.04% (4.0323 => 4.0741, std.dev.: 0.0046) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7948, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.18% (0.9531 => 1.0311, std.dev.: 0.0058) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 3.16% (0.3328 => 0.3433, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1031, std.dev.: 0.0186) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3822, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.60% (18.2231 => 18.5152, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: 1.54% (4.5320 => 4.6020, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.62% (0.1281 => 0.1145, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.20% (0.3194 => 0.3060, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.7198 => 0.6906, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4001, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3812 => 0.3678, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.40% (0.3880 => 0.3748, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.35% (0.3848 => 0.3719, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.34% (0.3896 => 0.3766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.17% (0.6441 => 0.6237, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.16% (0.3891 => 0.3768, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.16% (0.9852 => 0.9541, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -3.09% (0.4176 => 0.4047, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.81% (0.3884 => 0.3775, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.74% (0.3837 => 0.3732, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/property-reference: -2.48% (0.7779 => 0.7586, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.10% (0.9542 => 0.9342, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.08% (0.6484 => 0.6349, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.02% (20.7746 => 20.3542, std.dev.: 0.0117) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.96% (14.2083 => 13.9292, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.90% (2.1713 => 2.1301, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: -1.58% (17.1032 => 16.8333, std.dev.: 0.0082) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (6.7716 => 6.7015, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.07% (1.8100 => 0.6865, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0203) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3100, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.62% (1.3643 => 1.0284, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0818, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.62% (3.3454 => 2.5888, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.13% (4.1024 => 3.1947, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0050) SingleSource/UnitTests/Vector/multiplies: -15.41% (2.5106 => 2.1237, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3564, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/ary3: -2.60% (3.7241 => 3.6271, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.04% (7.9763 => 7.8133, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -1.94% (7.3040 => 7.1622, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.46% (1.6219 => 1.5983, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.09% (1.6307 => 1.6130, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 02:03:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 04:03:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127100352.D0AA32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8000?compare_to=7997&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8000, Order: 173610, Start Time: 2013-01-27 08:04:42, End Time: 2013-01-27 10:04:13 To: 7997, Order: 173608, Start Time: 2013-01-27 05:45:25, End Time: 2013-01-27 07:47:20 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (101 on baseline) Performance Improvements: 8 (136 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1051 (826 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 9.15% (48.2980 => 52.7195, std.dev.: 0.4762) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.79% (1.1972 => 1.2545, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (4.2345 => 4.3919, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.63% (2.6441 => 2.7136, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout/matrix: 1.54% (7.1094 => 7.2188, std.dev.: 0.0170) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.50% (0.1574 => 0.1456, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.11% (0.9600 => 0.9205, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.91% (1.2421 => 1.2184, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.86% (1.3128 => 1.2884, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.76% (1.2470 => 1.2250, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -4.97% (62.7332 => 59.6166, std.dev.: 0.0945) MultiSource/Applications/SIBsim4/SIBsim4: -4.81% (3.4286 => 3.2638, std.dev.: 0.0099) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.49% (1.5949 => 1.5233, std.dev.: 0.0140) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.12% (1.2120 => 1.2106, std.dev.: 0.0172) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -23.59% (0.0195 => 0.0149, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.55% (0.0433 => 0.0383, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 13.00% (0.0277 => 0.0313, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.86% (0.0430 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: 8.24% (0.0170 => 0.0184, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -14.55% (0.0220 => 0.0188, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.61% (0.0230 => 0.0201, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.45% (0.1513 => 0.1476, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -0.61% (1.1451 => 1.1381, std.dev.: 0.0533) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.24% (0.4105 => 0.4013, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.93% (0.1527 => 0.1467, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.68% (0.0598 => 0.0614, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 44.50% (0.0191 => 0.0276) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.01% (0.0533 => 0.0613, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.92% (1.3147 => 1.2894, std.dev.: 0.0516) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 93.33% (0.0015 => 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 150.00% (0.0008 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.71% (0.0586 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.09% (0.0368 => 0.0372, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.05% (1.7452 => 1.7636, std.dev.: 0.0148) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 136.54% (0.0052 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.06% (33.9744 => 33.9554, std.dev.: 0.3189) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 390.77% (0.0336 => 0.1649, std.dev.: 0.0024) SingleSource/Regression/C/sumarraymalloc: 110.58% (0.0293 => 0.0617, std.dev.: 0.0011) SingleSource/Regression/C/sumarray2d: 85.04% (0.0274 => 0.0507, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 60.93% (0.1638 => 0.2636, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 58.87% (0.0265 => 0.0421, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.64% (0.8893 => 1.2596, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.27% (0.9120 => 1.2884, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.23% (0.8926 => 1.2606, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.61% (0.9061 => 1.2741, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.20% (0.9612 => 1.3476, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.71% (0.9381 => 1.3106, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.60% (0.9564 => 1.3351, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.55% (0.9588 => 1.3380, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.32% (0.8990 => 1.2525, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.70% (0.9091 => 1.2609, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.08% (0.9855 => 1.3608, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.82% (0.9998 => 1.3779, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.60% (0.9422 => 1.2965, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.37% (0.9403 => 1.2917, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.43% (0.9010 => 1.2292, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.25% (0.9512 => 1.2960, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.72% (1.0119 => 1.3734, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.51% (0.8912 => 1.2077, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.34% (0.8736 => 1.1823, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.24% (1.0867 => 1.4696, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.65% (1.0052 => 1.3535, std.dev.: 0.0114) SingleSource/Benchmarks/Stanford/IntMM: 34.57% (0.0431 => 0.0580, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.28% (0.8732 => 1.1725, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.11% (0.8846 => 1.1863, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.60% (1.0017 => 1.3283, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.57% (0.9867 => 1.3081, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.68% (0.9788 => 1.2889, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.58% (0.9507 => 1.2509, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.34% (0.9488 => 1.2462, std.dev.: 0.0068) SingleSource/Benchmarks/McGill/exptree: 30.97% (0.0859 => 0.1125, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.40% (1.0088 => 1.3155, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.21% (0.9685 => 1.2611, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.97% (0.9127 => 1.1862, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.55% (0.9405 => 1.2184, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.41% (0.9993 => 1.2932, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.27% (0.9550 => 1.2250, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.57% (1.0860 => 1.3746, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.27% (0.0738 => 0.0895, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.70% (0.0738 => 0.0876, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 18.18% (0.3598 => 0.4252, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.13% (0.0963 => 0.1128, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.44% (0.0669 => 0.0779, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.79% (0.1332 => 0.1529, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.97% (1.0986 => 1.2521, std.dev.: 0.0096) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.54% (0.0783 => 0.0889, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.31% (0.1240 => 0.1405, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.07% (3.6295 => 4.1040, std.dev.: 0.1528) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 12.55% (0.0805 => 0.0906, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 12.17% (9.5202 => 10.6785, std.dev.: 0.1174) SingleSource/Benchmarks/Shootout-C++/matrix: 10.69% (0.2385 => 0.2640, std.dev.: 0.0029) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.12% (0.4596 => 0.5061, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2577 => 0.2829, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 9.59% (0.1793 => 0.1965, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 9.02% (0.2050 => 0.2235, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.75% (0.1955 => 0.2126, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.64% (5.0381 => 5.4734, std.dev.: 0.0262) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.41% (1.4110 => 1.5296, std.dev.: 0.0125) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.01% (0.5369 => 0.5799, std.dev.: 0.0066) SingleSource/Benchmarks/Linpack/linpack-pc: 7.87% (0.2566 => 0.2768, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.57% (1.8651 => 1.9876, std.dev.: 0.0200) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.56% (0.2879 => 0.3068, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.40% (0.2372 => 0.2500, std.dev.: 0.0023) SingleSource/Regression/C++/ofstream_ctor: 4.90% (0.2042 => 0.2142, std.dev.: 0.0022) MultiSource/Applications/oggenc/oggenc: 3.21% (5.3553 => 5.5273, std.dev.: 0.0131) SingleSource/Benchmarks/Misc-C++/bigfib: 3.14% (0.6711 => 0.6922, std.dev.: 0.0028) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.99% (44.1538 => 45.0309, std.dev.: 0.1529) MultiSource/Benchmarks/Bullet/bullet: 1.92% (33.2440 => 33.8834, std.dev.: 0.0344) MultiSource/Applications/JM/lencod/lencod: 1.04% (16.7012 => 16.8741, std.dev.: 0.0446) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106712.50% (0.0008 => 0.8545, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/matrix: 356.16% (1.5825 => 7.2188, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout/ary3: 283.69% (2.2304 => 8.5579, std.dev.: 0.2745) MultiSource/Applications/sgefa/sgefa: 259.03% (0.3515 => 1.2620, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.43% (1.1825 => 4.0256, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 225.87% (4.8185 => 15.7020, std.dev.: 0.0940) SingleSource/Benchmarks/Shootout-C++/ary2: 201.55% (0.0129 => 0.0389, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 186.84% (0.0228 => 0.0654, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 139.22% (0.0232 => 0.0555, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 63.00% (2.9083 => 4.7405, std.dev.: 0.1659) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.27% (0.2562 => 0.3440, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.26% (3.1254 => 4.1025, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 28.60% (5.6033 => 7.2058, std.dev.: 0.2798) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.06% (1.4588 => 1.8390, std.dev.: 0.0594) SingleSource/Benchmarks/Misc/salsa20: 21.78% (7.4497 => 9.0726, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.50% (4.8112 => 5.7974, std.dev.: 0.1026) SingleSource/Regression/C/uint64_to_float: 15.81% (1.5397 => 1.7831, std.dev.: 0.0737) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.12% (5.1752 => 5.8543, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6500, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.73% (3.6477 => 3.9661, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/ReedSolomon: 8.04% (8.6447 => 9.3401, std.dev.: 0.0199) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.40% (4.1668 => 4.3919, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1836 => 4.4028, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.86% (5.0310 => 5.2252, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: 3.59% (50.8945 => 52.7195, std.dev.: 0.4762) SingleSource/Benchmarks/Misc/pi: 3.24% (2.1390 => 2.2082, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.22% (4.7254 => 4.8776, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8628, std.dev.: 0.0002) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.23% (0.0808 => 0.0491, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -38.10% (0.0727 => 0.0450, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.91% (0.0692 => 0.0485, std.dev.: 0.0023) SingleSource/Benchmarks/SmallPT/smallpt: -26.38% (0.1888 => 0.1390, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0023) MultiSource/Applications/hbd/hbd: -19.78% (1.8964 => 1.5212, std.dev.: 0.0242) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.84% (0.1009 => 0.0829, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.40% (0.1684 => 0.1391, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.15% (0.7686 => 0.6445, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.01% (1.0960 => 0.9205, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.57% (0.1079 => 0.0911, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -13.85% (9.8875 => 8.5185, std.dev.: 0.1991) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -11.95% (0.0862 => 0.0759, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: -11.55% (1.0220 => 0.9040, std.dev.: 0.0077) MultiSource/Applications/hexxagon/hexxagon: -11.02% (1.1433 => 1.0173, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.92% (0.4074 => 0.3629, std.dev.: 0.0066) MultiSource/Applications/treecc/treecc: -10.90% (2.4719 => 2.2024, std.dev.: 0.0331) MultiSource/Applications/aha/aha: -10.09% (0.1378 => 0.1239, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.05% (6.4235 => 5.7777, std.dev.: 0.0234) MultiSource/Applications/Burg/burg: -9.97% (1.5979 => 1.4386, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.96% (0.1366 => 0.1230, std.dev.: 0.0013) MultiSource/Applications/lua/lua: -9.54% (4.6406 => 4.1980, std.dev.: 0.0785) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.47% (0.2481 => 0.2246, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.31% (0.7693 => 0.6977, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash2: -9.10% (0.5134 => 0.4667, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.25% (0.1587 => 0.1456, std.dev.: 0.0038) MultiSource/Applications/siod/siod: -7.70% (2.6437 => 2.4401, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.67% (0.3560 => 0.3287, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -7.59% (0.8653 => 0.7996, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.49% (1.0234 => 0.9467, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: -7.39% (17.4365 => 16.1483, std.dev.: 0.1002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -7.36% (1.1498 => 1.0652, std.dev.: 0.0104) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.34% (10.2703 => 9.5167, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.22% (0.6885 => 0.6388, std.dev.: 0.0050) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.12% (1.2154 => 1.1289, std.dev.: 0.0197) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.10% (0.9124 => 0.8476, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: -6.89% (0.1610 => 0.1499, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -6.85% (17.5634 => 16.3595, std.dev.: 0.0340) SingleSource/Benchmarks/Shootout-C++/hash: -6.72% (0.4689 => 0.4374, std.dev.: 0.0054) MultiSource/Applications/lemon/lemon: -6.70% (1.3979 => 1.3042, std.dev.: 0.0039) MultiSource/Applications/viterbi/viterbi: -6.52% (0.1824 => 0.1705, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/fibo: -6.23% (0.2006 => 0.1881, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: -5.87% (0.4002 => 0.3767, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.76% (0.9588 => 0.9036, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.69% (0.5746 => 0.5419, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/reversefile: -5.68% (0.3665 => 0.3457, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -5.62% (0.1798 => 0.1697, std.dev.: 0.0037) MultiSource/Applications/d/make_dparser: -5.56% (3.7840 => 3.5737, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.69% (0.2283 => 0.2176, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.62% (0.2618 => 0.2497, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.54% (0.2709 => 0.2586, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.42% (0.3462 => 0.3309, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.31% (1.5131 => 1.4479, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.28% (1.6874 => 1.6151, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.66% (1.3924 => 1.3414, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.49% (0.3093 => 0.2985, std.dev.: 0.0011) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.24% (1.1731 => 1.1351, std.dev.: 0.0120) MultiSource/Benchmarks/sim/sim: -2.83% (0.3715 => 0.3610, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (1.3220 => 1.2871, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: -2.08% (4.5936 => 4.4979, std.dev.: 0.0257) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.97% (14.9757 => 14.6803, std.dev.: 0.1097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.79% (7.2721 => 7.1416, std.dev.: 0.0306) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.92% (11.5523 => 3.9375, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/fp-convert: -61.60% (15.6525 => 6.0111, std.dev.: 0.0371) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.37% (0.4146 => 0.1809, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.47% (0.4578 => 0.2359, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.04% (11.3868 => 6.3725, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.88% (5.4023 => 3.6260, std.dev.: 0.0468) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.75% (0.4452 => 0.3083, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/bisort/bisort: -30.57% (0.9372 => 0.6507, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/heapsort: -29.56% (4.4739 => 3.1513, std.dev.: 0.1565) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.30% (1.0816 => 0.7755, std.dev.: 0.0581) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.22% (0.5495 => 0.3999, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.24% (5.2605 => 3.8802, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.53% (4.2042 => 3.1309, std.dev.: 0.1785) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.17% (4.4467 => 3.3275, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.16% (0.5826 => 0.4360, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.91% (0.5897 => 0.4428, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary3: -23.45% (1.8123 => 1.3873, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8224, std.dev.: 0.0017) MultiSource/Applications/minisat/minisat: -22.69% (7.9891 => 6.1766, std.dev.: 0.1965) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.59% (0.1164 => 0.0936, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.75% (1.5623 => 1.2694, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.68% (5.8755 => 4.7781, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.63% (2.8778 => 2.3418, std.dev.: 0.1486) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.33% (16.6791 => 13.7891, std.dev.: 0.3314) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.32% (0.0845 => 0.0724, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.55% (3.1921 => 2.7597, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6744, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.49% (5.7056 => 4.9931, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.36% (9.7992 => 8.5884, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.06% (7.0016 => 6.1573, std.dev.: 0.1668) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.87% (1.4235 => 1.2545, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.72% (5.0421 => 4.4510, std.dev.: 0.0299) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.39% (0.4081 => 0.3657, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout/hash: -10.37% (4.5259 => 4.0564, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/lists1: -8.60% (0.6628 => 0.6058, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: -8.47% (9.0650 => 8.2973, std.dev.: 0.0948) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.14% (0.3217 => 0.2955, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.03% (4.4540 => 4.0963, std.dev.: 0.0369) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.94% (1.6547 => 1.5233, std.dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: -7.91% (3.5443 => 3.2638, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -7.05% (46.0987 => 42.8477, std.dev.: 1.0971) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.62% (23.3986 => 21.8502, std.dev.: 0.2421) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2275, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.50% (4.5424 => 4.2471, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: -6.19% (0.3654 => 0.3428, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: -5.76% (1.7443 => 1.6438, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.76% (0.1789 => 0.1686, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.68% (4.9799 => 4.6972, std.dev.: 0.0340) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (63.1520 => 59.6166, std.dev.: 0.0945) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.38% (3.5127 => 3.3237, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.34% (42.3194 => 40.0608, std.dev.: 0.6797) SingleSource/Benchmarks/Shootout-C++/hash2: -4.87% (3.6768 => 3.4977, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.78% (0.3349 => 0.3189, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.71% (3.7662 => 3.5890, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4358, std.dev.: 0.0078) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.66% (2.5170 => 2.4250, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (5.8973 => 5.6830, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.35% (40.4729 => 39.1190, std.dev.: 0.2321) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.07% (1.4446 => 1.4002, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.66% (3.0082 => 2.9281, std.dev.: 0.0222) SingleSource/Benchmarks/Misc/ffbench: -2.65% (1.4244 => 1.3867, std.dev.: 0.0102) MultiSource/Benchmarks/Bullet/bullet: -2.35% (7.2040 => 7.0344, std.dev.: 0.0375) MultiSource/Applications/spiff/spiff: -2.23% (2.8571 => 2.7933, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/mandel-2: -2.11% (0.8521 => 0.8341, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.93% (8.7327 => 8.5638, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.93% (61.0379 => 59.8586, std.dev.: 0.4395) SingleSource/Benchmarks/Shootout-C++/hash: -1.77% (0.6254 => 0.6143, std.dev.: 0.0022) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.70% (85.3042 => 83.8528, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.47% (5.9063 => 5.8194, std.dev.: 0.0290) SingleSource/Benchmarks/Misc/whetstone: -1.43% (1.6251 => 1.6018, std.dev.: 0.0041) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3157, std.dev.: 0.0082) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.24% (3.5669 => 3.5226, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (6.8262 => 6.7466, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (3.7450 => 3.7026, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.49% (1.2047 => 1.2106, std.dev.: 0.0172) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.05% (0.0233 => 0.0149, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.08% (0.0451 => 0.0383, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -20.56% (0.0394 => 0.0313, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.17% (0.0445 => 0.0422, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/casts: -13.62% (0.0213 => 0.0184, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/test1: -17.18% (0.0227 => 0.0188, std.dev.: 0.0019) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.18% (0.0255 => 0.0201, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.53% (0.1530 => 0.1476, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -41.01% (1.9293 => 1.1381, std.dev.: 0.0533) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4049 => 0.4013, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.85% (0.1510 => 0.1467, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.22% (0.0978 => 0.0614, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.90% (0.0590 => 0.0613, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.99% (1.1617 => 1.2894, std.dev.: 0.0516) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.93% (0.0027 => 0.0020, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.57% (0.0610 => 0.0576, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.81% (0.0268 => 0.0372, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.14% (0.7437 => 1.7636, std.dev.: 0.0148) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.73% (12.7781 => 33.9554, std.dev.: 0.3189) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 02:47:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 04:47:25 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127104725.1B8D12A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8001?compare_to=7998&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8001, Order: 173610, Start Time: 2013-01-27 08:36:12, End Time: 2013-01-27 10:47:43 To: 7998, Order: 173608, Start Time: 2013-01-27 05:50:21, End Time: 2013-01-27 08:01:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (216 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.66% (0.3144 => 0.3259, std.dev.: 0.0001) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.65% (0.0665 => 0.0654, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8291 => 499.7895, std.dev.: 0.0309) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44219.37% (1.1277 => 499.7895, std.dev.: 0.0309) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.85% (0.5229 => 1.6516, std.dev.: 0.0026) MultiSource/Applications/SPASS/SPASS: 20.68% (14.9895 => 18.0889, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 44.95% (14.1553 => 20.5181, std.dev.: 0.0139) MultiSource/Benchmarks/MallocBench/gs/gs: 18.52% (4.1105 => 4.8716, std.dev.: 0.0195) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.89% (1.1048 => 1.7333, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 423.85% (7.1582 => 37.4980, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.56% (3.4629 => 6.4605, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.99% (0.6222 => 1.0950, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10274.58% (0.0720 => 7.4697, std.dev.: 0.0077) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11159900.00% (0.0001 => 11.1600, std.dev.: 0.0288) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848000.00% (0.0001 => 9.8481, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482400.00% (0.0001 => 5.4825, std.dev.: 0.0051) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 811.18% (1.1194 => 10.1997, std.dev.: 0.0128) SingleSource/UnitTests/SignlessTypes/factor: 164.53% (0.0296 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 147.31% (22.1758 => 54.8433, std.dev.: 0.0443) SingleSource/Benchmarks/Misc/lowercase: 122.66% (0.0256 => 0.0570, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.88% (0.0929 => 0.1829, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 68.27% (0.0271 => 0.0456, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 64.93% (0.0730 => 0.1204, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 60.91% (0.0394 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.40% (2.9384 => 4.5957, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.22% (7.0540 => 10.7379, std.dev.: 0.0100) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.91% (1.5859 => 2.4091, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 48.20% (0.1056 => 0.1565, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.60% (8.1363 => 11.9277, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.40% (2.2024 => 3.1362, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 40.66% (0.3109 => 0.4373, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.18% (0.0439 => 0.0611, std.dev.: 0.0009) SingleSource/UnitTests/vla: 38.03% (0.0355 => 0.0490, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 37.97% (21.9371 => 30.2656, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/flops: 37.78% (0.1432 => 0.1973, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.38% (0.1062 => 0.1459, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.41% (4.2646 => 5.6894, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.02% (0.4615 => 0.6139, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 32.68% (0.0814 => 0.1080, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.40% (1.5415 => 2.0409, std.dev.: 0.0219) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.73% (0.0479 => 0.0631, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.34% (0.2271 => 0.2960, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.10% (0.1143 => 0.1487, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.85% (1.1642 => 1.5117, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/05-eks/eks: 29.61% (0.4299 => 0.5572, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.54% (0.5105 => 0.6562, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 28.30% (0.0636 => 0.0816, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.18% (0.1125 => 0.1442, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 28.09% (0.0719 => 0.0921, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.62% (0.0793 => 0.1012, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.43% (0.6675 => 0.8506, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 27.14% (0.1555 => 0.1977, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.96% (0.1584 => 0.2011, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.37% (0.1892 => 0.2391, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 26.20% (9.4845 => 11.9696, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.14% (3.8922 => 4.9096, std.dev.: 0.0203) SingleSource/Benchmarks/McGill/chomp: 26.04% (0.1655 => 0.2086, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.03% (0.0730 => 0.0920, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 25.76% (0.2554 => 0.3212, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.78% (0.1566 => 0.1954, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 24.71% (0.4289 => 0.5349, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.50% (0.1906 => 0.2373, std.dev.: 0.0026) MultiSource/Applications/lemon/lemon: 24.47% (1.0722 => 1.3346, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.46% (0.1337 => 0.1664, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.42% (0.1695 => 0.2109, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.33% (1.4186 => 1.7638, std.dev.: 0.0103) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.26% (0.3121 => 0.3878, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/tsp/tsp: 24.09% (0.1175 => 0.1458, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: 24.03% (0.4620 => 0.5730, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 23.42% (0.7115 => 0.8781, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 23.33% (0.6456 => 0.7962, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/messages-2: 23.11% (0.0662 => 0.0815, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.07% (0.0672 => 0.0827, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 22.15% (0.1151 => 0.1406, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.2700 => 0.3298, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.09% (0.0842 => 0.1028, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.84% (0.1236 => 0.1506, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 21.60% (0.7835 => 0.9527, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 21.30% (0.3098 => 0.3758, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 20.94% (0.1695 => 0.2050, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.90% (1.3050 => 1.5777, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.64% (0.1032 => 0.1245, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.46% (0.0953 => 0.1148, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 20.45% (5.7591 => 6.9370, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/mst/mst: 20.21% (0.1163 => 0.1398, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.86% (0.0871 => 0.1044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.83% (0.5860 => 0.7022, std.dev.: 0.0063) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.74% (0.1940 => 0.2323, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.62% (0.8172 => 0.9775, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.53% (0.3307 => 0.3953, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.47% (4.9449 => 5.9075, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.18% (0.2758 => 0.3287, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.16% (0.5020 => 0.5982, std.dev.: 0.0018) MultiSource/Applications/lambda-0_1_3/lambda: 19.06% (0.7433 => 0.8850, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 18.96% (3.3354 => 3.9679, std.dev.: 0.0166) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.78% (5.0018 => 5.9410, std.dev.: 0.0092) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0026) MultiSource/Applications/lua/lua: 18.29% (3.8723 => 4.5806, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.21% (0.5569 => 0.6583, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: 17.99% (0.0567 => 0.0669, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.97% (0.9765 => 1.1520, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 17.92% (0.0770 => 0.0908, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 17.82% (0.1268 => 0.1494, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 17.82% (2.0273 => 2.3885, std.dev.: 0.0025) MultiSource/Benchmarks/nbench/nbench: 17.76% (1.1840 => 1.3943, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.62% (0.1510 => 0.1776, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.56% (0.2107 => 0.2477, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.53% (0.0770 => 0.0905, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.49% (0.4203 => 0.4938, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/18-imp/imp: 17.27% (0.3423 => 0.4014, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.26% (0.0933 => 0.1094, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.23% (1.1861 => 1.3905, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.10% (0.5981 => 0.7004, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 17.10% (2.2969 => 2.6897, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.95% (0.1044 => 0.1221, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.85% (0.2065 => 0.2413, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.85% (0.8101 => 0.9466, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary3: 16.81% (0.3283 => 0.3835, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.59% (0.3441 => 0.4012, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 16.49% (0.3232 => 0.3765, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.22% (0.6450 => 0.7496, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ReedSolomon: 16.06% (0.2049 => 0.2378, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 15.80% (0.0633 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 15.53% (0.3180 => 0.3674, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 15.36% (0.8921 => 1.0291, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/rem: 15.30% (0.1144 => 0.1319, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.89% (0.0759 => 0.0872, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.86% (0.8067 => 0.9266, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.77% (0.0704 => 0.0808, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.46% (0.3865 => 0.4424, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 14.44% (0.3379 => 0.3867, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.29% (0.2603 => 0.2975, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.4636 => 0.5275, std.dev.: 0.0024) SingleSource/Regression/C++/ofstream_ctor: 13.77% (0.2905 => 0.3305, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 13.60% (1.5603 => 1.7725, std.dev.: 0.0055) MultiSource/Benchmarks/sim/sim: 13.29% (0.3387 => 0.3837, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.26% (0.4103 => 0.4647, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 12.55% (0.4048 => 0.4556, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.43% (0.3603 => 0.4051, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 12.36% (0.3422 => 0.3845, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 12.24% (17.1811 => 19.2844, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/lists1: 12.05% (0.3684 => 0.4128, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.85% (0.2430 => 0.2718, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 11.67% (0.3282 => 0.3665, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.42% (0.3826 => 0.4263, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.22% (0.4064 => 0.4520, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.19% (0.3092 => 0.3438, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.13% (0.1114 => 0.1238, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.65% (0.3427 => 0.3792, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 10.65% (0.1268 => 0.1403, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.29% (14.3668 => 15.8448, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/strcat: 10.24% (0.2831 => 0.3121, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 10.09% (0.3886 => 0.4278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 9.93% (0.2871 => 0.3156, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 9.69% (1.2842 => 1.4087, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (2.0665 => 2.2635, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions: 9.38% (0.3828 => 0.4187, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/methcall: 9.35% (0.2877 => 0.3146, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.30% (0.3162 => 0.3456, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.07% (0.3650 => 0.3981, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.06% (0.2891 => 0.3153, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 8.99% (0.3694 => 0.4026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 8.95% (0.3543 => 0.3860, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 8.85% (0.2756 => 0.3000, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 8.85% (0.3561 => 0.3876, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 8.84% (0.3473 => 0.3780, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.83% (0.3543 => 0.3856, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 8.66% (0.3497 => 0.3800, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 8.65% (0.3052 => 0.3316, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.64% (0.3935 => 0.4275, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.59% (0.2793 => 0.3033, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 8.51% (0.2725 => 0.2957, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 8.34% (63.2438 => 68.5189, std.dev.: 0.0734) SingleSource/Benchmarks/Shootout-C++/hello: 8.33% (0.2714 => 0.2940, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.3136 => 0.3395, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.03% (0.6030 => 0.6514, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std.dev.: 0.0041) SingleSource/UnitTests/ObjC++/Hello: 7.44% (0.5925 => 0.6366, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.97% (2.2022 => 2.3558, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1625 => 0.1738, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.58% (0.4879 => 0.5200, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.11% (0.3177 => 0.3371, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 3.75% (10.3673 => 10.7562, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.35% (7.9617 => 8.1489, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8960, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4725, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4258, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.39% (4.2280 => 4.4557, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/hash2: 4.84% (3.1578 => 3.3106, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0171) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.33% (0.9957 => 1.0289, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9091, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.71% (9.1159 => 9.2716, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.63% (3.6395 => 3.6990, std.dev.: 0.0151) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2385, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.22% (6.5088 => 6.5883, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1690, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.90% (5.2763 => 1.1662, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -75.51% (0.8651 => 0.2119, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -43.34% (0.1622 => 0.0919, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.85% (5.3855 => 4.4240, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.36% (5.3526 => 4.4234, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: -13.38% (10.4361 => 9.0399, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.04% (1.7609 => 1.6193, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -7.63% (54.1659 => 50.0325, std.dev.: 0.0481) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.83% (1.9577 => 0.6493, std.dev.: 0.0146) SingleSource/Benchmarks/Dhrystone/dry: -51.56% (2.4116 => 1.1681) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5624, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -33.59% (1.5373 => 1.0209, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.66% (10.7105 => 7.4271, std.dev.: 0.0219) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8513, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0035, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7328, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.00% (0.9540 => 0.8395, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4945, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.04% (1.8329 => 1.7039, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5731, std.dev.: 0.0316) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -6.49% (1.2373 => 1.1570, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.02% (1.6805 => 1.5793, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.61% (8.1563 => 7.6987, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5033, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.89% (0.4808 => 0.4573, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.38% (10.2830 => 9.8331, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0025) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.94% (3.7221 => 3.6499, std.dev.: 0.0246) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6763, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.68% (3.6994 => 3.6372, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.23% (4.6441 => 4.5872, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8560, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0033) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 03:45:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 05:45:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130127114527.3DD452A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8002?compare_to=7996&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8002, Order: 173610, Start Time: 2013-01-27 07:59:25, End Time: 2013-01-27 11:45:44 To: 7996, Order: 173603, Start Time: 2013-01-27 03:33:21, End Time: 2013-01-27 07:07:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 12 (177 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1092 (760 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 45.01% (0.4086 => 0.5925, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.33% (0.3819 => 0.4099, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.81% (0.7474 => 0.7908, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.76% (0.3888 => 0.4112, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.74% (0.1916 => 0.2026, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.21% (0.6317 => 0.6646, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.72% (1.5703 => 1.6287, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.58% (2.3022 => 2.3846, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.44% (0.3281 => 0.3394, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.51% (0.4775 => 0.4895, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 17.16% (0.3526 => 0.4131, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.58% (0.1493 => 0.1636, std.dev.: 0.0003) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 60.00% (0.0625 => 0.1000, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 43.65% (0.1063 => 0.1527, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 43.51% (0.0239 => 0.0343, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 38.06% (0.2969 => 0.4099, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 34.95% (0.0475 => 0.0641, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 34.03% (0.5900 => 0.7908, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.08% (0.4994 => 0.6646, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.12% (0.0331 => 0.0434, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.84% (0.0415 => 0.0543, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 30.79% (0.1549 => 0.2026, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.90% (0.1107 => 0.1438, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.41% (0.4139 => 0.5315, std.dev.: 0.0076) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.61% (0.0547 => 0.0698, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.22% (0.1106 => 0.1407, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.75% (0.0714 => 0.0905, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.48% (0.0642 => 0.0812, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.46% (0.5000 => 0.6323, std.dev.: 0.0165) MultiSource/Applications/oggenc/oggenc: 25.82% (1.5932 => 2.0045, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.72% (0.4253 => 0.5347, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.71% (0.3271 => 0.4112, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.68% (0.0584 => 0.0734, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.68% (0.1620 => 0.2036, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.42% (0.3903 => 0.4895, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.17% (0.1021 => 0.1278, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 24.78% (0.0452 => 0.0564, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 24.52% (0.4029 => 0.5017, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/05-eks/eks: 24.34% (0.1619 => 0.2013, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.30% (0.1103 => 0.1371, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 24.16% (0.0948 => 0.1177, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.08% (0.0897 => 0.1113, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.05% (0.2736 => 0.3394, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.85% (0.0633 => 0.0784, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 23.84% (1.3152 => 1.6287, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/mst/mst: 23.50% (0.0698 => 0.0862, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.23% (0.1003 => 0.1236, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.11% (0.0822 => 0.1012, std.dev.: 0.0035) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.88% (0.1604 => 0.1971, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.02% (0.2866 => 0.3497, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 21.54% (0.0947 => 0.1151, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/08-main/main: 21.35% (0.1218 => 0.1478, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.23% (0.3890 => 0.4716, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.08% (1.9694 => 2.3846, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.66% (0.1462 => 0.1764, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.50% (0.1088 => 0.1311, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.46% (0.2014 => 0.2426, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.26% (0.1160 => 0.1395, std.dev.: 0.0042) MultiSource/Applications/sgefa/sgefa: 20.05% (0.0808 => 0.0970, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 20.01% (1.8794 => 2.2554, std.dev.: 0.0284) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.86% (0.4658 => 0.5583, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/09-vor/vor: 19.80% (0.1505 => 0.1803, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.46% (0.5026 => 0.6004, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 19.26% (0.5546 => 0.6614, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.25% (3.5627 => 4.2485, std.dev.: 0.0760) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.97% (1.6211 => 1.9287, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/Hello: 18.95% (0.5826 => 0.6930, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/property-reference-object: 18.85% (0.5889 => 0.6999, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/bh/bh: 18.61% (0.1284 => 0.1523, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.26% (0.1090 => 0.1289, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.0582 => 0.0687, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 18.04% (1.0781 => 1.2726, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 18.03% (0.7171 => 0.8464, std.dev.: 0.0179) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.97% (2.7292 => 3.2197, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/18-imp/imp: 17.95% (0.1421 => 0.1676, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.90% (4.2109 => 4.9647, std.dev.: 0.0917) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.74% (0.2875 => 0.3385, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 17.54% (0.9697 => 1.1398, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.47% (0.4361 => 0.5123, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.41% (0.2792 => 0.3278, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: 17.35% (0.2750 => 0.3227, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/except: 17.25% (0.2811 => 0.3296, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hello: 17.21% (0.2714 => 0.3181, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: 17.21% (0.9909 => 1.1614, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.20% (0.3930 => 0.4606, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 17.11% (0.2823 => 0.3306, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/random: 17.09% (0.2803 => 0.3282, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.00% (0.2911 => 0.3406, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.98% (4.4195 => 5.1701, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.91% (1.9966 => 2.3343, std.dev.: 0.0454) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.89% (2.0673 => 2.4165, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/fibo: 16.84% (0.2725 => 0.3184, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: 16.81% (0.2813 => 0.3286, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.71% (0.2729 => 0.3185, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/wc: 16.60% (0.3096 => 0.3610, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.59% (0.3195 => 0.3725, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: 16.44% (0.3267 => 0.3804, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/lists: 16.19% (0.3348 => 0.3890, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.05% (0.3060 => 0.3551, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.00% (0.3488 => 0.4046, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/for-in: 15.90% (0.3496 => 0.4052, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: 15.90% (0.3460 => 0.4010, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/trivial-interface: 15.89% (0.3442 => 0.3989, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/exceptions-2: 15.87% (0.3446 => 0.3993, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/synchronized: 15.85% (0.3469 => 0.4019, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 15.85% (0.3124 => 0.3619, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 15.82% (0.3465 => 0.4013, std.dev.: 0.0041) MultiSource/Benchmarks/Bullet/bullet: 15.80% (23.5202 => 27.2373, std.dev.: 0.0422) SingleSource/Benchmarks/Shootout-C++/ary2: 15.80% (0.3317 => 0.3841, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 15.78% (0.3726 => 0.4314, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.76% (0.3362 => 0.3892, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 15.74% (0.2566 => 0.2970, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 15.71% (1.4269 => 1.6511, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.51% (0.3282 => 0.3791, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/property: 15.40% (0.3650 => 0.4212, std.dev.: 0.0082) MultiSource/Applications/treecc/treecc: 15.38% (0.7875 => 0.9086, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash: 15.34% (0.4146 => 0.4782, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/moments: 15.31% (0.3678 => 0.4241, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/parameter-passing: 15.28% (0.3724 => 0.4293, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.22% (0.3981 => 0.4587, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions: 15.21% (0.3643 => 0.4197, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.99% (0.3690 => 0.4243, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: 14.82% (2.1653 => 2.4862, std.dev.: 0.0357) SingleSource/Benchmarks/Misc-C++/bigfib: 14.80% (0.5012 => 0.5754, std.dev.: 0.0233) SingleSource/Benchmarks/Shootout-C++/hash2: 14.68% (0.4251 => 0.4875, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.65% (0.2068 => 0.2371, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 14.53% (0.2691 => 0.3082, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 14.02% (0.2075 => 0.2366, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: 13.86% (4.6177 => 5.2577, std.dev.: 0.0579) MultiSource/Applications/SPASS/SPASS: 13.67% (5.5417 => 6.2995, std.dev.: 0.0086) MultiSource/Applications/minisat/minisat: 13.22% (0.3336 => 0.3777, std.dev.: 0.0063) MultiSource/Benchmarks/mafft/pairlocalalign: 13.21% (2.1013 => 2.3788, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.19% (0.6435 => 0.7284, std.dev.: 0.0323) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.13% (0.1028 => 0.1163, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.79% (0.2737 => 0.3087, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.93% (0.3084 => 0.3452, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 11.86% (0.6634 => 0.7421, std.dev.: 0.0045) MultiSource/Applications/lambda-0_1_3/lambda: 11.69% (0.3498 => 0.3907, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.51% (0.5361 => 0.5978, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.37% (0.2040 => 0.2272, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 10.96% (0.4847 => 0.5378, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.79% (0.2103 => 0.2330, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.62% (11.6398 => 12.8760, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.61% (0.7426 => 0.8140, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.52% (4.6926 => 5.1395, std.dev.: 0.0404) MultiSource/Applications/lemon/lemon: 9.20% (0.2391 => 0.2611, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.83% (2.0346 => 2.2142, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.04% (0.5584 => 0.6033, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 7.65% (11.9555 => 12.8703, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.25% (0.3792 => 0.4029, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.80% (29.0505 => 181.5082, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 91.07% (0.2162 => 0.4131, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.22% (0.5917 => 0.6699, std.dev.: 0.0105) MultiSource/Applications/ClamAV/clamscan: 11.28% (0.2802 => 0.3118, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.92% (0.1475 => 0.1636, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.53% (0.3693 => 0.4082, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2429, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/objinst: 5.05% (12.0509 => 12.6589, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/ary: 4.85% (0.2122 => 0.2225, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6888, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-2: 4.61% (1.8057 => 1.8890, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1908, std.dev.: 0.0480) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3141, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.45% (1.0142 => 1.0289, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.40% (1.0927 => 1.1080, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.36% (7.1849 => 7.2828, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0824, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.14% (3.1722 => 3.2084, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4795, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5790, std.dev.: 0.0071) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.04% (2.4764 => 2.4260, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -35.17% (25.4195 => 16.4787, std.dev.: 0.0485) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/fldry: -16.57% (17.2379 => 14.3819, std.dev.: 0.0664) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8056, std.dev.: 0.0708) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -6.91% (0.2402 => 0.2236, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/dry: -5.46% (14.0481 => 13.2810, std.dev.: 0.2595) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2193, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8049, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.04% (0.6293 => 0.6102, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.14% (197.4719 => 193.2469, std.dev.: 0.7518) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5767, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: -1.38% (5.5810 => 5.5038, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1876, std.dev.: 0.0177) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.34s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 04:46:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 06:46:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127124618.917962A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8003?compare_to=7999&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8003, Order: 173613, Start Time: 2013-01-27 11:12:21, End Time: 2013-01-27 12:46:36 To: 7999, Order: 173610, Start Time: 2013-01-27 07:24:25, End Time: 2013-01-27 09:01:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (86 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (885 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.30% (1.2626 => 1.2917, std.dev.: 0.0102) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713) SingleSource/Benchmarks/Misc/lowercase: 83.21% (0.0280 => 0.0513, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876) SingleSource/Benchmarks/CoyoteBench/lpbench: 70.02% (0.0974 => 0.1656, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 46.40% (0.1500 => 0.2196, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.49% (0.1132 => 0.1613, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.57% (0.0599 => 0.0836, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.66% (0.6395 => 0.8867, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.35% (0.5688 => 0.7585, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.08% (0.5456 => 0.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.04% (0.6260 => 0.8328, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.99% (0.5805 => 0.7720, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.62% (0.5849 => 0.7757, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.45% (0.6395 => 0.8470, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.44% (0.5567 => 0.7373, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.18% (0.5575 => 0.7369, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.13% (0.5581 => 0.7374, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.16% (0.5941 => 0.7792, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.76% (0.6033 => 0.7889, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.64% (0.5859 => 0.7654, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.97% (0.6440 => 0.8370, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.24% (1.6474 => 2.1291, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.18% (0.6189 => 0.7995, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.10% (0.6676 => 0.8619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.39% (0.6304 => 0.8094, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 28.12% (0.6230 => 0.7982, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.49% (0.5802 => 0.7397, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.27% (0.6660 => 0.8476, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.97% (0.5925 => 0.7523, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.92% (0.5705 => 0.7241, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.60% (0.5857 => 0.7415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.34% (0.5569 => 0.7036, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 26.27% (0.5478 => 0.6917, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 26.16% (0.5570 => 0.7027, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.63% (0.5591 => 0.7024, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.70% (0.5863 => 0.7311, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.69% (0.7524 => 0.9382, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.60% (0.6052 => 0.7541, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.53% (0.6446 => 0.8027, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.80% (0.6681 => 0.8271, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.35% (0.6194 => 0.7640, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.14% (0.6297 => 0.7754, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.47% (0.0445 => 0.0545, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.19% (2.2587 => 2.7599, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 22.00% (0.6667 => 0.8134, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.22% (0.7339 => 0.8823, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341) MultiSource/Applications/sgefa/sgefa: 15.97% (0.3357 => 0.3893, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 15.49% (1.1450 => 1.3224, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.47% (0.0864 => 0.0989, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.97% (4.5069 => 5.0915, std.dev.: 0.0093) MultiSource/Benchmarks/McCat/05-eks/eks: 12.89% (0.4515 => 0.5097, std.dev.: 0.0027) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.59% (0.4916 => 0.5535, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.90% (3.5339 => 3.9545, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.84% (1.6364 => 1.8302, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.30% (0.1982 => 0.2206, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.23% (9.2283 => 10.1725, std.dev.: 0.0099) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1230 => 0.1344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.19% (0.1731 => 0.1890, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 8.87% (1.2515 => 1.3625, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.48% (0.5329 => 0.5781, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.45% (0.2001 => 0.2170, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 8.13% (0.4524 => 0.4892, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.81% (0.7021 => 0.7569, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.74% (1.4642 => 1.5775, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (0.4861 => 0.5232, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.38% (1.2784 => 1.3728, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 7.18% (0.1879 => 0.2014, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 6.76% (0.1761 => 0.1880, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.14% (0.3255 => 0.3455, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.93% (0.6750 => 0.7150, std.dev.: 0.0049) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.69% (0.3319 => 0.3508, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (5.4682 => 5.7074, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 3.93% (5.0226 => 5.2200, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.3864 => 1.4340, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.42% (0.8418 => 0.8706, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3446 => 0.3560, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.9557 => 0.9834, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.65% (0.5168 => 0.5305, std.dev.: 0.0044) MultiSource/Applications/minisat/minisat: 2.62% (0.7447 => 0.7642, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.53% (0.4427 => 0.4539, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (22.4056 => 22.9498, std.dev.: 0.0182) MultiSource/Applications/SPASS/SPASS: 2.30% (15.5079 => 15.8642, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.21% (1.3722 => 1.4025, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 1.42% (3.5154 => 3.5653, std.dev.: 0.0042) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.31% (1.2300 => 1.2461, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 1.11% (2.1401 => 2.1639, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8127, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.60% (0.9531 => 1.0255, std.dev.: 0.0029) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.60% (54.5751 => 56.5393, std.dev.: 0.1190) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.90% (2.0478 => 2.1072, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3814, std.dev.: 0.0025) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6047, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (18.2231 => 18.5052, std.dev.: 0.0076) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2689, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.08% (3.6551 => 3.6947, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.15% (0.7198 => 0.6899, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -3.93% (0.3812 => 0.3662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3831 => 0.3686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.72% (0.3896 => 0.3751, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.72% (0.3821 => 0.3679, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.4033 => 0.3886, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.57% (0.3891 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.51% (0.3880 => 0.3744, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -3.47% (0.4176 => 0.4031, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (2.4924 => 2.4064, std.dev.: 0.0053) SingleSource/UnitTests/ObjC++/Hello: -3.21% (0.6347 => 0.6143, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.19% (0.3884 => 0.3760, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.05% (0.9852 => 0.9552, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.86% (0.4199 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.77% (20.7746 => 20.1992, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/property-reference: -2.73% (0.7779 => 0.7567, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -2.67% (0.6441 => 0.6269, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.60% (1.3148 => 1.2806, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.60% (2.1713 => 2.1149, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/parameter-passing: -2.59% (0.4280 => 0.4169, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.22% (0.6484 => 0.6340, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.80% (14.2083 => 13.9523, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.65% (0.9542 => 0.9385, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -1.41% (17.1032 => 16.8614, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.90% (1.8100 => 0.7078, std.dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3119, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2497, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.24% (1.3643 => 1.0199, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7513, std.dev.: 0.0056) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0892, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.37% (2.5106 => 2.1247, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3576, std.dev.: 0.0116) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1701, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4008, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (7.9763 => 7.7566, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/ary3: -2.38% (3.7241 => 3.6354, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1724, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4696, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.37% (1.6219 => 1.5997, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.27% (1.6307 => 1.6100, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6701, std.dev.: 0.0115) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.02% (3.2107 => 3.1781, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 05:17:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 07:17:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127131734.580952A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8004?compare_to=8000&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8004, Order: 173613, Start Time: 2013-01-27 11:13:19, End Time: 2013-01-27 13:17:54 To: 8000, Order: 173610, Start Time: 2013-01-27 08:04:42, End Time: 2013-01-27 10:04:13 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 13 (87 on baseline) Performance Improvements: 0 (63 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1051 (913 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Bullet/bullet: 5.71% (33.8834 => 35.8172, std.dev.: 0.2829) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.62% (1.1862 => 1.2291, std.dev.: 0.0031) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.61% (45.0309 => 46.6582, std.dev.: 0.5314) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.36% (1.3106 => 1.3284, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 31.95% (1.3873 => 1.8305, std.dev.: 0.0550) SingleSource/Benchmarks/Misc-C++/bigfib: 7.73% (0.3403 => 0.3666, std.dev.: 0.0027) SingleSource/Regression/C/uint64_to_float: 6.72% (1.7831 => 1.9029, std.dev.: 0.0090) MultiSource/Applications/siod/siod: 4.91% (3.4760 => 3.6467, std.dev.: 0.0184) SingleSource/Benchmarks/Dhrystone/fldry: 3.22% (0.6561 => 0.6772, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.3706 => 4.4736, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/mandel: 2.27% (1.0420 => 1.0657, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 1.32% (1.4946 => 1.5143, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.02% (15.7020 => 15.8616, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.96% (1.2106 => 1.2222, std.dev.: 0.2567) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 51.68% (0.0149 => 0.0226, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 22.72% (0.0383 => 0.0470, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.95% (0.0313 => 0.0341, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.25% (0.0321 => 0.0325, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 12.56% (0.0422 => 0.0475, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: 13.59% (0.0184 => 0.0209, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: 18.62% (0.0188 => 0.0223, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 24.38% (0.0201 => 0.0250, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.95% (0.1476 => 0.1490, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 4.21% (1.1381 => 1.1860, std.dev.: 0.3398) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.64% (0.4013 => 0.4079, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.75% (0.1467 => 0.1478, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.42% (0.0614 => 0.0678, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.33% (0.0613 => 0.0611, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.2894 => 1.2850, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 30.00% (0.0020 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.0576 => 0.0608, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.15% (0.0372 => 0.0364, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.40% (1.7636 => 1.7706, std.dev.: 0.0245) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 400.00% (0.0001 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: - (0.0123 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.82% (33.9554 => 33.6767, std.dev.: 0.5526) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.81% (0.0336 => 0.1676, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 110.58% (0.0293 => 0.0617, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 87.96% (0.0274 => 0.0515, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 61.05% (0.1638 => 0.2638, std.dev.: 0.0333) SingleSource/Regression/C/sumarray: 51.70% (0.0265 => 0.0402, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.87% (0.8893 => 1.2794, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 43.38% (0.9120 => 1.3076, std.dev.: 0.0498) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 41.67% (0.9564 => 1.3549, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.61% (0.9381 => 1.3284, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.24% (0.8926 => 1.2607, std.dev.: 0.1059) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.69% (0.8990 => 1.2648, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.65% (0.9061 => 1.2744, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.64% (0.9612 => 1.3518, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.45% (0.9091 => 1.2768, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 40.25% (0.9422 => 1.3214, std.dev.: 0.0615) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.48% (0.9588 => 1.3373, std.dev.: 0.0749) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.46% (0.9403 => 1.3113, std.dev.: 0.0490) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.57% (0.9855 => 1.3656, std.dev.: 0.0519) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 38.26% (0.8736 => 1.2078, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.85% (1.0119 => 1.3949, std.dev.: 0.0171) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.45% (0.9998 => 1.3742, std.dev.: 0.0887) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 37.08% (1.0867 => 1.4897, std.dev.: 0.0799) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.01% (0.9010 => 1.2345, std.dev.: 0.1051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.93% (0.8912 => 1.2114, std.dev.: 0.0686) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.81% (0.9488 => 1.2886, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 35.49% (0.9867 => 1.3369, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.96% (0.8732 => 1.1785, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.85% (1.0052 => 1.3555, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.67% (0.9127 => 1.2291, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.42% (0.8846 => 1.1891, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.35% (0.9788 => 1.3052, std.dev.: 0.1146) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.23% (0.9405 => 1.2530, std.dev.: 0.0370) SingleSource/Benchmarks/McGill/exptree: 32.95% (0.0859 => 0.1142, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.72% (0.9685 => 1.2854, std.dev.: 0.0791) SingleSource/Benchmarks/Stanford/IntMM: 32.71% (0.0431 => 0.0572, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.49% (1.0017 => 1.3272, std.dev.: 0.0982) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.47% (0.9507 => 1.2499, std.dev.: 0.0682) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.34% (0.9993 => 1.3125, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.49% (1.0088 => 1.3164, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.16% (0.9550 => 1.2430, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.41% (1.0860 => 1.3945, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.09% (0.0738 => 0.0901, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.11% (0.0738 => 0.0879, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.64% (0.0669 => 0.0787, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.36% (0.0642 => 0.0747, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 13.84% (9.5202 => 10.8374, std.dev.: 0.1506) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.81% (0.1332 => 0.1516, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.52% (3.6295 => 4.1201, std.dev.: 0.1416) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.67% (0.2577 => 0.2852, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 10.65% (0.2385 => 0.2639, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/ReedSolomon: 10.34% (0.2050 => 0.2262, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/chomp: 10.09% (0.1793 => 0.1974, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.05% (0.5369 => 0.5855, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.90% (0.1955 => 0.2129, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.70% (1.4110 => 1.5338, std.dev.: 0.0355) MultiSource/Benchmarks/Bullet/bullet: 7.74% (33.2440 => 35.8172, std.dev.: 0.2829) SingleSource/Benchmarks/Linpack/linpack-pc: 6.94% (0.2566 => 0.2744, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.67% (44.1538 => 46.6582, std.dev.: 0.5314) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106675.00% (0.0008 => 0.8542, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: 334.01% (1.5825 => 6.8682, std.dev.: 0.1468) MultiSource/Applications/sgefa/sgefa: 258.78% (0.3515 => 1.2611, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.30% (1.1825 => 4.0477, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.18% (4.8185 => 15.8616, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 206.20% (0.0129 => 0.0395, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 195.18% (0.0228 => 0.0673, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary: 150.00% (0.0232 => 0.0580, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/matrix: 64.68% (2.9083 => 4.7894, std.dev.: 0.1510) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.19% (0.2562 => 0.3438, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.86% (3.1254 => 4.1212, std.dev.: 0.0202) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.62% (1.4588 => 1.8763, std.dev.: 0.1010) SingleSource/Regression/C/uint64_to_float: 23.59% (1.5397 => 1.9029, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.99% (5.6033 => 6.8915, std.dev.: 0.3774) SingleSource/Benchmarks/Misc/salsa20: 21.95% (7.4497 => 9.0851, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.48% (4.8112 => 5.7966, std.dev.: 0.1091) MultiSource/Applications/JM/lencod/lencod: 14.14% (6.8159 => 7.7800, std.dev.: 0.1745) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.21% (5.1752 => 5.8590, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6502, std.dev.: 0.1999) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.89% (3.6477 => 3.9718, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ReedSolomon: 8.31% (8.6447 => 9.3629, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.40% (4.1836 => 4.4097, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.91% (5.0310 => 5.2278, std.dev.: 0.0440) SingleSource/Benchmarks/Linpack/linpack-pc: 3.90% (50.8945 => 52.8772, std.dev.: 0.2445) SingleSource/Benchmarks/Misc/pi: 3.15% (2.1390 => 2.2064, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.58% (0.5224 => 0.5359, std.dev.: 0.0049) MultiSource/Applications/siod/siod: 1.55% (3.5910 => 3.6467, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8627, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.00% (2.5681 => 2.5938, std.dev.: 0.0040) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.35% (0.0808 => 0.0482, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.91% (0.0727 => 0.0495, std.dev.: 0.0044) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.19% (0.0692 => 0.0490, std.dev.: 0.0011) SingleSource/Benchmarks/SmallPT/smallpt: -25.26% (0.1888 => 0.1411, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.83% (0.1009 => 0.0819, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.58% (0.1684 => 0.1388, std.dev.: 0.0031) MultiSource/Applications/treecc/treecc: -10.45% (2.4719 => 2.2136, std.dev.: 0.0430) MultiSource/Applications/Burg/burg: -10.41% (1.5979 => 1.4315, std.dev.: 0.0406) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.77% (6.4235 => 5.7961, std.dev.: 0.1083) SingleSource/Benchmarks/Shootout-C++/hash2: -9.33% (0.5134 => 0.4655, std.dev.: 0.0106) MultiSource/Benchmarks/Olden/health/health: -7.89% (0.1610 => 0.1483, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -7.28% (0.2006 => 0.1860, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: -6.44% (17.5634 => 16.4323, std.dev.: 0.4183) SingleSource/Benchmarks/Shootout-C++/moments: -5.87% (0.4002 => 0.3767, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wc: -4.86% (0.2305 => 0.2193, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.34% (0.3665 => 0.3506, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.64% (0.2884 => 0.2779, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.86% (11.5523 => 3.9443, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/fp-convert: -61.84% (15.6525 => 5.9731, std.dev.: 0.0571) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.93% (0.4146 => 0.1827, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.38% (0.4578 => 0.2363, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -42.91% (11.3868 => 6.5007, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.93% (5.4023 => 3.6235, std.dev.: 0.0458) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.06% (0.4452 => 0.3069, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: -30.92% (0.9372 => 0.6474, std.dev.: 0.0454) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.57% (0.5495 => 0.4035, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.10% (5.2605 => 3.8873, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.28% (4.4467 => 3.3226, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.71% (0.5897 => 0.4440, std.dev.: 0.0113) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.13% (0.5826 => 0.4420, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8231, std.dev.: 0.0076) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.93% (16.6791 => 13.5220, std.dev.: 0.3890) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7918, std.dev.: 0.0268) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -17.74% (9.7992 => 8.0611, std.dev.: 0.2554) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.56% (7.0016 => 5.8420, std.dev.: 0.2239) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.19% (3.1921 => 2.7710, std.dev.: 0.1390) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.57% (5.7056 => 4.9885, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.57% (1.6547 => 1.4632, std.dev.: 0.0618) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.53% (4.2843 => 4.0044, std.dev.: 0.0993) MultiSource/Applications/SIBsim4/SIBsim4: -6.51% (3.5443 => 3.3137, std.dev.: 0.0577) MultiSource/Benchmarks/Olden/health/health: -6.46% (0.3654 => 0.3418, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.39% (4.5424 => 4.2521, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.32% (5.5974 => 5.2439, std.dev.: 0.0291) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.25% (4.9799 => 4.6687, std.dev.: 0.0496) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.50% (3.7662 => 3.5592, std.dev.: 0.0320) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (63.1520 => 59.6841, std.dev.: 0.0985) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (3.5127 => 3.3222, std.dev.: 0.0583) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.34% (0.3349 => 0.3170, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/queens: -5.24% (1.7443 => 1.6529, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -4.79% (3.6768 => 3.5005, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.73% (5.8973 => 5.6775, std.dev.: 0.0448) SingleSource/Benchmarks/Shootout-C++/lists: -3.27% (17.2182 => 16.6557, std.dev.: 0.0243) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.94% (0.3406 => 0.3306, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -2.11% (0.8521 => 0.8341, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.86% (8.7327 => 8.5704, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8644, std.dev.: 0.3105) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.45% (8.8249 => 8.6968, std.dev.: 0.0430) SingleSource/Benchmarks/Misc/whetstone: -1.43% (1.6251 => 1.6019, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/methcall: -1.26% (8.7416 => 8.6314, std.dev.: 0.0385) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3596 => 3.3196, std.dev.: 0.0052) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.45% (1.2047 => 1.2222, std.dev.: 0.2567) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.00% (0.0233 => 0.0226, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.21% (0.0451 => 0.0470, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0059) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.74% (0.0445 => 0.0475, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0042) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.96% (0.0255 => 0.0250, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1530 => 0.1490, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: -38.53% (1.9293 => 1.1860, std.dev.: 0.3398) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.74% (0.4049 => 0.4079, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.12% (0.1510 => 0.1478, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.67% (0.0978 => 0.0678, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.56% (0.0590 => 0.0611, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.61% (1.1617 => 1.2850, std.dev.: 0.0180) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0108) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.82% (0.0268 => 0.0364, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.08% (0.7437 => 1.7706, std.dev.: 0.0245) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -37.50% (0.0008 => 0.0005, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 163.55% (12.7781 => 33.6767, std.dev.: 0.5526) Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 05:29:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 07:29:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127132950.2FDEF2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8005?compare_to=8001&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8005, Order: 173613, Start Time: 2013-01-27 11:18:25, End Time: 2013-01-27 13:30:07 To: 8001, Order: 173610, Start Time: 2013-01-27 08:36:12, End Time: 2013-01-27 10:47:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (218 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (654 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 188.43% (3.1354 => 9.0434, std.dev.: 0.0612) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -2.03% (3.8361 => 3.7584, std.dev.: 0.0086) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.52% (0.0654 => 0.0677, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7895 => 499.8450, std.dev.: 0.0034) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44224.29% (1.1277 => 499.8450, std.dev.: 0.0034) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 215.93% (0.5229 => 1.6520, std.dev.: 0.0027) MultiSource/Applications/SPASS/SPASS: 20.74% (14.9895 => 18.0978, std.dev.: 0.0102) MultiSource/Applications/kimwitu++/kc: 44.68% (14.1553 => 20.4793, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 18.70% (4.1105 => 4.8790, std.dev.: 0.0146) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.35% (1.1048 => 1.7273, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.77% (7.1582 => 37.2781, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.24% (3.4629 => 6.4493, std.dev.: 0.0115) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.63% (0.6222 => 1.0928, std.dev.: 0.0006) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10280.28% (0.0720 => 7.4738, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 11188500.00% (0.0001 => 11.1886, std.dev.: 0.0053) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485600.00% (0.0001 => 5.4857, std.dev.: 0.0055) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.02% (1.1194 => 10.2091, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/factor: 163.85% (0.0296 => 0.0781, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 147.25% (22.1758 => 54.8296, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 96.99% (0.0929 => 0.1830, std.dev.: 0.0013) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 71.16% (0.1463 => 0.2504, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 67.90% (0.0271 => 0.0455, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 64.38% (0.0730 => 0.1200, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 60.66% (0.0394 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.44% (2.9384 => 4.5968, std.dev.: 0.0035) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 51.93% (7.0540 => 10.7172, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.73% (1.5859 => 2.4063, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 47.92% (0.1056 => 0.1562, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.20% (8.1363 => 11.8953, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.23% (2.2024 => 3.1325, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 40.30% (0.3109 => 0.4362, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.95% (0.0439 => 0.0610, std.dev.: 0.0003) SingleSource/UnitTests/vla: 38.03% (0.0355 => 0.0490, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.66% (0.1062 => 0.1462, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 37.55% (21.9371 => 30.1745, std.dev.: 0.0267) SingleSource/Benchmarks/Misc/flops: 36.87% (0.1432 => 0.1960, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.26% (4.2646 => 5.6829, std.dev.: 0.0089) SingleSource/Benchmarks/McGill/exptree: 32.56% (0.0814 => 0.1079, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.48% (0.4615 => 0.6114, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 32.37% (1.5415 => 2.0405, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.91% (0.2271 => 0.2973, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: 30.15% (0.4299 => 0.5595, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 29.61% (1.1642 => 1.5089, std.dev.: 0.0023) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.48% (0.1143 => 0.1480, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.88% (0.0793 => 0.1022, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 28.77% (0.0636 => 0.0819, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.86% (0.5105 => 0.6527, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.54% (0.6675 => 0.8513, std.dev.: 0.0064) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.70% (0.1584 => 0.2007, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 26.43% (0.2554 => 0.3229, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 26.40% (0.1655 => 0.2092, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.40% (0.1125 => 0.1422, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.22% (0.1892 => 0.2388, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.04% (3.8922 => 4.9059, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 26.00% (9.4845 => 11.9502, std.dev.: 0.0110) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.80% (0.1566 => 0.1970, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.75% (0.0730 => 0.0918, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 25.70% (0.1175 => 0.1477, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.47% (0.0746 => 0.0936, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 25.30% (0.4289 => 0.5374, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.48% (0.3121 => 0.3885, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 24.44% (1.0722 => 1.3342, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.40% (1.4186 => 1.7647, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.08% (0.1906 => 0.2365, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.83% (0.1695 => 0.2099, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 23.74% (0.4620 => 0.5717, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.49% (0.1337 => 0.1651, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 23.17% (0.6456 => 0.7952, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 23.15% (0.1555 => 0.1915, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/mst/mst: 22.87% (0.1163 => 0.1429, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.77% (0.0672 => 0.0825, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 22.70% (0.7115 => 0.8730, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.41% (0.2700 => 0.3305, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/messages-2: 22.21% (0.0662 => 0.0809, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.09% (0.1236 => 0.1509, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 22.03% (0.7835 => 0.9561, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/15-trie/trie: 21.82% (0.0527 => 0.0642, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 21.57% (0.0626 => 0.0761, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.48% (0.0675 => 0.0820, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 21.36% (0.0660 => 0.0801, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.19% (0.1940 => 0.2351, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 21.14% (0.3098 => 0.3753, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 20.99% (0.1029 => 0.1245, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.85% (1.3050 => 1.5771, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 20.59% (0.1151 => 0.1388, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.54% (0.1032 => 0.1244, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 20.35% (0.1695 => 0.2040, std.dev.: 0.0019) MultiSource/Applications/oggenc/oggenc: 20.24% (5.7591 => 6.9250, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.24% (0.5860 => 0.7046, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.04% (0.0953 => 0.1144, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 19.87% (0.0614 => 0.0736, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.75% (0.0871 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.62% (0.8172 => 0.9775, std.dev.: 0.0144) MultiSource/Applications/lambda-0_1_3/lambda: 19.55% (0.7433 => 0.8886, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.52% (4.9449 => 5.9103, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.26% (0.5020 => 0.5987, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.20% (0.3307 => 0.3942, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 18.75% (3.3354 => 3.9607, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.71% (0.5569 => 0.6611, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.67% (5.0018 => 5.9356, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.56% (0.2107 => 0.2498, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.52% (0.0648 => 0.0768, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.17% (0.2758 => 0.3259, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 18.03% (0.3423 => 0.4040, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.81% (0.1510 => 0.1779, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.81% (0.9765 => 1.1504, std.dev.: 0.0043) MultiSource/Applications/lua/lua: 17.72% (3.8723 => 4.5586, std.dev.: 0.0027) MultiSource/Applications/treecc/treecc: 17.61% (2.0273 => 2.3844, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.51% (0.0834 => 0.0980, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.46% (0.1117 => 0.1312, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: 17.41% (1.1840 => 1.3901, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.40% (0.0770 => 0.0904, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.39% (0.4203 => 0.4934, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.21% (1.1861 => 1.3902, std.dev.: 0.0021) MultiSource/Applications/siod/siod: 17.16% (2.2969 => 2.6910, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.02% (0.5981 => 0.6999, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.93% (0.0933 => 0.1091, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.86% (0.1044 => 0.1220, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 16.84% (0.3283 => 0.3836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.71% (0.3441 => 0.4016, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.66% (0.2065 => 0.2409, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 16.59% (0.2049 => 0.2389, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.47% (0.8101 => 0.9435, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0082) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.09% (0.6450 => 0.7488, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/09-vor/vor: 15.63% (0.3180 => 0.3677, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.48% (0.8921 => 1.0302, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/rem: 15.03% (0.1144 => 0.1316, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3379 => 0.3884, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.79% (0.0818 => 0.0939, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.76% (0.0759 => 0.0871, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.60% (0.8067 => 0.9245, std.dev.: 0.0098) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.49% (0.0704 => 0.0806, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.25% (0.2603 => 0.2974, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 13.96% (0.0838 => 0.0955, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.92% (0.3865 => 0.4403, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.78% (0.4636 => 0.5275, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 13.53% (0.2905 => 0.3298, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.16% (0.4103 => 0.4643, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 13.11% (0.3387 => 0.3831, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 12.98% (1.5603 => 1.7628, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sieve: 12.49% (0.3603 => 0.4053, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/moments: 12.48% (0.4048 => 0.4553, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 12.05% (17.1811 => 19.2519, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/lists: 12.01% (0.3422 => 0.3833, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.89% (0.2430 => 0.2719, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 11.89% (0.3684 => 0.4122, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 11.73% (0.3282 => 0.3667, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.32% (0.3826 => 0.4259, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 11.19% (0.3092 => 0.3438, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.86% (0.1114 => 0.1235, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 10.80% (0.4064 => 0.4503, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1268 => 0.1402, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.56% (0.3427 => 0.3789, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 10.49% (0.3927 => 0.4339, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2831 => 0.3126, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (14.3668 => 15.8615, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/except: 10.10% (0.2871 => 0.3161, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 9.96% (0.3886 => 0.4273, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.58% (2.0665 => 2.2644, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.42% (0.3162 => 0.3460, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.29% (0.2756 => 0.3012, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.28% (1.2842 => 1.4034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 9.28% (0.2877 => 0.3144, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 9.25% (0.3828 => 0.4182, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 8.99% (0.2725 => 0.2970, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 8.90% (0.3473 => 0.3782, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.88% (0.3650 => 0.3974, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.77% (0.2872 => 0.3124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 8.77% (0.2714 => 0.2952, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.75% (0.2891 => 0.3144, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 8.75% (0.3543 => 0.3853, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wc: 8.75% (0.3052 => 0.3319, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 8.73% (0.3516 => 0.3823, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 8.72% (0.3543 => 0.3852, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 8.69% (0.3694 => 0.4015, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 8.65% (0.3561 => 0.3869, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 8.55% (0.3497 => 0.3796, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 8.35% (0.2802 => 0.3036, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.16% (0.3136 => 0.3392, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.16% (0.2793 => 0.3021, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.09% (63.2438 => 68.3606, std.dev.: 0.0589) SingleSource/UnitTests/ObjC++/property-reference-object: 7.76% (0.6030 => 0.6498, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.60% (0.7326 => 0.7883, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 7.41% (0.5925 => 0.6364, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.77% (2.2022 => 2.3513, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.77% (0.1625 => 0.1735, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.52% (0.4879 => 0.5197, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.76% (0.3177 => 0.3360, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.46% (0.2266 => 0.2367, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 3.90% (0.3131 => 0.3253, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 2.87% (10.3673 => 10.6652, std.dev.: 0.0049) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.98% (7.9617 => 8.1193, std.dev.: 0.0073) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4726, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.08% (1.1145 => 1.2937, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6977, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.36% (4.2280 => 4.4548, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/hash2: 4.87% (3.1578 => 3.3117, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.20% (0.9957 => 1.0276, std.dev.: 0.0040) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9110, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (3.6395 => 3.7318, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.69% (9.1159 => 9.2702, std.dev.: 0.0230) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2385, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5774, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4522, std.dev.: 0.0303) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.49% (6.6874 => 0.1681, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.98% (5.2763 => 1.1619, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -75.53% (0.8651 => 0.2117, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -43.40% (0.1622 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.09% (5.3855 => 4.4113, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.62% (5.3526 => 4.4096, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: -13.53% (10.4361 => 9.0244, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.26% (1.7609 => 1.6155, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -7.59% (54.1659 => 50.0563, std.dev.: 0.0434) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.39% (1.9577 => 0.6580, std.dev.: 0.0093) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3060, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.57% (10.7105 => 7.4360, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8556, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0067, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: -12.97% (3.1443 => 2.7364, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.99% (0.9540 => 0.8396, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4921, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.11% (1.8329 => 1.7026, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.89% (4.8142 => 4.4823, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5879, std.dev.: 0.0334) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342) SingleSource/Benchmarks/McGill/chomp: -6.05% (1.2373 => 1.1624, std.dev.: 0.0223) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.51% (8.1563 => 7.7068, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.56% (1.5835 => 1.5113, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -4.34% (10.2830 => 9.8368, std.dev.: 0.0150) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.6441 => 4.5875, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/ary3: -1.14% (3.6994 => 3.6572, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout/lists: -1.12% (6.2999 => 6.2293, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.01% (0.2116 => 0.0677, std.dev.: 0.0031) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 06:43:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 08:43:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127144341.DF9942A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8006?compare_to=8003&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8006, Order: 173616, Start Time: 2013-01-27 13:09:57, End Time: 2013-01-27 14:44:00 To: 8003, Order: 173613, Start Time: 2013-01-27 11:12:21, End Time: 2013-01-27 12:46:36 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (87 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.82% (0.0974 => 0.1654, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0052) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.67% (0.1132 => 0.1615, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.31% (0.6395 => 0.8845, std.dev.: 0.0152) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.85% (0.5805 => 0.7712, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.73% (0.5456 => 0.7242, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.60% (0.6260 => 0.8301, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.38% (0.5849 => 0.7743, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.24% (0.5567 => 0.7362, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 32.04% (0.6395 => 0.8444, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.91% (0.5575 => 0.7354, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.89% (0.5581 => 0.7361, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.02% (0.5941 => 0.7784, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.35% (0.6033 => 0.7864, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.31% (0.5859 => 0.7635, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.81% (0.6440 => 0.8360, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.00% (1.6474 => 2.1252, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.95% (0.6189 => 0.7981, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.85% (0.6676 => 0.8602, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.16% (0.6304 => 0.8079, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 28.01% (0.6230 => 0.7975, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.21% (0.5802 => 0.7381, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.01% (0.6660 => 0.8459, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.85% (0.5925 => 0.7516, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.59% (0.5705 => 0.7222, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.31% (0.5857 => 0.7398, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.00% (0.5569 => 0.7017, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.98% (0.5478 => 0.6901, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.85% (0.5570 => 0.7010, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.43% (0.5591 => 0.7013, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.17% (0.0445 => 0.0557, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.52% (0.7524 => 0.9369, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.39% (0.5863 => 0.7293, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.34% (0.6052 => 0.7525, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.28% (0.6446 => 0.8011, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.51% (0.6681 => 0.8252, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.15% (0.6194 => 0.7628, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.00% (0.6297 => 0.7745, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.03% (2.2587 => 2.7562, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.82% (0.6667 => 0.8122, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.07% (0.7339 => 0.8812, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.79% (0.3357 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 15.22% (1.1450 => 1.3193, std.dev.: 0.0065) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.87% (4.5069 => 5.0869, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/05-eks/eks: 12.69% (0.4515 => 0.5088, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.57% (0.4916 => 0.5534, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.87% (1.6364 => 1.8307, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.81% (0.1982 => 0.2216, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.73% (3.5339 => 3.9485, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.07% (9.2283 => 10.1575, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.85% (0.2001 => 0.2198, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 9.31% (0.4524 => 0.4945, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.19% (0.1230 => 0.1343, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.13% (0.1731 => 0.1889, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.80% (1.2515 => 1.3616, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.39% (0.5329 => 0.5776, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.11% (0.4861 => 0.5255, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.86% (0.7021 => 0.7573, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (1.4642 => 1.5745, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.31% (1.2784 => 1.3718, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ReedSolomon: 7.18% (0.1879 => 0.2014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.94% (0.3255 => 0.3481, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 6.76% (0.1761 => 0.1880, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.31% (0.6750 => 0.7176, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.37% (5.4682 => 5.7073, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 4.12% (0.3446 => 0.3588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 4.10% (0.3394 => 0.3533, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 4.01% (5.0226 => 5.2240, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 3.58% (1.3864 => 1.4361, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.27% (0.8418 => 0.8693, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4427 => 0.4563, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.99% (0.9557 => 0.9843, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.48% (0.7447 => 0.7632, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (22.4056 => 22.9171, std.dev.: 0.0124) MultiSource/Applications/SPASS/SPASS: 2.19% (15.5079 => 15.8479, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.3722 => 1.4012, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.2300 => 1.2465, std.dev.: 0.0045) MultiSource/Applications/d/make_dparser: 1.25% (3.5154 => 3.5592, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.02% (2.1401 => 2.1619, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7937, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.84% (0.9531 => 1.0278, std.dev.: 0.0061) SingleSource/Regression/C/uint64_to_float: 7.31% (0.5692 => 0.6108, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5067, std.dev.: 0.0756) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.85% (2.0478 => 2.1062, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3834, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6032, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (18.2231 => 18.4997, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2692, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.32% (0.7198 => 0.6887, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3821 => 0.3674, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -3.69% (0.3194 => 0.3076, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.66% (2.4924 => 2.4012, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/trivial-interface: -3.52% (0.3812 => 0.3678, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.42% (0.3831 => 0.3700, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.40% (0.3848 => 0.3717, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3880 => 0.3750, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.34% (0.3896 => 0.3766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.26% (0.3891 => 0.3764, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.14% (0.9852 => 0.9543, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.11% (0.4176 => 0.4046, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.95% (0.3837 => 0.3724) SingleSource/UnitTests/ObjC++/Hello: -2.90% (0.6347 => 0.6163, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.83% (0.3884 => 0.3774, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2340, std.dev.: 0.0139) SingleSource/UnitTests/ObjC/property: -2.57% (0.4199 => 0.4091, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.34% (0.6484 => 0.6332, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -2.21% (0.7779 => 0.7607, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: -1.95% (1.3148 => 1.2891, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.95% (14.2083 => 13.9307, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.87% (0.9542 => 0.9364, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.72% (2.1713 => 2.1339, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: -1.60% (17.1032 => 16.8299, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.11% (1.0544 => 1.0427, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.51% (1.8100 => 0.6967, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.12% (0.6962 => 0.3403, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3082, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0256, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0809, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1982, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.23% (2.5106 => 2.1283, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3531, std.dev.: 0.0062) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.93% (2.2633 => 2.1743, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2714, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.15% (7.9763 => 7.8051, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/ary3: -1.84% (3.7241 => 3.6555, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: -1.82% (7.3040 => 7.1710, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.42% (1.6086 => 1.5857, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.22% (1.6219 => 1.6021, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 07:38:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 09:38:15 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127153815.8C2122A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8007?compare_to=8004&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8007, Order: 173618, Start Time: 2013-01-27 13:37:21, End Time: 2013-01-27 15:38:35 To: 8004, Order: 173613, Start Time: 2013-01-27 11:13:19, End Time: 2013-01-27 13:17:54 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (97 on baseline) Performance Improvements: 20 (94 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (872 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.26% (1.0115 => 1.0242, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.94% (0.3300 => 0.3529, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.08% (8.0611 => 8.5511, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.92% (4.8410 => 5.0791, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: 4.30% (6.8682 => 7.1634, std.dev.: 0.0583) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.74% (4.7417 => 4.8717, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ffbench: 2.04% (1.3726 => 1.4006, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.02% (1.3843 => 1.4122, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.61% (1.5553 => 1.5803, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.11% (3.3222 => 3.3592, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -10.22% (9.2192 => 8.2774, std.dev.: 0.2972) MultiSource/Benchmarks/Bullet/bullet: -5.44% (35.8172 => 33.8671, std.dev.: 0.2593) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.18% (25.1558 => 23.8522, std.dev.: 0.3883) MultiSource/Benchmarks/7zip/7zip-benchmark: -3.03% (46.6582 => 45.2424, std.dev.: 0.2684) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.53% (1.2854 => 1.2657, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.51% (1.8305 => 1.4368, std.dev.: 0.0221) SingleSource/Benchmarks/Shootout-C++/ackermann: -10.71% (4.2124 => 3.7613, std.dev.: 0.0701) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.37% (9.9144 => 9.3824, std.dev.: 0.0747) SingleSource/Benchmarks/Shootout-C++/except: -2.90% (0.5041 => 0.4895, std.dev.: 0.0048) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.57% (2.8190 => 2.7465, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.89% (4.0381 => 3.9618, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.84% (6.5007 => 6.3814, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.60% (1.8763 => 1.8463, std.dev.: 0.0111) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.58% (0.9807 => 0.9652, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: -1.57% (8.4617 => 8.3289, std.dev.: 0.0332) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.46% (22.5901 => 22.2600, std.dev.: 0.0637) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.41% (4.5310 => 4.4669, std.dev.: 0.0160) MultiSource/Benchmarks/Bullet/bullet: -1.35% (7.1406 => 7.0443, std.dev.: 0.0246) SingleSource/Benchmarks/Misc/mandel: -1.29% (1.0657 => 1.0519, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.02% (4.0044 => 3.9634, std.dev.: 0.0088) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.05% (1.2222 => 1.2228, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -37.61% (0.0226 => 0.0141, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.87% (0.0470 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -23.75% (0.0341 => 0.0260, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.15% (0.0325 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -10.11% (0.0475 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -12.44% (0.0209 => 0.0183, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -35.43% (0.0223 => 0.0144, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -11.60% (0.0250 => 0.0221, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -0.13% (0.1490 => 0.1488, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -2.01% (1.1860 => 1.1622, std.dev.: 0.0370) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.08% (0.4079 => 0.3994, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.14% (0.1478 => 0.1554, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.08% (0.0678 => 0.0726, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.93% (0.0611 => 0.0587, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.06% (1.2850 => 1.2842, std.dev.: 0.0372) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -10.00% (0.0030 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.93% (0.0608 => 0.0578, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.10% (0.0364 => 0.0368, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.07% (1.7706 => 1.7694, std.dev.: 0.0224) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -80.00% (0.0005 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.28% (0.0123 => 0.0071, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.42% (33.6767 => 34.1541, std.dev.: 0.2090) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 399.70% (0.0336 => 0.1679, std.dev.: 0.0028) SingleSource/Regression/C/sumarraymalloc: 112.63% (0.0293 => 0.0623, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 91.24% (0.0274 => 0.0524, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 61.36% (0.1638 => 0.2643, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.00% (0.8893 => 1.2628, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.68% (0.9120 => 1.2921, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.58% (0.8926 => 1.2637, std.dev.: 0.0569) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.11% (0.9061 => 1.2786, std.dev.: 0.0946) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.86% (0.9612 => 1.3539, std.dev.: 0.1412) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.34% (0.9381 => 1.3165, std.dev.: 0.0432) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.95% (0.9588 => 1.3418, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.87% (0.9564 => 1.3377, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.17% (0.9091 => 1.2652, std.dev.: 0.0949) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.02% (0.9855 => 1.3700, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.00% (0.8990 => 1.2496, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.61% (0.9998 => 1.3858, std.dev.: 0.0151) SingleSource/Regression/C/sumarray: 38.11% (0.0265 => 0.0366, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.97% (0.9422 => 1.3000, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.72% (0.9403 => 1.2950, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.96% (0.9010 => 1.2340, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.85% (0.9512 => 1.3017, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.58% (0.8912 => 1.2172, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.37% (0.8736 => 1.1913, std.dev.: 0.0736) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.23% (1.0119 => 1.3785, std.dev.: 0.1093) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.72% (1.0867 => 1.4749, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/exptree: 35.51% (0.0859 => 0.1164, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.02% (1.0052 => 1.3572, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.74% (0.8846 => 1.1919, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.72% (0.8732 => 1.1764, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.37% (0.9867 => 1.3160, std.dev.: 0.0335) SingleSource/Benchmarks/Stanford/IntMM: 33.18% (0.0431 => 0.0574, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.98% (1.0017 => 1.3321, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.18% (0.9788 => 1.2938, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.85% (0.9507 => 1.2535, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.75% (0.9488 => 1.2500, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.05% (1.0088 => 1.3220, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.69% (0.9685 => 1.2657, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.57% (0.9127 => 1.1917, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.23% (0.9405 => 1.2248, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.90% (0.9993 => 1.2981, std.dev.: 0.0793) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.66% (0.9550 => 1.2287, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.18% (1.0860 => 1.3812, std.dev.: 0.0533) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.68% (0.0738 => 0.0898, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.70% (0.0738 => 0.0876, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 17.87% (0.3598 => 0.4241, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 16.59% (0.0669 => 0.0780, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.89% (0.0642 => 0.0744, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.43% (1.0986 => 1.2571, std.dev.: 0.0188) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.35% (0.1240 => 0.1418, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.91% (0.0805 => 0.0917, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.71% (3.6295 => 4.1270, std.dev.: 0.0379) MultiSource/Benchmarks/mafft/pairlocalalign: 13.08% (9.5202 => 10.7651, std.dev.: 0.0385) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.99% (0.5369 => 0.5959, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/ReedSolomon: 10.34% (0.2050 => 0.2262, std.dev.: 0.0007) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.25% (0.4596 => 0.5067, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/matrix: 9.94% (0.2385 => 0.2622, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.05% (0.1955 => 0.2132, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 8.81% (0.1793 => 0.1951, std.dev.: 0.0015) SingleSource/Benchmarks/Linpack/linpack-pc: 8.50% (0.2566 => 0.2784, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.91% (0.2879 => 0.3078, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.67% (2.4519 => 2.5910, std.dev.: 0.0233) SingleSource/Regression/C++/ofstream_ctor: 5.00% (0.2042 => 0.2144, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.93% (0.2372 => 0.2489, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.66% (1.8127 => 1.8790, std.dev.: 0.0103) MultiSource/Applications/oggenc/oggenc: 3.54% (5.3553 => 5.5449, std.dev.: 0.0388) SingleSource/Benchmarks/Misc-C++/bigfib: 3.32% (0.6711 => 0.6934, std.dev.: 0.0036) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.47% (44.1538 => 45.2424, std.dev.: 0.2684) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.07% (0.7693 => 0.7852, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107000.00% (0.0008 => 0.8568, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: 352.66% (1.5825 => 7.1634, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout/ary3: 284.72% (2.2304 => 8.5808, std.dev.: 0.5323) MultiSource/Applications/sgefa/sgefa: 258.41% (0.3515 => 1.2598, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.60% (1.1825 => 4.0631, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.48% (4.8185 => 15.7312, std.dev.: 0.2235) SingleSource/Benchmarks/Shootout-C++/ary2: 206.20% (0.0129 => 0.0395, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 191.23% (0.0228 => 0.0664, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 137.93% (0.0232 => 0.0552, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 61.87% (2.9083 => 4.7077, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.61% (0.2562 => 0.3423, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.59% (3.1254 => 4.1126, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.56% (1.4588 => 1.8463, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.33% (5.6033 => 6.9108, std.dev.: 0.2185) SingleSource/Benchmarks/Misc/salsa20: 21.77% (7.4497 => 9.0716, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.40% (4.8112 => 5.7927, std.dev.: 0.1087) SingleSource/Regression/C/uint64_to_float: 16.46% (1.5397 => 1.7931, std.dev.: 0.0789) MultiSource/Applications/JM/lencod/lencod: 13.92% (6.8159 => 7.7645, std.dev.: 0.2044) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.77% (5.0033 => 5.6424, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.84% (3.6477 => 3.9702, std.dev.: 0.0481) SingleSource/Benchmarks/Misc/ReedSolomon: 8.02% (8.6447 => 9.3378, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.99% (4.7473 => 5.0791, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 5.45% (1.0425 => 1.0993, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (4.1836 => 4.4059, std.dev.: 0.0042) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.15% (9.0082 => 9.3824, std.dev.: 0.0747) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (5.0310 => 5.2282, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.10% (4.7254 => 4.8717, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/pi: 2.80% (2.1390 => 2.1988, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.18% (4.8076 => 4.8641, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -25.74% (0.1888 => 0.1402, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.51% (1.0960 => 0.8931, std.dev.: 0.0488) MultiSource/Applications/hbd/hbd: -18.42% (1.8964 => 1.5471, std.dev.: 0.0153) SingleSource/UnitTests/Vector/constpool: -16.28% (9.8875 => 8.2774, std.dev.: 0.2972) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.65% (0.0862 => 0.0753, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: -12.63% (1.0220 => 0.8929, std.dev.: 0.0054) MultiSource/Applications/aha/aha: -12.41% (0.1378 => 0.1207, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -11.65% (1.5979 => 1.4117, std.dev.: 0.0151) MultiSource/Applications/treecc/treecc: -10.64% (2.4719 => 2.2090, std.dev.: 0.0202) MultiSource/Applications/hexxagon/hexxagon: -10.42% (1.1433 => 1.0242, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.11% (6.4235 => 5.7744, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: -9.17% (0.5134 => 0.4663, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.49% (0.1366 => 0.1250, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -8.29% (4.6406 => 4.2559, std.dev.: 0.0328) MultiSource/Applications/siod/siod: -7.63% (2.6437 => 2.4420, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash: -7.08% (0.4689 => 0.4357, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: -7.01% (0.8653 => 0.8046, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.88% (1.0234 => 0.9530, std.dev.: 0.0249) MultiSource/Applications/ClamAV/clamscan: -6.84% (17.4365 => 16.2440, std.dev.: 0.0611) MultiSource/Applications/sqlite3/sqlite3: -6.77% (17.5634 => 16.3750, std.dev.: 0.3566) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.73% (1.2154 => 1.1336, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/fibo: -6.48% (0.2006 => 0.1876, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: -6.28% (1.3979 => 1.3101, std.dev.: 0.0168) MultiSource/Applications/d/make_dparser: -5.77% (3.7840 => 3.5656, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/moments: -5.30% (0.4002 => 0.3790, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: -5.23% (0.3462 => 0.3281, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/except: -4.65% (0.2172 => 0.2071, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -4.60% (0.2305 => 0.2199, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: -4.23% (0.3665 => 0.3510, std.dev.: 0.0047) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.90% (1.1731 => 1.1273, std.dev.: 0.0121) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9424, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -61.78% (15.6525 => 5.9822, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.58% (0.4146 => 0.1800, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.32% (0.4578 => 0.2366, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.96% (11.3868 => 6.3814, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.98% (5.4023 => 3.6205, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/heapsort: -31.05% (4.4739 => 3.0848, std.dev.: 0.1083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.86% (0.4452 => 0.3078, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.75% (0.5495 => 0.4025, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.19% (5.2605 => 3.8830, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.39% (0.5826 => 0.4347, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.13% (4.4467 => 3.3293, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/heapsort: -24.51% (4.2042 => 3.1738, std.dev.: 0.0762) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.42% (0.5897 => 0.4457, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8228, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: -20.72% (1.8123 => 1.4368, std.dev.: 0.0221) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.65% (1.5623 => 1.2710, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7928, std.dev.: 0.0263) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.37% (16.6791 => 13.7814, std.dev.: 0.2278) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.01% (7.0016 => 6.0207, std.dev.: 0.1792) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.18% (3.1921 => 2.7713, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.74% (9.7992 => 8.5511, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.49% (5.7056 => 4.9931, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.41% (5.0421 => 4.4669, std.dev.: 0.0160) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.97% (1.6547 => 1.4732, std.dev.: 0.0498) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.29% (0.4081 => 0.3661, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/lists1: -9.63% (0.6628 => 0.5990, std.dev.: 0.0074) MultiSource/Applications/SPASS/SPASS: -8.12% (9.0650 => 8.3289, std.dev.: 0.0332) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.98% (4.4540 => 4.0985, std.dev.: 0.0481) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.65% (0.3217 => 0.2971, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.49% (4.2843 => 3.9634, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: -7.39% (3.5443 => 3.2823, std.dev.: 0.0637) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.80% (4.9799 => 4.6413, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2276, std.dev.: 0.0717) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2489, std.dev.: 0.0264) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.23% (46.0987 => 43.2273, std.dev.: 0.2849) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (63.1520 => 59.6338, std.dev.: 0.3360) SingleSource/Benchmarks/McGill/queens: -5.37% (1.7443 => 1.6507, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.93% (3.7662 => 3.5807, std.dev.: 0.0192) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.88% (0.2173 => 0.2067, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.87% (23.3986 => 22.2600, std.dev.: 0.0637) SingleSource/Benchmarks/Shootout-C++/hash2: -4.70% (3.6768 => 3.5040, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3592, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (5.8973 => 5.6825, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.63% (3.5691 => 3.4396, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.37% (40.4729 => 39.1100, std.dev.: 0.4612) SingleSource/Benchmarks/Shootout-C++/lists: -3.36% (17.2182 => 16.6396, std.dev.: 0.0418) MultiSource/Applications/lua/lua: -2.63% (29.0327 => 28.2696, std.dev.: 0.2701) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.40% (3.0082 => 2.9361, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.24% (1.4446 => 1.4122, std.dev.: 0.0044) MultiSource/Benchmarks/Bullet/bullet: -2.22% (7.2040 => 7.0443, std.dev.: 0.0246) SingleSource/Benchmarks/Shootout-C++/hash: -2.11% (0.6254 => 0.6122, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -1.92% (0.8521 => 0.8357, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.87% (8.7327 => 8.5693, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.83% (4.0355 => 3.9618, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/ffbench: -1.67% (1.4244 => 1.4006, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (85.3042 => 83.8835, std.dev.: 0.0624) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.49% (3.3596 => 3.3096, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.41% (1.5476 => 1.5258, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.40% (5.9063 => 5.8239, std.dev.: 0.0169) SingleSource/Benchmarks/Misc/whetstone: -1.33% (1.6251 => 1.6035, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (6.8262 => 6.7464, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops-6: -1.09% (2.4234 => 2.3969, std.dev.: 0.0050) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.50% (1.2047 => 1.2228, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -39.48% (0.0233 => 0.0141, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -34.01% (0.0394 => 0.0260, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.05% (0.0328 => 0.0318, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.04% (0.0445 => 0.0427, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -14.08% (0.0213 => 0.0183, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -36.56% (0.0227 => 0.0144, std.dev.: 0.0039) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.33% (0.0255 => 0.0221, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.75% (0.1530 => 0.1488, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: -39.76% (1.9293 => 1.1622, std.dev.: 0.0370) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4049 => 0.3994, std.dev.: 0.0502) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.91% (0.1510 => 0.1554, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -25.77% (0.0978 => 0.0726, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.51% (0.0590 => 0.0587, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.54% (1.1617 => 1.2842, std.dev.: 0.0372) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.62% (0.0032 => 0.0027, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.25% (0.0610 => 0.0578, std.dev.: 0.0126) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.31% (0.0268 => 0.0368, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.92% (0.7437 => 1.7694, std.dev.: 0.0224) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -22.83% (0.0092 => 0.0071, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.29% (12.7781 => 34.1541, std.dev.: 0.2090) Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 08:12:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 10:12:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127161214.DECA12A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8008?compare_to=8005&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8008, Order: 173618, Start Time: 2013-01-27 14:00:41, End Time: 2013-01-27 16:12:34 To: 8005, Order: 173613, Start Time: 2013-01-27 11:18:25, End Time: 2013-01-27 13:30:07 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (224 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (646 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.46% (10.6652 => 10.8211, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 1.03% (1.5089 => 1.5245, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.01% (20.4793 => 20.6857, std.dev.: 0.0193) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.78% (76.5344 => 77.8975, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.40% (0.0677 => 0.0654, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8450 => 499.8599, std.dev.: 0.0020) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 44225.61% (1.1277 => 499.8599, std.dev.: 0.0020) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.90% (0.5229 => 1.6623, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 21.54% (14.9895 => 18.2177, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 46.13% (14.1553 => 20.6857, std.dev.: 0.0193) MultiSource/Benchmarks/MallocBench/gs/gs: 19.29% (4.1105 => 4.9034, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.49% (1.1048 => 1.7399, std.dev.: 0.0049) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.12% (7.1582 => 37.5178, std.dev.: 0.0074) SingleSource/Benchmarks/Misc-C++-EH/spirit: 88.09% (3.4629 => 6.5134, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.08% (0.6222 => 1.1018, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10277.50% (0.0720 => 7.4718, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11152000.00% (0.0001 => 11.1521, std.dev.: 0.0119) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 65900.00% (0.0001 => 0.0660, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9847400.00% (0.0001 => 9.8475, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485200.00% (0.0001 => 5.4853, std.dev.: 0.0381) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.40% (1.1194 => 10.2806, std.dev.: 0.0103) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 149.58% (22.1758 => 55.3463, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.74% (0.0929 => 0.1837, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 88.89% (0.0243 => 0.0459, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 72.18% (0.1463 => 0.2519, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 61.68% (0.0394 => 0.0637, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.76% (2.9384 => 4.6062, std.dev.: 0.0159) SingleSource/Regression/C/sumarray: 54.98% (0.0231 => 0.0358, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.75% (7.0540 => 10.7752, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.49% (1.5859 => 2.4183, std.dev.: 0.0106) MultiSource/Benchmarks/FreeBench/distray/distray: 49.24% (0.1056 => 0.1576, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.31% (8.1363 => 11.9857, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.81% (2.2024 => 3.1452, std.dev.: 0.0203) MultiSource/Applications/sgefa/sgefa: 41.11% (0.3109 => 0.4387, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615) SingleSource/Benchmarks/Misc/flops: 38.97% (0.1432 => 0.1990, std.dev.: 0.0002) SingleSource/UnitTests/vla: 38.59% (0.0355 => 0.0492, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.26% (21.9371 => 30.3304, std.dev.: 0.0225) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.23% (0.1062 => 0.1468, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.07% (4.2646 => 5.7175, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.82% (0.0479 => 0.0641, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.69% (0.4615 => 0.6170, std.dev.: 0.0051) SingleSource/Benchmarks/McGill/exptree: 33.42% (0.0814 => 0.1086, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.12% (1.5415 => 2.0521, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.31% (0.2271 => 0.2982, std.dev.: 0.0016) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.97% (0.1143 => 0.1497, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 30.95% (1.1642 => 1.5245, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/05-eks/eks: 30.12% (0.4299 => 0.5594, std.dev.: 0.0020) MultiSource/Benchmarks/NPB-serial/is/is: 29.07% (0.0719 => 0.0928) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.95% (0.5105 => 0.6583, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 28.77% (0.0636 => 0.0819, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.75% (0.0793 => 0.1021, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.53% (0.1125 => 0.1446, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.27% (0.6675 => 0.8562, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.59% (0.1584 => 0.2021, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 27.55% (0.1655 => 0.2111, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.33% (0.1892 => 0.2409, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/08-main/main: 26.82% (0.2554 => 0.3239, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 26.81% (9.4845 => 12.0276, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.68% (0.0746 => 0.0945, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.62% (3.8922 => 4.9282, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.58% (0.0730 => 0.0924, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 26.42% (0.4289 => 0.5422, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: 25.33% (1.0722 => 1.3438, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.22% (0.1566 => 0.1961, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.12% (0.3121 => 0.3905, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.08% (1.4186 => 1.7744, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0408 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.94% (0.1175 => 0.1468, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.90% (0.1695 => 0.2117, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.82% (0.1906 => 0.2379, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/hash2: 24.68% (0.4620 => 0.5760, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.01% (0.1337 => 0.1658, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 23.98% (0.6456 => 0.8004, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.96% (0.0672 => 0.0833, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 23.65% (0.7115 => 0.8798, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/messages-2: 23.56% (0.0662 => 0.0818, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 23.22% (0.1236 => 0.1523, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.04% (0.2700 => 0.3322, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 22.77% (0.0527 => 0.0647, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 22.68% (0.0626 => 0.0768, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.64% (0.1555 => 0.1907, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/whetstone: 22.58% (0.0660 => 0.0809) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.54% (0.0457 => 0.0560, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.37% (0.0675 => 0.0826, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.97% (0.0842 => 0.1027, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.96% (0.1029 => 0.1255, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 21.93% (0.7835 => 0.9553, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (0.3098 => 0.3775, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.61% (1.3050 => 1.5870, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.41% (0.1032 => 0.1253, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 21.37% (0.1151 => 0.1397, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 21.24% (0.1695 => 0.2055, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 21.12% (5.7591 => 6.9755, std.dev.: 0.0159) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.11% (0.0886 => 0.1073, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 20.98% (0.1163 => 0.1407, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.88% (0.0953 => 0.1152, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.72% (0.1940 => 0.2342, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bisort/bisort: 20.68% (0.0614 => 0.0741, std.dev.: 0.0020) MultiSource/Applications/lambda-0_1_3/lambda: 20.62% (0.7433 => 0.8966, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.60% (0.5860 => 0.7067, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.34% (0.8172 => 0.9834, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/wordfreq: 20.32% (0.3307 => 0.3979, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.29% (4.9449 => 5.9481, std.dev.: 0.0173) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.74% (0.5020 => 0.6011, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.70% (0.0528 => 0.0632, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.69% (3.3354 => 3.9920, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.65% (0.2107 => 0.2521, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.48% (5.0018 => 5.9761, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.29% (0.2758 => 0.3290, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.16% (0.5569 => 0.6636, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.16% (0.1117 => 0.1331, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/health/health: 18.93% (0.1268 => 0.1508, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.68% (0.1510 => 0.1792, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 18.55% (3.8723 => 4.5905, std.dev.: 0.0090) MultiSource/Applications/treecc/treecc: 18.54% (2.0273 => 2.4032, std.dev.: 0.0148) MultiSource/Benchmarks/BitBench/five11/five11: 18.52% (0.0567 => 0.0672, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.52% (0.9765 => 1.1573, std.dev.: 0.0056) MultiSource/Benchmarks/nbench/nbench: 18.45% (1.1840 => 1.4025, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.31% (0.0770 => 0.0911, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.21% (0.2065 => 0.2441, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.20% (0.4203 => 0.4968, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 18.08% (0.3423 => 0.4042, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.01% (0.1044 => 0.1232, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.98% (1.1861 => 1.3994, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 17.97% (2.2969 => 2.7096, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.90% (0.0933 => 0.1100, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.69% (0.5981 => 0.7039, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.52% (0.3441 => 0.4044, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: 17.39% (0.3283 => 0.3854, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 17.28% (0.2049 => 0.2403, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.02% (0.8101 => 0.9480, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 17.02% (0.3232 => 0.3782, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.79% (0.6450 => 0.7533, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/09-vor/vor: 16.64% (0.3180 => 0.3709, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 16.43% (0.0633 => 0.0737) SingleSource/UnitTests/SignlessTypes/rem: 15.91% (0.1144 => 0.1326, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 15.77% (0.8921 => 1.0328, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 15.57% (0.3379 => 0.3905, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.55% (0.0759 => 0.0877, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 15.53% (0.0818 => 0.0945, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.26% (0.8067 => 0.9298, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.03% (0.3865 => 0.4446, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.94% (0.2603 => 0.2992, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.80% (0.4636 => 0.5322, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 14.18% (0.2905 => 0.3317, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.99% (0.4103 => 0.4677, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 13.85% (0.3387 => 0.3856, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 13.63% (1.5603 => 1.7729, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/moments: 13.32% (0.4048 => 0.4587, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 12.99% (0.3603 => 0.4071, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 12.92% (0.3422 => 0.3864, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 12.83% (0.3282 => 0.3703, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists1: 12.81% (0.3684 => 0.4156, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.73% (0.3927 => 0.4427, std.dev.: 0.0092) MultiSource/Applications/sqlite3/sqlite3: 12.71% (17.1811 => 19.3651, std.dev.: 0.0200) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.63% (0.2430 => 0.2737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.23% (0.3826 => 0.4294, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 12.06% (0.3092 => 0.3465, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.03% (0.1114 => 0.1248, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.81% (0.4064 => 0.4544, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.47% (0.3427 => 0.3820, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.36% (0.3828 => 0.4263, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.17% (14.3668 => 15.9711, std.dev.: 0.0151) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.91% (0.2831 => 0.3140, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 10.88% (0.3694 => 0.4096, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 10.87% (0.2871 => 0.3183, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/synchronized: 10.81% (0.3561 => 0.3946, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.78% (0.3516 => 0.3895, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.72% (0.3497 => 0.3872, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.25% (2.0665 => 2.2784, std.dev.: 0.0091) SingleSource/Benchmarks/Stanford/Puzzle: 10.25% (0.1268 => 0.1398, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.15% (0.2877 => 0.3169, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2756 => 0.3034, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.06% (0.2725 => 0.2999, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3650 => 0.4011, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 9.89% (1.2842 => 1.4112, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.81% (0.2793 => 0.3067, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2714 => 0.2980, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.79% (0.2891 => 0.3174, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.77% (0.3162 => 0.3471, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.44% (0.3052 => 0.3340, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 9.31% (0.2802 => 0.3063, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2872 => 0.3138, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.22% (0.3935 => 0.4298, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.99% (0.6030 => 0.6572, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7326 => 0.7981, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.86% (0.3136 => 0.3414, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 8.78% (63.2438 => 68.7997, std.dev.: 0.0851) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.76% (2.2022 => 2.3731, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.69% (0.1625 => 0.1750, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.40% (0.4879 => 0.5240, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.45% (0.3177 => 0.3382, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 5.12% (0.2266 => 0.2382, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 4.73% (0.3131 => 0.3279, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 4.38% (10.3673 => 10.8211, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.43% (0.3817 => 0.3948, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.95% (7.9617 => 8.1965, std.dev.: 0.0093) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4704, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.16% (1.1145 => 1.2946, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 13.10% (0.5413 => 0.6122, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.10% (1.1396 => 1.2433, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4270, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4518, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (3.1578 => 3.3088, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.3316 => 0.3448, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.42% (2.0360 => 2.1056, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.14% (0.9957 => 1.0270, std.dev.: 0.0089) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9185, std.dev.: 0.0055) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.15% (3.6395 => 3.7179, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2197, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2881, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.57% (1.0785 => 1.0954, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2388, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.24% (10.3460 => 10.4747, std.dev.: 0.0217) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.01% (6.5088 => 6.5745, std.dev.: 0.0051) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.95% (5.2763 => 1.1632, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -75.33% (0.8651 => 0.2134, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.97% (0.1622 => 0.0925, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.70% (5.3855 => 4.4324, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.19% (5.3526 => 4.4327, std.dev.: 0.0098) MultiSource/Applications/JM/ldecod/ldecod: -13.04% (10.4361 => 9.0753, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.93% (1.7609 => 1.6213, std.dev.: 0.0053) SingleSource/UnitTests/Vector/constpool: -7.90% (54.1659 => 49.8867, std.dev.: 0.0293) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.00% (1.9577 => 0.6461, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3064, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -30.57% (10.7105 => 7.4368, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8463, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0038, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1255, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7333, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.97% (0.9540 => 0.8398, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4942, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.09% (1.5660 => 1.4236, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.80% (19.9488 => 18.5918, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: -6.22% (1.2373 => 1.1604, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7017, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5085, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.27% (10.2830 => 9.8439, std.dev.: 0.0049) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.70% (3.7221 => 3.6587, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout/ary3: -1.69% (3.6994 => 3.6370, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2189, std.dev.: 0.0121) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5893, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8580, std.dev.: 0.0066) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.09% (0.2116 => 0.0654, std.dev.: 0.0032) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 08:15:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 10:15:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130127161527.8CACD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8009?compare_to=8002&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8009, Order: 173615, Start Time: 2013-01-27 12:39:38, End Time: 2013-01-27 16:15:46 To: 8002, Order: 173610, Start Time: 2013-01-27 07:59:25, End Time: 2013-01-27 11:45:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (189 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1100 (748 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.39% (1.1398 => 1.1557, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.4165 => 2.4442, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.02% (2.1614 => 2.1834, std.dev.: 0.0060) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.95% (131.3846 => 128.8203, std.dev.: 0.7698) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.92% (0.0625 => 0.0937, std.dev.: 0.0032) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.03% (0.1063 => 0.1446, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 30.17% (0.1107 => 0.1441, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.11% (0.2969 => 0.3863, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.43% (0.0714 => 0.0917, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.17% (0.5900 => 0.7562, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.69% (0.4139 => 0.5285, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.61% (0.0547 => 0.0698, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.99% (0.4994 => 0.6342, std.dev.: 0.0143) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.95% (0.0475 => 0.0603, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.95% (0.0642 => 0.0815, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.78% (0.5000 => 0.6339, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0415 => 0.0526, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 26.73% (1.5932 => 2.0190, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.67% (0.1620 => 0.2052, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.10% (0.4253 => 0.5363, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.03% (0.0584 => 0.0736, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.27% (0.1021 => 0.1279, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.73% (0.1549 => 0.1932, std.dev.: 0.0069) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 24.05% (0.0948 => 0.1176, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.93% (0.1103 => 0.1367, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.85% (0.0633 => 0.0784, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.23% (0.1003 => 0.1236, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.13% (0.1604 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.11% (0.0822 => 0.1012, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/05-eks/eks: 23.04% (0.1619 => 0.1992, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.03% (0.0495 => 0.0609, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 23.02% (0.0821 => 0.1010, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.74% (0.0541 => 0.0664) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.70% (0.3903 => 0.4789, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.40% (0.2736 => 0.3349, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 22.02% (0.1090 => 0.1330, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.96% (0.0947 => 0.1155, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.70% (0.2866 => 0.3488, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.34% (0.3890 => 0.4720, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.20% (0.1462 => 0.1772, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.18% (1.3152 => 1.5937, std.dev.: 0.0312) MultiSource/Applications/spiff/spiff: 21.17% (0.4029 => 0.4882, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/08-main/main: 21.10% (0.1218 => 0.1475, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.96% (0.1088 => 0.1316, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.95% (0.2014 => 0.2436, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 20.79% (0.0481 => 0.0581, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 20.67% (0.0808 => 0.0975, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: 20.60% (0.1505 => 0.1815, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 20.56% (0.5826 => 0.7024) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.30% (0.3271 => 0.3935, std.dev.: 0.0110) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.27% (0.0513 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 20.13% (1.8794 => 2.2578, std.dev.: 0.0129) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 20.04% (0.5889 => 0.7069, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.76% (0.0582 => 0.0697, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.56% (0.4658 => 0.5569, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.53% (3.5627 => 4.2585, std.dev.: 0.0790) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.51% (0.1968 => 0.2352, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.48% (0.1160 => 0.1386, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 19.47% (0.5546 => 0.6626, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 19.37% (0.7171 => 0.8560, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.36% (0.5026 => 0.5999, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.22% (1.6211 => 1.9326, std.dev.: 0.0059) MultiSource/Applications/hbd/hbd: 19.18% (0.9697 => 1.1557, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.17% (0.0605 => 0.0721) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.99% (0.2875 => 0.3421, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 18.80% (0.2750 => 0.3267, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.77% (0.2792 => 0.3316, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 18.71% (0.2811 => 0.3337, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: 18.69% (0.1284 => 0.1524, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.49% (2.7292 => 3.2338, std.dev.: 0.0146) SingleSource/Benchmarks/Shootout-C++/matrix: 18.45% (0.2780 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 18.39% (0.2714 => 0.3213, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 18.34% (0.2803 => 0.3317, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.30% (0.2738 => 0.3239, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 18.28% (0.2823 => 0.3339, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.25% (0.2729 => 0.3227, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.24% (0.2911 => 0.3442, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 18.24% (0.2813 => 0.3326, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.23% (2.0673 => 2.4442, std.dev.: 0.0037) SingleSource/Regression/C++/ofstream_ctor: 18.18% (0.3004 => 0.3550, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.12% (0.4361 => 0.5151, std.dev.: 0.0022) MultiSource/Applications/ClamAV/clamscan: 18.09% (4.2109 => 4.9728, std.dev.: 0.0426) MultiSource/Benchmarks/McCat/18-imp/imp: 18.09% (0.1421 => 0.1678, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 18.06% (0.9909 => 1.1699, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.03% (1.9694 => 2.3244, std.dev.: 0.0461) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.02% (0.3930 => 0.4638, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 17.99% (1.0781 => 1.2721, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/wc: 17.96% (0.3096 => 0.3652, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.80% (0.3258 => 0.3838, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 17.72% (0.3267 => 0.3846, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.68% (0.3195 => 0.3760, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.52% (1.9966 => 2.3465, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.52% (0.3060 => 0.3596, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.25% (0.3124 => 0.3663, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 17.12% (0.3317 => 0.3885, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 17.12% (0.3726 => 0.4364, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.07% (0.3362 => 0.3936, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.00% (0.3282 => 0.3840, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 16.91% (0.2566 => 0.3000, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 16.86% (0.3469 => 0.4054, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.83% (0.3488 => 0.4075, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 16.74% (23.5202 => 27.4578, std.dev.: 0.0677) SingleSource/UnitTests/ObjC/exceptions-4: 16.74% (0.3465 => 0.4045, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 16.72% (0.3678 => 0.4293, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 16.72% (0.3446 => 0.4022, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.66% (0.3625 => 0.4229, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 16.65% (0.3477 => 0.4056, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.63% (4.4195 => 5.1545, std.dev.: 0.0450) SingleSource/UnitTests/ObjC/for-in: 16.62% (0.3496 => 0.4077, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 16.62% (0.3460 => 0.4035, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 16.55% (0.3348 => 0.3902, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: 16.50% (0.3442 => 0.4010, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.48% (0.3981 => 0.4637, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 16.43% (0.4146 => 0.4827, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.31% (0.3690 => 0.4292, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 16.30% (0.3650 => 0.4245, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.27% (1.4269 => 1.6590, std.dev.: 0.0049) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.20% (0.3845 => 0.4468, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 16.07% (0.4251 => 0.4934, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 16.03% (0.3724 => 0.4321, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 16.00% (0.3643 => 0.4226, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.63% (0.7875 => 0.9106, std.dev.: 0.0124) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.16% (0.0673 => 0.0775, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 15.00% (0.5012 => 0.5764, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 14.95% (2.1653 => 2.4891, std.dev.: 0.0222) MultiSource/Applications/JM/lencod/lencod: 14.50% (4.6177 => 5.2872, std.dev.: 0.0487) MultiSource/Applications/SPASS/SPASS: 14.24% (5.5417 => 6.3307, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.16% (0.6435 => 0.7346, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 14.03% (0.1383 => 0.1577, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.94% (0.2691 => 0.3066, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.73% (0.2068 => 0.2352, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 13.73% (2.1013 => 2.3898, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.72% (0.1028 => 0.1169, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 13.59% (0.2075 => 0.2357, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.59% (0.0758 => 0.0861, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.52% (0.2737 => 0.3107, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.55% (0.3084 => 0.3471, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 12.49% (0.3498 => 0.3935, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.40% (0.2040 => 0.2293, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 12.19% (0.6634 => 0.7443, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.08% (0.2103 => 0.2357, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 11.77% (0.5361 => 0.5992, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 11.72% (0.3336 => 0.3727, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: 11.62% (0.4847 => 0.5410, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.20% (11.6398 => 12.9430, std.dev.: 0.0309) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.26% (0.7426 => 0.8188, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 10.08% (0.2391 => 0.2632, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.72% (4.6926 => 5.1488, std.dev.: 0.0181) MultiSource/Applications/sqlite3/sqlite3: 9.49% (2.0346 => 2.2276, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.69% (0.5584 => 0.6069, std.dev.: 0.0013) MultiSource/Applications/kimwitu++/kc: 8.04% (11.9555 => 12.9170, std.dev.: 0.0273) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.99% (0.3792 => 0.4057, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5167, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.24% (0.0644 => 0.0755, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 11.28% (0.2802 => 0.3118, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.02% (0.3693 => 0.4063, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 7.21% (0.2122 => 0.2275, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.55% (3.3903 => 3.6124, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2414, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6820, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0052) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 2.80% (0.6276 => 0.6452, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1994, std.dev.: 0.0057) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3109, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2899, std.dev.: 0.0045) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.38% (1.0142 => 1.0282, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.24% (1.0927 => 1.1062, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 1.14% (4.0317 => 4.0777, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2082, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5980, std.dev.: 0.0041) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4792, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.03% (1.2197 => 1.2323, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.72% (25.4195 => 16.5947, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/fldry: -17.14% (17.2379 => 14.2832, std.dev.: 0.0951) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -9.49% (0.2402 => 0.2174, std.dev.: 0.0053) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9766, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/tsp/tsp: -7.26% (2.1113 => 1.9580, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -5.80% (14.0481 => 13.2329, std.dev.: 0.2477) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2265, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.62% (11.2080 => 10.8024, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.99% (0.6293 => 0.6105, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -2.98% (6.9842 => 6.7758, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.22% (197.4719 => 193.0969, std.dev.: 0.1194) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.63% (10.7630 => 10.5871, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.18% (105.3826 => 104.1443, std.dev.: 0.0263) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0494, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 08:41:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 10:41:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127164129.E650C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8010?compare_to=8006&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8010, Order: 173618, Start Time: 2013-01-27 15:07:28, End Time: 2013-01-27 16:41:49 To: 8006, Order: 173616, Start Time: 2013-01-27 13:09:57, End Time: 2013-01-27 14:44:00 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (87 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.79% (0.0280 => 0.0523, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.57% (0.0717 => 0.1223, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.40% (0.0974 => 0.1650, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 50.56% (0.0267 => 0.0402, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.58% (0.1132 => 0.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.57% (0.0599 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.86% (0.6395 => 0.8816, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.77% (0.5688 => 0.7552, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.61% (0.5456 => 0.7235, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.28% (0.6260 => 0.8281, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.20% (0.5805 => 0.7674, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.02% (0.5849 => 0.7722, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.90% (0.5567 => 0.7343, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.73% (0.6395 => 0.8424, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.68% (0.5581 => 0.7349, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.68% (0.5575 => 0.7341, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.77% (0.5941 => 0.7769, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.11% (0.5859 => 0.7623, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.05% (0.6033 => 0.7846, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.35% (0.6440 => 0.8330, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.06% (1.6474 => 2.1261, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.87% (0.6189 => 0.7976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.31% (0.6676 => 0.8566, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.98% (0.6304 => 0.8068, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.75% (0.0699 => 0.0893) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.48% (0.6230 => 0.7942, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.67% (0.6660 => 0.8436, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.59% (0.5802 => 0.7345, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.35% (0.5705 => 0.7208, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.26% (0.5925 => 0.7481, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.92% (0.5857 => 0.7375, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 25.84% (0.0445 => 0.0560, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.68% (0.5478 => 0.6885, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.66% (0.5570 => 0.6999, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.34% (0.5591 => 0.7008, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.08% (0.5863 => 0.7275, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.00% (0.7524 => 0.9330, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.92% (0.6446 => 0.7988, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.89% (0.6052 => 0.7498, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.33% (0.6681 => 0.8240, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.97% (0.6194 => 0.7617, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.80% (0.6297 => 0.7733, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.97% (2.2587 => 2.7549, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.43% (0.6667 => 0.8096, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.88% (0.7339 => 0.8798, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.28% (0.1146 => 0.1344, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.18% (0.0680 => 0.0790, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 15.70% (0.3357 => 0.3884, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.21% (1.1450 => 1.3192, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.99% (0.1081 => 0.1243, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 14.92% (0.3834 => 0.4406, std.dev.: 0.0111) SingleSource/Benchmarks/McGill/exptree: 14.47% (0.0864 => 0.0989, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.09% (0.0731 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.86% (4.5069 => 5.0863, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.67% (0.4916 => 0.5539, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.47% (0.4515 => 0.5078, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.06% (0.1982 => 0.2221, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.84% (1.6364 => 1.8301, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.55% (3.5339 => 3.9420, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 9.88% (9.2283 => 10.1397, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash: 9.31% (0.4524 => 0.4945, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.30% (0.1731 => 0.1892, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.94% (0.1230 => 0.1340, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.94% (1.2515 => 1.3634, std.dev.: 0.0054) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.45% (0.2001 => 0.2170, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.44% (0.5329 => 0.5779, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4861 => 0.5253, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.76% (0.7021 => 0.7566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.55% (1.4642 => 1.5748, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.25% (1.2784 => 1.3711, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 7.13% (0.1879 => 0.2013, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1761 => 0.1875, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.45% (0.3255 => 0.3465, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6750 => 0.7175, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.63% (0.3319 => 0.3506, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.42% (5.4682 => 5.7098, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 4.06% (5.0226 => 5.2267, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 3.98% (0.3446 => 0.3583, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.71% (0.3394 => 0.3520, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.46% (1.3864 => 1.4344, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 3.14% (0.8418 => 0.8682, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4427 => 0.4565, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.81% (0.9557 => 0.9826, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: 2.67% (0.7447 => 0.7646, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5168 => 0.5304, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 2.35% (15.5079 => 15.8718, std.dev.: 0.0069) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.34% (22.4056 => 22.9310, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.3722 => 1.4011, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.2300 => 1.2463, std.dev.: 0.0041) MultiSource/Applications/treecc/treecc: 1.30% (2.1401 => 2.1680, std.dev.: 0.0077) MultiSource/Applications/d/make_dparser: 1.19% (3.5154 => 3.5573, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8157, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.32% (0.9531 => 1.0324, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1497, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5879, std.dev.: 0.0665) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1011, std.dev.: 0.0092) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3831, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6063, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.60% (18.2231 => 18.5139, std.dev.: 0.0068) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.18% (5.1955 => 5.2566, std.dev.: 0.0064) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3489 => 10.4600, std.dev.: 0.0146) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.94% (0.1281 => 0.1128, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.38% (0.7198 => 0.6883, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.23% (0.3194 => 0.3059, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.95% (0.3821 => 0.3670, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -3.78% (0.3812 => 0.3668, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.64% (0.3848 => 0.3708, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.62% (0.4033 => 0.3887, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.55% (2.4924 => 2.4038, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.42% (0.3891 => 0.3758, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.40% (0.4176 => 0.4034, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.13% (0.3837 => 0.3717, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.06% (0.3884 => 0.3765, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.88% (0.4199 => 0.4078, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -2.78% (0.6441 => 0.6262, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.76% (0.6347 => 0.6172, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.75% (20.7746 => 20.2025, std.dev.: 0.0319) SingleSource/UnitTests/ObjC/parameter-passing: -2.50% (0.4280 => 0.4173, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.11% (0.6484 => 0.6347, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.94% (0.7779 => 0.7628, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.90% (0.9542 => 0.9361, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.89% (14.2083 => 13.9393, std.dev.: 0.0051) MultiSource/Applications/hexxagon/hexxagon: -1.88% (1.3148 => 1.2901, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.80% (2.1713 => 2.1323, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: -1.65% (17.1032 => 16.8216, std.dev.: 0.0105) MultiSource/Applications/JM/lencod/lencod: -1.02% (16.1920 => 16.0266, std.dev.: 0.0147) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.89% (1.8100 => 0.6717, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3097, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -24.41% (1.3643 => 1.0313, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7522, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0868, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1972, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.20% (2.5106 => 2.1290, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3574, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.01% (4.1534 => 3.8207, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6329, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.20% (0.8545 => 0.8186, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1747, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.27% (5.5807 => 5.3984, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.92% (1.3096 => 1.2714, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7755, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1747, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.52% (1.6219 => 1.5973, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.41% (1.6307 => 1.6077, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6709, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 09:54:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 11:54:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127175453.56A562A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8011?compare_to=8007&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8011, Order: 173620, Start Time: 2013-01-27 15:56:00, End Time: 2013-01-27 17:55:14 To: 8007, Order: 173618, Start Time: 2013-01-27 13:37:21, End Time: 2013-01-27 15:38:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (109 on baseline) Performance Improvements: 6 (132 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (822 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/bc/bc: 1.66% (1.2382 => 1.2587, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/sim/sim: 5.63% (3.9998 => 4.2248, std.dev.: 0.0207) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.56% (0.4247 => 0.4483, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 5.01% (0.4895 => 0.5140, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 4.43% (1.1570 => 1.2082, std.dev.: 0.0001) SingleSource/Benchmarks/Linpack/linpack-pc: 3.56% (51.3448 => 53.1731, std.dev.: 0.1274) MultiSource/Benchmarks/Olden/health/health: 3.24% (0.3425 => 0.3536, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (39.1100 => 40.1409, std.dev.: 0.0475) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.29% (0.9652 => 0.9873, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: 1.98% (0.5452 => 0.5560, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.98% (40.1187 => 40.9112, std.dev.: 0.1072) SingleSource/Benchmarks/Shootout-C++/heapsort: 1.44% (3.1738 => 3.2196, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.36% (3.9618 => 4.0157, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/n-body: 1.01% (1.5258 => 1.5412, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: -1.29% (0.8046 => 0.7942, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.23% (1.3597 => 1.3430, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -1.22% (1.5471 => 1.5283, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.18% (13.7814 => 13.3433, std.dev.: 0.0834) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.25% (1.4122 => 1.3804, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.00% (1.5803 => 1.5487, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.35% (1.2228 => 1.2063, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 56.74% (0.0141 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.92% (0.0260 => 0.0255, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.63% (0.0318 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.41% (0.0427 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -28.96% (0.0183 => 0.0130, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: 36.81% (0.0144 => 0.0197, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 14.03% (0.0221 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -0.54% (0.1488 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -1.85% (1.1622 => 1.1407, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.03% (0.3994 => 0.3993, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.96% (0.1554 => 0.1508, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.85% (0.0726 => 0.0640, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.65% (0.0276 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.56% (0.0587 => 0.0525, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.30% (1.2842 => 1.2803, std.dev.: 0.0574) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 7.41% (0.0027 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.60% (0.0578 => 0.0563, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.09% (0.0368 => 0.0364, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.02% (1.7694 => 1.7513, std.dev.: 0.0085) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.25% (0.0071 => 0.0041, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.53% (34.1541 => 33.9739, std.dev.: 0.8867) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 389.88% (0.0336 => 0.1646, std.dev.: 0.0026) SingleSource/Regression/C/sumarraymalloc: 109.22% (0.0293 => 0.0613, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 90.88% (0.0274 => 0.0523, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 60.44% (0.1638 => 0.2628, std.dev.: 0.0019) SingleSource/Regression/C/sumarray: 53.21% (0.0265 => 0.0406, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.91% (0.8893 => 1.2620, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.47% (0.9120 => 1.2902, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.15% (0.8926 => 1.2599, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.85% (0.9061 => 1.2762, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.50% (0.9612 => 1.3505, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.88% (0.9381 => 1.3122, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.62% (0.9564 => 1.3353, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.61% (0.9588 => 1.3386, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.88% (0.8990 => 1.2485, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.71% (0.9091 => 1.2610, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.61% (0.9855 => 1.3660, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.87% (0.9422 => 1.2990, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.73% (0.9998 => 1.3770, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.61% (0.9403 => 1.2939, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.70% (0.9010 => 1.2317, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.67% (0.9512 => 1.3000, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.14% (0.8736 => 1.1893, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.13% (1.0119 => 1.3775, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.06% (0.8912 => 1.2126, std.dev.: 0.0096) SingleSource/Benchmarks/Stanford/IntMM: 35.73% (0.0431 => 0.0585, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.24% (1.0867 => 1.4696, std.dev.: 0.0103) SingleSource/Benchmarks/McGill/exptree: 35.04% (0.0859 => 0.1160, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.91% (1.0052 => 1.3561, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.60% (0.8732 => 1.1753, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.18% (0.8846 => 1.1870, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.88% (0.9867 => 1.3111, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.37% (1.0017 => 1.3260, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.62% (0.9788 => 1.2883, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.62% (0.9507 => 1.2513, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.48% (0.9488 => 1.2475, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.73% (1.0088 => 1.3188, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.52% (0.9685 => 1.2641, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.15% (0.9127 => 1.1879, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.68% (0.9405 => 1.2196, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.44% (0.9993 => 1.2935, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.10% (0.9550 => 1.2234, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.74% (1.0860 => 1.3764, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: 20.01% (0.3598 => 0.4318, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 19.92% (0.0738 => 0.0885, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.07% (0.0738 => 0.0864, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.99% (0.0669 => 0.0776, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 15.89% (0.0642 => 0.0744, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.40% (0.0805 => 0.0929, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.23% (0.0963 => 0.1100, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.19% (0.1240 => 0.1416, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.96% (1.0986 => 1.2520, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.79% (0.0783 => 0.0891, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.66% (0.1332 => 0.1514, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.47% (3.6295 => 4.1184, std.dev.: 0.0238) MultiSource/Benchmarks/mafft/pairlocalalign: 12.45% (9.5202 => 10.7053, std.dev.: 0.0478) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.29% (0.4596 => 0.5161, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 11.03% (0.2385 => 0.2648, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ReedSolomon: 10.68% (0.2050 => 0.2269, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.30% (0.5369 => 0.5922, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.90% (0.2577 => 0.2832, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 9.87% (0.1793 => 0.1970, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.81% (1.4110 => 1.5494, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.95% (0.1955 => 0.2130, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.46% (5.0381 => 5.4643, std.dev.: 0.0244) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.78% (0.2879 => 0.3103, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.40% (1.8651 => 2.0031, std.dev.: 0.0075) SingleSource/Benchmarks/Linpack/linpack-pc: 6.66% (0.2566 => 0.2737, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 5.58% (0.2042 => 0.2156, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.26% (2.4519 => 2.5809, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.64% (1.8127 => 1.8787, std.dev.: 0.0076) MultiSource/Applications/oggenc/oggenc: 3.43% (5.3553 => 5.5390, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 3.43% (0.6711 => 0.6941, std.dev.: 0.0009) MultiSource/Benchmarks/7zip/7zip-benchmark: 1.87% (44.1538 => 44.9784, std.dev.: 0.1572) MultiSource/Benchmarks/Bullet/bullet: 1.61% (33.2440 => 33.7807, std.dev.: 0.1280) MultiSource/Benchmarks/Prolangs-C/football/football: 1.48% (0.9759 => 0.9903, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.17% (23.5861 => 23.8622, std.dev.: 0.0229) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (1.4805 => 1.4961, std.dev.: 0.0058) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107050.00% (0.0008 => 0.8572, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout/matrix: 333.57% (1.5825 => 6.8613, std.dev.: 0.1733) SingleSource/Benchmarks/Shootout/ary3: 264.67% (2.2304 => 8.1337, std.dev.: 1.3708) MultiSource/Applications/sgefa/sgefa: 257.64% (0.3515 => 1.2571, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.30% (1.1825 => 4.0359, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.21% (4.8185 => 15.8150, std.dev.: 0.1205) SingleSource/Benchmarks/Shootout-C++/ary2: 206.20% (0.0129 => 0.0395, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 191.23% (0.0228 => 0.0664, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 144.40% (0.0232 => 0.0567, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 63.82% (2.9083 => 4.7645, std.dev.: 0.1443) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.27% (3.1254 => 4.1027, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 29.90% (0.2562 => 0.3328, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.28% (1.4588 => 1.8421, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.50% (4.8112 => 5.7975, std.dev.: 0.0035) SingleSource/Regression/C/uint64_to_float: 15.90% (1.5397 => 1.7845, std.dev.: 0.0727) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8565, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.22% (5.0033 => 5.6145, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.83% (3.6477 => 3.9697, std.dev.: 0.0467) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.38% (0.1622 => 0.1758, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.74% (0.4161 => 0.4483, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.99% (4.7473 => 5.0790, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/chomp: 5.72% (1.0425 => 1.1021, std.dev.: 0.0031) MultiSource/Benchmarks/sim/sim: 5.53% (4.0036 => 4.2248, std.dev.: 0.0207) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (4.1836 => 4.4066, std.dev.: 0.0172) SingleSource/Benchmarks/Linpack/linpack-pc: 4.48% (50.8945 => 53.1731, std.dev.: 0.1274) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.29% (5.0310 => 5.2466, std.dev.: 0.0388) MultiSource/Benchmarks/Ptrdist/ks/ks: 4.14% (1.1602 => 1.2082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.7254 => 4.8709, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/except: 3.01% (0.4990 => 0.5140, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: 2.22% (0.5439 => 0.5560, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.99% (0.9680 => 0.9873, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.14% (2.5681 => 2.5975, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -40.99% (0.0727 => 0.0429, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.72% (0.0808 => 0.0479, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.46% (0.0692 => 0.0502, std.dev.: 0.0006) SingleSource/Benchmarks/SmallPT/smallpt: -26.80% (0.1888 => 0.1382, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: -19.41% (1.8964 => 1.5283, std.dev.: 0.0056) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.93% (0.0676 => 0.0548, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.14% (0.1009 => 0.0826, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -16.78% (0.7686 => 0.6396, std.dev.: 0.0116) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.66% (1.0960 => 0.9134, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.63% (0.1684 => 0.1404, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.48% (0.1079 => 0.0912, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -13.30% (9.8875 => 8.5727, std.dev.: 0.1862) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -13.23% (0.0862 => 0.0748, std.dev.: 0.0006) MultiSource/Applications/aha/aha: -13.06% (0.1378 => 0.1198, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: -12.47% (1.0220 => 0.8946, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -12.10% (0.4074 => 0.3581, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: -11.03% (1.5979 => 1.4217, std.dev.: 0.0162) MultiSource/Applications/hexxagon/hexxagon: -10.80% (1.1433 => 1.0198, std.dev.: 0.0037) MultiSource/Applications/treecc/treecc: -10.22% (2.4719 => 2.2192, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.15% (6.4235 => 5.7712, std.dev.: 0.0238) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.14% (0.7693 => 0.6990, std.dev.: 0.0055) MultiSource/Applications/lua/lua: -9.08% (4.6406 => 4.2193, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -8.84% (0.1210 => 0.1103, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: -8.75% (0.5134 => 0.4685, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.49% (0.1366 => 0.1250, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.37% (1.1498 => 1.0536, std.dev.: 0.0110) MultiSource/Applications/lambda-0_1_3/lambda: -8.22% (0.8653 => 0.7942, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.78% (10.2703 => 9.4711, std.dev.: 0.0419) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.70% (0.2481 => 0.2290, std.dev.: 0.0022) MultiSource/Applications/siod/siod: -7.56% (2.6437 => 2.4439, std.dev.: 0.0210) MultiSource/Applications/sqlite3/sqlite3: -7.55% (17.5634 => 16.2376, std.dev.: 0.0879) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.53% (1.2154 => 1.1239, std.dev.: 0.0043) MultiSource/Applications/ClamAV/clamscan: -7.06% (17.4365 => 16.2054, std.dev.: 0.0444) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.95% (0.9124 => 0.8490, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -6.90% (1.3979 => 1.3015, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash: -6.85% (0.4689 => 0.4368, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.75% (0.6885 => 0.6420, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.51% (0.5746 => 0.5372, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.44% (0.9588 => 0.8971, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.40% (0.3560 => 0.3332, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.06% (1.0234 => 0.9614, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ft/ft: -6.00% (0.2283 => 0.2146, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.77% (0.2615 => 0.2464, std.dev.: 0.0053) MultiSource/Applications/d/make_dparser: -5.32% (3.7840 => 3.5827, std.dev.: 0.0095) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.84% (0.2709 => 0.2578, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.58% (0.2618 => 0.2498, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.40% (1.5131 => 1.4465, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/moments: -4.15% (0.4002 => 0.3836, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.95% (1.6874 => 1.6207, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.88% (0.6934 => 0.6665, std.dev.: 0.0080) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.86% (1.1731 => 1.1278, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.81% (0.3462 => 0.3330, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.55% (1.3924 => 1.3430, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.46% (0.3093 => 0.2986, std.dev.: 0.0018) MultiSource/Applications/kimwitu++/kc: -2.47% (18.9377 => 18.4697, std.dev.: 0.0950) MultiSource/Benchmarks/MallocBench/gs/gs: -2.18% (4.5936 => 4.4934, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.91% (7.2721 => 7.1329, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.80% (1.3220 => 1.2982, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.78% (14.9757 => 14.7094, std.dev.: 0.0398) MultiSource/Applications/SPASS/SPASS: -1.29% (16.4479 => 16.2349, std.dev.: 0.0476) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9428, std.dev.: 0.0125) SingleSource/Benchmarks/Misc/fp-convert: -61.85% (15.6525 => 5.9720, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.30% (0.4146 => 0.1812, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.30% (0.4578 => 0.2367, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.95% (11.3868 => 6.3827, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6279, std.dev.: 0.0467) MultiSource/Benchmarks/Olden/bisort/bisort: -31.23% (0.9372 => 0.6445, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.00% (0.4452 => 0.3072, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/heapsort: -29.63% (4.4739 => 3.1482, std.dev.: 0.1093) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.94% (1.0816 => 0.7686, std.dev.: 0.0473) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.21% (0.5495 => 0.4000, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.19% (5.2605 => 3.8827, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.16% (0.5826 => 0.4360, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3284, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.30% (0.5897 => 0.4464, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8227, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.42% (4.2042 => 3.2196, std.dev.: 0.0010) MultiSource/Applications/minisat/minisat: -22.54% (7.9891 => 6.1882, std.dev.: 0.2500) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.79% (0.1164 => 0.0922, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.00% (16.6791 => 13.3433, std.dev.: 0.0834) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.92% (1.5623 => 1.2667, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.42% (5.8755 => 4.7930, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -17.64% (9.7992 => 8.0710, std.dev.: 0.2332) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.48% (2.8778 => 2.3747, std.dev.: 0.0966) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.32% (3.1921 => 2.7669, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.28% (7.0016 => 6.0715, std.dev.: 0.1883) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6750, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9946, std.dev.: 0.0103) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.79% (1.4235 => 1.2556, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.40% (5.0421 => 4.4671, std.dev.: 0.0649) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.95% (0.4081 => 0.3675, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/lists1: -9.81% (0.6628 => 0.5978, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout/hash: -9.72% (4.5259 => 4.0861, std.dev.: 0.0685) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.12% (1.6547 => 1.5038, std.dev.: 0.0542) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.27% (0.3217 => 0.2951, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.23% (4.4540 => 4.0874, std.dev.: 0.0539) MultiSource/Applications/SIBsim4/SIBsim4: -7.85% (3.5443 => 3.2659, std.dev.: 0.0175) MultiSource/Applications/SPASS/SPASS: -7.67% (9.0650 => 8.3695, std.dev.: 0.0763) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.43% (4.2843 => 3.9661, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.92% (46.0987 => 42.9108, std.dev.: 0.5930) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.76% (4.9799 => 4.6431, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2272, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2484, std.dev.: 0.1005) MultiSource/Benchmarks/mafft/pairlocalalign: -5.60% (63.1520 => 59.6171, std.dev.: 0.1203) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.39% (3.5127 => 3.3234, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/queens: -5.34% (1.7443 => 1.6512, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.23% (3.7662 => 3.5692, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.00% (23.3986 => 22.2281, std.dev.: 0.2665) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.44% (1.4446 => 1.3804, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/distray/distray: -4.41% (0.2427 => 0.2320, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: -4.29% (3.6768 => 3.5191, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.95% (3.5691 => 3.4281, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.71% (5.8973 => 5.6787, std.dev.: 0.0499) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.58% (0.3349 => 0.3229, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.33% (42.3194 => 40.9112, std.dev.: 0.1072) MultiSource/Benchmarks/Olden/health/health: -3.23% (0.3654 => 0.3536, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.94% (3.0082 => 2.9197, std.dev.: 0.0153) MultiSource/Applications/lua/lua: -2.70% (29.0327 => 28.2491, std.dev.: 0.2038) MultiSource/Benchmarks/Bullet/bullet: -2.42% (7.2040 => 7.0299, std.dev.: 0.0458) SingleSource/Benchmarks/Misc/ffbench: -2.20% (1.4244 => 1.3930, std.dev.: 0.0053) MultiSource/Benchmarks/BitBench/five11/five11: -2.05% (5.7021 => 5.5852, std.dev.: 0.0304) SingleSource/Benchmarks/Misc/mandel-2: -2.01% (0.8521 => 0.8350, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.98% (1.0995 => 1.0777, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.95% (8.7327 => 8.5623, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.66% (85.3042 => 83.8892, std.dev.: 0.0206) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.8249 => 8.6822, std.dev.: 0.0444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.61% (5.9063 => 5.8110, std.dev.: 0.0121) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3153, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/FloatMM: -1.24% (0.8328 => 0.8225, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7491, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: -1.08% (8.7416 => 8.6468, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bh/bh: -1.03% (2.4120 => 2.3872, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.13% (1.2047 => 1.2063, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -35.28% (0.0394 => 0.0255, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: -38.97% (0.0213 => 0.0130, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/test1: -13.22% (0.0227 => 0.0197, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -3.27% (0.1530 => 0.1480, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: -40.87% (1.9293 => 1.1407, std.dev.: 0.0039) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.38% (0.4049 => 0.3993, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.13% (0.1510 => 0.1508, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.56% (0.0978 => 0.0640, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.65% (0.0276 => 0.0219, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.02% (0.0590 => 0.0525, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.21% (1.1617 => 1.2803, std.dev.: 0.0574) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.70% (0.0610 => 0.0563, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.82% (0.0268 => 0.0364, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.48% (0.7437 => 1.7513, std.dev.: 0.0085) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -75.00% (0.0008 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -55.43% (0.0092 => 0.0041, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.88% (12.7781 => 33.9739, std.dev.: 0.8867) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 10:39:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 12:39:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127183900.8554D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8012?compare_to=8010&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8012, Order: 173620, Start Time: 2013-01-27 17:05:13, End Time: 2013-01-27 18:39:19 To: 8010, Order: 173618, Start Time: 2013-01-27 15:07:28, End Time: 2013-01-27 16:41:49 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (122 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.71% (0.6717 => 0.6966, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/chomp: 1.13% (1.1523 => 1.1653, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.04% (1.2714 => 1.2846, std.dev.: 0.0025) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 73.36% (0.0717 => 0.1243, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.30% (0.0974 => 0.1649, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 50.19% (0.0267 => 0.0401, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.49% (0.1132 => 0.1613, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.05% (0.6395 => 0.8828, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.82% (0.5688 => 0.7555, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.53% (0.5456 => 0.7231, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.40% (0.5805 => 0.7686, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.40% (0.6260 => 0.8288, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.13% (0.5849 => 0.7728, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.99% (0.5567 => 0.7348, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.80% (0.5575 => 0.7348, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.73% (0.5581 => 0.7352, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.71% (0.6395 => 0.8423, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.90% (0.5941 => 0.7777, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.41% (0.5859 => 0.7641, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.10% (0.6033 => 0.7849, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.06% (1.6474 => 2.1262, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.04% (0.6189 => 0.7986, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.54% (0.6676 => 0.8581, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.11% (0.6304 => 0.8076, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.69% (0.6230 => 0.7955, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.95% (0.6660 => 0.8455, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.82% (0.5802 => 0.7358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.55% (0.5925 => 0.7498, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.38% (0.5705 => 0.7210, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.12% (0.5857 => 0.7387, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.85% (0.5478 => 0.6894, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.83% (0.5570 => 0.7009, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.66% (0.5569 => 0.6998, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.34% (0.5591 => 0.7008, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.29% (0.5863 => 0.7287, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.7524 => 0.9335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.99% (0.6052 => 0.7504, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.94% (0.6446 => 0.7989, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.75% (0.6681 => 0.8268, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.99% (0.6194 => 0.7618, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.92% (0.6297 => 0.7740, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.03% (0.0622 => 0.0759, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.87% (2.2587 => 2.7526, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.61% (0.6667 => 0.8108, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.06% (0.7339 => 0.8811, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 16.00% (0.3357 => 0.3894, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.21% (1.1450 => 1.3191, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.58% (0.0864 => 0.0990, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.82% (0.0731 => 0.0832, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.75% (4.5069 => 5.0815, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.59% (0.4916 => 0.5535, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.38% (0.4515 => 0.5074, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.86% (0.1982 => 0.2217, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.79% (3.5339 => 3.9507, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.65% (1.6364 => 1.8270, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.03% (0.2385 => 0.2648, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.41% (0.1230 => 0.1358, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.94% (9.2283 => 10.1455, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.01% (0.1731 => 0.1887, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.82% (1.2515 => 1.3619, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.2001 => 0.2172, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.49% (0.4524 => 0.4908, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5329 => 0.5772, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4861 => 0.5235, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.62% (1.4642 => 1.5758, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.55% (0.7021 => 0.7551, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.30% (1.2784 => 1.3717, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 7.13% (0.1879 => 0.2013, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/chomp: 6.53% (0.1761 => 0.1876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (0.3255 => 0.3459, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/bigfib: 6.21% (0.6750 => 0.7169, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.58% (5.4682 => 5.7189, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 4.15% (5.0226 => 5.2308, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3394 => 0.3515, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.54% (1.3864 => 1.4355, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.93% (0.8418 => 0.8665, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: 2.71% (0.7447 => 0.7649, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4427 => 0.4546, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.56% (0.9557 => 0.9802, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (0.5168 => 0.5294, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.30% (22.4056 => 22.9205, std.dev.: 0.0143) MultiSource/Applications/SPASS/SPASS: 2.24% (15.5079 => 15.8556, std.dev.: 0.0160) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.14% (1.3722 => 1.4015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.2300 => 1.2473, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.19% (3.5154 => 3.5573, std.dev.: 0.0123) MultiSource/Applications/treecc/treecc: 1.04% (2.1401 => 2.1624, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8021, std.dev.: 0.0153) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0060) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.39% (54.5751 => 56.4238, std.dev.: 0.1371) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.69% (2.0478 => 2.1029, std.dev.: 0.0102) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3828, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6084, std.dev.: 0.0051) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.54% (18.2231 => 18.5031, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (5.1955 => 5.2676, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3489 => 10.4547, std.dev.: 0.0250) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.47% (0.7198 => 0.6876, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.38% (0.3812 => 0.3645, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.30% (0.3880 => 0.3713, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.28% (0.3831 => 0.3667, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.24% (0.3848 => 0.3685, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.19% (0.4033 => 0.3864, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.86% (0.4176 => 0.4015, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.73% (0.3884 => 0.3739, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.69% (2.4924 => 2.4005, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.31% (0.4199 => 0.4060, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.25% (0.6347 => 0.6141, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.09% (0.9852 => 0.9548, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: -2.97% (0.4280 => 0.4153, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.89% (0.6441 => 0.6255, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.70% (20.7746 => 20.2139, std.dev.: 0.0213) SingleSource/UnitTests/ObjC++/property-reference: -2.46% (0.7779 => 0.7588, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.31% (2.1713 => 2.1212, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.30% (0.6484 => 0.6335, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.30% (0.9542 => 0.9323, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.29% (1.3148 => 1.2847, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.94% (14.2083 => 13.9332, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: -1.44% (17.1032 => 16.8565, std.dev.: 0.0266) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.21% (6.7716 => 6.6898, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: -1.07% (16.1920 => 16.0186, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.04% (1.0544 => 1.0434, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.51% (1.8100 => 0.6966, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4207, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0445 => 5.3088, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.83% (1.3643 => 1.0256, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7541, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0807, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1997, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.00% (0.4092 => 0.3519, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3530, std.dev.: 0.0132) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1693, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1780, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4004, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.29% (7.9763 => 7.7936, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: -2.24% (3.7241 => 3.6408, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.91% (1.3096 => 1.2846, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1717, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4673, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6007, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5908, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.08s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 10:54:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 12:54:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127185423.D70872A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8013?compare_to=8008&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8013, Order: 173620, Start Time: 2013-01-27 16:42:56, End Time: 2013-01-27 18:54:40 To: 8008, Order: 173618, Start Time: 2013-01-27 14:00:41, End Time: 2013-01-27 16:12:34 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (223 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.18% (10.8211 => 10.9491, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1330 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.46% (0.0654 => 0.0651, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8599 => 499.8588, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.51% (1.1277 => 499.8588, std.dev.: 0.0057) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 218.19% (0.5229 => 1.6638, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 21.85% (14.9895 => 18.2643, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 46.27% (14.1553 => 20.7043, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 19.46% (4.1105 => 4.9105, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.67% (1.1048 => 1.7419, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.34% (7.1582 => 37.5334, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++-EH/spirit: 88.57% (3.4629 => 6.5301, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_container: 77.35% (0.6222 => 1.1035, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10270.00% (0.0720 => 7.4664, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 11149300.00% (0.0001 => 11.1494, std.dev.: 0.0260) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 66100.00% (0.0001 => 0.0662, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575800.00% (0.0001 => 0.5759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848800.00% (0.0001 => 9.8489, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488100.00% (0.0001 => 5.4882, std.dev.: 0.0124) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.84% (1.1194 => 10.2967, std.dev.: 0.0159) SingleSource/UnitTests/SignlessTypes/factor: 164.86% (0.0296 => 0.0784, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 150.04% (22.1758 => 55.4494, std.dev.: 0.0165) SingleSource/Benchmarks/Misc/lowercase: 124.22% (0.0256 => 0.0574, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 98.82% (0.0929 => 0.1847, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 88.48% (0.0243 => 0.0458, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 72.73% (0.1463 => 0.2527, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 69.00% (0.0271 => 0.0458, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 62.18% (0.0394 => 0.0639, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.13% (2.9384 => 4.6171, std.dev.: 0.0069) SingleSource/Regression/C/sumarray: 54.55% (0.0231 => 0.0357, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.13% (7.0540 => 10.8021, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.78% (1.5859 => 2.4229, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 49.15% (0.1056 => 0.1575, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.43% (8.1363 => 11.9950, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 43.22% (2.2024 => 3.1543, std.dev.: 0.0097) MultiSource/Applications/sgefa/sgefa: 40.62% (0.3109 => 0.4372, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 40.09% (0.0439 => 0.0615, std.dev.: 0.0010) SingleSource/UnitTests/vla: 38.87% (0.0355 => 0.0493, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 38.62% (21.9371 => 30.4098, std.dev.: 0.0137) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.51% (0.1062 => 0.1471, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.34% (0.1432 => 0.1981, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.66% (0.0479 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 34.47% (4.2646 => 5.7344, std.dev.: 0.0035) SingleSource/Benchmarks/McGill/exptree: 33.66% (0.0814 => 0.1088, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.59% (0.4615 => 0.6165, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.42% (1.5415 => 2.0566, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.85% (0.1143 => 0.1507, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.35% (0.2271 => 0.2983, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.27% (0.0793 => 0.1041, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.73% (1.1642 => 1.5220, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/05-eks/eks: 30.22% (0.4299 => 0.5598, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 29.09% (0.5105 => 0.6590, std.dev.: 0.0019) SingleSource/Benchmarks/Stanford/Oscar: 29.09% (0.0636 => 0.0821, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 29.07% (0.0719 => 0.0928, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.80% (0.1125 => 0.1449, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.49% (0.6675 => 0.8577, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 28.16% (0.1655 => 0.2121, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.03% (0.1584 => 0.2028, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 27.80% (0.1892 => 0.2418, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/08-main/main: 27.60% (0.2554 => 0.3259, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.26% (0.0730 => 0.0929, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 27.21% (9.4845 => 12.0656, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.93% (3.8922 => 4.9405, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 26.47% (0.1175 => 0.1486, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.43% (0.1695 => 0.2143, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 26.23% (0.4289 => 0.5414, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.99% (0.1566 => 0.1973, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 25.99% (0.3121 => 0.3932, std.dev.: 0.0043) MultiSource/Applications/lemon/lemon: 25.47% (1.0722 => 1.3453, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: 25.45% (0.0660 => 0.0828, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.07% (1.4186 => 1.7743, std.dev.: 0.0137) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.03% (0.1906 => 0.2383, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.68% (0.1337 => 0.1667, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 24.55% (0.0672 => 0.0837, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 24.46% (0.4620 => 0.5750, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 24.24% (0.1555 => 0.1932, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 24.06% (0.7115 => 0.8827, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 23.92% (0.6456 => 0.8000, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/messages-2: 23.72% (0.0662 => 0.0819, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 23.41% (0.0457 => 0.0564, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 23.30% (0.1236 => 0.1524, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 23.15% (0.0527 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.04% (0.2700 => 0.3322, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 22.84% (0.0626 => 0.0769, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 22.78% (0.7835 => 0.9620, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.52% (0.0675 => 0.0827, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.21% (0.0842 => 0.1029, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 22.01% (0.1163 => 0.1419, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.96% (0.1940 => 0.2366, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.87% (0.1029 => 0.1254, std.dev.: 0.0018) MultiSource/Applications/aha/aha: 21.55% (0.1151 => 0.1399, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 21.50% (5.7591 => 6.9974, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.48% (1.3050 => 1.5853, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/matrix: 21.43% (0.3098 => 0.3762, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 21.41% (0.1032 => 0.1253, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: 21.24% (0.0485 => 0.0588, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 21.20% (0.0953 => 0.1155, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 21.12% (0.1695 => 0.2053, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.09% (0.5860 => 0.7096, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 20.68% (0.0614 => 0.0741, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.67% (0.0871 => 0.1051, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.44% (4.9449 => 5.9555, std.dev.: 0.0151) SingleSource/Benchmarks/Adobe-C++/functionobjects: 20.26% (0.5020 => 0.6037, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.14% (0.0834 => 0.1002, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/wordfreq: 20.14% (0.3307 => 0.3973, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.01% (0.8172 => 0.9807, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 19.96% (3.3354 => 4.0010, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.86% (0.0886 => 0.1062, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 19.70% (0.0528 => 0.0632, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.70% (5.0018 => 5.9870, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 19.66% (0.7433 => 0.8894, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 19.33% (0.2758 => 0.3291, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.14% (0.5569 => 0.6635, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.98% (0.0648 => 0.0771, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 18.97% (3.8723 => 4.6070, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.96% (0.0770 => 0.0916, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 18.85% (0.1268 => 0.1507, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 18.71% (2.0273 => 2.4067, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 18.69% (0.0567 => 0.0673, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.68% (0.1510 => 0.1792, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.67% (0.9765 => 1.1588, std.dev.: 0.0059) MultiSource/Benchmarks/nbench/nbench: 18.64% (1.1840 => 1.4047, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.62% (0.1117 => 0.1325, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.41% (0.2107 => 0.2495, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.39% (0.1044 => 0.1236, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 18.37% (2.2969 => 2.7189, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.31% (1.1861 => 1.4033, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.31% (0.0770 => 0.0911, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.21% (0.2065 => 0.2441, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/18-imp/imp: 18.20% (0.3423 => 0.4046, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 18.11% (0.0933 => 0.1102, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.87% (0.4203 => 0.4954, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.69% (0.5981 => 0.7039, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.60% (0.6450 => 0.7585, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 17.42% (0.2049 => 0.2406, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.41% (0.3441 => 0.4040, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 17.24% (0.8101 => 0.9498, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 16.94% (0.3283 => 0.3839, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 16.58% (0.3232 => 0.3768, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.57% (0.3180 => 0.3707, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 16.43% (0.0633 => 0.0737, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 16.38% (0.8921 => 1.0382, std.dev.: 0.0057) SingleSource/UnitTests/SignlessTypes/rem: 16.35% (0.1144 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.69% (0.8067 => 0.9333, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.62% (0.0704 => 0.0814) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.42% (0.0759 => 0.0876) SingleSource/Benchmarks/Shootout-C++/ary2: 15.21% (0.3379 => 0.3893, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.98% (0.2603 => 0.2993, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.80% (0.0838 => 0.0962, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.64% (0.3865 => 0.4431, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.23% (0.4103 => 0.4687, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.19% (0.4636 => 0.5294, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 13.87% (0.2905 => 0.3308, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.45% (1.5603 => 1.7702, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 13.05% (17.1811 => 19.4227, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/moments: 12.99% (0.4048 => 0.4574, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.80% (0.2430 => 0.2741, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 12.71% (0.3603 => 0.4061, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 12.52% (0.3282 => 0.3693, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.45% (0.3092 => 0.3477, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 12.45% (0.3422 => 0.3848, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.39% (0.1114 => 0.1252, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 12.35% (0.3684 => 0.4139, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.10% (0.3927 => 0.4402, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.94% (0.3826 => 0.4283, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.88% (0.4064 => 0.4547, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.71% (0.3886 => 0.4341, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.58% (0.3427 => 0.3824, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.30% (14.3668 => 15.9900, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: 10.87% (0.3828 => 0.4244, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.78% (0.3543 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 10.57% (0.1268 => 0.1402, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.45% (0.3561 => 0.3933, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.42% (0.2831 => 0.3126, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 10.39% (0.3473 => 0.3834, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.30% (0.3543 => 0.3908, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 10.28% (0.2871 => 0.3166, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 10.27% (0.3516 => 0.3877, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.23% (0.3694 => 0.4072, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/methcall: 10.15% (0.2877 => 0.3169, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-2: 10.12% (0.3497 => 0.3851, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.53% (2.0665 => 2.2634, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.52% (0.3162 => 0.3463, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.43% (0.2756 => 0.3016, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 9.39% (1.2842 => 1.4048, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.26% (0.3650 => 0.3988, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.10% (0.2725 => 0.2973, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2793 => 0.3047, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.99% (0.2891 => 0.3151, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.99% (0.2714 => 0.2958, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 8.90% (63.2438 => 68.8722, std.dev.: 0.0079) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.87% (0.3935 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.68% (0.3052 => 0.3317, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.67% (0.3136 => 0.3408, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.66% (0.6030 => 0.6552, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.64% (0.2872 => 0.3120, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2802 => 0.3041, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 8.50% (0.7326 => 0.7949, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/Hello: 8.19% (0.5925 => 0.6410, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.06% (0.1625 => 0.1756, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (2.2022 => 2.3784, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.97% (0.4879 => 0.5219, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.39% (0.3177 => 0.3380, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 5.61% (10.3673 => 10.9491, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.59% (0.2266 => 0.2370, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: 4.18% (0.3131 => 0.3262, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.04% (7.9617 => 8.2041, std.dev.: 0.0113) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.86% (0.3817 => 0.3926, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0016) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4723, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6964, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 13.08% (0.5413 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.60% (4.2280 => 4.4649, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.18% (0.9957 => 1.0274, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.80% (8.6802 => 8.9231, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.36% (1.0313 => 1.0556, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7165, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.74% (9.1159 => 9.2742, std.dev.: 0.0443) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2393, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.16% (6.5088 => 6.5843, std.dev.: 0.0025) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.46% (6.6874 => 0.1700, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.81% (5.2763 => 1.1708, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.79% (0.1622 => 0.0928, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.43% (5.3855 => 4.4469, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.91% (5.3526 => 4.4473, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: -12.77% (10.4361 => 9.1030, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9894, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.39% (1.7609 => 1.6307, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.15% (1.9577 => 0.6626, std.dev.: 0.0076) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.01% (8.0499 => 5.3121, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0190, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.79% (10.7105 => 7.4123, std.dev.: 0.0176) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8525, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.37% (2.6546 => 2.0078, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.78% (1.6925 => 1.4254, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.90% (0.9540 => 0.8405, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4943, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7056, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.89% (1.2373 => 1.1521, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.69% (19.9488 => 18.6136, std.dev.: 0.0335) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.17% (0.2497 => 0.2343, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5792, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7027, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.41% (0.4808 => 0.4596, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.39% (10.2830 => 9.8312, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0084) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.69% (3.6994 => 3.6369, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3300, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.53% (3.7221 => 3.6653, std.dev.: 0.0166) MultiSource/Applications/sqlite3/sqlite3: -1.22% (4.6441 => 4.5873, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2327, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.23% (0.2116 => 0.0651, std.dev.: 0.0036) Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 12:42:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 14:42:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130127204257.33C502A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8014?compare_to=8009&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8014, Order: 173620, Start Time: 2013-01-27 17:07:44, End Time: 2013-01-27 20:43:16 To: 8009, Order: 173615, Start Time: 2013-01-27 12:39:38, End Time: 2013-01-27 16:15:46 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (187 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1096 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.56% (0.4720 => 0.4841, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.91% (0.6700 => 0.6895, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: 1.83% (13.2329 => 13.4756, std.dev.: 0.0884) SingleSource/Benchmarks/Misc/whetstone: 1.28% (2.7889 => 2.8246, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.09% (54.1787 => 54.7688, std.dev.: 0.0849) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/oggenc/oggenc: -1.45% (2.0190 => 1.9897, std.dev.: 0.0033) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.04% (3.2338 => 3.2002, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/ClamAV/clamscan: -5.10% (0.3118 => 0.2959, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.72% (0.0625 => 0.0917, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.50% (0.1063 => 0.1451, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.84% (0.0475 => 0.0612, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.75% (0.1106 => 0.1424, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.56% (0.2969 => 0.3817, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.79% (0.0547 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.73% (0.0714 => 0.0912, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.45% (0.4139 => 0.5275, std.dev.: 0.0147) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.22% (0.5900 => 0.7506, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 26.98% (0.0808 => 0.1026, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.87% (0.4994 => 0.6286, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.42% (0.5000 => 0.6271, std.dev.: 0.0139) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.12% (0.1620 => 0.2027, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.89% (1.5932 => 1.9897, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.78% (0.1021 => 0.1274, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 24.71% (0.0947 => 0.1181, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.69% (0.4253 => 0.5303, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 24.45% (0.3890 => 0.4841, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.30% (0.1103 => 0.1371, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.19% (0.0897 => 0.1114, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.69% (0.1549 => 0.1916, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/05-eks/eks: 23.66% (0.1619 => 0.2002, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 23.50% (0.4029 => 0.4976, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.36% (0.0642 => 0.0792, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.13% (0.1107 => 0.1363, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.00% (0.1604 => 0.1973, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.91% (0.3903 => 0.4797, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.83% (0.1003 => 0.1232, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608) MultiSource/Applications/aha/aha: 22.66% (0.0481 => 0.0590, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 22.53% (0.0821 => 0.1006, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 22.52% (0.0604 => 0.0740, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.75% (0.1462 => 0.1780, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 21.65% (0.0582 => 0.0708, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.65% (0.0462 => 0.0562, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.04% (0.2866 => 0.3469, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.98% (0.2736 => 0.3310, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.96% (0.1088 => 0.1316, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.85% (0.3271 => 0.3953, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.64% (1.3152 => 1.5867, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/08-main/main: 20.61% (0.1218 => 0.1469, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.34% (0.1160 => 0.1396, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.31% (0.2014 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 20.07% (0.1505 => 0.1807, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: 19.84% (0.5826 => 0.6982, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.76% (0.0572 => 0.0685, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 19.64% (1.8794 => 2.2485, std.dev.: 0.0165) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.49% (0.0513 => 0.0613, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 19.39% (0.5889 => 0.7031, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.26% (0.5026 => 0.5994, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.26% (0.4658 => 0.5555, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/oourafft: 19.25% (0.0561 => 0.0669, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 18.93% (0.9697 => 1.1533, std.dev.: 0.0034) MultiSource/Applications/Burg/burg: 18.90% (0.5546 => 0.6594, std.dev.: 0.0065) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.81% (3.5627 => 4.2328, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.80% (1.6211 => 1.9259, std.dev.: 0.0224) SingleSource/UnitTests/ObjC++/property-reference: 18.51% (0.7171 => 0.8498, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.47% (0.2875 => 0.3406, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 18.38% (0.1284 => 0.1520, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.33% (1.9966 => 2.3625, std.dev.: 0.0306) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.19% (0.1968 => 0.2326, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 18.13% (0.0673 => 0.0795, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.08% (0.2738 => 0.3233, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.02% (0.0605 => 0.0714, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 17.85% (0.2750 => 0.3241, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 17.83% (0.2725 => 0.3211, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hello: 17.80% (0.2714 => 0.3197, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 17.77% (0.2803 => 0.3301, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 17.75% (0.2823 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.74% (0.2729 => 0.3213, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 17.70% (1.0781 => 1.2689, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 17.68% (0.2811 => 0.3308, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 17.66% (0.1421 => 0.1672, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.65% (0.3195 => 0.3759, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 17.60% (0.2813 => 0.3308, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.59% (0.2792 => 0.3283, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 17.56% (0.9909 => 1.1649, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.49% (0.2911 => 0.3420, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 17.48% (0.2780 => 0.3266, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.46% (2.0673 => 2.4282, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.33% (0.3930 => 0.4611, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 17.31% (0.3096 => 0.3632, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.26% (2.7292 => 3.2002, std.dev.: 0.0009) SingleSource/Regression/C++/ofstream_ctor: 17.21% (0.3004 => 0.3521, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.17% (0.4361 => 0.5110, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 17.02% (4.2109 => 4.9275, std.dev.: 0.1005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.95% (1.9694 => 2.3033, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ary3: 16.93% (0.3267 => 0.3820, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 16.82% (0.3258 => 0.3806, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 16.80% (23.5202 => 27.4718, std.dev.: 0.0282) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.78% (0.3362 => 0.3926, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.73% (0.3060 => 0.3572, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/hash: 16.69% (0.4146 => 0.4838, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 16.67% (0.3317 => 0.3870, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.57% (0.3845 => 0.4482, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/sieve: 16.56% (0.3726 => 0.4343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 16.43% (0.3348 => 0.3898, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.42% (0.3124 => 0.3637, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 16.33% (0.2566 => 0.2985, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.17% (0.3625 => 0.4211, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.15% (0.3282 => 0.3812, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 16.11% (0.3477 => 0.4037, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.07% (1.4269 => 1.6562, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/moments: 15.99% (0.3678 => 0.4266, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.88% (4.4195 => 5.1215, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.83% (0.3690 => 0.4274, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.75% (0.3981 => 0.4608, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.69% (0.1090 => 0.1261, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/synchronized: 15.68% (0.3469 => 0.4013) SingleSource/Benchmarks/Shootout-C++/hash2: 15.64% (0.4251 => 0.4916, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-4: 15.64% (0.3465 => 0.4007, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 15.64% (0.3446 => 0.3985, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.54% (0.3488 => 0.4030, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 15.50% (0.3496 => 0.4038, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 15.49% (0.3460 => 0.3996, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.49% (0.3442 => 0.3975, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.45% (0.7875 => 0.9092, std.dev.: 0.0153) SingleSource/UnitTests/ObjC/property: 15.21% (0.3650 => 0.4205, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.02% (0.3643 => 0.4190, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 15.01% (0.3724 => 0.4283, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 14.60% (0.5012 => 0.5744, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 14.40% (5.5417 => 6.3396, std.dev.: 0.0155) MultiSource/Applications/JM/ldecod/ldecod: 14.38% (2.1653 => 2.4767, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.16% (0.6435 => 0.7346, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.07% (0.2068 => 0.2359, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 13.83% (4.6177 => 5.2562, std.dev.: 0.0507) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.41% (0.2737 => 0.3104, std.dev.: 0.0015) MultiSource/Applications/SIBsim4/SIBsim4: 13.34% (0.2691 => 0.3050, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/football/football: 13.16% (0.2075 => 0.2348, std.dev.: 0.0035) MultiSource/Benchmarks/mafft/pairlocalalign: 12.93% (2.1013 => 2.3731, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.0804 => 0.0907, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 12.66% (0.6634 => 0.7474, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.45% (0.3084 => 0.3468, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.20% (0.5361 => 0.6015, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 12.17% (0.3336 => 0.3742, std.dev.: 0.0053) MultiSource/Applications/lambda-0_1_3/lambda: 12.04% (0.3498 => 0.3919, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.86% (0.1383 => 0.1547, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.79% (0.2103 => 0.2351, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.53% (11.6398 => 12.9824, std.dev.: 0.0096) MultiSource/Benchmarks/PAQ8p/paq8p: 11.24% (0.4847 => 0.5392, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.52% (0.7426 => 0.8207, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.38% (4.6926 => 5.1799, std.dev.: 0.0215) MultiSource/Applications/lemon/lemon: 9.58% (0.2391 => 0.2620, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 8.91% (2.0346 => 2.2158, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.60% (0.5584 => 0.6064, std.dev.: 0.0010) MultiSource/Applications/kimwitu++/kc: 8.23% (11.9555 => 12.9398, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.07% (0.3792 => 0.4022, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5134, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0312) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.53% (0.5917 => 0.6895, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.75% (0.3693 => 0.4053, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary: 7.26% (0.2122 => 0.2276, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 5.60% (0.2802 => 0.2959, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2398, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.08% (12.0509 => 12.6628, std.dev.: 0.0137) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6843, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-2: 4.35% (1.8057 => 1.8843, std.dev.: 0.0087) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 2.08% (15.8721 => 16.2024, std.dev.: 0.0579) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3071, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.38% (1.0927 => 1.1078, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0813, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2073, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5906, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4777, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.27% (2.4764 => 2.4202, std.dev.: 0.0093) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.78% (25.4195 => 16.5779, std.dev.: 0.0129) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -16.02% (17.2379 => 14.4770, std.dev.: 0.1051) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1015, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -9.45% (0.2402 => 0.2175, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9780, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -7.58% (35.5013 => 32.8111, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -4.08% (14.0481 => 13.4756, std.dev.: 0.0884) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2190, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.64% (11.2080 => 10.8005, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.10% (0.6293 => 0.6098, std.dev.: 0.0064) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7755, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.22% (197.4719 => 193.0975, std.dev.: 0.0268) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/bh/bh: -1.41% (5.5810 => 5.5025, std.dev.: 0.0037) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.09% (105.3826 => 104.2329, std.dev.: 0.0349) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0428, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.48s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 14:09:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 16:09:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130127220952.F12DD2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8015?compare_to=8012&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8015, Order: 173621, Start Time: 2013-01-27 20:36:02, End Time: 2013-01-27 22:10:11 To: 8012, Order: 173620, Start Time: 2013-01-27 17:05:13, End Time: 2013-01-27 18:39:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 1 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.88% (3.8405 => 3.7682, std.dev.: 0.0232) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.56% (0.0974 => 0.1632, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.49% (0.1132 => 0.1613, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.06% (0.6395 => 0.8829, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.14% (0.5688 => 0.7573, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.75% (0.5456 => 0.7243, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.59% (0.5805 => 0.7697, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.28% (0.5849 => 0.7737, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.86% (0.5575 => 0.7351, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.85% (0.6395 => 0.8432, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.80% (0.5581 => 0.7356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.79% (0.5941 => 0.7770, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.33% (0.5859 => 0.7636, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.23% (0.6033 => 0.7857, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.50% (0.6440 => 0.8340, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.17% (1.6474 => 2.1280, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.95% (0.6189 => 0.7981, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.54% (0.6676 => 0.8581, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.04% (0.0699 => 0.0895, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.03% (0.6304 => 0.8071, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.83% (0.6230 => 0.7964, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.80% (0.6660 => 0.8445, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.70% (0.5802 => 0.7351, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.52% (0.5705 => 0.7218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.36% (0.5925 => 0.7487, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.02% (0.5857 => 0.7381, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.00% (0.5569 => 0.7017, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.89% (0.5570 => 0.7012, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.72% (0.5478 => 0.6887, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.56% (0.5591 => 0.7020, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.27% (0.5863 => 0.7286, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 24.20% (0.6446 => 0.8006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.16% (0.7524 => 0.9342, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.07% (0.6052 => 0.7509, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.48% (0.6681 => 0.8250, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.10% (0.6194 => 0.7625, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.82% (0.6297 => 0.7734, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.96% (2.2587 => 2.7546, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.58% (0.6667 => 0.8106, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.93% (0.7339 => 0.8802, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.20% (0.0566 => 0.0669) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.28% (0.1146 => 0.1344, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.76% (0.3357 => 0.3886, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 15.15% (1.1450 => 1.3185, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.99% (0.1081 => 0.1243, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.95% (0.0731 => 0.0833, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.85% (4.5069 => 5.0861, std.dev.: 0.0130) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.69% (0.4916 => 0.5540, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/05-eks/eks: 12.51% (0.4515 => 0.5080, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 12.15% (0.0864 => 0.0969, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.01% (0.1982 => 0.2220, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.73% (3.5339 => 3.9483, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.71% (1.6364 => 1.8280, std.dev.: 0.0051) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.65% (0.2385 => 0.2639, std.dev.: 0.0017) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.49% (0.1230 => 0.1359, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.04% (9.2283 => 10.1547, std.dev.: 0.0087) MultiSource/Applications/Burg/burg: 8.85% (1.2515 => 1.3623, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.70% (0.2001 => 0.2175, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash: 8.51% (0.4524 => 0.4909, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.22% (0.5329 => 0.5767, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.91% (0.1731 => 0.1868, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/BoolLiteralTest: 7.85% (0.3834 => 0.4135, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/hash2: 7.82% (0.4861 => 0.5241, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.75% (1.4642 => 1.5777, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.68% (0.7021 => 0.7560, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.21% (1.2784 => 1.3706, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (0.3255 => 0.3459, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.12% (0.1879 => 0.1994, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 6.12% (0.6750 => 0.7163, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.75% (0.3319 => 0.3510, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.52% (5.4682 => 5.7156, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.84% (5.0226 => 5.2154, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (1.3864 => 1.4389, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 3.65% (0.3394 => 0.3518, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 3.63% (0.3446 => 0.3571, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.29% (0.8418 => 0.8695, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.78% (0.4427 => 0.4550, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 2.69% (0.7447 => 0.7647, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.65% (0.9557 => 0.9810, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.35% (22.4056 => 22.9324, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.28% (0.5168 => 0.5286, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 2.27% (15.5079 => 15.8597, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.22% (1.3722 => 1.4026, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.2300 => 1.2473, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.12% (3.5154 => 3.5548, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.8002, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.15% (1.2783 => 1.3697, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.23% (54.5751 => 56.3391, std.dev.: 0.1448) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1031, std.dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3838, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (18.2231 => 18.5362, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 1.69% (4.5320 => 4.6087, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2707, std.dev.: 0.0037) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.62% (0.1281 => 0.1145, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.45% (0.3194 => 0.3052, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.33% (0.7198 => 0.6886, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.14% (0.3821 => 0.3663, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-3: -3.90% (0.3848 => 0.3698, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3880 => 0.3729, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/trivial-interface: -3.86% (0.3812 => 0.3665, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.84% (2.4924 => 2.3967, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -3.80% (0.3896 => 0.3748, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.74% (0.4033 => 0.3882, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.71% (0.3831 => 0.3689, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.70% (0.3891 => 0.3747, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.52% (0.4176 => 0.4029, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.26% (0.3837 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.19% (0.3884 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.14% (0.9852 => 0.9543, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.12% (0.6347 => 0.6149, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -3.02% (0.4199 => 0.4072, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.86% (0.6441 => 0.6257, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.76% (20.7746 => 20.2002, std.dev.: 0.0281) SingleSource/UnitTests/ObjC/parameter-passing: -2.52% (0.4280 => 0.4172, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.38% (0.9542 => 0.9315, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.21% (1.3148 => 1.2857, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.21% (0.6484 => 0.6341, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.20% (2.1713 => 2.1235, std.dev.: 0.0045) SingleSource/UnitTests/ObjC++/property-reference: -2.02% (0.7779 => 0.7622, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9257, std.dev.: 0.0144) MultiSource/Applications/sqlite3/sqlite3: -1.48% (17.1032 => 16.8502, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.15% (6.7716 => 6.6935, std.dev.: 0.0074) MultiSource/Applications/JM/lencod/lencod: -1.10% (16.1920 => 16.0138, std.dev.: 0.0130) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.03% (1.0544 => 1.0435, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.52% (1.8100 => 0.6964, std.dev.: 0.0084) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0096) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4204, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3136, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/mandel-2: -24.38% (1.3643 => 1.0317, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7559, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0840, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1981, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.47% (2.5106 => 2.1222, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3526, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3987, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -2.66% (3.7241 => 3.6250, std.dev.: 0.0157) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7756, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1750, std.dev.: 0.0307) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4619, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.67% (1.6307 => 1.6035, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.35% (1.6219 => 1.6000, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 14:42:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 16:42:06 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130127224206.CC75A2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8016?compare_to=8011&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8016, Order: 173621, Start Time: 2013-01-27 20:33:18, End Time: 2013-01-27 22:42:28 To: 8011, Order: 173620, Start Time: 2013-01-27 15:56:00, End Time: 2013-01-27 17:55:14 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 57 (97 on baseline) Performance Improvements: 2 (38 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1005 (928 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 70.13% (0.1627 => 0.2768, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 67.90% (0.0486 => 0.0816, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-8: 66.88% (0.0314 => 0.0524, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.06% (2.0031 => 2.3248, std.dev.: 0.0803) SingleSource/Benchmarks/CoyoteBench/almabench: 14.50% (0.0738 => 0.0845, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/gs/gs: 12.96% (4.4934 => 5.0757, std.dev.: 0.2039) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 12.16% (0.6990 => 0.7840, std.dev.: 0.0286) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.88% (0.8490 => 0.9329, std.dev.: 0.0236) MultiSource/Applications/siod/siod: 9.38% (2.4439 => 2.6731, std.dev.: 0.0360) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.36% (23.8622 => 26.0953, std.dev.: 0.2090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.09% (1.2935 => 1.4111, std.dev.: 0.0288) MultiSource/Applications/sqlite3/sqlite3: 9.01% (16.2376 => 17.7002, std.dev.: 0.1422) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.89% (1.8787 => 2.0458, std.dev.: 0.0466) MultiSource/Applications/d/make_dparser: 8.89% (3.5827 => 3.9011, std.dev.: 0.0828) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.63% (1.3260 => 1.4404, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.41% (1.1870 => 1.2749, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.32% (1.2902 => 1.3847, std.dev.: 0.0226) MultiSource/Benchmarks/mafft/pairlocalalign: 6.82% (10.7053 => 11.4358, std.dev.: 0.1493) SingleSource/Benchmarks/Shootout-C++/hash2: 6.66% (0.4685 => 0.4997, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 6.60% (0.1940 => 0.2068, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 5.98% (0.2107 => 0.2233, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.80% (1.2990 => 1.3743, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/ary3: 5.50% (0.2636 => 0.2781, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 5.42% (18.4697 => 19.4715, std.dev.: 0.1000) SingleSource/Benchmarks/Shootout-C++/sumcol: 5.40% (0.2149 => 0.2265, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.08% (1.2599 => 1.3239, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.90% (1.1753 => 1.2329, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.2136 => 0.2239, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.28% (1.3770 => 1.4360, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.25% (1.1893 => 1.2398, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.15% (0.4676 => 0.4870, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.50% (0.3313 => 0.3429, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.35% (0.3103 => 0.3207, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 86.25% (0.0429 => 0.0799, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 50.94% (0.1433 => 0.2163, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/ary3: 47.52% (8.1337 => 11.9992, std.dev.: 0.8478) SingleSource/Benchmarks/Shootout-C++/heapsort: 37.05% (3.2196 => 4.4125, std.dev.: 0.2705) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 31.53% (0.3346 => 0.4401, std.dev.: 0.0175) MultiSource/Applications/minisat/minisat: 27.69% (6.1882 => 7.9020, std.dev.: 0.0732) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.03% (1.4601 => 1.8548, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary3: 23.68% (1.4194 => 1.7555, std.dev.: 0.1028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.31% (42.9108 => 49.0505, std.dev.: 0.6754) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.47% (9.2304 => 10.2893, std.dev.: 0.3604) SingleSource/Regression/C/uint64_to_float: 7.35% (1.7845 => 1.9156, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.52% (8.0710 => 8.5972, std.dev.: 0.0147) SingleSource/Benchmarks/McGill/chomp: 5.99% (1.1021 => 1.1681, std.dev.: 0.0231) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.89% (22.2281 => 23.3144, std.dev.: 0.0662) SingleSource/Benchmarks/Shootout/matrix: 4.15% (6.8613 => 7.1462, std.dev.: 0.0485) MultiSource/Applications/SIBsim4/SIBsim4: 3.91% (3.2659 => 3.3935, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/flops: 2.69% (8.6482 => 8.8806, std.dev.: 0.0317) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.36% (1.5487 => 1.5853, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.74% (0.8773 => 0.8926, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.70% (3.5100 => 3.5697, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.63% (5.8110 => 5.9060, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.54% (5.9637 => 6.0553, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.48% (4.6431 => 4.7116, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.45% (15.8150 => 16.0442, std.dev.: 0.0765) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.07% (6.0715 => 5.7635, std.dev.: 0.1105) SingleSource/Benchmarks/Shootout-C++/except: -3.72% (0.5140 => 0.4949, std.dev.: 0.0066) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.20% (1.2063 => 1.2208, std.dev.: 0.0227) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0435 => 0.0436, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.55% (0.0255 => 0.0338, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.94% (0.0320 => 0.0323, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: 60.00% (0.0130 => 0.0208, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: 12.69% (0.0197 => 0.0222, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.57% (0.0252 => 0.0243, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.89% (0.1480 => 0.1508, std.dev.: 0.0248) MultiSource/Applications/lemon/lemon: 25.86% (1.1407 => 1.4357, std.dev.: 0.2383) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.89% (0.3993 => 0.4308, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.99% (0.1508 => 0.1478, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.00% (0.0008 => 0.0010, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.06% (0.0640 => 0.0614, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 48.86% (0.0219 => 0.0326, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 5.71% (0.0525 => 0.0555, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.60% (1.2803 => 1.2880, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 27.59% (0.0029 => 0.0037, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.10% (0.0563 => 0.0603, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.20% (0.0364 => 0.0356, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.40% (1.7513 => 1.7759, std.dev.: 0.0113) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 85.37% (0.0041 => 0.0076, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.40% (33.9739 => 34.1105, std.dev.: 0.3070) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 417.86% (0.0336 => 0.1740, std.dev.: 0.0063) SingleSource/Regression/C/sumarraymalloc: 119.80% (0.0293 => 0.0644, std.dev.: 0.0072) SingleSource/Regression/C/sumarray2d: 87.96% (0.0274 => 0.0515, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 70.65% (0.1622 => 0.2768, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 67.90% (0.0486 => 0.0816, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 60.62% (0.1638 => 0.2631, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops-8: 58.79% (0.0330 => 0.0524, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 51.83% (0.9120 => 1.3847, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 51.37% (0.9381 => 1.4200, std.dev.: 0.1641) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 50.97% (0.9612 => 1.4511, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 49.28% (0.9855 => 1.4712, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 48.32% (0.8926 => 1.3239, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 47.32% (0.9512 => 1.4013, std.dev.: 0.0637) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 47.14% (0.8893 => 1.3085, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 45.86% (0.9422 => 1.3743, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 45.27% (0.8990 => 1.3060, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 45.15% (0.9061 => 1.3152, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 44.56% (0.9564 => 1.3826, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 44.12% (0.8846 => 1.2749, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 43.80% (1.0017 => 1.4404, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 43.63% (0.9998 => 1.4360, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 42.39% (0.9091 => 1.2945, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 41.92% (0.8736 => 1.2398, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 41.61% (1.0119 => 1.4330, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 41.28% (0.9403 => 1.3285, std.dev.: 0.0800) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 41.21% (0.9993 => 1.4111, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 41.19% (0.8732 => 1.2329, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 41.17% (0.9405 => 1.3277, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.48% (0.9010 => 1.2657, std.dev.: 0.0823) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.58% (1.0052 => 1.3930, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 38.56% (0.9488 => 1.3147, std.dev.: 0.0471) SingleSource/Benchmarks/McGill/exptree: 38.18% (0.0859 => 0.1187, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 37.69% (1.0860 => 1.4953, std.dev.: 0.0979) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.05% (0.8912 => 1.2214, std.dev.: 0.1203) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 36.93% (0.9550 => 1.3077, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 34.81% (0.9507 => 1.2816, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 34.16% (1.0088 => 1.3534, std.dev.: 0.0645) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.41% (0.9788 => 1.3058, std.dev.: 0.0705) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.65% (1.8651 => 2.3248, std.dev.: 0.0803) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.01% (5.0381 => 6.0965, std.dev.: 0.2746) MultiSource/Benchmarks/mafft/pairlocalalign: 20.12% (9.5202 => 11.4358, std.dev.: 0.1493) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.10% (3.6295 => 4.3226, std.dev.: 0.0896) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.77% (1.0986 => 1.2718, std.dev.: 0.0611) SingleSource/Benchmarks/Shootout-C++/matrix: 15.47% (0.2385 => 0.2754, std.dev.: 0.0078) SingleSource/UnitTests/Vectorizer/gcc-loops: 14.08% (0.4596 => 0.5243, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.96% (0.1955 => 0.2228, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/chomp: 13.83% (0.1793 => 0.2041, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 13.08% (1.4110 => 1.5955, std.dev.: 0.0586) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.86% (1.8127 => 2.0458, std.dev.: 0.0466) SingleSource/Benchmarks/Linpack/linpack-pc: 12.43% (0.2566 => 0.2885, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: 12.10% (0.2050 => 0.2298, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.39% (0.2879 => 0.3207, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.64% (23.5861 => 26.0953, std.dev.: 0.2090) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.61% (0.1384 => 0.1517, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 8.46% (0.2564 => 0.2781, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sumcol: 7.19% (0.2113 => 0.2265, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ackermann: 5.73% (0.1956 => 0.2068, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 4.94% (0.2551 => 0.2677, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.64% (0.3277 => 0.3429, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.01% (0.2791 => 0.2903, std.dev.: 0.0040) MultiSource/Applications/kimwitu++/kc: 2.82% (18.9377 => 19.4715, std.dev.: 0.1000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.27% (0.4762 => 0.4870, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 108487.50% (0.0008 => 0.8687, std.dev.: 0.0206) SingleSource/Benchmarks/Shootout/ary3: 437.98% (2.2304 => 11.9992, std.dev.: 0.8478) SingleSource/Benchmarks/Shootout/matrix: 351.58% (1.5825 => 7.1462, std.dev.: 0.0485) MultiSource/Applications/sgefa/sgefa: 259.43% (0.3515 => 1.2634, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.97% (4.8185 => 16.0442, std.dev.: 0.0765) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 231.12% (1.1825 => 3.9155, std.dev.: 0.0729) SingleSource/Benchmarks/Shootout-C++/ary2: 201.55% (0.0129 => 0.0389, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 187.28% (0.0228 => 0.0655, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/ary: 159.05% (0.0232 => 0.0601, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 64.04% (2.9083 => 4.7708, std.dev.: 0.1090) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 58.53% (0.0504 => 0.0799, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 45.07% (0.1491 => 0.2163, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.80% (0.2562 => 0.3428, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.66% (3.1254 => 4.1150, std.dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.56% (1.4588 => 1.8609, std.dev.: 0.0342) SingleSource/Regression/C/uint64_to_float: 24.41% (1.5397 => 1.9156, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.87% (5.6033 => 6.8849, std.dev.: 0.1461) SingleSource/Benchmarks/Misc/salsa20: 22.19% (7.4497 => 9.1028, std.dev.: 0.0433) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.95% (0.3609 => 0.4401, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.71% (4.8112 => 5.8074, std.dev.: 0.0387) MultiSource/Benchmarks/7zip/7zip-benchmark: 14.22% (9.0082 => 10.2893, std.dev.: 0.3604) MultiSource/Applications/JM/lencod/lencod: 14.09% (6.8159 => 7.7760, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.32% (5.1752 => 5.8646, std.dev.: 0.0505) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.20% (5.0033 => 5.6636, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 12.05% (1.0425 => 1.1681, std.dev.: 0.0231) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (3.6477 => 3.9740, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/ReedSolomon: 8.19% (8.6447 => 9.3526, std.dev.: 0.0283) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.10% (4.7473 => 5.0845, std.dev.: 0.0548) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.40% (46.0987 => 49.0505, std.dev.: 0.6754) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.21% (4.1836 => 4.4016, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.62% (5.0310 => 5.2632, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8768, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.43% (5.9115 => 6.0553, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.65% (1.5595 => 1.5853, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.43% (0.8800 => 0.8926, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -23.73% (0.1888 => 0.1440, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.06% (0.0862 => 0.0758, std.dev.: 0.0026) SingleSource/UnitTests/Vector/constpool: -11.28% (9.8875 => 8.7719, std.dev.: 0.0932) MultiSource/Applications/lua/lua: -7.13% (4.6406 => 4.3099, std.dev.: 0.0643) SingleSource/Benchmarks/Shootout-C++/hash2: -2.67% (0.5134 => 0.4997, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.67% (11.5523 => 3.9663, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/fp-convert: -61.69% (15.6525 => 5.9961, std.dev.: 0.1024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.63% (0.4146 => 0.1798, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.91% (0.4578 => 0.2339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.04% (11.3868 => 6.3720, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.23% (5.4023 => 3.6072, std.dev.: 0.0388) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.82% (0.4452 => 0.3080, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.30% (0.5495 => 0.3995, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.12% (5.2605 => 3.8867, std.dev.: 0.0903) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.18% (4.4467 => 3.3270, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.16% (0.5897 => 0.4472, std.dev.: 0.0111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.69% (0.5826 => 0.4446, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.36% (4.9921 => 3.8260, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.68% (7.0016 => 5.7635, std.dev.: 0.1105) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -17.35% (5.8755 => 4.8560, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.78% (3.1921 => 2.7843, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.63% (5.3626 => 4.6853, std.dev.: 0.0909) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.39% (5.7056 => 4.9985, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.27% (9.7992 => 8.5972, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/hash: -8.43% (4.5259 => 4.1445, std.dev.: 0.1235) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2284, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.20% (4.5424 => 4.2606, std.dev.: 0.0223) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.39% (4.9799 => 4.7116, std.dev.: 0.0263) MultiSource/Benchmarks/mafft/pairlocalalign: -5.32% (63.1520 => 59.7952, std.dev.: 0.1221) SingleSource/Benchmarks/McGill/queens: -5.06% (1.7443 => 1.6560, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/hash2: -4.37% (3.6768 => 3.5161, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.33% (3.5127 => 3.3606, std.dev.: 0.0485) MultiSource/Applications/SIBsim4/SIBsim4: -4.25% (3.5443 => 3.3935, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.45% (5.8973 => 5.6936, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/lists: -2.62% (17.2182 => 16.7669, std.dev.: 0.1599) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.57% (8.7327 => 8.5955, std.dev.: 0.0025) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.39% (85.3042 => 84.1176, std.dev.: 0.0975) SingleSource/Benchmarks/Misc/mandel-2: -1.35% (0.8521 => 0.8406, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.34% (1.2047 => 1.2208, std.dev.: 0.0227) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0024) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0027) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0039) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.25% (0.0445 => 0.0435, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.71% (0.0255 => 0.0243, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.44% (0.1530 => 0.1508, std.dev.: 0.0248) MultiSource/Applications/lemon/lemon: -25.58% (1.9293 => 1.4357, std.dev.: 0.2383) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.40% (0.4049 => 0.4308, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.12% (0.1510 => 0.1478, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.11% (0.0009 => 0.0010, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.22% (0.0978 => 0.0614, std.dev.: 0.0244) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.12% (0.0276 => 0.0326, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.93% (0.0590 => 0.0555, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.87% (1.1617 => 1.2880, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 15.62% (0.0032 => 0.0037, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.15% (0.0610 => 0.0603, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.84% (0.0268 => 0.0356, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.79% (0.7437 => 1.7759, std.dev.: 0.0113) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 166.95% (12.7781 => 34.1105, std.dev.: 0.3070) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 14:54:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 16:54:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130127225416.35FAB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8017?compare_to=8013&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8017, Order: 173621, Start Time: 2013-01-27 20:43:06, End Time: 2013-01-27 22:54:35 To: 8013, Order: 173620, Start Time: 2013-01-27 16:42:56, End Time: 2013-01-27 18:54:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (223 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (648 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 1.76% (3.7804 => 3.8470, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/chomp: 1.55% (1.1521 => 1.1700, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1332 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0651 => 0.0652, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8588 => 499.8529, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44224.99% (1.1277 => 499.8529, std.dev.: 0.0039) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 217.73% (0.5229 => 1.6614, std.dev.: 0.0045) MultiSource/Applications/SPASS/SPASS: 21.31% (14.9895 => 18.1832, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 45.14% (14.1553 => 20.5444, std.dev.: 0.0255) MultiSource/Benchmarks/MallocBench/gs/gs: 18.89% (4.1105 => 4.8868, std.dev.: 0.0078) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 57.51% (1.1048 => 1.7402, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 424.52% (7.1582 => 37.5462, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.41% (3.4629 => 6.4898, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/stepanov_container: 76.86% (0.6222 => 1.1004, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10268.75% (0.0720 => 7.4655, std.dev.: 0.0032) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11145500.00% (0.0001 => 11.1456, std.dev.: 0.0047) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486900.00% (0.0001 => 5.4870, std.dev.: 0.0018) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 821.57% (1.1194 => 10.3161, std.dev.: 0.0121) SingleSource/UnitTests/SignlessTypes/factor: 165.20% (0.0296 => 0.0785, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 149.01% (22.1758 => 55.2191, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/lowercase: 123.83% (0.0256 => 0.0573, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 98.17% (0.0929 => 0.1841, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 88.07% (0.0243 => 0.0457, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 72.32% (0.1463 => 0.2521, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 68.63% (0.0271 => 0.0457, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 65.48% (0.0730 => 0.1208, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 61.42% (0.0394 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.10% (2.9384 => 4.6163, std.dev.: 0.0209) SingleSource/Regression/C/sumarray: 54.11% (0.0231 => 0.0356, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.02% (7.0540 => 10.7938, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.42% (1.5859 => 2.4172, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 49.24% (0.1056 => 0.1576, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 48.71% (0.0232 => 0.0345) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 47.57% (8.1363 => 12.0064, std.dev.: 0.0107) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.19% (0.0439 => 0.0633, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.69% (2.2024 => 3.1426, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 40.43% (0.3109 => 0.4366, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: 38.83% (0.1432 => 0.1988, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 38.70% (21.9371 => 30.4275, std.dev.: 0.0045) SingleSource/UnitTests/vla: 38.59% (0.0355 => 0.0492, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.04% (0.1062 => 0.1466, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 33.96% (4.2646 => 5.7129, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 33.28% (0.4615 => 0.6151, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 33.19% (1.5415 => 2.0532, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 33.17% (0.0814 => 0.1084, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.57% (0.0479 => 0.0635, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.09% (0.2271 => 0.2977, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 30.46% (1.1642 => 1.5188, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/05-eks/eks: 30.33% (0.4299 => 0.5603, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 29.05% (0.1143 => 0.1475, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: 28.93% (0.0719 => 0.0927, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.66% (0.5105 => 0.6568, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Oscar: 28.62% (0.0636 => 0.0818, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.96% (0.6675 => 0.8541, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 27.67% (0.1655 => 0.2113, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.62% (0.0793 => 0.1012, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.53% (0.1584 => 0.2020, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 26.85% (9.4845 => 12.0314, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/n-body: 26.81% (0.0746 => 0.0946, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.64% (0.1892 => 0.2396, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.61% (3.8922 => 4.9278, std.dev.: 0.0036) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.58% (0.1125 => 0.1424, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 26.23% (0.2554 => 0.3224, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.49% (0.1695 => 0.2127, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.48% (0.0730 => 0.0916, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 25.41% (0.4289 => 0.5379, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 25.28% (1.0722 => 1.3433, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.25% (0.0408 => 0.0511) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.03% (0.1566 => 0.1958, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.93% (0.3121 => 0.3899, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.87% (0.1906 => 0.2380, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 24.77% (0.1175 => 0.1466, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 24.68% (0.1337 => 0.1667, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.56% (1.4186 => 1.7670, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 24.26% (0.4620 => 0.5741, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 23.64% (0.7115 => 0.8797, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 23.50% (0.6456 => 0.7973, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 23.21% (0.0672 => 0.0828, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 22.64% (0.1555 => 0.1907, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.56% (0.2700 => 0.3309, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 22.51% (0.0662 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.33% (0.1236 => 0.1512, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 22.32% (0.0457 => 0.0559, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 22.27% (0.0660 => 0.0807, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 22.20% (0.0626 => 0.0765, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/15-trie/trie: 22.20% (0.0527 => 0.0644, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 22.00% (0.7835 => 0.9559, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/17-bintr/bintr: 21.93% (0.0675 => 0.0823, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.77% (0.1029 => 0.1253, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 21.37% (0.1151 => 0.1397, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.36% (1.3050 => 1.5837, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/matrix: 21.27% (0.3098 => 0.3757, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 21.19% (5.7591 => 6.9792, std.dev.: 0.0126) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.14% (0.0842 => 0.1020, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.93% (0.1032 => 0.1248, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 20.83% (0.1695 => 0.2048, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 20.82% (0.0485 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 20.81% (0.1163 => 0.1405, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.57% (0.0953 => 0.1149, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 20.55% (0.0871 => 0.1050, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.36% (0.5860 => 0.7053, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 20.36% (0.0614 => 0.0739, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.30% (4.9449 => 5.9489, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ft/ft: 20.21% (0.1940 => 0.2332, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 20.12% (0.8172 => 0.9816, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.92% (0.5020 => 0.6020, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 19.74% (3.3354 => 3.9938, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 19.59% (0.3307 => 0.3955, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.47% (5.0018 => 5.9759, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0886 => 0.1058, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 18.90% (0.7433 => 0.8838, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.85% (0.2758 => 0.3278, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.67% (0.0648 => 0.0769, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 18.61% (0.1268 => 0.1504, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.57% (0.0770 => 0.0913, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 18.50% (1.1840 => 1.4030, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.50% (0.5569 => 0.6599, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 18.42% (3.8723 => 4.5855, std.dev.: 0.0080) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.41% (0.1510 => 0.1788, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 18.38% (0.9765 => 1.1560, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.37% (0.2107 => 0.2494, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 18.34% (0.0567 => 0.0671, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 18.13% (2.0273 => 2.3949, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.05% (0.0770 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.87% (0.0834 => 0.0983, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.84% (1.1861 => 1.3977, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.82% (0.1117 => 0.1316, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/18-imp/imp: 17.79% (0.3423 => 0.4032, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 17.68% (0.0933 => 0.1098, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.63% (0.4203 => 0.4944, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.62% (0.1044 => 0.1228, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.62% (0.5981 => 0.7035, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 17.54% (2.2969 => 2.6998, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/ReedSolomon: 17.42% (0.2049 => 0.2406, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.29% (0.2065 => 0.2422, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.06% (0.3441 => 0.4028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.00% (0.3283 => 0.3841, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.86% (0.8101 => 0.9467, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.54% (0.6450 => 0.7517, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 16.40% (0.3232 => 0.3762, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 16.11% (0.0633 => 0.0735, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 16.10% (0.3180 => 0.3692, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 15.82% (0.1144 => 0.1325, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.74% (0.8921 => 1.0325, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 15.65% (0.0818 => 0.0946) SingleSource/UnitTests/Vector/SSE/sse_isamax: 15.34% (0.0704 => 0.0812, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/bmm/bmm: 15.28% (0.0759 => 0.0875, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 15.06% (0.3379 => 0.3888, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.93% (0.8067 => 0.9271, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 14.83% (0.2603 => 0.2989, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.68% (0.0838 => 0.0961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.26% (0.3865 => 0.4416, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.98% (0.4636 => 0.5284, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 13.91% (0.3387 => 0.3858, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 13.43% (0.2905 => 0.3295, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.34% (1.5603 => 1.7685, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 13.19% (0.3282 => 0.3715, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.19% (0.4103 => 0.4644, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 12.88% (17.1811 => 19.3945, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout-C++/lists: 12.57% (0.3422 => 0.3852, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.51% (0.2430 => 0.2734, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/moments: 12.45% (0.4048 => 0.4552, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 12.35% (0.3603 => 0.4048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 12.13% (0.3684 => 0.4131, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 11.79% (0.3927 => 0.4390, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/bh/bh: 11.77% (0.3092 => 0.3456, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.61% (0.4064 => 0.4536, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.58% (0.3826 => 0.4269, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 11.22% (0.3886 => 0.4322, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 11.18% (0.3427 => 0.3810, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.07% (14.3668 => 15.9570, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.04% (0.1114 => 0.1237, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/exceptions: 10.45% (0.3828 => 0.4228, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.39% (0.3543 => 0.3911, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 10.33% (0.1268 => 0.1399, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/strcat: 10.28% (0.2831 => 0.3122, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.08% (0.3543 => 0.3900, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.03% (0.2871 => 0.3159, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 9.95% (0.3497 => 0.3845, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 9.94% (0.3561 => 0.3915, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 9.83% (0.3694 => 0.4057, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.81% (0.3516 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.73% (2.0665 => 2.2675, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2877 => 0.3149, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 9.30% (1.2842 => 1.4036, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.22% (0.2756 => 0.3010, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.14% (0.3162 => 0.3451, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 9.14% (0.2725 => 0.2974, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.07% (0.3650 => 0.3981, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.99% (0.2793 => 0.3044, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 8.92% (0.2714 => 0.2956, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 8.73% (63.2438 => 68.7651, std.dev.: 0.0391) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.67% (0.3935 => 0.4276, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2872 => 0.3119, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.55% (0.3052 => 0.3313, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/random: 8.53% (0.2802 => 0.3041, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 8.41% (0.6030 => 0.6537, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.24% (0.7326 => 0.7930, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.11% (2.2022 => 2.3807, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.10% (0.3136 => 0.3390, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.08% (0.1625 => 0.1740, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.03% (0.4879 => 0.5222, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.48% (0.3177 => 0.3383, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 6.20% (10.3673 => 11.0100, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.55% (0.2266 => 0.2369, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 4.34% (0.3131 => 0.3267, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.86% (7.9617 => 8.1891, std.dev.: 0.0092) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4706, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 12.93% (0.5413 => 0.6113, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.27% (1.1396 => 1.2452, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4261, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4562, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.71% (0.3316 => 0.3439, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.29% (0.9957 => 1.0285, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9177, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6395 => 3.7124, std.dev.: 0.0126) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2906, std.dev.: 0.0134) MultiSource/Benchmarks/llubenchmark/llu: 1.82% (3.7781 => 3.8470, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 1.75% (0.8333 => 0.8479, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2381, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 1.37% (1.0785 => 1.0933, std.dev.: 0.0054) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4533, std.dev.: 0.0185) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.02% (6.5088 => 6.5754, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.47% (6.6874 => 0.1693, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.83% (5.2763 => 1.1695, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -74.87% (0.8651 => 0.2174, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -43.22% (0.1622 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.48% (5.3855 => 4.4443, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.79% (5.3526 => 4.4541, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: -13.02% (10.4361 => 9.0773, std.dev.: 0.0076) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0240, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.62% (1.7609 => 1.6267, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.14% (1.9577 => 0.6628, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3066, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4285, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8503, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0068, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -20.36% (0.2161 => 0.1721, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-6: -16.03% (1.6925 => 1.4212, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7357, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.02% (0.9540 => 0.8393, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4928, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.76% (19.9488 => 18.5998, std.dev.: 0.0112) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.08% (1.6805 => 1.5784, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.62% (8.1563 => 7.6983, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.44% (1.2373 => 1.1700, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -5.29% (0.2497 => 0.2365, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.68% (0.4808 => 0.4583, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -4.47% (10.2830 => 9.8234, std.dev.: 0.0110) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0022) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6760, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: -1.54% (3.7221 => 3.6646, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout/ary3: -1.34% (3.6994 => 3.6499, std.dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: -1.21% (4.6441 => 4.5877, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2310, std.dev.: 0.0076) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0012) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 16:07:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 18:07:22 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128000722.9395F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8018?compare_to=8015&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8018, Order: 173632, Start Time: 2013-01-27 22:33:45, End Time: 2013-01-28 00:07:42 To: 8015, Order: 173621, Start Time: 2013-01-27 20:36:02, End Time: 2013-01-27 22:10:11 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 1 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.29% (1.1513 => 1.1662, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.01% (80.0975 => 80.9089, std.dev.: 0.1724) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.79% (0.6964 => 0.6839, std.dev.: 0.0029) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.45% (0.0974 => 0.1631, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.06% (0.6395 => 0.8829, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.59% (0.5456 => 0.7234, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.44% (0.6260 => 0.8291, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.44% (0.5805 => 0.7688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.02% (0.5849 => 0.7722, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.96% (0.5575 => 0.7357, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.74% (0.6395 => 0.8425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.61% (0.5581 => 0.7345, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.84% (0.5941 => 0.7773, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.36% (0.5859 => 0.7638, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.20% (0.6033 => 0.7855, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.99% (0.6189 => 0.7983, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 28.84% (1.6474 => 2.1225, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.46% (0.6676 => 0.8576, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.11% (0.6304 => 0.8076, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.75% (0.0699 => 0.0893, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.58% (0.6230 => 0.7948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.70% (0.6660 => 0.8438, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.59% (0.5802 => 0.7345, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.43% (0.5705 => 0.7213, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.30% (0.5925 => 0.7483, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 25.99% (0.5857 => 0.7379, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.80% (0.5570 => 0.7007, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.68% (0.5478 => 0.6885, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 25.62% (0.5569 => 0.6996, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.43% (0.5591 => 0.7013, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.13% (0.5863 => 0.7278, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.11% (0.7524 => 0.9338, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.97% (0.6446 => 0.7991, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.89% (0.6052 => 0.7498, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.11% (0.6681 => 0.8225, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.04% (0.6194 => 0.7621, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.74% (0.6297 => 0.7729, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.73% (2.2587 => 2.7495, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.42% (0.6667 => 0.8095, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 19.95% (0.7339 => 0.8803, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.37% (0.3357 => 0.3873, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.03% (1.1450 => 1.3171, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.50% (4.5069 => 5.0702, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.25% (0.4916 => 0.5518, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4515 => 0.5060, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.47% (1.6364 => 1.8241, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.43% (3.5339 => 3.9378, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.20% (0.1982 => 0.2204, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.92% (0.1230 => 0.1352, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.62% (9.2283 => 10.1161, std.dev.: 0.0215) MultiSource/Applications/Burg/burg: 8.65% (1.2515 => 1.3597, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.05% (0.4524 => 0.4888, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.99% (0.5329 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.86% (0.1731 => 0.1867, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (0.4861 => 0.5228, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.45% (0.7021 => 0.7544, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.31% (1.4642 => 1.5713, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.87% (1.2784 => 1.3662, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 6.18% (0.3255 => 0.3456, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.12% (0.1879 => 0.1994, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 5.67% (0.6750 => 0.7133, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.3319 => 0.3491, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.22% (5.4682 => 5.6989, std.dev.: 0.0135) MultiSource/Applications/oggenc/oggenc: 3.36% (5.0226 => 5.1916, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3446 => 0.3560, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.3864 => 1.4322, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.74% (0.8418 => 0.8649, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.50% (0.9557 => 0.9796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.48% (0.4427 => 0.4537, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 2.20% (0.7447 => 0.7611, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (22.4056 => 22.8668, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.03% (0.5168 => 0.5273, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 1.97% (15.5079 => 15.8135, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.90% (1.3722 => 1.3983, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8036, std.dev.: 0.0095) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.03% (11.6767 => 12.1478, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5567, std.dev.: 0.0603) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3821, std.dev.: 0.0021) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.63% (18.2231 => 18.5205, std.dev.: 0.0187) MultiSource/Applications/sqlite3/sqlite3: 1.56% (4.5320 => 4.6029, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.50% (79.7170 => 80.9089, std.dev.: 0.1724) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2693, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.21% (10.3489 => 10.4738, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.85% (0.7198 => 0.6849, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.97% (2.4924 => 2.3935, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.96% (0.3812 => 0.3661, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3831 => 0.3682, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.85% (0.3896 => 0.3746, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.82% (0.3848 => 0.3701, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.4033 => 0.3881, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.62% (0.3837 => 0.3698, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.59% (0.4176 => 0.4026, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.57% (0.3891 => 0.3752, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.49% (0.9852 => 0.9508, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.35% (0.3884 => 0.3754, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.13% (0.3323 => 0.3219, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.05% (0.4199 => 0.4071, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.74% (0.9542 => 0.9281, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.69% (0.4280 => 0.4165, std.dev.: 0.0017) MultiSource/Applications/hexxagon/hexxagon: -2.68% (1.3148 => 1.2795, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2267, std.dev.: 0.0369) SingleSource/UnitTests/ObjC++/Hello: -2.63% (0.6347 => 0.6180, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.58% (2.1713 => 2.1152, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.56% (0.6484 => 0.6318, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -2.53% (0.6441 => 0.6278, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9085, std.dev.: 0.0213) MultiSource/Applications/sqlite3/sqlite3: -1.70% (17.1032 => 16.8129, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/property-reference: -1.58% (0.7779 => 0.7656, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.54% (6.7716 => 6.6674, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.38% (0.7919 => 0.7810, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -1.31% (16.1920 => 15.9801, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/gs/gs: -1.17% (4.3330 => 4.2824, std.dev.: 0.0075) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (7.0961 => 7.0202, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.01% (1.2221 => 1.2097, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.22% (1.8100 => 0.6839, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0117) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0267, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7574, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0742, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.00% (4.1024 => 3.1998, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1735, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3559, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.55% (1.3096 => 1.2631, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.73% (7.9763 => 7.7589, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.22% (3.7241 => 3.6414, std.dev.: 0.0030) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1752, std.dev.: 0.0094) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.59% (6.5735 => 6.4690, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6009, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.25% (1.6307 => 1.6103, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.02% (3.7092 => 3.6714, std.dev.: 0.0120) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 17:07:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 19:07:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128010757.1A35E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8019?compare_to=8016&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8019, Order: 173634, Start Time: 2013-01-27 23:02:51, End Time: 2013-01-28 01:08:17 To: 8016, Order: 173621, Start Time: 2013-01-27 20:33:18, End Time: 2013-01-27 22:42:28 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (88 on baseline) Performance Improvements: 32 (47 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1025 (928 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.75% (2.6293 => 2.8069, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.41% (0.5143 => 0.5267, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 20.00% (44.2757 => 53.1295, std.dev.: 0.4243) SingleSource/Benchmarks/Misc/flops-4: 4.29% (1.6672 => 1.7387, std.dev.: 0.0201) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.95% (3.9155 => 4.0703, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/pi: 2.51% (2.1588 => 2.2129, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.61% (2.7217 => 2.7655, std.dev.: 0.0153) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -42.65% (0.0816 => 0.0468, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -41.29% (0.2768 => 0.1625, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -18.13% (0.0844 => 0.0691, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -17.75% (0.0586 => 0.0482, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -17.32% (0.1345 => 0.1112, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -16.11% (0.1862 => 0.1562, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -14.87% (0.2879 => 0.2451, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -12.86% (0.2948 => 0.2569, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -12.78% (0.2691 => 0.2347, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.72% (2.3248 => 2.0291, std.dev.: 0.0532) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -12.39% (0.3777 => 0.3309, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.87% (1.4768 => 1.3311, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.14% (16.2559 => 14.7708, std.dev.: 0.5584) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.28% (26.0953 => 23.9358, std.dev.: 0.6952) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.67% (0.2263 => 0.2112, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ackermann: -6.09% (0.2068 => 0.1942, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -5.54% (0.2238 => 0.2114, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: -5.09% (1.3433 => 1.2749, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash2: -4.14% (0.4997 => 0.4790, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.86% (5.1453 => 4.9467, std.dev.: 0.0682) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.59% (1.3415 => 1.2934, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.43% (0.6099 => 0.5951, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.71% (1.5955 => 1.5682, std.dev.: 0.0067) MultiSource/Applications/siod/siod: -1.36% (2.6731 => 2.6367, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -37.05% (0.0799 => 0.0503, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -25.29% (0.4401 => 0.3288, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout-C++/lists1: -8.05% (0.6655 => 0.6119, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: -6.91% (1.9156 => 1.7832, std.dev.: 0.0495) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.08% (40.7581 => 39.0952, std.dev.: 0.4261) MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.29% (0.6686 => 0.6533, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.59% (3.5697 => 3.5128, std.dev.: 0.0206) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.49% (6.0553 => 5.9652, std.dev.: 0.0301) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.07% (1.2208 => 1.2199, std.dev.: 0.2549) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 2.71% (0.0221 => 0.0227, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.69% (0.0436 => 0.0433, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.89% (0.0338 => 0.0341, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0323 => 0.0321, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.69% (0.0435 => 0.0432, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0222 => 0.0222, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.53% (0.0243 => 0.0232, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 14.29% (0.0014 => 0.0016, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.32% (0.1508 => 0.1473, std.dev.: 0.0281) MultiSource/Applications/lemon/lemon: -20.48% (1.4357 => 1.1417, std.dev.: 0.3602) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.80% (0.4308 => 0.3929, std.dev.: 0.1454) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.32% (0.1478 => 0.1527, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -20.00% (0.0010 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.98% (0.0614 => 0.0620, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.34% (0.0326 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.65% (0.0555 => 0.0603, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.28% (1.2880 => 1.2844, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -54.05% (0.0037 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.49% (0.0603 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.78% (0.0356 => 0.0373, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.50% (1.7759 => 1.7671, std.dev.: 0.0413) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 50.00% (0.0076 => 0.0114, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.39% (34.1105 => 33.9766, std.dev.: 0.2467) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 395.24% (0.0336 => 0.1664, std.dev.: 0.0189) SingleSource/Regression/C/sumarraymalloc: 118.77% (0.0293 => 0.0641, std.dev.: 0.0048) SingleSource/Regression/C/sumarray2d: 92.34% (0.0274 => 0.0527, std.dev.: 0.0046) SingleSource/Regression/C/sumarray: 58.49% (0.0265 => 0.0420, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 58.42% (0.1638 => 0.2595, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.77% (0.8893 => 1.2608, std.dev.: 0.0640) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.52% (0.8926 => 1.2632, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.49% (0.9120 => 1.2904, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.64% (0.9061 => 1.2743, std.dev.: 0.0527) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.39% (0.9612 => 1.3494, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.37% (0.9855 => 1.3833, std.dev.: 0.0551) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 40.04% (0.9403 => 1.3168, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.84% (0.9588 => 1.3408, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.81% (0.9564 => 1.3371, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.75% (0.9381 => 1.3110, std.dev.: 0.0463) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.45% (0.9091 => 1.2677, std.dev.: 0.0556) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.99% (0.8990 => 1.2495, std.dev.: 0.0909) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 38.36% (0.8912 => 1.2331, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.91% (0.9998 => 1.3788, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.79% (0.9422 => 1.2983, std.dev.: 0.0547) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.11% (0.9010 => 1.2354, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.80% (1.0119 => 1.3843, std.dev.: 0.1064) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.07% (0.8736 => 1.1887, std.dev.: 0.0372) SingleSource/Benchmarks/Stanford/IntMM: 35.73% (0.0431 => 0.0585, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.64% (1.0867 => 1.4740, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.90% (1.0052 => 1.3560, std.dev.: 0.0796) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.49% (0.8732 => 1.1744, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.18% (0.8846 => 1.1870, std.dev.: 0.0368) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.94% (0.9867 => 1.3117, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.35% (1.0017 => 1.3258, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.90% (0.9507 => 1.2540, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.76% (0.9788 => 1.2897, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.58% (0.9488 => 1.2484, std.dev.: 0.0748) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.90% (0.9993 => 1.3081, std.dev.: 0.0791) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.72% (0.9405 => 1.2294, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.50% (0.9550 => 1.2463, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.46% (1.0088 => 1.3161, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.42% (0.9685 => 1.2631, std.dev.: 0.0777) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.35% (0.9127 => 1.1897, std.dev.: 0.0415) MultiSource/Applications/sgefa/sgefa: 29.82% (0.3598 => 0.4671, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.57% (1.0860 => 1.3746, std.dev.: 0.1010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.76% (0.0738 => 0.0906, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.15% (3.6295 => 4.3247, std.dev.: 0.1091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.04% (0.0669 => 0.0783, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.02% (0.0805 => 0.0942, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.20% (0.0642 => 0.0746, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.48% (2.4519 => 2.8069, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.43% (0.0783 => 0.0896, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.02% (0.0963 => 0.1098, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.47% (1.8127 => 2.0568, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.39% (0.1240 => 0.1406, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 12.92% (9.5202 => 10.7504, std.dev.: 0.3117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.14% (1.4110 => 1.5682, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.84% (0.5369 => 0.5951, std.dev.: 0.0022) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.62% (0.4596 => 0.5084, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/chomp: 9.93% (0.1793 => 0.1971, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.1955 => 0.2143, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.79% (1.8651 => 2.0291, std.dev.: 0.0532) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.11% (0.5059 => 0.5267, std.dev.: 0.0041) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107337.50% (0.0008 => 0.8595, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/ary3: 391.52% (2.2304 => 10.9628, std.dev.: 1.3105) SingleSource/Benchmarks/Shootout/matrix: 335.42% (1.5825 => 6.8906, std.dev.: 0.2302) MultiSource/Applications/sgefa/sgefa: 259.03% (0.3515 => 1.2620, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.21% (1.1825 => 4.0703, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.00% (4.8185 => 15.8047, std.dev.: 0.1273) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 196.49% (0.0228 => 0.0676, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary2: 184.50% (0.0129 => 0.0367, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 135.34% (0.0232 => 0.0546, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/matrix: 63.70% (2.9083 => 4.7610, std.dev.: 0.1204) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.65% (0.2562 => 0.3424, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.12% (3.1254 => 4.0980, std.dev.: 0.0158) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 23.98% (1.4588 => 1.8086, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.13% (5.6033 => 6.8994, std.dev.: 0.2201) SingleSource/Benchmarks/Misc/salsa20: 22.26% (7.4497 => 9.1080, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.30% (4.8112 => 5.7879, std.dev.: 0.0144) MultiSource/Applications/JM/lencod/lencod: 16.13% (6.8159 => 7.9153, std.dev.: 0.3790) SingleSource/Regression/C/uint64_to_float: 15.81% (1.5397 => 1.7832, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8570, std.dev.: 0.0823) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6499, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.94% (3.6477 => 3.9739, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 8.79% (8.6447 => 9.4050, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.95% (4.7473 => 5.0772, std.dev.: 0.0241) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.41% (4.1836 => 4.4099, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.18% (0.6211 => 0.6533, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-4: 5.03% (1.6555 => 1.7387, std.dev.: 0.0201) SingleSource/Benchmarks/Linpack/linpack-pc: 4.39% (50.8945 => 53.1295, std.dev.: 0.4243) SingleSource/Benchmarks/Misc/pi: 3.45% (2.1390 => 2.2129, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8768, std.dev.: 0.0338) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.35% (0.0808 => 0.0482, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.74% (0.0727 => 0.0489, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.23% (0.0676 => 0.0546, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: -18.85% (1.8964 => 1.5389, std.dev.: 0.0735) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.56% (1.0960 => 0.9364, std.dev.: 0.0217) MultiSource/Applications/spiff/spiff: -9.70% (1.0220 => 0.9229, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.71% (0.1366 => 0.1247, std.dev.: 0.0045) MultiSource/Applications/treecc/treecc: -8.67% (2.4719 => 2.2577, std.dev.: 0.0630) SingleSource/Benchmarks/Shootout-C++/hash2: -6.70% (0.5134 => 0.4790, std.dev.: 0.0057) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.40% (0.2481 => 0.2347, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.16% (1.3220 => 1.2934, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.84% (11.5523 => 3.9467, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/fp-convert: -61.44% (15.6525 => 6.0355, std.dev.: 0.1859) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.71% (0.4146 => 0.1795, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.45% (0.4578 => 0.2360, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.93% (11.3868 => 6.3850, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6276, std.dev.: 0.0389) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.84% (0.4452 => 0.3079, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.39% (0.5495 => 0.3990, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.05% (5.2605 => 3.8903, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.31% (4.4467 => 3.3211, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.30% (0.5826 => 0.4352, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.74% (0.5897 => 0.4497, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.47% (4.9921 => 3.8206, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7921, std.dev.: 0.0832) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.42% (7.0016 => 5.7817, std.dev.: 0.2080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.59% (16.6791 => 13.9126, std.dev.: 0.4341) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.49% (5.3626 => 4.6927, std.dev.: 0.1084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9938, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.16% (9.7992 => 8.6072, std.dev.: 0.0122) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.72% (2.8778 => 2.5694, std.dev.: 0.0636) SingleSource/Benchmarks/Shootout-C++/lists1: -7.68% (0.6628 => 0.6119, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2275, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2482, std.dev.: 0.0460) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.02% (4.2843 => 4.0264, std.dev.: 0.0996) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (63.1520 => 59.6103, std.dev.: 0.1342) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.07% (4.9799 => 4.7272, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: -4.80% (3.6768 => 3.5002, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.5127 => 3.3587, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4359, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (5.8973 => 5.6807, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.40% (40.4729 => 39.0952, std.dev.: 0.4261) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.75% (8.7327 => 8.5798, std.dev.: 0.0084) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8995, std.dev.: 0.1206) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.52% (3.5669 => 3.5128, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (3.7450 => 3.7037, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.26% (1.2047 => 1.2199, std.dev.: 0.2549) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0063) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0068) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.02% (0.0255 => 0.0232, std.dev.: 0.0039) MultiSource/Applications/Burg/burg: 6.67% (0.0015 => 0.0016, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.73% (0.1530 => 0.1473, std.dev.: 0.0281) MultiSource/Applications/lemon/lemon: -40.82% (1.9293 => 1.1417, std.dev.: 0.3602) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.96% (0.4049 => 0.3929, std.dev.: 0.1454) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.13% (0.1510 => 0.1527, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.61% (0.0978 => 0.0620, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.20% (0.0590 => 0.0603, std.dev.: 0.0029) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.56% (1.1617 => 1.2844, std.dev.: 0.0034) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.61% (0.7437 => 1.7671, std.dev.: 0.0413) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.91% (0.0092 => 0.0114, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.90% (12.7781 => 33.9766, std.dev.: 0.2467) Report Time: 0.81s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 17:10:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 19:10:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130128011044.797F12A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8020?compare_to=8014&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8020, Order: 173622, Start Time: 2013-01-27 21:35:40, End Time: 2013-01-28 01:11:03 To: 8014, Order: 173620, Start Time: 2013-01-27 17:07:44, End Time: 2013-01-27 20:43:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (187 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.70% (1.5867 => 1.6136, std.dev.: 0.0040) MultiSource/Applications/oggenc/oggenc: 1.06% (1.9897 => 2.0108, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ClamAV/clamscan: 3.55% (0.2959 => 0.3064, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.43% (14.4770 => 14.2693, std.dev.: 0.0680) SingleSource/Benchmarks/Misc/whetstone: -1.23% (2.8246 => 2.7899, std.dev.: 0.0073) MultiSource/Benchmarks/llubenchmark/llu: -1.08% (5.0220 => 4.9678, std.dev.: 0.0113) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.40% (0.0625 => 0.0915, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.01% (0.1063 => 0.1467, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.42% (0.0331 => 0.0435, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.67% (0.0714 => 0.0933, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.04% (0.2969 => 0.3861, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.75% (0.1106 => 0.1435, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.63% (0.0475 => 0.0611, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.39% (0.5900 => 0.7575, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 28.15% (0.4994 => 0.6400, std.dev.: 0.0132) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.15% (0.0547 => 0.0701, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.71% (0.4139 => 0.5286, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.29% (0.1107 => 0.1398, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 26.25% (0.0541 => 0.0683, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.22% (0.1003 => 0.1266, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 26.21% (1.5932 => 2.0108, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.12% (0.5000 => 0.6306, std.dev.: 0.0136) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.93% (0.1620 => 0.2040, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.91% (0.4253 => 0.5355, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.47% (0.1021 => 0.1281, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.60% (0.1549 => 0.1930, std.dev.: 0.0054) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/em3d/em3d: 24.26% (0.0948 => 0.1178, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.01% (0.0633 => 0.0785, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.83% (0.0642 => 0.0795) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.57% (0.1604 => 0.1982, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.48% (0.0822 => 0.1015, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 23.14% (0.0821 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.14% (0.3903 => 0.4806, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 22.85% (0.1619 => 0.1989, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.79% (0.0452 => 0.0555, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.69% (1.3152 => 1.6136, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.47% (0.3271 => 0.4006, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 22.44% (0.4029 => 0.4933, std.dev.: 0.0142) MultiSource/Applications/viterbi/viterbi: 22.18% (0.0947 => 0.1157, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.08% (0.0462 => 0.0564) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.96% (0.1462 => 0.1783, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/08-main/main: 21.92% (0.1218 => 0.1485, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.84% (0.2866 => 0.3492, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 21.58% (0.4658 => 0.5663, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/09-vor/vor: 21.40% (0.1505 => 0.1827, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.32% (0.1088 => 0.1320, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 21.20% (0.0698 => 0.0846, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.18% (0.3890 => 0.4714, std.dev.: 0.0111) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.95% (0.2014 => 0.2436, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 20.79% (0.0808 => 0.0976, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/Hello: 20.75% (0.5826 => 0.7035, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.61% (0.2736 => 0.3300, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 20.33% (0.5026 => 0.6048, std.dev.: 0.0034) SingleSource/UnitTests/ObjC++/property-reference-object: 20.31% (0.5889 => 0.7085, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: 20.16% (0.5546 => 0.6664, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 20.12% (1.8794 => 2.2575, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.02% (0.1968 => 0.2362, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 19.63% (0.9697 => 1.1601, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.62% (0.2875 => 0.3439, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.52% (3.5627 => 4.2581, std.dev.: 0.0709) SingleSource/UnitTests/ObjC++/property-reference: 19.31% (0.7171 => 0.8556, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/fibo: 18.97% (0.2725 => 0.3242, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.95% (1.6211 => 1.9283, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/strcat: 18.95% (0.2750 => 0.3271, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 18.93% (0.2811 => 0.3343, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.90% (0.0582 => 0.0692, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.80% (0.2792 => 0.3317, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: 18.77% (0.2813 => 0.3341, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.71% (0.1160 => 0.1377, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 18.64% (0.2714 => 0.3220, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 18.62% (0.2803 => 0.3325, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.59% (0.2738 => 0.3247, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 18.51% (0.0605 => 0.0717, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.50% (0.2729 => 0.3234, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 18.46% (0.2823 => 0.3344, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.40% (0.3195 => 0.3783, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 18.34% (0.3004 => 0.3555, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 18.31% (0.2780 => 0.3289, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.30% (2.0673 => 2.4457, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/18-imp/imp: 18.30% (0.1421 => 0.1681, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.17% (0.2911 => 0.3440, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 18.10% (0.9909 => 1.1703, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/wc: 18.06% (0.3096 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.02% (0.3930 => 0.4638, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: 17.81% (0.3267 => 0.3849, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.81% (0.3060 => 0.3605, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.77% (0.4361 => 0.5136, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary: 17.68% (0.3258 => 0.3834, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 17.68% (1.0781 => 1.2687, std.dev.: 0.0068) MultiSource/Benchmarks/Bullet/bullet: 17.66% (23.5202 => 27.6746, std.dev.: 0.0551) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.59% (1.9694 => 2.3158, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/hash: 17.58% (0.4146 => 0.4875, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.40% (1.9966 => 2.3440, std.dev.: 0.0337) SingleSource/Benchmarks/Shootout-C++/ary2: 17.27% (0.3317 => 0.3890, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 17.27% (4.2109 => 4.9380, std.dev.: 0.0222) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.19% (0.3124 => 0.3661, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.10% (0.3362 => 0.3937, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.02% (2.7292 => 3.1938, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/sieve: 17.02% (0.3726 => 0.4360, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.00% (0.3282 => 0.3840, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.98% (0.3845 => 0.4498, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.97% (0.3625 => 0.4240, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists1: 16.94% (0.3477 => 0.4066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 16.94% (0.3348 => 0.3915, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 16.83% (0.3678 => 0.4297, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.67% (0.3690 => 0.4305, std.dev.: 0.0116) MultiSource/Applications/lua/lua: 16.47% (1.4269 => 1.6619, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 16.42% (0.4251 => 0.4949, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.33% (0.3981 => 0.4631, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.31% (4.4195 => 5.1404, std.dev.: 0.0293) MultiSource/Benchmarks/nbench/nbench: 16.06% (0.2566 => 0.2978, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-4: 16.05% (0.3465 => 0.4021, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 16.02% (0.3446 => 0.3998, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.97% (0.3469 => 0.4023, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.95% (0.2075 => 0.2406, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.94% (0.3488 => 0.4044, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 15.86% (0.3442 => 0.3988, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.84% (0.3460 => 0.4008, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.75% (0.0673 => 0.0779, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 15.73% (0.3496 => 0.4046, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 15.58% (0.7875 => 0.9102, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/property: 15.51% (0.3650 => 0.4216, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 15.44% (0.5012 => 0.5786, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 15.34% (0.3643 => 0.4202, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 15.31% (0.3724 => 0.4294, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.04% (0.2068 => 0.2379, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.79% (0.1028 => 0.1180, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.78% (0.6435 => 0.7386, std.dev.: 0.0071) MultiSource/Applications/SIBsim4/SIBsim4: 14.60% (0.2691 => 0.3084, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 14.53% (5.5417 => 6.3470, std.dev.: 0.0151) MultiSource/Applications/JM/ldecod/ldecod: 14.23% (2.1653 => 2.4734, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.18% (0.2737 => 0.3125, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 13.91% (4.6177 => 5.2598, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 13.66% (2.1013 => 2.3883, std.dev.: 0.0041) MultiSource/Benchmarks/sim/sim: 13.46% (0.0758 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.18% (0.0804 => 0.0910, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.04% (0.3084 => 0.3486, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: 13.01% (0.3498 => 0.3953, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.42% (0.5361 => 0.6027, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 12.29% (0.3336 => 0.3746, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.27% (0.2103 => 0.2361, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.21% (0.2040 => 0.2289, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 12.18% (0.6634 => 0.7442, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.89% (11.6398 => 13.0242, std.dev.: 0.0185) MultiSource/Benchmarks/PAQ8p/paq8p: 11.66% (0.4847 => 0.5412, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 10.77% (0.7426 => 0.8226, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.46% (4.6926 => 5.1834, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.51% (0.5584 => 0.6115, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.34% (2.0346 => 2.2246, std.dev.: 0.0015) MultiSource/Applications/kimwitu++/kc: 8.61% (11.9555 => 12.9854, std.dev.: 0.0067) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.38% (0.3792 => 0.4034, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.83% (29.0505 => 181.5161, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6529, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.43% (0.3693 => 0.4078, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 9.35% (0.2802 => 0.3064, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 8.77% (0.2122 => 0.2308, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6783, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2390, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6886, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.10% (15.8721 => 16.2056, std.dev.: 0.0367) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3040, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2869, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0819, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.19% (3.1722 => 3.2099, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5394, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4790, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5793, std.dev.: 0.0207) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.56% (2.4764 => 2.4378, std.dev.: 0.0080) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.75% (25.4195 => 16.5869, std.dev.: 0.0143) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.22% (17.2379 => 14.2693, std.dev.: 0.0680) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: -7.99% (0.2402 => 0.2210, std.dev.: 0.0037) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8016, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2325, std.dev.: 0.0085) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8056, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0001) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -2.41% (14.0481 => 13.7098, std.dev.: 0.0963) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.2027, std.dev.: 0.0384) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5753, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4992, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7158, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (105.3826 => 104.2084, std.dev.: 0.0816) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0489, std.dev.: 0.0008) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 17:35:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 19:35:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128013534.717BC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8021?compare_to=8017&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8021, Order: 173636, Start Time: 2013-01-27 23:25:01, End Time: 2013-01-28 01:35:53 To: 8017, Order: 173621, Start Time: 2013-01-27 20:43:06, End Time: 2013-01-27 22:54:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (216 on baseline) Performance Improvements: 6 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1092 (655 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.30% (10.3161 => 10.4501, std.dev.: 0.0417) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.61% (0.6628 => 0.6801, std.dev.: 0.0044) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.13% (11.0100 => 10.7754, std.dev.: 0.0151) MultiSource/Applications/SIBsim4/SIBsim4: -1.17% (1.6614 => 1.6420, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: -1.13% (3.9938 => 3.9485, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.13% (6.4898 => 6.4162, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: -1.01% (19.3945 => 19.1991, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/McGill/chomp: -1.24% (1.1700 => 1.1555, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1330 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8529 => 499.8279, std.dev.: 0.0207) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 44222.77% (1.1277 => 499.8279, std.dev.: 0.0207) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 214.02% (0.5229 => 1.6420, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 20.14% (14.9895 => 18.0086, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 44.04% (14.1553 => 20.3886, std.dev.: 0.0122) MultiSource/Benchmarks/MallocBench/gs/gs: 17.99% (4.1105 => 4.8499, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.44% (1.1048 => 1.7283, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 420.90% (7.1582 => 37.2871, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.28% (3.4629 => 6.4162, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 75.65% (0.6222 => 1.0929, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10278.61% (0.0720 => 7.4726, std.dev.: 0.0014) MultiSource/Applications/SIBsim4/SIBsim4: 3835500.00% (0.0001 => 3.8356, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 11146100.00% (0.0001 => 11.1462, std.dev.: 0.0408) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63500.00% (0.0001 => 0.0636, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486400.00% (0.0001 => 5.4865, std.dev.: 0.0027) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.54% (1.1194 => 10.4501, std.dev.: 0.0417) SingleSource/UnitTests/SignlessTypes/factor: 164.19% (0.0296 => 0.0782, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 149.50% (22.1758 => 55.3279, std.dev.: 0.0109) SingleSource/Benchmarks/Misc/lowercase: 122.27% (0.0256 => 0.0569, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 97.09% (0.0929 => 0.1831, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 87.24% (0.0243 => 0.0455, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 70.81% (0.1463 => 0.2499, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 67.53% (0.0271 => 0.0454, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 65.34% (0.0730 => 0.1207, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 60.41% (0.0394 => 0.0632, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6159, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 53.68% (0.0231 => 0.0355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 52.70% (7.0540 => 10.7718, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.47% (1.5859 => 2.4022, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/distray/distray: 48.48% (0.1056 => 0.1568, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 47.84% (0.0232 => 0.0343, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 46.91% (8.1363 => 11.9530, std.dev.: 0.0146) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 43.51% (0.0439 => 0.0630, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 41.70% (2.2024 => 3.1208, std.dev.: 0.0084) MultiSource/Applications/sgefa/sgefa: 39.40% (0.3109 => 0.4334, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 38.48% (0.1432 => 0.1983, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 37.75% (21.9371 => 30.2177, std.dev.: 0.0065) SingleSource/UnitTests/vla: 37.46% (0.0355 => 0.0488, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 37.19% (0.1062 => 0.1457, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.86% (4.2646 => 5.6659, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.31% (0.4615 => 0.6106, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 32.06% (0.0814 => 0.1075, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.99% (1.5415 => 2.0346, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 30.30% (0.2271 => 0.2959, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 29.26% (0.4299 => 0.5557, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 29.23% (1.1642 => 1.5045, std.dev.: 0.0090) MultiSource/Benchmarks/NPB-serial/is/is: 27.96% (0.0719 => 0.0920, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Oscar: 27.67% (0.0636 => 0.0812, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.58% (0.5105 => 0.6513, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 27.56% (0.0479 => 0.0611, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.09% (0.6675 => 0.8483, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.73% (0.0793 => 0.1005, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 26.53% (0.1655 => 0.2094, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.52% (0.1584 => 0.2004, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 26.37% (0.1892 => 0.2391, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 26.13% (0.1125 => 0.1419, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 25.87% (0.0746 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 25.84% (9.4845 => 11.9355, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.80% (3.8922 => 4.8964, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 25.60% (0.0457 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 25.45% (0.2554 => 0.3204, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.28% (0.1143 => 0.1432, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.72% (0.1695 => 0.2114, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 24.53% (0.4289 => 0.5341, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 24.33% (0.1566 => 0.1947, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.19% (0.1906 => 0.2367, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 24.17% (1.0722 => 1.3314, std.dev.: 0.0106) MultiSource/Benchmarks/SciMark2-C/scimark2: 24.09% (0.3121 => 0.3873, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 24.00% (0.1175 => 0.1457, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.77% (1.4186 => 1.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 23.61% (0.4620 => 0.5711, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 23.56% (0.1337 => 0.1652, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 23.42% (0.0730 => 0.0901, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 22.97% (0.6456 => 0.7939, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 22.53% (0.7115 => 0.8718, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 22.17% (0.0672 => 0.0821, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.78% (0.2700 => 0.3288, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 21.74% (0.1555 => 0.1893, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 21.63% (0.0527 => 0.0641, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 21.52% (0.0660 => 0.0802, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 21.30% (0.0662 => 0.0803, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.12% (0.1236 => 0.1497, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 21.09% (0.1029 => 0.1246, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 21.09% (0.0626 => 0.0758, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 20.95% (0.3098 => 0.3747, std.dev.: 0.0085) MultiSource/Applications/spiff/spiff: 20.79% (0.7835 => 0.9464, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 20.78% (0.0842 => 0.1017, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 20.74% (0.0675 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.59% (1.3050 => 1.5737, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 20.38% (0.1163 => 0.1400) MultiSource/Applications/oggenc/oggenc: 20.17% (5.7591 => 6.9206, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/em3d/em3d: 20.06% (0.1695 => 0.2035, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 19.96% (0.1032 => 0.1238, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.94% (0.0953 => 0.1143, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 19.91% (0.8172 => 0.9799, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 19.81% (0.1151 => 0.1379, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.66% (0.5860 => 0.7012, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 19.63% (0.0871 => 0.1042, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 19.54% (0.0614 => 0.0734, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.50% (4.9449 => 5.9093, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/ft/ft: 19.28% (0.1940 => 0.2314, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 18.96% (0.0886 => 0.1054, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 18.81% (0.3307 => 0.3929, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 18.71% (0.5020 => 0.5959, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.55% (5.0018 => 5.9296, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: 18.38% (3.3354 => 3.9485, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 18.36% (0.0648 => 0.0767, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.24% (0.2758 => 0.3261, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 18.05% (0.0770 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 17.99% (0.0567 => 0.0669, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 17.98% (0.1268 => 0.1496, std.dev.: 0.0000) MultiSource/Applications/lambda-0_1_3/lambda: 17.93% (0.7433 => 0.8766, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.76% (0.5569 => 0.6558, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 17.75% (0.0834 => 0.0982, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 17.66% (0.0770 => 0.0906, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 17.64% (0.1117 => 0.1314, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 17.63% (0.9765 => 1.1487, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 17.62% (1.1840 => 1.3926, std.dev.: 0.0107) MultiSource/Benchmarks/Ptrdist/ks/ks: 17.42% (0.1510 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.37% (0.2107 => 0.2473, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 17.24% (3.8723 => 4.5398, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/18-imp/imp: 17.15% (0.3423 => 0.4010, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.11% (2.0273 => 2.3741, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.01% (1.1861 => 1.3879) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.99% (0.4203 => 0.4917, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 16.99% (0.5981 => 0.6997, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 16.95% (0.2065 => 0.2415, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 16.75% (0.3283 => 0.3833, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.51% (0.0933 => 0.1087, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.46% (0.3232 => 0.3764, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 16.34% (2.2969 => 2.6722, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.33% (0.3441 => 0.4003, std.dev.: 0.0075) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 16.26% (0.8101 => 0.9418, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ReedSolomon: 16.25% (0.2049 => 0.2382, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.00% (0.1044 => 0.1211, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.74% (0.6450 => 0.7465, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 15.35% (0.3180 => 0.3668, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 14.95% (0.3379 => 0.3884, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 14.91% (0.0818 => 0.0940, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 14.86% (0.1144 => 0.1314, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 14.80% (0.8921 => 1.0241, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 14.63% (0.0704 => 0.0807, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.23% (0.8067 => 0.9215, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/bmm/bmm: 14.23% (0.0759 => 0.0867, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.20% (0.0838 => 0.0957, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.15% (0.3865 => 0.4412, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 13.98% (0.2603 => 0.2967, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.40% (0.4636 => 0.5257, std.dev.: 0.0020) SingleSource/Regression/C++/ofstream_ctor: 13.29% (0.2905 => 0.3291, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 12.93% (0.3387 => 0.3825, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.75% (0.4103 => 0.4626, std.dev.: 0.0054) MultiSource/Applications/hbd/hbd: 12.73% (1.5603 => 1.7589, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/moments: 12.18% (0.4048 => 0.4541, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 12.07% (0.3603 => 0.4038, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 12.07% (0.3422 => 0.3835, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.89% (0.2430 => 0.2719, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 11.88% (0.3282 => 0.3672, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 11.83% (0.3684 => 0.4120, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 11.75% (17.1811 => 19.1991, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/Large/ray: 11.20% (0.4064 => 0.4519, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 11.16% (0.3092 => 0.3437, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.08% (0.3826 => 0.4250, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 10.71% (0.3427 => 0.3794, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/parameter-passing: 10.64% (0.3927 => 0.4345, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 10.27% (0.3886 => 0.4285, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 10.10% (0.2871 => 0.3161, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.07% (14.3668 => 15.8135, std.dev.: 0.0155) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.78% (0.1114 => 0.1223, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 9.61% (0.3828 => 0.4196, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.52% (0.2877 => 0.3151, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.45% (2.0665 => 2.2617, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.33% (0.2756 => 0.3013, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 9.31% (0.1268 => 0.1386, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 9.13% (0.3473 => 0.3790, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.12% (0.3497 => 0.3816, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/for-in: 9.07% (0.3694 => 0.4029, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.06% (0.3543 => 0.3864, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 9.04% (0.3561 => 0.3883, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.02% (0.2793 => 0.3045, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 9.02% (0.3516 => 0.3833, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.01% (0.3162 => 0.3447, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.00% (0.3543 => 0.3862, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/fibo: 8.99% (0.2725 => 0.2970, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 8.94% (1.2842 => 1.3990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.86% (0.2891 => 0.3147, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 8.84% (0.2714 => 0.2954, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.79% (0.3650 => 0.3971, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 8.66% (63.2438 => 68.7224, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/random: 8.60% (0.2802 => 0.3043, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.49% (0.3935 => 0.4269, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 8.49% (0.3052 => 0.3311, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.43% (0.2872 => 0.3114, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.00% (0.3136 => 0.3387, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 7.86% (0.7326 => 0.7902, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: 7.86% (0.6030 => 0.6504, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.85% (2.2022 => 2.3750, std.dev.: 0.0025) SingleSource/UnitTests/ObjC++/Hello: 7.54% (0.5925 => 0.6372, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.52% (0.4879 => 0.5197, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.98% (0.3177 => 0.3367, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 4.02% (0.3131 => 0.3257, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.94% (10.3673 => 10.7754, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.07% (7.9617 => 8.1265, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.90% (32.5116 => 59.4645, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 13.02% (0.5413 => 0.6118, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.04% (4.2280 => 4.4411, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1578 => 3.3098, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.28% (0.9957 => 1.0284, std.dev.: 0.0106) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.78% (8.6802 => 8.9212, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.04% (3.6395 => 3.7137, std.dev.: 0.0085) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2813, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0052) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2400, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.21% (10.3460 => 10.4717, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.48% (6.6874 => 0.1683, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.87% (5.2763 => 1.1674, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -74.90% (0.8651 => 0.2171, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -43.65% (0.1622 => 0.0914, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.44% (5.3855 => 4.4464, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.79% (5.3526 => 4.4540, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: -13.70% (10.4361 => 9.0067, std.dev.: 0.0133) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.88% (1.7609 => 1.6221, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0241, std.dev.: 0.0327) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.26% (1.9577 => 0.6801, std.dev.: 0.0044) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0499 => 5.3095, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -33.44% (1.1492 => 0.7649, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.54% (10.7105 => 7.4392, std.dev.: 0.0218) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8580, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0081, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0907, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-6: -15.94% (1.6925 => 1.4227, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7326, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.93% (0.9540 => 0.8402, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4914, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7042, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.87% (19.9488 => 18.5792, std.dev.: 0.0128) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.61% (1.2373 => 1.1555, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.03% (1.6805 => 1.5791, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (8.1563 => 7.6951, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.95% (0.8614 => 0.8188, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.88% (1.5835 => 1.5062, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.74% (0.4808 => 0.4580, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/salsa20: -4.64% (10.2830 => 9.8056, std.dev.: 0.0235) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0021) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.6994 => 3.6248, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.43% (3.7221 => 3.6687, std.dev.: 0.0135) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5884, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2267, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0024) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0000) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 18:04:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 20:04:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128020437.A3F6E2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8022?compare_to=8018&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8022, Order: 173640, Start Time: 2013-01-28 00:31:06, End Time: 2013-01-28 02:04:56 To: 8018, Order: 173632, Start Time: 2013-01-27 22:33:45, End Time: 2013-01-28 00:07:42 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 69.51% (0.0974 => 0.1651, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.09% (0.6395 => 0.8831, std.dev.: 0.0151) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.43% (0.6260 => 0.8290, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.33% (0.5805 => 0.7682, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.26% (0.5567 => 0.7363, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.02% (0.5849 => 0.7722, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.88% (0.5581 => 0.7360, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 31.85% (0.6395 => 0.8432, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.70% (0.5575 => 0.7342, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.90% (0.5941 => 0.7777, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.19% (0.5859 => 0.7628, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.15% (0.6033 => 0.7852, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.03% (1.6474 => 2.1256, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.02% (0.6189 => 0.7985, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.55% (0.6676 => 0.8582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.95% (0.6304 => 0.8066, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 27.67% (0.6230 => 0.7954, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.08% (0.5802 => 0.7373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.80% (0.6660 => 0.8445, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.60% (0.5925 => 0.7501, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 26.45% (0.5705 => 0.7214, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.43% (0.5857 => 0.7405, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.02% (0.5569 => 0.7018, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.81% (0.5478 => 0.6892, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.75% (0.5570 => 0.7004, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.31% (0.5591 => 0.7006, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 24.25% (0.5863 => 0.7285, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.24% (0.6052 => 0.7519, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.15% (0.7524 => 0.9341, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.97% (0.6446 => 0.7991, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 23.36% (0.6681 => 0.8242, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 23.09% (0.6297 => 0.7751, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.05% (0.6194 => 0.7622, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.95% (2.2587 => 2.7545, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 21.60% (0.6667 => 0.8107, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.11% (0.7339 => 0.8815, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 15.58% (0.3357 => 0.3880, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.03% (1.1450 => 1.3171, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.08% (0.0864 => 0.0977, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.55% (4.5069 => 5.0724, std.dev.: 0.0048) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.27% (0.4916 => 0.5519, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.70% (3.5339 => 3.9474, std.dev.: 0.0014) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.63% (0.1230 => 0.1373, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.59% (1.6364 => 1.8261, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 10.90% (0.1982 => 0.2198, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: 10.35% (0.3834 => 0.4231, std.dev.: 0.0088) MultiSource/Benchmarks/mafft/pairlocalalign: 9.88% (9.2283 => 10.1405, std.dev.: 0.0053) MultiSource/Applications/Burg/burg: 8.52% (1.2515 => 1.3581, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.26% (0.1731 => 0.1874, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.13% (0.5329 => 0.5762, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 7.91% (0.4524 => 0.4882, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.52% (0.7021 => 0.7549, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.38% (1.4642 => 1.5723, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: 7.30% (0.4861 => 0.5216, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.11% (1.2784 => 1.3693, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.1879 => 0.2000, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.3255 => 0.3447, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 5.75% (0.6750 => 0.7138, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.3319 => 0.3491, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.25% (5.4682 => 5.7006, std.dev.: 0.0035) MultiSource/Applications/oggenc/oggenc: 3.51% (5.0226 => 5.1987, std.dev.: 0.0042) MultiSource/Applications/SIBsim4/SIBsim4: 3.09% (1.3864 => 1.4292, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 3.02% (0.3446 => 0.3550, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 2.65% (0.8418 => 0.8641, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.55% (0.4427 => 0.4540, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 2.54% (0.7447 => 0.7636, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.38% (0.9557 => 0.9784, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.16% (22.4056 => 22.8886, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.05% (0.5168 => 0.5274, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 2.00% (15.5079 => 15.8181, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.92% (1.3722 => 1.3986, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.04% (18.2933 => 18.4832, std.dev.: 0.0300) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7888, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0052) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5091, std.dev.: 0.2049) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.92% (2.0478 => 2.1076, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3819, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6070, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.61% (18.2231 => 18.5173, std.dev.: 0.0134) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2699, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3489 => 10.4563, std.dev.: 0.0076) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.32% (0.7198 => 0.6815, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.98% (0.3812 => 0.3622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.83% (0.3831 => 0.3646, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.81% (0.3848 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.73% (0.3891 => 0.3707, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.71% (0.4033 => 0.3843, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.65% (0.3896 => 0.3715, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.50% (0.4176 => 0.3988, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.94% (2.4924 => 2.3941, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.94% (0.3837 => 0.3686, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.83% (0.4199 => 0.4038, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.48% (0.4280 => 0.4131, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.46% (0.3323 => 0.3208, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.19% (0.9852 => 0.9538, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.83% (2.1713 => 2.1099, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -2.76% (1.3148 => 1.2785, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.74% (0.6347 => 0.6173, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.53% (0.6484 => 0.6320, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -2.41% (0.6441 => 0.6286, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.17% (20.7746 => 20.3234, std.dev.: 0.0267) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.13% (14.2083 => 13.9052, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.12% (0.9542 => 0.9340, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.07% (0.7779 => 0.7618, std.dev.: 0.0059) MultiSource/Applications/sqlite3/sqlite3: -1.59% (17.1032 => 16.8307, std.dev.: 0.0181) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.49% (6.7716 => 6.6707, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.29% (1.0544 => 1.0408, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.25% (16.1920 => 15.9904, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.23% (1.2221 => 1.2071, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.14% (1.2210 => 1.2071, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -1.02% (1.5610 => 1.5450, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.39% (1.8100 => 0.6808, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3114, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0237, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.31% (0.2274 => 0.1744, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0871, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1976, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7267, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3339, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.69% (7.9763 => 7.7614, std.dev.: 0.0162) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.11% (3.7241 => 3.6455, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1736, std.dev.: 0.0289) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.62% (6.5735 => 6.4670, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.39% (1.6086 => 1.5863, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.25% (1.6307 => 1.6103, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6033, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.08% (4.8776 => 4.8250, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.15s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 19:34:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 21:34:44 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128033444.625C52A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8023?compare_to=8019&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8023, Order: 173643, Start Time: 2013-01-28 01:28:46, End Time: 2013-01-28 03:35:04 To: 8019, Order: 173634, Start Time: 2013-01-27 23:02:51, End Time: 2013-01-28 01:08:17 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 16 (85 on baseline) Performance Improvements: 6 (60 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1042 (918 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 59.23% (0.0439 => 0.0699, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.82% (6.1264 => 6.3604, std.dev.: 0.0544) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.00% (4.3247 => 4.4544, std.dev.: 0.0328) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 46.55% (3.1224 => 4.5759, std.dev.: 0.1403) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.29% (1.4583 => 1.8709, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.34% (1.4686 => 1.8701, std.dev.: 0.0939) SingleSource/Benchmarks/Shootout/ary3: 24.09% (10.9628 => 13.6039, std.dev.: 0.2056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.93% (4.6876 => 5.7154, std.dev.: 0.1964) SingleSource/Benchmarks/Shootout-C++/ary3: 15.88% (1.5256 => 1.7679, std.dev.: 0.0423) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.69% (4.1103 => 4.7140, std.dev.: 0.2139) SingleSource/Regression/C/uint64_to_float: 5.64% (1.7832 => 1.8838, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/matrix: 4.68% (6.8906 => 7.2132, std.dev.: 0.0322) SingleSource/Benchmarks/Dhrystone/fldry: 3.47% (0.6600 => 0.6829, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 2.96% (2.3689 => 2.4391, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.62% (4.2119 => 4.3224, std.dev.: 0.0418) MultiSource/Benchmarks/BitBench/five11/five11: 1.77% (5.6590 => 5.7590, std.dev.: 0.0371) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -12.08% (0.0927 => 0.0815, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -10.23% (0.1095 => 0.0983, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.69% (2.8069 => 2.6753, std.dev.: 0.0510) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: -3.68% (2.4904 => 2.3987, std.dev.: 0.0312) MultiSource/Benchmarks/Olden/em3d/em3d: -1.54% (4.9690 => 4.8927, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.43% (2.7655 => 2.7260, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.21% (1.2199 => 1.2346, std.dev.: 0.2124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.88% (0.0227 => 0.0225, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.62% (0.0433 => 0.0440, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0341 => 0.0341, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.40% (0.0321 => 0.0278, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.08% (0.0432 => 0.0441, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/casts: 25.48% (0.0208 => 0.0261, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0222 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.62% (0.0232 => 0.0252, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -25.00% (0.0016 => 0.0012, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1473 => 0.1481, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 5.75% (1.1417 => 1.2073, std.dev.: 0.4420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.14% (0.3929 => 0.4013, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.42% (0.1527 => 0.1490, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.35% (0.0620 => 0.0647, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.61% (0.0603 => 0.0533, std.dev.: 0.0031) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.31% (1.2844 => 1.2884, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 76.47% (0.0017 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.96% (0.0612 => 0.0600, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.43% (0.0373 => 0.0349, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.48% (1.7671 => 1.7586, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -50.00% (0.0114 => 0.0057, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.46% (33.9766 => 34.4740, std.dev.: 0.0327) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.00% (0.0336 => 0.1680, std.dev.: 0.0019) SingleSource/Regression/C/sumarraymalloc: 116.72% (0.0293 => 0.0635, std.dev.: 0.0015) SingleSource/Regression/C/sumarray2d: 91.61% (0.0274 => 0.0525, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/heapsort: 61.06% (0.0434 => 0.0699, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/neural/neural: 58.00% (0.1638 => 0.2588, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.74% (0.8893 => 1.2605, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.46% (0.9120 => 1.2901, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.40% (0.8926 => 1.2621, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.90% (0.9061 => 1.2767, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.58% (0.9612 => 1.3513, std.dev.: 0.0970) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.78% (0.9588 => 1.3402, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.65% (0.9381 => 1.3101, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.64% (0.9564 => 1.3355, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.19% (0.8990 => 1.2513, std.dev.: 0.0819) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.86% (0.9091 => 1.2624, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.33% (0.9855 => 1.3632, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.82% (0.9998 => 1.3779, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.82% (0.9422 => 1.2985, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.46% (0.9403 => 1.2925, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.87% (0.9512 => 1.3019, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.79% (0.9010 => 1.2325, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.08% (0.8736 => 1.1888, std.dev.: 0.0717) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.90% (0.8912 => 1.2111, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.83% (1.0119 => 1.3745, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.36% (1.0867 => 1.4710, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.72% (1.0052 => 1.3542, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.36% (0.8732 => 1.1732, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.03% (0.8846 => 1.1856, std.dev.: 0.0292) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.05% (0.9867 => 1.3128, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.44% (1.0017 => 1.3267, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.02% (0.9788 => 1.2922, std.dev.: 0.0933) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.00% (0.9507 => 1.2549, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.40% (0.9488 => 1.2467, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.58% (0.9685 => 1.2647, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.50% (1.0088 => 1.3165, std.dev.: 0.1039) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.28% (0.9127 => 1.1891, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.64% (0.9405 => 1.2193, std.dev.: 0.0629) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.53% (0.9993 => 1.2944, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.40% (0.9550 => 1.2262, std.dev.: 0.0241) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.80% (1.0860 => 1.3770, std.dev.: 0.0914) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 22.73% (3.6295 => 4.4544, std.dev.: 0.0328) SingleSource/Benchmarks/Shootout-C++/matrix: 17.15% (0.2385 => 0.2794, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.03% (1.0986 => 1.2637, std.dev.: 0.0569) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.33% (0.0963 => 0.1101, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 13.61% (0.1955 => 0.2221, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.36% (0.1332 => 0.1510, std.dev.: 0.0042) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.18% (0.4596 => 0.5156, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.52% (0.2577 => 0.2848, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/chomp: 10.49% (0.1793 => 0.1981, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.21% (1.8127 => 1.9797, std.dev.: 0.0315) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.11% (2.4519 => 2.6753, std.dev.: 0.0510) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.51% (0.2879 => 0.3124, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107125.00% (0.0008 => 0.8578, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: 509.93% (2.2304 => 13.6039, std.dev.: 0.2056) SingleSource/Benchmarks/Shootout/matrix: 355.81% (1.5825 => 7.2132, std.dev.: 0.0322) MultiSource/Applications/sgefa/sgefa: 259.00% (0.3515 => 1.2619, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.14% (1.1825 => 4.0576, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.32% (4.8185 => 15.7237, std.dev.: 0.1880) SingleSource/Benchmarks/Shootout-C++/ary2: 200.00% (0.0129 => 0.0387, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 189.04% (0.0228 => 0.0659, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/ary: 146.55% (0.0232 => 0.0572, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/matrix: 63.91% (2.9083 => 4.7671, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.41% (0.2562 => 0.3418, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.69% (3.1254 => 4.1158, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 30.79% (1.4588 => 1.9080, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.48% (5.6033 => 7.0871, std.dev.: 0.3854) SingleSource/Regression/C/uint64_to_float: 22.35% (1.5397 => 1.8838, std.dev.: 0.0191) SingleSource/Benchmarks/Misc/salsa20: 22.05% (7.4497 => 9.0924, std.dev.: 0.0176) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.56% (4.8112 => 5.8003, std.dev.: 0.0143) MultiSource/Applications/JM/lencod/lencod: 13.77% (6.8159 => 7.7547, std.dev.: 0.0729) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.35% (5.0421 => 5.7154, std.dev.: 0.1964) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8563, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.17% (5.0033 => 5.6121, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.17% (3.7074 => 4.1585, std.dev.: 0.1362) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.87% (3.6477 => 3.9712, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/ReedSolomon: 8.56% (8.6447 => 9.3844, std.dev.: 0.1963) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.99% (4.7473 => 5.0791, std.dev.: 0.0263) SingleSource/Benchmarks/McGill/chomp: 6.82% (1.0425 => 1.1136, std.dev.: 0.0165) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.33% (0.6211 => 0.6542, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (4.1836 => 4.4059, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.96% (5.0310 => 5.2304, std.dev.: 0.0215) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.73% (4.1668 => 4.3224, std.dev.: 0.0418) SingleSource/Benchmarks/Linpack/linpack-pc: 3.67% (50.8945 => 52.7621, std.dev.: 0.2266) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.24% (4.7254 => 4.8783, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.86% (6.4534 => 6.5734, std.dev.: 0.0169) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.91% (0.0727 => 0.0495, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: -26.88% (0.0692 => 0.0506, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: -17.54% (1.8964 => 1.5637, std.dev.: 0.0735) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.40% (0.1684 => 0.1391, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -17.33% (0.1079 => 0.0892, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.65% (0.1009 => 0.0841, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.20% (1.0960 => 0.9185, std.dev.: 0.0276) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.14% (0.7686 => 0.6522, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.22% (0.7693 => 0.6984, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.09% (10.2703 => 9.5425, std.dev.: 0.0819) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.08% (0.3560 => 0.3308, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: -6.25% (0.8653 => 0.8112, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/hash: -5.59% (0.4689 => 0.4427, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.32% (0.9124 => 0.8639, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -4.82% (0.5746 => 0.5469, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.38% (0.2283 => 0.2183, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.17% (1.6874 => 1.6170, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.83% (1.5131 => 1.4552, std.dev.: 0.0134) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.03% (1.3924 => 1.3502, std.dev.: 0.0094) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.81% (11.5523 => 3.9495, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/fp-convert: -61.76% (15.6525 => 5.9848, std.dev.: 0.1322) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.90% (0.4146 => 0.1787, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.49% (0.4578 => 0.2358, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.94% (11.3868 => 6.3832, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.87% (5.4023 => 3.6264, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.04% (0.4452 => 0.3070, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/bisort/bisort: -29.78% (0.9372 => 0.6581, std.dev.: 0.0723) MultiSource/Benchmarks/Ptrdist/ft/ft: -29.58% (1.0816 => 0.7617, std.dev.: 0.1025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.84% (0.5495 => 0.4020, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8823, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.25% (4.4467 => 3.3239, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.63% (0.5826 => 0.4391, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8225, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -20.03% (0.5897 => 0.4716, std.dev.: 0.0314) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.12% (16.6791 => 13.4908, std.dev.: 0.4047) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.45% (5.8755 => 4.7912, std.dev.: 0.0526) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.44% (7.0016 => 5.9904, std.dev.: 0.0930) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.48% (3.1921 => 2.7618, std.dev.: 0.0515) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6752, std.dev.: 0.0643) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.51% (9.7992 => 8.5730, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9946, std.dev.: 0.0181) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.19% (0.4081 => 0.3665, std.dev.: 0.0122) MultiSource/Applications/SIBsim4/SIBsim4: -7.97% (3.5443 => 3.2619, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2283, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2484, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/health/health: -6.16% (0.3654 => 0.3429, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: -5.36% (63.1520 => 59.7692, std.dev.: 0.1158) SingleSource/Benchmarks/McGill/queens: -5.21% (1.7443 => 1.6534, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.76% (4.9799 => 4.7429, std.dev.: 0.0886) SingleSource/Benchmarks/Shootout-C++/hash2: -4.76% (3.6768 => 3.5019, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.5127 => 3.3588, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.74% (3.5691 => 3.4356, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (5.8973 => 5.6822, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/lists: -2.72% (17.2182 => 16.7499, std.dev.: 0.0870) MultiSource/Applications/sqlite3/sqlite3: -2.35% (4.4730 => 4.3678, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5768, std.dev.: 0.0367) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8599, std.dev.: 0.0780) SingleSource/Benchmarks/Misc/mandel-2: -1.36% (0.8521 => 0.8405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (6.8262 => 6.7463, std.dev.: 0.0113) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.05% (3.7450 => 3.7056, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.48% (1.2047 => 1.2346, std.dev.: 0.2124) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.44% (0.0451 => 0.0440, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.24% (0.0328 => 0.0278, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.90% (0.0445 => 0.0441, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/casts: 22.54% (0.0213 => 0.0261, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/test1: -1.32% (0.0227 => 0.0224, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -20.00% (0.0015 => 0.0012, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.20% (0.1530 => 0.1481, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: -37.42% (1.9293 => 1.2073, std.dev.: 0.4420) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.89% (0.4049 => 0.4013, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.32% (0.1510 => 0.1490, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.84% (0.0978 => 0.0647, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0276 => 0.0274, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.66% (0.0590 => 0.0533, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.91% (1.1617 => 1.2884, std.dev.: 0.0096) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.22% (0.0268 => 0.0349, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.47% (0.7437 => 1.7586, std.dev.: 0.0063) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -38.04% (0.0092 => 0.0057, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.79% (12.7781 => 34.4740, std.dev.: 0.0327) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 20:05:01 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 22:05:01 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128040501.B75722A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8024?compare_to=8022&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8024, Order: 173648, Start Time: 2013-01-28 02:28:36, End Time: 2013-01-28 04:05:20 To: 8022, Order: 173640, Start Time: 2013-01-28 00:31:06, End Time: 2013-01-28 02:04:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 188 (224 on baseline) Performance Improvements: 1 (69 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 915 (799 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: 53.02% (0.0364 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 51.78% (22.8886 => 34.7396, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/objinst: 42.62% (0.0420 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 34.83% (0.2670 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: 28.15% (0.0604 => 0.0774, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 26.75% (0.0658 => 0.0834, std.dev.: 0.0001) SingleSource/Benchmarks/SmallPT/smallpt: 26.08% (0.1292 => 0.1629, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 24.35% (0.1840 => 0.2288, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 23.55% (5.7006 => 7.0431, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 22.68% (0.0904 => 0.1109, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 22.14% (0.3437 => 0.4198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 21.94% (0.0761 => 0.0928, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 21.50% (16.8307 => 20.4493, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 21.15% (2.4000 => 2.9077, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 21.14% (15.8181 => 19.1620, std.dev.: 0.0146) SingleSource/UnitTests/2006-12-11-LoadConstants: 21.12% (0.1373 => 0.1663) MultiSource/Benchmarks/Olden/bh/bh: 20.17% (0.2980 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 19.51% (1.3693 => 1.6365, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 18.32% (0.0584 => 0.0691) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 18.08% (0.7549 => 0.8914, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.97% (0.2537 => 0.2993, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.88% (1.8261 => 2.1526, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.72% (0.3573 => 0.4206, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 17.61% (0.7636 => 0.8981, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 17.49% (1.3171 => 1.5475, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 17.19% (34.0787 => 39.9375, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.15% (0.1073 => 0.1257, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 16.98% (4.0590 => 4.7484, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: 16.88% (2.1526 => 2.5160, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 16.70% (0.1611 => 0.1880, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 16.69% (1.3581 => 1.5848, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.97% (3.9474 => 4.5778, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.92% (0.6815 => 0.7900, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.91% (0.6354 => 0.7365, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 15.85% (0.0921 => 0.1067, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.76% (0.1536 => 0.1778, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: 15.55% (1.1594 => 1.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 15.42% (0.3553 => 0.4101, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 15.41% (0.0772 => 0.0891, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 15.07% (1.4292 => 1.6446, std.dev.: 0.0083) MultiSource/Applications/d/make_dparser: 14.85% (3.5455 => 4.0720, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.79% (2.7545 => 3.1620, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.76% (0.5984 => 0.6867, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 14.50% (0.7138 => 0.8173, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.44% (2.1256 => 2.4325, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.40% (0.9784 => 1.1193, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 14.33% (0.0719 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.07% (0.0732 => 0.0835, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.04% (0.1118 => 0.1275, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.96% (0.1125 => 0.1282, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 13.87% (0.3568 => 0.4063, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 13.85% (0.1718 => 0.1956, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 13.42% (0.8641 => 0.9801, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 13.36% (0.0913 => 0.1035, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.07% (1.2422 => 1.4046, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.02% (0.1874 => 0.2118, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 12.88% (15.2253 => 17.1866, std.dev.: 0.0078) MultiSource/Benchmarks/7zip/7zip-benchmark: 12.63% (43.6075 => 49.1130, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 12.58% (0.0819 => 0.0922, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.52% (2.3941 => 2.6939, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 12.49% (18.4832 => 20.7917, std.dev.: 0.0134) MultiSource/Applications/oggenc/oggenc: 12.47% (5.1987 => 5.8469, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.47% (0.2984 => 0.3356, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 12.34% (0.3040 => 0.3415, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 12.03% (0.2261 => 0.2533, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 11.89% (0.1203 => 0.1346, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 11.82% (0.9107 => 1.0183, std.dev.: 0.0039) MultiSource/Applications/hbd/hbd: 11.77% (1.5450 => 1.7269, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 11.68% (0.7822 => 0.8736, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 11.50% (0.1157 => 0.1290, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.49% (0.5762 => 0.6424, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 11.32% (0.0936 => 0.1042, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 11.12% (0.1888 => 0.2098, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.11% (4.0569 => 4.5075, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.81% (0.0981 => 0.1087, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 10.79% (0.7932 => 0.8788, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 10.73% (0.1202 => 0.1331, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.71% (0.1092 => 0.1209, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 10.61% (10.1405 => 11.2161, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.60% (0.2641 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.50% (0.1181 => 0.1305, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.43% (0.0978 => 0.1080, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 10.41% (0.6320 => 0.6978, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/neural/neural: 10.37% (0.2189 => 0.2416, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.20% (0.4051 => 0.4464, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.08% (0.3275 => 0.3605, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 10.06% (0.1620 => 0.1783, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.04% (1.5723 => 1.7301, std.dev.: 0.0095) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.03% (0.6750 => 0.7427, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/mst/mst: 9.86% (0.1278 => 0.1404, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 9.76% (0.1875 => 0.2058, std.dev.: 0.0044) MultiSource/Applications/JM/lencod/lencod: 9.64% (15.9904 => 17.5325, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.42% (5.0724 => 5.5502, std.dev.: 0.0106) MultiSource/Benchmarks/MallocBench/gs/gs: 9.40% (4.2900 => 4.6933, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 9.37% (7.0265 => 7.6849, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.30% (0.9538 => 1.0425, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 9.18% (0.5216 => 0.5695, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.14% (13.9052 => 15.1764, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.08% (1.0408 => 1.1353, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.91% (0.8476 => 0.9231, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.86% (0.4279 => 0.4658, std.dev.: 0.0031) MultiSource/Applications/ALAC/encode/alacconvert-encode: 8.81% (1.1324 => 1.2322, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.65% (0.3779 => 0.4106, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 8.63% (0.3880 => 0.4215, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.62% (0.2135 => 0.2319, std.dev.: 0.0011) MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.51% (1.1317 => 1.2280, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.50% (6.6707 => 7.2376, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.47% (0.1228 => 0.1332, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 8.43% (0.1222 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.42% (0.9050 => 0.9812, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.20% (0.7954 => 0.8606, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.18% (0.8107 => 0.8770, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.16% (0.8432 => 0.9120, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.15% (0.7991 => 0.8642, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.11% (0.8815 => 0.9530, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.06% (0.5274 => 0.5699, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 8.02% (0.1347 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.99% (0.7622 => 0.8231, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.95% (0.4540 => 0.4901, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 7.95% (0.7285 => 0.7864, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.92% (0.8242 => 0.8895, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/04-bisect/bisect: 7.92% (0.1338 => 0.1444, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.89% (1.3986 => 1.5089, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.83% (0.7501 => 0.8088, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.81% (0.4074 => 0.4392, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 7.76% (0.3350 => 0.3610, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.72% (0.8831 => 0.9513, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.71% (0.2633 => 0.2836, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.71% (0.2296 => 0.2473, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.71% (0.7006 => 0.7546, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.70% (7.9889 => 8.6039, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 7.64% (0.9341 => 1.0055, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 7.62% (0.4882 => 0.5254, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.57% (0.8445 => 0.9084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 7.55% (0.7214 => 0.7759, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.55% (0.7373 => 0.7930, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.55% (0.7004 => 0.7533, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.54% (0.8290 => 0.8915, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.51% (4.8924 => 5.2597, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.47% (0.6892 => 0.7407, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.46% (0.7519 => 0.8080, std.dev.: 0.0010) SingleSource/Benchmarks/Linpack/linpack-pc: 7.46% (0.2696 => 0.2897, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 7.42% (0.7018 => 0.7539, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.41% (0.7405 => 0.7954, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.40% (4.8437 => 5.2021, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 7.38% (0.8582 => 0.9215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.37% (0.8346 => 0.8961, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.33% (0.7751 => 0.8319, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.33% (0.8066 => 0.8657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.25% (0.7682 => 0.8239, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.24% (0.7628 => 0.8180, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.23% (0.7722 => 0.8280, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 7.19% (0.3491 => 0.3742, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.18% (0.7777 => 0.8335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.14% (0.7852 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.13% (0.7222 => 0.7737, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.10% (0.7548 => 0.8084, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.09% (0.7985 => 0.8551, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.04% (0.7360 => 0.7878, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 7.03% (0.2118 => 0.2267, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.02% (0.7363 => 0.7880, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.00% (0.7342 => 0.7856, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.98% (1.2071 => 1.2914, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.94% (1.2071 => 1.2909, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.87% (0.2198 => 0.2349, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.72% (0.5519 => 0.5890, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.66% (0.4778 => 0.5096, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.4183 => 0.4458, std.dev.: 0.0003) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.57% (0.5742 => 0.6119, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.46% (0.3686 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.19% (0.2342 => 0.2487, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 5.92% (0.5064 => 0.5364, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 5.85% (0.3746 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.84% (0.3664 => 0.3878, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.80% (0.3864 => 0.4088, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 5.40% (0.3812 => 0.4018, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3447 => 0.3630, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 4.95% (0.3558 => 0.3734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.80% (0.9340 => 0.9788, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 4.54% (1.2785 => 1.3365, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.24% (0.3208 => 0.3344, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3519 => 0.3656, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.61% (0.3550 => 0.3678, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.52% (0.3490 => 0.3613, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 3.42% (0.3162 => 0.3270, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.38% (2.1099 => 2.1602, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.97% (8.5706 => 9.0823, std.dev.: 0.0147) SingleSource/Benchmarks/Dhrystone/fldry: 3.60% (0.6808 => 0.7053, std.dev.: 0.0092) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -9.76% (0.4231 => 0.3818, std.dev.: 0.0115) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.75% (0.0315 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 93.57% (0.0280 => 0.0542, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.80% (0.0717 => 0.1325, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 83.07% (0.0514 => 0.0941, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 74.74% (0.0974 => 0.1702, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 66.08% (0.1132 => 0.1880, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 61.07% (0.1500 => 0.2416, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 55.05% (22.4056 => 34.7396, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.13% (0.0371 => 0.0557, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.76% (0.6395 => 0.9513, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.41% (0.0599 => 0.0889, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.66% (1.6474 => 2.4325, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/objinst: 47.17% (0.0407 => 0.0599, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.61% (0.6395 => 0.9120, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.41% (0.6260 => 0.8915, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.12% (0.5688 => 0.8084, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.93% (0.5805 => 0.8239, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 41.87% (0.0418 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.81% (0.5456 => 0.7737, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.56% (0.5849 => 0.8280, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 41.55% (0.5567 => 0.7880, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.16% (0.5581 => 0.7878, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.91% (0.5575 => 0.7856, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 40.30% (0.5941 => 0.8335, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.99% (2.2587 => 3.1620, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.61% (0.5859 => 0.8180, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.45% (0.6033 => 0.8413, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.34% (0.0699 => 0.0974, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 39.15% (0.6440 => 0.8961, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 38.88% (0.0445 => 0.0618, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 38.16% (0.6189 => 0.8551, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 38.14% (0.6230 => 0.8606, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.03% (0.6676 => 0.9215, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 37.33% (0.6304 => 0.8657, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 36.86% (0.0293 => 0.0401) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.77% (0.0582 => 0.0796, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.68% (0.5802 => 0.7930, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.51% (0.5925 => 0.8088, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.40% (0.6660 => 0.9084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.00% (0.5705 => 0.7759, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.80% (0.5857 => 0.7954, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 35.39% (0.2659 => 0.3600, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.37% (0.5569 => 0.7539, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.24% (0.5570 => 0.7533, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.21% (0.5478 => 0.7407, std.dev.: 0.0061) SingleSource/UnitTests/2006-12-11-LoadConstants: 35.20% (0.1230 => 0.1663) MultiSource/Applications/lemon/lemon: 35.15% (1.1450 => 1.5475, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.97% (0.5591 => 0.7546, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 34.13% (0.5863 => 0.7864, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 34.07% (0.6446 => 0.8642, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.64% (0.7524 => 1.0055, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.51% (0.6052 => 0.8080, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.29% (0.0790 => 0.1053, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.14% (0.6681 => 0.8895, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 32.89% (0.6194 => 0.8231, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.11% (0.6297 => 0.8319, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.83% (0.0622 => 0.0820, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.60% (0.0693 => 0.0912, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 31.54% (1.6364 => 2.1526, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.54% (0.6667 => 0.8770, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.47% (0.0556 => 0.0731, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.85% (0.7339 => 0.9530, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.65% (0.0833 => 0.1080, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.54% (3.5339 => 4.5778, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 29.41% (0.0680 => 0.0880, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 28.80% (5.4682 => 7.0431, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.01% (1.2784 => 1.6365, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.39% (0.1796 => 0.2288, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.96% (0.7021 => 0.8914, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.86% (0.0566 => 0.0718, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 26.63% (1.2515 => 1.5848, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 26.03% (0.0707 => 0.0891, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 26.00% (0.1146 => 0.1444, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: 25.56% (0.3357 => 0.4215, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 25.41% (0.0665 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: 24.64% (0.0621 => 0.0774, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 24.42% (0.0864 => 0.1075, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 23.67% (0.0731 => 0.0904, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 23.56% (15.5079 => 19.1620, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.15% (4.5069 => 5.5502, std.dev.: 0.0106) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 23.03% (0.1081 => 0.1330, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.36% (0.1731 => 0.2118, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 21.54% (9.2283 => 11.2161, std.dev.: 0.0148) SingleSource/Benchmarks/Misc-C++/bigfib: 21.08% (0.6750 => 0.8173, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 21.05% (2.4021 => 2.9077, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 21.02% (0.0571 => 0.0691) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 20.68% (0.0764 => 0.0922, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/distray/distray: 20.67% (0.0919 => 0.1109, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 20.60% (0.7447 => 0.8981, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.56% (0.0885 => 0.1067, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.55% (0.5329 => 0.6424, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 20.53% (0.3483 => 0.4198, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.22% (0.0806 => 0.0969, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 19.97% (0.2985 => 0.3581, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.81% (0.4916 => 0.5890, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 19.77% (0.0526 => 0.0630, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.70% (0.0604 => 0.0723, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 19.56% (17.1032 => 20.4493, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 19.12% (0.0617 => 0.0735, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.91% (0.2385 => 0.2836, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 18.80% (0.4515 => 0.5364, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 18.62% (1.3864 => 1.6446, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.52% (0.1982 => 0.2349, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.16% (1.4642 => 1.7301, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.83% (0.1509 => 0.1778, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.61% (0.0710 => 0.0835, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 17.56% (2.1401 => 2.5160, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 17.47% (0.3491 => 0.4101, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.46% (0.2548 => 0.2993, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 17.16% (0.4861 => 0.5695, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 17.14% (34.0927 => 39.9375, std.dev.: 0.0143) SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.12% (0.9557 => 1.1193, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 17.03% (0.6293 => 0.7365, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 16.97% (4.0594 => 4.7484, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 16.87% (0.1761 => 0.2058, std.dev.: 0.0044) MultiSource/Applications/viterbi/viterbi: 16.85% (0.1674 => 0.1956, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 16.76% (0.0704 => 0.0822, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.71% (0.1077 => 0.1257, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 16.44% (0.0797 => 0.0928, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 16.43% (0.8418 => 0.9801, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 16.41% (5.0226 => 5.8469, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.33% (0.1096 => 0.1275, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 16.19% (1.1530 => 1.3397, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 16.14% (0.4524 => 0.5254, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 15.89% (0.0686 => 0.0795, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.83% (3.5154 => 4.0720, std.dev.: 0.0061) MultiSource/Benchmarks/NPB-serial/is/is: 15.54% (0.0708 => 0.0818, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.25% (0.0741 => 0.0854, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 14.98% (0.3658 => 0.4206, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 14.47% (0.5999 => 0.6867, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 14.20% (1.2300 => 1.4046, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 13.66% (18.2933 => 20.7917, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/18-imp/imp: 13.46% (0.3581 => 0.4063, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.79% (0.1290 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.74% (0.3319 => 0.3742, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 12.68% (15.2527 => 17.1866, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/em3d/em3d: 12.67% (0.1862 => 0.2098, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.62% (0.0919 => 0.1035, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 12.45% (0.1197 => 0.1346, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.36% (0.1076 => 0.1209, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.23% (0.1145 => 0.1285, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.19% (0.2001 => 0.2245, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.90% (0.2999 => 0.3356, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.79% (0.1154 => 0.1290, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.78% (4.0323 => 4.5075, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.60% (0.0974 => 0.1087, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.59% (0.0932 => 0.1040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.52% (0.3255 => 0.3630, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.25% (0.1173 => 0.1305, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 11.19% (0.2278 => 0.2533, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 10.94% (0.9179 => 1.0183, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.74% (0.1108 => 0.1227, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 10.73% (0.1202 => 0.1331, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.71% (0.4427 => 0.4901, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 10.63% (1.5610 => 1.7269, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 10.46% (0.1271 => 0.1404, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.32% (0.7919 => 0.8736, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.27% (0.5168 => 0.5699, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.26% (0.6736 => 0.7427, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/09-vor/vor: 10.21% (0.3271 => 0.3605, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.11% (0.2106 => 0.2319, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 10.10% (0.7982 => 0.8788, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.99% (0.1621 => 0.1783, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.96% (1.3722 => 1.5089, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.75% (0.7198 => 0.7900, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 9.47% (0.1879 => 0.2057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.33% (0.4083 => 0.4464, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.69% (0.3142 => 0.3415, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.39% (0.2695 => 0.2921, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.33% (0.8521 => 0.9231, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 8.32% (4.3330 => 4.6933, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 8.30% (7.0961 => 7.6849, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 8.28% (16.1920 => 17.5325, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.20% (0.1231 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.12% (0.1441 => 0.1558, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.10% (0.9077 => 0.9812, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: 8.08% (2.4924 => 2.6939, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 8.01% (4.8161 => 5.2021, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.80% (0.4321 => 0.4658, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.78% (4.8802 => 5.2597, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.67% (1.0544 => 1.1353, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.62% (0.6484 => 0.6978, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.38% (8.0126 => 8.6039, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.88% (6.7716 => 7.2376, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.81% (14.2083 => 15.1764, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 6.73% (0.3446 => 0.3678, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.68% (0.3849 => 0.4106, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 6.45% (0.3394 => 0.3613, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 5.99% (0.3406 => 0.3610, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.88% (0.4813 => 0.5096, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.82% (0.9852 => 1.0425, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.81% (0.4151 => 0.4392, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.77% (1.2210 => 1.2914, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.63% (1.2221 => 1.2909, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/ary2: 5.03% (0.3481 => 0.3656, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.01% (0.2355 => 0.2473, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 4.95% (0.2160 => 0.2267, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 4.94% (0.4248 => 0.4458, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 4.67% (0.3788 => 0.3965, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.99% (0.3931 => 0.4088, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists1: 3.90% (0.3867 => 0.4018, std.dev.: 0.0047) SingleSource/Regression/C++/ofstream_ctor: 3.53% (0.3059 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 3.12% (0.3621 => 0.3734, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.58% (0.9542 => 0.9788, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 1.65% (1.3148 => 1.3365, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8197, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.79% (0.9531 => 1.0273, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: 7.41% (0.5692 => 0.6114, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.37% (54.5751 => 56.4116, std.dev.: 0.0522) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0086) MultiSource/Benchmarks/mafft/pairlocalalign: 2.01% (27.8210 => 28.3815, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0034) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.45% (18.2231 => 18.4880, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2694, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4555, std.dev.: 0.0195) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.96% (0.3812 => 0.3623, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.45% (0.3884 => 0.3711, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.34% (0.3891 => 0.3722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.29% (0.4033 => 0.3860, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.66% (20.7746 => 20.2220, std.dev.: 0.0538) SingleSource/UnitTests/ObjC/exceptions: -2.56% (0.4176 => 0.4069, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.52% (0.6347 => 0.6187, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -1.61% (0.6441 => 0.6337, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.03% (1.8100 => 0.7053, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.82% (1.3643 => 1.0257, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7567, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0816, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1970, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.87% (5.3397 => 4.1720, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.30% (2.5106 => 2.1264, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/matrix: -13.33% (3.1443 => 2.7252, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3556, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/richards_benchmark: -8.93% (1.2842 => 1.1695, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.24% (1.7753 => 1.7001, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7653, std.dev.: 0.0114) SingleSource/Benchmarks/Shootout/ary3: -2.41% (3.7241 => 3.6343, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1719, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4746, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.26s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 20:25:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 22:25:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128042506.C8AF42A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8025?compare_to=8021&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8025, Order: 173645, Start Time: 2013-01-28 02:06:17, End Time: 2013-01-28 04:25:24 To: 8021, Order: 173636, Start Time: 2013-01-27 23:25:01, End Time: 2013-01-28 01:35:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 227 (272 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 872 (600 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 252.43% (37.2871 => 131.4115, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/flops: 100.71% (0.1983 => 0.3980, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/objinst: 80.70% (0.0487 => 0.0880, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 59.63% (0.1568 => 0.2503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 59.40% (0.0973 => 0.1551, std.dev.: 0.0001) SingleSource/Regression/C/casts: 58.86% (0.0367 => 0.0583, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 54.71% (0.0276 => 0.0427, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 53.76% (0.0439 => 0.0675, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 42.68% (0.0239 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 41.64% (0.3204 => 0.4538, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 31.61% (10.7718 => 14.1769, std.dev.: 0.0108) SingleSource/Regression/C++/EH/function_try_block: 30.86% (0.0337 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 29.99% (0.0837 => 0.1088) SingleSource/Benchmarks/SmallPT/smallpt: 29.75% (0.1714 => 0.2224, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 28.59% (0.0717 => 0.0922, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 28.26% (0.0637 => 0.0817, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.99% (0.1683 => 0.2154, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 27.47% (0.1143 => 0.1457, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.89% (0.1432 => 0.1817, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 26.77% (0.3437 => 0.4357, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.69% (0.5197 => 0.6532, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 25.53% (0.0940 => 0.1180, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 25.40% (68.7224 => 86.1770, std.dev.: 0.0209) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 24.40% (0.1947 => 0.2422, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.09% (0.3794 => 0.4670, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.85% (6.4162 => 7.8820, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.70% (0.0630 => 0.0773, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 22.17% (0.0812 => 0.0992, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 22.07% (0.2352 => 0.2871, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 21.95% (2.6722 => 3.2588, std.dev.: 0.0047) MultiSource/Applications/sqlite3/sqlite3: 21.81% (19.1991 => 23.3870, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.56% (0.3288 => 0.3997, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.31% (0.0549 => 0.0666, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.11% (1.7283 => 2.0931, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 20.68% (0.0556 => 0.0671, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 20.55% (18.0086 => 21.7094, std.dev.: 0.0106) MultiSource/Benchmarks/McCat/15-trie/trie: 19.81% (0.0641 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 19.33% (0.3367 => 0.4018, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 18.44% (0.8718 => 1.0326, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.34% (2.0346 => 2.4077, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.31% (0.4003 => 0.4736, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 18.24% (1.3314 => 1.5742, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 18.09% (1.5045 => 1.7766, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.08% (0.1211 => 0.1430, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.84% (0.8483 => 0.9996, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.76% (0.1419 => 0.1671, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 17.74% (4.5398 => 5.3452, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.72% (4.8964 => 5.7641, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 17.68% (2.3741 => 2.7938, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 17.60% (0.0574 => 0.0675, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 17.50% (0.1509 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 17.41% (0.1005 => 0.1180, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 17.34% (1.6420 => 1.9268, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 16.69% (0.0803 => 0.0937, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.65% (0.1724 => 0.2011, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 16.47% (0.0868 => 0.1011, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.31% (0.7012 => 0.8156, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 16.28% (0.0909 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 16.18% (0.3825 => 0.4444, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 16.06% (1.3926 => 1.6162, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 15.87% (0.6558 => 0.7599, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.86% (0.1362 => 0.1578, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 15.82% (0.1087 => 0.1259, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 15.60% (3.9485 => 4.5644, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 15.58% (0.1207 => 0.1395, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.50% (2.4022 => 2.7745, std.dev.: 0.0055) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.50% (3.1208 => 3.6044, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 15.39% (0.4010 => 0.4627, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.11% (0.1238 => 0.1425, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 14.92% (0.0677 => 0.0778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.91% (0.3929 => 0.4515, std.dev.: 0.0035) MultiSource/Applications/viterbi/viterbi: 14.84% (0.1893 => 0.2174, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 14.74% (0.0821 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 14.71% (0.1496 => 0.1716, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 14.43% (0.0901 => 0.1031, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 14.22% (0.0914 => 0.1044, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.21% (1.0929 => 1.2482, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 14.07% (0.0803 => 0.0916, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 14.04% (0.7939 => 0.9054, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.90% (1.3879 => 1.5808, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.86% (0.3261 => 0.3713, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 13.84% (6.9206 => 7.8785, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.74% (0.0815 => 0.0927) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 13.57% (0.0877 => 0.0996, std.dev.: 0.0004) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.55% (49.4954 => 56.2036, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.51% (0.2473 => 0.2807, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.30% (0.9215 => 1.0441, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 13.29% (0.9464 => 1.0722, std.dev.: 0.0022) MultiSource/Applications/hbd/hbd: 13.26% (1.7589 => 1.9921, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/tsp/tsp: 13.18% (0.1457 => 0.1649, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 13.12% (0.2035 => 0.2302, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 13.01% (20.3886 => 23.0408, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 12.64% (0.2967 => 0.3342, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 12.54% (0.3668 => 0.4128, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.34% (0.7465 => 0.8386, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 12.30% (1.0241 => 1.1501, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 12.30% (0.2114 => 0.2374, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 12.25% (0.1314 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 12.03% (0.0906 => 0.1015, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 12.01% (11.9355 => 13.3690, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.98% (0.1519 => 0.1701, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 11.89% (0.1379 => 0.1543, std.dev.: 0.0046) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.76% (0.1054 => 0.1178, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 11.70% (0.8766 => 0.9792, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 11.63% (0.6997 => 0.7811, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.63% (0.0886 => 0.0989, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 11.60% (0.0905 => 0.1010, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.44% (0.6513 => 0.7258, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/exptree: 11.35% (0.1075 => 0.1197, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.20% (0.1098 => 0.1221, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 11.10% (0.0937 => 0.1041, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 11.04% (0.2499 => 0.2775, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 11.00% (0.1773 => 0.1968, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.87% (0.1223 => 0.1356, std.dev.: 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: 10.79% (1.3292 => 1.4726, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.79% (1.7558 => 1.9452, std.dev.: 0.0007) MultiSource/Applications/ALAC/decode/alacconvert-decode: 10.77% (1.3289 => 1.4720, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/chomp: 10.74% (0.2094 => 0.2319, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (15.8135 => 17.5048, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 10.63% (1.1674 => 1.2915, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.62% (5.6659 => 6.2677, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.62% (0.1017 => 0.1125, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.49% (0.9418 => 1.0406, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 10.38% (0.0992 => 0.1095, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 10.34% (4.8499 => 5.3516, std.dev.: 0.0134) MultiSource/Applications/sgefa/sgefa: 10.34% (0.4334 => 0.4782, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.24% (0.0977 => 0.1077, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 10.13% (9.0067 => 9.9195, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 9.94% (0.1117 => 0.1228) MultiSource/Benchmarks/Olden/mst/mst: 9.93% (0.1400 => 0.1539, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 9.91% (4.4464 => 4.8869, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 9.86% (0.4412 => 0.4847, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 9.76% (4.4540 => 4.8888, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.69% (1.1487 => 1.2600, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.60% (0.4626 => 0.5070, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.46% (0.2314 => 0.2533, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.46% (11.9530 => 13.0834, std.dev.: 0.0050) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.42% (8.1265 => 8.8920, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/hash2: 9.28% (0.5711 => 0.6241, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 9.23% (0.1397 => 0.1526, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.22% (0.8398 => 0.9172, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.18% (0.9083 => 0.9917, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 9.17% (0.8219 => 0.8973, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 9.15% (0.1497 => 0.1634, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 9.15% (0.8678 => 0.9472, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.14% (0.7603 => 0.8298, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.95% (0.8536 => 0.9300, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.94% (0.8196 => 0.8929, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 8.91% (0.3873 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.90% (0.4519 => 0.4921, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.87% (0.7426 => 0.8085, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 8.86% (0.9799 => 1.0667, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.83% (0.1314 => 0.1430, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 8.79% (0.7484 => 0.8142, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 8.78% (0.6935 => 0.7544, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.74% (0.7621 => 0.8287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.73% (0.7066 => 0.7683, std.dev.: 0.0006) SingleSource/Benchmarks/Linpack/linpack-pc: 8.59% (0.3179 => 0.3452, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.58% (0.1457 => 0.1582, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.56% (0.7882 => 0.8557, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.55% (0.7461 => 0.8099, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.55% (0.7415 => 0.8049, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.55% (0.7054 => 0.7657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 8.51% (0.7783 => 0.8445, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.50% (0.7058 => 0.7658, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.48% (0.2959 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.27% (1.5737 => 1.7039, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.25% (0.1394 => 0.1509, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 8.12% (30.2177 => 32.6726, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.07% (0.9994 => 1.0801, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 8.06% (1.0588 => 1.1441, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 8.04% (0.9804 => 1.0592, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.02% (0.5959 => 0.6437, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.01% (0.4917 => 0.5311, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.96% (0.9661 => 1.0430, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 7.88% (0.5341 => 0.5762, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.87% (5.9296 => 6.3965, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.84% (0.9462 => 1.0204, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.75% (0.8878 => 0.9566, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.74% (5.9093 => 6.3666, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.74% (0.8645 => 0.9314, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 7.62% (0.9492 => 1.0215, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.62% (0.6106 => 0.6571, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.61% (0.8808 => 0.9478, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.56% (0.8716 => 0.9375, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.56% (0.9131 => 0.9821, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.51% (0.9026 => 0.9704, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.49% (0.8764 => 0.9420, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 7.44% (0.8320 => 0.8939, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.42% (0.8299 => 0.8915, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.39% (0.8682 => 0.9324, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.37% (0.8321 => 0.8934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.32% (0.8197 => 0.8797, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.15% (0.2391 => 0.2562, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 6.93% (0.5557 => 0.5942, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.88% (0.1947 => 0.2081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.82% (0.4250 => 0.4540, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.79% (0.4269 => 0.4559, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 6.75% (0.5257 => 0.5612, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.69% (0.2719 => 0.2901, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.65% (0.3971 => 0.4235, std.dev.: 0.0005) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.64% (0.2004 => 0.2137, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 6.59% (0.3672 => 0.3914, std.dev.: 0.0004) SingleSource/UnitTests/Vectorizer/gcc-loops: 6.56% (0.6269 => 0.6680, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 6.41% (2.3750 => 2.5272, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 6.28% (0.4541 => 0.4826, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 5.65% (0.4285 => 0.4527, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.58% (10.7754 => 11.3767, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 5.52% (0.4038 => 0.4261, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 5.31% (0.3747 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 5.17% (0.4120 => 0.4333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 4.75% (0.3835 => 0.4017, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.54% (1.6221 => 1.6957, std.dev.: 0.0012) MultiSource/Applications/hexxagon/hexxagon: 4.52% (1.3990 => 1.4622, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 4.48% (0.2367 => 0.2473, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.89% (0.3884 => 0.4035, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 3.77% (0.3447 => 0.3577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3833 => 0.3960, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3764 => 0.3885, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 2.98% (0.3387 => 0.3488, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 2.96% (55.3279 => 56.9681, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.84% (4.6159 => 4.7472, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: 2.74% (0.4345 => 0.4464, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 2.41% (0.4196 => 0.4297, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 2.18% (2.2617 => 2.3111, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 1.42% (0.7902 => 0.8014, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.32% (79.9049 => 80.9603, std.dev.: 0.1822) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -3.88% (0.6801 => 0.6537, std.dev.: 0.0085) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1329 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0652 => 0.0652, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8279 => 499.8465, std.dev.: 0.0065) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 44224.42% (1.1277 => 499.8465, std.dev.: 0.0065) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 268.48% (0.5229 => 1.9268, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 44.83% (14.9895 => 21.7094, std.dev.: 0.0106) MultiSource/Applications/kimwitu++/kc: 62.77% (14.1553 => 23.0408, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/gs/gs: 30.19% (4.1105 => 5.3516, std.dev.: 0.0134) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.46% (1.1048 => 2.0931, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1735.82% (7.1582 => 131.4115, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++-EH/spirit: 127.61% (3.4629 => 7.8820, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 100.61% (0.6222 => 1.2482, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10280.00% (0.0720 => 7.4736, std.dev.: 0.0148) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11161500.00% (0.0001 => 11.1616, std.dev.: 0.0395) MultiSource/Applications/kimwitu++/kc: 51000.00% (0.0001 => 0.0511, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487000.00% (0.0001 => 5.4871, std.dev.: 0.0320) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.21% (1.1194 => 10.4463, std.dev.: 0.0298) SingleSource/Benchmarks/Misc/flops: 177.93% (0.1432 => 0.3980, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/factor: 171.28% (0.0296 => 0.0803, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 156.89% (22.1758 => 56.9681, std.dev.: 0.0228) SingleSource/Benchmarks/Misc/lowercase: 141.02% (0.0256 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 137.03% (0.1056 => 0.2503, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 112.76% (0.0243 => 0.0517, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/objinst: 106.09% (0.0427 => 0.0880, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.95% (0.0929 => 0.1904, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 100.98% (7.0540 => 14.1769, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/almabench: 91.10% (0.0730 => 0.1395, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 89.68% (0.1463 => 0.2775, std.dev.: 0.0002) SingleSource/Regression/C/casts: 83.33% (0.0318 => 0.0583, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 80.17% (0.0237 => 0.0427, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 79.05% (0.0377 => 0.0675, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 77.68% (0.2554 => 0.4538, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 76.08% (0.0439 => 0.0773, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 74.95% (1.5859 => 2.7745, std.dev.: 0.0055) SingleSource/Regression/C/sumarray2d: 71.22% (0.0271 => 0.0464, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 65.99% (0.0394 => 0.0654, std.dev.: 0.0002) SingleSource/UnitTests/Vector/simple: 65.41% (0.0185 => 0.0306, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: 64.55% (0.0268 => 0.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 63.66% (2.2024 => 3.6044, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 61.56% (2.9384 => 4.7472, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 60.80% (8.1363 => 13.0834, std.dev.: 0.0050) SingleSource/UnitTests/2002-05-02-CastTest: 59.63% (0.0218 => 0.0348, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 59.31% (0.0231 => 0.0368, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 58.97% (0.1143 => 0.1817, std.dev.: 0.0011) SingleSource/Regression/C/testtrace: 58.96% (0.0212 => 0.0337, std.dev.: 0.0002) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 57.14% (0.0217 => 0.0341, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 56.19% (1.5415 => 2.4077, std.dev.: 0.0028) SingleSource/Benchmarks/Stanford/Oscar: 55.97% (0.0636 => 0.0992, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-31-CastToBool: 55.94% (0.0202 => 0.0315, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 54.31% (0.0232 => 0.0358, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 53.81% (0.3109 => 0.4782, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.89% (0.0953 => 0.1457, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 52.60% (1.1642 => 1.7766, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.75% (0.6675 => 0.9996, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 48.96% (0.1062 => 0.1582, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 48.94% (21.9371 => 32.6726, std.dev.: 0.0217) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.80% (0.0793 => 0.1180, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 48.53% (0.1125 => 0.1671, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.09% (3.8922 => 5.7641, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 48.04% (0.2700 => 0.3997, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 47.70% (0.0457 => 0.0675, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 47.05% (0.0814 => 0.1197, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 46.97% (4.2646 => 6.2677, std.dev.: 0.0018) MultiSource/Applications/lemon/lemon: 46.82% (1.0722 => 1.5742, std.dev.: 0.0009) SingleSource/UnitTests/2003-07-09-SignedArgs: 45.74% (0.0282 => 0.0411) MultiSource/Benchmarks/McCat/15-trie/trie: 45.73% (0.0527 => 0.0768, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 45.24% (0.0462 => 0.0671, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 45.13% (0.7115 => 1.0326, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.86% (0.0564 => 0.0817, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.68% (0.0479 => 0.0693, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 44.25% (0.0818 => 0.1180, std.dev.: 0.0004) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 44.06% (0.0640 => 0.0922, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/div: 42.64% (0.0258 => 0.0368) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 42.61% (0.0467 => 0.0666, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.38% (0.4615 => 0.6571, std.dev.: 0.0036) SingleSource/UnitTests/block-copied-in-cxxobj: 42.26% (0.0310 => 0.0441) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.17% (0.5105 => 0.7258, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/shr: 42.06% (0.0252 => 0.0358) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.04% (0.0245 => 0.0348) MultiSource/Applications/siod/siod: 41.88% (2.2969 => 3.2588, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/messages-2: 41.54% (0.0662 => 0.0937, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.35% (0.2271 => 0.3210, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 41.23% (0.0730 => 0.1031, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 40.96% (9.4845 => 13.3690, std.dev.: 0.0132) MultiSource/Benchmarks/Olden/bh/bh: 40.91% (0.3092 => 0.4357, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 40.34% (0.1175 => 0.1649, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 40.24% (0.6456 => 0.9054, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.18% (0.0672 => 0.0942, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 40.12% (0.1655 => 0.2319, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 40.06% (0.1695 => 0.2374, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 39.81% (0.1555 => 0.2174, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.18% (0.5860 => 0.8156, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 39.14% (0.0746 => 0.1038) MultiSource/Benchmarks/NPB-serial/is/is: 38.25% (0.0719 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 38.22% (0.4299 => 0.5942, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 38.14% (0.0485 => 0.0670, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 38.08% (0.1032 => 0.1425, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 38.04% (3.8723 => 5.3452, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.04% (0.0397 => 0.0548, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 37.81% (2.0273 => 2.7938, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.63% (0.3441 => 0.4736, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: 37.63% (0.0295 => 0.0406, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.33% (0.0675 => 0.0927) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.27% (0.0770 => 0.1057, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.12% (1.4186 => 1.9452, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 37.06% (0.0626 => 0.0858) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 36.97% (0.1044 => 0.1430, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 36.85% (0.7835 => 1.0722, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 36.85% (3.3354 => 4.5644, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 36.80% (5.7591 => 7.8785, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.53% (0.3307 => 0.4515, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 36.50% (1.1840 => 1.6162, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.45% (0.5569 => 0.7599, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.27% (0.3427 => 0.4670, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 36.26% (63.2438 => 86.1770, std.dev.: 0.0209) MultiSource/Applications/sqlite3/sqlite3: 36.12% (17.1811 => 23.3870, std.dev.: 0.0103) MultiSource/Benchmarks/Olden/em3d/em3d: 35.81% (0.1695 => 0.2302, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 35.45% (0.0660 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.41% (0.1892 => 0.2562, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 35.33% (0.1268 => 0.1716, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 35.17% (0.3423 => 0.4627, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages: 35.17% (0.0327 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.15% (0.3121 => 0.4218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 35.09% (0.4620 => 0.6241, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.94% (0.0933 => 0.1259, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.91% (0.1584 => 0.2137, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.90% (0.0447 => 0.0603, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 34.81% (0.0316 => 0.0426, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Queens: 34.78% (0.0414 => 0.0558, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 34.63% (0.2758 => 0.3713, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 34.34% (0.4289 => 0.5762, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: 34.16% (0.0811 => 0.1088) MultiSource/Applications/aha/aha: 34.06% (0.1151 => 0.1543, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: 34.00% (0.0403 => 0.0540) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 33.88% (0.4879 => 0.6532, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.61% (0.0842 => 0.1125, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.28% (1.1861 => 1.5808, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.22% (0.2107 => 0.2807, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 32.96% (0.0886 => 0.1178, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.89% (0.1566 => 0.2081, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0002) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.39% (0.0389 => 0.0515, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 32.33% (0.1163 => 0.1539, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.20% (0.1236 => 0.1634, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.01% (0.0528 => 0.0697, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.82% (0.0770 => 0.1015, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 31.74% (0.7433 => 0.9792, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 31.43% (0.0614 => 0.0807, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 31.42% (0.0592 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 31.21% (0.3387 => 0.4444, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.91% (0.0482 => 0.0631, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.61% (0.1029 => 0.1344, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.60% (0.5981 => 0.7811, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.57% (1.3050 => 1.7039, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.57% (0.1940 => 0.2533, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.53% (0.8172 => 1.0667, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.39% (0.0408 => 0.0532, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.33% (0.1510 => 0.1968, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.02% (0.6450 => 0.8386, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 29.81% (0.3180 => 0.4128, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 29.75% (0.1906 => 0.2473, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.43% (0.8067 => 1.0441, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Towers: 29.30% (0.0471 => 0.0609, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/dot-syntax: 29.30% (0.0355 => 0.0459) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.03% (0.9765 => 1.2600, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.95% (0.1337 => 0.1724, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 28.93% (0.1144 => 0.1475, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.93% (0.0871 => 0.1123, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 28.92% (0.8921 => 1.1501, std.dev.: 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: 28.86% (0.0350 => 0.0451, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.85% (0.0416 => 0.0536, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 28.75% (0.0633 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.75% (4.9449 => 6.3666, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.45% (0.8101 => 1.0406, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.39% (0.2603 => 0.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.23% (0.5020 => 0.6437, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 28.04% (0.0567 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.02% (0.1117 => 0.1430, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.88% (5.0018 => 6.3965, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Treesort: 27.74% (0.0411 => 0.0525, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 27.67% (1.5603 => 1.9921, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 27.37% (0.3098 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.70% (0.2266 => 0.2871, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.47% (0.3177 => 0.4018, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.36% (0.4203 => 0.5311, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.41% (0.3865 => 0.4847, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 25.22% (0.0456 => 0.0571, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.38% (0.0443 => 0.0551, std.dev.: 0.0002) SingleSource/Regression/C/bigstack: 24.22% (0.0417 => 0.0518, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 24.07% (0.0536 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.93% (0.0798 => 0.0989, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 23.75% (0.1625 => 0.2011, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 23.57% (0.4103 => 0.5070, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.15% (0.0648 => 0.0798, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 23.13% (0.1440 => 0.1773, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.02% (0.0834 => 0.1026, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 22.87% (0.0481 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.81% (0.0491 => 0.0603, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.87% (0.0704 => 0.0858, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.84% (14.3668 => 17.5048, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.72% (0.1114 => 0.1356, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.09% (0.4064 => 0.4921, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.05% (0.4636 => 0.5612, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary3: 20.62% (0.3283 => 0.3960, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.39% (0.2065 => 0.2486, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 20.25% (0.2049 => 0.2464, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 20.20% (0.3232 => 0.3885, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 19.41% (0.3379 => 0.4035, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.38% (0.2430 => 0.2901, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.33% (0.0838 => 0.1000, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 19.26% (0.3282 => 0.3914, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 19.22% (0.4048 => 0.4826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.66% (0.3826 => 0.4540, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.29% (0.1438 => 0.1701, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 18.26% (0.3603 => 0.4261, std.dev.: 0.0003) SingleSource/UnitTests/initp1: 18.02% (0.0555 => 0.0655, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 17.62% (0.3684 => 0.4333, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 17.39% (0.3422 => 0.4017, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.66% (0.2905 => 0.3389, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 16.50% (0.3886 => 0.4527, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.03% (0.3650 => 0.4235, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.86% (0.3935 => 0.4559, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 15.18% (0.0705 => 0.0812, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.76% (2.2022 => 2.5272, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: 13.86% (1.2842 => 1.4622, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 13.67% (0.3927 => 0.4464, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 13.56% (0.1268 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.46% (0.1330 => 0.1509, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.12% (0.3162 => 0.3577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 12.89% (0.2831 => 0.3196, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 12.37% (0.2871 => 0.3226, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 12.25% (0.3828 => 0.4297, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.84% (2.0665 => 2.3111, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/methcall: 11.71% (0.2877 => 0.3214, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.68% (7.9617 => 8.8920, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.22% (0.3136 => 0.3488, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.56% (0.2756 => 0.3047, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.34% (0.2891 => 0.3190, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (0.2725 => 0.3004, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.17% (0.2714 => 0.2990, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 10.07% (0.3694 => 0.4066, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.06% (0.3052 => 0.3359, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.03% (0.2872 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.03% (0.2793 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2802 => 0.3077, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 9.74% (10.3673 => 11.3767, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/exceptions-3: 9.73% (0.3516 => 0.3858, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 9.69% (0.3561 => 0.3906, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.62% (0.3543 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.62% (0.3543 => 0.3884, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 9.55% (0.3497 => 0.3831, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.50% (0.3473 => 0.3803, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.39% (0.7326 => 0.8014, std.dev.: 0.0031) SingleSource/UnitTests/ObjC++/property-reference-object: 9.20% (0.6030 => 0.6585, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 7.81% (0.5925 => 0.6388, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 7.38% (0.3131 => 0.3362, std.dev.: 0.0077) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4746, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.77% (6.6465 => 7.6949, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.21% (1.1396 => 1.2446, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4263, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.41% (4.2280 => 4.4569, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3119, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ffbench: 4.07% (0.9505 => 0.9892, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0089) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.14% (0.9957 => 1.0270, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.84% (8.6802 => 8.9265, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.32% (3.6395 => 3.7239, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.05% (0.8333 => 0.8504, std.dev.: 0.0017) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.72% (9.1159 => 9.2726, std.dev.: 0.0285) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2381, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.78% (6.6874 => 0.2154, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.52% (5.2763 => 1.2915, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -75.03% (0.8651 => 0.2160, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -35.64% (0.1622 => 0.1044, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.26% (5.3855 => 4.8869, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.66% (5.3526 => 4.8888, std.dev.: 0.0040) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 49.9990, std.dev.: 0.0190) MultiSource/Applications/JM/ldecod/ldecod: -4.95% (10.4361 => 9.9195, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.70% (1.7609 => 1.6957, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.61% (1.9577 => 0.6537, std.dev.: 0.0085) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3068, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0190, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7652, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4329, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8515, std.dev.: 0.0180) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0042, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5891, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.04% (0.6223 => 0.5038, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.81% (2.5528 => 2.1238, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4264, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7347, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.15% (9.5636 => 8.4977, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5816, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -6.69% (1.2373 => 1.1545, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5788, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7029, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -5.18% (0.4808 => 0.4559, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5092, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -4.33% (10.2830 => 9.8379, std.dev.: 0.0083) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3281, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/ary3: -1.26% (3.6994 => 3.6527, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: -1.16% (4.6441 => 4.5901, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2356, std.dev.: 0.0030) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.19% (0.2116 => 0.0652, std.dev.: 0.0027) Report Time: 1.68s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 21:40:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Sun, 27 Jan 2013 23:40:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130128054017.72FA32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8026?compare_to=8020&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8026, Order: 173643, Start Time: 2013-01-28 02:05:06, End Time: 2013-01-28 05:40:36 To: 8020, Order: 173622, Start Time: 2013-01-27 21:35:40, End Time: 2013-01-28 01:11:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (181 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 43.84% (0.0625 => 0.0899, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.34% (0.1063 => 0.1428, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.58% (0.0475 => 0.0625, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.66% (0.1106 => 0.1423, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.63% (0.2969 => 0.3819, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.79% (0.0547 => 0.0699, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.34% (0.5900 => 0.7513, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.94% (0.4139 => 0.5254, std.dev.: 0.0089) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.97% (0.4994 => 0.6291, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.51% (0.4253 => 0.5338, std.dev.: 0.0011) MultiSource/Applications/oggenc/oggenc: 25.32% (1.5932 => 1.9966, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.18% (0.5000 => 0.6259, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.63% (0.1620 => 0.2019, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 24.54% (0.0599 => 0.0746, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.41% (0.0897 => 0.1116, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.39% (0.1107 => 0.1377, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.29% (0.1021 => 0.1269, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.85% (0.0633 => 0.0784, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.46% (0.0584 => 0.0721, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/em3d/em3d: 23.31% (0.0948 => 0.1169, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.83% (0.1003 => 0.1232, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.76% (0.1103 => 0.1354, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.74% (0.0642 => 0.0788, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.63% (0.1604 => 0.1967, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 22.51% (0.4029 => 0.4936, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.50% (0.3903 => 0.4781, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.47% (0.1549 => 0.1897, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.42% (0.0495 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.26% (0.0822 => 0.1005, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.09% (0.1462 => 0.1785, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 22.02% (0.0604 => 0.0737, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.95% (0.3271 => 0.3989, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 21.87% (0.1619 => 0.1973, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.67% (0.3890 => 0.4733, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 21.63% (0.0698 => 0.0849, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.53% (0.2866 => 0.3483, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.31% (0.2736 => 0.3319, std.dev.: 0.0021) MultiSource/Applications/viterbi/viterbi: 21.22% (0.0947 => 0.1148, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.86% (0.1088 => 0.1315, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 20.65% (1.8794 => 2.2675, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/08-main/main: 20.53% (0.1218 => 0.1468, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 20.38% (0.5546 => 0.6676, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/09-vor/vor: 20.13% (0.1505 => 0.1808, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.01% (0.2014 => 0.2417, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.90% (0.4658 => 0.5585, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.56% (0.1968 => 0.2353, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.41% (1.3152 => 1.5705, std.dev.: 0.0209) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.41% (0.0572 => 0.0683, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/Hello: 19.33% (0.5826 => 0.6952, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: 19.15% (0.5889 => 0.7017, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.64% (0.5026 => 0.5963, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 18.52% (0.9697 => 1.1493, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.44% (3.5627 => 4.2195, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.40% (0.2875 => 0.3404, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.40% (0.3930 => 0.4653, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.36% (1.6211 => 1.9188, std.dev.: 0.0101) SingleSource/UnitTests/ObjC++/property-reference: 18.28% (0.7171 => 0.8482, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 18.22% (0.1284 => 0.1518, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/fibo: 18.09% (0.2725 => 0.3218, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.04% (0.0582 => 0.0687, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.93% (0.1160 => 0.1368, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 17.92% (1.0781 => 1.2713, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.86% (0.2738 => 0.3227, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.72% (0.3195 => 0.3761, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.67% (0.2750 => 0.3236, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.66% (0.2792 => 0.3285, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/except: 17.64% (0.2811 => 0.3307, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 17.57% (0.9909 => 1.1650, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: 17.49% (0.2813 => 0.3305, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 17.48% (0.2780 => 0.3266, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 17.45% (0.1421 => 0.1669, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.44% (1.9694 => 2.3128, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hello: 17.43% (0.2714 => 0.3187, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 17.37% (0.2803 => 0.3290, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 17.37% (0.3258 => 0.3824, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.30% (2.0673 => 2.4249, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.22% (0.4361 => 0.5112, std.dev.: 0.0018) SingleSource/Regression/C++/ofstream_ctor: 17.21% (0.3004 => 0.3521, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.19% (0.2729 => 0.3198, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 17.08% (0.3267 => 0.3825, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.07% (0.2911 => 0.3408, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.85% (0.3317 => 0.3876, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 16.81% (23.5202 => 27.4748, std.dev.: 0.0348) SingleSource/Benchmarks/Shootout-C++/wc: 16.70% (0.3096 => 0.3613, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 16.59% (0.3726 => 0.4344, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 16.57% (4.2109 => 4.9086, std.dev.: 0.0539) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.57% (0.3060 => 0.3567, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 16.56% (0.3678 => 0.4287, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.44% (0.3625 => 0.4221, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.36% (1.9966 => 2.3232, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout-C++/hash: 16.30% (0.4146 => 0.4822, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 16.28% (1.4269 => 1.6592, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.23% (0.3124 => 0.3631, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.15% (0.3845 => 0.4466, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: 16.13% (0.3477 => 0.4038, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.12% (0.3362 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.09% (0.3282 => 0.3810, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/lists: 16.04% (0.3348 => 0.3885, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.94% (2.7292 => 3.1643, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash2: 15.78% (0.4251 => 0.4922, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 15.73% (0.7875 => 0.9114, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.69% (0.3690 => 0.4269, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.62% (0.3981 => 0.4603, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 15.59% (0.2566 => 0.2966, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.48% (4.4195 => 5.1037, std.dev.: 0.0317) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.01% (0.0673 => 0.0774, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/bigfib: 14.96% (0.5012 => 0.5762, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 14.96% (0.3496 => 0.4019, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.91% (0.3488 => 0.4008, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 14.90% (0.3442 => 0.3955, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 14.89% (0.3465 => 0.3981, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 14.89% (0.3446 => 0.3959, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 14.87% (0.3469 => 0.3985, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 14.84% (0.3498 => 0.4017, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 14.74% (0.3460 => 0.3970, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: 14.49% (0.3650 => 0.4179, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 14.34% (0.3724 => 0.4258, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 14.32% (5.5417 => 6.3350, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/football/football: 14.31% (0.2075 => 0.2372, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions: 14.27% (0.3643 => 0.4163, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.88% (0.6435 => 0.7328, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: 13.85% (2.1653 => 2.4651, std.dev.: 0.0294) MultiSource/Applications/minisat/minisat: 13.79% (0.3336 => 0.3796, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.59% (0.2737 => 0.3109, std.dev.: 0.0008) MultiSource/Applications/JM/lencod/lencod: 13.44% (4.6177 => 5.2384, std.dev.: 0.0412) MultiSource/Applications/SIBsim4/SIBsim4: 13.42% (0.2691 => 0.3052, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.39% (0.2068 => 0.2345, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.06% (0.0804 => 0.0909, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 12.94% (2.1013 => 2.3732, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.89% (0.5361 => 0.6052, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.89% (0.2103 => 0.2374, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.39% (0.3084 => 0.3466, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.93% (11.6398 => 13.0288, std.dev.: 0.0076) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.93% (0.1383 => 0.1548, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 11.68% (0.4847 => 0.5413, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 11.65% (0.6634 => 0.7407, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.62% (0.2040 => 0.2277, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.06% (0.7426 => 0.8247, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.32% (4.6926 => 5.1767, std.dev.: 0.0025) MultiSource/Applications/lemon/lemon: 9.91% (0.2391 => 0.2628, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 9.41% (2.0346 => 2.2261, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.65% (0.5584 => 0.6067, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 8.35% (11.9555 => 12.9539, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.43% (0.3792 => 0.3998, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5101, std.dev.: 0.0110) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.41% (0.2162 => 0.3533, std.dev.: 0.0314) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0100) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.34% (0.3693 => 0.3964, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.70% (0.2122 => 0.2243, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/objinst: 5.23% (12.0509 => 12.6808, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2384, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/flops-2: 4.75% (1.8057 => 1.8914, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6847, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1930, std.dev.: 0.0558) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3017, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.39% (7.1849 => 7.2845, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0817, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.14% (1.0927 => 1.1052, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6854, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5940, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.05% (3.1722 => 3.2056, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.76% (25.4195 => 16.5833, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.17% (17.2379 => 14.1063, std.dev.: 0.1850) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1015, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -9.28% (0.2402 => 0.2179, std.dev.: 0.0027) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -4.61% (14.0481 => 13.4006, std.dev.: 0.1885) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2213, std.dev.: 0.0060) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.56% (11.2080 => 10.8085, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7743, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1782, std.dev.: 0.0322) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5764, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1523, std.dev.: 0.0843) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0457, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 22:05:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 00:05:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128060520.1B5C72A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8027?compare_to=8024&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8027, Order: 173653, Start Time: 2013-01-28 04:29:03, End Time: 2013-01-28 06:05:38 To: 8024, Order: 173648, Start Time: 2013-01-28 02:28:36, End Time: 2013-01-28 04:05:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (218 on baseline) Performance Improvements: 40 (72 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1064 (802 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.08% (34.7396 => 33.6695, std.dev.: 0.0118) MultiSource/Applications/siod/siod: -2.33% (2.9077 => 2.8400, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -2.18% (20.4493 => 20.0038, std.dev.: 0.0148) MultiSource/Applications/SPASS/SPASS: -2.12% (19.1620 => 18.7566, std.dev.: 0.0111) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.96% (7.0431 => 6.9049, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.71% (0.8914 => 0.8762, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.69% (1.6365 => 1.6089, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.68% (1.1193 => 1.1005, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/bigfib: -1.65% (0.8173 => 0.8038, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.60% (2.1526 => 2.1181, std.dev.: 0.0060) MultiSource/Applications/lua/lua: -1.60% (4.7484 => 4.6726, std.dev.: 0.0069) MultiSource/Applications/lemon/lemon: -1.59% (1.5475 => 1.5229, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.54% (39.9375 => 39.3225, std.dev.: 0.0379) MultiSource/Applications/treecc/treecc: -1.51% (2.5160 => 2.4779, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: -1.49% (20.7917 => 20.4819, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.47% (3.1620 => 3.1155, std.dev.: 0.0052) MultiSource/Applications/minisat/minisat: -1.46% (0.8981 => 0.8850, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: -1.40% (1.3397 => 1.3209, std.dev.: 0.0068) MultiSource/Applications/spiff/spiff: -1.39% (0.9801 => 0.9665, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (4.5778 => 4.5144, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/football/football: -1.35% (1.0183 => 1.0046, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.34% (1.4046 => 1.3858, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.29% (0.9530 => 0.9407, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: -1.27% (4.0720 => 4.0202, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: -1.25% (1.5848 => 1.5650, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.23% (0.8642 => 0.8536, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: -1.22% (1.7269 => 1.7059, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.21% (1.0425 => 1.0299, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -1.19% (1.6446 => 1.6250, std.dev.: 0.0017) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.16% (49.1130 => 48.5445, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.14% (0.8770 => 0.8670, std.dev.: 0.0005) MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.08% (1.2322 => 1.2189, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.06% (1.0055 => 0.9948, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -1.06% (17.1866 => 17.0040, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.06% (1.7301 => 1.7118, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.05% (4.5075 => 4.4601, std.dev.: 0.0105) MultiSource/Benchmarks/mafft/pairlocalalign: -1.04% (11.2161 => 11.0990, std.dev.: 0.0067) MultiSource/Benchmarks/PAQ8p/paq8p: -1.03% (2.6939 => 2.6662, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.01% (2.1602 => 2.1383, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: -1.01% (5.8469 => 5.7879, std.dev.: 0.0122) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.11% (0.0315 => 0.0728, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 92.14% (0.0280 => 0.0538, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 83.54% (0.0717 => 0.1316, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 81.71% (0.0514 => 0.0934, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 73.92% (0.0974 => 0.1694, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 64.13% (0.1132 => 0.1858, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 59.53% (0.1500 => 0.2393, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 50.27% (22.4056 => 33.6695, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 50.13% (0.0371 => 0.0557, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 47.41% (0.0599 => 0.0883, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 47.22% (0.6395 => 0.9415, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 45.81% (1.6474 => 2.4020, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout/objinst: 43.73% (0.0407 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 41.15% (0.0418 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.13% (0.6395 => 0.9025, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.09% (0.6260 => 0.8832, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.81% (0.5688 => 0.8009, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 40.71% (0.5805 => 0.8168, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.51% (0.5456 => 0.7666, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 40.30% (0.5849 => 0.8206, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.02% (0.5567 => 0.7795, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 39.97% (0.5581 => 0.7812, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 39.57% (0.5575 => 0.7781, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.03% (0.5941 => 0.8260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.30% (0.5859 => 0.8103, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 38.20% (0.0699 => 0.0966, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 37.96% (0.6033 => 0.8323, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 37.93% (2.2587 => 3.1155, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 37.62% (0.6440 => 0.8863, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.30% (0.0445 => 0.0611, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 36.69% (0.6189 => 0.8460, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 36.68% (0.6230 => 0.8515, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 36.67% (0.6676 => 0.9124, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 36.52% (0.0293 => 0.0400) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.09% (0.6304 => 0.8579, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 35.57% (0.0582 => 0.0789) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 35.54% (0.5802 => 0.7864) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 35.14% (0.5925 => 0.8007, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.06% (0.6660 => 0.8995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 34.67% (0.5705 => 0.7683, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 34.42% (0.5857 => 0.7873, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 34.19% (0.5569 => 0.7473, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 33.99% (0.5478 => 0.7340, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.97% (0.5570 => 0.7462, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 33.57% (0.5591 => 0.7468, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 33.00% (1.1450 => 1.5229, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 32.68% (0.2659 => 0.3528, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.66% (0.5863 => 0.7778, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 32.53% (0.0790 => 0.1047, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 32.42% (0.6446 => 0.8536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.34% (0.6052 => 0.8009, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 32.22% (0.7524 => 0.9948, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.79% (0.6681 => 0.8805, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.63% (0.1230 => 0.1619) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 31.40% (0.6194 => 0.8139, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.74% (0.6297 => 0.8233, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 30.71% (0.0622 => 0.0813, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 30.59% (0.0693 => 0.0905, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 30.22% (0.0556 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 30.04% (0.6667 => 0.8670, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 29.44% (1.6364 => 2.1181, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 28.57% (0.0833 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.18% (0.7339 => 0.9407, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.09% (0.0680 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.92% (0.0634 => 0.0811, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.75% (3.5339 => 4.5144, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.73% (0.1796 => 0.2294, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.05% (0.0621 => 0.0789, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 26.27% (5.4682 => 6.9049, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.15% (0.0566 => 0.0714, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.85% (1.2784 => 1.6089, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.22% (0.1146 => 0.1435, std.dev.: 0.0021) MultiSource/Applications/Burg/burg: 25.05% (1.2515 => 1.5650, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.80% (0.7021 => 0.8762, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 24.75% (0.3357 => 0.4188, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 24.75% (0.0707 => 0.0882, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 24.31% (0.0864 => 0.1074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 22.71% (0.0665 => 0.0816, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: 22.71% (0.0621 => 0.0762) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.44% (0.0731 => 0.0895, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.08% (4.5069 => 5.5020, std.dev.: 0.0111) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.92% (0.1081 => 0.1318, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.14% (0.1731 => 0.2097) MultiSource/Applications/SPASS/SPASS: 20.95% (15.5079 => 18.7566, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 20.27% (9.2283 => 11.0990, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/distray/distray: 19.37% (0.0919 => 0.1097, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.32% (0.0885 => 0.1056, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.23% (0.0806 => 0.0961, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.18% (0.4916 => 0.5859, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 19.08% (0.6750 => 0.8038, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.05% (0.5329 => 0.6344, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/15-trie/trie: 18.91% (0.0571 => 0.0679, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 18.84% (0.7447 => 0.8850, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.71% (0.0604 => 0.0717) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.46% (0.0764 => 0.0905, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.31% (0.0617 => 0.0730, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bh/bh: 18.29% (0.2985 => 0.3531, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 18.23% (2.4021 => 2.8400, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.20% (0.2385 => 0.2819, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 18.10% (0.4515 => 0.5332, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.01% (0.1982 => 0.2339, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.74% (0.3483 => 0.4101, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.22% (0.0598 => 0.0701) MultiSource/Applications/SIBsim4/SIBsim4: 17.21% (1.3864 => 1.6250, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 16.96% (17.1032 => 20.0038, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.91% (1.4642 => 1.7118, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.30% (0.1509 => 0.1755, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.20% (0.0710 => 0.0825, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 15.83% (0.1674 => 0.1939, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.78% (2.1401 => 2.4779, std.dev.: 0.0142) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.74% (0.2548 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.73% (0.6293 => 0.7283, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 15.68% (0.4861 => 0.5623, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.67% (0.1761 => 0.2037, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 15.62% (0.0704 => 0.0814, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 15.53% (0.3491 => 0.4033, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.34% (34.0927 => 39.3225, std.dev.: 0.0379) MultiSource/Applications/oggenc/oggenc: 15.24% (5.0226 => 5.7879, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/hash: 15.23% (0.4524 => 0.5213, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.15% (0.9557 => 1.1005, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.13% (0.1077 => 0.1240, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 15.11% (4.0594 => 4.6726, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: 14.87% (0.0686 => 0.0788) MultiSource/Applications/spiff/spiff: 14.81% (0.8418 => 0.9665, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.69% (0.1096 => 0.1257, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.68% (0.0797 => 0.0914) MultiSource/Benchmarks/nbench/nbench: 14.56% (1.1530 => 1.3209, std.dev.: 0.0068) MultiSource/Benchmarks/NPB-serial/is/is: 14.41% (0.0708 => 0.0810, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 14.36% (3.5154 => 4.0202, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/17-bintr/bintr: 13.77% (0.0741 => 0.0843, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.15% (0.5999 => 0.6788, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.88% (0.3658 => 0.4129, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.67% (1.2300 => 1.3858, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.44% (0.3319 => 0.3732, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/18-imp/imp: 12.23% (0.3581 => 0.4019, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.99% (0.2001 => 0.2241, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 11.96% (18.2933 => 20.4819, std.dev.: 0.0189) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.63% (0.1290 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.53% (0.0919 => 0.1025, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 11.48% (15.2527 => 17.0040, std.dev.: 0.0086) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.44% (0.1145 => 0.1276, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 11.44% (0.1862 => 0.2075, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 11.11% (0.1197 => 0.1330, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.00% (0.2999 => 0.3329, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 10.94% (0.0932 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.91% (0.1173 => 0.1301, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.88% (0.0974 => 0.1080) MultiSource/Benchmarks/Olden/power/power: 10.75% (0.1154 => 0.1278, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.61% (4.0323 => 4.4601, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/matrix: 10.29% (0.3255 => 0.3590, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.29% (0.1108 => 0.1222, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.14% (0.2278 => 0.2509, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.04% (0.1076 => 0.1184, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/tsp/tsp: 9.73% (0.1202 => 0.1319) SingleSource/Benchmarks/Misc/ReedSolomon: 9.69% (0.1879 => 0.2061, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.52% (0.1271 => 0.1392, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.50% (0.7919 => 0.8671, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/football/football: 9.45% (0.9179 => 1.0046, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.40% (0.2106 => 0.2304, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.29% (0.7198 => 0.7867, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: 9.28% (1.5610 => 1.7059, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.19% (0.1621 => 0.1770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.15% (0.4427 => 0.4832, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.12% (1.3722 => 1.4974, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/09-vor/vor: 9.11% (0.3271 => 0.3569, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.04% (0.6736 => 0.7345, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.98% (0.5168 => 0.5632, std.dev.: 0.0023) MultiSource/Applications/lambda-0_1_3/lambda: 8.91% (0.7982 => 0.8693, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 8.74% (0.8521 => 0.9266, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.98% (0.1441 => 0.1556, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.74% (0.4083 => 0.4399, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.73% (0.3142 => 0.3385, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 7.48% (4.3330 => 4.6573, std.dev.: 0.0073) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.48% (0.9077 => 0.9756, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 7.30% (7.0961 => 7.6141, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.27% (4.8161 => 5.1662, std.dev.: 0.0132) MultiSource/Applications/JM/lencod/lencod: 7.26% (16.1920 => 17.3674, std.dev.: 0.0118) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.09% (4.8802 => 5.2260, std.dev.: 0.0103) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.05% (0.2695 => 0.2885, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 6.97% (2.4924 => 2.6662, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.86% (0.6484 => 0.6929, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.71% (1.0544 => 1.1251, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.62% (8.0126 => 8.5428, std.dev.: 0.0081) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.33% (6.7716 => 7.2002, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.16% (0.4321 => 0.4587, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.01% (14.2083 => 15.0629, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary3: 5.57% (0.3446 => 0.3638, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.40% (0.3849 => 0.4057, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.34% (1.2221 => 1.2874, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.22% (0.3394 => 0.3571, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.09% (1.2210 => 1.2832, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.97% (0.2355 => 0.2472, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.82% (0.4813 => 0.5045, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.82% (0.4151 => 0.4351, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 4.58% (0.3406 => 0.3562, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.54% (0.9852 => 1.0299, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.62% (0.3481 => 0.3607, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.48% (0.4248 => 0.4396, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 3.22% (0.3788 => 0.3910, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.93% (0.3931 => 0.4046, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.64% (0.3867 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.71% (0.9542 => 0.9705, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7980, std.dev.: 0.0067) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 7.45% (0.5692 => 0.6116, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.02% (1.2783 => 1.3680, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1495, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5479, std.dev.: 0.0612) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0117) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3825, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (18.2231 => 18.4898, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.46% (5.1955 => 5.2711, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.18% (10.3489 => 10.4705, std.dev.: 0.0074) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.43% (0.3812 => 0.3643, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: -4.23% (0.3831 => 0.3669, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.12% (0.3880 => 0.3720, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: -4.03% (0.3848 => 0.3693, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.02% (0.3884 => 0.3728, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.83% (0.3891 => 0.3742, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.79% (0.4033 => 0.3880, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -2.76% (20.7746 => 20.2005, std.dev.: 0.0208) SingleSource/UnitTests/ObjC++/Hello: -2.69% (0.6347 => 0.6176, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -1.97% (0.6441 => 0.6314, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.52% (2.1713 => 2.1383, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.21% (1.8100 => 0.6659, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3106, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.38% (1.3643 => 1.0181, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7549, std.dev.: 0.0048) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0781, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.10% (4.1024 => 3.1959, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1309, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0915, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.92% (0.5142 => 0.4632, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.81% (0.9021 => 0.8407, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1740, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7696, std.dev.: 0.0232) SingleSource/Benchmarks/Shootout/ary3: -2.53% (3.7241 => 3.6299, std.dev.: 0.0330) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1728, std.dev.: 0.0236) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4602, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.42% (1.6086 => 1.5858, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/ary3: -1.33% (3.7092 => 3.6597, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.30% (1.6307 => 1.6095, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6010, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 22:16:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 00:16:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128061642.987192A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8028?compare_to=8023&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8028, Order: 173653, Start Time: 2013-01-28 04:05:00, End Time: 2013-01-28 06:17:04 To: 8023, Order: 173643, Start Time: 2013-01-28 01:28:46, End Time: 2013-01-28 03:35:04 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 148 (187 on baseline) Performance Improvements: 4 (40 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 912 (836 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 71.93% (23.9370 => 41.1556, std.dev.: 1.2289) SingleSource/UnitTests/SignlessTypes/Large/cast: 69.57% (0.0539 => 0.0914, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 64.34% (0.0429 => 0.0705, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: 52.16% (0.0809 => 0.1231, std.dev.: 0.0007) SingleSource/UnitTests/2006-01-23-UnionInit: 51.78% (0.0253 => 0.0384, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 49.45% (0.0364 => 0.0544, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 48.29% (0.0729 => 0.1081, std.dev.: 0.0066) SingleSource/UnitTests/SignlessTypes/rem: 46.99% (0.1164 => 0.1711, std.dev.: 0.0084) SingleSource/UnitTests/2006-12-11-LoadConstants: 46.10% (0.1308 => 0.1911, std.dev.: 0.0125) SingleSource/UnitTests/SignlessTypes/div: 43.43% (0.0327 => 0.0469, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 42.63% (0.2897 => 0.4132, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 42.05% (0.4716 => 0.6699, std.dev.: 0.0256) SingleSource/Regression/C/casts: 40.68% (0.0413 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 40.37% (1.5688 => 2.2021, std.dev.: 0.0443) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.64% (2.6753 => 3.7359, std.dev.: 0.0163) MultiSource/Benchmarks/FreeBench/distray/distray: 39.33% (0.1012 => 0.1410, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 37.96% (1.9797 => 2.7311, std.dev.: 0.0047) SingleSource/Benchmarks/SmallPT/smallpt: 37.29% (0.1400 => 0.1922, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 36.15% (16.3677 => 22.2844, std.dev.: 0.1192) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.00% (0.3456 => 0.4700, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.20% (0.1287 => 0.1740, std.dev.: 0.0108) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 35.14% (0.0424 => 0.0573, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 34.57% (2.0105 => 2.7055, std.dev.: 0.1072) MultiSource/Benchmarks/Olden/bh/bh: 33.39% (0.3255 => 0.4342, std.dev.: 0.0272) MultiSource/Applications/sqlite3/sqlite3: 31.12% (16.3431 => 21.4292, std.dev.: 0.9096) SingleSource/Benchmarks/Misc/himenobmtxpa: 30.84% (0.2221 => 0.2906, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: 30.70% (0.0860 => 0.1124, std.dev.: 0.0022) MultiSource/Applications/Burg/burg: 29.81% (1.4502 => 1.8825, std.dev.: 0.0769) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 29.39% (0.6522 => 0.8439, std.dev.: 0.0236) MultiSource/Applications/lemon/lemon: 29.25% (1.3049 => 1.6866, std.dev.: 0.0896) MultiSource/Applications/SIBsim4/SIBsim4: 29.13% (1.4444 => 1.8651, std.dev.: 0.0598) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.91% (4.4544 => 5.7423, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.81% (0.7136 => 0.9192, std.dev.: 0.0350) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.73% (0.1065 => 0.1371, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 28.66% (0.0478 => 0.0615, std.dev.: 0.0019) MultiSource/Applications/lua/lua: 28.52% (4.2609 => 5.4762, std.dev.: 0.4164) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 28.29% (0.6422 => 0.8239, std.dev.: 0.0248) SingleSource/Benchmarks/McGill/queens: 28.14% (0.0526 => 0.0674, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 28.12% (0.0658 => 0.0843, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/fbench: 27.79% (0.0727 => 0.0929, std.dev.: 0.0062) MultiSource/Applications/siod/siod: 27.30% (2.4773 => 3.1536, std.dev.: 0.0328) MultiSource/Applications/treecc/treecc: 27.22% (2.2303 => 2.8374, std.dev.: 0.0552) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.08% (0.7979 => 1.0140, std.dev.: 0.0613) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 26.98% (0.0882 => 0.1120, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 26.34% (0.0915 => 0.1156, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 26.13% (0.6984 => 0.8809, std.dev.: 0.0217) MultiSource/Benchmarks/Bullet/bullet: 25.59% (33.9215 => 42.6017, std.dev.: 2.1129) SingleSource/Benchmarks/Stanford/Queens: 25.45% (0.0440 => 0.0552, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 24.95% (3.5892 => 4.4848, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 24.75% (0.0408 => 0.0509, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 24.55% (0.0892 => 0.1111, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.15% (0.3308 => 0.4107, std.dev.: 0.0211) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.06% (1.2732 => 1.5795, std.dev.: 0.0760) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 24.01% (0.6214 => 0.7706, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 23.87% (0.8639 => 1.0701, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 23.78% (10.7438 => 13.2985, std.dev.: 0.1351) MultiSource/Benchmarks/BitBench/five11/five11: 23.55% (0.0586 => 0.0724, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/flops: 23.37% (0.1061 => 0.1309, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.19% (1.0742 => 1.3233, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.16% (1.6170 => 1.9915, std.dev.: 0.0854) SingleSource/Benchmarks/Misc-C++-EH/spirit: 23.11% (6.3604 => 7.8300, std.dev.: 0.2146) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 22.83% (0.1257 => 0.1544, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/pifft/pifft: 22.83% (0.9493 => 1.1660, std.dev.: 0.0501) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.81% (4.9896 => 6.1278, std.dev.: 0.3721) MultiSource/Applications/ClamAV/clamscan: 22.68% (16.3988 => 20.1178, std.dev.: 0.8308) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.65% (0.2150 => 0.2637, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: 22.56% (9.6864 => 11.8713, std.dev.: 0.7476) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 21.10% (0.0910 => 0.1102, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 20.88% (0.9166 => 1.1080, std.dev.: 0.0069) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.67% (0.1011 => 0.1220, std.dev.: 0.0065) MultiSource/Applications/aha/aha: 20.55% (0.1270 => 0.1531, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/lists: 20.54% (0.0774 => 0.0933, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.41% (14.7046 => 17.7065, std.dev.: 0.6149) MultiSource/Applications/oggenc/oggenc: 20.15% (5.5495 => 6.6677, std.dev.: 0.2059) MultiSource/Benchmarks/Olden/tsp/tsp: 19.97% (0.1337 => 0.1604, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.72% (4.6560 => 5.5740, std.dev.: 0.2930) MultiSource/Benchmarks/McCat/17-bintr/bintr: 19.27% (0.0794 => 0.0947, std.dev.: 0.0031) MultiSource/Applications/JM/ldecod/ldecod: 19.13% (7.3832 => 8.7953, std.dev.: 0.5030) MultiSource/Applications/JM/lencod/lencod: 19.11% (16.9136 => 20.1465, std.dev.: 0.7794) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 18.97% (1.4710 => 1.7500, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 18.74% (1.2922 => 1.5343, std.dev.: 0.0879) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 18.45% (0.2569 => 0.3043, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.41% (1.2605 => 1.4926, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.33% (1.3745 => 1.6265, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.10% (5.4896 => 6.4831, std.dev.: 0.2962) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.84% (1.3128 => 1.5470, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 17.76% (1.2624 => 1.4866, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 17.69% (1.3542 => 1.5937, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 17.68% (1.2925 => 1.5210, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 17.54% (0.5469 => 0.6428, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.11% (1.3513 => 1.5825, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 16.94% (0.0744 => 0.0870, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 16.84% (1.2647 => 1.4777, std.dev.: 0.0675) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 16.66% (1.3101 => 1.5283, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.48% (0.5120 => 0.5964, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 15.99% (1.2901 => 1.4964, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.98% (1.3770 => 1.5971, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.98% (1.2513 => 1.4513, std.dev.: 0.0135) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.82% (0.3698 => 0.4283, std.dev.: 0.0054) MultiSource/Benchmarks/sim/sim: 15.76% (0.3611 => 0.4180, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.66% (9.5425 => 11.0365, std.dev.: 0.2568) MultiSource/Applications/kimwitu++/kc: 15.47% (18.5606 => 21.4314, std.dev.: 0.9696) MultiSource/Applications/lambda-0_1_3/lambda: 15.29% (0.8112 => 0.9352, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 15.16% (1.2944 => 1.4906, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 15.12% (1.3019 => 1.4987, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.08% (1.2262 => 1.4111, std.dev.: 0.0537) MultiSource/Applications/sgefa/sgefa: 15.00% (0.4292 => 0.4936, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 14.89% (1.1891 => 1.3662, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 14.63% (1.3632 => 1.5627, std.dev.: 0.0265) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 14.61% (0.0801 => 0.0918, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 14.59% (1.2467 => 1.4286, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.44% (1.3779 => 1.5768, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 14.34% (1.3402 => 1.5324, std.dev.: 0.0540) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.19% (0.3348 => 0.3823, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.09% (1.2193 => 1.3911, std.dev.: 0.0641) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.99% (1.4552 => 1.6588, std.dev.: 0.0108) SingleSource/Benchmarks/Misc-C++/bigfib: 13.82% (0.7331 => 0.8344, std.dev.: 0.0184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 13.78% (0.0791 => 0.0900, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 13.76% (0.0981 => 0.1116, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.64% (0.2140 => 0.2432, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 13.48% (0.0749 => 0.0850, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.24% (1.3355 => 1.5123, std.dev.: 0.0614) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.20% (0.0826 => 0.0935, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 13.18% (0.0804 => 0.0910, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.02% (0.2904 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.92% (1.2621 => 1.4252, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.28% (0.9978 => 1.1203, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.00% (0.4025 => 0.4508, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/moments: 11.96% (0.3838 => 0.4297, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.95% (0.2804 => 0.3139, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: 11.69% (0.4713 => 0.5264, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.18% (1.1856 => 1.3181, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.03% (1.2549 => 1.3933, std.dev.: 0.0375) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 10.90% (0.1101 => 0.1221, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.84% (1.1888 => 1.3177, std.dev.: 0.0307) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.55% (0.1081 => 0.1195, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash: 10.12% (0.4427 => 0.4875, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.76% (0.2183 => 0.2396, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.43% (0.3255 => 0.3562, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary2: 6.26% (0.2701 => 0.2870, std.dev.: 0.0056) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 8.61% (9.6389 => 10.4685, std.dev.: 0.1499) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.32% (13.4908 => 14.2085, std.dev.: 0.0288) MultiSource/Benchmarks/Bullet/bullet: 4.43% (7.0966 => 7.4110, std.dev.: 0.0653) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.97% (1.0853 => 1.1175, std.dev.: 0.0102) MultiSource/Applications/SIBsim4/SIBsim4: 2.94% (3.2619 => 3.3579, std.dev.: 0.0134) SingleSource/Benchmarks/Misc/pi: 2.11% (2.1460 => 2.1912, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.10% (39.4842 => 40.3136, std.dev.: 0.2436) SingleSource/Benchmarks/Shootout-C++/random: 1.56% (2.4391 => 2.4772, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -28.90% (0.0699 => 0.0497, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/perlin: -15.36% (0.0742 => 0.0628, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/nbench/nbench: -3.90% (21.7770 => 20.9270, std.dev.: 0.2578) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.19% (1.9080 => 1.8472, std.dev.: 0.0204) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 16.15% (1.2346 => 1.4340, std.dev.: 0.1246) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.56% (0.0225 => 0.0233, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0440 => 0.0441, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.52% (0.0341 => 0.0353, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 21.22% (0.0278 => 0.0337, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.68% (0.0441 => 0.0438, std.dev.: 0.0161) SingleSource/UnitTests/Vector/Altivec/casts: -19.54% (0.0261 => 0.0210, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 7.14% (0.0224 => 0.0240, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -33.33% (0.0012 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.68% (0.1481 => 0.1471, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -5.28% (1.2073 => 1.1435, std.dev.: 0.3266) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.54% (0.4013 => 0.4195, std.dev.: 0.0819) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.68% (0.1490 => 0.1450, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.41% (0.0647 => 0.0612, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.46% (0.0274 => 0.0278, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.63% (0.0533 => 0.0547, std.dev.: 0.0142) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.98% (1.2884 => 1.3010, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.00% (0.0600 => 0.0612, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.64% (0.0349 => 0.0435, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.80% (1.7586 => 1.7726, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -15.79% (0.0057 => 0.0048, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.49% (34.4740 => 34.3062, std.dev.: 0.2028) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.60% (0.0336 => 0.1682, std.dev.: 0.0040) SingleSource/Regression/C/sumarraymalloc: 133.79% (0.0293 => 0.0685, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 101.82% (0.0274 => 0.0553, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 95.18% (0.1638 => 0.3197, std.dev.: 0.0381) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 84.07% (0.0383 => 0.0705, std.dev.: 0.0036) SingleSource/Regression/C++/EH/function_try_block: 78.19% (0.0243 => 0.0433, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 74.49% (23.5861 => 41.1556, std.dev.: 1.2289) SingleSource/UnitTests/SignlessTypes/Large/cast: 69.57% (0.0539 => 0.0914, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 67.84% (0.8893 => 1.4926, std.dev.: 0.0196) SingleSource/Regression/C/sumarray: 66.79% (0.0265 => 0.0442, std.dev.: 0.0067) SingleSource/Benchmarks/McGill/exptree: 65.31% (0.0859 => 0.1420, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 64.64% (0.9612 => 1.5825, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 64.08% (0.9120 => 1.4964, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 63.52% (0.9091 => 1.4866, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 62.91% (0.9381 => 1.5283, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 61.76% (0.9403 => 1.5210, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 61.43% (0.8990 => 1.4513, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 61.04% (1.0867 => 1.7500, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 60.74% (1.0119 => 1.6265, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 59.82% (0.9588 => 1.5324, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 59.67% (0.8926 => 1.4252, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 58.90% (0.9061 => 1.4398, std.dev.: 0.0722) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 58.57% (0.9855 => 1.5627, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 58.55% (1.0052 => 1.5937, std.dev.: 0.0107) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 58.21% (3.6295 => 5.7423, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 58.12% (0.9564 => 1.5123, std.dev.: 0.0614) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 57.71% (0.9998 => 1.5768, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 57.56% (0.9512 => 1.4987, std.dev.: 0.0438) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 57.12% (0.0688 => 0.1081, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 56.79% (0.9867 => 1.5470, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 56.75% (0.9788 => 1.5343, std.dev.: 0.0879) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 56.07% (1.4110 => 2.2021, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 55.54% (0.9422 => 1.4655, std.dev.: 0.1419) MultiSource/Benchmarks/FreeBench/mason/mason: 55.23% (0.0793 => 0.1231, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 52.98% (0.8912 => 1.3634, std.dev.: 0.0889) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 52.58% (0.9685 => 1.4777, std.dev.: 0.0675) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 52.37% (2.4519 => 3.7359, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 52.22% (0.9010 => 1.3715, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.84% (0.8736 => 1.3177, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.66% (1.8127 => 2.7311, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 50.57% (0.9488 => 1.4286, std.dev.: 0.0160) SingleSource/UnitTests/2006-12-11-LoadConstants: 50.00% (0.1274 => 0.1911, std.dev.: 0.0125) SingleSource/Regression/C/casts: 49.74% (0.0388 => 0.0581, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 49.69% (0.9127 => 1.3662, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 49.39% (1.0017 => 1.4964, std.dev.: 0.1288) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 49.16% (0.9993 => 1.4906, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.01% (0.8846 => 1.3181, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 48.87% (0.8732 => 1.2999, std.dev.: 0.0822) SingleSource/Benchmarks/Misc/himenobmtxpa: 48.64% (0.1955 => 0.2906, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 47.91% (0.9405 => 1.3911, std.dev.: 0.0641) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 47.76% (0.9550 => 1.4111, std.dev.: 0.0537) SingleSource/UnitTests/SignlessTypes/rem: 47.12% (0.1163 => 0.1711, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 47.06% (1.0860 => 1.5971, std.dev.: 0.0568) SingleSource/UnitTests/SignlessTypes/div: 46.56% (0.0320 => 0.0469, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.56% (0.9507 => 1.3933, std.dev.: 0.0375) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 45.06% (1.8651 => 2.7055, std.dev.: 0.1072) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 43.56% (0.2879 => 0.4133, std.dev.: 0.0411) SingleSource/UnitTests/2006-01-23-UnionInit: 42.75% (0.0269 => 0.0384, std.dev.: 0.0001) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 42.18% (0.0403 => 0.0573, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 41.75% (0.2915 => 0.4132, std.dev.: 0.0352) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 40.68% (0.4762 => 0.6699, std.dev.: 0.0256) MultiSource/Benchmarks/mafft/pairlocalalign: 39.69% (9.5202 => 13.2985, std.dev.: 0.1351) SingleSource/Benchmarks/Shootout-C++/wordfreq: 39.30% (0.3374 => 0.4700, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/distray/distray: 38.64% (0.1017 => 0.1410, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.01% (0.0805 => 0.1111, std.dev.: 0.0079) SingleSource/UnitTests/2003-07-09-SignedArgs: 37.82% (0.0275 => 0.0379, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 37.55% (0.0490 => 0.0674, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 37.19% (0.3598 => 0.4936, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/matrix: 36.91% (0.0821 => 0.1124, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 35.48% (16.4479 => 22.2844, std.dev.: 0.1192) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 35.05% (0.0856 => 0.1156, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 34.65% (1.0986 => 1.4793, std.dev.: 0.1053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 34.53% (0.0669 => 0.0900, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 33.88% (0.0738 => 0.0988, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fbench: 33.48% (0.0696 => 0.0929, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 33.33% (0.1305 => 0.1740, std.dev.: 0.0108) MultiSource/Benchmarks/Olden/bh/bh: 32.66% (0.3273 => 0.4342, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.40% (0.0642 => 0.0850, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 32.25% (0.0707 => 0.0935, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 31.96% (0.1793 => 0.2366, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 31.81% (0.7693 => 1.0140, std.dev.: 0.0613) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 31.55% (0.0783 => 0.1030, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 31.07% (0.1046 => 0.1371, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 30.41% (0.0845 => 0.1102, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/misr: 29.89% (0.0649 => 0.0843, std.dev.: 0.0054) MultiSource/Applications/SIBsim4/SIBsim4: 29.59% (1.4392 => 1.8651, std.dev.: 0.0598) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.83% (0.1332 => 0.1716, std.dev.: 0.0088) MultiSource/Benchmarks/MallocBench/espresso/espresso: 28.68% (5.0381 => 6.4831, std.dev.: 0.2962) MultiSource/Benchmarks/Bullet/bullet: 28.15% (33.2440 => 42.6017, std.dev.: 2.1129) SingleSource/Benchmarks/Misc/richards_benchmark: 27.69% (0.0798 => 0.1019, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 27.63% (0.0713 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.22% (0.7225 => 0.9192, std.dev.: 0.0350) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.13% (0.0457 => 0.0581, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 26.94% (0.0735 => 0.0933, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 26.79% (0.0963 => 0.1221, std.dev.: 0.0016) SingleSource/Benchmarks/Stanford/Queens: 26.61% (0.0436 => 0.0552, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 26.24% (1.2708 => 1.6042, std.dev.: 0.1224) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 25.61% (0.6135 => 0.7706, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.57% (0.2100 => 0.2637, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 24.79% (4.9104 => 6.1278, std.dev.: 0.3721) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.57% (1.2680 => 1.5795, std.dev.: 0.0760) MultiSource/Applications/oggenc/oggenc: 24.51% (5.3553 => 6.6677, std.dev.: 0.2059) SingleSource/Regression/C/uint64_to_float: 24.45% (0.0409 => 0.0509, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 24.33% (0.6711 => 0.8344, std.dev.: 0.0184) SingleSource/UnitTests/Vectorizer/gcc-loops: 23.69% (0.4596 => 0.5685, std.dev.: 0.0378) MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.19% (0.0775 => 0.0947, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 22.01% (17.5634 => 21.4292, std.dev.: 0.9096) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.00% (0.0918 => 0.1120, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 21.90% (6.4235 => 7.8300, std.dev.: 0.2146) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.59% (0.9214 => 1.1203, std.dev.: 0.0253) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.57% (0.0918 => 0.1116, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.17% (0.0718 => 0.0870, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 20.65% (1.3979 => 1.6866, std.dev.: 0.0896) MultiSource/Applications/JM/lencod/lencod: 20.63% (16.7012 => 20.1465, std.dev.: 0.7794) SingleSource/UnitTests/Vector/constpool: 20.06% (9.8875 => 11.8713, std.dev.: 0.7476) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.67% (4.6579 => 5.5740, std.dev.: 0.2930) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.67% (0.6885 => 0.8239, std.dev.: 0.0248) MultiSource/Applications/JM/ldecod/ldecod: 19.62% (7.3529 => 8.7953, std.dev.: 0.5030) MultiSource/Benchmarks/7zip/7zip-benchmark: 19.56% (44.1538 => 52.7920, std.dev.: 2.9273) MultiSource/Applications/siod/siod: 19.29% (2.6437 => 3.1536, std.dev.: 0.0328) MultiSource/Applications/d/make_dparser: 18.52% (3.7840 => 4.4848, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.43% (0.0776 => 0.0919, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.23% (14.9757 => 17.7065, std.dev.: 0.6149) SingleSource/Benchmarks/Misc/flops: 18.03% (0.1109 => 0.1309, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.02% (1.6874 => 1.9915, std.dev.: 0.0854) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.89% (0.5059 => 0.5964, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 17.81% (1.5979 => 1.8825, std.dev.: 0.0769) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.28% (0.9124 => 1.0701, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/tsp/tsp: 17.17% (0.1369 => 0.1604, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.66% (0.3277 => 0.3823, std.dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 15.38% (17.4365 => 20.1178, std.dev.: 0.8308) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.37% (0.3560 => 0.4107, std.dev.: 0.0211) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.16% (0.3093 => 0.3562, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.09% (1.1498 => 1.3233, std.dev.: 0.0210) MultiSource/Applications/treecc/treecc: 14.79% (2.4719 => 2.8374, std.dev.: 0.0552) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 14.51% (0.7693 => 0.8809, std.dev.: 0.0217) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.93% (1.0234 => 1.1660, std.dev.: 0.0501) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.43% (0.2144 => 0.2432, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 13.24% (0.3981 => 0.4508, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: 12.67% (0.2913 => 0.3282, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 12.52% (0.3715 => 0.4180, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 12.47% (0.2791 => 0.3139, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.33% (0.2709 => 0.3043, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 11.87% (0.5746 => 0.6428, std.dev.: 0.0110) SingleSource/Regression/C++/ofstream_ctor: 11.85% (0.2042 => 0.2284, std.dev.: 0.0042) SingleSource/Benchmarks/CoyoteBench/huffbench: 11.47% (0.1072 => 0.1195, std.dev.: 0.0035) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.46% (0.1071 => 0.1183, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.31% (0.2172 => 0.2396, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.80% (0.7686 => 0.8439, std.dev.: 0.0236) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.63% (1.5131 => 1.6588, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: 8.41% (1.0220 => 1.1080, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/ary2: 7.69% (0.2665 => 0.2870, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.46% (10.2703 => 11.0365, std.dev.: 0.2568) SingleSource/Benchmarks/Shootout-C++/moments: 7.37% (0.4002 => 0.4297, std.dev.: 0.0082) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.13% (0.4074 => 0.4283, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/objinst: 5.02% (0.2150 => 0.2258, std.dev.: 0.0034) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107650.00% (0.0008 => 0.8620, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/ary3: 417.25% (2.2304 => 11.5368, std.dev.: 0.8153) SingleSource/Benchmarks/Shootout/matrix: 358.42% (1.5825 => 7.2545, std.dev.: 0.0217) MultiSource/Applications/sgefa/sgefa: 258.61% (0.3515 => 1.2605, std.dev.: 0.0286) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.16% (1.1825 => 4.0461, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.36% (4.8185 => 15.8703, std.dev.: 0.0783) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 223.68% (0.0228 => 0.0738, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 203.88% (0.0129 => 0.0392, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 144.40% (0.0232 => 0.0567, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/matrix: 66.45% (2.9083 => 4.8409, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.51% (3.1254 => 4.1103, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.62% (1.4588 => 1.8472, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.16% (5.6033 => 7.0130, std.dev.: 0.0543) SingleSource/Regression/C/uint64_to_float: 22.91% (1.5397 => 1.8925, std.dev.: 0.0252) SingleSource/Benchmarks/Misc/salsa20: 21.79% (7.4497 => 9.0731, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.91% (4.8112 => 5.8173, std.dev.: 0.0639) MultiSource/Applications/JM/lencod/lencod: 16.40% (6.8159 => 7.9340, std.dev.: 0.2349) MultiSource/Benchmarks/7zip/7zip-benchmark: 16.21% (9.0082 => 10.4685, std.dev.: 0.1499) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.42% (5.1752 => 5.8696, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.15% (5.0033 => 5.6612, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.81% (3.6477 => 3.9690, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/ReedSolomon: 8.06% (8.6447 => 9.3417, std.dev.: 0.2078) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.19% (4.7473 => 5.0886, std.dev.: 0.0412) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.73% (0.6211 => 0.6567, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/chomp: 5.73% (1.0425 => 1.1022, std.dev.: 0.0129) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.46% (4.1836 => 4.4122, std.dev.: 0.0546) SingleSource/Benchmarks/Linpack/linpack-pc: 4.24% (50.8945 => 53.0500, std.dev.: 0.0910) MultiSource/Benchmarks/Bullet/bullet: 2.87% (7.2040 => 7.4110, std.dev.: 0.0653) SingleSource/Benchmarks/Misc/pi: 2.44% (2.1390 => 2.1912, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.29% (4.8076 => 4.8696, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.28% (5.9115 => 5.9869, std.dev.: 0.0095) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.81% (11.5523 => 3.9502, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/fp-convert: -61.84% (15.6525 => 5.9732, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -57.14% (0.4146 => 0.1777, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.65% (0.4578 => 0.2351, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.77% (11.3868 => 6.4023, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.92% (5.4023 => 3.6239, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.02% (0.4452 => 0.3071, std.dev.: 0.0161) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.28% (0.5495 => 0.3996, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.06% (5.2605 => 3.8898, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.16% (4.4467 => 3.3279, std.dev.: 0.0091) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.92% (0.5826 => 0.4374, std.dev.: 0.0428) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.81% (0.5897 => 0.4493, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.41% (4.9921 => 3.8232, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.23% (5.8755 => 4.8043, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.81% (16.6791 => 14.2085, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.15% (7.0016 => 6.0107, std.dev.: 0.0278) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.32% (0.1164 => 0.1009, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.73% (5.3626 => 4.6799, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.73% (3.1921 => 2.7858, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.39% (9.7992 => 8.5847, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.32% (5.7056 => 5.0024, std.dev.: 0.0393) SingleSource/Benchmarks/Shootout/hash: -8.06% (4.5259 => 4.1613, std.dev.: 0.1408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -7.70% (23.3986 => 21.5975, std.dev.: 0.6745) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.44% (5.5974 => 5.2372, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.84% (4.5424 => 4.2769, std.dev.: 0.0911) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.68% (4.9799 => 4.6970, std.dev.: 0.0552) SingleSource/Benchmarks/McGill/queens: -5.53% (1.7443 => 1.6479, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: -5.26% (3.5443 => 3.3579, std.dev.: 0.0134) MultiSource/Benchmarks/mafft/pairlocalalign: -5.25% (63.1520 => 59.8384, std.dev.: 0.0297) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (3.6768 => 3.5043, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.22% (3.5127 => 3.3646, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.78% (5.8973 => 5.6742, std.dev.: 0.0425) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.98% (1.4446 => 1.4015, std.dev.: 0.0131) SingleSource/Benchmarks/Misc/mandel-2: -2.17% (0.8521 => 0.8336, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: -1.90% (2.8571 => 2.8027, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.74% (8.7327 => 8.5804, std.dev.: 0.0059) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.63% (85.3042 => 83.9170, std.dev.: 0.0922) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.32% (8.8249 => 8.7081, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/whetstone: -1.30% (1.6251 => 1.6040, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (3.7450 => 3.7038, std.dev.: 0.0018) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 19.03% (1.2047 => 1.4340, std.dev.: 0.1246) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0233 => 0.0233, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.22% (0.0451 => 0.0441, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.41% (0.0394 => 0.0353, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.74% (0.0328 => 0.0337, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.57% (0.0445 => 0.0438, std.dev.: 0.0161) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 5.73% (0.0227 => 0.0240, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0058) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.86% (0.1530 => 0.1471, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -40.73% (1.9293 => 1.1435, std.dev.: 0.3266) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.61% (0.4049 => 0.4195, std.dev.: 0.0819) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.97% (0.1510 => 0.1450, std.dev.: 0.0580) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.42% (0.0978 => 0.0612, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.29% (0.0590 => 0.0547, std.dev.: 0.0142) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.99% (1.1617 => 1.3010, std.dev.: 0.0101) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 62.31% (0.0268 => 0.0435, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.35% (0.7437 => 1.7726, std.dev.: 0.0031) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0000) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -25.00% (0.0008 => 0.0006, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.83% (0.0092 => 0.0048, std.dev.: 0.0038) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.48% (12.7781 => 34.3062, std.dev.: 0.2028) Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Sun Jan 27 23:15:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 01:15:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128071517.38B442A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8029?compare_to=8025&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8029, Order: 173654, Start Time: 2013-01-28 04:55:59, End Time: 2013-01-28 07:15:36 To: 8025, Order: 173645, Start Time: 2013-01-28 02:06:17, End Time: 2013-01-28 04:25:24 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (274 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (596 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/flops: 2.91% (0.3980 => 0.4096, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.80% (131.4115 => 133.7751, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.28% (0.6537 => 0.6686, std.dev.: 0.0054) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1329 => 0.1330, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.22% (0.0652 => 0.0673, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8465 => 499.8403, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.87% (1.1277 => 499.8403, std.dev.: 0.0088) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 269.04% (0.5229 => 1.9297, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 45.30% (14.9895 => 21.7793, std.dev.: 0.0114) MultiSource/Applications/kimwitu++/kc: 63.16% (14.1553 => 23.0951, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/gs/gs: 30.50% (4.1105 => 5.3644, std.dev.: 0.0156) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 90.04% (1.1048 => 2.0996, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1768.84% (7.1582 => 133.7751, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 128.51% (3.4629 => 7.9132, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 101.16% (0.6222 => 1.2516, std.dev.: 0.0057) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10278.19% (0.0720 => 7.4723, std.dev.: 0.0117) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11171600.00% (0.0001 => 11.1717, std.dev.: 0.0603) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5486400.00% (0.0001 => 5.4865, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 831.94% (1.1194 => 10.4321, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: 186.03% (0.1432 => 0.4096, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 171.62% (0.0296 => 0.0804, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 156.97% (22.1758 => 56.9862, std.dev.: 0.0412) SingleSource/Benchmarks/Misc/lowercase: 141.02% (0.0256 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 138.07% (0.1056 => 0.2514, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 114.40% (0.0243 => 0.0521, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/objinst: 109.13% (0.0427 => 0.0893, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.63% (0.0929 => 0.1901, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 101.96% (7.0540 => 14.2464, std.dev.: 0.0108) SingleSource/Benchmarks/CoyoteBench/almabench: 91.10% (0.0730 => 0.1395, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 89.47% (0.1463 => 0.2772, std.dev.: 0.0001) SingleSource/Regression/C/casts: 85.85% (0.0318 => 0.0591, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 83.54% (0.0237 => 0.0435, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 80.64% (0.0377 => 0.0681, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 78.94% (0.2554 => 0.4570, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 76.99% (0.0439 => 0.0777, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 75.90% (1.5859 => 2.7896, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0000) SingleSource/UnitTests/Vector/simple: 66.49% (0.0185 => 0.0308, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 65.74% (0.0394 => 0.0653, std.dev.: 0.0001) SingleSource/Regression/C++/EH/function_try_block: 65.67% (0.0268 => 0.0444, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 64.40% (2.2024 => 3.6207, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.32% (2.9384 => 4.7697, std.dev.: 0.0006) SingleSource/UnitTests/2002-05-02-CastTest: 61.47% (0.0218 => 0.0352, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 60.97% (8.1363 => 13.0971, std.dev.: 0.0046) SingleSource/UnitTests/2006-12-11-LoadConstants: 60.72% (0.1143 => 0.1837, std.dev.: 0.0000) SingleSource/Regression/C/testtrace: 60.38% (0.0212 => 0.0340) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 59.91% (0.0217 => 0.0347, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 59.31% (0.0231 => 0.0368, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-31-CastToBool: 57.43% (0.0202 => 0.0318, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 57.08% (0.0636 => 0.0999, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 56.28% (1.5415 => 2.4091, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 54.74% (0.0232 => 0.0359) MultiSource/Applications/sgefa/sgefa: 54.23% (0.3109 => 0.4795, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 53.73% (0.0953 => 0.1465, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 53.37% (1.1642 => 1.7855, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 50.23% (0.6675 => 1.0028, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 49.94% (0.0793 => 0.1189, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 49.34% (0.1062 => 0.1586, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 49.16% (0.1125 => 0.1678, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 49.07% (21.9371 => 32.7014, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 49.02% (0.0457 => 0.0681, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.61% (3.8922 => 5.7843, std.dev.: 0.0066) MultiSource/Benchmarks/Olden/voronoi/voronoi: 48.33% (0.2700 => 0.4005, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 47.30% (0.0814 => 0.1199, std.dev.: 0.0003) SingleSource/UnitTests/2003-07-09-SignedArgs: 47.16% (0.0282 => 0.0415) MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.00% (4.2646 => 6.2691, std.dev.: 0.0142) MultiSource/Applications/lemon/lemon: 46.87% (1.0722 => 1.5747, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/Large/cast: 46.81% (0.0564 => 0.0828, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 45.92% (0.0527 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 45.67% (0.0462 => 0.0673, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 45.61% (0.7115 => 1.0360, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 45.51% (0.0479 => 0.0697, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 45.47% (0.0640 => 0.0931, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: 44.87% (0.0818 => 0.1185, std.dev.: 0.0003) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/div: 43.41% (0.0258 => 0.0370) SingleSource/Benchmarks/BenchmarkGame/partialsums: 43.27% (0.0245 => 0.0351) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 43.25% (0.0467 => 0.0669, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/shr: 42.86% (0.0252 => 0.0360) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.82% (0.5105 => 0.7291, std.dev.: 0.0005) SingleSource/UnitTests/block-copied-in-cxxobj: 42.58% (0.0310 => 0.0442, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.56% (0.4615 => 0.6579, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 42.48% (2.2969 => 3.2726, std.dev.: 0.0148) SingleSource/UnitTests/ObjC/messages-2: 42.45% (0.0662 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 41.78% (0.0730 => 0.1035, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.44% (0.2271 => 0.3212, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 41.27% (9.4845 => 13.3988, std.dev.: 0.0180) MultiSource/Benchmarks/Olden/bh/bh: 41.14% (0.3092 => 0.4364, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 40.85% (0.1175 => 0.1655, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 40.63% (0.6456 => 0.9079, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 40.53% (0.1695 => 0.2382, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.33% (0.0672 => 0.0943, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 40.18% (0.1655 => 0.2320, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.08% (0.0746 => 0.1045, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 39.94% (0.1555 => 0.2176, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.51% (0.5860 => 0.8175, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/family/family: 39.04% (0.0397 => 0.0552) MultiSource/Benchmarks/NPB-serial/is/is: 38.53% (0.0719 => 0.0996, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 38.43% (2.0273 => 2.8064, std.dev.: 0.0107) SingleSource/UnitTests/Vector/build2: 38.31% (0.0295 => 0.0408) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 38.18% (0.0770 => 0.1064, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 38.18% (0.1032 => 0.1426, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 38.16% (3.8723 => 5.3499, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout/hash: 38.14% (0.0485 => 0.0670, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 38.07% (0.0675 => 0.0932, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 38.06% (0.4299 => 0.5935, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 38.04% (0.3441 => 0.4750, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 37.74% (0.1044 => 0.1438, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 37.69% (0.7835 => 1.0788, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.64% (1.4186 => 1.9526, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 37.37% (1.1840 => 1.6265, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 37.11% (3.3354 => 4.5733, std.dev.: 0.0059) MultiSource/Benchmarks/Bullet/bullet: 37.08% (63.2438 => 86.6966, std.dev.: 0.0394) SingleSource/Benchmarks/Shootout/lists: 37.06% (0.0626 => 0.0858) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.89% (0.3307 => 0.4527, std.dev.: 0.0036) MultiSource/Applications/oggenc/oggenc: 36.87% (5.7591 => 7.8825, std.dev.: 0.0118) MultiSource/Applications/sqlite3/sqlite3: 36.67% (17.1811 => 23.4822, std.dev.: 0.0195) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.45% (0.3427 => 0.4676, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.42% (0.5569 => 0.7597, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/em3d/em3d: 36.17% (0.1695 => 0.2308, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages: 36.09% (0.0327 => 0.0445, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 35.96% (0.1268 => 0.1724, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Queens: 35.75% (0.0414 => 0.0562, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 35.64% (0.3423 => 0.4643, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.57% (0.1892 => 0.2565, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.57% (0.3121 => 0.4231, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: 35.45% (0.0660 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 35.37% (0.0933 => 0.1263, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 35.35% (0.0447 => 0.0605, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 35.03% (0.4879 => 0.6588, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 35.02% (0.4620 => 0.6238, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 35.01% (0.1151 => 0.1554, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 34.99% (0.2758 => 0.3723, std.dev.: 0.0019) SingleSource/UnitTests/2003-08-11-VaListArg: 34.81% (0.0316 => 0.0426, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.79% (0.1584 => 0.2135, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.78% (0.0437 => 0.0589, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: 34.40% (0.0811 => 0.1090, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 34.09% (0.4289 => 0.5751, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 34.09% (0.0842 => 0.1129, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 34.00% (0.0403 => 0.0540, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 33.75% (0.1117 => 0.1494, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.69% (1.1861 => 1.5857, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.51% (0.2107 => 0.2813, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 33.30% (0.0886 => 0.1181, std.dev.: 0.0002) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.90% (0.0389 => 0.0517) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.82% (0.1566 => 0.2080, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.82% (0.0326 => 0.0433, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.58% (0.0528 => 0.0700, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 32.50% (0.1163 => 0.1541, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 32.47% (0.0770 => 0.1020, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.28% (0.1236 => 0.1635, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 32.09% (0.3387 => 0.4474, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 31.93% (0.7433 => 0.9806, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 31.92% (0.0614 => 0.0810, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 31.59% (0.0592 => 0.0779, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.24% (0.8172 => 1.0725, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 31.20% (0.1029 => 0.1350, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: 31.12% (0.0482 => 0.0632, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.03% (0.1940 => 0.2542, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.93% (0.5981 => 0.7831, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.77% (1.3050 => 1.7065, std.dev.: 0.0094) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.64% (0.0408 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.43% (0.6450 => 0.8413, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.26% (0.1510 => 0.1967, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 30.25% (0.3180 => 0.4142, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.06% (0.1906 => 0.2479, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 30.02% (0.8067 => 1.0489, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Towers: 29.72% (0.0471 => 0.0611, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0014) SingleSource/Regression/C++/EH/exception_spec_test: 29.43% (0.0350 => 0.0453, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/rem: 29.37% (0.1144 => 0.1480, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.17% (0.9765 => 1.2613, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/treeadd/treeadd: 29.09% (0.0416 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 29.07% (0.8921 => 1.1514, std.dev.: 0.0027) SingleSource/Benchmarks/CoyoteBench/huffbench: 29.05% (0.0871 => 0.1124) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.03% (4.9449 => 6.3803, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.02% (0.1337 => 0.1725, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.80% (0.5020 => 0.6466, std.dev.: 0.0113) SingleSource/Benchmarks/McGill/misr: 28.75% (0.0633 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 28.57% (0.0567 => 0.0729, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.48% (0.8101 => 1.0408, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.47% (0.2603 => 0.3344, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.00% (5.0018 => 6.4022, std.dev.: 0.0102) MultiSource/Applications/hbd/hbd: 27.99% (1.5603 => 1.9971, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Treesort: 27.98% (0.0411 => 0.0526, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/matrix: 27.18% (0.3098 => 0.3940, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.07% (0.3177 => 0.4037, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.05% (0.2266 => 0.2879, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.43% (0.4203 => 0.5314, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.61% (0.3865 => 0.4855, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/dry: 25.44% (0.0456 => 0.0572, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.11% (0.0442 => 0.0553, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.06% (0.0443 => 0.0554, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 24.84% (0.4103 => 0.5122, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 24.31% (0.0798 => 0.0992, std.dev.: 0.0011) SingleSource/Regression/C/bigstack: 24.22% (0.0417 => 0.0518, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.80% (0.0479 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 23.75% (0.1625 => 0.2011, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: 23.75% (0.1440 => 0.1782, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.61% (0.0648 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.38% (0.0834 => 0.1029, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0481 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.01% (0.0491 => 0.0604, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.02% (0.0704 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.64% (14.3668 => 17.4756, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.63% (0.1114 => 0.1355) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.14% (0.4064 => 0.4923, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.79% (0.4636 => 0.5600, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.63% (0.2065 => 0.2491, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary3: 20.35% (0.3283 => 0.3951, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 20.34% (0.0536 => 0.0645, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 20.25% (0.2049 => 0.2464, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 20.02% (0.3232 => 0.3879, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.67% (0.2430 => 0.2908, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 19.56% (0.3379 => 0.4040, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.37% (0.0759 => 0.0906, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/moments: 19.32% (0.4048 => 0.4830, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 19.29% (0.3282 => 0.3915, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.21% (0.0838 => 0.0999) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.48% (0.3826 => 0.4533, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/sieve: 18.43% (0.3603 => 0.4267, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.29% (0.1438 => 0.1701, std.dev.: 0.0001) SingleSource/UnitTests/initp1: 18.20% (0.0555 => 0.0656, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 17.56% (0.3684 => 0.4331, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 17.24% (0.3422 => 0.4012, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 16.59% (0.2905 => 0.3387, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 16.16% (0.3886 => 0.4514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.92% (0.3650 => 0.4231, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.78% (0.3935 => 0.4556, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ffbench: 15.32% (0.0705 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 14.63% (2.2022 => 2.5243, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.21% (0.1330 => 0.1519, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 14.04% (0.1268 => 0.1446, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 13.62% (1.2842 => 1.4591, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/parameter-passing: 13.27% (0.3927 => 0.4448, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.00% (0.3162 => 0.3573, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 12.50% (0.2831 => 0.3185, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/except: 12.09% (0.2871 => 0.3218, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.07% (2.0665 => 2.3159, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions: 11.81% (0.3828 => 0.4280, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 11.75% (0.2877 => 0.3215, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.65% (7.9617 => 8.8893, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.03% (0.3136 => 0.3482, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.74% (0.2756 => 0.3052, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2891 => 0.3185, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.13% (0.2725 => 0.3001, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.03% (0.3052 => 0.3358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.99% (0.2793 => 0.3072) SingleSource/Benchmarks/Shootout-C++/hello: 9.91% (0.2714 => 0.2983, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.60% (0.2802 => 0.3071, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 9.55% (10.3673 => 11.3569, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.54% (0.2872 => 0.3146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.47% (0.7326 => 0.8020, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.6030 => 0.6601, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: 9.42% (0.3694 => 0.4042, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/synchronized: 9.15% (0.3561 => 0.3887, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 9.13% (0.3516 => 0.3837, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.12% (0.3543 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 9.09% (0.3543 => 0.3865, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.04% (0.3497 => 0.3813, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 8.98% (0.3473 => 0.3785, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.09% (0.3131 => 0.3353, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4740, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2444, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4256, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (4.2280 => 4.4428, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1063, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.35% (0.9957 => 1.0291, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.41% (8.6802 => 8.8893, std.dev.: 0.0144) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7208, std.dev.: 0.0072) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.92% (0.8333 => 0.8493, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2780, std.dev.: 0.0435) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2400, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4560, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0045) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.76% (6.6874 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.57% (5.2763 => 1.2891, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -35.39% (0.1622 => 0.1048, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -9.02% (5.3855 => 4.8997, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.43% (5.3526 => 4.9013, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -7.67% (54.1659 => 50.0134, std.dev.: 0.0192) MultiSource/Applications/JM/ldecod/ldecod: -5.01% (10.4361 => 9.9129, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.91% (1.7609 => 1.6921, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.85% (1.9577 => 0.6686, std.dev.: 0.0054) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3076, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel-2: -33.38% (1.5373 => 1.0242, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7660, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4303, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8482, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.85% (0.2161 => 0.1732, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1273, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-6: -15.67% (1.6925 => 1.4273, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.97% (0.9540 => 0.8398, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: -11.14% (9.5636 => 8.4983, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7061, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5731, std.dev.: 0.0722) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5786, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: -6.05% (1.2373 => 1.1625, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.61% (8.1563 => 7.6988, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.66% (1.5835 => 1.5097, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/salsa20: -4.43% (10.2830 => 9.8278, std.dev.: 0.0111) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: -1.68% (3.7221 => 3.6596, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: -1.32% (3.6994 => 3.6507, std.dev.: 0.0143) MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.6441 => 4.5887, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2277, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0079) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.19% (0.2116 => 0.0673, std.dev.: 0.0024) Report Time: 1.57s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 00:07:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 02:07:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128080731.2678F2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8030?compare_to=8027&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8030, Order: 173663, Start Time: 2013-01-28 06:29:10, End Time: 2013-01-28 08:07:50 To: 8027, Order: 173653, Start Time: 2013-01-28 04:29:03, End Time: 2013-01-28 06:05:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (218 on baseline) Performance Improvements: 0 (69 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (805 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.75% (0.0315 => 0.0730, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 92.50% (0.0280 => 0.0539, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 83.40% (0.0717 => 0.1315, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.10% (0.0514 => 0.0936, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 74.64% (0.0974 => 0.1701, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 64.05% (0.1132 => 0.1857, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 59.80% (0.1500 => 0.2397, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 49.85% (22.4056 => 33.5737, std.dev.: 0.5900) SingleSource/Regression/C/sumarraymalloc: 48.69% (0.0267 => 0.0397, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 47.57% (0.6395 => 0.9437, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 47.41% (0.0599 => 0.0883, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 45.98% (1.6474 => 2.4048, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 44.47% (0.0371 => 0.0536, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/objinst: 42.01% (0.0407 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.75% (0.6395 => 0.9065, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 41.63% (0.0418 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.39% (0.5688 => 0.8042, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.29% (0.6260 => 0.8845, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.15% (0.5805 => 0.8194, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.06% (0.5456 => 0.7696, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 40.62% (0.5849 => 0.8225, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.49% (0.5567 => 0.7821, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.19% (0.5581 => 0.7824, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 39.96% (0.5575 => 0.7803, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.40% (0.5941 => 0.8282, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.83% (0.5859 => 0.8134, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.37% (0.6033 => 0.8348, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 38.20% (0.0699 => 0.0966, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 37.98% (2.2587 => 3.1165, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 37.93% (0.6440 => 0.8883, std.dev.: 0.0160) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.53% (0.0445 => 0.0612, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.24% (0.6676 => 0.9162, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.07% (0.6189 => 0.8483, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 36.93% (0.6230 => 0.8531, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 36.86% (0.0293 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.18% (0.6304 => 0.8585, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 35.91% (0.0582 => 0.0791, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 35.71% (0.5802 => 0.7874, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 35.66% (0.5925 => 0.8038, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.42% (0.6660 => 0.9019, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.25% (0.5705 => 0.7716, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 34.76% (0.5857 => 0.7893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.63% (0.5478 => 0.7375, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 34.55% (0.5569 => 0.7493, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.49% (0.5570 => 0.7491, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 33.89% (0.5591 => 0.7486, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 33.20% (1.1450 => 1.5251, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.12% (0.5863 => 0.7805, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 32.95% (0.6446 => 0.8570, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.93% (0.6052 => 0.8045, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 32.67% (0.7524 => 0.9982, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 32.53% (0.0790 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 32.23% (0.2659 => 0.3516, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.08% (0.6681 => 0.8824, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 31.92% (0.6194 => 0.8171, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.36% (0.6297 => 0.8272, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 30.88% (0.0693 => 0.0907, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.73% (0.1230 => 0.1608, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 30.71% (0.0622 => 0.0813, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 30.40% (0.6667 => 0.8694, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 30.40% (0.0556 => 0.0725, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.27% (0.0621 => 0.0809, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 29.64% (1.6364 => 2.1215, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.76% (0.7339 => 0.9450, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 28.69% (0.0833 => 0.1072, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.09% (0.0680 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.96% (3.5339 => 4.5219, std.dev.: 0.0130) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.92% (0.0634 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.00% (0.1796 => 0.2281, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.33% (0.0566 => 0.0715, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.20% (1.2784 => 1.6134, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++-EH/spirit: 25.73% (5.4682 => 6.8749, std.dev.: 0.0189) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.57% (0.1146 => 0.1439, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 24.99% (1.2515 => 1.5643, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 24.89% (0.0707 => 0.0883, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.84% (0.7021 => 0.8765, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 24.81% (0.3357 => 0.4190, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 24.65% (0.0864 => 0.1077, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 22.71% (0.0665 => 0.0816, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.57% (0.0731 => 0.0896, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.48% (0.1081 => 0.1324, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.22% (4.5069 => 5.5084, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 21.11% (15.5079 => 18.7817, std.dev.: 0.0145) MultiSource/Benchmarks/FreeBench/mason/mason: 21.10% (0.0621 => 0.0752, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 20.68% (0.1731 => 0.2089, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 20.40% (9.2283 => 11.1113, std.dev.: 0.2428) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.73% (0.0806 => 0.0965, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 19.61% (0.0571 => 0.0683) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.51% (0.4916 => 0.5875, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.32% (0.0885 => 0.1056, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 19.27% (0.6750 => 0.8051, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 18.95% (0.5329 => 0.6339, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 18.88% (0.7447 => 0.8853, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.82% (0.1982 => 0.2355, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 18.58% (0.4515 => 0.5354, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.54% (0.0604 => 0.0716, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 18.39% (0.0919 => 0.1088, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.32% (0.2385 => 0.2822, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.19% (0.0764 => 0.0903, std.dev.: 0.0033) MultiSource/Applications/siod/siod: 18.18% (2.4021 => 2.8389, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.15% (0.0617 => 0.0729, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/bh/bh: 18.12% (0.2985 => 0.3526, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.94% (0.3483 => 0.4108, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 17.54% (1.3864 => 1.6296, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.06% (0.0598 => 0.0700, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.04% (1.4642 => 1.7137, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 16.97% (17.1032 => 20.0057, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.30% (0.1509 => 0.1755, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: 16.11% (0.4861 => 0.5644, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.09% (2.1401 => 2.4845, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 16.07% (0.1674 => 0.1943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.06% (0.0710 => 0.0824, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 15.90% (0.1761 => 0.2041, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 15.69% (0.4524 => 0.5234, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 15.69% (5.0226 => 5.8105, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 15.66% (0.2548 => 0.2947, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.65% (0.6293 => 0.7278, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 15.50% (0.3491 => 0.4032, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.42% (0.9557 => 1.1031, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages-2: 15.34% (0.0704 => 0.0812, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 15.24% (4.0594 => 4.6781, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 15.24% (34.0927 => 39.2869, std.dev.: 0.8284) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.05% (0.1096 => 0.1261, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: 15.01% (0.0686 => 0.0789, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 14.99% (0.8418 => 0.9680, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.95% (0.1077 => 0.1238, std.dev.: 0.0039) MultiSource/Benchmarks/NPB-serial/is/is: 14.83% (0.0708 => 0.0813) MultiSource/Benchmarks/nbench/nbench: 14.61% (1.1530 => 1.3215, std.dev.: 0.0171) MultiSource/Applications/d/make_dparser: 14.60% (3.5154 => 4.0286, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/matrix: 14.30% (0.0797 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.17% (0.0741 => 0.0846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.14% (0.5999 => 0.6787, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.01% (1.2300 => 1.3900, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.96% (0.3658 => 0.4132, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.38% (0.3319 => 0.3730, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.24% (0.2001 => 0.2246, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 12.20% (0.3581 => 0.4018, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 12.01% (18.2933 => 20.4906, std.dev.: 0.0085) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.88% (0.1145 => 0.1281, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.71% (0.1290 => 0.1441, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 11.68% (15.2527 => 17.0337, std.dev.: 0.0471) MultiSource/Benchmarks/Olden/em3d/em3d: 11.65% (0.1862 => 0.2079, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.64% (0.0919 => 0.1026, std.dev.: 0.0027) SingleSource/UnitTests/SignlessTypes/rem: 11.45% (0.1197 => 0.1334, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.16% (0.0932 => 0.1036, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.07% (0.2999 => 0.3331, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.88% (0.0974 => 0.1080, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/power/power: 10.83% (0.1154 => 0.1279, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 10.75% (0.3255 => 0.3605, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.74% (0.1173 => 0.1299, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.71% (4.0323 => 4.4640, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.65% (0.1108 => 0.1226, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.40% (0.2278 => 0.2515, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 10.03% (1.5610 => 1.7176, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/mst/mst: 9.83% (0.1271 => 0.1396, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 9.69% (0.1879 => 0.2061, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 9.67% (0.1076 => 0.1180, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: 9.65% (0.9179 => 1.0065, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.64% (0.2106 => 0.2309) MultiSource/Benchmarks/Olden/tsp/tsp: 9.57% (0.1202 => 0.1317, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.56% (0.4427 => 0.4850, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.44% (0.6736 => 0.7372, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 9.32% (0.3271 => 0.3576, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.31% (1.3722 => 1.4999, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.23% (0.5168 => 0.5645, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.13% (0.1621 => 0.1769, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.11% (0.7982 => 0.8709, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.08% (0.7919 => 0.8638, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.00% (0.7198 => 0.7846, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 8.84% (0.1211 => 0.1318, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.33% (0.1441 => 0.1561, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.25% (0.4083 => 0.4420, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.85% (0.8521 => 0.9190, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.64% (0.3142 => 0.3382, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.58% (0.9077 => 0.9765, std.dev.: 0.0024) MultiSource/Applications/JM/ldecod/ldecod: 7.56% (7.0961 => 7.6329, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.46% (4.8161 => 5.1753, std.dev.: 0.0099) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2695 => 0.2894, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: 7.30% (4.3330 => 4.6491, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.29% (16.1920 => 17.3730, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.26% (4.8802 => 5.2344, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (8.0126 => 8.5658, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.85% (0.6484 => 0.6928, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.84% (1.0544 => 1.1265, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 6.80% (2.4924 => 2.6620, std.dev.: 0.0534) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.69% (0.4321 => 0.4610, std.dev.: 0.0096) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.32% (6.7716 => 7.1993, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 6.30% (0.3446 => 0.3663, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.07% (0.3394 => 0.3600, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.94% (14.2083 => 15.0519, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.72% (0.3849 => 0.4069, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.42% (0.4151 => 0.4376, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.29% (1.2221 => 1.2867, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.28% (1.2210 => 1.2855, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.19% (0.4813 => 0.5063, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2355 => 0.2474, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 4.93% (0.3406 => 0.3574, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.80% (0.9852 => 1.0325, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 4.48% (0.3481 => 0.3637, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.05% (0.4248 => 0.4420, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 3.72% (0.3788 => 0.3929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 3.36% (0.3867 => 0.3997, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.08% (0.9542 => 0.9740, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7945, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0032) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1484, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.20% (54.5751 => 56.3197, std.dev.: 0.1717) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1039, std.dev.: 0.0111) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3836, std.dev.: 0.1240) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6067, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5076, std.dev.: 0.0189) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -3.96% (0.3812 => 0.3661, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.84% (0.3831 => 0.3684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.72% (0.3896 => 0.3751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.42% (0.4033 => 0.3895, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.22% (0.3884 => 0.3759, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.98% (0.6347 => 0.6158, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.91% (20.7746 => 20.1702, std.dev.: 0.0300) SingleSource/UnitTests/ObjC++/property-reference-object: -2.16% (0.6441 => 0.6302, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.41% (0.7779 => 0.7669, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.56% (1.8100 => 0.6777, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.72% (1.3643 => 1.0270, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7501, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0870, std.dev.: 0.4208) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.28% (2.5106 => 2.1270, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0303) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3534, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.06% (4.1534 => 3.8188, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0278) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0306) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0101) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1788, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/oourafft: -3.30% (5.5807 => 5.3964, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (7.9763 => 7.7501, std.dev.: 0.0109) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.3096 => 1.2813, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.49% (1.6307 => 1.6064, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.06% (1.6086 => 1.5916, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 00:49:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 02:49:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128084922.F29462A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8031?compare_to=8028&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8031, Order: 173664, Start Time: 2013-01-28 06:37:36, End Time: 2013-01-28 08:49:44 To: 8028, Order: 173653, Start Time: 2013-01-28 04:05:00, End Time: 2013-01-28 06:17:04 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (174 on baseline) Performance Improvements: 8 (41 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1042 (848 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/strcat: 9.79% (0.2156 => 0.2367, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 7.71% (21.4292 => 23.0805, std.dev.: 0.0865) MultiSource/Applications/lemon/lemon: 4.00% (1.6866 => 1.7540, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/hash: 3.55% (0.4875 => 0.5048, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.41% (0.8352 => 0.8553, std.dev.: 0.0044) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: 39.11% (3.2347 => 4.4997, std.dev.: 0.0803) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.78% (1.4611 => 1.8524, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.08% (44.3413 => 47.4818, std.dev.: 0.7319) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.06% (21.5975 => 22.9069, std.dev.: 0.1249) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.92% (0.5322 => 0.5584, std.dev.: 0.0033) MultiSource/Benchmarks/llubenchmark/llu: 4.41% (2.0338 => 2.1234, std.dev.: 0.0248) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.89% (1.5487 => 1.5934, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.42% (4.6970 => 4.8107, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.83% (15.8703 => 16.1600, std.dev.: 0.0472) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -21.32% (0.0544 => 0.0428, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -17.95% (0.4133 => 0.3391, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C++/objects/objects: -9.78% (0.1247 => 0.1125, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.18% (1.4513 => 1.3906, std.dev.: 0.0214) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.31% (0.7033 => 0.6800, std.dev.: 0.0082) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -22.78% (4.7007 => 3.6299, std.dev.: 0.3991) SingleSource/Benchmarks/CoyoteBench/fftbench: -10.63% (1.8249 => 1.6310, std.dev.: 0.0684) SingleSource/Benchmarks/Shootout-C++/matrix: -1.64% (4.8409 => 4.7617, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.78% (1.4340 => 1.4595, std.dev.: 0.0333) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.73% (0.0233 => 0.0265, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.72% (0.0441 => 0.0453, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.12% (0.0353 => 0.0364, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.59% (0.0337 => 0.0339, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.97% (0.0438 => 0.0451, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: 2.86% (0.0210 => 0.0216, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: 36.25% (0.0240 => 0.0327, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0252 => 0.0252, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 10.94% (0.1471 => 0.1632, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: 20.28% (1.1435 => 1.3754, std.dev.: 0.1712) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.91% (0.4195 => 0.4317, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.10% (0.1450 => 0.1495, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.49% (0.0612 => 0.0609, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0278 => 0.0277, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.51% (0.0547 => 0.0599, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.11% (1.3010 => 1.2866, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.65% (0.0612 => 0.0616, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.94% (0.0435 => 0.0370, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.84% (1.7726 => 1.7400, std.dev.: 0.0161) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 137.50% (0.0048 => 0.0114, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.41% (34.3062 => 34.4466, std.dev.: 0.1929) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 408.04% (0.0336 => 0.1707, std.dev.: 0.0167) SingleSource/Regression/C/sumarraymalloc: 134.81% (0.0293 => 0.0688, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 99.27% (0.0274 => 0.0546, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 87.91% (0.1638 => 0.3078, std.dev.: 0.0075) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 84.60% (0.0383 => 0.0707, std.dev.: 0.0007) SingleSource/Regression/C++/EH/function_try_block: 82.72% (0.0243 => 0.0444, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 73.28% (0.0539 => 0.0934, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 72.25% (23.5861 => 40.6276, std.dev.: 1.4036) SingleSource/Benchmarks/McGill/exptree: 60.30% (0.0859 => 0.1377, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 58.43% (0.0688 => 0.1090, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.83% (0.9120 => 1.4303, std.dev.: 0.0677) SingleSource/UnitTests/SignlessTypes/shr: 56.77% (0.0310 => 0.0486, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 56.62% (0.8893 => 1.3928, std.dev.: 0.0553) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.61% (0.9612 => 1.5053, std.dev.: 0.0822) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 56.24% (0.9588 => 1.4980, std.dev.: 0.0560) MultiSource/Benchmarks/FreeBench/mason/mason: 56.12% (0.0793 => 0.1238, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 56.06% (0.9381 => 1.4640, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 55.90% (0.9061 => 1.4126, std.dev.: 0.1004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 55.10% (0.9564 => 1.4834, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 55.10% (0.8926 => 1.3844, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 54.87% (0.9855 => 1.5262, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 54.68% (0.8990 => 1.3906, std.dev.: 0.0214) SingleSource/Regression/C/casts: 53.87% (0.0388 => 0.0597, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.93% (0.9998 => 1.5290, std.dev.: 0.0564) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 52.48% (0.9403 => 1.4338, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 52.23% (0.9512 => 1.4480, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 52.20% (0.9422 => 1.4340, std.dev.: 0.0632) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 51.99% (0.9091 => 1.3817, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 51.94% (0.9010 => 1.3690, std.dev.: 0.0681) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 51.59% (1.0867 => 1.6473, std.dev.: 0.0981) SingleSource/UnitTests/2006-12-11-LoadConstants: 51.49% (0.1274 => 0.1930, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.42% (1.0119 => 1.5322, std.dev.: 0.0468) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 51.28% (0.8732 => 1.3210, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.80% (0.8912 => 1.3439, std.dev.: 0.0664) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 50.35% (1.0052 => 1.5113, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 49.99% (0.8736 => 1.3103, std.dev.: 0.0566) SingleSource/Benchmarks/Misc/himenobmtxpa: 49.57% (0.1955 => 0.2924, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.43% (0.8846 => 1.3219, std.dev.: 0.0696) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 48.93% (0.9867 => 1.4695, std.dev.: 0.0859) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 47.96% (0.9788 => 1.4482, std.dev.: 0.1178) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 47.94% (3.6295 => 5.3696, std.dev.: 0.3359) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 47.30% (1.0017 => 1.4755, std.dev.: 0.1819) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.46% (0.9507 => 1.3924, std.dev.: 0.0607) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 46.34% (0.0492 => 0.0720, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.65% (1.0088 => 1.4693, std.dev.: 0.0874) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.90% (0.9685 => 1.4034, std.dev.: 0.0479) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.39% (0.9993 => 1.4429, std.dev.: 0.1169) SingleSource/Benchmarks/Stanford/IntMM: 44.32% (0.0431 => 0.0622, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.20% (0.9127 => 1.3161, std.dev.: 0.1281) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 43.52% (0.9550 => 1.3706, std.dev.: 0.0429) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 42.98% (1.8651 => 2.6668, std.dev.: 0.2600) SingleSource/Benchmarks/Shootout-C++/wordfreq: 42.41% (0.3374 => 0.4805, std.dev.: 0.0197) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.22% (2.4519 => 3.4872, std.dev.: 0.1201) SingleSource/UnitTests/SignlessTypes/rem: 42.05% (0.1163 => 0.1652, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 41.75% (1.0860 => 1.5394, std.dev.: 0.1116) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 41.18% (0.4762 => 0.6723, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.81% (1.8127 => 2.5524, std.dev.: 0.1003) SingleSource/UnitTests/2003-08-11-VaListArg: 40.43% (0.0277 => 0.0389, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 39.41% (0.3702 => 0.5161, std.dev.: 0.0087) MultiSource/Applications/SPASS/SPASS: 36.80% (16.4479 => 22.5001, std.dev.: 0.9449) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 35.24% (0.0403 => 0.0545, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 35.05% (0.0856 => 0.1156, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/ary3: 34.80% (0.0296 => 0.0399, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 34.35% (0.0821 => 0.1103, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 33.97% (9.5202 => 12.7544, std.dev.: 0.3550) SingleSource/Benchmarks/McGill/queens: 33.88% (0.0490 => 0.0656, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 33.46% (0.0783 => 0.1045, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: 32.42% (0.7776 => 1.0297, std.dev.: 0.0214) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 32.30% (0.0486 => 0.0643, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 32.05% (1.4392 => 1.9005, std.dev.: 0.0919) MultiSource/Benchmarks/FreeBench/distray/distray: 31.76% (0.1017 => 0.1340, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/chomp: 31.73% (0.1793 => 0.2362, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 31.41% (17.5634 => 23.0805, std.dev.: 0.0865) SingleSource/Benchmarks/Misc/fbench: 29.60% (0.0696 => 0.0902, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.90% (0.1332 => 0.1717, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: 28.16% (0.0735 => 0.0942, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.88% (1.0986 => 1.4049, std.dev.: 0.0464) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 27.82% (0.1240 => 0.1585, std.dev.: 0.0113) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.78% (0.2577 => 0.3293, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.81% (0.1384 => 0.1755, std.dev.: 0.0053) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.65% (0.5369 => 0.6800, std.dev.: 0.0082) MultiSource/Benchmarks/Bullet/bullet: 26.57% (33.2440 => 42.0755, std.dev.: 1.5366) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.43% (5.0381 => 6.3698, std.dev.: 0.3944) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.80% (0.2884 => 0.3628, std.dev.: 0.0238) MultiSource/Applications/lemon/lemon: 25.47% (1.3979 => 1.7540, std.dev.: 0.0164) MultiSource/Benchmarks/NPB-serial/is/is: 25.35% (0.0797 => 0.0999, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 25.18% (0.0409 => 0.0512, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 25.17% (1.2680 => 1.5872, std.dev.: 0.0098) MultiSource/Applications/oggenc/oggenc: 24.80% (5.3553 => 6.6834, std.dev.: 0.1459) SingleSource/Benchmarks/Misc-C++/bigfib: 24.05% (0.6711 => 0.8325, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/football/football: 23.96% (0.9759 => 1.2097, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 23.35% (0.6934 => 0.8553, std.dev.: 0.0044) SingleSource/Benchmarks/Stanford/Towers: 23.32% (0.0506 => 0.0624, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.24% (0.7693 => 0.9481, std.dev.: 0.0440) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.09% (0.7225 => 0.8893, std.dev.: 0.0364) MultiSource/Applications/ClamAV/clamscan: 22.80% (17.4365 => 21.4123, std.dev.: 0.9280) SingleSource/Benchmarks/McGill/misr: 22.65% (0.0649 => 0.0796, std.dev.: 0.0029) MultiSource/Applications/Burg/burg: 22.63% (1.5979 => 1.9595, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/richards_benchmark: 22.56% (0.0798 => 0.0978, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 22.53% (0.0963 => 0.1180, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 22.52% (0.2385 => 0.2922, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.42% (0.0718 => 0.0879, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 22.10% (0.0457 => 0.0558, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.74% (0.9214 => 1.1217, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.11% (0.6135 => 0.7430, std.dev.: 0.0184) MultiSource/Applications/lua/lua: 21.07% (4.6406 => 5.6186, std.dev.: 0.1820) SingleSource/Benchmarks/Stanford/Oscar: 20.79% (0.0659 => 0.0796, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: 20.72% (0.0531 => 0.0641, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/almabench: 20.42% (0.0754 => 0.0908, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.32% (0.0935 => 0.1125, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.26% (0.6885 => 0.8280, std.dev.: 0.0128) MultiSource/Applications/d/make_dparser: 19.53% (3.7840 => 4.5229, std.dev.: 0.0873) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.80% (0.2372 => 0.2818, std.dev.: 0.0116) MultiSource/Benchmarks/7zip/7zip-benchmark: 18.67% (44.1538 => 52.3973, std.dev.: 2.2890) MultiSource/Applications/treecc/treecc: 18.42% (2.4719 => 2.9272, std.dev.: 0.1633) MultiSource/Benchmarks/PAQ8p/paq8p: 18.33% (2.5772 => 3.0497, std.dev.: 0.1103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.18% (6.4235 => 7.5915, std.dev.: 0.2874) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.08% (0.0730 => 0.0862, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.78% (0.2879 => 0.3391, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.02% (0.9124 => 1.0677, std.dev.: 0.0212) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.98% (0.3560 => 0.4129, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.36% (1.1498 => 1.3264, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/flops: 15.33% (0.1109 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.12% (0.1356 => 0.1561, std.dev.: 0.0034) MultiSource/Applications/kimwitu++/kc: 14.72% (18.9377 => 21.7262, std.dev.: 0.7049) MultiSource/Benchmarks/sim/sim: 14.05% (0.3715 => 0.4237, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/strcat: 13.63% (0.2083 => 0.2367, std.dev.: 0.0055) MultiSource/Applications/aha/aha: 13.57% (0.1378 => 0.1565, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.93% (0.5059 => 0.5713, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/sieve: 12.43% (0.2913 => 0.3275, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.25% (0.5746 => 0.6450, std.dev.: 0.0085) MultiSource/Applications/lambda-0_1_3/lambda: 10.27% (0.8653 => 0.9542, std.dev.: 0.0326) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 10.11% (0.1563 => 0.1721, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.98% (0.1963 => 0.2159, std.dev.: 0.0060) SingleSource/Regression/C++/ofstream_ctor: 9.84% (0.2042 => 0.2243, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/oourafft: 9.78% (0.2269 => 0.2491, std.dev.: 0.0030) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.36% (0.3847 => 0.4207, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary2: 8.86% (0.2665 => 0.2901, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/objinst: 8.65% (0.2150 => 0.2336, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/moments: 7.95% (0.4002 => 0.4320, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.94% (0.3462 => 0.3737, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/hash: 7.66% (0.4689 => 0.5048, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 6.64% (0.2725 => 0.2906, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107187.50% (0.0008 => 0.8583, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/ary3: 415.77% (2.2304 => 11.5037, std.dev.: 0.9252) SingleSource/Benchmarks/Shootout/matrix: 355.23% (1.5825 => 7.2040, std.dev.: 0.0130) MultiSource/Applications/sgefa/sgefa: 259.00% (0.3515 => 1.2619, std.dev.: 0.0289) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 239.51% (1.1825 => 4.0147, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 235.37% (4.8185 => 16.1600, std.dev.: 0.0472) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 232.02% (0.0228 => 0.0757, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 142.24% (0.0232 => 0.0562, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 63.73% (2.9083 => 4.7617, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.45% (0.2562 => 0.3419, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.79% (3.1254 => 4.1189, std.dev.: 0.0228) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.80% (1.4588 => 1.8643, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/salsa20: 22.12% (7.4497 => 9.0976, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.69% (5.6033 => 6.7629, std.dev.: 0.3344) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.47% (4.8112 => 5.7961, std.dev.: 0.1543) MultiSource/Applications/JM/lencod/lencod: 16.10% (6.8159 => 7.9134, std.dev.: 0.2995) SingleSource/Regression/C/uint64_to_float: 15.99% (1.5397 => 1.7859, std.dev.: 0.0580) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.30% (5.1752 => 5.8635, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6501, std.dev.: 0.0126) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.43% (3.6477 => 3.9553, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/ReedSolomon: 7.73% (8.6447 => 9.3127, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/heapsort: 7.03% (4.2042 => 4.4997, std.dev.: 0.0803) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.89% (0.5224 => 0.5584, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.39% (4.1836 => 4.4089, std.dev.: 0.0074) MultiSource/Benchmarks/llubenchmark/llu: 4.61% (2.0298 => 2.1234, std.dev.: 0.0248) SingleSource/Benchmarks/Linpack/linpack-pc: 4.17% (50.8945 => 53.0166, std.dev.: 0.2799) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (5.0310 => 5.2294, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.27% (4.7254 => 4.8801, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/pi: 2.78% (2.1390 => 2.1984, std.dev.: 0.0094) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.17% (1.5595 => 1.5934, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.16% (4.8076 => 4.8636, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -31.93% (0.0808 => 0.0550, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -24.90% (0.0727 => 0.0546, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.75% (11.5523 => 3.9563, std.dev.: 0.0369) SingleSource/Benchmarks/Misc/fp-convert: -62.15% (15.6525 => 5.9247, std.dev.: 0.0222) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.42% (0.4146 => 0.1807, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.32% (0.4578 => 0.2366) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.85% (11.3868 => 6.3941, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.84% (5.4023 => 3.6280, std.dev.: 0.0591) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.95% (0.4452 => 0.3074, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.33% (0.5495 => 0.3993, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.13% (5.2605 => 3.8858, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.36% (4.4467 => 3.3192, std.dev.: 0.0267) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.21% (0.5826 => 0.4357, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0567) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -22.28% (0.5897 => 0.4583, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.45% (5.8755 => 4.7917, std.dev.: 0.0162) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.54% (16.6791 => 14.0869, std.dev.: 0.2546) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.23% (7.0016 => 5.9351, std.dev.: 0.0773) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.44% (3.1921 => 2.7631, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6752, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.45% (5.7056 => 4.9953, std.dev.: 0.0677) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.35% (9.7992 => 8.5887, std.dev.: 0.0758) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.90% (0.3217 => 0.2963, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2284, std.dev.: 0.0210) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2490, std.dev.: 0.0120) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (63.1520 => 59.6123, std.dev.: 0.0487) MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (3.5443 => 3.3547, std.dev.: 0.0636) SingleSource/Benchmarks/McGill/queens: -5.31% (1.7443 => 1.6516, std.dev.: 0.0236) MultiSource/Benchmarks/Olden/health/health: -5.04% (0.3654 => 0.3470, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: -4.91% (3.6768 => 3.4964, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3591, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.40% (4.9799 => 4.8107, std.dev.: 0.0266) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.32% (1.4446 => 1.3967, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.64% (40.4729 => 39.4044, std.dev.: 0.3799) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.10% (23.3986 => 22.9069, std.dev.: 0.1249) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (8.7327 => 8.5842, std.dev.: 0.0459) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.62% (85.3042 => 83.9188, std.dev.: 0.0955) SingleSource/Benchmarks/Misc/whetstone: -1.59% (1.6251 => 1.5992, std.dev.: 0.0045) MultiSource/Applications/spiff/spiff: -1.49% (2.8571 => 2.8145, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7489, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.11% (3.7450 => 3.7034, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 21.15% (1.2047 => 1.4595, std.dev.: 0.0333) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 13.73% (0.0233 => 0.0265, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.44% (0.0451 => 0.0453, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.61% (0.0394 => 0.0364, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.35% (0.0328 => 0.0339, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.35% (0.0445 => 0.0451, std.dev.: 0.0112) SingleSource/UnitTests/Vector/Altivec/casts: 1.41% (0.0213 => 0.0216, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: 44.05% (0.0227 => 0.0327, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 6.67% (0.1530 => 0.1632, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -28.71% (1.9293 => 1.3754, std.dev.: 0.1712) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.62% (0.4049 => 0.4317, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.99% (0.1510 => 0.1495, std.dev.: 0.0308) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.73% (0.0978 => 0.0609, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.53% (0.0590 => 0.0599, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.75% (1.1617 => 1.2866, std.dev.: 0.0422) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.98% (0.0610 => 0.0616, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.06% (0.0268 => 0.0370, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/puzzle: 133.97% (0.7437 => 1.7400, std.dev.: 0.0161) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.91% (0.0092 => 0.0114, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.58% (12.7781 => 34.4466, std.dev.: 0.1929) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 02:07:30 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 04:07:30 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128100730.F0B3D2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8032?compare_to=8029&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8032, Order: 173667, Start Time: 2013-01-28 07:46:17, End Time: 2013-01-28 10:07:49 To: 8029, Order: 173654, Start Time: 2013-01-28 04:55:59, End Time: 2013-01-28 07:15:36 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (273 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (600 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.89% (11.3569 => 11.6848, std.dev.: 0.0066) SingleSource/UnitTests/ObjC++/property-reference: 1.42% (0.8020 => 0.8134, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.03% (2.5243 => 2.5503, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.57% (133.7751 => 129.0044, std.dev.: 0.1710) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1330 => 0.1331, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.72% (0.0416 => 0.0419, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.38% (0.0673 => 0.0689, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8403 => 499.8457, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: 44224.35% (1.1277 => 499.8457, std.dev.: 0.0088) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 270.28% (0.5229 => 1.9362, std.dev.: 0.0378) MultiSource/Applications/SPASS/SPASS: 45.38% (14.9895 => 21.7913, std.dev.: 0.4739) MultiSource/Applications/kimwitu++/kc: 63.16% (14.1553 => 23.0963, std.dev.: 0.0150) MultiSource/Benchmarks/MallocBench/gs/gs: 30.75% (4.1105 => 5.3744, std.dev.: 0.0188) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.52% (1.1048 => 2.0938, std.dev.: 0.0045) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1702.19% (7.1582 => 129.0044, std.dev.: 0.1710) SingleSource/Benchmarks/Misc-C++-EH/spirit: 127.04% (3.4629 => 7.8621, std.dev.: 0.0222) SingleSource/Benchmarks/Misc-C++/stepanov_container: 100.40% (0.6222 => 1.2469, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10279.31% (0.0720 => 7.4731, std.dev.: 0.1369) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0144) MultiSource/Applications/SPASS/SPASS: 11144600.00% (0.0001 => 11.1447, std.dev.: 0.8739) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5482600.00% (0.0001 => 5.4827, std.dev.: 0.0055) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 826.01% (1.1194 => 10.3657, std.dev.: 0.0518) SingleSource/Benchmarks/Misc/flops: 179.75% (0.1432 => 0.4006, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/factor: 172.30% (0.0296 => 0.0806) MultiSource/Applications/ClamAV/clamscan: 158.03% (22.1758 => 57.2213, std.dev.: 1.1252) SingleSource/Benchmarks/Misc/lowercase: 141.02% (0.0256 => 0.0617, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 133.52% (0.1056 => 0.2466, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 112.35% (0.0243 => 0.0516, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 105.27% (0.0929 => 0.1907, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 101.16% (7.0540 => 14.1897, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout/objinst: 98.36% (0.0427 => 0.0847, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 89.06% (0.1463 => 0.2766, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 88.22% (0.0730 => 0.1374, std.dev.: 0.0009) SingleSource/UnitTests/2006-01-23-UnionInit: 80.59% (0.0237 => 0.0428, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 78.25% (0.0377 => 0.0672, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 77.76% (0.2554 => 0.4540, std.dev.: 0.0008) SingleSource/Regression/C/casts: 77.67% (0.0318 => 0.0565, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 75.41% (1.5859 => 2.7818, std.dev.: 0.0016) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 71.98% (0.0439 => 0.0755, std.dev.: 0.0009) SingleSource/UnitTests/Vector/simple: 67.57% (0.0185 => 0.0310, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 64.07% (2.2024 => 3.6134, std.dev.: 0.0012) SingleSource/Regression/C++/EH/function_try_block: 63.06% (0.0268 => 0.0437, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.68% (2.9384 => 4.7802, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 61.50% (8.1363 => 13.1405, std.dev.: 0.0108) SingleSource/Regression/C/sumarray: 59.74% (0.0231 => 0.0369, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 59.45% (0.0217 => 0.0346) SingleSource/UnitTests/2006-12-11-LoadConstants: 58.97% (0.1143 => 0.1817, std.dev.: 0.0009) SingleSource/UnitTests/2002-05-02-CastTest: 58.26% (0.0218 => 0.0345, std.dev.: 0.0001) SingleSource/Regression/C/testtrace: 57.55% (0.0212 => 0.0334) SingleSource/UnitTests/2003-05-31-CastToBool: 56.44% (0.0202 => 0.0316, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 56.29% (0.0636 => 0.0994, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 56.16% (1.5415 => 2.4072, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/ary3: 54.74% (0.0232 => 0.0359) MultiSource/Applications/sgefa/sgefa: 54.33% (0.3109 => 0.4798, std.dev.: 0.0121) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.68% (0.0953 => 0.1455, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 52.51% (1.1642 => 1.7755, std.dev.: 0.0536) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 50.95% (0.0793 => 0.1197, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 50.67% (0.1125 => 0.1695, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 49.91% (0.1062 => 0.1592, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.71% (0.6675 => 0.9993, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 49.27% (21.9371 => 32.7451, std.dev.: 0.5671) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 47.97% (3.8922 => 5.7593, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.37% (4.2646 => 6.2847, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/voronoi/voronoi: 47.30% (0.2700 => 0.3977, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 46.93% (0.0814 => 0.1196, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 46.52% (1.0722 => 1.5710, std.dev.: 0.0437) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 46.47% (0.0467 => 0.0684, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 45.97% (0.7115 => 1.0386, std.dev.: 0.0211) MultiSource/Benchmarks/McCat/15-trie/trie: 45.92% (0.0527 => 0.0769) SingleSource/UnitTests/2003-07-09-SignedArgs: 45.74% (0.0282 => 0.0411, std.dev.: 0.0009) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.04% (0.0564 => 0.0818) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 44.93% (0.0730 => 0.1058, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.64% (0.0457 => 0.0661, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.47% (0.0479 => 0.0692, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 43.91% (0.0640 => 0.0921, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 43.03% (0.4615 => 0.6601, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/div: 43.02% (0.0258 => 0.0369, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.45% (0.0245 => 0.0349) SingleSource/UnitTests/block-copied-in-cxxobj: 42.26% (0.0310 => 0.0441, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.08% (0.5105 => 0.7253, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/shr: 42.06% (0.0252 => 0.0358, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 41.99% (0.0662 => 0.0940, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.83% (0.2271 => 0.3221, std.dev.: 0.0027) MultiSource/Applications/siod/siod: 41.62% (2.2969 => 3.2529, std.dev.: 0.0555) SingleSource/Benchmarks/Shootout/matrix: 41.56% (0.0818 => 0.1158, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 41.22% (9.4845 => 13.3940, std.dev.: 0.0255) MultiSource/Benchmarks/Olden/tsp/tsp: 41.11% (0.1175 => 0.1658, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 41.04% (0.0675 => 0.0952, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.75% (0.0746 => 0.1050, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 40.69% (0.0462 => 0.0650, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 40.56% (0.3092 => 0.4346, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/bigfib: 40.33% (0.6456 => 0.9060, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.33% (0.0672 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.88% (0.5860 => 0.8197, std.dev.: 0.0033) MultiSource/Applications/viterbi/viterbi: 39.74% (0.1555 => 0.2173, std.dev.: 0.0077) MultiSource/Benchmarks/McCat/05-eks/eks: 39.43% (0.4299 => 0.5994, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/chomp: 38.97% (0.1655 => 0.2300, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 38.94% (0.1695 => 0.2355, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 38.80% (0.0719 => 0.0998, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: 38.35% (0.0485 => 0.0671, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.29% (0.0397 => 0.0549, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 37.90% (3.8723 => 5.3399, std.dev.: 0.1588) MultiSource/Applications/treecc/treecc: 37.82% (2.0273 => 2.7940, std.dev.: 0.0660) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 37.69% (0.1032 => 0.1421, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.58% (0.3441 => 0.4734, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 37.56% (0.7835 => 1.0778, std.dev.: 0.0281) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.47% (1.4186 => 1.9502, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.27% (0.0770 => 0.1057, std.dev.: 0.0021) MultiSource/Benchmarks/SciMark2-C/scimark2: 37.26% (0.3121 => 0.4284, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/lists: 37.22% (0.0626 => 0.0859, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 37.17% (0.0842 => 0.1155, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 37.07% (0.1044 => 0.1431, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: 36.95% (0.0295 => 0.0404, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.83% (0.5569 => 0.7620, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 36.79% (63.2438 => 86.5129, std.dev.: 0.0631) MultiSource/Applications/oggenc/oggenc: 36.76% (5.7591 => 7.8761, std.dev.: 0.1129) MultiSource/Benchmarks/nbench/nbench: 36.71% (1.1840 => 1.6187, std.dev.: 0.0127) MultiSource/Applications/d/make_dparser: 36.64% (3.3354 => 4.5574, std.dev.: 0.0867) MultiSource/Benchmarks/McCat/18-imp/imp: 36.58% (0.3423 => 0.4675, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.56% (0.3307 => 0.4516, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 36.32% (0.1151 => 0.1569, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 35.98% (17.1811 => 23.3627, std.dev.: 0.4578) SingleSource/Benchmarks/Misc/whetstone: 35.91% (0.0660 => 0.0897, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 35.86% (0.3427 => 0.4656, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/em3d/em3d: 35.75% (0.1695 => 0.2301, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.62% (0.1892 => 0.2566, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/health/health: 35.49% (0.1268 => 0.1718, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/messages: 35.47% (0.0327 => 0.0443, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 35.44% (0.0886 => 0.1200, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 35.12% (0.0447 => 0.0604, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 35.09% (0.4620 => 0.6241, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/loader/loader: 35.03% (0.2758 => 0.3724, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Queens: 35.02% (0.0414 => 0.0559, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 34.95% (0.4289 => 0.5788, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.73% (0.0933 => 0.1257, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 34.49% (0.0316 => 0.0425, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.41% (0.4879 => 0.6558, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: 34.16% (0.0811 => 0.1088, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 34.00% (0.0403 => 0.0540, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.96% (0.1584 => 0.2122, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.74% (0.2107 => 0.2818, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.61% (1.1861 => 1.5848, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.01% (0.1566 => 0.2083, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.82% (0.0326 => 0.0433) MultiSource/Benchmarks/Olden/mst/mst: 32.76% (0.1163 => 0.1544, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.44% (0.1236 => 0.1637, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0001) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.13% (0.0389 => 0.0514, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 32.08% (0.0770 => 0.1017, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 31.87% (0.1117 => 0.1473, std.dev.: 0.0039) MultiSource/Applications/lambda-0_1_3/lambda: 31.83% (0.7433 => 0.9799, std.dev.: 0.0260) MultiSource/Benchmarks/Olden/bisort/bisort: 31.76% (0.0614 => 0.0809, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 31.76% (0.0592 => 0.0780, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.69% (0.8172 => 1.0762, std.dev.: 0.0164) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.39% (0.1940 => 0.2549, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 31.13% (0.0408 => 0.0535) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 31.10% (0.1029 => 0.1349, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 31.03% (0.3387 => 0.4438, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.97% (1.3050 => 1.7091, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.79% (0.1510 => 0.1975, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.71% (0.0482 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.65% (0.5981 => 0.7814, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.59% (0.6450 => 0.8423, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.43% (0.1906 => 0.2486, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 30.23% (0.8067 => 1.0506, std.dev.: 0.0073) MultiSource/Benchmarks/McCat/09-vor/vor: 29.81% (0.3180 => 0.4128, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.77% (4.9449 => 6.4172, std.dev.: 0.0109) SingleSource/Benchmarks/Stanford/Towers: 29.72% (0.0471 => 0.0611, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 29.26% (0.8921 => 1.1531, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.24% (0.1337 => 0.1728, std.dev.: 0.0031) SingleSource/Regression/C++/EH/exception_spec_test: 29.14% (0.0350 => 0.0452, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.10% (0.9765 => 1.2607, std.dev.: 0.0051) MultiSource/Benchmarks/Olden/treeadd/treeadd: 29.09% (0.0416 => 0.0537, std.dev.: 0.0007) SingleSource/UnitTests/SignlessTypes/rem: 28.93% (0.1144 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.93% (0.0871 => 0.1123, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 28.92% (0.0567 => 0.0731, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: 28.91% (0.0633 => 0.0816, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 28.59% (1.5603 => 2.0064, std.dev.: 0.0489) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.59% (0.5020 => 0.6455, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.51% (0.2603 => 0.3345, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.48% (5.0018 => 6.4265, std.dev.: 0.0056) SingleSource/Benchmarks/Stanford/Treesort: 27.98% (0.0411 => 0.0526, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.60% (0.8101 => 1.0337, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/matrix: 27.47% (0.3098 => 0.3949, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.83% (0.2266 => 0.2874, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.66% (0.3177 => 0.4024, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.60% (0.4203 => 0.5321, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 25.91% (0.1625 => 0.2046, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 25.66% (0.0456 => 0.0573, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.56% (0.3865 => 0.4853, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 25.11% (0.0442 => 0.0553, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.06% (0.0443 => 0.0554, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 24.52% (0.4103 => 0.5109, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 24.31% (0.0798 => 0.0992, std.dev.: 0.0038) SingleSource/Regression/C/bigstack: 24.22% (0.0417 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.80% (0.0479 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.61% (0.0648 => 0.0801, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.54% (0.2065 => 0.2551, std.dev.: 0.0062) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.42% (0.0491 => 0.0606, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: 23.33% (0.1440 => 0.1776, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 23.28% (0.0481 => 0.0593, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.90% (0.0834 => 0.1025, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.44% (0.0704 => 0.0862, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.81% (0.1114 => 0.1357, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.55% (14.3668 => 17.4625, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/perlin: 21.27% (0.0536 => 0.0650, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.16% (0.4636 => 0.5617, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 20.99% (0.3283 => 0.3972, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.66% (0.2430 => 0.2932, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.64% (0.4064 => 0.4903, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 20.45% (0.3232 => 0.3893, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 20.20% (0.3282 => 0.3945, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.17% (0.0838 => 0.1007, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 19.67% (0.2049 => 0.2452, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 19.44% (0.4048 => 0.4835, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 19.24% (0.3379 => 0.4029, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.21% (0.3826 => 0.4561, std.dev.: 0.0005) SingleSource/UnitTests/initp1: 18.92% (0.0555 => 0.0660, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.78% (0.1438 => 0.1708, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/sieve: 18.57% (0.3603 => 0.4272, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists1: 17.86% (0.3684 => 0.4342, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 17.48% (0.3422 => 0.4020, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 17.16% (0.3886 => 0.4553, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.90% (0.2905 => 0.3396, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.14% (0.3650 => 0.4239, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.86% (0.3935 => 0.4559, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.81% (2.2022 => 2.5503, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/ffbench: 15.74% (0.0705 => 0.0816, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Puzzle: 15.30% (0.1268 => 0.1462, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 14.75% (1.2842 => 1.4736, std.dev.: 0.0442) SingleSource/UnitTests/ObjC/parameter-passing: 14.57% (0.3927 => 0.4499, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.91% (0.1330 => 0.1515, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.63% (0.3162 => 0.3593, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: 13.22% (0.3828 => 0.4334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 13.21% (0.2831 => 0.3205, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.71% (10.3673 => 11.6848, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.12% (2.0665 => 2.3170, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/methcall: 12.06% (0.2877 => 0.3224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 11.91% (0.2871 => 0.3213, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.87% (7.9617 => 8.9068, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.80% (0.3136 => 0.3506, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 11.03% (0.7326 => 0.8134, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.99% (0.3694 => 0.4100, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/synchronized: 10.73% (0.3561 => 0.3943, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 10.64% (0.3543 => 0.3920, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions-2: 10.58% (0.3497 => 0.3867, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.57% (0.3473 => 0.3840, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.56% (0.2756 => 0.3047, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.52% (0.2891 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2725 => 0.3008, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 10.22% (0.3052 => 0.3364, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 10.17% (0.6030 => 0.6643, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 10.14% (0.2802 => 0.3086, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.92% (0.2872 => 0.3157, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.84% (0.2714 => 0.2981, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.63% (0.2793 => 0.3062, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 7.76% (0.3131 => 0.3374, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.30% (0.3817 => 0.3943, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4730, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.92% (1.1145 => 1.2919, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.40% (4.2280 => 4.4564, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: 5.18% (3.1578 => 3.3215, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.66% (0.9957 => 1.0321, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (2.0360 => 2.1047, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9114, std.dev.: 0.0255) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.20% (3.6395 => 3.7195, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0067) MultiSource/Benchmarks/Olden/bisort/bisort: 1.85% (0.8333 => 0.8487, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 1.47% (1.0785 => 1.0944, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2394, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4518, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.78% (6.6874 => 0.2154, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.59% (5.2763 => 1.2877, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.78% (0.8651 => 0.2182, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -35.39% (0.1622 => 0.1048) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.62% (5.3855 => 4.9213, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.00% (5.3526 => 4.9245, std.dev.: 0.0079) SingleSource/UnitTests/Vector/constpool: -7.81% (54.1659 => 49.9330, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.05% (1.7609 => 1.7072, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.73% (1.9577 => 0.6710, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.57% (0.3987 => 0.2569, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3075, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.74% (1.5373 => 1.0186, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.52% (1.1492 => 0.7640, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4292, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -24.93% (85.0658 => 63.8623, std.dev.: 0.0777) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0041, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0032) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.85% (1.6925 => 1.4243, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.90% (0.9540 => 0.8405, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4937, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.02% (1.8329 => 1.7043, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.75% (19.9488 => 18.6023, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.17% (0.2497 => 0.2343, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.06% (1.6805 => 1.5787, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: -5.94% (1.2373 => 1.1638, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7052, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5101, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.26% (10.2830 => 9.8453, std.dev.: 0.0036) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0311) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.52% (3.6994 => 3.6432, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7221 => 3.6735, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8569, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2364, std.dev.: 0.0050) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.44% (0.2116 => 0.0689, std.dev.: 0.0020) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 02:09:54 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 04:09:54 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128100954.9F3762A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8033?compare_to=8030&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8033, Order: 173675, Start Time: 2013-01-28 08:33:22, End Time: 2013-01-28 10:10:13 To: 8030, Order: 173663, Start Time: 2013-01-28 06:29:10, End Time: 2013-01-28 08:07:50 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (218 on baseline) Performance Improvements: 1 (72 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (802 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.55% (33.5737 => 34.0937, std.dev.: 0.0218) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.54% (6.8749 => 6.9807, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.06% (1.2813 => 1.2677, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 92.86% (0.0280 => 0.0540, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.10% (0.0717 => 0.1320, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.88% (0.0514 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.90% (0.0974 => 0.1684, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 64.93% (0.1132 => 0.1867, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 60.07% (0.1500 => 0.2401, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 52.17% (22.4056 => 34.0937, std.dev.: 0.0218) SingleSource/Regression/C/sumarraymalloc: 48.69% (0.0267 => 0.0397, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.16% (0.6395 => 0.9475, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.08% (0.0599 => 0.0887, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 47.71% (0.0371 => 0.0548, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.11% (1.6474 => 2.4235, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/objinst: 43.00% (0.0407 => 0.0582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.28% (0.6395 => 0.9099, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 42.11% (0.0418 => 0.0594, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.85% (0.6260 => 0.8880, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.84% (0.5688 => 0.8068, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.71% (0.5805 => 0.8226, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.39% (0.5456 => 0.7714, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.29% (0.5849 => 0.8264, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.92% (0.5567 => 0.7845, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.59% (0.5575 => 0.7838, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.57% (0.5581 => 0.7845, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.96% (0.5941 => 0.8315, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.18% (2.2587 => 3.1436, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.14% (0.5859 => 0.8152, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.09% (0.6033 => 0.8391, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.49% (0.6440 => 0.8919, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.75% (0.0445 => 0.0613, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.73% (0.6676 => 0.9195, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.68% (0.6189 => 0.8521, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.61% (0.6230 => 0.8573, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 37.20% (0.0293 => 0.0402, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.64% (0.6304 => 0.8614, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.60% (0.0582 => 0.0795, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.33% (0.5802 => 0.7910, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.17% (0.5925 => 0.8068, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.96% (0.6660 => 0.9055, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.93% (0.5705 => 0.7755, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 35.62% (0.0699 => 0.0948, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 35.53% (0.1230 => 0.1667, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.34% (0.5857 => 0.7927, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.90% (0.5570 => 0.7514, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.88% (0.5478 => 0.7389, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 34.87% (0.5569 => 0.7511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.52% (0.5591 => 0.7521, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 33.95% (1.1450 => 1.5337, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 33.73% (0.2659 => 0.3556, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 33.54% (0.6446 => 0.8608, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.43% (0.5863 => 0.7823, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.29% (0.0790 => 0.1053, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.24% (0.7524 => 1.0025, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.16% (0.6052 => 0.8059, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.56% (0.6681 => 0.8856, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 32.37% (0.6194 => 0.8199, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.87% (0.6297 => 0.8304, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.60% (0.0693 => 0.0912, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.51% (0.0622 => 0.0818, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.29% (0.0556 => 0.0730, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.06% (0.6667 => 0.8738, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.24% (1.6364 => 2.1312, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.34% (0.7339 => 0.9492, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.17% (0.0833 => 0.1076, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.87% (3.5339 => 4.5541, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.82% (0.0680 => 0.0876, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.66% (5.4682 => 6.9807, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.86% (0.0566 => 0.0718, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.83% (1.2784 => 1.6214, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.78% (0.1796 => 0.2277, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.08% (0.7021 => 0.8852, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.88% (0.0707 => 0.0890, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 25.78% (1.2515 => 1.5741, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.74% (0.1146 => 0.1441, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 25.17% (0.3357 => 0.4202, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.46% (0.0665 => 0.0821, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 23.03% (0.0864 => 0.1063, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.85% (0.1081 => 0.1328, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.72% (4.5069 => 5.5310, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/mason/mason: 22.71% (0.0621 => 0.0762, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 22.07% (15.5079 => 18.9305, std.dev.: 0.0284) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.47% (0.0764 => 0.0928, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 21.27% (9.2283 => 11.1911, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.20% (0.1731 => 0.2098, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.72% (0.0526 => 0.0635) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.45% (0.0885 => 0.1066, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/15-trie/trie: 20.32% (0.0571 => 0.0687, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 20.04% (0.6750 => 0.8103, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.04% (0.5329 => 0.6397, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.85% (0.0806 => 0.0966, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.84% (0.0731 => 0.0876, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.81% (0.4916 => 0.5890, std.dev.: 0.0042) MultiSource/Applications/minisat/minisat: 19.78% (0.7447 => 0.8920, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: 19.46% (0.2985 => 0.3566, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.37% (0.0604 => 0.0721, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 19.26% (0.0919 => 0.1096, std.dev.: 0.0019) MultiSource/Applications/siod/siod: 19.25% (2.4021 => 2.8646, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 18.85% (0.4515 => 0.5366, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.80% (0.0617 => 0.0733, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.69% (0.3483 => 0.4134, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.57% (0.2385 => 0.2828, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.16% (0.1982 => 0.2342, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 17.85% (1.3864 => 1.6339, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.83% (0.1509 => 0.1778, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 17.64% (17.1032 => 20.1204, std.dev.: 0.0190) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (1.4642 => 1.7208, std.dev.: 0.0115) SingleSource/UnitTests/ObjC/messages-2: 17.19% (0.0704 => 0.0825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.18% (0.0710 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.88% (0.2548 => 0.2978, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.71% (0.1077 => 0.1257, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 16.42% (2.1401 => 2.4915, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.41% (0.3491 => 0.4064, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 16.37% (0.1674 => 0.1948, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.21% (0.9557 => 1.1106, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.19% (0.6293 => 0.7312, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 16.17% (0.4861 => 0.5647, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 16.07% (34.0927 => 39.5706, std.dev.: 0.1092) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (0.1096 => 0.1271, std.dev.: 0.0009) MultiSource/Applications/lua/lua: 15.74% (4.0594 => 4.6985, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 15.69% (5.0226 => 5.8108, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/whetstone: 15.60% (0.0686 => 0.0793, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 15.47% (0.4524 => 0.5224, std.dev.: 0.0034) SingleSource/Benchmarks/McGill/chomp: 15.39% (0.1761 => 0.2032, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 15.28% (1.1530 => 1.3292, std.dev.: 0.0049) MultiSource/Benchmarks/NPB-serial/is/is: 15.25% (0.0708 => 0.0816) MultiSource/Applications/spiff/spiff: 15.18% (0.8418 => 0.9696, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 15.06% (0.0797 => 0.0917, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.05% (3.5154 => 4.0444, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.84% (0.0741 => 0.0851, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.55% (0.5999 => 0.6812, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.53% (0.3658 => 0.4153, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.27% (1.2300 => 1.3932, std.dev.: 0.0046) MultiSource/Applications/kimwitu++/kc: 13.11% (18.2933 => 20.6915, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.95% (0.1290 => 0.1457, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.87% (0.3319 => 0.3746, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/18-imp/imp: 12.65% (0.3581 => 0.4034, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.62% (0.0919 => 0.1035, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/em3d/em3d: 12.35% (0.1862 => 0.2092, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.29% (0.2001 => 0.2247, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.05% (0.1145 => 0.1283, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 11.86% (0.1197 => 0.1339, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 11.85% (15.2527 => 17.0605, std.dev.: 0.0224) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.70% (0.0932 => 0.1041, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.62% (0.1076 => 0.1201, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/power/power: 11.44% (0.1154 => 0.1286, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.44% (0.2999 => 0.3342, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.25% (0.1173 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.23% (4.0323 => 4.4851, std.dev.: 0.0112) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.09% (0.0974 => 0.1082, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.71% (0.2278 => 0.2522, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.56% (0.1108 => 0.1225, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: 10.51% (0.3255 => 0.3597, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.12% (0.5168 => 0.5691, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/football/football: 10.08% (0.9179 => 1.0104, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/mst/mst: 9.99% (0.1271 => 0.1398, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1202 => 0.1322, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.97% (0.2106 => 0.2316, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.7919 => 0.8703, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 9.83% (0.7982 => 0.8767, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.81% (0.6736 => 0.7397, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/09-vor/vor: 9.78% (0.3271 => 0.3591, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.78% (0.4427 => 0.4860, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.78% (1.5610 => 1.7136, std.dev.: 0.0103) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (0.1621 => 0.1778, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.48% (1.3722 => 1.5023, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 8.94% (0.1879 => 0.2047, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.7198 => 0.7837, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.47% (0.4083 => 0.4429, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.47% (0.1441 => 0.1563, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.18% (0.3142 => 0.3399, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.98% (0.2695 => 0.2910, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 7.92% (4.3330 => 4.6760, std.dev.: 0.0124) MultiSource/Applications/JM/ldecod/ldecod: 7.82% (7.0961 => 7.6512, std.dev.: 0.0252) MultiSource/Applications/JM/lencod/lencod: 7.82% (16.1920 => 17.4586, std.dev.: 0.0046) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.71% (0.8521 => 0.9178, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.70% (4.8161 => 5.1871, std.dev.: 0.0114) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.63% (0.9077 => 0.9770, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.48% (4.8802 => 5.2453, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 7.48% (2.4924 => 2.6788, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.18% (1.0544 => 1.1301, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.04% (0.4321 => 0.4625, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.02% (0.6484 => 0.6939, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.97% (8.0126 => 8.5713, std.dev.: 0.0045) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.68% (6.7716 => 7.2240, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.16% (14.2083 => 15.0841, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.98% (0.3849 => 0.4079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 5.89% (0.3446 => 0.3649, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.48% (1.2221 => 1.2891, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/ary: 5.48% (0.3394 => 0.3580, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.44% (0.9852 => 1.0388, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.32% (1.2210 => 1.2859, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 5.23% (0.3406 => 0.3584, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4813 => 0.5061, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.96% (0.4151 => 0.4357, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 4.86% (0.2160 => 0.2265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.10% (0.4248 => 0.4422, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 3.96% (0.3481 => 0.3619, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3788 => 0.3925, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.41% (0.3931 => 0.4065, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.15% (0.9542 => 0.9747, std.dev.: 0.0021) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8024, std.dev.: 0.0060) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.02% (0.9531 => 1.0295, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 7.48% (0.5692 => 0.6118, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1479, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6064, std.dev.: 0.1176) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3828, std.dev.: 0.0030) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6056, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5109, std.dev.: 0.0162) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0039) MultiSource/Benchmarks/llubenchmark/llu: 1.35% (3.7435 => 3.7942, std.dev.: 0.0188) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3831 => 0.3650, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.64% (0.3880 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.58% (0.3884 => 0.3706, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.39% (0.3896 => 0.3725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.22% (0.4033 => 0.3863, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.95% (0.6347 => 0.6160, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.66% (0.4176 => 0.4065, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.23% (20.7746 => 20.3109, std.dev.: 0.0169) SingleSource/UnitTests/ObjC++/property-reference-object: -2.20% (0.6441 => 0.6299, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -1.83% (0.7779 => 0.7637, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.23% (2.1713 => 2.1446, std.dev.: 0.0089) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.64% (1.8100 => 0.6763, std.dev.: 0.0195) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -24.66% (1.3643 => 1.0279, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7577, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0798, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.10% (4.1024 => 3.1957, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.33% (2.5106 => 2.1258, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3561, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.20% (1.3096 => 1.2677, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (7.9763 => 7.7853, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3040 => 7.1778, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4699, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6091, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: -1.10% (3.7092 => 3.6684, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 02:29:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 04:29:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130128102916.BBF182A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8034?compare_to=8026&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8034, Order: 173659, Start Time: 2013-01-28 06:37:53, End Time: 2013-01-28 10:29:36 To: 8026, Order: 173643, Start Time: 2013-01-28 02:05:06, End Time: 2013-01-28 05:40:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 115 (207 on baseline) Performance Improvements: 0 (18 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 989 (733 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 33.36% (0.6052 => 0.8071, std.dev.: 0.0155) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.84% (0.8247 => 1.0131, std.dev.: 0.0123) SingleSource/Benchmarks/SmallPT/smallpt: 22.60% (0.0615 => 0.0754, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.66% (0.2277 => 0.2702, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 18.49% (0.0649 => 0.0769, std.dev.: 0.0041) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.61% (0.0647 => 0.0748, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.54% (0.6067 => 0.7010, std.dev.: 0.0150) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.37% (13.0288 => 15.0316, std.dev.: 0.0069) MultiSource/Applications/sqlite3/sqlite3: 15.03% (2.2261 => 2.5607, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.94% (0.2374 => 0.2705, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.61% (0.1315 => 0.1494, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 13.30% (0.3052 => 0.3458, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.61% (0.1110 => 0.1250, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 12.42% (0.1071 => 0.1204, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.39% (0.1114 => 0.1252, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 12.30% (0.7407 => 0.8318, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 12.28% (0.1091 => 0.1225, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.26% (0.1175 => 0.1319, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.24% (0.1111 => 0.1247, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.21% (0.1548 => 0.1737, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.20% (0.1180 => 0.1324, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 12.17% (6.3350 => 7.1060, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.14% (0.1021 => 0.1145, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.09% (0.0951 => 0.1066, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.06% (0.1061 => 0.1189, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: 12.06% (0.2628 => 0.2945, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 12.01% (0.0999 => 0.1119, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 12.00% (0.1025 => 0.1148, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.00% (0.0942 => 0.1055, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.98% (0.1302 => 0.1458, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.94% (0.0980 => 0.1097, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.92% (0.1107 => 0.1239, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 11.90% (0.1059 => 0.1185, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 11.89% (0.0950 => 0.1063, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.0909 => 0.1017, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.86% (0.0995 => 0.1113, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.84% (0.1039 => 0.1162, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 11.82% (0.0981 => 0.1097, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.78% (0.0959 => 0.1072, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.73% (0.0955 => 0.1067, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 11.64% (0.5413 => 0.6043, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.63% (0.1307 => 0.1459, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.62% (0.1007 => 0.1124, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 11.59% (0.1070 => 0.1194, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.52% (0.0946 => 0.1055, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 11.52% (0.0955 => 0.1065, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.49% (0.1001 => 0.1116, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 11.45% (0.1004 => 0.1119, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.43% (0.1102 => 0.1228, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.41% (0.1043 => 0.1162, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 11.36% (0.2966 => 0.3303, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 11.30% (0.0956 => 0.1064, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.26% (0.1012 => 0.1126, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 10.74% (0.0978 => 0.1083, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.73% (0.1174 => 0.1300, std.dev.: 0.0018) MultiSource/Applications/ALAC/encode/alacconvert-encode: 10.63% (0.5052 => 0.5589, std.dev.: 0.0007) MultiSource/Applications/ALAC/decode/alacconvert-decode: 10.34% (0.5037 => 0.5558, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 9.93% (0.4017 => 0.4416, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 9.72% (0.3796 => 0.4165, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/bh/bh: 9.68% (0.1518 => 0.1665, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.68% (5.1767 => 5.6777, std.dev.: 0.0886) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.63% (0.1163 => 0.1275, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.47% (0.5112 => 0.5596, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.26% (2.3732 => 2.5929, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: 9.13% (0.1468 => 0.1602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 8.81% (0.2372 => 0.2581, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: 8.64% (4.9086 => 5.3329, std.dev.: 0.0813) SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.52% (0.3109 => 0.3374, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 8.23% (2.4651 => 2.6680, std.dev.: 0.0297) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.12% (0.7328 => 0.7923, std.dev.: 0.0097) MultiSource/Applications/oggenc/oggenc: 8.11% (1.9966 => 2.1585, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 8.07% (1.6592 => 1.7931, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 8.01% (3.1643 => 3.4178, std.dev.: 0.0162) MultiSource/Applications/kimwitu++/kc: 7.96% (12.9539 => 13.9852, std.dev.: 0.0214) MultiSource/Applications/JM/lencod/lencod: 7.85% (5.2384 => 5.6497, std.dev.: 0.0564) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.72% (0.3483 => 0.3752, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 7.48% (0.9114 => 0.9796, std.dev.: 0.0138) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.37% (25.2349 => 27.0951, std.dev.: 0.0409) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.97% (1.5705 => 1.6800, std.dev.: 0.0306) MultiSource/Benchmarks/McCat/18-imp/imp: 6.77% (0.1669 => 0.1782, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 6.77% (0.4653 => 0.4968, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/09-vor/vor: 6.64% (0.1808 => 0.1928, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 6.54% (1.2713 => 1.3544, std.dev.: 0.0092) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.51% (0.3319 => 0.3535, std.dev.: 0.0061) MultiSource/Benchmarks/MallocBench/gs/gs: 6.45% (2.2675 => 2.4138, std.dev.: 0.0244) MultiSource/Benchmarks/Bullet/bullet: 6.28% (27.4748 => 29.1996, std.dev.: 0.0809) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.96% (0.1897 => 0.2010, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.95% (0.2353 => 0.2493, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 5.94% (0.5585 => 0.5917, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 5.77% (1.1493 => 1.2156, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.67% (0.2417 => 0.2554, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.51% (1.9188 => 2.0246, std.dev.: 0.0133) MultiSource/Applications/Burg/burg: 5.47% (0.6676 => 0.7041, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 5.47% (0.5963 => 0.6289, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 5.43% (0.4733 => 0.4990, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.35% (5.1037 => 5.3767, std.dev.: 0.0487) MultiSource/Benchmarks/McCat/05-eks/eks: 5.12% (0.1973 => 0.2074, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: 5.05% (2.4205 => 2.5428, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/hash2: 3.96% (0.4922 => 0.5117, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.83% (0.4781 => 0.4964, std.dev.: 0.0047) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.81% (0.4517 => 0.4689, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 3.48% (0.4822 => 0.4990, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 2.78% (0.3810 => 0.3916, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.77% (0.4038 => 0.4150, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 2.61% (0.3904 => 0.4006, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 2.61% (0.4287 => 0.4399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 2.55% (0.4269 => 0.4378, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 2.53% (0.4344 => 0.4454, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.44% (0.5338 => 0.5468, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.61% (0.0842 => 0.0965, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.57% (0.1494 => 0.1637, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.44% (123.7759 => 130.5040, std.dev.: 0.5001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.70% (0.6219 => 0.6449, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.88% (0.6700 => 0.6893, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.24% (54.1390 => 54.8088, std.dev.: 0.0879) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.88% (0.0625 => 0.0943, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.55% (0.5361 => 0.8071, std.dev.: 0.0155) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.51% (0.0547 => 0.0785, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 40.96% (0.0415 => 0.0585, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.04% (0.1063 => 0.1478, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/voronoi/voronoi: 37.32% (0.1088 => 0.1494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 37.08% (0.0561 => 0.0769, std.dev.: 0.0041) SingleSource/Benchmarks/CoyoteBench/almabench: 36.65% (0.0281 => 0.0384, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 36.43% (0.7426 => 1.0131, std.dev.: 0.0123) MultiSource/Benchmarks/FreeBench/mason/mason: 35.53% (0.0304 => 0.0412, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 35.48% (1.5932 => 2.1585, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.72% (0.1106 => 0.1490, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 34.03% (0.0808 => 0.1083, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.02% (0.4994 => 0.6643, std.dev.: 0.0161) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 33.00% (0.0897 => 0.1193, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/treeadd/treeadd: 32.93% (0.0331 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.86% (0.5000 => 0.6643, std.dev.: 0.0166) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.86% (0.0563 => 0.0748, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 32.45% (0.2040 => 0.2702, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 32.30% (0.4139 => 0.5476, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 32.20% (0.2969 => 0.3925, std.dev.: 0.0146) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.15% (0.5900 => 0.7797, std.dev.: 0.0199) MultiSource/Benchmarks/Olden/tsp/tsp: 31.72% (0.0599 => 0.0789, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.68% (0.0584 => 0.0769, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: 31.53% (0.1218 => 0.1602, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.91% (0.2866 => 0.3752, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.79% (0.0367 => 0.0480, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 30.71% (0.1107 => 0.1447, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 30.46% (0.0604 => 0.0788, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 30.36% (0.0336 => 0.0438, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.11% (0.0475 => 0.0618, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/bisort/bisort: 30.09% (0.0349 => 0.0454, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.98% (0.0457 => 0.0594, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.97% (0.0714 => 0.0928, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 29.94% (0.0481 => 0.0625, std.dev.: 0.0025) MultiSource/Applications/viterbi/viterbi: 29.78% (0.0947 => 0.1229, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 29.76% (0.1549 => 0.2010, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: 29.67% (0.1284 => 0.1665, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 29.20% (0.2736 => 0.3535, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 29.14% (11.6398 => 15.0316, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 29.09% (0.0440 => 0.0568, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 28.88% (0.0419 => 0.0540, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 28.72% (0.2566 => 0.3303, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 28.63% (0.2103 => 0.2705, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 28.57% (0.4253 => 0.5468, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.53% (0.3084 => 0.3964, std.dev.: 0.0284) MultiSource/Applications/SIBsim4/SIBsim4: 28.50% (0.2691 => 0.3458, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/perimeter/perimeter: 28.48% (0.0495 => 0.0636, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.46% (0.0390 => 0.0501, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/gs/gs: 28.43% (1.8794 => 2.4138, std.dev.: 0.0244) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.42% (0.0584 => 0.0750, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.41% (0.1003 => 0.1288, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 28.32% (0.4361 => 0.5596, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 28.28% (0.0541 => 0.0694, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 28.28% (0.3890 => 0.4990, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 28.24% (0.0386 => 0.0495, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.24% (0.0425 => 0.0545, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 28.23% (5.5417 => 7.1060, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/em3d/em3d: 28.16% (0.0948 => 0.1215, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 28.11% (0.1505 => 0.1928, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 28.10% (0.1619 => 0.2074, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.99% (0.1604 => 0.2053, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.91% (0.1021 => 0.1306, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 27.77% (0.0605 => 0.0773, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 27.75% (0.4029 => 0.5147, std.dev.: 0.0155) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 27.74% (1.3152 => 1.6800, std.dev.: 0.0306) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 27.64% (0.0673 => 0.0859, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/04-bisect/bisect: 27.49% (0.0633 => 0.0807, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.47% (0.1103 => 0.1406, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.43% (0.0452 => 0.0576, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 27.27% (0.3271 => 0.4163, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.18% (0.3903 => 0.4964, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 27.10% (0.0642 => 0.0816, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.03% (0.4658 => 0.5917, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 26.96% (0.5546 => 0.7041, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.88% (0.1462 => 0.1855, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.85% (0.1620 => 0.2055, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.84% (0.2068 => 0.2623, std.dev.: 0.0187) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.81% (0.2014 => 0.2554, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 26.68% (0.1968 => 0.2493, std.dev.: 0.0005) MultiSource/Applications/ClamAV/clamscan: 26.65% (4.2109 => 5.3329, std.dev.: 0.0813) MultiSource/Benchmarks/FreeBench/distray/distray: 26.63% (0.0398 => 0.0504, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.49% (0.0804 => 0.1017, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.46% (0.1028 => 0.1300, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 26.43% (0.0821 => 0.1038, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 26.41% (0.3930 => 0.4968, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 26.24% (0.3498 => 0.4416, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_isamax: 26.19% (0.0462 => 0.0583, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.16% (0.0822 => 0.1037, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 25.86% (2.0346 => 2.5607, std.dev.: 0.0072) MultiSource/Applications/lua/lua: 25.66% (1.4269 => 1.7931, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 25.66% (0.0491 => 0.0617, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 25.63% (1.0781 => 1.3544, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.60% (0.1383 => 0.1737, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.54% (0.5584 => 0.7010, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/mst/mst: 25.50% (0.0698 => 0.0876, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 25.40% (0.1421 => 0.1782, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 25.38% (0.6634 => 0.8318, std.dev.: 0.0104) MultiSource/Applications/hbd/hbd: 25.36% (0.9697 => 1.2156, std.dev.: 0.0085) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.23% (2.7292 => 3.4178, std.dev.: 0.0162) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 25.13% (0.5026 => 0.6289, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.89% (1.6211 => 2.0246, std.dev.: 0.0133) MultiSource/Applications/minisat/minisat: 24.85% (0.3336 => 0.4165, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.78% (0.0573 => 0.0715, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 24.68% (0.4847 => 0.6043, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.57% (0.0582 => 0.0725, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 24.39% (0.7875 => 0.9796, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/football/football: 24.39% (0.2075 => 0.2581, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 24.15% (23.5202 => 29.1996, std.dev.: 0.0809) MultiSource/Benchmarks/sim/sim: 24.01% (0.0758 => 0.0940, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.98% (0.0513 => 0.0636, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.85% (0.1090 => 0.1350, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.78% (0.0572 => 0.0708, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 23.40% (2.1013 => 2.5929, std.dev.: 0.0033) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.39% (0.0496 => 0.0612, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.37% (1.9694 => 2.4296, std.dev.: 0.0472) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.36% (0.1160 => 0.1431, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.27% (0.2737 => 0.3374, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 23.22% (2.1653 => 2.6680, std.dev.: 0.0297) MultiSource/Applications/lemon/lemon: 23.17% (0.2391 => 0.2945, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.12% (0.6435 => 0.7923, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 22.72% (3.5627 => 4.3722, std.dev.: 0.0776) MultiSource/Applications/JM/lencod/lencod: 22.35% (4.6177 => 5.6497, std.dev.: 0.0564) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.32% (1.9966 => 2.4423, std.dev.: 0.0483) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.66% (4.4195 => 5.3767, std.dev.: 0.0487) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.99% (4.6926 => 5.6777, std.dev.: 0.0886) SingleSource/Benchmarks/Misc-C++/bigfib: 20.95% (0.5012 => 0.6062, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/hash2: 20.37% (0.4251 => 0.5117, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 20.36% (0.4146 => 0.4990, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.28% (0.3195 => 0.3843, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/moments: 19.60% (0.3678 => 0.4399, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 19.54% (0.3726 => 0.4454, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 19.36% (0.3477 => 0.4150, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 19.32% (0.3282 => 0.3916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 19.16% (0.3362 => 0.4006, std.dev.: 0.0007) MultiSource/Applications/hexxagon/hexxagon: 19.12% (0.9909 => 1.1804, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/lists: 18.97% (0.3348 => 0.3983, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/Hello: 18.88% (0.5826 => 0.6926, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 18.77% (0.2823 => 0.3353, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.66% (0.3981 => 0.4724, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/reversefile: 18.64% (0.3690 => 0.4378, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/property-reference-object: 18.59% (0.5889 => 0.6984, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 18.56% (0.2813 => 0.3335, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.50% (0.2875 => 0.3407, std.dev.: 0.0062) SingleSource/UnitTests/ObjC++/property-reference: 18.41% (0.7171 => 0.8491, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.37% (0.3124 => 0.3698, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.30% (0.3060 => 0.3620, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.23% (0.3845 => 0.4546, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 18.12% (0.3317 => 0.3918, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 18.08% (0.3258 => 0.3847, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 18.06% (0.3267 => 0.3857, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.93% (0.2911 => 0.3433, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.75% (0.2811 => 0.3310, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.73% (0.2792 => 0.3287, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.64% (0.2738 => 0.3221, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.63% (2.0673 => 2.4317, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 17.56% (0.2750 => 0.3233, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 17.34% (0.2780 => 0.3262, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 17.23% (0.2803 => 0.3286, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.11% (0.2729 => 0.3196, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (0.2725 => 0.3191, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 17.10% (0.2714 => 0.3178, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 16.98% (11.9555 => 13.9852, std.dev.: 0.0214) SingleSource/Regression/C++/ofstream_ctor: 16.74% (0.3004 => 0.3507, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 16.67% (0.3096 => 0.3612, std.dev.: 0.0099) SingleSource/UnitTests/ObjC/parameter-passing: 15.20% (0.3724 => 0.4290, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.19% (0.3488 => 0.4018, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.04% (0.3650 => 0.4199, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 14.99% (0.3496 => 0.4020, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 14.94% (0.3460 => 0.3977, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 14.83% (0.3465 => 0.3979, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 14.74% (0.3643 => 0.4180, std.dev.: 0.0053) SingleSource/UnitTests/ObjC/exceptions-2: 14.68% (0.3446 => 0.3952, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 14.67% (0.3469 => 0.3978, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 14.50% (0.3442 => 0.3941, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.67% (0.3792 => 0.4007, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 2.68% (2.4764 => 2.5428, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5138, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0289) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.47% (0.0734 => 0.0965, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.49% (0.5917 => 0.6893, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.98% (0.1475 => 0.1637, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.02% (0.3693 => 0.4026, std.dev.: 0.0040) MultiSource/Applications/ClamAV/clamscan: 8.85% (0.2802 => 0.3050, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 5.56% (0.2122 => 0.2240, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6740, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2383, std.dev.: 0.0224) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6789, std.dev.: 0.1017) SingleSource/Benchmarks/Misc/flops-2: 4.50% (1.8057 => 1.8869, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.28% (0.6244 => 0.6449, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 3.01% (0.6276 => 0.6465, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.13% (15.8721 => 16.2109, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3034, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2875, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.11% (3.1722 => 3.2074, std.dev.: 0.0038) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5858, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5735, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/mandel-2: -20.87% (3.6262 => 2.8693, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -17.47% (17.2379 => 14.2257, std.dev.: 0.1884) SingleSource/UnitTests/Vector/multiplies: -11.32% (2.3713 => 2.1028, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9754, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7959, std.dev.: 0.0820) MultiSource/Benchmarks/Olden/tsp/tsp: -7.20% (2.1113 => 1.9593, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout-C++/ary2: -5.58% (0.2402 => 0.2268, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2253, std.dev.: 0.0217) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7987, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0039) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7749, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.13% (197.4719 => 193.2618, std.dev.: 0.8974) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5770, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4983, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7159, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 03:14:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 05:14:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128111427.EFB962A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8035?compare_to=8031&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8035, Order: 173675, Start Time: 2013-01-28 09:06:59, End Time: 2013-01-28 11:14:49 To: 8031, Order: 173664, Start Time: 2013-01-28 06:37:36, End Time: 2013-01-28 08:49:44 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (207 on baseline) Performance Improvements: 13 (57 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1049 (799 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Regression/C/uint64_to_float: 6.11% (1.7859 => 1.8951, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 1.90% (0.8840 => 0.9008, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -19.85% (11.0972 => 8.8943, std.dev.: 0.2019) SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.41% (0.2159 => 0.1999, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: -6.14% (21.4123 => 20.0974, std.dev.: 0.2445) MultiSource/Applications/sqlite3/sqlite3: -4.95% (23.0805 => 21.9385, std.dev.: 0.1965) SingleSource/Benchmarks/Shootout-C++/objinst: -4.45% (0.2336 => 0.2232, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -3.70% (0.5048 => 0.4861, std.dev.: 0.0048) MultiSource/Applications/treecc/treecc: -3.63% (2.9272 => 2.8210, std.dev.: 0.0393) MultiSource/Applications/lemon/lemon: -3.53% (1.7540 => 1.6920, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sieve: -3.48% (0.3275 => 0.3161, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.81% (0.4805 => 0.4670, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/heapsort: -28.28% (4.4997 => 3.2273, std.dev.: 0.3615) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -14.93% (0.0757 => 0.0644, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: -7.59% (0.6624 => 0.6121, std.dev.: 0.0144) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.67% (1.4595 => 1.4351, std.dev.: 0.0831) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -16.60% (0.0265 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.64% (0.0453 => 0.0432, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.69% (0.0364 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.90% (0.0339 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -4.66% (0.0451 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -4.63% (0.0216 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -32.11% (0.0327 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -35.32% (0.0252 => 0.0163, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -10.23% (0.1632 => 0.1465, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -16.93% (1.3754 => 1.1425, std.dev.: 0.1817) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -8.76% (0.4317 => 0.3939, std.dev.: 0.1914) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.21% (0.1495 => 0.1462, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.15% (0.0609 => 0.0616, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.67% (0.0599 => 0.0577, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.34% (1.2866 => 1.2822, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.15% (0.0026 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.63% (0.0616 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.62% (0.0370 => 0.0327, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.90% (1.7400 => 1.7731, std.dev.: 0.0109) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 500.00% (0.0001 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 7.02% (0.0114 => 0.0122, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.56% (34.4466 => 33.9089, std.dev.: 0.2503) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 409.52% (0.0336 => 0.1712, std.dev.: 0.0050) SingleSource/Regression/C/sumarraymalloc: 129.01% (0.0293 => 0.0671, std.dev.: 0.0024) SingleSource/Regression/C/sumarray2d: 91.97% (0.0274 => 0.0526, std.dev.: 0.0019) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 73.05% (23.5861 => 40.8169, std.dev.: 1.2285) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.35% (0.0539 => 0.0902, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 59.25% (0.0859 => 0.1368, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 58.22% (0.9061 => 1.4336, std.dev.: 0.0353) SingleSource/Benchmarks/Shootout/objinst: 57.71% (0.0480 => 0.0757, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.74% (0.9120 => 1.4295, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.73% (0.9612 => 1.5065, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 56.67% (0.8893 => 1.3933, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 56.02% (0.8926 => 1.3926, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 55.84% (0.9588 => 1.4942, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 54.75% (0.9381 => 1.4517, std.dev.: 0.0625) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.75% (0.9564 => 1.4800, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 54.27% (0.9855 => 1.5203, std.dev.: 0.0915) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 53.86% (0.8990 => 1.3832, std.dev.: 0.0937) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 53.20% (0.9091 => 1.3927, std.dev.: 0.0743) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.16% (0.9998 => 1.5313, std.dev.: 0.0301) SingleSource/UnitTests/SignlessTypes/div: 53.12% (0.0320 => 0.0490, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 52.59% (0.9422 => 1.4377, std.dev.: 0.0476) SingleSource/UnitTests/SignlessTypes/shr: 52.26% (0.0310 => 0.0472, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 52.12% (0.9512 => 1.4470, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 52.12% (0.9403 => 1.4304, std.dev.: 0.0586) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 51.85% (0.9010 => 1.3682, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.63% (1.0119 => 1.5343, std.dev.: 0.0931) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 51.13% (0.8912 => 1.3469, std.dev.: 0.0590) MultiSource/Benchmarks/FreeBench/mason/mason: 50.95% (0.0793 => 0.1197, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 50.93% (1.0867 => 1.6402, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.90% (0.8736 => 1.3183, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 49.65% (1.0052 => 1.5043, std.dev.: 0.0561) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 49.56% (1.4110 => 2.1103, std.dev.: 0.2520) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.42% (0.8732 => 1.3047, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 49.36% (0.9867 => 1.4737, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.13% (0.8846 => 1.3192, std.dev.: 0.0131) SingleSource/UnitTests/2003-05-31-CastToBool: 48.85% (0.0260 => 0.0387, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.78% (0.0492 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.55% (3.6295 => 5.3918, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 47.69% (0.9788 => 1.4456, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 47.09% (0.9488 => 1.3956, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 47.05% (1.0017 => 1.4730, std.dev.: 0.0352) SingleSource/UnitTests/2003-05-26-Shorts: 46.85% (0.0222 => 0.0326, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.80% (0.9507 => 1.3956, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.76% (1.0088 => 1.4704, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.85% (0.9993 => 1.4475, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.67% (0.9127 => 1.3204, std.dev.: 0.0591) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.46% (0.9685 => 1.3991, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.96% (0.9405 => 1.3539, std.dev.: 0.0267) SingleSource/Benchmarks/Stanford/IntMM: 43.62% (0.0431 => 0.0619, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 42.65% (0.1163 => 0.1659, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 42.52% (1.8651 => 2.6582, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.50% (0.9550 => 1.3609, std.dev.: 0.0918) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 42.37% (2.4519 => 3.4907, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 42.24% (1.0860 => 1.5447, std.dev.: 0.0359) MultiSource/Benchmarks/McCat/08-main/main: 41.72% (0.2915 => 0.4131, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.07% (1.8127 => 2.5572, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/wordfreq: 38.41% (0.3374 => 0.4670, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.01% (0.0805 => 0.1111, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 37.94% (0.0738 => 0.1018, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/queens: 36.53% (0.0490 => 0.0669, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 36.24% (0.3598 => 0.4902, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 35.77% (0.0738 => 0.1002, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 35.47% (0.0296 => 0.0401, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 35.39% (0.0486 => 0.0658, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 35.16% (0.0856 => 0.1157, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 34.94% (0.0707 => 0.0954, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 34.38% (0.0669 => 0.0899, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: 34.21% (9.5202 => 12.7766, std.dev.: 0.3461) SingleSource/Benchmarks/Shootout/matrix: 33.13% (0.0821 => 0.1093, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 32.93% (16.4479 => 21.8650, std.dev.: 0.2881) MultiSource/Applications/minisat/minisat: 32.32% (0.7776 => 1.0289, std.dev.: 0.0080) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 31.93% (0.0642 => 0.0847, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/15-trie/trie: 31.53% (0.0593 => 0.0780, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 31.16% (0.0783 => 0.1027, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/distray/distray: 31.07% (0.1017 => 0.1333, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.70% (0.0733 => 0.0958, std.dev.: 0.0083) SingleSource/Benchmarks/McGill/chomp: 30.40% (0.1793 => 0.2338, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.18% (0.0762 => 0.0992, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 29.94% (0.0845 => 0.1098, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 29.45% (0.0696 => 0.0901, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 29.35% (0.1046 => 0.1353, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 27.82% (0.1240 => 0.1585, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 27.33% (0.2100 => 0.2674, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.83% (1.0986 => 1.3934, std.dev.: 0.0692) MultiSource/Benchmarks/Bullet/bullet: 26.39% (33.2440 => 42.0157, std.dev.: 1.3578) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.32% (5.0381 => 6.3641, std.dev.: 0.3555) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.98% (0.1332 => 0.1678, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 25.79% (0.1384 => 0.1741, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: 25.56% (0.0798 => 0.1002, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 25.44% (0.0735 => 0.0922, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/bigfib: 25.17% (0.6711 => 0.8400, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.16% (0.0803 => 0.1005, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 25.08% (1.4392 => 1.8001, std.dev.: 0.1207) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.03% (0.0775 => 0.0969, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.95% (0.0457 => 0.0571, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 24.91% (17.5634 => 21.9385, std.dev.: 0.1965) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.88% (0.5369 => 0.6705, std.dev.: 0.0410) SingleSource/Benchmarks/Linpack/linpack-pc: 24.55% (0.2566 => 0.3196, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.49% (0.0486 => 0.0605, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.36% (0.7693 => 0.9567, std.dev.: 0.0512) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.82% (0.7225 => 0.8946, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.42% (0.0713 => 0.0880, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/football/football: 23.39% (0.9759 => 1.2042, std.dev.: 0.0671) MultiSource/Applications/oggenc/oggenc: 23.29% (5.3553 => 6.6024, std.dev.: 0.0366) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.05% (0.0963 => 0.1185, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/matrix: 22.81% (0.2385 => 0.2929, std.dev.: 0.0020) SingleSource/Benchmarks/McGill/misr: 22.80% (0.0649 => 0.0797, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 22.73% (0.0902 => 0.1107, std.dev.: 0.0027) SingleSource/UnitTests/Vectorizer/gcc-loops: 22.69% (0.4596 => 0.5639, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.87% (0.6135 => 0.7477, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.78% (0.9214 => 1.1221, std.dev.: 0.0092) SingleSource/Benchmarks/Dhrystone/fldry: 21.75% (0.0593 => 0.0722, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 21.75% (0.6934 => 0.8442, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.37% (0.0730 => 0.0886, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 21.33% (0.3394 => 0.4118, std.dev.: 0.0060) MultiSource/Applications/lemon/lemon: 21.04% (1.3979 => 1.6920, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 21.03% (0.0718 => 0.0869, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 20.15% (4.6406 => 5.5757, std.dev.: 0.3240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.11% (0.0726 => 0.0872, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/five11/five11: 19.71% (0.0614 => 0.0735, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.70% (0.1716 => 0.2054, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.23% (0.6885 => 0.8209, std.dev.: 0.0405) MultiSource/Applications/siod/siod: 19.07% (2.6437 => 3.1479, std.dev.: 0.1268) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.90% (0.0963 => 0.1145, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: 18.71% (2.5772 => 3.0594, std.dev.: 0.0798) MultiSource/Benchmarks/7zip/7zip-benchmark: 18.61% (44.1538 => 52.3700, std.dev.: 1.0723) SingleSource/Benchmarks/CoyoteBench/almabench: 18.44% (0.0754 => 0.0893, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.41% (0.0918 => 0.1087, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 18.40% (0.0935 => 0.1107, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/hash: 18.37% (0.0615 => 0.0728, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.11% (6.4235 => 7.5868, std.dev.: 0.2043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.04% (0.0776 => 0.0916, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 17.93% (16.7012 => 19.6956, std.dev.: 0.3395) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.92% (0.2372 => 0.2797, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 17.87% (3.7840 => 4.4601, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.74% (0.0992 => 0.1168, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.73% (4.6579 => 5.4837, std.dev.: 0.0508) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.61% (0.2879 => 0.3386, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.34% (0.2993 => 0.3512, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 17.11% (0.0637 => 0.0746, std.dev.: 0.0029) SingleSource/Benchmarks/Stanford/Oscar: 16.54% (0.0659 => 0.0768, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 16.45% (0.1435 => 0.1671, std.dev.: 0.0068) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.38% (0.6996 => 0.8142, std.dev.: 0.0335) SingleSource/Benchmarks/Misc/whetstone: 16.31% (0.0834 => 0.0970, std.dev.: 0.0046) MultiSource/Applications/JM/ldecod/ldecod: 16.15% (7.3529 => 8.5405, std.dev.: 0.0964) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.90% (14.9757 => 17.3573, std.dev.: 0.3713) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.27% (0.1356 => 0.1563, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 15.26% (17.4365 => 20.0974, std.dev.: 0.2445) SingleSource/Benchmarks/Misc/ReedSolomon: 14.88% (0.2050 => 0.2355, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 14.70% (0.1109 => 0.1272, std.dev.: 0.0053) MultiSource/Applications/treecc/treecc: 14.12% (2.4719 => 2.8210, std.dev.: 0.0393) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.05% (0.1317 => 0.1502, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.66% (0.5059 => 0.5750, std.dev.: 0.0120) MultiSource/Benchmarks/sim/sim: 12.22% (0.3715 => 0.4169, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/loader/loader: 12.22% (0.3560 => 0.3995, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.06% (0.3981 => 0.4461, std.dev.: 0.0142) MultiSource/Applications/aha/aha: 11.83% (0.1378 => 0.1541, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/oourafft: 11.72% (0.2269 => 0.2535, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.54% (0.3093 => 0.3450, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 11.39% (0.2283 => 0.2543, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.94% (0.3665 => 0.4066, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.06% (1.0234 => 1.1264, std.dev.: 0.0312) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.66% (0.1563 => 0.1714, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.62% (0.3847 => 0.4217, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.62% (1.3924 => 1.5124, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/sieve: 8.51% (0.2913 => 0.3161, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 8.37% (0.2042 => 0.2213, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.93% (0.4121 => 0.4448, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 7.80% (1.0220 => 1.1017, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 7.58% (0.1755 => 0.1888, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.54% (0.3462 => 0.3723, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 6.98% (0.2564 => 0.2743, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: 6.70% (0.4002 => 0.4270, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/lists1: 6.67% (0.3206 => 0.3420, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 5.47% (0.2725 => 0.2874, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary: 5.14% (0.2551 => 0.2682, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 3.67% (0.4689 => 0.4861, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106950.00% (0.0008 => 0.8564, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout/matrix: 333.57% (1.5825 => 6.8612, std.dev.: 0.2188) SingleSource/Benchmarks/Shootout/ary3: 264.64% (2.2304 => 8.1330, std.dev.: 1.7180) MultiSource/Applications/sgefa/sgefa: 258.49% (0.3515 => 1.2601, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.51% (1.1825 => 4.0383, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.16% (4.8185 => 16.0052, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ary2: 200.78% (0.0129 => 0.0388, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 182.46% (0.0228 => 0.0644, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 135.78% (0.0232 => 0.0547, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 65.05% (2.9083 => 4.8001, std.dev.: 0.1446) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.76% (0.2562 => 0.3427, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.50% (3.1254 => 4.1099, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 28.20% (5.6033 => 7.1832, std.dev.: 0.3127) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.51% (1.4588 => 1.8601, std.dev.: 0.0521) SingleSource/Regression/C/uint64_to_float: 23.08% (1.5397 => 1.8951, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/salsa20: 21.78% (7.4497 => 9.0725, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.44% (4.8112 => 5.7946, std.dev.: 0.0063) MultiSource/Applications/JM/lencod/lencod: 13.74% (6.8159 => 7.7525, std.dev.: 0.0963) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.21% (5.1752 => 5.8591, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.17% (5.0033 => 5.6123, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (3.6477 => 3.9749, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.97% (4.7473 => 5.0783, std.dev.: 0.1014) SingleSource/Benchmarks/McGill/chomp: 5.71% (1.0425 => 1.1020, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.31% (4.1836 => 4.4059, std.dev.: 0.0053) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.31% (0.6211 => 0.6541, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: 4.23% (50.8945 => 53.0469, std.dev.: 0.5078) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.22% (4.7254 => 4.8777, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/pi: 2.82% (2.1390 => 2.1994, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.36% (0.8800 => 0.9008, std.dev.: 0.0050) MultiSource/Applications/siod/siod: 1.31% (3.5910 => 3.6382, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -25.31% (0.0727 => 0.0543, std.dev.: 0.0015) SingleSource/UnitTests/Vector/constpool: -10.05% (9.8875 => 8.8943, std.dev.: 0.2019) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (0.2006 => 0.1905, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.82% (11.5523 => 3.9490, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/fp-convert: -61.68% (15.6525 => 5.9981, std.dev.: 0.1320) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.10% (0.4146 => 0.1820, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.41% (0.4578 => 0.2362, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.11% (11.3868 => 6.3636, std.dev.: 0.0315) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.98% (5.4023 => 3.6208, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.27% (0.4452 => 0.3060, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/heapsort: -29.31% (4.4739 => 3.1625, std.dev.: 0.3224) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.02% (0.5495 => 0.4010, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.24% (5.2605 => 3.8801, std.dev.: 0.0214) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.44% (0.5826 => 0.4344, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3287, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0480) SingleSource/Benchmarks/Shootout-C++/heapsort: -23.24% (4.2042 => 3.2273, std.dev.: 0.3615) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.01% (0.5897 => 0.4540, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -21.82% (0.1164 => 0.0910, std.dev.: 0.0061) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.94% (16.6791 => 13.1873, std.dev.: 0.4563) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.66% (2.8778 => 2.3408, std.dev.: 0.1796) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7926, std.dev.: 0.0122) MultiSource/Applications/minisat/minisat: -18.42% (7.9891 => 6.5179, std.dev.: 0.3330) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.72% (7.0016 => 5.8309, std.dev.: 0.2710) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.23% (3.1921 => 2.7698, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6746, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.49% (5.7056 => 4.9928, std.dev.: 0.0828) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.40% (9.7992 => 8.5841, std.dev.: 0.0206) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.53% (5.0421 => 4.4605, std.dev.: 0.0870) SingleSource/Benchmarks/Shootout/hash: -10.45% (4.5259 => 4.0530, std.dev.: 0.1712) SingleSource/Benchmarks/Shootout-C++/lists1: -9.41% (0.6628 => 0.6004, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.29% (0.4081 => 0.3702, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout/nestedloop: -8.68% (0.2200 => 0.2009, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: -7.56% (9.0650 => 8.3799, std.dev.: 0.1122) MultiSource/Applications/SIBsim4/SIBsim4: -7.54% (3.5443 => 3.2770, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.21% (4.2843 => 3.9752, std.dev.: 0.1003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2275, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2480, std.dev.: 0.0352) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.21% (4.9799 => 4.6706, std.dev.: 0.0877) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -5.93% (23.3986 => 22.0116, std.dev.: 0.3846) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (63.1520 => 59.6072, std.dev.: 0.0283) SingleSource/Benchmarks/McGill/queens: -5.38% (1.7443 => 1.6505, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/hash2: -4.86% (3.6768 => 3.4981, std.dev.: 0.0346) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.77% (3.7662 => 3.5866, std.dev.: 0.0648) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.47% (1.4446 => 1.3800, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.30% (0.3349 => 0.3205, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.01% (1.0995 => 1.0554, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.74% (3.5691 => 3.4357, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (5.8973 => 5.6829, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/lists: -3.41% (17.2182 => 16.6302, std.dev.: 0.1449) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.27% (40.4729 => 39.1502, std.dev.: 0.1967) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.80% (8.7327 => 8.5758, std.dev.: 0.0023) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.66% (85.3042 => 83.8923, std.dev.: 0.0766) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (8.8249 => 8.6949, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.27% (3.7450 => 3.6974, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/whetstone: -1.26% (1.6251 => 1.6047, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (6.8262 => 6.7462, std.dev.: 0.0284) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 19.13% (1.2047 => 1.4351, std.dev.: 0.0831) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -36.08% (0.0255 => 0.0163, std.dev.: 0.0046) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.25% (0.1530 => 0.1465, std.dev.: 0.0021) MultiSource/Applications/lemon/lemon: -40.78% (1.9293 => 1.1425, std.dev.: 0.1817) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.72% (0.4049 => 0.3939, std.dev.: 0.1914) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.18% (0.1510 => 0.1462, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.01% (0.0978 => 0.0616, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.20% (0.0590 => 0.0577, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.37% (1.1617 => 1.2822, std.dev.: 0.0537) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -96.30% (0.0027 => 0.0001, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.72% (0.0610 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.01% (0.0268 => 0.0327, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.42% (0.7437 => 1.7731, std.dev.: 0.0109) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -25.00% (0.0008 => 0.0006, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.37% (12.7781 => 33.9089, std.dev.: 0.2503) Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 04:09:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 06:09:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128120956.AF8712A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8036?compare_to=8033&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8036, Order: 173680, Start Time: 2013-01-28 10:33:50, End Time: 2013-01-28 12:10:17 To: 8033, Order: 173675, Start Time: 2013-01-28 08:33:22, End Time: 2013-01-28 10:10:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (219 on baseline) Performance Improvements: 0 (72 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (801 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 5.22% (0.6763 => 0.7116, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.18% (78.7165 => 81.2178, std.dev.: 0.3646) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 93.21% (0.0280 => 0.0541, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.24% (0.0717 => 0.1321, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.68% (0.0514 => 0.0939, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.90% (0.0974 => 0.1684, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 65.02% (0.1132 => 0.1868, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 60.07% (0.1500 => 0.2401, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 52.12% (22.4056 => 34.0840, std.dev.: 0.0099) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.16% (0.6395 => 0.9475, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.08% (0.0599 => 0.0887, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 47.71% (0.0371 => 0.0548, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 46.97% (1.6474 => 2.4212, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout/objinst: 43.00% (0.0407 => 0.0582, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 42.34% (0.0418 => 0.0595) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.10% (0.6395 => 0.9087, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.07% (0.5688 => 0.8081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.93% (0.6260 => 0.8885, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.59% (0.5456 => 0.7725, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.57% (0.5805 => 0.8218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.08% (0.5849 => 0.8252, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.88% (0.5567 => 0.7843, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.49% (0.5581 => 0.7841, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.48% (0.5575 => 0.7832, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.91% (0.5941 => 0.8312, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.15% (0.5859 => 0.8153, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.02% (2.2587 => 3.1401, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.89% (0.6033 => 0.8379, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.51% (0.6440 => 0.8920, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.84% (0.6676 => 0.9202, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.75% (0.0445 => 0.0613, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.59% (0.6230 => 0.8572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.57% (0.6189 => 0.8514, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 37.20% (0.0293 => 0.0402) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.69% (0.6304 => 0.8617, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.60% (0.0582 => 0.0795, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.30% (0.5802 => 0.7908, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.10% (0.5925 => 0.8064, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.05% (0.6660 => 0.9061, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 35.77% (0.0699 => 0.0949, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.62% (0.5705 => 0.7737, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 35.61% (0.1230 => 0.1668, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.19% (0.5857 => 0.7918, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.12% (0.5478 => 0.7402, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.92% (0.5570 => 0.7515, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 34.89% (0.5569 => 0.7512, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.52% (0.5591 => 0.7521, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 33.97% (1.1450 => 1.5340, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 33.81% (0.2659 => 0.3558, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.65% (0.5863 => 0.7836, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 33.42% (0.6446 => 0.8600, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.39% (0.6052 => 0.8073, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.29% (0.0790 => 0.1053) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.20% (0.7524 => 1.0022, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.56% (0.6681 => 0.8856, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 32.42% (0.6194 => 0.8202, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 32.19% (0.0556 => 0.0735, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.89% (0.6297 => 0.8305, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.60% (0.0693 => 0.0912, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.51% (0.0622 => 0.0818, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.03% (0.6667 => 0.8736, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.23% (1.6364 => 2.1311, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.27% (0.7339 => 0.9487, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.17% (0.0833 => 0.1076, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.82% (0.0680 => 0.0876, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.77% (3.5339 => 4.5505, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.68% (5.4682 => 6.9818, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 27.03% (0.0566 => 0.0719, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.89% (0.1796 => 0.2279, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.78% (1.2784 => 1.6208, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.01% (0.7021 => 0.8847, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.88% (0.0707 => 0.0890, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.65% (0.1146 => 0.1440, std.dev.: 0.0019) MultiSource/Applications/Burg/burg: 25.59% (1.2515 => 1.5717, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 25.11% (0.3357 => 0.4200, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.61% (0.0665 => 0.0822, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 22.80% (0.0864 => 0.1061, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.76% (0.1081 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.67% (4.5069 => 5.5288, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/mason/mason: 22.54% (0.0621 => 0.0761, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 22.08% (15.5079 => 18.9316, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.47% (0.0764 => 0.0928, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.14% (0.1731 => 0.2097, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 21.07% (9.2283 => 11.1726, std.dev.: 0.0169) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.53% (0.0526 => 0.0634) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.34% (0.0885 => 0.1065, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.32% (0.0571 => 0.0687, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.10% (0.0806 => 0.0968, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.10% (0.5329 => 0.6400, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 19.99% (0.6750 => 0.8099, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.84% (0.0731 => 0.0876, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.73% (0.4916 => 0.5886, std.dev.: 0.0020) MultiSource/Applications/minisat/minisat: 19.56% (0.7447 => 0.8904, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 19.42% (2.4021 => 2.8685, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.37% (0.0604 => 0.0721) MultiSource/Benchmarks/Olden/bh/bh: 19.30% (0.2985 => 0.3561, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/distray/distray: 19.04% (0.0919 => 0.1094, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.80% (0.0617 => 0.0733, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 18.74% (0.4515 => 0.5361, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.72% (0.3483 => 0.4135, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.70% (0.2385 => 0.2831, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 17.97% (1.3864 => 1.6355, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 17.96% (0.1982 => 0.2338, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.83% (0.1509 => 0.1778, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 17.79% (17.1032 => 20.1467, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (1.4642 => 1.7208, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.32% (0.0710 => 0.0833) SingleSource/UnitTests/ObjC/messages-2: 17.05% (0.0704 => 0.0824, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.92% (0.2548 => 0.2979, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.53% (0.1077 => 0.1255, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.50% (0.3491 => 0.4067, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 16.49% (2.1401 => 2.4930, std.dev.: 0.0080) MultiSource/Applications/viterbi/viterbi: 16.43% (0.1674 => 0.1949, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.22% (0.9557 => 1.1107, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 16.15% (0.4861 => 0.5646, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.13% (0.6293 => 0.7308, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 16.08% (34.0927 => 39.5760, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (0.1096 => 0.1271, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 15.83% (4.0594 => 4.7019, std.dev.: 0.0057) MultiSource/Applications/oggenc/oggenc: 15.62% (5.0226 => 5.8072, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: 15.61% (0.4524 => 0.5230, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 15.60% (0.0686 => 0.0793, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 15.40% (0.0708 => 0.0817, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 15.39% (0.1761 => 0.2032, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 15.34% (1.1530 => 1.3299, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/matrix: 15.18% (0.0797 => 0.0918, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 15.12% (0.8418 => 0.9691, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 15.04% (3.5154 => 4.0440, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.84% (0.0741 => 0.0851, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.56% (0.3658 => 0.4154, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.54% (0.5999 => 0.6811, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.26% (1.2300 => 1.3931, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 13.18% (18.2933 => 20.7036, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.02% (0.1290 => 0.1458, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.81% (0.3319 => 0.3744, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 12.62% (0.3581 => 0.4033, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 12.62% (0.1862 => 0.2097, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.40% (0.0919 => 0.1033, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.34% (0.2001 => 0.2248, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.31% (0.1145 => 0.1286, std.dev.: 0.0011) SingleSource/UnitTests/SignlessTypes/rem: 11.86% (0.1197 => 0.1339, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 11.83% (15.2527 => 17.0570, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.52% (0.1076 => 0.1200, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.48% (0.0932 => 0.1039, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 11.44% (0.1154 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.40% (0.2999 => 0.3341, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.27% (4.0323 => 4.4868, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.25% (0.1173 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.09% (0.0974 => 0.1082) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.76% (0.2278 => 0.2523, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.56% (0.1108 => 0.1225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: 10.54% (0.3255 => 0.3598, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.22% (0.9179 => 1.0117, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.22% (0.5168 => 0.5696, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 10.15% (0.1271 => 0.1400, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.07% (0.1202 => 0.1323, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.96% (0.4427 => 0.4868, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.87% (0.7919 => 0.8701, std.dev.: 0.0060) MultiSource/Applications/lambda-0_1_3/lambda: 9.86% (0.7982 => 0.8769, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 9.84% (0.3271 => 0.3593, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.83% (0.2106 => 0.2313, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 9.79% (1.5610 => 1.7138, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.75% (0.6736 => 0.7393, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.50% (0.1621 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.48% (1.3722 => 1.5023, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.88% (0.7198 => 0.7837, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 8.83% (0.1879 => 0.2045, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.52% (0.4083 => 0.4431, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.47% (0.1441 => 0.1563, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.08% (0.3142 => 0.3396, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 8.03% (4.3330 => 4.6809, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.94% (0.2695 => 0.2909, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 7.82% (7.0961 => 7.6511, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: 7.81% (16.1920 => 17.4563, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.67% (4.8161 => 5.1853, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.66% (0.8521 => 0.9174, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.61% (0.9077 => 0.9768, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.44% (4.8802 => 5.2435, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 7.42% (2.4924 => 2.6774, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (1.0544 => 1.1303, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 7.04% (0.4321 => 0.4625, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.97% (0.6484 => 0.6936, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.94% (8.0126 => 8.5686, std.dev.: 0.0115) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.78% (6.7716 => 7.2306, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.09% (14.2083 => 15.0737, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 5.80% (0.3446 => 0.3646, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.74% (0.3849 => 0.4070, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 5.66% (0.3394 => 0.3586, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.47% (0.9852 => 1.0391, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.34% (1.2221 => 1.2874, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.32% (1.2210 => 1.2860, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 5.26% (0.3406 => 0.3585, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.09% (0.4813 => 0.5058, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.05% (0.2355 => 0.2474, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.99% (0.4151 => 0.4358, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 4.91% (0.2160 => 0.2266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 4.11% (0.3481 => 0.3624, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 4.07% (0.4248 => 0.4421, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 3.67% (0.3788 => 0.3927, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.21% (0.9542 => 0.9753, std.dev.: 0.0037) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8070, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9531 => 1.0288, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5035, std.dev.: 0.0974) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.83% (2.0478 => 2.1057, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3831, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (79.7170 => 81.2178, std.dev.: 0.3646) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6031, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.52% (18.2231 => 18.5005, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.85% (0.3812 => 0.3627, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.70% (0.3831 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.59% (0.3880 => 0.3702, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.56% (0.3884 => 0.3707, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.34% (0.3891 => 0.3722, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/BoolLiteralTest: -4.25% (0.3834 => 0.3671, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/for-in: -4.07% (0.4033 => 0.3869, std.dev.: 0.0038) SingleSource/UnitTests/ObjC++/Hello: -2.88% (0.6347 => 0.6164, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.63% (0.4176 => 0.4066, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.32% (20.7746 => 20.2928, std.dev.: 0.0228) SingleSource/UnitTests/ObjC++/property-reference-object: -2.17% (0.6441 => 0.6301, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.83% (0.7779 => 0.7637, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.28% (2.1713 => 2.1436, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.69% (1.8100 => 0.7116, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0062) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0803, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.04% (4.1024 => 3.1983, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0008) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1333, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.25% (0.4092 => 0.3509, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3551, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.42% (3.0680 => 2.7482, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.91% (2.2633 => 2.1748, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3992, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.88% (7.9763 => 7.7469, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout/ary3: -2.77% (3.7241 => 3.6210, std.dev.: 0.0149) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1746, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.70% (6.5735 => 6.4618, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5990, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.38% (1.6307 => 1.6082, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5897, std.dev.: 0.0049) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 04:58:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 06:58:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128125838.C5EC32A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8037?compare_to=8032&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8037, Order: 173680, Start Time: 2013-01-28 10:38:44, End Time: 2013-01-28 12:58:58 To: 8032, Order: 173667, Start Time: 2013-01-28 07:46:17, End Time: 2013-01-28 10:07:49 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (273 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (599 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (14.1897 => 14.3693, std.dev.: 0.0162) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.26% (129.0044 => 130.6332, std.dev.: 0.0270) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.16% (79.2133 => 80.9266, std.dev.: 0.2556) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.09% (11.6848 => 11.5572, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1331 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.72% (0.0419 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.60% (0.0689 => 0.0678, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8457 => 499.8446, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.25% (1.1277 => 499.8446, std.dev.: 0.0057) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 268.69% (0.5229 => 1.9279, std.dev.: 0.0106) MultiSource/Applications/SPASS/SPASS: 45.67% (14.9895 => 21.8348, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 63.16% (14.1553 => 23.0962, std.dev.: 0.0224) MultiSource/Benchmarks/MallocBench/gs/gs: 30.63% (4.1105 => 5.3697, std.dev.: 0.0102) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.74% (1.1048 => 2.0963, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1724.94% (7.1582 => 130.6332, std.dev.: 0.0270) SingleSource/Benchmarks/Misc-C++-EH/spirit: 128.06% (3.4629 => 7.8975, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 100.63% (0.6222 => 1.2483, std.dev.: 0.0011) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10282.92% (0.0720 => 7.4757, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11149100.00% (0.0001 => 11.1492, std.dev.: 0.0223) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575800.00% (0.0001 => 0.5759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5480700.00% (0.0001 => 5.4808, std.dev.: 0.0073) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.69% (1.1194 => 10.3622, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/flops: 181.08% (0.1432 => 0.4025, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/factor: 171.96% (0.0296 => 0.0805, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 157.98% (22.1758 => 57.2082, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/lowercase: 140.62% (0.0256 => 0.0616, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 135.70% (0.1056 => 0.2489, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 111.93% (0.0243 => 0.0515, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.74% (0.0929 => 0.1902, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 103.70% (7.0540 => 14.3693, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/objinst: 98.83% (0.0427 => 0.0849, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 88.79% (0.1463 => 0.2762, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 87.95% (0.0730 => 0.1372, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 80.59% (0.0237 => 0.0428, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 79.31% (0.0377 => 0.0676, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 78.11% (0.2554 => 0.4549, std.dev.: 0.0009) SingleSource/Regression/C/casts: 77.67% (0.0318 => 0.0565, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 75.35% (1.5859 => 2.7808, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 71.30% (0.0439 => 0.0752, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 65.99% (0.0394 => 0.0654, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 64.03% (2.2024 => 3.6125, std.dev.: 0.0174) SingleSource/UnitTests/Vector/simple: 63.78% (0.0185 => 0.0303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.29% (2.9384 => 4.7980, std.dev.: 0.0037) SingleSource/Regression/C++/EH/function_try_block: 63.06% (0.0268 => 0.0437, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 61.12% (8.1363 => 13.1088, std.dev.: 0.0135) SingleSource/Regression/C/sumarray: 59.74% (0.0231 => 0.0369, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 59.58% (0.1143 => 0.1824, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 59.45% (0.0217 => 0.0346) SingleSource/UnitTests/2002-05-02-CastTest: 58.26% (0.0218 => 0.0345) SingleSource/Regression/C/testtrace: 57.08% (0.0212 => 0.0333, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 56.45% (0.0636 => 0.0995, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-31-CastToBool: 55.94% (0.0202 => 0.0315, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 55.94% (1.5415 => 2.4038, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: 54.31% (0.0232 => 0.0358, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 53.84% (0.3109 => 0.4783, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.99% (0.0953 => 0.1458, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 52.65% (1.1642 => 1.7772, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: 50.58% (21.9371 => 33.0334, std.dev.: 0.0152) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 49.87% (0.1125 => 0.1686, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.84% (0.6675 => 1.0002, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/04-bisect/bisect: 49.62% (0.1062 => 0.1589, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.68% (0.0793 => 0.1179, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.01% (3.8922 => 5.7608, std.dev.: 0.0192) MultiSource/Benchmarks/Olden/voronoi/voronoi: 47.93% (0.2700 => 0.3994, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.00% (4.2646 => 6.2689, std.dev.: 0.0077) SingleSource/Benchmarks/McGill/exptree: 46.93% (0.0814 => 0.1196, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 46.58% (1.0722 => 1.5716, std.dev.: 0.0014) SingleSource/UnitTests/2003-07-09-SignedArgs: 46.10% (0.0282 => 0.0412, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 45.92% (0.0527 => 0.0769, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 45.45% (0.7115 => 1.0349, std.dev.: 0.0024) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.68% (0.0564 => 0.0816, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.68% (0.0479 => 0.0693, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 44.63% (0.1555 => 0.2249, std.dev.: 0.0008) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 43.98% (0.0457 => 0.0658, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 43.75% (0.0640 => 0.0920, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/div: 43.41% (0.0258 => 0.0370, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 42.83% (0.0467 => 0.0667, std.dev.: 0.0007) SingleSource/UnitTests/block-copied-in-cxxobj: 42.58% (0.0310 => 0.0442, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.47% (0.4615 => 0.6575, std.dev.: 0.0058) SingleSource/UnitTests/SignlessTypes/shr: 42.46% (0.0252 => 0.0359, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.45% (0.0245 => 0.0349) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 42.05% (0.0730 => 0.1037, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 42.01% (2.2969 => 3.2618, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 41.80% (0.5105 => 0.7239, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/messages-2: 41.69% (0.0662 => 0.0938, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 41.46% (0.3092 => 0.4374, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.44% (0.2271 => 0.3212, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/matrix: 41.32% (0.0818 => 0.1156, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 41.32% (9.4845 => 13.4034, std.dev.: 0.0227) MultiSource/Benchmarks/llubenchmark/llu: 40.91% (0.0462 => 0.0651) MultiSource/Benchmarks/Olden/tsp/tsp: 40.68% (0.1175 => 0.1653, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 40.49% (0.6456 => 0.9070, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.48% (0.0672 => 0.0944, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.35% (0.0746 => 0.1047, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 39.94% (0.1655 => 0.2316, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 39.71% (0.1695 => 0.2368, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 39.53% (0.1032 => 0.1440, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.22% (0.5860 => 0.8158, std.dev.: 0.0056) MultiSource/Benchmarks/McCat/05-eks/eks: 38.85% (0.4299 => 0.5969, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 38.66% (0.7835 => 1.0864, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 38.53% (0.0719 => 0.0996, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.29% (0.0397 => 0.0549, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 38.14% (0.0485 => 0.0670, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 37.97% (2.0273 => 2.7970, std.dev.: 0.0050) MultiSource/Applications/lua/lua: 37.94% (3.8723 => 5.3414, std.dev.: 0.0185) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.82% (1.4186 => 1.9551, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.63% (0.3441 => 0.4736, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.63% (0.0675 => 0.0929, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 37.41% (5.7591 => 7.9137, std.dev.: 0.0133) SingleSource/UnitTests/Vector/build2: 37.29% (0.0295 => 0.0405, std.dev.: 0.0016) MultiSource/Applications/aha/aha: 37.27% (0.1151 => 0.1580, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 37.22% (0.0626 => 0.0859, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 37.17% (63.2438 => 86.7523, std.dev.: 0.0602) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 37.16% (0.1044 => 0.1432, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.14% (0.0770 => 0.1056, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 36.93% (3.3354 => 4.5671, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.71% (0.3307 => 0.4521, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.58% (0.1892 => 0.2584, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 36.24% (1.1840 => 1.6131, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.15% (0.3427 => 0.4666, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 36.15% (17.1811 => 23.3920, std.dev.: 0.0199) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.15% (0.5569 => 0.7582, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: 35.91% (0.0660 => 0.0897, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/em3d/em3d: 35.63% (0.1695 => 0.2299, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.50% (0.3121 => 0.4229, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/health/health: 35.41% (0.1268 => 0.1717, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 35.33% (0.0886 => 0.1199, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 35.20% (0.3423 => 0.4628, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/messages: 35.17% (0.0327 => 0.0442, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 35.04% (0.4620 => 0.6239, std.dev.: 0.0122) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.90% (0.0447 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 34.90% (0.0811 => 0.1094, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 34.88% (0.4289 => 0.5785, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Queens: 34.78% (0.0414 => 0.0558, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.73% (0.0933 => 0.1257, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.64% (0.4879 => 0.6569, std.dev.: 0.0042) SingleSource/UnitTests/2003-08-11-VaListArg: 34.49% (0.0316 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 34.34% (0.1584 => 0.2128, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 34.20% (0.0842 => 0.1130, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 34.12% (0.2758 => 0.3699, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/queens: 34.00% (0.0403 => 0.0540, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.63% (1.1861 => 1.5850, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.41% (0.2107 => 0.2811, std.dev.: 0.0023) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 33.16% (0.0389 => 0.0518, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.95% (0.1566 => 0.2082, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/mst/mst: 32.59% (0.1163 => 0.1542, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.44% (0.1236 => 0.1637, std.dev.: 0.0062) MultiSource/Applications/lambda-0_1_3/lambda: 32.40% (0.7433 => 0.9841, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 32.09% (0.0592 => 0.0782, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.95% (0.0770 => 0.1016, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 31.92% (0.0614 => 0.0810, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 31.56% (0.3387 => 0.4456, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.98% (0.8172 => 1.0704, std.dev.: 0.0136) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.91% (0.0482 => 0.0631, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.90% (0.1029 => 0.1347, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.77% (0.1940 => 0.2537, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.73% (1.3050 => 1.7060, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.64% (0.0408 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.53% (0.5981 => 0.7807, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.28% (0.6450 => 0.8403, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.26% (0.1510 => 0.1967, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 30.22% (0.8067 => 1.0505, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 29.96% (0.1906 => 0.2477, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: 29.82% (0.0456 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Towers: 29.72% (0.0471 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 29.63% (0.1117 => 0.1448, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.57% (4.9449 => 6.4073, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/09-vor/vor: 29.53% (0.3180 => 0.4119, std.dev.: 0.0015) SingleSource/Regression/C++/EH/exception_spec_test: 29.43% (0.0350 => 0.0453, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/rem: 29.11% (0.1144 => 0.1477, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 28.99% (0.8921 => 1.1507, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 28.96% (0.9765 => 1.2593, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.95% (0.1337 => 0.1724, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.70% (0.0871 => 0.1121, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.61% (0.0416 => 0.0535, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 28.59% (0.0633 => 0.0814, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.55% (0.5020 => 0.6453, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.54% (0.2603 => 0.3346, std.dev.: 0.0037) MultiSource/Benchmarks/BitBench/five11/five11: 28.22% (0.0567 => 0.0727, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.14% (5.0018 => 6.4094, std.dev.: 0.0109) MultiSource/Applications/hbd/hbd: 28.07% (1.5603 => 1.9982, std.dev.: 0.0139) SingleSource/Benchmarks/Stanford/Treesort: 27.98% (0.0411 => 0.0526) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.81% (0.8101 => 1.0354, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/matrix: 27.57% (0.3098 => 0.3952, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.77% (0.4203 => 0.5328, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.69% (0.3177 => 0.4025, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.61% (0.2266 => 0.2869, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.74% (0.3865 => 0.4860, std.dev.: 0.0015) SingleSource/Regression/C/bigstack: 25.42% (0.0417 => 0.0523, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.94% (0.0834 => 0.1042, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.85% (0.0491 => 0.0613, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.83% (0.0443 => 0.0553, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 24.06% (0.0798 => 0.0990, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.61% (0.0648 => 0.0801, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 23.57% (0.1625 => 0.2008, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 23.57% (0.4103 => 0.5070, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 23.33% (0.1440 => 0.1776, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0481 => 0.0592, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.05% (0.2065 => 0.2541, std.dev.: 0.0067) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.30% (0.0704 => 0.0861, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.85% (0.4636 => 0.5649, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.81% (0.1114 => 0.1357, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.58% (14.3668 => 17.4671, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 21.08% (0.0536 => 0.0649, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.92% (0.4064 => 0.4914, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 20.83% (0.3283 => 0.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 20.73% (0.3232 => 0.3902, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 20.48% (0.3282 => 0.3954, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.45% (0.1438 => 0.1732, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.05% (0.0838 => 0.1006, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 19.67% (0.2049 => 0.2452, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: 19.64% (0.4048 => 0.4843, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.59% (0.2430 => 0.2906, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 19.47% (0.3379 => 0.4037, std.dev.: 0.0005) SingleSource/UnitTests/initp1: 19.28% (0.0555 => 0.0662, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 18.71% (0.3603 => 0.4277, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.56% (0.3826 => 0.4536, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 17.92% (0.3684 => 0.4344, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 17.42% (0.3422 => 0.4018, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.2905 => 0.3402, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/property: 16.55% (0.3886 => 0.4529, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.16% (0.3650 => 0.4240, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3935 => 0.4567, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.92% (2.2022 => 2.5528, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 15.69% (0.1268 => 0.1467, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 15.46% (0.0705 => 0.0814, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 14.09% (1.2842 => 1.4651, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/parameter-passing: 14.01% (0.3927 => 0.4477, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.68% (0.1330 => 0.1512, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.28% (0.3162 => 0.3582, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 13.03% (0.2831 => 0.3200, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.59% (0.3828 => 0.4310, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.11% (2.0665 => 2.3168, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 11.95% (0.2871 => 0.3214, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 11.92% (0.2877 => 0.3220, std.dev.: 0.0008) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.71% (7.9617 => 8.8942, std.dev.: 0.0141) MultiSource/Benchmarks/PAQ8p/paq8p: 11.48% (10.3673 => 11.5572, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.45% (0.3136 => 0.3495, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.67% (0.2756 => 0.3050, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.62% (0.2891 => 0.3198, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 10.42% (0.3694 => 0.4079, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.33% (0.6030 => 0.6653, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.3052 => 0.3367, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 10.28% (0.7326 => 0.8079, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hello: 10.17% (0.2714 => 0.2990, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.04% (0.3497 => 0.3848, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.02% (0.3473 => 0.3821, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.99% (0.2872 => 0.3159, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.99% (0.2802 => 0.3082, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.91% (0.2725 => 0.2995, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.70% (0.2793 => 0.3064, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/objinst: 7.79% (0.3131 => 0.3375, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.75% (0.3817 => 0.3922, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4735, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (1.1145 => 1.2948, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 9.36% (1.1396 => 1.2463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4266, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4503, std.dev.: 0.0168) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1066, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9056, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.41% (1.0313 => 1.0562, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.08% (3.6395 => 3.7153, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.73% (9.1159 => 9.2735, std.dev.: 0.0064) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2393, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.75% (6.6874 => 0.2172, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.47% (5.2763 => 1.2945, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -74.87% (0.8651 => 0.2174, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -35.33% (0.1622 => 0.1049, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.91% (5.3855 => 4.9597, std.dev.: 0.0023) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9299, std.dev.: 0.0140) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.24% (5.3526 => 4.9650, std.dev.: 0.0084) MultiSource/Applications/JM/ldecod/ldecod: -4.35% (10.4361 => 9.9825, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.10% (1.7609 => 1.7064, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.74% (1.9577 => 0.6708, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.77% (0.3987 => 0.2561, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.64% (1.5373 => 1.0201, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel: -33.34% (1.1492 => 0.7661, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.43% (10.7105 => 7.4515, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8530, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0066, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1248, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.54% (1.6925 => 1.4295, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7339, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.03% (0.9540 => 0.8392, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4935, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.96% (19.9488 => 18.5606, std.dev.: 0.0268) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.59% (1.2373 => 1.1558, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7074, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.35% (10.2830 => 9.8355, std.dev.: 0.0080) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0079) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Shootout/ary3: -2.07% (3.6994 => 3.6228, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3282, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7221 => 3.6717, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: -1.14% (4.6441 => 4.5910, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2308, std.dev.: 0.0083) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0008) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 05:38:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 07:38:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128133843.D78952A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8038?compare_to=8035&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8038, Order: 173680, Start Time: 2013-01-28 11:31:58, End Time: 2013-01-28 13:39:05 To: 8035, Order: 173675, Start Time: 2013-01-28 09:06:59, End Time: 2013-01-28 11:14:49 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (197 on baseline) Performance Improvements: 2 (52 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1054 (814 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.56% (3.4907 => 3.5450, std.dev.: 0.0080) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.70% (1.4586 => 1.8480, std.dev.: 0.0175) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 15.27% (0.0910 => 0.1049, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.08% (0.3286 => 0.3650, std.dev.: 0.0127) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.76% (13.1873 => 14.3430, std.dev.: 0.2383) SingleSource/Benchmarks/Misc-C++/bigfib: 6.72% (0.3407 => 0.3636, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.32% (1.0554 => 1.1115, std.dev.: 0.0188) SingleSource/Benchmarks/Shootout/matrix: 4.78% (6.8612 => 7.1895, std.dev.: 0.0661) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -1.91% (4.8001 => 4.7086, std.dev.: 0.0281) MultiSource/Benchmarks/nbench/nbench: -1.17% (21.9583 => 21.7018, std.dev.: 0.0914) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.30% (1.4351 => 1.4308, std.dev.: 0.0652) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.23% (0.0432 => 0.0433, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0336 => 0.0336, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.31% (0.0319 => 0.0320, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.70% (0.0430 => 0.0433, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0222 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 29.45% (0.0163 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 1.57% (0.1465 => 0.1488, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 2.84% (1.1425 => 1.1750, std.dev.: 0.0376) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.13% (0.3939 => 0.3934, std.dev.: 0.0660) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.96% (0.1462 => 0.1448, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 12.82% (0.0616 => 0.0695, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.52% (0.0577 => 0.0580, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.49% (1.2822 => 1.2885, std.dev.: 0.0565) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 700.00% (0.0001 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.03% (0.0569 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.07% (0.0327 => 0.0373, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.43% (1.7731 => 1.7655, std.dev.: 0.0290) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0003 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 0.82% (0.0122 => 0.0123, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.83% (33.9089 => 34.1893, std.dev.: 0.2343) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.81% (0.0336 => 0.1676, std.dev.: 0.0037) SingleSource/Regression/C/sumarraymalloc: 131.74% (0.0293 => 0.0679, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 80.68% (0.0383 => 0.0692, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 73.14% (23.5861 => 40.8378, std.dev.: 0.8529) SingleSource/Regression/C/sumarray: 65.28% (0.0265 => 0.0438, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/objinst: 58.75% (0.0480 => 0.0762, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.71% (0.9120 => 1.4292, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.65% (0.9612 => 1.5057, std.dev.: 0.1103) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 56.53% (0.8893 => 1.3920, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 56.36% (0.9588 => 1.4992, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 56.18% (0.8926 => 1.3941, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 55.60% (0.9061 => 1.4099, std.dev.: 0.0433) SingleSource/Benchmarks/McGill/exptree: 55.18% (0.0859 => 0.1333, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.87% (0.9564 => 1.4812, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 54.78% (0.9381 => 1.4520, std.dev.: 0.0436) SingleSource/UnitTests/2003-05-31-CastToBool: 54.23% (0.0260 => 0.0401, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 54.00% (0.9855 => 1.5177, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 53.36% (0.8990 => 1.3787, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 53.16% (0.9091 => 1.3924, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 53.06% (0.9998 => 1.5303, std.dev.: 0.0119) SingleSource/UnitTests/SignlessTypes/div: 52.19% (0.0320 => 0.0487, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 52.17% (0.9422 => 1.4337, std.dev.: 0.0507) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 52.10% (0.9010 => 1.3704, std.dev.: 0.0992) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 52.00% (0.9403 => 1.4293, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.48% (1.0119 => 1.5328, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 51.46% (0.9512 => 1.4407, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 51.25% (1.0867 => 1.6436, std.dev.: 0.0763) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 51.20% (0.8912 => 1.3475, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 51.13% (0.8736 => 1.3203, std.dev.: 0.0168) SingleSource/UnitTests/2006-12-11-LoadConstants: 50.24% (0.1274 => 0.1914, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 49.70% (1.0052 => 1.5048, std.dev.: 0.0657) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.48% (0.8732 => 1.3053, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 49.24% (0.8846 => 1.3202, std.dev.: 0.0420) SingleSource/Benchmarks/Misc/himenobmtxpa: 49.00% (0.1955 => 0.2913, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 48.87% (0.9867 => 1.4689, std.dev.: 0.0176) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.65% (3.6295 => 5.3952, std.dev.: 0.0464) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.58% (0.0492 => 0.0731, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: 48.17% (0.0793 => 0.1175, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 47.78% (0.9788 => 1.4465, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 46.89% (1.0017 => 1.4714, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.88% (0.9507 => 1.3964, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.54% (0.9488 => 1.3904, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 46.40% (1.0088 => 1.4769, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 45.14% (0.9685 => 1.4057, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.79% (0.9993 => 1.4469, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.67% (0.9127 => 1.3204, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 44.58% (2.4519 => 3.5450, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 44.24% (0.9405 => 1.3566, std.dev.: 0.0160) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 43.47% (1.8651 => 2.6759, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.82% (0.9550 => 1.3639, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/IntMM: 42.69% (0.0431 => 0.0615, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 42.40% (1.0860 => 1.5465, std.dev.: 0.0561) MultiSource/Benchmarks/McCat/08-main/main: 41.34% (0.2915 => 0.4120, std.dev.: 0.0450) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 41.17% (1.8127 => 2.5589, std.dev.: 0.0714) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 40.13% (0.4762 => 0.6673, std.dev.: 0.0386) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 39.30% (0.0738 => 0.1028, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 38.35% (0.3374 => 0.4668, std.dev.: 0.0040) SingleSource/UnitTests/2003-07-09-SignedArgs: 37.82% (0.0275 => 0.0379, std.dev.: 0.0009) SingleSource/UnitTests/2003-08-11-VaListArg: 37.55% (0.0277 => 0.0381, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 36.71% (0.3598 => 0.4919, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 36.52% (0.0805 => 0.1099, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 35.08% (0.0707 => 0.0955, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 34.71% (0.0821 => 0.1106, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 34.68% (0.0669 => 0.0901, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 34.28% (0.0738 => 0.0991, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 34.25% (9.5202 => 12.7807, std.dev.: 0.5893) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 33.88% (0.0856 => 0.1146, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/queens: 33.67% (0.0490 => 0.0655, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 33.13% (0.0486 => 0.0647, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 32.75% (16.4479 => 21.8342, std.dev.: 0.1478) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 32.71% (0.0642 => 0.0852, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bh/bh: 32.36% (0.3273 => 0.4332, std.dev.: 0.0335) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 31.67% (0.0783 => 0.1031, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 30.94% (0.7776 => 1.0182, std.dev.: 0.0481) SingleSource/Benchmarks/McGill/chomp: 30.17% (0.1793 => 0.2334, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 29.89% (0.1017 => 0.1321, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.68% (0.1046 => 0.1346, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 27.75% (0.1384 => 0.1768, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/lists: 27.35% (0.0735 => 0.0936, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 27.14% (0.2100 => 0.2670, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 26.58% (0.0696 => 0.0881, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 26.55% (33.2440 => 42.0713, std.dev.: 1.5048) MultiSource/Applications/SIBsim4/SIBsim4: 25.90% (1.4392 => 1.8120, std.dev.: 0.0707) MultiSource/Benchmarks/llubenchmark/llu: 25.41% (0.0547 => 0.0686, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.98% (0.5369 => 0.6710, std.dev.: 0.0390) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.27% (0.7693 => 0.9560, std.dev.: 0.0177) SingleSource/Benchmarks/Misc-C++/bigfib: 24.17% (0.6711 => 0.8333, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 23.94% (17.5634 => 21.7673, std.dev.: 0.4304) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 23.64% (0.7225 => 0.8933, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.48% (0.0775 => 0.0957, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.28% (0.0713 => 0.0879, std.dev.: 0.0027) MultiSource/Applications/oggenc/oggenc: 23.26% (5.3553 => 6.6012, std.dev.: 0.0463) MultiSource/Benchmarks/NPB-serial/is/is: 23.21% (0.0797 => 0.0982, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.60% (0.2385 => 0.2924, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 22.57% (0.1927 => 0.2362, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 22.54% (0.0803 => 0.0984, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 22.54% (0.0457 => 0.0560, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.43% (0.2884 => 0.3531, std.dev.: 0.0048) SingleSource/UnitTests/Vectorizer/gcc-loops: 22.32% (0.4596 => 0.5622, std.dev.: 0.0078) MultiSource/Benchmarks/Ptrdist/bc/bc: 22.09% (1.2680 => 1.5481, std.dev.: 0.1022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.78% (0.9214 => 1.1221, std.dev.: 0.0154) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.73% (0.6135 => 0.7468, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.35% (0.0918 => 0.1114, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: 21.14% (1.3979 => 1.6934, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 21.10% (0.3394 => 0.4110, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.75% (0.0935 => 0.1129, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/misr: 20.18% (0.0649 => 0.0780, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 19.92% (0.0718 => 0.0861, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 19.56% (0.0726 => 0.0868, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.55% (6.4235 => 7.6794, std.dev.: 0.0727) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.47% (0.0976 => 0.1166, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 19.09% (44.1538 => 52.5809, std.dev.: 0.8913) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 19.06% (0.0918 => 0.1093, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 18.80% (2.6437 => 3.1406, std.dev.: 0.0757) MultiSource/Benchmarks/PAQ8p/paq8p: 18.76% (2.5772 => 3.0608, std.dev.: 0.0947) MultiSource/Applications/JM/lencod/lencod: 18.67% (16.7012 => 19.8187, std.dev.: 0.1382) MultiSource/Applications/ALAC/decode/alacconvert-decode: 18.57% (1.1731 => 1.3909, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.50% (4.6579 => 5.5198, std.dev.: 0.1257) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 18.36% (0.0730 => 0.0864, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.78% (0.2879 => 0.3391, std.dev.: 0.0125) MultiSource/Benchmarks/MallocBench/gs/gs: 17.60% (4.5936 => 5.4020, std.dev.: 0.0524) MultiSource/Benchmarks/BitBench/five11/five11: 17.59% (0.0614 => 0.0722, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 17.42% (3.7840 => 4.4431, std.dev.: 0.1287) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.24% (0.0963 => 0.1129, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.01% (0.0776 => 0.0908, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.62% (14.9757 => 17.4645, std.dev.: 0.4895) SingleSource/Benchmarks/Stanford/Oscar: 16.24% (0.0659 => 0.0766, std.dev.: 0.0015) MultiSource/Applications/JM/ldecod/ldecod: 16.16% (7.3529 => 8.5411, std.dev.: 0.0414) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 16.04% (0.0636 => 0.0738, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: 16.01% (17.4365 => 20.2278, std.dev.: 0.3216) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.99% (1.6874 => 1.9572, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 15.91% (0.0704 => 0.0816, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.49% (0.1356 => 0.1566, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.44% (0.3277 => 0.3783, std.dev.: 0.0085) MultiSource/Applications/viterbi/viterbi: 15.08% (0.1824 => 0.2099, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 14.93% (0.2050 => 0.2356, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: 14.79% (0.1109 => 0.1273, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.58% (0.1317 => 0.1509, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 14.20% (2.4719 => 2.8230, std.dev.: 0.0287) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.08% (7.2721 => 8.2963, std.dev.: 0.2137) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.94% (0.5059 => 0.5764, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 13.65% (18.9377 => 21.5235, std.dev.: 0.8068) MultiSource/Applications/ALAC/encode/alacconvert-encode: 13.52% (1.2154 => 1.3797, std.dev.: 0.0209) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.30% (4.8904 => 5.5409, std.dev.: 0.1135) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 12.45% (0.1366 => 0.1536, std.dev.: 0.0049) MultiSource/Benchmarks/sim/sim: 11.82% (0.3715 => 0.4154, std.dev.: 0.0144) MultiSource/Applications/aha/aha: 11.39% (0.1378 => 0.1535, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.60% (0.3981 => 0.4403, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.48% (0.3665 => 0.4049, std.dev.: 0.0033) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.72% (0.3847 => 0.4221, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.61% (0.7686 => 0.8425, std.dev.: 0.0210) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.29% (0.1184 => 0.1294, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.93% (0.2709 => 0.2951, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.69% (0.1622 => 0.1763, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.58% (1.3924 => 1.5119, std.dev.: 0.0130) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.15% (0.4121 => 0.4457, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.15% (0.3462 => 0.3744, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sieve: 7.86% (0.2913 => 0.3142, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary3: 7.61% (0.2564 => 0.2759, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: 7.53% (0.8653 => 0.9305, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.18% (0.1587 => 0.1701, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 6.53% (1.0220 => 1.0887, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout-C++/moments: 6.32% (0.4002 => 0.4255, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary2: 5.85% (0.2665 => 0.2821, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.32% (1.3220 => 1.3791, std.dev.: 0.0131) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106912.50% (0.0008 => 0.8561, std.dev.: 0.0153) SingleSource/Benchmarks/Shootout/matrix: 354.31% (1.5825 => 7.1895, std.dev.: 0.0661) SingleSource/Benchmarks/Shootout/ary3: 282.70% (2.2304 => 8.5358, std.dev.: 1.0144) MultiSource/Applications/sgefa/sgefa: 258.66% (0.3515 => 1.2607, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.77% (1.1825 => 4.0651, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 225.84% (4.8185 => 15.7008, std.dev.: 0.1786) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 195.18% (0.0228 => 0.0673, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary2: 192.25% (0.0129 => 0.0377, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 146.12% (0.0232 => 0.0571, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/matrix: 61.90% (2.9083 => 4.7086, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.61% (0.2562 => 0.3423, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.98% (3.1254 => 4.0935, std.dev.: 0.0068) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.17% (1.4588 => 1.8551, std.dev.: 0.0259) SingleSource/Benchmarks/Misc/salsa20: 21.85% (7.4497 => 9.0772, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.51% (4.8112 => 5.7981, std.dev.: 0.0928) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.42% (5.6033 => 6.7474, std.dev.: 0.2497) SingleSource/Regression/C/uint64_to_float: 15.99% (1.5397 => 1.7859, std.dev.: 0.0711) MultiSource/Applications/JM/lencod/lencod: 14.51% (6.8159 => 7.8048, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.21% (5.1752 => 5.8588, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.94% (5.0033 => 5.6508, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.77% (3.6477 => 3.9676, std.dev.: 0.0489) SingleSource/Benchmarks/Misc/ReedSolomon: 7.92% (8.6447 => 9.3293, std.dev.: 0.1130) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.21% (0.1622 => 0.1739, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 6.17% (1.0425 => 1.1068, std.dev.: 0.0063) MultiSource/Benchmarks/nbench/nbench: 5.80% (20.5117 => 21.7018, std.dev.: 0.0914) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (4.1836 => 4.4050, std.dev.: 0.0022) SingleSource/Benchmarks/Linpack/linpack-pc: 4.79% (50.8945 => 53.3313, std.dev.: 0.3054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.87% (5.0310 => 5.2256, std.dev.: 0.0103) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.83% (0.5224 => 0.5424, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/pi: 3.37% (2.1390 => 2.2110, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.27% (4.7254 => 4.8800, std.dev.: 0.0040) MultiSource/Applications/siod/siod: 1.07% (3.5910 => 3.6295, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -23.38% (0.0727 => 0.0557, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.82% (11.5523 => 3.9491, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -62.23% (15.6525 => 5.9113, std.dev.: 0.2476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.17% (0.4146 => 0.1817, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.17% (0.4578 => 0.2373, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3751, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.94% (5.4023 => 3.6230, std.dev.: 0.0508) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.91% (0.4452 => 0.3076, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.19% (0.5495 => 0.4001, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.17% (5.2605 => 3.8836, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.32% (0.5826 => 0.4351, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.10% (4.4467 => 3.3307, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.45% (0.5897 => 0.4455, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.41% (4.9921 => 3.8233, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: -23.14% (1.8123 => 1.3930, std.dev.: 0.0517) MultiSource/Applications/minisat/minisat: -21.81% (7.9891 => 6.2467, std.dev.: 0.6185) SingleSource/Benchmarks/Shootout-C++/heapsort: -20.87% (4.2042 => 3.3267, std.dev.: 0.3040) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.46% (5.8755 => 4.7910, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.02% (7.0016 => 5.9502, std.dev.: 0.2149) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.01% (16.6791 => 14.3430, std.dev.: 0.2383) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.16% (3.1921 => 2.7719, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6749, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9947, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.38% (9.7992 => 8.5865, std.dev.: 0.0128) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.88% (0.1164 => 0.1049, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.86% (2.8778 => 2.5941, std.dev.: 0.1087) MultiSource/Applications/SPASS/SPASS: -9.71% (9.0650 => 8.1851, std.dev.: 0.2071) SingleSource/Benchmarks/Shootout-C++/lists1: -9.32% (0.6628 => 0.6010, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: -7.45% (3.5443 => 3.2802, std.dev.: 0.0636) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.78% (0.3217 => 0.2999, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.60% (23.3986 => 21.8539, std.dev.: 0.5172) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.56% (5.5974 => 5.2301, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.56% (4.5424 => 4.2446, std.dev.: 0.0635) SingleSource/Benchmarks/McGill/queens: -5.82% (1.7443 => 1.6428, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.77% (4.9799 => 4.6924, std.dev.: 0.0383) MultiSource/Benchmarks/mafft/pairlocalalign: -5.62% (63.1520 => 59.6050, std.dev.: 0.4541) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.45% (3.7662 => 3.5611, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.41% (3.5127 => 3.3226, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (3.6768 => 3.4985, std.dev.: 0.0334) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.98% (2.7432 => 2.6340, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.75% (3.5691 => 3.4353, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (5.8973 => 5.6824, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/lists: -3.49% (17.2182 => 16.6166, std.dev.: 0.0544) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.05% (1.4446 => 1.4006, std.dev.: 0.0141) SingleSource/Benchmarks/Misc/mandel-2: -2.35% (0.8521 => 0.8321, std.dev.: 0.0061) MultiSource/Applications/spiff/spiff: -2.04% (2.8571 => 2.7989, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.98% (8.7327 => 8.5595, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.71% (85.3042 => 83.8441, std.dev.: 0.1063) SingleSource/Benchmarks/Misc/whetstone: -1.62% (1.6251 => 1.5987, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3155, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7490, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/fibo: -1.10% (4.3512 => 4.3035, std.dev.: 0.0076) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 18.77% (1.2047 => 1.4308, std.dev.: 0.0652) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0076) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.44% (0.0328 => 0.0320, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0121) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0011) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.25% (0.0255 => 0.0211, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.75% (0.1530 => 0.1488, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: -39.10% (1.9293 => 1.1750, std.dev.: 0.0376) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.84% (0.4049 => 0.3934, std.dev.: 0.0660) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.11% (0.1510 => 0.1448, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.94% (0.0978 => 0.0695, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.69% (0.0590 => 0.0580, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.92% (1.1617 => 1.2885, std.dev.: 0.0565) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0085) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.39% (0.7437 => 1.7655, std.dev.: 0.0290) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 200.00% (0.0001 => 0.0003, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.56% (12.7781 => 34.1893, std.dev.: 0.2343) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 06:10:24 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 08:10:24 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128141024.869122A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8039?compare_to=8036&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8039, Order: 173682, Start Time: 2013-01-28 12:33:51, End Time: 2013-01-28 14:10:44 To: 8036, Order: 173680, Start Time: 2013-01-28 10:33:50, End Time: 2013-01-28 12:10:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (222 on baseline) Performance Improvements: 2 (73 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (797 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (0.7116 => 0.6948, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.40% (81.2178 => 80.0823, std.dev.: 0.4250) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 92.86% (0.0280 => 0.0540, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.10% (0.0717 => 0.1320, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.88% (0.0514 => 0.0940, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.90% (0.0974 => 0.1684, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 65.02% (0.1132 => 0.1868, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 60.27% (0.1500 => 0.2404, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 52.64% (22.4056 => 34.1999, std.dev.: 0.0208) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.38% (0.6395 => 0.9489, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.25% (0.0599 => 0.0888, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 47.71% (0.0371 => 0.0548, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.11% (1.6474 => 2.4235, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/objinst: 43.24% (0.0407 => 0.0583, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 42.34% (0.0418 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.24% (0.6395 => 0.9096, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.06% (0.6260 => 0.8893, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.88% (0.5688 => 0.8070, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.69% (0.5805 => 0.8225, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.40% (0.5456 => 0.7715, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.17% (0.5849 => 0.8257, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.87% (0.5567 => 0.7842, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.65% (0.5575 => 0.7841, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.60% (0.5581 => 0.7847, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.84% (0.5941 => 0.8308, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.39% (0.5859 => 0.8167, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.01% (2.2587 => 3.1398, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.94% (0.6033 => 0.8382, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 38.77% (0.0699 => 0.0970, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.56% (0.6440 => 0.8923, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.76% (0.6676 => 0.9197, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.75% (0.0445 => 0.0613, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.66% (0.6189 => 0.8520, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.64% (0.6230 => 0.8575, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 37.20% (0.0293 => 0.0402) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.79% (0.6304 => 0.8623, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.77% (0.0582 => 0.0796, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.37% (0.5802 => 0.7912, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.27% (0.5925 => 0.8074, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 36.26% (0.1230 => 0.1676, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.90% (0.6660 => 0.9051, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.69% (0.5705 => 0.7741, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.24% (0.5857 => 0.7921, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.00% (0.5569 => 0.7518, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.92% (0.5478 => 0.7391, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.85% (0.5570 => 0.7511, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/08-main/main: 34.64% (0.2659 => 0.3580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.52% (0.5591 => 0.7521, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 34.29% (1.1450 => 1.5376, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 33.62% (0.6446 => 0.8613, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.53% (0.5863 => 0.7829, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.42% (0.0790 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.35% (0.7524 => 1.0033, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.29% (0.6052 => 0.8067, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 32.80% (0.0622 => 0.0826, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.54% (0.6681 => 0.8855, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 32.45% (0.6194 => 0.8204, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.94% (0.6297 => 0.8308, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.60% (0.0693 => 0.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.29% (0.0556 => 0.0730, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.12% (0.6667 => 0.8742, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.46% (1.6364 => 2.1348, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.39% (0.7339 => 0.9496, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.29% (0.0833 => 0.1077, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.97% (0.0680 => 0.0877, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.86% (0.0634 => 0.0817, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.80% (3.5339 => 4.5518, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 28.45% (0.0566 => 0.0727, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.58% (5.4682 => 6.9762, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.88% (1.2784 => 1.6220, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.84% (0.1796 => 0.2278, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.11% (0.7021 => 0.8854, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 25.89% (1.2515 => 1.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.88% (0.0707 => 0.0890, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.83% (0.1146 => 0.1442, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 25.47% (0.3357 => 0.4212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 24.06% (0.0665 => 0.0825, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 23.19% (0.0621 => 0.0765, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 23.15% (0.0864 => 0.1064, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 23.12% (0.0731 => 0.0900, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.94% (0.1081 => 0.1329, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.68% (4.5069 => 5.5290, std.dev.: 0.0028) MultiSource/Applications/SPASS/SPASS: 22.53% (15.5079 => 19.0023, std.dev.: 0.0205) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.86% (0.0764 => 0.0931, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.37% (0.1731 => 0.2101, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 21.05% (9.2283 => 11.1708, std.dev.: 0.0183) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.53% (0.0526 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0571 => 0.0688, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.45% (0.0885 => 0.1066, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.25% (0.5329 => 0.6408, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.10% (0.0806 => 0.0968, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 20.03% (0.6750 => 0.8102, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.83% (0.4916 => 0.5891, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 19.81% (0.7447 => 0.8922, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 19.69% (2.4021 => 2.8750, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.54% (0.0604 => 0.0722, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: 19.48% (0.0919 => 0.1098, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 19.36% (0.2985 => 0.3563, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.18% (0.3483 => 0.4151, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.96% (0.0617 => 0.0734, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 18.76% (0.4515 => 0.5362, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.74% (0.2385 => 0.2832, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.72% (0.1982 => 0.2353, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 18.06% (0.0598 => 0.0706, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: 18.02% (1.3864 => 1.6362, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 18.00% (17.1032 => 20.1823, std.dev.: 0.0258) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.69% (0.1509 => 0.1776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.61% (1.4642 => 1.7220, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.32% (0.0710 => 0.0833, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 17.19% (0.0704 => 0.0825) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.11% (0.2548 => 0.2984, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.62% (0.1077 => 0.1256, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 16.59% (0.0645 => 0.0752, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 16.56% (2.1401 => 2.4944, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 16.49% (0.1674 => 0.1950, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.33% (0.3491 => 0.4061, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.29% (0.6293 => 0.7318, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.20% (0.9557 => 1.1105, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 16.18% (5.0226 => 5.8353, std.dev.: 0.0104) MultiSource/Benchmarks/Bullet/bullet: 16.16% (34.0927 => 39.6034, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout-C++/hash2: 16.09% (0.4861 => 0.5643, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (0.1096 => 0.1272, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 15.92% (0.4524 => 0.5244, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 15.91% (4.0594 => 4.7053, std.dev.: 0.0132) SingleSource/Benchmarks/Misc/whetstone: 15.74% (0.0686 => 0.0794, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 15.52% (1.1530 => 1.3320, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 15.45% (0.1761 => 0.2033, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 15.32% (0.8418 => 0.9708, std.dev.: 0.0015) MultiSource/Benchmarks/NPB-serial/is/is: 15.25% (0.0708 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.25% (0.0741 => 0.0854, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.22% (3.5154 => 4.0504, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/matrix: 15.18% (0.0797 => 0.0918, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.89% (0.1145 => 0.1304, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.83% (0.3658 => 0.4164, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.52% (0.5999 => 0.6810, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.50% (1.2300 => 1.3961, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 13.19% (18.2933 => 20.7058, std.dev.: 0.0298) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.95% (0.1290 => 0.1457, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.90% (0.3319 => 0.3747, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 12.79% (0.3581 => 0.4039, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.51% (0.0919 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.49% (0.2001 => 0.2251, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/em3d/em3d: 12.24% (0.1862 => 0.2090, std.dev.: 0.0006) MultiSource/Applications/ClamAV/clamscan: 12.05% (15.2527 => 17.0899, std.dev.: 0.0074) SingleSource/UnitTests/SignlessTypes/rem: 12.03% (0.1197 => 0.1341, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 11.61% (0.1154 => 0.1288, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.59% (0.0932 => 0.1040, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.57% (0.2999 => 0.3346) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.52% (0.1076 => 0.1200, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.35% (4.0323 => 4.4900, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.25% (0.1173 => 0.1305, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.19% (0.0974 => 0.1083, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.80% (0.2278 => 0.2524) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.65% (0.1108 => 0.1226, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 10.51% (0.3255 => 0.3597, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 10.49% (0.9179 => 1.0142, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.27% (0.5168 => 0.5699, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 10.23% (0.1202 => 0.1325, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.21% (0.2106 => 0.2321, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.15% (0.1271 => 0.1400, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 10.06% (0.3271 => 0.3600, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.94% (0.7919 => 0.8706, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.87% (0.6736 => 0.7401, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 9.80% (0.7982 => 0.8764, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.78% (0.4427 => 0.4860, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 9.72% (1.5610 => 1.7127, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (0.1621 => 0.1778, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.66% (1.3722 => 1.5048, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 9.05% (0.1879 => 0.2049, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.67% (0.7198 => 0.7822, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.40% (0.1441 => 0.1562, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 8.34% (0.1211 => 0.1312, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.23% (0.4083 => 0.4419, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 8.12% (4.3330 => 4.6849, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.3142 => 0.3397, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.05% (0.2695 => 0.2912, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.99% (0.8521 => 0.9202, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.92% (7.0961 => 7.6580, std.dev.: 0.0171) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.81% (4.8161 => 5.1921, std.dev.: 0.0015) MultiSource/Applications/JM/lencod/lencod: 7.73% (16.1920 => 17.4435, std.dev.: 0.0191) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.9077 => 0.9764, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.56% (4.8802 => 5.2491, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: 7.33% (2.4924 => 2.6750, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.28% (1.0544 => 1.1312, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.14% (0.6484 => 0.6947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.99% (8.0126 => 8.5730, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.90% (0.4321 => 0.4619, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.81% (6.7716 => 7.2329, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (14.2083 => 15.1003, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/ary3: 5.72% (0.3446 => 0.3643, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.61% (0.3849 => 0.4065, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (0.9852 => 1.0402, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.52% (1.2221 => 1.2896, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 5.45% (0.3394 => 0.3579, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.43% (1.2210 => 1.2873, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 5.37% (0.3406 => 0.3589, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.18% (0.2355 => 0.2477, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.08% (0.4151 => 0.4362, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.07% (0.4813 => 0.5057, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.2160 => 0.2268, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 4.14% (0.4248 => 0.4424, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 3.88% (0.3481 => 0.3616, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3931 => 0.4079, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 3.56% (0.3788 => 0.3923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 3.26% (0.3867 => 0.3993, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.17% (0.9542 => 0.9749, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8012, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.99% (1.2783 => 1.3676, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1497, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5079, std.dev.: 0.0388) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1007, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 2.03% (27.8210 => 28.3848, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6038, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5118, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2690, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.17% (10.3489 => 10.4703, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.59% (0.3812 => 0.3637, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3831 => 0.3663, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.30% (0.3884 => 0.3717, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.26% (0.3896 => 0.3730, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.02% (0.4033 => 0.3871, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.20% (0.6347 => 0.6144, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.39% (0.4176 => 0.4076, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.36% (0.6441 => 0.6289, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.27% (20.7746 => 20.3022, std.dev.: 0.0455) SingleSource/UnitTests/ObjC++/property-reference: -2.10% (0.7779 => 0.7616, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.39% (2.1713 => 2.1412, std.dev.: 0.0106) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.61% (1.8100 => 0.6948, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4206) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.33% (1.3643 => 1.0323, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7530, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0824, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.06% (4.1024 => 3.1975, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -14.98% (2.5106 => 2.1345, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3545, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.88% (1.2842 => 1.1702, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (1.7753 => 1.6988, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -4.04% (2.2633 => 2.1719, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.29% (5.5807 => 5.3969, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.24% (7.9763 => 7.7976, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6434, std.dev.: 0.0225) MultiSource/Benchmarks/Bullet/bullet: -1.75% (7.3040 => 7.1759, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4683, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.38% (1.6307 => 1.6082, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: -1.36% (3.7092 => 3.6586, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6219 => 1.6036, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 07:00:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 09:00:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130128150052.C99D22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8040?compare_to=8034&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8040, Order: 173680, Start Time: 2013-01-28 11:25:45, End Time: 2013-01-28 15:01:11 To: 8034, Order: 173659, Start Time: 2013-01-28 06:37:53, End Time: 2013-01-28 10:29:36 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (204 on baseline) Performance Improvements: 0 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (734 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.02% (2.4317 => 2.4566, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 31.39% (57.0287 => 74.9313, std.dev.: 0.0176) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 50.05% (0.5361 => 0.8044, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.72% (0.0625 => 0.0917, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.33% (0.0547 => 0.0784, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.04% (0.1063 => 0.1478, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 37.13% (0.1088 => 0.1492, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/almabench: 36.65% (0.0281 => 0.0384, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/mason/mason: 35.86% (0.0304 => 0.0413, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 35.80% (1.5932 => 2.1635, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.60% (0.7426 => 1.0070, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 35.17% (0.1106 => 0.1495, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 33.69% (0.0561 => 0.0750, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 33.04% (0.2040 => 0.2714, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/treeadd/treeadd: 32.93% (0.0331 => 0.0440, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.44% (0.0897 => 0.1188, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 32.30% (0.4139 => 0.5476, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.16% (0.4994 => 0.6600, std.dev.: 0.0152) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 31.96% (0.2969 => 0.3918, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.79% (0.0563 => 0.0742, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 31.77% (0.1218 => 0.1605, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 31.72% (0.0599 => 0.0789, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.68% (0.5000 => 0.6584, std.dev.: 0.0041) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.68% (0.0584 => 0.0769, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.47% (0.5900 => 0.7757, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 31.31% (0.0808 => 0.1061, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 30.63% (0.0604 => 0.0789, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.52% (0.0367 => 0.0479, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.36% (0.0415 => 0.0541, std.dev.: 0.0025) MultiSource/Applications/aha/aha: 29.52% (0.0481 => 0.0623, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/bisort/bisort: 29.51% (0.0349 => 0.0452, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.41% (0.0714 => 0.0924, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bh/bh: 29.36% (0.1284 => 0.1661, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.21% (0.1003 => 0.1296, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.10% (0.0457 => 0.0590, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 28.88% (0.0419 => 0.0540, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 28.76% (0.0605 => 0.0779, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 28.64% (0.0440 => 0.0566, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.63% (0.0475 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 28.60% (0.2566 => 0.3300, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 28.50% (0.0386 => 0.0496, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: 28.48% (0.0495 => 0.0636, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.44% (0.3084 => 0.3961, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.34% (11.6398 => 14.9381, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 28.28% (0.0541 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.25% (0.0584 => 0.0749, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.24% (0.1604 => 0.2057, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.21% (0.0390 => 0.0500, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 28.15% (0.1549 => 0.1985, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 28.09% (0.1107 => 0.1418, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/09-vor/vor: 28.04% (0.1505 => 0.1927, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.91% (0.1021 => 0.1306, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 27.76% (0.0425 => 0.0543, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 27.74% (0.0948 => 0.1211, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 27.67% (0.1619 => 0.2067, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.67% (0.2736 => 0.3493, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.63% (0.4253 => 0.5428, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/04-bisect/bisect: 27.49% (0.0633 => 0.0807, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 27.48% (1.8794 => 2.3959, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 27.48% (5.5417 => 7.0646, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.43% (0.0452 => 0.0576, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.29% (0.1103 => 0.1404, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 27.24% (0.0947 => 0.1205, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.20% (0.2103 => 0.2675, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 27.17% (0.3890 => 0.4947, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.11% (0.3903 => 0.4961, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 27.10% (0.0642 => 0.0816, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/distray/distray: 26.88% (0.0398 => 0.0505, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 26.88% (0.1968 => 0.2497, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.79% (0.1620 => 0.2054, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.71% (0.2014 => 0.2552, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 26.67% (1.3152 => 1.6659, std.dev.: 0.0206) SingleSource/UnitTests/Vector/SSE/sse_isamax: 26.62% (0.0462 => 0.0585, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 26.31% (0.0821 => 0.1037, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/bc/bc: 26.28% (0.3930 => 0.4963, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.28% (0.0822 => 0.1038, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.26% (0.1028 => 0.1298, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.24% (0.0804 => 0.1015, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 26.20% (0.2691 => 0.3396, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 26.17% (0.1383 => 0.1745, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/18-imp/imp: 26.11% (0.1421 => 0.1792, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.10% (0.2866 => 0.3614, std.dev.: 0.0084) MultiSource/Applications/sqlite3/sqlite3: 26.02% (2.0346 => 2.5641, std.dev.: 0.0144) MultiSource/Applications/spiff/spiff: 26.01% (0.4029 => 0.5077, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 25.87% (0.0491 => 0.0618, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 25.50% (0.9697 => 1.2170, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/mst/mst: 25.50% (0.0698 => 0.0876, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 25.48% (4.2109 => 5.2839, std.dev.: 0.1052) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.44% (0.1462 => 0.1834, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.43% (0.4361 => 0.5470, std.dev.: 0.0078) MultiSource/Benchmarks/FreeBench/neural/neural: 25.38% (0.0394 => 0.0494) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.31% (0.3271 => 0.4099, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 25.30% (0.5546 => 0.6949, std.dev.: 0.0025) MultiSource/Applications/lua/lua: 25.15% (1.4269 => 1.7858, std.dev.: 0.0116) MultiSource/Applications/d/make_dparser: 24.96% (1.0781 => 1.3472, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.96% (0.0573 => 0.0716, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.91% (0.0582 => 0.0727) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.82% (0.4658 => 0.5814, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/football/football: 24.77% (0.2075 => 0.2589, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.73% (1.6211 => 2.0220, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.57% (0.5584 => 0.6956, std.dev.: 0.0140) MultiSource/Benchmarks/PAQ8p/paq8p: 24.47% (0.4847 => 0.6033, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 24.45% (0.6634 => 0.8256, std.dev.: 0.0037) MultiSource/Benchmarks/sim/sim: 24.41% (0.0758 => 0.0943, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.37% (0.0513 => 0.0638, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 24.31% (0.3336 => 0.4147, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 24.08% (23.5202 => 29.1831, std.dev.: 0.0424) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.07% (0.0673 => 0.0835, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.05% (2.7292 => 3.3855, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/functionobjects: 23.84% (0.2068 => 0.2561, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 23.76% (0.5026 => 0.6220, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: 23.71% (0.2391 => 0.2958, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.67% (0.1090 => 0.1348, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 23.61% (2.1013 => 2.5975, std.dev.: 0.0015) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.59% (0.0496 => 0.0613, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.43% (0.0572 => 0.0706, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 23.38% (0.3498 => 0.4316, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.28% (0.1160 => 0.1430, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 23.11% (0.7875 => 0.9695, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.11% (0.6435 => 0.7922, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 23.00% (3.5627 => 4.3822, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.98% (1.9694 => 2.4219, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.84% (0.2737 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.44% (1.9966 => 2.4447, std.dev.: 0.0216) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.20% (4.4195 => 5.4007, std.dev.: 0.0434) MultiSource/Applications/JM/lencod/lencod: 21.63% (4.6177 => 5.6166, std.dev.: 0.0298) MultiSource/Applications/JM/ldecod/ldecod: 21.38% (2.1653 => 2.6283, std.dev.: 0.0283) SingleSource/Benchmarks/Misc-C++/bigfib: 20.93% (0.5012 => 0.6061, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 20.79% (0.4146 => 0.5008, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 20.75% (0.4251 => 0.5133, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.72% (0.3195 => 0.3857, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.69% (0.3625 => 0.4375, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 20.56% (0.3726 => 0.4492, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.45% (4.6926 => 5.6523, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 20.35% (0.3282 => 0.3950, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 20.31% (0.3678 => 0.4425, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 20.28% (0.3477 => 0.4182, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 19.92% (0.3348 => 0.4015, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 19.84% (0.3362 => 0.4029, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: 19.76% (0.5826 => 0.6977, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/objinst: 19.70% (0.2823 => 0.3379, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference-object: 19.68% (0.5889 => 0.7048, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.52% (0.3981 => 0.4758, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.46% (0.3124 => 0.3732, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.43% (0.3690 => 0.4407, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 19.43% (0.9909 => 1.1834, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/ary3: 19.38% (0.3267 => 0.3900, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 19.37% (0.2813 => 0.3358, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.31% (0.3060 => 0.3651, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 19.15% (0.3258 => 0.3882, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 19.14% (0.2811 => 0.3349, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.13% (0.2875 => 0.3425, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 19.02% (0.3317 => 0.3948, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.02% (0.2792 => 0.3323, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.96% (0.2911 => 0.3463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 18.87% (0.2750 => 0.3269, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 18.85% (0.2780 => 0.3304, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.83% (2.0673 => 2.4566, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.83% (0.3845 => 0.4569, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/random: 18.59% (0.2803 => 0.3324, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 18.50% (0.2714 => 0.3216, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 18.46% (0.2725 => 0.3228, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.44% (0.2738 => 0.3243, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.40% (0.2729 => 0.3231, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 18.32% (0.7171 => 0.8485, std.dev.: 0.0044) SingleSource/Regression/C++/ofstream_ctor: 18.14% (0.3004 => 0.3549, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 17.89% (0.3096 => 0.3650, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 16.88% (11.9555 => 13.9737, std.dev.: 0.0228) SingleSource/UnitTests/ObjC/parameter-passing: 15.90% (0.3724 => 0.4316, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 15.75% (0.3650 => 0.4225, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.61% (0.3465 => 0.4006, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 15.47% (0.3446 => 0.3979, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.45% (0.3488 => 0.4027, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 15.45% (0.3496 => 0.4036, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 15.43% (0.3643 => 0.4205, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.19% (0.3442 => 0.3965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.22% (0.3792 => 0.4028, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: 2.69% (2.4764 => 2.5429, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5248, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.56% (2.5769 => 3.0295, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.56% (0.5917 => 0.6897, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.26% (0.3693 => 0.4072, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0026) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6778, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2385, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops-2: 4.77% (1.8057 => 1.8918, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6824, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.85% (0.6276 => 0.6455, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1974, std.dev.: 0.0060) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3036, std.dev.: 0.0076) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.43% (7.1849 => 7.2877, std.dev.: 0.0049) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2091, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6005, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4789, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.82% (25.4195 => 16.5674, std.dev.: 0.0287) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.15% (17.2379 => 14.2814, std.dev.: 0.0404) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1017, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: -9.37% (0.2402 => 0.2177, std.dev.: 0.0043) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9749, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8139, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2281, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.65% (11.2080 => 10.7985, std.dev.: 0.0094) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7729, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1313, std.dev.: 0.0230) SingleSource/Benchmarks/Dhrystone/dry: -2.07% (14.0481 => 13.7571, std.dev.: 0.0771) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.68% (10.7630 => 10.5817, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1607, std.dev.: 0.0402) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0478, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 07:49:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 09:49:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128154921.77AFC2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8041?compare_to=8037&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8041, Order: 173683, Start Time: 2013-01-28 13:29:49, End Time: 2013-01-28 15:49:41 To: 8037, Order: 173680, Start Time: 2013-01-28 10:38:44, End Time: 2013-01-28 12:58:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (275 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (597 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0024) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0416 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.62% (0.0678 => 0.0667, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8446 => 499.8508, std.dev.: 0.0056) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.80% (1.1277 => 499.8508, std.dev.: 0.0056) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 268.56% (0.5229 => 1.9272, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 45.64% (14.9895 => 21.8304, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 63.10% (14.1553 => 23.0875, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: 30.42% (4.1105 => 5.3608, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.94% (1.1048 => 2.0985, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1725.10% (7.1582 => 130.6440, std.dev.: 0.0151) SingleSource/Benchmarks/Misc-C++-EH/spirit: 128.19% (3.4629 => 7.9020, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: 100.79% (0.6222 => 1.2493, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10274.72% (0.0720 => 7.4698, std.dev.: 0.0027) MultiSource/Applications/SIBsim4/SIBsim4: 3833500.00% (0.0001 => 3.8336, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11160300.00% (0.0001 => 11.1604, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63700.00% (0.0001 => 0.0638, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850900.00% (0.0001 => 9.8510, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485900.00% (0.0001 => 5.4860, std.dev.: 0.0042) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.75% (1.1194 => 10.3629, std.dev.: 0.0185) SingleSource/Benchmarks/Misc/flops: 180.94% (0.1432 => 0.4023, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/factor: 172.30% (0.0296 => 0.0806, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 157.82% (22.1758 => 57.1746, std.dev.: 0.0244) SingleSource/Benchmarks/Misc/lowercase: 140.62% (0.0256 => 0.0616, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 135.13% (0.1056 => 0.2483, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 111.93% (0.0243 => 0.0515) SingleSource/Benchmarks/CoyoteBench/lpbench: 105.17% (0.0929 => 0.1906, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 103.60% (7.0540 => 14.3621, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/objinst: 99.30% (0.0427 => 0.0851) MultiSource/Benchmarks/FreeBench/neural/neural: 88.93% (0.1463 => 0.2764, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 87.95% (0.0730 => 0.1372, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 80.59% (0.0237 => 0.0428) SingleSource/Regression/C/uint64_to_float: 79.58% (0.0377 => 0.0677) MultiSource/Benchmarks/McCat/08-main/main: 77.88% (0.2554 => 0.4543, std.dev.: 0.0016) SingleSource/Regression/C/casts: 77.67% (0.0318 => 0.0565) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 75.40% (1.5859 => 2.7816, std.dev.: 0.0011) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 71.30% (0.0439 => 0.0752, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 65.99% (0.0394 => 0.0654, std.dev.: 0.0000) SingleSource/UnitTests/Vector/simple: 64.32% (0.0185 => 0.0304, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 64.09% (2.2024 => 3.6140, std.dev.: 0.0051) SingleSource/Regression/C++/EH/function_try_block: 63.43% (0.0268 => 0.0438, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.22% (2.9384 => 4.7962, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 61.15% (8.1363 => 13.1119, std.dev.: 0.0052) SingleSource/Regression/C/sumarray: 59.74% (0.0231 => 0.0369, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 59.58% (0.1143 => 0.1824, std.dev.: 0.0009) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 59.45% (0.0217 => 0.0346, std.dev.: 0.0001) SingleSource/UnitTests/2002-05-02-CastTest: 57.80% (0.0218 => 0.0344, std.dev.: 0.0000) SingleSource/Regression/C/testtrace: 57.08% (0.0212 => 0.0333, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 56.60% (0.0636 => 0.0996, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-31-CastToBool: 56.44% (0.0202 => 0.0316, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 56.07% (1.5415 => 2.4058, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/ary3: 54.74% (0.0232 => 0.0359) MultiSource/Applications/sgefa/sgefa: 54.45% (0.3109 => 0.4802, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 53.51% (1.1642 => 1.7872, std.dev.: 0.0035) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 53.10% (0.0953 => 0.1459, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 51.20% (0.1125 => 0.1701, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 50.64% (21.9371 => 33.0452, std.dev.: 0.0075) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.81% (0.6675 => 1.0000, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 49.34% (0.1062 => 0.1586, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.55% (0.0793 => 0.1178, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.11% (3.8922 => 5.7648, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 48.07% (0.2700 => 0.3998, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 47.05% (0.0814 => 0.1197, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 47.00% (4.2646 => 6.2691, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 46.71% (1.0722 => 1.5730, std.dev.: 0.0069) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 46.47% (0.0467 => 0.0684, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 45.74% (0.0282 => 0.0411, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/15-trie/trie: 45.73% (0.0527 => 0.0768, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 45.23% (0.7115 => 1.0333, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 44.69% (0.1555 => 0.2250, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.50% (0.0564 => 0.0815, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.47% (0.0479 => 0.0692, std.dev.: 0.0016) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 43.98% (0.0457 => 0.0658, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 43.75% (0.0640 => 0.0920, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/div: 43.41% (0.0258 => 0.0370, std.dev.: 0.0001) SingleSource/UnitTests/block-copied-in-cxxobj: 42.58% (0.0310 => 0.0442, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/shr: 42.46% (0.0252 => 0.0359, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.45% (0.0245 => 0.0349, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.43% (0.5105 => 0.7271, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.41% (0.4615 => 0.6572, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 41.92% (0.0730 => 0.1036, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 41.85% (2.2969 => 3.2582, std.dev.: 0.0045) SingleSource/UnitTests/ObjC/messages-2: 41.84% (0.0662 => 0.0939, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.52% (0.2271 => 0.3214, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 41.44% (0.0818 => 0.1157, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 41.43% (9.4845 => 13.4144, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 41.07% (0.3092 => 0.4362, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 40.77% (0.1175 => 0.1654, std.dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 40.69% (0.0462 => 0.0650, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 40.54% (0.6456 => 0.9073, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.48% (0.0746 => 0.1048, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.48% (0.0672 => 0.0944, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 40.41% (0.1695 => 0.2380, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 40.06% (0.1655 => 0.2318, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.25% (0.5860 => 0.8160, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 38.66% (0.4299 => 0.5961, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.54% (0.0397 => 0.0550, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 38.53% (0.0719 => 0.0996, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 38.26% (2.0273 => 2.8030, std.dev.: 0.0027) MultiSource/Applications/spiff/spiff: 38.25% (0.7835 => 1.0832, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 37.94% (0.0485 => 0.0669, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 37.88% (3.8723 => 5.3391, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 37.79% (0.1032 => 0.1422, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.78% (0.0675 => 0.0930, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.61% (0.3441 => 0.4735, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.45% (1.4186 => 1.9498, std.dev.: 0.0015) MultiSource/Applications/oggenc/oggenc: 37.32% (5.7591 => 7.9085, std.dev.: 0.0177) SingleSource/UnitTests/Vector/build2: 37.29% (0.0295 => 0.0405, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: 37.20% (63.2438 => 86.7734, std.dev.: 0.0424) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 37.07% (0.1044 => 0.1431, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 37.06% (0.0626 => 0.0858, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.01% (0.0770 => 0.1055, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.89% (0.3307 => 0.4527, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 36.89% (3.3354 => 4.5657, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.63% (0.1892 => 0.2585, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.49% (0.5569 => 0.7601, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 36.33% (17.1811 => 23.4231, std.dev.: 0.0075) MultiSource/Benchmarks/nbench/nbench: 36.31% (1.1840 => 1.6139, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.24% (0.3427 => 0.4669, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 36.22% (0.0842 => 0.1147, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 35.91% (0.0660 => 0.0897, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages: 35.47% (0.0327 => 0.0443, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 35.46% (0.1695 => 0.2296, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 35.42% (0.4289 => 0.5808, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 35.41% (0.1268 => 0.1717, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.34% (0.3121 => 0.4224, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 35.32% (0.4620 => 0.6252, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 35.21% (0.0886 => 0.1198, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 35.03% (0.3423 => 0.4622, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/mason/mason: 35.02% (0.0811 => 0.1095) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.90% (0.0447 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.86% (0.4879 => 0.6580, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/mst/mst: 34.82% (0.1163 => 0.1568, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Queens: 34.78% (0.0414 => 0.0558, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.73% (0.0933 => 0.1257, std.dev.: 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: 34.49% (0.0316 => 0.0425, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 34.14% (0.1151 => 0.1544, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 34.12% (0.2758 => 0.3699, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.90% (0.1584 => 0.2121, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.78% (1.1861 => 1.5868, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/queens: 33.50% (0.0403 => 0.0538, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.27% (0.2107 => 0.2808, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 33.08% (0.1566 => 0.2084, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 32.41% (0.7433 => 0.9842, std.dev.: 0.0002) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.39% (0.0389 => 0.0515, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.28% (0.1236 => 0.1635, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 32.26% (0.0592 => 0.0783, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 31.98% (0.3387 => 0.4470, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.82% (0.0770 => 0.1015, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 31.60% (0.0614 => 0.0808, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.06% (0.1906 => 0.2498, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.98% (1.3050 => 1.7093, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.84% (0.8172 => 1.0692, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.81% (0.1029 => 0.1346, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.71% (0.0482 => 0.0630, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.67% (0.1940 => 0.2535, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.64% (0.0408 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.58% (0.5981 => 0.7810, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.46% (0.1510 => 0.1970, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.22% (0.6450 => 0.8399, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.95% (0.8067 => 1.0483, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Towers: 29.51% (0.0471 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 29.43% (0.3180 => 0.4116, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 29.30% (0.8921 => 1.1535, std.dev.: 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 29.14% (0.0350 => 0.0452, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.14% (4.9449 => 6.3856, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.03% (0.9765 => 1.2600, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 29.02% (0.1144 => 0.1476, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.93% (0.0871 => 0.1123, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.87% (0.1337 => 0.1723, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 28.75% (0.0633 => 0.0815, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.67% (0.5020 => 0.6459, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.61% (0.0416 => 0.0535, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.43% (0.2603 => 0.3343, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/five11/five11: 28.40% (0.0567 => 0.0728, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.38% (0.1117 => 0.1434, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.24% (5.0018 => 6.4144, std.dev.: 0.0072) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.14% (0.8101 => 1.0381, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Treesort: 27.98% (0.0411 => 0.0526, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 27.83% (1.5603 => 1.9946, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/matrix: 27.79% (0.3098 => 0.3959, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.91% (0.4203 => 0.5334, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.88% (0.2266 => 0.2875, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.82% (0.3177 => 0.4029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 26.41% (0.0443 => 0.0560, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.98% (0.3865 => 0.4869, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: 25.44% (0.0456 => 0.0572, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.94% (0.0834 => 0.1042, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0000) SingleSource/Regression/C/bigstack: 24.46% (0.0417 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 24.27% (0.4103 => 0.5099, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 24.19% (0.0798 => 0.0991, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 24.12% (0.1625 => 0.2017, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 23.54% (0.1440 => 0.1779, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.46% (0.0648 => 0.0800, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.22% (0.0491 => 0.0605, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0481 => 0.0592, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.30% (0.0704 => 0.0861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.90% (0.1114 => 0.1358, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.87% (0.4636 => 0.5650, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.54% (14.3668 => 17.4618, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/perlin: 21.27% (0.0536 => 0.0650, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.06% (0.4064 => 0.4920, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 20.96% (0.3282 => 0.3970, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 20.93% (0.3283 => 0.3970, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.92% (0.2065 => 0.2497, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary: 20.67% (0.3232 => 0.3900, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 20.64% (0.2049 => 0.2472, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.10% (0.1438 => 0.1727, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.93% (0.0838 => 0.1005, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.71% (0.2430 => 0.2909, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 19.61% (0.4048 => 0.4842, std.dev.: 0.0042) SingleSource/UnitTests/initp1: 19.28% (0.0555 => 0.0662, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 19.27% (0.3379 => 0.4030, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.50% (0.3826 => 0.4534, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/sieve: 18.43% (0.3603 => 0.4267, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: 17.81% (0.3684 => 0.4340, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 17.48% (0.3422 => 0.4020, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.87% (0.2905 => 0.3395, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: 16.57% (0.3886 => 0.4530, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.14% (0.3650 => 0.4239, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.04% (0.3935 => 0.4566, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.92% (2.2022 => 2.5529, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 15.62% (0.1268 => 0.1466, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 15.46% (0.0705 => 0.0814, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 14.03% (0.3927 => 0.4478, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 13.98% (1.2842 => 1.4637, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.83% (0.1330 => 0.1514) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.63% (0.3162 => 0.3593, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/strcat: 13.28% (0.2831 => 0.3207) SingleSource/UnitTests/ObjC/exceptions: 12.67% (0.3828 => 0.4313, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 12.61% (0.2871 => 0.3233, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.33% (2.0665 => 2.3213, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/methcall: 11.96% (0.2877 => 0.3221, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.86% (7.9617 => 8.9056, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.48% (0.3136 => 0.3496, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 11.43% (10.3673 => 11.5519, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.62% (0.2891 => 0.3198, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.40% (0.3694 => 0.4078, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 10.27% (0.6030 => 0.6649, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.26% (0.7326 => 0.8078, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.23% (0.2756 => 0.3038, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 10.22% (0.3052 => 0.3364, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.08% (0.3543 => 0.3900, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.07% (0.3497 => 0.3849, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 10.05% (0.3561 => 0.3919, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 10.01% (0.3516 => 0.3868, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.99% (0.2802 => 0.3082, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.92% (0.2872 => 0.3157, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.91% (0.2714 => 0.2983, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 9.91% (0.2725 => 0.2995, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 9.90% (0.3473 => 0.3817, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.77% (0.2793 => 0.3066, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.98% (0.5925 => 0.6457, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 7.70% (0.3131 => 0.3372, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.88% (0.3817 => 0.3927, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4743, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.18% (1.1145 => 1.2948, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4267, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.43% (4.2280 => 4.4576, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3126, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.3316 => 0.3446, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.23% (0.9957 => 1.0279, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.66% (8.6802 => 8.9107, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.00% (0.8333 => 0.8500, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.92% (9.1159 => 9.2907, std.dev.: 0.0295) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.90% (3.6395 => 3.7085, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2379, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4565, std.dev.: 0.0175) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5767, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.76% (6.6874 => 0.2167, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.46% (5.2763 => 1.2948, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -74.64% (0.8651 => 0.2194, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -35.39% (0.1622 => 0.1048, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.95% (5.3855 => 4.9573, std.dev.: 0.0090) SingleSource/UnitTests/Vector/constpool: -7.82% (54.1659 => 49.9292, std.dev.: 0.0260) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.23% (5.3526 => 4.9658, std.dev.: 0.0016) MultiSource/Applications/JM/ldecod/ldecod: -4.29% (10.4361 => 9.9882, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.11% (1.7609 => 1.7062, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.38% (1.9577 => 0.6582, std.dev.: 0.0082) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.77% (0.3987 => 0.2561, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel: -33.37% (1.1492 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4372, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -24.95% (85.0658 => 63.8456, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0063, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -20.36% (0.2161 => 0.1721, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.72% (1.6925 => 1.4265, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: -12.98% (3.1443 => 2.7361, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.01% (0.9540 => 0.8394, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4930, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9116, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.89% (1.8329 => 1.7067, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.66% (19.9488 => 18.6193, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5797, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.78% (1.2373 => 1.1658, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.54% (8.1563 => 7.7046, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.80% (0.4808 => 0.4577, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.64% (1.5835 => 1.5100, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/salsa20: -4.28% (10.2830 => 9.8428, std.dev.: 0.0076) MultiSource/Applications/siod/siod: -3.83% (3.2827 => 3.1570, std.dev.: 0.0071) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.66% (3.6994 => 3.6380, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3299, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.18% (4.6441 => 4.5891, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std.dev.: 0.0119) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.48% (0.2116 => 0.0667, std.dev.: 0.0022) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 08:05:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 10:05:45 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128160545.38FEE2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8042?compare_to=8038&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8042, Order: 173685, Start Time: 2013-01-28 13:58:55, End Time: 2013-01-28 16:06:06 To: 8038, Order: 173680, Start Time: 2013-01-28 11:31:58, End Time: 2013-01-28 13:39:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 9 (230 on baseline) Performance Improvements: 1 (59 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1054 (774 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.40% (0.8933 => 0.9058, std.dev.: 0.0043) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.46% (6.7474 => 7.4534, std.dev.: 0.2361) SingleSource/Regression/C/uint64_to_float: 7.60% (1.7859 => 1.9217, std.dev.: 0.0175) MultiSource/Benchmarks/nbench/nbench: 5.06% (21.7018 => 22.8008, std.dev.: 0.1738) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.86% (4.8444 => 5.0797, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.56% (1.2450 => 1.3018, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.79% (2.6340 => 2.7339, std.dev.: 0.0187) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.42% (21.8539 => 22.3838, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.06% (3.3226 => 3.3578, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.40% (2.0266 => 1.9983, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.11% (1.4308 => 1.4324, std.dev.: 0.0744) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0221 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0433 => 0.0433, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0336 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.50% (0.0320 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -14.78% (0.0433 => 0.0369, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: 0.49% (0.0205 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -3.62% (0.0221 => 0.0213, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 18.96% (0.0211 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1488 => 0.1484, std.dev.: 0.0218) MultiSource/Applications/lemon/lemon: -4.63% (1.1750 => 1.1206, std.dev.: 0.1970) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.24% (0.3934 => 0.4140, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.11% (0.1448 => 0.1403, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.88% (0.0695 => 0.0668, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.24% (0.0580 => 0.0567, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.2885 => 1.2893, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 11.11% (0.0018 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0008 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.05% (0.0609 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.32% (0.0373 => 0.0286, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.19% (1.7655 => 1.6915, std.dev.: 0.0615) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0007 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.16% (0.0123 => 0.0049, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.12% (34.1893 => 34.1469, std.dev.: 0.1681) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 396.73% (0.0336 => 0.1669, std.dev.: 0.0038) SingleSource/Regression/C/sumarraymalloc: 130.38% (0.0293 => 0.0675, std.dev.: 0.0025) SingleSource/Regression/C/sumarray2d: 100.00% (0.0274 => 0.0548, std.dev.: 0.0058) MultiSource/Benchmarks/FreeBench/neural/neural: 87.00% (0.1638 => 0.3063, std.dev.: 0.0038) SingleSource/Regression/C++/EH/function_try_block: 80.25% (0.0243 => 0.0438, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 71.75% (23.5861 => 40.5101, std.dev.: 1.6026) SingleSource/UnitTests/SignlessTypes/Large/cast: 66.23% (0.0539 => 0.0896, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 63.02% (0.0265 => 0.0432, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/objinst: 60.00% (0.0480 => 0.0768, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 56.27% (0.9588 => 1.4983, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 56.26% (0.8893 => 1.3896, std.dev.: 0.0685) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.21% (0.9120 => 1.4246, std.dev.: 0.0750) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.20% (0.9612 => 1.5014, std.dev.: 0.0932) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 56.10% (0.0688 => 0.1074, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 55.95% (0.9061 => 1.4131, std.dev.: 0.0741) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 55.75% (0.8926 => 1.3902, std.dev.: 0.0506) SingleSource/UnitTests/SignlessTypes/shr: 55.48% (0.0310 => 0.0482, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.31% (0.9564 => 1.4758, std.dev.: 0.0538) SingleSource/Regression/C/casts: 54.12% (0.0388 => 0.0598, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 54.10% (0.9381 => 1.4456, std.dev.: 0.0507) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 54.02% (0.8990 => 1.3846, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 53.77% (0.9855 => 1.5154, std.dev.: 0.0796) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 52.89% (0.9091 => 1.3899, std.dev.: 0.0576) SingleSource/UnitTests/SignlessTypes/div: 52.81% (0.0320 => 0.0489, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 52.59% (0.1274 => 0.1944, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.58% (0.9998 => 1.5255, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 52.35% (0.9422 => 1.4354, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 51.80% (0.9403 => 1.4274, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 51.70% (0.9010 => 1.3668, std.dev.: 0.0507) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 51.49% (0.9512 => 1.4410, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.98% (0.8912 => 1.3455, std.dev.: 0.1653) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 50.81% (1.0119 => 1.5260, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 50.69% (0.8736 => 1.3164, std.dev.: 0.0844) MultiSource/Benchmarks/FreeBench/mason/mason: 50.57% (0.0793 => 0.1194, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 50.49% (1.0867 => 1.6354, std.dev.: 0.0527) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 49.68% (1.0052 => 1.5046, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.05% (0.8732 => 1.3015, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.89% (0.8846 => 1.3171, std.dev.: 0.0991) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 48.88% (0.9867 => 1.4690, std.dev.: 0.0720) SingleSource/Benchmarks/Misc/himenobmtxpa: 48.54% (0.1955 => 0.2904, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 48.26% (1.4110 => 2.0920, std.dev.: 0.0130) SingleSource/UnitTests/2003-05-26-Shorts: 48.20% (0.0222 => 0.0329, std.dev.: 0.0003) SingleSource/UnitTests/2003-05-31-CastToBool: 48.08% (0.0260 => 0.0385, std.dev.: 0.0048) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 48.04% (3.6295 => 5.3732, std.dev.: 0.1879) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 47.20% (0.9788 => 1.4408, std.dev.: 0.0429) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 47.15% (0.0492 => 0.0724, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 46.66% (1.0017 => 1.4691, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.64% (0.9488 => 1.3913, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.60% (0.9507 => 1.3937, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.39% (1.0088 => 1.4667, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 45.12% (0.9993 => 1.4502, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 45.00% (0.9685 => 1.4043, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.90% (0.9127 => 1.3225, std.dev.: 0.0779) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.94% (0.9405 => 1.3538, std.dev.: 0.0546) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 43.86% (2.4519 => 3.5273, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.58% (0.9550 => 1.3616, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 42.56% (1.8651 => 2.6589, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 41.98% (1.0860 => 1.5419, std.dev.: 0.0481) SingleSource/UnitTests/SignlessTypes/rem: 41.44% (0.1163 => 0.1645, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 41.30% (0.0431 => 0.0609, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.68% (1.8127 => 2.5501, std.dev.: 0.0871) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 40.11% (0.0738 => 0.1034, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/08-main/main: 40.03% (0.2915 => 0.4082, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 39.96% (0.4762 => 0.6665, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 39.03% (0.3702 => 0.5147, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/queens: 38.16% (0.0490 => 0.0677, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.01% (0.0805 => 0.1111, std.dev.: 0.0068) SingleSource/UnitTests/2006-01-23-UnionInit: 37.92% (0.0269 => 0.0371, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 37.10% (0.3598 => 0.4933, std.dev.: 0.0224) SingleSource/Benchmarks/Shootout/ary3: 35.81% (0.0296 => 0.0402, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 34.79% (0.0707 => 0.0953, std.dev.: 0.0062) MultiSource/Benchmarks/mafft/pairlocalalign: 34.22% (9.5202 => 12.7784, std.dev.: 0.3380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 34.18% (0.1305 => 0.1751, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 33.54% (0.0486 => 0.0649, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 33.20% (0.0738 => 0.0983, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/bh/bh: 32.94% (0.3273 => 0.4351, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 32.71% (0.0856 => 0.1136, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 32.66% (16.4479 => 21.8196, std.dev.: 0.4746) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 32.29% (0.0669 => 0.0885, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 31.93% (0.0783 => 0.1033, std.dev.: 0.0018) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 31.76% (0.0403 => 0.0531, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.65% (0.0733 => 0.0965, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/15-trie/trie: 31.53% (0.0593 => 0.0780, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 31.28% (0.7776 => 1.0208, std.dev.: 0.0306) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 30.69% (0.0642 => 0.0839, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 29.84% (0.1240 => 0.1610, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.08% (0.1332 => 0.1706, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 27.92% (0.1046 => 0.1338, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 27.30% (0.0696 => 0.0886, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.17% (0.0762 => 0.0969, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.83% (1.0986 => 1.3933, std.dev.: 0.0446) SingleSource/Benchmarks/Shootout/lists: 26.67% (0.0735 => 0.0931, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 26.36% (33.2440 => 42.0080, std.dev.: 1.4658) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.29% (0.2100 => 0.2652, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 25.74% (0.3807 => 0.4787, std.dev.: 0.0115) MultiSource/Benchmarks/NPB-serial/is/is: 25.72% (0.0797 => 0.1002, std.dev.: 0.0009) MultiSource/Benchmarks/llubenchmark/llu: 25.59% (0.0547 => 0.0687, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.57% (0.5369 => 0.6742, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.52% (0.7693 => 0.9656, std.dev.: 0.0189) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.42% (5.0381 => 6.3190, std.dev.: 0.0602) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.37% (0.7225 => 0.9058, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/09-vor/vor: 25.34% (0.3402 => 0.4264, std.dev.: 0.0115) MultiSource/Applications/SIBsim4/SIBsim4: 24.91% (1.4392 => 1.7977, std.dev.: 0.1387) SingleSource/Benchmarks/Misc-C++/bigfib: 24.35% (0.6711 => 0.8345, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: 24.23% (5.3553 => 6.6528, std.dev.: 0.1407) MultiSource/Benchmarks/nbench/nbench: 24.22% (1.2708 => 1.5786, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.99% (0.0963 => 0.1194, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.87% (0.0775 => 0.0960, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/family/family: 23.85% (0.0436 => 0.0540, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 23.79% (0.0803 => 0.0994, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 23.67% (0.9759 => 1.2069, std.dev.: 0.0055) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.44% (0.2577 => 0.3181, std.dev.: 0.0165) MultiSource/Benchmarks/Ptrdist/bc/bc: 22.95% (1.2680 => 1.5590, std.dev.: 0.0066) SingleSource/UnitTests/Vectorizer/gcc-loops: 22.26% (0.4596 => 0.5619, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 22.14% (0.0718 => 0.0877, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.05% (0.0889 => 0.1085, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 22.01% (17.5634 => 21.4296, std.dev.: 0.7790) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.74% (0.2884 => 0.3511, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 21.60% (0.0486 => 0.0591, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 21.57% (0.0918 => 0.1116, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.55% (0.9214 => 1.1200, std.dev.: 0.0553) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 21.36% (0.3394 => 0.4119, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/misr: 21.11% (0.0649 => 0.0786, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.73% (0.6135 => 0.7407, std.dev.: 0.0200) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 20.56% (0.0963 => 0.1161, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: 20.49% (1.3979 => 1.6843, std.dev.: 0.0492) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 20.39% (0.0726 => 0.0874, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.16% (0.0992 => 0.1192, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 20.15% (0.1335 => 0.1604, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/almabench: 19.63% (0.0754 => 0.0902, std.dev.: 0.0051) MultiSource/Benchmarks/7zip/7zip-benchmark: 19.54% (44.1538 => 52.7815, std.dev.: 2.3870) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.51% (0.6885 => 0.8228, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.32% (0.1025 => 0.1223, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.18% (0.6934 => 0.8264, std.dev.: 0.0144) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.99% (0.0974 => 0.1159, std.dev.: 0.0013) MultiSource/Applications/siod/siod: 18.87% (2.6437 => 3.1425, std.dev.: 0.0878) MultiSource/Benchmarks/PAQ8p/paq8p: 18.65% (2.5772 => 3.0578, std.dev.: 0.0854) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.52% (0.0918 => 0.1088, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.49% (0.2618 => 0.3102, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 18.21% (0.0637 => 0.0753, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.18% (0.1716 => 0.2028, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.09% (0.2372 => 0.2801, std.dev.: 0.0093) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.03% (0.0976 => 0.1152, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/hash: 17.89% (0.0615 => 0.0725, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.88% (6.4235 => 7.5722, std.dev.: 0.3013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.82% (0.2879 => 0.3392, std.dev.: 0.0069) SingleSource/Benchmarks/Stanford/Oscar: 17.45% (0.0659 => 0.0774, std.dev.: 0.0018) MultiSource/Applications/JM/lencod/lencod: 17.37% (16.7012 => 19.6022, std.dev.: 0.8014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.28% (0.9124 => 1.0701, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.22% (4.6579 => 5.4601, std.dev.: 0.0622) MultiSource/Applications/d/make_dparser: 17.10% (3.7840 => 4.4310, std.dev.: 0.0620) MultiSource/Benchmarks/Olden/bisort/bisort: 17.10% (0.0737 => 0.0863, std.dev.: 0.0036) MultiSource/Applications/ALAC/decode/alacconvert-decode: 16.87% (1.1731 => 1.3710, std.dev.: 0.0538) MultiSource/Benchmarks/MallocBench/gs/gs: 16.81% (4.5936 => 5.3656, std.dev.: 0.0644) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 16.75% (0.0776 => 0.0906, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.23% (1.6874 => 1.9613, std.dev.: 0.0226) MultiSource/Applications/JM/ldecod/ldecod: 16.19% (7.3529 => 8.5431, std.dev.: 0.4351) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.96% (14.9757 => 17.3651, std.dev.: 0.2488) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.87% (0.3277 => 0.3797, std.dev.: 0.0154) SingleSource/Benchmarks/Misc/ReedSolomon: 15.66% (0.2050 => 0.2371, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.25% (1.1498 => 1.3251, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 15.23% (17.4365 => 20.0920, std.dev.: 0.7626) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.92% (0.6996 => 0.8040, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.08% (0.1058 => 0.1207, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/05-eks/eks: 13.88% (0.4776 => 0.5439, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/tsp/tsp: 13.88% (0.1369 => 0.1559, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 13.85% (18.9377 => 21.5605, std.dev.: 0.1487) MultiSource/Applications/treecc/treecc: 13.72% (2.4719 => 2.8111, std.dev.: 0.0277) MultiSource/Benchmarks/Prolangs-C/loader/loader: 13.43% (0.3560 => 0.4038, std.dev.: 0.0094) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.42% (0.1356 => 0.1538, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 13.42% (4.8904 => 5.5466, std.dev.: 0.0320) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.30% (0.5059 => 0.5732, std.dev.: 0.0073) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.21% (7.2721 => 8.2324, std.dev.: 0.0329) MultiSource/Benchmarks/Fhourstones/fhourstones: 13.13% (0.1798 => 0.2034, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 13.10% (0.1435 => 0.1623, std.dev.: 0.0046) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.92% (4.9104 => 5.5446, std.dev.: 0.1445) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 12.37% (0.1366 => 0.1535, std.dev.: 0.0024) SingleSource/Benchmarks/CoyoteBench/lpbench: 12.23% (0.1071 => 0.1202, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.51% (0.3093 => 0.3449, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 11.09% (0.7693 => 0.8546, std.dev.: 0.0144) MultiSource/Benchmarks/sim/sim: 10.93% (0.3715 => 0.4121, std.dev.: 0.0030) SingleSource/Regression/C++/ofstream_ctor: 10.48% (0.2042 => 0.2256, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.15% (0.3665 => 0.4037, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.72% (0.2283 => 0.2505, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 9.66% (0.5746 => 0.6301, std.dev.: 0.0096) SingleSource/Benchmarks/CoyoteBench/fftbench: 9.38% (0.3847 => 0.4208, std.dev.: 0.0086) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 9.26% (0.9588 => 1.0476, std.dev.: 0.0321) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.23% (1.5131 => 1.6528, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 9.15% (0.4121 => 0.4498, std.dev.: 0.0082) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.06% (1.0234 => 1.1161, std.dev.: 0.0191) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.90% (0.3462 => 0.3770, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.88% (0.1622 => 0.1766, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.50% (1.3924 => 1.5107, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout-C++/sieve: 8.00% (0.2913 => 0.3146, std.dev.: 0.0054) MultiSource/Applications/lambda-0_1_3/lambda: 8.00% (0.8653 => 0.9345, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 7.52% (0.7686 => 0.8264, std.dev.: 0.0166) MultiSource/Applications/spiff/spiff: 6.65% (1.0220 => 1.0900, std.dev.: 0.0199) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.38% (0.1755 => 0.1867, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 5.87% (10.2703 => 10.8727, std.dev.: 0.0525) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.71% (1.3220 => 1.3711, std.dev.: 0.0070) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107387.50% (0.0008 => 0.8599, std.dev.: 0.0208) SingleSource/Benchmarks/Shootout/matrix: 355.67% (1.5825 => 7.2109, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout/ary3: 283.30% (2.2304 => 8.5492, std.dev.: 2.1861) MultiSource/Applications/sgefa/sgefa: 257.84% (0.3515 => 1.2578, std.dev.: 0.0088) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.54% (1.1825 => 4.0387, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.78% (4.8185 => 15.8422, std.dev.: 0.1118) SingleSource/Benchmarks/Shootout-C++/ary2: 203.88% (0.0129 => 0.0392, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 195.18% (0.0228 => 0.0673, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary: 146.12% (0.0232 => 0.0571, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/matrix: 62.44% (2.9083 => 4.7243, std.dev.: 0.0215) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.65% (0.2562 => 0.3424, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.02% (5.6033 => 7.4534, std.dev.: 0.2361) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.68% (3.1254 => 4.1154, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.00% (1.4588 => 1.8381, std.dev.: 0.0392) SingleSource/Regression/C/uint64_to_float: 24.81% (1.5397 => 1.9217, std.dev.: 0.0175) SingleSource/Benchmarks/Misc/salsa20: 21.92% (7.4497 => 9.0824, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.42% (4.8112 => 5.7938, std.dev.: 0.0113) MultiSource/Applications/JM/lencod/lencod: 13.79% (6.8159 => 7.7555, std.dev.: 0.0833) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8555, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.80% (5.0033 => 5.6438, std.dev.: 0.0501) MultiSource/Benchmarks/nbench/nbench: 11.16% (20.5117 => 22.8008, std.dev.: 0.1738) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.86% (3.6477 => 3.9709, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 7.94% (8.6447 => 9.3314, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.00% (4.7473 => 5.0797, std.dev.: 0.0111) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (0.6211 => 0.6552, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.61% (4.1836 => 4.3764, std.dev.: 0.0141) SingleSource/Benchmarks/Linpack/linpack-pc: 4.10% (50.8945 => 52.9822, std.dev.: 0.0939) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.83% (5.0310 => 5.2237, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/pi: 3.53% (2.1390 => 2.2146, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.00% (4.7254 => 4.8672, std.dev.: 0.0067) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.54% (0.0808 => 0.0537, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -22.70% (0.0727 => 0.0562, std.dev.: 0.0025) SingleSource/UnitTests/Vector/constpool: -8.93% (9.8875 => 9.0043, std.dev.: 0.2200) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.89% (1.0960 => 1.0424, std.dev.: 0.0195) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.84% (11.5523 => 3.9467, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/fp-convert: -61.98% (15.6525 => 5.9515, std.dev.: 0.0417) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.46% (0.4146 => 0.1805, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.49% (0.4578 => 0.2358, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.05% (11.3868 => 6.3707, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.90% (5.4023 => 3.6247, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.04% (0.4452 => 0.3070, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: -31.04% (0.9372 => 0.6463, std.dev.: 0.0157) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.30% (1.0816 => 0.7755, std.dev.: 0.0455) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.44% (0.5495 => 0.3987, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8825, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.44% (0.5826 => 0.4344, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.38% (4.4467 => 3.3180, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.11% (0.5897 => 0.4475, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.51% (4.9921 => 3.8184, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/ary3: -22.89% (1.8123 => 1.3974, std.dev.: 0.1544) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.26% (1.5623 => 1.2614, std.dev.: 0.0134) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.44% (16.6791 => 13.6029, std.dev.: 0.3180) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.41% (5.8755 => 4.7940, std.dev.: 0.0104) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.29% (2.8778 => 2.3514, std.dev.: 0.1985) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.20% (7.0016 => 5.8670, std.dev.: 0.1694) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.78% (0.1164 => 0.0992, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.99% (3.1921 => 2.7776, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.88% (5.3626 => 4.6720, std.dev.: 0.0217) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.72% (1.4235 => 1.2424, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.45% (5.7056 => 4.9952, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.36% (9.7992 => 8.5884, std.dev.: 0.0313) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.49% (5.0421 => 4.4627, std.dev.: 0.0921) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.10% (0.4081 => 0.3669, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/lists1: -8.74% (0.6628 => 0.6049, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: -7.87% (3.5443 => 3.2652, std.dev.: 0.0681) SingleSource/Benchmarks/Shootout/nestedloop: -7.45% (0.2200 => 0.2036, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2279, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2482, std.dev.: 0.0479) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.79% (46.0987 => 43.4280, std.dev.: 0.9053) MultiSource/Benchmarks/Olden/health/health: -5.64% (0.3654 => 0.3448, std.dev.: 0.0052) SingleSource/Benchmarks/McGill/queens: -5.33% (1.7443 => 1.6514, std.dev.: 0.0029) MultiSource/Benchmarks/mafft/pairlocalalign: -5.25% (63.1520 => 59.8344, std.dev.: 0.2976) SingleSource/Benchmarks/Shootout-C++/hash2: -4.70% (3.6768 => 3.5039, std.dev.: 0.0103) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.57% (3.7662 => 3.5942, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.41% (3.5127 => 3.3578, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.34% (23.3986 => 22.3838, std.dev.: 0.0865) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.85% (2.5170 => 2.4200, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.82% (3.5691 => 3.4329, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.80% (1.4446 => 1.3897, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (5.8973 => 5.6808, std.dev.: 0.0205) SingleSource/Benchmarks/Shootout-C++/lists: -3.52% (17.2182 => 16.6124, std.dev.: 0.0988) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.37% (0.3349 => 0.3236, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.80% (8.7327 => 8.5757, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (85.3042 => 83.8833, std.dev.: 0.0849) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.8249 => 8.6819, std.dev.: 0.0027) MultiSource/Benchmarks/llubenchmark/llu: -1.55% (2.0298 => 1.9983, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/mandel-2: -1.50% (0.8521 => 0.8393, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: -1.45% (1.6251 => 1.6015, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (3.7450 => 3.7020, std.dev.: 0.0026) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 18.90% (1.2047 => 1.4324, std.dev.: 0.0744) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.88% (0.0328 => 0.0312, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.08% (0.0445 => 0.0369, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/test1: -6.17% (0.0227 => 0.0213, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.01% (0.1530 => 0.1484, std.dev.: 0.0218) MultiSource/Applications/lemon/lemon: -41.92% (1.9293 => 1.1206, std.dev.: 0.1970) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.25% (0.4049 => 0.4140, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.09% (0.1510 => 0.1403, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.70% (0.0978 => 0.0668, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.90% (0.0590 => 0.0567, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.98% (1.1617 => 1.2893, std.dev.: 0.0486) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.20% (0.0610 => 0.0560, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.72% (0.0268 => 0.0286, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 127.44% (0.7437 => 1.6915, std.dev.: 0.0615) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -12.50% (0.0008 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: -46.74% (0.0092 => 0.0049, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.23% (12.7781 => 34.1469, std.dev.: 0.1681) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 08:10:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 10:10:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128161021.559382A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8043?compare_to=8039&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8043, Order: 173685, Start Time: 2013-01-28 14:34:05, End Time: 2013-01-28 16:10:40 To: 8039, Order: 173682, Start Time: 2013-01-28 12:33:51, End Time: 2013-01-28 14:10:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (220 on baseline) Performance Improvements: 0 (74 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (798 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 95.36% (0.0280 => 0.0547, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.10% (0.0717 => 0.1320, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.88% (0.0514 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.90% (0.0974 => 0.1684, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 65.02% (0.1132 => 0.1868, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 60.27% (0.1500 => 0.2404, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 52.73% (22.4056 => 34.2196, std.dev.: 0.0062) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.25% (0.0599 => 0.0888, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.24% (0.6395 => 0.9480, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 47.44% (0.0371 => 0.0547, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.06% (1.6474 => 2.4227, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/objinst: 43.24% (0.0407 => 0.0583, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.33% (0.6395 => 0.9102, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 42.11% (0.0418 => 0.0594, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.92% (0.6260 => 0.8884, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.90% (0.5688 => 0.8071, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.57% (0.5805 => 0.8218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.46% (0.5456 => 0.7718, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.25% (0.5849 => 0.8262, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.79% (0.5567 => 0.7838, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.53% (0.5581 => 0.7843, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.47% (0.5575 => 0.7831, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.94% (0.5941 => 0.8314, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.32% (0.5859 => 0.8163, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 39.10% (0.0445 => 0.0619, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.06% (2.2587 => 3.1410, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.00% (0.6033 => 0.8386, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.54% (0.6440 => 0.8922, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.82% (0.6676 => 0.9201, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.71% (0.6189 => 0.8523, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.45% (0.6230 => 0.8563, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 37.20% (0.0293 => 0.0402, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.74% (0.6304 => 0.8620, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.60% (0.0582 => 0.0795, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.26% (0.5802 => 0.7906, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 36.18% (0.1230 => 0.1675, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.12% (0.5925 => 0.8065, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.05% (0.6660 => 0.9061, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 35.77% (0.0699 => 0.0949, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.72% (0.5705 => 0.7743, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 35.26% (0.5857 => 0.7922, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.12% (0.5569 => 0.7525, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.06% (0.5570 => 0.7523, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.94% (0.5478 => 0.7392, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 34.45% (0.5591 => 0.7517, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/08-main/main: 34.37% (0.2659 => 0.3573, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 34.24% (1.1450 => 1.5371, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 33.63% (0.6446 => 0.8614, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.50% (0.5863 => 0.7827, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.42% (0.0790 => 0.1054, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.29% (0.6052 => 0.8067, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.19% (0.7524 => 1.0021, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.53% (0.6681 => 0.8854, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 32.45% (0.6194 => 0.8204, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.89% (0.6297 => 0.8305, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.60% (0.0693 => 0.0912, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.51% (0.0622 => 0.0818, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.12% (0.0556 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 31.05% (0.6667 => 0.8737, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.49% (1.6364 => 2.1353, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.39% (0.7339 => 0.9496, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.29% (0.0833 => 0.1077, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.89% (3.5339 => 4.5548, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.82% (0.0680 => 0.0876, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.58% (5.4682 => 6.9766, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.06% (0.1796 => 0.2282, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 27.03% (0.0566 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.81% (1.2784 => 1.6211, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.28% (0.7021 => 0.8866, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.88% (0.0707 => 0.0890, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.74% (0.1146 => 0.1441, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 25.71% (1.2515 => 1.5732, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 25.26% (0.3357 => 0.4205, std.dev.: 0.0044) SingleSource/Benchmarks/McGill/exptree: 24.31% (0.0864 => 0.1074, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 24.06% (0.0665 => 0.0825) MultiSource/Benchmarks/FreeBench/mason/mason: 23.19% (0.0621 => 0.0765, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.85% (0.1081 => 0.1328, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.85% (0.0731 => 0.0898, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.68% (4.5069 => 5.5289, std.dev.: 0.0048) MultiSource/Applications/SPASS/SPASS: 22.45% (15.5079 => 18.9890, std.dev.: 0.0142) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.73% (0.0764 => 0.0930, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.55% (0.1731 => 0.2104, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 21.15% (9.2283 => 11.1804, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/15-trie/trie: 20.67% (0.0571 => 0.0689) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.45% (0.0885 => 0.1066, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.34% (0.0526 => 0.0633, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.17% (0.5329 => 0.6404, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 20.00% (0.6750 => 0.8100, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.98% (0.0806 => 0.0967, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 19.66% (0.7447 => 0.8911, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.65% (0.4916 => 0.5882, std.dev.: 0.0026) MultiSource/Applications/siod/siod: 19.56% (2.4021 => 2.8719, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: 19.48% (0.0919 => 0.1098, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 19.40% (0.2985 => 0.3564, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.37% (0.0604 => 0.0721, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.21% (0.3483 => 0.4152, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 18.80% (0.4515 => 0.5364, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.80% (0.0617 => 0.0733) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 18.77% (0.1982 => 0.2354, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.74% (0.2385 => 0.2832, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 18.07% (17.1032 => 20.1936, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 18.06% (1.3864 => 1.6368, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.69% (0.1509 => 0.1776, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.63% (1.4642 => 1.7224, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: 17.11% (0.2548 => 0.2984, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 17.05% (0.0704 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.04% (0.0710 => 0.0831, std.dev.: 0.0004) MultiSource/Applications/treecc/treecc: 16.70% (2.1401 => 2.4976, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.44% (0.3491 => 0.4065, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.43% (0.1077 => 0.1254, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 16.43% (0.1674 => 0.1949, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 16.18% (34.0927 => 39.6083, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.13% (0.9557 => 1.1099, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.11% (0.6293 => 0.7307, std.dev.: 0.0079) MultiSource/Applications/oggenc/oggenc: 16.06% (5.0226 => 5.8290, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/hash2: 16.05% (0.4861 => 0.5641, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.97% (0.1096 => 0.1271, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 15.85% (0.4524 => 0.5241, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 15.84% (4.0594 => 4.7024, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 15.74% (0.0686 => 0.0794) SingleSource/Benchmarks/McGill/chomp: 15.73% (0.1761 => 0.2038, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 15.57% (0.8418 => 0.9729, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 15.46% (1.1530 => 1.3313, std.dev.: 0.0021) MultiSource/Benchmarks/NPB-serial/is/is: 15.25% (0.0708 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.25% (0.0741 => 0.0854, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 15.23% (3.5154 => 4.0509, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/matrix: 15.06% (0.0797 => 0.0917, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.78% (0.3658 => 0.4162, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.52% (0.5999 => 0.6810, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.51% (1.2300 => 1.3962) MultiSource/Applications/kimwitu++/kc: 13.17% (18.2933 => 20.7030, std.dev.: 0.0099) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.96% (0.1173 => 0.1325, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.95% (0.1290 => 0.1457, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.74% (0.3319 => 0.3742, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 12.73% (0.3581 => 0.4037, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.62% (0.0919 => 0.1035, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/em3d/em3d: 12.41% (0.1862 => 0.2093, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.39% (0.2001 => 0.2249, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.14% (0.1145 => 0.1284, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 12.10% (15.2527 => 17.0976, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: 11.95% (0.1197 => 0.1340, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.59% (0.0932 => 0.1040, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 11.53% (0.1154 => 0.1287, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.52% (0.1076 => 0.1200, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.42% (4.0323 => 4.4926, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.34% (0.2999 => 0.3339, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.29% (0.0974 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.76% (0.2278 => 0.2523, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.56% (0.1108 => 0.1225, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 10.40% (0.9179 => 1.0134, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 10.32% (0.3255 => 0.3591, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 10.32% (0.1202 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 10.31% (0.1271 => 0.1402, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.98% (0.5168 => 0.5684, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.97% (0.2106 => 0.2316, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 9.97% (0.3271 => 0.3597, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.92% (0.6736 => 0.7404, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.90% (0.7919 => 0.8703, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 9.86% (0.7982 => 0.8769, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.69% (0.1621 => 0.1778, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.67% (1.5610 => 1.7119, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.65% (0.4427 => 0.4854, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.58% (1.3722 => 1.5036, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 9.37% (0.1879 => 0.2055, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.75% (0.7198 => 0.7828, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.40% (0.1441 => 0.1562, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 8.34% (0.1211 => 0.1312, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.08% (0.3142 => 0.3396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.08% (0.4083 => 0.4413, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 8.02% (4.3330 => 4.6806, std.dev.: 0.0071) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.01% (0.2695 => 0.2911, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.89% (0.8521 => 0.9193, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 7.88% (7.0961 => 7.6553, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.86% (4.8161 => 5.1946, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 7.72% (16.1920 => 17.4421, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.52% (0.9077 => 0.9760, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.47% (4.8802 => 5.2447, std.dev.: 0.0095) MultiSource/Benchmarks/PAQ8p/paq8p: 7.35% (2.4924 => 2.6755, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.20% (1.0544 => 1.1303, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.09% (0.6484 => 0.6944, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.96% (8.0126 => 8.5701, std.dev.: 0.0018) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.83% (6.7716 => 7.2342, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.78% (0.4321 => 0.4614, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.20% (14.2083 => 15.0897, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3446 => 0.3641, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 5.58% (0.3406 => 0.3596, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.57% (0.9852 => 1.0401, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.53% (0.3849 => 0.4062, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.46% (1.2221 => 1.2888, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.45% (1.2210 => 1.2875, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.39% (0.3394 => 0.3577, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.2355 => 0.2475, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.03% (0.4151 => 0.4360, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.01% (0.4813 => 0.5054, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 4.95% (0.2160 => 0.2267, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 4.07% (0.4248 => 0.4421, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 3.85% (0.3481 => 0.3615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.56% (0.3931 => 0.4071, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.48% (0.3788 => 0.3920, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.00% (0.3867 => 0.3983, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.18% (0.9542 => 0.9750, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7953, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.85% (0.9531 => 1.0279, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.72% (0.2380 => 0.2540) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.47% (54.5751 => 56.4697, std.dev.: 0.1324) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.57% (2.0478 => 2.1005, std.dev.: 0.0183) MultiSource/Benchmarks/mafft/pairlocalalign: 2.02% (27.8210 => 28.3819, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2231 => 18.4984, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.64% (0.3812 => 0.3635, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.44% (0.3831 => 0.3661, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.41% (0.3880 => 0.3709, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.40% (0.3884 => 0.3713, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.31% (0.3848 => 0.3682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.21% (0.3896 => 0.3732, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.16% (0.3891 => 0.3729, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.02% (0.4033 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.26% (0.6347 => 0.6140, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.48% (0.6441 => 0.6281, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.44% (0.4176 => 0.4074, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.24% (20.7746 => 20.3083, std.dev.: 0.0206) SingleSource/UnitTests/ObjC++/property-reference: -2.16% (0.7779 => 0.7611, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.44% (2.1713 => 2.1401, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.45% (1.8100 => 0.6978, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -48.73% (6.6713 => 3.4205, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3161, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0755, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -22.07% (4.1024 => 3.1970, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0059) SingleSource/UnitTests/Vector/multiplies: -15.31% (2.5106 => 2.1263, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3544, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.23% (0.5142 => 0.4616, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.76% (2.2633 => 2.1781, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.14% (1.0557 => 1.0225, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.77% (1.3096 => 1.2733, std.dev.: 0.0126) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.59% (7.9763 => 7.7701, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.76% (6.5735 => 6.4579, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3040 => 7.1771, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.31% (1.6086 => 1.5876, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.23% (1.6219 => 1.6020, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.23% (1.6307 => 1.6107, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6677, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.12s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 10:10:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 12:10:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128181026.A8B792A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8044?compare_to=8043&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8044, Order: 173691, Start Time: 2013-01-28 16:34:09, End Time: 2013-01-28 18:10:47 To: 8043, Order: 173685, Start Time: 2013-01-28 14:34:05, End Time: 2013-01-28 16:10:40 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 19 (219 on baseline) Performance Improvements: 1 (74 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1084 (799 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.38% (0.7517 => 0.7771, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.34% (0.7392 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.33% (0.8563 => 0.8848, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.28% (0.7827 => 0.8084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.22% (0.7523 => 0.7765, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.19% (0.7525 => 0.7765, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.18% (0.7922 => 0.8174, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.14% (0.7743 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.13% (0.9102 => 0.9387, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.12% (0.7906 => 0.8153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.99% (0.8204 => 0.8449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.98% (0.8067 => 0.8307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.95% (0.8305 => 0.8550, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.91% (0.8737 => 0.8991, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.87% (0.8854 => 0.9108, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.72% (0.9496 => 0.9754, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.66% (0.8614 => 0.8843, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.90% (0.8065 => 0.8218, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/McGill/chomp: 1.03% (1.1540 => 1.1659, std.dev.: 0.0011) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.92% (4.4049 => 4.2763, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 99.64% (0.0280 => 0.0559, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.38% (0.0717 => 0.1322, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.88% (0.0514 => 0.0940, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 74.95% (0.0974 => 0.1704, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 65.02% (0.1132 => 0.1868, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 60.33% (0.1500 => 0.2405, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 52.83% (0.0371 => 0.0567, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 52.74% (22.4056 => 34.2218, std.dev.: 0.0086) SingleSource/Regression/C/sumarraymalloc: 48.69% (0.0267 => 0.0397, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.25% (0.0599 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.13% (0.6395 => 0.9473, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 46.98% (1.6474 => 2.4213, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 46.79% (0.6395 => 0.9387, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/objinst: 43.24% (0.0407 => 0.0583, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 42.34% (0.0418 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 42.02% (0.6230 => 0.8848, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.98% (0.6260 => 0.8888, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.97% (0.5688 => 0.8075, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.68% (0.5456 => 0.7730, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.57% (0.5805 => 0.8218, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.27% (0.5849 => 0.8263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.85% (0.5567 => 0.7841, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.56% (0.5575 => 0.7836, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.52% (0.5802 => 0.8153, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.44% (0.5581 => 0.7838, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.99% (0.5941 => 0.8317, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 39.98% (0.5705 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 39.56% (0.5857 => 0.8174, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 39.45% (0.5478 => 0.7639, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 39.43% (0.5569 => 0.7765, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 39.41% (0.5570 => 0.7765, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.38% (0.5859 => 0.8166, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.04% (2.2587 => 3.1404, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 38.99% (0.5591 => 0.7771, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.95% (0.6033 => 0.8383, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 38.70% (0.5925 => 0.8218, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.54% (0.6440 => 0.8922, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.98% (0.0445 => 0.0614, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 37.88% (0.5863 => 0.8084, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.70% (0.6676 => 0.9193, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.66% (0.6189 => 0.8520, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.26% (0.6052 => 0.8307, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 37.19% (0.6446 => 0.8843, std.dev.: 0.0007) SingleSource/Regression/C/sumarray2d: 36.86% (0.0293 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.82% (0.6304 => 0.8625, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.60% (0.0582 => 0.0795, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 36.41% (0.6194 => 0.8449, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 36.33% (0.6681 => 0.9108, std.dev.: 0.0008) SingleSource/UnitTests/2006-12-11-LoadConstants: 36.18% (0.1230 => 0.1675, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.98% (0.6660 => 0.9056, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 35.91% (0.0699 => 0.0950, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 35.78% (0.6297 => 0.8550, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.86% (0.6667 => 0.8991, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/08-main/main: 34.49% (0.2659 => 0.3576) MultiSource/Applications/lemon/lemon: 34.24% (1.1450 => 1.5371, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.42% (0.0790 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.28% (0.7524 => 1.0028, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.91% (0.7339 => 0.9754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.75% (0.0693 => 0.0913) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.51% (0.0622 => 0.0818, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.12% (0.0556 => 0.0729, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.82% (1.6364 => 2.1408, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.53% (0.0833 => 0.1079, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.97% (0.0680 => 0.0877, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.86% (3.5339 => 4.5539, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 27.90% (0.1796 => 0.2297, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.86% (0.0621 => 0.0794, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 27.78% (1.2784 => 1.6335, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.54% (5.4682 => 6.9743, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 27.03% (0.0566 => 0.0719, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 26.48% (0.3357 => 0.4246, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.21% (0.7021 => 0.8861, std.dev.: 0.0043) MultiSource/Applications/Burg/burg: 25.90% (1.2515 => 1.5757, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.88% (0.0707 => 0.0890, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.74% (0.1146 => 0.1441, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 25.46% (0.0864 => 0.1084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.91% (0.0665 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 23.19% (0.0621 => 0.0765, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.98% (0.0731 => 0.0899, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.94% (0.1081 => 0.1329) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.72% (4.5069 => 5.5309, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 22.54% (15.5079 => 19.0037, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 22.24% (0.1731 => 0.2116, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.60% (0.0764 => 0.0929, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 21.25% (9.2283 => 11.1892, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.99% (0.1982 => 0.2398, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.53% (0.0526 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.49% (0.0571 => 0.0688, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.34% (0.0885 => 0.1065, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 20.12% (0.5329 => 0.6401, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.10% (0.0806 => 0.0968, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 20.06% (0.6750 => 0.8104, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 19.89% (0.7447 => 0.8928, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.85% (0.4916 => 0.5892, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 19.65% (2.4021 => 2.8741, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/distray/distray: 19.59% (0.0919 => 0.1099, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 19.40% (0.2985 => 0.3564, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.29% (0.3483 => 0.4155, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.21% (0.0604 => 0.0720, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.96% (0.0617 => 0.0734, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.78% (0.2385 => 0.2833, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 18.76% (0.4515 => 0.5362, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 18.03% (17.1032 => 20.1873, std.dev.: 0.0100) MultiSource/Applications/SIBsim4/SIBsim4: 18.01% (1.3864 => 1.6361, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.83% (0.1509 => 0.1778, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (1.4642 => 1.7207, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.18% (0.0710 => 0.0832, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 17.05% (0.0704 => 0.0824, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 17.02% (0.0611 => 0.0715) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.99% (0.2548 => 0.2981, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 16.67% (2.1401 => 2.4968, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.62% (0.1077 => 0.1256, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.56% (0.3491 => 0.4069, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 16.43% (0.1674 => 0.1949, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.21% (0.9557 => 1.1106, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 16.18% (0.1761 => 0.2046, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.16% (0.6293 => 0.7310, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.15% (34.0927 => 39.5988, std.dev.: 0.0271) MultiSource/Applications/oggenc/oggenc: 16.10% (5.0226 => 5.8314, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/hash2: 16.09% (0.4861 => 0.5643, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (0.1096 => 0.1272, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 15.89% (0.4524 => 0.5243, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/whetstone: 15.89% (0.0686 => 0.0795, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 15.85% (4.0594 => 4.7027, std.dev.: 0.0047) MultiSource/Benchmarks/nbench/nbench: 15.61% (1.1530 => 1.3330, std.dev.: 0.0050) MultiSource/Applications/spiff/spiff: 15.43% (0.8418 => 0.9717, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 15.26% (3.5154 => 4.0518, std.dev.: 0.0155) MultiSource/Benchmarks/NPB-serial/is/is: 15.25% (0.0708 => 0.0816, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 15.18% (0.0797 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 15.11% (0.0741 => 0.0853, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 13.97% (0.1145 => 0.1305, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.72% (0.3658 => 0.4160, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.69% (0.5999 => 0.6820, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.39% (1.2300 => 1.3947, std.dev.: 0.0011) MultiSource/Applications/kimwitu++/kc: 13.11% (18.2933 => 20.6921, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/18-imp/imp: 13.07% (0.3581 => 0.4049, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 13.02% (0.1290 => 0.1458, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.99% (0.3319 => 0.3750, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 12.78% (0.1862 => 0.2100, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.51% (0.0919 => 0.1034, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.34% (0.2001 => 0.2248, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 12.05% (15.2527 => 17.0908, std.dev.: 0.0195) SingleSource/UnitTests/SignlessTypes/rem: 12.03% (0.1197 => 0.1341, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 11.70% (0.1154 => 0.1289, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.64% (0.2999 => 0.3348, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.62% (0.1076 => 0.1201, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.59% (0.0932 => 0.1040, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 11.34% (0.1173 => 0.1306, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.33% (4.0323 => 4.4893, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.29% (0.0974 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.80% (0.2278 => 0.2524, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.56% (0.1108 => 0.1225, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 10.40% (0.1202 => 0.1327, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 10.38% (0.3255 => 0.3593, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.32% (0.9179 => 1.0126, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 10.18% (0.5168 => 0.5694, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 10.16% (0.1879 => 0.2070, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 10.07% (0.1271 => 0.1399, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.07% (0.2106 => 0.2318, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.02% (0.6736 => 0.7411, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 10.00% (0.3271 => 0.3598, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.89% (0.4427 => 0.4865, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 9.80% (0.7982 => 0.8764, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.79% (0.7919 => 0.8694, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.66% (1.3722 => 1.5048, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 9.66% (1.5610 => 1.7118, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.62% (0.1621 => 0.1777, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.71% (0.7198 => 0.7825, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.47% (0.1441 => 0.1563, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.23% (0.4083 => 0.4419, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.15% (0.3142 => 0.3398, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 8.07% (7.0961 => 7.6690, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 8.01% (0.2695 => 0.2911, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 7.99% (4.3330 => 4.6790, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.90% (4.8161 => 5.1967, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.84% (0.8521 => 0.9189, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.83% (0.9077 => 0.9788, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: 7.82% (16.1920 => 17.4586, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.59% (4.8802 => 5.2506, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 7.31% (2.4924 => 2.6747, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.31% (1.0544 => 1.1315, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.05% (8.0126 => 8.5776, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.99% (0.6484 => 0.6937, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.82% (6.7716 => 7.2331, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.80% (0.4321 => 0.4615, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.24% (14.2083 => 15.0946, std.dev.: 0.0141) SingleSource/Benchmarks/Shootout-C++/ary3: 5.69% (0.3446 => 0.3642, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.69% (1.2221 => 1.2916, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.68% (1.2210 => 1.2903, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.59% (0.9852 => 1.0403, std.dev.: 0.0044) MultiSource/Benchmarks/sim/sim: 5.55% (0.3406 => 0.3595, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.4151 => 0.4379, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 5.39% (0.3394 => 0.3577, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.22% (0.2355 => 0.2478, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.07% (0.4813 => 0.5057, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: 5.00% (0.2160 => 0.2268, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.26% (0.4248 => 0.4429, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 3.99% (0.3481 => 0.3620, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.76% (0.3931 => 0.4079, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.59% (0.3788 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.13% (0.3867 => 0.3988, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.24% (0.9542 => 0.9756, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8038, std.dev.: 0.0024) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.50% (0.9531 => 1.0341, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0066) MultiSource/Applications/sqlite3/sqlite3: 1.73% (4.5320 => 4.6102, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2486, std.dev.: 0.0032) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.48% (18.2231 => 18.4919, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.01% (3.6551 => 3.6921, std.dev.: 0.0036) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3812 => 0.3634, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.46% (0.3831 => 0.3660, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.33% (0.3880 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -4.18% (0.3848 => 0.3687, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.02% (0.4033 => 0.3871, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.71% (0.3884 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.09% (0.6347 => 0.6151, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.47% (20.7746 => 20.2607, std.dev.: 0.0225) SingleSource/UnitTests/ObjC++/property-reference-object: -2.30% (0.6441 => 0.6293, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.08% (0.7779 => 0.7617, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.36% (2.1713 => 2.1417, std.dev.: 0.0003) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.96% (1.8100 => 0.6885, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3116, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.74% (1.3643 => 1.0268, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: -23.54% (7.5137 => 5.7452, std.dev.: 0.0039) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0795, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2050, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0048) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.70% (2.2633 => 2.1795, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.69% (3.7241 => 3.6241, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7777, std.dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.82% (7.3040 => 7.1709, std.dev.: 0.0125) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.81% (6.5735 => 6.4548, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.50% (1.6219 => 1.5975, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6086, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.35% (2.1154 => 2.0868, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.20% (1.6086 => 1.5893, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.17% (3.7092 => 3.6657, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 10:33:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 12:33:56 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128183356.6D9872A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8045?compare_to=8042&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8045, Order: 173690, Start Time: 2013-01-28 16:26:24, End Time: 2013-01-28 18:34:18 To: 8042, Order: 173685, Start Time: 2013-01-28 13:58:55, End Time: 2013-01-28 16:06:06 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 25 (239 on baseline) Performance Improvements: 2 (51 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1037 (773 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: 66.13% (0.1116 => 0.1854, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/family/family: 63.70% (0.0540 => 0.0884, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.80% (1.4456 => 1.5584, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.80% (1.5260 => 1.6297, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.29% (1.4691 => 1.5615, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.93% (1.5046 => 1.5938, std.dev.: 0.0228) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.64% (40.5101 => 42.7954, std.dev.: 0.3953) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.58% (1.3937 => 1.4715, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.55% (1.5014 => 1.5847, std.dev.: 0.0156) MultiSource/Benchmarks/Bullet/bullet: 5.48% (42.0080 => 44.3080, std.dev.: 0.1223) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.43% (1.5255 => 1.6083, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.22% (0.3392 => 0.3569, std.dev.: 0.0044) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.08% (52.7815 => 55.4631, std.dev.: 0.5925) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.55% (1.4758 => 1.5430, std.dev.: 0.0196) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.01% (0.4037 => 0.4199, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.75% (1.0424 => 1.0606, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.92% (1.4649 => 1.8593, std.dev.: 0.0143) MultiSource/Benchmarks/7zip/7zip-benchmark: 15.72% (9.2304 => 10.6811, std.dev.: 0.0201) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.50% (0.3285 => 0.3630, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.79% (0.2971 => 0.3262, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.15% (2.3514 => 2.5196, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.51% (0.8837 => 0.9412, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/hash: 6.15% (4.0282 => 4.2761, std.dev.: 0.0941) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.03% (1.8381 => 1.9122, std.dev.: 0.0241) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.82% (2.7538 => 2.8038, std.dev.: 0.0175) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.11% (0.9058 => 0.8867, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.28% (7.4534 => 6.8364, std.dev.: 0.0530) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.20% (1.4324 => 1.4152, std.dev.: 0.0193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0221 => 0.0222, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.69% (0.0433 => 0.0436, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.30% (0.0337 => 0.0338, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.88% (0.0312 => 0.0321, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 17.62% (0.0369 => 0.0434, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: 1.46% (0.0206 => 0.0209, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: 3.76% (0.0213 => 0.0221, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.80% (0.0251 => 0.0253, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.20% (0.1484 => 0.1481, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 0.87% (1.1206 => 1.1303, std.dev.: 0.2652) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.15% (0.4140 => 0.3968, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.63% (0.1403 => 0.1482, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.25% (0.0668 => 0.0653, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.70% (0.0567 => 0.0529, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.40% (1.2893 => 1.2841, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 45.00% (0.0020 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.57% (0.0560 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.42% (0.0286 => 0.0373, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.15% (1.6915 => 1.7447, std.dev.: 0.0125) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 8.16% (0.0049 => 0.0053, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.75% (34.1469 => 33.8912, std.dev.: 0.2676) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 397.92% (0.0336 => 0.1673, std.dev.: 0.0135) SingleSource/Regression/C/sumarraymalloc: 136.18% (0.0293 => 0.0692, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: 105.54% (0.0902 => 0.1854, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C++/family/family: 102.75% (0.0436 => 0.0884, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: 85.04% (0.1638 => 0.3031, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 84.07% (0.0383 => 0.0705, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 81.44% (23.5861 => 42.7954, std.dev.: 0.3953) SingleSource/UnitTests/SignlessTypes/Large/cast: 71.06% (0.0539 => 0.0922, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 66.12% (0.9381 => 1.5584, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 65.70% (0.9588 => 1.5887, std.dev.: 0.0531) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 65.16% (0.9855 => 1.6277, std.dev.: 0.0661) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 64.87% (0.9612 => 1.5847, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 64.65% (0.9061 => 1.4919, std.dev.: 0.0639) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 63.71% (0.9091 => 1.4883, std.dev.: 0.0753) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 63.49% (0.8990 => 1.4698, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 61.33% (0.9564 => 1.5430, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 61.13% (0.9512 => 1.5327, std.dev.: 0.0871) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 61.06% (0.9422 => 1.5175, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 61.05% (1.0119 => 1.6297, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 60.86% (0.9998 => 1.6083, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.38% (0.8893 => 1.4263, std.dev.: 0.0236) SingleSource/Benchmarks/Shootout/objinst: 59.79% (0.0480 => 0.0767, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 59.32% (0.9120 => 1.4530, std.dev.: 0.0523) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 59.16% (0.8912 => 1.4184, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 58.83% (0.8926 => 1.4177, std.dev.: 0.0248) SingleSource/Benchmarks/McGill/exptree: 58.67% (0.0859 => 0.1363, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 58.56% (1.0052 => 1.5938, std.dev.: 0.0228) SingleSource/UnitTests/SignlessTypes/shr: 57.74% (0.0310 => 0.0489, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 57.62% (0.9403 => 1.4821, std.dev.: 0.0493) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 56.83% (1.0867 => 1.7043, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 55.88% (1.0017 => 1.5615, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 54.78% (0.9507 => 1.4715, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 54.08% (0.8736 => 1.3460, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 53.87% (0.9010 => 1.3864, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 53.40% (0.8732 => 1.3395, std.dev.: 0.1575) SingleSource/Regression/C/casts: 52.84% (0.0388 => 0.0593, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 52.83% (0.1274 => 0.1947, std.dev.: 0.0037) SingleSource/UnitTests/2003-05-31-CastToBool: 52.69% (0.0260 => 0.0397, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 52.39% (0.8846 => 1.3480, std.dev.: 0.0474) SingleSource/UnitTests/SignlessTypes/div: 52.19% (0.0320 => 0.0487, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 50.68% (0.9867 => 1.4868, std.dev.: 0.0294) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 50.27% (1.0088 => 1.5159, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 50.15% (3.6295 => 5.4498, std.dev.: 0.2091) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.50% (0.9788 => 1.4633, std.dev.: 0.0272) MultiSource/Benchmarks/FreeBench/mason/mason: 49.05% (0.0793 => 0.1182, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 48.97% (1.4110 => 2.1020, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 48.03% (0.1955 => 0.2894, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 47.15% (0.0492 => 0.0724, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 46.28% (0.9488 => 1.3879, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.86% (0.9685 => 1.4030, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.56% (0.9993 => 1.4446, std.dev.: 0.1112) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 44.41% (2.4519 => 3.5407, std.dev.: 0.1049) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.33% (0.9127 => 1.3173, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 43.82% (1.0860 => 1.5619, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.82% (0.9405 => 1.3526, std.dev.: 0.0432) SingleSource/Benchmarks/Stanford/IntMM: 43.39% (0.0431 => 0.0618, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.84% (0.9550 => 1.3641, std.dev.: 0.0450) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 42.50% (1.8651 => 2.6578, std.dev.: 0.0068) SingleSource/UnitTests/SignlessTypes/rem: 42.13% (0.1163 => 0.1653, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 40.87% (1.8127 => 2.5535, std.dev.: 0.1036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 40.63% (0.3702 => 0.5206, std.dev.: 0.0234) MultiSource/Benchmarks/McCat/08-main/main: 40.17% (0.2915 => 0.4086, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 39.84% (0.0738 => 0.1032, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 39.67% (0.4762 => 0.6651, std.dev.: 0.0128) MultiSource/Benchmarks/mafft/pairlocalalign: 39.11% (9.5202 => 13.2432, std.dev.: 0.2067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 38.94% (0.3374 => 0.4688, std.dev.: 0.0314) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 38.47% (0.0707 => 0.0979, std.dev.: 0.0038) SingleSource/UnitTests/2003-07-09-SignedArgs: 38.18% (0.0275 => 0.0380, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 38.01% (0.0805 => 0.1111, std.dev.: 0.0034) MultiSource/Applications/sgefa/sgefa: 37.69% (0.3598 => 0.4954, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout/ary3: 36.82% (0.0296 => 0.0405, std.dev.: 0.0034) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 36.72% (0.0403 => 0.0551, std.dev.: 0.0042) SingleSource/Benchmarks/McGill/queens: 36.53% (0.0490 => 0.0669, std.dev.: 0.0034) SingleSource/UnitTests/2003-08-11-VaListArg: 36.46% (0.0277 => 0.0378, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 36.30% (0.0821 => 0.1119, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 34.53% (0.0669 => 0.0900, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 34.02% (0.1305 => 0.1749, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 33.58% (0.3273 => 0.4372, std.dev.: 0.0295) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 33.41% (0.0856 => 0.1142, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 33.33% (0.0642 => 0.0856, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 33.28% (33.2440 => 44.3080, std.dev.: 0.1223) MultiSource/Applications/SPASS/SPASS: 32.94% (16.4479 => 21.8655, std.dev.: 0.3083) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 32.30% (0.0486 => 0.0643, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.98% (0.0738 => 0.0974, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 31.70% (0.7776 => 1.0241, std.dev.: 0.0330) MultiSource/Benchmarks/FreeBench/distray/distray: 30.97% (0.1017 => 0.1332, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.31% (0.0762 => 0.0993, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 30.14% (0.0783 => 0.1019, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 29.82% (0.0845 => 0.1097, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.20% (0.1046 => 0.1341, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.16% (1.0986 => 1.4080, std.dev.: 0.0301) MultiSource/Benchmarks/McCat/15-trie/trie: 28.16% (0.0593 => 0.0760, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 27.74% (0.1240 => 0.1584, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 27.55% (0.1332 => 0.1699, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 26.72% (0.0696 => 0.0882, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.19% (0.2100 => 0.2650, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.15% (0.2577 => 0.3251, std.dev.: 0.0109) MultiSource/Benchmarks/NPB-serial/is/is: 26.10% (0.0797 => 0.1005, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 26.03% (0.0803 => 0.1012, std.dev.: 0.0024) SingleSource/Regression/C/uint64_to_float: 25.92% (0.0409 => 0.0515, std.dev.: 0.0007) MultiSource/Benchmarks/7zip/7zip-benchmark: 25.61% (44.1538 => 55.4631, std.dev.: 0.5925) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.47% (5.0381 => 6.3214, std.dev.: 0.1571) MultiSource/Benchmarks/nbench/nbench: 25.08% (1.2708 => 1.5895, std.dev.: 0.0119) MultiSource/Applications/SIBsim4/SIBsim4: 25.00% (1.4392 => 1.7990, std.dev.: 0.1107) MultiSource/Benchmarks/PAQ8p/paq8p: 24.98% (2.5772 => 3.2209, std.dev.: 0.0748) SingleSource/Benchmarks/BenchmarkGame/puzzle: 24.73% (0.0457 => 0.0570, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 24.12% (0.6711 => 0.8330, std.dev.: 0.0170) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 23.97% (0.2879 => 0.3569, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/18-imp/imp: 23.93% (0.3807 => 0.4718, std.dev.: 0.0089) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 23.87% (0.7693 => 0.9529, std.dev.: 0.0416) SingleSource/Benchmarks/Shootout/lists: 23.67% (0.0735 => 0.0909, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/09-vor/vor: 23.63% (0.3402 => 0.4206, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 23.62% (0.0889 => 0.1099, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 23.61% (0.2385 => 0.2948, std.dev.: 0.0093) SingleSource/Benchmarks/McGill/misr: 23.57% (0.0649 => 0.0802, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 23.26% (0.0963 => 0.1187, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.20% (0.0918 => 0.1131, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.10% (0.0775 => 0.0954, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/hash: 23.09% (0.0615 => 0.0757, std.dev.: 0.0004) SingleSource/UnitTests/Vectorizer/gcc-loops: 22.98% (0.4596 => 0.5652, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/richards_benchmark: 22.93% (0.0798 => 0.0981, std.dev.: 0.0023) MultiSource/Applications/oggenc/oggenc: 22.87% (5.3553 => 6.5799, std.dev.: 0.1639) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 22.73% (0.7225 => 0.8867, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.58% (0.0713 => 0.0874, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.34% (0.3277 => 0.4009, std.dev.: 0.0212) MultiSource/Applications/sqlite3/sqlite3: 22.18% (17.5634 => 21.4585, std.dev.: 0.7601) MultiSource/Benchmarks/Olden/em3d/em3d: 22.16% (0.1927 => 0.2354, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.98% (1.2680 => 1.5467, std.dev.: 0.0266) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 21.92% (0.3394 => 0.4138, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: 21.90% (0.2566 => 0.3128, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_container: 21.52% (0.9214 => 1.1197, std.dev.: 0.0235) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 21.22% (0.6135 => 0.7437, std.dev.: 0.0356) MultiSource/Applications/lemon/lemon: 20.56% (1.3979 => 1.6853, std.dev.: 0.0948) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 20.50% (0.0878 => 0.1058, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 20.37% (0.1335 => 0.1607, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.03% (6.4235 => 7.7103, std.dev.: 0.3091) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.90% (0.6934 => 0.8314, std.dev.: 0.0404) MultiSource/Applications/lua/lua: 19.38% (4.6406 => 5.5398, std.dev.: 0.1851) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.06% (0.2372 => 0.2824, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 18.89% (2.6437 => 3.1431, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.80% (0.0963 => 0.1144, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 18.74% (0.0918 => 0.1090, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.65% (0.6885 => 0.8169, std.dev.: 0.0346) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.30% (0.1716 => 0.2030, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.24% (0.1025 => 0.1212, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 18.18% (0.0737 => 0.0871, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.14% (0.0976 => 0.1153, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 18.04% (0.0704 => 0.0831, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 17.92% (0.0614 => 0.0724, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 17.88% (0.2618 => 0.3086, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/whetstone: 17.87% (0.0834 => 0.0983, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 17.77% (0.0636 => 0.0749, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 17.69% (16.7012 => 19.6549, std.dev.: 0.1080) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 17.57% (4.6579 => 5.4765, std.dev.: 0.1130) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 17.56% (0.0974 => 0.1145, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.53% (0.0776 => 0.0912, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 17.33% (4.5936 => 5.3896, std.dev.: 0.2960) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.32% (0.9124 => 1.0704, std.dev.: 0.0263) MultiSource/Applications/d/make_dparser: 17.26% (3.7840 => 4.4373, std.dev.: 0.0354) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.97% (0.2993 => 0.3501, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 16.93% (0.1317 => 0.1540, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 16.64% (0.0637 => 0.0743, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.50% (1.6874 => 1.9659, std.dev.: 0.0367) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.37% (0.1356 => 0.1578, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 16.17% (7.3529 => 8.5420, std.dev.: 0.0257) MultiSource/Applications/viterbi/viterbi: 15.79% (0.1824 => 0.2112, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.77% (14.9757 => 17.3372, std.dev.: 0.2316) MultiSource/Applications/ClamAV/clamscan: 15.64% (17.4365 => 20.1635, std.dev.: 0.7427) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.48% (0.5059 => 0.5842, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/city/city: 15.47% (1.4805 => 1.7095, std.dev.: 0.0591) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.95% (0.2481 => 0.2852, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ReedSolomon: 14.93% (0.2050 => 0.2356, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 14.78% (0.6996 => 0.8030, std.dev.: 0.0230) MultiSource/Applications/treecc/treecc: 14.74% (2.4719 => 2.8363, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/reversefile: 14.57% (0.3665 => 0.4199, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops: 14.52% (0.1109 => 0.1270, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 14.43% (0.1435 => 0.1642, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.32% (1.1498 => 1.3145, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.26% (4.8904 => 5.5880, std.dev.: 0.0179) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.63% (4.9104 => 5.5796, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 13.62% (0.1366 => 0.1552, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 13.60% (0.7693 => 0.8739, std.dev.: 0.0397) MultiSource/Applications/kimwitu++/kc: 13.60% (18.9377 => 21.5126, std.dev.: 0.2762) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.58% (7.2721 => 8.2597, std.dev.: 0.0718) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.56% (0.3981 => 0.4481, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 12.40% (1.3310 => 1.4960, std.dev.: 0.0562) MultiSource/Applications/ALAC/encode/alacconvert-encode: 11.94% (1.2154 => 1.3605, std.dev.: 0.0414) MultiSource/Benchmarks/sim/sim: 11.36% (0.3715 => 0.4137, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3093 => 0.3433, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.66% (1.5131 => 1.6744, std.dev.: 0.0262) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.54% (0.1072 => 0.1185, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/lpbench: 10.46% (0.1071 => 0.1183, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.30% (0.1058 => 0.1167, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 10.26% (0.2709 => 0.2987, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/oourafft: 10.05% (0.2269 => 0.2497, std.dev.: 0.0038) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.79% (0.1563 => 0.1716, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.49% (0.1622 => 0.1776, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 9.35% (0.2042 => 0.2233, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.84% (0.3462 => 0.3768, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/sieve: 8.79% (0.2913 => 0.3169, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 8.70% (0.1184 => 0.1287, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 8.61% (1.0220 => 1.1100, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/ary3: 8.23% (0.2564 => 0.2775, std.dev.: 0.0048) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.09% (1.3924 => 1.5050, std.dev.: 0.0244) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 7.28% (0.4121 => 0.4421, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.06% (0.1587 => 0.1699, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.87% (0.1755 => 0.1858, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.87% (1.3220 => 1.3732, std.dev.: 0.0120) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106175.00% (0.0008 => 0.8502, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout/matrix: 343.18% (1.5825 => 7.0133, std.dev.: 0.1207) SingleSource/Benchmarks/Shootout/ary3: 335.78% (2.2304 => 9.7196, std.dev.: 1.8702) MultiSource/Applications/sgefa/sgefa: 259.15% (0.3515 => 1.2624, std.dev.: 0.0269) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.38% (1.1825 => 4.0723, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.19% (4.8185 => 16.0065, std.dev.: 0.0779) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 202.19% (0.0228 => 0.0689, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 200.78% (0.0129 => 0.0388, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 150.00% (0.0232 => 0.0580, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/matrix: 63.24% (2.9083 => 4.7474, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.61% (0.2562 => 0.3423, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.54% (3.1254 => 4.1113, std.dev.: 0.0322) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 31.08% (1.4588 => 1.9122, std.dev.: 0.0241) SingleSource/Regression/C/uint64_to_float: 23.06% (1.5397 => 1.8948, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.01% (5.6033 => 6.8364, std.dev.: 0.0530) SingleSource/Benchmarks/Misc/salsa20: 21.84% (7.4497 => 9.0769, std.dev.: 0.0662) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.28% (4.8112 => 5.7870, std.dev.: 0.0991) MultiSource/Benchmarks/7zip/7zip-benchmark: 18.57% (9.0082 => 10.6811, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.60% (5.1752 => 5.8791, std.dev.: 0.2457) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.12% (5.0033 => 5.6595, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.02% (3.6477 => 3.9768, std.dev.: 0.0435) SingleSource/Benchmarks/Misc/ReedSolomon: 8.06% (8.6447 => 9.3411, std.dev.: 0.0237) SingleSource/Benchmarks/McGill/chomp: 7.20% (1.0425 => 1.1176, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.95% (0.8800 => 0.9412, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.75% (4.7473 => 5.0677, std.dev.: 0.0325) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.43% (4.1836 => 4.4106, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.53% (5.0310 => 5.2590, std.dev.: 0.0844) SingleSource/Benchmarks/Linpack/linpack-pc: 3.64% (50.8945 => 52.7471, std.dev.: 0.2120) SingleSource/Benchmarks/Misc/pi: 3.55% (2.1390 => 2.2150, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.41% (4.8076 => 4.8756, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 1.05% (3.5910 => 3.6286, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -34.41% (0.0808 => 0.0530, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -23.80% (0.0727 => 0.0554, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.23% (1.0960 => 1.0606, std.dev.: 0.0063) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.89% (11.5523 => 3.9406, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -61.68% (15.6525 => 5.9976, std.dev.: 0.0279) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.32% (0.4146 => 0.1811, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.23% (0.4578 => 0.2370, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.79% (11.3868 => 6.4007, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.83% (5.4023 => 3.6287, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: -31.34% (0.9372 => 0.6435, std.dev.: 0.1111) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.68% (0.4452 => 0.3086, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.77% (0.5495 => 0.4024, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.05% (5.2605 => 3.8902, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3285, std.dev.: 0.0272) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.97% (0.5826 => 0.4371, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.71% (0.5897 => 0.4440, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.25% (4.9921 => 3.8313, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: -22.14% (7.9891 => 6.2203, std.dev.: 0.6626) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.89% (16.6791 => 13.1956, std.dev.: 0.5382) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.35% (5.8755 => 4.7973, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.92% (7.0016 => 5.7471, std.dev.: 0.1032) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.81% (3.1921 => 2.7831, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.49% (5.3626 => 4.6930, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/dbms/dbms: -12.45% (2.8778 => 2.5196, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.30% (9.7992 => 8.5940, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.11% (5.7056 => 5.0144, std.dev.: 0.0817) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.61% (0.4081 => 0.3648, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.97% (0.1164 => 0.1048, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: -8.56% (9.0650 => 8.2888, std.dev.: 0.1961) MultiSource/Applications/SIBsim4/SIBsim4: -7.78% (3.5443 => 3.2687, std.dev.: 0.0656) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.53% (4.2843 => 3.9617, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.16% (5.5974 => 5.2525, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.11% (4.5424 => 4.2648, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.04% (4.9799 => 4.6791, std.dev.: 0.0258) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.81% (46.0987 => 43.4219, std.dev.: 1.0163) SingleSource/Benchmarks/McGill/queens: -5.62% (1.7443 => 1.6462, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: -5.61% (63.1520 => 59.6084, std.dev.: 0.0766) SingleSource/Benchmarks/Shootout/hash: -5.52% (4.5259 => 4.2761, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.35% (3.5127 => 3.3246, std.dev.: 0.0344) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.12% (3.7662 => 3.5734, std.dev.: 0.0518) SingleSource/Benchmarks/Shootout-C++/hash2: -4.87% (3.6768 => 3.4978, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.51% (5.8973 => 5.6902, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.29% (0.3406 => 0.3294, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.93% (40.4729 => 39.2861, std.dev.: 0.4235) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.58% (3.0082 => 2.9307, std.dev.: 0.0140) MultiSource/Applications/spiff/spiff: -2.41% (2.8571 => 2.7883, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/mandel-2: -2.19% (0.8521 => 0.8334, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.71% (85.3042 => 83.8462, std.dev.: 0.0395) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.68% (8.7327 => 8.5862, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/whetstone: -1.58% (1.6251 => 1.5995, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3155, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 17.47% (1.2047 => 1.4152, std.dev.: 0.0193) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0115) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0061) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0024) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.20% (0.1530 => 0.1481, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: -41.41% (1.9293 => 1.1303, std.dev.: 0.2652) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.00% (0.4049 => 0.3968, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.85% (0.1510 => 0.1482, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.23% (0.0978 => 0.0653, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.71% (0.0276 => 0.0263, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.34% (0.0590 => 0.0529, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.54% (1.1617 => 1.2841, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.60% (0.7437 => 1.7447, std.dev.: 0.0125) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.39% (0.0092 => 0.0053, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.23% (12.7781 => 33.8912, std.dev.: 0.2676) Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 10:40:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 12:40:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128184003.8ABEB2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8046?compare_to=8041&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8046, Order: 173690, Start Time: 2013-01-28 16:20:41, End Time: 2013-01-28 18:40:22 To: 8041, Order: 173683, Start Time: 2013-01-28 13:29:49, End Time: 2013-01-28 15:49:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (273 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (598 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.27% (76.9051 => 77.8783, std.dev.: 0.0241) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1330 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.05% (0.0667 => 0.0674, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8508 => 499.8553, std.dev.: 0.0038) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44225.20% (1.1277 => 499.8553, std.dev.: 0.0038) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 268.90% (0.5229 => 1.9290, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 45.41% (14.9895 => 21.7959, std.dev.: 0.0183) MultiSource/Applications/kimwitu++/kc: 63.07% (14.1553 => 23.0833, std.dev.: 0.0259) MultiSource/Benchmarks/MallocBench/gs/gs: 30.47% (4.1105 => 5.3630, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.90% (1.1048 => 2.0980, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1724.82% (7.1582 => 130.6241, std.dev.: 0.0118) SingleSource/Benchmarks/Misc-C++-EH/spirit: 127.98% (3.4629 => 7.8947, std.dev.: 0.0199) SingleSource/Benchmarks/Misc-C++/stepanov_container: 100.43% (0.6222 => 1.2471, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10273.89% (0.0720 => 7.4692, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3834500.00% (0.0001 => 3.8346, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11170500.00% (0.0001 => 11.1706, std.dev.: 0.0086) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848300.00% (0.0001 => 9.8484, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488000.00% (0.0001 => 5.4881, std.dev.: 0.0056) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 825.69% (1.1194 => 10.3622, std.dev.: 0.0077) SingleSource/Benchmarks/Misc/flops: 180.94% (0.1432 => 0.4023, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/factor: 171.96% (0.0296 => 0.0805, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 157.86% (22.1758 => 57.1835, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/lowercase: 140.23% (0.0256 => 0.0615, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 135.23% (0.1056 => 0.2484, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 111.93% (0.0243 => 0.0515, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.95% (0.0929 => 0.1904, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 103.57% (7.0540 => 14.3599, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout/objinst: 98.83% (0.0427 => 0.0849, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 88.93% (0.1463 => 0.2764, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 87.95% (0.0730 => 0.1372, std.dev.: 0.0009) SingleSource/UnitTests/2006-01-23-UnionInit: 80.59% (0.0237 => 0.0428, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 79.31% (0.0377 => 0.0676, std.dev.: 0.0000) SingleSource/Regression/C/casts: 77.67% (0.0318 => 0.0565, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 77.53% (0.2554 => 0.4534, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 75.26% (1.5859 => 2.7795, std.dev.: 0.0042) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 71.30% (0.0439 => 0.0752, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 65.99% (0.0394 => 0.0654, std.dev.: 0.0004) SingleSource/UnitTests/Vector/simple: 64.32% (0.0185 => 0.0304, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 63.87% (2.2024 => 3.6090, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.22% (2.9384 => 4.7961, std.dev.: 0.0306) SingleSource/Regression/C++/EH/function_try_block: 63.06% (0.0268 => 0.0437, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 61.25% (8.1363 => 13.1197, std.dev.: 0.0090) SingleSource/Regression/C/sumarray: 59.74% (0.0231 => 0.0369, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 59.49% (0.1143 => 0.1823, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 59.45% (0.0217 => 0.0346, std.dev.: 0.0001) SingleSource/UnitTests/2002-05-02-CastTest: 57.80% (0.0218 => 0.0344, std.dev.: 0.0000) SingleSource/Regression/C/testtrace: 57.08% (0.0212 => 0.0333, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 56.60% (0.0636 => 0.0996, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-31-CastToBool: 55.94% (0.0202 => 0.0315, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 55.85% (1.5415 => 2.4024, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/ary3: 54.31% (0.0232 => 0.0358, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 53.81% (0.3109 => 0.4782, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: 52.94% (1.1642 => 1.7805, std.dev.: 0.0056) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.78% (0.0953 => 0.1456, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 51.02% (0.1125 => 0.1699, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 50.73% (21.9371 => 33.0668, std.dev.: 0.0314) MultiSource/Benchmarks/McCat/04-bisect/bisect: 50.28% (0.1062 => 0.1596, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.77% (0.6675 => 0.9997, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.42% (0.0793 => 0.1177, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 48.19% (0.2700 => 0.4001, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 47.89% (3.8922 => 5.7561, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 46.96% (4.2646 => 6.2672, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/exptree: 46.93% (0.0814 => 0.1196, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 46.53% (1.0722 => 1.5711, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 45.75% (0.7115 => 1.0370, std.dev.: 0.0017) SingleSource/UnitTests/2003-07-09-SignedArgs: 45.74% (0.0282 => 0.0411, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 45.54% (0.0527 => 0.0767, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 44.95% (0.1555 => 0.2254, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.64% (0.0457 => 0.0661, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.50% (0.0564 => 0.0815) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.47% (0.0479 => 0.0692, std.dev.: 0.0008) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 43.59% (0.0640 => 0.0919, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/div: 43.41% (0.0258 => 0.0370) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.45% (0.0245 => 0.0349) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.43% (0.5105 => 0.7271, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.34% (0.4615 => 0.6569, std.dev.: 0.0020) SingleSource/UnitTests/block-copied-in-cxxobj: 42.26% (0.0310 => 0.0441, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 42.18% (0.0467 => 0.0664, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/shr: 42.06% (0.0252 => 0.0358, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 41.96% (2.2969 => 3.2606, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 41.78% (0.0730 => 0.1035, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 41.54% (0.0662 => 0.0937, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.52% (0.2271 => 0.3214, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 41.43% (0.3092 => 0.4373, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 41.33% (9.4845 => 13.4044, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout/matrix: 41.32% (0.0818 => 0.1156, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 40.69% (0.0462 => 0.0650, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 40.68% (0.1175 => 0.1653, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 40.41% (0.6456 => 0.9065, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.35% (0.0746 => 0.1047, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.33% (0.0672 => 0.0943, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 39.53% (0.1695 => 0.2365, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.04% (0.5860 => 0.8148, std.dev.: 0.0050) SingleSource/Benchmarks/McGill/chomp: 38.85% (0.1655 => 0.2298, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 38.80% (0.0719 => 0.0998, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 38.61% (0.4299 => 0.5959, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/hash: 38.14% (0.0485 => 0.0670, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.04% (0.0397 => 0.0548, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.87% (0.3441 => 0.4744, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 37.84% (3.8723 => 5.3375, std.dev.: 0.0127) MultiSource/Applications/treecc/treecc: 37.74% (2.0273 => 2.7924, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 37.66% (0.7835 => 1.0786, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.61% (1.4186 => 1.9521, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 37.60% (0.1032 => 0.1420, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.48% (0.0675 => 0.0928, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 37.39% (5.7591 => 7.9122, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 37.20% (63.2438 => 86.7678, std.dev.: 0.0425) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.01% (0.0770 => 0.1055, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 36.97% (0.1044 => 0.1430, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: 36.95% (0.0295 => 0.0404, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 36.92% (3.3354 => 4.5667, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout/lists: 36.90% (0.0626 => 0.0857, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.71% (0.3307 => 0.4521, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.58% (0.1892 => 0.2584, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.48% (0.3427 => 0.4677, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 36.28% (1.1840 => 1.6136, std.dev.: 0.0048) MultiSource/Applications/sqlite3/sqlite3: 36.14% (17.1811 => 23.3908, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.11% (0.5569 => 0.7580, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/whetstone: 35.61% (0.0660 => 0.0895, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages: 35.47% (0.0327 => 0.0443) MultiSource/Benchmarks/Olden/em3d/em3d: 35.46% (0.1695 => 0.2296, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 35.41% (0.1268 => 0.1717, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 35.36% (0.1151 => 0.1558, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.28% (0.3121 => 0.4222, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 35.04% (0.4620 => 0.6239, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.94% (0.0933 => 0.1259, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 34.94% (0.3423 => 0.4619, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.90% (0.0447 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 34.90% (0.0811 => 0.1094, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 34.69% (0.4289 => 0.5777, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Queens: 34.54% (0.0414 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.27% (0.4879 => 0.6551, std.dev.: 0.0040) SingleSource/UnitTests/2003-08-11-VaListArg: 34.18% (0.0316 => 0.0424, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.96% (0.1584 => 0.2122, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 33.76% (0.2758 => 0.3689, std.dev.: 0.0028) SingleSource/Benchmarks/McGill/queens: 33.75% (0.0403 => 0.0539) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.68% (1.1861 => 1.5856, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.61% (0.0842 => 0.1125, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 33.52% (0.0886 => 0.1183, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/mst/mst: 33.28% (0.1163 => 0.1550, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.22% (0.2107 => 0.2807, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.89% (0.1566 => 0.2081, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 32.40% (0.7433 => 0.9841, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 32.28% (0.1236 => 0.1635, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 32.20% (0.0528 => 0.0698, std.dev.: 0.0000) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.13% (0.0389 => 0.0514, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.95% (0.0770 => 0.1016, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 31.93% (0.0592 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 31.60% (0.0614 => 0.0808, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 31.41% (0.3387 => 0.4451, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.02% (0.8172 => 1.0707, std.dev.: 0.0120) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 31.00% (0.1029 => 0.1348, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.90% (1.3050 => 1.7083, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.71% (0.0482 => 0.0630, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.67% (0.1940 => 0.2535, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.64% (0.0408 => 0.0533, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.41% (0.5981 => 0.7800, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.31% (0.6450 => 0.8405, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.26% (0.1510 => 0.1967, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.01% (0.1906 => 0.2478, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.60% (0.8067 => 1.0455, std.dev.: 0.0083) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Towers: 29.51% (0.0471 => 0.0610) MultiSource/Benchmarks/McCat/09-vor/vor: 29.34% (0.3180 => 0.4113, std.dev.: 0.0003) SingleSource/Regression/C++/EH/exception_spec_test: 29.14% (0.0350 => 0.0452, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 29.11% (0.1144 => 0.1477, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 29.07% (4.9449 => 6.3824, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/football/football: 29.00% (0.8921 => 1.1508, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.95% (0.1337 => 0.1724, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 28.92% (0.9765 => 1.2589, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.85% (0.0416 => 0.0536, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.82% (0.0871 => 0.1122, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 28.75% (0.0633 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.47% (0.2603 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.45% (0.5020 => 0.6448, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 28.22% (0.0567 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 28.19% (5.0018 => 6.4116, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.07% (0.8101 => 1.0375, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 27.96% (1.5603 => 1.9966, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.93% (0.1117 => 0.1429, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Treesort: 27.74% (0.0411 => 0.0525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 27.50% (0.3098 => 0.3950, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.72% (0.3177 => 0.4026, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.65% (0.2266 => 0.2870, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.65% (0.4203 => 0.5323, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.64% (0.3865 => 0.4856, std.dev.: 0.0017) SingleSource/Benchmarks/Dhrystone/dry: 25.44% (0.0456 => 0.0572, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.94% (0.0834 => 0.1042, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0019) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.83% (0.0443 => 0.0553, std.dev.: 0.0009) SingleSource/Regression/C/bigstack: 24.46% (0.0417 => 0.0519, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 24.20% (0.4103 => 0.5096, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.93% (0.0798 => 0.0989, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.59% (0.0479 => 0.0592, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 23.51% (0.1625 => 0.2007, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 23.26% (0.1440 => 0.1775, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.15% (0.0648 => 0.0798, std.dev.: 0.0019) SingleSource/Benchmarks/Dhrystone/fldry: 23.08% (0.0481 => 0.0592, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.01% (0.0491 => 0.0604, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.30% (0.0704 => 0.0861, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.79% (0.2065 => 0.2515, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.63% (0.1114 => 0.1355, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.54% (14.3668 => 17.4608, std.dev.: 0.0184) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.35% (0.4636 => 0.5626, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/perlin: 21.08% (0.0536 => 0.0649, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 20.90% (0.3283 => 0.3969, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.87% (0.4064 => 0.4912, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 20.51% (0.3232 => 0.3895, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 20.29% (0.3282 => 0.3948, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 20.24% (0.1438 => 0.1729, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 20.16% (0.2049 => 0.2462, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.93% (0.0838 => 0.1005, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.71% (0.2430 => 0.2909, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 19.52% (0.4048 => 0.4838, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 19.21% (0.3379 => 0.4028, std.dev.: 0.0012) SingleSource/UnitTests/initp1: 19.10% (0.0555 => 0.0661, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.40% (0.3826 => 0.4530, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 18.37% (0.3603 => 0.4265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 17.97% (0.3684 => 0.4346, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 17.49% (0.2905 => 0.3413, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 17.39% (0.3422 => 0.4017, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 16.47% (0.3886 => 0.4526, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.14% (0.3650 => 0.4239, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 16.06% (0.3935 => 0.4567, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.97% (2.2022 => 2.5538, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 15.54% (0.1268 => 0.1465, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ffbench: 15.46% (0.0705 => 0.0814, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 14.08% (0.3927 => 0.4480, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.98% (0.1330 => 0.1516, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 13.91% (1.2842 => 1.4628, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/strcat: 13.39% (0.2831 => 0.3210, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.16% (0.3162 => 0.3578, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.49% (0.3828 => 0.4306, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 12.23% (2.0665 => 2.3192, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 12.05% (0.2871 => 0.3217, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 11.85% (0.2877 => 0.3218, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.79% (7.9617 => 8.9005, std.dev.: 0.0116) MultiSource/Benchmarks/PAQ8p/paq8p: 11.54% (10.3673 => 11.5634, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.42% (0.3136 => 0.3494, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.75% (0.3543 => 0.3924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.52% (0.2891 => 0.3195, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.38% (0.2756 => 0.3042, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.34% (0.3694 => 0.4076, std.dev.: 0.0028) SingleSource/UnitTests/ObjC++/property-reference: 10.29% (0.7326 => 0.8080, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/wc: 10.22% (0.3052 => 0.3364, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.22% (0.6030 => 0.6646, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.16% (0.3543 => 0.3903, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 10.05% (0.3473 => 0.3822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.01% (0.3497 => 0.3847, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.99% (0.2872 => 0.3159, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.99% (0.2802 => 0.3082, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.97% (0.3561 => 0.3916, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-3: 9.95% (0.3516 => 0.3866, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.95% (0.2793 => 0.3071, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.87% (0.2725 => 0.2994, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hello: 9.76% (0.2714 => 0.2979, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.89% (0.5925 => 0.6452, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.51% (0.3131 => 0.3366, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.72% (0.3817 => 0.3921, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4763, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 13.08% (0.5413 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2436, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.74% (11.6436 => 12.4283, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4494, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3110, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.65% (0.3316 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.10% (0.9957 => 1.0266, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.6802 => 8.9257, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7218, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.69% (9.1159 => 9.2697, std.dev.: 0.0198) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 1.43% (27.8444 => 28.2413, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5783, std.dev.: 0.0018) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.76% (6.6874 => 0.2166, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.46% (5.2763 => 1.2949, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -35.45% (0.1622 => 0.1047, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.03% (5.3855 => 4.9533, std.dev.: 0.0051) SingleSource/UnitTests/Vector/constpool: -7.81% (54.1659 => 49.9349, std.dev.: 0.0148) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.34% (5.3526 => 4.9597, std.dev.: 0.0076) MultiSource/Applications/JM/ldecod/ldecod: -4.41% (10.4361 => 9.9757, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.09% (1.7609 => 1.7065, std.dev.: 0.0057) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.94% (1.9577 => 0.6277, std.dev.: 0.0199) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.39% (1.5373 => 1.0240, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.55% (10.7105 => 7.4387, std.dev.: 0.0068) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8496, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.50% (2.6546 => 2.0042, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.76% (2.5528 => 2.1249, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/matrix: -12.97% (3.1443 => 2.7364, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.82% (0.9540 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4921, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5799, std.dev.: 0.0359) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.05% (1.6805 => 1.5789, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7036, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: -4.65% (10.2830 => 9.8044, std.dev.: 0.0202) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5098, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: -1.61% (3.6994 => 3.6398, std.dev.: 0.0129) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7221 => 3.6754, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -1.19% (4.6441 => 4.5889, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.16% (6.2999 => 6.2271, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/hash: -1.09% (4.9088 => 4.8554, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.44% (0.1485 => 0.1330, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.15% (0.2116 => 0.0674, std.dev.: 0.0010) Report Time: 1.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 11:42:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 13:42:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130128194244.0F4A22A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8047?compare_to=8040&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8047, Order: 173685, Start Time: 2013-01-28 16:07:55, End Time: 2013-01-28 19:43:04 To: 8040, Order: 173680, Start Time: 2013-01-28 11:25:45, End Time: 2013-01-28 15:01:11 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 0 (204 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1104 (733 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 49.54% (0.5361 => 0.8017, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.72% (0.0625 => 0.0917, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.51% (0.0547 => 0.0785, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.95% (0.1063 => 0.1477, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 37.13% (0.1088 => 0.1492, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 36.30% (0.0281 => 0.0383, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.60% (0.7426 => 1.0070, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: 35.53% (0.0304 => 0.0412, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 35.53% (1.5932 => 2.1592, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.54% (0.1106 => 0.1488, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.82% (0.4994 => 0.6683, std.dev.: 0.0122) SingleSource/Benchmarks/Misc/oourafft: 33.51% (0.0561 => 0.0749) MultiSource/Benchmarks/Olden/treeadd/treeadd: 32.63% (0.0331 => 0.0439, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 32.50% (0.2040 => 0.2703, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.33% (0.0897 => 0.1187, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 32.13% (0.4139 => 0.5469, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 31.86% (0.2969 => 0.3915, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 31.72% (0.0599 => 0.0789, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.69% (0.5900 => 0.7770, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 31.62% (0.5000 => 0.6581, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.51% (0.0584 => 0.0768, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 31.44% (0.1218 => 0.1601, std.dev.: 0.0022) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.08% (0.0563 => 0.0738, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 31.01% (0.1003 => 0.1314, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 30.94% (0.0808 => 0.1058, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 30.63% (0.0604 => 0.0789) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.25% (0.0367 => 0.0478, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.12% (0.0415 => 0.0540, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 29.80% (0.0349 => 0.0453, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 29.75% (0.1284 => 0.1666, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 29.73% (0.0481 => 0.0624, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.63% (0.1107 => 0.1435, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.41% (0.0714 => 0.0924, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.10% (0.0457 => 0.0590, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 28.64% (0.0419 => 0.0539, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 28.64% (0.0440 => 0.0566, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 28.49% (0.2566 => 0.3297, std.dev.: 0.0071) MultiSource/Benchmarks/Olden/perimeter/perimeter: 28.48% (0.0495 => 0.0636) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.42% (0.0475 => 0.0610, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.31% (0.3084 => 0.3957, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.28% (11.6398 => 14.9317, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 28.28% (0.0541 => 0.0694, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 28.26% (0.0605 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.25% (0.0584 => 0.0749, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 28.24% (0.1505 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.21% (0.0390 => 0.0500, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 28.02% (0.1549 => 0.1983, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.99% (0.1604 => 0.2053, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 27.98% (0.0386 => 0.0494, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 27.92% (0.1619 => 0.2071, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 27.85% (0.0948 => 0.1212, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 27.76% (0.0425 => 0.0543, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.62% (0.1021 => 0.1303, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 27.49% (1.8794 => 2.3961, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.34% (0.2736 => 0.3484, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 27.33% (0.0633 => 0.0806, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.21% (0.0452 => 0.0575, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.20% (0.4253 => 0.5410, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.20% (0.1103 => 0.1403, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.15% (0.2103 => 0.2674, std.dev.: 0.0026) MultiSource/Applications/viterbi/viterbi: 27.14% (0.0947 => 0.1204, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 27.08% (5.5417 => 7.0425, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.06% (0.3903 => 0.4959, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.95% (0.0642 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.94% (0.3890 => 0.4938, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.64% (0.0822 => 0.1041, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/distray/distray: 26.63% (0.0398 => 0.0504, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.61% (0.2014 => 0.2550, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 26.56% (1.3152 => 1.6645, std.dev.: 0.0168) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.54% (0.1620 => 0.2050, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 26.43% (0.0821 => 0.1038, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 26.41% (0.0462 => 0.0584, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.37% (0.0804 => 0.1016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 26.26% (0.3930 => 0.4962, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.06% (0.2866 => 0.3613, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.97% (0.1028 => 0.1295, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 25.96% (0.4029 => 0.5075, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 25.94% (0.2691 => 0.3389, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.89% (0.1383 => 0.1741, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 25.80% (2.0346 => 2.5595, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.76% (0.1968 => 0.2475, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 25.74% (0.9697 => 1.2193, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/mst/mst: 25.64% (0.0698 => 0.0877, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 25.48% (0.5546 => 0.6959, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 25.48% (0.1421 => 0.1783, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 25.46% (0.0491 => 0.0616, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 25.38% (0.0394 => 0.0494, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 25.36% (4.2109 => 5.2789, std.dev.: 0.0617) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.36% (0.4361 => 0.5467, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.19% (0.3271 => 0.4095, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.17% (0.1462 => 0.1830, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 25.09% (1.4269 => 1.7849, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 24.91% (1.0781 => 1.3467, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.91% (0.0582 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 24.78% (0.0573 => 0.0715, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.68% (1.6211 => 2.0212, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/football/football: 24.67% (0.2075 => 0.2587, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 24.65% (0.4658 => 0.5806, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 24.59% (0.6634 => 0.8265, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.56% (0.0513 => 0.0639, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.37% (0.0673 => 0.0837) MultiSource/Applications/minisat/minisat: 24.28% (0.3336 => 0.4146, std.dev.: 0.0047) MultiSource/Benchmarks/sim/sim: 24.27% (0.0758 => 0.0942) MultiSource/Benchmarks/PAQ8p/paq8p: 24.26% (0.4847 => 0.6023, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 24.18% (23.5202 => 29.2081, std.dev.: 0.0336) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 24.11% (0.5026 => 0.6238, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/functionobjects: 23.89% (0.2068 => 0.2562, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 23.85% (0.5584 => 0.6916, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.85% (0.1090 => 0.1350, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.66% (2.7292 => 3.3749, std.dev.: 0.0135) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.59% (0.0496 => 0.0613) MultiSource/Applications/lambda-0_1_3/lambda: 23.53% (0.3498 => 0.4321, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: 23.52% (2.1013 => 2.5955, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.43% (0.0572 => 0.0706, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 23.25% (0.2391 => 0.2947, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.25% (1.9694 => 2.4272, std.dev.: 0.0054) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.23% (0.6435 => 0.7930, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.19% (0.1160 => 0.1429, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 23.01% (0.7875 => 0.9687, std.dev.: 0.0111) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 22.82% (4.4195 => 5.4280, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.76% (0.2737 => 0.3360, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 22.66% (3.5627 => 4.3700, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.23% (1.9966 => 2.4405, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 21.45% (4.6177 => 5.6083, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 21.32% (2.1653 => 2.6269, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 21.13% (0.5012 => 0.6071, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.97% (0.3195 => 0.3865, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.88% (0.3625 => 0.4382, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 20.74% (0.4146 => 0.5006, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 20.63% (0.4251 => 0.5128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 20.61% (0.3726 => 0.4494, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 20.60% (0.3282 => 0.3958, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.40% (4.6926 => 5.6499, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/moments: 20.28% (0.3678 => 0.4424, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 20.16% (0.3477 => 0.4178, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.05% (0.3362 => 0.4036, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 19.92% (0.3348 => 0.4015, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 19.91% (0.5826 => 0.6986, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 19.75% (0.5889 => 0.7052, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 19.74% (0.9909 => 1.1865, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 19.62% (0.3267 => 0.3908, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.57% (0.3690 => 0.4412, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 19.57% (0.2811 => 0.3361, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 19.55% (0.2823 => 0.3375, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.53% (0.3124 => 0.3734, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.47% (0.3981 => 0.4756, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 19.46% (0.3258 => 0.3892, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.30% (0.2875 => 0.3430, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: 19.30% (0.2813 => 0.3356, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 19.23% (0.3317 => 0.3955, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.18% (0.3060 => 0.3647, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 19.03% (0.2780 => 0.3309, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.97% (2.0673 => 2.4595, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/strcat: 18.95% (0.2750 => 0.3271, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.93% (0.2911 => 0.3462, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.77% (0.2792 => 0.3316, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 18.75% (0.2725 => 0.3236, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 18.62% (0.2803 => 0.3325, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 18.57% (0.2714 => 0.3218, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.55% (0.2738 => 0.3246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.50% (0.2729 => 0.3234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.47% (0.3845 => 0.4555, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 18.39% (0.7171 => 0.8490, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 18.31% (0.3004 => 0.3554, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 17.93% (0.3096 => 0.3651, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 16.82% (11.9555 => 13.9663, std.dev.: 0.0145) SingleSource/UnitTests/ObjC/parameter-passing: 16.00% (0.3724 => 0.4320, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 15.75% (0.3650 => 0.4225, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.58% (0.3446 => 0.3983, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-4: 15.50% (0.3465 => 0.4002, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 15.47% (0.3496 => 0.4037, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 15.43% (0.3460 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.43% (0.3643 => 0.4205, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.42% (0.3488 => 0.4026, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/synchronized: 15.42% (0.3469 => 0.4004, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 15.34% (0.3442 => 0.3970, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.91% (0.3792 => 0.4016, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5212, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: 9.39% (0.2802 => 0.3065, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.85% (0.3693 => 0.3983, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6104, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6723, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2375, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-2: 4.91% (1.8057 => 1.8943, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6854, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5022, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 3.01% (0.6276 => 0.6465, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1918, std.dev.: 0.0086) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2907, std.dev.: 0.0029) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.2989, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 1.24% (4.0317 => 4.0818, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.04% (3.1722 => 3.2051, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5806, std.dev.: 0.0204) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4778, std.dev.: 0.0076) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5547, std.dev.: 0.0249) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.51% (17.2379 => 14.3921, std.dev.: 0.0099) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1015, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary2: -10.16% (0.2402 => 0.2158, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9756, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8024, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.76% (41.7953 => 40.2257, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8116, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0055) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0022) SingleSource/Benchmarks/Dhrystone/dry: -2.45% (14.0481 => 13.7044, std.dev.: 0.0642) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1538, std.dev.: 0.0499) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5763, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2258, std.dev.: 0.0420) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0435, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 12:11:05 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 14:11:05 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128201105.B5C432A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8048?compare_to=8044&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8048, Order: 173703, Start Time: 2013-01-28 18:34:32, End Time: 2013-01-28 20:11:26 To: 8044, Order: 173691, Start Time: 2013-01-28 16:34:09, End Time: 2013-01-28 18:10:47 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (219 on baseline) Performance Improvements: 0 (74 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (799 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 1.98% (55.3839 => 56.4819, std.dev.: 0.1138) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 92.50% (0.0280 => 0.0539, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 84.10% (0.0717 => 0.1320, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 83.07% (0.0514 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.90% (0.0974 => 0.1684, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 64.75% (0.1132 => 0.1865, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 60.07% (0.1500 => 0.2401, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 51.94% (22.4056 => 34.0430, std.dev.: 0.0158) SingleSource/Regression/C/sumarraymalloc: 49.06% (0.0267 => 0.0398, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 48.25% (0.0599 => 0.0888, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 48.10% (0.6395 => 0.9471, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 46.90% (1.6474 => 2.4200, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 46.68% (0.6395 => 0.9380, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 46.63% (0.0371 => 0.0544, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/objinst: 43.00% (0.0407 => 0.0582, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 42.11% (0.0418 => 0.0594, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 41.97% (0.6230 => 0.8845, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.92% (0.6260 => 0.8884, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.88% (0.5688 => 0.8070, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.76% (0.5805 => 0.8229, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.44% (0.5456 => 0.7717, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.14% (0.5849 => 0.8255, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.63% (0.5567 => 0.7829, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.61% (0.5575 => 0.7839, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.49% (0.5802 => 0.8151, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.32% (0.5581 => 0.7831, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 40.05% (0.5705 => 0.7990, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.74% (0.5941 => 0.8302, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 39.51% (0.5857 => 0.8171, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 39.41% (0.5570 => 0.7765, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 39.38% (0.5569 => 0.7762, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 39.36% (0.5478 => 0.7634, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.20% (0.0699 => 0.0973, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 39.03% (2.2587 => 3.1403, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.97% (0.6033 => 0.8384, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.97% (0.5859 => 0.8142, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 38.72% (0.5591 => 0.7756, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 38.46% (0.5925 => 0.8204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.34% (0.6440 => 0.8909, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 37.78% (0.5863 => 0.8078, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.60% (0.6676 => 0.9186, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.58% (0.6189 => 0.8515, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.53% (0.0445 => 0.0612, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.14% (0.6052 => 0.8300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 37.12% (0.6446 => 0.8839, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 36.86% (0.0293 => 0.0401, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.63% (0.6304 => 0.8613, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.60% (0.0582 => 0.0795, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 36.36% (0.6194 => 0.8446, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 36.28% (0.6681 => 0.9105, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.93% (0.6660 => 0.9053, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 35.85% (0.1230 => 0.1671, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 35.62% (0.6297 => 0.8540, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.71% (0.6667 => 0.8981, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 33.99% (1.1450 => 1.5342, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 33.85% (0.2659 => 0.3559, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 33.29% (0.0790 => 0.1053, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 33.11% (0.7524 => 1.0015, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.72% (0.7339 => 0.9740, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 31.51% (0.0622 => 0.0818, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.46% (0.0693 => 0.0911) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 31.40% (0.0621 => 0.0816, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 31.12% (0.0556 => 0.0729, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.61% (1.6364 => 2.1373, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 29.29% (0.0833 => 0.1077, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.71% (0.0634 => 0.0816, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.68% (3.5339 => 4.5473, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.68% (0.0680 => 0.0875, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 27.21% (1.2784 => 1.6262, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++-EH/spirit: 27.18% (5.4682 => 6.9544, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 26.86% (0.0566 => 0.0718, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.61% (0.1796 => 0.2274, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 26.30% (0.3357 => 0.4240, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.85% (0.7021 => 0.8836, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.74% (0.0707 => 0.0889, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.65% (0.1146 => 0.1440, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 25.63% (1.2515 => 1.5722, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 23.26% (0.0864 => 0.1065, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.16% (0.0665 => 0.0819, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.76% (0.1081 => 0.1327, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.71% (0.0731 => 0.0897, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.66% (4.5069 => 5.5283, std.dev.: 0.0114) MultiSource/Benchmarks/FreeBench/mason/mason: 22.38% (0.0621 => 0.0760) MultiSource/Applications/SPASS/SPASS: 22.00% (15.5079 => 18.9200, std.dev.: 0.0209) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.34% (0.0764 => 0.0927, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 21.23% (9.2283 => 11.1871, std.dev.: 0.0155) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.03% (0.1731 => 0.2095, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 20.68% (0.0885 => 0.1068) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.53% (0.1982 => 0.2389, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 20.53% (0.0526 => 0.0634, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 20.32% (0.0571 => 0.0687, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 20.06% (0.6750 => 0.8104, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.98% (0.0806 => 0.0967, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.93% (0.5329 => 0.6391, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.81% (0.4916 => 0.5890, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 19.56% (0.7447 => 0.8904, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 19.26% (0.2985 => 0.3560, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 19.26% (0.0919 => 0.1096, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 19.25% (2.4021 => 2.8645, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 19.21% (0.0604 => 0.0720, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 18.85% (0.4515 => 0.5366, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.64% (0.0617 => 0.0732, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.63% (0.3483 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.57% (0.2385 => 0.2828, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 18.10% (1.3864 => 1.6373, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.89% (0.0598 => 0.0705, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 17.72% (17.1032 => 20.1336, std.dev.: 0.0159) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 17.63% (0.1509 => 0.1775, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.52% (1.4642 => 1.7208, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 17.32% (0.0710 => 0.0833) SingleSource/UnitTests/ObjC/messages-2: 17.05% (0.0704 => 0.0824, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.84% (0.2548 => 0.2977, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 16.47% (2.1401 => 2.4925, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.43% (0.1077 => 0.1254, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 16.25% (0.1674 => 0.1946, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.21% (0.3491 => 0.4057, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 16.07% (0.4861 => 0.5642, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.04% (0.9557 => 1.1090, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 16.02% (0.6293 => 0.7301, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 15.99% (34.0927 => 39.5450, std.dev.: 0.0255) SingleSource/Benchmarks/Misc/whetstone: 15.89% (0.0686 => 0.0795, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 15.80% (5.0226 => 5.8160, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.78% (0.1096 => 0.1269, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 15.78% (4.0594 => 4.6999, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 15.74% (0.4524 => 0.5236, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 15.42% (0.8418 => 0.9716, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/chomp: 15.39% (0.1761 => 0.2032, std.dev.: 0.0050) MultiSource/Benchmarks/nbench/nbench: 15.34% (1.1530 => 1.3299, std.dev.: 0.0043) MultiSource/Benchmarks/NPB-serial/is/is: 15.11% (0.0708 => 0.0815, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 14.99% (3.5154 => 4.0425, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.98% (0.0741 => 0.0852, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 14.81% (0.0797 => 0.0915, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 13.59% (0.3658 => 0.4155, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.45% (0.5999 => 0.6806, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 13.20% (1.2300 => 1.3923, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: 13.14% (18.2933 => 20.6968, std.dev.: 0.0047) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.90% (0.3319 => 0.3747, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.87% (0.1173 => 0.1324, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.79% (0.1290 => 0.1455, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 12.57% (0.3581 => 0.4031, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 12.40% (0.0919 => 0.1033, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.24% (0.2001 => 0.2246, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 12.14% (0.1862 => 0.2088, std.dev.: 0.0021) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.97% (0.1145 => 0.1282, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 11.79% (15.2527 => 17.0511, std.dev.: 0.0073) SingleSource/UnitTests/SignlessTypes/rem: 11.70% (0.1197 => 0.1337, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/power/power: 11.44% (0.1154 => 0.1286, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.37% (0.0932 => 0.1038, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.37% (0.2999 => 0.3340, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.34% (0.1076 => 0.1198, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 11.29% (0.0974 => 0.1084, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.20% (4.0323 => 4.4840, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.80% (0.2278 => 0.2524, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.47% (0.1108 => 0.1224, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: 10.45% (0.3255 => 0.3595, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 10.14% (0.9179 => 1.0110, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/mst/mst: 10.07% (0.1271 => 0.1399, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.02% (0.2106 => 0.2317, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 9.98% (0.1202 => 0.1322, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.93% (0.7982 => 0.8775, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.93% (0.5168 => 0.5681, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 9.87% (0.3271 => 0.3594, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.83% (0.6736 => 0.7398, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.80% (0.4427 => 0.4861, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.67% (0.7919 => 0.8685, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 9.58% (1.5610 => 1.7105, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.56% (0.1621 => 0.1776, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.47% (1.3722 => 1.5022, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.04% (0.7198 => 0.7849, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 8.78% (0.1879 => 0.2044, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: 8.77% (0.4083 => 0.4441, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.26% (0.1441 => 0.1560, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.94% (0.2695 => 0.2909, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.3142 => 0.3390, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 7.89% (4.3330 => 4.6750, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 7.77% (16.1920 => 17.4494, std.dev.: 0.0158) MultiSource/Applications/JM/ldecod/ldecod: 7.74% (7.0961 => 7.6456, std.dev.: 0.0081) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.70% (0.8521 => 0.9177, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.66% (4.8161 => 5.1849, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.54% (0.9077 => 0.9761, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.46% (4.8802 => 5.2444, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.16% (1.0544 => 1.1299, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 7.15% (2.4924 => 2.6706, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 7.03% (0.6484 => 0.6940, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.90% (8.0126 => 8.5652, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.83% (0.4321 => 0.4616, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.69% (6.7716 => 7.2246, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.05% (14.2083 => 15.0678, std.dev.: 0.0185) SingleSource/Benchmarks/Shootout-C++/ary3: 5.83% (0.3446 => 0.3647, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.58% (0.9852 => 1.0402, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.53% (0.3849 => 0.4062, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.51% (1.2210 => 1.2883, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.47% (1.2221 => 1.2889, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 5.45% (0.3394 => 0.3579, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 5.20% (0.3406 => 0.3583, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 5.15% (0.4813 => 0.5061, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.10% (0.2355 => 0.2475, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.94% (0.4151 => 0.4356, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/moments: 4.10% (0.4248 => 0.4422, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 3.94% (0.3481 => 0.3618, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 3.62% (0.3788 => 0.3925, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.51% (0.3931 => 0.4069, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 3.31% (0.3867 => 0.3995, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.24% (0.9542 => 0.9756, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.79% (31.3723 => 55.7758, std.dev.: 0.0214) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.70% (0.9531 => 1.0265, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 7.50% (0.5692 => 0.6119, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.95% (1.2783 => 1.3671, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4819, std.dev.: 0.1138) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0058) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6045, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2231 => 18.5091, std.dev.: 0.0279) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2487, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2709, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.49% (0.3812 => 0.3641, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.31% (0.3831 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.25% (0.3880 => 0.3715, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.22% (0.3884 => 0.3720, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.13% (0.3848 => 0.3689, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.11% (0.3896 => 0.3736, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.01% (0.3891 => 0.3735, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.89% (0.4033 => 0.3876, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.76% (0.6347 => 0.6172, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -1.89% (0.6441 => 0.6319, std.dev.: 0.0030) SingleSource/UnitTests/Vector/constpool: -1.72% (20.7746 => 20.4179, std.dev.: 0.0344) SingleSource/UnitTests/ObjC++/property-reference: -1.67% (0.7779 => 0.7649, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.31% (2.1713 => 2.1428, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.08% (1.8100 => 0.6863, std.dev.: 0.0110) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.75% (0.6962 => 0.3429, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3108, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.92% (1.3643 => 1.0243, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7548, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0832, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.90% (4.1024 => 3.2039, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.09% (2.5106 => 2.1317, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3562, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.65% (7.1848 => 6.6354, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6997, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.92% (7.9763 => 7.7437, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.54% (3.7241 => 3.6296, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.23% (1.3096 => 1.2804, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: -1.75% (7.3040 => 7.1760, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0054) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.50% (6.5735 => 6.4747, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.34% (1.6086 => 1.5871, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.27% (1.6219 => 1.6013, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary3: -1.21% (3.7092 => 3.6642, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.6307 => 1.6112, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 13:06:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 15:06:46 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128210646.15E3C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8049?compare_to=8045&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8049, Order: 173703, Start Time: 2013-01-28 18:54:42, End Time: 2013-01-28 21:07:08 To: 8045, Order: 173690, Start Time: 2013-01-28 16:26:24, End Time: 2013-01-28 18:34:18 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 29 (188 on baseline) Performance Improvements: 5 (39 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1030 (836 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 54.41% (0.0601 => 0.0928, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 48.46% (0.0324 => 0.0481, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 41.84% (0.0423 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 24.99% (0.4718 => 0.5897, std.dev.: 0.0082) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.66% (0.1699 => 0.2033, std.dev.: 0.0042) MultiSource/Benchmarks/Olden/health/health: 17.11% (0.1672 => 0.1958, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.44% (1.3641 => 1.4383, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.38% (1.4080 => 1.4838, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.23% (1.4868 => 1.5645, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.22% (7.7103 => 8.1126, std.dev.: 0.0736) MultiSource/Applications/sqlite3/sqlite3: 4.75% (21.4585 => 22.4774, std.dev.: 0.3531) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.72% (1.4633 => 1.5323, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.56% (1.4446 => 1.5105, std.dev.: 0.0236) MultiSource/Applications/oggenc/oggenc: 4.34% (6.5799 => 6.8656, std.dev.: 0.0984) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 4.30% (1.3732 => 1.4323, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.95% (1.3864 => 1.4411, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash: 3.12% (0.4841 => 0.4992, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.97% (1.5159 => 1.5609, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.82% (1.3460 => 1.3839, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.35% (0.4688 => 0.4798, std.dev.: 0.0019) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 34.76% (0.0633 => 0.0853, std.dev.: 0.0070) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.77% (1.4889 => 1.9173, std.dev.: 0.1453) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.36% (0.3137 => 0.3713, std.dev.: 0.0212) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.97% (1.2531 => 1.4783, std.dev.: 0.0324) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.93% (13.1956 => 13.9777, std.dev.: 0.1849) MultiSource/Benchmarks/llubenchmark/llu: 5.42% (2.0284 => 2.1383, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 5.02% (1.2436 => 1.3060, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.97% (4.7355 => 4.8761, std.dev.: 0.0167) SingleSource/Benchmarks/Shootout/matrix: 2.89% (7.0133 => 7.2163, std.dev.: 0.0233) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/life/life: -36.52% (0.1854 => 0.1177, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -5.13% (1.5615 => 1.4814, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -9.53% (0.3262 => 0.2951, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -3.29% (1.9122 => 1.8492, std.dev.: 0.0165) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.55% (2.8038 => 2.7603, std.dev.: 0.0101) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.53% (1.4152 => 1.4510, std.dev.: 0.2046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0222 => 0.0224, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.92% (0.0436 => 0.0432, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0338 => 0.0335, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.49% (0.0321 => 0.0329, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.92% (0.0434 => 0.0430, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: -1.91% (0.0209 => 0.0205, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.95% (0.0253 => 0.0243, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 75.00% (0.0008 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.88% (0.1481 => 0.1494, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: 4.43% (1.1303 => 1.1804, std.dev.: 0.2457) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.44% (0.3968 => 0.4025, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.62% (0.1482 => 0.1458, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0653 => 0.0653, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.49% (0.0263 => 0.0217, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 6.81% (0.0529 => 0.0565, std.dev.: 0.0117) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.94% (1.2841 => 1.2962, std.dev.: 0.1934) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.76% (0.0608 => 0.0573, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.24% (0.0373 => 0.0346, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.04% (1.7447 => 1.7454, std.dev.: 0.0774) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 5.66% (0.0053 => 0.0056, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.67% (33.8912 => 34.4557, std.dev.: 0.1563) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 408.93% (0.0336 => 0.1710, std.dev.: 0.0025) SingleSource/Regression/C/sumarraymalloc: 137.20% (0.0293 => 0.0695, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 90.90% (0.1638 => 0.3127, std.dev.: 0.0027) SingleSource/Regression/C++/EH/function_try_block: 76.95% (0.0243 => 0.0430, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 76.81% (23.5861 => 41.7019, std.dev.: 0.9897) MultiSource/Benchmarks/McCat/04-bisect/bisect: 69.14% (0.1332 => 0.2253, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 64.49% (0.9091 => 1.4954, std.dev.: 0.0388) SingleSource/Benchmarks/McGill/exptree: 63.45% (0.0859 => 0.1404, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 62.79% (0.0688 => 0.1120, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/objinst: 61.67% (0.0480 => 0.0776, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 60.88% (0.8893 => 1.4307, std.dev.: 0.0208) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 60.43% (0.0374 => 0.0600, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 60.21% (0.8912 => 1.4278, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 59.94% (0.9010 => 1.4411, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 58.56% (0.9867 => 1.5645, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 58.41% (0.8736 => 1.3839, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 58.40% (0.8990 => 1.4240, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 57.99% (0.9588 => 1.5148, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 57.90% (0.8732 => 1.3788, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 57.67% (0.9488 => 1.4960, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 57.38% (0.9120 => 1.4353, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 57.12% (0.9061 => 1.4237, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 57.09% (0.8926 => 1.4022, std.dev.: 0.0117) MultiSource/Benchmarks/FreeBench/mason/mason: 57.00% (0.0793 => 0.1245, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 56.98% (0.9507 => 1.4924, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 56.67% (0.9855 => 1.5440, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 56.55% (0.9788 => 1.5323, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.45% (0.9612 => 1.5038, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 56.35% (0.8846 => 1.3831, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 55.58% (0.9564 => 1.4880, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 55.57% (1.0052 => 1.5638, std.dev.: 0.0246) MultiSource/Benchmarks/McCat/18-imp/imp: 54.90% (0.3807 => 0.5897, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 54.83% (0.9381 => 1.4525, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 54.73% (1.0088 => 1.5609, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 54.61% (0.9685 => 1.4974, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 54.39% (0.9512 => 1.4686, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/himenobmtxpa: 52.94% (0.1955 => 0.2990, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 52.78% (0.9422 => 1.4395, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 52.37% (0.9127 => 1.3907, std.dev.: 0.0834) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 52.21% (1.0119 => 1.5402, std.dev.: 0.0875) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 52.10% (0.9403 => 1.4302, std.dev.: 0.0314) SingleSource/UnitTests/2006-12-11-LoadConstants: 51.49% (0.1274 => 0.1930, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 51.48% (1.0860 => 1.6451, std.dev.: 0.0478) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 51.16% (0.9993 => 1.5105, std.dev.: 0.0236) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 51.14% (1.4110 => 2.1326, std.dev.: 0.2636) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 51.04% (1.0867 => 1.6413, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 50.61% (0.9550 => 1.4383, std.dev.: 0.0254) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 49.38% (3.6295 => 5.4219, std.dev.: 0.1534) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 48.19% (0.3702 => 0.5486, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 47.89% (1.0017 => 1.4814, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 47.15% (0.0492 => 0.0724, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/IntMM: 45.48% (0.0431 => 0.0627, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 45.01% (1.8651 => 2.7045, std.dev.: 0.1056) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 43.68% (2.4519 => 3.5228, std.dev.: 0.1175) SingleSource/Benchmarks/Shootout-C++/wordfreq: 42.21% (0.3374 => 0.4798, std.dev.: 0.0019) SingleSource/UnitTests/SignlessTypes/rem: 42.13% (0.1163 => 0.1653, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: 41.75% (0.3598 => 0.5100, std.dev.: 0.0371) MultiSource/Benchmarks/llubenchmark/llu: 41.13% (0.0547 => 0.0772, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 40.84% (0.1305 => 0.1838, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 40.34% (0.4762 => 0.6683, std.dev.: 0.0682) MultiSource/Benchmarks/mafft/pairlocalalign: 39.96% (9.5202 => 13.3248, std.dev.: 0.4926) MultiSource/Applications/SIBsim4/SIBsim4: 39.90% (1.4392 => 2.0135, std.dev.: 0.0839) SingleSource/Benchmarks/Shootout/matrix: 39.34% (0.0821 => 0.1144, std.dev.: 0.0018) SingleSource/Benchmarks/McGill/queens: 38.57% (0.0490 => 0.0679, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 37.76% (0.0805 => 0.1109, std.dev.: 0.0111) MultiSource/Applications/minisat/minisat: 37.65% (0.7776 => 1.0704, std.dev.: 0.0211) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 37.28% (0.0676 => 0.0928, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/mandel-2: 37.04% (0.0351 => 0.0481, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/distray/distray: 36.18% (0.1017 => 0.1385, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 36.10% (16.4479 => 22.3862, std.dev.: 0.5857) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 35.51% (0.0642 => 0.0870, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 35.06% (1.0986 => 1.4838, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 34.11% (0.0856 => 0.1148, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 34.10% (0.0783 => 0.1050, std.dev.: 0.0070) MultiSource/Applications/viterbi/viterbi: 34.05% (0.1824 => 0.2445, std.dev.: 0.0229) SingleSource/Regression/C/uint64_to_float: 32.76% (0.0409 => 0.0543, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 32.72% (0.0486 => 0.0645, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.65% (0.0733 => 0.0965, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 30.91% (0.3394 => 0.4443, std.dev.: 0.0257) MultiSource/Benchmarks/Prolangs-C++/life/life: 30.49% (0.0902 => 0.1177, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 30.16% (33.2440 => 43.2695, std.dev.: 0.6107) SingleSource/Benchmarks/Stanford/Queens: 29.13% (0.0436 => 0.0563, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: 28.29% (0.2566 => 0.3292, std.dev.: 0.0227) MultiSource/Applications/oggenc/oggenc: 28.20% (5.3553 => 6.8656, std.dev.: 0.0984) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.10% (0.1587 => 0.2033, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: 27.98% (17.5634 => 22.4774, std.dev.: 0.3531) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 27.95% (0.0762 => 0.0975, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/football/football: 27.91% (0.9759 => 1.2483, std.dev.: 0.0854) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 27.74% (0.1240 => 0.1584, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 27.60% (5.0381 => 6.4285, std.dev.: 0.2897) SingleSource/Benchmarks/Misc/richards_benchmark: 27.57% (0.0798 => 0.1018, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: 27.50% (0.0531 => 0.0677, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 27.45% (0.0889 => 0.1133, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 26.30% (6.4235 => 8.1126, std.dev.: 0.0736) SingleSource/Benchmarks/CoyoteBench/almabench: 25.99% (0.0754 => 0.0950, std.dev.: 0.0060) MultiSource/Benchmarks/nbench/nbench: 25.98% (1.2708 => 1.6010, std.dev.: 0.0807) MultiSource/Benchmarks/NPB-serial/is/is: 25.72% (0.0797 => 0.1002, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.63% (0.5369 => 0.6745, std.dev.: 0.0358) SingleSource/Benchmarks/Misc-C++/bigfib: 25.51% (0.6711 => 0.8423, std.dev.: 0.0140) MultiSource/Benchmarks/7zip/7zip-benchmark: 25.48% (44.1538 => 55.4043, std.dev.: 1.7025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.67% (0.7693 => 0.9591, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/mst/mst: 24.12% (0.1335 => 0.1657, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.77% (0.6135 => 0.7593, std.dev.: 0.0229) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.14% (0.0713 => 0.0878, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.04% (0.9214 => 1.1337, std.dev.: 0.0281) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.60% (4.8904 => 5.9957, std.dev.: 0.2129) MultiSource/Applications/lemon/lemon: 22.51% (1.3979 => 1.7126, std.dev.: 0.0619) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.44% (0.1716 => 0.2101, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: 22.21% (1.5979 => 1.9528, std.dev.: 0.0583) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 21.78% (0.2879 => 0.3506, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 21.62% (0.0976 => 0.1187, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/health/health: 21.61% (0.1610 => 0.1958, std.dev.: 0.0034) MultiSource/Applications/siod/siod: 21.56% (2.6437 => 3.2137, std.dev.: 0.2006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 21.54% (0.0469 => 0.0570, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 21.23% (16.7012 => 20.2476, std.dev.: 0.8369) SingleSource/Benchmarks/Misc/whetstone: 21.22% (0.0834 => 0.1011, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 21.03% (0.3277 => 0.3966, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.56% (0.0992 => 0.1196, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 20.56% (2.5772 => 3.1071, std.dev.: 0.0533) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.93% (0.0878 => 0.1053, std.dev.: 0.0032) MultiSource/Applications/d/make_dparser: 19.86% (3.7840 => 4.5354, std.dev.: 0.0520) SingleSource/Benchmarks/Dhrystone/fldry: 19.73% (0.0593 => 0.0710, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 19.69% (0.6885 => 0.8241, std.dev.: 0.0458) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.50% (4.6579 => 5.5660, std.dev.: 0.2486) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.27% (0.2372 => 0.2829, std.dev.: 0.0139) MultiSource/Applications/lua/lua: 19.22% (4.6406 => 5.5324, std.dev.: 0.3223) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.78% (14.9757 => 17.7884, std.dev.: 0.3667) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.74% (4.9104 => 5.8305, std.dev.: 0.1387) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 18.68% (0.0637 => 0.0756, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 17.97% (17.4365 => 20.5695, std.dev.: 0.5411) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 17.50% (0.0697 => 0.0819, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 17.47% (1.3310 => 1.5635, std.dev.: 0.0795) MultiSource/Applications/treecc/treecc: 17.33% (2.4719 => 2.9002, std.dev.: 0.1190) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.90% (0.0704 => 0.0823, std.dev.: 0.0023) MultiSource/Benchmarks/BitBench/five11/five11: 16.61% (0.0614 => 0.0716, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 16.48% (18.9377 => 22.0592, std.dev.: 0.6942) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.90% (0.2283 => 0.2646, std.dev.: 0.0123) MultiSource/Benchmarks/sim/sim: 15.64% (0.3715 => 0.4296, std.dev.: 0.0074) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.65% (0.1563 => 0.1792, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.65% (0.5059 => 0.5800, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.35% (0.1317 => 0.1506, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.35% (1.3924 => 1.5783, std.dev.: 0.0641) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.23% (0.3847 => 0.4356, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/reversefile: 13.04% (0.3665 => 0.4143, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.24% (0.1356 => 0.1522, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.96% (0.2791 => 0.3097, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.70% (1.5131 => 1.6598, std.dev.: 0.0366) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.28% (0.2253 => 0.2462, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/objinst: 9.21% (0.2150 => 0.2348, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/sieve: 8.99% (0.2913 => 0.3175, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/ary3: 8.58% (0.2564 => 0.2784, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.34% (1.3220 => 1.4323, std.dev.: 0.0161) SingleSource/Benchmarks/Misc-C++/Large/ray: 8.09% (0.3462 => 0.3742, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/strcat: 7.25% (0.2083 => 0.2234, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 6.86% (0.2172 => 0.2321, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/moments: 6.77% (0.4002 => 0.4273, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/hash: 6.46% (0.4689 => 0.4992, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/lists: 5.76% (0.2725 => 0.2882, std.dev.: 0.0051) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107450.00% (0.0008 => 0.8604, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout/ary3: 421.52% (2.2304 => 11.6319, std.dev.: 0.8763) SingleSource/Benchmarks/Shootout/matrix: 356.01% (1.5825 => 7.2163, std.dev.: 0.0233) MultiSource/Applications/sgefa/sgefa: 259.94% (0.3515 => 1.2652, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 233.34% (1.1825 => 3.9418, std.dev.: 0.0603) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.54% (4.8185 => 16.0234, std.dev.: 0.0613) SingleSource/Benchmarks/Shootout-C++/ary2: 221.71% (0.0129 => 0.0415, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 205.70% (0.0228 => 0.0697, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 141.81% (0.0232 => 0.0561, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/matrix: 62.21% (2.9083 => 4.7175, std.dev.: 0.1003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.96% (0.2562 => 0.3432, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.31% (3.1254 => 4.1041, std.dev.: 0.0217) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.76% (1.4588 => 1.8492, std.dev.: 0.0165) SingleSource/Regression/C/uint64_to_float: 24.23% (1.5397 => 1.9128, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.23% (5.6033 => 6.9048, std.dev.: 0.0699) SingleSource/Benchmarks/Misc/salsa20: 22.60% (7.4497 => 9.1336, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.81% (4.8112 => 5.8126, std.dev.: 0.0150) MultiSource/Applications/JM/lencod/lencod: 16.16% (6.8159 => 7.9173, std.dev.: 0.0906) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.56% (5.1752 => 5.8768, std.dev.: 0.0114) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.36% (9.0082 => 10.2114, std.dev.: 0.2603) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.02% (5.0033 => 5.6547, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (3.6477 => 3.9743, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/ReedSolomon: 8.32% (8.6447 => 9.3639, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.09% (4.7473 => 5.0841, std.dev.: 0.0316) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.48% (4.1836 => 4.4130, std.dev.: 0.0042) MultiSource/Benchmarks/llubenchmark/llu: 5.35% (2.0298 => 2.1383, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.05% (5.0310 => 5.2349, std.dev.: 0.0554) SingleSource/Benchmarks/Misc/pi: 3.66% (2.1390 => 2.2173, std.dev.: 0.0030) SingleSource/Benchmarks/Linpack/linpack-pc: 3.53% (50.8945 => 52.6925, std.dev.: 0.2074) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.19% (4.7254 => 4.8761, std.dev.: 0.0167) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.78% (11.5523 => 3.9536, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -61.83% (15.6525 => 5.9741, std.dev.: 0.0444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.08% (0.4146 => 0.1821, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.12% (0.4578 => 0.2375, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.92% (11.3868 => 6.3861, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.97% (5.4023 => 3.6214, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.15% (0.4452 => 0.3065, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.57% (0.5495 => 0.4035, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.08% (5.2605 => 3.8886, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.90% (4.4467 => 3.3394, std.dev.: 0.0281) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.79% (0.5826 => 0.4382, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.49% (0.5897 => 0.4512, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.12% (4.9921 => 3.8381, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary3: -18.97% (1.8123 => 1.4685, std.dev.: 0.1334) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.15% (5.8755 => 4.8089, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.20% (16.6791 => 13.9777, std.dev.: 0.1849) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.46% (7.0016 => 5.9191, std.dev.: 0.1309) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.12% (3.1921 => 2.7733, std.dev.: 0.0060) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.06% (0.1164 => 0.1012, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.74% (5.3626 => 4.6795, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.50% (9.7992 => 8.5745, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.49% (5.7056 => 4.9930, std.dev.: 0.0725) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.27% (0.3217 => 0.2951, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.86% (4.2843 => 3.9902, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.38% (5.5974 => 5.2404, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.73% (4.5424 => 4.2822, std.dev.: 0.0533) MultiSource/Benchmarks/mafft/pairlocalalign: -5.59% (63.1520 => 59.6211, std.dev.: 0.1317) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.87% (4.9799 => 4.7372, std.dev.: 0.0388) SingleSource/Benchmarks/Shootout-C++/hash2: -4.41% (3.6768 => 3.5146, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.27% (3.5127 => 3.3626, std.dev.: 0.0192) SingleSource/Benchmarks/Misc/ffbench: -4.01% (1.4244 => 1.3673, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.61% (3.5691 => 3.4401, std.dev.: 0.0177) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.38% (23.3986 => 22.6080, std.dev.: 0.1949) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.37% (3.7662 => 3.6392, std.dev.: 0.0429) SingleSource/Benchmarks/Shootout-C++/lists: -3.00% (17.2182 => 16.7015, std.dev.: 0.0851) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.59% (8.7327 => 8.5940, std.dev.: 0.0124) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.50% (85.3042 => 84.0287, std.dev.: 0.0288) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (3.7450 => 3.7014, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.05% (6.8262 => 6.7545, std.dev.: 0.0128) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 20.44% (1.2047 => 1.4510, std.dev.: 0.2046) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.97% (0.0394 => 0.0335, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.30% (0.0328 => 0.0329, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0073) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0029) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.71% (0.0255 => 0.0243, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.35% (0.1530 => 0.1494, std.dev.: 0.0017) MultiSource/Applications/lemon/lemon: -38.82% (1.9293 => 1.1804, std.dev.: 0.2457) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.59% (0.4049 => 0.4025, std.dev.: 0.0204) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.44% (0.1510 => 0.1458, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.23% (0.0978 => 0.0653, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -21.38% (0.0276 => 0.0217, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.24% (0.0590 => 0.0565, std.dev.: 0.0117) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.58% (1.1617 => 1.2962, std.dev.: 0.1934) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.07% (0.0610 => 0.0573, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.10% (0.0268 => 0.0346, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.69% (0.7437 => 1.7454, std.dev.: 0.0774) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.13% (0.0092 => 0.0056, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.65% (12.7781 => 34.4557, std.dev.: 0.1563) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 13:30:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 15:30:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130128213037.A33EA2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8050?compare_to=8046&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8050, Order: 173705, Start Time: 2013-01-28 19:11:16, End Time: 2013-01-28 21:30:54 To: 8046, Order: 173690, Start Time: 2013-01-28 16:20:41, End Time: 2013-01-28 18:40:22 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (273 on baseline) Performance Improvements: 3 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (597 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 6.99% (0.6277 => 0.6716, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.25% (130.6241 => 128.9866, std.dev.: 0.0252) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.70% (4.4042 => 4.2413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.19% (3.1977 => 3.1276, std.dev.: 0.0177) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1330 => 0.1333, std.dev.: 0.0020) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (0.0674 => 0.0684, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8553 => 499.8197, std.dev.: 0.0141) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44222.04% (1.1277 => 499.8197, std.dev.: 0.0141) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 267.74% (0.5229 => 1.9229, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 44.37% (14.9895 => 21.6403, std.dev.: 0.0170) MultiSource/Applications/kimwitu++/kc: 62.41% (14.1553 => 22.9895, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/gs/gs: 30.13% (4.1105 => 5.3491, std.dev.: 0.0119) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 89.97% (1.1048 => 2.0988, std.dev.: 0.0077) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1701.94% (7.1582 => 128.9866, std.dev.: 0.0252) SingleSource/Benchmarks/Misc-C++-EH/spirit: 127.06% (3.4629 => 7.8628, std.dev.: 0.0198) SingleSource/Benchmarks/Misc-C++/stepanov_container: 99.74% (0.6222 => 1.2428, std.dev.: 0.0018) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10265.69% (0.0720 => 7.4633, std.dev.: 0.0114) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11152100.00% (0.0001 => 11.1522, std.dev.: 0.0246) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9847100.00% (0.0001 => 9.8472, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483100.00% (0.0001 => 5.4832, std.dev.: 0.0029) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.77% (1.1194 => 10.2623, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 177.79% (0.1432 => 0.3978, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/factor: 171.62% (0.0296 => 0.0804, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 156.05% (22.1758 => 56.7819, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/lowercase: 140.62% (0.0256 => 0.0616, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 132.67% (0.1056 => 0.2457, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 112.35% (0.0243 => 0.0516, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.84% (0.0929 => 0.1903, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 101.64% (7.0540 => 14.2238, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/objinst: 98.13% (0.0427 => 0.0846, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 88.79% (0.1463 => 0.2762, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/almabench: 86.71% (0.0730 => 0.1363, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 79.32% (0.0237 => 0.0425, std.dev.: 0.0012) SingleSource/Regression/C/casts: 77.36% (0.0318 => 0.0564, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 76.98% (0.2554 => 0.4520, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 75.86% (0.0377 => 0.0663, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 74.72% (1.5859 => 2.7709, std.dev.: 0.0014) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 71.53% (0.0439 => 0.0753, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 65.99% (0.0394 => 0.0654, std.dev.: 0.0017) SingleSource/UnitTests/Vector/simple: 64.32% (0.0185 => 0.0304, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 63.48% (2.2024 => 3.6005, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.75% (2.9384 => 4.7823, std.dev.: 0.0193) SingleSource/Regression/C++/EH/function_try_block: 62.31% (0.0268 => 0.0435, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 60.59% (8.1363 => 13.0659, std.dev.: 0.0319) SingleSource/Regression/C/sumarray: 59.31% (0.0231 => 0.0368, std.dev.: 0.0010) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 58.53% (0.0217 => 0.0344, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 58.44% (0.1143 => 0.1811, std.dev.: 0.0001) SingleSource/UnitTests/2002-05-02-CastTest: 57.80% (0.0218 => 0.0344, std.dev.: 0.0000) SingleSource/Regression/C/testtrace: 56.60% (0.0212 => 0.0332, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-31-CastToBool: 56.44% (0.0202 => 0.0316, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 56.41% (1.5415 => 2.4111, std.dev.: 0.0037) SingleSource/Benchmarks/Stanford/Oscar: 55.97% (0.0636 => 0.0992, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 55.58% (0.3109 => 0.4837, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 54.74% (0.0232 => 0.0359) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.36% (0.0953 => 0.1452, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 52.28% (1.1642 => 1.7729, std.dev.: 0.0053) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 50.58% (0.1125 => 0.1694, std.dev.: 0.0026) MultiSource/Applications/JM/lencod/lencod: 50.02% (21.9371 => 32.9092, std.dev.: 0.0300) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.21% (0.6675 => 0.9960, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 49.15% (0.1062 => 0.1584, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.17% (0.0793 => 0.1175, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 47.33% (0.2700 => 0.3978, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 47.23% (3.8922 => 5.7304, std.dev.: 0.0054) MultiSource/Benchmarks/MallocBench/espresso/espresso: 46.94% (4.2646 => 6.2664, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/exptree: 46.68% (0.0814 => 0.1194, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 46.25% (1.0722 => 1.5681, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-09-SignedArgs: 45.39% (0.0282 => 0.0410, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 45.33% (0.7115 => 1.0340, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/15-trie/trie: 45.16% (0.0527 => 0.0765, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 44.68% (0.0564 => 0.0816, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 44.47% (0.0479 => 0.0692, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 44.31% (0.1555 => 0.2244, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 44.25% (0.0730 => 0.1053, std.dev.: 0.0001) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 43.54% (0.0457 => 0.0656, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/div: 43.02% (0.0258 => 0.0369) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 42.81% (0.0640 => 0.0914, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.34% (0.4615 => 0.6569, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/shr: 42.06% (0.0252 => 0.0358, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 42.00% (0.5105 => 0.7249, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 41.97% (0.0467 => 0.0663) SingleSource/UnitTests/block-copied-in-cxxobj: 41.94% (0.0310 => 0.0440, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/partialsums: 41.63% (0.0245 => 0.0347, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.39% (0.2271 => 0.3211, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/messages-2: 41.39% (0.0662 => 0.0936, std.dev.: 0.0007) MultiSource/Applications/siod/siod: 41.39% (2.2969 => 3.2475, std.dev.: 0.0116) MultiSource/Benchmarks/mafft/pairlocalalign: 41.32% (9.4845 => 13.4037, std.dev.: 0.0171) SingleSource/Benchmarks/Shootout/matrix: 41.32% (0.0818 => 0.1156, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 41.24% (0.3092 => 0.4367, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 41.17% (0.1892 => 0.2671, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 40.62% (0.0746 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 40.48% (0.0462 => 0.0649, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 40.34% (0.1175 => 0.1649, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 40.04% (0.6456 => 0.9041, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.03% (0.0672 => 0.0941, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 39.76% (0.1655 => 0.2313, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 39.71% (0.1695 => 0.2368, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.15% (0.5860 => 0.8154, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 38.70% (0.1044 => 0.1448, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 38.38% (0.4299 => 0.5949, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 38.25% (0.0719 => 0.0994, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.04% (0.0397 => 0.0548, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 37.94% (0.0485 => 0.0669, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 37.74% (0.3121 => 0.4299, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 37.65% (2.0273 => 2.7905, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 37.48% (3.8723 => 5.3236, std.dev.: 0.0110) SingleSource/UnitTests/Vector/build2: 37.29% (0.0295 => 0.0405, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.27% (1.4186 => 1.9473, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.23% (0.3441 => 0.4722, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.19% (0.0675 => 0.0926, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 37.14% (0.7835 => 1.0745, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 37.11% (0.1032 => 0.1415, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 36.90% (0.0626 => 0.0857) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 36.88% (0.0770 => 0.1054, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 36.69% (3.3354 => 4.5591, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.69% (0.5569 => 0.7612, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/em3d/em3d: 36.52% (0.1695 => 0.2314, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 36.41% (5.7591 => 7.8561, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.11% (0.3307 => 0.4501, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 35.99% (63.2438 => 86.0049, std.dev.: 0.0196) MultiSource/Benchmarks/nbench/nbench: 35.82% (1.1840 => 1.6081, std.dev.: 0.0017) MultiSource/Applications/sqlite3/sqlite3: 35.62% (17.1811 => 23.3002, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/whetstone: 35.45% (0.0660 => 0.0894, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 35.34% (0.3427 => 0.4638, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/loader/loader: 35.28% (0.2758 => 0.3731, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/messages: 35.17% (0.0327 => 0.0442, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 35.02% (0.1268 => 0.1712, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 34.93% (0.1151 => 0.1553, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 34.74% (0.3423 => 0.4612, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 34.65% (0.4620 => 0.6221, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 34.58% (0.4289 => 0.5772, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Queens: 34.54% (0.0414 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.45% (0.0447 => 0.0601, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.41% (0.0933 => 0.1254, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.25% (0.4879 => 0.6550, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.10% (0.0437 => 0.0586, std.dev.: 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: 33.86% (0.0316 => 0.0423, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: 33.66% (0.0811 => 0.1084, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.65% (0.1584 => 0.2117, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/queens: 33.50% (0.0403 => 0.0538, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.27% (1.1861 => 1.5807, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.25% (0.0842 => 0.1122, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.08% (0.2107 => 0.2804, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 32.93% (0.1163 => 0.1546, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.63% (0.1566 => 0.2077, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 32.52% (0.0326 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 32.51% (0.0886 => 0.1174, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 32.07% (0.7433 => 0.9817, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.82% (0.0770 => 0.1015, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.82% (0.0528 => 0.0696, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.80% (0.1236 => 0.1629, std.dev.: 0.0001) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 31.62% (0.0389 => 0.0512, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: 31.60% (0.0614 => 0.0808, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fbench: 31.25% (0.0592 => 0.0777, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 31.08% (1.3050 => 1.7106, std.dev.: 0.0135) MultiSource/Benchmarks/sim/sim: 30.91% (0.3387 => 0.4434, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.75% (0.8172 => 1.0685, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.61% (0.1029 => 0.1344, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.50% (0.0482 => 0.0629) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.39% (0.0408 => 0.0532, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.36% (0.1940 => 0.2529, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.31% (0.5981 => 0.7794, std.dev.: 0.0093) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.07% (0.1510 => 0.1964, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.06% (0.1906 => 0.2479, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 29.74% (0.6450 => 0.8368, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.65% (0.8067 => 1.0459, std.dev.: 0.0141) SingleSource/UnitTests/ObjC/dot-syntax: 29.58% (0.0355 => 0.0460, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 29.54% (0.8921 => 1.1556, std.dev.: 0.0070) MultiSource/Benchmarks/McCat/09-vor/vor: 29.21% (0.3180 => 0.4109, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 29.16% (0.9765 => 1.2612, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.95% (0.1337 => 0.1724, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Towers: 28.87% (0.0471 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.85% (0.0416 => 0.0536, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.80% (4.9449 => 6.3691, std.dev.: 0.0136) SingleSource/Benchmarks/McGill/misr: 28.75% (0.0633 => 0.0815, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.70% (0.0871 => 0.1121, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 28.58% (0.1144 => 0.1471, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.51% (0.5020 => 0.6451, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.08% (0.2603 => 0.3334, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/five11/five11: 28.04% (0.0567 => 0.0726, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.93% (0.1117 => 0.1429, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.91% (5.0018 => 6.3976, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: 27.71% (1.5603 => 1.9926, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Treesort: 27.49% (0.0411 => 0.0524, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.31% (0.8101 => 1.0313, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/matrix: 26.99% (0.3098 => 0.3934, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.52% (0.2266 => 0.2867, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 26.38% (0.0834 => 0.1054, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.28% (0.3177 => 0.4012, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.12% (0.4203 => 0.5301, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 25.54% (0.1625 => 0.2040, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.30% (0.3865 => 0.4843, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.06% (0.0443 => 0.0554, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: 24.78% (0.0456 => 0.0569, std.dev.: 0.0010) SingleSource/Regression/C/bigstack: 24.46% (0.0417 => 0.0519, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 23.91% (0.4103 => 0.5084, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.81% (0.0798 => 0.0988, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.30% (0.0648 => 0.0799, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 23.19% (0.1440 => 0.1774, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.17% (0.0479 => 0.0590, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 23.01% (0.0491 => 0.0604, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 22.66% (0.0481 => 0.0590, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.02% (0.0704 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.41% (14.3668 => 17.4430, std.dev.: 0.0134) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.36% (0.1114 => 0.1352, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.23% (0.4636 => 0.5620, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: 20.90% (0.0536 => 0.0648, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.79% (0.4064 => 0.4909, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.53% (0.2065 => 0.2489, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ReedSolomon: 20.45% (0.2049 => 0.2468, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 20.16% (0.3283 => 0.3945, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 19.89% (0.3232 => 0.3875, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 19.59% (0.3282 => 0.3925, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.55% (0.2430 => 0.2905, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.45% (0.0838 => 0.1001, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 19.44% (0.3379 => 0.4036, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.37% (0.0759 => 0.0906, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 19.10% (0.4048 => 0.4821, std.dev.: 0.0005) SingleSource/UnitTests/initp1: 18.74% (0.0555 => 0.0659, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.64% (0.3826 => 0.4539, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.15% (0.1438 => 0.1699, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 17.93% (0.3603 => 0.4249, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 17.35% (0.3684 => 0.4323, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 16.92% (0.3422 => 0.4001, std.dev.: 0.0015) SingleSource/Regression/C++/ofstream_ctor: 16.73% (0.2905 => 0.3391, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 15.75% (0.3886 => 0.4498, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.71% (0.3935 => 0.4553, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.62% (0.3650 => 0.4220, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ffbench: 15.32% (0.0705 => 0.0813, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.19% (2.2022 => 2.5368, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Puzzle: 14.83% (0.1268 => 0.1456, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.68% (0.1330 => 0.1512, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 13.63% (1.2842 => 1.4593, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/parameter-passing: 13.24% (0.3927 => 0.4447, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.90% (0.3162 => 0.3570, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 12.68% (0.2831 => 0.3190, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/except: 12.02% (0.2871 => 0.3216, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 11.99% (10.3673 => 11.6106, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/exceptions: 11.86% (0.3828 => 0.4282, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.67% (0.3136 => 0.3502, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.58% (2.0665 => 2.3058, std.dev.: 0.0021) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.43% (7.9617 => 8.8721, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: 11.40% (0.2877 => 0.3205, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.52% (0.2756 => 0.3046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.07% (0.2891 => 0.3182, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.06% (0.2725 => 0.2999, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 9.94% (0.7326 => 0.8054, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.88% (0.2793 => 0.3069, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.88% (0.3543 => 0.3893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.87% (0.2714 => 0.2982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 9.75% (0.3694 => 0.4054, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 9.73% (0.3052 => 0.3349, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.56% (0.2802 => 0.3070, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.47% (0.6030 => 0.6601, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 9.46% (0.3561 => 0.3898, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.40% (0.2872 => 0.3142, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 9.34% (0.3543 => 0.3874, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions-3: 9.19% (0.3516 => 0.3839, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 9.16% (0.3473 => 0.3791, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 9.15% (0.3497 => 0.3817, std.dev.: 0.0082) SingleSource/UnitTests/ObjC++/Hello: 8.10% (0.5925 => 0.6405, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.03% (0.3131 => 0.3351, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4767, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.17% (1.1145 => 1.2947, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 13.10% (0.5413 => 0.6122, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.92% (2.8904 => 3.1483, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4262, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (4.2280 => 4.4652, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.48% (2.0360 => 2.1068, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.28% (0.9957 => 1.0284, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.75% (8.6802 => 8.9185, std.dev.: 0.0150) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.26% (3.6395 => 3.7218, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.79% (0.8333 => 0.8482, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2779, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0943, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2408, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.06% (6.5088 => 6.5780, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4528, std.dev.: 0.0265) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.81% (6.6874 => 0.2136, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.50% (5.2763 => 1.2925, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.08% (0.8651 => 0.2156, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -35.70% (0.1622 => 0.1043, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.69% (5.3855 => 4.9173, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.97% (5.3526 => 4.9259, std.dev.: 0.0048) SingleSource/UnitTests/Vector/constpool: -7.80% (54.1659 => 49.9424, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -4.79% (10.4361 => 9.9364, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.61% (1.7609 => 1.6974, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.69% (1.9577 => 0.6716, std.dev.: 0.0063) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3064, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0205, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4372, std.dev.: 0.0082) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8533, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0045, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.79% (1.2258 => 0.9587, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.99% (0.2161 => 0.1729, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7337, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.81% (0.9540 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.23% (9.5636 => 8.4900, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.81% (1.8329 => 1.7080, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.50% (19.9488 => 18.6520, std.dev.: 0.0523) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5796, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2373 => 1.1651, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.52% (8.1563 => 7.7062, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.92% (1.5835 => 1.5056, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.83% (0.4808 => 0.4576, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -4.53% (10.2830 => 9.8171, std.dev.: 0.0126) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -1.53% (3.6994 => 3.6428, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/ary3: -1.31% (3.7221 => 3.6735, std.dev.: 0.0073) MultiSource/Applications/sqlite3/sqlite3: -1.26% (4.6441 => 4.5855, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2338, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0067) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.67% (0.2116 => 0.0684, std.dev.: 0.0020) Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 14:11:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 16:11:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130128221119.9420C2A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8051?compare_to=8048&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8051, Order: 173712, Start Time: 2013-01-28 20:35:01, End Time: 2013-01-28 22:11:39 To: 8048, Order: 173703, Start Time: 2013-01-28 18:34:32, End Time: 2013-01-28 20:11:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (219 on baseline) Performance Improvements: 2 (73 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (800 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.47% (20.4179 => 19.9127, std.dev.: 0.0167) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.10% (34.0430 => 33.6698, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 131.43% (0.0315 => 0.0729) SingleSource/Benchmarks/Misc/lowercase: 92.86% (0.0280 => 0.0540, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 86.19% (0.0717 => 0.1335, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 82.30% (0.0514 => 0.0937, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 72.69% (0.0974 => 0.1682, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 63.87% (0.1132 => 0.1855, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 59.73% (0.1500 => 0.2396, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 50.27% (22.4056 => 33.6698, std.dev.: 0.0059) SingleSource/Regression/C/sumarraymalloc: 48.69% (0.0267 => 0.0397, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 47.75% (0.0599 => 0.0885, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 47.54% (0.6395 => 0.9435, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 46.29% (0.6395 => 0.9355, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 46.13% (1.6474 => 2.4074, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 43.94% (0.0371 => 0.0534, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/objinst: 42.01% (0.0407 => 0.0578) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 41.70% (0.6230 => 0.8828, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 41.63% (0.0418 => 0.0592, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.51% (0.5688 => 0.8049, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.50% (0.6260 => 0.8858, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 41.20% (0.0699 => 0.0987, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.15% (0.5805 => 0.8194, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.07% (0.5456 => 0.7697, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 40.74% (0.5849 => 0.8232, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.22% (0.5567 => 0.7806, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 40.16% (0.5575 => 0.7814, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.14% (0.5802 => 0.8131, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 39.91% (0.5705 => 0.7982, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 39.87% (0.5581 => 0.7806, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 39.30% (0.5857 => 0.8159, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 39.27% (0.5569 => 0.7756, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.27% (0.5941 => 0.8274, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 39.21% (0.5478 => 0.7626, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 39.03% (0.5570 => 0.7744, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.71% (0.5859 => 0.8127, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 38.63% (0.5591 => 0.7751, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 38.59% (0.6033 => 0.8361, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 38.26% (2.2587 => 3.1229, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 38.20% (0.6440 => 0.8900, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 38.18% (0.5925 => 0.8187, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 37.51% (0.5863 => 0.8062, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.30% (0.0445 => 0.0611, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 37.16% (0.6189 => 0.8489, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.15% (0.6676 => 0.9156, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.01% (0.6052 => 0.8292, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 36.95% (0.6446 => 0.8828, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 36.86% (0.0293 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 36.36% (0.6304 => 0.8596, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 36.25% (0.0582 => 0.0793, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 36.21% (0.6681 => 0.9100, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 36.00% (0.6194 => 0.8424, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.53% (0.6660 => 0.9026, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 35.37% (0.6297 => 0.8524, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.36% (0.6667 => 0.8958, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 34.24% (0.0622 => 0.0835, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 33.35% (1.1450 => 1.5269, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.93% (0.1230 => 0.1635, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 32.79% (0.7524 => 0.9991, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 32.78% (0.0790 => 0.1049, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 32.76% (0.2659 => 0.3530, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.35% (0.7339 => 0.9713, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 31.02% (0.0693 => 0.0908, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.76% (0.0621 => 0.0812, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 30.58% (0.0556 => 0.0726, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.16% (1.6364 => 2.1299, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 29.86% (0.0566 => 0.0735, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 28.93% (0.0833 => 0.1074, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 28.38% (0.0680 => 0.0873, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 28.23% (0.0634 => 0.0813, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.99% (3.5339 => 4.5232, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 26.65% (1.2784 => 1.6191, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 26.36% (5.4682 => 6.9098, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.06% (0.1796 => 0.2264, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 26.01% (0.3357 => 0.4230, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 25.39% (0.1146 => 0.1437) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 25.32% (0.0707 => 0.0886, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 25.19% (1.2515 => 1.5668, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 25.01% (0.7021 => 0.8777, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.71% (0.0731 => 0.0897, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 22.69% (0.0864 => 0.1060, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.57% (0.1081 => 0.1325, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 22.56% (0.0665 => 0.0815, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.36% (4.5069 => 5.5145, std.dev.: 0.0090) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 21.96% (0.0806 => 0.0983, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 21.43% (0.1731 => 0.2102, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/mason/mason: 21.42% (0.0621 => 0.0754, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 21.18% (15.5079 => 18.7928, std.dev.: 0.0100) MultiSource/Benchmarks/mafft/pairlocalalign: 20.60% (9.2283 => 11.1296, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 20.53% (0.1982 => 0.2389, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.90% (0.0764 => 0.0916, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 19.79% (0.0571 => 0.0684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 19.58% (0.0526 => 0.0629) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.57% (0.4916 => 0.5878, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 19.47% (0.6750 => 0.8064, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.44% (0.0885 => 0.1057, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.38% (0.5329 => 0.6362, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 18.87% (0.0604 => 0.0718) MultiSource/Applications/minisat/minisat: 18.81% (0.7447 => 0.8848, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 18.60% (0.4515 => 0.5355, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 18.53% (0.2985 => 0.3538, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: 18.50% (0.0919 => 0.1089, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 18.32% (0.2385 => 0.2822, std.dev.: 0.0014) MultiSource/Applications/siod/siod: 18.26% (2.4021 => 2.8407, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.15% (0.0617 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.15% (0.3483 => 0.4115, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 17.70% (1.3864 => 1.6318, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.39% (0.0598 => 0.0702, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.13% (1.4642 => 1.7150, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 16.91% (17.1032 => 19.9945, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.70% (0.1509 => 0.1761, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 16.34% (0.0710 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 16.17% (0.2548 => 0.2960, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 16.05% (0.0704 => 0.0817) MultiSource/Applications/viterbi/viterbi: 16.01% (0.1674 => 0.1942, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 15.95% (2.1401 => 2.4815, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 15.84% (0.3491 => 0.4044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 15.72% (0.4861 => 0.5625, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.69% (0.4524 => 0.5234, std.dev.: 0.0014) MultiSource/Applications/oggenc/oggenc: 15.63% (5.0226 => 5.8076, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.60% (0.1077 => 0.1245, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 15.59% (0.6293 => 0.7274, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.33% (0.9557 => 1.1022, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 15.31% (0.0686 => 0.0791, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.24% (0.1096 => 0.1263, std.dev.: 0.0017) MultiSource/Applications/lua/lua: 15.23% (4.0594 => 4.6778, std.dev.: 0.0036) MultiSource/Benchmarks/Bullet/bullet: 15.20% (34.0927 => 39.2741, std.dev.: 0.0176) MultiSource/Benchmarks/NPB-serial/is/is: 14.97% (0.0708 => 0.0814) SingleSource/Benchmarks/McGill/chomp: 14.93% (0.1761 => 0.2024, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 14.84% (0.8418 => 0.9667, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 14.77% (1.1530 => 1.3233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 14.55% (0.0797 => 0.0913, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 14.54% (3.5154 => 4.0265, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/17-bintr/bintr: 14.17% (0.0741 => 0.0846, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.09% (0.5999 => 0.6784, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 12.99% (1.2300 => 1.3898, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 12.85% (0.3658 => 0.4128, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 12.62% (0.3319 => 0.3738, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 12.34% (18.2933 => 20.5516, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/18-imp/imp: 12.20% (0.3581 => 0.4018, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.19% (0.2001 => 0.2245, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.17% (0.1290 => 0.1447, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.88% (0.1145 => 0.1281, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.86% (0.0919 => 0.1028, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 11.71% (0.1862 => 0.2080, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 11.56% (15.2527 => 17.0160, std.dev.: 0.0090) SingleSource/UnitTests/SignlessTypes/rem: 11.53% (0.1197 => 0.1335, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 11.17% (0.2999 => 0.3334, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 11.16% (0.0932 => 0.1036, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.99% (0.0974 => 0.1081, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.91% (0.1173 => 0.1301, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.82% (4.0323 => 4.4686, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/power/power: 10.75% (0.1154 => 0.1278, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 10.49% (0.2278 => 0.2517, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 10.41% (0.3255 => 0.3594, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.41% (0.1076 => 0.1188, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.38% (0.1108 => 0.1223, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 9.91% (0.9179 => 1.0089, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/tsp/tsp: 9.90% (0.1202 => 0.1321, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.83% (0.5168 => 0.5676, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 9.76% (0.1271 => 0.1395, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 9.66% (0.7982 => 0.8753, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 9.59% (0.2106 => 0.2308, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 9.56% (0.6736 => 0.7380, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 9.45% (0.3271 => 0.3580, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 9.40% (1.5610 => 1.7077, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.35% (1.3722 => 1.5005, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.33% (0.4427 => 0.4840, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 9.29% (0.7919 => 0.8655, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 9.25% (0.1621 => 0.1771, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 9.10% (0.1879 => 0.2050, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.57% (0.7198 => 0.7815, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.05% (0.1441 => 0.1557, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.89% (0.3142 => 0.3390, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.84% (0.4083 => 0.4403, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 7.62% (0.8521 => 0.9170, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.57% (0.9077 => 0.9764, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 7.50% (7.0961 => 7.6284, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 7.46% (4.3330 => 4.6562, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.46% (4.8161 => 5.1752, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: 7.41% (16.1920 => 17.3912, std.dev.: 0.0210) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.38% (0.2695 => 0.2894, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.27% (4.8802 => 5.2349, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.91% (1.0544 => 1.1273, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.83% (0.6484 => 0.6927, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.79% (8.0126 => 8.5564, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 6.75% (2.4924 => 2.6606, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.45% (6.7716 => 7.2085, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.36% (0.4321 => 0.4596, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.02% (14.2083 => 15.0631, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.3446 => 0.3641, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.49% (1.2221 => 1.2892, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.46% (1.2210 => 1.2877, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 5.36% (0.3394 => 0.3576, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.33% (0.3849 => 0.4054, std.dev.: 0.0008) MultiSource/Benchmarks/sim/sim: 5.02% (0.3406 => 0.3577, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.93% (0.2355 => 0.2471, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.92% (0.9852 => 1.0337, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.84% (0.4151 => 0.4352, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 4.84% (0.4813 => 0.5046, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 4.03% (0.4248 => 0.4419, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 3.94% (0.3481 => 0.3618, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 3.43% (0.3931 => 0.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 3.33% (0.3788 => 0.3914, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 2.95% (0.3867 => 0.3981, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.96% (0.9542 => 0.9729, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8189, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.62% (0.9531 => 1.0353, std.dev.: 0.0021) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0076) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5048, std.dev.: 0.1378) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.74% (2.0478 => 2.1039, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6043, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5130, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2489, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2689, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.15% (0.3831 => 0.3672, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -4.15% (20.7746 => 19.9127, std.dev.: 0.0167) SingleSource/UnitTests/ObjC/exceptions-4: -4.10% (0.3880 => 0.3721, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.08% (0.3896 => 0.3737, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.00% (0.3848 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.99% (0.3884 => 0.3729, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -3.77% (0.4033 => 0.3881, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.73% (0.3891 => 0.3746, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -3.28% (0.6347 => 0.6139, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.48% (0.6441 => 0.6281, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: -1.71% (0.7779 => 0.7646, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.28% (2.1713 => 2.1436, std.dev.: 0.0004) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.35% (1.8100 => 0.6995, std.dev.: 0.0205) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3115, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.67% (1.3643 => 1.0277, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0756, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.91% (4.1024 => 3.2036, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.30% (1.0217 => 0.8449, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1297, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.25% (4.9100 => 4.3578, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.72% (2.2633 => 2.1790, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.39% (1.0557 => 1.0199, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.37% (1.3096 => 1.2655, std.dev.: 0.0140) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2761, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (7.9763 => 7.7815, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.83% (7.3040 => 7.1700, std.dev.: 0.0170) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.70% (1.6307 => 1.6030, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.29% (3.7092 => 3.6612, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.17s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 15:37:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 17:37:34 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130128233734.987892A6C06B@llvm.org> http://llvm.org/perf/db_default/v4/nts/8052?compare_to=8049&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8052, Order: 173716, Start Time: 2013-01-28 21:26:21, End Time: 2013-01-28 23:37:56 To: 8049, Order: 173703, Start Time: 2013-01-28 18:54:42, End Time: 2013-01-28 21:07:08 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (177 on baseline) Performance Improvements: 10 (36 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1047 (850 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.21% (2.6110 => 2.7471, std.dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 3.42% (6.8656 => 7.1005, std.dev.: 0.0748) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.31% (1.0680 => 1.0927, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 51.53% (0.1566 => 0.2373, std.dev.: 0.0194) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 3.28% (3.9418 => 4.0712, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 2.70% (3.5417 => 3.6374, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.96% (3.6392 => 3.7107, std.dev.: 0.0245) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -35.02% (0.0928 => 0.0603, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -26.67% (0.0600 => 0.0440, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: -10.48% (2.0135 => 1.8024, std.dev.: 0.0428) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -8.73% (0.1283 => 0.1171, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.68% (1.4960 => 1.3961, std.dev.: 0.0359) MultiSource/Applications/minisat/minisat: -4.10% (1.0704 => 1.0265, std.dev.: 0.0163) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/hash: -7.70% (0.6677 => 0.6163, std.dev.: 0.0116) MultiSource/Applications/SIBsim4/SIBsim4: -2.98% (3.3707 => 3.2702, std.dev.: 0.0387) SingleSource/Benchmarks/McGill/misr: -2.72% (0.4924 => 0.4790, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/queens: -1.46% (1.6744 => 1.6500, std.dev.: 0.0014) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.41% (1.4510 => 1.4860, std.dev.: 0.0336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.80% (0.0224 => 0.0211, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0432 => 0.0432, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.90% (0.0335 => 0.0338, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0329 => 0.0322, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0430 => 0.0432, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 1.46% (0.0205 => 0.0208, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0221 => 0.0221, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.29% (0.0243 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.27% (0.1494 => 0.1475, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: 0.91% (1.1804 => 1.1911, std.dev.: 0.2277) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.44% (0.4025 => 0.4244, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.64% (0.1458 => 0.1405, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0653 => 0.0653, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.65% (0.0217 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 8.14% (0.0565 => 0.0611, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.18% (1.2962 => 1.2985, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.98% (0.0573 => 0.0613, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -11.85% (0.0346 => 0.0305, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.80% (1.7454 => 1.7593, std.dev.: 0.0266) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -33.93% (0.0056 => 0.0037, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.74% (34.4557 => 34.2012, std.dev.: 0.2137) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 415.77% (0.0336 => 0.1733, std.dev.: 0.0013) SingleSource/Regression/C/sumarray2d: 106.20% (0.0274 => 0.0565, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 85.90% (0.0383 => 0.0712, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 85.23% (0.1638 => 0.3034, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 72.97% (23.5861 => 40.7977, std.dev.: 1.1870) SingleSource/Benchmarks/Shootout/objinst: 58.96% (0.0480 => 0.0763, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 57.12% (0.0688 => 0.1081, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 56.57% (0.9120 => 1.4279, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.30% (0.9612 => 1.5024, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 56.00% (0.9381 => 1.4634, std.dev.: 0.0544) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 55.90% (0.8893 => 1.3864, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 55.89% (0.9588 => 1.4947, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 55.46% (0.8926 => 1.3876, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 55.07% (0.9061 => 1.4051, std.dev.: 0.0725) SingleSource/Regression/C/casts: 54.38% (0.0388 => 0.0599, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.08% (0.9564 => 1.4736, std.dev.: 0.0968) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 53.84% (3.6295 => 5.5838, std.dev.: 0.1423) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 53.74% (0.9855 => 1.5151, std.dev.: 0.0425) SingleSource/UnitTests/2006-12-11-LoadConstants: 53.53% (0.1274 => 0.1956, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 52.85% (1.0867 => 1.6610, std.dev.: 0.0622) SingleSource/UnitTests/2003-05-26-Shorts: 52.70% (0.0222 => 0.0339, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.44% (0.9998 => 1.5241, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 51.75% (0.9422 => 1.4298, std.dev.: 0.1295) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 51.56% (0.8732 => 1.3234, std.dev.: 0.0524) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 51.55% (1.8127 => 2.7471, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 51.47% (0.9403 => 1.4243, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.47% (1.0119 => 1.5327, std.dev.: 0.1841) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 51.33% (1.4110 => 2.1352, std.dev.: 0.1067) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 51.17% (0.9010 => 1.3620, std.dev.: 0.0870) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 50.86% (0.8846 => 1.3345, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 50.47% (0.8912 => 1.3410, std.dev.: 0.0857) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 50.31% (0.9788 => 1.4712, std.dev.: 0.0719) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 49.26% (1.0088 => 1.5057, std.dev.: 0.1883) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 49.08% (1.0052 => 1.4986, std.dev.: 0.1456) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 48.76% (0.9867 => 1.4678, std.dev.: 0.0422) MultiSource/Benchmarks/McCat/08-main/main: 48.54% (0.2915 => 0.4330, std.dev.: 0.0226) MultiSource/Benchmarks/Olden/bh/bh: 47.63% (0.3273 => 0.4832, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 47.14% (0.9488 => 1.3961, std.dev.: 0.0359) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.98% (2.4519 => 3.6038, std.dev.: 0.1122) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 46.78% (0.9507 => 1.3954, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 45.94% (1.0017 => 1.4619, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.62% (0.9685 => 1.4006, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 43.91% (0.9993 => 1.4381, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 43.88% (0.9127 => 1.3132, std.dev.: 0.0633) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.70% (0.9405 => 1.3515, std.dev.: 0.0805) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 43.68% (1.0860 => 1.5604, std.dev.: 0.0929) SingleSource/UnitTests/SignlessTypes/rem: 43.42% (0.1163 => 0.1668, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 43.14% (1.8651 => 2.6697, std.dev.: 0.0611) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.47% (0.9550 => 1.3606, std.dev.: 0.0647) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 42.29% (0.0707 => 0.1006, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 41.73% (0.0738 => 0.1046, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.65% (0.3702 => 0.5244, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 40.03% (0.4762 => 0.6668, std.dev.: 0.0056) MultiSource/Applications/SPASS/SPASS: 39.79% (16.4479 => 22.9922, std.dev.: 0.3208) SingleSource/Benchmarks/Shootout-C++/wordfreq: 38.94% (0.3374 => 0.4688, std.dev.: 0.0081) MultiSource/Benchmarks/Olden/em3d/em3d: 38.19% (0.1927 => 0.2663, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 37.62% (0.1305 => 0.1796, std.dev.: 0.0003) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 36.72% (0.0403 => 0.0551, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 36.01% (0.0486 => 0.0661, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/18-imp/imp: 35.88% (0.3807 => 0.5173, std.dev.: 0.0512) SingleSource/Benchmarks/Shootout/matrix: 35.81% (0.0821 => 0.1115, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 35.28% (9.5202 => 12.8793, std.dev.: 0.2758) SingleSource/Benchmarks/McGill/queens: 35.10% (0.0490 => 0.0662, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/15-trie/trie: 32.72% (0.0593 => 0.0787, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 32.59% (5.3553 => 7.1005, std.dev.: 0.0748) MultiSource/Applications/minisat/minisat: 32.01% (0.7776 => 1.0265, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/fbench: 31.32% (0.0696 => 0.0914, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 31.29% (0.0735 => 0.0965, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/09-vor/vor: 31.07% (0.3402 => 0.4459, std.dev.: 0.0199) SingleSource/Benchmarks/McGill/chomp: 31.07% (0.1793 => 0.2350, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: 30.88% (0.1017 => 0.1331, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.18% (0.0762 => 0.0992, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: 29.76% (0.0615 => 0.0798, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 29.23% (0.7693 => 0.9942, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.47% (1.0986 => 1.4114, std.dev.: 0.0851) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 28.39% (0.1240 => 0.1592, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 28.13% (0.0718 => 0.0920, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/mst/mst: 27.94% (0.1335 => 0.1708, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.71% (0.1025 => 0.1309, std.dev.: 0.0096) MultiSource/Applications/sqlite3/sqlite3: 27.54% (17.5634 => 22.4012, std.dev.: 0.3322) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.27% (0.0803 => 0.1022, std.dev.: 0.0020) MultiSource/Benchmarks/Bullet/bullet: 27.03% (33.2440 => 42.2299, std.dev.: 0.8547) MultiSource/Benchmarks/nbench/nbench: 26.83% (1.2708 => 1.6118, std.dev.: 0.0666) MultiSource/Benchmarks/MallocBench/espresso/espresso: 26.13% (5.0381 => 6.3545, std.dev.: 0.2003) SingleSource/Benchmarks/Misc/richards_benchmark: 25.56% (0.0798 => 0.1002, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: 25.24% (1.4392 => 1.8024, std.dev.: 0.0428) MultiSource/Benchmarks/Prolangs-C/football/football: 24.73% (0.9759 => 1.2172, std.dev.: 0.0758) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.65% (1.2680 => 1.5806, std.dev.: 0.1211) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.48% (0.7225 => 0.8994, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 24.44% (4.6579 => 5.7964, std.dev.: 0.1386) SingleSource/Benchmarks/Misc/whetstone: 23.98% (0.0834 => 0.1034, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 23.97% (6.4235 => 7.9629, std.dev.: 0.1650) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 23.95% (0.3394 => 0.4207, std.dev.: 0.0209) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.90% (0.2577 => 0.3193, std.dev.: 0.0188) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 23.16% (0.6135 => 0.7556, std.dev.: 0.0315) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 22.82% (0.6934 => 0.8516, std.dev.: 0.0508) SingleSource/Benchmarks/McGill/misr: 22.65% (0.0649 => 0.0796, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.27% (4.8904 => 5.9796, std.dev.: 0.2435) SingleSource/Benchmarks/Misc/salsa20: 22.01% (0.0527 => 0.0643, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: 21.75% (0.0593 => 0.0722, std.dev.: 0.0011) MultiSource/Applications/JM/ldecod/ldecod: 21.61% (7.3529 => 8.9418, std.dev.: 0.1504) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 21.60% (0.0963 => 0.1171, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 21.41% (0.0976 => 0.1185, std.dev.: 0.0072) MultiSource/Applications/JM/lencod/lencod: 21.21% (16.7012 => 20.2437, std.dev.: 0.2066) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 20.80% (0.0697 => 0.0842, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 20.78% (0.0486 => 0.0587, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/almabench: 20.42% (0.0754 => 0.0908, std.dev.: 0.0030) MultiSource/Applications/lua/lua: 20.36% (4.6406 => 5.5854, std.dev.: 0.1792) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.10% (0.6885 => 0.8269, std.dev.: 0.0249) MultiSource/Applications/siod/siod: 20.10% (2.6437 => 3.1751, std.dev.: 0.2048) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.76% (0.9124 => 1.0927, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 19.56% (18.9377 => 22.6411, std.dev.: 0.2753) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 19.42% (0.0963 => 0.1150, std.dev.: 0.0038) MultiSource/Benchmarks/7zip/7zip-benchmark: 19.19% (44.1538 => 52.6286, std.dev.: 1.6010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.18% (0.2372 => 0.2827, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 19.11% (2.5772 => 3.0696, std.dev.: 0.1155) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.88% (0.1716 => 0.2040, std.dev.: 0.0097) MultiSource/Applications/ClamAV/clamscan: 18.72% (17.4365 => 20.7008, std.dev.: 0.3273) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 18.46% (0.0726 => 0.0860, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 18.40% (0.0636 => 0.0753, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 18.38% (2.4719 => 2.9262, std.dev.: 0.0542) MultiSource/Benchmarks/MallocBench/gs/gs: 17.92% (4.5936 => 5.4168, std.dev.: 0.1515) MultiSource/Applications/d/make_dparser: 17.79% (3.7840 => 4.4573, std.dev.: 0.1836) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 17.63% (0.1356 => 0.1595, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 17.33% (0.0704 => 0.0826, std.dev.: 0.0026) MultiSource/Applications/ALAC/decode/alacconvert-decode: 17.16% (1.1731 => 1.3744, std.dev.: 0.0472) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.01% (14.9757 => 17.5229, std.dev.: 0.4572) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.87% (1.6874 => 1.9721, std.dev.: 0.0151) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.43% (7.2721 => 8.3939, std.dev.: 0.3499) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.22% (0.3560 => 0.4102, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.19% (1.1498 => 1.3244, std.dev.: 0.0565) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.69% (0.5059 => 0.5802, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 14.26% (0.7693 => 0.8790, std.dev.: 0.0230) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.10% (0.1071 => 0.1222, std.dev.: 0.0020) MultiSource/Applications/aha/aha: 12.77% (0.1378 => 0.1554, std.dev.: 0.0065) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.59% (0.1072 => 0.1207, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 12.18% (0.5746 => 0.6446, std.dev.: 0.0262) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.87% (0.3665 => 0.4100, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.00% (0.2791 => 0.3098, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 10.42% (0.1622 => 0.1791, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 10.28% (1.5131 => 1.6687, std.dev.: 0.0419) SingleSource/Benchmarks/CoyoteBench/fftbench: 10.06% (0.3847 => 0.4234, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.86% (1.0234 => 1.1243, std.dev.: 0.0296) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 9.13% (0.7686 => 0.8388, std.dev.: 0.0105) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.54% (0.4121 => 0.4473, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 7.24% (0.1755 => 0.1882, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.84% (0.2253 => 0.2407, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 4.16% (0.4689 => 0.4884, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107350.00% (0.0008 => 0.8596, std.dev.: 0.0915) SingleSource/Benchmarks/Shootout/ary3: 363.19% (2.2304 => 10.3311, std.dev.: 1.5388) SingleSource/Benchmarks/Shootout/matrix: 358.58% (1.5825 => 7.2571, std.dev.: 0.0104) MultiSource/Applications/sgefa/sgefa: 259.03% (0.3515 => 1.2620, std.dev.: 0.0055) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.29% (1.1825 => 4.0712, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.45% (4.8185 => 15.9710, std.dev.: 0.1384) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 219.30% (0.0228 => 0.0728, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 207.75% (0.0129 => 0.0397, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 156.03% (0.0232 => 0.0594, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 62.12% (2.9083 => 4.7149, std.dev.: 0.0215) MultiSource/Benchmarks/Olden/mst/mst: 59.15% (0.1491 => 0.2373, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.65% (0.2562 => 0.3424, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.94% (3.1254 => 4.1237, std.dev.: 0.0123) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.87% (1.4588 => 1.8508, std.dev.: 0.0290) SingleSource/Regression/C/uint64_to_float: 23.86% (1.5397 => 1.9071, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.71% (5.6033 => 6.8759, std.dev.: 0.4531) SingleSource/Benchmarks/Misc/salsa20: 22.11% (7.4497 => 9.0970, std.dev.: 0.0272) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.39% (4.8112 => 5.7920, std.dev.: 0.1656) MultiSource/Applications/JM/lencod/lencod: 13.88% (6.8159 => 7.7619, std.dev.: 0.2383) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8564, std.dev.: 0.2083) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6498, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (3.6477 => 3.9747, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ReedSolomon: 8.42% (8.6447 => 9.3727, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (4.7473 => 5.0812, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (4.1836 => 4.4067, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (5.0310 => 5.2290, std.dev.: 0.0297) SingleSource/Benchmarks/Misc/pi: 3.28% (2.1390 => 2.2092, std.dev.: 0.0066) SingleSource/Benchmarks/Linpack/linpack-pc: 2.62% (50.8945 => 52.2258, std.dev.: 0.4912) MultiSource/Applications/siod/siod: 1.29% (3.5910 => 3.6374, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -22.83% (0.0727 => 0.0561, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.85% (11.5523 => 3.9450, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/fp-convert: -62.28% (15.6525 => 5.9040, std.dev.: 0.2081) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.49% (0.4146 => 0.1804, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.60% (0.4578 => 0.2353, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.89% (11.3868 => 6.3896, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.90% (5.4023 => 3.6251, std.dev.: 0.0558) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -29.94% (0.4452 => 0.3119, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.73% (0.5495 => 0.4026, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.29% (5.2605 => 3.8774, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.13% (4.4467 => 3.3292, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.32% (0.5897 => 0.4463, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.40% (4.9921 => 3.8239, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -22.62% (0.5826 => 0.4508, std.dev.: 0.0299) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.54% (16.6791 => 13.4199, std.dev.: 0.3836) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.45% (5.8755 => 4.7914, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.03% (7.0016 => 5.8794, std.dev.: 0.2685) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.18% (3.1921 => 2.7715, std.dev.: 0.0994) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6743, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9939, std.dev.: 0.0223) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.47% (9.7992 => 8.5774, std.dev.: 0.0674) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.48% (0.1164 => 0.1042, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: -9.68% (4.5259 => 4.0880, std.dev.: 0.1398) MultiSource/Applications/SIBsim4/SIBsim4: -7.73% (3.5443 => 3.2702, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2491, std.dev.: 0.1123) MultiSource/Benchmarks/mafft/pairlocalalign: -5.49% (63.1520 => 59.6822, std.dev.: 0.4353) SingleSource/Benchmarks/McGill/queens: -5.41% (1.7443 => 1.6500, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: -4.29% (3.6768 => 3.5189, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.29% (3.5127 => 3.3619, std.dev.: 0.0466) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.90% (1.4446 => 1.3883, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.70% (5.8973 => 5.6789, std.dev.: 0.0707) SingleSource/Benchmarks/Shootout-C++/methcall: -1.98% (8.7416 => 8.5689, std.dev.: 0.0580) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5781, std.dev.: 0.0151) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8973, std.dev.: 0.3906) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.21% (3.7450 => 3.6997, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.15% (6.8262 => 6.7478, std.dev.: 0.0158) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 23.35% (1.2047 => 1.4860, std.dev.: 0.0336) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -9.44% (0.0233 => 0.0211, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.21% (0.0451 => 0.0432, std.dev.: 0.0108) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.59% (0.1530 => 0.1475, std.dev.: 0.0028) MultiSource/Applications/lemon/lemon: -38.26% (1.9293 => 1.1911, std.dev.: 0.2277) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.82% (0.4049 => 0.4244, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.95% (0.1510 => 0.1405, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.23% (0.0978 => 0.0653, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.56% (0.0590 => 0.0611, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.78% (1.1617 => 1.2985, std.dev.: 0.0518) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0610 => 0.0613, std.dev.: 0.0113) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.81% (0.0268 => 0.0305, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.56% (0.7437 => 1.7593, std.dev.: 0.0266) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -59.78% (0.0092 => 0.0037, std.dev.: 0.0021) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.65% (12.7781 => 34.2012, std.dev.: 0.2137) Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 16:11:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 18:11:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129001102.20A5F2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8053?compare_to=8051&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8053, Order: 173722, Start Time: 2013-01-28 22:35:04, End Time: 2013-01-29 00:11:22 To: 8051, Order: 173712, Start Time: 2013-01-28 20:35:01, End Time: 2013-01-28 22:11:39 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (211 on baseline) Performance Improvements: 30 (74 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1073 (807 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.66% (19.9127 => 20.2427, std.dev.: 0.0286) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.04% (33.6698 => 32.3112, std.dev.: 0.0102) MultiSource/Applications/SPASS/SPASS: -3.20% (18.7928 => 18.1915, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -2.53% (0.4115 => 0.4011, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: -2.33% (19.9945 => 19.5286, std.dev.: 0.0215) MultiSource/Applications/siod/siod: -1.97% (2.8407 => 2.7847, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.81% (0.8777 => 0.8618, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.80% (39.2741 => 38.5684, std.dev.: 0.0120) MultiSource/Applications/oggenc/oggenc: -1.38% (5.8076 => 5.7272, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.38% (2.1299 => 2.1006, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.37% (0.7982 => 0.7873, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.35% (0.7756 => 0.7651, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.32% (0.8049 => 0.7943, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.31% (6.9098 => 6.8196, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.30% (1.1022 => 1.0879, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.29% (4.5232 => 4.4649, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.28% (0.8828 => 0.8715, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -1.28% (1.5269 => 1.5074, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.23% (0.8187 => 0.8086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.23% (0.8131 => 0.8031, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.23% (1.0337 => 1.0210, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.23% (0.8232 => 0.8131, std.dev.: 0.0008) MultiSource/Applications/lua/lua: -1.22% (4.6778 => 4.6205, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.17% (0.9026 => 0.8920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.15% (0.9100 => 0.8995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.15% (0.9713 => 0.9601, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: -1.15% (1.6318 => 1.6130, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.12% (0.9156 => 0.9053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.11% (0.9991 => 0.9880, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: -1.08% (20.5516 => 20.3302, std.dev.: 0.0204) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.00% (1.0353 => 1.0249, std.dev.: 0.0036) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 130.48% (0.0315 => 0.0726, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/lowercase: 91.79% (0.0280 => 0.0537) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 83.96% (0.0717 => 0.1319, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 81.32% (0.0514 => 0.0932, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 71.56% (0.0974 => 0.1671, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 62.54% (0.1132 => 0.1840, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 58.60% (0.1500 => 0.2379, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 47.98% (0.0371 => 0.0549) SingleSource/Regression/C/sumarraymalloc: 47.94% (0.0267 => 0.0395, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 47.08% (0.0599 => 0.0881, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 46.04% (0.6395 => 0.9339, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 45.33% (1.6474 => 2.3941, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 44.77% (0.6395 => 0.9258, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 44.21% (22.4056 => 32.3112, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout/objinst: 42.01% (0.0407 => 0.0578) SingleSource/Benchmarks/Stanford/IntMM: 41.15% (0.0418 => 0.0590) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 40.63% (0.0699 => 0.0983, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.18% (0.6260 => 0.8775, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 39.89% (0.6230 => 0.8715, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.71% (0.5805 => 0.8110, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 39.64% (0.5688 => 0.7943, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.46% (0.5456 => 0.7609, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.03% (0.5567 => 0.7740, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 39.02% (0.5849 => 0.8131, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 38.91% (0.5575 => 0.7744, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 38.58% (0.5581 => 0.7734, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.42% (0.5802 => 0.8031, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 38.00% (0.5705 => 0.7873, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.94% (0.5941 => 0.8195, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 37.73% (0.5857 => 0.8067, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 37.53% (0.5478 => 0.7534, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.53% (0.0445 => 0.0612) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.39% (0.5569 => 0.7651, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 37.31% (0.5570 => 0.7648, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.14% (0.5859 => 0.8035, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 37.08% (0.5591 => 0.7664, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 37.07% (2.2587 => 3.0960, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 37.05% (0.6033 => 0.8268, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 36.52% (0.0293 => 0.0400, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.48% (0.6440 => 0.8789, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.47% (0.5925 => 0.8086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 35.85% (0.5863 => 0.7965, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 35.84% (0.6189 => 0.8407, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 35.61% (0.6676 => 0.9053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.57% (0.6446 => 0.8739, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.44% (0.6052 => 0.8197, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 35.05% (0.0582 => 0.0786, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 34.91% (0.6304 => 0.8505, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 34.64% (0.6681 => 0.8995, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 34.42% (0.6194 => 0.8326, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 33.93% (0.6660 => 0.8920, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 33.79% (0.6297 => 0.8425, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.01% (0.6667 => 0.8868, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 32.03% (0.0790 => 0.1043, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 31.65% (1.1450 => 1.5074, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 31.31% (0.7524 => 0.9880, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 30.82% (0.7339 => 0.9601, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 30.46% (0.2659 => 0.3469, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 30.23% (0.0622 => 0.0810, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 30.16% (0.0693 => 0.0902, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.11% (0.0621 => 0.0808, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.68% (0.0556 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 28.37% (1.6364 => 2.1006, std.dev.: 0.0081) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 28.09% (0.0833 => 0.1067, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.89% (0.1230 => 0.1573, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 27.79% (0.0680 => 0.0869, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.60% (0.0634 => 0.0809) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.34% (3.5339 => 4.4649, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 25.62% (0.0566 => 0.0711, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.58% (1.2784 => 1.6054, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 25.26% (0.3357 => 0.4205, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.00% (0.1796 => 0.2245, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 24.71% (5.4682 => 6.8196, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.61% (0.1146 => 0.1428, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 24.46% (1.2515 => 1.5576, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 23.62% (0.0707 => 0.0874, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.75% (0.7021 => 0.8618, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.71% (4.5069 => 5.4853, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.65% (0.1081 => 0.1315, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/exptree: 21.53% (0.0864 => 0.1050, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 21.20% (0.0731 => 0.0886, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 20.11% (9.2283 => 11.0841, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.40% (0.0665 => 0.0794, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.27% (0.1982 => 0.2364, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.94% (0.4916 => 0.5847, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.76% (0.0885 => 0.1051, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.60% (0.1731 => 0.2053, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.49% (0.0806 => 0.0955, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 18.04% (0.6750 => 0.7968, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/mason/mason: 18.04% (0.0621 => 0.0733, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 17.92% (0.4515 => 0.5324, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.88% (0.0604 => 0.0712, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.82% (0.2385 => 0.2810, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 17.69% (0.0571 => 0.0672) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.58% (0.5329 => 0.6266, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 17.54% (0.0764 => 0.0898, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.50% (0.0617 => 0.0725, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 17.46% (0.7447 => 0.8747, std.dev.: 0.0055) MultiSource/Applications/SPASS/SPASS: 17.30% (15.5079 => 18.1915, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.72% (0.0598 => 0.0698, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.55% (1.4642 => 1.7065, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: 16.52% (0.2985 => 0.3478, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 16.34% (1.3864 => 1.6130, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/distray/distray: 16.21% (0.0919 => 0.1068, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 15.93% (2.4021 => 2.7847, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.63% (0.0710 => 0.0821, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 15.35% (0.1674 => 0.1931, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.18% (0.1509 => 0.1738, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.16% (0.3483 => 0.4011, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 15.12% (0.4861 => 0.5596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.03% (0.4524 => 0.5204, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 15.01% (2.1401 => 2.4614, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.86% (0.1077 => 0.1237, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.68% (0.0797 => 0.0914, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.65% (0.6293 => 0.7215, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/messages-2: 14.63% (0.0704 => 0.0807, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 14.18% (17.1032 => 19.5286, std.dev.: 0.0215) SingleSource/Benchmarks/McGill/chomp: 14.08% (0.1761 => 0.2009, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 14.03% (5.0226 => 5.7272, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 13.90% (0.8418 => 0.9588, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.83% (0.9557 => 1.0879, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 13.82% (1.1530 => 1.3124, std.dev.: 0.0042) MultiSource/Applications/lua/lua: 13.82% (4.0594 => 4.6205, std.dev.: 0.0200) MultiSource/Applications/d/make_dparser: 13.75% (3.5154 => 3.9989, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.69% (0.1096 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.66% (0.2548 => 0.2896, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.49% (0.3491 => 0.3962, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 13.13% (34.0927 => 38.5684, std.dev.: 0.0120) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 12.31% (0.1145 => 0.1286, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 12.19% (0.1173 => 0.1316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 12.10% (0.5999 => 0.6725, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.96% (0.3319 => 0.3716, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.94% (0.2001 => 0.2240, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.87% (1.2300 => 1.3760, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 11.59% (0.3581 => 0.3996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1290 => 0.1436, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 11.13% (18.2933 => 20.3302, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.10% (0.0919 => 0.1021, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 10.90% (0.1862 => 0.2065, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.74% (0.3658 => 0.4051, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 10.68% (0.0974 => 0.1078, std.dev.: 0.0007) MultiSource/Applications/ClamAV/clamscan: 10.67% (15.2527 => 16.8804, std.dev.: 0.0052) SingleSource/UnitTests/SignlessTypes/rem: 10.28% (0.1197 => 0.1320, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 10.23% (0.3255 => 0.3588, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.14% (0.2999 => 0.3303, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.04% (4.0323 => 4.4370, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.61% (0.2278 => 0.2497, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.50% (0.7198 => 0.7882, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.48% (0.1108 => 0.1213, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 9.45% (0.1154 => 0.1263, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 9.13% (0.1271 => 0.1387, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.94% (0.5168 => 0.5630, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 8.92% (1.5610 => 1.7003, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/football/football: 8.90% (0.9179 => 0.9996, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.78% (0.2106 => 0.2291, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.74% (1.3722 => 1.4921, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 8.72% (0.7982 => 0.8678, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.64% (0.1621 => 0.1761, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 8.62% (0.1879 => 0.2041, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.52% (0.4427 => 0.4804, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 8.44% (0.3271 => 0.3547, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.31% (0.6736 => 0.7296, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.28% (0.7919 => 0.8575, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 8.12% (0.1441 => 0.1558, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 7.37% (0.4083 => 0.4384, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.26% (0.3142 => 0.3370, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 7.11% (7.0961 => 7.6009, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.04% (4.8161 => 5.1552, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.87% (0.9077 => 0.9701, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.82% (4.8802 => 5.2129, std.dev.: 0.0062) MultiSource/Benchmarks/MallocBench/gs/gs: 6.75% (4.3330 => 4.6254, std.dev.: 0.0122) MultiSource/Applications/JM/lencod/lencod: 6.67% (16.1920 => 17.2713, std.dev.: 0.0250) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.56% (0.8521 => 0.9080, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.40% (8.0126 => 8.5258, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.29% (1.0544 => 1.1207, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.05% (0.6484 => 0.6876, std.dev.: 0.0007) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (6.7716 => 7.1718, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.90% (0.2695 => 0.2854, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 5.83% (2.4924 => 2.6376, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 5.74% (0.4321 => 0.4569, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (14.2083 => 14.9804, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary3: 5.43% (0.3446 => 0.3633, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 5.27% (0.3394 => 0.3573, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.90% (1.2221 => 1.2820, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.85% (1.2210 => 1.2802, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.60% (0.3849 => 0.4026, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.59% (0.2355 => 0.2463, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 4.17% (0.3406 => 0.3548, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 4.05% (0.4151 => 0.4319, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.63% (0.9852 => 1.0210, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/ary2: 3.53% (0.3481 => 0.3604, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.11% (0.4248 => 0.4380, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.90% (0.3931 => 0.4045, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 2.80% (0.3788 => 0.3894, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.38% (0.9542 => 0.9674, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8027, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.53% (0.9531 => 1.0249, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1494, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5233, std.dev.: 0.1272) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1034, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.77% (79.7170 => 81.1263, std.dev.: 0.1486) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6057, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2495, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.50% (18.2231 => 18.4970, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0061) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4533, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.20% (0.3812 => 0.3652, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.97% (0.3831 => 0.3679, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.89% (0.3880 => 0.3729, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3884 => 0.3734, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: -3.85% (0.3848 => 0.3700, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.82% (0.3896 => 0.3747, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.75% (0.3891 => 0.3745, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.4033 => 0.3886, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -3.01% (0.6347 => 0.6156, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2427, std.dev.: 0.0286) SingleSource/UnitTests/ObjC++/property-reference-object: -2.38% (0.6441 => 0.6288, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -1.63% (0.7779 => 0.7652, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.53% (2.1713 => 2.1381, std.dev.: 0.0120) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.73% (1.8100 => 0.6926, std.dev.: 0.0081) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3125, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.68% (1.3643 => 1.0276, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7569, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0806, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5896, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2047, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2237 => 0.9590, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -15.07% (2.5106 => 2.1323, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6677, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3559, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.28% (5.5807 => 5.3977, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.84% (7.9763 => 7.7494, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2730, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/ary3: -2.62% (3.7241 => 3.6267, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1723, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.55% (1.6307 => 1.6054, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.48% (6.5735 => 6.4759, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5891, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 16:20:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 18:20:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129002046.CFD8B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8054?compare_to=8050&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8054, Order: 173717, Start Time: 2013-01-28 22:01:30, End Time: 2013-01-29 00:20:56 To: 8050, Order: 173705, Start Time: 2013-01-28 19:11:16, End Time: 2013-01-28 21:30:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (271 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (600 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.24% (128.9866 => 131.8797, std.dev.: 0.0398) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.17% (55.2688 => 56.4662, std.dev.: 0.1706) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (3.1276 => 3.1648, std.dev.: 0.0007) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.30% (0.1333 => 0.1329, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.44% (0.0684 => 0.0681, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8197 => 499.8394, std.dev.: 0.0053) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44223.79% (1.1277 => 499.8394, std.dev.: 0.0053) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 267.70% (0.5229 => 1.9227, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 44.90% (14.9895 => 21.7204, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 62.21% (14.1553 => 22.9609, std.dev.: 0.0202) MultiSource/Benchmarks/MallocBench/gs/gs: 30.04% (4.1105 => 5.3451, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 90.40% (1.1048 => 2.1035, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1742.36% (7.1582 => 131.8797, std.dev.: 0.0398) SingleSource/Benchmarks/Misc-C++-EH/spirit: 127.09% (3.4629 => 7.8639, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 99.76% (0.6222 => 1.2429, std.dev.: 0.0009) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10265.83% (0.0720 => 7.4634, std.dev.: 0.0049) MultiSource/Applications/SIBsim4/SIBsim4: 3835100.00% (0.0001 => 3.8352, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11145900.00% (0.0001 => 11.1460, std.dev.: 0.0248) MultiSource/Applications/kimwitu++/kc: 50900.00% (0.0001 => 0.0510, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 65700.00% (0.0001 => 0.0658, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850500.00% (0.0001 => 9.8506, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5483900.00% (0.0001 => 5.4840, std.dev.: 0.0029) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.51% (1.1194 => 10.2930, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/flops: 183.10% (0.1432 => 0.4054, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/factor: 171.62% (0.0296 => 0.0804, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 156.69% (22.1758 => 56.9222, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/lowercase: 140.23% (0.0256 => 0.0615, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 134.56% (0.1056 => 0.2477, std.dev.: 0.0009) SingleSource/Regression/C/sumarraymalloc: 112.35% (0.0243 => 0.0516) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.41% (0.0929 => 0.1899, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 102.39% (7.0540 => 14.2768, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout/objinst: 101.17% (0.0427 => 0.0859, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 88.52% (0.1463 => 0.2758, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 87.40% (0.0730 => 0.1368, std.dev.: 0.0010) SingleSource/UnitTests/2006-01-23-UnionInit: 81.86% (0.0237 => 0.0431, std.dev.: 0.0009) SingleSource/Regression/C/casts: 79.87% (0.0318 => 0.0572) SingleSource/Regression/C/uint64_to_float: 78.78% (0.0377 => 0.0674, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 77.84% (0.2554 => 0.4542, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 74.95% (1.5859 => 2.7746, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 72.21% (0.0439 => 0.0756, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0004) SingleSource/UnitTests/Vector/simple: 65.95% (0.0185 => 0.0307, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 63.55% (2.2024 => 3.6020, std.dev.: 0.0027) SingleSource/Regression/C++/EH/function_try_block: 63.43% (0.0268 => 0.0438) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.28% (2.9384 => 4.7684, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 60.88% (8.1363 => 13.0900, std.dev.: 0.0140) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 60.37% (0.0217 => 0.0348) SingleSource/UnitTests/2002-05-02-CastTest: 59.63% (0.0218 => 0.0348) SingleSource/Regression/C/sumarray: 59.31% (0.0231 => 0.0368) SingleSource/UnitTests/2006-12-11-LoadConstants: 57.66% (0.1143 => 0.1802, std.dev.: 0.0000) SingleSource/Regression/C/testtrace: 57.55% (0.0212 => 0.0334, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 57.07% (1.5415 => 2.4213, std.dev.: 0.0160) SingleSource/UnitTests/2003-05-31-CastToBool: 56.44% (0.0202 => 0.0316, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 56.29% (0.0636 => 0.0994, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 55.39% (0.3109 => 0.4831, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 54.31% (0.0232 => 0.0358, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 52.68% (0.0953 => 0.1455, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 52.44% (1.1642 => 1.7747, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 50.00% (0.1062 => 0.1593, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: 49.66% (21.9371 => 32.8306, std.dev.: 0.0124) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 49.24% (0.6675 => 0.9962, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 48.80% (0.1125 => 0.1674, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.17% (0.0793 => 0.1175, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 47.63% (0.2700 => 0.3986, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 47.44% (3.8922 => 5.7387, std.dev.: 0.0049) MultiSource/Benchmarks/MallocBench/espresso/espresso: 46.74% (4.2646 => 6.2577, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/exptree: 46.56% (0.0814 => 0.1193) MultiSource/Applications/lemon/lemon: 46.39% (1.0722 => 1.5696, std.dev.: 0.0002) SingleSource/UnitTests/2003-07-09-SignedArgs: 46.10% (0.0282 => 0.0412, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/Large/cast: 45.92% (0.0564 => 0.0823, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 45.16% (0.0527 => 0.0765, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 45.06% (0.7115 => 1.0321, std.dev.: 0.0063) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 43.98% (0.0457 => 0.0658, std.dev.: 0.0009) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 43.22% (0.0479 => 0.0686, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 43.12% (0.0640 => 0.0916) SingleSource/Benchmarks/BenchmarkGame/partialsums: 42.45% (0.0245 => 0.0349, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 42.21% (0.4615 => 0.6563, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 42.18% (0.0467 => 0.0664, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/div: 41.86% (0.0258 => 0.0366, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 41.67% (2.2969 => 3.2540, std.dev.: 0.0032) SingleSource/UnitTests/block-copied-in-cxxobj: 41.61% (0.0310 => 0.0439, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 41.45% (0.5105 => 0.7221, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: 41.44% (0.0818 => 0.1157, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 41.30% (0.2271 => 0.3209, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 41.12% (9.4845 => 13.3844, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/bh/bh: 41.01% (0.3092 => 0.4360, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/shr: 40.87% (0.0252 => 0.0355, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 40.79% (0.0662 => 0.0932, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 40.51% (0.1175 => 0.1651, std.dev.: 0.0024) MultiSource/Benchmarks/llubenchmark/llu: 40.48% (0.0462 => 0.0649, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 40.41% (0.0730 => 0.1025, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 40.10% (0.6456 => 0.9045, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 40.03% (0.0672 => 0.0941, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.85% (0.1892 => 0.2646, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 39.61% (0.1555 => 0.2171, std.dev.: 0.0042) SingleSource/Benchmarks/BenchmarkGame/n-body: 39.41% (0.0746 => 0.1040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 39.03% (0.5860 => 0.8147, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 38.82% (0.1695 => 0.2353, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/family/family: 38.29% (0.0397 => 0.0549, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 38.25% (0.1655 => 0.2288, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 38.25% (0.0719 => 0.0994, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 38.22% (0.4299 => 0.5942, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 37.93% (3.8723 => 5.3409, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/hash: 37.73% (0.0485 => 0.0668, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 37.51% (2.0273 => 2.7878, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 37.40% (0.1032 => 0.1418, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 37.37% (0.3441 => 0.4727, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 37.34% (1.4186 => 1.9483, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/17-bintr/bintr: 37.33% (0.0675 => 0.0927, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 37.14% (0.0770 => 0.1056, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 36.85% (5.7591 => 7.8813, std.dev.: 0.0043) MultiSource/Applications/d/make_dparser: 36.77% (3.3354 => 4.5618, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 36.64% (0.7835 => 1.0706, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/wordfreq: 36.62% (0.3307 => 0.4518, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/lists: 36.58% (0.0626 => 0.0855, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 36.49% (0.1044 => 0.1425, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 36.37% (63.2438 => 86.2478, std.dev.: 0.0562) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.31% (0.5569 => 0.7591, std.dev.: 0.0018) SingleSource/UnitTests/Vector/build2: 36.27% (0.0295 => 0.0402, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 36.27% (0.3427 => 0.4670, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 36.07% (17.1811 => 23.3775, std.dev.: 0.0159) MultiSource/Benchmarks/nbench/nbench: 35.90% (1.1840 => 1.6090, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/em3d/em3d: 35.46% (0.1695 => 0.2296, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: 35.45% (0.0660 => 0.0894, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 35.15% (0.3121 => 0.4218, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: 35.09% (0.1268 => 0.1713, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 34.93% (0.4289 => 0.5787, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages: 34.86% (0.0327 => 0.0441, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 34.76% (0.3423 => 0.4613, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 34.68% (0.0447 => 0.0602, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 34.68% (0.4620 => 0.6222, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.60% (0.4879 => 0.6567, std.dev.: 0.0043) SingleSource/Benchmarks/Stanford/Queens: 34.54% (0.0414 => 0.0557, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 34.51% (0.0933 => 0.1255, std.dev.: 0.0000) SingleSource/UnitTests/2003-08-11-VaListArg: 34.49% (0.0316 => 0.0425, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 34.32% (0.0437 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/mason/mason: 34.03% (0.0811 => 0.1087, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 33.97% (0.2758 => 0.3695, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.61% (0.0842 => 0.1125, std.dev.: 0.0009) MultiSource/Applications/aha/aha: 33.54% (0.1151 => 0.1537, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/bc/bc: 33.46% (1.1861 => 1.5830, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 33.40% (0.1584 => 0.2113, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 33.27% (0.2107 => 0.2808, std.dev.: 0.0024) SingleSource/Benchmarks/McGill/queens: 33.25% (0.0403 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 32.73% (0.0886 => 0.1176, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.44% (0.1566 => 0.2074, std.dev.: 0.0010) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 32.39% (0.0389 => 0.0515) MultiSource/Benchmarks/Olden/mst/mst: 32.16% (0.1163 => 0.1537, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 31.90% (0.0326 => 0.0430, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 31.82% (0.0770 => 0.1015, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fbench: 31.76% (0.0592 => 0.0780) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 31.47% (0.1236 => 0.1625, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 31.44% (0.0528 => 0.0694, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 31.32% (0.7433 => 0.9761, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 31.15% (0.3387 => 0.4442, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 31.11% (0.0614 => 0.0805, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.85% (0.8172 => 1.0693, std.dev.: 0.0165) MultiSource/Benchmarks/BitBench/drop3/drop3: 30.71% (0.0482 => 0.0630, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 30.70% (1.3050 => 1.7056, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.61% (0.1029 => 0.1344, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ft/ft: 30.57% (0.1940 => 0.2533, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.40% (0.5981 => 0.7799, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 30.15% (0.0408 => 0.0531, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.12% (0.1906 => 0.2480, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ks/ks: 30.07% (0.1510 => 0.1964, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 29.74% (0.6450 => 0.8368, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.52% (0.8067 => 1.0448, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax: 29.30% (0.0355 => 0.0459) MultiSource/Benchmarks/McCat/09-vor/vor: 29.18% (0.3180 => 0.4108, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 28.94% (0.9765 => 1.2591, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/Towers: 28.87% (0.0471 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.85% (4.9449 => 6.3713, std.dev.: 0.0109) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.80% (0.1337 => 0.1722, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 28.79% (0.8921 => 1.1489, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 28.70% (0.0871 => 0.1121, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 28.67% (0.1144 => 0.1472, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/treeadd/treeadd: 28.61% (0.0416 => 0.0535) SingleSource/Benchmarks/Adobe-C++/functionobjects: 28.45% (0.5020 => 0.6448, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: 28.44% (0.0633 => 0.0813, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 28.22% (0.0567 => 0.0727, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 28.12% (0.2603 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.11% (0.1117 => 0.1431, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.89% (5.0018 => 6.3969, std.dev.: 0.0135) MultiSource/Applications/hbd/hbd: 27.57% (1.5603 => 1.9904, std.dev.: 0.0049) SingleSource/Benchmarks/Stanford/Treesort: 27.49% (0.0411 => 0.0524, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.28% (0.8101 => 1.0311, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/matrix: 27.05% (0.3098 => 0.3936, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: 26.75% (0.0456 => 0.0578, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 26.70% (0.2266 => 0.2871, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.57% (0.3177 => 0.4021, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 26.46% (0.4203 => 0.5315, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 25.28% (0.3865 => 0.4842, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.60% (0.0443 => 0.0552, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 23.86% (0.0834 => 0.1033, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 23.81% (0.0798 => 0.0988, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 23.38% (0.0479 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.30% (0.0648 => 0.0799, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: 23.19% (0.1440 => 0.1774, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 23.06% (0.4103 => 0.5049, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.81% (0.0491 => 0.0603, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 22.77% (0.1625 => 0.1995, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 22.66% (0.0481 => 0.0590) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.16% (0.0704 => 0.0860, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.71% (14.3668 => 17.4853, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 21.18% (0.1114 => 0.1350, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 20.94% (0.4636 => 0.5607, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/perlin: 20.71% (0.0536 => 0.0647, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.48% (0.2065 => 0.2488, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/Large/ray: 20.47% (0.4064 => 0.4896, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 20.29% (0.3283 => 0.3949, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/oourafft: 20.05% (0.3282 => 0.3940, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 19.83% (0.3232 => 0.3873, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 19.71% (0.2430 => 0.2909, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.45% (0.0838 => 0.1001, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 19.34% (0.4048 => 0.4831, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.10% (0.0759 => 0.0904, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/ReedSolomon: 18.94% (0.2049 => 0.2437, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 18.70% (0.3379 => 0.4011, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 18.29% (0.1438 => 0.1701, std.dev.: 0.0003) SingleSource/UnitTests/initp1: 18.20% (0.0555 => 0.0656, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.11% (0.3826 => 0.4519, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 18.10% (0.3603 => 0.4255, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 17.43% (0.3684 => 0.4326, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 17.15% (0.3422 => 0.4009, std.dev.: 0.0029) SingleSource/Regression/C++/ofstream_ctor: 16.63% (0.2905 => 0.3388, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.83% (0.3886 => 0.4501, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.67% (0.3650 => 0.4222, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.60% (0.3935 => 0.4549, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.33% (2.2022 => 2.5397, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/ffbench: 15.04% (0.0705 => 0.0811, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 14.04% (0.1268 => 0.1446, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.61% (0.1330 => 0.1511, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: 13.58% (1.2842 => 1.4586, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/parameter-passing: 13.01% (0.3927 => 0.4438, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.71% (0.3162 => 0.3564, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 12.54% (0.2831 => 0.3186, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: 11.91% (0.3828 => 0.4284, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.71% (2.0665 => 2.3084, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/except: 11.49% (0.2871 => 0.3201, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.45% (7.9617 => 8.8733, std.dev.: 0.0247) SingleSource/Benchmarks/Shootout-C++/methcall: 11.44% (0.2877 => 0.3206, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 11.14% (10.3673 => 11.5222, std.dev.: 0.0106) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.00% (0.3136 => 0.3481, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.27% (0.2891 => 0.3188, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 10.13% (0.7326 => 0.8068, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 10.05% (0.6030 => 0.6636) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.91% (0.2756 => 0.3029, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wc: 9.90% (0.3052 => 0.3354, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.72% (0.2725 => 0.2990, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.65% (0.2714 => 0.2976, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/random: 9.64% (0.2802 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.58% (0.2872 => 0.3147, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 9.50% (0.3694 => 0.4045, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 9.34% (0.3543 => 0.3874, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2793 => 0.3053, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 9.27% (0.3561 => 0.3891, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 9.24% (0.3516 => 0.3841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 9.12% (0.3543 => 0.3866, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 9.09% (0.3497 => 0.3815, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 9.01% (0.3473 => 0.3786, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: 8.71% (0.5925 => 0.6441, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 7.03% (0.3131 => 0.3351, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4704, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.93% (1.1145 => 1.2920, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6956, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.11% (1.1396 => 1.2434, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.73% (11.6436 => 12.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.12% (4.2280 => 4.4444, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: 4.90% (3.1578 => 3.3125, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.39% (0.9957 => 1.0295, std.dev.: 0.0093) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8957, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.82% (9.1159 => 9.2817, std.dev.: 0.0227) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.73% (3.6395 => 3.7026, std.dev.: 0.0138) MultiSource/Benchmarks/mafft/pairlocalalign: 1.42% (27.8444 => 28.2392, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.27% (10.3460 => 10.4776, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.79% (6.6874 => 0.2148, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.51% (5.2763 => 1.2920, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.19% (0.8651 => 0.2146, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -35.70% (0.1622 => 0.1043, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.32% (5.3855 => 4.9376, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.81% (5.3526 => 4.9346, std.dev.: 0.0073) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9739, std.dev.: 0.0128) MultiSource/Applications/JM/ldecod/ldecod: -4.92% (10.4361 => 9.9226, std.dev.: 0.0175) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.63% (1.7609 => 1.6970, std.dev.: 0.0073) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.09% (1.9577 => 0.6638, std.dev.: 0.0053) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.32% (0.3987 => 0.2539, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3057, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.63% (1.5373 => 1.0203, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4294, std.dev.: 0.0043) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8488, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.43% (2.6546 => 2.0060, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -20.87% (0.0757 => 0.0599, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/mason/mason: -19.48% (0.2161 => 0.1740, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1257, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -13.03% (3.1443 => 2.7345, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.13% (0.9540 => 0.8383, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.00% (1.8329 => 1.7046, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.79% (19.9488 => 18.5949, std.dev.: 0.0246) SingleSource/Benchmarks/McGill/chomp: -6.60% (1.2373 => 1.1557, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.04% (1.6805 => 1.5790, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7016, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.71% (1.5835 => 1.5089, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -4.56% (10.2830 => 9.8138, std.dev.: 0.0161) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.6994 => 3.6282, std.dev.: 0.0105) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3295, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -1.21% (4.6441 => 4.5880, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/lists: -1.07% (6.2999 => 6.2327, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8575, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0010) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 16:25:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 18:25:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130129002518.89AFB2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8055?compare_to=8047&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8055, Order: 173711, Start Time: 2013-01-28 20:49:52, End Time: 2013-01-29 00:25:34 To: 8047, Order: 173685, Start Time: 2013-01-28 16:07:55, End Time: 2013-01-28 19:43:04 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (205 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (732 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.83% (2.1632 => 2.2027, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 49.13% (0.5361 => 0.7995, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.28% (0.0625 => 0.0908, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 43.69% (0.0547 => 0.0786, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.29% (0.1063 => 0.1470, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/voronoi/voronoi: 37.32% (0.1088 => 0.1494, std.dev.: 0.0039) SingleSource/Benchmarks/CoyoteBench/almabench: 37.01% (0.0281 => 0.0385, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: 35.86% (0.0304 => 0.0413) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 35.52% (0.7426 => 1.0064, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 34.68% (1.5932 => 2.1458, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.63% (0.1106 => 0.1489, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 33.69% (0.0561 => 0.0750, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 33.23% (0.0331 => 0.0441, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 32.60% (0.2040 => 0.2705, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 32.59% (0.4139 => 0.5488, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 32.55% (0.0897 => 0.1189, std.dev.: 0.0011) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.50% (0.0563 => 0.0746, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 32.40% (0.2969 => 0.3931, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/dbms/dbms: 32.20% (0.5900 => 0.7800, std.dev.: 0.0259) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.18% (0.5000 => 0.6609, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.10% (0.4994 => 0.6597, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: 32.02% (0.0584 => 0.0771, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 32.02% (0.1218 => 0.1608, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 31.89% (0.0599 => 0.0790, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 31.19% (0.0808 => 0.1060) MultiSource/Benchmarks/Olden/power/power: 30.96% (0.0604 => 0.0791) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 30.84% (0.0415 => 0.0543, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.79% (0.0367 => 0.0480, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 30.15% (0.0481 => 0.0626, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 30.09% (0.0349 => 0.0454, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: 29.60% (0.1284 => 0.1664, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages-2: 29.36% (0.0419 => 0.0542) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.32% (0.0457 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 29.26% (0.0475 => 0.0614, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 29.09% (0.0440 => 0.0568, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.94% (0.0584 => 0.0753, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 28.91% (0.1003 => 0.1293, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 28.89% (0.0495 => 0.0638, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 28.72% (0.0390 => 0.0502, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 28.66% (0.1549 => 0.1993, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 28.64% (0.1505 => 0.1936, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.59% (11.6398 => 14.9678, std.dev.: 0.0176) MultiSource/Benchmarks/nbench/nbench: 28.57% (0.2566 => 0.3299, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.55% (0.1604 => 0.2062, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 28.47% (0.0541 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 28.38% (0.0948 => 0.1217, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.29% (0.0714 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 28.17% (0.1619 => 0.2075, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.12% (0.0633 => 0.0811, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 28.08% (0.3084 => 0.3950, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.01% (0.1021 => 0.1307, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 28.00% (0.1107 => 0.1417, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 28.00% (0.0425 => 0.0544, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 27.98% (0.0386 => 0.0494, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.92% (0.2736 => 0.3500, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.88% (0.0452 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 27.84% (1.8794 => 2.4027, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 27.77% (0.0605 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 27.74% (0.1103 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 27.69% (0.3890 => 0.4967, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 27.57% (0.0642 => 0.0819, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 27.56% (0.0947 => 0.1208, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 27.46% (5.5417 => 7.0635, std.dev.: 0.0133) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 27.29% (0.2103 => 0.2677, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 27.26% (0.3903 => 0.4967, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.22% (0.1620 => 0.2061, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.01% (0.2014 => 0.2558, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 26.97% (0.2866 => 0.3639, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 26.92% (0.0821 => 0.1042, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.89% (0.0822 => 0.1043, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/distray/distray: 26.88% (0.0398 => 0.0505, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.88% (0.4253 => 0.5396, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 26.85% (1.3152 => 1.6683, std.dev.: 0.0149) SingleSource/UnitTests/Vector/SSE/sse_isamax: 26.84% (0.0462 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 26.74% (0.0804 => 0.1019, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 26.58% (0.4029 => 0.5100, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 26.46% (0.3930 => 0.4970, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.29% (0.3271 => 0.4131, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 26.26% (0.1028 => 0.1298, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 26.22% (0.1968 => 0.2484, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 26.12% (0.2691 => 0.3394, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 26.07% (0.0491 => 0.0619, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 25.93% (0.0698 => 0.0879, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 25.83% (2.0346 => 2.5601, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 25.83% (0.1421 => 0.1788, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 25.79% (0.1462 => 0.1839, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.77% (0.4361 => 0.5485, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.74% (0.1383 => 0.1739, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 25.73% (0.5546 => 0.6973, std.dev.: 0.0009) MultiSource/Applications/ClamAV/clamscan: 25.68% (4.2109 => 5.2923, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/neural/neural: 25.63% (0.0394 => 0.0495, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 25.33% (1.4269 => 1.7884, std.dev.: 0.0030) MultiSource/Benchmarks/Ptrdist/ks/ks: 25.31% (0.0573 => 0.0718, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 25.23% (0.4658 => 0.5833, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 25.20% (0.9697 => 1.2141, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 24.91% (0.0582 => 0.0727, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.89% (1.6211 => 2.0246, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: 24.84% (1.0781 => 1.3459, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 24.78% (0.6634 => 0.8278, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 24.58% (0.2075 => 0.2585, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.56% (0.0513 => 0.0639, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.52% (0.0673 => 0.0838, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.48% (0.5584 => 0.6951, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: 24.32% (0.4847 => 0.6026, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 24.31% (0.3336 => 0.4147, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: 24.27% (0.0758 => 0.0942, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.13% (2.7292 => 3.3877, std.dev.: 0.0145) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.13% (0.0572 => 0.0710, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 23.98% (0.2068 => 0.2564, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 23.86% (0.5026 => 0.6225, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 23.66% (2.1013 => 2.5984, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 23.58% (0.1090 => 0.1347, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 23.53% (0.1160 => 0.1433, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 23.53% (0.3498 => 0.4321, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 23.46% (0.2391 => 0.2952, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.45% (0.6435 => 0.7944, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 23.38% (23.5202 => 29.0192, std.dev.: 0.0269) MultiSource/Applications/treecc/treecc: 23.25% (0.7875 => 0.9706, std.dev.: 0.0026) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.19% (0.0496 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.16% (0.2737 => 0.3371, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 23.08% (3.5627 => 4.3850, std.dev.: 0.0451) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.83% (1.9694 => 2.4191, std.dev.: 0.0133) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.66% (1.9966 => 2.4491, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 21.85% (4.4195 => 5.3852, std.dev.: 0.0376) SingleSource/Benchmarks/Misc-C++/Large/ray: 21.49% (0.3625 => 0.4404, std.dev.: 0.0002) MultiSource/Applications/JM/ldecod/ldecod: 21.47% (2.1653 => 2.6301, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 21.47% (4.6177 => 5.6089, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/bigfib: 21.15% (0.5012 => 0.6072, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 21.06% (0.3195 => 0.3868, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 20.91% (0.5826 => 0.7044, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 20.89% (0.4146 => 0.5012, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 20.87% (0.4251 => 0.5138, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 20.77% (0.5889 => 0.7112, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 20.75% (0.3726 => 0.4499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.73% (4.6926 => 5.6656, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/moments: 20.72% (0.3678 => 0.4440, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 20.69% (0.3282 => 0.3961, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/lists1: 20.48% (0.3477 => 0.4189, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 20.19% (0.3348 => 0.4024, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 20.11% (0.3362 => 0.4038, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 19.95% (0.3690 => 0.4426, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 19.81% (0.3124 => 0.3743, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 19.80% (0.2823 => 0.3382, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 19.72% (0.9909 => 1.1863, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.72% (0.3981 => 0.4766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 19.69% (0.2813 => 0.3367, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 19.65% (0.2911 => 0.3483, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 19.62% (0.3267 => 0.3908, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 19.61% (0.3060 => 0.3660, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.58% (0.2875 => 0.3438, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 19.49% (0.3258 => 0.3893, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 19.42% (0.2811 => 0.3357, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 19.26% (0.3317 => 0.3956, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.24% (2.0673 => 2.4651, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference: 19.22% (0.7171 => 0.8549, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 19.16% (0.2750 => 0.3277, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 19.14% (0.2780 => 0.3312, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.05% (0.2792 => 0.3324, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 18.96% (0.3845 => 0.4574, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 18.91% (0.2803 => 0.3333, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 18.75% (0.2714 => 0.3223, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.74% (0.2738 => 0.3251, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 18.72% (0.2725 => 0.3235, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.69% (0.2729 => 0.3239, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 18.18% (0.3004 => 0.3550, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 18.15% (0.3096 => 0.3658, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 17.09% (11.9555 => 13.9981, std.dev.: 0.0114) SingleSource/UnitTests/ObjC/parameter-passing: 17.05% (0.3724 => 0.4359, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 16.99% (0.3650 => 0.4270, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 16.91% (0.3465 => 0.4051) SingleSource/UnitTests/ObjC/exceptions-2: 16.77% (0.3446 => 0.4024, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 16.72% (0.3469 => 0.4049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.69% (0.3488 => 0.4070, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/for-in: 16.65% (0.3496 => 0.4078, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-3: 16.65% (0.3460 => 0.4036, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: 16.58% (0.3643 => 0.4247, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 16.47% (0.3442 => 0.4009, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.04% (0.3792 => 0.4059, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.88% (29.0505 => 181.5306, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.85% (0.0734 => 0.0843, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.67% (0.5917 => 0.6726, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.07% (0.3693 => 0.4065, std.dev.: 0.0020) MultiSource/Applications/ClamAV/clamscan: 9.10% (0.2802 => 0.3057, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6752, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2372, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6792, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/flops-2: 4.55% (1.8057 => 1.8879, std.dev.: 0.0036) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2903, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 1.45% (46.6247 => 47.3003, std.dev.: 0.0135) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.29% (2.1746 => 2.2027, std.dev.: 0.0024) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) MultiSource/Applications/spiff/spiff: 1.20% (4.0317 => 4.0799, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.15% (3.1722 => 3.2088, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.13% (1.0927 => 1.1051, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5392, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5940, std.dev.: 0.0086) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4788, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.80% (25.4195 => 16.5738, std.dev.: 0.0147) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.66% (17.2379 => 14.3668, std.dev.: 0.0831) SingleSource/UnitTests/Vector/multiplies: -11.37% (2.3713 => 2.1017, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary2: -8.45% (0.2402 => 0.2199, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.64% (35.5013 => 32.7873, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0043) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2071, std.dev.: 0.0149) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8033, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.29% (0.6293 => 0.6149, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -2.28% (14.0481 => 13.7279, std.dev.: 0.0965) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.1986, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (105.3826 => 104.1624, std.dev.: 0.0515) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0466, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 18:05:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 20:05:29 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129020529.6E40C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8056?compare_to=8052&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8056, Order: 173726, Start Time: 2013-01-28 23:55:19, End Time: 2013-01-29 02:05:51 To: 8052, Order: 173716, Start Time: 2013-01-28 21:26:21, End Time: 2013-01-28 23:37:56 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (170 on baseline) Performance Improvements: 10 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1047 (844 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 3.52% (52.6286 => 54.4796, std.dev.: 0.2417) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.25% (1.3961 => 1.4136, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: 24.72% (1.4236 => 1.7755, std.dev.: 0.0742) MultiSource/Benchmarks/sim/sim: 4.13% (4.0018 => 4.1672, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.71% (4.6743 => 4.7541, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/fp-convert: 1.38% (5.9040 => 5.9855, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/methcall: 1.30% (8.5689 => 8.6804, std.dev.: 0.0059) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Olden/bh/bh: -11.44% (0.4832 => 0.4279, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: -8.00% (22.9922 => 21.1534, std.dev.: 0.4995) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.93% (2.7471 => 2.5292, std.dev.: 0.0790) MultiSource/Applications/oggenc/oggenc: -7.46% (7.1005 => 6.5707, std.dev.: 0.1054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -6.37% (0.1665 => 0.1559, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.28% (0.3663 => 0.3433, std.dev.: 0.0079) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -3.37% (0.4508 => 0.4356, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.87% (3.7107 => 3.6043, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/himenobmtxpa: -1.83% (4.2230 => 4.1459, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.52% (5.3094 => 5.2285, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -4.26% (1.4860 => 1.4227, std.dev.: 0.1537) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.21% (0.0211 => 0.0222, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.62% (0.0432 => 0.0439, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 2.66% (0.0338 => 0.0347, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0322 => 0.0322, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.46% (0.0432 => 0.0434, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: 4.52% (0.0221 => 0.0231, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0251 => 0.0252, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1475 => 0.1477, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: -4.07% (1.1911 => 1.1426, std.dev.: 0.3992) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.10% (0.4244 => 0.4155, std.dev.: 0.1636) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.57% (0.1405 => 0.1413, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.23% (0.0653 => 0.0645, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.53% (0.0277 => 0.0270, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.58% (0.0611 => 0.0528, std.dev.: 0.0151) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.01% (1.2985 => 1.2854, std.dev.: 0.1176) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.98% (0.0613 => 0.0607, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.69% (0.0305 => 0.0362, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.31% (1.7593 => 1.7647, std.dev.: 0.0273) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 56.76% (0.0037 => 0.0058, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.99% (34.2012 => 33.8624, std.dev.: 0.3048) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 410.71% (0.0336 => 0.1716, std.dev.: 0.0021) SingleSource/Regression/C/sumarray2d: 96.72% (0.0274 => 0.0539, std.dev.: 0.0033) MultiSource/Benchmarks/FreeBench/neural/neural: 86.39% (0.1638 => 0.3053, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 85.90% (0.0383 => 0.0712, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 77.21% (23.5861 => 41.7960, std.dev.: 1.0291) SingleSource/Regression/C++/EH/function_try_block: 71.60% (0.0243 => 0.0417, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/objinst: 61.67% (0.0480 => 0.0776, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/exptree: 59.95% (0.0859 => 0.1374, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 56.96% (0.9564 => 1.5012, std.dev.: 0.1758) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 56.24% (0.9612 => 1.5018, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 55.95% (0.9120 => 1.4223, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 55.83% (0.8893 => 1.3858, std.dev.: 0.1565) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 55.83% (0.9588 => 1.4941, std.dev.: 0.1604) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 55.79% (0.8926 => 1.3906, std.dev.: 0.0463) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 55.38% (0.0688 => 0.1069, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 55.06% (0.9061 => 1.4050, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 54.31% (0.9381 => 1.4476, std.dev.: 0.0793) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 54.16% (0.9998 => 1.5413, std.dev.: 0.1299) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 53.77% (0.9855 => 1.5154, std.dev.: 0.0871) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 53.13% (0.8912 => 1.3647, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 52.83% (0.8990 => 1.3739, std.dev.: 0.1065) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 52.74% (0.8736 => 1.3343, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 52.58% (0.9091 => 1.3871, std.dev.: 0.0971) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 51.76% (0.9422 => 1.4299, std.dev.: 0.0950) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 51.37% (0.9512 => 1.4398, std.dev.: 0.0832) SingleSource/UnitTests/SignlessTypes/div: 51.25% (0.0320 => 0.0484, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 51.01% (1.0119 => 1.5281, std.dev.: 0.0630) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 50.71% (1.4110 => 2.1265, std.dev.: 0.0842) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 50.62% (1.0867 => 1.6368, std.dev.: 0.0499) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 49.62% (1.0017 => 1.4987, std.dev.: 0.1385) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 49.43% (0.9788 => 1.4626, std.dev.: 0.0677) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 49.29% (1.0052 => 1.5007, std.dev.: 0.0796) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 49.20% (0.8732 => 1.3028, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 48.99% (0.9488 => 1.4136, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/himenobmtxpa: 48.95% (0.1955 => 0.2912, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 48.67% (0.9867 => 1.4669, std.dev.: 0.0196) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 48.41% (0.8846 => 1.3128, std.dev.: 0.0511) SingleSource/UnitTests/2006-12-11-LoadConstants: 46.78% (0.1274 => 0.1870, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 46.58% (3.6295 => 5.3200, std.dev.: 0.1651) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.53% (0.0492 => 0.0716, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 45.26% (1.0088 => 1.4654, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 44.68% (0.9685 => 1.4012, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 44.42% (0.9550 => 1.3792, std.dev.: 0.0632) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 44.41% (0.9127 => 1.3180, std.dev.: 0.0660) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.06% (0.9993 => 1.4396, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 43.40% (0.9405 => 1.3487, std.dev.: 0.0160) SingleSource/Benchmarks/Stanford/IntMM: 42.00% (0.0431 => 0.0612, std.dev.: 0.0041) SingleSource/UnitTests/SignlessTypes/rem: 41.70% (0.1163 => 0.1648, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 41.69% (1.0860 => 1.5388, std.dev.: 0.0977) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 40.87% (1.8651 => 2.6273, std.dev.: 0.0810) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 40.81% (2.4519 => 3.4524, std.dev.: 0.1175) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 39.71% (0.4762 => 0.6653, std.dev.: 0.0213) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 39.53% (1.8127 => 2.5292, std.dev.: 0.0790) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 39.25% (0.0805 => 0.1121, std.dev.: 0.0003) SingleSource/UnitTests/2003-08-11-VaListArg: 37.91% (0.0277 => 0.0382, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 37.67% (0.0738 => 0.1016, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 37.24% (0.3598 => 0.4938, std.dev.: 0.0388) SingleSource/Benchmarks/Shootout/matrix: 36.54% (0.0821 => 0.1121, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: 36.49% (0.0296 => 0.0404, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 35.90% (9.5202 => 12.9378, std.dev.: 0.3145) SingleSource/Benchmarks/McGill/queens: 35.10% (0.0490 => 0.0662, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 34.68% (0.3374 => 0.4544, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 33.88% (0.0856 => 0.1146, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 33.18% (0.0669 => 0.0891, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 32.96% (0.0707 => 0.0940, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 32.31% (0.0783 => 0.1036, std.dev.: 0.0008) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 31.51% (0.0403 => 0.0530, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 30.74% (0.3273 => 0.4279, std.dev.: 0.0109) SingleSource/Benchmarks/McGill/chomp: 30.06% (0.1793 => 0.2332, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 30.06% (0.0845 => 0.1099, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 30.03% (0.0696 => 0.0905, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.60% (0.0733 => 0.0950, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: 28.98% (0.0797 => 0.1028, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 28.61% (16.4479 => 21.1534, std.dev.: 0.4995) MultiSource/Benchmarks/McCat/15-trie/trie: 26.98% (0.0593 => 0.0753, std.dev.: 0.0019) MultiSource/Benchmarks/Bullet/bullet: 26.63% (33.2440 => 42.0953, std.dev.: 2.5169) MultiSource/Benchmarks/Prolangs-C/football/football: 26.54% (0.9759 => 1.2349, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.36% (1.0986 => 1.3882, std.dev.: 0.0710) SingleSource/Benchmarks/Shootout/lists: 25.71% (0.0735 => 0.0924, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 25.33% (1.4392 => 1.8038, std.dev.: 0.0163) MultiSource/Benchmarks/nbench/nbench: 25.06% (1.2708 => 1.5892, std.dev.: 0.0442) MultiSource/Benchmarks/McCat/09-vor/vor: 24.96% (0.3402 => 0.4251, std.dev.: 0.0255) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.84% (0.7225 => 0.9020, std.dev.: 0.0185) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 24.23% (0.7693 => 0.9557, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.14% (0.2100 => 0.2607, std.dev.: 0.0149) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 23.91% (0.0803 => 0.0995, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/misr: 23.88% (0.0649 => 0.0804, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 23.65% (1.2680 => 1.5679, std.dev.: 0.0663) MultiSource/Benchmarks/7zip/7zip-benchmark: 23.39% (44.1538 => 54.4796, std.dev.: 0.2417) SingleSource/Benchmarks/Misc-C++/bigfib: 23.17% (0.6711 => 0.8266, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/richards_benchmark: 22.81% (0.0798 => 0.0980, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 22.73% (0.0726 => 0.0891, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 22.70% (5.3553 => 6.5707, std.dev.: 0.1054) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 22.58% (0.0713 => 0.0874, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 21.81% (17.5634 => 21.3934, std.dev.: 0.7563) SingleSource/Benchmarks/Shootout/hash: 21.63% (0.0615 => 0.0748, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 20.97% (0.4596 => 0.5560, std.dev.: 0.0148) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.77% (0.0992 => 0.1198, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 19.76% (0.0754 => 0.0903, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 19.66% (2.5772 => 3.0840, std.dev.: 0.0185) MultiSource/Applications/lemon/lemon: 19.66% (1.3979 => 1.6727, std.dev.: 0.0516) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 19.51% (0.6135 => 0.7332, std.dev.: 0.0182) SingleSource/Benchmarks/Misc/whetstone: 19.06% (0.0834 => 0.0993, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.90% (0.0963 => 0.1145, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 18.30% (2.6437 => 3.1275, std.dev.: 0.0921) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.30% (0.0776 => 0.0918, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.15% (6.4235 => 7.5896, std.dev.: 0.2634) MultiSource/Applications/JM/lencod/lencod: 17.95% (16.7012 => 19.6994, std.dev.: 0.3457) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.09% (0.3277 => 0.3837, std.dev.: 0.0180) MultiSource/Applications/d/make_dparser: 16.98% (3.7840 => 4.4267, std.dev.: 0.2336) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 16.76% (0.0704 => 0.0822, std.dev.: 0.0042) SingleSource/Benchmarks/Stanford/Oscar: 16.69% (0.0659 => 0.0769, std.dev.: 0.0012) MultiSource/Applications/JM/ldecod/ldecod: 16.52% (7.3529 => 8.5678, std.dev.: 0.2714) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 16.44% (0.2993 => 0.3485, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.92% (14.9757 => 17.3605, std.dev.: 0.5553) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 15.52% (0.2481 => 0.2866, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/ReedSolomon: 15.41% (0.2050 => 0.2366, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (4.9104 => 5.6596, std.dev.: 0.1997) MultiSource/Applications/viterbi/viterbi: 15.24% (0.1824 => 0.2102, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 15.24% (0.1109 => 0.1278, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 14.99% (17.4365 => 20.0497, std.dev.: 0.3280) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 14.68% (0.1356 => 0.1555, std.dev.: 0.0037) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.43% (7.2721 => 8.3216, std.dev.: 0.3739) MultiSource/Applications/Burg/burg: 14.38% (1.5979 => 1.8276, std.dev.: 0.0668) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 14.13% (0.1366 => 0.1559, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 13.46% (0.3715 => 0.4215, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 12.66% (18.9377 => 21.3352, std.dev.: 0.9254) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.55% (0.5059 => 0.5694, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.25% (1.0234 => 1.1385, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.07% (0.2791 => 0.3100, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.03% (0.3981 => 0.4420, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.99% (0.3093 => 0.3433, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/reversefile: 10.72% (0.3665 => 0.4058, std.dev.: 0.0152) SingleSource/Benchmarks/CoyoteBench/huffbench: 10.07% (0.1072 => 0.1180, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/oourafft: 10.05% (0.2269 => 0.2497, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/lpbench: 9.90% (0.1071 => 0.1177, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/sieve: 9.20% (0.2913 => 0.3181, std.dev.: 0.0031) SingleSource/Regression/C++/ofstream_ctor: 8.67% (0.2042 => 0.2219, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.66% (0.1755 => 0.1907, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 7.96% (0.2564 => 0.2768, std.dev.: 0.0066) MultiSource/Applications/lambda-0_1_3/lambda: 7.78% (0.8653 => 0.9326, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/ary2: 5.55% (0.2665 => 0.2813, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 5.36% (1.3220 => 1.3929, std.dev.: 0.0234) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106950.00% (0.0008 => 0.8564, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: 343.71% (1.5825 => 7.0217, std.dev.: 0.0915) MultiSource/Applications/sgefa/sgefa: 259.23% (0.3515 => 1.2627, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.32% (1.1825 => 4.0361, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.58% (4.8185 => 15.8806, std.dev.: 0.2112) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 211.84% (0.0228 => 0.0711, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 168.99% (0.0129 => 0.0347, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary: 140.52% (0.0232 => 0.0558, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 64.96% (2.9083 => 4.7974, std.dev.: 0.1736) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.55% (3.1254 => 4.1116, std.dev.: 0.0327) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.70% (1.4588 => 1.8629, std.dev.: 0.0385) SingleSource/Regression/C/uint64_to_float: 24.17% (1.5397 => 1.9118, std.dev.: 0.0177) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 24.03% (5.6033 => 6.9500, std.dev.: 0.2306) SingleSource/Benchmarks/Misc/salsa20: 21.90% (7.4497 => 9.0811, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.66% (4.8112 => 5.8052, std.dev.: 0.0248) MultiSource/Applications/JM/lencod/lencod: 15.69% (6.8159 => 7.8850, std.dev.: 0.1516) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.96% (5.0033 => 5.6517, std.dev.: 0.0307) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.78% (3.6477 => 3.9679, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 7.96% (8.6447 => 9.3332, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.87% (4.7473 => 5.0736, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.02% (0.6211 => 0.6585, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.35% (4.1836 => 4.4075, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.58% (2.2499 => 2.3530, std.dev.: 0.0245) MultiSource/Benchmarks/sim/sim: 4.09% (4.0036 => 4.1672, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.91% (5.0310 => 5.2276, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/pi: 3.53% (2.1390 => 2.2145, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.17% (2.5681 => 2.5982, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -23.25% (0.0727 => 0.0558, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.78% (11.5523 => 3.9536, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fp-convert: -61.76% (15.6525 => 5.9855, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.49% (0.4146 => 0.1804, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.73% (0.4578 => 0.2347, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.92% (11.3868 => 6.3852, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.87% (5.4023 => 3.6267, std.dev.: 0.0083) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.82% (0.4452 => 0.3080, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.53% (0.5495 => 0.3982, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.10% (5.2605 => 3.8874, std.dev.: 0.1726) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.23% (0.5826 => 0.4356, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.10% (4.4467 => 3.3304, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.06% (0.5897 => 0.4478, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.49% (4.9921 => 3.8193, std.dev.: 0.1890) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.33% (16.6791 => 13.4544, std.dev.: 0.4696) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.47% (5.8755 => 4.7901, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.00% (7.0016 => 5.8810, std.dev.: 0.1631) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.22% (3.1921 => 2.7700, std.dev.: 0.0910) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.27% (9.7992 => 8.5966, std.dev.: 0.0098) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.07% (0.0845 => 0.0743, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -11.35% (5.3626 => 4.7541, std.dev.: 0.0243) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -9.79% (0.1164 => 0.1050, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/lists1: -9.43% (0.6628 => 0.6003, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout/nestedloop: -9.41% (0.2200 => 0.1993, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: -8.49% (4.5259 => 4.1418, std.dev.: 0.1485) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.46% (0.3217 => 0.2945, std.dev.: 0.0076) MultiSource/Applications/SIBsim4/SIBsim4: -7.67% (3.5443 => 3.2723, std.dev.: 0.0270) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.05% (4.2843 => 3.9823, std.dev.: 0.0313) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2285, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.49% (23.3986 => 21.8804, std.dev.: 0.5255) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2482, std.dev.: 0.0186) SingleSource/Benchmarks/McGill/queens: -5.58% (1.7443 => 1.6470, std.dev.: 0.0032) MultiSource/Benchmarks/mafft/pairlocalalign: -5.47% (63.1520 => 59.6997, std.dev.: 0.2673) SingleSource/Benchmarks/Shootout-C++/hash2: -4.84% (3.6768 => 3.4988, std.dev.: 0.0104) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.37% (4.9799 => 4.7621, std.dev.: 0.0596) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3592, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.30% (3.7662 => 3.6043, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.28% (1.4446 => 1.3828, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4358, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.66% (5.8973 => 5.6812, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/lists: -3.01% (17.2182 => 16.6997, std.dev.: 0.0913) SingleSource/Benchmarks/Misc/mandel-2: -1.87% (0.8521 => 0.8362, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.78% (8.7327 => 8.5776, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.62% (85.3042 => 83.9185, std.dev.: 0.0243) SingleSource/Benchmarks/Misc/whetstone: -1.45% (1.6251 => 1.6015, std.dev.: 0.0061) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7022, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7483, std.dev.: 0.0239) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.12% (5.9063 => 5.8400, std.dev.: 0.0151) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.01% (8.8249 => 8.7361, std.dev.: 0.0120) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 18.10% (1.2047 => 1.4227, std.dev.: 0.1537) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.66% (0.0451 => 0.0439, std.dev.: 0.0138) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.93% (0.0394 => 0.0347, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/test1: 1.76% (0.0227 => 0.0231, std.dev.: 0.0066) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.46% (0.1530 => 0.1477, std.dev.: 0.0096) MultiSource/Applications/lemon/lemon: -40.78% (1.9293 => 1.1426, std.dev.: 0.3992) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.62% (0.4049 => 0.4155, std.dev.: 0.1636) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.42% (0.1510 => 0.1413, std.dev.: 0.0114) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.05% (0.0978 => 0.0645, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.17% (0.0276 => 0.0270, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.51% (0.0590 => 0.0528, std.dev.: 0.0151) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.65% (1.1617 => 1.2854, std.dev.: 0.1176) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0115) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.07% (0.0268 => 0.0362, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.29% (0.7437 => 1.7647, std.dev.: 0.0273) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.96% (0.0092 => 0.0058, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.00% (12.7781 => 33.8624, std.dev.: 0.3048) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 18:10:48 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 20:10:48 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129021048.574192A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8057?compare_to=8053&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8057, Order: 173726, Start Time: 2013-01-29 00:34:56, End Time: 2013-01-29 02:11:08 To: 8053, Order: 173722, Start Time: 2013-01-28 22:35:04, End Time: 2013-01-29 00:11:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 3 (211 on baseline) Performance Improvements: 0 (73 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (808 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.06% (20.2427 => 20.4567, std.dev.: 0.0506) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.59% (1.2730 => 1.2933, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/chomp: 1.23% (1.1506 => 1.1648, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 130.16% (0.0315 => 0.0725, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 91.07% (0.0280 => 0.0535, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 83.82% (0.0717 => 0.1318, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 81.32% (0.0514 => 0.0932, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 71.15% (0.0974 => 0.1667, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 62.46% (0.1132 => 0.1839, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 58.47% (0.1500 => 0.2377, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 49.06% (0.0371 => 0.0553, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 47.19% (0.0267 => 0.0393, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 46.91% (0.0599 => 0.0880, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 46.04% (0.6395 => 0.9339, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.86% (1.6474 => 2.3865, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 44.66% (0.6395 => 0.9251, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 43.67% (22.4056 => 32.1896, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/objinst: 41.77% (0.0407 => 0.0577, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 41.15% (0.0418 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.14% (0.6260 => 0.8773, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 39.91% (0.0699 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 39.89% (0.5688 => 0.7957, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 39.74% (0.6230 => 0.8706, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.72% (0.5456 => 0.7623, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.50% (0.5805 => 0.8098, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.16% (0.5567 => 0.7747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 39.12% (0.5849 => 0.8137, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 38.73% (0.5575 => 0.7734, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 38.56% (0.5581 => 0.7733, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.37% (0.5802 => 0.8028, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 38.09% (0.5705 => 0.7878, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.02% (0.5941 => 0.8200, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 37.66% (0.5478 => 0.7541, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 37.56% (0.5857 => 0.8057, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.55% (0.5569 => 0.7660, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 37.40% (0.5570 => 0.7653, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.21% (0.5859 => 0.8039, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 37.08% (0.0445 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 37.03% (0.6033 => 0.8267, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 36.81% (2.2587 => 3.0902, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 36.74% (0.5591 => 0.7645, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.65% (0.6440 => 0.8800, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.42% (0.5925 => 0.8083, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 36.18% (0.0293 => 0.0399, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 36.10% (0.6189 => 0.8423, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 35.95% (0.5863 => 0.7971, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 35.62% (0.6676 => 0.9054, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.53% (0.6052 => 0.8202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.40% (0.6446 => 0.8728, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 35.14% (0.6304 => 0.8519, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 34.71% (0.0582 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 34.68% (0.6681 => 0.8998, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 34.58% (0.6194 => 0.8336, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 34.11% (0.6660 => 0.8932, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 33.70% (0.6297 => 0.8419, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.97% (0.6667 => 0.8865, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 31.90% (0.0790 => 0.1042) MultiSource/Applications/lemon/lemon: 31.62% (1.1450 => 1.5070, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 31.45% (0.7524 => 0.9890, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.81% (0.1230 => 0.1609, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 30.71% (0.7339 => 0.9593, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 30.71% (0.0622 => 0.0813, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 30.35% (0.2659 => 0.3466, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 30.16% (0.0693 => 0.0902, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 30.11% (0.0621 => 0.0808, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 29.32% (0.0556 => 0.0719, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 28.29% (1.6364 => 2.0994, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 27.97% (0.0833 => 0.1066, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.29% (0.0634 => 0.0807, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 27.21% (0.0680 => 0.0865, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 27.03% (0.0566 => 0.0719, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.00% (3.5339 => 4.4527, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.50% (0.1796 => 0.2254, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.34% (1.2784 => 1.6023, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 25.05% (0.3357 => 0.4198, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 24.67% (5.4682 => 6.8170, std.dev.: 0.0080) MultiSource/Applications/Burg/burg: 24.43% (1.2515 => 1.5573, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.17% (0.1146 => 0.1423, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 23.34% (0.0707 => 0.0872, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 22.52% (0.7021 => 0.8602, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.02% (0.0731 => 0.0892, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 21.76% (0.0864 => 0.1052, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.60% (4.5069 => 5.4806, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 21.28% (0.1081 => 0.1311, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 20.36% (9.2283 => 11.1068, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 19.32% (0.1982 => 0.2365, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 19.20% (0.0526 => 0.0627, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 19.11% (0.0764 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 19.10% (0.0665 => 0.0792, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.98% (0.0885 => 0.1053, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 18.92% (0.4916 => 0.5846, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.49% (0.0806 => 0.0955, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.31% (0.1731 => 0.2048, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 17.88% (0.0604 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 17.79% (0.6750 => 0.7951, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/05-eks/eks: 17.74% (0.4515 => 0.5316, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: 17.71% (0.0621 => 0.0731, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 17.56% (0.0598 => 0.0703, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 17.51% (0.0571 => 0.0671, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 17.49% (0.5329 => 0.6261, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 17.40% (0.2385 => 0.2800, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 17.34% (0.0617 => 0.0724, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 17.23% (0.7447 => 0.8730, std.dev.: 0.0037) MultiSource/Applications/SPASS/SPASS: 16.85% (15.5079 => 18.1214, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.47% (1.4642 => 1.7053, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 16.24% (2.4021 => 2.7922, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 16.18% (0.2985 => 0.3468, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 16.12% (1.3864 => 1.6099, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/distray/distray: 16.00% (0.0919 => 0.1066, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 15.77% (0.0710 => 0.0822, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 15.48% (0.0704 => 0.0813) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 15.36% (0.3483 => 0.4018, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 15.31% (0.1509 => 0.1740, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 15.04% (0.1077 => 0.1239, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 14.82% (2.1401 => 2.4572, std.dev.: 0.0038) MultiSource/Applications/viterbi/viterbi: 14.70% (0.1674 => 0.1920, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: 14.68% (0.0797 => 0.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 14.59% (0.4861 => 0.5570, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash: 14.54% (0.4524 => 0.5182, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.38% (0.6293 => 0.7198, std.dev.: 0.0033) MultiSource/Applications/sqlite3/sqlite3: 14.29% (17.1032 => 19.5469, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/chomp: 14.08% (0.1761 => 0.2009, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 13.99% (4.0594 => 4.6274, std.dev.: 0.0086) MultiSource/Applications/oggenc/oggenc: 13.97% (5.0226 => 5.7245, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 13.76% (1.1530 => 1.3117, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 13.67% (3.5154 => 3.9961, std.dev.: 0.0036) SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.64% (0.9557 => 1.0861, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: 13.61% (0.8418 => 0.9564, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/voronoi/voronoi: 13.54% (0.2548 => 0.2893, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.50% (0.1096 => 0.1244, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.23% (0.3491 => 0.3953, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 12.92% (34.0927 => 38.4973, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.88% (0.1145 => 0.1281, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.85% (0.5999 => 0.6710, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/bc/bc: 11.67% (1.2300 => 1.3735, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 11.63% (0.3319 => 0.3705, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.59% (0.2001 => 0.2233, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 11.45% (0.3581 => 0.3991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 11.43% (0.0919 => 0.1024, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.32% (0.1290 => 0.1436, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 11.22% (18.2933 => 20.3458, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 10.88% (0.3658 => 0.4056, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/em3d/em3d: 10.74% (0.1862 => 0.2062, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 10.40% (15.2527 => 16.8383, std.dev.: 0.0141) SingleSource/UnitTests/SignlessTypes/rem: 10.28% (0.1197 => 0.1320, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.23% (0.1173 => 0.1293, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 10.22% (0.1076 => 0.1186, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 10.11% (0.3255 => 0.3584, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.02% (4.0323 => 4.4364, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/loader/loader: 9.97% (0.2999 => 0.3298, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 9.62% (0.1154 => 0.1265, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 9.48% (0.2278 => 0.2494, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 9.21% (0.1108 => 0.1210, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 8.97% (0.1271 => 0.1385, std.dev.: 0.0000) MultiSource/Applications/hbd/hbd: 8.91% (1.5610 => 1.7001, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/football/football: 8.85% (0.9179 => 0.9991, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.84% (0.5168 => 0.5625, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.78% (0.7198 => 0.7830, std.dev.: 0.0007) MultiSource/Applications/lambda-0_1_3/lambda: 8.76% (0.7982 => 0.8681, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 8.57% (0.1621 => 0.1760, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 8.55% (0.2106 => 0.2286, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 8.49% (1.3722 => 1.4887, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.43% (0.6736 => 0.7304, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.35% (0.7919 => 0.8580, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 8.30% (0.1879 => 0.2035, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.29% (0.4427 => 0.4794, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 8.22% (0.3271 => 0.3540, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 7.56% (0.1441 => 0.1550) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.29% (0.3142 => 0.3371, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 7.28% (4.3330 => 4.6483, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/reversefile: 6.91% (0.4083 => 0.4365, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.82% (4.8161 => 5.1446, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: 6.79% (7.0961 => 7.5776, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.69% (0.8521 => 0.9091, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 6.63% (16.1920 => 17.2658, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.62% (0.9077 => 0.9678, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 6.52% (4.8802 => 5.1984, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.35% (1.0544 => 1.1214, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.22% (0.6484 => 0.6887, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 6.10% (8.0126 => 8.5010, std.dev.: 0.0016) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.93% (6.7716 => 7.1734, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.90% (0.2695 => 0.2854, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 5.69% (2.4924 => 2.6341, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.27% (14.2083 => 14.9573, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: 4.96% (0.3446 => 0.3617, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 4.89% (0.3394 => 0.3560, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.65% (1.2221 => 1.2789, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.57% (1.2210 => 1.2768, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.47% (0.3849 => 0.4021, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.46% (0.2355 => 0.2460, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 3.99% (0.3406 => 0.3542, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.90% (0.4151 => 0.4313, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.64% (0.4813 => 0.4988, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.56% (0.9852 => 1.0203, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary2: 3.30% (0.3481 => 0.3596, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.4248 => 0.4367, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.75% (0.3931 => 0.4039, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.26% (0.9542 => 0.9662, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8051, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0037) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1484, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5357, std.dev.: 0.1023) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.65% (2.0478 => 2.1020, std.dev.: 0.0067) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6040, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5079, std.dev.: 0.0089) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2491, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.26% (79.7170 => 80.7249, std.dev.: 0.0727) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.16% (5.1955 => 5.2556, std.dev.: 0.0130) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.83% (0.3812 => 0.3628, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-2: -4.67% (0.3831 => 0.3652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.49% (0.3896 => 0.3721, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.45% (0.3884 => 0.3711, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.37% (0.3891 => 0.3721, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.24% (0.4033 => 0.3862, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -3.35% (0.3194 => 0.3087, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -3.01% (0.6347 => 0.6156, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/exceptions: -2.68% (0.4176 => 0.4064, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.22% (0.6441 => 0.6298, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.10% (0.7779 => 0.7616, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.69% (2.1713 => 2.1347, std.dev.: 0.0107) SingleSource/UnitTests/Vector/constpool: -1.53% (20.7746 => 20.4567, std.dev.: 0.0506) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.09% (1.8100 => 0.6862, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3130, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2492, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7544, std.dev.: 0.0063) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0742, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2051, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.08% (1.0217 => 0.8472, std.dev.: 0.0097) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1287, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3549, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1682, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.64% (7.1848 => 6.6360, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1768, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7752, std.dev.: 0.0154) SingleSource/Benchmarks/Shootout/ary3: -2.27% (3.7241 => 3.6394, std.dev.: 0.0145) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1739, std.dev.: 0.0087) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.64% (6.5735 => 6.4656, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.24% (1.3096 => 1.2933, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.14% (1.6307 => 1.6121, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6711, std.dev.: 0.0041) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 19:09:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 21:09:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129030951.030E12A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8058?compare_to=8054&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8058, Order: 173726, Start Time: 2013-01-29 00:51:41, End Time: 2013-01-29 03:10:09 To: 8054, Order: 173717, Start Time: 2013-01-28 22:01:30, End Time: 2013-01-29 00:20:56 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (270 on baseline) Performance Improvements: 67 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1031 (602 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.18% (10.2930 => 10.4148, std.dev.: 0.0068) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.25% (76.8766 => 77.8375, std.dev.: 0.0288) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -10.94% (131.8797 => 117.4531, std.dev.: 0.0134) MultiSource/Benchmarks/FreeBench/distray/distray: -7.15% (0.2477 => 0.2300, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.05% (0.2148 => 0.2018, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: -4.10% (21.7204 => 20.8306, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.36% (0.4670 => 0.4513, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: -3.32% (23.3775 => 22.6010, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/bh/bh: -3.28% (0.4360 => 0.4217, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.91% (0.3986 => 0.3870, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: -2.82% (0.4542 => 0.4414, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -2.81% (3.2540 => 3.1627, std.dev.: 0.0171) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.72% (0.9962 => 0.9691, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.69% (0.4021 => 0.3913, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: -2.60% (86.2478 => 84.0081, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.48% (0.4518 => 0.4406, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.28% (0.4727 => 0.4619, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.07% (1.2429 => 1.2172, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.06% (7.8639 => 7.7020, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: -1.92% (1.0321 => 1.0123, std.dev.: 0.0019) MultiSource/Applications/lua/lua: -1.91% (5.3409 => 5.2389, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -1.82% (1.5696 => 1.5411, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.81% (0.7221 => 0.7090, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.69% (2.4213 => 2.3804, std.dev.: 0.0125) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.69% (5.7387 => 5.6419, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: -1.63% (0.9045 => 0.8898, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.58% (0.8238 => 0.8108, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.57% (0.7768 => 0.7646, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.56% (0.9247 => 0.9103, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: -1.55% (7.8813 => 7.7592, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.54% (0.9062 => 0.8922, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -1.54% (0.7745 => 0.7626, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: -1.53% (1.9227 => 1.8932, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.49% (0.9009 => 0.8875, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.48% (0.8634 => 0.8506, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.48% (0.9382 => 0.9243, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.47% (1.0424 => 1.0271, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.46% (3.6020 => 3.5494, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.43% (0.8159 => 0.8042, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.41% (0.8129 => 0.8014, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.39% (0.8363 => 0.8247, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.38% (0.8522 => 0.8404, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.38% (0.9606 => 0.9473, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.38% (0.7740 => 0.7633, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.38% (0.9989 => 0.9851, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.38% (0.8182 => 0.8069, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -1.38% (0.7607 => 0.7502, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (0.8343 => 0.8230, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -1.35% (22.9609 => 22.6510, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.34% (0.9413 => 0.9287, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.32% (2.7746 => 2.7380, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.32% (2.1035 => 2.0758, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.30% (1.1427 => 1.1278, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.28% (1.0189 => 1.0059, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.25% (0.9810 => 0.9687, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.22% (0.9455 => 0.9340, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.21% (1.0553 => 1.0425, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: -1.20% (2.7878 => 2.7544, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.19% (0.9699 => 0.9584, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.18% (1.0789 => 1.0662, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.16% (0.8929 => 0.8825, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.14% (0.9539 => 0.9430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.14% (0.8774 => 0.8674, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.14% (1.5830 => 1.5650, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.10% (1.0191 => 1.0079, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: -1.09% (4.5618 => 4.5119, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.09% (0.9342 => 0.9240, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: -1.07% (1.6090 => 1.5918, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.07% (1.9483 => 1.9275, std.dev.: 0.0023) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1329 => 0.1329, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0681 => 0.0680, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8394 => 499.8436, std.dev.: 0.0057) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44224.16% (1.1277 => 499.8436, std.dev.: 0.0057) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 262.06% (0.5229 => 1.8932, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 38.97% (14.9895 => 20.8306, std.dev.: 0.0049) MultiSource/Applications/kimwitu++/kc: 60.02% (14.1553 => 22.6510, std.dev.: 0.0124) MultiSource/Benchmarks/MallocBench/gs/gs: 29.39% (4.1105 => 5.3187, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 87.89% (1.1048 => 2.0758, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1540.82% (7.1582 => 117.4531, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++-EH/spirit: 122.41% (3.4629 => 7.7020, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_container: 95.63% (0.6222 => 1.2172, std.dev.: 0.0007) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10267.50% (0.0720 => 7.4646, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 11152100.00% (0.0001 => 11.1522, std.dev.: 0.0400) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488200.00% (0.0001 => 5.4883, std.dev.: 0.0106) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 830.39% (1.1194 => 10.4148, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops: 179.68% (0.1432 => 0.4005, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/factor: 170.95% (0.0296 => 0.0802, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 157.66% (22.1758 => 57.1376, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/lowercase: 138.67% (0.0256 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 117.80% (0.1056 => 0.2300, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 111.11% (0.0243 => 0.0513, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.55% (0.0929 => 0.1891, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 100.62% (7.0540 => 14.1517, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/objinst: 99.53% (0.0427 => 0.0852, std.dev.: 0.0008) SingleSource/UnitTests/2006-01-23-UnionInit: 87.76% (0.0237 => 0.0445, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 87.22% (0.1463 => 0.2739, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 85.07% (0.0730 => 0.1351, std.dev.: 0.0010) SingleSource/Regression/C/casts: 81.13% (0.0318 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 73.58% (0.0439 => 0.0762, std.dev.: 0.0000) SingleSource/UnitTests/Vector/simple: 72.97% (0.0185 => 0.0320, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 72.83% (0.2554 => 0.4414, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 72.65% (1.5859 => 2.7380, std.dev.: 0.0051) SingleSource/Regression/C/sumarray2d: 70.85% (0.0271 => 0.0463, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 62.29% (2.9384 => 4.7688, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 61.16% (2.2024 => 3.5494, std.dev.: 0.0109) SingleSource/Regression/C++/EH/function_try_block: 60.82% (0.0268 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 60.61% (8.1363 => 13.0678, std.dev.: 0.0057) SingleSource/UnitTests/2002-05-02-CastTest: 60.55% (0.0218 => 0.0350, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 59.31% (0.0231 => 0.0368, std.dev.: 0.0000) SingleSource/Regression/C/uint64_to_float: 57.56% (0.0377 => 0.0594) SingleSource/Regression/C/testtrace: 57.55% (0.0212 => 0.0334) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 56.68% (0.0217 => 0.0340, std.dev.: 0.0001) SingleSource/UnitTests/2003-05-31-CastToBool: 54.95% (0.0202 => 0.0313, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 54.87% (0.0636 => 0.0985, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 54.42% (1.5415 => 2.3804, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/ary3: 54.31% (0.0232 => 0.0358) MultiSource/Applications/sgefa/sgefa: 54.26% (0.3109 => 0.4796, std.dev.: 0.0042) SingleSource/UnitTests/2006-12-11-LoadConstants: 53.02% (0.1143 => 0.1749, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 51.62% (1.1642 => 1.7652, std.dev.: 0.0061) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 51.31% (0.0953 => 0.1442, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0282 => 0.0423, std.dev.: 0.0000) SingleSource/UnitTests/vla: 48.73% (0.0355 => 0.0528, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 48.71% (0.1125 => 0.1673, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 48.48% (21.9371 => 32.5720, std.dev.: 0.0146) MultiSource/Benchmarks/McCat/04-bisect/bisect: 48.40% (0.1062 => 0.1576, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 47.41% (0.0793 => 0.1169, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 47.26% (0.0457 => 0.0673, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 46.97% (0.0479 => 0.0704, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 45.75% (4.2646 => 6.2157, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/exptree: 45.45% (0.0814 => 0.1184, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 45.18% (0.6675 => 0.9691, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 44.95% (3.8922 => 5.6419, std.dev.: 0.0067) MultiSource/Applications/lemon/lemon: 43.73% (1.0722 => 1.5411, std.dev.: 0.0049) SingleSource/UnitTests/SignlessTypes/Large/cast: 43.44% (0.0564 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 43.33% (0.2700 => 0.3870, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 42.31% (0.0527 => 0.0750, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 42.28% (0.7115 => 1.0123, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 41.71% (0.4615 => 0.6540, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 41.51% (0.0730 => 0.1033, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: 41.02% (0.0295 => 0.0416, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/partialsums: 40.82% (0.0245 => 0.0345) SingleSource/Benchmarks/Shootout/matrix: 40.59% (0.0818 => 0.1150, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 40.55% (0.2271 => 0.3192, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 40.31% (9.4845 => 13.3078, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/messages-2: 40.03% (0.0662 => 0.0927, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/div: 39.92% (0.0258 => 0.0361, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 39.61% (0.0467 => 0.0652, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.48% (0.1892 => 0.2639, std.dev.: 0.0010) SingleSource/UnitTests/block-copied-in-cxxobj: 39.35% (0.0310 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 39.18% (0.0462 => 0.0643, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 39.01% (0.0746 => 0.1037, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 38.88% (0.5105 => 0.7090, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 38.69% (0.0672 => 0.0932, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 38.39% (0.1555 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 38.31% (0.1655 => 0.2289, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 37.97% (0.0640 => 0.0883, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 37.92% (0.4299 => 0.5929, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 37.83% (0.6456 => 0.8898, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 37.69% (2.2969 => 3.1627, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 37.53% (0.5860 => 0.8059, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 37.40% (0.1695 => 0.2329, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 37.36% (0.1175 => 0.1614, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 37.13% (0.0719 => 0.0986, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/hash: 36.70% (0.0485 => 0.0663, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/family/family: 36.52% (0.0397 => 0.0542, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 36.38% (0.3092 => 0.4217, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 35.97% (0.0770 => 0.1047, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 35.87% (1.4186 => 1.9275, std.dev.: 0.0023) MultiSource/Applications/treecc/treecc: 35.87% (2.0273 => 2.7544, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 35.85% (0.1032 => 0.1402, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 35.73% (0.1044 => 0.1417, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 35.70% (0.7835 => 1.0632, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 35.29% (3.8723 => 5.2389, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 35.28% (0.5569 => 0.7534, std.dev.: 0.0030) MultiSource/Applications/d/make_dparser: 35.27% (3.3354 => 4.5119, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 35.26% (0.0675 => 0.0913, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/lists: 34.82% (0.0626 => 0.0844, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 34.73% (5.7591 => 7.7592, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/messages: 34.56% (0.0327 => 0.0440, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 34.54% (0.3121 => 0.4199, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 34.44% (1.1840 => 1.5918, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 34.23% (0.3441 => 0.4619, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 34.09% (0.0660 => 0.0885, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 34.00% (0.4879 => 0.6538, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/em3d/em3d: 33.92% (0.1695 => 0.2270, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 33.77% (0.3423 => 0.4579, std.dev.: 0.0013) SingleSource/Benchmarks/Stanford/Queens: 33.57% (0.0414 => 0.0553, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 33.55% (0.0933 => 0.1246, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 33.23% (0.3307 => 0.4406, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 33.23% (0.4620 => 0.6155, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 33.18% (0.0437 => 0.0582, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 33.04% (0.4289 => 0.5706, std.dev.: 0.0027) MultiSource/Benchmarks/Bullet/bullet: 32.83% (63.2438 => 84.0081, std.dev.: 0.0087) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 32.66% (0.0447 => 0.0593, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 32.66% (0.0842 => 0.1117, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 32.63% (0.2758 => 0.3658, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: 32.59% (0.0316 => 0.0419, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 32.51% (0.1584 => 0.2099, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 32.33% (0.1268 => 0.1678, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 32.18% (0.2107 => 0.2785, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/queens: 32.01% (0.0403 => 0.0532) MultiSource/Benchmarks/Ptrdist/bc/bc: 31.95% (1.1861 => 1.5650, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 31.83% (0.0886 => 0.1168, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 31.74% (0.1566 => 0.2063, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 31.69% (0.3427 => 0.4513, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 31.64% (0.1163 => 0.1531, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 31.55% (17.1811 => 22.6010, std.dev.: 0.0030) MultiSource/Applications/aha/aha: 31.28% (0.1151 => 0.1511) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 31.11% (0.0389 => 0.0510) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 30.98% (0.0326 => 0.0427, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 30.91% (0.1236 => 0.1618, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.85% (0.8172 => 1.0693, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 30.68% (0.0528 => 0.0690, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 30.38% (0.7433 => 0.9691, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 29.90% (0.0408 => 0.0530, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 29.74% (0.1029 => 0.1335) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 29.64% (0.1906 => 0.2471, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 29.64% (0.0614 => 0.0796, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 29.62% (1.3050 => 1.6916, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.49% (0.5981 => 0.7745, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 29.38% (0.1940 => 0.2510, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 29.21% (0.1510 => 0.1951, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 29.05% (0.0592 => 0.0764, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.95% (0.1337 => 0.1724, std.dev.: 0.0006) MultiSource/Benchmarks/sim/sim: 28.79% (0.3387 => 0.4362, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/dot-syntax: 28.73% (0.0355 => 0.0457) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 28.30% (0.8067 => 1.0350, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.25% (4.9449 => 6.3417, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 28.03% (0.9765 => 1.2502, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 28.01% (0.0482 => 0.0617, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 27.99% (0.3180 => 0.4070, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 27.95% (0.6450 => 0.8253, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.92% (0.0770 => 0.0985, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: 27.90% (0.0871 => 0.1114, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 27.80% (0.0633 => 0.0809, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 27.72% (0.8921 => 1.1394, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: 27.63% (0.0456 => 0.0582, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Towers: 27.60% (0.0471 => 0.0601, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.57% (0.1117 => 0.1425, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/treeadd/treeadd: 27.40% (0.0416 => 0.0530, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/rem: 27.36% (0.1144 => 0.1457, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 27.24% (5.0018 => 6.3643, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/mason/mason: 27.13% (0.0811 => 0.1031, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/five11/five11: 26.98% (0.0567 => 0.0720, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.95% (0.5020 => 0.6373, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 26.75% (1.5603 => 1.9777, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: 26.69% (0.3098 => 0.3925, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Treesort: 26.52% (0.0411 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.48% (0.8101 => 1.0246, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 25.74% (0.2603 => 0.3273, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 25.15% (0.2266 => 0.2836, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 25.05% (0.4203 => 0.5256, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 24.89% (0.0442 => 0.0552) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 24.60% (0.0443 => 0.0552) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.10% (0.0834 => 0.1035, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 23.93% (0.3865 => 0.4790, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 23.30% (0.0648 => 0.0799, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.17% (0.3177 => 0.3913, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 22.81% (0.0491 => 0.0603, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 22.56% (0.0798 => 0.0978, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.47% (0.4103 => 0.5025, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 22.34% (0.0479 => 0.0586, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 21.67% (0.1440 => 0.1752, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: 21.41% (0.0481 => 0.0584, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.23% (0.1625 => 0.1970, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.87% (0.2065 => 0.2496, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.79% (14.3668 => 17.3540, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 20.38% (0.1114 => 0.1341, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 20.31% (0.0704 => 0.0847, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 19.88% (0.4064 => 0.4872, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 19.80% (0.3283 => 0.3933, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 19.78% (0.4636 => 0.5553, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 19.56% (0.3282 => 0.3924, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 19.46% (0.3232 => 0.3861, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 19.40% (0.0536 => 0.0640, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 19.18% (0.2049 => 0.2442, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 18.88% (0.3379 => 0.4017, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.74% (0.0838 => 0.0995, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 18.58% (0.0759 => 0.0900, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 18.52% (0.2430 => 0.2880, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 18.16% (0.4048 => 0.4783, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 17.66% (0.1438 => 0.1692, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.56% (0.3826 => 0.4498, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 17.43% (0.3603 => 0.4231, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 17.11% (0.3886 => 0.4551, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 16.69% (0.3684 => 0.4299, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.42% (0.2905 => 0.3382, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 16.31% (0.3422 => 0.3980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.23% (0.3650 => 0.4206, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 15.21% (2.2022 => 2.5371, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.85% (0.3927 => 0.4510, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ffbench: 14.61% (0.0705 => 0.0808, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 14.56% (0.3935 => 0.4508, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 13.72% (0.1268 => 0.1442, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 13.32% (0.3828 => 0.4338, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 13.20% (1.2842 => 1.4537, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 12.78% (0.3162 => 0.3566, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.56% (0.1330 => 0.1497, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 12.26% (0.2831 => 0.3178, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/except: 12.12% (0.2871 => 0.3219, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.77% (2.0665 => 2.3098, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.77% (0.3543 => 0.3960, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 11.30% (0.2877 => 0.3202, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.29% (0.3694 => 0.4111, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.98% (0.3516 => 0.3902, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.90% (7.9617 => 8.8292, std.dev.: 0.0081) MultiSource/Benchmarks/PAQ8p/paq8p: 10.77% (10.3673 => 11.4837, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.75% (0.3136 => 0.3473, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.63% (0.2756 => 0.3049, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 10.20% (0.2725 => 0.3003, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.07% (0.2891 => 0.3182, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 10.06% (0.7326 => 0.8063, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 10.06% (0.2714 => 0.2987, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.03% (0.2793 => 0.3073, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.98% (0.6030 => 0.6632, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.96% (0.3052 => 0.3356, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.67% (0.2802 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.64% (0.2872 => 0.3149, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.79% (0.5925 => 0.6446, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 6.77% (0.3131 => 0.3343, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.72% (0.3817 => 0.3959, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8953, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4736, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 15.94% (1.1145 => 1.2922, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: 9.34% (1.1396 => 1.2460, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.72% (11.6436 => 12.4265, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.16% (4.2280 => 4.4462, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3127, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.36% (0.9957 => 1.0292, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9074, std.dev.: 0.0142) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.46% (1.0313 => 1.0567, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.37% (3.6395 => 3.7257, std.dev.: 0.0053) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2561, std.dev.: 0.0345) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 1.41% (27.8444 => 28.2365, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4560, std.dev.: 0.0198) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -96.98% (6.6874 => 0.2018, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.47% (5.2763 => 1.2945, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -74.62% (0.8651 => 0.2196, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -36.37% (0.1622 => 0.1032) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.47% (5.3855 => 4.9295, std.dev.: 0.0016) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9593, std.dev.: 0.0278) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.75% (5.3526 => 4.9377, std.dev.: 0.0027) MultiSource/Applications/JM/ldecod/ldecod: -5.48% (10.4361 => 9.8642, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.86% (1.7609 => 1.6930, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.39% (1.9577 => 0.6580, std.dev.: 0.0095) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.25% (0.0400 => 0.0207) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -34.74% (0.3987 => 0.2602, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3058, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.67% (1.5373 => 1.0197, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/mandel: -33.46% (1.1492 => 0.7647, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.57% (10.7105 => 7.4364, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -24.94% (85.0658 => 63.8523, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.38% (2.6546 => 2.0073, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1262, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4209, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7356, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4936, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.92% (1.8329 => 1.7060, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.85% (19.9488 => 18.5828, std.dev.: 0.0201) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.21% (0.2497 => 0.2342, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.19% (1.2373 => 1.1607, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.00% (1.6805 => 1.5797, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.50% (8.1563 => 7.7074, std.dev.: 0.0081) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5091, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -4.59% (10.2830 => 9.8112, std.dev.: 0.0191) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.58% (0.4808 => 0.4588, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1543, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3298, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: -1.59% (3.6994 => 3.6407, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: -1.20% (4.6441 => 4.5886, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.09% (6.2999 => 6.2313, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0018) Report Time: 1.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 20:12:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 22:12:12 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129041212.9B8AD2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8059?compare_to=8057&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8059, Order: 173752, Start Time: 2013-01-29 02:34:49, End Time: 2013-01-29 04:12:33 To: 8057, Order: 173726, Start Time: 2013-01-29 00:34:56, End Time: 2013-01-29 02:11:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 138 (240 on baseline) Performance Improvements: 0 (72 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 966 (780 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.95% (32.1896 => 37.3227, std.dev.: 0.0113) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.87% (0.1609 => 0.1800, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 11.17% (0.3466 => 0.3853, std.dev.: 0.0014) SingleSource/Benchmarks/SmallPT/smallpt: 10.08% (0.1557 => 0.1714, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 9.43% (0.4018 => 0.4397, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.91% (6.8170 => 7.4247, std.dev.: 0.0125) MultiSource/Applications/SPASS/SPASS: 8.90% (18.1214 => 19.7348, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.34% (0.2254 => 0.2442, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.96% (0.8602 => 0.9287, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 7.93% (0.3468 => 0.3743, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 7.78% (2.7922 => 3.0094, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 7.42% (19.5469 => 20.9964, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.36% (0.2893 => 0.3106, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 7.16% (38.4973 => 41.2520, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.98% (0.3953 => 0.4229, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 6.93% (0.8730 => 0.9335, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 6.68% (1.5070 => 1.6077, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.51% (0.4056 => 0.4320, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.47% (1.6023 => 1.7060, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.44% (0.1740 => 0.1852, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.25% (0.2048 => 0.2176, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.21% (1.0861 => 1.1536, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 6.17% (2.0994 => 2.2289, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.07% (4.4527 => 4.7231, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 5.95% (2.4572 => 2.6034, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 5.87% (0.1839 => 0.1947, std.dev.: 0.0000) MultiSource/Applications/lua/lua: 5.84% (4.6274 => 4.8976, std.dev.: 0.0140) MultiSource/Benchmarks/nbench/nbench: 5.82% (1.3117 => 1.3880, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.65% (0.6261 => 0.6615, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.51% (3.0902 => 3.2604, std.dev.: 0.0092) MultiSource/Applications/Burg/burg: 5.50% (1.5573 => 1.6430, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 5.46% (0.7198 => 0.7591, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 5.46% (0.7951 => 0.8385, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 5.38% (3.9961 => 4.2110, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.37% (2.3865 => 2.5147, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.37% (0.6710 => 0.7070, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 5.35% (20.3458 => 21.4350, std.dev.: 0.0099) MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.6099 => 1.6942, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.22% (0.7830 => 0.8239, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/18-imp/imp: 5.16% (0.3991 => 0.4197, std.dev.: 0.0002) MultiSource/Benchmarks/7zip/7zip-benchmark: 4.95% (48.2017 => 50.5894, std.dev.: 0.0092) MultiSource/Benchmarks/Ptrdist/bc/bc: 4.86% (1.3735 => 1.4402, std.dev.: 0.0015) MultiSource/Benchmarks/PAQ8p/paq8p: 4.81% (2.6341 => 2.7607, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 4.77% (0.3540 => 0.3709, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 4.77% (0.9564 => 1.0020, std.dev.: 0.0041) MultiSource/Applications/ClamAV/clamscan: 4.73% (16.8383 => 17.6348, std.dev.: 0.0096) MultiSource/Applications/oggenc/oggenc: 4.62% (5.7245 => 5.9891, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.58% (0.3298 => 0.3449, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 4.57% (0.2494 => 0.2608, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.38% (0.8580 => 0.8956, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.37% (1.0203 => 1.0649, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 4.35% (0.9991 => 1.0426, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.27% (0.2854 => 0.2976, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.19% (4.4364 => 4.6221, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 4.15% (0.4365 => 0.4546, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.15% (0.2460 => 0.2562, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.98% (0.7304 => 0.7595, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 3.94% (0.8681 => 0.9023, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 3.91% (0.5570 => 0.5788, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 3.91% (17.2658 => 17.9414, std.dev.: 0.0153) MultiSource/Applications/hbd/hbd: 3.84% (1.7001 => 1.7654, std.dev.: 0.0049) MultiSource/Applications/JM/ldecod/ldecod: 3.78% (7.5776 => 7.8643, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.74% (0.3371 => 0.3497, std.dev.: 0.0000) SingleSource/Benchmarks/Linpack/linpack-pc: 3.72% (0.2850 => 0.2956, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.72% (0.5625 => 0.5834, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 3.70% (1.2122 => 1.2571, std.dev.: 0.0015) MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.69% (1.2125 => 1.2573, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.69% (0.4794 => 0.4971, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.69% (0.9593 => 0.9947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.68% (0.8706 => 0.9026, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 3.64% (1.7053 => 1.7674, std.dev.: 0.0057) MultiSource/Benchmarks/mafft/pairlocalalign: 3.61% (11.1068 => 11.5074, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.57% (0.7878 => 0.8159, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.55% (5.4806 => 5.6753, std.dev.: 0.0048) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.55% (7.1734 => 7.4277, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.54% (0.4573 => 0.4735, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.52% (0.9251 => 0.9577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.51% (0.8200 => 0.8488, std.dev.: 0.0062) MultiSource/Benchmarks/sim/sim: 3.50% (0.3542 => 0.3666, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 3.50% (0.8865 => 0.9175, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.49% (0.8419 => 0.8713, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/gs/gs: 3.48% (4.6483 => 4.8100, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.43% (0.9054 => 0.9365) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.43% (0.9339 => 0.9659, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.42% (0.9091 => 0.9402, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/hash: 3.42% (0.5182 => 0.5359, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.41% (0.8083 => 0.8359, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.41% (0.4313 => 0.4460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.40% (0.7645 => 0.7905, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 3.38% (0.7660 => 0.7919, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.38% (14.9573 => 15.4622, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.37% (0.8336 => 0.8617, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.37% (1.1214 => 1.1592, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.37% (0.8728 => 0.9022, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.36% (0.8932 => 0.9232, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.35% (0.8028 => 0.8297, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.35% (0.7971 => 0.8238, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.33% (0.8057 => 0.8325, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.33% (0.6887 => 0.7116, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.31% (0.8039 => 0.8305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.30% (0.8202 => 0.8473, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.29% (0.7653 => 0.7905, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.29% (0.4988 => 0.5152, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 3.29% (0.4198 => 0.4336, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.29% (0.9890 => 1.0215, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.27% (0.7733 => 0.7986, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.26% (0.4021 => 0.4152, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 3.25% (5.1984 => 5.3674, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.24% (0.7541 => 0.7785, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.23% (0.8800 => 0.9084, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.21% (0.9678 => 0.9989, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 3.21% (0.3705 => 0.3824, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.21% (0.8098 => 0.8358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.20% (0.8998 => 0.9286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.18% (0.8137 => 0.8396, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 3.18% (0.4367 => 0.4506, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.17% (0.8267 => 0.8529, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 3.16% (1.4887 => 1.5358, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.12% (0.8773 => 0.9047, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.12% (0.7734 => 0.7975, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 3.11% (5.1446 => 5.3044, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.10% (0.7957 => 0.8204, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.09% (8.5010 => 8.7638, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.07% (1.2789 => 1.3182, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.05% (0.7747 => 0.7983, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.02% (1.2768 => 1.3154, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.01% (0.8519 => 0.8775, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.98% (0.5846 => 0.6020, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.97% (0.8423 => 0.8673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 2.89% (0.3947 => 0.4061, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.79% (0.7623 => 0.7836, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 2.77% (0.5316 => 0.5463, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 2.75% (0.3887 => 0.3994, std.dev.: 0.0003) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.75% (0.6002 => 0.6167, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.53% (0.4039 => 0.4141, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.35% (0.9662 => 0.9889, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: 1.79% (1.3191 => 1.3427, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.19% (2.1347 => 2.1602, std.dev.: 0.0005) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 133.97% (0.0315 => 0.0737, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 97.14% (0.0280 => 0.0552, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 88.56% (0.0717 => 0.1352, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 87.16% (0.0514 => 0.0962, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 75.26% (0.0974 => 0.1707, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 72.00% (0.1132 => 0.1947, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 66.58% (22.4056 => 37.3227, std.dev.: 0.0113) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 66.31% (0.0371 => 0.0617, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 64.60% (0.1500 => 0.2469, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/objinst: 56.02% (0.0407 => 0.0635, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 52.65% (1.6474 => 2.5147, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 51.25% (0.0599 => 0.0906, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 51.04% (0.6395 => 0.9659, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 50.56% (0.0267 => 0.0402, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 49.76% (0.6395 => 0.9577, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 46.34% (0.1230 => 0.1800, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 45.49% (0.0699 => 0.1017, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 44.90% (0.2659 => 0.3853, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 44.88% (0.6230 => 0.9026, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 44.52% (0.6260 => 0.9047, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 44.35% (2.2587 => 3.2604, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 44.33% (0.0582 => 0.0840, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 44.23% (0.5688 => 0.8204, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 43.98% (0.5805 => 0.8358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 43.62% (0.5456 => 0.7836, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 43.55% (0.5849 => 0.8396, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 43.40% (0.5567 => 0.7983, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 43.30% (0.0418 => 0.0599, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 43.09% (0.5581 => 0.7986, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.05% (0.5575 => 0.7975, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 43.01% (0.5705 => 0.8159, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 43.00% (0.5802 => 0.8297, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 42.92% (0.0445 => 0.0636) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 42.87% (0.5941 => 0.8488, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 42.20% (0.5569 => 0.7919, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 42.14% (0.5857 => 0.8325, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 42.11% (0.5478 => 0.7785, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 41.92% (0.5570 => 0.7905, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 41.75% (0.5859 => 0.8305, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 41.39% (0.5591 => 0.7905, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.37% (0.6033 => 0.8529, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 41.08% (0.5925 => 0.8359, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 41.06% (0.6440 => 0.9084, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 40.51% (0.5863 => 0.8238, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 40.41% (1.1450 => 1.6077, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 40.28% (0.6676 => 0.9365) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 40.14% (0.6189 => 0.8673, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 40.00% (0.6052 => 0.8473, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 39.96% (0.6446 => 0.9022, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.20% (0.6304 => 0.8775, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 39.12% (0.6194 => 0.8617, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 38.99% (0.6681 => 0.9286, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 38.62% (0.6660 => 0.9232, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 38.37% (0.6297 => 0.8713, std.dev.: 0.0011) SingleSource/Regression/C/sumarray2d: 37.88% (0.0293 => 0.0404, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 37.62% (0.0622 => 0.0856, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 37.62% (0.6667 => 0.9175, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 36.46% (0.0790 => 0.1078, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 36.21% (1.6364 => 2.2289, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 36.18% (0.0680 => 0.0926, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/himenobmtxpa: 35.97% (0.1796 => 0.2442, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 35.78% (5.4682 => 7.4247, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.77% (0.7524 => 1.0215, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 35.54% (0.7339 => 0.9947, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 35.43% (0.0556 => 0.0753, std.dev.: 0.0003) SingleSource/Regression/C++/EH/function_try_block: 35.17% (0.0290 => 0.0392, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 34.49% (0.0693 => 0.0932, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 34.46% (0.0621 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 33.65% (3.5339 => 4.7231, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.45% (1.2784 => 1.7060, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 33.22% (0.0566 => 0.0754, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 33.13% (0.0833 => 0.1109, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 32.33% (0.0634 => 0.0839, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.27% (0.7021 => 0.9287, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 31.28% (1.2515 => 1.6430, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: 30.60% (0.0621 => 0.0811, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 30.55% (0.0707 => 0.0923, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 30.08% (0.0665 => 0.0865, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 29.16% (0.3357 => 0.4336, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 28.27% (0.1146 => 0.1470, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.49% (0.0764 => 0.0974, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 27.32% (0.0604 => 0.0769, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 27.26% (15.5079 => 19.7348, std.dev.: 0.0088) SingleSource/Benchmarks/McGill/exptree: 26.50% (0.0864 => 0.1093, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 26.24% (0.3483 => 0.4397, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 25.99% (0.0731 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.92% (4.5069 => 5.6753, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 25.71% (0.1731 => 0.2176, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 25.65% (0.0885 => 0.1112, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 25.56% (0.0806 => 0.1012, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: 25.46% (0.0919 => 0.1153, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 25.39% (0.2985 => 0.3743, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 25.35% (0.7447 => 0.9335, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 25.35% (0.1081 => 0.1355, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 25.28% (2.4021 => 3.0094, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 25.22% (0.0571 => 0.0715, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 25.10% (0.0526 => 0.0658) MultiSource/Benchmarks/mafft/pairlocalalign: 24.70% (9.2283 => 11.5074, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 24.22% (0.6750 => 0.8385, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 24.13% (0.5329 => 0.6615, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 23.47% (0.0524 => 0.0647) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 22.91% (0.1982 => 0.2436, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 22.76% (17.1032 => 20.9964, std.dev.: 0.0120) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 22.73% (0.1509 => 0.1852, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 22.46% (0.4916 => 0.6020, std.dev.: 0.0057) MultiSource/Applications/SIBsim4/SIBsim4: 22.20% (1.3864 => 1.6942, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 22.08% (0.0797 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 22.01% (0.1077 => 0.1314, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.90% (0.2548 => 0.3106, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 21.73% (0.0704 => 0.0857, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 21.65% (2.1401 => 2.6034, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 21.55% (0.0710 => 0.0863, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.39% (0.0617 => 0.0749, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 21.22% (0.2385 => 0.2891, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.14% (0.3491 => 0.4229, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 21.06% (0.0508 => 0.0615, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 21.00% (34.0927 => 41.2520, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 21.00% (0.4515 => 0.5463, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 20.90% (0.0488 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.71% (1.4642 => 1.7674, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.71% (0.9557 => 1.1536, std.dev.: 0.0051) MultiSource/Applications/lua/lua: 20.65% (4.0594 => 4.8976, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.63% (0.6293 => 0.7591, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 20.43% (0.1674 => 0.2016, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 20.40% (0.0598 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 20.38% (1.1530 => 1.3880, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 20.16% (0.1096 => 0.1317, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 19.79% (3.5154 => 4.2110, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 19.52% (0.0589 => 0.0704) MultiSource/Applications/oggenc/oggenc: 19.24% (5.0226 => 5.9891, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: 19.10% (0.0686 => 0.0817, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 19.07% (0.4861 => 0.5788, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 19.03% (0.8418 => 1.0020, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 18.57% (0.1761 => 0.2088, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 18.49% (0.0741 => 0.0878, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 18.46% (0.4524 => 0.5359, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.10% (0.3658 => 0.4320, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.85% (0.5999 => 0.7070, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 17.83% (0.0645 => 0.0760, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 17.66% (0.0708 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 17.51% (0.0611 => 0.0718, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/18-imp/imp: 17.20% (0.3581 => 0.4197, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 17.17% (18.2933 => 21.4350, std.dev.: 0.0099) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.09% (1.2300 => 1.4402, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/lists: 16.86% (0.0688 => 0.0804, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 16.65% (0.0919 => 0.1072, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 16.54% (0.0762 => 0.0888) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 16.42% (0.1145 => 0.1333, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.20% (0.1290 => 0.1499, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 15.62% (15.2527 => 17.6348, std.dev.: 0.0096) MultiSource/Benchmarks/Olden/em3d/em3d: 15.41% (0.1862 => 0.2149, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 15.22% (0.3319 => 0.3824, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 15.20% (0.1197 => 0.1379, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.15% (0.1076 => 0.1239, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 15.01% (0.2999 => 0.3449, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/power/power: 14.99% (0.1154 => 0.1327, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 14.70% (0.0932 => 0.1069, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.63% (4.0323 => 4.6221, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.58% (0.1173 => 0.1344, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 14.49% (0.2278 => 0.2608, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.46% (0.7198 => 0.8239, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.27% (0.0974 => 0.1113, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/football/football: 13.59% (0.9179 => 1.0426, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 13.39% (0.2001 => 0.2269, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 13.39% (0.3271 => 0.3709, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 13.21% (0.0833 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 13.10% (0.7919 => 0.8956, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 13.09% (1.5610 => 1.7654, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/tsp/tsp: 13.06% (0.1202 => 0.1359, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 13.04% (0.7982 => 0.9023, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 12.89% (0.5168 => 0.5834, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.75% (0.6736 => 0.7595, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/mst/mst: 12.75% (0.1271 => 0.1433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 12.70% (0.0961 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 12.63% (0.2106 => 0.2372, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.55% (0.1108 => 0.1247, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 12.52% (0.1621 => 0.1824, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 12.29% (0.4427 => 0.4971, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 12.23% (0.3255 => 0.3653, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.92% (1.3722 => 1.5358, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.34% (0.4083 => 0.4546, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 11.30% (0.3142 => 0.3497, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 11.01% (4.3330 => 4.8100, std.dev.: 0.0157) MultiSource/Applications/aha/aha: 10.98% (0.1211 => 0.1344) MultiSource/Applications/JM/ldecod/ldecod: 10.83% (7.0961 => 7.8643, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 10.80% (16.1920 => 17.9414, std.dev.: 0.0153) MultiSource/Benchmarks/PAQ8p/paq8p: 10.76% (2.4924 => 2.7607, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.43% (0.2695 => 0.2976, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.8521 => 0.9402, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.15% (0.1231 => 0.1356, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 10.14% (4.8161 => 5.3044, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.05% (0.9077 => 0.9989, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 9.98% (4.8802 => 5.3674, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 9.94% (1.0544 => 1.1592, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 9.85% (0.1879 => 0.2064, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.75% (0.6484 => 0.7116, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.69% (6.7716 => 7.4277, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 9.58% (0.4321 => 0.4735, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 9.38% (8.0126 => 8.7638, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 9.37% (0.1441 => 0.1576, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.83% (14.2083 => 15.4622, std.dev.: 0.0139) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.79% (0.2355 => 0.2562, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 8.64% (0.1354 => 0.1471, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (0.9852 => 1.0649, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.87% (0.3849 => 0.4152, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 7.86% (1.2221 => 1.3182, std.dev.: 0.0041) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.73% (1.2210 => 1.3154, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 7.63% (0.3406 => 0.3666, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 7.44% (0.4151 => 0.4460, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 7.18% (0.2160 => 0.2315, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 7.04% (0.4813 => 0.5152, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 6.79% (0.3446 => 0.3680, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 6.48% (0.3394 => 0.3614, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 6.07% (0.4248 => 0.4506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 5.44% (0.3788 => 0.3994, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 5.34% (0.3931 => 0.4141, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.15% (0.2428 => 0.2553, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 5.02% (0.3867 => 0.4061, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 5.00% (0.3481 => 0.3655, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 3.64% (0.9542 => 0.9889, std.dev.: 0.0021) SingleSource/Regression/C++/ofstream_ctor: 3.60% (0.3059 => 0.3169, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 3.59% (0.3621 => 0.3751, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.39% (0.3837 => 0.3967, std.dev.: 0.0043) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.14% (0.3821 => 0.3941, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 2.12% (1.3148 => 1.3427, std.dev.: 0.0015) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8097, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0012) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6332, std.dev.: 0.1140) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.69% (18.2231 => 18.5311, std.dev.: 0.0116) MultiSource/Applications/sqlite3/sqlite3: 1.60% (4.5320 => 4.6044, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2485, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.32% (5.1955 => 5.2643, std.dev.: 0.0028) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4552, std.dev.: 0.0253) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/trivial-interface: -4.09% (0.3812 => 0.3656, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3831 => 0.3686, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-4: -3.74% (0.3880 => 0.3735, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.63% (0.3884 => 0.3743) SingleSource/UnitTests/ObjC/exceptions-3: -3.48% (0.3848 => 0.3714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.47% (0.3896 => 0.3761, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.44% (0.3891 => 0.3757, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.12% (0.4033 => 0.3907, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -2.84% (0.6347 => 0.6167, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -1.77% (0.6441 => 0.6327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -1.63% (20.7746 => 20.4360, std.dev.: 0.0473) SingleSource/UnitTests/ObjC++/property-reference: -1.43% (0.7779 => 0.7668, std.dev.: 0.0002) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.51% (1.8100 => 0.6966, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.10% (6.6713 => 3.3957, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3094, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.74% (1.3643 => 1.0268, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -23.49% (7.5137 => 5.7490, std.dev.: 0.0037) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0816, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.96% (4.1024 => 3.2017, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary: -21.80% (0.0757 => 0.0592, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.02% (0.6299 => 0.5038, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.03% (0.3418 => 0.2836, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.22% (2.5106 => 2.1286, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3557, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.46% (0.8545 => 0.8164, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.48% (3.7241 => 3.6316, std.dev.: 0.0129) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.46% (7.9763 => 7.7800, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1177, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1719, std.dev.: 0.0301) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.58% (6.5735 => 6.4694, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6109, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.19% (1.6086 => 1.5894, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 20:39:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 22:39:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129043950.4E3E52A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8060?compare_to=8056&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8060, Order: 173752, Start Time: 2013-01-29 02:25:55, End Time: 2013-01-29 04:40:12 To: 8056, Order: 173726, Start Time: 2013-01-28 23:55:19, End Time: 2013-01-29 02:05:51 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 40 (200 on baseline) Performance Improvements: 5 (42 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1019 (821 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: 44.41% (0.0340 => 0.0491, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.07% (1.5148 => 1.7886, std.dev.: 0.0664) MultiSource/Benchmarks/Prolangs-C/loader/loader: 17.51% (0.4117 => 0.4838, std.dev.: 0.0172) MultiSource/Applications/ALAC/encode/alacconvert-encode: 11.67% (1.3646 => 1.5238, std.dev.: 0.0574) SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.31% (0.4544 => 0.5058, std.dev.: 0.0105) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 9.98% (5.4660 => 6.0116, std.dev.: 0.0956) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.29% (1.3882 => 1.5172, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.09% (1.4396 => 1.5705, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.73% (1.4669 => 1.5950, std.dev.: 0.0180) MultiSource/Benchmarks/mafft/pairlocalalign: 8.29% (12.9378 => 14.0103, std.dev.: 0.3849) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.28% (1.3906 => 1.5057, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 8.12% (1.4254 => 1.5411, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.98% (1.5007 => 1.6204, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 7.88% (1.3128 => 1.4163, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.3539 => 0.3796, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.23% (1.3328 => 1.4291, std.dev.: 0.0243) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.44% (41.7960 => 44.4875, std.dev.: 0.6764) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.38% (1.4626 => 1.5559, std.dev.: 0.0282) SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.84% (0.4420 => 0.4678, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 5.80% (0.1777 => 0.1880, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.65% (1.3028 => 1.3764, std.dev.: 0.0193) SingleSource/Benchmarks/Shootout-C++/objinst: 5.13% (0.2241 => 0.2356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.09% (1.4136 => 1.4856, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.46% (1.3695 => 1.4306, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.45% (1.6368 => 1.7097, std.dev.: 0.0243) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 79.29% (0.1560 => 0.2797, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout/ary3: 44.64% (8.1794 => 11.8304, std.dev.: 0.7484) MultiSource/Benchmarks/Olden/bisort/bisort: 41.99% (0.6459 => 0.9171, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.27% (1.4605 => 1.8442, std.dev.: 0.0187) SingleSource/Benchmarks/CoyoteBench/fftbench: 21.54% (1.4533 => 1.7663, std.dev.: 0.0818) SingleSource/Benchmarks/CoyoteBench/lpbench: 18.30% (4.0866 => 4.8343, std.dev.: 0.1418) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.25% (2.4943 => 2.9496, std.dev.: 0.0815) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.89% (0.3273 => 0.3662, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.79% (1.2455 => 1.3051, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/tsp/tsp: 4.44% (1.4930 => 1.5593, std.dev.: 0.0222) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.17% (13.4544 => 14.0157, std.dev.: 0.1229) SingleSource/Benchmarks/Linpack/linpack-pc: 3.39% (50.8872 => 52.6125, std.dev.: 0.2906) MultiSource/Benchmarks/nbench/nbench: 2.62% (20.7813 => 21.3250, std.dev.: 0.2099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.51% (15.8806 => 16.1206, std.dev.: 0.0581) MultiSource/Benchmarks/BitBench/five11/five11: 1.18% (5.6219 => 5.6885, std.dev.: 0.0206) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/sim/sim: -3.84% (4.1672 => 4.0072, std.dev.: 0.0110) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.92% (2.8358 => 2.7531, std.dev.: 0.0171) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -2.01% (0.9023 => 0.8842, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.47% (2.3772 => 2.3423, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.42% (4.7541 => 4.6864, std.dev.: 0.0087) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.67% (1.4227 => 1.4891, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0222 => 0.0223, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.91% (0.0439 => 0.0443, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.88% (0.0347 => 0.0337, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0322 => 0.0321, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0434 => 0.0434, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0207 => 0.0209, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: -3.90% (0.0231 => 0.0222, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 34.13% (0.0252 => 0.0338, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.27% (0.1477 => 0.1473, std.dev.: 0.0279) MultiSource/Applications/lemon/lemon: 2.68% (1.1426 => 1.1732, std.dev.: 0.4118) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.20% (0.4155 => 0.4105, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.59% (0.1413 => 0.1492, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.86% (0.0645 => 0.0657, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.59% (0.0270 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.98% (0.0528 => 0.0586, std.dev.: 0.0023) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.10% (1.2854 => 1.2867, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.08% (0.0026 => 0.0032, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.14% (0.0607 => 0.0620, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.59% (0.0362 => 0.0349, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.97% (1.7647 => 1.7475, std.dev.: 0.0121) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: -75.00% (0.0004 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -31.03% (0.0058 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.45% (33.8624 => 34.3518, std.dev.: 0.1347) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 402.98% (0.0336 => 0.1690, std.dev.: 0.0034) SingleSource/Regression/C/sumarraymalloc: 136.18% (0.0293 => 0.0692, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 103.39% (0.0383 => 0.0779, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 101.46% (0.0274 => 0.0552, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 94.62% (0.0688 => 0.1339, std.dev.: 0.0238) MultiSource/Benchmarks/FreeBench/neural/neural: 89.26% (0.1638 => 0.3100, std.dev.: 0.0527) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 88.62% (23.5861 => 44.4875, std.dev.: 0.6764) SingleSource/Regression/C++/EH/function_try_block: 86.83% (0.0243 => 0.0454, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 81.45% (0.0539 => 0.0978, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 71.96% (0.9564 => 1.6446, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 68.69% (0.8926 => 1.5057, std.dev.: 0.0201) SingleSource/Regression/C/sumarray: 68.30% (0.0265 => 0.0446, std.dev.: 0.0010) SingleSource/Regression/C/casts: 67.53% (0.0388 => 0.0650, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/objinst: 65.00% (0.0480 => 0.0792, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 64.78% (0.8893 => 1.4654, std.dev.: 0.0488) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 64.48% (0.9127 => 1.5012, std.dev.: 0.1489) MultiSource/Benchmarks/Olden/mst/mst: 64.12% (0.1335 => 0.2191, std.dev.: 0.0267) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 63.89% (0.9403 => 1.5411, std.dev.: 0.0085) SingleSource/UnitTests/SignlessTypes/shr: 63.55% (0.0310 => 0.0507, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 62.94% (0.9588 => 1.5623, std.dev.: 0.1114) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 62.17% (0.9381 => 1.5213, std.dev.: 0.1103) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 61.65% (0.9867 => 1.5950, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 61.57% (0.9612 => 1.5530, std.dev.: 0.0525) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 61.22% (0.8736 => 1.4084, std.dev.: 0.0532) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 61.20% (1.0052 => 1.6204, std.dev.: 0.0426) SingleSource/UnitTests/2003-05-31-CastToBool: 60.77% (0.0260 => 0.0418, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 60.35% (0.4762 => 0.7636, std.dev.: 0.0938) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 60.11% (0.8846 => 1.4163, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 59.58% (0.9998 => 1.5955, std.dev.: 0.0661) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 58.96% (0.9788 => 1.5559, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 58.85% (0.9061 => 1.4393, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 58.78% (0.9010 => 1.4306, std.dev.: 0.0214) SingleSource/UnitTests/SignlessTypes/div: 58.75% (0.0320 => 0.0508, std.dev.: 0.0014) SingleSource/UnitTests/2003-05-26-Shorts: 58.56% (0.0222 => 0.0352, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 58.32% (0.0859 => 0.1360, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 58.32% (0.9091 => 1.4393, std.dev.: 0.1573) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 58.04% (1.0119 => 1.5992, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 57.63% (0.8732 => 1.3764, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 57.62% (0.8912 => 1.4047, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 57.57% (0.9855 => 1.5529, std.dev.: 0.0613) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 57.55% (0.8990 => 1.4164, std.dev.: 0.0924) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 57.33% (1.0867 => 1.7097, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 57.16% (0.9993 => 1.5705, std.dev.: 0.0371) MultiSource/Benchmarks/FreeBench/mason/mason: 56.87% (0.0793 => 0.1244, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 56.84% (0.9685 => 1.5190, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 56.75% (0.9422 => 1.4769, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 56.58% (0.9488 => 1.4856, std.dev.: 0.0219) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 55.13% (1.4110 => 2.1889, std.dev.: 0.1262) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 54.81% (0.9512 => 1.4726, std.dev.: 0.0834) SingleSource/Benchmarks/Misc/himenobmtxpa: 54.53% (0.1955 => 0.3021, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 53.91% (3.6295 => 5.5860, std.dev.: 0.2399) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 53.81% (0.9405 => 1.4466, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 53.42% (0.9507 => 1.4586, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 52.08% (1.0017 => 1.5234, std.dev.: 0.0312) MultiSource/Benchmarks/McCat/08-main/main: 52.08% (0.2915 => 0.4433, std.dev.: 0.0572) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 51.83% (0.9550 => 1.4500, std.dev.: 0.0447) SingleSource/Benchmarks/Shootout-C++/wordfreq: 49.91% (0.3374 => 0.5058, std.dev.: 0.0105) SingleSource/UnitTests/SignlessTypes/rem: 49.87% (0.1163 => 0.1743, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 49.53% (2.4519 => 3.6664, std.dev.: 0.1045) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 49.22% (1.0088 => 1.5053, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 47.93% (1.0860 => 1.6065, std.dev.: 0.0333) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 47.68% (1.8651 => 2.7544, std.dev.: 0.0663) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 47.51% (1.8127 => 2.6740, std.dev.: 0.1092) MultiSource/Benchmarks/mafft/pairlocalalign: 47.16% (9.5202 => 14.0103, std.dev.: 0.3849) SingleSource/UnitTests/2002-05-02-CastTest: 45.45% (0.0253 => 0.0368, std.dev.: 0.0024) SingleSource/UnitTests/2003-07-09-SignedArgs: 44.73% (0.0275 => 0.0398, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 43.57% (0.7776 => 1.1164, std.dev.: 0.0616) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 43.50% (0.0738 => 0.1059, std.dev.: 0.0086) SingleSource/UnitTests/2006-01-23-UnionInit: 43.12% (0.0269 => 0.0385, std.dev.: 0.0040) SingleSource/UnitTests/2003-08-11-VaListArg: 40.43% (0.0277 => 0.0389, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 40.28% (4.6406 => 6.5098, std.dev.: 0.4079) SingleSource/Benchmarks/McGill/queens: 40.00% (0.0490 => 0.0686, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: 39.89% (0.0351 => 0.0491, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 39.63% (0.0805 => 0.1124, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 39.30% (0.0486 => 0.0677, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: 38.97% (0.3598 => 0.5000, std.dev.: 0.0538) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 38.10% (1.0986 => 1.5172, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.08% (0.0738 => 0.1019, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout/matrix: 36.66% (0.0821 => 0.1122, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 35.90% (0.3560 => 0.4838, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/football/football: 35.80% (0.9759 => 1.3253, std.dev.: 0.0674) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 35.71% (0.1305 => 0.1771, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 35.51% (0.0642 => 0.0870, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 35.40% (0.1384 => 0.1874, std.dev.: 0.0161) MultiSource/Applications/SPASS/SPASS: 35.35% (16.4479 => 22.2623, std.dev.: 0.9283) MultiSource/Benchmarks/Bullet/bullet: 34.41% (33.2440 => 44.6829, std.dev.: 1.6879) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.38% (1.3310 => 1.7886, std.dev.: 0.0664) SingleSource/Benchmarks/McGill/chomp: 33.85% (0.1793 => 0.2400, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 33.59% (0.0783 => 0.1046, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.47% (0.0733 => 0.0971, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: 32.18% (0.0696 => 0.0920, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/espresso/espresso: 32.02% (5.0381 => 6.6513, std.dev.: 0.2963) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.62% (0.2884 => 0.3796, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 31.24% (0.0845 => 0.1109, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 30.40% (0.1240 => 0.1617, std.dev.: 0.0092) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.04% (0.5369 => 0.6982, std.dev.: 0.0249) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 29.62% (0.2100 => 0.2722, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 29.06% (4.6579 => 6.0116, std.dev.: 0.0956) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 28.74% (0.0762 => 0.0981, std.dev.: 0.0053) SingleSource/Regression/C/uint64_to_float: 28.61% (0.0409 => 0.0526, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: 28.49% (0.1369 => 0.1759, std.dev.: 0.0124) MultiSource/Benchmarks/7zip/7zip-benchmark: 28.24% (44.1538 => 56.6213, std.dev.: 2.9333) MultiSource/Benchmarks/Olden/bisort/bisort: 28.09% (0.0737 => 0.0944, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 27.96% (0.7693 => 0.9844, std.dev.: 0.0309) MultiSource/Benchmarks/Ptrdist/bc/bc: 27.91% (1.2680 => 1.6219, std.dev.: 0.0950) MultiSource/Benchmarks/nbench/nbench: 27.64% (1.2708 => 1.6220, std.dev.: 0.0955) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 27.57% (0.0486 => 0.0620, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 27.45% (1.4392 => 1.8343, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.45% (0.7225 => 0.9208, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 27.28% (0.6711 => 0.8542, std.dev.: 0.0163) SingleSource/UnitTests/Vectorizer/gcc-loops: 26.28% (0.4596 => 0.5804, std.dev.: 0.0173) SingleSource/Benchmarks/Dhrystone/dry: 25.99% (0.0531 => 0.0669, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 25.94% (0.0798 => 0.1005, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 25.87% (0.0889 => 0.1119, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.81% (0.9214 => 1.1592, std.dev.: 0.0240) SingleSource/Benchmarks/McGill/misr: 25.73% (0.0649 => 0.0816, std.dev.: 0.0018) SingleSource/Benchmarks/Linpack/linpack-pc: 25.64% (0.2566 => 0.3224, std.dev.: 0.0026) MultiSource/Applications/ALAC/encode/alacconvert-encode: 25.37% (1.2154 => 1.5238, std.dev.: 0.0574) MultiSource/Applications/oggenc/oggenc: 25.33% (5.3553 => 6.7118, std.dev.: 0.1721) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 25.13% (0.0963 => 0.1205, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/matrix: 25.12% (0.2385 => 0.2984, std.dev.: 0.0049) MultiSource/Applications/sqlite3/sqlite3: 24.91% (17.5634 => 21.9393, std.dev.: 1.0202) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 24.73% (0.0918 => 0.1145, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.29% (1.1498 => 1.4291, std.dev.: 0.0243) MultiSource/Applications/lemon/lemon: 24.14% (1.3979 => 1.7353, std.dev.: 0.0758) MultiSource/Benchmarks/PAQ8p/paq8p: 23.47% (2.5772 => 3.1820, std.dev.: 0.0994) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 23.28% (0.0713 => 0.0879, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.96% (0.0479 => 0.0589, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++-EH/spirit: 22.60% (6.4235 => 7.8752, std.dev.: 0.3140) MultiSource/Applications/siod/siod: 22.34% (2.6437 => 3.2343, std.dev.: 0.1788) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 21.76% (0.0726 => 0.0884, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.49% (0.1317 => 0.1600, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: 21.28% (0.1109 => 0.1345, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/whetstone: 20.98% (0.0834 => 0.1009, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.97% (14.9757 => 18.1166, std.dev.: 0.6397) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.49% (0.0976 => 0.1176, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 20.46% (0.0963 => 0.1160, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: 20.11% (16.7012 => 20.0598, std.dev.: 0.8536) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 20.04% (0.2879 => 0.3456, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 19.93% (18.9377 => 22.7112, std.dev.: 0.6719) SingleSource/Benchmarks/CoyoteBench/almabench: 19.76% (0.0754 => 0.0903, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 19.72% (0.0776 => 0.0929, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 19.58% (3.7840 => 4.5250, std.dev.: 0.2480) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 19.47% (0.0637 => 0.0761, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 19.24% (17.4365 => 20.7905, std.dev.: 1.2055) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 19.05% (0.0588 => 0.0700, std.dev.: 0.0010) MultiSource/Applications/JM/ldecod/ldecod: 18.78% (7.3529 => 8.7335, std.dev.: 0.3294) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 18.75% (0.0704 => 0.0836, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.51% (0.3981 => 0.4678, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 16.86% (0.2283 => 0.2668, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 16.40% (0.1366 => 0.1590, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 15.93% (0.1563 => 0.1812, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 15.91% (0.1622 => 0.1880, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ReedSolomon: 15.71% (0.2050 => 0.2372, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 15.35% (0.0697 => 0.0804, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.98% (0.5059 => 0.5817, std.dev.: 0.0170) SingleSource/Benchmarks/CoyoteBench/huffbench: 12.50% (0.1072 => 0.1206, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 11.55% (0.2709 => 0.3022, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/fftbench: 11.26% (0.3847 => 0.4280, std.dev.: 0.0143) SingleSource/Benchmarks/Shootout-C++/objinst: 9.58% (0.2150 => 0.2356, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 8.50% (0.4002 => 0.4342, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/lists: 7.74% (0.2725 => 0.2936, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary: 7.25% (0.2551 => 0.2736, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107100.00% (0.0008 => 0.8576, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/ary3: 430.42% (2.2304 => 11.8304, std.dev.: 0.7484) SingleSource/Benchmarks/Shootout/matrix: 355.31% (1.5825 => 7.2053, std.dev.: 0.0780) MultiSource/Applications/sgefa/sgefa: 259.32% (0.3515 => 1.2630, std.dev.: 0.0279) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.71% (1.1825 => 4.0525, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 234.56% (4.8185 => 16.1206, std.dev.: 0.0581) SingleSource/Benchmarks/Shootout-C++/ary2: 204.65% (0.0129 => 0.0393, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 186.40% (0.0228 => 0.0653, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 142.24% (0.0232 => 0.0562, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/mst/mst: 87.59% (0.1491 => 0.2797, std.dev.: 0.0344) SingleSource/Benchmarks/Shootout-C++/matrix: 65.47% (2.9083 => 4.8124, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.52% (3.1254 => 4.1105, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.15% (0.2562 => 0.3360, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.64% (1.4588 => 1.8328, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.81% (5.6033 => 6.9372, std.dev.: 0.2864) SingleSource/Regression/C/uint64_to_float: 23.24% (1.5397 => 1.8975, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: 22.34% (7.4497 => 9.1136, std.dev.: 0.0288) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.66% (4.8112 => 5.8054, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.19% (2.5170 => 2.9496, std.dev.: 0.0815) MultiSource/Applications/JM/lencod/lencod: 13.92% (6.8159 => 7.7648, std.dev.: 0.1112) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.28% (5.1752 => 5.8626, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.96% (5.0033 => 5.6517, std.dev.: 0.0099) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.58% (9.0082 => 10.0516, std.dev.: 0.3769) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (3.6477 => 3.9694, std.dev.: 0.0086) SingleSource/Benchmarks/CoyoteBench/lpbench: 8.54% (4.4540 => 4.8343, std.dev.: 0.1418) SingleSource/Benchmarks/Misc/ReedSolomon: 8.30% (8.6447 => 9.3621, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.34% (4.7473 => 5.0959, std.dev.: 0.0384) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (0.6211 => 0.6577, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.21% (4.1836 => 4.4014, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.75% (5.0310 => 5.2701, std.dev.: 0.0657) MultiSource/Benchmarks/nbench/nbench: 3.97% (20.5117 => 21.3250, std.dev.: 0.2099) MultiSource/Benchmarks/Olden/tsp/tsp: 3.84% (1.5017 => 1.5593, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.40% (4.7254 => 4.8860, std.dev.: 0.0197) SingleSource/Benchmarks/Linpack/linpack-pc: 3.38% (50.8945 => 52.6125, std.dev.: 0.2906) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.16% (5.9115 => 5.9800, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.08% (4.9763 => 5.0300, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.04% (4.3851 => 4.4309, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.84% (11.5523 => 3.9466, std.dev.: 0.0414) SingleSource/Benchmarks/Misc/fp-convert: -61.88% (15.6525 => 5.9662, std.dev.: 0.0651) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.71% (0.4146 => 0.1795, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.54% (0.4578 => 0.2356, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.87% (11.3868 => 6.3913, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.76% (5.4023 => 3.6327, std.dev.: 0.0487) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.93% (0.4452 => 0.3075, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.19% (0.5495 => 0.4001, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.09% (5.2605 => 3.8878, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.80% (0.5826 => 0.4381, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.23% (0.5897 => 0.4468, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.14% (4.4467 => 3.3734, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.29% (4.9921 => 3.8294, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: -22.20% (1.8123 => 1.4099, std.dev.: 0.1438) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.22% (5.8755 => 4.8049, std.dev.: 0.0326) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.97% (16.6791 => 14.0157, std.dev.: 0.1229) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.69% (7.0016 => 5.9730, std.dev.: 0.1290) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.99% (3.1921 => 2.7773, std.dev.: 0.0447) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.97% (0.1164 => 0.1013, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.61% (5.3626 => 4.6864, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.39% (9.7992 => 8.5846, std.dev.: 0.0428) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.21% (5.7056 => 5.0088, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout/nestedloop: -9.91% (0.2200 => 0.1982, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -7.79% (3.5443 => 3.2681, std.dev.: 0.0652) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.58% (4.2843 => 4.0026, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.37% (5.5974 => 5.2408, std.dev.: 0.0366) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.90% (1.4446 => 1.3594, std.dev.: 0.0307) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.81% (4.5424 => 4.2787, std.dev.: 0.0485) SingleSource/Benchmarks/McGill/queens: -5.26% (1.7443 => 1.6526, std.dev.: 0.0152) MultiSource/Benchmarks/mafft/pairlocalalign: -5.21% (63.1520 => 59.8609, std.dev.: 0.1069) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.10% (4.9799 => 4.7257, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout-C++/hash2: -4.66% (3.6768 => 3.5054, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.63% (3.7662 => 3.5920, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.95% (3.5127 => 3.3739, std.dev.: 0.0388) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.33% (5.8973 => 5.7011, std.dev.: 0.0423) SingleSource/Benchmarks/Shootout-C++/lists: -3.04% (17.2182 => 16.6946, std.dev.: 0.2019) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.59% (85.3042 => 83.9459, std.dev.: 0.0842) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.59% (8.7327 => 8.5937, std.dev.: 0.0228) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.39% (8.8249 => 8.7018, std.dev.: 0.0478) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0014) SingleSource/Benchmarks/SmallPT/smallpt: -1.26% (14.9448 => 14.7564, std.dev.: 0.0577) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (3.7450 => 3.7014, std.dev.: 0.0034) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 23.61% (1.2047 => 1.4891, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0052) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.77% (0.0451 => 0.0443, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0035) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0016) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0038) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 32.55% (0.0255 => 0.0338, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.73% (0.1530 => 0.1473, std.dev.: 0.0279) MultiSource/Applications/lemon/lemon: -39.19% (1.9293 => 1.1732, std.dev.: 0.4118) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.38% (0.4049 => 0.4105, std.dev.: 0.0254) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.19% (0.1510 => 0.1492, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.82% (0.0978 => 0.0657, std.dev.: 0.0154) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.68% (0.0590 => 0.0586, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.76% (1.1617 => 1.2867, std.dev.: 0.0351) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 18.52% (0.0027 => 0.0032, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.64% (0.0610 => 0.0620, std.dev.: 0.0120) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.22% (0.0268 => 0.0349, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.97% (0.7437 => 1.7475, std.dev.: 0.0121) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -56.52% (0.0092 => 0.0040, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.83% (12.7781 => 34.3518, std.dev.: 0.1347) Report Time: 0.91s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 21:19:39 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Mon, 28 Jan 2013 23:19:39 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130129051939.E489A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8061?compare_to=8055&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8061, Order: 173726, Start Time: 2013-01-29 01:45:23, End Time: 2013-01-29 05:19:59 To: 8055, Order: 173711, Start Time: 2013-01-28 20:49:52, End Time: 2013-01-29 00:25:34 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (198 on baseline) Performance Improvements: 43 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1060 (739 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.43% (126.2223 => 129.2901, std.dev.: 0.3177) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.96% (0.2705 => 0.2598, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.33% (14.9678 => 14.4697, std.dev.: 0.0073) MultiSource/Applications/SPASS/SPASS: -3.20% (7.0635 => 6.8375, std.dev.: 0.0245) MultiSource/Applications/sqlite3/sqlite3: -2.84% (2.5601 => 2.4873, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -2.51% (0.8278 => 0.8070, std.dev.: 0.0027) MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.41% (0.5527 => 0.5394, std.dev.: 0.0021) SingleSource/UnitTests/Vector/constpool: -2.38% (2.5510 => 2.4904, std.dev.: 0.0127) MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.33% (0.5526 => 0.5397, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.32% (0.6951 => 0.6790, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -2.13% (2.5984 => 2.5430, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash: -2.02% (0.5012 => 0.4911, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.99% (0.7944 => 0.7786, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: -1.97% (0.5138 => 0.5037, std.dev.: 0.0006) MultiSource/Applications/lua/lua: -1.96% (1.7884 => 1.7533, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.90% (2.4651 => 2.4183, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -1.88% (1.1863 => 1.1640, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -1.88% (0.5485 => 0.5382, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.86% (5.6656 => 5.5600, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: -1.86% (0.6072 => 0.5959, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: -1.85% (0.9706 => 0.9526, std.dev.: 0.0053) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.83% (3.3877 => 3.3258, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.75% (0.5833 => 0.5731, std.dev.: 0.0025) MultiSource/Applications/ClamAV/clamscan: -1.74% (5.2923 => 5.2004, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference-object: -1.69% (0.7112 => 0.6992, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: -1.68% (13.9981 => 13.7636, std.dev.: 0.0061) MultiSource/Applications/JM/lencod/lencod: -1.65% (5.6089 => 5.5162, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -1.63% (2.6301 => 2.5871, std.dev.: 0.0048) SingleSource/UnitTests/ObjC++/Hello: -1.62% (0.7044 => 0.6930, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: -1.61% (2.4027 => 2.3640, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.60% (2.4191 => 2.3803, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.56% (1.0064 => 0.9907, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -1.54% (0.8549 => 0.8417, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.54% (0.6609 => 0.6507, std.dev.: 0.0026) MultiSource/Applications/d/make_dparser: -1.52% (1.3459 => 1.3254, std.dev.: 0.0041) MultiSource/Applications/Burg/burg: -1.46% (0.6973 => 0.6871, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: -1.42% (2.1458 => 2.1153, std.dev.: 0.0040) MultiSource/Benchmarks/7zip/7zip-benchmark: -1.37% (27.1052 => 26.7348, std.dev.: 0.0135) MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.36% (2.0246 => 1.9970, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: -1.34% (29.0192 => 28.6312, std.dev.: 0.0133) MultiSource/Applications/hbd/hbd: -1.29% (1.2141 => 1.1984, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.25% (1.6683 => 1.6475, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.16% (4.3850 => 4.3342, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.04% (5.3852 => 5.3293, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.76% (0.0625 => 0.0936, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 48.59% (0.5361 => 0.7966, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.60% (0.0547 => 0.0780, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.01% (0.1063 => 0.1467, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 34.28% (0.1088 => 0.1461) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 33.41% (0.7426 => 0.9907, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 32.82% (0.1106 => 0.1469, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 32.77% (1.5932 => 2.1153, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.72% (0.0331 => 0.0436, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.05% (0.5900 => 0.7732, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 30.92% (0.2969 => 0.3887, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 30.85% (0.4139 => 0.5416, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 30.76% (0.4994 => 0.6530, std.dev.: 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.66% (0.0897 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.14% (0.5000 => 0.6507, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones/fhourstones: 30.14% (0.0584 => 0.0760, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 29.55% (0.0599 => 0.0776, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/08-main/main: 29.47% (0.1218 => 0.1577, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 29.40% (0.0415 => 0.0537, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 28.64% (0.0604 => 0.0777, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.43% (0.0714 => 0.0917, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 28.34% (0.0561 => 0.0720, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 28.34% (0.0808 => 0.1037, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.07% (0.0367 => 0.0470, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.79% (0.0475 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.57% (0.0584 => 0.0745, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 27.45% (0.0419 => 0.0534, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 27.44% (0.0481 => 0.0613, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 27.35% (0.2040 => 0.2598, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.05% (0.1549 => 0.1968, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.00% (0.0563 => 0.0715) MultiSource/Benchmarks/Olden/bh/bh: 26.95% (0.1284 => 0.1630, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/17-bintr/bintr: 26.92% (0.0390 => 0.0495, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.92% (0.1003 => 0.1273, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: 26.87% (0.0495 => 0.0628) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.70% (0.0457 => 0.0579, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 26.69% (0.0948 => 0.1201, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 26.65% (0.1107 => 0.1402, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.64% (0.1021 => 0.1293, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.62% (0.1604 => 0.2031, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 26.62% (0.0541 => 0.0685, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 26.59% (0.0440 => 0.0557, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 26.54% (0.0633 => 0.0801, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 26.45% (0.1505 => 0.1903, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 26.35% (0.0425 => 0.0537, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.29% (0.1103 => 0.1393) MultiSource/Benchmarks/McCat/05-eks/eks: 26.25% (0.1619 => 0.2044, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.17% (0.1620 => 0.2044, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.17% (0.0642 => 0.0810, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 26.13% (0.3084 => 0.3890, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 26.13% (0.2736 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.05% (0.4253 => 0.5361, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 26.03% (0.2566 => 0.3234, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 25.88% (0.0452 => 0.0569, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 25.87% (0.0947 => 0.1192, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: 25.78% (1.8794 => 2.3640, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 25.75% (0.3903 => 0.4908, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.63% (0.3890 => 0.4887, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 25.43% (0.0822 => 0.1031, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 25.33% (0.0821 => 0.1029, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 25.32% (0.0462 => 0.0579) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 25.27% (1.3152 => 1.6475, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.05% (0.2866 => 0.3584, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 25.02% (0.2014 => 0.2518, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 24.96% (0.3930 => 0.4911, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 24.88% (0.0804 => 0.1004, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 24.73% (0.2103 => 0.2623, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 24.65% (0.4029 => 0.5022, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/mst/mst: 24.36% (0.0698 => 0.0868, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.34% (0.3271 => 0.4067, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 24.31% (11.6398 => 14.4697, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 24.30% (0.0605 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 24.09% (0.1968 => 0.2442, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 24.01% (0.1462 => 0.1813, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 23.89% (0.5546 => 0.6871, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 23.79% (0.1421 => 0.1759, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 23.64% (0.1028 => 0.1271, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 23.58% (0.9697 => 1.1984, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.56% (0.0573 => 0.0708, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 23.50% (4.2109 => 5.2004, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 23.41% (0.4361 => 0.5382, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 23.38% (5.5417 => 6.8375, std.dev.: 0.0245) MultiSource/Benchmarks/MallocBench/espresso/espresso: 23.19% (1.6211 => 1.9970, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.04% (0.4658 => 0.5731, std.dev.: 0.0025) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 23.02% (0.0582 => 0.0716, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 23.01% (0.0491 => 0.0604, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 22.94% (1.0781 => 1.3254, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 22.93% (0.2691 => 0.3308, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.90% (0.0572 => 0.0703, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 22.87% (1.4269 => 1.7533, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.81% (0.0513 => 0.0630, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 22.60% (0.5026 => 0.6162, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: 22.54% (0.3336 => 0.4088, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 22.43% (0.4847 => 0.5934, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 22.29% (0.0673 => 0.0823, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 22.25% (2.0346 => 2.4873, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 22.10% (0.3498 => 0.4271, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.05% (0.1383 => 0.1688, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.98% (0.1160 => 0.1415, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.86% (2.7292 => 3.3258, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 21.86% (0.2068 => 0.2520, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 21.78% (0.2075 => 0.2527, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 21.73% (23.5202 => 28.6312, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.65% (3.5627 => 4.3342, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 21.65% (0.1090 => 0.1326, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 21.65% (0.6634 => 0.8070, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.60% (0.5584 => 0.6790, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/Large/cast: 21.57% (0.0496 => 0.0603, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 21.24% (0.0758 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.05% (1.9966 => 2.4168, std.dev.: 0.0154) MultiSource/Benchmarks/mafft/pairlocalalign: 21.02% (2.1013 => 2.5430, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_container: 20.99% (0.6435 => 0.7786, std.dev.: 0.0006) MultiSource/Applications/treecc/treecc: 20.97% (0.7875 => 0.9526, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.86% (1.9694 => 2.3803, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/wordfreq: 20.75% (0.2737 => 0.3305, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.59% (4.4195 => 5.3293, std.dev.: 0.0121) MultiSource/Applications/lemon/lemon: 19.99% (0.2391 => 0.2869, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 19.48% (2.1653 => 2.5871, std.dev.: 0.0048) MultiSource/Applications/JM/lencod/lencod: 19.46% (4.6177 => 5.5162, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 18.95% (0.5826 => 0.6930, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.94% (0.3195 => 0.3800, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 18.89% (0.5012 => 0.5959, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.84% (0.3625 => 0.4308, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 18.73% (0.5889 => 0.6992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 18.71% (0.3282 => 0.3896, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 18.49% (0.4251 => 0.5037, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 18.48% (4.6926 => 5.5600, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash: 18.45% (0.4146 => 0.4911, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 18.41% (0.3726 => 0.4412, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 18.12% (0.3477 => 0.4107, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 18.05% (0.3678 => 0.4342, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 17.89% (0.3348 => 0.3947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.79% (0.3362 => 0.3960, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.64% (0.3690 => 0.4341, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.57% (0.3124 => 0.3673, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 17.53% (0.3981 => 0.4679, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.53% (0.2813 => 0.3306, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 17.47% (0.9909 => 1.1640, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.42% (0.3060 => 0.3593, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.38% (0.7171 => 0.8417, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.25% (0.2875 => 0.3371, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 17.23% (0.3267 => 0.3830, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary: 17.16% (0.3258 => 0.3817, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 17.04% (0.2811 => 0.3290, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.04% (0.2911 => 0.3407, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 17.03% (0.3317 => 0.3882, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.98% (2.0673 => 2.4183, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/heapsort: 16.98% (0.2792 => 0.3266, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 16.95% (0.2750 => 0.3216, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.78% (0.3845 => 0.4490, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 16.73% (0.2803 => 0.3272, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 16.65% (0.2780 => 0.3243, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.54% (0.2738 => 0.3191, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.53% (0.2729 => 0.3180, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 16.51% (0.2725 => 0.3175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 16.51% (0.2714 => 0.3162, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/wc: 16.18% (0.3096 => 0.3597, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.18% (0.3004 => 0.3490, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.59% (0.3650 => 0.4219, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/parameter-passing: 15.57% (0.3724 => 0.4304, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 15.34% (0.3643 => 0.4202, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: 15.32% (0.3465 => 0.3996, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 15.25% (0.3469 => 0.3998, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 15.25% (0.3496 => 0.4029, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-2: 15.24% (0.3446 => 0.3971, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-3: 15.20% (0.3460 => 0.3986, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 15.12% (11.9555 => 13.7636, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.11% (0.3488 => 0.4015, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 15.05% (0.3442 => 0.3960, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.80% (0.3792 => 0.4012, std.dev.: 0.0004) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5269, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0095) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.96% (0.3693 => 0.4024, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.50% (3.3903 => 3.6106, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6741, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2380, std.dev.: 0.0212) SingleSource/Benchmarks/Misc/flops-2: 5.04% (1.8057 => 1.8967, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6871, std.dev.: 0.0064) MultiSource/Benchmarks/Olden/health/health: 3.04% (0.6276 => 0.6467, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1989, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0030) MultiSource/Applications/viterbi/viterbi: 1.44% (46.6247 => 47.2968, std.dev.: 0.0143) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0812, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.23% (1.0927 => 1.1061, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.10% (3.6465 => 3.6867, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.6002, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4768, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5443, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.45% (17.2379 => 14.4015, std.dev.: 0.0547) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -7.70% (28.1477 => 25.9795, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7968, std.dev.: 0.0107) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9575, std.dev.: 0.0005) SingleSource/Benchmarks/Dhrystone/dry: -4.99% (14.0481 => 13.3467, std.dev.: 0.1901) SingleSource/Benchmarks/Shootout-C++/ary2: -4.95% (0.2402 => 0.2283, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0015) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2265, std.dev.: 0.0224) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8039, std.dev.: 0.0077) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0051) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7727, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1640, std.dev.: 0.0059) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5778, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4995, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (105.3826 => 104.1934, std.dev.: 0.0466) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0422, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 22:01:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 00:01:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129060152.D426B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8062?compare_to=8058&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8062, Order: 173760, Start Time: 2013-01-29 03:40:55, End Time: 2013-01-29 06:02:11 To: 8058, Order: 173726, Start Time: 2013-01-29 00:51:41, End Time: 2013-01-29 03:10:09 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 147 (288 on baseline) Performance Improvements: 4 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 949 (583 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 23.23% (117.4531 => 144.7349, std.dev.: 0.0126) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.56% (0.1547 => 0.1865, std.dev.: 0.0019) SingleSource/Regression/C/uint64_to_float: 16.84% (0.0594 => 0.0694, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: 14.91% (0.2300 => 0.2643, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.64% (0.1749 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 12.18% (0.4005 => 0.4493, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 9.86% (20.8306 => 22.8835, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.82% (0.7090 => 0.7786, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.73% (0.9691 => 1.0634, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 9.49% (0.4414 => 0.4833, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: 8.70% (0.2139 => 0.2325, std.dev.: 0.0013) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 8.67% (0.1442 => 0.1567, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.58% (7.7020 => 8.3629, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 8.55% (1.5918 => 1.7279, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.50% (0.2329 => 0.2527, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 8.48% (1.1394 => 1.2360, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 8.40% (0.4513 => 0.4892, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bh/bh: 8.37% (0.4217 => 0.4570, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 8.35% (22.6010 => 24.4872, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.16% (1.2172 => 1.3165, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.07% (0.6373 => 0.6887, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 8.06% (1.0123 => 1.0939, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 8.03% (0.1457 => 0.1574, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 7.97% (3.1627 => 3.4149, std.dev.: 0.0092) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 7.94% (0.1512 => 0.1632, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 7.92% (1.5411 => 1.6632, std.dev.: 0.0062) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.68% (0.8253 => 0.8887, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/neural/neural: 7.67% (0.2739 => 0.2949, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.64% (0.3273 => 0.3523, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 7.56% (0.4406 => 0.4739, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.45% (2.3804 => 2.5578, std.dev.: 0.0039) MultiSource/Applications/treecc/treecc: 7.41% (2.7544 => 2.9586, std.dev.: 0.0017) MultiSource/Applications/d/make_dparser: 7.35% (4.5119 => 4.8436, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.33% (0.2836 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.31% (5.6419 => 6.0545, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/voronoi/voronoi: 7.26% (0.3870 => 0.4151, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 7.25% (84.0081 => 90.0981, std.dev.: 0.0123) MultiSource/Applications/aha/aha: 7.21% (0.1511 => 0.1620, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.11% (0.1970 => 0.2110, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 7.02% (0.4362 => 0.4668, std.dev.: 0.0009) MultiSource/Applications/SIBsim4/SIBsim4: 6.98% (1.8932 => 2.0253, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.95% (3.5494 => 3.7962, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 6.92% (2.0758 => 2.2195, std.dev.: 0.0021) MultiSource/Applications/lua/lua: 6.83% (5.2389 => 5.5966, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.69% (2.7380 => 2.9212, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 6.34% (1.7652 => 1.8772, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.34% (0.4619 => 0.4912, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 6.19% (0.6538 => 0.6943, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 6.17% (1.9275 => 2.0464, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 6.12% (0.2289 => 0.2429, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ks/ks: 6.10% (0.1951 => 0.2070, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 6.09% (0.8059 => 0.8550, std.dev.: 0.0066) MultiSource/Benchmarks/mafft/pairlocalalign: 6.08% (13.3078 => 14.1171, std.dev.: 0.0058) MultiSource/Benchmarks/7zip/7zip-benchmark: 6.07% (55.5298 => 58.9025, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.06% (1.0079 => 1.0690, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 5.99% (7.7592 => 8.2239, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 5.97% (0.2411 => 0.2555, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 5.93% (22.6510 => 23.9951, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.76% (1.0425 => 1.1025, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 5.75% (0.8898 => 0.9410, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 5.74% (1.5650 => 1.6548, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.72% (14.1517 => 14.9609, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/ft/ft: 5.70% (0.2510 => 0.2653, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.64% (1.0246 => 1.0824, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.55% (0.3192 => 0.3369, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.53% (0.9287 => 0.9801, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 5.49% (0.3658 => 0.3859, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.49% (6.2157 => 6.5571, std.dev.: 0.0088) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.48% (0.7534 => 0.7947, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.47% (1.0350 => 1.0916, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 5.43% (1.0632 => 1.1209, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/em3d/em3d: 5.42% (0.2270 => 0.2393, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.41% (0.6540 => 0.6894, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 5.41% (0.2442 => 0.2574, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.35% (0.2785 => 0.2934, std.dev.: 0.0011) MultiSource/Applications/viterbi/viterbi: 5.25% (0.2152 => 0.2265, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.16% (0.7502 => 0.7889, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.16% (0.8069 => 0.8485, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 5.11% (0.3913 => 0.4113, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.08% (0.8814 => 0.9262, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.04% (1.0662 => 1.1199, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.03% (1.6916 => 1.7767, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.00% (0.9340 => 0.9807, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.97% (0.9584 => 1.0060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.96% (1.2502 => 1.3122, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.88% (0.9204 => 0.9653, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 4.84% (0.4796 => 0.5028, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 4.82% (0.4070 => 0.4266, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.77% (0.9430 => 0.9880, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.73% (0.8810 => 0.9227, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 4.73% (0.6155 => 0.6446, std.dev.: 0.0005) SingleSource/Benchmarks/Linpack/linpack-pc: 4.61% (0.3424 => 0.3582, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 4.55% (0.5929 => 0.6199, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.55% (0.8674 => 0.9069, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.53% (0.9240 => 0.9659, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 4.43% (5.3187 => 5.5542, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.42% (0.7626 => 0.7963, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.37% (0.7646 => 0.7980) SingleSource/Benchmarks/Shootout-C++/hash: 4.33% (0.5706 => 0.5953, std.dev.: 0.0009) MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.33% (1.4585 => 1.5216, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.24% (0.2639 => 0.2751, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.21% (0.7633 => 0.7954, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.19% (0.4199 => 0.4375, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.18% (17.3540 => 18.0793, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.17% (0.7745 => 0.8068, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 4.17% (6.3417 => 6.6061, std.dev.: 0.0026) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.07% (0.6604 => 0.6873, std.dev.: 0.0022) MultiSource/Applications/ALAC/encode/alacconvert-encode: 4.06% (1.4616 => 1.5210, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 4.03% (6.3643 => 6.6207, std.dev.: 0.0030) MultiSource/Applications/JM/ldecod/ldecod: 3.99% (9.8642 => 10.2573, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.92% (0.4790 => 0.4978, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: 3.91% (1.9777 => 2.0551, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.70% (0.8247 => 0.8552, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.56% (0.8825 => 0.9139, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.55% (8.8292 => 9.1425, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 3.52% (13.0678 => 13.5281, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.51% (0.8042 => 0.8324, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.44% (0.5256 => 0.5437, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (0.5553 => 0.5744, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.43% (0.8108 => 0.8386, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.35% (0.4872 => 0.5035, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 3.29% (0.8230 => 0.8501, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 3.26% (0.5025 => 0.5189, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.18% (1.0059 => 1.0379, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 3.01% (0.4783 => 0.4927, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.97% (1.0271 => 1.0576, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: 2.85% (0.3924 => 0.4036, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.82% (0.4508 => 0.4635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 2.72% (0.4299 => 0.4416, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 2.69% (1.0693 => 1.0981, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.60% (0.8014 => 0.8222, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 2.58% (0.4231 => 0.4340, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.57% (0.9103 => 0.9337, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.51% (0.9687 => 0.9930, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 2.47% (0.4498 => 0.4609, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 2.31% (32.5720 => 33.3228, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.04% (4.9295 => 5.0301, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.88% (2.5371 => 2.5848, std.dev.: 0.0116) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.81% (4.9377 => 5.0271, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 1.64% (1.4537 => 1.4776, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.60% (1.1278 => 1.1458, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.55% (0.8506 => 0.8638, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.33% (1.6930 => 1.7155, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.27% (1.2945 => 1.3109, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 1.17% (57.1376 => 57.8051, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.12% (0.8922 => 0.9022, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.01% (80.4581 => 81.2732, std.dev.: 0.0515) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: -51.12% (0.0802 => 0.0392, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.69% (0.2018 => 0.1883, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (0.9851 => 0.9708, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.83% (3.5665 => 3.4299, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1329 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.06% (0.0680 => 0.0694, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8436 => 499.8426, std.dev.: 0.0124) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44224.08% (1.1277 => 499.8426, std.dev.: 0.0124) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 287.32% (0.5229 => 2.0253, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 52.66% (14.9895 => 22.8835, std.dev.: 0.0057) MultiSource/Applications/kimwitu++/kc: 69.51% (14.1553 => 23.9951, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 35.12% (4.1105 => 5.5542, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 100.90% (1.1048 => 2.2195, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1921.95% (7.1582 => 144.7349, std.dev.: 0.0126) SingleSource/Benchmarks/Misc-C++-EH/spirit: 141.50% (3.4629 => 8.3629, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 111.59% (0.6222 => 1.3165, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10243.19% (0.0720 => 7.4471, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0032) MultiSource/Applications/SPASS/SPASS: 11121100.00% (0.0001 => 11.1212, std.dev.: 0.0343) MultiSource/Applications/kimwitu++/kc: 51100.00% (0.0001 => 0.0512, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487300.00% (0.0001 => 5.4874, std.dev.: 0.0194) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 830.39% (1.1194 => 10.4148, std.dev.: 0.0108) SingleSource/Benchmarks/Misc/flops: 213.76% (0.1432 => 0.4493, std.dev.: 0.0011) MultiSource/Applications/ClamAV/clamscan: 160.67% (22.1758 => 57.8051, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/lowercase: 153.52% (0.0256 => 0.0649, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/distray/distray: 150.28% (0.1056 => 0.2643, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 125.51% (0.0243 => 0.0548, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/objinst: 118.03% (0.0427 => 0.0931, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 113.24% (0.0929 => 0.1981, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 112.09% (7.0540 => 14.9609, std.dev.: 0.0066) MultiSource/Benchmarks/FreeBench/neural/neural: 101.57% (0.1463 => 0.2949, std.dev.: 0.0005) SingleSource/Regression/C/casts: 98.74% (0.0318 => 0.0632, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: 94.09% (0.0237 => 0.0460, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 93.29% (0.0730 => 0.1411) MultiSource/Benchmarks/McCat/08-main/main: 89.23% (0.2554 => 0.4833, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 84.28% (0.0439 => 0.0809, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 84.20% (1.5859 => 2.9212, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 84.08% (0.0377 => 0.0694, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 76.75% (0.0271 => 0.0479, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 75.42% (0.1143 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 73.10% (0.0394 => 0.0682, std.dev.: 0.0000) SingleSource/Regression/C++/EH/function_try_block: 72.76% (0.0268 => 0.0463, std.dev.: 0.0000) SingleSource/UnitTests/Vector/simple: 72.43% (0.0185 => 0.0319, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 72.37% (2.2024 => 3.7962, std.dev.: 0.0012) SingleSource/Regression/C/2003-05-21-BitfieldHandling: 70.00% (0.0160 => 0.0272) SingleSource/Regression/C/testtrace: 69.81% (0.0212 => 0.0360, std.dev.: 0.0000) SingleSource/UnitTests/2002-05-02-CastTest: 69.27% (0.0218 => 0.0369, std.dev.: 0.0001) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 67.74% (0.0217 => 0.0364, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 66.27% (8.1363 => 13.5281, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 65.93% (1.5415 => 2.5578, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/Oscar: 65.72% (0.0636 => 0.1054, std.dev.: 0.0000) SingleSource/UnitTests/2003-05-31-CastToBool: 64.85% (0.0202 => 0.0333, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 64.43% (0.0953 => 0.1567, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 63.42% (2.9384 => 4.8019, std.dev.: 0.0080) SingleSource/Regression/C/sumarray: 62.77% (0.0231 => 0.0376, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 61.72% (0.3109 => 0.5028, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 61.24% (1.1642 => 1.8772, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 59.31% (0.6675 => 1.0634, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 58.19% (0.0232 => 0.0367, std.dev.: 0.0000) SingleSource/Regression/C++/global_ctor: 56.67% (0.0180 => 0.0282, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 55.64% (0.1125 => 0.1751, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 55.61% (0.0793 => 0.1234, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 55.55% (3.8922 => 6.0545, std.dev.: 0.0061) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 55.14% (0.0457 => 0.0709, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 55.12% (1.0722 => 1.6632, std.dev.: 0.0062) SingleSource/Regression/C++/EH/ConditionalExpr: 54.79% (0.0188 => 0.0291) SingleSource/Benchmarks/McGill/exptree: 54.55% (0.0814 => 0.1258, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 54.43% (0.1062 => 0.1640, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 53.76% (4.2646 => 6.5571, std.dev.: 0.0088) MultiSource/Applications/minisat/minisat: 53.75% (0.7115 => 1.0939, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/voronoi/voronoi: 53.74% (0.2700 => 0.4151, std.dev.: 0.0003) SingleSource/UnitTests/vla: 52.68% (0.0355 => 0.0542, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 52.52% (0.5105 => 0.7786, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/15-trie/trie: 52.37% (0.0527 => 0.0803, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/Large/cast: 52.13% (0.0564 => 0.0858, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 51.90% (21.9371 => 33.3228, std.dev.: 0.0090) SingleSource/UnitTests/ObjC/dot-syntax-1: 51.36% (0.0479 => 0.0725, std.dev.: 0.0008) SingleSource/Regression/C++/pointer_method2: 51.20% (0.0209 => 0.0316, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/div: 51.16% (0.0258 => 0.0390) SingleSource/UnitTests/2003-07-09-SignedArgs: 50.71% (0.0282 => 0.0425, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 50.55% (0.0730 => 0.1099, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 50.12% (0.0818 => 0.1228, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0252 => 0.0378, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 49.89% (0.0467 => 0.0700, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 49.84% (0.0640 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 49.57% (0.0462 => 0.0691, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 49.38% (0.4615 => 0.6894, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 49.09% (0.1695 => 0.2527, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 48.84% (9.4845 => 14.1171, std.dev.: 0.0058) MultiSource/Applications/siod/siod: 48.67% (2.2969 => 3.4149, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/partialsums: 48.57% (0.0245 => 0.0364, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 48.35% (0.2271 => 0.3369, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 48.21% (0.0672 => 0.0996, std.dev.: 0.0000) SingleSource/UnitTests/block-copied-in-cxxobj: 48.06% (0.0310 => 0.0459) MultiSource/Benchmarks/Olden/bh/bh: 47.80% (0.3092 => 0.4570, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 47.58% (0.0662 => 0.0977, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 46.77% (0.1655 => 0.2429, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/hash: 46.19% (0.0485 => 0.0709, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 45.94% (2.0273 => 2.9586, std.dev.: 0.0017) MultiSource/Benchmarks/nbench/nbench: 45.94% (1.1840 => 1.7279, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 45.90% (0.5860 => 0.8550, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 45.76% (0.6456 => 0.9410, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/n-body: 45.71% (0.0746 => 0.1087, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 45.66% (0.1555 => 0.2265, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 45.40% (0.1892 => 0.2751, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 45.22% (3.3354 => 4.8436, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 45.16% (0.1032 => 0.1498, std.dev.: 0.0038) MultiSource/Benchmarks/NPB-serial/is/is: 44.92% (0.0719 => 0.1042) MultiSource/Benchmarks/Olden/tsp/tsp: 44.77% (0.1175 => 0.1701, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/family/family: 44.58% (0.0397 => 0.0574, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 44.53% (3.8723 => 5.5966, std.dev.: 0.0090) SingleSource/UnitTests/Vector/build2: 44.41% (0.0295 => 0.0426, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 44.25% (1.4186 => 2.0464, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 44.20% (0.4299 => 0.6199, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 43.56% (0.0675 => 0.0969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 43.30% (0.3307 => 0.4739, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 43.29% (0.0626 => 0.0897, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 43.06% (0.7835 => 1.1209, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-5: 42.80% (0.0257 => 0.0367, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-6: 42.80% (0.0257 => 0.0367, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 42.80% (5.7591 => 8.2239, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 42.75% (0.3441 => 0.4912, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 42.75% (0.3427 => 0.4892, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 42.72% (0.1044 => 0.1490, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 42.70% (0.5569 => 0.7947, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 42.52% (17.1811 => 24.4872, std.dev.: 0.0056) MultiSource/Benchmarks/Bullet/bullet: 42.46% (63.2438 => 90.0981, std.dev.: 0.0123) MultiSource/Benchmarks/McCat/18-imp/imp: 42.39% (0.3423 => 0.4874, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 42.34% (0.0770 => 0.1096, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 42.30% (0.4879 => 0.6943, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/uudecode/uudecode: 42.28% (0.0447 => 0.0636) SingleSource/Benchmarks/Misc/whetstone: 41.82% (0.0660 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 41.59% (0.0933 => 0.1321, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: 41.20% (0.0267 => 0.0377, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 41.18% (0.1695 => 0.2393, std.dev.: 0.0017) SingleSource/Benchmarks/Stanford/Queens: 40.82% (0.0414 => 0.0583, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 40.75% (0.1151 => 0.1620, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/queens: 40.45% (0.0403 => 0.0566, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 40.27% (0.0437 => 0.0613, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 40.18% (0.3121 => 0.4375, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/messages: 40.06% (0.0327 => 0.0458, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 39.92% (0.2758 => 0.3859, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash2: 39.52% (0.4620 => 0.6446, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 39.52% (1.1861 => 1.6548, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 39.39% (0.0528 => 0.0736, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 39.35% (0.1268 => 0.1767, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 39.25% (0.2107 => 0.2934, std.dev.: 0.0011) SingleSource/UnitTests/2003-08-11-VaListArg: 38.92% (0.0316 => 0.0439, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 38.83% (0.0886 => 0.1230, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 38.80% (0.4289 => 0.5953, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 38.55% (0.8921 => 1.2360, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 38.51% (0.1236 => 0.1712, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: 37.98% (0.0811 => 0.1119, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/mst/mst: 37.92% (0.1163 => 0.1604, std.dev.: 0.0006) SingleSource/UnitTests/block-byref-cxxobj-test: 37.83% (0.0267 => 0.0368, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 37.82% (0.3387 => 0.4668, std.dev.: 0.0009) SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 37.79% (0.0389 => 0.0536) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 37.78% (0.6450 => 0.8887, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 37.77% (0.0842 => 0.1160, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/rem: 37.59% (0.1144 => 0.1574, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 37.19% (0.5020 => 0.6887, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 37.12% (0.0326 => 0.0447) MultiSource/Benchmarks/Ptrdist/ks/ks: 37.09% (0.1510 => 0.2070, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 36.97% (0.0614 => 0.0841, std.dev.: 0.0007) SingleSource/UnitTests/2003-05-07-VarArgs: 36.86% (0.0293 => 0.0401, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fbench: 36.82% (0.0592 => 0.0810, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 36.75% (0.1940 => 0.2653, std.dev.: 0.0011) MultiSource/Benchmarks/Fhourstones/fhourstones: 36.59% (0.1566 => 0.2139, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/methcall: 36.21% (0.0301 => 0.0410, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 36.15% (1.3050 => 1.7767, std.dev.: 0.0031) MultiSource/Applications/lambda-0_1_3/lambda: 35.97% (0.7433 => 1.0107, std.dev.: 0.0162) MultiSource/Benchmarks/BitBench/five11/five11: 35.45% (0.0567 => 0.0768, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 35.36% (0.0871 => 0.1179, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 35.34% (0.2603 => 0.3523, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 35.32% (0.8067 => 1.0916, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/puzzle: 35.05% (0.0408 => 0.0551, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.89% (0.5981 => 0.8068, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 34.76% (0.0633 => 0.0853, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 34.68% (0.0770 => 0.1037, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 34.38% (0.9765 => 1.3122, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 34.37% (0.8172 => 1.0981, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/himenobmtxpa: 34.33% (0.2266 => 0.3044, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Towers: 34.18% (0.0471 => 0.0632, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 34.15% (0.3180 => 0.4266, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 34.11% (0.1029 => 0.1380, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.61% (0.8101 => 1.0824, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 33.59% (4.9449 => 6.6061, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 33.58% (0.1337 => 0.1786, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.58% (0.1906 => 0.2546, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Treesort: 33.58% (0.0411 => 0.0549) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 33.55% (0.0310 => 0.0414, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax: 33.24% (0.0355 => 0.0473, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 33.20% (0.0482 => 0.0642, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 32.37% (5.0018 => 6.6207, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 32.23% (0.1117 => 0.1477, std.dev.: 0.0025) SingleSource/Regression/C++/EH/exception_spec_test: 32.00% (0.0350 => 0.0462) SingleSource/Benchmarks/Stanford/Perm: 31.75% (0.0315 => 0.0415) MultiSource/Applications/hbd/hbd: 31.71% (1.5603 => 2.0551, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 30.83% (0.0798 => 0.1044, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.77% (0.0416 => 0.0544, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 30.30% (0.1584 => 0.2064, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 29.85% (0.1625 => 0.2110, std.dev.: 0.0015) SingleSource/Benchmarks/Dhrystone/dry: 29.82% (0.0456 => 0.0592, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.46% (0.3177 => 0.4113, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 29.36% (0.4203 => 0.5437, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 28.80% (0.3865 => 0.4978, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 28.66% (0.3098 => 0.3986, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 28.19% (0.1114 => 0.1428, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.18% (0.0479 => 0.0614, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 28.06% (0.1440 => 0.1844, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 27.94% (0.0834 => 0.1067, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_shift: 27.78% (0.0378 => 0.0483, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.60% (0.0442 => 0.0564, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/fldry: 27.44% (0.0481 => 0.0613, std.dev.: 0.0001) SingleSource/Regression/C/bigstack: 27.34% (0.0417 => 0.0531, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 27.31% (0.0443 => 0.0564, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/RealMM: 27.02% (0.0396 => 0.0503, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 26.47% (0.4103 => 0.5189, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/bmm/bmm: 26.22% (0.0759 => 0.0958, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/FloatMM: 25.94% (0.0401 => 0.0505, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.93% (0.0648 => 0.0816, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.84% (14.3668 => 18.0793, std.dev.: 0.0079) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.66% (0.0491 => 0.0617, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 25.62% (0.2049 => 0.2574, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.23% (0.0432 => 0.0541, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/perlin: 25.19% (0.0536 => 0.0671, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 24.86% (0.0704 => 0.0879, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 23.90% (0.4636 => 0.5744, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/ray: 23.89% (0.4064 => 0.5035, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 22.97% (0.3282 => 0.4036, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 22.95% (0.2065 => 0.2539, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 21.93% (0.2430 => 0.2963, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 21.71% (0.4048 => 0.4927, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 21.35% (0.3283 => 0.3984, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 21.35% (0.1438 => 0.1745, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 21.04% (0.3232 => 0.3912, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.88% (0.0838 => 0.1013, std.dev.: 0.0000) SingleSource/UnitTests/initp1: 20.72% (0.0555 => 0.0670, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 20.47% (0.3826 => 0.4609, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 20.46% (0.3603 => 0.4340, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: 20.43% (0.0705 => 0.0849, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 19.87% (0.3684 => 0.4416, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 19.71% (0.3379 => 0.4045, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: 19.38% (0.3886 => 0.4639, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 19.17% (0.3422 => 0.4078, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 18.87% (0.1330 => 0.1581, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.79% (0.3935 => 0.4635, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 17.37% (2.2022 => 2.5848, std.dev.: 0.0116) SingleSource/Regression/C++/ofstream_ctor: 17.04% (0.2905 => 0.3400, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.90% (0.3650 => 0.4267, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 16.01% (0.1268 => 0.1471, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 15.94% (0.3927 => 0.4553, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 15.06% (1.2842 => 1.4776, std.dev.: 0.0059) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.83% (7.9617 => 9.1425, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions: 14.21% (0.3828 => 0.4372, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.95% (0.3162 => 0.3603, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 12.86% (0.2831 => 0.3195, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 11.82% (0.2877 => 0.3217, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.76% (2.0665 => 2.3095, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/except: 11.56% (0.2871 => 0.3203, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.56% (0.3694 => 0.4121, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 11.36% (10.3673 => 11.5455, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/office/office: 11.35% (0.3136 => 0.3492, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.32% (0.3543 => 0.3944, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 11.06% (0.3561 => 0.3955, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.01% (0.3543 => 0.3933, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.95% (0.3516 => 0.3901, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 10.86% (0.3473 => 0.3850, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.20% (0.2891 => 0.3186, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.09% (0.3052 => 0.3360, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2756 => 0.3030, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.71% (0.2872 => 0.3151, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.71% (0.2802 => 0.3074, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference: 9.61% (0.7326 => 0.8030, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 9.40% (0.6030 => 0.6597, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2725 => 0.2979, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.31% (0.2793 => 0.3053, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.17% (0.2714 => 0.2963, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 7.78% (0.5925 => 0.6386, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 7.60% (0.3131 => 0.3369) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.90% (0.3817 => 0.3966, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8958, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4743, std.dev.: 0.0051) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.27% (1.1145 => 1.2958, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.35% (1.1396 => 1.2462, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.91% (11.6436 => 12.4479, std.dev.: 0.0958) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4539, std.dev.: 0.0098) SingleSource/Benchmarks/Shootout-C++/hash2: 4.96% (3.1578 => 3.3143, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0065) SingleSource/Benchmarks/Misc-C++/bigfib: 3.74% (0.3316 => 0.3440, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.33% (2.0360 => 2.1039, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.6802 => 8.9275, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.01% (3.6395 => 3.7128, std.dev.: 0.0092) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.74% (9.1159 => 9.2746, std.dev.: 0.0103) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2902, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 1.53% (1.0785 => 1.0950, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.18% (6.6874 => 0.1883, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -75.15% (5.2763 => 1.3109, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -32.86% (0.1622 => 0.1089, std.dev.: 0.0001) SingleSource/UnitTests/Vector/constpool: -7.51% (54.1659 => 50.0993, std.dev.: 0.0456) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.60% (5.3855 => 5.0301, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.08% (5.3526 => 5.0271, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.58% (1.7609 => 1.7155, std.dev.: 0.0041) MultiSource/Applications/JM/ldecod/ldecod: -1.71% (10.4361 => 10.2573, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.34% (1.9577 => 0.6589, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: -34.11% (8.0499 => 5.3038, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -33.56% (1.5373 => 1.0214, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel: -33.54% (1.1492 => 0.7638, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4378, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9234, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0015) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.64% (1.6925 => 1.4278, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7335, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.14% (0.9540 => 0.8382, std.dev.: 0.0016) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4917, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.86% (1.8329 => 1.7072, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.70% (19.9488 => 18.6132, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: -6.43% (1.2373 => 1.1578, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7029, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.80% (0.4808 => 0.4577, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5081, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -4.71% (10.2830 => 9.7983, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0006) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3284, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout/ary3: -1.51% (3.6994 => 3.6437, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/ary3: -1.34% (3.7221 => 3.6722, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -1.27% (4.6441 => 4.5850, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout/lists: -1.18% (6.2999 => 6.2254, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout/hash: -1.10% (4.9088 => 4.8547, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.20% (0.2116 => 0.0694, std.dev.: 0.0006) Report Time: 1.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 22:09:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 00:09:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129060949.497B22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8063?compare_to=8059&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8063, Order: 173763, Start Time: 2013-01-29 04:36:05, End Time: 2013-01-29 06:10:08 To: 8059, Order: 173752, Start Time: 2013-01-29 02:34:49, End Time: 2013-01-29 04:12:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (109 on baseline) Performance Improvements: 215 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 889 (887 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -41.00% (0.0617 => 0.0364, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -37.48% (37.3227 => 23.3338, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout/objinst: -33.70% (0.0635 => 0.0421) MultiSource/Benchmarks/McCat/08-main/main: -31.01% (0.3853 => 0.2658, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: -26.11% (0.1800 => 0.1330) MultiSource/Benchmarks/FreeBench/mason/mason: -25.28% (0.0811 => 0.0606, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: -25.10% (0.2442 => 0.1829, std.dev.: 0.0010) SingleSource/Benchmarks/SmallPT/smallpt: -23.86% (0.1714 => 0.1305, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -23.70% (0.0865 => 0.0660, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: -22.35% (7.4247 => 5.7652, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout/matrix: -22.30% (0.0973 => 0.0756, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -22.04% (0.4397 => 0.3428, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -21.34% (0.1153 => 0.0907, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: -21.12% (0.0483 => 0.0381, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bh/bh: -20.38% (0.3743 => 0.2980, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -20.31% (3.0094 => 2.3981, std.dev.: 0.0018) MultiSource/Applications/sqlite3/sqlite3: -19.67% (20.9964 => 16.8674, std.dev.: 0.0226) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -19.51% (1.7060 => 1.3731, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: -19.12% (19.7348 => 15.9611, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/trees/trees: -18.49% (0.1314 => 0.1071, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: -18.32% (0.0715 => 0.0584, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.29% (0.3106 => 0.2538, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -18.19% (1.6077 => 1.3153, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -18.12% (0.9287 => 0.7604, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -18.00% (2.2289 => 1.8278, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: -17.81% (0.9335 => 0.7672, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -17.62% (0.1947 => 0.1604, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -17.54% (0.1112 => 0.0917, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: -17.44% (1.6430 => 1.3565, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -17.40% (2.6034 => 2.1504, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -17.25% (0.4320 => 0.3575, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -17.23% (41.2520 => 34.1444, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -17.06% (0.1852 => 0.1536, std.dev.: 0.0002) MultiSource/Applications/lua/lua: -17.05% (4.8976 => 4.0627, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -17.04% (0.0974 => 0.0808, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -16.76% (0.8239 => 0.6858, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: -16.75% (0.0615 => 0.0512, std.dev.: 0.0008) MultiSource/Benchmarks/nbench/nbench: -16.74% (1.3880 => 1.1556, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/messages-2: -16.69% (0.0857 => 0.0714) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -16.64% (0.0769 => 0.0641, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -16.60% (4.7231 => 3.9389, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -16.58% (0.0923 => 0.0770, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: -15.94% (4.2110 => 3.5396, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -15.92% (0.0647 => 0.0544, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: -15.88% (0.0718 => 0.0604, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -15.86% (1.6942 => 1.4255, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -15.68% (0.7591 => 0.6401, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -15.66% (0.0926 => 0.0781, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -15.64% (0.0863 => 0.0728, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -15.45% (3.2604 => 2.7568, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -15.40% (0.1325 => 0.1121, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -15.39% (2.5147 => 2.1277, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: -15.34% (0.4197 => 0.3553, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: -15.20% (0.4229 => 0.3586, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/life/life: -15.11% (0.1072 => 0.0910, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.84% (0.7070 => 0.6021, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -14.76% (1.1536 => 0.9833, std.dev.: 0.0007) MultiSource/Applications/viterbi/viterbi: -14.73% (0.2016 => 0.1719, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -14.65% (0.1317 => 0.1124, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -14.64% (0.0840 => 0.0717, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -14.64% (0.0888 => 0.0758, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -14.62% (0.0718 => 0.0613, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -14.18% (0.8385 => 0.7196, std.dev.: 0.0012) MultiSource/Applications/kimwitu++/kc: -13.97% (21.4350 => 18.4410, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/lists: -13.93% (0.0804 => 0.0692, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -13.82% (1.4402 => 1.2411, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: -13.82% (1.0020 => 0.8635, std.dev.: 0.0018) MultiSource/Benchmarks/7zip/7zip-benchmark: -13.70% (50.5894 => 43.6584, std.dev.: 0.0190) MultiSource/Applications/ClamAV/clamscan: -13.66% (17.6348 => 15.2253, std.dev.: 0.0081) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -13.56% (0.2176 => 0.1881, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.55% (0.0878 => 0.0759, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.54% (0.2608 => 0.2255, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: -13.45% (5.9891 => 5.1836, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -13.27% (0.3497 => 0.3033, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -13.23% (2.7607 => 2.3954, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: -13.04% (1.0426 => 0.9066, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/loader/loader: -12.99% (0.3449 => 0.3001, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.93% (0.8956 => 0.7798, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -12.74% (0.6615 => 0.5772, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: -12.69% (0.1379 => 0.1204) MultiSource/Benchmarks/Prolangs-C++/objects/objects: -12.67% (0.1239 => 0.1082, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -12.59% (0.1017 => 0.0889, std.dev.: 0.0010) MultiSource/Applications/lambda-0_1_3/lambda: -12.56% (0.9023 => 0.7890, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: -12.47% (0.2149 => 0.1881, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -12.47% (4.6221 => 4.0457, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -12.45% (0.1012 => 0.0886, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -12.43% (0.1327 => 0.1162, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.41% (0.0943 => 0.0826, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: -12.29% (0.1066 => 0.0935, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -12.23% (11.5074 => 10.0995, std.dev.: 0.0116) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -12.17% (0.1109 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: -12.05% (0.3709 => 0.3262, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -12.04% (0.1113 => 0.0979, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.92% (0.0931 => 0.0820, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.90% (0.1344 => 0.1184, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: -11.89% (0.1093 => 0.0963, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -11.85% (1.7654 => 1.5562, std.dev.: 0.0039) SingleSource/Benchmarks/McGill/chomp: -11.83% (0.2088 => 0.1841, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.69% (0.2976 => 0.2628, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: -11.66% (0.2469 => 0.2181, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -11.48% (0.1359 => 0.1203, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.41% (0.1069 => 0.0947, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -11.37% (0.7116 => 0.6307, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: -11.35% (0.1824 => 0.1617, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.34% (1.7674 => 1.5670, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.30% (0.7595 => 0.6737, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -11.25% (0.1333 => 0.1183, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -11.18% (17.9414 => 15.9364, std.dev.: 0.0136) MultiSource/Benchmarks/MallocBench/espresso/espresso: -11.00% (5.6753 => 5.0512, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: -10.94% (7.8643 => 7.0042, std.dev.: 0.0141) MultiSource/Benchmarks/FreeBench/pifft/pifft: -10.93% (1.0649 => 0.9485, std.dev.: 0.0006) MultiSource/Benchmarks/MallocBench/gs/gs: -10.85% (4.8100 => 4.2882, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/mst/mst: -10.75% (0.1433 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -10.67% (0.1499 => 0.1339, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -10.62% (0.1083 => 0.0968, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -10.48% (0.1078 => 0.0965, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.46% (7.4277 => 6.6507, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -10.41% (1.1592 => 1.0385, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -10.38% (0.2562 => 0.2296, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -10.36% (0.1352 => 0.1212, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -10.33% (0.4336 => 0.3888, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -10.29% (0.4546 => 0.4078, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: -10.24% (0.2372 => 0.2129, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.14% (15.4622 => 13.8947, std.dev.: 0.0098) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.01% (0.9402 => 0.8461, std.dev.: 0.0054) MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.99% (1.2573 => 1.1317, std.dev.: 0.0024) MultiSource/Applications/ALAC/encode/alacconvert-encode: -9.83% (1.2571 => 1.1335, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.66% (0.9947 => 0.8986, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: -9.63% (0.5834 => 0.5272, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -9.55% (0.4735 => 0.4283, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -9.52% (0.9026 => 0.8167, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -9.51% (0.9175 => 0.8302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -9.46% (0.9577 => 0.8671, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.42% (0.9989 => 0.9048, std.dev.: 0.0031) SingleSource/Benchmarks/Linpack/linpack-pc: -9.34% (0.2956 => 0.2680, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.32% (0.8617 => 0.7814, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: -9.30% (0.5788 => 0.5250, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -9.17% (0.8159 => 0.7411, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -9.17% (0.2891 => 0.2626, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.12% (0.1470 => 0.1336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.10% (1.0215 => 0.9285, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -9.10% (0.9232 => 0.8392, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -9.09% (0.8238 => 0.7489, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -9.08% (0.9286 => 0.8443, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -9.07% (0.2315 => 0.2105, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -9.07% (0.8713 => 0.7923, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -9.03% (5.3674 => 4.8825, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -9.03% (0.8473 => 0.7708, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.02% (0.3824 => 0.3479, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -9.00% (0.8359 => 0.7607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -8.99% (0.9022 => 0.8211, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -8.98% (8.7638 => 7.9769, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -8.98% (0.7919 => 0.7208, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -8.97% (0.9659 => 0.8793, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -8.95% (0.8325 => 0.7580, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.92% (5.3044 => 4.8310, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.86% (0.1355 => 0.1235, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -8.86% (0.7905 => 0.7205, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.85% (1.5358 => 1.3999, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: -8.84% (0.3666 => 0.3342, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.81% (0.7785 => 0.7099, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -8.81% (0.8297 => 0.7566, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -8.80% (0.6020 => 0.5490, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -8.79% (0.9365 => 0.8542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -8.78% (0.7905 => 0.7211, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.77% (0.9047 => 0.8254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -8.74% (0.8488 => 0.7746, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -8.71% (0.9084 => 0.8293, std.dev.: 0.0005) MultiSource/Applications/aha/aha: -8.63% (0.1344 => 0.1228, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.61% (0.8305 => 0.7590, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.58% (0.2553 => 0.2334, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.51% (0.8204 => 0.7506, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -8.49% (0.8673 => 0.7937, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.46% (0.8358 => 0.7651, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -8.45% (0.8529 => 0.7808, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -8.44% (0.8775 => 0.8034, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: -8.43% (0.4971 => 0.4552, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -8.42% (0.8396 => 0.7689, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -8.41% (0.7975 => 0.7304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -8.36% (0.7983 => 0.7316, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -8.30% (0.7986 => 0.7323, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -8.29% (0.4152 => 0.3808, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -8.25% (0.2436 => 0.2235, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.20% (1.3182 => 1.2101, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -8.12% (0.7836 => 0.7200, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.09% (0.4460 => 0.4099, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.05% (1.3154 => 1.2095, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/health/health: -7.95% (0.1471 => 0.1354, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: -7.95% (0.5359 => 0.4933, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: -7.85% (0.5463 => 0.5034, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.15% (0.1805 => 0.1676, std.dev.: 0.0029) SingleSource/Benchmarks/CoyoteBench/fftbench: -7.10% (0.5152 => 0.4786, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.03% (0.1437 => 0.1336, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.96% (0.1610 => 0.1498, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.93% (0.3941 => 0.3668, std.dev.: 0.0002) SingleSource/UnitTests/Vectorizer/gcc-loops: -6.81% (0.6167 => 0.5747, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.64% (0.4141 => 0.3866, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -6.60% (0.3967 => 0.3705, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: -6.52% (0.4506 => 0.4212, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.23% (0.9889 => 0.9273, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: -5.58% (0.3994 => 0.3771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -5.53% (0.3653 => 0.3451, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -5.52% (0.4061 => 0.3837, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: -4.69% (0.3751 => 0.3575, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.67% (0.2269 => 0.2163, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -4.60% (1.3427 => 1.2810, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.95% (0.3364 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -3.39% (0.3655 => 0.3531, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -3.07% (0.3680 => 0.3567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -2.96% (0.3614 => 0.3507, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.95% (0.4272 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -2.69% (0.4170 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.57% (0.4120 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.99% (2.1602 => 2.1173, std.dev.: 0.0032) SingleSource/UnitTests/ObjC++/property-reference: -1.55% (0.7668 => 0.7549, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 78.57% (0.0280 => 0.0500, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.26% (0.0514 => 0.0870, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.04% (0.0717 => 0.1212, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.81% (0.0974 => 0.1615, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 45.40% (0.1500 => 0.2181, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.23% (0.0599 => 0.0828, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.50% (0.6395 => 0.8793, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 35.59% (0.6395 => 0.8671, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.96% (0.5456 => 0.7200, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 31.96% (0.5688 => 0.7506, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 31.85% (0.6260 => 0.8254, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 31.80% (0.5805 => 0.7651, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.46% (0.5849 => 0.7689, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.42% (0.5567 => 0.7316, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.21% (0.5581 => 0.7323, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.09% (0.6230 => 0.8167, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.01% (0.5575 => 0.7304, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.40% (0.5802 => 0.7566, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.38% (0.5941 => 0.7746, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 29.90% (0.5705 => 0.7411, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.59% (0.5478 => 0.7099, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.54% (0.5859 => 0.7590, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.43% (0.5569 => 0.7208, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.42% (0.6033 => 0.7808, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.42% (0.5857 => 0.7580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.35% (0.5570 => 0.7205, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.16% (1.6474 => 2.1277, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.98% (0.5591 => 0.7211, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 28.77% (0.6440 => 0.8293, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.39% (0.5925 => 0.7607, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.24% (0.6189 => 0.7937, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 27.95% (0.6676 => 0.8542, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.73% (0.5863 => 0.7489, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.44% (0.6304 => 0.8034, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.38% (0.6446 => 0.8211, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.36% (0.6052 => 0.7708, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.37% (0.6681 => 0.8443, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.15% (0.6194 => 0.7814, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.01% (0.6660 => 0.8392, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.82% (0.6297 => 0.7923, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.52% (0.6667 => 0.8302, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.44% (0.0622 => 0.0774, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.41% (0.7524 => 0.9285, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.20% (0.0582 => 0.0717, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.44% (0.7339 => 0.8986, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.15% (0.0790 => 0.0965, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.05% (2.2587 => 2.7568, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.07% (0.0693 => 0.0839, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 20.93% (0.0621 => 0.0751, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.98% (0.0634 => 0.0748, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 16.93% (0.0833 => 0.0974, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 15.82% (0.3357 => 0.3888, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 14.87% (1.1450 => 1.3153, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.85% (0.0680 => 0.0781, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.25% (0.1081 => 0.1235, std.dev.: 0.0039) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.08% (4.5069 => 5.0512, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.70% (1.6364 => 1.8278, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.68% (0.4916 => 0.5490, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/05-eks/eks: 11.50% (0.4515 => 0.5034, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.46% (3.5339 => 3.9389, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.10% (0.2385 => 0.2626, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.44% (9.2283 => 10.0995, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/hash: 9.04% (0.4524 => 0.4933, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.67% (0.1731 => 0.1881, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 8.39% (1.2515 => 1.3565, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.31% (0.5329 => 0.5772, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.30% (0.7021 => 0.7604, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.13% (0.1230 => 0.1330) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.10% (0.2001 => 0.2163, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/hash2: 8.00% (0.4861 => 0.5250, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.41% (1.2784 => 1.3731, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.02% (1.4642 => 1.5670, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 6.61% (0.6750 => 0.7196, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 6.02% (0.3255 => 0.3451, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.43% (5.4682 => 5.7652, std.dev.: 0.0090) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.82% (0.3319 => 0.3479, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.14% (22.4056 => 23.3338, std.dev.: 0.0124) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.33% (0.3394 => 0.3507, std.dev.: 0.0005) MultiSource/Applications/oggenc/oggenc: 3.21% (5.0226 => 5.1836, std.dev.: 0.0067) MultiSource/Applications/minisat/minisat: 3.02% (0.7447 => 0.7672, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 2.92% (15.5079 => 15.9611, std.dev.: 0.0076) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.9557 => 0.9833, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.82% (0.4427 => 0.4552, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 2.82% (1.3864 => 1.4255, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.58% (0.8418 => 0.8635, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.02% (1.3722 => 1.3999, std.dev.: 0.0025) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7916, std.dev.: 0.0161) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.61% (0.9531 => 1.0256, std.dev.: 0.0055) SingleSource/Regression/C/uint64_to_float: 7.48% (0.5692 => 0.6118, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1498, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.75% (54.5751 => 56.6221, std.dev.: 0.0279) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1087, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5116, std.dev.: 0.0221) MultiSource/Applications/sqlite3/sqlite3: 1.57% (4.5320 => 4.6030, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2491, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2707, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.7198 => 0.6858, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3812 => 0.3649, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-4: -4.20% (0.3880 => 0.3717, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.20% (0.3884 => 0.3721, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.18% (0.3831 => 0.3671, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.13% (0.3848 => 0.3689, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/for-in: -4.09% (0.4033 => 0.3868, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.09% (0.3891 => 0.3732, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.00% (0.3821 => 0.3668, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.89% (2.4924 => 2.3954, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: -3.88% (0.4176 => 0.4014, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.73% (0.9852 => 0.9485, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.44% (0.3837 => 0.3705, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.36% (0.4199 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.15% (0.6347 => 0.6147, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -3.13% (0.4280 => 0.4146, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.96% (0.7779 => 0.7549, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -2.92% (0.6441 => 0.6253, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.9542 => 0.9273, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.73% (0.6484 => 0.6307, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -2.57% (1.3148 => 1.2810, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.49% (2.1713 => 2.1173, std.dev.: 0.0032) SingleSource/UnitTests/Vector/constpool: -2.44% (20.7746 => 20.2679, std.dev.: 0.0734) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (14.2083 => 13.8947, std.dev.: 0.0098) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.79% (6.7716 => 6.6507, std.dev.: 0.0011) MultiSource/Applications/JM/lencod/lencod: -1.58% (16.1920 => 15.9364, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.53% (0.7919 => 0.7798, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.51% (1.0544 => 1.0385, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: -1.38% (17.1032 => 16.8674, std.dev.: 0.0226) MultiSource/Applications/JM/ldecod/ldecod: -1.30% (7.0961 => 7.0042, std.dev.: 0.0141) MultiSource/Benchmarks/Prolangs-C/football/football: -1.23% (0.9179 => 0.9066, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/gs/gs: -1.03% (4.3330 => 4.2882, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.16% (1.8100 => 0.7030, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3124, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/mandel-2: -24.91% (1.3643 => 1.0245, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7510, std.dev.: 0.0042) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0825, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2054, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.08% (2.5106 => 2.1319, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6677, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.27% (3.1443 => 2.7271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3533, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0071) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3986, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7806, std.dev.: 0.0158) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: -2.28% (3.7241 => 3.6391, std.dev.: 0.0292) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.27% (1.3096 => 1.2799, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -1.82% (7.3040 => 7.1711, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4701, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6219 => 1.6017, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.20% (1.6307 => 1.6112, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary3: -1.09% (3.7092 => 3.6688, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.47s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Mon Jan 28 23:03:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 01:03:37 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129070337.1FD832A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8064?compare_to=8060&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8064, Order: 173768, Start Time: 2013-01-29 04:59:33, End Time: 2013-01-29 07:03:58 To: 8060, Order: 173752, Start Time: 2013-01-29 02:25:55, End Time: 2013-01-29 04:40:12 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (80 on baseline) Performance Improvements: 189 (63 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 871 (920 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.63% (6.9372 => 7.4664, std.dev.: 0.1570) SingleSource/Benchmarks/Misc-C++/bigfib: 4.37% (0.3429 => 0.3579, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.90% (1.8442 => 1.8792, std.dev.: 0.0087) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.58% (40.1025 => 40.7349, std.dev.: 0.0991) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Misc/matmul_f64_4x4: -50.58% (0.0779 => 0.0385, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -46.23% (0.1339 => 0.0720, std.dev.: 0.0081) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -45.54% (44.4875 => 24.2277, std.dev.: 0.1033) SingleSource/UnitTests/SignlessTypes/Large/cast: -44.48% (0.0978 => 0.0543, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/mst/mst: -39.30% (0.2191 => 0.1330, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -37.90% (0.7636 => 0.4742, std.dev.: 0.0095) MultiSource/Benchmarks/McCat/08-main/main: -35.64% (0.4433 => 0.2853, std.dev.: 0.0350) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -35.46% (0.5959 => 0.3846, std.dev.: 0.0122) MultiSource/Applications/lua/lua: -34.94% (6.5098 => 4.2350, std.dev.: 0.5745) SingleSource/Benchmarks/Misc/mandel-2: -34.01% (0.0491 => 0.0324, std.dev.: 0.0020) SingleSource/UnitTests/2006-01-23-UnionInit: -33.25% (0.0385 => 0.0257, std.dev.: 0.0020) SingleSource/UnitTests/2002-05-02-CastTest: -32.88% (0.0368 => 0.0247, std.dev.: 0.0011) SingleSource/UnitTests/2003-07-09-SignedArgs: -32.41% (0.0398 => 0.0269, std.dev.: 0.0013) SingleSource/UnitTests/SignlessTypes/rem: -32.24% (0.1743 => 0.1181, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/wordfreq: -31.79% (0.5058 => 0.3450, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -31.41% (0.1181 => 0.0810, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: -30.82% (0.4838 => 0.3347, std.dev.: 0.0136) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -30.15% (0.9563 => 0.6680, std.dev.: 0.0358) MultiSource/Benchmarks/Olden/health/health: -30.06% (0.2159 => 0.1510, std.dev.: 0.0119) MultiSource/Applications/minisat/minisat: -29.36% (1.1164 => 0.7886, std.dev.: 0.1086) SingleSource/UnitTests/2003-07-09-LoadShorts: -29.24% (0.0342 => 0.0242, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -29.16% (3.6664 => 2.5972, std.dev.: 0.1451) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -29.05% (2.6740 => 1.8972, std.dev.: 0.1006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -29.00% (2.1889 => 1.5541, std.dev.: 0.2189) MultiSource/Benchmarks/Olden/bh/bh: -28.66% (0.4574 => 0.3263, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/himenobmtxpa: -28.63% (0.3021 => 0.2156, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -28.04% (0.9113 => 0.6558, std.dev.: 0.0261) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -27.81% (0.3254 => 0.2349, std.dev.: 0.0219) SingleSource/Benchmarks/SmallPT/smallpt: -27.67% (0.1948 => 0.1409, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/distray/distray: -27.39% (0.1358 => 0.0986, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout/matrix: -27.27% (0.1122 => 0.0816, std.dev.: 0.0104) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -27.12% (0.1427 => 0.1040, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/uuencode/uuencode: -27.03% (0.0677 => 0.0494, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -26.60% (0.1771 => 0.1300, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/recursive: -26.44% (0.0382 => 0.0281, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: -26.23% (7.8752 => 5.8094, std.dev.: 0.3005) MultiSource/Benchmarks/Prolangs-C/football/football: -26.11% (1.3253 => 0.9793, std.dev.: 0.0355) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -26.06% (2.7544 => 2.0365, std.dev.: 0.0580) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -26.05% (5.5860 => 4.1311, std.dev.: 0.1792) MultiSource/Benchmarks/Olden/bisort/bisort: -25.95% (0.0944 => 0.0699, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/15-trie/trie: -25.82% (0.0790 => 0.0586, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: -25.74% (0.3796 => 0.2819, std.dev.: 0.0129) MultiSource/Applications/SPASS/SPASS: -25.48% (22.2623 => 16.5903, std.dev.: 0.6444) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -25.29% (0.0957 => 0.0715, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/salsa20: -25.20% (0.0766 => 0.0573, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -24.95% (0.3282 => 0.2463, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.80% (0.0637 => 0.0479, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: -24.69% (21.9393 => 16.5225, std.dev.: 0.6808) MultiSource/Benchmarks/McCat/09-vor/vor: -24.68% (0.4586 => 0.3454, std.dev.: 0.0275) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -24.51% (1.1358 => 0.8574, std.dev.: 0.0183) MultiSource/Benchmarks/llubenchmark/llu: -24.48% (0.0719 => 0.0543, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -24.18% (0.9325 => 0.7070, std.dev.: 0.0470) SingleSource/Benchmarks/McGill/queens: -24.05% (0.0686 => 0.0521, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: -24.04% (44.6829 => 33.9399, std.dev.: 0.0434) MultiSource/Benchmarks/McCat/18-imp/imp: -23.99% (0.4993 => 0.3795, std.dev.: 0.0126) SingleSource/Benchmarks/Stanford/Towers: -23.91% (0.0644 => 0.0490, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -23.86% (1.7353 => 1.3212, std.dev.: 0.0531) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -23.77% (0.2722 => 0.2075, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.64% (0.1176 => 0.0898, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -23.58% (0.8521 => 0.6512, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -23.34% (0.7001 => 0.5367, std.dev.: 0.0235) MultiSource/Applications/siod/siod: -23.29% (3.2343 => 2.4810, std.dev.: 0.1166) MultiSource/Benchmarks/mafft/pairlocalalign: -23.26% (14.0103 => 10.7520, std.dev.: 0.0502) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -23.18% (1.4291 => 1.0979, std.dev.: 0.0224) MultiSource/Benchmarks/BitBench/drop3/drop3: -22.79% (0.0645 => 0.0498, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -22.79% (1.7886 => 1.3810, std.dev.: 0.1543) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -22.74% (0.0620 => 0.0479, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.62% (9.2826 => 7.1831, std.dev.: 0.5808) SingleSource/Benchmarks/Stanford/Queens: -22.42% (0.0553 => 0.0429, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -22.28% (6.0116 => 4.6721, std.dev.: 0.1839) MultiSource/Applications/ClamAV/clamscan: -21.75% (20.7905 => 16.2681, std.dev.: 0.9965) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -21.73% (0.0888 => 0.0695, std.dev.: 0.0051) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -21.48% (0.0745 => 0.0585, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -21.45% (0.1874 => 0.1472, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -21.32% (0.1590 => 0.1251, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -21.32% (0.0971 => 0.0764, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: -21.31% (1.8343 => 1.4435, std.dev.: 0.0597) SingleSource/Benchmarks/Misc/richards_benchmark: -21.19% (0.1005 => 0.0792, std.dev.: 0.0081) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -21.06% (0.1600 => 0.1263, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -21.05% (1.1592 => 0.9152, std.dev.: 0.0121) MultiSource/Benchmarks/nbench/nbench: -20.97% (1.6220 => 1.2818, std.dev.: 0.0686) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -20.92% (0.7754 => 0.6132, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -20.90% (1.5012 => 1.1874, std.dev.: 0.0788) SingleSource/Benchmarks/Misc/fbench: -20.76% (0.0920 => 0.0729, std.dev.: 0.0007) SingleSource/Benchmarks/Dhrystone/dry: -20.63% (0.0669 => 0.0531, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -20.54% (11.9606 => 9.5038, std.dev.: 0.4595) MultiSource/Benchmarks/Olden/em3d/em3d: -20.36% (0.2431 => 0.1936, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/flops: -20.30% (0.1345 => 0.1072, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -20.28% (0.9844 => 0.7848, std.dev.: 0.0699) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -20.26% (0.1145 => 0.0913, std.dev.: 0.0087) MultiSource/Applications/treecc/treecc: -20.22% (2.8734 => 2.2923, std.dev.: 0.0806) MultiSource/Benchmarks/MallocBench/gs/gs: -20.11% (5.6226 => 4.4918, std.dev.: 0.0941) MultiSource/Benchmarks/7zip/7zip-benchmark: -19.94% (56.6213 => 45.3294, std.dev.: 0.1311) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -19.94% (2.0655 => 1.6536, std.dev.: 0.0263) SingleSource/Benchmarks/Shootout/lists: -19.83% (0.0928 => 0.0744, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/objects/objects: -19.77% (0.1199 => 0.0962, std.dev.: 0.0016) SingleSource/Benchmarks/Dhrystone/fldry: -19.75% (0.0724 => 0.0581, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -19.54% (3.1820 => 2.5601, std.dev.: 0.0334) MultiSource/Benchmarks/Prolangs-C++/trees/trees: -19.37% (0.1198 => 0.0966, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/misr: -19.24% (0.0816 => 0.0659, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -19.16% (0.3663 => 0.2961, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: -18.87% (0.8542 => 0.6930, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -18.49% (1.6446 => 1.3405, std.dev.: 0.0716) MultiSource/Applications/kimwitu++/kc: -18.43% (22.7112 => 18.5247, std.dev.: 0.9789) SingleSource/Benchmarks/CoyoteBench/lpbench: -18.12% (0.1253 => 0.1026, std.dev.: 0.0041) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -18.10% (0.3476 => 0.2847, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/whetstone: -18.04% (0.1009 => 0.0827, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -17.96% (1.1153 => 0.9150, std.dev.: 0.0716) MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.80% (1.1577 => 0.9516, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -17.78% (18.1166 => 14.8953, std.dev.: 0.5557) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -17.67% (1.5950 => 1.3131, std.dev.: 0.0563) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -17.62% (0.1124 => 0.0926, std.dev.: 0.0041) MultiSource/Applications/viterbi/viterbi: -17.58% (0.2139 => 0.1763, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -17.39% (1.5172 => 1.2533, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -17.39% (1.5705 => 1.2974, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -17.21% (1.5559 => 1.2881, std.dev.: 0.0642) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -17.06% (0.0633 => 0.0525, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/chomp: -16.75% (0.2400 => 0.1998, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -16.66% (1.5190 => 1.2659, std.dev.: 0.0323) SingleSource/Benchmarks/Shootout-C++/hash: -16.59% (0.5227 => 0.4360, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -16.43% (0.0621 => 0.0519, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -16.33% (1.6204 => 1.3558, std.dev.: 0.0361) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.21% (0.6982 => 0.5850, std.dev.: 0.0276) SingleSource/Benchmarks/CoyoteBench/almabench: -16.17% (0.0903 => 0.0757, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.16% (1.4163 => 1.1874, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -16.14% (1.5411 => 1.2923, std.dev.: 0.0274) MultiSource/Benchmarks/FreeBench/neural/neural: -16.06% (0.3100 => 0.2602, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -16.06% (0.1812 => 0.1521, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -16.03% (1.5057 => 1.2644, std.dev.: 0.0393) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -15.90% (0.1176 => 0.0989, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -15.88% (1.4084 => 1.1848, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -15.78% (1.4856 => 1.2511, std.dev.: 0.0628) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -15.72% (0.1018 => 0.0858, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -15.68% (0.1046 => 0.0882, std.dev.: 0.0026) MultiSource/Benchmarks/sim/sim: -15.65% (0.4276 => 0.3607, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -15.64% (1.4466 => 1.2204, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -15.48% (1.4500 => 1.2256, std.dev.: 0.0818) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -15.45% (0.3527 => 0.2982, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.37% (0.0761 => 0.0644, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -15.15% (0.1056 => 0.0896, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: -15.09% (0.4678 => 0.3972, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -14.72% (0.4157 => 0.3545, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -14.71% (0.0836 => 0.0713, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -14.59% (0.1145 => 0.0978, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -14.58% (1.5145 => 1.2937, std.dev.: 0.0399) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -14.31% (0.1579 => 0.1353, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -14.29% (1.6065 => 1.3770, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -14.27% (1.5623 => 1.3393, std.dev.: 0.0701) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -14.19% (1.4586 => 1.2516, std.dev.: 0.0452) MultiSource/Benchmarks/SciMark2-C/scimark2: -14.05% (0.4433 => 0.3810, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.79% (1.4047 => 1.2110, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -13.78% (1.4306 => 1.2334, std.dev.: 0.0484) SingleSource/Benchmarks/McGill/exptree: -13.75% (0.1360 => 0.1173, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -13.63% (1.5955 => 1.3780, std.dev.: 0.0842) SingleSource/Benchmarks/Adobe-C++/functionobjects: -13.29% (0.5817 => 0.5044, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -13.19% (1.7097 => 1.4842, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -13.16% (1.4654 => 1.2725, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -13.12% (1.5530 => 1.3492, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -13.10% (1.5234 => 1.3238, std.dev.: 0.0555) SingleSource/Benchmarks/CoyoteBench/huffbench: -12.77% (0.1206 => 0.1052, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -12.30% (1.4393 => 1.2622, std.dev.: 0.0413) SingleSource/Benchmarks/Shootout-C++/moments: -12.11% (0.4342 => 0.3816, std.dev.: 0.0113) SingleSource/Benchmarks/Misc-C++/Large/ray: -12.04% (0.3803 => 0.3345, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -11.73% (1.4164 => 1.2502, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -11.72% (0.0879 => 0.0776, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -11.37% (1.4393 => 1.2757, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -10.90% (1.5529 => 1.3836, std.dev.: 0.0316) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.85% (0.3456 => 0.3081, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: -10.83% (0.2972 => 0.2650, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -10.49% (1.4726 => 1.3181, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/oourafft: -10.37% (0.2489 => 0.2231, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: -10.29% (0.2936 => 0.2634, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.09% (0.1318 => 0.1185, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/strcat: -9.95% (0.2272 => 0.2046, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: -9.47% (0.2111 => 0.1911, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: -9.25% (0.2356 => 0.2138, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -8.30% (0.2254 => 0.2067, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/ary: -5.88% (0.2736 => 0.2575, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.92% (0.2437 => 0.2317, std.dev.: 0.0035) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -49.87% (0.2797 => 0.1402, std.dev.: 0.0411) MultiSource/Benchmarks/Olden/bisort/bisort: -29.27% (0.9171 => 0.6487, std.dev.: 0.0671) MultiSource/Benchmarks/7zip/7zip-benchmark: -9.03% (10.0516 => 9.1436, std.dev.: 0.1729) SingleSource/Benchmarks/Shootout-C++/hash: -6.43% (0.6575 => 0.6152, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: -5.98% (0.3630 => 0.3413, std.dev.: 0.0037) MultiSource/Benchmarks/Bullet/bullet: -2.87% (7.2393 => 7.0315, std.dev.: 0.0322) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.81% (0.5415 => 0.5263, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel: -2.53% (1.0677 => 1.0407, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.64% (3.3734 => 3.3181, std.dev.: 0.0101) SingleSource/Benchmarks/Misc/ffbench: -1.19% (1.4063 => 1.3895, std.dev.: 0.0065) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -18.76% (1.4891 => 1.2097, std.dev.: 0.1473) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -33.63% (0.0223 => 0.0148, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -20.77% (0.0443 => 0.0351, std.dev.: 0.0142) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.89% (0.0337 => 0.0334, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.62% (0.0321 => 0.0319, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.15% (0.0434 => 0.0429, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -1.44% (0.0209 => 0.0206, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -35.14% (0.0222 => 0.0144, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -25.15% (0.0338 => 0.0253, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 2.38% (0.1473 => 0.1508, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -2.89% (1.1732 => 1.1393, std.dev.: 0.3863) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.93% (0.4105 => 0.4067, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1492 => 0.1486, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.00% (0.0657 => 0.0611, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.85% (0.0586 => 0.0540, std.dev.: 0.0136) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.07% (1.2867 => 1.2858, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -18.75% (0.0032 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.48% (0.0620 => 0.0617, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.88% (0.0349 => 0.0373, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.19% (1.7475 => 1.7509, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 160.00% (0.0040 => 0.0104, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -5.18% (34.3518 => 32.5734, std.dev.: 0.7851) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 390.18% (0.0336 => 0.1647, std.dev.: 0.0472) SingleSource/Regression/C/sumarraymalloc: 109.22% (0.0293 => 0.0613, std.dev.: 0.0012) SingleSource/Regression/C/sumarray2d: 88.69% (0.0274 => 0.0517, std.dev.: 0.0036) MultiSource/Benchmarks/FreeBench/neural/neural: 58.85% (0.1638 => 0.2602, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.09% (0.8893 => 1.2725, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.85% (0.9120 => 1.2937, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.65% (0.8926 => 1.2644, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 40.90% (0.9422 => 1.3276, std.dev.: 0.0592) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.79% (0.9061 => 1.2757, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.40% (0.9855 => 1.3836, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.37% (0.9612 => 1.3492, std.dev.: 0.0459) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.16% (0.9564 => 1.3405, std.dev.: 0.0716) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.76% (0.9381 => 1.3111, std.dev.: 0.1361) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.69% (0.9588 => 1.3393, std.dev.: 0.0701) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.07% (0.8990 => 1.2502, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.84% (0.9091 => 1.2622, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.57% (0.9512 => 1.3181, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 38.24% (1.0119 => 1.3989, std.dev.: 0.0969) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.83% (0.9998 => 1.3780, std.dev.: 0.0842) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.43% (0.9403 => 1.2923, std.dev.: 0.0274) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.89% (0.9010 => 1.2334, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.58% (1.0867 => 1.4842, std.dev.: 0.0114) SingleSource/Benchmarks/McGill/exptree: 36.55% (0.0859 => 0.1173, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.88% (0.8912 => 1.2110, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.62% (0.8736 => 1.1848, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.88% (1.0052 => 1.3558, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.84% (0.8732 => 1.1774, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.23% (0.8846 => 1.1874, std.dev.: 0.0349) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.08% (0.9867 => 1.3131, std.dev.: 0.0563) SingleSource/Benchmarks/Stanford/IntMM: 32.95% (0.0431 => 0.0573, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.16% (1.0017 => 1.3238, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.86% (0.9488 => 1.2511, std.dev.: 0.0628) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.65% (0.9507 => 1.2516, std.dev.: 0.0452) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.60% (0.9788 => 1.2881, std.dev.: 0.0642) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.71% (0.9685 => 1.2659, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.41% (1.0088 => 1.3156, std.dev.: 0.0757) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.10% (0.9127 => 1.1874, std.dev.: 0.0788) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.83% (0.9993 => 1.2974, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.76% (0.9405 => 1.2204, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.34% (0.9550 => 1.2256, std.dev.: 0.0818) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.80% (1.0860 => 1.3770, std.dev.: 0.0495) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.03% (0.0805 => 0.0926, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.08% (1.0986 => 1.2533, std.dev.: 0.0346) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.82% (3.6295 => 4.1311, std.dev.: 0.1792) MultiSource/Benchmarks/mafft/pairlocalalign: 12.94% (9.5202 => 10.7520, std.dev.: 0.0502) SingleSource/Benchmarks/McGill/chomp: 11.43% (0.1793 => 0.1998, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.28% (0.1955 => 0.2156, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.19% (1.8651 => 2.0365, std.dev.: 0.0580) SingleSource/Benchmarks/Misc/ReedSolomon: 9.17% (0.2050 => 0.2238, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.02% (0.2879 => 0.3081, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/bigfib: 3.26% (0.6711 => 0.6930, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.72% (23.5861 => 24.2277, std.dev.: 0.1033) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.66% (44.1538 => 45.3294, std.dev.: 0.1311) MultiSource/Benchmarks/Bullet/bullet: 2.09% (33.2440 => 33.9399, std.dev.: 0.0434) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107237.50% (0.0008 => 0.8587, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout/matrix: 354.39% (1.5825 => 7.1908, std.dev.: 0.0484) MultiSource/Applications/sgefa/sgefa: 261.42% (0.3515 => 1.2704, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.37% (1.1825 => 4.0603, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.70% (4.8185 => 15.8386, std.dev.: 0.2114) SingleSource/Benchmarks/Shootout-C++/ary2: 208.53% (0.0129 => 0.0398, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 186.84% (0.0228 => 0.0654, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ary: 142.67% (0.0232 => 0.0563, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/matrix: 63.61% (2.9083 => 4.7582, std.dev.: 0.1767) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.25% (5.6033 => 7.4664, std.dev.: 0.1570) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.93% (3.1254 => 4.1233, std.dev.: 0.0192) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.13% (1.4588 => 1.8545, std.dev.: 0.0305) SingleSource/Regression/C/uint64_to_float: 23.58% (1.5397 => 1.9028, std.dev.: 0.0226) SingleSource/Benchmarks/Misc/salsa20: 22.09% (7.4497 => 9.0957, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.80% (4.8112 => 5.8121, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.22% (5.1752 => 5.8594, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.18% (5.0033 => 5.6128, std.dev.: 0.0295) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.97% (3.6477 => 3.9750, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/ReedSolomon: 7.99% (8.6447 => 9.3357, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.97% (4.7473 => 5.0783, std.dev.: 0.0094) SingleSource/Benchmarks/McGill/chomp: 5.39% (1.0425 => 1.0987, std.dev.: 0.0183) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.30% (4.1836 => 4.4054, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.09% (5.0310 => 5.2370, std.dev.: 0.0529) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.64% (4.7254 => 4.8500, std.dev.: 0.0432) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (4.1668 => 4.2726, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (2.5681 => 2.5961, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0023) SingleSource/Benchmarks/SmallPT/smallpt: -25.37% (0.1888 => 0.1409, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.72% (0.1009 => 0.0810, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -17.95% (0.0847 => 0.0695, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.68% (0.7686 => 0.6558, std.dev.: 0.0261) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.42% (0.1366 => 0.1251, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash: -7.02% (0.4689 => 0.4360, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.02% (1.0234 => 0.9516, std.dev.: 0.0194) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.03% (0.9124 => 0.8574, std.dev.: 0.0183) SingleSource/Benchmarks/Shootout-C++/fibo: -5.93% (0.2006 => 0.1887, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.59% (0.3093 => 0.2982, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.38% (0.3462 => 0.3345, std.dev.: 0.0022) MultiSource/Benchmarks/sim/sim: -2.91% (0.3715 => 0.3607, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.80% (11.5523 => 3.9509, std.dev.: 0.0283) SingleSource/Benchmarks/Misc/fp-convert: -61.95% (15.6525 => 5.9552, std.dev.: 0.1435) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.61% (0.4146 => 0.1799, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.58% (0.4578 => 0.2354, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.87% (11.3868 => 6.3913, std.dev.: 0.0124) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.86% (5.4023 => 3.6272, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/bisort/bisort: -30.78% (0.9372 => 0.6487, std.dev.: 0.0671) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -27.92% (0.4452 => 0.3209, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.59% (0.5495 => 0.4034, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.24% (5.2605 => 3.8801, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.38% (4.4467 => 3.3181, std.dev.: 0.0101) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.06% (0.5897 => 0.4478, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.96% (0.5826 => 0.4430, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.39% (4.9921 => 3.8244, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.24% (5.8755 => 4.8038, std.dev.: 0.0118) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.70% (16.6791 => 13.8929, std.dev.: 0.1824) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.86% (7.0016 => 5.8909, std.dev.: 0.0672) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.18% (0.1164 => 0.0999, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.59% (5.3626 => 4.6876, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.53% (3.1921 => 2.7920, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.51% (9.7992 => 8.5733, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.21% (5.7056 => 5.0092, std.dev.: 0.0188) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.41% (0.4081 => 0.3697, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.46% (0.3217 => 0.2977, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.93% (4.2843 => 3.9872, std.dev.: 0.0347) MultiSource/Benchmarks/Olden/health/health: -6.60% (0.3654 => 0.3413, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.52% (5.5974 => 5.2326, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.19% (4.5424 => 4.2614, std.dev.: 0.0204) MultiSource/Benchmarks/mafft/pairlocalalign: -5.65% (63.1520 => 59.5838, std.dev.: 0.1185) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.60% (4.9799 => 4.7011, std.dev.: 0.0585) SingleSource/Benchmarks/McGill/queens: -5.24% (1.7443 => 1.6529, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/hash2: -4.45% (3.6768 => 3.5130, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.20% (3.5127 => 3.3650, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.00% (0.3349 => 0.3215, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.56% (1.4446 => 1.3932, std.dev.: 0.0137) SingleSource/Benchmarks/Shootout-C++/lists: -3.33% (17.2182 => 16.6442, std.dev.: 0.0760) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.22% (5.8973 => 5.7076, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.14% (0.3406 => 0.3299, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: -2.93% (0.3687 => 0.3579, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel-2: -2.52% (0.8521 => 0.8306, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/ffbench: -2.45% (1.4244 => 1.3895, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -2.39% (7.2040 => 7.0315, std.dev.: 0.0322) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.86% (8.7327 => 8.5707, std.dev.: 0.0587) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.64% (85.3042 => 83.9016, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/hash: -1.63% (0.6254 => 0.6152, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/whetstone: -1.39% (1.6251 => 1.6025, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.27% (3.3596 => 3.3169, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (3.7450 => 3.7001, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.04% (6.8262 => 6.7555, std.dev.: 0.0186) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.42% (1.2047 => 1.2097, std.dev.: 0.1473) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -36.48% (0.0233 => 0.0148, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -22.17% (0.0451 => 0.0351, std.dev.: 0.0142) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.23% (0.0394 => 0.0334, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.74% (0.0328 => 0.0319, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0070) SingleSource/UnitTests/Vector/Altivec/casts: -3.29% (0.0213 => 0.0206, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/test1: -36.56% (0.0227 => 0.0144, std.dev.: 0.0092) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.78% (0.0255 => 0.0253, std.dev.: 0.0033) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.44% (0.1530 => 0.1508, std.dev.: 0.0071) MultiSource/Applications/lemon/lemon: -40.95% (1.9293 => 1.1393, std.dev.: 0.3863) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.44% (0.4049 => 0.4067, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.59% (0.1510 => 0.1486, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.53% (0.0978 => 0.0611, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.47% (0.0590 => 0.0540, std.dev.: 0.0136) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (1.1617 => 1.2858, std.dev.: 0.0074) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0610 => 0.0617, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.43% (0.7437 => 1.7509, std.dev.: 0.0100) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 13.04% (0.0092 => 0.0104, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 154.92% (12.7781 => 32.5734, std.dev.: 0.7851) Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 00:09:45 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 02:09:45 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129080945.A885D2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8065?compare_to=8063&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8065, Order: 173774, Start Time: 2013-01-29 06:33:43, End Time: 2013-01-29 08:10:06 To: 8063, Order: 173763, Start Time: 2013-01-29 04:36:05, End Time: 2013-01-29 06:10:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 4 (124 on baseline) Performance Improvements: 0 (88 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1100 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/kimwitu++/kc: 1.68% (18.4410 => 18.7512, std.dev.: 0.0032) MultiSource/Applications/siod/siod: 1.35% (2.3981 => 2.4305, std.dev.: 0.0005) MultiSource/Applications/lambda-0_1_3/lambda: 1.32% (0.7890 => 0.7994, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (5.7652 => 5.8252, std.dev.: 0.0121) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.89% (0.0974 => 0.1645, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 50.19% (0.0267 => 0.0401, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.40% (0.1500 => 0.2196, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.50% (0.6395 => 0.8857, std.dev.: 0.0225) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.72% (0.6395 => 0.8743, std.dev.: 0.0232) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.09% (0.5688 => 0.7570, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.97% (0.5456 => 0.7255, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.97% (0.5805 => 0.7719, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.89% (0.6260 => 0.8319, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.53% (0.5567 => 0.7378, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.45% (0.5849 => 0.7747, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.16% (0.5581 => 0.7376, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.09% (0.6230 => 0.8229, std.dev.: 0.0284) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.00% (0.5575 => 0.7359, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.33% (0.5802 => 0.7620, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.22% (0.5941 => 0.7796, std.dev.: 0.0191) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 31.04% (0.0699 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.03% (0.5705 => 0.7475, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.74% (0.5478 => 0.7162, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.57% (0.5859 => 0.7650, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.57% (0.6033 => 0.7877, std.dev.: 0.0194) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.48% (0.5857 => 0.7642, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.38% (0.5569 => 0.7261, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.19% (1.6474 => 2.1448, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.03% (0.5591 => 0.7270, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.75% (0.6440 => 0.8356, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.23% (0.5925 => 0.7657, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.07% (0.6189 => 0.7988, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.88% (0.6676 => 0.8604, std.dev.: 0.0207) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.60% (0.5863 => 0.7540, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.52% (0.6052 => 0.7778, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.43% (0.6304 => 0.8096, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.37% (0.6446 => 0.8275, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.35% (0.0582 => 0.0747, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.32% (0.6194 => 0.7886, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.24% (0.6681 => 0.8501, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.10% (0.6660 => 0.8465, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.89% (0.6297 => 0.7990, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.48% (0.6667 => 0.8366, std.dev.: 0.0227) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.39% (0.7524 => 0.9359, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.64% (0.7339 => 0.9074, std.dev.: 0.0210) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.16% (2.2587 => 2.7819, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.54% (0.0621 => 0.0761, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.03% (0.0622 => 0.0759, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.44% (0.3357 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 16.02% (0.1230 => 0.1427, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.62% (1.1450 => 1.3238, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.81% (0.0864 => 0.0992, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.82% (0.0731 => 0.0832, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.02% (0.1982 => 0.2240, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.74% (4.5069 => 5.0812, std.dev.: 0.0071) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.41% (0.4916 => 0.5526, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.18% (1.6364 => 1.8357, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.11% (3.5339 => 3.9618, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.69% (0.1731 => 0.1916, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.14% (9.2283 => 10.1636, std.dev.: 0.0864) SingleSource/Benchmarks/Shootout-C++/hash: 9.22% (0.4524 => 0.4941, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.21% (0.5329 => 0.5820, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.01% (1.2515 => 1.3643, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7021 => 0.7646, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.31% (0.4861 => 0.5265, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.06% (1.2784 => 1.3814, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.90% (0.2001 => 0.2159, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.74% (1.4642 => 1.5776, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.95% (0.6750 => 0.7219, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 6.92% (0.1879 => 0.2009, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.53% (5.4682 => 5.8252, std.dev.: 0.0121) SingleSource/Benchmarks/McGill/chomp: 6.47% (0.1761 => 0.1875, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 5.90% (0.3255 => 0.3447, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.85% (0.3319 => 0.3513, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.88% (5.0226 => 5.2175, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.87% (0.3491 => 0.3626, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.65% (0.7447 => 0.7719, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 3.57% (15.5079 => 16.0619, std.dev.: 0.0062) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.48% (0.9557 => 0.9890, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3446 => 0.3562, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.22% (1.3864 => 1.4311, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.14% (0.4427 => 0.4566, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.10% (0.8418 => 0.8679, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.08% (0.5168 => 0.5327, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.50% (18.2933 => 18.7512, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.16% (1.3722 => 1.4018, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.38% (1.2300 => 1.2470, std.dev.: 0.0049) MultiSource/Applications/treecc/treecc: 1.34% (2.1401 => 2.1688, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.27% (3.5154 => 3.5601, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 1.18% (2.4021 => 2.4305, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8085, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.87% (0.9531 => 1.0281, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1484, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4515, std.dev.: 0.1037) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1036, std.dev.: 0.0106) MultiSource/Applications/sqlite3/sqlite3: 1.58% (4.5320 => 4.6037, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.56% (4.8812 => 4.9572, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2484, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.48% (18.2231 => 18.4928, std.dev.: 0.0437) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2706, std.dev.: 0.0246) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4532, std.dev.: 0.0144) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.27% (0.3812 => 0.3611, std.dev.: 0.0054) SingleSource/UnitTests/ObjC/exceptions-2: -5.17% (0.3831 => 0.3633, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -5.15% (0.3848 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -5.08% (0.3880 => 0.3683, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -5.01% (0.4033 => 0.3831, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -5.01% (0.3896 => 0.3701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.94% (0.3884 => 0.3692, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.91% (0.3891 => 0.3700, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions: -4.53% (0.4176 => 0.3987, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.39% (0.7198 => 0.6882, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/property: -3.88% (0.4199 => 0.4036, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3821 => 0.3684, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.34% (0.4280 => 0.4137, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.01% (0.9852 => 0.9555, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -2.96% (0.6347 => 0.6159, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.84% (0.6441 => 0.6258, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2066, std.dev.: 0.0397) MultiSource/Applications/hexxagon/hexxagon: -2.45% (1.3148 => 1.2826, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: -2.43% (0.7779 => 0.7590, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.42% (0.6484 => 0.6327, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.21% (0.9542 => 0.9331, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.91% (14.2083 => 13.9367, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.55% (6.7716 => 6.6668, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -1.07% (16.1920 => 16.0193, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.06% (1.0544 => 1.0432, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.36% (1.8100 => 0.7174, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3135, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2492, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/mandel-2: -24.62% (1.3643 => 1.0284, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7516, std.dev.: 0.0047) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0832, std.dev.: 0.5299) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.94% (4.1024 => 3.2025, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1736, std.dev.: 0.0266) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -14.96% (2.5106 => 2.1349, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0325) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3572, std.dev.: 0.0175) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.88% (0.5142 => 0.4634, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0326) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0143) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1733, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3993, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2764, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/ary3: -2.68% (3.7241 => 3.6243, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.38% (7.9763 => 7.7864, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.60% (1.3096 => 1.2886, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6091, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5883, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6676, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0047) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.38s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 00:47:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 02:47:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129084721.8190F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8066?compare_to=8062&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8066, Order: 173774, Start Time: 2013-01-29 06:32:48, End Time: 2013-01-29 08:47:40 To: 8062, Order: 173760, Start Time: 2013-01-29 03:40:55, End Time: 2013-01-29 06:02:11 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (228 on baseline) Performance Improvements: 207 (62 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 892 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: 66.67% (0.0321 => 0.0535) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -72.48% (144.7349 => 39.8316, std.dev.: 0.0190) SingleSource/Benchmarks/Misc/flops: -54.62% (0.4493 => 0.2039, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/objinst: -46.29% (0.0931 => 0.0500, std.dev.: 0.0016) SingleSource/Regression/C/casts: -40.98% (0.0632 => 0.0373, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -40.13% (0.1632 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -38.48% (0.2643 => 0.1626, std.dev.: 0.0009) SingleSource/UnitTests/2006-01-23-UnionInit: -38.48% (0.0460 => 0.0283, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: -34.29% (0.0694 => 0.0456, std.dev.: 0.0021) SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -33.24% (0.0364 => 0.0243, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: -31.41% (0.4833 => 0.3315, std.dev.: 0.0013) SingleSource/UnitTests/2002-05-02-CastTest: -29.54% (0.0369 => 0.0260, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -26.21% (14.9609 => 11.0395, std.dev.: 0.0093) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.17% (0.0858 => 0.0642, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -24.70% (0.1567 => 0.1180, std.dev.: 0.0026) SingleSource/Benchmarks/SmallPT/smallpt: -24.22% (0.2325 => 0.1762) SingleSource/Regression/C++/EH/function_try_block: -23.97% (0.0463 => 0.0352, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/mason/mason: -23.95% (0.1119 => 0.0851, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -23.46% (0.0959 => 0.0734, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -22.71% (0.6943 => 0.5366, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: -22.46% (90.0981 => 69.8661, std.dev.: 0.0649) MultiSource/Benchmarks/Olden/bh/bh: -22.30% (0.4570 => 0.3551, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: -22.24% (0.2005 => 0.1559, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -21.53% (0.2555 => 0.2005, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -20.93% (0.1228 => 0.0971, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -20.27% (8.3629 => 6.6680, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -20.20% (0.4892 => 0.3904, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: -20.02% (0.1054 => 0.0843, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -19.20% (2.2195 => 1.7933, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/himenobmtxpa: -19.12% (0.3044 => 0.2462, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.12% (0.1883 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/uuencode/uuencode: -19.00% (0.0700 => 0.0567, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -18.92% (3.4149 => 2.7689, std.dev.: 0.0098) MultiSource/Applications/sqlite3/sqlite3: -18.85% (24.4872 => 19.8709, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -18.54% (0.0809 => 0.0659) MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.14% (0.4151 => 0.3398, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C++/family/family: -17.60% (0.0574 => 0.0473, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: -17.31% (0.0803 => 0.0664, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: -17.02% (22.8835 => 18.9889, std.dev.: 0.0384) MultiSource/Benchmarks/Prolangs-C++/trees/trees: -16.64% (0.1490 => 0.1242, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: -16.61% (1.6632 => 1.3870, std.dev.: 0.0097) MultiSource/Applications/Burg/burg: -16.57% (1.8772 => 1.5662, std.dev.: 0.0065) MultiSource/Benchmarks/llubenchmark/llu: -16.35% (0.0691 => 0.0578, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: -16.34% (2.9586 => 2.4752, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: -16.33% (1.0939 => 0.9153, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -16.24% (2.5578 => 2.1424, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -16.02% (6.0545 => 5.0843, std.dev.: 0.0192) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -15.94% (0.4912 => 0.4129, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -15.81% (5.5966 => 4.7118, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -15.78% (0.4113 => 0.3464, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -15.59% (0.1751 => 0.1478, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/messages-2: -15.56% (0.0977 => 0.0825, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -15.45% (1.0634 => 0.8991, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -15.42% (0.8550 => 0.7232, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: -15.40% (0.1844 => 0.1560, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: -15.38% (2.0253 => 1.7138, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.24% (0.1096 => 0.0929, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: -15.15% (0.4668 => 0.3961, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: -14.69% (0.1321 => 0.1127, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.65% (0.7947 => 0.6783, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -14.60% (3.7962 => 3.2418, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -14.54% (2.9212 => 2.4964, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: -14.50% (4.8436 => 4.1411, std.dev.: 0.0053) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.42% (0.1234 => 0.1056, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: -14.41% (1.7279 => 1.4789, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -14.25% (0.0709 => 0.0608, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fbench: -14.07% (0.0810 => 0.0696, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -13.96% (0.0996 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -13.89% (0.1498 => 0.1290, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/18-imp/imp: -13.75% (0.4874 => 0.4204, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: -13.40% (0.4739 => 0.4104, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/richards_benchmark: -13.31% (0.1089 => 0.0944, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -13.23% (0.0854 => 0.0741) SingleSource/Benchmarks/CoyoteBench/almabench: -13.18% (0.1411 => 0.1225, std.dev.: 0.0030) MultiSource/Applications/oggenc/oggenc: -13.16% (8.2239 => 7.1420, std.dev.: 0.0132) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.10% (0.1061 => 0.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -12.95% (0.9410 => 0.8191, std.dev.: 0.0034) MultiSource/Benchmarks/7zip/7zip-benchmark: -12.93% (58.9025 => 51.2887, std.dev.: 0.2518) MultiSource/Benchmarks/Prolangs-C++/simul/simul: -12.92% (0.1099 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -12.89% (0.2110 => 0.1838, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.87% (1.0916 => 0.9511, std.dev.: 0.0070) MultiSource/Benchmarks/Ptrdist/bc/bc: -12.84% (1.6548 => 1.4424, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: -12.74% (1.3165 => 1.1488, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -12.63% (0.0871 => 0.0761, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -12.60% (0.1040 => 0.0909, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -12.49% (0.0897 => 0.0785, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/loader/loader: -12.41% (0.3859 => 0.3380, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: -12.39% (0.1767 => 0.1548, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.28% (0.0969 => 0.0850, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.17% (0.2934 => 0.2577, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: -12.15% (23.9951 => 21.0806, std.dev.: 0.0114) MultiSource/Applications/hbd/hbd: -12.10% (2.0551 => 1.8065, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.98% (0.3523 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: -11.96% (14.1171 => 12.4287, std.dev.: 0.2391) MultiSource/Benchmarks/McCat/09-vor/vor: -11.93% (0.4266 => 0.3757, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: -11.91% (1.1209 => 0.9874, std.dev.: 0.0031) SingleSource/UnitTests/SignlessTypes/rem: -11.88% (0.1574 => 0.1387, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: -11.75% (1.2360 => 1.0908, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.57% (0.8887 => 0.7859, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -11.55% (0.8068 => 0.7136, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -11.52% (0.1745 => 0.1544, std.dev.: 0.0021) SingleSource/Benchmarks/BenchmarkGame/n-body: -11.32% (0.1087 => 0.0964, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: -11.29% (0.1258 => 0.1116, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: -11.28% (0.2393 => 0.2123, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -11.28% (0.2527 => 0.2242, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.19% (0.1037 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -11.11% (0.0936 => 0.0832, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.90% (0.1294 => 0.1153, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -10.78% (0.1865 => 0.1664, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: -10.77% (0.2265 => 0.2021, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: -10.70% (0.1701 => 0.1519, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -10.60% (5.0301 => 4.4968, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -10.57% (2.0464 => 1.8301, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/neural/neural: -10.38% (0.2949 => 0.2643, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: -10.35% (1.0107 => 0.9061, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: -10.29% (0.2070 => 0.1857, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.24% (1.5210 => 1.3653, std.dev.: 0.0018) MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.22% (1.5216 => 1.3661, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.18% (18.0793 => 16.2382, std.dev.: 0.0433) MultiSource/Benchmarks/MallocBench/espresso/espresso: -10.18% (6.5571 => 5.8897, std.dev.: 0.0145) MultiSource/Benchmarks/MallocBench/gs/gs: -10.17% (5.5542 => 4.9891, std.dev.: 0.0131) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -10.17% (0.1151 => 0.1034, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -10.12% (1.3109 => 1.1782, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -10.07% (0.7786 => 0.7002, std.dev.: 0.0006) MultiSource/Applications/sgefa/sgefa: -10.04% (0.5028 => 0.4523, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.02% (5.0271 => 4.5232, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -10.02% (10.2573 => 9.2294, std.dev.: 0.0205) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -10.01% (1.0824 => 0.9741, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -9.60% (1.3122 => 1.1862, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/chomp: -9.55% (0.2429 => 0.2197, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -9.52% (13.5281 => 12.2403, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/reversefile: -9.30% (0.4978 => 0.4515, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -9.30% (0.9337 => 0.8469, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -9.20% (0.9437 => 0.8569, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.13% (0.9708 => 0.8822, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -9.03% (0.9022 => 0.8207, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -8.94% (0.1230 => 0.1120, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -8.92% (0.8552 => 0.7789, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -8.85% (0.8501 => 0.7749, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.83% (0.9288 => 0.8468, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -8.70% (0.1712 => 0.1563, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -8.70% (0.1586 => 0.1448, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -8.69% (0.8485 => 0.7748, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -8.65% (9.1425 => 8.3515, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -8.62% (0.8222 => 0.7513, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -8.61% (0.5189 => 0.4742, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -8.61% (0.8540 => 0.7805, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: -8.54% (0.1604 => 0.1467, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.53% (0.8638 => 0.7901, std.dev.: 0.0002) SingleSource/Benchmarks/Linpack/linpack-pc: -8.51% (0.3582 => 0.3277, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -8.51% (0.8386 => 0.7672, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -8.50% (0.8898 => 0.8142, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -8.48% (0.7963 => 0.7288, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: -8.44% (0.2653 => 0.2429, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -8.42% (0.8324 => 0.7623, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.41% (0.1640 => 0.1502, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -8.36% (0.7980 => 0.7313, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.29% (0.7889 => 0.7235, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -8.27% (0.7954 => 0.7296, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.27% (1.0981 => 1.0073, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -8.26% (1.1458 => 1.0511, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: -8.20% (0.5035 => 0.4622, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -8.19% (1.0576 => 0.9710, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.14% (1.7767 => 1.6321, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/hash2: -8.08% (0.6446 => 0.5925, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.06% (1.0690 => 0.9828, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.03% (0.1581 => 0.1454, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -8.01% (0.3369 => 0.3099, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -8.01% (1.1199 => 1.0302, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.96% (1.0379 => 0.9553, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -7.92% (0.9807 => 0.9030, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -7.92% (6.6061 => 6.0830, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -7.91% (6.6207 => 6.0973, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.78% (0.9659 => 0.8908, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.76% (1.0060 => 0.9279, std.dev.: 0.0005) MultiSource/Applications/JM/lencod/lencod: -7.76% (33.3228 => 30.7382, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.75% (1.1025 => 1.0171, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.72% (0.6894 => 0.6362, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -7.63% (0.9801 => 0.9053, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/functionobjects: -7.62% (0.6887 => 0.6362, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.61% (0.9653 => 0.8918, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.60% (0.9930 => 0.9175, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -7.58% (0.9433 => 0.8718, std.dev.: 0.0008) MultiSource/Applications/aha/aha: -7.53% (0.1620 => 0.1498, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.52% (0.9069 => 0.8387, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: -7.51% (0.4036 => 0.3733, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.46% (0.9880 => 0.9143, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.42% (0.9262 => 0.8575, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -7.39% (0.9227 => 0.8545, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.39% (0.9139 => 0.8464, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.36% (0.2963 => 0.2745, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash: -7.26% (0.5953 => 0.5521, std.dev.: 0.0129) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.02% (2.5848 => 2.4033, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.98% (0.2751 => 0.2559, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/05-eks/eks: -6.89% (0.6199 => 0.5772, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (0.2139 => 0.1997, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.89% (0.4635 => 0.4362, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.71% (0.4375 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -5.69% (0.4639 => 0.4375, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -5.45% (0.4609 => 0.4358, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.41% (0.4267 => 0.4036, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.23% (0.2064 => 0.1956, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.46% (1.7155 => 1.6390, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (4.8019 => 4.6170, std.dev.: 0.0021) MultiSource/Applications/ClamAV/clamscan: -3.57% (57.8051 => 55.7387, std.dev.: 0.0176) MultiSource/Applications/hexxagon/hexxagon: -3.38% (1.4776 => 1.4276, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -3.37% (11.5455 => 11.1564, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.13% (10.4148 => 10.2975, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0417 => 0.0419, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.44% (0.0694 => 0.0704, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: -0.03% (499.8426 => 499.7165, std.dev.: 0.0689) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 44212.89% (1.1277 => 499.7165, std.dev.: 0.0689) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.75% (0.5229 => 1.7138, std.dev.: 0.0034) MultiSource/Applications/SPASS/SPASS: 26.68% (14.9895 => 18.9889, std.dev.: 0.0384) MultiSource/Applications/kimwitu++/kc: 48.92% (14.1553 => 21.0806, std.dev.: 0.0114) MultiSource/Benchmarks/MallocBench/gs/gs: 21.37% (4.1105 => 4.9891, std.dev.: 0.0131) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.32% (1.1048 => 1.7933, std.dev.: 0.0014) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 456.45% (7.1582 => 39.8316, std.dev.: 0.0190) SingleSource/Benchmarks/Misc-C++-EH/spirit: 92.56% (3.4629 => 6.6680, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.64% (0.6222 => 1.1488, std.dev.: 0.0020) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.36% (0.0720 => 7.4429, std.dev.: 0.0017) MultiSource/Applications/SIBsim4/SIBsim4: 3833600.00% (0.0001 => 3.8337, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11094600.00% (0.0001 => 11.0947, std.dev.: 0.0122) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 66000.00% (0.0001 => 0.0661, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489900.00% (0.0001 => 5.4900, std.dev.: 0.0120) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.91% (1.1194 => 10.2975, std.dev.: 0.0032) MultiSource/Applications/ClamAV/clamscan: 151.35% (22.1758 => 55.7387, std.dev.: 0.0176) SingleSource/Benchmarks/Misc/lowercase: 133.20% (0.0256 => 0.0597, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.77% (0.0929 => 0.1893, std.dev.: 0.0129) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 80.66% (0.1463 => 0.2643, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 72.69% (0.0271 => 0.0468, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 67.81% (0.0730 => 0.1225, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/IntMM: 67.26% (0.0394 => 0.0659, std.dev.: 0.0017) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.41% (1.5859 => 2.4964, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.13% (2.9384 => 4.6170, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.50% (7.0540 => 11.0395, std.dev.: 0.0093) MultiSource/Benchmarks/FreeBench/distray/distray: 53.98% (0.1056 => 0.1626, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.44% (8.1363 => 12.2403, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 50.11% (0.0439 => 0.0659) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.19% (2.2024 => 3.2418, std.dev.: 0.0008) SingleSource/UnitTests/vla: 45.63% (0.0355 => 0.0517, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 45.48% (0.3109 => 0.4523, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 42.39% (0.1432 => 0.2039, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.43% (0.1062 => 0.1502, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 40.12% (21.9371 => 30.7382, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.98% (1.5415 => 2.1424, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.11% (4.2646 => 5.8897, std.dev.: 0.0145) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.85% (0.4615 => 0.6362, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 37.16% (0.5105 => 0.7002, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 37.10% (0.0814 => 0.1116, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.46% (0.2271 => 0.3099, std.dev.: 0.0019) SingleSource/UnitTests/2006-12-11-LoadConstants: 36.40% (0.1143 => 0.1559, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.25% (0.1892 => 0.2559, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.70% (0.6675 => 0.8991, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 34.53% (1.1642 => 1.5662, std.dev.: 0.0065) MultiSource/Benchmarks/McCat/05-eks/eks: 34.26% (0.4299 => 0.5772, std.dev.: 0.0013) MultiSource/Benchmarks/NPB-serial/is/is: 33.80% (0.0719 => 0.0962, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.17% (0.0793 => 0.1056, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.04% (0.0457 => 0.0608, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 32.75% (0.1655 => 0.2197, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 32.54% (0.1337 => 0.1772, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 32.27% (0.1695 => 0.2242, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 32.17% (0.3121 => 0.4125, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.94% (0.0479 => 0.0632, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.38% (0.1125 => 0.1478, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.10% (0.0730 => 0.0957, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 31.04% (9.4845 => 12.4287, std.dev.: 0.2391) SingleSource/Benchmarks/Shootout/hash: 30.72% (0.0485 => 0.0634, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.63% (3.8922 => 5.0843, std.dev.: 0.0192) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 30.43% (0.1906 => 0.2486, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 30.42% (0.1029 => 0.1342, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 30.32% (0.0442 => 0.0576, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 30.15% (0.1151 => 0.1498, std.dev.: 0.0005) MultiSource/Applications/viterbi/viterbi: 29.97% (0.1555 => 0.2021, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 29.80% (0.2554 => 0.3315, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 29.48% (0.0614 => 0.0795, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 29.36% (1.0722 => 1.3870, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/tsp/tsp: 29.28% (0.1175 => 0.1519, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 29.01% (1.4186 => 1.8301, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash: 28.72% (0.4289 => 0.5521, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 28.64% (0.7115 => 0.9153, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 28.25% (0.4620 => 0.5925, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 28.15% (0.0842 => 0.1079, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.53% (0.0672 => 0.0857, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.52% (0.1566 => 0.1997, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.95% (0.1117 => 0.1418, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 26.87% (0.6456 => 0.8191, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 26.77% (0.0437 => 0.0554, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.73% (0.5020 => 0.6362, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.46% (0.1236 => 0.1563, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.41% (0.0886 => 0.1120, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/mst/mst: 26.14% (0.1163 => 0.1467, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 26.06% (0.0660 => 0.0832, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 26.02% (0.7835 => 0.9874, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/15-trie/trie: 26.00% (0.0527 => 0.0664, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.93% (0.0675 => 0.0850, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.85% (0.2700 => 0.3398, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/lists: 25.40% (0.0626 => 0.0785, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 25.25% (0.1695 => 0.2123, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 25.21% (0.1940 => 0.2429, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.07% (1.3050 => 1.6321, std.dev.: 0.0058) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.00% (0.1032 => 0.1290, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 24.91% (1.1840 => 1.4789, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 24.69% (0.0648 => 0.0808, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 24.62% (0.0662 => 0.0825, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0028) MultiSource/Applications/d/make_dparser: 24.16% (3.3354 => 4.1411, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.10% (0.3307 => 0.4104, std.dev.: 0.0100) MultiSource/Applications/oggenc/oggenc: 24.01% (5.7591 => 7.1420, std.dev.: 0.0132) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.82% (0.0953 => 0.1180, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.48% (0.1584 => 0.1956, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.41% (0.5860 => 0.7232, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.26% (0.8172 => 1.0073, std.dev.: 0.0150) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 23.15% (0.2065 => 0.2543, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/matrix: 23.11% (0.3098 => 0.3814, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.02% (4.9449 => 6.0830, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.98% (0.1510 => 0.1857, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/18-imp/imp: 22.82% (0.3423 => 0.4204, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 22.75% (0.0567 => 0.0696, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.55% (0.2758 => 0.3380, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.54% (0.0528 => 0.0647, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.31% (0.2107 => 0.2577, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/football/football: 22.27% (0.8921 => 1.0908, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 22.09% (2.0273 => 2.4752, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/health/health: 22.08% (0.1268 => 0.1548, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 21.96% (0.2049 => 0.2499, std.dev.: 0.0008) MultiSource/Applications/lambda-0_1_3/lambda: 21.90% (0.7433 => 0.9061, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.90% (5.0018 => 6.0973, std.dev.: 0.0145) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.84% (0.6450 => 0.7859, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.82% (0.0834 => 0.1016, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.80% (0.5569 => 0.6783, std.dev.: 0.0024) MultiSource/Applications/lua/lua: 21.68% (3.8723 => 4.7118, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.61% (1.1861 => 1.4424, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.47% (0.9765 => 1.1862, std.dev.: 0.0031) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.41% (0.0467 => 0.0567, std.dev.: 0.0009) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 21.08% (0.0759 => 0.0919, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.05% (0.0798 => 0.0966, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.79% (0.0933 => 0.1127, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.65% (0.0770 => 0.0929, std.dev.: 0.0016) MultiSource/Applications/siod/siod: 20.55% (2.2969 => 2.7689, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.37% (0.0491 => 0.0591, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.24% (0.8101 => 0.9741, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.99% (0.3441 => 0.4129, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.91% (0.4203 => 0.5040, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.31% (0.5981 => 0.7136, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.13% (0.2603 => 0.3101, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.97% (0.1044 => 0.1242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 18.92% (0.3283 => 0.3904, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout/matrix: 18.70% (0.0818 => 0.0971, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 18.66% (0.3232 => 0.3835, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.3180 => 0.3757, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.90% (0.8067 => 0.9511, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.33% (0.0704 => 0.0826, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: 17.11% (0.3379 => 0.3957, std.dev.: 0.0059) MultiSource/Benchmarks/sim/sim: 16.95% (0.3387 => 0.3961, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.82% (0.3865 => 0.4515, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.54% (0.4636 => 0.5403, std.dev.: 0.0207) MultiSource/Applications/hbd/hbd: 15.78% (1.5603 => 1.8065, std.dev.: 0.0031) MultiSource/Applications/sqlite3/sqlite3: 15.66% (17.1811 => 19.8709, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.57% (0.4103 => 0.4742, std.dev.: 0.0022) SingleSource/Regression/C++/ofstream_ctor: 15.56% (0.2905 => 0.3357, std.dev.: 0.0125) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 15.07% (0.3684 => 0.4239, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout-C++/lists: 14.93% (0.3422 => 0.3933, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bh/bh: 14.84% (0.3092 => 0.3551, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 14.54% (0.3603 => 0.4127, std.dev.: 0.0121) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.92% (0.3427 => 0.3904, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.90% (0.3826 => 0.4358, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/oourafft: 13.74% (0.3282 => 0.3733, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.73% (0.4064 => 0.4622, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.11% (0.1625 => 0.1838, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.03% (14.3668 => 16.2382, std.dev.: 0.0433) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.96% (0.2430 => 0.2745, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 12.91% (0.3927 => 0.4434, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/property: 12.58% (0.3886 => 0.4375, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/strcat: 12.54% (0.2831 => 0.3186, std.dev.: 0.0062) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 11.65% (0.3828 => 0.4274, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/except: 11.60% (0.2871 => 0.3204, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/for-in: 11.26% (0.3694 => 0.4110, std.dev.: 0.0057) MultiSource/Applications/hexxagon/hexxagon: 11.17% (1.2842 => 1.4276, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/synchronized: 11.15% (0.3561 => 0.3958, std.dev.: 0.0065) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.04% (0.3543 => 0.3934, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/exceptions-2: 10.95% (0.3497 => 0.3880, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.91% (2.0665 => 2.2920, std.dev.: 0.0074) SingleSource/UnitTests/ObjC/exceptions-3: 10.89% (0.3516 => 0.3899, std.dev.: 0.0072) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.85% (0.3935 => 0.4362, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 10.74% (0.2877 => 0.3186, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3650 => 0.4036, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 10.47% (63.2438 => 69.8661, std.dev.: 0.0649) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.47% (0.3162 => 0.3493, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/fibo: 10.42% (0.2725 => 0.3009, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2793 => 0.3079, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.24% (0.2891 => 0.3187, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/hello: 10.17% (0.2714 => 0.2990, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/random: 10.14% (0.2802 => 0.3086, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.06% (0.2872 => 0.3161, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.98% (0.4879 => 0.5366, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/wc: 9.80% (0.3052 => 0.3351, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.34% (0.3136 => 0.3429, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.32% (0.1330 => 0.1454, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.13% (2.2022 => 2.4033, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.03% (0.3177 => 0.3464, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference: 8.98% (0.7326 => 0.7984, std.dev.: 0.0188) SingleSource/UnitTests/ObjC++/property-reference-object: 8.97% (0.6030 => 0.6571, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.57% (0.5925 => 0.6433, std.dev.: 0.0114) MultiSource/Benchmarks/Olden/power/power: 8.33% (0.1440 => 0.1560, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 7.61% (10.3673 => 11.1564, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0032) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.90% (7.9617 => 8.3515, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0583) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3126, std.dev.: 0.0301) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4736, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.97% (11.6436 => 12.4552, std.dev.: 0.0459) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.36% (4.2280 => 4.4546, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/hash2: 4.83% (3.1578 => 3.3102, std.dev.: 0.0265) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.47% (8.6802 => 8.8943, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.00% (3.6395 => 3.7122, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/bisort/bisort: 1.97% (0.8333 => 0.8497, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7563, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.63% (9.1159 => 9.2644, std.dev.: 0.0328) MultiSource/Benchmarks/mafft/pairlocalalign: 1.62% (27.8444 => 28.2949, std.dev.: 0.0847) MultiSource/Benchmarks/Olden/tsp/tsp: 1.38% (1.0785 => 1.0934, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.18% (6.5088 => 6.5859, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.72% (6.6874 => 0.1523, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1782, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -41.80% (0.1622 => 0.0944, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.50% (5.3855 => 4.4968, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.50% (5.3526 => 4.5232, std.dev.: 0.0086) MultiSource/Applications/JM/ldecod/ldecod: -11.56% (10.4361 => 9.2294, std.dev.: 0.0205) SingleSource/UnitTests/Vector/constpool: -7.49% (54.1659 => 50.1064, std.dev.: 1.3158) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.92% (1.7609 => 1.6390, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.12% (1.9577 => 0.6632, std.dev.: 0.0137) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -41.50% (0.0400 => 0.0234, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -30.55% (10.7105 => 7.4381, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9234, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0050, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3255, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -18.74% (0.2161 => 0.1756, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.76% (2.5528 => 2.1249, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/flops-6: -15.79% (1.6925 => 1.4253, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.15% (3.1443 => 2.7308, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.95% (0.9540 => 0.8400, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4930, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7559, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.95% (1.8329 => 1.7055, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.89% (19.9488 => 18.5740, std.dev.: 0.1447) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.06% (1.2373 => 1.1623, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.67% (8.1563 => 7.6935, std.dev.: 0.0079) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.84% (1.5835 => 1.5069, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -4.81% (10.2830 => 9.7883, std.dev.: 0.0095) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0081) SingleSource/Benchmarks/Shootout/lists: -2.15% (6.2999 => 6.1642, std.dev.: 0.0334) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9551, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3305, std.dev.: 0.0304) MultiSource/Applications/sqlite3/sqlite3: -1.34% (4.6441 => 4.5817, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.73% (0.2116 => 0.0704, std.dev.: 0.0014) Report Time: 2.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 01:23:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 03:23:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129092322.DED042A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8067?compare_to=8064&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8067, Order: 173775, Start Time: 2013-01-29 07:21:24, End Time: 2013-01-29 09:23:44 To: 8064, Order: 173768, Start Time: 2013-01-29 04:59:33, End Time: 2013-01-29 07:03:58 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (97 on baseline) Performance Improvements: 5 (88 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1053 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/football/football: 1.77% (0.9793 => 0.9966, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 18.53% (44.5138 => 52.7607, std.dev.: 0.3138) SingleSource/Benchmarks/Shootout-C++/matrix: 6.27% (4.7582 => 5.0567, std.dev.: 0.0506) MultiSource/Applications/siod/siod: 2.68% (3.5378 => 3.6327, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.16% (4.3245 => 4.4177, std.dev.: 0.0219) SingleSource/Regression/C/uint64_to_float: 1.83% (1.9028 => 1.9376, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.46% (1.3810 => 1.3470, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -9.98% (7.4664 => 6.7214, std.dev.: 0.1983) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -7.13% (1.8792 => 1.7452, std.dev.: 0.0508) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.32% (40.7349 => 38.9733, std.dev.: 0.4035) MultiSource/Applications/spiff/spiff: -2.39% (2.8553 => 2.7872, std.dev.: 0.0172) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.03% (1.2097 => 1.2222, std.dev.: 0.2004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 43.92% (0.0148 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 23.36% (0.0351 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.60% (0.0334 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -14.42% (0.0319 => 0.0273, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.47% (0.0429 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -0.49% (0.0206 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: 49.31% (0.0144 => 0.0215, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.79% (0.0253 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -1.19% (0.1508 => 0.1490, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -0.18% (1.1393 => 1.1372, std.dev.: 0.3671) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.42% (0.4067 => 0.3928, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.61% (0.1486 => 0.1477, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.86% (0.0611 => 0.0659, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0277 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.93% (0.0540 => 0.0535, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.91% (1.2858 => 1.3103, std.dev.: 0.0452) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0617 => 0.0617, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.24% (0.0373 => 0.0346, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.53% (1.7509 => 1.7417, std.dev.: 0.0111) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -85.71% (0.0007 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 300.00% (0.0002 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 18.27% (0.0104 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 4.80% (32.5734 => 34.1360, std.dev.: 0.2087) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 392.86% (0.0336 => 0.1656, std.dev.: 0.0039) SingleSource/Regression/C/sumarraymalloc: 117.41% (0.0293 => 0.0637, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 87.96% (0.0274 => 0.0515, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/neural/neural: 60.68% (0.1638 => 0.2632, std.dev.: 0.0013) SingleSource/Regression/C/sumarray: 51.32% (0.0265 => 0.0401, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.35% (0.8926 => 1.2706, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.12% (0.8893 => 1.2639, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.63% (0.9120 => 1.2917, std.dev.: 0.0881) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.09% (0.9061 => 1.2784, std.dev.: 0.0883) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.98% (0.9612 => 1.3551, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.05% (0.9381 => 1.3138, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.95% (0.9564 => 1.3385, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.60% (0.9588 => 1.3385, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.07% (0.9091 => 1.2643, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.01% (0.8990 => 1.2497, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.37% (0.9855 => 1.3636, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.77% (0.9998 => 1.3774, std.dev.: 0.1232) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.72% (0.9422 => 1.2976, std.dev.: 0.0913) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.33% (0.9403 => 1.2913, std.dev.: 0.0421) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.85% (0.9512 => 1.3017, std.dev.: 0.0748) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.77% (1.0119 => 1.3840, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.75% (0.9010 => 1.2321, std.dev.: 0.0360) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.01% (0.8912 => 1.2121, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.86% (0.8736 => 1.1869, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.44% (1.0867 => 1.4718, std.dev.: 0.1148) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.22% (1.0052 => 1.3592, std.dev.: 0.0912) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.75% (0.8732 => 1.1766, std.dev.: 0.0244) SingleSource/Benchmarks/Stanford/IntMM: 34.57% (0.0431 => 0.0580, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.13% (0.8846 => 1.1865, std.dev.: 0.0907) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.75% (0.9867 => 1.3098, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.50% (1.0017 => 1.3273, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.18% (0.9788 => 1.2938, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.65% (0.9488 => 1.2491, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.48% (0.9507 => 1.2500, std.dev.: 0.0491) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.71% (1.0088 => 1.3186, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.61% (0.9685 => 1.2650, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.37% (0.9127 => 1.1899, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.68% (0.9405 => 1.2196, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.57% (0.9993 => 1.2948, std.dev.: 0.0254) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.31% (0.9550 => 1.2254, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.95% (1.0860 => 1.3787, std.dev.: 0.1049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.09% (0.0738 => 0.0901, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 19.68% (0.3598 => 0.4306, std.dev.: 0.0260) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 17.21% (0.0738 => 0.0865, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.41% (0.0707 => 0.0823, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.89% (0.0963 => 0.1116, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.41% (0.0805 => 0.0921, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.30% (0.0783 => 0.0895, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.27% (0.1240 => 0.1417, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.26% (1.0986 => 1.2553, std.dev.: 0.0333) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.91% (0.0762 => 0.0868, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.21% (0.1332 => 0.1508, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 10.93% (0.1793 => 0.1989, std.dev.: 0.0040) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.31% (0.4596 => 0.5070, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.09% (0.5369 => 0.5911, std.dev.: 0.0032) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.28% (1.4110 => 1.5419, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 9.07% (0.2050 => 0.2236, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.60% (5.0381 => 5.4713, std.dev.: 0.1636) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.03% (1.8651 => 2.0148, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.88% (0.1955 => 0.2109, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.84% (0.2577 => 0.2779, std.dev.: 0.0038) SingleSource/Benchmarks/Linpack/linpack-pc: 6.86% (0.2566 => 0.2742, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.38% (0.2372 => 0.2476, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.78% (0.3702 => 0.3805, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/football/football: 2.12% (0.9759 => 0.9966, std.dev.: 0.0052) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (1.3310 => 1.3470, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 105825.00% (0.0008 => 0.8474, std.dev.: 0.0309) SingleSource/Benchmarks/Shootout/matrix: 334.45% (1.5825 => 6.8752, std.dev.: 0.1874) SingleSource/Benchmarks/Shootout/ary3: 265.33% (2.2304 => 8.1483, std.dev.: 1.6635) MultiSource/Applications/sgefa/sgefa: 258.86% (0.3515 => 1.2614, std.dev.: 0.0256) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.43% (1.1825 => 4.0611, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.08% (4.8185 => 15.9529, std.dev.: 0.1039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 204.39% (0.0228 => 0.0694, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 186.82% (0.0129 => 0.0370, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary: 145.26% (0.0232 => 0.0569, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/matrix: 73.87% (2.9083 => 5.0567, std.dev.: 0.0506) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.08% (0.2562 => 0.3384, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.02% (3.1254 => 4.0949, std.dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.39% (1.4588 => 1.8583, std.dev.: 0.0292) SingleSource/Regression/C/uint64_to_float: 25.84% (1.5397 => 1.9376, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/salsa20: 21.84% (7.4497 => 9.0764, std.dev.: 0.1324) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.32% (4.8112 => 5.7886, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.95% (5.6033 => 6.7214, std.dev.: 0.1983) MultiSource/Applications/JM/lencod/lencod: 13.86% (6.8159 => 7.7609, std.dev.: 0.1315) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.34% (5.1752 => 5.8658, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6501, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.80% (3.6477 => 3.9688, std.dev.: 0.0339) SingleSource/Benchmarks/Misc/ReedSolomon: 7.82% (8.6447 => 9.3208, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.06% (4.7473 => 5.0824, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.88% (0.6211 => 0.6576, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.19% (4.1836 => 4.4009, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.97% (5.0310 => 5.2307, std.dev.: 0.0246) SingleSource/Benchmarks/Linpack/linpack-pc: 3.67% (50.8945 => 52.7607, std.dev.: 0.3138) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.31% (4.7254 => 4.8818, std.dev.: 0.0155) SingleSource/Benchmarks/Misc/pi: 3.25% (2.1390 => 2.2085, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.01% (0.8800 => 0.8977, std.dev.: 0.0045) MultiSource/Applications/siod/siod: 1.16% (3.5910 => 3.6327, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.11% (0.0808 => 0.0492, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.19% (0.0727 => 0.0493, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.02% (0.0692 => 0.0505, std.dev.: 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: -25.00% (0.1888 => 0.1416, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.71% (0.0676 => 0.0536, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.93% (0.1009 => 0.0818, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -18.41% (1.8964 => 1.5472, std.dev.: 0.0692) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.86% (0.1684 => 0.1400, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.13% (0.1079 => 0.0905, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.51% (0.7686 => 0.6571, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.22% (1.0960 => 0.9401, std.dev.: 0.0062) SingleSource/UnitTests/Vector/constpool: -12.89% (9.8875 => 8.6129, std.dev.: 0.2946) MultiSource/Applications/spiff/spiff: -11.75% (1.0220 => 0.9019, std.dev.: 0.0387) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.40% (0.7693 => 0.7047, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.91% (0.9124 => 0.8402, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.53% (10.2703 => 9.4965, std.dev.: 0.0792) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.08% (0.3560 => 0.3308, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.90% (1.0234 => 0.9528, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.49% (0.9588 => 0.8966, std.dev.: 0.0115) MultiSource/Applications/ClamAV/clamscan: -6.35% (17.4365 => 16.3292, std.dev.: 0.4259) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.33% (0.2481 => 0.2324, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.84% (0.6885 => 0.6483, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.19% (0.5746 => 0.5448, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.17% (0.2283 => 0.2165, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.16% (0.2618 => 0.2483, std.dev.: 0.0050) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.21% (0.2709 => 0.2595, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.06% (1.5131 => 1.4516, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.86% (0.2615 => 0.2514, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.80% (1.6874 => 1.6402, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.47% (1.3924 => 1.3580, std.dev.: 0.0053) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.69% (0.6996 => 0.6878, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.49% (14.9757 => 14.7530, std.dev.: 0.0291) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9427, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/fp-convert: -62.11% (15.6525 => 5.9312, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.83% (0.4146 => 0.1790, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.47% (0.4578 => 0.2359, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.91% (11.3868 => 6.3868, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.89% (5.4023 => 3.6253, std.dev.: 0.0485) MultiSource/Benchmarks/Olden/bisort/bisort: -31.12% (0.9372 => 0.6455, std.dev.: 0.0124) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.71% (0.4452 => 0.3085, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/heapsort: -30.14% (4.4739 => 3.1256, std.dev.: 0.3395) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.79% (1.0816 => 0.7702, std.dev.: 0.0497) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.12% (0.5495 => 0.4005, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.02% (5.2605 => 3.8917, std.dev.: 0.0518) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.16% (0.5826 => 0.4360, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3288, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.28% (0.5897 => 0.4465, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0056) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -19.85% (0.1164 => 0.0933, std.dev.: 0.0042) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.79% (1.5623 => 1.2688, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.46% (5.8755 => 4.7908, std.dev.: 0.0122) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.89% (16.6791 => 14.1951, std.dev.: 0.3325) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.51% (7.0016 => 5.9860, std.dev.: 0.2282) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.19% (3.1921 => 2.7710, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6741, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.69% (9.7992 => 8.5560, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.50% (5.7056 => 4.9923, std.dev.: 0.0143) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.07% (0.0845 => 0.0743, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.41% (1.4235 => 1.2611, std.dev.: 0.0282) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.83% (0.4081 => 0.3639, std.dev.: 0.0150) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.22% (2.8778 => 2.5836, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: -9.43% (4.5259 => 4.0992, std.dev.: 0.0632) MultiSource/Applications/SIBsim4/SIBsim4: -7.95% (3.5443 => 3.2627, std.dev.: 0.0115) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.80% (0.3217 => 0.2966, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.64% (5.5974 => 5.2256, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.45% (4.5424 => 4.2495, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.67% (4.9799 => 4.6976, std.dev.: 0.0574) MultiSource/Benchmarks/mafft/pairlocalalign: -5.62% (63.1520 => 59.6038, std.dev.: 0.0462) SingleSource/Benchmarks/McGill/queens: -5.60% (1.7443 => 1.6466, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: -4.81% (3.6768 => 3.4998, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3591, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.87% (23.3986 => 22.4931, std.dev.: 0.2690) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.80% (3.5691 => 3.4335, std.dev.: 0.0234) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.71% (40.4729 => 38.9733, std.dev.: 0.4035) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.60% (5.8973 => 5.6852, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.58% (1.4446 => 1.3929, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.05% (0.3406 => 0.3302, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -2.45% (2.8571 => 2.7872, std.dev.: 0.0172) SingleSource/Benchmarks/Misc/whetstone: -2.10% (1.6251 => 1.5910, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.82% (8.7327 => 8.5737, std.dev.: 0.0040) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.73% (85.3042 => 83.8286, std.dev.: 0.0643) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (8.8249 => 8.6848, std.dev.: 0.0218) MultiSource/Benchmarks/BitBench/five11/five11: -1.50% (5.7021 => 5.6167, std.dev.: 0.0329) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3596 => 3.3141, std.dev.: 0.0034) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (3.7450 => 3.6989, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7482, std.dev.: 0.0218) SingleSource/Benchmarks/Shootout-C++/methcall: -1.00% (8.7416 => 8.6540, std.dev.: 0.0157) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.45% (1.2047 => 1.2222, std.dev.: 0.2004) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -8.58% (0.0233 => 0.0213, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -16.77% (0.0328 => 0.0273, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -3.76% (0.0213 => 0.0205, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -5.29% (0.0227 => 0.0215, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.61% (0.1530 => 0.1490, std.dev.: 0.0039) MultiSource/Applications/lemon/lemon: -41.06% (1.9293 => 1.1372, std.dev.: 0.3671) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.99% (0.4049 => 0.3928, std.dev.: 0.0286) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.19% (0.1510 => 0.1477, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.62% (0.0978 => 0.0659, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.32% (0.0590 => 0.0535, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.79% (1.1617 => 1.3103, std.dev.: 0.0452) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0610 => 0.0617, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.10% (0.0268 => 0.0346, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.19% (0.7437 => 1.7417, std.dev.: 0.0111) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.14% (12.7781 => 34.1360, std.dev.: 0.2087) Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 02:08:49 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 04:08:49 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129100849.07BF22A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8068?compare_to=8065&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8068, Order: 173777, Start Time: 2013-01-29 08:34:07, End Time: 2013-01-29 10:09:08 To: 8065, Order: 173774, Start Time: 2013-01-29 06:33:43, End Time: 2013-01-29 08:10:06 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (121 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.01% (0.0717 => 0.1219, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.74% (0.0974 => 0.1624, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.42% (0.6395 => 0.8852, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.65% (0.6395 => 0.8739, std.dev.: 0.0015) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.99% (0.5805 => 0.7720, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.93% (0.5688 => 0.7561, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.89% (0.6260 => 0.8319, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.86% (0.5456 => 0.7249, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.59% (0.5849 => 0.7755, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.21% (0.5567 => 0.7360, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.18% (0.5581 => 0.7377, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.05% (0.5575 => 0.7362, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.99% (0.6230 => 0.8223, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.26% (0.5941 => 0.7798, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.23% (0.5802 => 0.7614, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.80% (0.5705 => 0.7462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.57% (0.5859 => 0.7650, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.36% (0.5857 => 0.7635, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.31% (0.5569 => 0.7257, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.30% (0.5478 => 0.7138, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.23% (0.5570 => 0.7254, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.13% (1.6474 => 2.1438, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.87% (0.5591 => 0.7261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.78% (0.6440 => 0.8358, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.01% (0.5925 => 0.7644, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.92% (0.6189 => 0.7979, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.76% (0.6676 => 0.8596, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.47% (0.0699 => 0.0898, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.47% (0.5863 => 0.7532, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.44% (0.6304 => 0.8097, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.37% (0.6052 => 0.7769, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.22% (0.6446 => 0.8265, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.42% (0.6681 => 0.8513, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.20% (0.6194 => 0.7879, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.04% (0.6660 => 0.8461, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.62% (0.6297 => 0.7973, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.32% (0.6667 => 0.8355, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.35% (0.7524 => 0.9356, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.49% (0.7339 => 0.9063, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.90% (2.2587 => 2.7760, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.38% (0.0621 => 0.0760, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.20% (0.0566 => 0.0669, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.41% (0.3357 => 0.3908, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.88% (0.0680 => 0.0788, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 15.57% (1.1450 => 1.3233, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 14.39% (0.1230 => 0.1407, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.09% (0.0731 => 0.0834, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.71% (4.5069 => 5.0796, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.45% (0.4916 => 0.5528, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 12.27% (0.0864 => 0.0970, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.12% (1.6364 => 1.8347, std.dev.: 0.0115) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4515 => 0.5060, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.07% (3.5339 => 3.9604, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: 9.95% (9.2283 => 10.1469, std.dev.: 0.0150) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.94% (0.1731 => 0.1903, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.5329 => 0.5823, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.97% (1.2515 => 1.3638, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.80% (0.4524 => 0.4922, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4861 => 0.5269, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.20% (0.2001 => 0.2165, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.78% (1.2784 => 1.3779, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.77% (1.4642 => 1.5780, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 7.04% (0.6750 => 0.7225, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.33% (5.4682 => 5.8144, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 6.24% (0.3255 => 0.3458, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 5.96% (0.1761 => 0.1866, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3319 => 0.3503, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.79% (22.4056 => 23.4793, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3446 => 0.3577, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 3.64% (5.0226 => 5.2056, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout-C++/ary: 3.57% (0.3394 => 0.3515, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.55% (0.9557 => 0.9896, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.53% (0.7447 => 0.7710, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 3.36% (15.5079 => 16.0293, std.dev.: 0.0313) MultiSource/Applications/spiff/spiff: 3.31% (0.8418 => 0.8697, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.25% (0.4427 => 0.4571, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.09% (0.3491 => 0.3599, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 2.99% (1.3864 => 1.4278, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.12% (1.3722 => 1.4013, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 2.08% (18.2933 => 18.6733, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.2300 => 1.2454, std.dev.: 0.0039) MultiSource/Applications/d/make_dparser: 1.19% (3.5154 => 3.5573, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8007, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5041, std.dev.: 0.0565) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6061, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2500, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.45% (18.2231 => 18.4871, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2694, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.13% (79.7170 => 80.6175, std.dev.: 0.2996) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -4.77% (0.3880 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.69% (0.3884 => 0.3702, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.67% (0.3896 => 0.3714, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.65% (0.3831 => 0.3653, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.39% (0.3891 => 0.3720, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -4.24% (0.4176 => 0.3999, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.82% (2.4924 => 2.3972, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3821 => 0.3681, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -3.62% (0.4199 => 0.4047, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.30% (0.9852 => 0.9527, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: -3.25% (0.4280 => 0.4141, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.21% (0.3142 => 0.3041, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.89% (0.3837 => 0.3726, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -2.85% (0.6347 => 0.6166, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.75% (0.9542 => 0.9280, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -2.74% (0.7779 => 0.7566, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference-object: -2.69% (0.6441 => 0.6268, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2175, std.dev.: 0.0299) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.39% (0.6484 => 0.6329, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.39% (1.3148 => 1.2834, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.11% (2.1713 => 2.1254, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.03% (14.2083 => 13.9204, std.dev.: 0.0119) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.50% (6.7716 => 6.6701, std.dev.: 0.0171) MultiSource/Applications/JM/lencod/lencod: -1.19% (16.1920 => 15.9989, std.dev.: 0.0432) MultiSource/Applications/sqlite3/sqlite3: -1.07% (17.1032 => 16.9205, std.dev.: 0.0068) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.94% (1.8100 => 0.6888, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3139, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0221, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7529, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0773, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3639, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2056, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1293, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3552, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.21% (0.5142 => 0.4617, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -8.91% (1.2842 => 1.1698, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.46% (0.8545 => 0.8164, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.79% (2.2633 => 2.1776, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (7.9763 => 7.7814, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.10% (3.7241 => 3.6458, std.dev.: 0.0078) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1747, std.dev.: 0.0247) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.63% (6.5735 => 6.4663, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6104, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6037, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5913, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6711, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 02:13:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 04:13:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130129101315.9FE5A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8069?compare_to=8061&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8069, Order: 173774, Start Time: 2013-01-29 06:16:47, End Time: 2013-01-29 10:13:35 To: 8061, Order: 173726, Start Time: 2013-01-29 01:45:23, End Time: 2013-01-29 05:19:59 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (173 on baseline) Performance Improvements: 33 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1067 (763 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 18.43% (0.3527 => 0.4177, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.91% (0.0642 => 0.0757, std.dev.: 0.0004) MultiSource/Applications/JM/ldecod/ldecod: 8.35% (0.2430 => 0.2633, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.42% (2.1627 => 2.1934, std.dev.: 0.0065) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -23.07% (0.7966 => 0.6128, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -15.76% (0.9907 => 0.8346, std.dev.: 0.0079) MultiSource/Benchmarks/FreeBench/pifft/pifft: -11.62% (0.2598 => 0.2296, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -10.39% (0.3890 => 0.3486, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.13% (0.6790 => 0.6102, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -9.76% (0.2623 => 0.2367, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -9.76% (2.4873 => 2.2446, std.dev.: 0.0147) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.96% (14.4697 => 13.1730, std.dev.: 0.0083) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -8.89% (0.1688 => 0.1538, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: -8.34% (0.5934 => 0.5439, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -8.31% (0.1216 => 0.1115, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -8.23% (0.1288 => 0.1182, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -8.10% (0.1284 => 0.1180, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -8.10% (0.1420 => 0.1305, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.08% (0.1423 => 0.1308, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -7.15% (0.2869 => 0.2664, std.dev.: 0.0068) MultiSource/Benchmarks/nbench/nbench: -6.90% (0.3234 => 0.3011, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: -6.35% (6.8375 => 6.4033, std.dev.: 0.1359) SingleSource/Benchmarks/Misc-C++-EH/spirit: -6.20% (5.5600 => 5.2154, std.dev.: 0.0060) MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (2.5430 => 2.3855, std.dev.: 0.0085) MultiSource/Applications/kimwitu++/kc: -5.61% (13.7636 => 12.9910, std.dev.: 0.2117) SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.60% (0.3305 => 0.3120, std.dev.: 0.0010) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.52% (26.7348 => 25.2582, std.dev.: 0.0574) SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.29% (0.7786 => 0.7374, std.dev.: 0.0025) MultiSource/Applications/oggenc/oggenc: -4.25% (2.1153 => 2.0253, std.dev.: 0.0314) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.04% (3.3258 => 3.1915, std.dev.: 0.0420) MultiSource/Benchmarks/Bullet/bullet: -3.75% (28.6312 => 27.5581, std.dev.: 0.0863) SingleSource/UnitTests/Vector/constpool: -3.57% (2.4904 => 2.4014, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.55% (5.3293 => 5.1399, std.dev.: 0.0319) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -3.38% (0.6162 => 0.5954, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/bigfib: -3.05% (0.5959 => 0.5777, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: -2.18% (0.4911 => 0.4804, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: -2.08% (0.5037 => 0.4932, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.28% (0.0625 => 0.0933, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.51% (0.2969 => 0.4142, std.dev.: 0.0204) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 39.04% (0.0415 => 0.0577, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.56% (0.1063 => 0.1441, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/loader/loader: 30.21% (0.1549 => 0.2017, std.dev.: 0.0116) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.88% (0.0547 => 0.0705, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.24% (0.4139 => 0.5308, std.dev.: 0.0374) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.51% (0.5900 => 0.7523, std.dev.: 0.0301) MultiSource/Applications/oggenc/oggenc: 27.12% (1.5932 => 2.0253, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.02% (0.4253 => 0.5402, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.81% (0.4994 => 0.6333, std.dev.: 0.0140) MultiSource/Applications/aha/aha: 26.61% (0.0481 => 0.0609, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 26.38% (0.0599 => 0.0757, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.35% (0.3271 => 0.4133, std.dev.: 0.0202) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.32% (0.0475 => 0.0600, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.24% (0.5000 => 0.6312, std.dev.: 0.0128) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0055) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.08% (0.0897 => 0.1122, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.88% (0.1021 => 0.1275, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.88% (0.1620 => 0.2023, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 24.62% (0.1462 => 0.1822, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 23.97% (0.2866 => 0.3553, std.dev.: 0.0183) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.93% (0.1103 => 0.1367, std.dev.: 0.0087) MultiSource/Benchmarks/McCat/05-eks/eks: 23.66% (0.1619 => 0.2002, std.dev.: 0.0130) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.63% (0.1604 => 0.1983, std.dev.: 0.0081) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.58% (0.1107 => 0.1368, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 23.42% (0.4658 => 0.5749, std.dev.: 0.0236) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.33% (0.1003 => 0.1237, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.01% (0.3903 => 0.4801, std.dev.: 0.0292) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 22.66% (0.4029 => 0.4942, std.dev.: 0.0267) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0023) MultiSource/Applications/viterbi/viterbi: 22.07% (0.0947 => 0.1156, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 21.73% (0.5546 => 0.6751, std.dev.: 0.0309) MultiSource/Benchmarks/McCat/09-vor/vor: 21.53% (0.1505 => 0.1829, std.dev.: 0.0051) MultiSource/Benchmarks/McCat/08-main/main: 21.35% (0.1218 => 0.1478, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.32% (3.5627 => 4.3224, std.dev.: 0.1167) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.32% (0.1088 => 0.1320, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.28% (0.4361 => 0.5289, std.dev.: 0.0326) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.23% (0.3890 => 0.4716, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/mst/mst: 20.77% (0.0698 => 0.0843, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.65% (0.2736 => 0.3301, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.46% (0.2014 => 0.2426, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.25% (1.3152 => 1.5815, std.dev.: 0.0306) SingleSource/UnitTests/ObjC++/Hello: 19.36% (0.5826 => 0.6954, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.20% (0.0573 => 0.0683, std.dev.: 0.0035) MultiSource/Applications/hbd/hbd: 19.12% (0.9697 => 1.1551, std.dev.: 0.0462) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0061) SingleSource/UnitTests/ObjC++/property-reference-object: 18.92% (0.5889 => 0.7003, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.90% (0.1090 => 0.1296, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.70% (0.1968 => 0.2336, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.64% (1.6211 => 1.9233, std.dev.: 0.0915) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.60% (0.3930 => 0.4661, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.46% (0.5026 => 0.5954, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.09% (0.2875 => 0.3395, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 18.02% (0.9909 => 1.1695, std.dev.: 0.0475) MultiSource/Benchmarks/McCat/18-imp/imp: 18.02% (0.1421 => 0.1677, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/except: 17.75% (0.2811 => 0.3310, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: 17.68% (0.2823 => 0.3322, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.67% (0.2813 => 0.3310, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.66% (0.2792 => 0.3285, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.64% (0.2738 => 0.3221, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 17.64% (0.2750 => 0.3235, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.58% (1.9966 => 2.3477, std.dev.: 0.0311) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.58% (2.0673 => 2.4308, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 17.55% (0.2780 => 0.3268, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.55% (1.9694 => 2.3151, std.dev.: 0.0368) SingleSource/Benchmarks/Shootout-C++/random: 17.55% (0.2803 => 0.3295, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.52% (0.2911 => 0.3421, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hello: 17.46% (0.2714 => 0.3188, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/fibo: 17.43% (0.2725 => 0.3200, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 17.36% (1.0781 => 1.2653, std.dev.: 0.0370) MultiSource/Benchmarks/nbench/nbench: 17.34% (0.2566 => 0.3011, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.31% (0.3195 => 0.3748, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.30% (0.2729 => 0.3201, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 17.28% (0.3004 => 0.3523, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.25% (0.3060 => 0.3588, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: 17.22% (0.7171 => 0.8406, std.dev.: 0.0046) MultiSource/Benchmarks/Bullet/bullet: 17.17% (23.5202 => 27.5581, std.dev.: 0.0863) MultiSource/Applications/ClamAV/clamscan: 17.13% (4.2109 => 4.9321, std.dev.: 0.2072) SingleSource/Benchmarks/Shootout-C++/wc: 17.12% (0.3096 => 0.3626, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/ary3: 16.99% (0.3267 => 0.3822, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.94% (2.7292 => 3.1915, std.dev.: 0.0420) SingleSource/Benchmarks/Shootout-C++/ary: 16.88% (0.3258 => 0.3808, std.dev.: 0.0058) MultiSource/Applications/lua/lua: 16.78% (1.4269 => 1.6663, std.dev.: 0.0568) SingleSource/Benchmarks/Shootout-C++/sieve: 16.69% (0.3726 => 0.4348, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.58% (0.3317 => 0.3867, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.52% (0.3625 => 0.4224, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.49% (0.3124 => 0.3639, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.39% (0.3282 => 0.3820, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 16.39% (0.2075 => 0.2415, std.dev.: 0.0087) SingleSource/Benchmarks/Shootout-C++/lists: 16.37% (0.3348 => 0.3896, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.30% (4.4195 => 5.1399, std.dev.: 0.0319) SingleSource/Benchmarks/Shootout-C++/lists1: 16.28% (0.3477 => 0.4043, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.24% (0.3362 => 0.3908, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 16.11% (0.7875 => 0.9144, std.dev.: 0.0292) SingleSource/Benchmarks/Shootout-C++/moments: 16.10% (0.3678 => 0.4270, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 16.02% (0.4251 => 0.4932, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 15.96% (0.3446 => 0.3996, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.88% (0.3981 => 0.4613, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 15.87% (0.4146 => 0.4804, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/synchronized: 15.80% (0.3469 => 0.4017, std.dev.: 0.0071) SingleSource/UnitTests/ObjC/for-in: 15.73% (0.3496 => 0.4046, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-4: 15.73% (0.3465 => 0.4010, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.72% (0.3690 => 0.4270, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.72% (0.2068 => 0.2393, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.71% (0.3488 => 0.4036, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 15.69% (0.3442 => 0.3982, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 15.64% (0.3460 => 0.4001, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 15.55% (5.5417 => 6.4033, std.dev.: 0.1359) SingleSource/UnitTests/ObjC/property: 15.40% (0.3650 => 0.4212, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 15.37% (0.3643 => 0.4203, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.30% (0.0673 => 0.0776, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 15.26% (0.5012 => 0.5777, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 15.17% (0.3724 => 0.4289, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 15.02% (4.6177 => 5.3115, std.dev.: 0.1135) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.88% (0.3845 => 0.4417, std.dev.: 0.0025) MultiSource/Applications/JM/ldecod/ldecod: 14.84% (2.1653 => 2.4866, std.dev.: 0.0703) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.59% (0.6435 => 0.7374, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.49% (0.1028 => 0.1177, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.31% (0.5361 => 0.6128, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.99% (0.2737 => 0.3120, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 13.98% (0.0758 => 0.0864, std.dev.: 0.0037) MultiSource/Benchmarks/mafft/pairlocalalign: 13.52% (2.1013 => 2.3855, std.dev.: 0.0085) MultiSource/Applications/minisat/minisat: 13.43% (0.3336 => 0.3784, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.31% (0.0804 => 0.0911, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.17% (11.6398 => 13.1730, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.04% (0.3084 => 0.3486, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.72% (0.3498 => 0.3943, std.dev.: 0.0156) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.55% (0.2103 => 0.2367, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0060) MultiSource/Applications/siod/siod: 12.44% (0.6634 => 0.7459, std.dev.: 0.0276) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.39% (0.7426 => 0.8346, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (0.4847 => 0.5439, std.dev.: 0.0064) MultiSource/Applications/lemon/lemon: 11.42% (0.2391 => 0.2664, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.21% (0.1383 => 0.1538, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.14% (4.6926 => 5.2154, std.dev.: 0.0060) MultiSource/Applications/sqlite3/sqlite3: 10.32% (2.0346 => 2.2446, std.dev.: 0.0147) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.28% (0.5584 => 0.6102, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 8.66% (11.9555 => 12.9910, std.dev.: 0.2117) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.41% (0.3792 => 0.4035, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5137, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 93.20% (0.2162 => 0.4177, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.55% (0.0644 => 0.0757, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.72% (0.5917 => 0.6729, std.dev.: 0.0082) MultiSource/Applications/ClamAV/clamscan: 9.78% (0.2802 => 0.3076, std.dev.: 0.0033) MultiSource/Applications/JM/ldecod/ldecod: 9.16% (0.2412 => 0.2633, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.10% (0.3693 => 0.4029, std.dev.: 0.0043) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6102, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 5.18% (12.0509 => 12.6749, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2422, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.73% (1.8057 => 1.8911, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6814, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5022, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/ary3: 2.01% (15.8721 => 16.1919, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3102, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2895, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 1.27% (4.0317 => 4.0828, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2061, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6854, std.dev.: 0.0026) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.03% (2.4764 => 2.4014, std.dev.: 0.0098) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.84% (25.4195 => 16.5624, std.dev.: 0.0074) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8689, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/fldry: -17.37% (17.2379 => 14.2432, std.dev.: 0.1187) SingleSource/UnitTests/Vector/multiplies: -11.33% (2.3713 => 2.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -10.70% (0.2402 => 0.2145, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9763, std.dev.: 0.0127) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7927, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: -7.21% (2.1113 => 1.9591, std.dev.: 0.0038) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4811, std.dev.: 0.0039) SingleSource/Benchmarks/Dhrystone/dry: -4.19% (14.0481 => 13.4599, std.dev.: 0.2056) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2057, std.dev.: 0.0120) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2420, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8117, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7751, std.dev.: 0.0212) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.22% (0.6293 => 0.6153, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1296, std.dev.: 0.0787) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.70% (10.7630 => 10.5800, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4993, std.dev.: 0.0180) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1680, std.dev.: 0.0220) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0450, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 03:30:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 05:30:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129113040.148AE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8070?compare_to=8066&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8070, Order: 173777, Start Time: 2013-01-29 09:18:50, End Time: 2013-01-29 11:31:00 To: 8066, Order: 173774, Start Time: 2013-01-29 06:32:48, End Time: 2013-01-29 08:47:40 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (227 on baseline) Performance Improvements: 5 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1093 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 2.52% (0.6632 => 0.6799, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/lists: 1.10% (6.1642 => 6.2321, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: -3.73% (0.4125 => 0.3971, std.dev.: 0.0053) MultiSource/Benchmarks/PAQ8p/paq8p: -2.27% (11.1564 => 10.9029, std.dev.: 0.0066) MultiSource/Applications/minisat/minisat: -1.31% (0.9153 => 0.9033, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.26% (39.8316 => 39.3293, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.01% (11.0395 => 10.9276, std.dev.: 0.0050) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0419 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.55% (0.0704 => 0.0679, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7165 => 499.7913, std.dev.: 0.0243) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44219.53% (1.1277 => 499.7913, std.dev.: 0.0243) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 225.86% (0.5229 => 1.7039, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 25.87% (14.9895 => 18.8673, std.dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: 47.53% (14.1553 => 20.8830, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/gs/gs: 20.13% (4.1105 => 4.9381, std.dev.: 0.0261) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.59% (1.1048 => 1.7853, std.dev.: 0.0025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 449.43% (7.1582 => 39.3293, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.78% (3.4629 => 6.6064, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.41% (0.6222 => 1.1412, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.25% (0.0720 => 7.4457, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: 11106900.00% (0.0001 => 11.1070, std.dev.: 0.0359) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494300.00% (0.0001 => 5.4944, std.dev.: 0.0032) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 818.34% (1.1194 => 10.2799, std.dev.: 0.0049) MultiSource/Applications/ClamAV/clamscan: 151.02% (22.1758 => 55.6663, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.44% (0.0929 => 0.1890, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.31% (0.1463 => 0.2638, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 72.69% (0.0271 => 0.0468, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 67.53% (0.0730 => 0.1223, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.19% (2.9384 => 4.6190, std.dev.: 0.0013) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.66% (1.5859 => 2.4845, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.91% (7.0540 => 10.9276, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/distray/distray: 53.60% (0.1056 => 0.1622, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.29% (8.1363 => 12.2282, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.26% (2.2024 => 3.2212, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.10% (0.0439 => 0.0637, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 45.00% (0.3109 => 0.4508, std.dev.: 0.0012) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 42.94% (0.1062 => 0.1518, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 42.39% (0.1432 => 0.2039, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 39.80% (21.9371 => 30.6686, std.dev.: 0.0224) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.14% (1.5415 => 2.1294, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.53% (4.2646 => 5.8650, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.97% (0.4615 => 0.6321, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 36.73% (0.0814 => 0.1113) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.69% (0.5105 => 0.6927, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.05% (0.2271 => 0.3067, std.dev.: 0.0028) MultiSource/Applications/Burg/burg: 34.67% (1.1642 => 1.5678, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 34.45% (0.4299 => 0.5780, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.41% (0.1892 => 0.2543, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 33.94% (0.0719 => 0.0963, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.90% (0.6675 => 0.8938, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 32.21% (0.1655 => 0.2188, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 32.08% (0.0636 => 0.0840) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.86% (0.1695 => 0.2218, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 30.73% (9.4845 => 12.3987, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.55% (0.0730 => 0.0953, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.53% (0.1143 => 0.1492, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.24% (3.8922 => 5.0692, std.dev.: 0.0062) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.38% (0.0793 => 0.1026, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.33% (0.1125 => 0.1455, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.32% (0.0457 => 0.0591, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.09% (0.0746 => 0.0963, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash: 28.86% (0.4289 => 0.5527, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 28.79% (1.0722 => 1.3809, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/08-main/main: 28.43% (0.2554 => 0.3280, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.23% (0.1906 => 0.2444, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.05% (1.4186 => 1.8165, std.dev.: 0.0057) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.37% (0.1337 => 0.1703, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: 27.36% (0.4620 => 0.5884, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.23% (0.3121 => 0.3971, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: 26.96% (0.7115 => 0.9033, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 26.81% (0.1175 => 0.1490, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.49% (0.0672 => 0.0850, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.1566 => 0.1979, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 25.96% (0.6456 => 0.8132, std.dev.: 0.0071) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.72% (0.5020 => 0.6311, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/whetstone: 25.61% (0.0660 => 0.0829, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 25.57% (0.0485 => 0.0609, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.32% (0.1236 => 0.1549, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 25.05% (0.0527 => 0.0659, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 24.93% (0.1151 => 0.1438, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.70% (1.3050 => 1.6273, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 24.69% (0.1555 => 0.1939, std.dev.: 0.0040) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.68% (0.0871 => 0.1086, std.dev.: 0.0022) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 24.60% (0.0626 => 0.0780, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 24.48% (0.1695 => 0.2110, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.42% (0.1032 => 0.1284, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.30% (0.2700 => 0.3356, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 24.26% (0.7835 => 0.9736, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.11% (0.0842 => 0.1045, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.10% (0.1029 => 0.1277, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.00% (0.0675 => 0.0837, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 23.87% (1.1840 => 1.4666, std.dev.: 0.0087) MultiSource/Applications/oggenc/oggenc: 23.63% (5.7591 => 7.1201, std.dev.: 0.0119) MultiSource/Applications/d/make_dparser: 23.59% (3.3354 => 4.1223, std.dev.: 0.0092) MultiSource/Benchmarks/Olden/mst/mst: 23.30% (0.1163 => 0.1434, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.29% (0.0953 => 0.1175, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.19% (0.3307 => 0.4074, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.14% (0.5860 => 0.7216, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/messages-2: 23.11% (0.0662 => 0.0815, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.99% (0.1940 => 0.2386, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 22.72% (0.3098 => 0.3802, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 22.64% (0.0614 => 0.0753, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.46% (0.0886 => 0.1085, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.38% (0.8172 => 1.0001, std.dev.: 0.0164) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.27% (4.9449 => 6.0461, std.dev.: 0.0115) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0567 => 0.0693, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.12% (0.1510 => 0.1844, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ReedSolomon: 22.11% (0.2049 => 0.2502, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.04% (0.2758 => 0.3366, std.dev.: 0.0056) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.72% (0.1584 => 0.1928, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/18-imp/imp: 21.68% (0.3423 => 0.4165, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.59% (0.0528 => 0.0642, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 21.59% (0.8921 => 1.0847, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.47% (1.1861 => 1.4408, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.42% (5.0018 => 6.0732, std.dev.: 0.0106) MultiSource/Applications/treecc/treecc: 21.38% (2.0273 => 2.4607, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.03% (0.9765 => 1.1819, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.98% (0.0834 => 0.1009, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.82% (0.6450 => 0.7793, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.74% (0.2107 => 0.2544, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 20.68% (3.8723 => 4.6731, std.dev.: 0.0028) SingleSource/UnitTests/SignlessTypes/rem: 20.63% (0.1144 => 0.1380, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.55% (0.0759 => 0.0915, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.42% (0.5569 => 0.6706, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/health/health: 20.27% (0.1268 => 0.1525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.05% (0.1117 => 0.1341, std.dev.: 0.0028) MultiSource/Applications/lambda-0_1_3/lambda: 19.99% (0.7433 => 0.8919, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.94% (0.0933 => 0.1119, std.dev.: 0.0005) MultiSource/Applications/siod/siod: 19.59% (2.2969 => 2.7469, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.49% (0.4203 => 0.5022, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/perlin: 19.40% (0.0536 => 0.0640, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.22% (0.0770 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.11% (0.5981 => 0.7124, std.dev.: 0.0038) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.03% (0.8101 => 0.9643, std.dev.: 0.0064) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.02% (0.2603 => 0.3098, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 18.96% (0.0633 => 0.0753, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.89% (0.2065 => 0.2455, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.72% (0.3441 => 0.4085, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 18.25% (0.3283 => 0.3882, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.91% (0.1044 => 0.1231, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 17.79% (0.3232 => 0.3807, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/09-vor/vor: 17.58% (0.3180 => 0.3739, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.22% (0.8067 => 0.9456, std.dev.: 0.0074) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.90% (0.0704 => 0.0823, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 16.86% (0.3387 => 0.3958, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 16.42% (0.3379 => 0.3934, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.09% (0.3865 => 0.4487, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.94% (0.4636 => 0.5375, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 15.43% (17.1811 => 19.8330, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.84% (0.4103 => 0.4712, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.81% (0.1114 => 0.1279, std.dev.: 0.0005) MultiSource/Applications/hbd/hbd: 14.71% (1.5603 => 1.7898, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/moments: 14.62% (0.4048 => 0.4640, std.dev.: 0.0016) SingleSource/Regression/C++/ofstream_ctor: 14.25% (0.2905 => 0.3319, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: 14.23% (0.3422 => 0.3909, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bh/bh: 14.10% (0.3092 => 0.3528, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 14.06% (0.3684 => 0.4202, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.93% (0.3603 => 0.4105, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 13.59% (0.3282 => 0.3728, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.31% (0.4064 => 0.4605, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.28% (0.3427 => 0.3882, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.25% (0.3826 => 0.4333, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.21% (0.2430 => 0.2751, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.83% (14.3668 => 16.2105, std.dev.: 0.0067) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1268 => 0.1429, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.53% (0.3927 => 0.4419, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.12% (0.3886 => 0.4357, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.1625 => 0.1818, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/strcat: 11.44% (0.2831 => 0.3155, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 11.18% (0.2871 => 0.3192, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 10.98% (0.3543 => 0.3932, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.97% (0.3473 => 0.3854, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.95% (0.3561 => 0.3951, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.89% (0.3543 => 0.3929, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 10.81% (0.3516 => 0.3896, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/exceptions-2: 10.69% (0.3497 => 0.3871, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.64% (2.0665 => 2.2863, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.55% (0.3935 => 0.4350, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 10.48% (1.2842 => 1.4188, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 10.39% (0.2877 => 0.3176, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.23% (0.2756 => 0.3038, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.18% (0.3162 => 0.3484, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 10.14% (63.2438 => 69.6549, std.dev.: 0.0632) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.11% (0.3650 => 0.4019, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.99% (0.2793 => 0.3072, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2891 => 0.3179, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/fibo: 9.94% (0.2725 => 0.2996, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 9.73% (0.2714 => 0.2978, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.68% (0.2872 => 0.3150, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.49% (0.2802 => 0.3068, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.47% (0.3052 => 0.3341, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.02% (0.1330 => 0.1450, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.96% (0.3136 => 0.3417, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.89% (2.2022 => 2.3980, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7326 => 0.7966, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 8.72% (0.6030 => 0.6556, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.47% (0.2266 => 0.2458, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.18% (0.3177 => 0.3437, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.05% (0.4879 => 0.5272, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (0.3131 => 0.3296, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 5.17% (10.3673 => 10.9029, std.dev.: 0.0066) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.51% (7.9617 => 8.3206, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.46% (0.3817 => 0.3949, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4706, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6958, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 13.02% (0.5413 => 0.6118, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.31% (1.1396 => 1.2457, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.97% (11.6436 => 12.4555, std.dev.: 0.0457) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.61% (4.2280 => 4.4651, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3122, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.82% (0.4162 => 0.4321, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.27% (0.9957 => 1.0283, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.68% (8.6802 => 8.9131, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (3.6395 => 3.7319, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.64% (9.1159 => 9.2651, std.dev.: 0.0450) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2908, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1478, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.79% (5.2763 => 1.1718, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.11% (0.1622 => 0.0939, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.53% (5.3855 => 4.4953, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.64% (5.3526 => 4.5157, std.dev.: 0.0021) MultiSource/Applications/JM/ldecod/ldecod: -11.97% (10.4361 => 9.1867, std.dev.: 0.0299) SingleSource/UnitTests/Vector/constpool: -7.57% (54.1659 => 50.0646, std.dev.: 0.0314) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.09% (1.7609 => 1.6360, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.27% (1.9577 => 0.6799, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3082, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel-2: -33.66% (1.5373 => 1.0198, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4338, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: -24.84% (85.0658 => 63.9334, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0049, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -20.87% (0.0757 => 0.0599, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -19.67% (0.2161 => 0.1736, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/flops-6: -15.93% (1.6925 => 1.4229, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.96% (0.9540 => 0.8399, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4933, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.04% (19.9488 => 18.5448, std.dev.: 0.0436) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.84% (1.2373 => 1.1651, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5860, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7017, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.8614 => 0.8160, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.80% (1.5835 => 1.5075, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -4.71% (10.2830 => 9.7984, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0099) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3291, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -1.44% (3.7221 => 3.6685, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.40% (3.6994 => 3.6476, std.dev.: 0.0182) MultiSource/Applications/sqlite3/sqlite3: -1.32% (4.6441 => 4.5828, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: -1.08% (6.2999 => 6.2321, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0084) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0020) Report Time: 1.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 03:49:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 05:49:18 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129114918.A8E922A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8071?compare_to=8067&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8071, Order: 173781, Start Time: 2013-01-29 09:44:03, End Time: 2013-01-29 11:49:41 To: 8067, Order: 173775, Start Time: 2013-01-29 07:21:24, End Time: 2013-01-29 09:23:44 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 27 (88 on baseline) Performance Improvements: 3 (51 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1034 (924 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/sumcol: 10.55% (0.2133 => 0.2358, std.dev.: 0.0050) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.89% (2.6123 => 2.8446, std.dev.: 0.0619) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.59% (1.8983 => 2.0613, std.dev.: 0.0336) SingleSource/Benchmarks/Shootout-C++/sieve: 8.35% (0.2873 => 0.3113, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 6.73% (10.7693 => 11.4937, std.dev.: 0.0624) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.63% (0.7856 => 0.8377, std.dev.: 0.0026) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.57% (45.3900 => 47.9163, std.dev.: 0.6746) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.36% (0.9206 => 0.9699, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.19% (0.6181 => 0.6440, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 4.09% (34.1754 => 35.5744, std.dev.: 0.3566) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.59% (0.3562 => 0.3690, std.dev.: 0.0049) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 38.25% (8.1483 => 11.2651, std.dev.: 1.1128) SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.00% (4.5290 => 5.7970, std.dev.: 0.1016) SingleSource/Benchmarks/Shootout-C++/ary3: 22.08% (1.4351 => 1.7519, std.dev.: 0.1165) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.51% (9.4504 => 10.2543, std.dev.: 0.0716) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 7.21% (1.7452 => 1.8711, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: 6.98% (4.0992 => 4.3853, std.dev.: 0.0502) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.95% (0.4360 => 0.4663, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists1: 6.94% (0.6040 => 0.6459, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/matrix: 5.47% (6.8752 => 7.2516, std.dev.: 0.0179) MultiSource/Applications/SIBsim4/SIBsim4: 4.89% (3.2627 => 3.4221, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.74% (40.9599 => 42.9026, std.dev.: 0.3915) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.34% (3.5916 => 3.7115, std.dev.: 0.0213) MultiSource/Applications/viterbi/viterbi: 2.57% (3.6396 => 3.7331, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/whetstone: 1.14% (1.5910 => 1.6091, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.01% (1.5866 => 1.6027, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.01% (2.7225 => 2.7500, std.dev.: 0.0069) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.60% (1.1645 => 1.1226, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/matrix: -5.54% (5.0567 => 4.7768, std.dev.: 0.0240) SingleSource/Regression/C/uint64_to_float: -1.61% (1.9376 => 1.9065, std.dev.: 0.0035) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.15% (1.2222 => 1.2081, std.dev.: 0.0785) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.16% (0.0213 => 0.0224, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0433 => 0.0435, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.49% (0.0336 => 0.0341, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 17.58% (0.0273 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.70% (0.0431 => 0.0434, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/casts: 1.46% (0.0205 => 0.0208, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: 2.79% (0.0215 => 0.0221, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0251 => 0.0251, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1490 => 0.1460, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: 1.06% (1.1372 => 1.1492, std.dev.: 0.2095) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.96% (0.3928 => 0.4005, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.06% (0.1477 => 0.1537, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.43% (0.0659 => 0.0675, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.93% (0.0535 => 0.0530, std.dev.: 0.0198) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.97% (1.3103 => 1.2845, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.59% (0.0017 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.78% (0.0617 => 0.0606, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.87% (0.0346 => 0.0349, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.42% (1.7417 => 1.7491, std.dev.: 0.0472) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -61.79% (0.0123 => 0.0047, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.41% (34.1360 => 33.6539, std.dev.: 0.4188) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 397.92% (0.0336 => 0.1673, std.dev.: 0.0418) SingleSource/Regression/C/sumarray2d: 91.61% (0.0274 => 0.0525, std.dev.: 0.0021) SingleSource/Regression/C/sumarray: 59.62% (0.0265 => 0.0423, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 58.12% (0.1638 => 0.2590, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 43.08% (0.9120 => 1.3049, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.52% (0.8893 => 1.2585, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 41.49% (0.9564 => 1.3532, std.dev.: 0.0843) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.72% (0.9061 => 1.2751, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.42% (0.9588 => 1.3463, std.dev.: 0.0781) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.24% (0.9612 => 1.3480, std.dev.: 0.1134) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.94% (0.9381 => 1.3128, std.dev.: 0.1005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.91% (0.9855 => 1.3788, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.70% (0.8990 => 1.2469, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.57% (0.9091 => 1.2597, std.dev.: 0.1028) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.44% (0.9010 => 1.2473, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.60% (0.8912 => 1.2263, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.44% (0.9998 => 1.3741, std.dev.: 0.0805) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.17% (0.9422 => 1.2924, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.01% (0.9403 => 1.2883, std.dev.: 0.0904) SingleSource/Benchmarks/Stanford/IntMM: 36.43% (0.0431 => 0.0588, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.38% (0.9512 => 1.2972, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.91% (1.0119 => 1.3753, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.67% (0.8736 => 1.1852, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.52% (1.0052 => 1.3522, std.dev.: 0.0603) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.28% (0.8732 => 1.1725, std.dev.: 0.0225) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.86% (0.8846 => 1.1841, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.83% (1.0017 => 1.3406, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.05% (0.9507 => 1.2649, std.dev.: 0.0877) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.01% (1.0088 => 1.3418, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.95% (0.9867 => 1.3118, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.60% (0.9788 => 1.2881, std.dev.: 0.0635) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.37% (0.9488 => 1.2464, std.dev.: 0.1109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.14% (0.9685 => 1.2604, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.10% (0.9127 => 1.1874, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.34% (0.9405 => 1.2164, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.27% (0.9993 => 1.2918, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.35% (0.9550 => 1.2257, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.68% (1.0860 => 1.3757, std.dev.: 0.0535) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.58% (0.0738 => 0.0912, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 20.73% (9.5202 => 11.4937, std.dev.: 0.0624) MultiSource/Applications/sgefa/sgefa: 20.26% (0.3598 => 0.4327, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 18.62% (0.2385 => 0.2829, std.dev.: 0.0102) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.50% (3.6295 => 4.2648, std.dev.: 0.1655) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.02% (2.4519 => 2.8446, std.dev.: 0.0619) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.58% (0.0963 => 0.1113, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.53% (0.0805 => 0.0930, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 14.20% (0.0845 => 0.0965, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.17% (1.0986 => 1.2543, std.dev.: 0.0405) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.71% (1.8127 => 2.0613, std.dev.: 0.0336) SingleSource/Benchmarks/Misc/ReedSolomon: 12.29% (0.2050 => 0.2302, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/sumcol: 11.59% (0.2113 => 0.2358, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.46% (0.1955 => 0.2179, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/chomp: 11.27% (0.1793 => 0.1995, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.89% (0.7693 => 0.8377, std.dev.: 0.0026) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.52% (44.1538 => 47.9163, std.dev.: 0.6746) SingleSource/Benchmarks/Linpack/linpack-pc: 7.95% (0.2566 => 0.2770, std.dev.: 0.0050) MultiSource/Benchmarks/Bullet/bullet: 7.01% (33.2440 => 35.5744, std.dev.: 0.3566) SingleSource/Benchmarks/Shootout-C++/sieve: 6.87% (0.2913 => 0.3113, std.dev.: 0.0059) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.77% (23.5861 => 25.1835, std.dev.: 0.4958) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.26% (0.9214 => 0.9699, std.dev.: 0.0170) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.97% (0.6135 => 0.6440, std.dev.: 0.0072) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107050.00% (0.0008 => 0.8572, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout/ary3: 405.07% (2.2304 => 11.2651, std.dev.: 1.1128) SingleSource/Benchmarks/Shootout/matrix: 358.24% (1.5825 => 7.2516, std.dev.: 0.0179) MultiSource/Applications/sgefa/sgefa: 258.83% (0.3515 => 1.2613, std.dev.: 0.0190) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.21% (1.1825 => 4.0585, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.52% (4.8185 => 15.9744, std.dev.: 0.0656) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 213.16% (0.0228 => 0.0714, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary2: 182.17% (0.0129 => 0.0364, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 144.40% (0.0232 => 0.0567, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 64.25% (2.9083 => 4.7768, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.81% (3.1254 => 4.1197, std.dev.: 0.0266) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.51% (1.4588 => 1.8456, std.dev.: 0.0355) SingleSource/Regression/C/uint64_to_float: 23.82% (1.5397 => 1.9065, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: 21.94% (7.4497 => 9.0841, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.51% (4.8112 => 5.7980, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.14% (5.6033 => 6.5639, std.dev.: 0.3705) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.97% (5.0421 => 5.7970, std.dev.: 0.1016) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.83% (9.0082 => 10.2543, std.dev.: 0.0716) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8556, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6497, std.dev.: 0.0057) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.94% (3.6477 => 3.9737, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (4.7473 => 5.0806, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 6.20% (1.0425 => 1.1071, std.dev.: 0.0223) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.50% (4.1836 => 4.4138, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.52% (5.0310 => 5.2585, std.dev.: 0.0733) SingleSource/Benchmarks/Linpack/linpack-pc: 3.14% (50.8945 => 52.4935, std.dev.: 0.5284) MultiSource/Applications/viterbi/viterbi: 2.57% (3.6397 => 3.7331, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -27.92% (0.0727 => 0.0524, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -26.43% (0.1888 => 0.1389, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.40% (0.1684 => 0.1391, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.81% (0.7686 => 0.6471, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -12.14% (0.1079 => 0.0948, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.40% (0.7693 => 0.6893, std.dev.: 0.0251) MultiSource/Applications/hexxagon/hexxagon: -10.27% (1.1433 => 1.0259, std.dev.: 0.0400) MultiSource/Applications/spiff/spiff: -10.05% (1.0220 => 0.9193, std.dev.: 0.0145) MultiSource/Applications/treecc/treecc: -9.78% (2.4719 => 2.2301, std.dev.: 0.0446) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.60% (0.4074 => 0.3683, std.dev.: 0.0116) MultiSource/Applications/lua/lua: -8.88% (4.6406 => 4.2287, std.dev.: 0.0478) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.14% (10.2703 => 9.5365, std.dev.: 0.1522) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.89% (1.2154 => 1.1316, std.dev.: 0.0062) MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.30% (1.1731 => 1.1226, std.dev.: 0.0101) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.74% (11.5523 => 3.9583, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/fp-convert: -61.98% (15.6525 => 5.9504, std.dev.: 0.0911) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.58% (0.4146 => 0.1800, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.67% (0.4578 => 0.2350, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.69% (11.3868 => 6.4115, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.82% (5.4023 => 3.6294, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.42% (0.4452 => 0.3053, std.dev.: 0.0266) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.11% (5.2605 => 3.8869, std.dev.: 0.0877) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.04% (0.5495 => 0.4064, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3289, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.49% (0.5897 => 0.4453, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.32% (4.9921 => 3.8281, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -19.96% (0.5826 => 0.4663, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.54% (5.8755 => 4.7864, std.dev.: 0.0164) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.48% (16.6791 => 13.7640, std.dev.: 0.2890) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.19% (3.1921 => 2.7711, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.65% (5.3626 => 4.6843, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.40% (9.7992 => 8.5842, std.dev.: 0.0157) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.78% (0.4081 => 0.3641, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.55% (5.7056 => 5.1038, std.dev.: 0.2109) SingleSource/Benchmarks/Shootout/nestedloop: -7.32% (0.2200 => 0.2039, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.93% (4.2843 => 3.9875, std.dev.: 0.0809) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2280, std.dev.: 0.0803) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.44% (4.5424 => 4.2498, std.dev.: 0.0405) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (63.1520 => 59.6674, std.dev.: 0.0313) SingleSource/Benchmarks/McGill/queens: -5.27% (1.7443 => 1.6523, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.77% (4.9799 => 4.7426, std.dev.: 0.0105) SingleSource/Benchmarks/Shootout-C++/hash2: -4.66% (3.6768 => 3.5054, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3593, std.dev.: 0.0050) MultiSource/Applications/SIBsim4/SIBsim4: -3.45% (3.5443 => 3.4221, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/hash: -3.11% (4.5259 => 4.3853, std.dev.: 0.0502) SingleSource/Benchmarks/Shootout-C++/lists1: -2.55% (0.6628 => 0.6459, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.73% (8.7327 => 8.5819, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.68% (85.3042 => 83.8735, std.dev.: 0.1074) SingleSource/Benchmarks/Misc/mandel-2: -1.35% (0.8521 => 0.8406, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3156, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.11% (6.8262 => 6.7503, std.dev.: 0.0199) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.28% (1.2047 => 1.2081, std.dev.: 0.0785) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0103) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.47% (0.0445 => 0.0434, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -4.58% (0.1530 => 0.1460, std.dev.: 0.0065) MultiSource/Applications/lemon/lemon: -40.43% (1.9293 => 1.1492, std.dev.: 0.2095) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.09% (0.4049 => 0.4005, std.dev.: 0.0300) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.79% (0.1510 => 0.1537, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.98% (0.0978 => 0.0675, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.17% (0.0590 => 0.0530, std.dev.: 0.0198) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.57% (1.1617 => 1.2845, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.22% (0.0268 => 0.0349, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.19% (0.7437 => 1.7491, std.dev.: 0.0472) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.91% (0.0092 => 0.0047, std.dev.: 0.0068) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 163.37% (12.7781 => 33.6539, std.dev.: 0.4188) Report Time: 0.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 04:07:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 06:07:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129120711.11FE82A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8072?compare_to=8068&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8072, Order: 173788, Start Time: 2013-01-29 10:32:53, End Time: 2013-01-29 12:07:32 To: 8068, Order: 173777, Start Time: 2013-01-29 08:34:07, End Time: 2013-01-29 10:09:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (125 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 13.28% (0.3893 => 0.4410, std.dev.: 0.0189) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.05% (2.1254 => 2.1478, std.dev.: 0.0024) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.89% (0.0974 => 0.1645, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 50.19% (0.0267 => 0.0401, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.14% (0.1132 => 0.1609, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.33% (0.6395 => 0.8846, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.48% (0.6395 => 0.8728, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.84% (0.5456 => 0.7248, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.73% (0.5805 => 0.7705, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.72% (0.6260 => 0.8308, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.48% (0.5849 => 0.7749, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.15% (0.5567 => 0.7357, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.02% (0.5581 => 0.7368, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.86% (0.6230 => 0.8215, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.82% (0.5575 => 0.7349, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.11% (0.5802 => 0.7607, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.09% (0.5941 => 0.7788, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.78% (0.5705 => 0.7461, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.62% (0.0699 => 0.0913, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.49% (0.5478 => 0.7148, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.38% (0.5859 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.36% (0.5569 => 0.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.27% (0.5857 => 0.7630, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.07% (1.6474 => 2.1427, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.00% (0.5570 => 0.7241, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.64% (0.5591 => 0.7248, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.06% (0.5925 => 0.7647, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.97% (0.6189 => 0.7982, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.73% (0.6676 => 0.8594, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.53% (0.5863 => 0.7536, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.19% (0.6052 => 0.7758, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.16% (0.6446 => 0.8261, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.16% (0.6304 => 0.8079, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.30% (0.6681 => 0.8505, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.07% (0.6660 => 0.8463, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.98% (0.6194 => 0.7865, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.84% (0.6297 => 0.7987, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 26.07% (0.0445 => 0.0561, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.27% (0.6667 => 0.8352, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 24.92% (0.0622 => 0.0777, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.30% (0.7524 => 0.9352, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.31% (0.7339 => 0.9050, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.93% (2.2587 => 2.7767, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.74% (0.0621 => 0.0756, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 21.38% (0.0566 => 0.0687, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.09% (0.0634 => 0.0755, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 16.20% (0.3357 => 0.3901, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.44% (1.1450 => 1.3218, std.dev.: 0.0065) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.37% (0.1230 => 0.1419, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/BoolLiteralTest: 15.02% (0.3834 => 0.4410, std.dev.: 0.0189) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/exptree: 14.70% (0.0864 => 0.0991, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.09% (0.0731 => 0.0834, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.17% (0.1982 => 0.2243, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.61% (4.5069 => 5.0752, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4916 => 0.5520, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.18% (1.6364 => 1.8357, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.05% (3.5339 => 3.9597, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/05-eks/eks: 11.98% (0.4515 => 0.5056, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.86% (0.1731 => 0.1919, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 10.41% (0.4524 => 0.4995, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.01% (9.2283 => 10.1525, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.40% (0.5329 => 0.5830, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 9.24% (0.4861 => 0.5310, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.00% (1.2515 => 1.3641, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.96% (0.7021 => 0.7650, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.80% (1.2784 => 1.3781, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/bigfib: 7.73% (0.6750 => 0.7272, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.60% (1.4642 => 1.5755, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/matrix: 7.40% (0.3255 => 0.3496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 6.87% (0.1879 => 0.2008, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.63% (5.4682 => 5.8306, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/chomp: 6.36% (0.1761 => 0.1873, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.54% (0.3319 => 0.3503, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary3: 4.90% (0.3446 => 0.3615, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.90% (22.4056 => 23.5026, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/ary: 4.54% (0.3394 => 0.3548, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.31% (0.4427 => 0.4618, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.28% (0.9557 => 0.9966, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 4.21% (0.3491 => 0.3638, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.81% (5.0226 => 5.2141, std.dev.: 0.0051) MultiSource/Applications/minisat/minisat: 3.65% (0.7447 => 0.7719, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.43% (15.5079 => 16.0400, std.dev.: 0.0161) MultiSource/Applications/spiff/spiff: 3.36% (0.8418 => 0.8701, std.dev.: 0.0011) MultiSource/Applications/SIBsim4/SIBsim4: 3.18% (1.3864 => 1.4305, std.dev.: 0.0121) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.17% (0.5168 => 0.5332, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.42% (18.2933 => 18.7354, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.07% (1.3722 => 1.4006, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.37% (1.2300 => 1.2468, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.25% (3.5154 => 3.5593, std.dev.: 0.0102) MultiSource/Applications/treecc/treecc: 1.17% (2.1401 => 2.1651, std.dev.: 0.0095) MultiSource/Benchmarks/Bullet/bullet: 1.14% (34.0927 => 34.4823, std.dev.: 0.0113) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7980, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0026) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.5751 => 56.5735, std.dev.: 0.0793) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1014, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.5320 => 4.6064, std.dev.: 0.0038) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2486, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2231 => 18.4984, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2691, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.22% (79.7170 => 80.6876, std.dev.: 0.1507) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.07% (0.7198 => 0.6833, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: -4.56% (0.3812 => 0.3638, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.54% (0.3880 => 0.3704, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.52% (0.3848 => 0.3674, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.52% (0.3831 => 0.3658, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.47% (0.3896 => 0.3722, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/for-in: -4.44% (0.4033 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.32% (0.3891 => 0.3723, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.17% (0.3884 => 0.3722, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -4.05% (0.4176 => 0.4007, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.82% (2.4924 => 2.3972, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.69% (0.3821 => 0.3680, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -3.57% (0.3194 => 0.3080, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.34% (0.9852 => 0.9523, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0009) SingleSource/UnitTests/Vector/constpool: -3.00% (20.7746 => 20.1523, std.dev.: 0.0379) SingleSource/UnitTests/ObjC/parameter-passing: -2.94% (0.4280 => 0.4154, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.9542 => 0.9286, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.48% (0.6484 => 0.6323, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -2.17% (0.6347 => 0.6209, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.13% (0.7779 => 0.7613, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9078, std.dev.: 0.0088) SingleSource/UnitTests/ObjC++/property-reference-object: -2.02% (0.6441 => 0.6311, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (6.7716 => 6.6741, std.dev.: 0.0144) MultiSource/Applications/hexxagon/hexxagon: -1.41% (1.3148 => 1.2962, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: -1.22% (16.1920 => 15.9948, std.dev.: 0.0238) MultiSource/Applications/sqlite3/sqlite3: -1.12% (17.1032 => 16.9121, std.dev.: 0.0216) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.08% (2.1713 => 2.1478, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.05% (1.0544 => 1.0433, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.74% (1.8100 => 0.6563, std.dev.: 0.0266) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0282, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout-C++/methcall: -23.34% (7.5137 => 5.7597, std.dev.: 0.0064) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0741, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.87% (0.2274 => 0.1754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2046, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.88% (5.3397 => 4.1713, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3552, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.33% (0.5142 => 0.4611, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6342, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.08% (2.2633 => 2.1710, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2764, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.79% (7.9763 => 7.7538, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.25% (3.7241 => 3.6404, std.dev.: 0.0134) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1740, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4729, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.49% (1.3096 => 1.2901, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.45% (1.6307 => 1.6071, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.42% (1.6086 => 1.5857, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 06:05:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 08:05:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129140523.316502A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8073?compare_to=8072&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8073, Order: 173793, Start Time: 2013-01-29 12:31:12, End Time: 2013-01-29 14:05:43 To: 8072, Order: 173788, Start Time: 2013-01-29 10:32:53, End Time: 2013-01-29 12:07:32 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (112 on baseline) Performance Improvements: 7 (100 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1096 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.57% (0.6563 => 0.6863, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/Hello: -1.87% (0.6209 => 0.6093, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.76% (2.1478 => 2.1101, std.dev.: 0.0119) SingleSource/UnitTests/ObjC++/property-reference-object: -1.74% (0.6311 => 0.6201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.62% (0.7613 => 0.7490, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -1.43% (1.2962 => 1.2776, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.32% (0.9966 => 0.9834, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: -1.16% (18.7354 => 18.5187, std.dev.: 0.0191) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.26% (0.0514 => 0.0870, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.18% (0.0717 => 0.1213, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.70% (0.1132 => 0.1604, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.19% (0.6395 => 0.8837, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.22% (0.6395 => 0.8711, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.63% (0.5688 => 0.7544, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.47% (0.5805 => 0.7690, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.46% (0.5456 => 0.7227, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.13% (0.5849 => 0.7728, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.91% (0.5581 => 0.7362, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.67% (0.6230 => 0.8203, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.66% (0.5575 => 0.7340, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.06% (0.5941 => 0.7786, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.99% (0.5802 => 0.7600, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.39% (0.5705 => 0.7439, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.16% (0.5859 => 0.7626, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.12% (0.5478 => 0.7128, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.08% (0.6033 => 0.7848, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.05% (0.5857 => 0.7617, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.04% (0.5569 => 0.7242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.77% (0.5570 => 0.7228, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.62% (0.5591 => 0.7247, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.58% (1.6474 => 2.1347, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.46% (0.6440 => 0.8337, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.89% (0.6189 => 0.7977, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.81% (0.5925 => 0.7632, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.43% (0.5863 => 0.7530, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.39% (0.6676 => 0.8571, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.14% (0.6304 => 0.8078, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.92% (0.6052 => 0.7742, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.80% (0.6446 => 0.8238, std.dev.: 0.0194) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.17% (0.6681 => 0.8496, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.98% (0.6194 => 0.7865, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.74% (0.6660 => 0.8441, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.44% (0.6297 => 0.7962, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.14% (0.6667 => 0.8343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.86% (0.7524 => 0.9319, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.26% (0.7339 => 0.9046, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.42% (2.2587 => 2.7652, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.41% (0.0790 => 0.0967, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.06% (0.0621 => 0.0758, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334) MultiSource/Applications/sgefa/sgefa: 16.15% (0.3357 => 0.3899, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.20% (1.1450 => 1.3190, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.92% (0.1982 => 0.2238, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.35% (4.5069 => 5.0636, std.dev.: 0.0163) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.96% (1.6364 => 1.8321, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.94% (0.4916 => 0.5503, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.82% (3.5339 => 3.9516, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.98% (0.2385 => 0.2623, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.84% (9.2283 => 10.1364, std.dev.: 0.0093) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.67% (0.1731 => 0.1881, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 8.66% (0.4524 => 0.4916, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.63% (0.5329 => 0.5789, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: 8.48% (1.2515 => 1.3576, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.42% (0.7021 => 0.7612, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.70% (1.2784 => 1.3769, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.70% (0.2001 => 0.2155, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.65% (0.4861 => 0.5233, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.23% (1.4642 => 1.5701, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6750 => 0.7180, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 5.71% (0.3255 => 0.3441, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.59% (5.4682 => 5.7737, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.00% (0.3319 => 0.3485, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.25% (22.4056 => 23.3579, std.dev.: 0.0137) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2005, std.dev.: 0.0174) MultiSource/Applications/SIBsim4/SIBsim4: 3.19% (1.3864 => 1.4306, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 3.10% (15.5079 => 15.9894, std.dev.: 0.0060) MultiSource/Applications/minisat/minisat: 3.10% (0.7447 => 0.7678, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.99% (0.3446 => 0.3549, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.90% (0.9557 => 0.9834, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.67% (0.8418 => 0.8643, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.53% (0.4427 => 0.4539, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.23% (0.5168 => 0.5283, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.83% (1.3722 => 1.3973, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.23% (18.2933 => 18.5187, std.dev.: 0.0191) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8161, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0039) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5983, std.dev.: 0.0393) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.66% (2.0478 => 2.1023, std.dev.: 0.0114) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6068, std.dev.: 0.0053) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.54% (18.2231 => 18.5033, std.dev.: 0.0188) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2484, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1431 => 0.1331, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.25% (0.7198 => 0.6820, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.10% (0.3194 => 0.3031, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.72% (0.3831 => 0.3650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.56% (0.4033 => 0.3849, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -4.00% (0.6347 => 0.6093, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0024) SingleSource/UnitTests/ObjC++/property-reference-object: -3.73% (0.6441 => 0.6201, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.72% (0.4199 => 0.4043, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -3.72% (0.7779 => 0.7490, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.53% (0.9852 => 0.9504, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.53% (2.4924 => 2.4044, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.48% (0.4280 => 0.4131, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.3142 => 0.3034, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.18% (0.3205 => 0.3103, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -3.18% (20.7746 => 20.1146, std.dev.: 0.0317) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.16% (0.3323 => 0.3218, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.83% (1.3148 => 1.2776, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.82% (2.1713 => 2.1101, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.59% (0.6484 => 0.6316, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.32% (14.2083 => 13.8786, std.dev.: 0.0058) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.76% (6.7716 => 6.6521, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.38% (1.0544 => 1.0399, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: -1.35% (16.1920 => 15.9731, std.dev.: 0.0109) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.20% (1.2210 => 1.2064, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: -1.18% (17.1032 => 16.9015, std.dev.: 0.0097) MultiSource/Applications/JM/ldecod/ldecod: -1.16% (7.0961 => 7.0137, std.dev.: 0.0185) MultiSource/Benchmarks/MallocBench/gs/gs: -1.10% (4.3330 => 4.2854, std.dev.: 0.0108) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.08% (1.8100 => 0.6863, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3969, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3127, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.70% (1.3643 => 1.0273, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7511, std.dev.: 0.0040) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0865, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2050, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1312, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3572, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6337, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.88% (2.2633 => 2.1755, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.69% (3.7241 => 3.6239, std.dev.: 0.0203) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.46% (7.9763 => 7.7804, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.78% (1.3096 => 1.2863, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1747, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.50% (1.6307 => 1.6063, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.44% (2.1154 => 2.0849, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5879, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7092 => 3.6639, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6219 => 1.6023, std.dev.: 0.0012) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 06:07:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 08:07:33 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129140733.5A1772A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8074?compare_to=8071&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8074, Order: 173793, Start Time: 2013-01-29 12:08:23, End Time: 2013-01-29 14:07:56 To: 8071, Order: 173781, Start Time: 2013-01-29 09:44:03, End Time: 2013-01-29 11:49:41 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (113 on baseline) Performance Improvements: 44 (135 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1006 (815 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.62% (0.8449 => 0.8670, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.93% (0.6841 => 0.6973, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 1.73% (1.6084 => 1.6362, std.dev.: 0.0024) MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.36% (5.4531 => 5.5275, std.dev.: 0.0081) MultiSource/Applications/Burg/burg: 1.36% (1.4227 => 1.4420, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.19% (1.2604 => 1.2754, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.17% (1.3741 => 1.3902, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.14% (1.2464 => 1.2606, std.dev.: 0.0005) MultiSource/Applications/JM/ldecod/ldecod: 1.12% (7.3476 => 7.4296, std.dev.: 0.0134) MultiSource/Applications/oggenc/oggenc: 1.11% (5.5485 => 5.6103, std.dev.: 0.0217) MultiSource/Applications/siod/siod: 1.02% (2.4535 => 2.4785, std.dev.: 0.0081) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 5.51% (0.3414 => 0.3602, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.76% (4.7458 => 4.8767, std.dev.: 0.0074) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.44% (1.8456 => 1.8906, std.dev.: 0.0155) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -13.25% (10.1233 => 8.7819, std.dev.: 0.0859) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -11.49% (0.1018 => 0.0901, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -10.05% (0.2358 => 0.2121, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -7.46% (2.8446 => 2.6323, std.dev.: 0.0152) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.27% (2.0613 => 1.9115, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout-C++/sieve: -6.59% (0.3113 => 0.2908, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -6.08% (0.2829 => 0.2657, std.dev.: 0.0048) MultiSource/Benchmarks/mafft/pairlocalalign: -6.03% (11.4937 => 10.8004, std.dev.: 0.0319) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.91% (0.8377 => 0.7882, std.dev.: 0.0056) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.22% (47.9163 => 45.4140, std.dev.: 0.1830) SingleSource/Benchmarks/Shootout-C++/wc: -5.04% (0.2321 => 0.2204, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -3.72% (35.5744 => 34.2509, std.dev.: 0.0899) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.66% (0.3690 => 0.3555, std.dev.: 0.0012) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.53% (0.5276 => 0.5090, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.45% (0.3420 => 0.3302, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.24% (6.0559 => 5.8595, std.dev.: 0.0373) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.21% (0.6440 => 0.6233, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.20% (0.5276 => 0.5107, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -1.86% (2.6227 => 2.5739, std.dev.: 0.0063) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.85% (25.1835 => 24.7164, std.dev.: 0.0701) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.85% (4.2648 => 4.1858, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.22% (1.3418 => 1.3254, std.dev.: 0.0052) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -24.29% (11.2651 => 8.5291, std.dev.: 1.0396) SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.62% (5.7970 => 4.4856, std.dev.: 0.0756) SingleSource/Benchmarks/Shootout-C++/ary3: -17.88% (1.7519 => 1.4387, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout/heapsort: -13.89% (3.6375 => 3.1324, std.dev.: 0.1540) MultiSource/Benchmarks/7zip/7zip-benchmark: -11.18% (10.2543 => 9.1082, std.dev.: 0.1473) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.62% (0.3640 => 0.3290, std.dev.: 0.0128) SingleSource/Benchmarks/CoyoteBench/fftbench: -9.27% (1.7097 => 1.5512, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -7.79% (4.3853 => 4.0437, std.dev.: 0.0194) SingleSource/Benchmarks/Shootout-C++/lists1: -7.51% (0.6459 => 0.5974, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.52% (0.4663 => 0.4359, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -5.49% (42.9026 => 40.5462, std.dev.: 0.6046) MultiSource/Applications/SIBsim4/SIBsim4: -4.71% (3.4221 => 3.2609, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.82% (3.7115 => 3.5699, std.dev.: 0.0123) SingleSource/Benchmarks/CoyoteBench/lpbench: -3.62% (4.2423 => 4.0886, std.dev.: 0.0435) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.32% (4.0567 => 3.9627, std.dev.: 0.0365) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.31% (61.5164 => 60.0970, std.dev.: 0.4993) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.29% (5.1038 => 4.9867, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.12% (22.7469 => 22.2648, std.dev.: 0.1459) SingleSource/Benchmarks/Shootout-C++/hash: -2.09% (0.6253 => 0.6122, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.48% (16.8665 => 16.6162, std.dev.: 0.0725) MultiSource/Benchmarks/llubenchmark/llu: -1.45% (2.0339 => 2.0044, std.dev.: 0.0085) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.11% (4.7426 => 4.6901, std.dev.: 0.0171) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.17% (1.2081 => 1.2222, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.45% (0.0224 => 0.0223, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0435 => 0.0434, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.17% (0.0341 => 0.0337, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.15% (0.0434 => 0.0429, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0208 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -39.82% (0.0221 => 0.0133, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.20% (0.0251 => 0.0248, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013) MultiSource/Applications/ClamAV/clamscan: 1.51% (0.1460 => 0.1482, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -0.09% (1.1492 => 1.1482, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.22% (0.4005 => 0.3916, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.11% (0.1537 => 0.1520, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.41% (0.0675 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 15.28% (0.0530 => 0.0611, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.2845 => 1.2816, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0606 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 7.16% (0.0349 => 0.0374) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.87% (1.7491 => 1.6989, std.dev.: 0.0331) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 17.02% (0.0047 => 0.0055, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.27% (33.6539 => 33.7463, std.dev.: 0.2119) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 391.67% (0.0336 => 0.1652, std.dev.: 0.0014) SingleSource/Regression/C/sumarraymalloc: 111.95% (0.0293 => 0.0621, std.dev.: 0.0014) SingleSource/Regression/C/sumarray2d: 87.59% (0.0274 => 0.0514, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/neural/neural: 61.48% (0.1638 => 0.2645, std.dev.: 0.0006) SingleSource/Regression/C/sumarray: 52.08% (0.0265 => 0.0403, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.62% (0.9120 => 1.3007, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.47% (0.8926 => 1.2717, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.37% (0.8893 => 1.2661, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.06% (0.9612 => 1.3655, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.42% (0.9061 => 1.2814, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 41.33% (0.9564 => 1.3517, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.01% (0.9381 => 1.3228, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.35% (0.9588 => 1.3457, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.69% (0.9091 => 1.2699, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.29% (0.8990 => 1.2522, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.21% (0.9855 => 1.3719, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.05% (0.9998 => 1.3902, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.57% (0.9010 => 1.2485, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.54% (0.9403 => 1.3027, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.45% (0.9422 => 1.3045, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 37.34% (1.0867 => 1.4925, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.32% (0.9512 => 1.3062, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.98% (1.0119 => 1.3861, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.61% (0.8912 => 1.2175, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.50% (0.8736 => 1.1925, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.65% (1.0052 => 1.3636, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.52% (0.8732 => 1.1834, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.38% (0.8846 => 1.1976, std.dev.: 0.0098) SingleSource/Benchmarks/Stanford/IntMM: 34.80% (0.0431 => 0.0581, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.10% (0.9867 => 1.3232, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 34.07% (0.9507 => 1.2746, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.44% (1.0017 => 1.3367, std.dev.: 0.0078) SingleSource/Benchmarks/McGill/exptree: 33.18% (0.0859 => 0.1144, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.86% (0.9488 => 1.2606, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.44% (0.9788 => 1.2963, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.69% (0.9685 => 1.2754, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 31.51% (0.9127 => 1.2003, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.38% (1.0088 => 1.3254, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.31% (0.9993 => 1.3122, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.14% (0.9405 => 1.2240, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.35% (0.9550 => 1.2353, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.31% (1.0860 => 1.3826, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.17% (0.0738 => 0.0909, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.92% (0.0738 => 0.0885, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.43% (0.0669 => 0.0799, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 19.32% (0.3598 => 0.4293, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 17.45% (0.0642 => 0.0754, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.34% (0.0963 => 0.1130, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.33% (3.6295 => 4.1858, std.dev.: 0.0238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.07% (0.0783 => 0.0901, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.75% (1.0986 => 1.2606, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.41% (0.0805 => 0.0921, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 14.04% (0.0762 => 0.0869, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.63% (0.1240 => 0.1409, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 13.45% (9.5202 => 10.8004, std.dev.: 0.0319) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.06% (0.1332 => 0.1506, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 11.40% (0.2385 => 0.2657, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 11.22% (0.2050 => 0.2280, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 10.99% (0.1793 => 0.1990, std.dev.: 0.0008) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.75% (0.4596 => 0.5090, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.38% (0.1955 => 0.2158, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.19% (0.5369 => 0.5916, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 10.11% (1.4110 => 1.5536, std.dev.: 0.0130) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.71% (5.0381 => 5.5275, std.dev.: 0.0081) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.96% (0.2577 => 0.2808, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.81% (1.8651 => 2.0295, std.dev.: 0.0138) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.82% (0.2879 => 0.3104, std.dev.: 0.0013) SingleSource/Benchmarks/Linpack/linpack-pc: 7.56% (0.2566 => 0.2760, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.36% (2.4519 => 2.6323, std.dev.: 0.0152) SingleSource/Regression/C++/ofstream_ctor: 5.48% (0.2042 => 0.2154, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.45% (1.8127 => 1.9115, std.dev.: 0.0254) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.31% (0.2372 => 0.2498, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.79% (23.5861 => 24.7164, std.dev.: 0.0701) MultiSource/Applications/oggenc/oggenc: 4.76% (5.3553 => 5.6103, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/bigfib: 4.07% (0.6711 => 0.6984, std.dev.: 0.0072) MultiSource/Benchmarks/Bullet/bullet: 3.03% (33.2440 => 34.2509, std.dev.: 0.0899) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.85% (44.1538 => 45.4140, std.dev.: 0.1830) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.46% (0.7693 => 0.7882, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/football/football: 2.22% (0.9759 => 0.9976, std.dev.: 0.0032) MultiSource/Applications/JM/lencod/lencod: 1.69% (16.7012 => 16.9839, std.dev.: 0.0871) MultiSource/Applications/SIBsim4/SIBsim4: 1.20% (1.4392 => 1.4565, std.dev.: 0.0055) MultiSource/Applications/JM/ldecod/ldecod: 1.04% (7.3529 => 7.4296, std.dev.: 0.0134) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106850.00% (0.0008 => 0.8556, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/matrix: 352.38% (1.5825 => 7.1589, std.dev.: 0.0615) SingleSource/Benchmarks/Shootout/ary3: 282.40% (2.2304 => 8.5291, std.dev.: 1.0396) MultiSource/Applications/sgefa/sgefa: 258.24% (0.3515 => 1.2592, std.dev.: 0.0022) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.35% (1.1825 => 4.0719, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.97% (4.8185 => 15.7552, std.dev.: 0.2220) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 200.88% (0.0228 => 0.0686, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 175.97% (0.0129 => 0.0356, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 142.67% (0.0232 => 0.0563, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 62.52% (2.9083 => 4.7265, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.53% (3.1254 => 4.1107, std.dev.: 0.0305) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.11% (0.2562 => 0.3359, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 29.60% (1.4588 => 1.8906, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.89% (5.6033 => 6.8861, std.dev.: 0.1529) SingleSource/Benchmarks/Misc/salsa20: 21.65% (7.4497 => 9.0622, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.45% (4.8112 => 5.7950, std.dev.: 0.0054) SingleSource/Regression/C/uint64_to_float: 15.22% (1.5397 => 1.7741, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.25% (5.1752 => 5.8607, std.dev.: 0.1049) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.95% (5.0033 => 5.6514, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (3.6477 => 3.9696, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/ReedSolomon: 7.92% (8.6447 => 9.3290, std.dev.: 0.0511) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.07% (4.7473 => 5.0831, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 5.85% (1.0425 => 1.1035, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1836 => 4.4027, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.64% (0.6211 => 0.6499, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.94% (5.0310 => 5.2291, std.dev.: 0.0135) SingleSource/Benchmarks/Linpack/linpack-pc: 3.73% (50.8945 => 52.7923, std.dev.: 0.5234) SingleSource/Benchmarks/Misc/pi: 3.31% (2.1390 => 2.2098, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8767, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.05% (4.8076 => 4.8583, std.dev.: 0.0117) MultiSource/Applications/siod/siod: 1.02% (3.5910 => 3.6275, std.dev.: 0.0030) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.11% (0.0808 => 0.0492, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.09% (0.0727 => 0.0501, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -29.29% (0.1888 => 0.1335, std.dev.: 0.0040) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.60% (0.0692 => 0.0501, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.12% (0.0676 => 0.0540, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -19.38% (1.8964 => 1.5289, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.15% (0.1009 => 0.0836, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.92% (0.1684 => 0.1399, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.61% (1.0960 => 0.9139, std.dev.: 0.0177) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.70% (0.7686 => 0.6556, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.37% (0.1079 => 0.0924, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -11.83% (0.0862 => 0.0760, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: -11.18% (1.0220 => 0.9077, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -11.18% (9.8875 => 8.7819, std.dev.: 0.0859) MultiSource/Applications/hexxagon/hexxagon: -10.68% (1.1433 => 1.0212, std.dev.: 0.0020) MultiSource/Applications/Burg/burg: -9.76% (1.5979 => 1.4420, std.dev.: 0.0063) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.52% (0.4074 => 0.3686, std.dev.: 0.0043) MultiSource/Applications/treecc/treecc: -9.45% (2.4719 => 2.2384, std.dev.: 0.0163) MultiSource/Applications/aha/aha: -9.36% (0.1378 => 0.1249, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.78% (6.4235 => 5.8595, std.dev.: 0.0373) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.50% (0.7693 => 0.7039, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/hash2: -8.24% (0.5134 => 0.4711, std.dev.: 0.0064) MultiSource/Applications/lua/lua: -8.07% (4.6406 => 4.2662, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.78% (0.2481 => 0.2288, std.dev.: 0.0069) MultiSource/Applications/lambda-0_1_3/lambda: -7.44% (0.8653 => 0.8009, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.39% (0.1366 => 0.1265, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.15% (0.9588 => 0.8902, std.dev.: 0.0119) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.04% (10.2703 => 9.5468, std.dev.: 0.0408) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.77% (1.2154 => 1.1331, std.dev.: 0.0101) MultiSource/Benchmarks/Olden/health/health: -6.77% (0.1610 => 0.1501, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -6.55% (0.4689 => 0.4382, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: -6.43% (0.2006 => 0.1877, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.35% (0.3560 => 0.3334, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.27% (1.0234 => 0.9592, std.dev.: 0.0021) MultiSource/Applications/siod/siod: -6.25% (2.6437 => 2.4785, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.14% (1.1498 => 1.0792, std.dev.: 0.0112) MultiSource/Applications/sqlite3/sqlite3: -6.08% (17.5634 => 16.4961, std.dev.: 0.0453) MultiSource/Applications/ClamAV/clamscan: -6.04% (17.4365 => 16.3838, std.dev.: 0.1284) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.95% (0.6885 => 0.6475, std.dev.: 0.0042) MultiSource/Applications/lemon/lemon: -5.72% (1.3979 => 1.3179, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.98% (0.9124 => 0.8670, std.dev.: 0.0046) MultiSource/Applications/d/make_dparser: -4.87% (3.7840 => 3.5996, std.dev.: 0.0112) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.82% (0.2283 => 0.2173, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.62% (0.3462 => 0.3302, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/wc: -4.38% (0.2305 => 0.2204, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/moments: -4.35% (0.4002 => 0.3828, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: -3.85% (0.3715 => 0.3572, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.38% (1.3924 => 1.3454, std.dev.: 0.0170) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.22% (1.1731 => 1.1353, std.dev.: 0.0065) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.14% (1.5131 => 1.4656, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.03% (1.6874 => 1.6362, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.00% (0.3665 => 0.3555, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/gs/gs: -1.49% (4.5936 => 4.5250, std.dev.: 0.0264) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.33% (14.9757 => 14.7768, std.dev.: 0.0655) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.19% (7.2721 => 7.1856, std.dev.: 0.0299) MultiSource/Applications/kimwitu++/kc: -1.15% (18.9377 => 18.7192, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.78% (11.5523 => 3.9535, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/fp-convert: -61.90% (15.6525 => 5.9635, std.dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.22% (0.4146 => 0.1815, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.49% (0.4578 => 0.2358, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3750, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.89% (5.4023 => 3.6253, std.dev.: 0.0510) MultiSource/Benchmarks/Olden/bisort/bisort: -31.10% (0.9372 => 0.6457, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.75% (0.4452 => 0.3083, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/heapsort: -29.99% (4.4739 => 3.1324, std.dev.: 0.1540) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.48% (0.5495 => 0.4040, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.12% (5.2605 => 3.8865, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/heapsort: -25.66% (4.2042 => 3.1253, std.dev.: 0.1169) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.30% (4.4467 => 3.3216, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.18% (0.5826 => 0.4359, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.55% (0.5897 => 0.4449, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.41% (4.9921 => 3.8232, std.dev.: 0.0032) MultiSource/Applications/minisat/minisat: -23.17% (7.9891 => 6.1381, std.dev.: 0.0639) MultiSource/Benchmarks/Ptrdist/ft/ft: -21.30% (1.0816 => 0.8512, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/ary3: -20.61% (1.8123 => 1.4387, std.dev.: 0.0410) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.61% (1.5623 => 1.2560, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.39% (5.8755 => 4.7948, std.dev.: 0.0057) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.21% (16.6791 => 13.6424, std.dev.: 0.6524) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -16.15% (0.1164 => 0.0976, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.93% (7.0016 => 5.8859, std.dev.: 0.2755) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -13.43% (1.4235 => 1.2323, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.23% (3.1921 => 2.7698, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -13.00% (5.3626 => 4.6656, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.71% (9.7992 => 8.5539, std.dev.: 0.0282) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.60% (5.7056 => 4.9867, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.04% (5.0421 => 4.4856, std.dev.: 0.0756) SingleSource/Benchmarks/Shootout/hash: -10.65% (4.5259 => 4.0437, std.dev.: 0.0194) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.57% (2.8778 => 2.5735, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0041) MultiSource/Applications/SPASS/SPASS: -9.94% (9.0650 => 8.1643, std.dev.: 0.2258) SingleSource/Benchmarks/Shootout-C++/lists1: -9.87% (0.6628 => 0.5974, std.dev.: 0.0060) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.20% (4.4540 => 4.0886, std.dev.: 0.0435) MultiSource/Applications/SIBsim4/SIBsim4: -8.00% (3.5443 => 3.2609, std.dev.: 0.0049) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.86% (0.3217 => 0.2964, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.73% (4.2843 => 3.9959, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: -6.70% (0.3654 => 0.3409, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2277, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2491, std.dev.: 0.0156) SingleSource/Benchmarks/CoyoteBench/fftbench: -6.25% (1.6547 => 1.5512, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.82% (4.9799 => 4.6901, std.dev.: 0.0171) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (63.1520 => 59.6304, std.dev.: 0.0529) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.37% (0.3349 => 0.3169, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/queens: -5.37% (1.7443 => 1.6506, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.21% (3.7662 => 3.5699, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/hash2: -4.85% (3.6768 => 3.4985, std.dev.: 0.0173) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.85% (23.3986 => 22.2648, std.dev.: 0.1459) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -4.55% (46.0987 => 44.0019, std.dev.: 0.4964) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.34% (3.5127 => 3.3601, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.19% (42.3194 => 40.5462, std.dev.: 0.6046) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.93% (1.4446 => 1.3878, std.dev.: 0.0112) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.89% (2.5170 => 2.4190, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.74% (5.8973 => 5.6768, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/lists: -3.50% (17.2182 => 16.6162, std.dev.: 0.0725) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.28% (40.4729 => 39.1453, std.dev.: 0.4947) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.19% (3.0082 => 2.9123, std.dev.: 0.0186) SingleSource/Benchmarks/Misc/ffbench: -3.10% (1.4244 => 1.3802, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: -2.69% (4.4730 => 4.3528, std.dev.: 0.0095) MultiSource/Applications/lua/lua: -2.60% (29.0327 => 28.2793, std.dev.: 0.0373) MultiSource/Benchmarks/Bullet/bullet: -2.32% (7.2040 => 7.0368, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.30% (1.0995 => 1.0742, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: -2.11% (0.6254 => 0.6122, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.87% (8.7327 => 8.5693, std.dev.: 0.0047) MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (5.7021 => 5.5956, std.dev.: 0.0187) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.66% (85.3042 => 83.8892, std.dev.: 0.0124) SingleSource/Benchmarks/SmallPT/smallpt: -1.66% (14.9448 => 14.6972, std.dev.: 0.0516) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.59% (8.8249 => 8.6845, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/whetstone: -1.55% (1.6251 => 1.5999, std.dev.: 0.0039) SingleSource/Benchmarks/Stanford/FloatMM: -1.38% (0.8328 => 0.8213, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.35% (3.3596 => 3.3141, std.dev.: 0.0156) MultiSource/Benchmarks/llubenchmark/llu: -1.25% (2.0298 => 2.0044, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.22% (6.8262 => 6.7431, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.18% (5.9063 => 5.8366, std.dev.: 0.0247) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7022, std.dev.: 0.0003) MultiSource/Applications/aha/aha: -1.01% (3.5321 => 3.4965, std.dev.: 0.0098) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.00% (1.9512 => 1.9316, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.45% (1.2047 => 1.2222, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.60% (0.0445 => 0.0429, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/test1: -41.41% (0.0227 => 0.0133, std.dev.: 0.0037) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.75% (0.0255 => 0.0248, std.dev.: 0.0027) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -3.14% (0.1530 => 0.1482, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: -40.49% (1.9293 => 1.1482, std.dev.: 0.0223) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.28% (0.4049 => 0.3916, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.66% (0.1510 => 0.1520, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -25.87% (0.0978 => 0.0725, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.45% (0.0276 => 0.0272, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.56% (0.0590 => 0.0611, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.32% (1.1617 => 1.2816, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374) SingleSource/Benchmarks/BenchmarkGame/puzzle: 128.44% (0.7437 => 1.6989, std.dev.: 0.0331) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -40.22% (0.0092 => 0.0055, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 164.09% (12.7781 => 33.7463, std.dev.: 0.2119) Report Time: 0.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 06:13:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 08:13:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129141343.A78D52A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8075?compare_to=8070&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8075, Order: 173792, Start Time: 2013-01-29 12:01:48, End Time: 2013-01-29 14:14:03 To: 8070, Order: 173777, Start Time: 2013-01-29 09:18:50, End Time: 2013-01-29 11:31:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (230 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (640 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 3.34% (10.9029 => 11.2676, std.dev.: 0.0033) MultiSource/Applications/lambda-0_1_3/lambda: 1.57% (0.8919 => 0.9059, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.02% (80.4561 => 81.2730, std.dev.: 0.2639) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1331 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0679 => 0.0680, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7913 => 499.8554, std.dev.: 0.0088) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.21% (1.1277 => 499.8554, std.dev.: 0.0088) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.23% (0.5229 => 1.7111, std.dev.: 0.0069) MultiSource/Applications/SPASS/SPASS: 26.70% (14.9895 => 18.9915, std.dev.: 0.0073) MultiSource/Applications/kimwitu++/kc: 48.68% (14.1553 => 21.0460, std.dev.: 0.0178) MultiSource/Benchmarks/MallocBench/gs/gs: 21.32% (4.1105 => 4.9869, std.dev.: 0.0136) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.01% (1.1048 => 1.7899, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.50% (7.1582 => 39.4061, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 92.09% (3.4629 => 6.6518, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.49% (0.6222 => 1.1479, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10245.56% (0.0720 => 7.4488, std.dev.: 0.0026) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11079700.00% (0.0001 => 11.0798, std.dev.: 0.0277) MultiSource/Applications/kimwitu++/kc: 51700.00% (0.0001 => 0.0518, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491100.00% (0.0001 => 5.4912, std.dev.: 0.0065) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 811.84% (1.1194 => 10.2071, std.dev.: 0.0066) MultiSource/Applications/ClamAV/clamscan: 149.89% (22.1758 => 55.4145, std.dev.: 0.0093) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.23% (0.0929 => 0.1888, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.45% (0.1463 => 0.2640, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/almabench: 66.85% (0.0730 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 66.75% (0.0394 => 0.0657, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.48% (1.5859 => 2.4974, std.dev.: 0.0024) SingleSource/Regression/C/sumarray: 57.14% (0.0231 => 0.0363, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.11% (2.9384 => 4.6165, std.dev.: 0.0135) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.05% (7.0540 => 10.9369, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/distray/distray: 53.41% (0.1056 => 0.1620, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.74% (8.1363 => 12.1834, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.66% (0.0439 => 0.0657, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.16% (2.2024 => 3.2410, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 45.96% (0.3109 => 0.4538, std.dev.: 0.0011) SingleSource/UnitTests/vla: 45.92% (0.0355 => 0.0518, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.76% (0.1432 => 0.2030, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.15% (0.1062 => 0.1499, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.17% (21.9371 => 30.7484, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.34% (1.5415 => 2.1325, std.dev.: 0.0027) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.02% (4.2646 => 5.8859, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.29% (0.4615 => 0.6336, std.dev.: 0.0014) SingleSource/Benchmarks/McGill/exptree: 37.10% (0.0814 => 0.1116, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.33% (0.2271 => 0.3096, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.26% (0.5105 => 0.6956, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.62% (0.1892 => 0.2566, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 34.65% (0.1143 => 0.1539, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.59% (0.6675 => 0.8984, std.dev.: 0.0060) MultiSource/Applications/Burg/burg: 34.53% (1.1642 => 1.5662, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/05-eks/eks: 33.94% (0.4299 => 0.5758, std.dev.: 0.0011) SingleSource/UnitTests/Vector/build2: 33.90% (0.0295 => 0.0395, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.70% (0.0457 => 0.0611, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 32.63% (0.1655 => 0.2195, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.60% (0.0730 => 0.0968, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.15% (0.0479 => 0.0633, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 32.09% (0.1695 => 0.2239, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.29% (0.1125 => 0.1477, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 30.81% (9.4845 => 12.4063, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.77% (0.0793 => 0.1037, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.51% (3.8922 => 5.0797, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 29.17% (1.0722 => 1.3850, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 29.13% (0.2554 => 0.3298, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash: 28.91% (0.4289 => 0.5529, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.87% (1.4186 => 1.8282, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/hash2: 28.03% (0.4620 => 0.5915, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 27.77% (0.7115 => 0.9091, std.dev.: 0.0007) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.68% (0.3121 => 0.3985, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.68% (0.0672 => 0.0858, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.60% (0.1337 => 0.1706, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 27.23% (0.1175 => 0.1495, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.12% (0.1906 => 0.2423, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.01% (0.1566 => 0.1989, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/bigfib: 26.94% (0.6456 => 0.8195, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.69% (0.5020 => 0.6360, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.37% (0.0842 => 0.1064, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.29% (0.1236 => 0.1561, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 26.19% (0.0527 => 0.0665, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 25.98% (0.0485 => 0.0611, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 25.88% (0.1163 => 0.1464, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.78% (0.2700 => 0.3396, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.23% (1.3050 => 1.6342, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 25.21% (0.1555 => 0.1947, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 25.19% (0.7835 => 0.9809, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.19% (0.0675 => 0.0845, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (0.1032 => 0.1291, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.06% (0.0886 => 0.1108, std.dev.: 0.0004) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 24.85% (0.1151 => 0.1437, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 24.62% (0.0662 => 0.0825, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.39% (0.1029 => 0.1280, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 24.37% (0.1695 => 0.2108, std.dev.: 0.0021) MultiSource/Benchmarks/nbench/nbench: 23.97% (1.1840 => 1.4678, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 23.89% (3.3354 => 4.1323, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.89% (0.3307 => 0.4097, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.76% (0.1940 => 0.2401, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.71% (0.0953 => 0.1179, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.66% (5.7591 => 7.1217, std.dev.: 0.0084) MultiSource/Benchmarks/Olden/bisort/bisort: 23.45% (0.0614 => 0.0758, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.26% (0.5860 => 0.7223, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 22.93% (0.0567 => 0.0697, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 22.89% (0.3098 => 0.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.65% (0.1510 => 0.1852, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.54% (0.0528 => 0.0647, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.52% (4.9449 => 6.0587, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.50% (0.2107 => 0.2581, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.47% (0.1584 => 0.1940, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/football/football: 22.33% (0.8921 => 1.0913, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.22% (0.8172 => 0.9988, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/18-imp/imp: 21.91% (0.3423 => 0.4173, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 21.90% (2.0273 => 2.4712, std.dev.: 0.0022) MultiSource/Applications/lambda-0_1_3/lambda: 21.88% (0.7433 => 0.9059, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.79% (0.2758 => 0.3359, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.75% (0.5569 => 0.6780, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.68% (5.0018 => 6.0860, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/ReedSolomon: 21.52% (0.2049 => 0.2490, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.52% (0.6450 => 0.7838, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.50% (1.1861 => 1.4411, std.dev.: 0.0117) SingleSource/Benchmarks/Stanford/Towers: 21.44% (0.0471 => 0.0572, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.37% (0.9765 => 1.1852, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 21.21% (3.8723 => 4.6936, std.dev.: 0.0027) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.95% (0.0759 => 0.0918, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.77% (0.1117 => 0.1349, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 20.66% (0.1268 => 0.1530) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.58% (0.0933 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.52% (0.0770 => 0.0928, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 20.49% (2.2969 => 2.7676, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.10% (0.2065 => 0.2480, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.99% (0.4203 => 0.5043, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.49% (0.8101 => 0.9680, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.44% (0.1044 => 0.1247, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.44% (0.3441 => 0.4110, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.29% (0.5981 => 0.7135, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.21% (0.2603 => 0.3103, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 18.61% (0.3283 => 0.3894, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 18.25% (0.3232 => 0.3822, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 18.08% (0.3180 => 0.3755, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.73% (0.8067 => 0.9497, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.47% (0.0704 => 0.0827, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 17.05% (0.3379 => 0.3955, std.dev.: 0.0029) MultiSource/Benchmarks/sim/sim: 16.77% (0.3387 => 0.3955, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.59% (0.4636 => 0.5405, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.58% (0.3865 => 0.4506, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.72% (0.4103 => 0.4748, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 15.60% (17.1811 => 19.8607, std.dev.: 0.0127) MultiSource/Applications/hbd/hbd: 15.55% (1.5603 => 1.8029, std.dev.: 0.0049) SingleSource/Regression/C++/ofstream_ctor: 15.28% (0.2905 => 0.3349, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 15.27% (0.4048 => 0.4666, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.72% (0.1114 => 0.1278, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 14.67% (0.3422 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3684 => 0.4219, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 14.49% (0.3603 => 0.4125, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 14.10% (0.3092 => 0.3528, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.69% (0.3427 => 0.3896, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.62% (0.3826 => 0.4347, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.51% (0.4064 => 0.4613, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 13.25% (0.3282 => 0.3717, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 13.17% (0.1268 => 0.1435, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.05% (0.1625 => 0.1837, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.05% (0.2430 => 0.2747, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.94% (14.3668 => 16.2264, std.dev.: 0.0060) SingleSource/UnitTests/ObjC/parameter-passing: 12.58% (0.3927 => 0.4421, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.02% (0.3886 => 0.4353, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 11.73% (0.2831 => 0.3163, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.31% (0.3828 => 0.4261, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.23% (0.3162 => 0.3517, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 11.04% (0.2871 => 0.3188, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.94% (2.0665 => 2.2926, std.dev.: 0.0025) MultiSource/Applications/hexxagon/hexxagon: 10.92% (1.2842 => 1.4244, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/methcall: 10.74% (0.2877 => 0.3186, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3935 => 0.4355, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 10.64% (0.3694 => 0.4087, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 10.62% (0.3473 => 0.3842, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.60% (0.2756 => 0.3048, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.55% (0.3497 => 0.3866, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.49% (0.2793 => 0.3086, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3650 => 0.4029, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.09% (0.2725 => 0.3000, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 9.99% (0.2714 => 0.2985, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2891 => 0.3179, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 9.92% (63.2438 => 69.5161, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.89% (0.2872 => 0.3156, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.86% (0.3052 => 0.3353, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.60% (0.2802 => 0.3071, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.15% (0.3136 => 0.3423, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.10% (0.1330 => 0.1451, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 8.68% (10.3673 => 11.2676, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/property-reference: 8.59% (0.7326 => 0.7955, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.56% (0.2266 => 0.2460, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.39% (2.2022 => 2.3870, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.03% (0.4879 => 0.5271, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.33% (0.3131 => 0.3298, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.48% (7.9617 => 8.3186, std.dev.: 0.0132) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.14% (0.3817 => 0.3937, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4668, std.dev.: 0.0075) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6972, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: 9.22% (1.1396 => 1.2447, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.88% (11.6436 => 12.4445, std.dev.: 0.0503) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (4.2280 => 4.4482, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3129, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.58% (0.4162 => 0.4311, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (2.0360 => 2.1070, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0067) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9222, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.12% (3.6395 => 3.7168, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bisort/bisort: 1.91% (0.8333 => 0.8492, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.79% (9.1159 => 9.2787, std.dev.: 0.0527) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (27.8444 => 28.2914, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4564, std.dev.: 0.0151) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1475, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1772, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -41.68% (0.1622 => 0.0946, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.92% (5.3855 => 4.4743, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.21% (5.3526 => 4.4851, std.dev.: 0.0047) MultiSource/Applications/JM/ldecod/ldecod: -11.80% (10.4361 => 9.2043, std.dev.: 0.0167) SingleSource/UnitTests/Vector/constpool: -7.54% (54.1659 => 50.0836, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.21% (1.7609 => 1.6339, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.83% (1.9577 => 0.6689, std.dev.: 0.0078) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.57% (1.5373 => 1.0213, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4329, std.dev.: 0.0115) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9277, std.dev.: 0.0075) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0065, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.04% (1.6925 => 1.4210, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7328, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.92% (0.9540 => 0.8403, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4929, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.72% (19.9488 => 18.6090, std.dev.: 0.0739) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.04% (0.3463 => 0.3254, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.96% (1.2373 => 1.1636, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.60% (1.6805 => 1.5864, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.51% (8.1563 => 7.7066, std.dev.: 0.0126) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.87% (0.4808 => 0.4574, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -4.66% (10.2830 => 9.8042, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0008) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.81% (3.7221 => 3.6546, std.dev.: 0.0104) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9572, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3305, std.dev.: 0.0028) MultiSource/Applications/sqlite3/sqlite3: -1.36% (4.6441 => 4.5810, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -1.33% (3.6994 => 3.6503, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2307, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8572, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0015) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 07:01:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 09:01:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130129150123.1A9BE2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8076?compare_to=8069&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8076, Order: 173788, Start Time: 2013-01-29 11:21:51, End Time: 2013-01-29 15:01:45 To: 8069, Order: 173774, Start Time: 2013-01-29 06:16:47, End Time: 2013-01-29 10:13:35 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1103 (750 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.17% (124.6690 => 128.6180, std.dev.: 1.3125) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.48% (0.0625 => 0.0903, std.dev.: 0.0044) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.09% (0.1063 => 0.1436, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.70% (0.2969 => 0.3821, std.dev.: 0.0167) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.52% (0.0547 => 0.0703, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.58% (0.1106 => 0.1411, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.40% (0.4139 => 0.5273, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.85% (0.5900 => 0.7484, std.dev.: 0.0296) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.53% (0.0475 => 0.0601, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.51% (0.0415 => 0.0525, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 26.41% (1.5932 => 2.0139, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.33% (0.4253 => 0.5373, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.03% (0.0584 => 0.0736, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.89% (0.4994 => 0.6287, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.48% (0.5000 => 0.6274, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.06% (0.1620 => 0.2026, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.86% (0.0897 => 0.1120, std.dev.: 0.0031) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 23.52% (0.0948 => 0.1171, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.38% (0.1604 => 0.1979, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.36% (0.0642 => 0.0792, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.23% (0.1003 => 0.1236, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 23.22% (0.1107 => 0.1364, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.05% (0.1549 => 0.1906, std.dev.: 0.0057) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.03% (0.1103 => 0.1357, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/05-eks/eks: 22.92% (0.1619 => 0.1990, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.75% (0.0822 => 0.1009, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.57% (0.3903 => 0.4784, std.dev.: 0.0058) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.08% (0.0462 => 0.0564, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.86% (0.0947 => 0.1154, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.69% (0.1088 => 0.1324, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 21.51% (0.1218 => 0.1480, std.dev.: 0.0054) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0040) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.86% (0.1462 => 0.1767, std.dev.: 0.0041) MultiSource/Applications/spiff/spiff: 20.80% (0.4029 => 0.4867, std.dev.: 0.0169) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.66% (0.2014 => 0.2430, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.54% (0.2736 => 0.3298, std.dev.: 0.0099) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 20.13% (0.1505 => 0.1808, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.10% (0.3890 => 0.4672, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.99% (0.2866 => 0.3439, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.49% (1.3152 => 1.5715, std.dev.: 0.0374) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684) MultiSource/Applications/Burg/burg: 19.31% (0.5546 => 0.6617, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 19.31% (1.8794 => 2.2423, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.13% (0.4658 => 0.5549, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.11% (0.3271 => 0.3896, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.90% (0.0582 => 0.0692, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 18.86% (0.5826 => 0.6925, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.81% (3.5627 => 4.2330, std.dev.: 0.0790) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.67% (1.6211 => 1.9238, std.dev.: 0.0201) MultiSource/Benchmarks/McCat/18-imp/imp: 18.65% (0.1421 => 0.1686, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.65% (0.1968 => 0.2335, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: 18.24% (0.5889 => 0.6963, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.14% (0.3930 => 0.4643, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.05% (0.2875 => 0.3394, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 17.89% (0.2811 => 0.3314, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 17.85% (0.2813 => 0.3315, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 17.84% (0.9697 => 1.1427, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.77% (0.4361 => 0.5136, std.dev.: 0.0098) SingleSource/Regression/C++/ofstream_ctor: 17.64% (0.3004 => 0.3534, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 17.63% (0.2780 => 0.3270, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.62% (0.2792 => 0.3284, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.61% (0.5026 => 0.5911, std.dev.: 0.0127) MultiSource/Applications/d/make_dparser: 17.61% (1.0781 => 1.2679, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/strcat: 17.56% (0.2750 => 0.3233, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.53% (0.2738 => 0.3218, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/random: 17.48% (0.2803 => 0.3293, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.47% (0.2725 => 0.3201, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.44% (0.2729 => 0.3205, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 17.39% (0.2714 => 0.3186, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.34% (0.3195 => 0.3749, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.22% (2.0673 => 2.4233, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.21% (0.2911 => 0.3412, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 16.99% (4.2109 => 4.9264, std.dev.: 0.1198) MultiSource/Applications/hexxagon/hexxagon: 16.98% (0.9909 => 1.1592, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/wc: 16.96% (0.3096 => 0.3621, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.94% (0.3258 => 0.3810, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 16.90% (0.3267 => 0.3819, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.86% (1.9694 => 2.3014, std.dev.: 0.0539) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.83% (1.9966 => 2.3327, std.dev.: 0.0515) SingleSource/UnitTests/ObjC++/property-reference: 16.80% (0.7171 => 0.8376, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.73% (0.3060 => 0.3572, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.69% (2.7292 => 3.1848, std.dev.: 0.0355) MultiSource/Benchmarks/Bullet/bullet: 16.67% (23.5202 => 27.4411, std.dev.: 0.1331) SingleSource/Benchmarks/Shootout-C++/ary2: 16.46% (0.3317 => 0.3863, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 16.42% (0.3477 => 0.4048, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.42% (0.1090 => 0.1269, std.dev.: 0.0031) MultiSource/Benchmarks/nbench/nbench: 16.41% (0.2566 => 0.2987, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/sieve: 16.40% (0.3726 => 0.4337, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.39% (0.3124 => 0.3636, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.36% (0.3282 => 0.3819, std.dev.: 0.0057) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.25% (0.3625 => 0.4214, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.24% (0.3362 => 0.3908, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.21% (4.4195 => 5.1360, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/lists: 16.19% (0.3348 => 0.3890, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.10% (1.4269 => 1.6567, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/moments: 16.04% (0.3678 => 0.4268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 15.99% (0.4146 => 0.4809, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.80% (0.3690 => 0.4273, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/hash2: 15.69% (0.4251 => 0.4918, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.60% (0.3981 => 0.4602, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.30% (0.0673 => 0.0776, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.24% (0.3845 => 0.4431, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/synchronized: 15.11% (0.3469 => 0.3993, std.dev.: 0.0002) MultiSource/Applications/treecc/treecc: 15.06% (0.7875 => 0.9061, std.dev.: 0.0191) SingleSource/UnitTests/ObjC/for-in: 15.05% (0.3496 => 0.4022, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 15.00% (0.5012 => 0.5764, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.99% (0.3488 => 0.4011, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 14.98% (0.3465 => 0.3984, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/exceptions-2: 14.97% (0.3446 => 0.3962, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 14.96% (5.5417 => 6.3708, std.dev.: 0.0324) SingleSource/UnitTests/ObjC/exceptions-3: 14.91% (0.3460 => 0.3976, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/trivial-interface: 14.88% (0.3442 => 0.3954, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.68% (0.3650 => 0.4186, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 14.58% (0.3724 => 0.4267, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 14.41% (0.3643 => 0.4168, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.31% (0.6435 => 0.7356, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: 14.16% (0.2691 => 0.3072, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: 14.13% (2.1653 => 2.4712, std.dev.: 0.0449) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.99% (0.5361 => 0.6111, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 13.88% (0.2075 => 0.2363, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.81% (0.2737 => 0.3115, std.dev.: 0.0051) MultiSource/Benchmarks/mafft/pairlocalalign: 13.67% (2.1013 => 2.3886, std.dev.: 0.0033) MultiSource/Applications/JM/lencod/lencod: 13.61% (4.6177 => 5.2462, std.dev.: 0.0751) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.15% (0.2068 => 0.2340, std.dev.: 0.0012) MultiSource/Applications/lambda-0_1_3/lambda: 12.89% (0.3498 => 0.3949, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.89% (0.2040 => 0.2303, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.84% (0.3084 => 0.3480, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.81% (0.0804 => 0.0907, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.53% (11.6398 => 13.0988, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.44% (0.1383 => 0.1555, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.13% (0.2103 => 0.2358, std.dev.: 0.0021) MultiSource/Applications/minisat/minisat: 12.11% (0.3336 => 0.3740, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 12.09% (0.4847 => 0.5433, std.dev.: 0.0055) MultiSource/Applications/siod/siod: 12.00% (0.6634 => 0.7430, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.97% (0.7426 => 0.8315, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.79% (4.6926 => 5.1987, std.dev.: 0.0051) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 10.27% (2.0346 => 2.2436, std.dev.: 0.0045) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.38% (0.5584 => 0.6052, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 8.03% (11.9555 => 12.9157, std.dev.: 0.0299) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.49% (0.3792 => 0.4000, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.59% (29.0505 => 181.4453, std.dev.: 0.0406) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0313) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0101) MultiSource/Applications/ClamAV/clamscan: 9.89% (0.2802 => 0.3079, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.67% (0.3693 => 0.4013, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.53% (3.3903 => 3.6116, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 5.75% (0.2122 => 0.2244, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 5.19% (12.0509 => 12.6764, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2415, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6841, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops-2: 4.59% (1.8057 => 1.8886, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5020, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1950, std.dev.: 0.0034) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3055, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.42% (7.1849 => 7.2866, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5961, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.01% (10.3705 => 10.4756, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.77% (25.4195 => 16.5809, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.38% (17.2379 => 14.2411, std.dev.: 0.1547) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9740, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.8013, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: -7.29% (2.1113 => 1.9574, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -7.24% (0.2402 => 0.2228, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -5.55% (14.0481 => 13.2691, std.dev.: 0.1682) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2148, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.57% (11.2080 => 10.8074, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0061) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1090, std.dev.: 0.0860) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.74% (10.7630 => 10.5759, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4994, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.20% (105.3826 => 104.1209, std.dev.: 0.0852) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.08% (16.2163 => 16.0410, std.dev.: 0.0052) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 08:10:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 10:10:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129161011.E5A682A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8077?compare_to=8073&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8077, Order: 173798, Start Time: 2013-01-29 14:36:21, End Time: 2013-01-29 16:10:33 To: 8073, Order: 173793, Start Time: 2013-01-29 12:31:12, End Time: 2013-01-29 14:05:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (115 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 11.40% (0.4061 => 0.4524, std.dev.: 0.0048) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 124.44% (0.0315 => 0.0707, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.46% (0.0514 => 0.0871) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.32% (0.0267 => 0.0380) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.78% (0.1132 => 0.1605, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.11% (0.6395 => 0.8832, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.40% (0.6395 => 0.8723, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.46% (0.5456 => 0.7227, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.44% (0.5805 => 0.7688, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.44% (0.5688 => 0.7533, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.10% (0.5567 => 0.7354, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.04% (0.5849 => 0.7723, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.73% (0.5581 => 0.7352, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.70% (0.6230 => 0.8205, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.62% (0.5575 => 0.7338, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.06% (0.5941 => 0.7786, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.92% (0.5802 => 0.7596, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.52% (0.5705 => 0.7446, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.12% (0.5478 => 0.7128, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.04% (0.5859 => 0.7619, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.99% (0.6033 => 0.7842, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.95% (0.5569 => 0.7237, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.95% (0.5857 => 0.7611, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.93% (0.5570 => 0.7237, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.58% (0.5591 => 0.7245, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.51% (1.6474 => 2.1336, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.47% (0.6440 => 0.8338, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.95% (0.5925 => 0.7640, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.91% (0.6189 => 0.7978, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.45% (0.6676 => 0.8575, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.35% (0.5863 => 0.7525, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.13% (0.6304 => 0.8077, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.06% (0.6052 => 0.7750, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.80% (0.6446 => 0.8238, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.32% (0.0699 => 0.0890, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.24% (0.6681 => 0.8501, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.96% (0.6194 => 0.7864, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.83% (0.6660 => 0.8447, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.39% (0.6297 => 0.7959, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.23% (0.6667 => 0.8349, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.03% (0.7524 => 0.9332, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.37% (0.0582 => 0.0718, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.00% (0.7339 => 0.9027, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.41% (0.0790 => 0.0967, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.38% (2.2587 => 2.7642, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.10% (0.0621 => 0.0752, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.06% (0.0622 => 0.0753, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/BoolLiteralTest: 18.00% (0.3834 => 0.4524, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.40% (0.1146 => 0.1334, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.18% (0.3357 => 0.3900, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.21% (1.1450 => 1.3192, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.00% (0.0680 => 0.0782, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.12% (0.1982 => 0.2242, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.29% (4.5069 => 5.0606, std.dev.: 0.0110) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.96% (1.6364 => 1.8321, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.84% (0.4916 => 0.5498, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.75% (3.5339 => 3.9490, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.69% (0.4515 => 0.5043, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (9.2283 => 10.1296, std.dev.: 0.0121) MultiSource/Applications/Burg/burg: 8.77% (1.2515 => 1.3613, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.71% (0.5329 => 0.5793, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.64% (0.4524 => 0.4915, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.55% (0.1731 => 0.1879, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.35% (0.7021 => 0.7607, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.78% (0.4861 => 0.5239, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.67% (1.2784 => 1.3764, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.60% (0.2001 => 0.2153, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.25% (1.4642 => 1.5703, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.31% (0.6750 => 0.7176, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.61% (5.4682 => 5.7750, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.94% (0.3319 => 0.3483, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.23% (22.4056 => 23.3524, std.dev.: 0.0139) MultiSource/Applications/oggenc/oggenc: 3.55% (5.0226 => 5.2009, std.dev.: 0.0173) MultiSource/Applications/SIBsim4/SIBsim4: 3.11% (1.3864 => 1.4295, std.dev.: 0.0040) MultiSource/Applications/SPASS/SPASS: 3.06% (15.5079 => 15.9827, std.dev.: 0.0117) MultiSource/Applications/minisat/minisat: 3.02% (0.7447 => 0.7672, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.02% (0.3446 => 0.3550, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.88% (0.9557 => 0.9832, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 2.73% (0.8418 => 0.8648, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4427 => 0.4547, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.26% (0.5168 => 0.5285, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.86% (1.3722 => 1.3977, std.dev.: 0.0001) MultiSource/Applications/kimwitu++/kc: 1.23% (18.2933 => 18.5184, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.02% (1.2300 => 1.2426, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 1.01% (3.5154 => 3.5510, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8046, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.32% (0.9531 => 1.0324, std.dev.: 0.0013) SingleSource/Regression/C/uint64_to_float: 7.26% (0.5692 => 0.6105, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1479, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6125, std.dev.: 0.0248) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1008, std.dev.: 0.0038) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6058, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5121, std.dev.: 0.0040) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2495, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2691, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.20% (0.7198 => 0.6824, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: -4.88% (0.3831 => 0.3644, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.87% (0.3880 => 0.3691, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.74% (0.4033 => 0.3842, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.68% (0.3891 => 0.3709, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.41% (0.4176 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.27% (0.3884 => 0.3718, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.95% (0.3821 => 0.3670, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.92% (0.6347 => 0.6098, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -3.83% (0.7779 => 0.7481, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/property: -3.76% (0.4199 => 0.4041, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.76% (0.6441 => 0.6199, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.70% (0.3837 => 0.3695, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.60% (0.9852 => 0.9497, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.60% (0.3057 => 0.2947, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (2.4924 => 2.4036, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.50% (0.3142 => 0.3032, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.43% (0.4280 => 0.4133, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.40% (0.3323 => 0.3210, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.37% (0.3205 => 0.3097, std.dev.: 0.0008) SingleSource/UnitTests/Vector/constpool: -3.11% (20.7746 => 20.1294, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.89% (2.1713 => 2.1085, std.dev.: 0.0036) MultiSource/Applications/hexxagon/hexxagon: -2.87% (1.3148 => 1.2771, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.67% (0.6484 => 0.6311, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.9542 => 0.9291, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.27% (14.2083 => 13.8856, std.dev.: 0.0137) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.73% (6.7716 => 6.6547, std.dev.: 0.0092) MultiSource/Applications/JM/lencod/lencod: -1.35% (16.1920 => 15.9732, std.dev.: 0.0084) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.35% (0.7919 => 0.7812, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.30% (1.0544 => 1.0407, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: -1.26% (17.1032 => 16.8885, std.dev.: 0.0192) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.18% (1.2210 => 1.2066, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -1.17% (7.0961 => 7.0129, std.dev.: 0.0063) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.17% (1.2221 => 1.2078, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: -1.13% (4.3330 => 4.2840, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.71% (1.8100 => 0.6931, std.dev.: 0.0038) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3103, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel-2: -25.04% (1.3643 => 1.0227, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0755, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2055, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1310, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7254, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0108) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.09% (0.5142 => 0.4623, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2761, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.64% (7.9763 => 7.7655, std.dev.: 0.0231) SingleSource/Benchmarks/Shootout/ary3: -2.33% (3.7241 => 3.6373, std.dev.: 0.0220) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.26% (1.3096 => 1.2800, std.dev.: 0.0097) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3040 => 7.1767, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4704, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -1.46% (3.7092 => 3.6552, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.13% (1.6307 => 1.6123, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.6086 => 1.5918, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 08:38:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 10:38:50 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129163850.7CB162A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8078?compare_to=8074&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8078, Order: 173798, Start Time: 2013-01-29 14:33:47, End Time: 2013-01-29 16:39:13 To: 8074, Order: 173793, Start Time: 2013-01-29 12:08:23, End Time: 2013-01-29 14:07:56 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 15 (94 on baseline) Performance Improvements: 0 (56 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1049 (913 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/sumarraymalloc: 16.43% (0.0621 => 0.0723, std.dev.: 0.0035) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.22% (45.4140 => 49.1478, std.dev.: 0.8970) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.45% (0.2423 => 0.2555, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/moments: 4.18% (0.3828 => 0.3988, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.49% (0.6790 => 0.6891, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/CoyoteBench/fftbench: 33.00% (1.5512 => 2.0631, std.dev.: 0.0301) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.65% (1.4600 => 1.8637, std.dev.: 0.0156) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.22% (0.3290 => 0.3659, std.dev.: 0.0011) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.44% (9.1082 => 9.8773, std.dev.: 0.2068) SingleSource/Regression/C/uint64_to_float: 8.04% (1.7741 => 1.9168, std.dev.: 0.0160) MultiSource/Applications/SIBsim4/SIBsim4: 4.66% (3.2609 => 3.4128, std.dev.: 0.0119) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 3.51% (0.4449 => 0.4605, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.30% (4.1528 => 4.2899, std.dev.: 0.0091) MultiSource/Applications/viterbi/viterbi: 2.40% (3.6426 => 3.7300, std.dev.: 0.0300) MultiSource/Applications/sqlite3/sqlite3: 2.36% (4.3528 => 4.4554, std.dev.: 0.0151) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.01% (1.2222 => 1.2099, std.dev.: 0.1280) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0223 => 0.0223, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.15% (0.0434 => 0.0439, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.59% (0.0337 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0321 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.10% (0.0429 => 0.0438, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: 1.44% (0.0208 => 0.0211, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: 64.66% (0.0133 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0248 => 0.0249, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1482 => 0.1483, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 2.33% (1.1482 => 1.1749, std.dev.: 0.1573) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.99% (0.3916 => 0.3994, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.59% (0.1520 => 0.1529, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.17% (0.0725 => 0.0673, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 1.47% (0.0272 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.27% (0.0611 => 0.0591, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.43% (1.2816 => 1.2871, std.dev.: 0.0521) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -44.83% (0.0029 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.82% (0.0606 => 0.0617, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.53% (0.0374 => 0.0372, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.12% (1.6989 => 1.7349, std.dev.: 0.0180) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 158.18% (0.0055 => 0.0142, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.47% (33.7463 => 34.2414, std.dev.: 0.1530) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 418.45% (0.0336 => 0.1742, std.dev.: 0.0260) SingleSource/Regression/C/sumarraymalloc: 146.76% (0.0293 => 0.0723, std.dev.: 0.0035) SingleSource/Regression/C/sumarray2d: 101.46% (0.0274 => 0.0552, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/neural/neural: 59.58% (0.1638 => 0.2614, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.77% (0.9120 => 1.3021, std.dev.: 0.0179) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.19% (0.8893 => 1.2645, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.11% (0.8926 => 1.2685, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.20% (0.9061 => 1.2794, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.17% (0.9612 => 1.3569, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.62% (0.9381 => 1.3192, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.50% (0.9588 => 1.3471, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.45% (0.9564 => 1.3433, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.73% (0.8990 => 1.2562, std.dev.: 0.0355) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.14% (0.9855 => 1.3712, std.dev.: 0.1105) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.04% (0.9091 => 1.2640, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.77% (0.9998 => 1.3874, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.31% (0.9422 => 1.3032, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.80% (0.9403 => 1.2957, std.dev.: 0.0576) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.51% (0.9512 => 1.3080, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.37% (0.9010 => 1.2377, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.74% (0.8736 => 1.1946, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.51% (1.0119 => 1.3813, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.50% (0.8912 => 1.2165, std.dev.: 0.0462) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.92% (1.0867 => 1.4770, std.dev.: 0.0620) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.47% (1.0052 => 1.3617, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.24% (0.8732 => 1.1809, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.85% (0.8846 => 1.1929, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.69% (0.9867 => 1.3191, std.dev.: 0.0472) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.10% (1.0017 => 1.3333, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.75% (0.9788 => 1.2994, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.64% (1.0088 => 1.3381, std.dev.: 0.0367) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.09% (0.9507 => 1.2558, std.dev.: 0.0795) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.08% (0.9488 => 1.2532, std.dev.: 0.0573) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.25% (0.9685 => 1.2712, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.95% (0.9127 => 1.1952, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.08% (0.9405 => 1.2234, std.dev.: 0.0411) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.05% (0.9993 => 1.2996, std.dev.: 0.0603) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.14% (0.9550 => 1.2333, std.dev.: 0.0782) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.48% (1.0860 => 1.3844, std.dev.: 0.0509) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 20.33% (0.0492 => 0.0592, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.33% (0.0738 => 0.0888, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 20.03% (0.0669 => 0.0803, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.13% (0.0963 => 0.1128, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.98% (0.0642 => 0.0751, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 15.72% (9.5202 => 11.0167, std.dev.: 0.2739) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.20% (3.6295 => 4.1812, std.dev.: 0.1420) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.09% (1.0986 => 1.2644, std.dev.: 0.0464) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.81% (0.0783 => 0.0899, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.64% (0.1332 => 0.1527, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.25% (0.0762 => 0.0863, std.dev.: 0.0010) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.29% (0.4596 => 0.5161, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.86% (0.5369 => 0.6006, std.dev.: 0.0058) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.77% (0.1274 => 0.1424, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 11.57% (0.2385 => 0.2661, std.dev.: 0.0076) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.31% (44.1538 => 49.1478, std.dev.: 0.8970) SingleSource/Benchmarks/Misc/ReedSolomon: 11.02% (0.2050 => 0.2276, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.87% (0.1955 => 0.2148, std.dev.: 0.0014) SingleSource/Benchmarks/Linpack/linpack-pc: 9.20% (0.2566 => 0.2802, std.dev.: 0.0085) SingleSource/Regression/C++/ofstream_ctor: 7.44% (0.2042 => 0.2194, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.60% (0.2879 => 0.3069, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 5.57% (0.6711 => 0.7085, std.dev.: 0.0121) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106012.50% (0.0008 => 0.8489, std.dev.: 0.0220) SingleSource/Benchmarks/Shootout/matrix: 356.38% (1.5825 => 7.2222, std.dev.: 0.0426) MultiSource/Applications/sgefa/sgefa: 258.69% (0.3515 => 1.2608, std.dev.: 0.0373) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.39% (1.1825 => 4.0606, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.53% (4.8185 => 15.9748, std.dev.: 0.1068) SingleSource/Benchmarks/Shootout-C++/ary2: 196.12% (0.0129 => 0.0382, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 187.72% (0.0228 => 0.0656, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/ary: 146.12% (0.0232 => 0.0571, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 63.46% (2.9083 => 4.7540, std.dev.: 0.0123) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.68% (0.2562 => 0.3425, std.dev.: 0.0287) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (5.6033 => 7.4073, std.dev.: 0.2309) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.97% (3.1254 => 4.1246, std.dev.: 0.0128) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 24.99% (1.4588 => 1.8233, std.dev.: 0.0276) SingleSource/Benchmarks/CoyoteBench/fftbench: 24.68% (1.6547 => 2.0631, std.dev.: 0.0301) SingleSource/Regression/C/uint64_to_float: 24.49% (1.5397 => 1.9168, std.dev.: 0.0160) SingleSource/Benchmarks/Misc/salsa20: 21.89% (7.4497 => 9.0804, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.49% (4.8112 => 5.7971, std.dev.: 0.0124) MultiSource/Applications/JM/lencod/lencod: 15.90% (6.8159 => 7.8993, std.dev.: 0.3768) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8559, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6503, std.dev.: 0.0038) MultiSource/Benchmarks/7zip/7zip-benchmark: 9.65% (9.0082 => 9.8773, std.dev.: 0.2068) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (3.6477 => 3.9747, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 8.03% (8.6447 => 9.3386, std.dev.: 0.0251) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (4.7473 => 5.0810, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.42% (4.1836 => 4.4105, std.dev.: 0.0093) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.30% (0.6211 => 0.6540, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2286, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8764, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.95% (4.1668 => 4.2899, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/pi: 2.82% (2.1390 => 2.1994, std.dev.: 0.0104) MultiSource/Applications/viterbi/viterbi: 2.48% (3.6397 => 3.7300, std.dev.: 0.0300) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8624, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.05% (2.8181 => 2.8476, std.dev.: 0.0072) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.11% (0.0808 => 0.0492, std.dev.: 0.0057) MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.66% (0.1009 => 0.0851, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.92% (0.1079 => 0.0918, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.89% (0.7686 => 0.6695, std.dev.: 0.0170) MultiSource/Applications/hexxagon/hexxagon: -10.67% (1.1433 => 1.0213, std.dev.: 0.0384) MultiSource/Benchmarks/SciMark2-C/scimark2: -8.20% (0.4074 => 0.3740, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -7.80% (9.8875 => 9.1158, std.dev.: 0.2206) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.23% (0.7693 => 0.7137, std.dev.: 0.0105) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.01% (10.2703 => 9.6531, std.dev.: 0.0597) MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.94% (0.3560 => 0.3384, std.dev.: 0.0057) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.88% (0.9588 => 0.9120, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.20% (1.5131 => 1.4798, std.dev.: 0.0051) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.90% (11.5523 => 3.9389, std.dev.: 0.0271) SingleSource/Benchmarks/Misc/fp-convert: -61.73% (15.6525 => 5.9903, std.dev.: 0.0196) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -57.09% (0.4146 => 0.1779, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.51% (0.4578 => 0.2357, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.95% (11.3868 => 6.3827, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.83% (5.4023 => 3.6285, std.dev.: 0.0470) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.82% (0.4452 => 0.3080, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/bisort/bisort: -30.14% (0.9372 => 0.6547, std.dev.: 0.0918) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.79% (0.5495 => 0.4023, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.22% (5.2605 => 3.8812, std.dev.: 0.0245) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.16% (4.4467 => 3.3280, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.15% (0.5826 => 0.4361, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.53% (4.9921 => 3.8176, std.dev.: 0.0360) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -21.91% (0.5897 => 0.4605, std.dev.: 0.0049) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.36% (1.5623 => 1.2599, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.42% (5.8755 => 4.7930, std.dev.: 0.0479) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.58% (16.6791 => 13.9132, std.dev.: 0.1326) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.13% (7.0016 => 5.9423, std.dev.: 0.0967) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.27% (3.1921 => 2.7686, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.89% (5.3626 => 4.6716, std.dev.: 0.0202) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.50% (9.7992 => 8.5739, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.46% (5.7056 => 4.9946, std.dev.: 0.0268) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.83% (1.4235 => 1.2551, std.dev.: 0.0200) MultiSource/Benchmarks/Olden/treeadd/treeadd: -11.15% (0.4081 => 0.3626, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/hash: -9.06% (4.5259 => 4.1158, std.dev.: 0.1553) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.96% (0.3217 => 0.2993, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.85% (4.2843 => 3.9907, std.dev.: 0.1095) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2272, std.dev.: 0.0180) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2481, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.19% (4.9799 => 4.6715, std.dev.: 0.1127) MultiSource/Benchmarks/mafft/pairlocalalign: -5.57% (63.1520 => 59.6353, std.dev.: 0.0780) SingleSource/Benchmarks/McGill/queens: -5.21% (1.7443 => 1.6534, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.36% (3.5127 => 3.3594, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/hash2: -4.34% (3.6768 => 3.5171, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: -3.71% (3.5443 => 3.4128, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.65% (5.8973 => 5.6820, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.32% (3.5691 => 3.4506, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/lists: -2.88% (17.2182 => 16.7218, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.71% (8.7327 => 8.5832, std.dev.: 0.0076) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.61% (85.3042 => 83.9266, std.dev.: 0.0453) SingleSource/Benchmarks/Misc/whetstone: -1.46% (1.6251 => 1.6013, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/mandel-2: -1.37% (0.8521 => 0.8404, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.19% (8.8249 => 8.7201, std.dev.: 0.0393) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.15% (6.8262 => 6.7475, std.dev.: 0.0302) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.43% (1.2047 => 1.2099, std.dev.: 0.1280) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.66% (0.0451 => 0.0439, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.57% (0.0445 => 0.0438, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -0.94% (0.0213 => 0.0211, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -3.52% (0.0227 => 0.0219, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.35% (0.0255 => 0.0249, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: -3.07% (0.1530 => 0.1483, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -39.10% (1.9293 => 1.1749, std.dev.: 0.1573) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.36% (0.4049 => 0.3994, std.dev.: 0.0435) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.26% (0.1510 => 0.1529, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.19% (0.0978 => 0.0673, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.17% (0.0590 => 0.0591, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.79% (1.1617 => 1.2871, std.dev.: 0.0521) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -50.00% (0.0032 => 0.0016, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0610 => 0.0617, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.81% (0.0268 => 0.0372, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 133.28% (0.7437 => 1.7349, std.dev.: 0.0180) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 54.35% (0.0092 => 0.0142, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.97% (12.7781 => 34.2414, std.dev.: 0.1530) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 08:56:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 10:56:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129165634.3A3302A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8079?compare_to=8075&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8079, Order: 173798, Start Time: 2013-01-29 14:44:46, End Time: 2013-01-29 16:56:55 To: 8075, Order: 173792, Start Time: 2013-01-29 12:01:48, End Time: 2013-01-29 14:14:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (230 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (641 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.00% (1.2987 => 1.3117, std.dev.: 0.0036) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.15% (0.1333 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: - (0.0680 => 0.0680, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8554 => 499.8534, std.dev.: 0.0082) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/power/power: 44225.03% (1.1277 => 499.8534, std.dev.: 0.0082) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.06% (0.5229 => 1.7102, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 26.64% (14.9895 => 18.9822, std.dev.: 0.0081) MultiSource/Applications/kimwitu++/kc: 48.56% (14.1553 => 21.0294, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/gs/gs: 21.16% (4.1105 => 4.9804, std.dev.: 0.0128) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.99% (1.1048 => 1.7897, std.dev.: 0.0026) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.16% (7.1582 => 39.3819, std.dev.: 0.0086) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.97% (3.4629 => 6.6477, std.dev.: 0.0116) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.43% (0.6222 => 1.1475, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.00% (0.0720 => 7.4448, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3834800.00% (0.0001 => 3.8349, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 11093700.00% (0.0001 => 11.0938, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491600.00% (0.0001 => 5.4917, std.dev.: 0.0127) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.24% (1.1194 => 10.2116, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 149.90% (22.1758 => 55.4181, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.23% (0.0929 => 0.1888, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.45% (0.1463 => 0.2640, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 73.80% (0.0271 => 0.0471, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 67.01% (0.0394 => 0.0658, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 66.85% (0.0730 => 0.1218, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.55% (2.9384 => 4.6295, std.dev.: 0.0119) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.37% (1.5859 => 2.4957, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.08% (7.0540 => 10.9392, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/distray/distray: 53.50% (0.1056 => 0.1621, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.62% (8.1363 => 12.1734, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.43% (0.0439 => 0.0656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.95% (2.2024 => 3.2365, std.dev.: 0.0026) MultiSource/Applications/sgefa/sgefa: 45.77% (0.3109 => 0.4532, std.dev.: 0.0004) SingleSource/UnitTests/vla: 45.63% (0.0355 => 0.0517, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.90% (0.1432 => 0.2032, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.15% (0.1062 => 0.1499, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 40.15% (21.9371 => 30.7456, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.45% (1.5415 => 2.1342, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.87% (4.2646 => 5.8798, std.dev.: 0.0072) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.29% (0.4615 => 0.6336, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.38% (0.5105 => 0.6962, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.70% (0.0479 => 0.0650) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.36% (0.2271 => 0.3074, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 34.56% (0.1143 => 0.1538, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.19% (0.6675 => 0.8957, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.14% (0.1892 => 0.2538, std.dev.: 0.0013) SingleSource/UnitTests/Vector/build2: 33.90% (0.0295 => 0.0395, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 33.89% (0.4299 => 0.5756, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 33.75% (1.1642 => 1.5571, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 33.42% (0.0730 => 0.0974, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.04% (0.0457 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 32.41% (0.0719 => 0.0952, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.98% (0.1695 => 0.2237, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 31.60% (0.1655 => 0.2178, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.20% (0.1125 => 0.1476, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 30.77% (9.4845 => 12.4027, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.52% (0.0793 => 0.1035, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.40% (3.8922 => 5.0755, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 29.06% (1.0722 => 1.3838, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 28.90% (0.2554 => 0.3292, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.58% (1.4186 => 1.8241, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 28.42% (0.4289 => 0.5508, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.83% (0.0672 => 0.0859, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 27.81% (0.4620 => 0.5905, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.72% (0.3121 => 0.3986, std.dev.: 0.0035) MultiSource/Applications/minisat/minisat: 27.67% (0.7115 => 0.9084, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.67% (0.1337 => 0.1707, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.18% (0.1906 => 0.2424, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 27.15% (0.1175 => 0.1494, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.01% (0.1566 => 0.1989, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/bigfib: 26.80% (0.6456 => 0.8186, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.45% (0.5020 => 0.6348, std.dev.: 0.0021) MultiSource/Applications/aha/aha: 26.41% (0.1151 => 0.1455, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.21% (0.1236 => 0.1560, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.01% (0.0842 => 0.1061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/hash: 25.98% (0.0485 => 0.0611, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 25.90% (0.0614 => 0.0773, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 25.81% (0.0527 => 0.0663) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.68% (0.1032 => 0.1297, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 25.45% (0.1163 => 0.1459, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 25.40% (0.0626 => 0.0785) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 25.27% (0.0467 => 0.0585, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.17% (0.0886 => 0.1109, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.11% (1.3050 => 1.6327, std.dev.: 0.0072) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.89% (0.0675 => 0.0843, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 24.89% (0.1555 => 0.1942, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.81% (0.2700 => 0.3370, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 24.74% (0.7835 => 0.9773, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/messages-2: 24.62% (0.0662 => 0.0825, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.45% (0.0871 => 0.1084, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.30% (0.1029 => 0.1279, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.95% (0.3307 => 0.4099, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 23.89% (1.1840 => 1.4669, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: 23.87% (3.3354 => 4.1314, std.dev.: 0.0087) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.71% (0.0953 => 0.1179, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.66% (0.1940 => 0.2399, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 23.54% (0.1695 => 0.2094, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.51% (5.7591 => 7.1129, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.45% (0.5860 => 0.7234, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 22.85% (0.3098 => 0.3806, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 22.75% (0.0567 => 0.0696, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.65% (0.1510 => 0.1852, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.43% (4.9449 => 6.0540, std.dev.: 0.0128) SingleSource/Benchmarks/Misc/ReedSolomon: 22.40% (0.2049 => 0.2508, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.35% (0.0528 => 0.0646, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.30% (0.8172 => 0.9994, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.10% (0.1584 => 0.1934) MultiSource/Benchmarks/Prolangs-C/football/football: 22.06% (0.8921 => 1.0889, std.dev.: 0.0035) MultiSource/Applications/treecc/treecc: 21.97% (2.0273 => 2.4727, std.dev.: 0.0096) MultiSource/Benchmarks/McCat/18-imp/imp: 21.88% (0.3423 => 0.4172, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 21.66% (0.7433 => 0.9043, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.61% (0.2758 => 0.3354, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.59% (5.0018 => 6.0819, std.dev.: 0.0096) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.58% (0.6450 => 0.7842, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.36% (0.2107 => 0.2557, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.31% (0.9765 => 1.1846, std.dev.: 0.0038) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 21.19% (3.8723 => 4.6928, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.05% (0.5569 => 0.6741, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.04% (1.1861 => 1.4357, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.95% (0.0759 => 0.0918, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 20.85% (2.2969 => 2.7759, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.1117 => 0.1348, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.68% (0.0648 => 0.0782, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.52% (0.0770 => 0.0928, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 20.50% (0.1268 => 0.1528, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.36% (0.0933 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.89% (0.4203 => 0.5039, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.76% (0.8101 => 0.9702, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.32% (0.2065 => 0.2464, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.24% (0.5981 => 0.7132, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.17% (0.2603 => 0.3102, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.09% (0.3441 => 0.4098, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.97% (0.1044 => 0.1242, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: 18.64% (0.3283 => 0.3895, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 18.25% (0.3232 => 0.3822, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.08% (0.3180 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.75% (0.8067 => 0.9499, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.47% (0.0704 => 0.0827, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.79% (0.3865 => 0.4514, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 16.72% (0.3379 => 0.3944, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 16.65% (0.3387 => 0.3951, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.29% (0.4636 => 0.5391, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 15.91% (1.5603 => 1.8085, std.dev.: 0.0023) MultiSource/Applications/sqlite3/sqlite3: 15.62% (17.1811 => 19.8641, std.dev.: 0.0174) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.48% (0.4103 => 0.4738, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 15.39% (0.4048 => 0.4671, std.dev.: 0.0045) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 15.04% (0.2905 => 0.3342, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3422 => 0.3921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3684 => 0.4219, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sieve: 14.49% (0.3603 => 0.4125, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.41% (0.0798 => 0.0913, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.36% (0.1114 => 0.1274, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.03% (0.4064 => 0.4634, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bh/bh: 13.97% (0.3092 => 0.3524, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.74% (0.3427 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.62% (0.3826 => 0.4347, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.59% (0.3282 => 0.3728, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.21% (0.2430 => 0.2751, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 13.17% (0.1268 => 0.1435, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.99% (14.3668 => 16.2332, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.45% (0.3927 => 0.4416, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 11.91% (0.3886 => 0.4349, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/strcat: 11.83% (0.2831 => 0.3166, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 11.32% (0.2871 => 0.3196, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.13% (0.3828 => 0.4254, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 10.93% (1.2842 => 1.4245, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.89% (2.0665 => 2.2915, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-4: 10.75% (0.3543 => 0.3924, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.73% (0.3543 => 0.3923, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 10.71% (0.2877 => 0.3185, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3935 => 0.4355, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.65% (0.3473 => 0.3843, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/synchronized: 10.53% (0.3561 => 0.3936, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 10.49% (0.3497 => 0.3864, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.36% (0.3650 => 0.4028, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.31% (0.3162 => 0.3488, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.30% (0.2756 => 0.3040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.24% (0.2793 => 0.3079, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.13% (0.2725 => 0.3001, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.99% (0.2714 => 0.2985, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.96% (0.2891 => 0.3179, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 9.93% (0.3052 => 0.3355, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 9.88% (63.2438 => 69.4927, std.dev.: 0.0291) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.85% (0.2872 => 0.3155, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.60% (0.2802 => 0.3071, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.50% (0.3136 => 0.3434, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 8.84% (0.6030 => 0.6563, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 8.72% (10.3673 => 11.2712, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.61% (0.2266 => 0.2461, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 8.57% (0.7326 => 0.7954, std.dev.: 0.0028) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.43% (2.2022 => 2.3879, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.10% (0.4879 => 0.5274, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.93% (0.3177 => 0.3429, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.40% (7.9617 => 8.3121, std.dev.: 0.0124) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.17% (0.3817 => 0.3938, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4724, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6955, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.20% (1.1396 => 1.2445, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.86% (11.6436 => 12.4420, std.dev.: 0.2089) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.52% (4.2280 => 4.4615, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.3316 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.17% (0.9957 => 1.0273, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8957, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7162, std.dev.: 0.0091) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2205, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 1.85% (9.1159 => 9.2842, std.dev.: 0.0372) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2909, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 1.55% (1.0785 => 1.0952, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3460 => 10.4553, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.72% (5.2763 => 1.1757, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -41.68% (0.1622 => 0.0946, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.90% (5.3855 => 4.4753, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.25% (5.3526 => 4.4827, std.dev.: 0.0036) MultiSource/Applications/JM/ldecod/ldecod: -11.59% (10.4361 => 9.2261, std.dev.: 0.0085) SingleSource/UnitTests/Vector/constpool: -7.47% (54.1659 => 50.1221, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.42% (1.7609 => 1.6302, std.dev.: 0.0009) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.23% (1.9577 => 0.6611, std.dev.: 0.0061) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/lowercase: -34.10% (8.0499 => 5.3049, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0039) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4308, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9293, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.35% (2.6546 => 2.0082, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.87% (2.6778 => 2.0921, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1256, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.82% (0.9540 => 0.8412, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4945, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/matrix: -10.17% (3.0680 => 2.7561, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.96% (1.8329 => 1.7054, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6044, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.81% (1.2373 => 1.1654, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5871, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7031, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8016, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.41% (0.4808 => 0.4596, std.dev.: 0.0002) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.88% (3.6994 => 3.6300, std.dev.: 0.0153) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3297, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7221 => 3.6709, std.dev.: 0.0133) MultiSource/Applications/sqlite3/sqlite3: -1.35% (4.6441 => 4.5816, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8588, std.dev.: 0.0027) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0019) Report Time: 1.69s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 10:07:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 12:07:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129180758.347AF2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8080?compare_to=8077&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8080, Order: 173806, Start Time: 2013-01-29 16:34:06, End Time: 2013-01-29 18:08:16 To: 8077, Order: 173798, Start Time: 2013-01-29 14:36:21, End Time: 2013-01-29 16:10:33 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (111 on baseline) Performance Improvements: 0 (101 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.46% (0.0514 => 0.0871, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.32% (0.0717 => 0.1214, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.45% (0.0974 => 0.1631, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/neural/neural: 45.60% (0.1500 => 0.2184, std.dev.: 0.0036) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.61% (0.1132 => 0.1603, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.69% (0.6395 => 0.8805, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.20% (0.6395 => 0.8710, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.35% (0.5688 => 0.7528, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.27% (0.6260 => 0.8280, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.25% (0.5805 => 0.7677, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.85% (0.5849 => 0.7712, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.68% (0.5581 => 0.7349, std.dev.: 0.0151) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.63% (0.5567 => 0.7328, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.46% (0.6230 => 0.8190, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.43% (0.5575 => 0.7327, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.71% (0.5802 => 0.7584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.65% (0.5941 => 0.7762, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.25% (0.5705 => 0.7431, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.96% (0.5478 => 0.7119, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.90% (0.5857 => 0.7608, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.84% (0.6033 => 0.7833, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.80% (0.5859 => 0.7605, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.75% (0.5569 => 0.7226, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.73% (0.5570 => 0.7226, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.60% (1.6474 => 2.1350, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.21% (0.5591 => 0.7224, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.16% (0.6440 => 0.8318, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.64% (0.5925 => 0.7622, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.60% (0.6189 => 0.7959, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.36% (0.6676 => 0.8569, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.99% (0.5863 => 0.7504, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.96% (0.6052 => 0.7744, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.74% (0.6304 => 0.8053, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.63% (0.6446 => 0.8227, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.18% (0.0699 => 0.0889, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.76% (0.6681 => 0.8469, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.56% (0.6194 => 0.7839, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.52% (0.6660 => 0.8426, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.43% (0.6297 => 0.7961, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.93% (0.6667 => 0.8329, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.83% (0.7524 => 0.9317, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.92% (0.7339 => 0.9021, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.41% (0.0790 => 0.0967, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.40% (2.2587 => 2.7647, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.21% (0.0693 => 0.0840, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.10% (0.0621 => 0.0752, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.14% (0.0634 => 0.0749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.05% (0.0833 => 0.0975, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 15.97% (0.3357 => 0.3893, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 15.18% (1.1450 => 1.3188, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.82% (0.1982 => 0.2236, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.35% (4.5069 => 5.0635, std.dev.: 0.0022) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.20% (0.1230 => 0.1380, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.02% (0.4916 => 0.5507, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.01% (1.6364 => 1.8330, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/05-eks/eks: 11.83% (0.4515 => 0.5049, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.81% (3.5339 => 3.9513, std.dev.: 0.0124) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.10% (0.2385 => 0.2626, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.71% (9.2283 => 10.1241, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.90% (0.1731 => 0.1885, std.dev.: 0.0051) MultiSource/Applications/Burg/burg: 8.53% (1.2515 => 1.3582, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.48% (0.5329 => 0.5781, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 8.42% (0.4524 => 0.4905, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.28% (0.7021 => 0.7602, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.77% (1.2784 => 1.3777, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 7.57% (0.4861 => 0.5229, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.27% (1.4642 => 1.5707, std.dev.: 0.0092) SingleSource/Benchmarks/Misc-C++/bigfib: 6.37% (0.6750 => 0.7180, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 5.59% (0.3255 => 0.3437, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.55% (5.4682 => 5.7717, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.3319 => 0.3490, std.dev.: 0.0034) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.25% (22.4056 => 23.3572, std.dev.: 0.0073) MultiSource/Applications/oggenc/oggenc: 3.51% (5.0226 => 5.1990, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 3.14% (0.7447 => 0.7681, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 3.11% (1.3864 => 1.4295, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 3.05% (0.3446 => 0.3551, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 2.92% (15.5079 => 15.9611, std.dev.: 0.0168) MultiSource/Applications/spiff/spiff: 2.67% (0.8418 => 0.8643, std.dev.: 0.0074) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.42% (0.4427 => 0.4534, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.85% (1.3722 => 1.3976, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.18% (18.2933 => 18.5087, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2300 => 1.2428, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.01% (3.5154 => 3.5508, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8133, std.dev.: 0.0167) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.94% (0.9531 => 1.0288, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 7.57% (0.5692 => 0.6123, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.02% (1.2783 => 1.3681, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1490, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.64% (54.5751 => 56.5591, std.dev.: 0.1072) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.88% (2.0478 => 2.1068, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.61% (4.5320 => 4.6050, std.dev.: 0.0067) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2488, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.53% (18.2231 => 18.5012, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2693, std.dev.: 0.0005) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.15% (0.7198 => 0.6827, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.78% (0.3848 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.64% (0.4033 => 0.3846, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.61% (0.3880 => 0.3701, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.55% (0.3891 => 0.3714, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.19% (0.3821 => 0.3661, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.17% (0.3884 => 0.3722, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -3.95% (0.6347 => 0.6096, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.94% (0.3837 => 0.3686, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.74% (0.4199 => 0.4042, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.73% (0.2871 => 0.2764, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference-object: -3.70% (0.6441 => 0.6203, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.52% (0.3323 => 0.3206, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.47% (2.4924 => 2.4059, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.45% (0.9852 => 0.9512, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.44% (0.3142 => 0.3034, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.39% (0.4280 => 0.4135, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: -3.28% (0.3205 => 0.3100, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -3.06% (0.7779 => 0.7541, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.95% (2.1713 => 2.1072, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.91% (1.3148 => 1.2765, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.9542 => 0.9289, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.60% (20.7746 => 20.2335, std.dev.: 0.0203) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.53% (0.6484 => 0.6320, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.14% (14.2083 => 13.9047, std.dev.: 0.0063) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.65% (6.7716 => 6.6602, std.dev.: 0.0110) MultiSource/Applications/JM/lencod/lencod: -1.31% (16.1920 => 15.9797, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.27% (1.0544 => 1.0410, std.dev.: 0.0037) MultiSource/Applications/sqlite3/sqlite3: -1.19% (17.1032 => 16.8996, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: -1.15% (7.0961 => 7.0142, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.14% (1.2210 => 1.2071, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.14% (1.2221 => 1.2082, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.35% (1.8100 => 0.6815, std.dev.: 0.0344) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3156, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.64% (1.3643 => 1.0281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0051) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0731, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2049, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0157) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -14.96% (2.5106 => 2.1351, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3537, std.dev.: 0.0125) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8197, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -4.00% (2.2633 => 2.1727, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.59% (3.7241 => 3.6278, std.dev.: 0.0155) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7778, std.dev.: 0.0276) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.92% (1.3096 => 1.2844, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1753, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.40% (1.6307 => 1.6079, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.35% (1.6219 => 1.6000, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.30% (1.6086 => 1.5877, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.11% (4.8776 => 4.8237, std.dev.: 0.0110) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 11:05:10 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 13:05:10 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129190510.0C33B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8081?compare_to=8078&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8081, Order: 173807, Start Time: 2013-01-29 16:59:21, End Time: 2013-01-29 19:05:32 To: 8078, Order: 173798, Start Time: 2013-01-29 14:33:47, End Time: 2013-01-29 16:39:13 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (74 on baseline) Performance Improvements: 2 (43 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1058 (946 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: 20.57% (0.1672 => 0.2016, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/except: 2.79% (0.4949 => 0.5087, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.47% (1.9358 => 1.9642, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.35% (1.8637 => 1.8888, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/vla: -20.58% (0.0588 => 0.0467, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.43% (7.4073 => 6.8572, std.dev.: 0.1748) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.11% (1.2099 => 1.2112, std.dev.: 0.1466) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.90% (0.0223 => 0.0225, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0439 => 0.0438, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.29% (0.0339 => 0.0340, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.25% (0.0321 => 0.0325, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.14% (0.0438 => 0.0433, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: -1.42% (0.0211 => 0.0208, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 0.91% (0.0219 => 0.0221, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.63% (0.0249 => 0.0230, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.34% (0.1483 => 0.1488, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: 0.34% (1.1749 => 1.1789, std.dev.: 0.3363) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.45% (0.3994 => 0.3936, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.44% (0.1529 => 0.1507, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.36% (0.0673 => 0.0610, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.26% (0.0591 => 0.0554, std.dev.: 0.0076) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.2871 => 1.2858, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0016 => 0.0020, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.76% (0.0617 => 0.0600, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.54% (0.0372 => 0.0374, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.11% (1.7349 => 1.7368, std.dev.: 0.0123) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -13.38% (0.0142 => 0.0123, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.11% (34.2414 => 33.8615, std.dev.: 0.3186) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 406.55% (0.0336 => 0.1702, std.dev.: 0.0425) MultiSource/Benchmarks/FreeBench/neural/neural: 60.38% (0.1638 => 0.2627, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 45.16% (0.8926 => 1.2957, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.55% (0.8893 => 1.2677, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.26% (0.9120 => 1.2974, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.61% (0.9061 => 1.2831, std.dev.: 0.1300) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.41% (0.9612 => 1.3592, std.dev.: 0.0844) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.96% (0.9564 => 1.3481, std.dev.: 0.0985) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.78% (0.9381 => 1.3207, std.dev.: 0.0817) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.54% (0.9588 => 1.3475, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.46% (0.9091 => 1.2678, std.dev.: 0.0744) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.12% (0.9010 => 1.2535, std.dev.: 0.0704) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.07% (0.9855 => 1.3705, std.dev.: 0.0670) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.51% (0.9998 => 1.3848, std.dev.: 0.0400) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.31% (0.9403 => 1.3005, std.dev.: 0.0277) SingleSource/Benchmarks/McGill/exptree: 37.49% (0.0859 => 0.1181, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.38% (0.9512 => 1.3068, std.dev.: 0.0741) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.04% (1.0119 => 1.3867, std.dev.: 0.0701) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.80% (0.8736 => 1.1951, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.59% (0.8912 => 1.2173, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.16% (1.0867 => 1.4796, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.10% (0.8732 => 1.1884, std.dev.: 0.0984) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.33% (1.0052 => 1.3603, std.dev.: 0.0917) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.12% (0.8846 => 1.1953, std.dev.: 0.0470) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 34.66% (1.0017 => 1.3489, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 34.36% (0.9788 => 1.3151, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.98% (0.9867 => 1.3220, std.dev.: 0.0428) SingleSource/Benchmarks/Stanford/IntMM: 33.41% (0.0431 => 0.0575, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.03% (1.0088 => 1.3420, std.dev.: 0.0874) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.59% (0.9507 => 1.2605, std.dev.: 0.0801) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.40% (0.9550 => 1.2549, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.47% (0.9405 => 1.2271, std.dev.: 0.0802) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.41% (0.9993 => 1.3032, std.dev.: 0.0599) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 22.58% (0.1240 => 0.1520, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 21.60% (0.3598 => 0.4375, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 20.33% (0.0669 => 0.0805, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.0963 => 0.1137, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 17.60% (0.0642 => 0.0755, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.66% (3.6295 => 4.2340, std.dev.: 0.1494) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.30% (1.0986 => 1.2777, std.dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: 16.00% (9.5202 => 11.0438, std.dev.: 0.4134) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 14.85% (0.0707 => 0.0812, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/matrix: 13.25% (0.2385 => 0.2701, std.dev.: 0.0109) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.14% (0.1332 => 0.1507, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.37% (1.4110 => 1.5714, std.dev.: 0.0266) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.84% (0.1955 => 0.2167, std.dev.: 0.0038) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.75% (44.1538 => 48.9023, std.dev.: 1.4898) SingleSource/Benchmarks/Linpack/linpack-pc: 9.04% (0.2566 => 0.2798, std.dev.: 0.0041) MultiSource/Applications/SIBsim4/SIBsim4: 2.87% (1.4392 => 1.4805, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107212.50% (0.0008 => 0.8585, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout/matrix: 356.78% (1.5825 => 7.2286, std.dev.: 0.0319) MultiSource/Applications/sgefa/sgefa: 259.03% (0.3515 => 1.2620, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.36% (1.1825 => 4.0721, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.85% (4.8185 => 15.8936, std.dev.: 0.1326) SingleSource/Benchmarks/Shootout-C++/ary2: 208.53% (0.0129 => 0.0398, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 187.28% (0.0228 => 0.0655, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 131.03% (0.0232 => 0.0536, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 63.21% (2.9083 => 4.7466, std.dev.: 0.1570) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.68% (3.1254 => 4.1156, std.dev.: 0.0485) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.25% (1.4588 => 1.8709, std.dev.: 0.0303) SingleSource/Regression/C/uint64_to_float: 24.63% (1.5397 => 1.9189, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.38% (5.6033 => 6.8572, std.dev.: 0.1748) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.52% (4.8112 => 5.7983, std.dev.: 0.0480) SingleSource/Benchmarks/Stanford/Puzzle: 18.73% (0.1698 => 0.2016, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 15.54% (6.8159 => 7.8749, std.dev.: 0.1797) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.16% (5.1752 => 5.8562, std.dev.: 0.0688) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.76% (5.0033 => 5.6419, std.dev.: 0.0109) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.13% (3.6477 => 3.9807, std.dev.: 0.0853) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.32% (4.1836 => 4.4063, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2286, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.22% (4.7254 => 4.8775, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.33% (1.2298 => 1.2584, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.36% (1.8634 => 1.8888, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8623, std.dev.: 0.0154) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -27.02% (0.0692 => 0.0505, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.34% (0.1009 => 0.0834, std.dev.: 0.0025) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.89% (11.5523 => 3.9408, std.dev.: 0.0390) SingleSource/Benchmarks/Misc/fp-convert: -61.79% (15.6525 => 5.9801, std.dev.: 0.1037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.25% (0.4146 => 0.1814, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.27% (0.4578 => 0.2368, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.21% (11.3868 => 6.3524, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.95% (5.4023 => 3.6220, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.04% (0.4452 => 0.3070, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/bisort/bisort: -28.10% (0.9372 => 0.6738, std.dev.: 0.0946) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.22% (5.2605 => 3.8811, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.40% (0.5495 => 0.4099, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.13% (4.4467 => 3.3292, std.dev.: 0.0230) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.10% (0.5826 => 0.4422, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8225, std.dev.: 0.3565) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -22.47% (0.5897 => 0.4572, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.61% (5.8755 => 4.7822, std.dev.: 0.1366) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.60% (16.6791 => 13.5771, std.dev.: 0.2622) MultiSource/Benchmarks/Fhourstones/fhourstones: -16.79% (1.5623 => 1.3000, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.88% (7.0016 => 5.9598, std.dev.: 0.2209) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.23% (3.1921 => 2.7698, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6748, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.60% (5.7056 => 4.9866, std.dev.: 0.1186) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.57% (9.7992 => 8.5679, std.dev.: 0.0323) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.06% (1.4235 => 1.2518, std.dev.: 0.0269) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.44% (0.4081 => 0.3655, std.dev.: 0.0044) MultiSource/Applications/SPASS/SPASS: -9.78% (9.0650 => 8.1785, std.dev.: 0.2836) MultiSource/Benchmarks/BitBench/drop3/drop3: -8.46% (0.3217 => 0.2945, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.46% (5.5974 => 5.2356, std.dev.: 0.0276) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2489, std.dev.: 0.0130) MultiSource/Applications/SIBsim4/SIBsim4: -6.38% (3.5443 => 3.3183, std.dev.: 0.0482) MultiSource/Benchmarks/Olden/health/health: -6.05% (0.3654 => 0.3433, std.dev.: 0.0053) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.85% (0.3349 => 0.3153, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.76% (4.9799 => 4.6930, std.dev.: 0.0632) SingleSource/Benchmarks/McGill/queens: -5.44% (1.7443 => 1.6494, std.dev.: 0.0148) MultiSource/Benchmarks/mafft/pairlocalalign: -5.31% (63.1520 => 59.7968, std.dev.: 0.0954) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.96% (1.4446 => 1.3729, std.dev.: 0.0250) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4362, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (5.8973 => 5.6832, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.80% (8.7327 => 8.5755, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: -1.41% (0.8521 => 0.8401, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.33% (3.3596 => 3.3149, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.15% (6.8262 => 6.7475, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.54% (1.2047 => 1.2112, std.dev.: 0.1466) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.71% (0.0394 => 0.0340, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0101) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0088) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0005) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -2.75% (0.1530 => 0.1488, std.dev.: 0.0015) MultiSource/Applications/lemon/lemon: -38.89% (1.9293 => 1.1789, std.dev.: 0.3363) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.79% (0.4049 => 0.3936, std.dev.: 0.0176) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1510 => 0.1507, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.63% (0.0978 => 0.0610, std.dev.: 0.0194) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0590 => 0.0554, std.dev.: 0.0076) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (1.1617 => 1.2858, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.50% (0.0032 => 0.0020, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.64% (0.0610 => 0.0600, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/puzzle: 133.54% (0.7437 => 1.7368, std.dev.: 0.0123) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 33.70% (0.0092 => 0.0123, std.dev.: 0.0026) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 165.00% (12.7781 => 33.8615, std.dev.: 0.3186) Report Time: 0.84s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 11:39:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 13:39:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129193937.150F62A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8082?compare_to=8079&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8082, Order: 173807, Start Time: 2013-01-29 17:27:48, End Time: 2013-01-29 19:39:58 To: 8079, Order: 173798, Start Time: 2013-01-29 14:44:46, End Time: 2013-01-29 16:56:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (232 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (640 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/fbench: 3.02% (2.2877 => 2.3568, std.dev.: 0.0146) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.15% (0.0680 => 0.0681, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8534 => 499.8636, std.dev.: 0.0067) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 44225.94% (1.1277 => 499.8636, std.dev.: 0.0067) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.66% (0.5229 => 1.7081, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 26.68% (14.9895 => 18.9884, std.dev.: 0.0141) MultiSource/Applications/kimwitu++/kc: 48.66% (14.1553 => 21.0432, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 21.09% (4.1105 => 4.9773, std.dev.: 0.0148) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.30% (1.1048 => 1.7931, std.dev.: 0.0035) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.04% (7.1582 => 39.3732, std.dev.: 0.0103) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.82% (3.4629 => 6.6425, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.35% (0.6222 => 1.1470, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.72% (0.0720 => 7.4446, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11100700.00% (0.0001 => 11.1008, std.dev.: 0.0174) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848900.00% (0.0001 => 9.8490, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487800.00% (0.0001 => 5.4879, std.dev.: 0.0126) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.54% (1.1194 => 10.2150, std.dev.: 0.0176) MultiSource/Applications/ClamAV/clamscan: 149.88% (22.1758 => 55.4120, std.dev.: 0.0090) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.23% (0.0929 => 0.1888, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.59% (0.1463 => 0.2642, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/IntMM: 67.01% (0.0394 => 0.0658, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 66.85% (0.0730 => 0.1218, std.dev.: 0.0011) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.36% (1.5859 => 2.4956, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.20% (2.9384 => 4.6192, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.01% (7.0540 => 10.9345, std.dev.: 0.0091) MultiSource/Benchmarks/FreeBench/distray/distray: 53.50% (0.1056 => 0.1621, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.89% (0.0439 => 0.0658, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.65% (8.1363 => 12.1756, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.94% (2.2024 => 3.2362, std.dev.: 0.0054) SingleSource/UnitTests/vla: 45.63% (0.0355 => 0.0517, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: 45.16% (0.3109 => 0.4513, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 43.03% (0.1062 => 0.1519, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: 41.55% (0.1432 => 0.2027, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 40.14% (21.9371 => 30.7430, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.62% (1.5415 => 2.1368, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.08% (4.2646 => 5.8885, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.81% (0.4615 => 0.6360, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.38% (0.5105 => 0.6962, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.33% (0.2271 => 0.3096, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.70% (0.0479 => 0.0650) SingleSource/UnitTests/2006-12-11-LoadConstants: 34.82% (0.1143 => 0.1541, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 34.57% (0.0457 => 0.0615, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.40% (0.6675 => 0.8971, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 34.38% (0.4299 => 0.5777, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.25% (0.1892 => 0.2540, std.dev.: 0.0016) MultiSource/Applications/Burg/burg: 34.06% (1.1642 => 1.5607, std.dev.: 0.0077) SingleSource/UnitTests/Vector/build2: 33.90% (0.0295 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: 33.66% (0.0719 => 0.0961, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.88% (0.0730 => 0.0970, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 32.51% (0.1655 => 0.2193, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 32.00% (0.1125 => 0.1485, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.92% (0.1695 => 0.2236, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.90% (0.0793 => 0.1038, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 30.67% (9.4845 => 12.3938, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.31% (3.8922 => 5.0719, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout/hash: 30.31% (0.0485 => 0.0632, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 29.21% (0.2554 => 0.3300, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 29.19% (1.0722 => 1.3852, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 29.13% (0.3121 => 0.4030, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 29.07% (0.4289 => 0.5536, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.58% (1.4186 => 1.8241, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 27.99% (0.4620 => 0.5913, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 27.94% (0.7115 => 0.9103, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.67% (0.1337 => 0.1707, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.53% (0.0672 => 0.0857, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 27.40% (0.1175 => 0.1497, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.28% (0.1906 => 0.2426, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 27.17% (0.5020 => 0.6384, std.dev.: 0.0108) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.08% (0.1566 => 0.1990, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 26.80% (0.6456 => 0.8186, std.dev.: 0.0007) MultiSource/Applications/aha/aha: 26.41% (0.1151 => 0.1455, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.13% (0.1236 => 0.1559, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 26.00% (0.0527 => 0.0664, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 25.31% (0.1695 => 0.2124, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.29% (1.3050 => 1.6350, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.19% (0.0675 => 0.0845, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 25.12% (0.7835 => 0.9803, std.dev.: 0.0028) MultiSource/Applications/viterbi/viterbi: 25.02% (0.1555 => 0.1944, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.00% (0.1032 => 0.1290, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.96% (0.2700 => 0.3374, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/messages-2: 24.77% (0.0662 => 0.0826, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.39% (0.1029 => 0.1280, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 24.19% (1.1840 => 1.4704, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 24.04% (3.3354 => 4.1372, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.99% (0.0842 => 0.1044, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 23.90% (0.1163 => 0.1441, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.89% (0.3307 => 0.4097, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.82% (0.0953 => 0.1180, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.81% (0.1940 => 0.2402, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.77% (0.0770 => 0.0953, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.49% (5.7591 => 7.1121, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.48% (0.5860 => 0.7236, std.dev.: 0.0028) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.42% (0.1584 => 0.1955, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 23.14% (0.3098 => 0.3815, std.dev.: 0.0083) MultiSource/Benchmarks/Olden/bisort/bisort: 23.13% (0.0614 => 0.0756, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/five11/five11: 22.93% (0.0567 => 0.0697, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.65% (0.1510 => 0.1852, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.64% (0.8172 => 1.0022, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.59% (0.2758 => 0.3381, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.50% (4.9449 => 6.0573, std.dev.: 0.0133) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.40% (0.2107 => 0.2579, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.35% (0.0528 => 0.0646, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 22.03% (2.0273 => 2.4739, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/18-imp/imp: 22.00% (0.3423 => 0.4176, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 21.91% (0.8921 => 1.0876, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 21.70% (3.8723 => 4.7124, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.59% (5.0018 => 6.0816, std.dev.: 0.0058) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.41% (0.0467 => 0.0567, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.36% (0.9765 => 1.1851, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 21.33% (0.2049 => 0.2486, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.32% (0.6450 => 0.7825, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.30% (0.5569 => 0.6755, std.dev.: 0.0064) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.22% (0.1117 => 0.1354, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 21.10% (0.7433 => 0.9001, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.05% (1.1861 => 1.4358, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.95% (0.0759 => 0.0918, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.74% (0.1268 => 0.1531, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 20.66% (2.2969 => 2.7714, std.dev.: 0.0147) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.47% (0.0933 => 0.1124, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.14% (0.0834 => 0.1002, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.89% (0.4203 => 0.5039, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.81% (0.8101 => 0.9706, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.74% (0.0770 => 0.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.44% (0.3441 => 0.4110, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.39% (0.5981 => 0.7141, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.23% (0.2065 => 0.2462, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.21% (0.2603 => 0.3103, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.16% (0.1044 => 0.1244, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 18.58% (0.3283 => 0.3893, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 18.25% (0.3232 => 0.3822, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.08% (0.3180 => 0.3755, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.92% (0.8067 => 0.9513, std.dev.: 0.0018) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.76% (0.0704 => 0.0829, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696) SingleSource/Benchmarks/Shootout-C++/ary2: 17.11% (0.3379 => 0.3957, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.74% (0.3865 => 0.4512, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 16.68% (0.3387 => 0.3952, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.43% (0.4103 => 0.4777, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 15.99% (1.5603 => 1.8098, std.dev.: 0.0048) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.88% (0.4636 => 0.5372, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 15.53% (17.1811 => 19.8492, std.dev.: 0.0194) SingleSource/Regression/C++/ofstream_ctor: 15.49% (0.2905 => 0.3355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/moments: 15.37% (0.4048 => 0.4670, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 14.65% (0.3092 => 0.3545, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 14.64% (0.3422 => 0.3923, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.54% (0.1114 => 0.1276, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: 14.50% (0.3684 => 0.4218, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 14.43% (0.3603 => 0.4123, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.70% (0.3826 => 0.4350, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.66% (0.3427 => 0.3895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.46% (0.4064 => 0.4611, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 13.09% (0.1268 => 0.1434, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.09% (0.2430 => 0.2748, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.00% (14.3668 => 16.2340, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.92% (0.1625 => 0.1835, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 12.17% (0.3886 => 0.4359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 11.76% (0.2831 => 0.3164, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 11.24% (1.2842 => 1.4285, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions: 11.18% (0.3828 => 0.4256, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 11.11% (0.2871 => 0.3190, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.94% (0.3162 => 0.3508, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.93% (2.0665 => 2.2923, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: 10.74% (0.2877 => 0.3186, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.67% (0.3935 => 0.4355, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.67% (0.3543 => 0.3921, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 10.67% (0.3694 => 0.4088, std.dev.: 0.0077) SingleSource/UnitTests/ObjC/synchronized: 10.64% (0.3561 => 0.3940, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.63% (0.2756 => 0.3049, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 10.61% (0.3543 => 0.3919, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 10.52% (0.3516 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.33% (0.3650 => 0.4027, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.31% (0.2793 => 0.3081, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.13% (0.2725 => 0.3001, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.06% (0.2872 => 0.3161, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.00% (0.2891 => 0.3180, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.99% (0.2802 => 0.3082, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.98% (0.3136 => 0.3449, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.95% (0.2714 => 0.2984, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 9.89% (63.2438 => 69.5008, std.dev.: 0.0287) SingleSource/Benchmarks/Shootout-C++/wc: 9.86% (0.3052 => 0.3353, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.87% (0.6030 => 0.6565, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.74% (0.2266 => 0.2464, std.dev.: 0.0011) MultiSource/Benchmarks/PAQ8p/paq8p: 8.70% (10.3673 => 11.2692, std.dev.: 0.0046) SingleSource/UnitTests/ObjC++/property-reference: 8.54% (0.7326 => 0.7952, std.dev.: 0.0048) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.40% (2.2022 => 2.3872, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.15% (0.3177 => 0.3436, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/Hello: 8.07% (0.5925 => 0.6403, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/power/power: 6.94% (0.1440 => 0.1540, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.71% (7.9617 => 8.3369, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.22% (0.3817 => 0.3940, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 148.01% (4.3953 => 10.9009, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3119, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4710, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.03% (1.1145 => 1.2932, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 13.10% (0.5413 => 0.6122, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.82% (11.6436 => 12.5542, std.dev.: 0.1724) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (4.2280 => 4.4658, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/hash2: 4.91% (3.1578 => 3.3129, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.3316 => 0.3445, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 3.50% (2.2771 => 2.3568, std.dev.: 0.0146) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1058, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.07% (0.9957 => 1.0263, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.48% (8.6802 => 8.8959, std.dev.: 0.0067) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 2.46% (9.1159 => 9.3405, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.11% (3.6395 => 3.7163, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2904, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.10% (6.5088 => 6.5807, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1474, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.70% (5.2763 => 1.1764, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -75.12% (0.8651 => 0.2152, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -41.74% (0.1622 => 0.0945, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.86% (5.3855 => 4.4775, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.19% (5.3526 => 4.4860, std.dev.: 0.0146) MultiSource/Applications/JM/ldecod/ldecod: -11.76% (10.4361 => 9.2089, std.dev.: 0.0195) SingleSource/UnitTests/Vector/constpool: -7.49% (54.1659 => 50.1072, std.dev.: 0.0161) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.41% (1.7609 => 1.6304, std.dev.: 0.0046) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.29% (1.9577 => 0.6599, std.dev.: 0.0158) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.02% (0.6962 => 0.3410, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -41.50% (0.0400 => 0.0234, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3055, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.44% (1.5373 => 1.0232, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel: -33.35% (1.1492 => 0.7659, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4376, std.dev.: 0.0058) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9303, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.40% (2.6546 => 2.0068, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029) SingleSource/UnitTests/Vector/multiplies: -16.84% (2.5528 => 2.1230, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/flops-6: -15.59% (1.6925 => 1.4286, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7324, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.20% (0.9540 => 0.8376, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4933, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.09% (1.8329 => 1.7029, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5889, std.dev.: 0.0147) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.92% (1.2373 => 1.1640, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.63% (1.6805 => 1.5859, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7017, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -5.09% (1.5835 => 1.5029, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/salsa20: -4.72% (10.2830 => 9.7973, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1563, std.dev.: 0.0024) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.04% (1.0554 => 1.0339, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: -1.59% (3.7221 => 3.6630, std.dev.: 0.0070) MultiSource/Applications/sqlite3/sqlite3: -1.33% (4.6441 => 4.5824, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/ary3: -1.29% (3.6994 => 3.6516, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8576, std.dev.: 0.0068) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0009) Report Time: 1.56s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 12:05:50 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 14:05:50 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129200550.910062A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8083?compare_to=8080&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8083, Order: 173811, Start Time: 2013-01-29 18:32:03, End Time: 2013-01-29 20:06:12 To: 8080, Order: 173806, Start Time: 2013-01-29 16:34:06, End Time: 2013-01-29 18:08:16 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (119 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.53% (0.0974 => 0.1622, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 41.87% (0.1132 => 0.1606, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.87% (0.6395 => 0.8817, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.18% (0.6395 => 0.8709, std.dev.: 0.0153) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.37% (0.5805 => 0.7684, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.26% (0.5688 => 0.7523, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.20% (0.5456 => 0.7213, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.19% (0.6260 => 0.8275, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.87% (0.5849 => 0.7713, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.61% (0.5567 => 0.7327, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.50% (0.5581 => 0.7339, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.48% (0.5575 => 0.7330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.43% (0.6230 => 0.8188, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.62% (0.5941 => 0.7760, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.58% (0.5802 => 0.7576, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.27% (0.5705 => 0.7432, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.85% (0.5478 => 0.7113, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 29.74% (0.5569 => 0.7225, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.70% (0.6033 => 0.7825, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.68% (0.5570 => 0.7223, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.67% (0.5857 => 0.7595, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.52% (1.6474 => 2.1337, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.39% (0.5591 => 0.7234, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.13% (0.6440 => 0.8316, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.54% (0.5925 => 0.7616, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.41% (0.6189 => 0.7947, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.33% (0.6676 => 0.8567, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.09% (0.5863 => 0.7510, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.04% (0.0699 => 0.0895, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.87% (0.6304 => 0.8061, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.69% (0.6052 => 0.7728, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.66% (0.6446 => 0.8229, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.87% (0.6681 => 0.8476, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.69% (0.6194 => 0.7847, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.41% (0.6660 => 0.8419, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.20% (0.6297 => 0.7947, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.85% (0.6667 => 0.8324, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.60% (0.7524 => 0.9300, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.91% (0.7339 => 0.9020, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.48% (2.2587 => 2.7665, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.42% (0.0621 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.06% (0.3357 => 0.3896, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.21% (1.1450 => 1.3192, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.71% (0.1982 => 0.2234, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.48% (4.5069 => 5.0695, std.dev.: 0.0027) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.36% (0.1230 => 0.1382, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.13% (1.6364 => 1.8349, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 12.03% (0.4515 => 0.5058, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.02% (0.4916 => 0.5507, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.76% (3.5339 => 3.9494, std.dev.: 0.0070) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.44% (0.2385 => 0.2634, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 9.82% (9.2283 => 10.1346, std.dev.: 0.0123) MultiSource/Applications/Burg/burg: 8.89% (1.2515 => 1.3628, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.61% (0.1731 => 0.1880, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 8.53% (0.4524 => 0.4910, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.46% (0.5329 => 0.5780, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.37% (0.7021 => 0.7609, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.69% (1.2784 => 1.3767, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (0.4861 => 0.5231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.29% (1.4642 => 1.5710, std.dev.: 0.0048) SingleSource/Benchmarks/Misc-C++/bigfib: 6.36% (0.6750 => 0.7179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.61% (5.4682 => 5.7747, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.3255 => 0.3436, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 5.53% (0.1879 => 0.1983, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.3319 => 0.3494, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.31% (22.4056 => 23.3715, std.dev.: 0.0184) MultiSource/Applications/oggenc/oggenc: 3.32% (5.0226 => 5.1891, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: 3.15% (1.3864 => 1.4301, std.dev.: 0.0028) MultiSource/Applications/minisat/minisat: 3.10% (0.7447 => 0.7678, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.08% (15.5079 => 15.9859, std.dev.: 0.0151) SingleSource/Benchmarks/Shootout-C++/ary3: 3.08% (0.3446 => 0.3552, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.97% (0.8418 => 0.8668, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.89% (0.9557 => 0.9833, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.48% (0.4427 => 0.4537, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.97% (0.5168 => 0.5270, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.95% (1.3722 => 1.3989, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.70% (0.6293 => 0.6400, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 1.30% (18.2933 => 18.5318, std.dev.: 0.0116) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.16% (1.2300 => 1.2443, std.dev.: 0.0054) MultiSource/Applications/d/make_dparser: 1.04% (3.5154 => 3.5521, std.dev.: 0.0005) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.82% (31.3723 => 55.7864, std.dev.: 0.0102) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (0.9531 => 1.0267, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.72% (54.5751 => 56.6076, std.dev.: 0.1045) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.64% (2.0478 => 2.1019, std.dev.: 0.0094) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6060, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.61% (18.2231 => 18.5162, std.dev.: 0.0211) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2501, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.30% (79.7170 => 80.7497, std.dev.: 0.2282) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4555, std.dev.: 0.0155) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.65% (0.7198 => 0.6863, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.78% (0.3837 => 0.3692, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: -3.71% (0.3831 => 0.3689, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.57% (0.4033 => 0.3889, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.57% (0.3896 => 0.3757, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.53% (0.3848 => 0.3712, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.53% (0.9852 => 0.9504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.50% (0.3057 => 0.2950, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.47% (0.3142 => 0.3033, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.46% (2.4924 => 2.4061, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.44% (0.3891 => 0.3757, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.37% (0.3323 => 0.3211, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.24% (0.3205 => 0.3101, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.23% (0.4176 => 0.4041, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.09% (0.3884 => 0.3764, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.95% (2.1713 => 2.1073, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -2.88% (0.6347 => 0.6164, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.85% (1.3148 => 1.2773, std.dev.: 0.0007) SingleSource/UnitTests/Vector/constpool: -2.66% (20.7746 => 20.2213, std.dev.: 0.0972) SingleSource/UnitTests/ObjC/property: -2.64% (0.4199 => 0.4088, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -2.64% (0.6441 => 0.6271, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.58% (0.6484 => 0.6317, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/parameter-passing: -2.38% (0.4280 => 0.4178, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9082, std.dev.: 0.0063) SingleSource/UnitTests/ObjC++/property-reference: -2.11% (0.7779 => 0.7615, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.37% (1.0544 => 1.0400, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (6.7716 => 6.6842, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: -1.24% (16.1920 => 15.9907, std.dev.: 0.0163) MultiSource/Applications/sqlite3/sqlite3: -1.16% (17.1032 => 16.9050, std.dev.: 0.0134) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (7.0961 => 7.0202, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.06% (1.2221 => 1.2092, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.29% (1.8100 => 0.7006, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0077) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3145, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.16% (1.3643 => 1.0210, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -23.31% (83.5423 => 64.0722, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2048, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1311, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3529, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.78% (0.5142 => 0.4639, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -9.01% (1.2842 => 1.1685, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: -4.02% (2.2633 => 2.1724, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4003, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.68% (7.9763 => 7.7622, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout/ary3: -2.47% (3.7241 => 3.6320, std.dev.: 0.0171) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1733, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4732, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857) SingleSource/Benchmarks/Shootout-C++/ary3: -1.11% (3.7092 => 3.6682, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.10s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 13:32:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 15:32:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130129213211.EEA362A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8084?compare_to=8081&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8084, Order: 173816, Start Time: 2013-01-29 19:24:40, End Time: 2013-01-29 21:32:34 To: 8081, Order: 173807, Start Time: 2013-01-29 16:59:21, End Time: 2013-01-29 19:05:32 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 22 (93 on baseline) Performance Improvements: 4 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1038 (921 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 68.65% (0.0504 => 0.0850, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.60% (7.2646 => 8.3978, std.dev.: 0.3221) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 13.22% (9.5967 => 10.8653, std.dev.: 0.4812) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.82% (1.3489 => 1.4813, std.dev.: 0.0365) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.50% (24.4595 => 26.5387, std.dev.: 0.2103) MultiSource/Benchmarks/Prolangs-C++/city/city: 7.61% (1.5011 => 1.6153, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.54% (1.2677 => 1.3633, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.24% (1.2737 => 1.3405, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.91% (1.2777 => 1.3277, std.dev.: 0.0065) MultiSource/Applications/JM/ldecod/ldecod: 3.45% (7.4417 => 7.6983, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.45% (1.1953 => 1.2365, std.dev.: 0.0132) MultiSource/Applications/Burg/burg: 1.10% (1.4630 => 1.4791, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: 71.45% (0.0837 => 0.1435, std.dev.: 0.0028) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.17% (2.4297 => 2.8711, std.dev.: 0.1184) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.04% (0.3283 => 0.3744, std.dev.: 0.0135) MultiSource/Benchmarks/nbench/nbench: 11.58% (19.3536 => 21.5941, std.dev.: 0.6690) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.52% (13.5771 => 14.1908, std.dev.: 0.0653) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.8473 => 5.0571, std.dev.: 0.0183) SingleSource/Benchmarks/Linpack/linpack-pc: 3.43% (50.8308 => 52.5744, std.dev.: 0.6311) SingleSource/Benchmarks/Misc/flops: 2.32% (8.6521 => 8.8531, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/methcall: 1.22% (8.3605 => 8.4627, std.dev.: 0.0392) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.06% (5.8634 => 5.9255, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Puzzle: -12.65% (0.2016 => 0.1761, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: -4.02% (2.9127 => 2.7956, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -2.32% (4.4791 => 4.3754, std.dev.: 0.0356) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.78% (1.4736 => 1.4474, std.dev.: 0.0024) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.66% (1.2112 => 1.2313, std.dev.: 0.1628) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.78% (0.0225 => 0.0221, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.14% (0.0438 => 0.0433, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.18% (0.0340 => 0.0336, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.23% (0.0325 => 0.0321, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/casts: -0.48% (0.0208 => 0.0207, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: -0.45% (0.0221 => 0.0220, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.87% (0.0230 => 0.0228, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014) MultiSource/Applications/ClamAV/clamscan: 0.47% (0.1488 => 0.1495, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: 0.28% (1.1789 => 1.1822, std.dev.: 0.3308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.29% (0.3936 => 0.4223, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.85% (0.1507 => 0.1550, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.48% (0.0610 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.00% (0.0267 => 0.0275, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.89% (0.0554 => 0.0570, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.05% (1.2858 => 1.2852, std.dev.: 0.0237) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 55.00% (0.0020 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 46.15% (0.0026 => 0.0038, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -2.00% (0.0600 => 0.0588, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -6.42% (0.0374 => 0.0350, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.90% (1.7368 => 1.7525, std.dev.: 0.0559) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.84% (0.0123 => 0.0074, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.49% (33.8615 => 34.0283, std.dev.: 0.2237) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 394.05% (0.0336 => 0.1660, std.dev.: 0.0289) SingleSource/Regression/C/sumarraymalloc: 120.14% (0.0293 => 0.0645, std.dev.: 0.0054) SingleSource/Regression/C/sumarray2d: 90.15% (0.0274 => 0.0521, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/neural/neural: 66.42% (0.1638 => 0.2726, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 53.30% (0.8893 => 1.3633, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 50.54% (0.9588 => 1.4434, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 50.26% (0.9120 => 1.3704, std.dev.: 0.0656) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 48.30% (0.8990 => 1.3332, std.dev.: 0.0800) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 48.10% (0.8926 => 1.3219, std.dev.: 0.0299) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 47.88% (1.0017 => 1.4813, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 47.52% (0.9612 => 1.4180, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.85% (1.0867 => 1.5850, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 45.11% (0.9010 => 1.3074, std.dev.: 0.0264) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 45.01% (0.9564 => 1.3869, std.dev.: 0.0277) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 43.92% (0.9381 => 1.3501, std.dev.: 0.0812) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 43.88% (0.9091 => 1.3080, std.dev.: 0.0763) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 43.73% (1.0088 => 1.4499, std.dev.: 0.0518) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 43.22% (0.8912 => 1.2764, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 43.03% (1.0119 => 1.4473, std.dev.: 0.0894) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.84% (0.9061 => 1.2943, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 42.49% (0.9998 => 1.4246, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 41.52% (0.9403 => 1.3307, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 39.78% (0.8846 => 1.2365, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 39.45% (1.0052 => 1.4018, std.dev.: 0.1029) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 38.84% (0.8736 => 1.2129, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 38.77% (0.9788 => 1.3583, std.dev.: 0.0855) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 38.49% (0.8732 => 1.2093, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.48% (0.9422 => 1.3048, std.dev.: 0.0667) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 38.41% (0.9685 => 1.3405, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.90% (0.9512 => 1.3117, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.70% (0.9488 => 1.3065, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 36.54% (0.9867 => 1.3472, std.dev.: 0.0649) SingleSource/Benchmarks/McGill/exptree: 35.27% (0.0859 => 0.1162, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 34.83% (0.9507 => 1.2818, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 34.63% (0.9550 => 1.2857, std.dev.: 0.0725) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.44% (0.9993 => 1.3035, std.dev.: 0.0506) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 26.02% (0.0738 => 0.0930, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 25.03% (0.0935 => 0.1169, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: 21.07% (0.3598 => 0.4356, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 20.85% (1.0986 => 1.3277, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.51% (0.0738 => 0.0882, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.83% (0.0669 => 0.0795, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 17.13% (0.0642 => 0.0752, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 15.82% (9.5202 => 11.0265, std.dev.: 0.4219) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.48% (0.1240 => 0.1432, std.dev.: 0.0005) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.48% (7.2721 => 8.3978, std.dev.: 0.3221) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.33% (0.0783 => 0.0903, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.91% (3.6295 => 4.1706, std.dev.: 0.1535) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.54% (0.2879 => 0.3240, std.dev.: 0.0060) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.52% (23.5861 => 26.5387, std.dev.: 0.2103) SingleSource/Benchmarks/Misc/ReedSolomon: 11.90% (0.2050 => 0.2294, std.dev.: 0.0084) SingleSource/Benchmarks/McGill/chomp: 11.66% (0.1793 => 0.2002, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 10.31% (0.2385 => 0.2631, std.dev.: 0.0081) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.12% (0.4596 => 0.5061, std.dev.: 0.0122) SingleSource/Benchmarks/Linpack/linpack-pc: 9.59% (0.2566 => 0.2812, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.11% (1.4805 => 1.6153, std.dev.: 0.0358) MultiSource/Applications/oggenc/oggenc: 7.24% (5.3553 => 5.7428, std.dev.: 0.1047) MultiSource/Applications/JM/ldecod/ldecod: 4.70% (7.3529 => 7.6983, std.dev.: 0.0261) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.52% (0.7693 => 0.7887, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107400.00% (0.0008 => 0.8600, std.dev.: 0.0249) SingleSource/Benchmarks/Shootout/matrix: 356.44% (1.5825 => 7.2232, std.dev.: 0.0526) SingleSource/Benchmarks/Shootout/ary3: 289.17% (2.2304 => 8.6801, std.dev.: 2.2946) MultiSource/Applications/sgefa/sgefa: 258.83% (0.3515 => 1.2613, std.dev.: 0.0021) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.48% (1.1825 => 4.0735, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.01% (4.8185 => 15.8532, std.dev.: 0.1767) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 214.47% (0.0228 => 0.0717, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/ary2: 200.00% (0.0129 => 0.0387, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary: 145.26% (0.0232 => 0.0569, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/gs/gs: 86.12% (0.0771 => 0.1435, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 62.73% (2.9083 => 4.7326, std.dev.: 0.0390) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.58% (3.1254 => 4.1124, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.22% (1.4588 => 1.8705, std.dev.: 0.0844) SingleSource/Regression/C/uint64_to_float: 23.19% (1.5397 => 1.8968, std.dev.: 0.0291) SingleSource/Benchmarks/Misc/salsa20: 21.95% (7.4497 => 9.0847, std.dev.: 0.0441) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 21.46% (5.6033 => 6.8059, std.dev.: 0.0401) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.43% (4.8112 => 5.7940, std.dev.: 0.0243) MultiSource/Applications/JM/lencod/lencod: 15.58% (6.8159 => 7.8780, std.dev.: 0.2554) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.07% (2.5170 => 2.8711, std.dev.: 0.1184) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.61% (5.1752 => 5.8796, std.dev.: 0.0648) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.97% (5.0033 => 5.6521, std.dev.: 0.0076) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.81% (9.0082 => 9.9816, std.dev.: 0.3687) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.72% (3.6477 => 3.9656, std.dev.: 0.0177) SingleSource/Benchmarks/Misc/ReedSolomon: 8.08% (8.6447 => 9.3434, std.dev.: 0.0216) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.56% (2.2499 => 2.3974, std.dev.: 0.0383) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.53% (4.7473 => 5.0571, std.dev.: 0.0183) SingleSource/Benchmarks/McGill/chomp: 5.78% (1.0425 => 1.1028, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1836 => 4.4028, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.31% (5.0310 => 5.2476, std.dev.: 0.0508) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.35% (4.7254 => 4.8835, std.dev.: 0.0168) SingleSource/Benchmarks/Linpack/linpack-pc: 3.30% (50.8945 => 52.5744, std.dev.: 0.6311) SingleSource/Benchmarks/Misc/pi: 2.81% (2.1390 => 2.1991, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.18% (5.9115 => 5.9811, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.03% (2.5681 => 2.5946, std.dev.: 0.0063) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -26.30% (0.0692 => 0.0510, std.dev.: 0.0027) SingleSource/Benchmarks/SmallPT/smallpt: -25.53% (0.1888 => 0.1406, std.dev.: 0.0059) MultiSource/Applications/spiff/spiff: -10.98% (1.0220 => 0.9098, std.dev.: 0.0140) MultiSource/Applications/Burg/burg: -7.43% (1.5979 => 1.4791, std.dev.: 0.0048) MultiSource/Applications/siod/siod: -5.95% (2.6437 => 2.4865, std.dev.: 0.0608) MultiSource/Applications/d/make_dparser: -3.64% (3.7840 => 3.6463, std.dev.: 0.0286) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.84% (11.5523 => 3.9460, std.dev.: 0.0250) SingleSource/Benchmarks/Misc/fp-convert: -61.99% (15.6525 => 5.9488, std.dev.: 0.0559) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.89% (0.4146 => 0.1829, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.36% (0.4578 => 0.2364, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.77% (11.3868 => 6.4025, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.89% (5.4023 => 3.6254, std.dev.: 0.0512) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.53% (0.4452 => 0.3093, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -25.98% (5.2605 => 3.8936, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.03% (4.4467 => 3.3338, std.dev.: 0.0754) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.02% (0.5495 => 0.4120, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.60% (0.5826 => 0.4393, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.27% (4.9921 => 3.8305, std.dev.: 0.1902) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -21.27% (0.5897 => 0.4643, std.dev.: 0.0311) SingleSource/Benchmarks/Shootout-C++/heapsort: -19.98% (4.2042 => 3.3640, std.dev.: 0.2913) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.32% (5.8755 => 4.7991, std.dev.: 0.0366) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.92% (16.6791 => 14.1908, std.dev.: 0.0653) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.63% (7.0016 => 5.9771, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.92% (3.1921 => 2.7797, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.67% (5.3626 => 4.6830, std.dev.: 0.0157) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.45% (5.7056 => 4.9954, std.dev.: 0.0181) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.38% (9.7992 => 8.5860, std.dev.: 0.0154) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.85% (0.4081 => 0.3679, std.dev.: 0.0153) MultiSource/Applications/SIBsim4/SIBsim4: -6.70% (3.5443 => 3.3069, std.dev.: 0.0593) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.39% (5.5974 => 5.2395, std.dev.: 0.0172) SingleSource/Benchmarks/McGill/queens: -5.54% (1.7443 => 1.6476, std.dev.: 0.0090) MultiSource/Benchmarks/mafft/pairlocalalign: -5.53% (63.1520 => 59.6570, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.13% (4.9799 => 4.7243, std.dev.: 0.0505) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (3.6768 => 3.5015, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.23% (3.5127 => 3.3640, std.dev.: 0.0325) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.95% (23.3986 => 22.4733, std.dev.: 0.2851) SingleSource/Benchmarks/Shootout-C++/lists: -3.69% (17.2182 => 16.5833, std.dev.: 0.1597) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.53% (5.8973 => 5.6893, std.dev.: 0.0577) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.18% (3.5691 => 3.4555, std.dev.: 0.0287) MultiSource/Applications/sqlite3/sqlite3: -2.18% (4.4730 => 4.3754, std.dev.: 0.0356) MultiSource/Applications/spiff/spiff: -2.15% (2.8571 => 2.7956, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/mandel-2: -2.03% (0.8521 => 0.8348, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.66% (8.7327 => 8.5880, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.58% (85.3042 => 83.9553, std.dev.: 0.0530) SingleSource/Benchmarks/Misc/whetstone: -1.41% (1.6251 => 1.6022, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.21% (3.3596 => 3.3190, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.13% (8.8249 => 8.7255, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (3.7450 => 3.7032, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: -1.02% (8.7416 => 8.6526, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.21% (1.2047 => 1.2313, std.dev.: 0.1628) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -5.15% (0.0233 => 0.0221, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.99% (0.0451 => 0.0433, std.dev.: 0.0125) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0109) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0143) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0060) SingleSource/UnitTests/Vector/Altivec/test1: -3.08% (0.0227 => 0.0220, std.dev.: 0.0030) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.59% (0.0255 => 0.0228, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014) MultiSource/Applications/ClamAV/clamscan: -2.29% (0.1530 => 0.1495, std.dev.: 0.0085) MultiSource/Applications/lemon/lemon: -38.72% (1.9293 => 1.1822, std.dev.: 0.3308) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.30% (0.4049 => 0.4223, std.dev.: 0.0425) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.65% (0.1510 => 0.1550, std.dev.: 0.0230) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.47% (0.0978 => 0.0680, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.39% (0.0590 => 0.0570, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.63% (1.1617 => 1.2852, std.dev.: 0.0237) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.74% (0.0027 => 0.0038, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.61% (0.0610 => 0.0588, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.60% (0.0268 => 0.0350, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.65% (0.7437 => 1.7525, std.dev.: 0.0559) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -19.57% (0.0092 => 0.0074, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 166.30% (12.7781 => 34.0283, std.dev.: 0.2237) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 14:03:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 16:03:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130129220351.7F2552A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8085?compare_to=8083&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8085, Order: 173821, Start Time: 2013-01-29 20:29:50, End Time: 2013-01-29 22:04:10 To: 8083, Order: 173811, Start Time: 2013-01-29 18:32:03, End Time: 2013-01-29 20:06:12 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.15% (0.0717 => 0.1220, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.94% (0.0974 => 0.1626, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.48% (0.6395 => 0.8856, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.56% (0.6395 => 0.8733, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.02% (0.5688 => 0.7566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.75% (0.5456 => 0.7243, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.72% (0.6260 => 0.8308, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.66% (0.5805 => 0.7701, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.36% (0.5849 => 0.7742, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.33% (0.5567 => 0.7367, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.11% (0.5581 => 0.7373, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.07% (0.5575 => 0.7363, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.97% (0.6230 => 0.8222, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.32% (0.5941 => 0.7802, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.21% (0.5802 => 0.7613, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.80% (0.5705 => 0.7462, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.55% (0.5859 => 0.7649, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.49% (0.5478 => 0.7148, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.36% (0.5857 => 0.7635, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.35% (0.5569 => 0.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.32% (0.6033 => 0.7862, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.18% (0.5570 => 0.7251, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.07% (1.6474 => 2.1427, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.87% (0.5591 => 0.7261, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.63% (0.6440 => 0.8348, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.08% (0.6189 => 0.7989, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.73% (0.6676 => 0.8594, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.64% (0.5863 => 0.7542, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.47% (0.0699 => 0.0898, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.30% (0.6304 => 0.8088, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.20% (0.6446 => 0.8264, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.01% (0.0582 => 0.0745, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.22% (0.6194 => 0.7880, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.06% (0.6681 => 0.8489, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.00% (0.6660 => 0.8458, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.70% (0.6297 => 0.7978, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 25.97% (0.0693 => 0.0873, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.48% (0.6667 => 0.8366, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.18% (0.7524 => 0.9343, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.46% (0.7339 => 0.9061, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.77% (2.2587 => 2.7731, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.19% (0.0622 => 0.0760, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.06% (0.0621 => 0.0758, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.71% (0.0556 => 0.0660, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.37% (0.0566 => 0.0670, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 16.41% (0.3357 => 0.3908, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.88% (0.0680 => 0.0788, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 15.69% (1.1450 => 1.3247, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 15.45% (0.1230 => 0.1420, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.36% (0.0731 => 0.0836, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 13.43% (0.0864 => 0.0980, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.83% (4.5069 => 5.0850, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.67% (0.4916 => 0.5539, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.41% (1.6364 => 1.8394, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.23% (0.4515 => 0.5067, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.14% (3.5339 => 3.9630, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.69% (0.2385 => 0.2640, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.13% (9.2283 => 10.1628, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.36% (0.1731 => 0.1893, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash: 9.35% (0.4524 => 0.4947, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 9.33% (1.2515 => 1.3683, std.dev.: 0.0073) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.27% (0.5329 => 0.5823, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.33% (0.4861 => 0.5266, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.96% (1.2784 => 1.3802, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.79% (1.4642 => 1.5782, std.dev.: 0.0109) SingleSource/Benchmarks/Misc-C++/bigfib: 7.04% (0.6750 => 0.7225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.48% (0.3255 => 0.3466, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.10% (5.4682 => 5.8017, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.68% (22.4056 => 23.4553, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/ary3: 3.74% (0.3446 => 0.3575, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.68% (0.8418 => 0.8728, std.dev.: 0.0032) MultiSource/Applications/oggenc/oggenc: 3.63% (5.0226 => 5.2048, std.dev.: 0.0023) MultiSource/Applications/SPASS/SPASS: 3.60% (15.5079 => 16.0657, std.dev.: 0.0153) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.55% (0.9557 => 0.9896, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 3.54% (0.3394 => 0.3514, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.52% (0.7447 => 0.7709, std.dev.: 0.0012) MultiSource/Applications/SIBsim4/SIBsim4: 3.42% (1.3864 => 1.4338, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.30% (0.4427 => 0.4573, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.01% (0.3491 => 0.3596, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.98% (0.5168 => 0.5322, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.32% (1.3722 => 1.4041, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 2.18% (18.2933 => 18.6926, std.dev.: 0.0213) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.80% (0.6293 => 0.6406, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 1.46% (2.1401 => 2.1713, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 1.42% (3.5154 => 3.5654, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 1.16% (34.0927 => 34.4870, std.dev.: 0.0130) MultiSource/Applications/siod/siod: 1.13% (2.4021 => 2.4292, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8062, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0075) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.71% (54.5751 => 56.5975, std.dev.: 0.0303) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.03% (2.0478 => 2.1099, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.62% (18.2231 => 18.5182, std.dev.: 0.0283) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6042, std.dev.: 0.0009) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2489, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2697, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.94% (0.1281 => 0.1128, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.70% (0.7198 => 0.6860, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -4.60% (0.3194 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.98% (0.3821 => 0.3669, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -3.56% (2.4924 => 2.4036, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.41% (0.3812 => 0.3682, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -3.35% (0.3880 => 0.3750, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.29% (0.9852 => 0.9528, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.28% (0.3142 => 0.3039, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.27% (0.3848 => 0.3722, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.26% (0.3896 => 0.3769, std.dev.: 0.0027) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.21% (0.3891 => 0.3766, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.97% (0.3837 => 0.3723, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.95% (0.4176 => 0.4053, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.83% (0.3884 => 0.3774, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.9542 => 0.9289, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.64% (20.7746 => 20.2253, std.dev.: 0.0240) SingleSource/UnitTests/ObjC++/Hello: -2.35% (0.6347 => 0.6198, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.25% (2.1713 => 2.1224, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: -2.24% (1.3148 => 1.2853, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.21% (0.6484 => 0.6341, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference-object: -2.14% (0.6441 => 0.6303, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.85% (14.2083 => 13.9448, std.dev.: 0.0125) SingleSource/UnitTests/ObjC++/property-reference: -1.80% (0.7779 => 0.7639, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.11% (6.7716 => 6.6965, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -1.01% (16.1920 => 16.0291, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.23% (1.8100 => 0.6656, std.dev.: 0.0153) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3133, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2492, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.16% (1.3643 => 1.0210, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7536, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0812, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.89% (4.1024 => 3.2042, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1736, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.25% (2.5106 => 2.1278, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.88% (0.4092 => 0.3524, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.28% (3.1443 => 2.7266, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3536, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.82% (0.9021 => 0.8406, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1067, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1817, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.44% (7.9763 => 7.7816, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1194, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.93% (1.3096 => 1.2843, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/ary3: -1.90% (3.7241 => 3.6533, std.dev.: 0.0096) MultiSource/Benchmarks/Bullet/bullet: -1.72% (7.3040 => 7.1784, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.43% (1.6219 => 1.5987, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.38% (1.6086 => 1.5864, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.36% (1.6307 => 1.6085, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary3: -1.12% (3.7092 => 3.6676, std.dev.: 0.0072) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 14:22:37 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 16:22:37 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130129222237.2B8442A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8086?compare_to=8082&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8086, Order: 173816, Start Time: 2013-01-29 20:10:40, End Time: 2013-01-29 22:22:58 To: 8082, Order: 173807, Start Time: 2013-01-29 17:27:48, End Time: 2013-01-29 19:39:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (228 on baseline) Performance Improvements: 0 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (642 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.26% (10.2150 => 10.4458, std.dev.: 0.0259) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.35% (0.0681 => 0.0697, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8636 => 499.8519, std.dev.: 0.0066) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.90% (1.1277 => 499.8519, std.dev.: 0.0066) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.02% (0.5229 => 1.7100, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 26.60% (14.9895 => 18.9772, std.dev.: 0.0140) MultiSource/Applications/kimwitu++/kc: 48.39% (14.1553 => 21.0047, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/gs/gs: 20.91% (4.1105 => 4.9702, std.dev.: 0.0082) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.06% (1.1048 => 1.7904, std.dev.: 0.0033) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.39% (7.1582 => 39.3977, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.29% (3.4629 => 6.6241, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.04% (0.6222 => 1.1451, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.72% (0.0720 => 7.4410, std.dev.: 0.0019) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 11088100.00% (0.0001 => 11.0882, std.dev.: 0.0184) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575100.00% (0.0001 => 0.5752, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849900.00% (0.0001 => 9.8500, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489800.00% (0.0001 => 5.4899, std.dev.: 0.0089) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.16% (1.1194 => 10.4458, std.dev.: 0.0259) MultiSource/Applications/ClamAV/clamscan: 152.42% (22.1758 => 55.9763, std.dev.: 0.3133) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.55% (0.0929 => 0.1891, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 94.24% (0.0243 => 0.0472) MultiSource/Benchmarks/FreeBench/neural/neural: 80.38% (0.1463 => 0.2639, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.53% (0.0730 => 0.1223, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 66.75% (0.0394 => 0.0657, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 66.23% (0.0231 => 0.0384) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.59% (2.9384 => 4.6306, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.16% (1.5859 => 2.4924, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.70% (7.0540 => 10.9832, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/distray/distray: 53.69% (0.1056 => 0.1623, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.40% (8.1363 => 12.2367, std.dev.: 0.0041) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.43% (0.0439 => 0.0656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.79% (2.2024 => 3.2329, std.dev.: 0.0151) MultiSource/Applications/sgefa/sgefa: 45.80% (0.3109 => 0.4533, std.dev.: 0.0005) SingleSource/UnitTests/vla: 45.35% (0.0355 => 0.0516, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 42.18% (0.1432 => 0.2036, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.24% (0.1062 => 0.1500, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 40.44% (21.9371 => 30.8087, std.dev.: 0.0068) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.47% (1.5415 => 2.1345, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.96% (4.2646 => 5.8835, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/exptree: 37.35% (0.0814 => 0.1118, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.16% (0.4615 => 0.6330, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.71% (0.5105 => 0.6979, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.62% (0.2271 => 0.3080, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.07% (0.0479 => 0.0647, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.41% (0.1892 => 0.2543, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 34.33% (0.4299 => 0.5775, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.22% (0.6675 => 0.8959, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 34.03% (0.1143 => 0.1532, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 33.92% (1.1642 => 1.5591, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.26% (0.0457 => 0.0609, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.74% (0.0730 => 0.0969, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.50% (0.1695 => 0.2229, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 31.42% (0.1655 => 0.2175, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.11% (0.1125 => 0.1475, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 30.78% (9.4845 => 12.4034, std.dev.: 0.0200) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.63% (3.8922 => 5.0842, std.dev.: 0.0075) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.26% (0.0793 => 0.1033, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.62% (0.0746 => 0.0967, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 29.37% (0.2554 => 0.3304, std.dev.: 0.0020) MultiSource/Applications/lemon/lemon: 28.88% (1.0722 => 1.3819, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 28.75% (0.4289 => 0.5522, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.57% (1.4186 => 1.8239, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.54% (0.1906 => 0.2450, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 28.06% (0.1151 => 0.1474, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.04% (0.3121 => 0.3996, std.dev.: 0.0049) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 27.86% (0.4620 => 0.5907, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 27.76% (0.7115 => 0.9090, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.30% (0.1337 => 0.1702, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 27.23% (0.1175 => 0.1495, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.08% (0.0672 => 0.0854, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.76% (0.1566 => 0.1985, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/bigfib: 26.60% (0.6456 => 0.8173, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: 26.50% (0.1555 => 0.1967, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.31% (0.5020 => 0.6341, std.dev.: 0.0020) MultiSource/Applications/spiff/spiff: 26.02% (0.7835 => 0.9874, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.81% (0.1236 => 0.1555, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/hash: 25.77% (0.0485 => 0.0610, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/15-trie/trie: 25.62% (0.0527 => 0.0662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 25.24% (0.0626 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.11% (0.2700 => 0.3378, std.dev.: 0.0028) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.08% (1.3050 => 1.6323, std.dev.: 0.0084) MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.04% (0.0675 => 0.0844, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.90% (0.1032 => 0.1289, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.68% (0.0871 => 0.1086, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 24.47% (0.0662 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.39% (0.1029 => 0.1280, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 24.25% (0.1695 => 0.2106, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 24.12% (3.3354 => 4.1400, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/mst/mst: 23.99% (0.1163 => 0.1442, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 23.88% (1.1840 => 1.4667, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bisort/bisort: 23.78% (0.0614 => 0.0760, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.76% (0.1940 => 0.2401, std.dev.: 0.0013) MultiSource/Applications/oggenc/oggenc: 23.69% (5.7591 => 7.1237, std.dev.: 0.0048) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.61% (0.0953 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.52% (0.0842 => 0.1040, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.50% (0.3307 => 0.4084, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.28% (0.5860 => 0.7224, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 23.11% (0.3098 => 0.3814, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/five11/five11: 22.75% (0.0567 => 0.0696) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.65% (0.1510 => 0.1852, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.62% (4.9449 => 6.0633, std.dev.: 0.0201) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.41% (0.1584 => 0.1939, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.41% (0.2758 => 0.3376, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.37% (0.8172 => 1.0000, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 22.19% (0.8921 => 1.0901, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.16% (0.0528 => 0.0645, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 22.16% (0.2049 => 0.2503, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 21.90% (2.0273 => 2.4712, std.dev.: 0.0028) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.73% (5.0018 => 6.0889, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 21.69% (0.2065 => 0.2513, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.48% (0.5569 => 0.6765, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.29% (1.1861 => 1.4386, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.28% (0.9765 => 1.1843, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 21.27% (0.3423 => 0.4151, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.17% (0.2107 => 0.2553, std.dev.: 0.0012) SingleSource/UnitTests/SignlessTypes/rem: 21.15% (0.1144 => 0.1386, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.15% (0.6450 => 0.7814, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 21.10% (3.8723 => 4.6892, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.95% (0.1117 => 0.1351, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.95% (0.0759 => 0.0918, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 20.68% (0.7433 => 0.8970, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/health/health: 20.50% (0.1268 => 0.1528, std.dev.: 0.0010) MultiSource/Applications/siod/siod: 20.50% (2.2969 => 2.7677, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.47% (0.0933 => 0.1124, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.39% (0.0770 => 0.0927, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.91% (0.4203 => 0.5040, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.74% (0.0770 => 0.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.29% (0.5981 => 0.7135, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.28% (0.8101 => 0.9663, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.12% (0.3441 => 0.4099, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.06% (0.1044 => 0.1243, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.05% (0.2603 => 0.3099, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 18.70% (0.3283 => 0.3897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 18.46% (0.0818 => 0.0969, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 18.44% (0.3232 => 0.3828, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.05% (0.3180 => 0.3754, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.00% (0.8067 => 0.9519, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.33% (0.0704 => 0.0826, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 17.02% (0.3379 => 0.3954, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 16.98% (0.3387 => 0.3962, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.56% (0.3865 => 0.4505, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.22% (0.4636 => 0.5388, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.84% (0.4103 => 0.4753, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: 15.55% (1.5603 => 1.8030, std.dev.: 0.0040) MultiSource/Applications/sqlite3/sqlite3: 15.49% (17.1811 => 19.8427, std.dev.: 0.1429) SingleSource/Regression/C++/ofstream_ctor: 15.46% (0.2905 => 0.3354, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.42% (0.4048 => 0.4672, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.17% (0.1114 => 0.1283, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.70% (0.3422 => 0.3925, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.52% (0.3684 => 0.4219, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.52% (0.3603 => 0.4126, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.95% (0.3282 => 0.3740, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.91% (0.2430 => 0.2768, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.90% (0.4064 => 0.4629, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.88% (0.3826 => 0.4357, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 13.75% (0.3092 => 0.3517, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.54% (0.3427 => 0.3891, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.92% (14.3668 => 16.2232, std.dev.: 0.0078) SingleSource/UnitTests/ObjC/parameter-passing: 12.86% (0.3927 => 0.4432, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.80% (0.1625 => 0.1833, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1268 => 0.1429, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 12.45% (0.3886 => 0.4370, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.80% (0.2831 => 0.3165, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.73% (0.3828 => 0.4277, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/except: 11.18% (0.2871 => 0.3192, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.17% (0.3473 => 0.3861, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.17% (2.0665 => 2.2973, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/for-in: 11.15% (0.3694 => 0.4106, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.09% (0.3561 => 0.3956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 11.02% (1.2842 => 1.4257, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.01% (0.3516 => 0.3903, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/exceptions-2: 10.98% (0.3497 => 0.3881, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.95% (0.3935 => 0.4366, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: 10.88% (0.2877 => 0.3190, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.60% (0.2756 => 0.3048, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.50% (0.3162 => 0.3494, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.47% (0.3650 => 0.4032, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.46% (0.2725 => 0.3010, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.45% (0.2793 => 0.3085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 10.28% (0.2714 => 0.2993, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.27% (0.2891 => 0.3188, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 10.22% (63.2438 => 69.7061, std.dev.: 0.0676) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.20% (0.3136 => 0.3456, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wc: 10.19% (0.3052 => 0.3363, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.03% (0.2872 => 0.3160, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2802 => 0.3077, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.18% (2.2022 => 2.4044, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.10% (0.1330 => 0.1451, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 8.89% (0.7326 => 0.7977, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.69% (0.2266 => 0.2463, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.34% (0.4879 => 0.5286, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.28% (0.3177 => 0.3440, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/Hello: 8.15% (0.5925 => 0.6408, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: 7.76% (10.3673 => 11.1719, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.3131 => 0.3303, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.60% (7.9617 => 8.3282, std.dev.: 0.0105) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.62% (0.3817 => 0.3955, std.dev.: 0.0035) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4780, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.11% (1.1145 => 1.2940, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6958, std.dev.: 0.0011) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260) SingleSource/Benchmarks/Misc/richards_benchmark: 9.36% (1.1396 => 1.2463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1491, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.81% (11.6436 => 12.5533, std.dev.: 0.1733) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.32% (4.2280 => 4.4531, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1052, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (0.9957 => 1.0247, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.6802 => 8.9277, std.dev.: 0.0080) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.13% (3.6395 => 3.7172, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 2.07% (9.1159 => 9.3050, std.dev.: 0.0242) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2908, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3460 => 10.4496, std.dev.: 0.0116) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1477, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.65% (5.2763 => 1.1791, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -74.81% (0.8651 => 0.2179, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -41.80% (0.1622 => 0.0944, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.23% (5.3855 => 4.5117, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.60% (5.3526 => 4.5178, std.dev.: 0.0080) MultiSource/Applications/JM/ldecod/ldecod: -11.57% (10.4361 => 9.2285, std.dev.: 0.0099) SingleSource/UnitTests/Vector/constpool: -7.52% (54.1659 => 50.0922, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.84% (1.7609 => 1.6404, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.82% (1.9577 => 0.6692, std.dev.: 0.0073) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0499 => 5.3094, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.72% (1.5373 => 1.0189, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4369, std.dev.: 0.0087) MultiSource/Benchmarks/PAQ8p/paq8p: -24.84% (85.0658 => 63.9326, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.42% (2.6546 => 2.0063, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0005) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4245, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7321, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.87% (0.9540 => 0.8408, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4921, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.79% (19.9488 => 18.5933, std.dev.: 0.0310) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) SingleSource/Benchmarks/McGill/chomp: -5.82% (1.2373 => 1.1653, std.dev.: 0.0006) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5870, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7029, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5784, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7996, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0044) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.69% (3.7221 => 3.6592, std.dev.: 0.0091) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: -1.62% (3.6994 => 3.6396, std.dev.: 0.0042) MultiSource/Applications/sqlite3/sqlite3: -1.32% (4.6441 => 4.5828, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8593, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.06% (0.2116 => 0.0697, std.dev.: 0.0012) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 14:54:29 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 16:54:29 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130129225429.7C69F2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8087?compare_to=8076&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8087, Order: 173810, Start Time: 2013-01-29 19:19:15, End Time: 2013-01-29 22:54:41 To: 8076, Order: 173788, Start Time: 2013-01-29 11:21:51, End Time: 2013-01-29 15:01:45 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 3 (186 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (751 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.68% (0.8376 => 0.8517, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: 1.29% (1.1592 => 1.1742, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 2.78% (13.2691 => 13.6379, std.dev.: 0.0773) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.08% (0.0625 => 0.0938, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.16% (0.1063 => 0.1458, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 30.74% (0.0475 => 0.0621, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.84% (0.1106 => 0.1436, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.97% (0.2969 => 0.3829, std.dev.: 0.0162) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.34% (0.0547 => 0.0702, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.98% (0.5900 => 0.7551, std.dev.: 0.0129) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 27.74% (0.0822 => 0.1050, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.66% (0.4139 => 0.5284, std.dev.: 0.0055) MultiSource/Applications/oggenc/oggenc: 27.64% (1.5932 => 2.0336, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.19% (0.4994 => 0.6352, std.dev.: 0.0165) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.03% (0.0714 => 0.0907, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.42% (0.1620 => 0.2048, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.96% (0.4253 => 0.5357, std.dev.: 0.0023) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.68% (0.0584 => 0.0734, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.64% (0.5000 => 0.6282, std.dev.: 0.0174) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.56% (0.1107 => 0.1390, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.63% (0.1003 => 0.1240, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 23.52% (0.0948 => 0.1171, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.0642 => 0.0793, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.43% (0.0572 => 0.0706, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.18% (0.1549 => 0.1908, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.13% (0.1604 => 0.1975, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.12% (0.1103 => 0.1358, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.67% (0.1619 => 0.1986, std.dev.: 0.0033) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.55% (0.3903 => 0.4783, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.54% (0.2866 => 0.3512, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 22.53% (0.0821 => 0.1006, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.35% (0.0452 => 0.0553, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 21.75% (0.0947 => 0.1153, std.dev.: 0.0048) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.69% (0.1088 => 0.1324, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.60% (0.2736 => 0.3327, std.dev.: 0.0050) MultiSource/Benchmarks/McCat/08-main/main: 21.43% (0.1218 => 0.1479, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 21.42% (0.4029 => 0.4892, std.dev.: 0.0170) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.29% (0.3890 => 0.4718, std.dev.: 0.0128) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.17% (1.3152 => 1.5936, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.14% (0.1462 => 0.1771, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0023) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.75% (0.2014 => 0.2432, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.63% (0.0698 => 0.0842, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 20.33% (0.1505 => 0.1811, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.16% (0.4658 => 0.5597, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 19.86% (1.8794 => 2.2526, std.dev.: 0.0181) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.75% (0.3271 => 0.3917, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/Hello: 19.69% (0.5826 => 0.6973, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.56% (0.5026 => 0.6009, std.dev.: 0.0077) MultiSource/Applications/Burg/burg: 19.47% (0.5546 => 0.6626, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.27% (0.2875 => 0.3429, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: 19.21% (0.5889 => 0.7020, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.95% (3.5627 => 4.2380, std.dev.: 0.0891) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.91% (0.2792 => 0.3320, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.89% (1.6211 => 1.9273, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.87% (0.2729 => 0.3244, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 18.85% (0.1284 => 0.1526, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/strcat: 18.80% (0.2750 => 0.3267, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/objinst: 18.77% (0.2823 => 0.3353, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 18.77% (0.7171 => 0.8517, std.dev.: 0.0014) MultiSource/Applications/hbd/hbd: 18.75% (0.9697 => 1.1515, std.dev.: 0.0132) SingleSource/Benchmarks/Shootout-C++/methcall: 18.66% (0.2813 => 0.3338, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 18.64% (0.2811 => 0.3335, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.60% (0.1968 => 0.2334, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/fibo: 18.57% (0.2725 => 0.3231, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 18.52% (0.2803 => 0.3322, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 18.50% (0.9909 => 1.1742, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hello: 18.50% (0.2714 => 0.3216, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.44% (0.2738 => 0.3243, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/matrix: 18.42% (0.2780 => 0.3292, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.34% (0.2911 => 0.3445, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.34% (2.0673 => 2.4464, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.31% (0.3195 => 0.3780, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 18.13% (1.0781 => 1.2736, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/18-imp/imp: 18.09% (0.1421 => 0.1678, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.07% (0.3930 => 0.4640, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 18.03% (0.3317 => 0.3915, std.dev.: 0.0008) SingleSource/Regression/C++/ofstream_ctor: 18.01% (0.3004 => 0.3545, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 17.99% (0.3096 => 0.3653, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 17.91% (0.3267 => 0.3852, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 17.89% (0.3258 => 0.3841, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.86% (1.9694 => 2.3211, std.dev.: 0.0487) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.77% (0.4361 => 0.5136, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.65% (0.3060 => 0.3600, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.60% (0.3625 => 0.4263, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.52% (0.3362 => 0.3951, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 17.50% (0.3726 => 0.4378, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 17.45% (4.2109 => 4.9458, std.dev.: 0.0946) MultiSource/Benchmarks/Bullet/bullet: 17.44% (23.5202 => 27.6225, std.dev.: 0.0156) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.41% (0.3124 => 0.3668, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 17.32% (0.3348 => 0.3928, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 17.11% (0.3477 => 0.4072, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.03% (1.9966 => 2.3367, std.dev.: 0.0473) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.00% (0.3282 => 0.3840, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 16.94% (0.3678 => 0.4301, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/hash2: 16.91% (0.4251 => 0.4970, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 16.81% (1.4269 => 1.6668, std.dev.: 0.0105) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.78% (2.7292 => 3.1871, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash: 16.71% (0.4146 => 0.4839, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.65% (0.3981 => 0.4644, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.53% (0.3690 => 0.4300, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.45% (0.2566 => 0.2988, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.33% (0.1090 => 0.1268, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.29% (4.4195 => 5.1396, std.dev.: 0.0478) MultiSource/Applications/treecc/treecc: 16.23% (0.7875 => 0.9153, std.dev.: 0.0142) SingleSource/Benchmarks/Misc-C++/bigfib: 16.00% (0.5012 => 0.5814, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.81% (0.3845 => 0.4453, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.60% (0.0673 => 0.0778, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.42% (0.3488 => 0.4026, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 15.42% (0.2691 => 0.3106, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/exceptions-2: 15.35% (0.3446 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 15.31% (0.3469 => 0.4000, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.28% (0.6435 => 0.7418, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-4: 15.27% (0.3465 => 0.3994, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 15.25% (5.5417 => 6.3870, std.dev.: 0.0478) SingleSource/UnitTests/ObjC/trivial-interface: 15.25% (0.3442 => 0.3967, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: 15.23% (0.3460 => 0.3987, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/for-in: 15.22% (0.3496 => 0.4028, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/football/football: 15.08% (0.2075 => 0.2388, std.dev.: 0.0024) MultiSource/Applications/lambda-0_1_3/lambda: 15.01% (0.3498 => 0.4023, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 14.99% (0.3650 => 0.4197, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 14.80% (0.3724 => 0.4275, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 14.80% (0.3643 => 0.4182, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.49% (0.1028 => 0.1177, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.42% (2.1653 => 2.4776, std.dev.: 0.0440) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.40% (0.2737 => 0.3131, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.25% (0.5361 => 0.6125, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.95% (2.1013 => 2.3944, std.dev.: 0.0029) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.93% (0.2068 => 0.2356, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.85% (0.0758 => 0.0863, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 13.77% (4.6177 => 5.2534, std.dev.: 0.0624) MultiSource/Applications/siod/siod: 13.61% (0.6634 => 0.7537, std.dev.: 0.0122) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.56% (0.0804 => 0.0913, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.42% (0.3084 => 0.3498, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.02% (0.1383 => 0.1563, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.00% (11.6398 => 13.1524, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.84% (0.2040 => 0.2302, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.60% (0.2103 => 0.2368, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 12.56% (0.3336 => 0.3755, std.dev.: 0.0052) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.08% (0.7426 => 0.8323, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 12.03% (0.4847 => 0.5430, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.14% (4.6926 => 5.2155, std.dev.: 0.0106) MultiSource/Applications/lemon/lemon: 10.41% (0.2391 => 0.2640, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.40% (2.0346 => 2.2463, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.97% (0.5584 => 0.6085, std.dev.: 0.0002) MultiSource/Applications/kimwitu++/kc: 8.78% (11.9555 => 13.0054, std.dev.: 0.0118) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.85% (0.3792 => 0.4014, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5103, std.dev.: 0.0125) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0316) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.25% (0.5917 => 0.6701, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.88% (0.3693 => 0.4058, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 9.81% (0.2802 => 0.3077, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6110, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6773, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2420, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6945, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-2: 4.66% (1.8057 => 1.8898, std.dev.: 0.0045) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.04% (3.3991 => 3.5026, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 2.77% (0.6276 => 0.6450, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1990, std.dev.: 0.0072) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3087, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2887, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0822, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.16% (3.1722 => 3.2089, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4821, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5820, std.dev.: 0.0203) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.85% (25.4195 => 16.5620, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.45% (17.2379 => 14.2307, std.dev.: 0.0715) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -10.66% (0.2402 => 0.2146, std.dev.: 0.0038) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9776, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/salsa20: -7.62% (35.5013 => 32.7954, std.dev.: 0.0058) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9584, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2192, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2419, std.dev.: 0.0012) SingleSource/UnitTests/Vector/build2: -3.66% (11.2080 => 10.7983, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7745, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -2.92% (14.0481 => 13.6379, std.dev.: 0.0773) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.16% (197.4719 => 193.2050, std.dev.: 0.0315) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5749, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (105.3826 => 104.1978, std.dev.: 0.0713) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0434, std.dev.: 0.0017) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 16:00:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 18:00:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130000036.9999A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8088?compare_to=8084&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8088, Order: 173833, Start Time: 2013-01-29 21:53:31, End Time: 2013-01-30 00:00:59 To: 8084, Order: 173816, Start Time: 2013-01-29 19:24:40, End Time: 2013-01-29 21:32:34 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (90 on baseline) Performance Improvements: 9 (49 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (924 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/2002-10-12-StructureArgs: 70.70% (0.0157 => 0.0268, std.dev.: 0.0011) SingleSource/UnitTests/byval-alignment: 65.70% (0.0172 => 0.0285, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.25% (4.1706 => 4.5562, std.dev.: 0.1191) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 42.23% (8.6801 => 12.3456, std.dev.: 1.0169) SingleSource/Benchmarks/Misc-C++/stepanov_container: 31.10% (4.4948 => 5.8928, std.dev.: 0.1442) SingleSource/Benchmarks/CoyoteBench/fftbench: 27.02% (1.4765 => 1.8755, std.dev.: 0.0749) SingleSource/Benchmarks/Shootout/hash: 6.85% (4.0673 => 4.3461, std.dev.: 0.0474) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.12% (22.4733 => 23.3994, std.dev.: 0.2471) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.37% (4.1124 => 4.1689, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout/lists: 1.23% (7.3374 => 7.4274, std.dev.: 0.0342) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -41.76% (0.0850 => 0.0495, std.dev.: 0.0124) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.13% (8.3978 => 7.2112, std.dev.: 0.4060) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.21% (1.4813 => 1.3300, std.dev.: 0.0457) MultiSource/Benchmarks/McCat/08-main/main: -7.57% (0.3172 => 0.2932, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/09-vor/vor: -6.07% (0.3726 => 0.3500, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.38% (0.2693 => 0.2575, std.dev.: 0.0020) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/MallocBench/gs/gs: -39.86% (0.1435 => 0.0863, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/distray/distray: -4.22% (0.2514 => 0.2408, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.35% (14.1908 => 13.7161, std.dev.: 0.1829) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.38% (1.2313 => 1.2360, std.dev.: 0.0233) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 11.31% (0.0221 => 0.0246, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.70% (0.0433 => 0.0462, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 7.74% (0.0336 => 0.0362, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.92% (0.0321 => 0.0340, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 25.75% (0.0431 => 0.0542, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/casts: 11.11% (0.0207 => 0.0230, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: 6.82% (0.0220 => 0.0235, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 7.46% (0.0228 => 0.0245, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -35.71% (0.0014 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -1.00% (0.1495 => 0.1480, std.dev.: 0.0259) MultiSource/Applications/lemon/lemon: -1.72% (1.1822 => 1.1619, std.dev.: 0.3446) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.04% (0.4223 => 0.4010, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.32% (0.1550 => 0.1545, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.56% (0.0680 => 0.0615, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.73% (0.0275 => 0.0277, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.63% (0.0570 => 0.0555, std.dev.: 0.0122) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.10% (1.2852 => 1.2839, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.45% (0.0031 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -31.58% (0.0038 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.40% (0.0588 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0350 => 0.0350, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.53% (1.7525 => 1.7618, std.dev.: 0.0079) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -51.35% (0.0074 => 0.0036, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.41% (34.0283 => 33.5496, std.dev.: 0.4774) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.00% (0.0336 => 0.1680, std.dev.: 0.0072) SingleSource/Regression/C/sumarraymalloc: 117.06% (0.0293 => 0.0636, std.dev.: 0.0069) SingleSource/Regression/C/sumarray2d: 92.70% (0.0274 => 0.0528, std.dev.: 0.0007) SingleSource/UnitTests/byval-alignment: 61.02% (0.0177 => 0.0285, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 60.99% (0.1638 => 0.2637, std.dev.: 0.0010) SingleSource/Regression/C/sumarray: 59.62% (0.0265 => 0.0423, std.dev.: 0.0015) SingleSource/UnitTests/2002-10-12-StructureArgs: 59.52% (0.0168 => 0.0268, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.34% (0.8893 => 1.2658, std.dev.: 0.1407) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.75% (0.8926 => 1.2653, std.dev.: 0.1003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.70% (0.9612 => 1.3620, std.dev.: 0.0540) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.52% (0.9120 => 1.2907, std.dev.: 0.1246) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.28% (0.9061 => 1.2801, std.dev.: 0.0408) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.12% (0.9564 => 1.3401, std.dev.: 0.0461) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 40.05% (0.9403 => 1.3169, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.00% (0.9381 => 1.3133, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.91% (0.9588 => 1.3415, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.12% (0.8990 => 1.2507, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.66% (0.9091 => 1.2606, std.dev.: 0.0947) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.65% (0.9855 => 1.3664, std.dev.: 0.0911) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.44% (0.9998 => 1.3841, std.dev.: 0.1296) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.82% (0.9422 => 1.2985, std.dev.: 0.0739) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 37.77% (1.0052 => 1.3849, std.dev.: 0.0741) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.67% (0.9512 => 1.3095, std.dev.: 0.0204) SingleSource/Benchmarks/McGill/exptree: 36.67% (0.0859 => 0.1174, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.97% (0.8912 => 1.2118, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.97% (0.8736 => 1.1878, std.dev.: 0.0841) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.31% (1.0867 => 1.4704, std.dev.: 0.0874) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.08% (0.8732 => 1.1795, std.dev.: 0.0948) SingleSource/Benchmarks/Stanford/IntMM: 34.80% (0.0431 => 0.0581, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.55% (0.8846 => 1.1902, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.14% (0.9867 => 1.3137, std.dev.: 0.0792) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.10% (0.9507 => 1.2654, std.dev.: 0.0607) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.05% (1.0088 => 1.3422, std.dev.: 0.1056) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.77% (1.0017 => 1.3300, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.86% (0.9488 => 1.2511, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.84% (0.9685 => 1.2769, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.49% (0.9127 => 1.1910, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.92% (0.9405 => 1.2219, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.75% (0.9993 => 1.2966, std.dev.: 0.0978) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 25.53% (3.6295 => 4.5562, std.dev.: 0.1191) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 25.47% (0.0738 => 0.0926, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 23.17% (0.0492 => 0.0606, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 22.59% (0.0642 => 0.0787, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.25% (0.0963 => 0.1158, std.dev.: 0.0070) MultiSource/Benchmarks/mafft/pairlocalalign: 14.39% (9.5202 => 10.8903, std.dev.: 0.1841) MultiSource/Benchmarks/McCat/04-bisect/bisect: 14.34% (0.1332 => 0.1523, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.30% (1.0986 => 1.2557, std.dev.: 0.0582) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.61% (2.4519 => 2.7365, std.dev.: 0.0507) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.02% (0.2577 => 0.2861, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.95% (1.8127 => 1.9931, std.dev.: 0.0623) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.82% (0.5369 => 0.5896, std.dev.: 0.0105) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.90% (0.1955 => 0.2129, std.dev.: 0.0039) SingleSource/Regression/C++/ofstream_ctor: 8.72% (0.2042 => 0.2220, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.92% (23.5861 => 25.4543, std.dev.: 0.6599) MultiSource/Benchmarks/7zip/7zip-benchmark: 5.97% (44.1538 => 46.7892, std.dev.: 0.9688) MultiSource/Benchmarks/Bullet/bullet: 5.53% (33.2440 => 35.0815, std.dev.: 0.6370) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106712.50% (0.0008 => 0.8545, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout/ary3: 453.52% (2.2304 => 12.3456, std.dev.: 1.0169) SingleSource/Benchmarks/Shootout/matrix: 355.91% (1.5825 => 7.2147, std.dev.: 0.0228) MultiSource/Applications/sgefa/sgefa: 257.01% (0.3515 => 1.2549, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.01% (1.1825 => 4.0324, std.dev.: 0.0197) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.09% (4.8185 => 15.8570, std.dev.: 0.1234) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 187.28% (0.0228 => 0.0655, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/ary2: 182.95% (0.0129 => 0.0365, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout-C++/ary: 126.72% (0.0232 => 0.0526, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 65.35% (2.9083 => 4.8089, std.dev.: 0.0556) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.54% (0.2562 => 0.3447, std.dev.: 0.0336) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 33.39% (3.1254 => 4.1689, std.dev.: 0.0134) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.66% (1.4588 => 1.8477, std.dev.: 0.0431) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.31% (5.6033 => 6.9092, std.dev.: 0.1161) SingleSource/Benchmarks/Misc/salsa20: 22.05% (7.4497 => 9.0923, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.58% (4.8112 => 5.8014, std.dev.: 0.0981) SingleSource/Benchmarks/Misc-C++/stepanov_container: 16.87% (5.0421 => 5.8928, std.dev.: 0.1442) SingleSource/Regression/C/uint64_to_float: 14.86% (1.5397 => 1.7685, std.dev.: 0.0713) MultiSource/Applications/JM/lencod/lencod: 14.18% (6.8159 => 7.7822, std.dev.: 0.3647) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.94% (5.1752 => 5.8968, std.dev.: 0.0523) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.34% (1.6547 => 1.8755, std.dev.: 0.0749) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.08% (5.0033 => 5.6577, std.dev.: 0.0084) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (3.6477 => 3.9743, std.dev.: 0.0306) SingleSource/Benchmarks/Misc/ReedSolomon: 8.31% (8.6447 => 9.3635, std.dev.: 0.1157) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.94% (4.7473 => 5.0769, std.dev.: 0.0947) SingleSource/Benchmarks/McGill/chomp: 6.70% (1.0425 => 1.1123, std.dev.: 0.0099) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.34% (4.1836 => 4.4070, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.39% (5.0310 => 5.2520, std.dev.: 0.0307) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 4.31% (2.4753 => 2.5820, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.15% (4.7254 => 4.8744, std.dev.: 0.0375) SingleSource/Benchmarks/Linpack/linpack-pc: 3.06% (50.8945 => 52.4506, std.dev.: 0.1118) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.56% (2.5681 => 2.6081, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/lists: 1.45% (7.3215 => 7.4274, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.04% (5.9115 => 5.9729, std.dev.: 0.0210) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -33.15% (0.0727 => 0.0486, std.dev.: 0.0025) MultiSource/Benchmarks/BitBench/drop3/drop3: -26.88% (0.0692 => 0.0506, std.dev.: 0.0008) MultiSource/Applications/hbd/hbd: -17.93% (1.8964 => 1.5564, std.dev.: 0.0811) MultiSource/Applications/hexxagon/hexxagon: -9.92% (1.1433 => 1.0299, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.74% (0.1058 => 0.0955, std.dev.: 0.0026) MultiSource/Applications/treecc/treecc: -8.88% (2.4719 => 2.2524, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.64% (11.5523 => 3.9689, std.dev.: 0.0514) SingleSource/Benchmarks/Misc/fp-convert: -61.45% (15.6525 => 6.0341, std.dev.: 0.1590) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.62% (0.4146 => 0.1840, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.38% (0.4578 => 0.2363, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.93% (11.3868 => 6.3843, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.75% (5.4023 => 3.6328, std.dev.: 0.0574) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.53% (0.4452 => 0.3093, std.dev.: 0.0105) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.59% (0.5495 => 0.4034, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.01% (5.2605 => 3.8920, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -25.06% (0.5897 => 0.4419, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.06% (4.4467 => 3.3322, std.dev.: 0.0282) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.17% (0.5826 => 0.4418, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.25% (4.9921 => 3.8313, std.dev.: 0.0954) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.50% (5.8755 => 4.7885, std.dev.: 0.0590) MultiSource/Benchmarks/Fhourstones/fhourstones: -17.85% (1.5623 => 1.2835, std.dev.: 0.0623) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.76% (16.6791 => 13.7161, std.dev.: 0.1829) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.88% (7.0016 => 5.8897, std.dev.: 0.1107) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.23% (0.1164 => 0.1010, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.10% (3.1921 => 2.7738, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.90% (9.7992 => 8.5348, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.54% (5.3626 => 4.6902, std.dev.: 0.0553) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.40% (5.7056 => 4.9979, std.dev.: 0.0249) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.80% (1.4235 => 1.2697, std.dev.: 0.0180) MultiSource/Applications/SIBsim4/SIBsim4: -7.08% (3.5443 => 3.2932, std.dev.: 0.0813) MultiSource/Benchmarks/BitBench/drop3/drop3: -6.96% (0.3217 => 0.2993, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.60% (4.2843 => 4.0015, std.dev.: 0.0879) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.40% (5.5974 => 5.2394, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.90% (4.5424 => 4.2744, std.dev.: 0.0522) SingleSource/Benchmarks/McGill/queens: -5.76% (1.7443 => 1.6439, std.dev.: 0.0288) MultiSource/Benchmarks/mafft/pairlocalalign: -5.47% (63.1520 => 59.6959, std.dev.: 0.0620) SingleSource/Benchmarks/Shootout-C++/hash2: -4.65% (3.6768 => 3.5057, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.40% (4.9799 => 4.7608, std.dev.: 0.0569) MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.14% (0.3406 => 0.3265, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/hash: -3.97% (4.5259 => 4.3461, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.56% (3.5691 => 3.4422, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.47% (5.8973 => 5.6928, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.32% (40.4729 => 39.1280, std.dev.: 0.4308) SingleSource/Benchmarks/Shootout-C++/lists: -2.68% (17.2182 => 16.7569, std.dev.: 0.0762) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.72% (8.7327 => 8.5824, std.dev.: 0.0062) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.71% (85.3042 => 83.8454, std.dev.: 0.0815) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.33% (8.8249 => 8.7075, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.23% (3.7450 => 3.6988, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/whetstone: -1.19% (1.6251 => 1.6058, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.60% (1.2047 => 1.2360, std.dev.: 0.0233) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 5.58% (0.0233 => 0.0246, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.44% (0.0451 => 0.0462, std.dev.: 0.0134) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.12% (0.0394 => 0.0362, std.dev.: 0.0050) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.66% (0.0328 => 0.0340, std.dev.: 0.0080) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 21.80% (0.0445 => 0.0542, std.dev.: 0.0082) SingleSource/UnitTests/Vector/Altivec/casts: 7.98% (0.0213 => 0.0230, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/test1: 3.52% (0.0227 => 0.0235, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.92% (0.0255 => 0.0245, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -3.27% (0.1530 => 0.1480, std.dev.: 0.0259) MultiSource/Applications/lemon/lemon: -39.78% (1.9293 => 1.1619, std.dev.: 0.3446) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.96% (0.4049 => 0.4010, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.32% (0.1510 => 0.1545, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.12% (0.0978 => 0.0615, std.dev.: 0.0102) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.93% (0.0590 => 0.0555, std.dev.: 0.0122) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.52% (1.1617 => 1.2839, std.dev.: 0.0071) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.60% (0.0268 => 0.0350, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.90% (0.7437 => 1.7618, std.dev.: 0.0079) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.87% (0.0092 => 0.0036, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 162.56% (12.7781 => 33.5496, std.dev.: 0.4774) Report Time: 1.11s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 16:02:15 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 18:02:15 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130000215.BB74A19BE008@llvm.org> http://llvm.org/perf/db_default/v4/nts/8089?compare_to=8085&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8089, Order: 173837, Start Time: 2013-01-29 22:27:49, End Time: 2013-01-30 00:02:26 To: 8085, Order: 173821, Start Time: 2013-01-29 20:29:50, End Time: 2013-01-29 22:04:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (126 on baseline) Performance Improvements: 0 (85 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 5.19% (0.4294 => 0.4517, std.dev.: 0.0083) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.16% (0.6656 => 0.6933, std.dev.: 0.0069) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 87.50% (0.0280 => 0.0525, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.79% (0.0974 => 0.1644, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 50.56% (0.0267 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.58% (0.1132 => 0.1614, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.23% (0.6395 => 0.8840, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.79% (0.6395 => 0.8748, std.dev.: 0.0019) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.98% (0.5688 => 0.7564, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.97% (0.5805 => 0.7719, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.94% (0.6260 => 0.8322, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.77% (0.5456 => 0.7244, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.30% (0.5849 => 0.7738, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.29% (0.5575 => 0.7375, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.23% (0.5567 => 0.7361, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.18% (0.5581 => 0.7377, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.13% (0.6230 => 0.8232, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.35% (0.5802 => 0.7621, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.24% (0.5941 => 0.7797, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.04% (0.5705 => 0.7476, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.56% (0.5857 => 0.7647, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.50% (0.5478 => 0.7149, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.45% (0.5569 => 0.7265, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.43% (0.5859 => 0.7642, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.34% (0.5570 => 0.7260, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.31% (1.6474 => 2.1468, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.23% (0.6033 => 0.7857, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.01% (0.5591 => 0.7269, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.72% (0.6440 => 0.8354, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.47% (0.5925 => 0.7671, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.28% (0.6189 => 0.8001, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.91% (0.6676 => 0.8606, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.84% (0.5863 => 0.7554, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.69% (0.0582 => 0.0749, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.62% (0.6304 => 0.8108, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.34% (0.6446 => 0.8273, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.30% (0.6052 => 0.7765, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.04% (0.0699 => 0.0895, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.58% (0.6194 => 0.7902, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.39% (0.6681 => 0.8511, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.34% (0.6660 => 0.8481, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.90% (0.6297 => 0.7991, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.78% (0.6667 => 0.8386, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.31% (0.7524 => 0.9353, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.56% (0.7339 => 0.9068, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.13% (2.2587 => 2.7811, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 22.71% (0.0621 => 0.0762, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.22% (0.0693 => 0.0847, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.19% (0.0622 => 0.0760, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.24% (0.0634 => 0.0756) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.06% (0.0556 => 0.0662, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.55% (0.0566 => 0.0671, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.89% (0.0833 => 0.0982, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/BoolLiteralTest: 17.81% (0.3834 => 0.4517, std.dev.: 0.0083) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.36% (0.1146 => 0.1345, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.56% (0.3357 => 0.3913, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.03% (0.0680 => 0.0789, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 15.68% (1.1450 => 1.3245, std.dev.: 0.0033) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.36% (0.1081 => 0.1247, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 14.70% (0.0864 => 0.0991, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.36% (0.0731 => 0.0836, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.82% (0.1230 => 0.1400, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.57% (0.1982 => 0.2251, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.00% (4.5069 => 5.0930, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.88% (0.4916 => 0.5549, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.6364 => 1.8413, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.29% (3.5339 => 3.9682, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 12.09% (0.4515 => 0.5061, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.03% (0.2385 => 0.2648, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.31% (9.2283 => 10.1796, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.23% (0.1731 => 0.1908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 9.77% (0.4524 => 0.4966, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.35% (0.5329 => 0.5827, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 9.34% (1.2515 => 1.3684, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.03% (0.7021 => 0.7655, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 8.74% (0.4861 => 0.5286, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.60% (0.2001 => 0.2173, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.06% (1.2784 => 1.3814, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.82% (1.4642 => 1.5787, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 7.29% (0.6750 => 0.7242, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/ReedSolomon: 7.03% (0.1879 => 0.2011, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.3255 => 0.3474, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/chomp: 6.70% (0.1761 => 0.1879, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.17% (5.4682 => 5.8056, std.dev.: 0.0038) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.78% (0.3319 => 0.3511, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.83% (22.4056 => 23.4874, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary3: 4.09% (0.3446 => 0.3587, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 3.95% (0.3394 => 0.3528) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.92% (0.3491 => 0.3628, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.87% (0.9557 => 0.9927, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.76% (0.7447 => 0.7727, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.65% (15.5079 => 16.0732, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.64% (0.4427 => 0.4588, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 3.64% (0.8418 => 0.8724, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.62% (5.0226 => 5.2046, std.dev.: 0.0093) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.3864 => 1.4331, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.92% (0.5168 => 0.5319, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.3722 => 1.4042, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.16% (18.2933 => 18.6884, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.75% (0.6293 => 0.6403, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.48% (1.2300 => 1.2482, std.dev.: 0.0023) MultiSource/Applications/d/make_dparser: 1.46% (3.5154 => 3.5666, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: 1.30% (34.0927 => 34.5375, std.dev.: 0.0397) MultiSource/Applications/treecc/treecc: 1.29% (2.1401 => 2.1678, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.08% (4.8161 => 4.8682, std.dev.: 0.0082) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8190, std.dev.: 0.0061) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0071) SingleSource/Regression/C/uint64_to_float: 7.45% (0.5692 => 0.6116, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (54.5751 => 56.3625, std.dev.: 0.1689) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.72% (18.2231 => 18.5358, std.dev.: 0.0109) MultiSource/Applications/sqlite3/sqlite3: 1.65% (4.5320 => 4.6067, std.dev.: 0.0250) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2501, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.79% (0.1281 => 0.1130, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.61% (0.7198 => 0.6866, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -3.82% (0.3194 => 0.3072, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.74% (0.3821 => 0.3678, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4003, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: -3.25% (0.3812 => 0.3688, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/exceptions-2: -3.24% (0.3831 => 0.3707, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3848 => 0.3725, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.18% (0.3896 => 0.3772, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.14% (0.3880 => 0.3758, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.12% (0.4033 => 0.3907, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.06% (0.3891 => 0.3772, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.05% (0.9852 => 0.9552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -2.92% (0.4176 => 0.4054, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.69% (0.9542 => 0.9285, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.63% (0.3884 => 0.3782, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2848, std.dev.: 0.0490) SingleSource/UnitTests/ObjC++/Hello: -2.21% (0.6347 => 0.6207, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.19% (0.6484 => 0.6342, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/property-reference-object: -1.77% (0.6441 => 0.6327, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: -1.76% (1.3148 => 1.2917, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.74% (2.1713 => 2.1336, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.71% (14.2083 => 13.9647, std.dev.: 0.0114) SingleSource/UnitTests/ObjC++/property-reference: -1.38% (0.7779 => 0.7672, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.70% (1.8100 => 0.6933, std.dev.: 0.0069) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.97% (1.3643 => 1.0236, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7527, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0744, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2048, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1737, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1281, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3570, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -8.96% (1.2842 => 1.1691, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: -4.05% (2.2633 => 2.1717, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4006, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0245, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2761, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.60% (7.9763 => 7.7689, std.dev.: 0.0169) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.93% (1.3096 => 1.2843, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.7241 => 3.6527, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1752, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.62% (2.7523 => 2.7078, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.56% (1.6307 => 1.6052, std.dev.: 0.0062) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4710, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7092 => 3.6638, std.dev.: 0.0069) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.04% (1.6219 => 1.6050, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 17:05:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 19:05:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130010556.30B022A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8090?compare_to=8086&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8090, Order: 173839, Start Time: 2013-01-29 22:53:46, End Time: 2013-01-30 01:06:02 To: 8086, Order: 173816, Start Time: 2013-01-29 20:10:40, End Time: 2013-01-29 22:22:58 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (228 on baseline) Performance Improvements: 1 (67 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (642 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.20% (80.0821 => 81.8472, std.dev.: 0.2497) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.13% (2.2973 => 2.2713, std.dev.: 0.0028) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1332 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.30% (0.0697 => 0.0681, std.dev.: 0.0023) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8519 => 499.8611, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44225.72% (1.1277 => 499.8611, std.dev.: 0.0091) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.49% (0.5229 => 1.7072, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 25.62% (14.9895 => 18.8291, std.dev.: 0.0142) MultiSource/Applications/kimwitu++/kc: 46.95% (14.1553 => 20.8010, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/gs/gs: 20.66% (4.1105 => 4.9599, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.19% (1.1048 => 1.7808, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 446.94% (7.1582 => 39.1513, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.99% (3.4629 => 6.5790, std.dev.: 0.0063) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.35% (0.6222 => 1.1346, std.dev.: 0.0003) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10236.94% (0.0720 => 7.4426, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11104400.00% (0.0001 => 11.1045, std.dev.: 0.0276) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/gs/gs: 66100.00% (0.0001 => 0.0662, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849400.00% (0.0001 => 9.8495, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5496200.00% (0.0001 => 5.4963, std.dev.: 0.0104) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 832.60% (1.1194 => 10.4395, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 151.81% (22.1758 => 55.8419, std.dev.: 0.0279) SingleSource/Benchmarks/Misc/lowercase: 131.25% (0.0256 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.69% (0.0929 => 0.1883, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 79.84% (0.1463 => 0.2631, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 67.40% (0.0730 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 65.74% (0.0394 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.02% (2.9384 => 4.6140, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.46% (1.5859 => 2.4813, std.dev.: 0.0006) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.17% (7.0540 => 10.9459, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/distray/distray: 53.50% (0.1056 => 0.1621, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.90% (8.1363 => 12.1966, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.20% (0.0439 => 0.0655, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 45.98% (2.2024 => 3.2151, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 45.22% (0.3109 => 0.4515, std.dev.: 0.0013) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.49% (0.1062 => 0.1492, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.10% (21.9371 => 30.7348, std.dev.: 0.0085) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 37.79% (1.5415 => 2.1241, std.dev.: 0.0080) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.32% (4.2646 => 5.8560, std.dev.: 0.0070) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.16% (0.4615 => 0.6284, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 36.00% (0.0814 => 0.1107, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.51% (0.5105 => 0.6918, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.96% (0.2271 => 0.3065, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.72% (0.1892 => 0.2530, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.61% (0.0479 => 0.0640, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 33.52% (0.4299 => 0.5740, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.47% (0.6675 => 0.8909, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 32.94% (1.1642 => 1.5477, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.60% (0.0457 => 0.0606, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 31.76% (0.0636 => 0.0838) SingleSource/Benchmarks/McGill/chomp: 31.66% (0.1655 => 0.2179, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.32% (0.1143 => 0.1501, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.02% (0.1125 => 0.1474, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 30.55% (0.0730 => 0.0953, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.32% (0.1695 => 0.2209, std.dev.: 0.0017) MultiSource/Benchmarks/mafft/pairlocalalign: 30.31% (9.4845 => 12.3595, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.06% (3.8922 => 5.0622, std.dev.: 0.0095) MultiSource/Applications/viterbi/viterbi: 29.32% (0.1555 => 0.2011, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.26% (0.0793 => 0.1025, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 28.90% (0.2554 => 0.3292, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.55% (0.0746 => 0.0959, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 28.28% (1.0722 => 1.3754, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.08% (1.4186 => 1.8169, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 28.03% (0.4289 => 0.5491, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0010) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.17% (0.3121 => 0.3969, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash2: 26.73% (0.4620 => 0.5855, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.71% (0.1906 => 0.2415, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.70% (0.1337 => 0.1694, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: 26.55% (0.1175 => 0.1487, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 26.55% (0.7115 => 0.9004, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.25% (0.1566 => 0.1977, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.04% (0.0672 => 0.0847, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.68% (0.5020 => 0.6309, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 25.57% (0.6456 => 0.8107, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: 25.45% (0.0660 => 0.0828, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.30% (0.0842 => 0.1055, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 25.11% (0.1151 => 0.1440, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 24.95% (0.0485 => 0.0606, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 24.94% (0.1163 => 0.1453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.92% (0.1236 => 0.1544, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 24.82% (0.7835 => 0.9780, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/15-trie/trie: 24.67% (0.0527 => 0.0657, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.52% (1.3050 => 1.6250, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.48% (0.2700 => 0.3361, std.dev.: 0.0072) MultiSource/Benchmarks/llubenchmark/llu: 24.46% (0.0462 => 0.0575) SingleSource/Benchmarks/Shootout/lists: 24.44% (0.0626 => 0.0779, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.27% (0.0886 => 0.1101, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.0871 => 0.1080, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (0.1032 => 0.1279, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.85% (0.0675 => 0.0836, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.71% (0.1029 => 0.1273, std.dev.: 0.0037) MultiSource/Benchmarks/nbench/nbench: 23.67% (1.1840 => 1.4642, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 23.43% (5.7591 => 7.1082, std.dev.: 0.0084) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.29% (0.0953 => 0.1175, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/messages-2: 23.26% (0.0662 => 0.0816, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 23.17% (3.3354 => 4.1082, std.dev.: 0.0169) MultiSource/Benchmarks/Olden/em3d/em3d: 23.01% (0.1695 => 0.2085, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.78% (0.1940 => 0.2382, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.73% (0.0770 => 0.0945, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.68% (0.3307 => 0.4057, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.65% (0.5860 => 0.7187, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.52% (0.2758 => 0.3379, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.22% (0.8172 => 0.9988, std.dev.: 0.0125) MultiSource/Benchmarks/Olden/bisort/bisort: 22.15% (0.0614 => 0.0750, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.14% (4.9449 => 6.0399, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/matrix: 22.14% (0.3098 => 0.3784, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.92% (0.1510 => 0.1841, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 21.82% (0.2049 => 0.2496, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/football/football: 21.81% (0.8921 => 1.0867, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.78% (0.2107 => 0.2566, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 21.69% (0.0567 => 0.0690, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.53% (0.1584 => 0.1925, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.40% (0.0528 => 0.0641, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 21.36% (0.3423 => 0.4154, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.25% (5.0018 => 6.0647, std.dev.: 0.0069) MultiSource/Applications/treecc/treecc: 21.24% (2.0273 => 2.4579, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.01% (0.5569 => 0.6739, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.85% (0.6450 => 0.7795, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.78% (0.9765 => 1.1794, std.dev.: 0.0037) SingleSource/UnitTests/SignlessTypes/rem: 20.72% (0.1144 => 0.1381, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.55% (1.1861 => 1.4299, std.dev.: 0.0025) MultiSource/Applications/lambda-0_1_3/lambda: 20.45% (0.7433 => 0.8953, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 20.31% (3.8723 => 4.6588, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.14% (0.1117 => 0.1342, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.06% (0.0648 => 0.0778, std.dev.: 0.0013) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.89% (0.0759 => 0.0910, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.87% (0.1268 => 0.1520, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.78% (0.0834 => 0.0999, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.51% (0.0933 => 0.1115, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 19.40% (2.2969 => 2.7426, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/perlin: 19.22% (0.0536 => 0.0639, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.21% (0.3441 => 0.4102, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.05% (0.8101 => 0.9644, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.96% (0.0770 => 0.0916, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.76% (0.5981 => 0.7103, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.68% (0.4203 => 0.4988, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.50% (0.2065 => 0.2447, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: 18.48% (0.0633 => 0.0750, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.48% (0.2603 => 0.3084, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.10% (0.1044 => 0.1233, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/matrix: 17.97% (0.0818 => 0.0965, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: 17.88% (0.3283 => 0.3870, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/09-vor/vor: 17.30% (0.3180 => 0.3730, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 17.14% (0.3232 => 0.3786, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: 17.06% (0.0592 => 0.0693, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.90% (0.0704 => 0.0823, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.90% (0.8067 => 0.9430, std.dev.: 0.0081) MultiSource/Benchmarks/sim/sim: 16.53% (0.3387 => 0.3947, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: 16.10% (0.3379 => 0.3923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.89% (0.3865 => 0.4479, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.42% (0.4636 => 0.5351, std.dev.: 0.0027) MultiSource/Applications/sqlite3/sqlite3: 15.09% (17.1811 => 19.7740, std.dev.: 0.0137) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.92% (0.0838 => 0.0963, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 14.54% (1.5603 => 1.7871, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.36% (0.4103 => 0.4692, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 14.23% (0.4048 => 0.4624, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: 13.97% (0.3422 => 0.3900, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 13.70% (0.2905 => 0.3303, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.60% (0.3684 => 0.4185, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.24% (0.3603 => 0.4080, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 13.20% (0.3092 => 0.3500, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.03% (0.0798 => 0.0902, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.96% (0.3826 => 0.4322, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.94% (0.4064 => 0.4590, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.93% (0.3427 => 0.3870, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.84% (0.1114 => 0.1257, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.67% (0.2430 => 0.2738, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: 12.66% (0.3927 => 0.4424, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.64% (14.3668 => 16.1830, std.dev.: 0.0101) SingleSource/UnitTests/ObjC/property: 12.07% (0.3886 => 0.4355, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.91% (0.1268 => 0.1419, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 11.88% (0.1625 => 0.1818, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.44% (0.3828 => 0.4266, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.43% (0.3543 => 0.3948, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.11% (0.3473 => 0.3859, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 10.94% (0.3694 => 0.4098, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.87% (0.3543 => 0.3928, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-2: 10.84% (0.3497 => 0.3876, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 10.78% (0.3561 => 0.3945, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.69% (0.3516 => 0.3892, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.60% (0.2831 => 0.3131, std.dev.: 0.0011) MultiSource/Applications/hexxagon/hexxagon: 10.21% (1.2842 => 1.4153, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.14% (0.3935 => 0.4334, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.00% (0.2871 => 0.3158, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.96% (0.3162 => 0.3477, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.91% (2.0665 => 2.2713, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 9.90% (63.2438 => 69.5026, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/methcall: 9.70% (0.2877 => 0.3156, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2756 => 0.3021, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.53% (0.3650 => 0.3998, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2725 => 0.2983, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.45% (0.2793 => 0.3057, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.21% (0.2714 => 0.2964, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.20% (0.2891 => 0.3157, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.12% (0.3136 => 0.3422, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.05% (0.2872 => 0.3132, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.01% (0.3052 => 0.3327, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/random: 8.85% (0.2802 => 0.3050, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.46% (0.6030 => 0.6540, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 8.34% (10.3673 => 11.2317, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.31% (2.2022 => 2.3851, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.25% (0.2266 => 0.2453, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.20% (0.4879 => 0.5279, std.dev.: 0.0035) SingleSource/UnitTests/ObjC++/property-reference: 8.15% (0.7326 => 0.7923, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 7.90% (0.5925 => 0.6393, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.41% (0.3131 => 0.3269, std.dev.: 0.0013) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.39% (7.9617 => 8.3116, std.dev.: 0.0100) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3817 => 0.3950, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4749, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.98% (11.6436 => 12.4568, std.dev.: 0.0946) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.09% (4.2280 => 4.4434, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3110, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.68% (0.3316 => 0.3438, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.39% (2.0360 => 2.1050, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.19% (0.9957 => 1.0275, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9182, std.dev.: 0.0040) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.04% (3.6395 => 3.7137, std.dev.: 0.0093) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.76% (9.1159 => 9.2767, std.dev.: 0.0346) MultiSource/Benchmarks/mafft/pairlocalalign: 1.61% (27.8444 => 28.2916, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3460 => 10.4614, std.dev.: 0.0050) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1471, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.74% (5.2763 => 1.1746, std.dev.: 0.0096) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.17% (0.1622 => 0.0938, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.71% (5.3855 => 4.4855, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.07% (5.3526 => 4.4924, std.dev.: 0.0102) MultiSource/Applications/JM/ldecod/ldecod: -11.93% (10.4361 => 9.1910, std.dev.: 0.0261) SingleSource/UnitTests/Vector/constpool: -7.76% (54.1659 => 49.9631, std.dev.: 0.0143) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.79% (1.7609 => 1.6413, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.80% (1.9577 => 0.6500, std.dev.: 0.0115) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.03% (0.6962 => 0.3409, std.dev.: 0.0183) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -41.72% (0.0628 => 0.0366, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0210, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4320, std.dev.: 0.0093) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9248, std.dev.: 0.0124) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.48% (2.6546 => 2.0048, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0916, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9590, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3251, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.67% (2.5528 => 2.1272, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.08% (1.6925 => 1.4203, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7336, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4933, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.14% (3.2416 => 2.9129, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5795, std.dev.: 0.0203) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0015) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.60% (1.6805 => 1.5864, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.55% (8.1563 => 7.7034, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.24% (0.8614 => 0.8163, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.85% (1.5835 => 1.5067, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7996, std.dev.: 0.0034) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.62% (0.4808 => 0.4586, std.dev.: 0.0005) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0033) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: -2.02% (3.6994 => 3.6248, std.dev.: 0.0210) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9574, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3309, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -1.58% (3.7221 => 3.6634, std.dev.: 0.0093) MultiSource/Applications/sqlite3/sqlite3: -1.32% (4.6441 => 4.5830, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2284, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/hash: -1.00% (4.9088 => 4.8596, std.dev.: 0.0102) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0023) Report Time: 1.66s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 18:00:16 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 20:00:16 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130020016.7D16E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8091?compare_to=8089&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8091, Order: 173852, Start Time: 2013-01-30 00:26:22, End Time: 2013-01-30 02:00:38 To: 8089, Order: 173837, Start Time: 2013-01-29 22:27:49, End Time: 2013-01-30 00:02:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (125 on baseline) Performance Improvements: 1 (88 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.79% (79.7798 => 81.2082, std.dev.: 0.1338) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.77% (1.2843 => 1.2616, std.dev.: 0.0070) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.66% (0.0974 => 0.1633, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.58% (0.1132 => 0.1614, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.26% (0.6395 => 0.8842, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.53% (0.6395 => 0.8731, std.dev.: 0.0009) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.86% (0.5688 => 0.7557, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.76% (0.5805 => 0.7707, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.75% (0.6260 => 0.8310, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.68% (0.5456 => 0.7239, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.42% (0.5849 => 0.7745, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.21% (0.5567 => 0.7360, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.11% (0.5575 => 0.7365, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.07% (0.6230 => 0.8228, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.04% (0.5581 => 0.7369, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.33% (0.5802 => 0.7620, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.21% (0.5941 => 0.7795, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.90% (0.5705 => 0.7468, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.45% (0.5569 => 0.7265, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.43% (0.5857 => 0.7639, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.38% (0.5859 => 0.7639, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.38% (0.5478 => 0.7142, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.37% (0.6033 => 0.7865, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.17% (1.6474 => 2.1444, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.16% (0.5591 => 0.7277, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.88% (0.6440 => 0.8364, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.40% (0.5925 => 0.7667, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.31% (0.6189 => 0.8003, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.09% (0.6676 => 0.8618, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.82% (0.5863 => 0.7553, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.51% (0.6304 => 0.8101, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.33% (0.0699 => 0.0897, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.26% (0.6052 => 0.7762, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 28.18% (0.0582 => 0.0746, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.00% (0.6446 => 0.8251, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.72% (0.6681 => 0.8533, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.56% (0.6194 => 0.7901, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.40% (0.6660 => 0.8485, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.89% (0.6297 => 0.7990, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.86% (0.6667 => 0.8391, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.35% (0.7524 => 0.9356, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.42% (0.7339 => 0.9058, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.17% (2.2587 => 2.7820, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.22% (0.0693 => 0.0847, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.90% (0.0621 => 0.0757, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.09% (0.0634 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.71% (0.0556 => 0.0660, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.55% (0.0566 => 0.0671, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.28% (0.1146 => 0.1344, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 16.38% (0.3357 => 0.3907, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.88% (0.0680 => 0.0788, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 15.70% (1.1450 => 1.3248, std.dev.: 0.0045) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.99% (0.1081 => 0.1243, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.23% (0.0731 => 0.0835, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.72% (0.1982 => 0.2254, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.95% (4.5069 => 5.0906, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.65% (0.4916 => 0.5538, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.53% (1.6364 => 1.8414, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.28% (3.5339 => 3.9679, std.dev.: 0.0029) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.28% (0.1230 => 0.1381, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.07% (0.4515 => 0.5060, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2385 => 0.2644, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 10.17% (9.2283 => 10.1671, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.59% (0.1731 => 0.1897, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash: 9.46% (0.4524 => 0.4952, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.20% (1.2515 => 1.3666, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.16% (0.5329 => 0.5817, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.2001 => 0.2172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.52% (0.4861 => 0.5275, std.dev.: 0.0100) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.10% (1.2784 => 1.3820, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.72% (1.4642 => 1.5773, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/bigfib: 7.17% (0.6750 => 0.7234, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/matrix: 6.51% (0.3255 => 0.3467, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.07% (0.1879 => 0.1993, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.01% (5.4682 => 5.7966, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3319 => 0.3499, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.65% (22.4056 => 23.4470, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/ary3: 4.03% (0.3446 => 0.3585, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.98% (5.0226 => 5.2227, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.76% (0.9557 => 0.9916, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary: 3.74% (0.3394 => 0.3521, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.67% (0.7447 => 0.7720, std.dev.: 0.0012) MultiSource/Applications/SPASS/SPASS: 3.57% (15.5079 => 16.0616, std.dev.: 0.0190) MultiSource/Applications/SIBsim4/SIBsim4: 3.50% (1.3864 => 1.4349, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4427 => 0.4580, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 3.39% (0.8418 => 0.8703, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.21% (0.3491 => 0.3603, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.59% (0.5168 => 0.5302, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.29% (1.3722 => 1.4036, std.dev.: 0.0006) MultiSource/Applications/kimwitu++/kc: 1.90% (18.2933 => 18.6412, std.dev.: 0.0153) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.88% (0.6293 => 0.6411, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.46% (1.2300 => 1.2479, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.38% (3.5154 => 3.5640, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 1.25% (2.1401 => 2.1668, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: 1.20% (34.0927 => 34.5025, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.84% (31.3723 => 55.7933, std.dev.: 0.0188) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 7.45% (0.5692 => 0.6116, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1501, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (54.5751 => 56.6507, std.dev.: 0.0263) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.52% (2.0478 => 2.0994, std.dev.: 0.0109) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.87% (79.7170 => 81.2082, std.dev.: 0.1338) MultiSource/Applications/sqlite3/sqlite3: 1.59% (4.5320 => 4.6042, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5133, std.dev.: 0.0145) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2494, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9563, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (5.1955 => 5.2678, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3489 => 10.4573, std.dev.: 0.0055) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.02% (1.5103 => 1.5257, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.87% (0.1281 => 0.1129, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.36% (0.7198 => 0.6884, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/objinst: -4.26% (0.3194 => 0.3058, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.95% (0.3821 => 0.3670, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.36% (0.9852 => 0.9521, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.34% (0.3831 => 0.3703, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -3.33% (0.3812 => 0.3685, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.32% (0.3880 => 0.3751, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.27% (0.3848 => 0.3722, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.23% (0.3896 => 0.3770, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.23% (2.4924 => 2.4119, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/for-in: -3.22% (0.4033 => 0.3903, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.96% (0.3891 => 0.3776, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions: -2.90% (0.4176 => 0.4055, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.87% (0.3837 => 0.3727, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.80% (0.6347 => 0.6169, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.65% (0.3884 => 0.3781, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.9542 => 0.9292, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2360, std.dev.: 0.0132) SingleSource/UnitTests/ObjC++/property-reference-object: -2.47% (0.6441 => 0.6282, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.17% (0.6484 => 0.6343, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.11% (1.3148 => 1.2870, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.87% (2.1713 => 2.1306, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.81% (14.2083 => 13.9513, std.dev.: 0.0036) SingleSource/UnitTests/ObjC++/property-reference: -1.74% (0.7779 => 0.7644, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.25% (6.7716 => 6.6867, std.dev.: 0.0052) MultiSource/Applications/JM/lencod/lencod: -1.13% (16.1920 => 16.0089, std.dev.: 0.0129) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.89% (1.8100 => 0.6898, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -25.05% (1.3643 => 1.0226, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0054) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0783, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2048, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.05% (2.5106 => 2.1327, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6677, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6999, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.80% (2.2633 => 2.1772, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.67% (1.3096 => 1.2616, std.dev.: 0.0070) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7719, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: -2.52% (3.7241 => 3.6301, std.dev.: 0.0317) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1747, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.29% (1.6219 => 1.6009, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.26% (1.6307 => 1.6101, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5900, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/ary3: -1.06% (3.7092 => 3.6700, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0000) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 18:28:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 20:28:57 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130022857.930DC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8092?compare_to=8088&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8092, Order: 173850, Start Time: 2013-01-30 00:21:16, End Time: 2013-01-30 02:29:20 To: 8088, Order: 173833, Start Time: 2013-01-29 21:53:31, End Time: 2013-01-30 00:00:59 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 33 (90 on baseline) Performance Improvements: 9 (45 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1022 (928 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 57.42% (0.0937 => 0.1475, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/family/family: 57.34% (0.0443 => 0.0697, std.dev.: 0.0014) SingleSource/Regression/C/DuffsDevice: 54.55% (0.0231 => 0.0357, std.dev.: 0.0020) SingleSource/Regression/C/casts: 50.61% (0.0411 => 0.0619, std.dev.: 0.0026) SingleSource/Regression/C++/fixups: 49.21% (0.0252 => 0.0376, std.dev.: 0.0012) SingleSource/Regression/C/matrixTranspose: 42.21% (0.0289 => 0.0411, std.dev.: 0.0004) SingleSource/Regression/C++/pointer_method2: 40.30% (0.0263 => 0.0369, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 33.60% (0.9140 => 1.2211, std.dev.: 0.0975) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 31.95% (0.0745 => 0.0983, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 18.43% (0.6370 => 0.7544, std.dev.: 0.0393) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 13.79% (0.9277 => 1.0556, std.dev.: 0.0292) MultiSource/Applications/d/make_dparser: 13.76% (3.6167 => 4.1142, std.dev.: 0.0664) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.31% (1.2658 => 1.3583, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.68% (1.3095 => 1.3970, std.dev.: 0.0228) MultiSource/Benchmarks/Fhourstones/fhourstones: 6.51% (0.1767 => 0.1882, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.31% (0.2630 => 0.2796, std.dev.: 0.0046) MultiSource/Benchmarks/PAQ8p/paq8p: 5.78% (2.5684 => 2.7168, std.dev.: 0.0557) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.69% (1.3664 => 1.4441, std.dev.: 0.0222) MultiSource/Applications/kimwitu++/kc: 5.30% (19.0903 => 20.1018, std.dev.: 0.1196) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.28% (1.2606 => 1.3272, std.dev.: 0.0149) MultiSource/Applications/lua/lua: 4.00% (4.3187 => 4.4914, std.dev.: 0.0668) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.87% (1.3819 => 1.4354, std.dev.: 0.0107) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 70.78% (0.0219 => 0.0374, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.34% (2.4405 => 2.9370, std.dev.: 0.0250) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.64% (0.0987 => 0.1092, std.dev.: 0.0029) MultiSource/Benchmarks/7zip/7zip-benchmark: 9.70% (9.7038 => 10.6455, std.dev.: 0.2732) SingleSource/Regression/C/uint64_to_float: 7.94% (1.7685 => 1.9090, std.dev.: 0.0294) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.53% (45.5489 => 48.9792, std.dev.: 0.2674) SingleSource/Benchmarks/Misc/pi: 3.98% (2.1272 => 2.2118, std.dev.: 0.0035) MultiSource/Applications/lua/lua: 2.58% (28.6516 => 29.3896, std.dev.: 0.1542) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.11% (39.1280 => 39.9525, std.dev.: 0.0631) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 1.99% (13.7161 => 13.9888, std.dev.: 0.1014) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.76% (1.8565 => 1.8892, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -16.40% (0.1000 => 0.0836, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: -12.19% (0.0853 => 0.0749, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -10.42% (0.2331 => 0.2088, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.58% (0.3188 => 0.3010, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc-C++/stepanov_container: -23.62% (5.8928 => 4.5010, std.dev.: 0.3020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.86% (23.3994 => 22.7301, std.dev.: 0.1732) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.89% (2.5907 => 2.5418, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.54% (4.1689 => 4.1047, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout/fib2: -1.49% (4.3862 => 4.3208, std.dev.: 0.0079) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.72% (1.2360 => 1.2271, std.dev.: 0.0551) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 41.06% (0.0246 => 0.0347, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.16% (0.0462 => 0.0452, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.21% (0.0362 => 0.0354, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 53.53% (0.0340 => 0.0522, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -15.31% (0.0542 => 0.0459, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: -4.35% (0.0230 => 0.0220, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: -1.28% (0.0235 => 0.0232, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -6.12% (0.0245 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: 55.56% (0.0009 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.41% (0.1480 => 0.1474, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: 2.02% (1.1619 => 1.1854, std.dev.: 0.1700) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.07% (0.4010 => 0.4053, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.46% (0.1545 => 0.1507, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.55% (0.0615 => 0.0587, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0277 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.52% (0.0555 => 0.0569, std.dev.: 0.0044) MultiSource/Benchmarks/PAQ8p/paq8p: 20.00% (0.0015 => 0.0018, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.90% (1.2839 => 1.2955, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0608 => 0.0609, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.14% (0.0350 => 0.0361, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.92% (1.7618 => 1.7456, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.56% (0.0036 => 0.0047, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 2.50% (33.5496 => 34.3890, std.dev.: 0.0386) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0018, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 415.77% (0.0336 => 0.1733, std.dev.: 0.0422) SingleSource/Regression/C/sumarray2d: 133.21% (0.0274 => 0.0639, std.dev.: 0.0095) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 83.23% (0.0805 => 0.1475, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/family/family: 59.86% (0.0436 => 0.0697, std.dev.: 0.0014) SingleSource/Regression/C/casts: 59.54% (0.0388 => 0.0619, std.dev.: 0.0026) SingleSource/Regression/C++/fixups: 58.65% (0.0237 => 0.0376, std.dev.: 0.0012) SingleSource/Regression/C/matrixTranspose: 57.47% (0.0261 => 0.0411, std.dev.: 0.0004) SingleSource/Regression/C/DuffsDevice: 56.58% (0.0228 => 0.0357, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 52.74% (0.8893 => 1.3583, std.dev.: 0.0049) SingleSource/Regression/C++/pointer_method2: 49.39% (0.0247 => 0.0369, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 48.13% (0.9588 => 1.4203, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 47.79% (0.9061 => 1.3391, std.dev.: 0.0910) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 47.35% (0.9381 => 1.3823, std.dev.: 0.0650) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 46.87% (0.9120 => 1.3395, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 46.87% (0.9512 => 1.3970, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 46.53% (0.9855 => 1.4441, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 46.01% (0.9564 => 1.3964, std.dev.: 0.0689) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 45.99% (0.9091 => 1.3272, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 45.54% (0.8926 => 1.2991, std.dev.: 0.1159) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 44.12% (0.9612 => 1.3853, std.dev.: 0.0737) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 43.74% (0.8990 => 1.2922, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 41.95% (0.9422 => 1.3375, std.dev.: 0.0259) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 41.37% (0.9010 => 1.2737, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 40.78% (0.9403 => 1.3238, std.dev.: 0.1114) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 40.74% (0.9507 => 1.3380, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 39.78% (0.8912 => 1.2457, std.dev.: 0.0673) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.54% (0.9998 => 1.3951, std.dev.: 0.1021) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 39.46% (1.0867 => 1.5155, std.dev.: 0.1213) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 39.44% (0.8732 => 1.2176, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 39.39% (0.8736 => 1.2177, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 39.31% (1.0052 => 1.4003, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 38.28% (0.8846 => 1.2232, std.dev.: 0.0252) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.28% (0.9867 => 1.3249, std.dev.: 0.0788) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 34.11% (0.0733 => 0.0983, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.63% (1.0017 => 1.3386, std.dev.: 0.0911) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.59% (0.9788 => 1.3076, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 33.43% (1.0088 => 1.3460, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 33.37% (0.9405 => 1.2543, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.56% (0.9488 => 1.2577, std.dev.: 0.0413) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 32.49% (0.9127 => 1.2092, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.40% (0.9685 => 1.2823, std.dev.: 0.0263) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.17% (1.0860 => 1.4354, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.60% (0.9993 => 1.3051, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.23% (0.9550 => 1.2437, std.dev.: 0.0240) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 24.96% (0.0669 => 0.0836, std.dev.: 0.0024) MultiSource/Benchmarks/mafft/pairlocalalign: 21.96% (9.5202 => 11.6109, std.dev.: 0.5526) MultiSource/Benchmarks/McCat/04-bisect/bisect: 19.37% (0.1332 => 0.1590, std.dev.: 0.0073) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.26% (0.0707 => 0.0829, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.13% (0.0963 => 0.1128, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.12% (1.0986 => 1.2757, std.dev.: 0.0515) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.63% (3.6295 => 4.1605, std.dev.: 0.1895) SingleSource/Benchmarks/Shootout-C++/matrix: 12.12% (0.2385 => 0.2674, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.10% (0.9588 => 1.0556, std.dev.: 0.0292) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.38% (23.5861 => 25.7978, std.dev.: 0.5740) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.17% (1.8651 => 2.0362, std.dev.: 0.0306) MultiSource/Applications/d/make_dparser: 8.73% (3.7840 => 4.1142, std.dev.: 0.0664) SingleSource/Regression/C++/ofstream_ctor: 7.10% (0.2042 => 0.2187, std.dev.: 0.0043) MultiSource/Applications/kimwitu++/kc: 6.15% (18.9377 => 20.1018, std.dev.: 0.1196) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107712.50% (0.0008 => 0.8625, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/ary3: 438.84% (2.2304 => 12.0183, std.dev.: 0.6031) SingleSource/Benchmarks/Shootout/matrix: 356.56% (1.5825 => 7.2251, std.dev.: 0.1757) MultiSource/Applications/sgefa/sgefa: 259.00% (0.3515 => 1.2619, std.dev.: 0.0776) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.69% (1.1825 => 4.0641, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.60% (4.8185 => 15.8820, std.dev.: 0.1145) SingleSource/Benchmarks/Shootout-C++/ary2: 205.43% (0.0129 => 0.0394, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 199.12% (0.0228 => 0.0682, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary: 146.55% (0.0232 => 0.0572, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 73.95% (0.0215 => 0.0374, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 63.05% (2.9083 => 4.7419, std.dev.: 0.1694) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.72% (0.2562 => 0.3426, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.33% (3.1254 => 4.1047, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.27% (1.4588 => 1.8420, std.dev.: 0.0456) SingleSource/Regression/C/uint64_to_float: 23.99% (1.5397 => 1.9090, std.dev.: 0.0294) SingleSource/Benchmarks/Misc/salsa20: 22.00% (7.4497 => 9.0890, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.72% (4.8112 => 5.8081, std.dev.: 0.1021) MultiSource/Benchmarks/7zip/7zip-benchmark: 18.18% (9.0082 => 10.6455, std.dev.: 0.2732) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.69% (2.5170 => 2.9370, std.dev.: 0.0250) MultiSource/Applications/JM/lencod/lencod: 15.05% (6.8159 => 7.8419, std.dev.: 0.0296) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.51% (5.1752 => 5.8745, std.dev.: 0.0902) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.02% (5.0033 => 5.6546, std.dev.: 0.0355) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (3.6477 => 3.9747, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/ReedSolomon: 8.21% (8.6447 => 9.3543, std.dev.: 0.0512) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.55% (4.7473 => 5.0581, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.25% (46.0987 => 48.9792, std.dev.: 0.2674) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.34% (4.1836 => 4.4069, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.38% (5.0310 => 5.2514, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/pi: 3.40% (2.1390 => 2.2118, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.78% (4.7254 => 4.8567, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.44% (4.8076 => 4.8769, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.38% (1.8634 => 1.8892, std.dev.: 0.0088) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -33.42% (0.0808 => 0.0538, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.57% (0.0727 => 0.0512, std.dev.: 0.0015) SingleSource/Benchmarks/SmallPT/smallpt: -24.74% (0.1888 => 0.1421, std.dev.: 0.0102) MultiSource/Benchmarks/BitBench/drop3/drop3: -24.57% (0.0692 => 0.0522, std.dev.: 0.0053) MultiSource/Applications/hbd/hbd: -17.10% (1.8964 => 1.5721, std.dev.: 0.0447) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.43% (6.4235 => 5.8175, std.dev.: 0.1761) SingleSource/Benchmarks/Shootout-C++/hash2: -8.49% (0.5134 => 0.4698, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/moments: -4.82% (0.4002 => 0.3809, std.dev.: 0.0067) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.73% (11.5523 => 3.9591, std.dev.: 0.0449) SingleSource/Benchmarks/Misc/fp-convert: -61.49% (15.6525 => 6.0282, std.dev.: 0.1242) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.93% (0.4146 => 0.1827, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.49% (0.4578 => 0.2358, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.91% (11.3868 => 6.3865, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.76% (5.4023 => 3.6326, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.91% (0.4452 => 0.3076, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.04% (5.2605 => 3.8909, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.17% (0.5495 => 0.4112, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.16% (4.4467 => 3.3280, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.77% (0.5826 => 0.4441, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.24% (4.9921 => 3.8321, std.dev.: 0.0624) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7918, std.dev.: 0.1588) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.30% (7.0016 => 5.8604, std.dev.: 0.0412) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.13% (16.6791 => 13.9888, std.dev.: 0.1014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.96% (3.1921 => 2.7785, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/heapsort: -12.60% (4.4739 => 3.9103, std.dev.: 0.1982) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.34% (9.7992 => 8.5895, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.29% (5.7056 => 5.0043, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.16% (5.3626 => 4.7103, std.dev.: 0.0687) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.85% (0.4081 => 0.3679, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/lists1: -9.43% (0.6628 => 0.6003, std.dev.: 0.0088) MultiSource/Applications/SIBsim4/SIBsim4: -7.23% (3.5443 => 3.2879, std.dev.: 0.0414) SingleSource/Benchmarks/Shootout/hash: -6.79% (4.5259 => 4.2185, std.dev.: 0.0913) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.42% (5.5974 => 5.2380, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.19% (4.5424 => 4.2613, std.dev.: 0.0686) SingleSource/Benchmarks/McGill/queens: -5.39% (1.7443 => 1.6502, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: -5.33% (63.1520 => 59.7835, std.dev.: 0.1167) SingleSource/Benchmarks/Shootout-C++/hash2: -4.76% (3.6768 => 3.5019, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.53% (3.5691 => 3.4430, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.53% (5.8973 => 5.6891, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/lists: -3.52% (17.2182 => 16.6123, std.dev.: 0.0896) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.86% (23.3986 => 22.7301, std.dev.: 0.1732) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.65% (8.7327 => 8.5885, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.58% (85.3042 => 83.9604, std.dev.: 0.0510) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.45% (8.8249 => 8.6968, std.dev.: 0.0179) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.29% (40.4729 => 39.9525, std.dev.: 0.0631) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.86% (1.2047 => 1.2271, std.dev.: 0.0551) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 48.93% (0.0233 => 0.0347, std.dev.: 0.0009) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.22% (0.0451 => 0.0452, std.dev.: 0.0114) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.15% (0.0394 => 0.0354, std.dev.: 0.0085) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 59.15% (0.0328 => 0.0522, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 3.15% (0.0445 => 0.0459, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: 3.29% (0.0213 => 0.0220, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: 2.20% (0.0227 => 0.0232, std.dev.: 0.0065) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -3.66% (0.1530 => 0.1474, std.dev.: 0.0073) MultiSource/Applications/lemon/lemon: -38.56% (1.9293 => 1.1854, std.dev.: 0.1700) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.10% (0.4049 => 0.4053, std.dev.: 0.0642) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.20% (0.1510 => 0.1507, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.98% (0.0978 => 0.0587, std.dev.: 0.0197) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.72% (0.0276 => 0.0278, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.56% (0.0590 => 0.0569, std.dev.: 0.0044) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.52% (1.1617 => 1.2955, std.dev.: 0.0048) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.16% (0.0610 => 0.0609, std.dev.: 0.0099) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 34.70% (0.0268 => 0.0361, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.72% (0.7437 => 1.7456, std.dev.: 0.0045) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.91% (0.0092 => 0.0047, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.12% (12.7781 => 34.3890, std.dev.: 0.0386) Report Time: 1.02s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 19:24:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 21:24:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130130032456.65F472A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8093?compare_to=8087&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8093, Order: 173842, Start Time: 2013-01-29 23:50:39, End Time: 2013-01-30 03:25:16 To: 8087, Order: 173810, Start Time: 2013-01-29 19:19:15, End Time: 2013-01-29 22:54:41 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (187 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (750 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.18% (2.3906 => 2.4189, std.dev.: 0.0097) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 20.21% (0.0663 => 0.0797, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.65% (122.9167 => 131.0865, std.dev.: 0.3164) SingleSource/Benchmarks/Shootout-C++/ary2: 5.36% (0.2146 => 0.2261, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.76% (0.6701 => 0.6886, std.dev.: 0.0010) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.72% (0.0625 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 39.04% (0.1063 => 0.1478, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.12% (0.0331 => 0.0434, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 30.20% (0.1106 => 0.1440, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.80% (0.0547 => 0.0710, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.61% (0.2969 => 0.3848, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.15% (0.0714 => 0.0915, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.03% (0.4139 => 0.5299, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.86% (0.5900 => 0.7544, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.27% (0.4994 => 0.6356, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.16% (0.0475 => 0.0604, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.95% (0.0642 => 0.0815, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 26.94% (1.5932 => 2.0224, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.85% (0.1620 => 0.2055, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.54% (0.0584 => 0.0739, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.53% (0.0897 => 0.1135, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.10% (0.5000 => 0.6305, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.72% (0.4253 => 0.5347, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/tsp/tsp: 25.71% (0.0599 => 0.0753, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.37% (0.1021 => 0.1280, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.75% (0.1107 => 0.1381, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.66% (0.0584 => 0.0728, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 24.16% (0.0948 => 0.1177, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.08% (0.1549 => 0.1922, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.03% (0.1003 => 0.1244, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.01% (0.0633 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 24.01% (0.0604 => 0.0749, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.98% (0.3903 => 0.4839, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.82% (0.1604 => 0.1986, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.64% (0.0495 => 0.0612) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.57% (0.1103 => 0.1363, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 23.35% (0.1619 => 0.1997, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 23.33% (0.4029 => 0.4969, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/health/health: 23.02% (0.0821 => 0.1010, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.99% (0.0822 => 0.1011, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.84% (0.2736 => 0.3361, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.79% (0.0452 => 0.0555, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.60% (0.0947 => 0.1161, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.06% (0.1088 => 0.1328, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 21.84% (0.1218 => 0.1484, std.dev.: 0.0003) MultiSource/Applications/aha/aha: 21.83% (0.0481 => 0.0586, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.65% (0.0462 => 0.0562, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.61% (0.1462 => 0.1778, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.42% (0.2866 => 0.3480, std.dev.: 0.0020) MultiSource/Applications/sgefa/sgefa: 21.41% (0.0808 => 0.0981, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 21.26% (0.1505 => 0.1825, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.25% (0.2014 => 0.2442, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.13% (0.3890 => 0.4712, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/mst/mst: 20.92% (0.0698 => 0.0844, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.76% (1.3152 => 1.5882, std.dev.: 0.0062) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.45% (0.0572 => 0.0689, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/gs/gs: 20.11% (1.8794 => 2.2574, std.dev.: 0.0059) MultiSource/Applications/Burg/burg: 20.01% (0.5546 => 0.6656, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.90% (0.0573 => 0.0687, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.75% (0.3271 => 0.3917, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.69% (0.0513 => 0.0614, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.36% (0.4658 => 0.5560, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.36% (0.1968 => 0.2349, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/bh/bh: 19.31% (0.1284 => 0.1532, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.28% (3.5627 => 4.2495, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.12% (0.5026 => 0.5987, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 19.05% (0.5826 => 0.6936, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.05% (0.1160 => 0.1381, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.05% (1.6211 => 1.9299, std.dev.: 0.0045) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.93% (0.3930 => 0.4674, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: 18.77% (0.9697 => 1.1517, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 18.76% (0.5889 => 0.6994, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.73% (0.4361 => 0.5178, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 18.72% (0.1421 => 0.1687, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.47% (0.0563 => 0.0667, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference: 18.32% (0.7171 => 0.8485, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 18.30% (1.0781 => 1.2754, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.23% (0.2792 => 0.3301, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.12% (0.2875 => 0.3396, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 18.07% (0.2823 => 0.3333, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 18.04% (0.2811 => 0.3318, std.dev.: 0.0054) MultiSource/Applications/ClamAV/clamscan: 18.02% (4.2109 => 4.9699, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.91% (1.9694 => 2.3221, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.78% (0.3195 => 0.3763, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/methcall: 17.74% (0.2813 => 0.3312, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 17.71% (0.2750 => 0.3237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 17.61% (0.2714 => 0.3192, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.52% (0.2911 => 0.3421, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.52% (0.3060 => 0.3596, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.51% (2.7292 => 3.2071, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/fibo: 17.50% (0.2725 => 0.3202, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.49% (0.2738 => 0.3217, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.48% (1.9966 => 2.3456, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/random: 17.37% (0.2803 => 0.3290, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 17.37% (0.2780 => 0.3263, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.33% (0.2729 => 0.3202, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.31% (2.0673 => 2.4251, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/wc: 17.28% (0.3096 => 0.3631, std.dev.: 0.0039) MultiSource/Applications/lua/lua: 17.17% (1.4269 => 1.6719, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: 17.02% (0.9909 => 1.1596, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout-C++/ary: 17.00% (0.3258 => 0.3812, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 17.00% (0.7875 => 0.9214, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/sieve: 16.99% (0.3726 => 0.4359, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 16.99% (0.3267 => 0.3822, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.97% (0.1090 => 0.1275, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 16.94% (0.3004 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 16.91% (0.2566 => 0.3000, std.dev.: 0.0022) MultiSource/Benchmarks/Bullet/bullet: 16.82% (23.5202 => 27.4764, std.dev.: 0.0328) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.74% (0.3625 => 0.4232, std.dev.: 0.0150) SingleSource/Benchmarks/Shootout-C++/ary2: 16.73% (0.3317 => 0.3872, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.71% (0.3124 => 0.3646, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.52% (4.4195 => 5.1495, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/lists1: 16.51% (0.3477 => 0.4051, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 16.46% (0.3348 => 0.3899, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.45% (0.3362 => 0.3915, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/functionobjects: 16.30% (0.2068 => 0.2405, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 16.23% (0.3678 => 0.4275, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 16.23% (0.4251 => 0.4941, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.20% (0.0673 => 0.0782, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.18% (0.3282 => 0.3813, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.15% (0.3981 => 0.4624, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 16.04% (0.0804 => 0.0933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 16.04% (0.4146 => 0.4811, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.88% (0.3690 => 0.4276, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.86% (0.1028 => 0.1191, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 15.81% (5.5417 => 6.4176, std.dev.: 0.0119) SingleSource/UnitTests/ObjC/exceptions-4: 15.76% (0.3465 => 0.4011, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.76% (0.3446 => 0.3989, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.71% (0.3469 => 0.4014, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.68% (0.3488 => 0.4035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 15.68% (0.3496 => 0.4044, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.57% (0.3442 => 0.3978, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-3: 15.55% (0.3460 => 0.3998, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 15.40% (0.5012 => 0.5784, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 15.40% (0.3650 => 0.4212, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.24% (0.3845 => 0.4431, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/parameter-passing: 15.23% (0.3724 => 0.4291, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.15% (0.3643 => 0.4195, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.83% (0.5361 => 0.6156, std.dev.: 0.0074) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (2.1653 => 2.4836, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.69% (0.6435 => 0.7380, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 14.68% (0.2691 => 0.3086, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.40% (0.2737 => 0.3131, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 14.29% (4.6177 => 5.2774, std.dev.: 0.0177) MultiSource/Benchmarks/mafft/pairlocalalign: 14.18% (2.1013 => 2.3993, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.12% (0.0758 => 0.0865, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.60% (0.2103 => 0.2389, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.59% (0.1383 => 0.1571, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.52% (0.3084 => 0.3501, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.42% (11.6398 => 13.2023, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.24% (0.2040 => 0.2310, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.18% (0.3498 => 0.3959, std.dev.: 0.0040) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.05% (0.7426 => 0.8395, std.dev.: 0.0059) MultiSource/Applications/siod/siod: 12.93% (0.6634 => 0.7492, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 12.80% (0.3336 => 0.3763, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: 12.48% (0.4847 => 0.5452, std.dev.: 0.0158) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.54% (4.6926 => 5.2340, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: 11.21% (0.2391 => 0.2659, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: 10.83% (2.0346 => 2.2550, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.71% (0.5584 => 0.6126, std.dev.: 0.0025) MultiSource/Applications/kimwitu++/kc: 8.68% (11.9555 => 12.9938, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.28% (0.3792 => 0.4030, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5126, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.38% (0.5917 => 0.6886, std.dev.: 0.0010) MultiSource/Applications/ClamAV/clamscan: 9.53% (0.2802 => 0.3069, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.18% (0.3693 => 0.3995, std.dev.: 0.0086) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6098, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: 5.19% (15.4430 => 16.2438, std.dev.: 0.0175) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6801, std.dev.: 0.0046) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 2.74% (0.6276 => 0.6448, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1973, std.dev.: 0.0059) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3096, std.dev.: 0.0035) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.37% (7.1849 => 7.2831, std.dev.: 0.0066) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0788, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2063, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5951, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.05% (10.3705 => 10.4798, std.dev.: 0.0073) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.32% (2.4764 => 2.4189, std.dev.: 0.0097) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.79% (25.4195 => 16.5770, std.dev.: 0.0278) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.95% (17.2379 => 14.3161, std.dev.: 0.0522) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9767, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7916, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: -5.87% (0.2402 => 0.2261, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.75% (41.7953 => 40.2272, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8064, std.dev.: 0.0084) SingleSource/Benchmarks/Dhrystone/dry: -3.16% (14.0481 => 13.6046, std.dev.: 0.0891) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7736, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.22% (197.4719 => 193.0899, std.dev.: 0.0859) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.67% (10.7630 => 10.5828, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (105.3826 => 104.2246, std.dev.: 0.0422) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0472, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 19:48:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 21:48:55 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130034855.727852A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8094?compare_to=8090&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8094, Order: 173866, Start Time: 2013-01-30 01:37:07, End Time: 2013-01-30 03:49:15 To: 8090, Order: 173839, Start Time: 2013-01-29 22:53:46, End Time: 2013-01-30 01:06:02 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (231 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1095 (640 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hbd/hbd: 1.18% (1.7871 => 1.8081, std.dev.: 0.0039) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.01% (39.1513 => 39.5474, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 4.54% (0.6500 => 0.6795, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.71% (11.2317 => 10.9269, std.dev.: 0.0176) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.31% (10.4395 => 10.3025, std.dev.: 0.0016) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1331 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.38% (0.0681 => 0.0658, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8611 => 499.8463, std.dev.: 0.0037) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.40% (1.1277 => 499.8463, std.dev.: 0.0037) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.54% (0.5229 => 1.7127, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 26.50% (14.9895 => 18.9614, std.dev.: 0.0126) MultiSource/Applications/kimwitu++/kc: 47.89% (14.1553 => 20.9346, std.dev.: 0.0119) MultiSource/Benchmarks/MallocBench/gs/gs: 21.37% (4.1105 => 4.9890, std.dev.: 0.0097) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.10% (1.1048 => 1.7909, std.dev.: 0.0031) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 452.48% (7.1582 => 39.5474, std.dev.: 0.0144) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.38% (3.4629 => 6.6274, std.dev.: 0.0069) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.85% (0.6222 => 1.1439, std.dev.: 0.0019) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10255.69% (0.0720 => 7.4561, std.dev.: 0.0095) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 11181400.00% (0.0001 => 11.1815, std.dev.: 0.0424) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848100.00% (0.0001 => 9.8482, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5484700.00% (0.0001 => 5.4848, std.dev.: 0.0137) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.36% (1.1194 => 10.3025, std.dev.: 0.0016) MultiSource/Applications/ClamAV/clamscan: 151.16% (22.1758 => 55.6963, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/lowercase: 132.03% (0.0256 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.66% (0.0929 => 0.1892, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.66% (0.1463 => 0.2643, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469) SingleSource/Benchmarks/CoyoteBench/almabench: 67.67% (0.0730 => 0.1224, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 66.24% (0.0394 => 0.0655, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.43% (1.5859 => 2.4967, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.35% (2.9384 => 4.6235, std.dev.: 0.0036) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.33% (7.0540 => 11.0278, std.dev.: 0.0060) MultiSource/Benchmarks/FreeBench/distray/distray: 54.07% (0.1056 => 0.1627, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.33% (8.1363 => 12.2317, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.89% (2.2024 => 3.2351, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 45.87% (0.3109 => 0.4535, std.dev.: 0.0012) SingleSource/UnitTests/vla: 45.63% (0.0355 => 0.0517, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.10% (0.0439 => 0.0637, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 42.11% (0.1432 => 0.2035, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 41.34% (21.9371 => 31.0066, std.dev.: 0.0157) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.15% (0.1062 => 0.1499, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.84% (1.5415 => 2.1402, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.85% (4.2646 => 5.8789, std.dev.: 0.0069) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.55% (0.4615 => 0.6302, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.28% (0.2271 => 0.3095, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.87% (0.5105 => 0.6936, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.51% (0.1892 => 0.2545) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.32% (0.6675 => 0.8966, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 33.87% (0.4299 => 0.5755, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 33.74% (1.1642 => 1.5570, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 31.66% (0.1655 => 0.2179, std.dev.: 0.0007) SingleSource/UnitTests/2006-12-11-LoadConstants: 31.58% (0.1143 => 0.1504, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 31.00% (9.4845 => 12.4249, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.75% (3.8922 => 5.0890, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/dot-syntax-1: 30.27% (0.0479 => 0.0624, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 29.97% (0.1695 => 0.2203, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.96% (0.1125 => 0.1462, std.dev.: 0.0036) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.76% (0.0793 => 0.1029, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/08-main/main: 29.60% (0.2554 => 0.3310, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.36% (0.0746 => 0.0965, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 29.29% (1.0722 => 1.3863, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.10% (0.0457 => 0.0590, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.78% (1.4186 => 1.8269, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 28.75% (0.4289 => 0.5522, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 28.00% (0.1175 => 0.1504, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.81% (0.0730 => 0.0933, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 27.73% (0.4620 => 0.5901, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.70% (0.0408 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.68% (0.3121 => 0.3985, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.60% (0.1337 => 0.1706, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 27.48% (0.7115 => 0.9070, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.12% (0.1906 => 0.2423, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.93% (0.0672 => 0.0853) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.88% (0.1566 => 0.1987, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.51% (0.5020 => 0.6351, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 26.32% (0.6456 => 0.8155, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: 26.21% (0.0660 => 0.0833, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.19% (0.2700 => 0.3407, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 25.80% (0.1163 => 0.1463, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.53% (0.0842 => 0.1057, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.40% (0.1236 => 0.1550, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: 25.36% (0.0485 => 0.0608, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 25.31% (0.1695 => 0.2124, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 25.26% (0.7835 => 0.9814, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/15-trie/trie: 25.24% (0.0527 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (0.1032 => 0.1291, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 25.08% (0.0626 => 0.0783, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.07% (1.3050 => 1.6322, std.dev.: 0.0015) MultiSource/Applications/viterbi/viterbi: 24.76% (0.1555 => 0.1940, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.72% (0.0886 => 0.1105, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.59% (0.0675 => 0.0841, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.45% (0.0871 => 0.1084, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 24.24% (0.1151 => 0.1430, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.10% (0.1029 => 0.1277, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 24.01% (3.3354 => 4.1363, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 24.00% (5.7591 => 7.1411, std.dev.: 0.0104) MultiSource/Benchmarks/nbench/nbench: 23.97% (1.1840 => 1.4678, std.dev.: 0.0052) SingleSource/UnitTests/ObjC/messages-2: 23.87% (0.0662 => 0.0820, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.82% (0.0953 => 0.1180, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 23.62% (0.0614 => 0.0759, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.37% (0.3307 => 0.4080, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.36% (0.1584 => 0.1954, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.35% (0.1940 => 0.2393, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.28% (0.5860 => 0.7224, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 23.05% (0.3098 => 0.3812, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.70% (4.9449 => 6.0676, std.dev.: 0.0116) MultiSource/Benchmarks/McCat/18-imp/imp: 22.58% (0.3423 => 0.4196, std.dev.: 0.0015) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.45% (0.1510 => 0.1849, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/football/football: 22.41% (0.8921 => 1.0920, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.14% (0.8172 => 0.9981, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.12% (0.2107 => 0.2573, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.86% (5.0018 => 6.0952, std.dev.: 0.0088) MultiSource/Applications/treecc/treecc: 21.84% (2.0273 => 2.4701, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.76% (0.5569 => 0.6781, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 21.65% (0.7433 => 0.9042, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.43% (0.2758 => 0.3349, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ReedSolomon: 21.43% (0.2049 => 0.2488, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.33% (0.9765 => 1.1848, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.26% (0.6450 => 0.7821, std.dev.: 0.0016) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.19% (1.1861 => 1.4374, std.dev.: 0.0064) MultiSource/Applications/lua/lua: 21.10% (3.8723 => 4.6893, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.74% (0.0834 => 0.1007, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.58% (0.0933 => 0.1125, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.55% (0.0759 => 0.0915, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.50% (0.1117 => 0.1346, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.27% (0.1268 => 0.1525, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.26% (0.0770 => 0.0926, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 20.26% (2.2969 => 2.7622, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.91% (0.0648 => 0.0777, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.61% (0.4203 => 0.5027, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.60% (0.8101 => 0.9689, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.41% (0.3441 => 0.4109, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.23% (0.5981 => 0.7131, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.21% (0.2603 => 0.3103, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.77% (0.1044 => 0.1240, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.60% (0.2065 => 0.2449, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/matrix: 18.58% (0.0818 => 0.0970, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 18.49% (0.3283 => 0.3890, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.3180 => 0.3757, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 18.01% (0.3232 => 0.3814, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.33% (0.0704 => 0.0826, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 17.21% (0.3387 => 0.3970, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.04% (0.8067 => 0.9442, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.54% (0.0798 => 0.0930, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.53% (0.3865 => 0.4504, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary2: 16.31% (0.3379 => 0.3930, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.11% (0.4636 => 0.5383, std.dev.: 0.0025) MultiSource/Applications/hbd/hbd: 15.88% (1.5603 => 1.8081, std.dev.: 0.0039) MultiSource/Applications/sqlite3/sqlite3: 15.85% (17.1811 => 19.9038, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.04% (0.4103 => 0.4720, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/moments: 14.80% (0.4048 => 0.4647, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bh/bh: 14.65% (0.3092 => 0.3545, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 14.58% (0.3684 => 0.4221, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: 14.52% (0.3422 => 0.3919, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 14.29% (0.2905 => 0.3320, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.10% (0.3603 => 0.4111, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.99% (0.3282 => 0.3741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.89% (0.3427 => 0.3903, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.46% (0.1114 => 0.1264, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.39% (0.4064 => 0.4608, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.34% (14.3668 => 16.2839, std.dev.: 0.0160) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.17% (0.2430 => 0.2750, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.86% (0.3826 => 0.4318, std.dev.: 0.0051) SingleSource/Benchmarks/Stanford/Puzzle: 12.70% (0.1268 => 0.1429, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 12.63% (0.3927 => 0.4423, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 12.20% (0.3886 => 0.4360, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.52% (0.3828 => 0.4269, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.37% (0.2831 => 0.3153, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 10.96% (0.3694 => 0.4099, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/trivial-interface: 10.94% (0.3473 => 0.3853, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.92% (0.3543 => 0.3930, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 10.87% (0.3561 => 0.3948, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.83% (2.0665 => 2.2903, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.83% (0.3935 => 0.4361, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: 10.80% (1.2842 => 1.4229, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 10.78% (0.3497 => 0.3874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.75% (0.3516 => 0.3894, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.52% (0.2871 => 0.3173, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 10.51% (63.2438 => 69.8909, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.47% (0.3650 => 0.4032, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.46% (0.2877 => 0.3178, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.28% (0.3162 => 0.3487, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 9.95% (0.2714 => 0.2984, std.dev.: 0.0072) SingleSource/UnitTests/ObjC++/property-reference-object: 9.90% (0.6030 => 0.6627, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.89% (0.2891 => 0.3177, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.83% (0.2756 => 0.3027, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.77% (0.2793 => 0.3066, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.68% (0.2872 => 0.3150, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 9.60% (0.3052 => 0.3345, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/random: 9.56% (0.2802 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.39% (2.2022 => 2.4089, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2725 => 0.2980, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.25% (0.3136 => 0.3426, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.21% (0.7326 => 0.8001, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 8.88% (0.5925 => 0.6451, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.80% (0.1330 => 0.1447, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.74% (0.2266 => 0.2464, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.40% (0.4879 => 0.5289, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/power/power: 8.13% (0.1440 => 0.1557, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.65% (0.1438 => 0.1548, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.55% (0.3177 => 0.3417, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: 5.40% (10.3673 => 10.9269, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.37% (7.9617 => 8.3097, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.48% (0.3817 => 0.3950, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4749, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (1.1145 => 1.2933, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0001) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1485, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.92% (11.6436 => 12.5653, std.dev.: 0.1566) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.24% (4.2280 => 4.4497, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3120, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.44% (0.9957 => 1.0300, std.dev.: 0.0034) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.40% (2.0360 => 2.1053, std.dev.: 0.0135) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.67% (8.6802 => 8.9117, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7144, std.dev.: 0.0097) MultiSource/Benchmarks/Olden/bisort/bisort: 2.04% (0.8333 => 0.8503, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.62% (9.1159 => 9.2634, std.dev.: 0.0248) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2911, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.35% (1.0785 => 1.0931, std.dev.: 0.0052) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.05% (6.5088 => 6.5772, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4546, std.dev.: 0.0073) MultiSource/Applications/lua/lua: 1.03% (26.0924 => 26.3610, std.dev.: 0.0126) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1481, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.64% (5.2763 => 1.1797, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.02% (0.8651 => 0.2161, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -41.86% (0.1622 => 0.0943, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.02% (5.3855 => 4.5226, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.36% (5.3526 => 4.5303, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: -11.44% (10.4361 => 9.2417, std.dev.: 0.0029) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0245, std.dev.: 0.0709) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (1.7609 => 1.6465, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.29% (1.9577 => 0.6795, std.dev.: 0.0043) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.08% (1.5373 => 1.0288, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4350, std.dev.: 0.0235) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9285, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0058, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/mason/mason: -18.46% (0.2161 => 0.1762, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1259, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7350, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.88% (0.9540 => 0.8407, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4938, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9116, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: -6.87% (1.2373 => 1.1523, std.dev.: 0.0053) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.86% (19.9488 => 18.5809, std.dev.: 0.0296) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.85% (1.8329 => 1.7073, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.63% (8.1563 => 7.6975, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.54% (1.6805 => 1.5874, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.87% (0.4808 => 0.4574, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-5: -4.81% (1.5835 => 1.5073, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -4.72% (10.2830 => 9.7976, std.dev.: 0.0047) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6767, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary3: -1.50% (3.7221 => 3.6661, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/ary3: -1.37% (3.6994 => 3.6489, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/lists: -1.33% (6.2999 => 6.2158, std.dev.: 0.0156) MultiSource/Applications/sqlite3/sqlite3: -1.30% (4.6441 => 4.5839, std.dev.: 0.0037) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0018) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 19:58:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 21:58:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130035852.659502A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8095?compare_to=8091&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8095, Order: 173881, Start Time: 2013-01-30 02:24:25, End Time: 2013-01-30 03:59:14 To: 8091, Order: 173852, Start Time: 2013-01-30 00:26:22, End Time: 2013-01-30 02:00:38 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (122 on baseline) Performance Improvements: 1 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: -1.04% (2.1306 => 2.1084, std.dev.: 0.0004) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710) SingleSource/Benchmarks/Misc/lowercase: 86.43% (0.0280 => 0.0522, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.74% (0.0717 => 0.1217, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 68.69% (0.0974 => 0.1643, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 50.56% (0.0267 => 0.0402, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.89% (0.6395 => 0.8818, std.dev.: 0.0083) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.45% (0.6395 => 0.8726, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.86% (0.5688 => 0.7557, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.73% (0.5805 => 0.7705, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.55% (0.5456 => 0.7232, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.30% (0.5575 => 0.7376, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.28% (0.6260 => 0.8281, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.13% (0.5849 => 0.7728, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.99% (0.5567 => 0.7348, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.79% (0.5581 => 0.7355, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.69% (0.6230 => 0.8204, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.23% (0.5802 => 0.7614, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.06% (0.5941 => 0.7786, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.78% (0.5705 => 0.7461, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.27% (0.5569 => 0.7255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.27% (0.5478 => 0.7136, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.26% (0.5859 => 0.7632, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.20% (0.5857 => 0.7626, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.04% (0.5570 => 0.7243, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.99% (0.6033 => 0.7842, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.90% (1.6474 => 2.1400, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.78% (0.5591 => 0.7256, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.60% (0.6440 => 0.8346, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.97% (0.6189 => 0.7982, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.89% (0.6676 => 0.8605, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.60% (0.5863 => 0.7540, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.27% (0.6304 => 0.8086, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.12% (0.6052 => 0.7754, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.83% (0.6446 => 0.8240, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.24% (0.6194 => 0.7881, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.12% (0.6660 => 0.8466, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.11% (0.6681 => 0.8492, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.63% (0.6297 => 0.7974, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.69% (0.6667 => 0.8380, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.18% (0.7524 => 0.9343, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.23% (0.7339 => 0.9044, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.80% (2.2587 => 2.7737, std.dev.: 0.0154) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.74% (0.0621 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.26% (0.3357 => 0.3903, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 15.49% (1.1450 => 1.3224, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/exptree: 14.24% (0.0864 => 0.0987, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.95% (0.0731 => 0.0833, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.47% (0.1982 => 0.2249, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 13.01% (0.1230 => 0.1390, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.81% (4.5069 => 5.0841, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.57% (0.4916 => 0.5534, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.6364 => 1.8370, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.05% (3.5339 => 3.9597, std.dev.: 0.0063) MultiSource/Benchmarks/McCat/05-eks/eks: 11.87% (0.4515 => 0.5051, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.61% (0.2385 => 0.2638, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.11% (0.1731 => 0.1906, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.07% (9.2283 => 10.1577, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 8.88% (1.2515 => 1.3626, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.82% (0.5329 => 0.5799, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.64% (0.4524 => 0.4915, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.62% (0.7021 => 0.7626, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.99% (1.2784 => 1.3805, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/hash2: 7.82% (0.4861 => 0.5241, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.66% (1.4642 => 1.5763, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 6.97% (0.1879 => 0.2010, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.6750 => 0.7195, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/chomp: 6.25% (0.1761 => 0.1871, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.82% (5.4682 => 5.7863, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.3255 => 0.3440, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3319 => 0.3495, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.44% (22.4056 => 23.4001, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 4.08% (5.0226 => 5.2277, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 3.56% (0.8418 => 0.8718, std.dev.: 0.0045) MultiSource/Applications/minisat/minisat: 3.50% (0.7447 => 0.7708, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.38% (15.5079 => 16.0320, std.dev.: 0.0140) MultiSource/Applications/SIBsim4/SIBsim4: 3.29% (1.3864 => 1.4320, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.24% (0.9557 => 0.9867, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.18% (0.3491 => 0.3602, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3446 => 0.3553, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.46% (0.4427 => 0.4536, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.3722 => 1.4046, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.32% (0.5168 => 0.5288, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.80% (0.6293 => 0.6406, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 1.49% (18.2933 => 18.5652, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.34% (1.2300 => 1.2465, std.dev.: 0.0038) MultiSource/Applications/d/make_dparser: 1.28% (3.5154 => 3.5603, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8195, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.55% (0.9531 => 1.0251, std.dev.: 0.0060) SingleSource/Regression/C/uint64_to_float: 7.40% (0.5692 => 0.6113, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.04% (1.2783 => 1.3683, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1492, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.19% (54.5751 => 56.3153, std.dev.: 0.1683) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1082, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6054, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (18.2231 => 18.5053, std.dev.: 0.0137) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2494, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2700, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.21% (79.7170 => 80.6846, std.dev.: 0.2960) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.72% (0.7198 => 0.6858, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.73% (0.3831 => 0.3688, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.72% (0.3848 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.66% (0.3880 => 0.3738, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.59% (0.6347 => 0.6119, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.55% (0.3884 => 0.3746, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -3.55% (0.4033 => 0.3890, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.48% (0.3821 => 0.3688, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: -3.26% (0.6441 => 0.6231, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.22% (0.9852 => 0.9535, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.18% (0.4176 => 0.4043, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.09% (2.4924 => 2.4155, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.07% (0.3323 => 0.3221, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.90% (2.1713 => 2.1084, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.87% (20.7746 => 20.1792, std.dev.: 0.0081) SingleSource/UnitTests/ObjC/property: -2.76% (0.4199 => 0.4083, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference: -2.74% (0.7779 => 0.7566, std.dev.: 0.0014) MultiSource/Applications/hexxagon/hexxagon: -2.74% (1.3148 => 1.2788, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.63% (0.9542 => 0.9291, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.47% (0.6484 => 0.6324, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.86% (14.2083 => 13.9435, std.dev.: 0.0035) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (6.7716 => 6.6844, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: -1.15% (16.1920 => 16.0053, std.dev.: 0.0118) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.71% (1.8100 => 0.7111, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3162, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -25.38% (1.3643 => 1.0181, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -23.30% (83.5423 => 64.0766, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2055, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.19% (1.0217 => 0.8461, std.dev.: 0.0117) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.09% (0.3418 => 0.2834, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.07% (2.5106 => 2.1322, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3529, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.96% (0.5142 => 0.4630, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2766, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.49% (7.9763 => 7.7779, std.dev.: 0.0163) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: -2.19% (3.7241 => 3.6427, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.05% (1.3096 => 1.2827, std.dev.: 0.0103) MultiSource/Benchmarks/Bullet/bullet: -1.84% (7.3040 => 7.1699, std.dev.: 0.0035) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4678, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.49% (1.6219 => 1.5977, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.28% (1.6086 => 1.5880, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.00s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 20:54:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 22:54:38 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130045438.925772A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8096?compare_to=8092&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8096, Order: 173884, Start Time: 2013-01-30 02:50:27, End Time: 2013-01-30 04:55:01 To: 8092, Order: 173850, Start Time: 2013-01-30 00:21:16, End Time: 2013-01-30 02:29:20 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (84 on baseline) Performance Improvements: 39 (64 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1019 (915 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C++/ofstream_ctor: 7.64% (0.2187 => 0.2354, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 21.74% (43.3403 => 52.7618, std.dev.: 0.5012) SingleSource/Benchmarks/Misc/flops: 18.55% (7.4766 => 8.8636, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout/nestedloop: 5.99% (0.2019 => 0.2140, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 2.26% (2.6708 => 2.7311, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.72% (3.9626 => 4.0306, std.dev.: 0.0260) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -37.02% (0.1475 => 0.0929, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C++/family/family: -36.73% (0.0697 => 0.0441, std.dev.: 0.0014) SingleSource/Regression/C/DuffsDevice: -36.69% (0.0357 => 0.0226, std.dev.: 0.0033) SingleSource/Regression/C/casts: -34.25% (0.0619 => 0.0407, std.dev.: 0.0067) SingleSource/Regression/C/matrixTranspose: -27.25% (0.0411 => 0.0299, std.dev.: 0.0037) MultiSource/Applications/spiff/spiff: -26.16% (1.2211 => 0.9017, std.dev.: 0.0804) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -18.78% (0.4132 => 0.3356, std.dev.: 0.0229) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -15.99% (0.1163 => 0.0977, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: -15.07% (0.5767 => 0.4898, std.dev.: 0.0069) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -13.82% (1.0556 => 0.9097, std.dev.: 0.0527) MultiSource/Benchmarks/McCat/09-vor/vor: -13.08% (0.3931 => 0.3417, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/08-main/main: -11.17% (0.3267 => 0.2902, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -10.88% (0.1066 => 0.0950, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.61% (0.2790 => 0.2494, std.dev.: 0.0075) MultiSource/Benchmarks/Olden/power/power: -9.24% (0.1504 => 0.1365, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -8.61% (0.1882 => 0.1720, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: -8.25% (4.9115 => 4.5061, std.dev.: 0.1521) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.49% (0.9352 => 0.8652, std.dev.: 0.0222) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.64% (0.1656 => 0.1546, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: -6.42% (0.1590 => 0.1488, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: -5.96% (0.2786 => 0.2620, std.dev.: 0.0051) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.58% (0.2491 => 0.2352, std.dev.: 0.0025) MultiSource/Benchmarks/mafft/pairlocalalign: -5.58% (11.6109 => 10.9635, std.dev.: 0.1513) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.28% (1.4556 => 1.3788, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.98% (1.4354 => 1.3783, std.dev.: 0.0199) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.19% (7.3707 => 7.1358, std.dev.: 0.0768) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.73% (1.3767 => 1.3391, std.dev.: 0.0130) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -44.92% (0.0374 => 0.0206, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -17.14% (2.9370 => 2.4336, std.dev.: 0.1146) MultiSource/Benchmarks/Fhourstones/fhourstones: -16.25% (1.5215 => 1.2742, std.dev.: 0.0221) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.05% (1.3412 => 1.1930, std.dev.: 0.0492) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.85% (3.1680 => 2.9194, std.dev.: 0.0179) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.51% (0.4703 => 0.4444, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.28% (4.2312 => 4.0076, std.dev.: 0.0709) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -4.51% (2.3443 => 2.2385, std.dev.: 0.0364) SingleSource/Benchmarks/Shootout/hash: -3.40% (4.2185 => 4.0752, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -3.11% (3.7090 => 3.5936, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.40% (5.9587 => 5.8752, std.dev.: 0.0307) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.34% (2.6159 => 2.5809, std.dev.: 0.0044) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.82% (1.2271 => 1.2170, std.dev.: 0.0231) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -34.29% (0.0347 => 0.0228, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.44% (0.0452 => 0.0450, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.41% (0.0354 => 0.0349, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -36.59% (0.0522 => 0.0331, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.27% (0.0459 => 0.0444, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: -2.27% (0.0220 => 0.0215, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -0.86% (0.0232 => 0.0230, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 8.70% (0.0230 => 0.0250, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.14% (0.1474 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -4.41% (1.1854 => 1.1331, std.dev.: 0.3354) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.81% (0.4053 => 0.4020, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.11% (0.1507 => 0.1445, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.62% (0.0587 => 0.0620, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -19.42% (0.0278 => 0.0224, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.04% (0.0569 => 0.0546, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -16.67% (0.0018 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.52% (1.2955 => 1.2888, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.00% (0.0030 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0609 => 0.0606, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.43% (0.0361 => 0.0345, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.84% (1.7456 => 1.7309, std.dev.: 0.0101) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 163.83% (0.0047 => 0.0124, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.12% (34.3890 => 34.4297, std.dev.: 0.0228) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 407.44% (0.0336 => 0.1705, std.dev.: 0.0092) SingleSource/Regression/C/sumarraymalloc: 115.70% (0.0293 => 0.0632, std.dev.: 0.0023) SingleSource/Regression/C/sumarray2d: 92.70% (0.0274 => 0.0528, std.dev.: 0.0084) SingleSource/Regression/C/sumarray: 60.38% (0.0265 => 0.0425, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/neural/neural: 59.95% (0.1638 => 0.2620, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 44.09% (0.9120 => 1.3141, std.dev.: 0.0806) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 42.33% (0.9381 => 1.3352, std.dev.: 0.0632) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.94% (0.8926 => 1.2670, std.dev.: 0.0685) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.79% (0.8893 => 1.2609, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.66% (0.9061 => 1.2745, std.dev.: 0.1054) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.90% (0.9564 => 1.3380, std.dev.: 0.0792) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.55% (0.9588 => 1.3380, std.dev.: 0.0833) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.24% (0.8990 => 1.2518, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.44% (0.9091 => 1.2586, std.dev.: 0.1002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.41% (0.9855 => 1.3640, std.dev.: 0.1049) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.71% (0.9998 => 1.3768, std.dev.: 0.0837) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.57% (0.9422 => 1.2962, std.dev.: 0.0854) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.21% (0.9403 => 1.2902, std.dev.: 0.1030) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.68% (0.9512 => 1.3001, std.dev.: 0.0866) SingleSource/Benchmarks/Stanford/IntMM: 36.43% (0.0431 => 0.0588, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.26% (1.0119 => 1.3788, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.90% (0.8912 => 1.2111, std.dev.: 0.1005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.75% (0.8736 => 1.1859, std.dev.: 0.0938) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.30% (1.0867 => 1.4703, std.dev.: 0.1001) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.85% (0.8732 => 1.1775, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.81% (1.0052 => 1.3551, std.dev.: 0.1111) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.17% (0.8846 => 1.1869, std.dev.: 0.0712) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.91% (0.9867 => 1.3114, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.32% (1.0017 => 1.3254, std.dev.: 0.0503) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.85% (0.9788 => 1.2905, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.64% (1.0088 => 1.3179, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.56% (0.9685 => 1.2645, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.26% (0.9127 => 1.1889, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.56% (0.9993 => 1.2947, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.49% (0.9405 => 1.2179, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.27% (0.9550 => 1.2250, std.dev.: 0.0236) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.92% (1.0860 => 1.3783, std.dev.: 0.0199) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.17% (0.0738 => 0.0909, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 19.79% (0.3598 => 0.4310, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.54% (0.0669 => 0.0793, std.dev.: 0.0024) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.43% (0.0738 => 0.0874, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.67% (0.0642 => 0.0749, std.dev.: 0.0032) SingleSource/UnitTests/Vectorizer/gcc-loops: 15.40% (0.4596 => 0.5304, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.40% (0.0805 => 0.0929, std.dev.: 0.0034) SingleSource/Regression/C++/ofstream_ctor: 15.28% (0.2042 => 0.2354, std.dev.: 0.0050) MultiSource/Benchmarks/mafft/pairlocalalign: 15.16% (9.5202 => 10.9635, std.dev.: 0.1513) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 14.99% (0.0707 => 0.0813, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.04% (3.6295 => 4.1390, std.dev.: 0.1475) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.89% (1.0986 => 1.2512, std.dev.: 0.0231) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.31% (0.1240 => 0.1405, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.03% (0.0783 => 0.0885, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.71% (0.1332 => 0.1488, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 11.43% (0.1793 => 0.1998, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.33% (0.1955 => 0.2157, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/ReedSolomon: 9.12% (0.2050 => 0.2237, std.dev.: 0.0055) SingleSource/Benchmarks/Linpack/linpack-pc: 7.95% (0.2566 => 0.2770, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 108012.50% (0.0008 => 0.8649, std.dev.: 0.0213) SingleSource/Benchmarks/Shootout/matrix: 353.26% (1.5825 => 7.1729, std.dev.: 0.0235) SingleSource/Benchmarks/Shootout/ary3: 353.00% (2.2304 => 10.1037, std.dev.: 0.8437) MultiSource/Applications/sgefa/sgefa: 258.95% (0.3515 => 1.2617, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.39% (1.1825 => 4.0606, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.70% (4.8185 => 15.9349, std.dev.: 0.1648) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 221.49% (0.0228 => 0.0733, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 168.22% (0.0129 => 0.0346, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 154.31% (0.0232 => 0.0590, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/matrix: 62.61% (2.9083 => 4.7291, std.dev.: 0.0393) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.37% (0.2562 => 0.3417, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.51% (3.1254 => 4.1102, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.15% (5.6033 => 7.0687, std.dev.: 0.1007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.97% (1.4588 => 1.8376, std.dev.: 0.0806) SingleSource/Regression/C/uint64_to_float: 24.33% (1.5397 => 1.9143, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/salsa20: 22.16% (7.4497 => 9.1008, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.69% (4.8112 => 5.8064, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8567, std.dev.: 0.0162) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6499, std.dev.: 0.0369) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.82% (3.6477 => 3.9695, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/ReedSolomon: 7.91% (8.6447 => 9.3282, std.dev.: 0.0120) SingleSource/Benchmarks/McGill/chomp: 7.80% (1.0425 => 1.1238, std.dev.: 0.0242) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.38% (4.1836 => 4.4087, std.dev.: 0.0094) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.28% (0.6211 => 0.6539, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.07% (4.7473 => 4.9403, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2287, std.dev.: 0.0723) SingleSource/Benchmarks/Misc/pi: 3.74% (2.1390 => 2.2190, std.dev.: 0.0063) SingleSource/Benchmarks/Linpack/linpack-pc: 3.67% (50.8945 => 52.7618, std.dev.: 0.5012) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.75% (0.0808 => 0.0503, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.75% (0.0692 => 0.0500, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.67% (0.0676 => 0.0543, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -18.99% (1.8964 => 1.5362, std.dev.: 0.1070) MultiSource/Benchmarks/Olden/perimeter/perimeter: -18.93% (0.1009 => 0.0818, std.dev.: 0.0032) MultiSource/Applications/hexxagon/hexxagon: -10.55% (1.1433 => 1.0227, std.dev.: 0.0275) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.52% (0.1366 => 0.1236, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -9.35% (6.4235 => 5.8229, std.dev.: 0.0870) MultiSource/Applications/aha/aha: -8.06% (0.1378 => 0.1267, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/hash2: -8.04% (0.5134 => 0.4721, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.93% (0.7693 => 0.7083, std.dev.: 0.0161) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.30% (1.0234 => 0.9487, std.dev.: 0.0219) MultiSource/Applications/viterbi/viterbi: -6.58% (0.1824 => 0.1704, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/fibo: -6.08% (0.2006 => 0.1884, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.20% (0.2481 => 0.2352, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.07% (0.3462 => 0.3321, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.56% (0.3093 => 0.2983, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.86% (11.5523 => 3.9444, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -62.09% (15.6525 => 5.9334, std.dev.: 0.0467) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.08% (0.4146 => 0.1821, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.21% (0.4578 => 0.2371, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.99% (11.3868 => 6.3774, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6279, std.dev.: 0.0498) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.93% (0.4452 => 0.3075, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/bisort/bisort: -30.45% (0.9372 => 0.6518, std.dev.: 0.1053) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.18% (5.2605 => 3.8832, std.dev.: 0.0440) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.84% (0.5495 => 0.4075, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.13% (4.4467 => 3.3294, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.64% (0.5897 => 0.4444, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.77% (0.5826 => 0.4441, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8225, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.46% (16.6791 => 13.4336, std.dev.: 0.4334) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.44% (1.5623 => 1.2742, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7925, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.21% (7.0016 => 5.7964, std.dev.: 0.2843) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -16.19% (1.4235 => 1.1930, std.dev.: 0.0492) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.09% (0.1164 => 0.1000, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.87% (3.1921 => 2.7813, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6746, std.dev.: 0.0342) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.60% (9.7992 => 8.5645, std.dev.: 0.0076) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.50% (5.7056 => 4.9925, std.dev.: 0.0272) SingleSource/Benchmarks/Shootout/hash: -9.96% (4.5259 => 4.0752, std.dev.: 0.0147) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.58% (0.3217 => 0.2973, std.dev.: 0.0010) MultiSource/Applications/SIBsim4/SIBsim4: -7.38% (3.5443 => 3.2827, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.62% (5.5974 => 5.2271, std.dev.: 0.0753) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2490, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.46% (4.2843 => 4.0076, std.dev.: 0.0709) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.82% (4.9799 => 4.6901, std.dev.: 0.0355) MultiSource/Benchmarks/mafft/pairlocalalign: -5.55% (63.1520 => 59.6440, std.dev.: 0.1057) SingleSource/Benchmarks/Shootout-C++/hash2: -4.80% (3.6768 => 3.5002, std.dev.: 0.0344) MultiSource/Benchmarks/Olden/health/health: -4.79% (0.3654 => 0.3479, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.58% (3.7662 => 3.5936, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.36% (3.5127 => 3.3594, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (5.8973 => 5.6832, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.26% (3.5691 => 3.4529, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.95% (3.0082 => 2.9194, std.dev.: 0.0179) MultiSource/Applications/sqlite3/sqlite3: -2.55% (4.4730 => 4.3589, std.dev.: 0.0380) SingleSource/Benchmarks/Misc/ffbench: -2.30% (1.4244 => 1.3917, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.70% (8.7327 => 8.5843, std.dev.: 0.0094) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.68% (85.3042 => 83.8673, std.dev.: 0.1310) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.24% (3.7450 => 3.6986, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.22% (3.3596 => 3.3186, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/whetstone: -1.19% (1.6251 => 1.6057, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.13% (6.8262 => 6.7489, std.dev.: 0.0200) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.02% (1.2047 => 1.2170, std.dev.: 0.0231) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.15% (0.0233 => 0.0228, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.22% (0.0451 => 0.0450, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.42% (0.0394 => 0.0349, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.91% (0.0328 => 0.0331, std.dev.: 0.0083) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.22% (0.0445 => 0.0444, std.dev.: 0.0102) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 1.32% (0.0227 => 0.0230, std.dev.: 0.0058) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.96% (0.0255 => 0.0250, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.53% (0.1530 => 0.1476, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: -41.27% (1.9293 => 1.1331, std.dev.: 0.3354) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.72% (0.4049 => 0.4020, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.30% (0.1510 => 0.1445, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.61% (0.0978 => 0.0620, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.84% (0.0276 => 0.0224, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.46% (0.0590 => 0.0546, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.94% (1.1617 => 1.2888, std.dev.: 0.0106) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.73% (0.0268 => 0.0345, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/puzzle: 132.74% (0.7437 => 1.7309, std.dev.: 0.0101) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 34.78% (0.0092 => 0.0124, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.44% (12.7781 => 34.4297, std.dev.: 0.0228) Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 21:56:57 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Tue, 29 Jan 2013 23:56:57 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130055657.F415B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8097?compare_to=8095&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8097, Order: 173889, Start Time: 2013-01-30 04:22:47, End Time: 2013-01-30 05:57:18 To: 8095, Order: 173881, Start Time: 2013-01-30 02:24:25, End Time: 2013-01-30 03:59:14 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 0 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 86.07% (0.0280 => 0.0521, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.97% (0.0974 => 0.1636, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.14% (0.1132 => 0.1609, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.56% (0.0599 => 0.0830, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.89% (0.6395 => 0.8818, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.29% (0.6395 => 0.8716, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.52% (0.5688 => 0.7538, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.51% (0.5805 => 0.7692, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.48% (0.6260 => 0.8293, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.02% (0.6230 => 0.8225, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.90% (0.5567 => 0.7343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.83% (0.5849 => 0.7711, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.66% (0.5575 => 0.7340, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.52% (0.5581 => 0.7340, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.09% (0.5802 => 0.7606, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.57% (0.5705 => 0.7449, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.53% (0.5569 => 0.7269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.43% (0.5941 => 0.7749, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.39% (0.5478 => 0.7143, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.22% (0.5857 => 0.7627, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.14% (0.5859 => 0.7625, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.96% (0.5570 => 0.7239, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.85% (0.6033 => 0.7834, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.82% (0.5591 => 0.7258, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.54% (1.6474 => 2.1340, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.16% (0.6440 => 0.8318, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.81% (0.5925 => 0.7632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.62% (0.6189 => 0.7960, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.43% (0.5863 => 0.7530, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.31% (0.6676 => 0.8566, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.24% (0.6052 => 0.7761, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.13% (0.6304 => 0.8077, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.75% (0.6446 => 0.8235, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.12% (0.6681 => 0.8493, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 26.91% (0.6194 => 0.7861, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.88% (0.6660 => 0.8450, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.77% (0.6297 => 0.7983, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.12% (0.6667 => 0.8342, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.06% (0.7524 => 0.9334, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.46% (0.7339 => 0.9061, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.28% (2.2587 => 2.7620, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.42% (0.0621 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.09% (0.3357 => 0.3897, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 15.07% (1.1450 => 1.3175, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0015) SingleSource/Benchmarks/McGill/exptree: 13.89% (0.0864 => 0.0984, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.57% (0.1982 => 0.2251, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.38% (4.5069 => 5.0650, std.dev.: 0.0103) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.26% (1.6364 => 1.8371, std.dev.: 0.0044) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.16% (0.4916 => 0.5514, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 11.65% (0.4515 => 0.5041, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.64% (3.5339 => 3.9451, std.dev.: 0.0044) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.57% (0.2385 => 0.2637, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 9.94% (9.2283 => 10.1455, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.88% (0.1731 => 0.1902, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.88% (1.2515 => 1.3626, std.dev.: 0.0030) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.70% (0.1230 => 0.1337, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.69% (0.5329 => 0.5792, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.42% (0.7021 => 0.7612, std.dev.: 0.0108) SingleSource/Benchmarks/Shootout-C++/hash: 8.36% (0.4524 => 0.4902, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.30% (0.2001 => 0.2167, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.78% (1.2784 => 1.3779, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.74% (0.4861 => 0.5237, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.41% (1.4642 => 1.5727, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.31% (0.6750 => 0.7176, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.58% (5.4682 => 5.7732, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.47% (0.3255 => 0.3433, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3319 => 0.3488, std.dev.: 0.0042) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.23% (22.4056 => 23.3539, std.dev.: 0.0236) MultiSource/Applications/spiff/spiff: 3.43% (0.8418 => 0.8707, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 3.36% (5.0226 => 5.1914, std.dev.: 0.0054) MultiSource/Applications/SPASS/SPASS: 3.21% (15.5079 => 16.0057, std.dev.: 0.0170) MultiSource/Applications/minisat/minisat: 3.17% (0.7447 => 0.7683, std.dev.: 0.0035) MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (1.3864 => 1.4297, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.02% (0.3446 => 0.3550, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.92% (0.3491 => 0.3593, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.48% (0.4427 => 0.4537, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.13% (1.3722 => 1.4014, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.99% (0.5168 => 0.5271, std.dev.: 0.0007) MultiSource/Applications/d/make_dparser: 1.15% (3.5154 => 3.5558, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7879, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.35% (0.9531 => 1.0327, std.dev.: 0.0051) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1493, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.61% (54.5751 => 56.5468, std.dev.: 0.0655) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1025, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 1.63% (4.5320 => 4.6057, std.dev.: 0.0083) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2504, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.49% (18.2231 => 18.4942, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2687, std.dev.: 0.0010) MultiSource/Benchmarks/llubenchmark/llu: 1.39% (3.7435 => 3.7956, std.dev.: 0.0165) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.27% (0.7198 => 0.6891, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.91% (0.3837 => 0.3687, std.dev.: 0.0029) MultiSource/Benchmarks/PAQ8p/paq8p: -3.75% (2.4924 => 2.3990, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3821 => 0.3681, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.66% (0.3057 => 0.2945, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.64% (0.9852 => 0.9493, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.62% (0.6347 => 0.6117) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.37% (0.3205 => 0.3097, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.31% (0.3812 => 0.3686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.30% (0.3880 => 0.3752, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.30% (0.4033 => 0.3900, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.26% (0.3831 => 0.3706, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.21% (0.3891 => 0.3766, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.20% (0.3848 => 0.3725) SingleSource/UnitTests/ObjC/synchronized: -3.18% (0.3896 => 0.3772, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.06% (2.1713 => 2.1048, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: -3.02% (0.4176 => 0.4050, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.89% (0.9542 => 0.9266, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: -2.88% (1.3148 => 1.2769, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.68% (0.3884 => 0.3780, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -2.62% (0.7779 => 0.7575, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/property: -2.52% (0.4199 => 0.4093, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.38% (0.6484 => 0.6330, std.dev.: 0.0013) SingleSource/UnitTests/Vector/constpool: -2.29% (20.7746 => 20.2989, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.82% (14.2083 => 13.9502, std.dev.: 0.0062) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.31% (6.7716 => 6.6831, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.29% (0.7919 => 0.7817, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: -1.16% (16.1920 => 16.0038, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.08% (1.0544 => 1.0430, std.dev.: 0.0026) MultiSource/Benchmarks/MallocBench/gs/gs: -1.04% (4.3330 => 4.2878, std.dev.: 0.0103) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.06% (1.8100 => 0.7049, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3137, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -24.58% (1.3643 => 1.0289, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0066) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0840, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.13% (0.2274 => 0.1748, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.09% (0.0756 => 0.0589, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2052, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.12% (2.5106 => 2.1311, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.22% (0.4092 => 0.3510, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3553, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -9.05% (1.2842 => 1.1680, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8192, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1742, std.dev.: 0.0045) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7607, std.dev.: 0.0192) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -2.29% (3.7241 => 3.6389, std.dev.: 0.0075) MultiSource/Benchmarks/Bullet/bullet: -1.85% (7.3040 => 7.1692, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4722, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.34% (1.6307 => 1.6089, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.16% (1.6086 => 1.5899, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 22:31:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 00:31:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130063138.A92662A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8098?compare_to=8094&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8098, Order: 173888, Start Time: 2013-01-30 04:19:51, End Time: 2013-01-30 06:31:59 To: 8094, Order: 173866, Start Time: 2013-01-30 01:37:07, End Time: 2013-01-30 03:49:15 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (230 on baseline) Performance Improvements: 2 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (643 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.73% (10.9269 => 11.2252, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.04% (10.3025 => 10.1951, std.dev.: 0.0042) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.18% (81.1757 => 80.2218, std.dev.: 0.2856) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1331 => 0.1332) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.80% (0.0658 => 0.0683, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8463 => 499.8554, std.dev.: 0.0112) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44225.21% (1.1277 => 499.8554, std.dev.: 0.0112) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.65% (0.5229 => 1.7133, std.dev.: 0.0155) MultiSource/Applications/SPASS/SPASS: 26.84% (14.9895 => 19.0132, std.dev.: 0.0132) MultiSource/Applications/kimwitu++/kc: 48.58% (14.1553 => 21.0320, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/gs/gs: 21.30% (4.1105 => 4.9859, std.dev.: 0.0121) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.46% (1.1048 => 1.7949, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 451.84% (7.1582 => 39.5021, std.dev.: 0.0181) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.85% (3.4629 => 6.6435, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.02% (0.6222 => 1.1450, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.83% (0.0720 => 7.4418, std.dev.: 0.0047) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0030) MultiSource/Applications/SPASS/SPASS: 11101600.00% (0.0001 => 11.1017, std.dev.: 0.0225) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850000.00% (0.0001 => 9.8501, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487100.00% (0.0001 => 5.4872, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 810.76% (1.1194 => 10.1951, std.dev.: 0.0042) MultiSource/Applications/ClamAV/clamscan: 149.38% (22.1758 => 55.3019, std.dev.: 0.0364) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 104.52% (0.0929 => 0.1900, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 81.13% (0.1463 => 0.2650, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 72.69% (0.0271 => 0.0468, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.26% (0.0730 => 0.1221, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.82% (1.5859 => 2.5029, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.10% (2.9384 => 4.6161, std.dev.: 0.0062) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.94% (7.0540 => 11.0000, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/distray/distray: 54.07% (0.1056 => 0.1627, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.98% (8.1363 => 12.2032, std.dev.: 0.0118) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.49% (2.2024 => 3.2484, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.56% (0.0439 => 0.0639) MultiSource/Applications/sgefa/sgefa: 45.42% (0.3109 => 0.4521, std.dev.: 0.0006) SingleSource/UnitTests/vla: 45.35% (0.0355 => 0.0516, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 41.76% (21.9371 => 31.0983, std.dev.: 0.0270) SingleSource/Benchmarks/Misc/flops: 41.69% (0.1432 => 0.2029, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.15% (0.1062 => 0.1499, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.87% (1.5415 => 2.1407, std.dev.: 0.0058) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.19% (4.2646 => 5.8933, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 37.22% (0.0814 => 0.1117, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.97% (0.4615 => 0.6321, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.61% (0.5105 => 0.6974, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.62% (0.2271 => 0.3080, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.04% (0.1892 => 0.2555, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.67% (0.6675 => 0.8989, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.45% (0.0479 => 0.0644, std.dev.: 0.0015) MultiSource/Applications/Burg/burg: 33.89% (1.1642 => 1.5588, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 33.59% (0.4299 => 0.5743, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 32.96% (0.0719 => 0.0956, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.28% (0.1143 => 0.1512, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.64% (0.1125 => 0.1481, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: 31.55% (9.4845 => 12.4770, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/chomp: 31.36% (0.1655 => 0.2174, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.74% (0.1695 => 0.2216, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.50% (3.8922 => 5.0793, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.26% (0.0793 => 0.1033, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 29.89% (0.4289 => 0.5571, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 29.63% (1.0722 => 1.3899, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.49% (0.0746 => 0.0966, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 29.25% (0.2554 => 0.3301, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.10% (0.0457 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.95% (1.4186 => 1.8293, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.36% (0.0730 => 0.0937, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.35% (0.1337 => 0.1716, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 28.18% (0.7115 => 0.9120, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/hash2: 28.01% (0.4620 => 0.5914, std.dev.: 0.0009) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.62% (0.3121 => 0.3983, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.49% (0.1906 => 0.2430, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 27.32% (0.1175 => 0.1496, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.23% (0.0672 => 0.0855, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.95% (0.1566 => 0.1988, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 26.80% (0.6456 => 0.8186, std.dev.: 0.0037) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.24% (0.5020 => 0.6337, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 26.21% (0.0660 => 0.0833, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 26.19% (0.0485 => 0.0612, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.81% (0.1236 => 0.1555, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 25.62% (0.0527 => 0.0662, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.35% (1.3050 => 1.6358, std.dev.: 0.0110) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.26% (0.2700 => 0.3382, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 25.24% (0.0626 => 0.0784, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.19% (0.1032 => 0.1292, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 25.17% (0.7835 => 0.9807, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: 25.14% (0.0871 => 0.1090) MultiSource/Benchmarks/llubenchmark/llu: 25.11% (0.0462 => 0.0578, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 24.95% (0.1555 => 0.1943, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.89% (0.0675 => 0.0843, std.dev.: 0.0008) MultiSource/Applications/aha/aha: 24.85% (0.1151 => 0.1437, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/messages-2: 24.62% (0.0662 => 0.0825) MultiSource/Applications/d/make_dparser: 24.41% (3.3354 => 4.1496, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 24.34% (1.1840 => 1.4722, std.dev.: 0.0060) MultiSource/Applications/oggenc/oggenc: 24.24% (5.7591 => 7.1550, std.dev.: 0.0126) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.13% (0.0953 => 0.1183, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.10% (0.1029 => 0.1277, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 23.82% (0.1163 => 0.1440, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.76% (0.1940 => 0.2401, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.71% (0.3307 => 0.4091, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 23.66% (0.1695 => 0.2096, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.63% (0.5860 => 0.7245, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.52% (0.0842 => 0.1040, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 23.05% (0.3098 => 0.3812, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.02% (4.9449 => 6.0830, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.85% (0.1510 => 0.1855, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 22.80% (0.0614 => 0.0754, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 22.57% (0.0567 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.41% (0.1584 => 0.1939, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 22.40% (0.8921 => 1.0919, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.23% (0.8172 => 0.9989, std.dev.: 0.0024) MultiSource/Applications/treecc/treecc: 22.21% (2.0273 => 2.4776, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.06% (5.0018 => 6.1050, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.04% (0.2758 => 0.3366, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.82% (1.1861 => 1.4449, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 21.82% (0.2049 => 0.2496, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.70% (0.0834 => 0.1015, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.65% (0.9765 => 1.1879, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 21.59% (0.1144 => 0.1391, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.53% (0.6450 => 0.7839, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.41% (0.0467 => 0.0567, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 21.36% (0.3423 => 0.4154, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 21.30% (3.8723 => 4.6971, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.12% (0.2107 => 0.2552) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.87% (0.5569 => 0.6731, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.86% (0.1117 => 0.1350, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 20.84% (0.7433 => 0.8982, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.69% (0.0759 => 0.0916, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 20.66% (2.2969 => 2.7714, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.65% (0.0770 => 0.0929, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.1268 => 0.1529, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.58% (0.0933 => 0.1125, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.94% (0.4203 => 0.5041, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.87% (0.8101 => 0.9711, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.46% (0.5981 => 0.7145, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.44% (0.3441 => 0.4110, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.32% (0.2603 => 0.3106, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.06% (0.1044 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.93% (0.2065 => 0.2456, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 18.92% (0.3283 => 0.3904, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 18.29% (0.3232 => 0.3823, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 18.24% (0.3180 => 0.3760, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.61% (0.0704 => 0.0828, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 17.51% (0.3387 => 0.3980, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.19% (0.8067 => 0.9454, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: 16.99% (0.3379 => 0.3953, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.72% (0.4636 => 0.5411, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.66% (0.3865 => 0.4509, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 15.93% (17.1811 => 19.9189, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 15.32% (1.5603 => 1.7994, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/moments: 15.02% (0.4048 => 0.4656, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.96% (0.4103 => 0.4717, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 14.93% (0.3684 => 0.4234, std.dev.: 0.0086) SingleSource/Regression/C++/ofstream_ctor: 14.91% (0.2905 => 0.3338, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.79% (0.3422 => 0.3928, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.59% (0.3427 => 0.3927, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/sieve: 14.32% (0.3603 => 0.4119, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 14.00% (0.3092 => 0.3525, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.92% (0.3282 => 0.3739, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.91% (0.1114 => 0.1269, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.70% (14.3668 => 16.3356, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.56% (0.4064 => 0.4615, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.30% (0.3826 => 0.4335, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.29% (0.2430 => 0.2753, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/property: 12.92% (0.3886 => 0.4388, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.04% (0.3828 => 0.4289, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.91% (0.3543 => 0.3965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.73% (0.2831 => 0.3163, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.57% (0.3543 => 0.3953, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.48% (0.3694 => 0.4118, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 11.40% (0.3473 => 0.3869, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 11.29% (0.3561 => 0.3963, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.21% (0.3516 => 0.3910, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 11.01% (1.2842 => 1.4256, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.90% (0.3935 => 0.4364, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 10.90% (0.2871 => 0.3184, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.88% (2.0665 => 2.2914, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 10.81% (0.2877 => 0.3188, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.58% (0.3650 => 0.4036, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.56% (0.2756 => 0.3047, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.44% (0.3162 => 0.3492, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.42% (0.2793 => 0.3084, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hello: 10.39% (0.2714 => 0.2996, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2725 => 0.3008, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 10.32% (0.6030 => 0.6652, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.28% (0.1625 => 0.1792, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.17% (0.2891 => 0.3185, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 10.02% (63.2438 => 69.5829, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.89% (0.2872 => 0.3156, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 9.83% (0.3052 => 0.3352, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.81% (0.2802 => 0.3077, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 9.62% (0.7326 => 0.8031, std.dev.: 0.0023) SingleSource/UnitTests/ObjC++/Hello: 9.38% (0.5925 => 0.6481, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.25% (0.1330 => 0.1453, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.22% (0.3136 => 0.3425, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.84% (2.2022 => 2.3968, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: 8.28% (10.3673 => 11.2252, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.96% (0.3177 => 0.3430, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.72% (0.1438 => 0.1549, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.01% (0.1440 => 0.1541, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.49% (0.3131 => 0.3303, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.66% (7.9617 => 8.3328, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.93% (0.3817 => 0.3967, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3124, std.dev.: 0.0011) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4727, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.24% (1.1145 => 1.2955, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6974, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 13.06% (0.5413 => 0.6120, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.87% (11.6436 => 12.4438, std.dev.: 0.1123) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.35% (4.2280 => 4.4543, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3108, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.3316 => 0.3446, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (2.0360 => 2.1047, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.21% (0.9957 => 1.0277, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.65% (8.6802 => 8.9105, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.36% (3.6395 => 3.7254, std.dev.: 0.0054) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.94% (3.1595 => 3.2207, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.82% (9.1159 => 9.2819, std.dev.: 0.0311) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2894, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0059) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4541, std.dev.: 0.0096) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.78% (6.6874 => 0.1485, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.67% (5.2763 => 1.1781, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/salsa20: -75.46% (0.8651 => 0.2123, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.86% (0.1622 => 0.0943, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.84% (5.3855 => 4.4787, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.19% (5.3526 => 4.4862, std.dev.: 0.0115) MultiSource/Applications/JM/ldecod/ldecod: -11.51% (10.4361 => 9.2349, std.dev.: 0.0242) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9841, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.96% (1.7609 => 1.6384, std.dev.: 0.0039) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.52% (1.9577 => 0.6751, std.dev.: 0.0037) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0088) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3068, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/mandel-2: -33.71% (1.5373 => 1.0190, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4295, std.dev.: 0.0026) MultiSource/Benchmarks/PAQ8p/paq8p: -24.85% (85.0658 => 63.9278, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.55% (2.6546 => 2.0029, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7335, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.08% (0.9540 => 0.8388, std.dev.: 0.0008) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4943, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.09% (1.5660 => 1.4236, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.85% (1.2373 => 1.1526, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.83% (19.9488 => 18.5853, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5861, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.56% (8.1563 => 7.7026, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.79% (1.5835 => 1.5076, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -4.75% (10.2830 => 9.7945, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.70% (0.4808 => 0.4582, std.dev.: 0.0010) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0093) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.88% (3.6994 => 3.6299, std.dev.: 0.0136) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6759, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/ary3: -1.49% (3.7221 => 3.6668, std.dev.: 0.0141) MultiSource/Applications/sqlite3/sqlite3: -1.31% (4.6441 => 4.5834, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.30% (0.1485 => 0.1332) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.72% (0.2116 => 0.0683, std.dev.: 0.0022) Report Time: 1.61s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 23:18:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 01:18:52 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130071852.59A342A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8099?compare_to=8096&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8099, Order: 173893, Start Time: 2013-01-30 05:15:15, End Time: 2013-01-30 07:19:15 To: 8096, Order: 173884, Start Time: 2013-01-30 02:50:27, End Time: 2013-01-30 04:55:01 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 4 (71 on baseline) Performance Improvements: 3 (71 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1057 (921 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: 2.78% (10.9635 => 11.2687, std.dev.: 0.0306) MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.26% (1.1224 => 1.1365, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.70% (0.3455 => 0.3583, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.84% (4.9403 => 5.0805, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/nestedloop: -7.10% (0.2140 => 0.1988, std.dev.: 0.0029) SingleSource/Benchmarks/McGill/misr: -2.07% (0.4891 => 0.4790, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C++/primes/primes: -1.29% (0.9023 => 0.8907, std.dev.: 0.0045) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.22% (1.2170 => 1.2197, std.dev.: 0.0582) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.44% (0.0228 => 0.0227, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0450 => 0.0435, std.dev.: 0.0152) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.72% (0.0349 => 0.0336, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.81% (0.0331 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0444 => 0.0430, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: -0.47% (0.0215 => 0.0214, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: -3.91% (0.0230 => 0.0221, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.40% (0.0250 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1476 => 0.1484, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: 2.07% (1.1331 => 1.1566, std.dev.: 0.1325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.74% (0.4020 => 0.3950, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.66% (0.1445 => 0.1469, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.68% (0.0620 => 0.0680, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.21% (0.0224 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.62% (0.0546 => 0.0604, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.54% (1.2888 => 1.3087, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 61.11% (0.0018 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.17% (0.0606 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.12% (0.0345 => 0.0373, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.06% (1.7309 => 1.6953, std.dev.: 0.0886) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -41.13% (0.0124 => 0.0073, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.54% (34.4297 => 34.2450, std.dev.: 0.0991) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.21% (0.0336 => 0.1674, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.27% (0.9120 => 1.2975, std.dev.: 0.1069) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.47% (0.8926 => 1.2628, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.29% (0.9612 => 1.3581, std.dev.: 0.0584) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.03% (0.9588 => 1.3522, std.dev.: 0.0450) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.53% (0.9564 => 1.3440, std.dev.: 0.0720) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.41% (0.8990 => 1.2533, std.dev.: 0.0338) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.87% (0.9855 => 1.3686, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.57% (0.9422 => 1.3056, std.dev.: 0.0835) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.85% (0.8912 => 1.2285, std.dev.: 0.0131) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.79% (0.9010 => 1.2415, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.76% (0.9998 => 1.3773, std.dev.: 0.1079) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.52% (0.9403 => 1.2931, std.dev.: 0.1242) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.87% (0.9512 => 1.3019, std.dev.: 0.0522) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.73% (0.8736 => 1.1945, std.dev.: 0.0366) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.30% (1.0867 => 1.4812, std.dev.: 0.0886) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.93% (1.0119 => 1.3755, std.dev.: 0.0494) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.19% (0.8732 => 1.1805, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.17% (1.0052 => 1.3587, std.dev.: 0.1129) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.02% (0.8846 => 1.1944, std.dev.: 0.0778) SingleSource/Benchmarks/McGill/exptree: 34.23% (0.0859 => 0.1153, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.41% (0.9867 => 1.3164, std.dev.: 0.0541) SingleSource/Benchmarks/Stanford/IntMM: 33.18% (0.0431 => 0.0574, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.72% (0.9507 => 1.2618, std.dev.: 0.0872) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.34% (0.9788 => 1.2953, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.68% (0.9488 => 1.2494, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.42% (0.9685 => 1.2631, std.dev.: 0.0258) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.34% (0.9127 => 1.1896, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.15% (0.9993 => 1.3006, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.75% (0.9405 => 1.2203, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.82% (1.0860 => 1.3881, std.dev.: 0.0426) MultiSource/Applications/sgefa/sgefa: 22.37% (0.3598 => 0.4403, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.13% (0.0669 => 0.0797, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 18.37% (9.5202 => 11.2687, std.dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.72% (0.0963 => 0.1124, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.32% (3.6295 => 4.1854, std.dev.: 0.1466) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.90% (1.0986 => 1.2513, std.dev.: 0.0400) SingleSource/Benchmarks/Misc/ReedSolomon: 11.46% (0.2050 => 0.2285, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 10.69% (0.2385 => 0.2640, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.77% (0.1955 => 0.2146, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/chomp: 9.65% (0.1793 => 0.1966, std.dev.: 0.0035) SingleSource/Benchmarks/Linpack/linpack-pc: 8.22% (0.2566 => 0.2777, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.54% (1.8651 => 2.0057, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.09% (0.2879 => 0.3083, std.dev.: 0.0064) MultiSource/Benchmarks/7zip/7zip-benchmark: 6.39% (44.1538 => 46.9746, std.dev.: 0.8356) SingleSource/Benchmarks/Misc-C++/bigfib: 5.32% (0.6711 => 0.7068, std.dev.: 0.0110) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107262.50% (0.0008 => 0.8589, std.dev.: 0.0259) SingleSource/Benchmarks/Shootout/matrix: 355.04% (1.5825 => 7.2010, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout/ary3: 282.99% (2.2304 => 8.5423, std.dev.: 2.2033) MultiSource/Applications/sgefa/sgefa: 257.24% (0.3515 => 1.2557, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.71% (1.1825 => 4.0407, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.67% (4.8185 => 15.9332, std.dev.: 0.1542) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 203.51% (0.0228 => 0.0692, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary2: 202.33% (0.0129 => 0.0390, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary: 140.52% (0.0232 => 0.0558, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 63.40% (2.9083 => 4.7521, std.dev.: 0.0229) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.45% (0.2562 => 0.3419, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 31.45% (5.6033 => 7.3653, std.dev.: 0.1652) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.04% (3.1254 => 4.0954, std.dev.: 0.0357) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.27% (1.4588 => 1.8712, std.dev.: 0.0192) SingleSource/Regression/C/uint64_to_float: 23.40% (1.5397 => 1.9000, std.dev.: 0.0406) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.44% (4.8112 => 5.7947, std.dev.: 0.0232) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.89% (9.0082 => 10.2593, std.dev.: 0.2001) MultiSource/Applications/JM/lencod/lencod: 13.76% (6.8159 => 7.7541, std.dev.: 0.1152) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.15% (5.1752 => 5.8556, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6496, std.dev.: 0.0385) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.19% (3.6477 => 3.9828, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.02% (4.7473 => 5.0805, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/chomp: 5.99% (1.0425 => 1.1049, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.29% (4.1836 => 4.4051, std.dev.: 0.0171) SingleSource/Benchmarks/Linpack/linpack-pc: 4.25% (50.8945 => 53.0590, std.dev.: 0.1091) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.74% (0.0808 => 0.0495, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.46% (0.0727 => 0.0491, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.90% (0.0692 => 0.0492, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -25.00% (0.1888 => 0.1416, std.dev.: 0.0037) MultiSource/Applications/hbd/hbd: -19.17% (1.8964 => 1.5328, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.93% (0.1684 => 0.1382, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.25% (0.1009 => 0.0845, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.02% (1.0960 => 0.9314, std.dev.: 0.0370) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.16% (0.7686 => 0.6598, std.dev.: 0.0123) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.62% (0.1079 => 0.0932, std.dev.: 0.0034) MultiSource/Applications/aha/aha: -10.96% (0.1378 => 0.1227, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -10.19% (1.1433 => 1.0268, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: -9.88% (1.5979 => 1.4400, std.dev.: 0.0211) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.54% (0.7693 => 0.6959, std.dev.: 0.0171) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.91% (6.4235 => 5.8513, std.dev.: 0.2023) SingleSource/Benchmarks/Shootout-C++/hash2: -8.67% (0.5134 => 0.4689, std.dev.: 0.0067) MultiSource/Applications/lua/lua: -8.57% (4.6406 => 4.2427, std.dev.: 0.0537) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.05% (0.1366 => 0.1256, std.dev.: 0.0020) MultiSource/Applications/sqlite3/sqlite3: -7.45% (17.5634 => 16.2547, std.dev.: 0.4633) MultiSource/Applications/ClamAV/clamscan: -6.90% (17.4365 => 16.2326, std.dev.: 0.1209) MultiSource/Applications/siod/siod: -6.51% (2.6437 => 2.4716, std.dev.: 0.0479) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.49% (1.2154 => 1.1365, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -6.42% (1.3979 => 1.3081, std.dev.: 0.0164) SingleSource/Benchmarks/Shootout-C++/fibo: -6.33% (0.2006 => 0.1879, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.43% (0.2283 => 0.2159, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: -4.97% (0.4002 => 0.3803, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.67% (0.2615 => 0.2493, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.57% (0.3665 => 0.3534, std.dev.: 0.0037) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.44% (1.1731 => 1.1328, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.79% (1.3220 => 1.2851, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.82% (11.5523 => 3.9485, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/fp-convert: -61.25% (15.6525 => 6.0652, std.dev.: 0.0892) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.08% (0.4146 => 0.1821, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.25% (0.4578 => 0.2369, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.94% (11.3868 => 6.3832, std.dev.: 0.0597) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.97% (5.4023 => 3.6214, std.dev.: 0.1112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.91% (0.4452 => 0.3076, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.13% (0.5495 => 0.4004, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.16% (5.2605 => 3.8844, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3285, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.57% (0.5826 => 0.4453, std.dev.: 0.0310) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0082) MultiSource/Applications/minisat/minisat: -22.56% (7.9891 => 6.1867, std.dev.: 0.2264) SingleSource/Benchmarks/Shootout-C++/heapsort: -21.55% (4.2042 => 3.2983, std.dev.: 0.3325) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -21.16% (0.5897 => 0.4649, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.69% (5.8755 => 4.7772, std.dev.: 0.0190) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.21% (16.6791 => 13.6412, std.dev.: 0.4921) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -17.29% (9.7992 => 8.1048, std.dev.: 0.2622) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.18% (3.1921 => 2.7715, std.dev.: 0.0293) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.92% (5.3626 => 4.6697, std.dev.: 0.0097) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9939, std.dev.: 0.0789) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.51% (0.4081 => 0.3652, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/nestedloop: -9.64% (0.2200 => 0.1988, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: -7.96% (3.5443 => 3.2621, std.dev.: 0.0111) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.74% (0.3217 => 0.2968, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2275, std.dev.: 0.0144) MultiSource/Benchmarks/mafft/pairlocalalign: -5.52% (63.1520 => 59.6631, std.dev.: 0.0992) SingleSource/Benchmarks/McGill/queens: -5.25% (1.7443 => 1.6528, std.dev.: 0.0209) SingleSource/Benchmarks/Shootout-C++/hash2: -4.69% (3.6768 => 3.5042, std.dev.: 0.0252) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.62% (4.9799 => 4.7500, std.dev.: 0.0273) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.57% (3.5127 => 3.3522, std.dev.: 0.0070) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.69% (2.5170 => 2.4241, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.60% (5.8973 => 5.6850, std.dev.: 0.0401) SingleSource/Benchmarks/Shootout-C++/lists: -3.19% (17.2182 => 16.6688, std.dev.: 0.0594) SingleSource/Benchmarks/Misc/ffbench: -2.14% (1.4244 => 1.3939, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.90% (8.7327 => 8.5667, std.dev.: 0.0119) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (85.3042 => 83.8791, std.dev.: 0.2428) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.62% (8.8249 => 8.6822, std.dev.: 0.0250) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.25% (3.3596 => 3.3177, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/methcall: -1.16% (8.7416 => 8.6404, std.dev.: 0.0237) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7483, std.dev.: 0.0223) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.25% (1.2047 => 1.2197, std.dev.: 0.0582) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.58% (0.0233 => 0.0227, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0152) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.37% (0.0445 => 0.0430, std.dev.: 0.0043) SingleSource/UnitTests/Vector/Altivec/casts: 0.47% (0.0213 => 0.0214, std.dev.: 0.0066) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0035) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -3.01% (0.1530 => 0.1484, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -40.05% (1.9293 => 1.1566, std.dev.: 0.1325) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.45% (0.4049 => 0.3950, std.dev.: 0.0331) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.72% (0.1510 => 0.1469, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.47% (0.0978 => 0.0680, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.37% (0.0590 => 0.0604, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.65% (1.1617 => 1.3087, std.dev.: 0.0397) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 127.95% (0.7437 => 1.6953, std.dev.: 0.0886) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: -20.65% (0.0092 => 0.0073, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.00% (12.7781 => 34.2450, std.dev.: 0.0991) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 23:54:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 01:54:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130075451.C90152A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8100?compare_to=8097&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8100, Order: 173898, Start Time: 2013-01-30 06:20:57, End Time: 2013-01-30 07:55:13 To: 8097, Order: 173889, Start Time: 2013-01-30 04:22:47, End Time: 2013-01-30 05:57:18 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (123 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (878 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Linpack/linpack-pc: 1.75% (76.4741 => 77.8136, std.dev.: 0.0210) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/neural/neural: 46.00% (0.1500 => 0.2190, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.15% (0.6395 => 0.8835, std.dev.: 0.0109) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.48% (0.6395 => 0.8728, std.dev.: 0.0008) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.92% (0.5456 => 0.7252, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.91% (0.5688 => 0.7560, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.64% (0.5805 => 0.7700, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.57% (0.6260 => 0.8299, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.35% (0.5849 => 0.7741, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.27% (0.5575 => 0.7374, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.26% (0.6230 => 0.8240, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.12% (0.5567 => 0.7355, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.11% (0.5581 => 0.7373, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.30% (0.5802 => 0.7618, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.85% (0.5705 => 0.7465, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 30.76% (0.0699 => 0.0914, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.74% (0.5478 => 0.7162, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.66% (0.5857 => 0.7653, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.58% (0.5569 => 0.7272, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.36% (0.5570 => 0.7261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.31% (0.5859 => 0.7635, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.28% (0.6033 => 0.7860, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.28% (0.5591 => 0.7284, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.00% (1.6474 => 2.1417, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.20% (0.5925 => 0.7655, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.20% (0.6189 => 0.7996, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.70% (0.6676 => 0.8592, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.65% (0.5863 => 0.7543, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.52% (0.6052 => 0.7778, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.51% (0.6304 => 0.8101, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.06% (0.6446 => 0.8255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.72% (0.6681 => 0.8533, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.30% (0.6297 => 0.8016, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.28% (0.6194 => 0.7884, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.27% (0.6660 => 0.8476, std.dev.: 0.0183) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.68% (0.6667 => 0.8379, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.31% (0.7524 => 0.9353, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.65% (0.7339 => 0.9075, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.87% (2.2587 => 2.7752, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.90% (0.0621 => 0.0757, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.10% (0.1146 => 0.1342) MultiSource/Applications/sgefa/sgefa: 16.23% (0.3357 => 0.3902, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.44% (1.1450 => 1.3218, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.03% (0.1982 => 0.2260, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (4.5069 => 5.0794, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.6364 => 1.8413, std.dev.: 0.0102) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.47% (0.4916 => 0.5529, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.04% (3.5339 => 3.9595, std.dev.: 0.0168) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.87% (0.4515 => 0.5051, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.82% (0.2385 => 0.2643, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.81% (0.1230 => 0.1363, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.28% (9.2283 => 10.1768, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/BoolLiteralTest: 9.94% (0.3834 => 0.4215, std.dev.: 0.0122) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.59% (0.1731 => 0.1897, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.23% (0.5329 => 0.5821, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 8.97% (1.2515 => 1.3638, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.94% (0.7021 => 0.7649, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.71% (0.4524 => 0.4918, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: 8.31% (0.4861 => 0.5265, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.25% (0.2001 => 0.2166, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.02% (1.2784 => 1.3809, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.68% (1.4642 => 1.5766, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/bigfib: 6.87% (0.6750 => 0.7214, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.1879 => 0.2000, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.28% (5.4682 => 5.8114, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 5.93% (0.3255 => 0.3448, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3319 => 0.3498, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.83% (22.4056 => 23.4871, std.dev.: 0.0092) MultiSource/Applications/oggenc/oggenc: 4.09% (5.0226 => 5.2281, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.95% (0.3491 => 0.3629, std.dev.: 0.0026) MultiSource/Applications/minisat/minisat: 3.64% (0.7447 => 0.7718, std.dev.: 0.0006) MultiSource/Applications/SPASS/SPASS: 3.62% (15.5079 => 16.0693, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: 3.57% (0.3446 => 0.3569, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.54% (0.8418 => 0.8716, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.49% (0.9557 => 0.9891, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0003) MultiSource/Applications/SIBsim4/SIBsim4: 3.20% (1.3864 => 1.4308, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.91% (0.4427 => 0.4556, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.54% (1.3722 => 1.4071, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.40% (0.5168 => 0.5292, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.15% (0.6293 => 0.6428, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 1.69% (18.2933 => 18.6019, std.dev.: 0.0213) MultiSource/Benchmarks/Bullet/bullet: 1.53% (34.0927 => 34.6149, std.dev.: 0.0206) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.41% (1.2300 => 1.2473, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 1.39% (3.5154 => 3.5642, std.dev.: 0.0099) MultiSource/Applications/treecc/treecc: 1.03% (2.1401 => 2.1622, std.dev.: 0.0029) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8080, std.dev.: 0.0121) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.33% (0.9531 => 1.0325, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.57% (54.5751 => 56.5245, std.dev.: 0.1095) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.51% (2.0478 => 2.1197, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.64% (18.2231 => 18.5216, std.dev.: 0.0054) MultiSource/Applications/sqlite3/sqlite3: 1.62% (4.5320 => 4.6052, std.dev.: 0.0034) MultiSource/Benchmarks/mafft/pairlocalalign: 1.54% (27.8210 => 28.2498, std.dev.: 0.0011) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.35% (5.1955 => 5.2655, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.06% (10.3489 => 10.4588, std.dev.: 0.0238) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.33% (0.3831 => 0.3665, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3812 => 0.3648, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.29% (0.7198 => 0.6889, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.23% (0.3880 => 0.3716, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.16% (0.3896 => 0.3734, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-3: -4.16% (0.3848 => 0.3688, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -4.14% (0.4033 => 0.3866, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.4176 => 0.4017, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.66% (0.3884 => 0.3742, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.64% (0.3821 => 0.3682, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.43% (0.9852 => 0.9514, std.dev.: 0.0038) MultiSource/Benchmarks/PAQ8p/paq8p: -3.30% (2.4924 => 2.4101, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.21% (0.3837 => 0.3714, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: -3.17% (0.4199 => 0.4066, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.06% (0.6347 => 0.6153, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4280 => 0.4158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -2.76% (0.6441 => 0.6263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.63% (2.1713 => 2.1142, std.dev.: 0.0019) MultiSource/Applications/hexxagon/hexxagon: -2.54% (1.3148 => 1.2814, std.dev.: 0.0005) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2853, std.dev.: 0.0177) SingleSource/UnitTests/ObjC++/property-reference: -2.28% (0.7779 => 0.7602, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.22% (0.6484 => 0.6340, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.74% (14.2083 => 13.9607, std.dev.: 0.0097) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.39% (6.7716 => 6.6772, std.dev.: 0.0095) MultiSource/Applications/JM/lencod/lencod: -1.03% (16.1920 => 16.0250, std.dev.: 0.0128) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.01% (1.0544 => 1.0438, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.58% (1.8100 => 0.6773, std.dev.: 0.0130) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3095, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/mandel-2: -24.63% (1.3643 => 1.0283, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7554, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -23.29% (83.5423 => 64.0840, std.dev.: 0.0067) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3644, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.90% (4.1024 => 3.2041, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -15.27% (2.5106 => 2.1273, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0918, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3535, std.dev.: 0.0120) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.00% (0.3626 => 0.3227, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.04% (0.5142 => 0.4626, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1068, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.99% (2.2633 => 2.1730, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4010, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.69% (7.9763 => 7.7617, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout/ary3: -2.38% (3.7241 => 3.6355, std.dev.: 0.0108) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.34% (3.1919 => 3.1172, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1727, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7075, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5991, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.35% (1.6307 => 1.6087, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.32% (1.3096 => 1.2923, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.04% (1.6086 => 1.5918, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Tue Jan 29 23:57:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 01:57:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130130075744.06CCC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8101?compare_to=8093&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8101, Order: 173888, Start Time: 2013-01-30 04:21:47, End Time: 2013-01-30 07:58:05 To: 8093, Order: 173842, Start Time: 2013-01-29 23:50:39, End Time: 2013-01-30 03:25:16 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 4 (190 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (747 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.20% (0.5987 => 0.6119, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.59% (2.3456 => 2.3829, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.34% (2.0727 => 2.1211, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.20% (54.2137 => 54.8667, std.dev.: 0.0245) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.08% (131.0865 => 124.4230, std.dev.: 0.4381) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.96% (0.0625 => 0.0906, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.65% (0.1063 => 0.1442, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 31.42% (0.0331 => 0.0435, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 30.56% (0.1106 => 0.1444, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.39% (0.0714 => 0.0931, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 29.86% (0.4139 => 0.5375, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.84% (0.2969 => 0.3855, std.dev.: 0.0198) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.25% (0.0547 => 0.0707, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.17% (0.5900 => 0.7562, std.dev.: 0.0187) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.39% (0.4994 => 0.6362, std.dev.: 0.0165) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 27.23% (0.0415 => 0.0528, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.16% (0.0475 => 0.0604, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.16% (0.4253 => 0.5408, std.dev.: 0.0050) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.08% (0.5000 => 0.6354, std.dev.: 0.0070) MultiSource/Applications/oggenc/oggenc: 26.76% (1.5932 => 2.0196, std.dev.: 0.0027) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.54% (0.0584 => 0.0739, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/tsp/tsp: 26.04% (0.0599 => 0.0755, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.62% (0.1620 => 0.2035, std.dev.: 0.0050) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.47% (0.1021 => 0.1281, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 25.08% (0.0897 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.73% (0.1549 => 0.1932, std.dev.: 0.0028) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.49% (0.0584 => 0.0727, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 24.30% (0.1107 => 0.1376, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 24.26% (0.0948 => 0.1178, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 24.21% (0.0822 => 0.1021, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.17% (0.0633 => 0.0786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.93% (0.1003 => 0.1243, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/power/power: 23.84% (0.0604 => 0.0748, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.84% (0.0495 => 0.0613, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.83% (0.0642 => 0.0795, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 23.67% (0.0452 => 0.0559, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.66% (0.1103 => 0.1364, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 23.47% (0.3890 => 0.4803, std.dev.: 0.0109) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.44% (0.1604 => 0.1980, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.39% (0.3903 => 0.4816, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/05-eks/eks: 23.35% (0.1619 => 0.1997, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.28% (0.2736 => 0.3373, std.dev.: 0.0073) MultiSource/Benchmarks/Olden/health/health: 23.14% (0.0821 => 0.1011, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 23.12% (0.1462 => 0.1800, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.11% (0.0541 => 0.0666, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.75% (0.2866 => 0.3518, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.65% (0.3271 => 0.4012, std.dev.: 0.0107) MultiSource/Applications/spiff/spiff: 22.46% (0.4029 => 0.4934, std.dev.: 0.0155) MultiSource/Applications/viterbi/viterbi: 22.39% (0.0947 => 0.1159, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.24% (0.1088 => 0.1330, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/08-main/main: 22.00% (0.1218 => 0.1486, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 21.78% (0.0808 => 0.0984, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 21.75% (0.5026 => 0.6119, std.dev.: 0.0044) MultiSource/Applications/aha/aha: 21.41% (0.0481 => 0.0584, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/mst/mst: 21.20% (0.0698 => 0.0846, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.20% (0.2014 => 0.2441, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 21.20% (0.1505 => 0.1824, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.07% (1.3152 => 1.5923, std.dev.: 0.0333) MultiSource/Applications/Burg/burg: 20.86% (0.5546 => 0.6703, std.dev.: 0.0102) MultiSource/Benchmarks/MallocBench/gs/gs: 20.53% (1.8794 => 2.2653, std.dev.: 0.0117) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.45% (0.0572 => 0.0689, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.17% (0.0605 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.09% (0.1160 => 0.1393, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.90% (0.0573 => 0.0687, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 19.79% (0.5826 => 0.6979, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.79% (3.5627 => 4.2676, std.dev.: 0.0900) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.71% (0.4658 => 0.5576, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.66% (0.1968 => 0.2355, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 19.63% (0.1284 => 0.1536, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/property-reference-object: 19.46% (0.5889 => 0.7035, std.dev.: 0.0036) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.41% (1.6211 => 1.9357, std.dev.: 0.0111) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 19.35% (1.9966 => 2.3829, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 19.30% (0.9697 => 1.1569, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/objinst: 19.13% (0.2823 => 0.3363, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.08% (0.4361 => 0.5193, std.dev.: 0.0069) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 18.94% (0.7171 => 0.8529, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.82% (0.2875 => 0.3416, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 18.81% (0.2813 => 0.3342, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.75% (0.3930 => 0.4667, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/18-imp/imp: 18.72% (0.1421 => 0.1687, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 18.69% (0.2750 => 0.3264, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 18.68% (0.2811 => 0.3336, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 18.63% (1.0781 => 1.2789, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/matrix: 18.56% (0.2780 => 0.3296, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.55% (0.2738 => 0.3246, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.52% (0.2911 => 0.3450, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.47% (2.7292 => 3.2333, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.40% (0.3195 => 0.3783, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.34% (0.2792 => 0.3304, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 18.28% (0.2714 => 0.3210, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/random: 18.23% (0.2803 => 0.3314, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/fibo: 18.20% (0.2725 => 0.3221, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.13% (2.0673 => 2.4421, std.dev.: 0.0139) MultiSource/Applications/ClamAV/clamscan: 18.11% (4.2109 => 4.9733, std.dev.: 0.0375) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.10% (0.2729 => 0.3223, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.09% (1.9694 => 2.3257, std.dev.: 0.0494) MultiSource/Benchmarks/nbench/nbench: 18.04% (0.2566 => 0.3029, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/Large/ray: 18.04% (0.3625 => 0.4279, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 17.84% (0.9909 => 1.1677, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 17.83% (0.0561 => 0.0661, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 17.81% (0.3004 => 0.3539, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 17.78% (0.3267 => 0.3848, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 17.74% (0.3258 => 0.3836, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 17.67% (0.3096 => 0.3643, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.65% (4.4195 => 5.1994, std.dev.: 0.0305) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.58% (0.3060 => 0.3598, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.54% (0.3124 => 0.3672, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 17.49% (0.3317 => 0.3897, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.34% (0.3362 => 0.3945, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sieve: 17.31% (0.3726 => 0.4371, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 17.20% (0.3348 => 0.3924, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.16% (0.1090 => 0.1277, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 17.13% (0.7875 => 0.9224, std.dev.: 0.0148) MultiSource/Applications/lua/lua: 17.11% (1.4269 => 1.6710, std.dev.: 0.0102) SingleSource/UnitTests/ObjC/exceptions-2: 17.09% (0.3446 => 0.4035, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/exceptions-4: 17.06% (0.3465 => 0.4056, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.03% (0.3282 => 0.3841, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 16.98% (0.3469 => 0.4058, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: 16.96% (0.3496 => 0.4089, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.94% (0.3488 => 0.4079, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 16.91% (0.3442 => 0.4024, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 16.91% (0.3460 => 0.4045, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 16.88% (0.3477 => 0.4064, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.82% (23.5202 => 27.4770, std.dev.: 0.0361) SingleSource/Benchmarks/Shootout-C++/hash: 16.67% (0.4146 => 0.4837, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/moments: 16.67% (0.3678 => 0.4291, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 16.58% (0.3650 => 0.4255, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 16.56% (0.4251 => 0.4955, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/exceptions: 16.44% (0.3643 => 0.4242, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 16.43% (0.3724 => 0.4336, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.43% (0.3981 => 0.4635, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.34% (0.3690 => 0.4293, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 15.94% (0.2691 => 0.3120, std.dev.: 0.0019) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.81% (0.3845 => 0.4453, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.76% (0.2075 => 0.2402, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.75% (0.0673 => 0.0779, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 15.51% (5.5417 => 6.4011, std.dev.: 0.0337) SingleSource/Benchmarks/Misc-C++/bigfib: 15.46% (0.5012 => 0.5787, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.18% (0.6435 => 0.7412, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 15.18% (2.1653 => 2.4939, std.dev.: 0.0341) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.08% (0.1028 => 0.1183, std.dev.: 0.0007) MultiSource/Benchmarks/sim/sim: 14.91% (0.0758 => 0.0871, std.dev.: 0.0020) MultiSource/Applications/JM/lencod/lencod: 14.72% (4.6177 => 5.2976, std.dev.: 0.0375) MultiSource/Benchmarks/mafft/pairlocalalign: 14.61% (2.1013 => 2.4083, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.31% (0.2068 => 0.2364, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.29% (0.2737 => 0.3128, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.18% (0.5361 => 0.6121, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.88% (0.1383 => 0.1575, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.68% (0.2040 => 0.2319, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 13.52% (0.3498 => 0.3971, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.39% (0.3084 => 0.3497, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 13.39% (0.6634 => 0.7522, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.18% (0.0804 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.97% (11.6398 => 13.1499, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 12.80% (0.3336 => 0.3763, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.79% (0.2103 => 0.2372, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.38% (0.7426 => 0.8345, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: 12.34% (0.4847 => 0.5445, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.46% (0.2391 => 0.2665, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 10.83% (2.0346 => 2.2549, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.71% (4.6926 => 5.1951, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.31% (0.5584 => 0.6104, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 9.07% (11.9555 => 13.0399, std.dev.: 0.0080) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.41% (0.3792 => 0.4073, std.dev.: 0.0007) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5142, std.dev.: 0.0126) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0317) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0107) MultiSource/Applications/ClamAV/clamscan: 9.71% (0.2802 => 0.3074, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.29% (0.3693 => 0.3999, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.52% (3.3903 => 3.6115, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 6.50% (0.2122 => 0.2260, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 5.18% (15.4430 => 16.2425, std.dev.: 0.0229) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6727, std.dev.: 0.0053) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6866, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/flops-2: 4.65% (1.8057 => 1.8896, std.dev.: 0.0029) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 2.79% (0.6276 => 0.6451, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.11% (15.8721 => 16.2077, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.88% (2.0820 => 2.1211, std.dev.: 0.0071) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3069, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.41% (7.1849 => 7.2864, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0823, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2061, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5857, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4769, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.74% (25.4195 => 16.5877, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.93% (17.2379 => 14.3187, std.dev.: 0.0556) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -9.08% (0.2402 => 0.2184, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9743, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7997, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9572, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: -4.79% (1.5554 => 1.4809, std.dev.: 0.0004) SingleSource/Benchmarks/Dhrystone/dry: -4.36% (14.0481 => 13.4353, std.dev.: 0.1572) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2178, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.63% (11.2080 => 10.8012, std.dev.: 0.0052) MultiSource/Applications/siod/siod: -2.99% (6.9842 => 6.7754, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1206, std.dev.: 0.0322) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.00% (0.6293 => 0.6167, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.80% (10.7630 => 10.5691, std.dev.: 0.0070) MultiSource/Benchmarks/Olden/bh/bh: -1.46% (5.5810 => 5.4996, std.dev.: 0.0066) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7153, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.25% (105.3826 => 104.0630, std.dev.: 0.0811) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0448, std.dev.: 0.0043) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 01:16:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 03:16:43 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130091643.ACD342A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8102?compare_to=8098&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8102, Order: 173898, Start Time: 2013-01-30 07:02:45, End Time: 2013-01-30 09:17:03 To: 8098, Order: 173888, Start Time: 2013-01-30 04:19:51, End Time: 2013-01-30 06:31:59 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (226 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1332 => 0.1333, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -0.15% (0.0683 => 0.0682, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8554 => 499.7514, std.dev.: 0.0533) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44215.99% (1.1277 => 499.7514, std.dev.: 0.0533) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.39% (0.5229 => 1.7067, std.dev.: 0.0412) MultiSource/Applications/SPASS/SPASS: 25.92% (14.9895 => 18.8752, std.dev.: 0.3939) MultiSource/Applications/kimwitu++/kc: 47.36% (14.1553 => 20.8597, std.dev.: 0.0198) MultiSource/Benchmarks/MallocBench/gs/gs: 21.02% (4.1105 => 4.9744, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.64% (1.1048 => 1.7858, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 449.40% (7.1582 => 39.3271, std.dev.: 0.1816) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.76% (3.4629 => 6.6060, std.dev.: 0.0014) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.96% (0.6222 => 1.1384, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.89% (0.0720 => 7.4440, std.dev.: 0.1390) MultiSource/Applications/SIBsim4/SIBsim4: 3834300.00% (0.0001 => 3.8344, std.dev.: 0.0164) MultiSource/Applications/SPASS/SPASS: 11100400.00% (0.0001 => 11.1005, std.dev.: 0.8754) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5499200.00% (0.0001 => 5.4993, std.dev.: 0.0009) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 812.51% (1.1194 => 10.2146, std.dev.: 0.0217) MultiSource/Applications/ClamAV/clamscan: 149.45% (22.1758 => 55.3176, std.dev.: 1.1335) SingleSource/Benchmarks/Misc/lowercase: 132.03% (0.0256 => 0.0594, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.01% (0.0929 => 0.1886, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.04% (0.1463 => 0.2634, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656) SingleSource/Benchmarks/CoyoteBench/almabench: 66.03% (0.0730 => 0.1212, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.86% (1.5859 => 2.4876, std.dev.: 0.0065) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.76% (2.9384 => 4.6063, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.82% (7.0540 => 10.9211, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/distray/distray: 53.60% (0.1056 => 0.1622, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.50% (8.1363 => 12.1635, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.61% (2.2024 => 3.2289, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 45.45% (0.3109 => 0.4522, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.65% (0.0439 => 0.0635, std.dev.: 0.0009) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops: 40.78% (0.1432 => 0.2016, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.68% (0.1062 => 0.1494, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.49% (21.9371 => 30.8193, std.dev.: 0.5150) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.16% (1.5415 => 2.1298, std.dev.: 0.0073) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.52% (4.2646 => 5.8646, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.23% (0.4615 => 0.6333, std.dev.: 0.0053) SingleSource/Benchmarks/McGill/exptree: 36.36% (0.0814 => 0.1110, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.46% (0.5105 => 0.6915, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.14% (0.2271 => 0.3069, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.25% (0.1892 => 0.2540, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.81% (0.6675 => 0.8932, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 33.47% (1.1642 => 1.5538, std.dev.: 0.0496) MultiSource/Benchmarks/McCat/05-eks/eks: 33.45% (0.4299 => 0.5737, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.98% (0.1143 => 0.1520, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 31.71% (0.0719 => 0.0947, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 31.12% (0.1655 => 0.2170, std.dev.: 0.0016) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 30.93% (0.1125 => 0.1473, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 30.64% (9.4845 => 12.3909, std.dev.: 0.0156) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.15% (0.1695 => 0.2206, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.01% (0.0793 => 0.1031, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.85% (3.8922 => 5.0542, std.dev.: 0.0042) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.65% (0.0479 => 0.0621, std.dev.: 0.0009) MultiSource/Applications/lemon/lemon: 28.87% (1.0722 => 1.3817, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/08-main/main: 28.86% (0.2554 => 0.3291, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 28.23% (0.0457 => 0.0586, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.01% (1.4186 => 1.8160, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/hash: 28.00% (0.4289 => 0.5490, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.65% (0.1906 => 0.2433, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: 27.52% (0.7115 => 0.9073, std.dev.: 0.0270) SingleSource/Benchmarks/Shootout-C++/hash2: 27.49% (0.4620 => 0.5890, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.40% (0.0730 => 0.0930, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.23% (0.1337 => 0.1701, std.dev.: 0.0034) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.08% (0.1566 => 0.1990, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.04% (0.3121 => 0.3965, std.dev.: 0.0072) MultiSource/Benchmarks/Olden/tsp/tsp: 26.81% (0.1175 => 0.1490, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.64% (0.0672 => 0.0851, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 26.46% (0.7835 => 0.9908, std.dev.: 0.0205) MultiSource/Applications/aha/aha: 26.06% (0.1151 => 0.1451, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/bigfib: 26.04% (0.6456 => 0.8137, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.68% (0.5020 => 0.6309, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: 25.30% (0.0660 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.30% (0.0842 => 0.1055, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/lists: 25.24% (0.0626 => 0.0784) MultiSource/Benchmarks/McCat/15-trie/trie: 25.24% (0.0527 => 0.0660) MultiSource/Benchmarks/Olden/mst/mst: 25.19% (0.1163 => 0.1456, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.19% (0.2700 => 0.3380, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/hash: 25.15% (0.0485 => 0.0607, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.00% (0.1236 => 0.1545, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.72% (0.0886 => 0.1105, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.69% (1.3050 => 1.6272, std.dev.: 0.0005) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.59% (0.1940 => 0.2417, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 24.50% (0.1555 => 0.1936, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (0.1032 => 0.1282, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.15% (0.0675 => 0.0838, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.11% (0.0871 => 0.1081, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.10% (0.1029 => 0.1277, std.dev.: 0.0029) MultiSource/Benchmarks/nbench/nbench: 23.76% (1.1840 => 1.4653, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.53% (0.5860 => 0.7239, std.dev.: 0.0042) MultiSource/Applications/d/make_dparser: 23.45% (3.3354 => 4.1176, std.dev.: 0.0991) MultiSource/Applications/oggenc/oggenc: 23.40% (5.7591 => 7.1065, std.dev.: 0.1374) SingleSource/UnitTests/ObjC/messages-2: 23.26% (0.0662 => 0.0816, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 23.24% (0.1695 => 0.2089, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.19% (0.0953 => 0.1174, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.86% (0.3307 => 0.4063, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.85% (0.1584 => 0.1946, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.85% (0.1510 => 0.1855, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 22.63% (0.3098 => 0.3799, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.28% (4.9449 => 6.0468, std.dev.: 0.0247) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.16% (0.0528 => 0.0645, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 22.15% (0.0614 => 0.0750, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 22.05% (0.0567 => 0.0692, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.04% (0.2758 => 0.3366, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/football/football: 22.02% (0.8921 => 1.0885, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 21.79% (0.3423 => 0.4169, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.67% (0.8172 => 0.9943, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.64% (0.2107 => 0.2563, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 21.44% (2.0273 => 2.4619, std.dev.: 0.0662) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.43% (5.0018 => 6.0739, std.dev.: 0.0066) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.21% (0.6450 => 0.7818, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.15% (0.5569 => 0.6747, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.13% (1.1861 => 1.4367, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 21.07% (0.1144 => 0.1385, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 21.04% (0.7433 => 0.8997, std.dev.: 0.0220) SingleSource/Benchmarks/Misc/ReedSolomon: 20.94% (0.2049 => 0.2478, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.90% (0.9765 => 1.1806, std.dev.: 0.0038) MultiSource/Applications/lua/lua: 20.69% (3.8723 => 4.6735, std.dev.: 0.0352) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.50% (0.0834 => 0.1005, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.41% (0.1117 => 0.1345, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.39% (0.0770 => 0.0927, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.22% (0.0648 => 0.0779, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.04% (0.0933 => 0.1120, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 19.87% (2.2969 => 2.7532, std.dev.: 0.0956) MultiSource/Benchmarks/Olden/health/health: 19.79% (0.1268 => 0.1519, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.48% (0.0770 => 0.0920, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.20% (0.4203 => 0.5010, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.97% (0.8101 => 0.9638, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.93% (0.5981 => 0.7113, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.89% (0.3441 => 0.4091, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.71% (0.2603 => 0.3090, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/misr: 18.64% (0.0633 => 0.0751, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.45% (0.2065 => 0.2446, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/ary3: 18.37% (0.3283 => 0.3886, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.20% (0.1044 => 0.1234, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: 17.97% (0.0818 => 0.0965, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.88% (0.3232 => 0.3810, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/09-vor/vor: 17.52% (0.3180 => 0.3737, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.43% (0.8067 => 0.9473, std.dev.: 0.0075) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.76% (0.0704 => 0.0822, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 16.68% (0.3387 => 0.3952, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary2: 16.66% (0.3379 => 0.3942, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.12% (0.3865 => 0.4488, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.05% (0.4636 => 0.5380, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 15.27% (17.1811 => 19.8039, std.dev.: 0.5100) MultiSource/Applications/hbd/hbd: 14.80% (1.5603 => 1.7913, std.dev.: 0.0489) SingleSource/Benchmarks/Shootout-C++/moments: 14.70% (0.4048 => 0.4643, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 14.56% (0.0838 => 0.0960, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.38% (0.4103 => 0.4693, std.dev.: 0.0026) SingleSource/Regression/C++/ofstream_ctor: 14.25% (0.2905 => 0.3319, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists: 14.20% (0.3422 => 0.3908, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 14.14% (0.3684 => 0.4205, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 13.91% (0.3603 => 0.4104, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.62% (0.2430 => 0.2761, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.55% (0.1114 => 0.1265, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 13.42% (0.3092 => 0.3507, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.31% (0.4064 => 0.4605, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.31% (0.3427 => 0.3883, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/oourafft: 13.04% (0.3282 => 0.3710, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.94% (0.3826 => 0.4321, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.79% (14.3668 => 16.2043, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/parameter-passing: 12.12% (0.3927 => 0.4403, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.91% (0.1268 => 0.1419, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.76% (0.3886 => 0.4343, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 11.55% (0.2831 => 0.3158, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 11.08% (0.3828 => 0.4252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 10.87% (0.2871 => 0.3183, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.57% (2.0665 => 2.2849, std.dev.: 0.0094) MultiSource/Applications/hexxagon/hexxagon: 10.57% (1.2842 => 1.4199, std.dev.: 0.0489) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.53% (0.3543 => 0.3916, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.52% (0.3935 => 0.4349, std.dev.: 0.0046) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.48% (0.3694 => 0.4081, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 10.47% (0.3516 => 0.3884, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: 10.41% (0.3543 => 0.3912, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 10.33% (0.3561 => 0.3929, std.dev.: 0.0057) SingleSource/UnitTests/ObjC/exceptions-2: 10.29% (0.3497 => 0.3857, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 10.29% (0.2877 => 0.3173, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.23% (0.2756 => 0.3038, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.06% (0.2725 => 0.2999, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.05% (0.3650 => 0.4017, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.03% (0.2793 => 0.3073, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.99% (0.3162 => 0.3478, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 9.95% (0.2714 => 0.2984, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.79% (0.2891 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.76% (0.3052 => 0.3350, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 9.53% (0.2802 => 0.3069, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.48% (0.1625 => 0.1779, std.dev.: 0.0025) MultiSource/Benchmarks/Bullet/bullet: 9.39% (63.2438 => 69.1828, std.dev.: 0.0885) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.30% (0.2872 => 0.3139, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 9.06% (0.7326 => 0.7990, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.93% (0.3136 => 0.3416, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 8.82% (10.3673 => 11.2822, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.80% (0.1330 => 0.1447, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.43% (0.2266 => 0.2457, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: 8.24% (0.5925 => 0.6413, std.dev.: 0.0094) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.00% (2.2022 => 2.3784, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/objinst: 4.79% (0.3131 => 0.3281, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.95% (7.9617 => 8.2763, std.dev.: 0.0138) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.04% (0.3817 => 0.3933, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4689, std.dev.: 0.0034) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 13.04% (0.5413 => 0.6119, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.82% (11.6436 => 12.5544, std.dev.: 0.0611) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4479, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/hash2: 4.81% (3.1578 => 3.3097, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.79% (0.9957 => 1.0334, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (2.0360 => 2.1065, std.dev.: 0.0080) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.6802 => 8.9043, std.dev.: 0.0272) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (3.6395 => 3.7224, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0053) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.60% (27.8444 => 28.2906, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.17% (6.5088 => 6.5848, std.dev.: 0.0058) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.02% (10.3460 => 10.4518, std.dev.: 0.0174) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1474, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.85% (5.2763 => 1.1685, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -75.26% (0.8651 => 0.2140) SingleSource/Benchmarks/Misc/richards_benchmark: -42.11% (0.1622 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.06% (5.3855 => 4.4670, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.41% (5.3526 => 4.4742, std.dev.: 0.0063) MultiSource/Applications/JM/ldecod/ldecod: -12.07% (10.4361 => 9.1760, std.dev.: 0.2135) SingleSource/UnitTests/Vector/constpool: -7.67% (54.1659 => 50.0108, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.18% (1.7609 => 1.6344, std.dev.: 0.0056) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.41% (1.9577 => 0.6771, std.dev.: 0.0008) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.53% (1.5373 => 1.0218, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4356, std.dev.: 0.0086) MultiSource/Benchmarks/PAQ8p/paq8p: -24.84% (85.0658 => 63.9350, std.dev.: 0.0956) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.26% (2.6546 => 2.0105, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0919, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0021) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1266, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.77% (1.6925 => 1.4256, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.08% (3.1443 => 2.7331, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.84% (0.9540 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4941, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9123, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4233, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.88% (1.8329 => 1.7068, std.dev.: 0.0151) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.79% (19.9488 => 18.5936, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.96% (1.2373 => 1.1635, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5861, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6994, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/salsa20: -4.83% (10.2830 => 9.7866, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/flops-5: -4.77% (1.5835 => 1.5080, std.dev.: 0.0020) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.49% (0.4808 => 0.4592, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1552, std.dev.: 0.0261) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.80% (5.0483 => 4.9573, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -1.64% (3.6994 => 3.6387, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: -1.01% (6.2999 => 6.2363, std.dev.: 0.0065) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.24% (0.1485 => 0.1333, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.77% (0.2116 => 0.0682, std.dev.: 0.0024) Report Time: 1.77s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 01:41:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 03:41:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130094155.7749A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8103?compare_to=8099&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8103, Order: 173905, Start Time: 2013-01-30 07:39:06, End Time: 2013-01-30 09:42:18 To: 8099, Order: 173893, Start Time: 2013-01-30 05:15:15, End Time: 2013-01-30 07:19:15 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (93 on baseline) Performance Improvements: 6 (66 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1050 (904 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lua/lua: 1.28% (4.2427 => 4.2972, std.dev.: 0.0139) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.75% (1.4595 => 1.8791, std.dev.: 0.0039) MultiSource/Benchmarks/nbench/nbench: 13.64% (19.0817 => 21.6849, std.dev.: 0.6891) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.71% (8.1048 => 8.5677, std.dev.: 0.0511) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.91% (1.2452 => 1.3063, std.dev.: 0.0077) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.22% (13.6412 => 14.2171, std.dev.: 0.1866) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.86% (4.7412 => 4.8768, std.dev.: 0.0207) MultiSource/Applications/siod/siod: 2.59% (3.5354 => 3.6271, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mafft/pairlocalalign: -4.51% (11.2687 => 10.7608, std.dev.: 0.0784) MultiSource/Benchmarks/7zip/7zip-benchmark: -3.26% (46.9746 => 45.4431, std.dev.: 0.2556) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.18% (1.2285 => 1.2140, std.dev.: 0.0037) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -10.09% (10.2593 => 9.2237, std.dev.: 0.1414) MultiSource/Benchmarks/mafft/pairlocalalign: -3.89% (59.6631 => 57.3410, std.dev.: 0.3045) MultiSource/Benchmarks/Bullet/bullet: -2.25% (7.1850 => 7.0233, std.dev.: 0.0210) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.80% (1.2197 => 1.2295, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.44% (0.0227 => 0.0226, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0435 => 0.0434, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.89% (0.0336 => 0.0339, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0325 => 0.0325, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -17.21% (0.0430 => 0.0356, std.dev.: 0.0156) SingleSource/UnitTests/Vector/Altivec/casts: -2.80% (0.0214 => 0.0208, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/test1: 0.90% (0.0221 => 0.0223, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.76% (0.0251 => 0.0229, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.62% (0.1484 => 0.1460, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -0.03% (1.1566 => 1.1562, std.dev.: 0.1008) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.08% (0.3950 => 0.3953, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.97% (0.1469 => 0.1498, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -12.50% (0.0680 => 0.0595, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.30% (0.0604 => 0.0572, std.dev.: 0.0119) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.86% (1.3087 => 1.2844, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.15% (0.0607 => 0.0614, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0373 => 0.0373, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.01% (1.6953 => 1.7463, std.dev.: 0.0134) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 67.12% (0.0073 => 0.0122, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.36% (34.2450 => 34.1204, std.dev.: 0.2622) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 395.83% (0.0336 => 0.1666, std.dev.: 0.0027) SingleSource/Regression/C/sumarraymalloc: 118.77% (0.0293 => 0.0641, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 60.20% (0.1638 => 0.2624, std.dev.: 0.0067) SingleSource/Regression/C/sumarray: 56.60% (0.0265 => 0.0415, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.01% (0.8893 => 1.2629, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.85% (0.9120 => 1.2937, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.63% (0.8926 => 1.2642, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.15% (0.9612 => 1.3567, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.04% (0.9061 => 1.2780, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.51% (0.9564 => 1.3438, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.25% (0.9381 => 1.3157, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.92% (0.9588 => 1.3416, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.32% (0.8990 => 1.2525, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.90% (0.9855 => 1.3689, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.85% (0.9091 => 1.2623, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.28% (0.9998 => 1.3825, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.08% (0.9422 => 1.3010, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.78% (0.9403 => 1.2955, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.29% (0.9010 => 1.2370, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.95% (0.9512 => 1.3027, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.46% (0.8736 => 1.1921, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.36% (1.0119 => 1.3798, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.22% (0.8912 => 1.2140, std.dev.: 0.0037) SingleSource/Benchmarks/McGill/exptree: 35.74% (0.0859 => 0.1166, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 35.73% (0.0431 => 0.0585, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.58% (1.0867 => 1.4734, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.20% (1.0052 => 1.3590, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.94% (0.8732 => 1.1783, std.dev.: 0.0184) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.60% (0.8846 => 1.1907, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.49% (0.9867 => 1.3171, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.75% (1.0017 => 1.3298, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.38% (0.9788 => 1.2957, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.34% (0.9488 => 1.2556, std.dev.: 0.0156) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.10% (0.9507 => 1.2559, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.18% (0.9685 => 1.2705, std.dev.: 0.1108) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.91% (0.9127 => 1.1948, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.46% (0.9405 => 1.2270, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.07% (0.9993 => 1.2998, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.80% (0.9550 => 1.2300, std.dev.: 0.0285) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.14% (1.0860 => 1.3916, std.dev.: 0.0859) MultiSource/Applications/sgefa/sgefa: 18.59% (0.3598 => 0.4267, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.54% (0.0669 => 0.0793, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.0963 => 0.1137, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.82% (3.6295 => 4.2037, std.dev.: 0.1555) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 15.62% (0.0762 => 0.0881, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.74% (0.1332 => 0.1515, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.23% (0.1240 => 0.1404, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 13.03% (9.5202 => 10.7608, std.dev.: 0.0784) SingleSource/Benchmarks/Shootout-C++/matrix: 12.33% (0.2385 => 0.2679, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.03% (0.2577 => 0.2887, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.60% (0.5369 => 0.5938, std.dev.: 0.0161) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.62% (0.1955 => 0.2143, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.86% (0.2879 => 0.3134, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.00% (1.8651 => 2.0143, std.dev.: 0.0143) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.70% (2.4519 => 2.6406, std.dev.: 0.0468) SingleSource/Benchmarks/Misc-C++/bigfib: 5.80% (0.6711 => 0.7100, std.dev.: 0.0076) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.78% (0.2372 => 0.2509, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.13% (0.7693 => 0.8088, std.dev.: 0.0115) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.33% (23.5861 => 24.3723, std.dev.: 0.2496) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.92% (44.1538 => 45.4431, std.dev.: 0.2556) MultiSource/Benchmarks/Bullet/bullet: 2.75% (33.2440 => 34.1596, std.dev.: 0.1395) MultiSource/Benchmarks/McCat/05-eks/eks: 2.26% (0.4776 => 0.4884, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 105850.00% (0.0008 => 0.8476, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout/matrix: 353.69% (1.5825 => 7.1797, std.dev.: 0.0698) MultiSource/Applications/sgefa/sgefa: 258.72% (0.3515 => 1.2609, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.32% (1.1825 => 4.0716, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.23% (4.8185 => 15.9605, std.dev.: 0.0699) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 193.86% (0.0228 => 0.0670, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary2: 184.50% (0.0129 => 0.0367, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/ary: 143.97% (0.0232 => 0.0566, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 64.80% (2.9083 => 4.7929, std.dev.: 0.1444) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.59% (0.2562 => 0.3397, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.44% (3.1254 => 4.1079, std.dev.: 0.0098) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 29.75% (1.4588 => 1.8928, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.98% (5.6033 => 7.1148, std.dev.: 0.1969) SingleSource/Benchmarks/Misc/salsa20: 23.18% (7.4497 => 9.1767, std.dev.: 0.2685) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.44% (4.8112 => 5.7948, std.dev.: 0.0132) SingleSource/Regression/C/uint64_to_float: 17.35% (1.5397 => 1.8068, std.dev.: 0.0546) MultiSource/Applications/JM/lencod/lencod: 14.58% (6.8159 => 7.8097, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.03% (5.1752 => 5.8497, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6497, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.00% (3.6477 => 3.9759, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 8.16% (8.6447 => 9.3497, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.46% (4.7473 => 5.0542, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/chomp: 6.09% (1.0425 => 1.1060, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.55% (0.6211 => 0.6556, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.26% (4.1836 => 4.4038, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2288, std.dev.: 0.0010) SingleSource/Benchmarks/Linpack/linpack-pc: 3.81% (50.8945 => 52.8347, std.dev.: 0.3813) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.20% (4.7254 => 4.8768, std.dev.: 0.0207) SingleSource/Benchmarks/Misc/pi: 2.77% (2.1390 => 2.1982, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8625, std.dev.: 0.0015) MultiSource/Applications/siod/siod: 1.01% (3.5910 => 3.6271, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -27.02% (0.0692 => 0.0505, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -18.01% (1.8964 => 1.5548, std.dev.: 0.0500) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.44% (0.1009 => 0.0833, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.48% (1.0960 => 0.9263, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.90% (0.1079 => 0.0929, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.06% (0.7686 => 0.6682, std.dev.: 0.0228) MultiSource/Applications/Burg/burg: -9.53% (1.5979 => 1.4456, std.dev.: 0.0467) MultiSource/Applications/treecc/treecc: -8.78% (2.4719 => 2.2548, std.dev.: 0.0314) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.49% (6.4235 => 5.9425, std.dev.: 0.0720) MultiSource/Applications/lua/lua: -7.40% (4.6406 => 4.2972, std.dev.: 0.0139) MultiSource/Applications/siod/siod: -7.15% (2.6437 => 2.4546, std.dev.: 0.0474) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.00% (1.0234 => 0.9518, std.dev.: 0.0206) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.55% (0.6885 => 0.6503, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/fibo: -5.03% (0.2006 => 0.1905, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/moments: -3.55% (0.4002 => 0.3860, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.39% (0.3093 => 0.2988, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.38% (0.7225 => 0.7125, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.73% (11.5523 => 3.9595, std.dev.: 0.0604) SingleSource/Benchmarks/Misc/fp-convert: -62.02% (15.6525 => 5.9442, std.dev.: 0.2167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.37% (0.4146 => 0.1809, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.84% (0.4578 => 0.2342, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.99% (11.3868 => 6.3776, std.dev.: 0.0243) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.86% (5.4023 => 3.6273, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.06% (0.4452 => 0.3069, std.dev.: 0.0177) MultiSource/Benchmarks/Olden/bisort/bisort: -30.34% (0.9372 => 0.6529, std.dev.: 0.1078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.22% (0.5495 => 0.4054, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8821, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.16% (4.4467 => 3.3281, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.51% (0.5826 => 0.4398, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.10% (0.5897 => 0.4476, std.dev.: 0.0186) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.49% (4.9921 => 3.8193, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.41% (1.5623 => 1.2590, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7926, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.04% (0.1164 => 0.0954, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.77% (7.0016 => 5.8276, std.dev.: 0.2808) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.76% (16.6791 => 14.2171, std.dev.: 0.1866) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.20% (3.1921 => 2.7707, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6738, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.57% (9.7992 => 8.5677, std.dev.: 0.0511) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.51% (5.7056 => 4.9916, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.41% (1.4235 => 1.2611, std.dev.: 0.0329) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.12% (0.4081 => 0.3668, std.dev.: 0.0130) MultiSource/Benchmarks/mafft/pairlocalalign: -9.20% (63.1520 => 57.3410, std.dev.: 0.3045) SingleSource/Benchmarks/Shootout-C++/lists1: -8.68% (0.6628 => 0.6053, std.dev.: 0.0095) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.71% (0.3217 => 0.2969, std.dev.: 0.0030) MultiSource/Applications/SIBsim4/SIBsim4: -7.71% (3.5443 => 3.2712, std.dev.: 0.0391) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.61% (5.5974 => 5.2275, std.dev.: 0.1142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.49% (4.5424 => 4.2478, std.dev.: 0.0220) SingleSource/Benchmarks/McGill/queens: -5.70% (1.7443 => 1.6449, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.29% (4.9799 => 4.7167, std.dev.: 0.0753) SingleSource/Benchmarks/Shootout-C++/hash2: -4.97% (3.6768 => 3.4939, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.36% (3.5127 => 3.3594, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4361, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (5.8973 => 5.6806, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists: -3.14% (17.2182 => 16.6779, std.dev.: 0.1157) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.04% (40.4729 => 39.2416, std.dev.: 0.2381) MultiSource/Applications/lua/lua: -2.55% (29.0327 => 28.2915, std.dev.: 0.1884) MultiSource/Benchmarks/Bullet/bullet: -2.51% (7.2040 => 7.0233, std.dev.: 0.0210) MultiSource/Applications/spiff/spiff: -2.14% (2.8571 => 2.7959, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5764, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8631, std.dev.: 0.0502) MultiSource/Benchmarks/BitBench/five11/five11: -1.66% (5.7021 => 5.6075, std.dev.: 0.0208) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3163, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.18% (8.8249 => 8.7207, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.17% (6.8262 => 6.7466, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.07% (3.7450 => 3.7050, std.dev.: 0.0016) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.06% (1.2047 => 1.2295, std.dev.: 0.0090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.00% (0.0233 => 0.0226, std.dev.: 0.0081) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.96% (0.0394 => 0.0339, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0107) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.00% (0.0445 => 0.0356, std.dev.: 0.0156) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0078) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0057) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0023) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.58% (0.1530 => 0.1460, std.dev.: 0.0031) MultiSource/Applications/lemon/lemon: -40.07% (1.9293 => 1.1562, std.dev.: 0.1008) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.37% (0.4049 => 0.3953, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.79% (0.1510 => 0.1498, std.dev.: 0.0185) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.16% (0.0978 => 0.0595, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.05% (0.0590 => 0.0572, std.dev.: 0.0119) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.56% (1.1617 => 1.2844, std.dev.: 0.0154) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0036) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.81% (0.7437 => 1.7463, std.dev.: 0.0134) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0028) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.02% (12.7781 => 34.1204, std.dev.: 0.2622) Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 01:57:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 03:57:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130095706.517B62A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8104?compare_to=8100&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8104, Order: 173907, Start Time: 2013-01-30 08:23:12, End Time: 2013-01-30 09:57:28 To: 8100, Order: 173898, Start Time: 2013-01-30 06:20:57, End Time: 2013-01-30 07:55:13 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (115 on baseline) Performance Improvements: 2 (97 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -1.55% (0.7602 => 0.7484, std.dev.: 0.0031) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.68% (1.2923 => 1.2706, std.dev.: 0.0059) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.50% (0.0974 => 0.1612, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.40% (0.0599 => 0.0829, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.89% (0.6395 => 0.8818, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.26% (0.6395 => 0.8714, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.84% (0.5688 => 0.7556, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.80% (0.5805 => 0.7709, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.77% (0.5456 => 0.7244, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.51% (0.6260 => 0.8295, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.23% (0.5849 => 0.7734, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.12% (0.6230 => 0.8231, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.05% (0.5575 => 0.7362, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.85% (0.5567 => 0.7340, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.84% (0.5581 => 0.7358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.06% (0.5802 => 0.7604, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.70% (0.5941 => 0.7765, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.64% (0.5705 => 0.7453, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.58% (0.5478 => 0.7153, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.44% (0.5857 => 0.7640, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.42% (0.5569 => 0.7263, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.38% (0.5859 => 0.7639, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.23% (0.6033 => 0.7857, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.18% (0.5570 => 0.7251, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.97% (1.6474 => 2.1412, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.85% (0.5591 => 0.7260, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.43% (0.6440 => 0.8335, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.05% (0.5925 => 0.7646, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.92% (0.6189 => 0.7979, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.71% (0.6676 => 0.8593, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.47% (0.5863 => 0.7532, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.34% (0.6052 => 0.7767, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.22% (0.6304 => 0.8083, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.92% (0.6446 => 0.8246, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.20% (0.6681 => 0.8498, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.10% (0.6660 => 0.8465, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.01% (0.6194 => 0.7867, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.90% (0.6297 => 0.7991, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.35% (0.6667 => 0.8357, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.46% (0.0699 => 0.0870, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.18% (0.7524 => 0.9343, std.dev.: 0.0167) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.49% (0.7339 => 0.9063, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.97% (2.2587 => 2.7776, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.67% (0.1146 => 0.1337, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.06% (0.3357 => 0.3896, std.dev.: 0.0030) MultiSource/Applications/lemon/lemon: 15.37% (1.1450 => 1.3210, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.53% (4.5069 => 5.0714, std.dev.: 0.0158) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.23% (1.6364 => 1.8366, std.dev.: 0.0223) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.11% (0.1230 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.04% (0.4916 => 0.5508, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.01% (3.5339 => 3.9582, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 11.41% (0.4515 => 0.5030, std.dev.: 0.0039) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0019) MultiSource/Benchmarks/mafft/pairlocalalign: 9.86% (9.2283 => 10.1386, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.30% (0.1731 => 0.1892, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.21% (0.5329 => 0.5820, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.77% (0.7021 => 0.7637, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.61% (1.2515 => 1.3593, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 8.33% (0.4524 => 0.4901, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: 7.88% (0.4861 => 0.5244, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.76% (1.2784 => 1.3776, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.43% (1.4642 => 1.5730, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++/bigfib: 6.59% (0.6750 => 0.7195, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.19% (5.4682 => 5.8069, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 5.91% (0.1879 => 0.1990, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3255 => 0.3439, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.03% (0.3319 => 0.3486, std.dev.: 0.0055) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.67% (22.4056 => 23.4524, std.dev.: 0.0126) MultiSource/Applications/oggenc/oggenc: 3.76% (5.0226 => 5.2116, std.dev.: 0.0014) MultiSource/Applications/minisat/minisat: 3.49% (0.7447 => 0.7707, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.9557 => 0.9886, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.40% (15.5079 => 16.0358, std.dev.: 0.0159) MultiSource/Applications/SIBsim4/SIBsim4: 3.16% (1.3864 => 1.4302, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/ary3: 3.02% (0.3446 => 0.3550, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 2.92% (0.8418 => 0.8664, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4427 => 0.4546, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.30% (0.5168 => 0.5287, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.3722 => 1.3992, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 1.72% (18.2933 => 18.6079, std.dev.: 0.0269) MultiSource/Benchmarks/Bullet/bullet: 1.48% (34.0927 => 34.5981, std.dev.: 0.1169) MultiSource/Applications/d/make_dparser: 1.17% (3.5154 => 3.5564, std.dev.: 0.0144) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8023, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.91% (0.9531 => 1.0285, std.dev.: 0.0072) SingleSource/Regression/C/uint64_to_float: 7.54% (0.5692 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1497, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5122, std.dev.: 0.0888) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.13% (2.0478 => 2.1119, std.dev.: 0.0062) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3036, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5132, std.dev.: 0.0280) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9568, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5320 => 4.5981, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2694, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.27% (0.7198 => 0.6819, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: -5.04% (0.3194 => 0.3033, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -5.04% (0.3812 => 0.3620, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -5.01% (0.3831 => 0.3639, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.95% (0.3880 => 0.3688, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.88% (0.4033 => 0.3836, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.87% (0.3884 => 0.3695, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: -4.83% (0.3896 => 0.3708, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.78% (0.3891 => 0.3705, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.38% (0.4176 => 0.3993, std.dev.: 0.0000) SingleSource/UnitTests/ObjC++/Hello: -4.05% (0.6347 => 0.6090, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -3.79% (0.7779 => 0.7484, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/fibo: -3.76% (0.2871 => 0.2763, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -3.74% (0.4199 => 0.4042, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.70% (0.3057 => 0.2944, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.66% (0.6441 => 0.6205, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.64% (0.9852 => 0.9493, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.61% (0.3821 => 0.3683, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.51% (0.3016 => 0.2910, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.51% (0.2933 => 0.2830, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.49% (0.3323 => 0.3207, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/parameter-passing: -3.39% (0.4280 => 0.4135, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.37% (0.3205 => 0.3097, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -3.36% (2.4924 => 2.4086, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.03% (2.1713 => 2.1056, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.9542 => 0.9259, std.dev.: 0.0021) MultiSource/Applications/hexxagon/hexxagon: -2.80% (1.3148 => 1.2780, std.dev.: 0.0041) SingleSource/UnitTests/Vector/constpool: -2.59% (20.7746 => 20.2356, std.dev.: 0.0472) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.51% (0.6484 => 0.6321, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.79% (6.7716 => 6.6501, std.dev.: 0.0124) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.68% (14.2083 => 13.9692, std.dev.: 0.0014) MultiSource/Applications/JM/lencod/lencod: -1.15% (16.1920 => 16.0061, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.28% (1.8100 => 0.6827, std.dev.: 0.0249) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0014) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/mandel-2: -24.74% (1.3643 => 1.0268, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7525, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4532, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2049, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1732, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0049) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1303, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.98% (0.4092 => 0.3520, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3555, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.45% (0.5142 => 0.4656, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1679, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.11% (5.3830 => 5.1078, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.74% (2.2633 => 2.1787, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.98% (1.3096 => 1.2706, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.56% (3.7241 => 3.6286, std.dev.: 0.0185) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (7.9763 => 7.7850, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.83% (7.3040 => 7.1701, std.dev.: 0.0117) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.69% (6.5735 => 6.4627, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.39% (1.6307 => 1.6081, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5907, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.00% (1.6219 => 1.6056, std.dev.: 0.0029) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 03:55:20 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 05:55:20 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130115520.BA5122A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8105?compare_to=8104&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8105, Order: 173918, Start Time: 2013-01-30 10:21:17, End Time: 2013-01-30 11:55:43 To: 8104, Order: 173907, Start Time: 2013-01-30 08:23:12, End Time: 2013-01-30 09:57:28 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.65% (0.0514 => 0.0872, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.61% (0.0974 => 0.1613, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 45.93% (0.1500 => 0.2189, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.03% (0.6395 => 0.8827, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.37% (0.6395 => 0.8721, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.68% (0.5805 => 0.7702, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.67% (0.5688 => 0.7546, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.64% (0.5456 => 0.7237, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.62% (0.6260 => 0.8302, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.15% (0.6230 => 0.8233, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.09% (0.5849 => 0.7726, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.05% (0.5567 => 0.7351, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.98% (0.5575 => 0.7358, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.79% (0.5581 => 0.7355, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.23% (0.5802 => 0.7614, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.64% (0.5705 => 0.7453, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.46% (0.5857 => 0.7641, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.41% (0.5478 => 0.7144, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.24% (0.5569 => 0.7253, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.23% (0.5859 => 0.7630, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.11% (0.5570 => 0.7247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.00% (0.6033 => 0.7843, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.90% (1.6474 => 2.1399, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.83% (0.5591 => 0.7259, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.55% (0.6440 => 0.8343, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.16% (0.5925 => 0.7653, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.02% (0.6189 => 0.7985, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.71% (0.6676 => 0.8593, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.53% (0.5863 => 0.7536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.44% (0.6304 => 0.8097, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.21% (0.6052 => 0.7759, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.82% (0.6446 => 0.8239, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.62% (0.6681 => 0.8526, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.28% (0.6194 => 0.7884, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.98% (0.6660 => 0.8457, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.81% (0.6297 => 0.7985, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.39% (0.6667 => 0.8360, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.32% (0.0699 => 0.0869, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.12% (0.7524 => 0.9339, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.42% (0.7339 => 0.9058, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.89% (2.2587 => 2.7757, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.06% (0.3357 => 0.3896, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 15.34% (1.1450 => 1.3207, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.67% (0.1982 => 0.2253, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.45% (4.5069 => 5.0679, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.32% (1.6364 => 1.8380, std.dev.: 0.0055) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.20% (0.1230 => 0.1380, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 12.15% (0.0864 => 0.0969, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.06% (0.4916 => 0.5509, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.94% (3.5339 => 3.9560, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 11.25% (0.4515 => 0.5023, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.61% (0.2385 => 0.2638, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 9.96% (9.2283 => 10.1470, std.dev.: 0.0030) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.36% (0.1731 => 0.1893, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.12% (0.5329 => 0.5815, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 9.04% (0.4524 => 0.4933, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 8.95% (1.2515 => 1.3635, std.dev.: 0.0070) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.65% (0.7021 => 0.7628, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.92% (0.4861 => 0.5246, std.dev.: 0.0114) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.75% (0.2001 => 0.2156, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.72% (1.2784 => 1.3771, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.39% (1.4642 => 1.5724, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.6750 => 0.7200, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.15% (5.4682 => 5.8044, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.97% (0.3319 => 0.3484, std.dev.: 0.0047) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.66% (22.4056 => 23.4499, std.dev.: 0.0125) MultiSource/Applications/oggenc/oggenc: 3.78% (5.0226 => 5.2123, std.dev.: 0.0069) MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.3864 => 1.4346, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.44% (0.9557 => 0.9886, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.44% (0.7447 => 0.7703, std.dev.: 0.0033) MultiSource/Applications/SPASS/SPASS: 3.38% (15.5079 => 16.0314, std.dev.: 0.0127) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3446 => 0.3553, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.98% (0.3491 => 0.3595, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 2.95% (0.3394 => 0.3494, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 2.82% (0.8418 => 0.8655, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.60% (0.4427 => 0.4542, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.21% (0.5168 => 0.5282, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.97% (1.3722 => 1.3992, std.dev.: 0.0016) MultiSource/Applications/kimwitu++/kc: 1.74% (18.2933 => 18.6113, std.dev.: 0.0173) MultiSource/Benchmarks/Bullet/bullet: 1.51% (34.0927 => 34.6067, std.dev.: 0.0248) MultiSource/Applications/d/make_dparser: 1.19% (3.5154 => 3.5571, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.15% (1.2300 => 1.2441, std.dev.: 0.0012) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.8001, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.28% (0.9531 => 1.0320, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1484, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.38% (54.5751 => 56.4188, std.dev.: 0.1269) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.0478 => 2.1081, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3039, std.dev.: 0.0015) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.50% (18.2231 => 18.4959, std.dev.: 0.0099) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5970, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2699, std.dev.: 0.0071) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.10% (10.3489 => 10.4630, std.dev.: 0.0039) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.71% (0.1281 => 0.1131, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.14% (0.7198 => 0.6828, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions-2: -4.96% (0.3831 => 0.3641, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.96% (0.3812 => 0.3623, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.88% (0.3896 => 0.3706, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.83% (0.3848 => 0.3662, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.79% (0.3880 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.79% (0.3884 => 0.3698, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.78% (0.3891 => 0.3705, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -4.76% (0.4033 => 0.3841, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.43% (0.4176 => 0.3991, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -4.06% (0.6347 => 0.6089, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.79% (0.4199 => 0.4040, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.69% (0.2871 => 0.2765, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3821 => 0.3681, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: -3.63% (0.6441 => 0.6207, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.62% (0.9852 => 0.9495, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.60% (0.3057 => 0.2947, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.55% (0.2903 => 0.2800, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (2.4924 => 2.4074, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.41% (0.2933 => 0.2833, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/parameter-passing: -3.36% (0.4280 => 0.4136, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.34% (0.3323 => 0.3212, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: -3.34% (0.3205 => 0.3098, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.24% (0.7779 => 0.7527, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.98% (2.1713 => 2.1065, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.97% (0.9542 => 0.9259, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -2.81% (1.3148 => 1.2778, std.dev.: 0.0052) SingleSource/UnitTests/Vector/constpool: -2.73% (20.7746 => 20.2081, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.33% (0.6484 => 0.6333, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.76% (14.2083 => 13.9581, std.dev.: 0.0158) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.75% (6.7716 => 6.6528, std.dev.: 0.0115) MultiSource/Applications/JM/lencod/lencod: -1.27% (16.1920 => 15.9857, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.19% (1.0544 => 1.0418, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: -1.02% (7.0961 => 7.0237, std.dev.: 0.0092) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.13% (1.8100 => 0.6854, std.dev.: 0.0341) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3964, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -25.12% (1.3643 => 1.0216, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7572, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4532, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.90% (4.1024 => 3.2040, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.24% (2.5106 => 2.1281, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6679, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.35% (4.9100 => 4.3529, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.90% (0.5142 => 0.4633, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1745, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2761, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.40% (7.9763 => 7.7847, std.dev.: 0.0083) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.29% (1.3096 => 1.2796, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1198, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -1.74% (7.3040 => 7.1772, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.67% (6.5735 => 6.4635, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.47% (1.6086 => 1.5850, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.37% (3.7092 => 3.6585, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.02% (1.6219 => 1.6054, std.dev.: 0.0018) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 04:00:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 06:00:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130120013.578372A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8106?compare_to=8102&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8106, Order: 173914, Start Time: 2013-01-30 09:48:02, End Time: 2013-01-30 12:00:35 To: 8102, Order: 173898, Start Time: 2013-01-30 07:02:45, End Time: 2013-01-30 09:17:03 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (227 on baseline) Performance Improvements: 1 (63 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.41% (1.1685 => 1.1850, std.dev.: 0.0012) MultiSource/Applications/Burg/burg: 1.16% (1.5538 => 1.5719, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/sqlite3/sqlite3: 1.17% (4.5823 => 4.6358, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.91% (11.2822 => 11.0667, std.dev.: 0.0053) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.30% (0.1333 => 0.1329, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.52% (0.0682 => 0.0658, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.7514 => 499.7581, std.dev.: 0.0464) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44216.58% (1.1277 => 499.7581, std.dev.: 0.0464) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.10% (0.5229 => 1.7104, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 26.45% (14.9895 => 18.9541, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: 47.84% (14.1553 => 20.9273, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/gs/gs: 21.26% (4.1105 => 4.9845, std.dev.: 0.0132) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.18% (1.1048 => 1.7918, std.dev.: 0.0078) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.49% (7.1582 => 39.4050, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.24% (3.4629 => 6.6226, std.dev.: 0.0046) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.07% (0.6222 => 1.1453, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.56% (0.0720 => 7.4452, std.dev.: 0.0106) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11088600.00% (0.0001 => 11.0887, std.dev.: 0.0603) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66000.00% (0.0001 => 0.0661, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849000.00% (0.0001 => 9.8491, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5485400.00% (0.0001 => 5.4855, std.dev.: 0.0197) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.65% (1.1194 => 10.2946, std.dev.: 0.0064) MultiSource/Applications/ClamAV/clamscan: 151.09% (22.1758 => 55.6813, std.dev.: 0.0126) SingleSource/Benchmarks/Misc/lowercase: 132.03% (0.0256 => 0.0594) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.80% (0.0929 => 0.1884, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 80.04% (0.1463 => 0.2634, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 67.53% (0.0730 => 0.1223, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.10% (2.9384 => 4.6163, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.02% (1.5859 => 2.4902, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.18% (7.0540 => 10.9466, std.dev.: 0.0202) MultiSource/Benchmarks/FreeBench/distray/distray: 53.50% (0.1056 => 0.1621, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.04% (8.1363 => 12.2073, std.dev.: 0.0126) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.97% (0.0439 => 0.0654, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.78% (2.2024 => 3.2327, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: 45.61% (0.3109 => 0.4527, std.dev.: 0.0011) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: 41.34% (0.1432 => 0.2024, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.24% (0.1062 => 0.1500, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: 40.95% (21.9371 => 30.9202, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.76% (1.5415 => 2.1390, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.75% (4.2646 => 5.8744, std.dev.: 0.0049) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.73% (0.4615 => 0.6310, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 36.36% (0.0814 => 0.1110, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.75% (0.5105 => 0.6930, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.09% (0.2271 => 0.3068, std.dev.: 0.0008) MultiSource/Applications/Burg/burg: 35.02% (1.1642 => 1.5719, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.30% (0.1892 => 0.2541, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.10% (0.6675 => 0.8951, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 33.31% (0.4299 => 0.5731, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.19% (0.0479 => 0.0638, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 33.16% (0.1143 => 0.1522, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.04% (0.0457 => 0.0608, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: 32.68% (0.0719 => 0.0954, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.45% (0.1695 => 0.2228, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 31.00% (0.1655 => 0.2168, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 30.93% (0.1125 => 0.1473, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 30.78% (9.4845 => 12.4039, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.95% (3.8922 => 5.0580, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.63% (0.0793 => 0.1028, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: 29.47% (0.4289 => 0.5553, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 29.45% (0.1555 => 0.2013, std.dev.: 0.0007) MultiSource/Applications/lemon/lemon: 28.97% (1.0722 => 1.3828, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.82% (0.0746 => 0.0961, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 28.47% (0.2554 => 0.3281, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.36% (1.4186 => 1.8209, std.dev.: 0.0069) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.12% (0.1906 => 0.2442, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: 28.05% (0.4620 => 0.5916, std.dev.: 0.0037) MultiSource/Applications/minisat/minisat: 27.94% (0.7115 => 0.9103, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 27.67% (0.0842 => 0.1075, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.67% (0.0730 => 0.0932, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.52% (0.1337 => 0.1705, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 26.98% (0.1175 => 0.1492, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.98% (0.3121 => 0.3963, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++/bigfib: 26.81% (0.6456 => 0.8187, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.76% (0.1566 => 0.1985, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.49% (0.0672 => 0.0850, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.45% (0.5020 => 0.6348, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 26.14% (0.1163 => 0.1467, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 25.89% (0.1151 => 0.1449, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 25.65% (0.7835 => 0.9845, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.63% (0.2700 => 0.3392, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/whetstone: 25.61% (0.0660 => 0.0829, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.57% (0.1236 => 0.1552, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.51% (0.0886 => 0.1112, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: 25.36% (0.0485 => 0.0608, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/15-trie/trie: 25.24% (0.0527 => 0.0660) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.01% (1.3050 => 1.6314, std.dev.: 0.0029) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.52% (0.1032 => 0.1285, std.dev.: 0.0013) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.30% (0.0675 => 0.0839, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.23% (0.0871 => 0.1082, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 23.96% (3.3354 => 4.1344, std.dev.: 0.0016) MultiSource/Benchmarks/nbench/nbench: 23.69% (1.1840 => 1.4645, std.dev.: 0.0050) SingleSource/UnitTests/ObjC/messages-2: 23.56% (0.0662 => 0.0818) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.52% (0.1029 => 0.1271, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.50% (0.3307 => 0.4084, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.45% (0.1940 => 0.2395, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 23.43% (0.3098 => 0.3824, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.42% (0.1584 => 0.1955, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 23.40% (5.7591 => 7.1067, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.34% (0.5860 => 0.7228, std.dev.: 0.0038) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.29% (0.0953 => 0.1175, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.21% (0.2758 => 0.3398, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/em3d/em3d: 23.13% (0.1695 => 0.2087, std.dev.: 0.0019) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.91% (0.1510 => 0.1856, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.86% (0.0770 => 0.0946, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.77% (4.9449 => 6.0711, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/football/football: 22.55% (0.8921 => 1.0933, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bisort/bisort: 22.48% (0.0614 => 0.0752, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.35% (0.0528 => 0.0646, std.dev.: 0.0000) MultiSource/Applications/treecc/treecc: 22.12% (2.0273 => 2.4758, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 22.05% (0.0567 => 0.0692, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.99% (0.8172 => 0.9969, std.dev.: 0.0134) MultiSource/Benchmarks/McCat/18-imp/imp: 21.71% (0.3423 => 0.4166, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.67% (0.5569 => 0.6776, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 21.62% (3.8723 => 4.7096, std.dev.: 0.0046) MultiSource/Applications/lambda-0_1_3/lambda: 21.62% (0.7433 => 0.9040, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.59% (0.2107 => 0.2562, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.56% (5.0018 => 6.0803, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/ReedSolomon: 21.43% (0.2049 => 0.2488, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.23% (0.9765 => 1.1838, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.21% (0.6450 => 0.7818, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.14% (1.1861 => 1.4369, std.dev.: 0.0025) SingleSource/UnitTests/SignlessTypes/rem: 21.07% (0.1144 => 0.1385, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.39% (0.2065 => 0.2486, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.26% (0.0933 => 0.1122, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 20.14% (2.2969 => 2.7596, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.06% (0.0648 => 0.0778, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.06% (0.4203 => 0.5046, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 19.95% (0.1268 => 0.1521, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.79% (0.1117 => 0.1338, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.54% (0.0834 => 0.0997, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.41% (0.5981 => 0.7142, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.34% (0.8101 => 0.9668, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.09% (0.3441 => 0.4098, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: 19.07% (0.3283 => 0.3909, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.86% (0.2603 => 0.3094, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 18.60% (0.3232 => 0.3833, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.49% (0.1044 => 0.1237, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/09-vor/vor: 17.89% (0.3180 => 0.3749, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 17.40% (0.3379 => 0.3967, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 17.23% (0.0592 => 0.0694, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.19% (0.8067 => 0.9454, std.dev.: 0.0077) MultiSource/Benchmarks/sim/sim: 17.18% (0.3387 => 0.3969, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.90% (0.0704 => 0.0823, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.90% (0.3865 => 0.4518, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.31% (0.4636 => 0.5392, std.dev.: 0.0015) MultiSource/Applications/hbd/hbd: 15.86% (1.5603 => 1.8077, std.dev.: 0.0042) SingleSource/Regression/C++/ofstream_ctor: 15.63% (0.2905 => 0.3359, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 15.60% (17.1811 => 19.8611, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/moments: 15.34% (0.4048 => 0.4669, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.31% (0.4103 => 0.4731, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 15.11% (0.3422 => 0.3939, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists1: 14.82% (0.3684 => 0.4230, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.79% (0.3603 => 0.4136, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.20% (0.4064 => 0.4641, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.86% (0.3427 => 0.3902, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 13.75% (0.3092 => 0.3517, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.33% (0.3826 => 0.4336, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.31% (14.3668 => 16.2792, std.dev.: 0.0208) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.29% (0.1114 => 0.1262, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.21% (0.2430 => 0.2751, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/strcat: 12.22% (0.2831 => 0.3177, std.dev.: 0.0063) SingleSource/UnitTests/ObjC/parameter-passing: 12.07% (0.3927 => 0.4401, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.91% (0.2871 => 0.3213, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.91% (0.1268 => 0.1419, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 11.61% (0.3886 => 0.4337, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 11.46% (1.2842 => 1.4314, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.25% (2.0665 => 2.2989, std.dev.: 0.0128) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.11% (0.3935 => 0.4372, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 11.05% (0.2877 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.96% (0.2756 => 0.3058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 10.92% (0.3828 => 0.4246, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 10.90% (0.2725 => 0.3022, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.81% (0.2793 => 0.3095, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.79% (0.3650 => 0.4044, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 10.72% (0.2714 => 0.3005, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.69% (0.3162 => 0.3500, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.58% (0.2891 => 0.3197, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 10.48% (0.3473 => 0.3837, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-4: 10.47% (0.3543 => 0.3914, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.3052 => 0.3370, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 10.37% (0.3694 => 0.4077, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.36% (0.3543 => 0.3910, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2872 => 0.3168, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 10.25% (63.2438 => 69.7265, std.dev.: 0.0700) SingleSource/Benchmarks/Shootout-C++/random: 10.24% (0.2802 => 0.3089, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 10.22% (0.3561 => 0.3925, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-2: 10.21% (0.3497 => 0.3854, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.10% (0.3516 => 0.3871, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.85% (0.1625 => 0.1785, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.63% (0.3136 => 0.3438, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 8.86% (0.6030 => 0.6564, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.79% (0.7326 => 0.7970, std.dev.: 0.0030) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.72% (0.1330 => 0.1446, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.48% (2.2022 => 2.3889, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.34% (0.2266 => 0.2455, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.01% (0.4879 => 0.5270, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.37% (0.1438 => 0.1544, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.37% (0.3177 => 0.3411, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 6.75% (10.3673 => 11.0667, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/objinst: 5.75% (0.3131 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.04% (7.9617 => 8.2831, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/block-byref-aggr: 2.99% (0.3817 => 0.3931, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4721, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6965, std.dev.: 0.0015) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2454, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 6.88% (11.6436 => 12.4449, std.dev.: 0.2249) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.74% (4.2280 => 4.4708, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.11% (0.9957 => 1.0366, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.98% (0.3316 => 0.3448, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.37% (2.0360 => 2.1047, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.63% (8.6802 => 8.9088, std.dev.: 0.0118) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.93% (3.6395 => 3.7098, std.dev.: 0.0118) MultiSource/Applications/aha/aha: 1.93% (3.1595 => 3.2204, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 1.69% (9.1159 => 9.2701, std.dev.: 0.0184) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3128, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 1.43% (1.0785 => 1.0939, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.07% (10.3460 => 10.4570, std.dev.: 0.0042) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1481, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.54% (5.2763 => 1.1850, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.05% (0.1622 => 0.0940, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.66% (5.3855 => 4.4883, std.dev.: 0.0060) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.01% (5.3526 => 4.4955, std.dev.: 0.0066) MultiSource/Applications/JM/ldecod/ldecod: -11.62% (10.4361 => 9.2238, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -7.69% (54.1659 => 50.0001, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.99% (1.7609 => 1.6379, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.29% (1.9577 => 0.6600, std.dev.: 0.0131) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3088, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/mandel: -33.51% (1.1492 => 0.7641, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/mandel-2: -33.49% (1.5373 => 1.0224, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4351, std.dev.: 0.0098) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1273, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.44% (2.6546 => 2.0059, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0909, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.81% (0.2161 => 0.1733, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030) SingleSource/UnitTests/Vector/multiplies: -16.72% (2.5528 => 2.1260, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/flops-6: -15.81% (1.6925 => 1.4250, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.04% (3.1443 => 2.7344, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.01% (0.9540 => 0.8394, std.dev.: 0.0007) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4917, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.98% (1.8329 => 1.7050, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.87% (19.9488 => 18.5778, std.dev.: 0.0159) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.79% (1.2373 => 1.1656, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.64% (8.1563 => 7.6963, std.dev.: 0.0050) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5870, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.55% (1.8525 => 1.7496) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/salsa20: -4.66% (10.2830 => 9.8040, std.dev.: 0.0022) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.64% (0.4808 => 0.4585, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6769, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3304, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary3: -1.27% (3.7221 => 3.6747, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: -1.10% (6.2999 => 6.2305, std.dev.: 0.0023) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.90% (0.2116 => 0.0658, std.dev.: 0.0028) Report Time: 1.36s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 04:00:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 06:00:17 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130120017.B9B642A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8107?compare_to=8103&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8107, Order: 173914, Start Time: 2013-01-30 10:00:41, End Time: 2013-01-30 12:00:36 To: 8103, Order: 173905, Start Time: 2013-01-30 07:39:06, End Time: 2013-01-30 09:42:18 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (95 on baseline) Performance Improvements: 6 (122 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (846 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/recursive: 3.10% (2.3701 => 2.4436, std.dev.: 0.0274) SingleSource/Benchmarks/Misc/flops: 2.50% (8.6324 => 8.8485, std.dev.: 0.0191) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hexxagon/hexxagon: -1.80% (1.0445 => 1.0257, std.dev.: 0.0027) MultiSource/Applications/minisat/minisat: -1.36% (0.7918 => 0.7810, std.dev.: 0.0027) MultiSource/Applications/ALAC/encode/alacconvert-encode: -1.06% (1.1535 => 1.1413, std.dev.: 0.0019) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -7.47% (14.2171 => 13.1554, std.dev.: 0.3327) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.16% (0.3292 => 0.3188, std.dev.: 0.0035) MultiSource/Benchmarks/llubenchmark/llu: -2.37% (2.0444 => 1.9960, std.dev.: 0.0104) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.69% (1.2295 => 1.2210, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -25.22% (0.0226 => 0.0169, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.46% (0.0434 => 0.0436, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.59% (0.0339 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.62% (0.0325 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 23.31% (0.0356 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: 0.48% (0.0208 => 0.0209, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.35% (0.0223 => 0.0226, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0229 => 0.0229, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -2.05% (0.1460 => 0.1430, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -2.56% (1.1562 => 1.1266, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.39% (0.3953 => 0.4087, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.47% (0.1498 => 0.1535, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.95% (0.0595 => 0.0678, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (0.0276 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.10% (0.0572 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.06% (1.2844 => 1.2852, std.dev.: 0.0553) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 61.11% (0.0018 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.70% (0.0614 => 0.0579, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0373 => 0.0373, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.49% (1.7463 => 1.7723, std.dev.: 0.0368) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0008 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -43.44% (0.0122 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.93% (34.1204 => 33.8033, std.dev.: 0.2972) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 396.13% (0.0336 => 0.1667, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 60.93% (0.1638 => 0.2636, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.77% (0.8893 => 1.2608, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.58% (0.8926 => 1.2637, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.51% (0.9120 => 1.2906, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.88% (0.9061 => 1.2765, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.67% (0.9612 => 1.3521, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.51% (0.9381 => 1.3181, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.37% (0.9564 => 1.3425, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.97% (0.9588 => 1.3420, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.18% (0.8990 => 1.2512, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.94% (0.9091 => 1.2631, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.89% (0.9855 => 1.3688, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.22% (0.9422 => 1.3023, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.18% (0.9998 => 1.3815, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.70% (0.9403 => 1.2948, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.24% (0.9512 => 1.3054, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.03% (0.9010 => 1.2346, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.48% (0.8736 => 1.1923, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.48% (0.8912 => 1.2163, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.33% (1.0119 => 1.3795, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.51% (1.0867 => 1.4726, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.32% (0.8732 => 1.1816, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.19% (1.0052 => 1.3589, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.84% (0.8846 => 1.1928, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 33.88% (0.0859 => 0.1150, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.50% (0.9867 => 1.3172, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.74% (1.0017 => 1.3297, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.28% (0.9788 => 1.2948, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.08% (0.9488 => 1.2532, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.04% (0.9507 => 1.2553, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.55% (1.0088 => 1.3271, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.82% (0.9685 => 1.2670, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.73% (0.9993 => 1.3064, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.60% (0.9127 => 1.1920, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.81% (0.9405 => 1.2209, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.93% (0.9550 => 1.2313, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.17% (1.0860 => 1.3811, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.95% (0.0738 => 0.0900, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.65% (0.0738 => 0.0883, std.dev.: 0.0034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.90% (0.0963 => 0.1145, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.83% (0.0669 => 0.0795, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.32% (0.3598 => 0.4257, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.20% (0.0642 => 0.0746, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.06% (1.0986 => 1.2641, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.60% (0.1240 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.29% (0.0805 => 0.0920, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.99% (0.1332 => 0.1505, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 12.90% (9.5202 => 10.7479, std.dev.: 0.0453) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.99% (0.2577 => 0.2886, std.dev.: 0.0017) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.99% (0.4596 => 0.5101, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ReedSolomon: 10.49% (0.2050 => 0.2265, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/matrix: 10.40% (0.2385 => 0.2633, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.89% (0.5369 => 0.5900, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 9.71% (1.4110 => 1.5480, std.dev.: 0.0078) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.61% (5.0381 => 5.4720, std.dev.: 0.0422) SingleSource/Benchmarks/Linpack/linpack-pc: 8.18% (0.2566 => 0.2776, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.71% (1.8651 => 2.0089, std.dev.: 0.0187) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.64% (0.2879 => 0.3099, std.dev.: 0.0031) MultiSource/Applications/oggenc/oggenc: 4.07% (5.3553 => 5.5734, std.dev.: 0.0348) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.89% (23.5861 => 24.2685, std.dev.: 0.0885) MultiSource/Benchmarks/7zip/7zip-benchmark: 2.62% (44.1538 => 45.3086, std.dev.: 0.2956) MultiSource/Benchmarks/Bullet/bullet: 2.60% (33.2440 => 34.1073, std.dev.: 0.2243) MultiSource/Benchmarks/McCat/05-eks/eks: 2.11% (0.4776 => 0.4877, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.4805 => 1.5027, std.dev.: 0.0030) MultiSource/Applications/JM/lencod/lencod: 1.37% (16.7012 => 16.9304, std.dev.: 0.0190) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 105912.50% (0.0008 => 0.8481, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout/matrix: 352.90% (1.5825 => 7.1671, std.dev.: 0.0277) SingleSource/Benchmarks/Shootout/ary3: 283.16% (2.2304 => 8.5461, std.dev.: 1.5914) MultiSource/Applications/sgefa/sgefa: 259.49% (0.3515 => 1.2636, std.dev.: 0.0165) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.56% (1.1825 => 4.0389, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.39% (4.8185 => 15.9200, std.dev.: 0.0868) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 204.39% (0.0228 => 0.0694, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: 193.80% (0.0129 => 0.0379, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary: 143.10% (0.0232 => 0.0564, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: 63.00% (2.9083 => 4.7406, std.dev.: 0.0800) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.76% (0.2562 => 0.3427, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.44% (3.1254 => 4.1081, std.dev.: 0.0108) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 24.86% (1.4588 => 1.8215, std.dev.: 0.0459) SingleSource/Benchmarks/Misc/salsa20: 21.88% (7.4497 => 9.0800, std.dev.: 0.0598) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.67% (4.8112 => 5.8056, std.dev.: 0.0501) SingleSource/Regression/C/uint64_to_float: 15.75% (1.5397 => 1.7822, std.dev.: 0.0765) MultiSource/Applications/JM/lencod/lencod: 14.56% (6.8159 => 7.8083, std.dev.: 0.2667) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.12% (5.1752 => 5.8540, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.81% (5.0033 => 5.6441, std.dev.: 0.0088) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.66% (3.6477 => 3.9636, std.dev.: 0.0323) SingleSource/Benchmarks/Misc/ReedSolomon: 7.72% (8.6447 => 9.3122, std.dev.: 0.0634) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.98% (4.7473 => 5.0786, std.dev.: 0.0092) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1836 => 4.4030, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.03% (5.0310 => 5.2337, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/pi: 3.43% (2.1390 => 2.2124, std.dev.: 0.0043) SingleSource/Benchmarks/Linpack/linpack-pc: 3.41% (50.8945 => 52.6310, std.dev.: 0.3093) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.21% (4.7254 => 4.8771, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8626, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.09% (2.5681 => 2.5962, std.dev.: 0.0090) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.98% (0.0808 => 0.0485, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.57% (0.0727 => 0.0512, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: -28.03% (0.0692 => 0.0498, std.dev.: 0.0005) SingleSource/Benchmarks/SmallPT/smallpt: -25.00% (0.1888 => 0.1416, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.41% (0.0676 => 0.0538, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: -18.83% (1.8964 => 1.5393, std.dev.: 0.0047) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.39% (0.1684 => 0.1408, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.87% (0.7686 => 0.6466, std.dev.: 0.0093) MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.86% (0.1009 => 0.0849, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.71% (1.0960 => 0.9238, std.dev.: 0.0133) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.01% (0.1079 => 0.0917, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -13.93% (9.8875 => 8.5102, std.dev.: 0.2738) MultiSource/Applications/spiff/spiff: -12.53% (1.0220 => 0.8939, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.41% (0.0862 => 0.0755, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.96% (0.7693 => 0.6850, std.dev.: 0.0214) MultiSource/Applications/Burg/burg: -10.74% (1.5979 => 1.4263, std.dev.: 0.0187) MultiSource/Applications/treecc/treecc: -10.65% (2.4719 => 2.2087, std.dev.: 0.0192) MultiSource/Applications/hexxagon/hexxagon: -10.29% (1.1433 => 1.0257, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -10.16% (0.1378 => 0.1238, std.dev.: 0.0031) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -9.35% (0.2481 => 0.2249, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -9.30% (0.1366 => 0.1239, std.dev.: 0.0033) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.16% (0.4074 => 0.3701, std.dev.: 0.0030) MultiSource/Applications/lua/lua: -8.68% (4.6406 => 4.2379, std.dev.: 0.0249) MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.09% (0.3560 => 0.3272, std.dev.: 0.0067) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.43% (1.0234 => 0.9474, std.dev.: 0.0070) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.37% (10.2703 => 9.5136, std.dev.: 0.0264) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.20% (0.9588 => 0.8898, std.dev.: 0.0146) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.17% (0.9124 => 0.8470, std.dev.: 0.0201) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -7.07% (0.6885 => 0.6398, std.dev.: 0.0074) MultiSource/Applications/sqlite3/sqlite3: -7.00% (17.5634 => 16.3342, std.dev.: 0.0270) MultiSource/Applications/lambda-0_1_3/lambda: -6.98% (0.8653 => 0.8049, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.95% (1.1498 => 1.0699, std.dev.: 0.0136) MultiSource/Applications/lemon/lemon: -6.76% (1.3979 => 1.3034, std.dev.: 0.0101) MultiSource/Applications/siod/siod: -6.57% (2.6437 => 2.4700, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.54% (0.5746 => 0.5370, std.dev.: 0.0129) MultiSource/Applications/ClamAV/clamscan: -6.48% (17.4365 => 16.3070, std.dev.: 0.0973) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.10% (1.2154 => 1.1413, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: -5.83% (0.2006 => 0.1889, std.dev.: 0.0031) MultiSource/Applications/d/make_dparser: -4.97% (3.7840 => 3.5961, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/hash: -4.95% (0.4689 => 0.4457, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.62% (0.2618 => 0.2497, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/ft/ft: -4.42% (0.2283 => 0.2182, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -4.20% (1.6874 => 1.6166, std.dev.: 0.0231) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.08% (1.5131 => 1.4513, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.06% (0.2709 => 0.2599, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/moments: -3.32% (0.4002 => 0.3869, std.dev.: 0.0021) MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.19% (1.1731 => 1.1357, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.47% (1.3924 => 1.3580, std.dev.: 0.0065) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.92% (7.2721 => 7.1325, std.dev.: 0.0337) MultiSource/Applications/kimwitu++/kc: -1.66% (18.9377 => 18.6240, std.dev.: 0.0740) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.85% (11.5523 => 3.9454, std.dev.: 0.0157) SingleSource/Benchmarks/Misc/fp-convert: -62.11% (15.6525 => 5.9310, std.dev.: 0.0390) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.22% (0.4146 => 0.1815, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.51% (0.4578 => 0.2357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.13% (11.3868 => 6.3621, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.83% (5.4023 => 3.6285, std.dev.: 0.0500) MultiSource/Benchmarks/Olden/bisort/bisort: -30.98% (0.9372 => 0.6469, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.97% (0.4452 => 0.3073, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/heapsort: -29.85% (4.4739 => 3.1386, std.dev.: 0.1662) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.12% (1.0816 => 0.7774, std.dev.: 0.0440) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.10% (0.5495 => 0.4006, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.35% (5.2605 => 3.8743, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.12% (4.4467 => 3.3295, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.09% (0.5826 => 0.4364, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.32% (0.5897 => 0.4463, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary3: -22.95% (1.8123 => 1.3963, std.dev.: 0.1373) MultiSource/Applications/minisat/minisat: -22.79% (7.9891 => 6.1682, std.dev.: 0.0478) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -21.13% (16.6791 => 13.1554, std.dev.: 0.3327) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.50% (1.5623 => 1.2576, std.dev.: 0.0296) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.50% (2.8778 => 2.3455, std.dev.: 0.1319) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7927, std.dev.: 0.0072) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.38% (0.1164 => 0.0950, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.94% (7.0016 => 6.0259, std.dev.: 0.0860) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.37% (0.0845 => 0.0732, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.01% (3.1921 => 2.7768, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.98% (5.3626 => 4.6668, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9933, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.44% (9.7992 => 8.5798, std.dev.: 0.0075) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.22% (1.4235 => 1.2638, std.dev.: 0.0270) MultiSource/Benchmarks/BitBench/drop3/drop3: -10.35% (0.3217 => 0.2884, std.dev.: 0.0045) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.29% (0.4081 => 0.3661, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/hash: -10.22% (4.5259 => 4.0635, std.dev.: 0.0368) MultiSource/Benchmarks/mafft/pairlocalalign: -9.38% (63.1520 => 57.2263, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout/nestedloop: -9.27% (0.2200 => 0.1996, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.62% (0.3609 => 0.3298, std.dev.: 0.0120) MultiSource/Applications/SPASS/SPASS: -8.46% (9.0650 => 8.2979, std.dev.: 0.0489) MultiSource/Applications/SIBsim4/SIBsim4: -7.95% (3.5443 => 3.2627, std.dev.: 0.0772) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.26% (4.2843 => 3.9734, std.dev.: 0.0101) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.73% (5.5974 => 5.2206, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2485, std.dev.: 0.0231) MultiSource/Benchmarks/Olden/health/health: -6.27% (0.3654 => 0.3425, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.11% (4.9799 => 4.6758, std.dev.: 0.0194) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.93% (0.1789 => 0.1683, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.57% (3.7662 => 3.5564, std.dev.: 0.0155) SingleSource/Benchmarks/McGill/queens: -5.39% (1.7443 => 1.6502, std.dev.: 0.0146) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.81% (0.3349 => 0.3188, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/hash2: -4.71% (3.6768 => 3.5038, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.53% (3.5127 => 3.3535, std.dev.: 0.0123) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.49% (1.4446 => 1.3797, std.dev.: 0.0110) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.08% (23.3986 => 22.4441, std.dev.: 0.3540) SingleSource/Benchmarks/Misc/ffbench: -3.97% (1.4244 => 1.3678, std.dev.: 0.0208) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.74% (3.5691 => 3.4357, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.72% (5.8973 => 5.6780, std.dev.: 0.0209) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.63% (40.4729 => 39.0037, std.dev.: 0.0558) SingleSource/Benchmarks/Shootout-C++/lists: -3.35% (17.2182 => 16.6406, std.dev.: 0.0314) MultiSource/Applications/lua/lua: -2.56% (29.0327 => 28.2898, std.dev.: 0.1043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.41% (3.0082 => 2.9357, std.dev.: 0.0076) MultiSource/Benchmarks/Bullet/bullet: -2.33% (7.2040 => 7.0361, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/mandel-2: -2.08% (0.8521 => 0.8344, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/whetstone: -1.91% (1.6251 => 1.5941, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5763, std.dev.: 0.0080) MultiSource/Applications/spiff/spiff: -1.78% (2.8571 => 2.8063, std.dev.: 0.0015) MultiSource/Benchmarks/llubenchmark/llu: -1.67% (2.0298 => 1.9960, std.dev.: 0.0104) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.66% (85.3042 => 83.8846, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.65% (3.5669 => 3.5082, std.dev.: 0.0174) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (8.8249 => 8.6841, std.dev.: 0.0442) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.39% (3.3596 => 3.3128, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.29% (3.7450 => 3.6967, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/methcall: -1.18% (8.7416 => 8.6387, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7487, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/flops-6: -1.09% (2.4234 => 2.3970, std.dev.: 0.0100) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.35% (1.2047 => 1.2210, std.dev.: 0.0032) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -27.47% (0.0233 => 0.0169, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.33% (0.0451 => 0.0436, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.30% (0.0328 => 0.0327, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.35% (0.0445 => 0.0439, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -0.44% (0.0227 => 0.0226, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0011) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013) MultiSource/Applications/ClamAV/clamscan: -6.54% (0.1530 => 0.1430, std.dev.: 0.0014) MultiSource/Applications/lemon/lemon: -41.61% (1.9293 => 1.1266, std.dev.: 0.0104) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.94% (0.4049 => 0.4087, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.66% (0.1510 => 0.1535, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -88.89% (0.0009 => 0.0001, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.67% (0.0978 => 0.0678, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (0.0276 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.08% (0.0590 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.63% (1.1617 => 1.2852, std.dev.: 0.0553) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.08% (0.0610 => 0.0579, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.18% (0.0268 => 0.0373, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.31% (0.7437 => 1.7723, std.dev.: 0.0368) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0092 => 0.0069, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 164.54% (12.7781 => 33.8033, std.dev.: 0.2972) Report Time: 0.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 04:43:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 06:43:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130130124328.E143B2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8108?compare_to=8101&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8108, Order: 173907, Start Time: 2013-01-30 09:08:14, End Time: 2013-01-30 12:43:51 To: 8101, Order: 173888, Start Time: 2013-01-30 04:21:47, End Time: 2013-01-30 07:58:05 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (187 on baseline) Performance Improvements: 1 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (750 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/dry: 1.74% (13.4353 => 13.6685, std.dev.: 0.0140) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: -2.09% (0.8529 => 0.8351, std.dev.: 0.0033) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 44.80% (0.0625 => 0.0905, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.28% (0.1063 => 0.1438, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 31.74% (0.1106 => 0.1457, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.17% (0.2969 => 0.3835, std.dev.: 0.0158) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.07% (0.0547 => 0.0706, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 28.00% (0.0475 => 0.0608, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.69% (0.4139 => 0.5285, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.46% (0.5900 => 0.7520, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0415 => 0.0526, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.54% (0.0584 => 0.0739, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 26.48% (1.5932 => 2.0151, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.19% (0.0714 => 0.0901, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.01% (0.4994 => 0.6293, std.dev.: 0.0211) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.84% (0.4253 => 0.5352, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.58% (0.5000 => 0.6279, std.dev.: 0.0201) MultiSource/Benchmarks/Olden/tsp/tsp: 25.54% (0.0599 => 0.0752, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.02% (0.1107 => 0.1384, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.97% (0.0897 => 0.1121, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/em3d/em3d: 23.73% (0.0948 => 0.1173, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.68% (0.0642 => 0.0794, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.53% (0.1003 => 0.1239, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 23.51% (0.0604 => 0.0746, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.39% (0.1103 => 0.1361, std.dev.: 0.0045) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.25% (0.1604 => 0.1977, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.03% (0.3903 => 0.4802, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.92% (0.1549 => 0.1904, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/05-eks/eks: 22.79% (0.1619 => 0.1988, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 22.66% (0.0821 => 0.1007, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.1088 => 0.1329, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 21.96% (0.0947 => 0.1155, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/08-main/main: 21.76% (0.1218 => 0.1483) MultiSource/Applications/sgefa/sgefa: 21.66% (0.0808 => 0.0983, std.dev.: 0.0037) MultiSource/Applications/aha/aha: 21.62% (0.0481 => 0.0585, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.55% (0.1462 => 0.1777, std.dev.: 0.0040) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.54% (0.3890 => 0.4728, std.dev.: 0.0101) MultiSource/Applications/spiff/spiff: 21.25% (0.4029 => 0.4885, std.dev.: 0.0172) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.21% (0.2866 => 0.3474, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/09-vor/vor: 21.20% (0.1505 => 0.1824, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.00% (0.2014 => 0.2437, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 20.92% (0.0698 => 0.0844, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.72% (0.2736 => 0.3303, std.dev.: 0.0088) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.48% (1.3152 => 1.5845, std.dev.: 0.0308) MultiSource/Applications/Burg/burg: 20.23% (0.5546 => 0.6668, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.99% (0.4658 => 0.5589, std.dev.: 0.0044) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0018) MultiSource/Benchmarks/MallocBench/gs/gs: 19.86% (1.8794 => 2.2526, std.dev.: 0.0260) MultiSource/Applications/hbd/hbd: 19.79% (0.9697 => 1.1616, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.69% (0.3271 => 0.3915, std.dev.: 0.0155) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.55% (0.0573 => 0.0685, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.49% (0.0513 => 0.0613, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 19.39% (0.1284 => 0.1533, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.16% (0.1968 => 0.2345, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.06% (3.5627 => 4.2416, std.dev.: 0.0709) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.02% (1.6211 => 1.9294, std.dev.: 0.0083) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.73% (0.0582 => 0.0691, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 18.38% (0.5826 => 0.6897, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 18.37% (0.1421 => 0.1682, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.32% (0.3930 => 0.4650, std.dev.: 0.0020) SingleSource/UnitTests/2006-12-11-LoadConstants: 18.29% (0.0563 => 0.0666) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.25% (0.4361 => 0.5157, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.25% (0.5026 => 0.5943, std.dev.: 0.0107) SingleSource/UnitTests/ObjC++/property-reference-object: 18.03% (0.5889 => 0.6951, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.95% (0.2875 => 0.3391, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 17.80% (1.0781 => 1.2700, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/objinst: 17.64% (0.2823 => 0.3321, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.64% (0.2738 => 0.3221, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/strcat: 17.64% (0.2750 => 0.3235, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/except: 17.61% (0.2811 => 0.3306, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 17.58% (0.2566 => 0.3017, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 17.56% (0.2813 => 0.3307, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.50% (2.0673 => 2.4290, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 17.46% (0.9909 => 1.1639, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/fibo: 17.43% (0.2725 => 0.3200, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.41% (0.2792 => 0.3278, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 17.39% (23.5202 => 27.6108, std.dev.: 0.0635) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.38% (0.2911 => 0.3417, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.38% (1.9694 => 2.3117, std.dev.: 0.0467) MultiSource/Applications/ClamAV/clamscan: 17.34% (4.2109 => 4.9412, std.dev.: 0.1132) SingleSource/Benchmarks/Shootout-C++/random: 17.30% (0.2803 => 0.3288, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 17.30% (0.2780 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.28% (0.3195 => 0.3747, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 17.24% (0.2714 => 0.3182, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.17% (1.9966 => 2.3395, std.dev.: 0.0466) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.11% (0.2729 => 0.3196, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 16.99% (0.3267 => 0.3822, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.97% (0.3625 => 0.4240, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.96% (0.3060 => 0.3579, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 16.92% (1.4269 => 1.6683, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/wc: 16.89% (0.3096 => 0.3619, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.87% (2.7292 => 3.1896, std.dev.: 0.0237) SingleSource/Benchmarks/Shootout-C++/ary: 16.85% (0.3258 => 0.3807, std.dev.: 0.0003) SingleSource/Regression/C++/ofstream_ctor: 16.78% (0.3004 => 0.3508, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.78% (0.3362 => 0.3926, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 16.72% (0.3726 => 0.4349, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.70% (0.3317 => 0.3871, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.70% (0.1090 => 0.1272, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: 16.46% (0.7171 => 0.8351, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.43% (4.4195 => 5.1457, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout-C++/lists: 16.37% (0.3348 => 0.3896, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/lists1: 16.36% (0.3477 => 0.4046, std.dev.: 0.0059) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.18% (0.3282 => 0.3813, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 16.12% (0.3678 => 0.4271, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 16.06% (0.4146 => 0.4812, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.05% (0.0673 => 0.0781, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash2: 15.93% (0.4251 => 0.4928, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 15.89% (0.7875 => 0.9126, std.dev.: 0.0184) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.77% (0.3981 => 0.4609, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 15.76% (0.1028 => 0.1190, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.69% (0.3690 => 0.4269, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 15.57% (0.2075 => 0.2398, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 15.56% (5.5417 => 6.4039, std.dev.: 0.0312) SingleSource/Benchmarks/Misc-C++/bigfib: 15.32% (0.5012 => 0.5780, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.01% (0.3845 => 0.4422, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.98% (0.5361 => 0.6164, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: 14.86% (0.3465 => 0.3980, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.80% (0.3460 => 0.3972, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 14.79% (0.2691 => 0.3089, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.76% (0.6435 => 0.7385, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 14.76% (0.3469 => 0.3981, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 14.74% (0.3446 => 0.3954, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.74% (0.3488 => 0.4002, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: 14.73% (0.3496 => 0.4011, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.56% (0.3442 => 0.3943, std.dev.: 0.0001) MultiSource/Applications/JM/ldecod/ldecod: 14.52% (2.1653 => 2.4796, std.dev.: 0.0436) SingleSource/UnitTests/ObjC/property: 14.49% (0.3650 => 0.4179, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.32% (0.2737 => 0.3129, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 14.19% (0.3643 => 0.4160, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 14.10% (4.6177 => 5.2687, std.dev.: 0.0833) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.02% (0.2068 => 0.2358, std.dev.: 0.0030) MultiSource/Benchmarks/mafft/pairlocalalign: 14.00% (2.1013 => 2.3954, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.97% (0.2040 => 0.2325, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.81% (0.3084 => 0.3510, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.81% (0.0804 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.65% (11.6398 => 13.2287, std.dev.: 0.0077) MultiSource/Applications/lambda-0_1_3/lambda: 13.49% (0.3498 => 0.3970, std.dev.: 0.0080) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.49% (0.7426 => 0.8428, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.22% (0.2103 => 0.2381, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.07% (0.3336 => 0.3772, std.dev.: 0.0047) MultiSource/Applications/siod/siod: 13.07% (0.6634 => 0.7501, std.dev.: 0.0079) MultiSource/Benchmarks/PAQ8p/paq8p: 12.85% (0.4847 => 0.5470, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.71% (0.1383 => 0.1545, std.dev.: 0.0019) MultiSource/Applications/lemon/lemon: 11.59% (0.2391 => 0.2668, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.34% (4.6926 => 5.2246, std.dev.: 0.0044) MultiSource/Applications/sqlite3/sqlite3: 11.07% (2.0346 => 2.2598, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.32% (0.5584 => 0.6160, std.dev.: 0.0017) MultiSource/Applications/kimwitu++/kc: 8.78% (11.9555 => 13.0052, std.dev.: 0.0320) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.27% (0.3792 => 0.3992, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.86% (29.0505 => 181.5250, std.dev.: 0.0096) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0093) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (0.3693 => 0.4077, std.dev.: 0.0046) MultiSource/Applications/ClamAV/clamscan: 10.10% (0.2802 => 0.3085, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.49% (3.3903 => 3.6103, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (12.0509 => 12.6792, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2416, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8910, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6916, std.dev.: 0.0031) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0043) MultiSource/Benchmarks/Olden/health/health: 2.72% (0.6276 => 0.6447, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1973, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.47% (7.1849 => 7.2907, std.dev.: 0.0019) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3049, std.dev.: 0.0051) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.44% (1.0142 => 1.0288, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.17% (1.0927 => 1.1055, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4819, std.dev.: 0.0051) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5905, std.dev.: 0.0042) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.05% (3.1722 => 3.2054, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0012) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5463, std.dev.: 0.0067) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.13% (17.2379 => 14.2843, std.dev.: 0.0143) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -8.49% (0.2402 => 0.2198, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9760, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7995, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/tsp/tsp: -7.22% (2.1113 => 1.9588, std.dev.: 0.0005) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2128, std.dev.: 0.0150) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2416, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -3.60% (11.2080 => 10.8045, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0035) SingleSource/Benchmarks/Dhrystone/dry: -2.70% (14.0481 => 13.6685, std.dev.: 0.0140) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2268, std.dev.: 0.0358) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5776, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.49% (5.5810 => 5.4981, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.15% (105.3826 => 104.1715, std.dev.: 0.0543) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.04s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 06:10:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 08:10:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130141026.2002A2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8109?compare_to=8105&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8109, Order: 173924, Start Time: 2013-01-30 12:36:10, End Time: 2013-01-30 14:10:48 To: 8105, Order: 173918, Start Time: 2013-01-30 10:21:17, End Time: 2013-01-30 11:55:43 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (120 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 50.19% (0.0267 => 0.0401, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/neural/neural: 46.47% (0.1500 => 0.2197, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.14% (0.6395 => 0.8834, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.86% (0.6395 => 0.8752, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.07% (0.5805 => 0.7725, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.89% (0.5688 => 0.7559, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.81% (0.6260 => 0.8314, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.64% (0.5849 => 0.7758, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.57% (0.5456 => 0.7233, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.02% (0.6230 => 0.8225, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.00% (0.5581 => 0.7367, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.98% (0.5575 => 0.7358, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.92% (0.5567 => 0.7344, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.23% (0.5802 => 0.7614, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.09% (0.5941 => 0.7788, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.60% (0.5705 => 0.7451, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.46% (0.5857 => 0.7641, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.43% (0.5478 => 0.7145, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.31% (0.5859 => 0.7635, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.24% (0.5569 => 0.7253, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.20% (0.6033 => 0.7855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.16% (0.5570 => 0.7250, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.00% (1.6474 => 2.1416, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.92% (0.5591 => 0.7264, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.43% (0.6440 => 0.8335, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.25% (0.6189 => 0.7999, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.00% (0.5925 => 0.7643, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.95% (0.6676 => 0.8609, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.66% (0.6304 => 0.8111, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.42% (0.5863 => 0.7529, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.89% (0.6446 => 0.8244, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.59% (0.6681 => 0.8524, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.47% (0.0699 => 0.0891, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.27% (0.6194 => 0.7883, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.09% (0.6660 => 0.8464, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.84% (0.6297 => 0.7987, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.33% (0.6667 => 0.8356, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.19% (0.7524 => 0.9344, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.44% (0.7339 => 0.9059, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.98% (2.2587 => 2.7777, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.65% (0.0693 => 0.0843, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 16.38% (0.3357 => 0.3907, std.dev.: 0.0089) MultiSource/Applications/lemon/lemon: 15.52% (1.1450 => 1.3227, std.dev.: 0.0148) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.07% (0.1982 => 0.2241, std.dev.: 0.0014) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.70% (4.5069 => 5.0792, std.dev.: 0.0078) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.33% (1.6364 => 1.8381, std.dev.: 0.0099) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.11% (0.1230 => 0.1379, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.10% (0.4916 => 0.5511, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.98% (3.5339 => 3.9572, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.54% (0.4515 => 0.5036, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.06% (9.2283 => 10.1568, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/hash: 9.33% (0.4524 => 0.4946, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.30% (0.1731 => 0.1892, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.08% (0.5329 => 0.5813, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.7021 => 0.7644, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.84% (1.2515 => 1.3621, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4861 => 0.5252, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.95% (0.2001 => 0.2160, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.83% (1.2784 => 1.3785, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.55% (1.4642 => 1.5748, std.dev.: 0.0095) SingleSource/Benchmarks/Misc-C++/bigfib: 6.68% (0.6750 => 0.7201, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.17% (5.4682 => 5.8058, std.dev.: 0.0053) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.21% (0.3319 => 0.3492, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.71% (22.4056 => 23.4608, std.dev.: 0.0104) MultiSource/Applications/oggenc/oggenc: 3.89% (5.0226 => 5.2181, std.dev.: 0.0090) MultiSource/Applications/minisat/minisat: 3.67% (0.7447 => 0.7720, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.58% (0.9557 => 0.9899, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.44% (15.5079 => 16.0419, std.dev.: 0.0169) MultiSource/Applications/SIBsim4/SIBsim4: 3.28% (1.3864 => 1.4319, std.dev.: 0.0028) MultiSource/Applications/spiff/spiff: 3.27% (0.8418 => 0.8693, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.22% (0.3446 => 0.3557, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.04% (0.3491 => 0.3597, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.01% (0.3394 => 0.3496, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.71% (0.4427 => 0.4547, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.61% (0.5168 => 0.5303, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.14% (1.3722 => 1.4015, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 1.73% (18.2933 => 18.6099, std.dev.: 0.0093) MultiSource/Benchmarks/Bullet/bullet: 1.52% (34.0927 => 34.6117, std.dev.: 0.0385) MultiSource/Applications/d/make_dparser: 1.27% (3.5154 => 3.5601, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7909, std.dev.: 0.0142) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.62% (0.9531 => 1.0257, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.77% (54.5751 => 56.6302, std.dev.: 0.0592) SingleSource/Benchmarks/Misc-C++/bigfib: 3.00% (0.3328 => 0.3428, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0081) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3018, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (79.7170 => 80.9886, std.dev.: 0.3563) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2231 => 18.5096, std.dev.: 0.0069) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5320 => 4.5984, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2710, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3489 => 10.4557, std.dev.: 0.0058) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: -4.75% (0.3812 => 0.3631, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -4.74% (0.3880 => 0.3696, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.73% (0.3848 => 0.3666) SingleSource/UnitTests/ObjC/synchronized: -4.72% (0.3896 => 0.3712, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: -4.70% (0.3831 => 0.3651, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.60% (0.3891 => 0.3712, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: -4.56% (0.4033 => 0.3849, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: -4.11% (0.6347 => 0.6086, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: -3.80% (0.6441 => 0.6196, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/property: -3.69% (0.4199 => 0.4044, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: -3.66% (2.4924 => 2.4012, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3821 => 0.3684, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.49% (0.9852 => 0.9508, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.47% (0.3057 => 0.2951, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4280 => 0.4138, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: -3.12% (0.7779 => 0.7536, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.76% (0.9542 => 0.9279, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.68% (1.3148 => 1.2795, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.63% (2.1713 => 2.1143, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -2.36% (20.7746 => 20.2836, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.04% (0.6484 => 0.6352, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.82% (14.2083 => 13.9495, std.dev.: 0.0042) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.53% (6.7716 => 6.6682, std.dev.: 0.0125) MultiSource/Applications/JM/lencod/lencod: -1.34% (16.1920 => 15.9749, std.dev.: 0.0154) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.09% (1.0544 => 1.0429, std.dev.: 0.0029) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.43% (1.8100 => 0.6982, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -25.01% (1.3643 => 1.0231, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/methcall: -23.38% (7.5137 => 5.7571, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.86% (83.5423 => 64.4475, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2052, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.04% (2.5106 => 2.1330, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.34% (3.1443 => 2.7250, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3540, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1750, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (7.9763 => 7.7514, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6293, std.dev.: 0.0074) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1742, std.dev.: 0.0044) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.68% (1.3096 => 1.2876, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4702, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.52% (1.6219 => 1.5973, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.34% (3.7092 => 3.6596, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.31% (1.6307 => 1.6094, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.29% (1.6086 => 1.5878, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: -1.03% (1.0443 => 1.0335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 06:21:22 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 08:21:22 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130142122.95F2E2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8110?compare_to=8107&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8110, Order: 173918, Start Time: 2013-01-30 12:18:53, End Time: 2013-01-30 14:21:47 To: 8107, Order: 173914, Start Time: 2013-01-30 10:00:41, End Time: 2013-01-30 12:00:36 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 14 (88 on baseline) Performance Improvements: 0 (75 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1050 (900 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.96% (0.6573 => 0.6833, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.21% (0.3244 => 0.3348, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.64% (0.6466 => 0.6637, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.85% (0.6850 => 0.6977, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.99% (1.4592 => 1.8677, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.15% (6.6284 => 7.3009, std.dev.: 0.2416) SingleSource/Regression/C/uint64_to_float: 6.67% (1.7822 => 1.9011, std.dev.: 0.0136) SingleSource/Benchmarks/Misc-C++/bigfib: 6.54% (0.3410 => 0.3633, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (13.1554 => 13.9590, std.dev.: 0.1379) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 5.43% (0.3298 => 0.3477, std.dev.: 0.0058) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.87% (1.2453 => 1.3060, std.dev.: 0.0126) SingleSource/Benchmarks/Dhrystone/fldry: 4.14% (0.6587 => 0.6860, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.22% (3.5082 => 3.5510, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/matrix: 1.12% (4.7406 => 4.7936, std.dev.: 0.0190) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.54% (1.2210 => 1.2144, std.dev.: 0.1044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 34.91% (0.0169 => 0.0228, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.92% (0.0436 => 0.0440, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0337 => 0.0337, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.53% (0.0327 => 0.0322, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.59% (0.0439 => 0.0432, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0209 => 0.0209, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -1.33% (0.0226 => 0.0223, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 10.04% (0.0229 => 0.0252, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.59% (0.1430 => 0.1467, std.dev.: 0.0213) MultiSource/Applications/lemon/lemon: 3.54% (1.1266 => 1.1665, std.dev.: 0.2994) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.60% (0.4087 => 0.3899, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.11% (0.1535 => 0.1518, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.46% (0.0678 => 0.0641, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 4.53% (0.0265 => 0.0277, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.93% (0.0560 => 0.0538, std.dev.: 0.0036) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.19% (1.2852 => 1.2876, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 3.45% (0.0579 => 0.0599, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.80% (0.0373 => 0.0370, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.91% (1.7723 => 1.7562, std.dev.: 0.0073) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.03% (0.0069 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.09% (33.8033 => 34.1717, std.dev.: 0.1400) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 412.20% (0.0336 => 0.1721, std.dev.: 0.0432) SingleSource/Regression/C/sumarraymalloc: 119.80% (0.0293 => 0.0644, std.dev.: 0.0034) SingleSource/Regression/C/sumarray2d: 119.34% (0.0274 => 0.0601, std.dev.: 0.0097) MultiSource/Benchmarks/FreeBench/neural/neural: 61.36% (0.1638 => 0.2643, std.dev.: 0.0042) SingleSource/Regression/C/sumarray: 61.13% (0.0265 => 0.0427, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.45% (0.8893 => 1.2668, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.86% (0.8926 => 1.2662, std.dev.: 0.0412) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.81% (0.9120 => 1.2933, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.69% (0.9612 => 1.3619, std.dev.: 0.1101) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.39% (0.9061 => 1.2811, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.55% (0.9564 => 1.3442, std.dev.: 0.0671) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.25% (0.9588 => 1.3447, std.dev.: 0.0434) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.86% (0.9091 => 1.2715, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.73% (0.8990 => 1.2562, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.03% (0.9855 => 1.3701, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.63% (0.9998 => 1.3860, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.34% (0.9422 => 1.3034, std.dev.: 0.0115) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.21% (0.9403 => 1.2996, std.dev.: 0.0549) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.55% (0.9010 => 1.2393, std.dev.: 0.0319) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.33% (0.9512 => 1.3063, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.87% (1.0119 => 1.3850, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.68% (0.8912 => 1.2181, std.dev.: 0.0454) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.61% (0.8736 => 1.1934, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.11% (1.0867 => 1.4791, std.dev.: 0.0512) SingleSource/Benchmarks/Stanford/IntMM: 35.73% (0.0431 => 0.0585, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.33% (0.8732 => 1.1817, std.dev.: 0.0358) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.33% (1.0052 => 1.3603, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.22% (0.8846 => 1.1962, std.dev.: 0.0298) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.84% (0.9867 => 1.3206, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.17% (1.0017 => 1.3340, std.dev.: 0.0614) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.99% (0.9788 => 1.3017, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.74% (0.9685 => 1.2856, std.dev.: 0.0199) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.63% (0.9488 => 1.2584, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.24% (0.9507 => 1.2572, std.dev.: 0.0376) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.97% (1.0088 => 1.3313, std.dev.: 0.1045) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.85% (0.9127 => 1.1943, std.dev.: 0.0394) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.23% (0.9993 => 1.3014, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.14% (0.9405 => 1.2240, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.08% (0.9550 => 1.2327, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.65% (1.0860 => 1.3863, std.dev.: 0.0383) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.63% (0.0738 => 0.0905, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.38% (0.0738 => 0.0881, std.dev.: 0.0051) MultiSource/Applications/sgefa/sgefa: 19.29% (0.3598 => 0.4292, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.39% (0.0669 => 0.0792, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.0963 => 0.1137, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.53% (0.0805 => 0.0930, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.25% (3.6295 => 4.1829, std.dev.: 0.1542) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.11% (0.1240 => 0.1415, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.03% (0.0783 => 0.0885, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.41% (0.2577 => 0.2871, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 10.69% (0.2385 => 0.2640, std.dev.: 0.0094) SingleSource/Benchmarks/Linpack/linpack-pc: 8.69% (0.2566 => 0.2789, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.75% (1.8651 => 2.0097, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.29% (0.2879 => 0.3089, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 5.62% (0.6711 => 0.7088, std.dev.: 0.0092) MultiSource/Benchmarks/7zip/7zip-benchmark: 3.67% (44.1538 => 45.7749, std.dev.: 0.4658) MultiSource/Benchmarks/Bullet/bullet: 3.21% (33.2440 => 34.3116, std.dev.: 0.3961) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107475.00% (0.0008 => 0.8606, std.dev.: 0.0283) SingleSource/Benchmarks/Shootout/matrix: 355.69% (1.5825 => 7.2113, std.dev.: 0.0432) SingleSource/Benchmarks/Shootout/ary3: 304.70% (2.2304 => 9.0265, std.dev.: 1.8011) MultiSource/Applications/sgefa/sgefa: 259.43% (0.3515 => 1.2634, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.40% (1.1825 => 4.0725, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.05% (4.8185 => 15.9997, std.dev.: 0.0938) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 194.30% (0.0228 => 0.0671, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 189.15% (0.0129 => 0.0373, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 136.64% (0.0232 => 0.0549, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/matrix: 64.82% (2.9083 => 4.7936, std.dev.: 0.0190) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.72% (0.2562 => 0.3426, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.51% (3.1254 => 4.1102, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 30.30% (5.6033 => 7.3009, std.dev.: 0.2416) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.59% (1.4588 => 1.8467, std.dev.: 0.0156) SingleSource/Regression/C/uint64_to_float: 23.47% (1.5397 => 1.9011, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/salsa20: 22.07% (7.4497 => 9.0935, std.dev.: 0.0320) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.47% (4.8112 => 5.7961, std.dev.: 0.0271) MultiSource/Applications/JM/lencod/lencod: 13.64% (6.8159 => 7.7458, std.dev.: 0.0706) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.19% (5.1752 => 5.8579, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.90% (5.0033 => 5.6488, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.13% (3.6477 => 3.9809, std.dev.: 0.0452) SingleSource/Benchmarks/Misc/ReedSolomon: 8.02% (8.6447 => 9.3382, std.dev.: 0.1364) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.03% (4.7473 => 5.0809, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: 6.66% (1.0425 => 1.1119, std.dev.: 0.0187) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.91% (0.6211 => 0.6578, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.40% (4.1836 => 4.4094, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2295, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/pi: 3.37% (2.1390 => 2.2111, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.24% (4.7254 => 4.8785, std.dev.: 0.0012) SingleSource/Benchmarks/Linpack/linpack-pc: 2.07% (50.8945 => 51.9470, std.dev.: 0.2961) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.11% (6.4534 => 6.5253, std.dev.: 0.0102) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.24% (0.0808 => 0.0499, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.40% (0.0727 => 0.0506, std.dev.: 0.0003) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.02% (0.0692 => 0.0505, std.dev.: 0.0024) SingleSource/Benchmarks/SmallPT/smallpt: -25.32% (0.1888 => 0.1410, std.dev.: 0.0142) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.81% (0.1684 => 0.1384, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.05% (0.1009 => 0.0837, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.94% (0.1079 => 0.0907, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.58% (1.0960 => 0.9362, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.65% (0.7686 => 0.6637, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.06% (0.0862 => 0.0758, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: -9.70% (2.4719 => 2.2322, std.dev.: 0.0472) MultiSource/Benchmarks/SciMark2-C/scimark2: -9.62% (0.4074 => 0.3682, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.31% (0.7693 => 0.6977, std.dev.: 0.0027) MultiSource/Applications/aha/aha: -9.29% (0.1378 => 0.1250, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.57% (0.1366 => 0.1249, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.58% (10.2703 => 9.4922, std.dev.: 0.1186) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -7.07% (0.9124 => 0.8479, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -7.00% (2.6437 => 2.4586, std.dev.: 0.0599) MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.83% (1.2154 => 1.1324, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.74% (1.1498 => 1.0723, std.dev.: 0.0107) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.46% (0.3560 => 0.3330, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.26% (0.6885 => 0.6454, std.dev.: 0.0051) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.36% (0.5746 => 0.5438, std.dev.: 0.0056) MultiSource/Applications/d/make_dparser: -5.30% (3.7840 => 3.5836, std.dev.: 0.0656) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.39% (1.5131 => 1.4618, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.75% (11.5523 => 3.9565, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/fp-convert: -61.80% (15.6525 => 5.9799, std.dev.: 0.0079) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.37% (0.4146 => 0.1809, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.38% (0.4578 => 0.2363, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.01% (11.3868 => 6.3755, std.dev.: 0.0361) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.88% (5.4023 => 3.6259, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.73% (0.4452 => 0.3084, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.90% (0.5495 => 0.4017, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.42% (5.2605 => 3.8705, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.32% (4.4467 => 3.3207, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.08% (0.5826 => 0.4365, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.40% (0.5897 => 0.4458, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.48% (4.9921 => 3.8198, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary3: -21.98% (1.8123 => 1.4140, std.dev.: 0.0476) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.48% (5.8755 => 4.7897, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.61% (7.0016 => 5.7687, std.dev.: 0.1737) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.31% (16.6791 => 13.9590, std.dev.: 0.1379) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.98% (3.1921 => 2.7777, std.dev.: 0.0015) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.89% (0.1164 => 0.1014, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6750, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.55% (5.7056 => 4.9898, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.46% (9.7992 => 8.5785, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout/hash: -9.64% (4.5259 => 4.0896, std.dev.: 0.1499) SingleSource/Benchmarks/Shootout/nestedloop: -9.18% (0.2200 => 0.1998, std.dev.: 0.0027) MultiSource/Benchmarks/mafft/pairlocalalign: -9.07% (63.1520 => 57.4227, std.dev.: 0.3548) MultiSource/Applications/SIBsim4/SIBsim4: -7.49% (3.5443 => 3.2787, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.94% (23.3986 => 21.7759, std.dev.: 0.3960) MultiSource/Applications/SPASS/SPASS: -6.93% (9.0650 => 8.4369, std.dev.: 0.0915) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2286, std.dev.: 0.0185) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.45% (4.2843 => 4.0081, std.dev.: 0.0108) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.45% (4.5424 => 4.2496, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.67% (4.9799 => 4.6977, std.dev.: 0.0340) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.42% (46.0987 => 43.6003, std.dev.: 0.6909) SingleSource/Benchmarks/McGill/queens: -5.23% (1.7443 => 1.6531, std.dev.: 0.0171) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.58% (3.7662 => 3.5938, std.dev.: 0.0234) SingleSource/Benchmarks/Shootout-C++/hash2: -4.46% (3.6768 => 3.5129, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.5127 => 3.3590, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.77% (3.5691 => 3.4344, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.64% (5.8973 => 5.6828, std.dev.: 0.0351) SingleSource/Benchmarks/Shootout-C++/lists: -3.16% (17.2182 => 16.6741, std.dev.: 0.1370) MultiSource/Applications/spiff/spiff: -2.16% (2.8571 => 2.7953, std.dev.: 0.0114) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -2.07% (3.0082 => 2.9458, std.dev.: 0.0086) SingleSource/Benchmarks/Misc/whetstone: -1.80% (1.6251 => 1.5958, std.dev.: 0.0051) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.2040 => 7.0762, std.dev.: 0.0438) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.76% (8.7327 => 8.5793, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8978, std.dev.: 0.1453) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.31% (3.3596 => 3.3156, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7483, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.09% (6.6336 => 6.5614, std.dev.: 0.0066) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.02% (3.7450 => 3.7067, std.dev.: 0.0011) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.81% (1.2047 => 1.2144, std.dev.: 0.1044) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.15% (0.0233 => 0.0228, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.44% (0.0451 => 0.0440, std.dev.: 0.0124) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.47% (0.0394 => 0.0337, std.dev.: 0.0104) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0137) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0065) SingleSource/UnitTests/Vector/Altivec/test1: -1.76% (0.0227 => 0.0223, std.dev.: 0.0076) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0050) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.12% (0.1530 => 0.1467, std.dev.: 0.0213) MultiSource/Applications/lemon/lemon: -39.54% (1.9293 => 1.1665, std.dev.: 0.2994) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4049 => 0.3899, std.dev.: 0.0138) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.53% (0.1510 => 0.1518, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.46% (0.0978 => 0.0641, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.81% (0.0590 => 0.0538, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.84% (1.1617 => 1.2876, std.dev.: 0.0193) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.80% (0.0610 => 0.0599, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.06% (0.0268 => 0.0370, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.14% (0.7437 => 1.7562, std.dev.: 0.0073) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.52% (0.0092 => 0.0098, std.dev.: 0.0012) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.42% (12.7781 => 34.1717, std.dev.: 0.1400) Report Time: 0.71s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 06:43:32 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 08:43:32 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130144332.EAFF82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8111?compare_to=8106&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8111, Order: 173918, Start Time: 2013-01-30 12:31:26, End Time: 2013-01-30 14:43:55 To: 8106, Order: 173914, Start Time: 2013-01-30 09:48:02, End Time: 2013-01-30 12:00:35 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (226 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.03% (1.0366 => 1.0259, std.dev.: 0.0022) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1329 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.48% (0.0418 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.74% (0.0658 => 0.0676, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: 0.02% (499.7581 => 499.8589, std.dev.: 0.0086) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44225.52% (1.1277 => 499.8589, std.dev.: 0.0086) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.41% (0.5229 => 1.7068, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 26.46% (14.9895 => 18.9551, std.dev.: 0.0104) MultiSource/Applications/kimwitu++/kc: 47.78% (14.1553 => 20.9189, std.dev.: 0.0164) MultiSource/Benchmarks/MallocBench/gs/gs: 21.15% (4.1105 => 4.9799, std.dev.: 0.0065) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.70% (1.1048 => 1.7865, std.dev.: 0.0036) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.36% (7.1582 => 39.3959, std.dev.: 0.0129) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.32% (3.4629 => 6.6251, std.dev.: 0.0134) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.72% (0.6222 => 1.1431, std.dev.: 0.0017) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.11% (0.0720 => 7.4456, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11089500.00% (0.0001 => 11.0896, std.dev.: 0.0255) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849800.00% (0.0001 => 9.8499, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491300.00% (0.0001 => 5.4914, std.dev.: 0.0086) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 816.07% (1.1194 => 10.2545, std.dev.: 0.0183) MultiSource/Applications/ClamAV/clamscan: 149.65% (22.1758 => 55.3625, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/lowercase: 132.03% (0.0256 => 0.0594, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.80% (0.0929 => 0.1884, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.18% (0.1463 => 0.2636, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 66.71% (0.0730 => 0.1217, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656) SingleSource/Regression/C/sumarray: 64.94% (0.0231 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.31% (1.5859 => 2.4947, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.00% (2.9384 => 4.6133, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.89% (7.0540 => 10.9262, std.dev.: 0.0174) MultiSource/Benchmarks/FreeBench/distray/distray: 53.31% (0.1056 => 0.1619, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.55% (8.1363 => 12.1679, std.dev.: 0.0144) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.20% (0.0439 => 0.0655, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.87% (2.2024 => 3.2346, std.dev.: 0.0146) MultiSource/Applications/sgefa/sgefa: 44.84% (0.3109 => 0.4503, std.dev.: 0.0002) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 40.99% (0.1432 => 0.2019, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 40.85% (21.9371 => 30.8975, std.dev.: 0.0052) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.77% (0.1062 => 0.1495, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.86% (1.5415 => 2.1406, std.dev.: 0.0039) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.81% (4.2646 => 5.8772, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.31% (0.4615 => 0.6337, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.18% (0.5105 => 0.6952, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.98% (0.2271 => 0.3088, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.25% (0.1892 => 0.2540, std.dev.: 0.0032) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.14% (0.6675 => 0.8954, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 33.83% (1.1642 => 1.5581, std.dev.: 0.0070) SingleSource/UnitTests/ObjC/dot-syntax-1: 33.61% (0.0479 => 0.0640, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 33.25% (0.1143 => 0.1523, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.82% (0.0457 => 0.0607, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 32.73% (0.4299 => 0.5706, std.dev.: 0.0012) MultiSource/Benchmarks/NPB-serial/is/is: 32.68% (0.0719 => 0.0954, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 31.84% (0.1655 => 0.2182, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.78% (0.0793 => 0.1045, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.50% (0.1695 => 0.2229, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.02% (0.1125 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 30.87% (9.4845 => 12.4119, std.dev.: 0.0157) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.99% (3.8922 => 5.0594, std.dev.: 0.0111) MultiSource/Applications/viterbi/viterbi: 29.58% (0.1555 => 0.2015, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 29.26% (0.4289 => 0.5544, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 29.25% (0.2554 => 0.3301, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 28.96% (1.0722 => 1.3827, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.52% (0.3121 => 0.4011, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.51% (1.4186 => 1.8230, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/whetstone: 28.33% (0.0660 => 0.0847, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.17% (0.1906 => 0.2443, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 28.05% (0.7115 => 0.9111, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 27.94% (0.4620 => 0.5911, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.67% (0.0730 => 0.0932, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.93% (0.1337 => 0.1697, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: 26.89% (0.1175 => 0.1491, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 26.71% (0.0614 => 0.0778, std.dev.: 0.0007) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.69% (0.1566 => 0.1984, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.64% (0.0672 => 0.0851, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 26.61% (0.6456 => 0.8174, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.45% (0.5020 => 0.6348, std.dev.: 0.0017) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.45% (0.1032 => 0.1305, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 25.89% (0.1151 => 0.1449, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/hash: 25.57% (0.0485 => 0.0609, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.53% (0.0842 => 0.1057, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 25.40% (0.0626 => 0.0785) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.32% (0.1236 => 0.1549, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/15-trie/trie: 25.24% (0.0527 => 0.0660, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 24.98% (0.7835 => 0.9792, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.77% (1.3050 => 1.6282, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.74% (0.0675 => 0.0842, std.dev.: 0.0008) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.56% (0.2700 => 0.3363, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.38% (0.0886 => 0.1102, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 24.37% (0.1695 => 0.2108, std.dev.: 0.0018) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.34% (0.0871 => 0.1083, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 24.02% (1.1840 => 1.4684, std.dev.: 0.0040) MultiSource/Applications/d/make_dparser: 23.94% (3.3354 => 4.1339, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.81% (0.1029 => 0.1274, std.dev.: 0.0031) SingleSource/UnitTests/ObjC/messages-2: 23.72% (0.0662 => 0.0819, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.38% (0.5860 => 0.7230, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.31% (0.3307 => 0.4078, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 23.30% (0.1163 => 0.1434, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 23.30% (5.7591 => 7.1008, std.dev.: 0.0025) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.30% (0.1584 => 0.1953, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.29% (0.0953 => 0.1175, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 23.11% (0.3098 => 0.3814, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.04% (0.1940 => 0.2387, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.84% (0.2758 => 0.3388, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.76% (4.9449 => 6.0705, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.72% (0.1510 => 0.1853, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 22.45% (0.2049 => 0.2509, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 22.24% (0.8921 => 1.0905, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.07% (0.5569 => 0.6798, std.dev.: 0.0046) MultiSource/Benchmarks/BitBench/five11/five11: 22.05% (0.0567 => 0.0692, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.93% (0.2107 => 0.2569, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.88% (0.8172 => 0.9960, std.dev.: 0.0117) MultiSource/Applications/treecc/treecc: 21.87% (2.0273 => 2.4707, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.75% (0.6450 => 0.7853, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/18-imp/imp: 21.59% (0.3423 => 0.4162, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.50% (5.0018 => 6.0774, std.dev.: 0.0069) MultiSource/Applications/lua/lua: 21.38% (3.8723 => 4.7001, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.28% (0.9765 => 1.1843, std.dev.: 0.0039) SingleSource/UnitTests/SignlessTypes/rem: 21.15% (0.1144 => 0.1386, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.04% (1.1861 => 1.4356, std.dev.: 0.0015) MultiSource/Applications/lambda-0_1_3/lambda: 20.80% (0.7433 => 0.8979, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.38% (0.0834 => 0.1004, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.26% (0.0770 => 0.0926, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.26% (0.0933 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.23% (0.1117 => 0.1343, std.dev.: 0.0020) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.10% (0.8101 => 0.9729, std.dev.: 0.0022) MultiSource/Applications/siod/siod: 20.06% (2.2969 => 2.7576, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/health/health: 19.87% (0.1268 => 0.1520, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.87% (0.4203 => 0.5038, std.dev.: 0.0080) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.43% (0.5981 => 0.7143, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.33% (0.3441 => 0.4106, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.27% (0.2065 => 0.2463, std.dev.: 0.0061) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.22% (0.0770 => 0.0918, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.05% (0.2603 => 0.3099, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 18.82% (0.3283 => 0.3901, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.49% (0.1044 => 0.1237, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 18.32% (0.3232 => 0.3824, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.96% (0.3180 => 0.3751, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 17.27% (0.3387 => 0.3972, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/fbench: 17.23% (0.0592 => 0.0694, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.19% (0.0704 => 0.0825, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.18% (0.8067 => 0.9453, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/ary2: 17.05% (0.3379 => 0.3955, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.77% (0.3865 => 0.4513, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.11% (0.4636 => 0.5383, std.dev.: 0.0027) MultiSource/Applications/hbd/hbd: 16.09% (1.5603 => 1.8114, std.dev.: 0.0036) MultiSource/Applications/sqlite3/sqlite3: 15.84% (17.1811 => 19.9030, std.dev.: 0.0055) SingleSource/Regression/C++/ofstream_ctor: 15.35% (0.2905 => 0.3351, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 15.14% (0.4048 => 0.4661, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.92% (0.4103 => 0.4715, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.82% (0.3422 => 0.3929, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 14.54% (0.3603 => 0.4127, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists1: 14.47% (0.3684 => 0.4217, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.06% (0.3427 => 0.3909, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.83% (0.4064 => 0.4626, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 13.62% (0.3092 => 0.3513, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.37% (0.2430 => 0.2755, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.31% (14.3668 => 16.2792, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.20% (0.1114 => 0.1261, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.07% (0.3282 => 0.3711, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.99% (0.3826 => 0.4323, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 12.76% (0.3927 => 0.4428, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: 12.43% (0.3886 => 0.4369, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 11.69% (0.2831 => 0.3162, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions: 11.57% (0.3828 => 0.4271, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/except: 11.46% (0.2871 => 0.3200, std.dev.: 0.0064) MultiSource/Applications/hexxagon/hexxagon: 11.27% (1.2842 => 1.4289, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/trivial-interface: 11.26% (0.3473 => 0.3864, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 11.01% (0.3561 => 0.3953, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.99% (2.0665 => 2.2937, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/exceptions-3: 10.92% (0.3516 => 0.3900, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 10.90% (0.3497 => 0.3878, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.80% (0.3935 => 0.4360, std.dev.: 0.0118) SingleSource/Benchmarks/Shootout-C++/methcall: 10.78% (0.2877 => 0.3187, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.67% (0.2793 => 0.3091) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.60% (0.2756 => 0.3048, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.57% (0.2725 => 0.3013, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.55% (0.3650 => 0.4035, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.50% (0.3162 => 0.3494, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.27% (0.2891 => 0.3188, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2714 => 0.2992, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.03% (0.3052 => 0.3358, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 9.92% (0.2802 => 0.3080, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.91% (0.1625 => 0.1786, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.89% (0.2872 => 0.3156, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 9.82% (63.2438 => 69.4530, std.dev.: 0.0204) SingleSource/UnitTests/ObjC++/property-reference: 9.68% (0.7326 => 0.8035, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.25% (0.3136 => 0.3426, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 8.96% (0.6030 => 0.6570, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.80% (0.1330 => 0.1447, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: 8.44% (0.5925 => 0.6425, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.16% (0.2266 => 0.2451, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.09% (2.2022 => 2.3804, std.dev.: 0.0051) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.08% (0.4879 => 0.5273, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: 6.39% (10.3673 => 11.0301, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 5.40% (0.3131 => 0.3300, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.09% (7.9617 => 8.2873, std.dev.: 0.0073) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.67% (0.3817 => 0.3957, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4766, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.25% (1.1145 => 1.2956, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6975, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.28% (1.1396 => 1.2453, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.89% (11.6436 => 12.4454, std.dev.: 0.2254) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.20% (4.2280 => 4.4478, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout-C++/hash2: 4.85% (3.1578 => 3.3111, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0114) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.03% (0.9957 => 1.0259, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.76% (8.6802 => 8.9196, std.dev.: 0.0147) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7230, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.74% (9.1159 => 9.2749, std.dev.: 0.0354) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3107, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.48% (1.0785 => 1.0945, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1473, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.62% (5.2763 => 1.1806, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -75.19% (0.8651 => 0.2146, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -41.99% (0.1622 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.02% (5.3855 => 4.4689, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.37% (5.3526 => 4.4765, std.dev.: 0.0067) MultiSource/Applications/JM/ldecod/ldecod: -11.68% (10.4361 => 9.2172, std.dev.: 0.0248) SingleSource/UnitTests/Vector/constpool: -7.72% (54.1659 => 49.9849, std.dev.: 0.0213) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.23% (1.7609 => 1.6335, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.75% (1.9577 => 0.6705, std.dev.: 0.0098) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3072, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.42% (1.1492 => 0.7651, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.52% (10.7105 => 7.4417, std.dev.: 0.0057) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1356, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.46% (2.6546 => 2.0052, std.dev.: 0.0050) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0908, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.78% (2.5528 => 2.1245, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -15.92% (1.6925 => 1.4231, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout/matrix: -13.09% (3.1443 => 2.7328, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.01% (0.9540 => 0.8394, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.04% (19.9488 => 18.5449, std.dev.: 0.0693) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.88% (1.8329 => 1.7068, std.dev.: 0.0179) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.13% (1.2373 => 1.1615, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.66% (8.1563 => 7.6945, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5871, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5065, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.83% (0.4808 => 0.4576, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.77% (10.2830 => 9.7927, std.dev.: 0.0042) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0007) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.65% (3.7221 => 3.6608, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/ary3: -1.45% (3.6994 => 3.6458, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout/hash: -1.08% (4.9088 => 4.8559, std.dev.: 0.0031) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.37% (0.1485 => 0.1331, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0022) Report Time: 1.39s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 08:09:23 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 10:09:23 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130160923.ABBB32A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8112?compare_to=8109&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8112, Order: 173927, Start Time: 2013-01-30 14:34:30, End Time: 2013-01-30 16:09:46 To: 8109, Order: 173924, Start Time: 2013-01-30 12:36:10, End Time: 2013-01-30 14:10:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (93 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (881 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 72.52% (0.0717 => 0.1237, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 46.00% (0.1500 => 0.2190, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.90% (0.6395 => 0.8819, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.20% (0.6395 => 0.8710, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.77% (0.5456 => 0.7244, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.74% (0.5688 => 0.7550, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.52% (0.6260 => 0.8296, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.18% (0.5849 => 0.7731, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.16% (0.5575 => 0.7368, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.06% (0.5567 => 0.7352, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.97% (0.5581 => 0.7365, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.91% (0.6230 => 0.8218, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.11% (0.5802 => 0.7607, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.89% (0.5941 => 0.7776, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.50% (0.5705 => 0.7445, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.49% (0.5478 => 0.7148, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.35% (0.5569 => 0.7259, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.33% (0.5859 => 0.7636, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.25% (0.5857 => 0.7629, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.13% (0.6033 => 0.7851, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.04% (1.6474 => 2.1422, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.00% (0.5570 => 0.7241, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.87% (0.5591 => 0.7261, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.16% (0.5925 => 0.7653, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.08% (0.6189 => 0.7989, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.71% (0.6676 => 0.8593, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.43% (0.5863 => 0.7530, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.32% (0.6052 => 0.7766, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.32% (0.6304 => 0.8089, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.99% (0.6446 => 0.8250, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.21% (0.6681 => 0.8499, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.19% (0.6660 => 0.8471, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.09% (0.6194 => 0.7872, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.85% (0.6297 => 0.7988, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.41% (0.6667 => 0.8361, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.61% (0.0699 => 0.0871, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.14% (0.7524 => 0.9340, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.05% (0.0582 => 0.0722, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.42% (0.7339 => 0.9058, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.04% (2.2587 => 2.7790, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.41% (0.0833 => 0.0978, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.06% (0.3357 => 0.3896, std.dev.: 0.0006) MultiSource/Applications/lemon/lemon: 15.45% (1.1450 => 1.3219, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.62% (4.5069 => 5.0755, std.dev.: 0.0131) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.31% (1.6364 => 1.8379, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.21% (0.4916 => 0.5516, std.dev.: 0.0005) SingleSource/UnitTests/2006-12-11-LoadConstants: 12.11% (0.1230 => 0.1379, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.06% (3.5339 => 3.9601, std.dev.: 0.0087) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 11.50% (0.4515 => 0.5034, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.40% (0.2385 => 0.2633, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.03% (9.2283 => 10.1537, std.dev.: 0.0172) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.29% (0.5329 => 0.5824, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.13% (0.1731 => 0.1889, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 8.86% (1.2515 => 1.3624, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/hash: 8.84% (0.4524 => 0.4924, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.76% (0.7021 => 0.7636, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 8.06% (0.4861 => 0.5253, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.00% (0.2001 => 0.2161, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.91% (1.2784 => 1.3795, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.53% (1.4642 => 1.5744, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 6.79% (0.6750 => 0.7208, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.19% (5.4682 => 5.8067, std.dev.: 0.0148) SingleSource/Benchmarks/Misc/ReedSolomon: 5.80% (0.1879 => 0.1988, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 5.56% (0.3255 => 0.3436, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.33% (0.3319 => 0.3496, std.dev.: 0.0021) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.66% (22.4056 => 23.4490, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 3.75% (5.0226 => 5.2107, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.65% (0.9557 => 0.9906, std.dev.: 0.0058) MultiSource/Applications/minisat/minisat: 3.60% (0.7447 => 0.7715, std.dev.: 0.0038) MultiSource/Applications/SPASS/SPASS: 3.50% (15.5079 => 16.0505, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 3.24% (0.8418 => 0.8691, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.19% (1.3864 => 1.4306, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 3.16% (0.3446 => 0.3555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.92% (0.3491 => 0.3593, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4427 => 0.4546, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.36% (0.5168 => 0.5290, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.3722 => 1.4011, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.71% (18.2933 => 18.6053, std.dev.: 0.0168) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.55% (1.2300 => 1.2491, std.dev.: 0.0065) MultiSource/Benchmarks/Bullet/bullet: 1.44% (34.0927 => 34.5845, std.dev.: 0.0388) MultiSource/Applications/d/make_dparser: 1.22% (3.5154 => 3.5583, std.dev.: 0.0016) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.89% (31.3723 => 55.8073, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.28% (0.9531 => 1.0320, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 7.27% (0.5692 => 0.6106, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0014) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.67% (54.5751 => 56.5778, std.dev.: 0.0510) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.60% (2.0478 => 2.1010, std.dev.: 0.0042) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3050, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.62% (18.2231 => 18.5178, std.dev.: 0.0290) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5967, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2691, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.63% (0.1281 => 0.1132, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: -5.17% (0.3194 => 0.3029, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -4.93% (0.3812 => 0.3624, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.92% (0.7198 => 0.6844, std.dev.: 0.0047) SingleSource/UnitTests/ObjC/exceptions-2: -4.80% (0.3831 => 0.3647, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.77% (0.3896 => 0.3710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3880 => 0.3697, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.71% (0.3884 => 0.3701, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -4.66% (0.4033 => 0.3845, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.63% (0.3891 => 0.3711, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.55% (0.3848 => 0.3673, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -4.36% (0.4176 => 0.3994, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -4.08% (0.6347 => 0.6088, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.76% (0.6441 => 0.6199, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.60% (2.4924 => 2.4026, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.59% (0.3821 => 0.3684, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: -3.57% (0.4199 => 0.4049, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.54% (0.9852 => 0.9503, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.47% (0.3837 => 0.3704, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.44% (0.2903 => 0.2803, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.43% (0.3057 => 0.2952, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4280 => 0.4138, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.31% (0.3323 => 0.3213, std.dev.: 0.0029) SingleSource/UnitTests/ObjC++/property-reference: -3.18% (0.7779 => 0.7532, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.86% (2.1713 => 2.1091, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.75% (0.9542 => 0.9280, std.dev.: 0.0009) MultiSource/Applications/hexxagon/hexxagon: -2.68% (1.3148 => 1.2795, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.55% (20.7746 => 20.2440, std.dev.: 0.0337) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.39% (0.6484 => 0.6329, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.90% (14.2083 => 13.9387, std.dev.: 0.0202) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.57% (6.7716 => 6.6652, std.dev.: 0.0067) MultiSource/Applications/JM/lencod/lencod: -1.33% (16.1920 => 15.9761, std.dev.: 0.0084) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.40% (1.8100 => 0.6806, std.dev.: 0.0116) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3115, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.87% (1.3643 => 1.0250, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7552, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.86% (83.5423 => 64.4483, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2047, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1729, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.41% (2.5106 => 2.1237, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.17% (0.5142 => 0.4619, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.06% (1.2842 => 1.1678, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8043, std.dev.: 0.0066) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.84% (2.2633 => 2.1763, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3996, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.83% (7.9763 => 7.7508, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1196, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.80% (1.3096 => 1.2860, std.dev.: 0.0080) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1729, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4724, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5861, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.32% (1.6307 => 1.6091, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary3: -1.26% (3.7092 => 3.6624, std.dev.: 0.0176) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.06% (1.6219 => 1.6047, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.92s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 08:45:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 10:45:27 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130164527.D5D2C2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8113?compare_to=8110&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8113, Order: 173927, Start Time: 2013-01-30 14:39:48, End Time: 2013-01-30 16:45:51 To: 8110, Order: 173918, Start Time: 2013-01-30 12:18:53, End Time: 2013-01-30 14:21:47 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 18 (96 on baseline) Performance Improvements: 1 (63 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1045 (904 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Regression/C/2003-05-21-UnionTest: 77.63% (0.0152 => 0.0270, std.dev.: 0.0013) SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 68.87% (0.0151 => 0.0255, std.dev.: 0.0008) SingleSource/Regression/C++/global_ctor: 61.74% (0.0230 => 0.0372, std.dev.: 0.0013) SingleSource/Regression/C++/EH/function_try_block: 34.77% (0.0325 => 0.0438, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.34% (2.6331 => 2.8528, std.dev.: 0.0362) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.77% (4.1829 => 4.5078, std.dev.: 0.0180) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.75% (24.8709 => 26.0517, std.dev.: 0.3112) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.41% (0.5076 => 0.5300, std.dev.: 0.0024) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 31.45% (9.0265 => 11.8657, std.dev.: 0.2549) SingleSource/Benchmarks/Shootout-C++/ary3: 14.47% (1.4140 => 1.6186, std.dev.: 0.0369) SingleSource/Benchmarks/CoyoteBench/lpbench: 14.41% (4.1895 => 4.7933, std.dev.: 0.1275) SingleSource/Benchmarks/Stanford/Puzzle: 9.42% (0.1719 => 0.1881, std.dev.: 0.0059) MultiSource/Benchmarks/7zip/7zip-benchmark: 9.04% (9.4042 => 10.2542, std.dev.: 0.2597) MultiSource/Benchmarks/Bullet/bullet: 5.17% (7.0762 => 7.4417, std.dev.: 0.0621) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.35% (21.7759 => 22.7223, std.dev.: 0.1763) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.62% (2.4114 => 2.4986, std.dev.: 0.0252) SingleSource/Regression/C/uint64_to_float: 2.67% (1.9011 => 1.9519, std.dev.: 0.0121) SingleSource/Benchmarks/Linpack/linpack-pc: 2.35% (51.9470 => 53.1698, std.dev.: 0.3901) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.73% (1.6129 => 1.5850, std.dev.: 0.0064) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.09% (1.2144 => 1.2155, std.dev.: 0.1213) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.95% (0.0228 => 0.0237, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.27% (0.0440 => 0.0450, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 5.64% (0.0337 => 0.0356, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.90% (0.0322 => 0.0341, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.32% (0.0432 => 0.0455, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/casts: 4.31% (0.0209 => 0.0218, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 4.48% (0.0223 => 0.0233, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0252 => 0.0251, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.82% (0.1467 => 0.1455, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -1.57% (1.1665 => 1.1482, std.dev.: 0.1722) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.44% (0.3899 => 0.3916, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.47% (0.1518 => 0.1435, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.87% (0.0641 => 0.0653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.44% (0.0277 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.09% (0.0538 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.05% (1.2876 => 1.2883, std.dev.: 0.0552) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.50% (0.0599 => 0.0608, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.51% (0.0370 => 0.0357, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.05% (1.7562 => 1.7570, std.dev.: 0.0145) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -21.43% (0.0098 => 0.0077, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.93% (34.1717 => 34.4910, std.dev.: 0.0542) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 423.21% (0.0336 => 0.1758, std.dev.: 0.0523) SingleSource/Regression/C/pointer_arithmetic: 226.42% (0.0053 => 0.0173, std.dev.: 0.0008) SingleSource/Regression/C/sumarraymalloc: 118.09% (0.0293 => 0.0639, std.dev.: 0.0074) SingleSource/Regression/C++/EH/function_try_block: 80.25% (0.0243 => 0.0438, std.dev.: 0.0043) SingleSource/Regression/C/2003-05-21-UnionTest: 76.47% (0.0153 => 0.0270, std.dev.: 0.0013) SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 73.47% (0.0147 => 0.0255, std.dev.: 0.0008) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 73.03% (0.0152 => 0.0263, std.dev.: 0.0025) SingleSource/Regression/C++/global_ctor: 70.64% (0.0218 => 0.0372, std.dev.: 0.0013) SingleSource/Regression/C/PR1386: 70.47% (0.0149 => 0.0254, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 62.27% (0.1638 => 0.2658, std.dev.: 0.0023) SingleSource/Regression/C++/EH/simple_throw: 62.11% (0.0161 => 0.0261, std.dev.: 0.0017) SingleSource/Regression/C/sumarray: 58.87% (0.0265 => 0.0421, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 43.34% (0.9612 => 1.3778, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 43.07% (0.9381 => 1.3421, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.31% (0.8926 => 1.2703, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.94% (0.9120 => 1.2945, std.dev.: 0.0726) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.76% (0.9564 => 1.3462, std.dev.: 0.0776) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.45% (0.9855 => 1.3841, std.dev.: 0.0385) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 40.15% (0.9403 => 1.3178, std.dev.: 0.1313) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.47% (0.9588 => 1.3372, std.dev.: 0.0565) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.95% (0.8990 => 1.2492, std.dev.: 0.0420) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.95% (0.9091 => 1.2632, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.51% (0.9010 => 1.2480, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.18% (0.9998 => 1.3815, std.dev.: 0.0797) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.67% (0.8736 => 1.2027, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.29% (0.9512 => 1.3059, std.dev.: 0.0403) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.40% (1.0119 => 1.3802, std.dev.: 0.0805) SingleSource/Benchmarks/Stanford/IntMM: 36.19% (0.0431 => 0.0587, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.86% (0.8912 => 1.2108, std.dev.: 0.0687) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.72% (1.0867 => 1.4749, std.dev.: 0.0968) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.40% (1.0052 => 1.3610, std.dev.: 0.0736) SingleSource/Benchmarks/McGill/exptree: 35.39% (0.0859 => 0.1163, std.dev.: 0.0047) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 35.23% (0.9867 => 1.3343, std.dev.: 0.0332) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.58% (0.8846 => 1.1905, std.dev.: 0.0372) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.47% (0.8732 => 1.1742, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.53% (1.0017 => 1.3276, std.dev.: 0.0448) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.28% (0.9405 => 1.2441, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.80% (0.9488 => 1.2505, std.dev.: 0.0895) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.79% (0.9507 => 1.2529, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.83% (0.9685 => 1.2671, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.79% (1.0088 => 1.3194, std.dev.: 0.0357) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.59% (0.9127 => 1.1919, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.89% (0.9993 => 1.2980, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.63% (0.9550 => 1.2284, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.16% (1.0860 => 1.3810, std.dev.: 0.0612) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 24.20% (3.6295 => 4.5078, std.dev.: 0.0180) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.87% (0.0738 => 0.0892, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.92% (0.0738 => 0.0885, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.68% (0.0669 => 0.0794, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.65% (0.0963 => 0.1133, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 16.82% (0.0642 => 0.0750, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.35% (2.4519 => 2.8528, std.dev.: 0.0362) SingleSource/Benchmarks/Misc/ReedSolomon: 13.95% (0.2050 => 0.2336, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.79% (0.1240 => 0.1411, std.dev.: 0.0060) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 11.88% (1.4110 => 1.5786, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/matrix: 11.57% (0.2385 => 0.2661, std.dev.: 0.0107) MultiSource/Benchmarks/Bullet/bullet: 11.15% (33.2440 => 36.9520, std.dev.: 1.0562) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.56% (44.1538 => 48.8178, std.dev.: 1.7941) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.47% (0.5369 => 0.5931, std.dev.: 0.0064) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.45% (23.5861 => 26.0517, std.dev.: 0.3112) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.78% (0.2577 => 0.2829, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.77% (0.1955 => 0.2146, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.23% (0.2879 => 0.3116, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.66% (1.8651 => 2.0080, std.dev.: 0.0311) MultiSource/Applications/oggenc/oggenc: 5.48% (5.3553 => 5.6487, std.dev.: 0.1102) SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.76% (0.5059 => 0.5300, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.17% (4.9104 => 5.0171, std.dev.: 0.0333) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107025.00% (0.0008 => 0.8570, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/ary3: 432.00% (2.2304 => 11.8657, std.dev.: 0.2549) SingleSource/Benchmarks/Shootout/matrix: 355.65% (1.5825 => 7.2106, std.dev.: 0.0379) MultiSource/Applications/sgefa/sgefa: 259.15% (0.3515 => 1.2624, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.44% (1.1825 => 4.0494, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 226.67% (4.8185 => 15.7406, std.dev.: 0.2039) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 200.88% (0.0228 => 0.0686, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 180.62% (0.0129 => 0.0362, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 155.17% (0.0232 => 0.0592, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 62.71% (2.9083 => 4.7322, std.dev.: 0.0299) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.76% (0.2562 => 0.3427, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.42% (3.1254 => 4.1074, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 31.19% (1.4588 => 1.9138, std.dev.: 0.0330) SingleSource/Regression/C/uint64_to_float: 26.77% (1.5397 => 1.9519, std.dev.: 0.0121) SingleSource/Benchmarks/Misc/salsa20: 22.11% (7.4497 => 9.0971, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.55% (4.8112 => 5.8000, std.dev.: 0.0100) MultiSource/Benchmarks/7zip/7zip-benchmark: 13.83% (9.0082 => 10.2542, std.dev.: 0.2597) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.72% (3.7074 => 4.2162, std.dev.: 0.1585) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.60% (5.1752 => 5.8789, std.dev.: 0.0690) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.19% (5.0033 => 5.6133, std.dev.: 0.0512) SingleSource/Benchmarks/Stanford/Puzzle: 10.78% (0.1698 => 0.1881, std.dev.: 0.0059) SingleSource/Benchmarks/Misc/ReedSolomon: 9.04% (8.6447 => 9.4262, std.dev.: 0.0631) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.02% (3.6477 => 3.9766, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/lpbench: 7.62% (4.4540 => 4.7933, std.dev.: 0.1275) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.06% (4.7473 => 5.0825, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.50% (4.1836 => 4.4136, std.dev.: 0.0192) SingleSource/Benchmarks/Linpack/linpack-pc: 4.47% (50.8945 => 53.1698, std.dev.: 0.3901) MultiSource/Benchmarks/Bullet/bullet: 3.30% (7.2040 => 7.4417, std.dev.: 0.0621) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.25% (4.7254 => 4.8791, std.dev.: 0.0444) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.38% (0.0808 => 0.0506, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.60% (0.0727 => 0.0490, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/drop3/drop3: -29.34% (0.0692 => 0.0489, std.dev.: 0.0063) SingleSource/Benchmarks/SmallPT/smallpt: -25.11% (0.1888 => 0.1414, std.dev.: 0.0013) MultiSource/Applications/hbd/hbd: -18.71% (1.8964 => 1.5415, std.dev.: 0.0178) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.90% (0.0676 => 0.0555, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.87% (0.1684 => 0.1383, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: -17.34% (0.1009 => 0.0834, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.48% (1.0960 => 0.9373, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.18% (0.0862 => 0.0757, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -10.99% (1.1433 => 1.0177, std.dev.: 0.0093) MultiSource/Applications/lua/lua: -7.99% (4.6406 => 4.2700, std.dev.: 0.1237) MultiSource/Applications/ALAC/encode/alacconvert-encode: -7.10% (1.2154 => 1.1291, std.dev.: 0.0319) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.59% (1.0234 => 0.9560, std.dev.: 0.0256) MultiSource/Applications/siod/siod: -6.50% (2.6437 => 2.4718, std.dev.: 0.0120) MultiSource/Applications/sqlite3/sqlite3: -6.07% (17.5634 => 16.4968, std.dev.: 0.3107) MultiSource/Applications/ClamAV/clamscan: -6.04% (17.4365 => 16.3826, std.dev.: 0.1621) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.11% (1.3924 => 1.3491, std.dev.: 0.0127) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.65% (0.7225 => 0.7106, std.dev.: 0.0026) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.87% (11.5523 => 3.9430, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -62.00% (15.6525 => 5.9478, std.dev.: 0.1922) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.85% (0.4146 => 0.1789, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.45% (0.4578 => 0.2360, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.93% (11.3868 => 6.3844, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.79% (5.4023 => 3.6310, std.dev.: 0.0476) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.44% (0.4452 => 0.3097, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/bisort/bisort: -30.22% (0.9372 => 0.6540, std.dev.: 0.0862) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.81% (1.0816 => 0.7700, std.dev.: 0.0737) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.48% (0.5495 => 0.4040, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.23% (5.2605 => 3.8806, std.dev.: 0.0443) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.28% (0.5826 => 0.4353, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.22% (4.4467 => 3.3253, std.dev.: 0.0257) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.39% (0.5897 => 0.4459, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.34% (4.9921 => 3.8270, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.57% (5.8755 => 4.7842, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.13% (16.6791 => 13.8227, std.dev.: 0.2594) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.79% (3.1921 => 2.7838, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.67% (5.3626 => 4.6833, std.dev.: 0.0551) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.44% (5.7056 => 4.9957, std.dev.: 0.0627) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.40% (9.7992 => 8.5845, std.dev.: 0.0161) SingleSource/Benchmarks/Shootout-C++/ary3: -10.69% (1.8123 => 1.6186, std.dev.: 0.0369) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.37% (0.4081 => 0.3658, std.dev.: 0.0136) MultiSource/Benchmarks/mafft/pairlocalalign: -8.77% (63.1520 => 57.6129, std.dev.: 0.1492) MultiSource/Applications/SIBsim4/SIBsim4: -7.62% (3.5443 => 3.2744, std.dev.: 0.0409) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.96% (4.2843 => 3.9862, std.dev.: 0.0729) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.60% (5.5974 => 5.2277, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.45% (4.5424 => 4.2493, std.dev.: 0.0363) MultiSource/Benchmarks/Olden/health/health: -5.88% (0.3654 => 0.3439, std.dev.: 0.0046) SingleSource/Benchmarks/McGill/queens: -5.31% (1.7443 => 1.6516, std.dev.: 0.0305) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.23% (0.3349 => 0.3174, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.93% (3.7662 => 3.5806, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.80% (4.9799 => 4.7407, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.41% (3.5127 => 3.3577, std.dev.: 0.0302) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.31% (1.4446 => 1.3824, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/hash2: -4.22% (3.6768 => 3.5216, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.41% (5.8973 => 5.6962, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/lists: -3.04% (17.2182 => 16.6946, std.dev.: 0.1351) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.89% (23.3986 => 22.7223, std.dev.: 0.1763) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.94% (8.7327 => 8.5636, std.dev.: 0.0184) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.69% (85.3042 => 83.8584, std.dev.: 0.3684) SingleSource/Benchmarks/Misc/mandel-2: -1.47% (0.8521 => 0.8396, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.43% (8.8249 => 8.6989, std.dev.: 0.0195) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7487, std.dev.: 0.0213) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.90% (1.2047 => 1.2155, std.dev.: 0.1213) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 1.72% (0.0233 => 0.0237, std.dev.: 0.0067) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.22% (0.0451 => 0.0450, std.dev.: 0.0106) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.64% (0.0394 => 0.0356, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.96% (0.0328 => 0.0341, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.25% (0.0445 => 0.0455, std.dev.: 0.0113) SingleSource/UnitTests/Vector/Altivec/casts: 2.35% (0.0213 => 0.0218, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/test1: 2.64% (0.0227 => 0.0233, std.dev.: 0.0062) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.90% (0.1530 => 0.1455, std.dev.: 0.0037) MultiSource/Applications/lemon/lemon: -40.49% (1.9293 => 1.1482, std.dev.: 0.1722) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.28% (0.4049 => 0.3916, std.dev.: 0.0294) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.97% (0.1510 => 0.1435, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.23% (0.0978 => 0.0653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -1.09% (0.0276 => 0.0273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.08% (0.0590 => 0.0560, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.90% (1.1617 => 1.2883, std.dev.: 0.0552) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 33.21% (0.0268 => 0.0357, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.25% (0.7437 => 1.7570, std.dev.: 0.0145) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -16.30% (0.0092 => 0.0077, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.92% (12.7781 => 34.4910, std.dev.: 0.0542) Report Time: 0.83s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 09:19:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 11:19:35 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130130171935.CA5BC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8114?compare_to=8108&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8114, Order: 173925, Start Time: 2013-01-30 13:43:51, End Time: 2013-01-30 17:19:57 To: 8108, Order: 173907, Start Time: 2013-01-30 09:08:14, End Time: 2013-01-30 12:43:51 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 0 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1102 (750 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.84% (0.8351 => 0.8505, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 1.13% (0.9126 => 0.9229, std.dev.: 0.0026) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 50.40% (0.0625 => 0.0940, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.41% (0.1063 => 0.1450, std.dev.: 0.0036) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 32.21% (0.0475 => 0.0628, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 31.74% (0.1106 => 0.1457, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 30.81% (0.0714 => 0.0934, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.20% (0.2969 => 0.3836, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.70% (0.0547 => 0.0704, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 28.27% (0.4994 => 0.6406, std.dev.: 0.0123) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.88% (0.4139 => 0.5293, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.81% (0.5900 => 0.7541, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.27% (0.4253 => 0.5413, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 27.01% (1.5932 => 2.0235, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.75% (0.0415 => 0.0526, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.52% (0.5000 => 0.6326, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.93% (0.1107 => 0.1394, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 25.54% (0.0599 => 0.0752, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.06% (0.1620 => 0.2026, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.88% (0.1021 => 0.1275, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.86% (0.0897 => 0.1120, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.97% (0.0584 => 0.0724, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.73% (0.1003 => 0.1241, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.70% (0.0633 => 0.0783, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.68% (0.0642 => 0.0794, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 23.34% (0.0604 => 0.0745, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.32% (0.1604 => 0.1978, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.30% (0.1103 => 0.1360, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.11% (0.1549 => 0.1907, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.11% (0.0541 => 0.0666, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 23.10% (0.1619 => 0.1993, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.99% (0.0822 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.96% (0.3903 => 0.4799, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 22.90% (0.0821 => 0.1009, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.57% (0.0452 => 0.0554, std.dev.: 0.0026) MultiSource/Applications/spiff/spiff: 22.54% (0.4029 => 0.4937, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: 22.52% (0.0808 => 0.0990, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.51% (0.0462 => 0.0566, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 22.07% (0.0947 => 0.1156, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.97% (0.1088 => 0.1327, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 21.67% (0.1218 => 0.1482, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.41% (0.1462 => 0.1775, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.39% (0.2866 => 0.3479, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.31% (0.3890 => 0.4719, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.13% (0.2736 => 0.3314, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 21.06% (0.0698 => 0.0845, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.00% (0.2014 => 0.2437, std.dev.: 0.0002) MultiSource/Applications/aha/aha: 21.00% (0.0481 => 0.0582, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 20.73% (0.1505 => 0.1817, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.59% (1.3152 => 1.5860, std.dev.: 0.0033) MultiSource/Benchmarks/MallocBench/gs/gs: 20.22% (1.8794 => 2.2594, std.dev.: 0.0081) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.10% (0.0572 => 0.0687, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.90% (0.0573 => 0.0687, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 19.82% (0.5546 => 0.6645, std.dev.: 0.0096) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.67% (0.4658 => 0.5574, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/Hello: 19.65% (0.5826 => 0.6971, std.dev.: 0.0006) MultiSource/Applications/hbd/hbd: 19.59% (0.9697 => 1.1597, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.59% (0.0582 => 0.0696, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: 19.55% (0.1284 => 0.1535, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.39% (1.6211 => 1.9354, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 19.38% (0.3271 => 0.3905, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.24% (3.5627 => 4.2482, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.24% (0.5026 => 0.5993, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.11% (0.1968 => 0.2344, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference-object: 19.05% (0.5889 => 0.7011, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.79% (0.1160 => 0.1378, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 18.60% (0.7171 => 0.8505, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.60% (0.3930 => 0.4661, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.54% (0.2875 => 0.3408, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 18.51% (0.1421 => 0.1684, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 18.34% (1.0781 => 1.2758, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/strcat: 18.15% (0.2750 => 0.3249, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 18.14% (0.2823 => 0.3335, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 18.13% (0.2813 => 0.3323, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.12% (0.2792 => 0.3298, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 18.09% (0.2725 => 0.3218, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.08% (0.2738 => 0.3233, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 18.07% (0.2811 => 0.3319, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 18.05% (0.2714 => 0.3204, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.02% (0.4361 => 0.5147, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 18.02% (0.2803 => 0.3308, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: 17.99% (0.2780 => 0.3280, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.93% (0.2911 => 0.3433, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.81% (0.2729 => 0.3215, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 17.75% (0.3267 => 0.3847, std.dev.: 0.0122) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.74% (2.7292 => 3.2133, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.74% (1.9694 => 2.3187, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.71% (2.0673 => 2.4335, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.71% (1.9966 => 2.3501, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: 17.61% (0.9909 => 1.1654, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wc: 17.60% (0.3096 => 0.3641, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.59% (0.3195 => 0.3757, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 17.56% (0.3258 => 0.3830, std.dev.: 0.0012) SingleSource/Regression/C++/ofstream_ctor: 17.54% (0.3004 => 0.3531, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 17.47% (4.2109 => 4.9465, std.dev.: 0.0207) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.38% (0.3625 => 0.4255, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.32% (0.3060 => 0.3590, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.32% (4.4195 => 5.1848, std.dev.: 0.0256) SingleSource/Benchmarks/Shootout-C++/ary2: 17.27% (0.3317 => 0.3890, std.dev.: 0.0091) MultiSource/Benchmarks/Bullet/bullet: 17.23% (23.5202 => 27.5734, std.dev.: 0.0254) MultiSource/Applications/treecc/treecc: 17.19% (0.7875 => 0.9229, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash: 17.17% (0.4146 => 0.4858, std.dev.: 0.0007) MultiSource/Applications/lua/lua: 17.06% (1.4269 => 1.6704, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.88% (0.1090 => 0.1274, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/sieve: 16.85% (0.3726 => 0.4354, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.84% (0.3124 => 0.3650, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.78% (0.3362 => 0.3926, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 16.72% (0.2566 => 0.2995, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: 16.65% (0.3477 => 0.4056, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/lists: 16.64% (0.3348 => 0.3905, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.61% (0.3282 => 0.3827, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.57% (0.3488 => 0.4066, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 16.48% (0.3678 => 0.4284, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 16.28% (0.4251 => 0.4943, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.15% (0.3845 => 0.4466, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.12% (0.3690 => 0.4285, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.10% (0.3981 => 0.4622, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 16.08% (0.3496 => 0.4058, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 16.06% (0.3469 => 0.4026, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.05% (0.3465 => 0.4021, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 15.99% (0.3446 => 0.3997, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 15.98% (0.3460 => 0.4013, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/trivial-interface: 15.86% (0.3442 => 0.3988, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 15.62% (0.3650 => 0.4220, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.45% (0.0673 => 0.0777, std.dev.: 0.0010) MultiSource/Applications/SPASS/SPASS: 15.43% (5.5417 => 6.3970, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/exceptions: 15.43% (0.3643 => 0.4205, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: 15.39% (0.3724 => 0.4297, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 15.30% (0.5012 => 0.5779, std.dev.: 0.0023) MultiSource/Applications/SIBsim4/SIBsim4: 14.94% (0.2691 => 0.3093, std.dev.: 0.0032) MultiSource/Applications/JM/ldecod/ldecod: 14.88% (2.1653 => 2.4876, std.dev.: 0.0077) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.88% (0.1028 => 0.1181, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.62% (0.6435 => 0.7376, std.dev.: 0.0023) MultiSource/Benchmarks/mafft/pairlocalalign: 14.41% (2.1013 => 2.4040, std.dev.: 0.0013) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867) MultiSource/Applications/JM/lencod/lencod: 14.31% (4.6177 => 5.2783, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.21% (0.2737 => 0.3126, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.05% (0.5361 => 0.6114, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.68% (0.2068 => 0.2351, std.dev.: 0.0011) MultiSource/Applications/lambda-0_1_3/lambda: 13.35% (0.3498 => 0.3965, std.dev.: 0.0039) MultiSource/Applications/siod/siod: 13.33% (0.6634 => 0.7518, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.14% (0.2040 => 0.2308, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.06% (0.0804 => 0.0909, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.04% (11.6398 => 13.1577, std.dev.: 0.0144) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.91% (0.3084 => 0.3482, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 12.71% (0.3336 => 0.3760, std.dev.: 0.0014) MultiSource/Benchmarks/PAQ8p/paq8p: 12.50% (0.4847 => 0.5453, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.41% (0.2103 => 0.2364, std.dev.: 0.0060) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.32% (0.7426 => 0.8341, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.57% (0.1383 => 0.1543, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.46% (0.2391 => 0.2665, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 10.78% (2.0346 => 2.2539, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.68% (4.6926 => 5.1937, std.dev.: 0.0036) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.67% (0.5584 => 0.6124, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 8.66% (11.9555 => 12.9913, std.dev.: 0.0110) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.43% (0.3792 => 0.4036, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.87% (29.0505 => 181.5289, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0319) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0087) MultiSource/Applications/ClamAV/clamscan: 10.99% (0.2802 => 0.3110, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.53% (0.3693 => 0.4045, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2353, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/objinst: 5.12% (12.0509 => 12.6679, std.dev.: 0.0084) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6926, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-2: 4.62% (1.8057 => 1.8891, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/health/health: 3.12% (0.6276 => 0.6472, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 2.15% (15.8721 => 16.2127, std.dev.: 0.0089) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3072, std.dev.: 0.0135) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.45% (7.1849 => 7.2890, std.dev.: 0.0031) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0827, std.dev.: 0.0100) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0000) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.18% (3.1722 => 3.2097, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5397, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4827, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6855, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5906, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.79% (2.4764 => 2.4321, std.dev.: 0.0050) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.73% (25.4195 => 16.5920, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.04% (17.2379 => 14.3006, std.dev.: 0.0387) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -8.37% (0.2402 => 0.2201, std.dev.: 0.0040) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9772, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/salsa20: -7.63% (35.5013 => 32.7928, std.dev.: 0.0121) MultiSource/Benchmarks/Olden/tsp/tsp: -7.24% (2.1113 => 1.9585, std.dev.: 0.0086) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -3.89% (14.0481 => 13.5013, std.dev.: 0.1720) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2140, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8108, std.dev.: 0.0082) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7726, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2177, std.dev.: 0.0394) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5734, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4991, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1796, std.dev.: 0.0085) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0432, std.dev.: 0.0020) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 09:27:33 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 11:27:33 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130172733.684C92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8115?compare_to=8111&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8115, Order: 173931, Start Time: 2013-01-30 15:15:20, End Time: 2013-01-30 17:27:55 To: 8111, Order: 173918, Start Time: 2013-01-30 12:31:26, End Time: 2013-01-30 14:43:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 4 (233 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (640 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.63% (11.0301 => 11.3206, std.dev.: 0.0090) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.24% (4.4765 => 4.5320, std.dev.: 0.0088) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.20% (4.4689 => 4.5226, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: 2.31% (3.7575 => 3.8442, std.dev.: 0.0173) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.38% (0.1331 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.48% (0.0416 => 0.0418, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.96% (0.0676 => 0.0696, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8589 => 499.8535, std.dev.: 0.0043) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 44225.04% (1.1277 => 499.8535, std.dev.: 0.0043) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 228.09% (0.5229 => 1.7156, std.dev.: 0.0016) MultiSource/Applications/SPASS/SPASS: 26.66% (14.9895 => 18.9861, std.dev.: 0.0194) MultiSource/Applications/kimwitu++/kc: 47.82% (14.1553 => 20.9247, std.dev.: 0.0116) MultiSource/Benchmarks/MallocBench/gs/gs: 21.83% (4.1105 => 5.0077, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.68% (1.1048 => 1.7973, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 451.55% (7.1582 => 39.4808, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.15% (3.4629 => 6.6193, std.dev.: 0.0070) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.54% (0.6222 => 1.1420, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.00% (0.0720 => 7.4448, std.dev.: 0.0029) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 11100700.00% (0.0001 => 11.1008, std.dev.: 0.0256) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14300.00% (0.0001 => 0.0144, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575200.00% (0.0001 => 0.5753, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5495500.00% (0.0001 => 5.4956, std.dev.: 0.0135) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.95% (1.1194 => 10.3091, std.dev.: 0.0305) MultiSource/Applications/ClamAV/clamscan: 151.47% (22.1758 => 55.7649, std.dev.: 0.0353) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.55% (0.0929 => 0.1891, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 80.72% (0.1463 => 0.2644, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.67% (0.0730 => 0.1224, std.dev.: 0.0014) SingleSource/Benchmarks/Stanford/IntMM: 66.75% (0.0394 => 0.0657, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 65.80% (0.0231 => 0.0383, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.59% (2.9384 => 4.6305, std.dev.: 0.0169) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.48% (1.5859 => 2.4974, std.dev.: 0.0192) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.16% (7.0540 => 11.0153, std.dev.: 0.0127) MultiSource/Benchmarks/FreeBench/distray/distray: 54.07% (0.1056 => 0.1627, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.56% (8.1363 => 12.2504, std.dev.: 0.0179) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.43% (0.0439 => 0.0656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.86% (2.2024 => 3.2344, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 45.13% (0.3109 => 0.4512, std.dev.: 0.0005) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 42.60% (0.1432 => 0.2042, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 41.48% (21.9371 => 31.0375, std.dev.: 0.0120) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.24% (0.1062 => 0.1500, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 39.05% (1.5415 => 2.1434, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.26% (4.2646 => 5.8962, std.dev.: 0.0032) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.12% (0.4615 => 0.6328, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.46% (0.2271 => 0.3099, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.18% (0.5105 => 0.6952, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 34.36% (0.4299 => 0.5776, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.36% (0.1892 => 0.2542, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.24% (0.0479 => 0.0643, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 34.12% (1.1642 => 1.5614, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.93% (0.6675 => 0.8940, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 32.68% (0.0719 => 0.0954, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 32.55% (0.0636 => 0.0843, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 32.51% (0.1655 => 0.2193, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.20% (0.1143 => 0.1511, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.91% (0.1125 => 0.1484, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 31.26% (9.4845 => 12.4496, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.09% (0.1695 => 0.2222, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.29% (3.8922 => 5.0713, std.dev.: 0.0131) SingleSource/Benchmarks/Shootout/hash: 30.10% (0.0485 => 0.0631, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 29.97% (0.1555 => 0.2021, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.51% (0.0793 => 0.1027, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.49% (0.0746 => 0.0966, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 29.31% (1.0722 => 1.3865, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.10% (0.0457 => 0.0590, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 29.08% (1.4186 => 1.8311, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/08-main/main: 28.86% (0.2554 => 0.3291, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash: 28.54% (0.4289 => 0.5513, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 28.32% (0.7115 => 0.9130, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 28.08% (0.0730 => 0.0935, std.dev.: 0.0014) MultiSource/Applications/aha/aha: 27.98% (0.1151 => 0.1473, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.70% (0.0408 => 0.0521) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.60% (0.1337 => 0.1706, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.36% (0.3121 => 0.3975, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hash2: 27.36% (0.4620 => 0.5884, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.18% (0.1906 => 0.2424, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/tsp/tsp: 27.15% (0.1175 => 0.1494, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.14% (0.1566 => 0.1991, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.64% (0.0672 => 0.0851, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.55% (0.1032 => 0.1306, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 26.41% (0.0443 => 0.0560, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 26.10% (0.6456 => 0.8141, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.06% (0.5020 => 0.6328, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/bisort/bisort: 25.90% (0.0614 => 0.0773, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 25.86% (0.7835 => 0.9861, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/whetstone: 25.76% (0.0660 => 0.0830, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 25.62% (0.0527 => 0.0662, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.37% (1.3050 => 1.6361, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 25.36% (0.1029 => 0.1290, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.32% (0.1236 => 0.1549, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 25.23% (1.1840 => 1.4827, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.19% (0.2700 => 0.3380, std.dev.: 0.0013) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.85% (0.0491 => 0.0613, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.83% (0.0886 => 0.1106, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/em3d/em3d: 24.78% (0.1695 => 0.2115, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 24.51% (0.1163 => 0.1448, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.44% (0.0675 => 0.0840, std.dev.: 0.0012) MultiSource/Applications/d/make_dparser: 24.30% (3.3354 => 4.1459, std.dev.: 0.0166) MultiSource/Applications/oggenc/oggenc: 24.25% (5.7591 => 7.1554, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/messages-2: 24.17% (0.0662 => 0.0822, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.16% (0.5860 => 0.7276, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.02% (0.1940 => 0.2406, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.80% (0.1584 => 0.1961, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.61% (0.0953 => 0.1178, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.40% (0.0842 => 0.1039, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.11% (0.1510 => 0.1859, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.07% (0.3307 => 0.4070, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.06% (4.9449 => 6.0854, std.dev.: 0.0123) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.74% (0.8172 => 1.0030, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: 22.69% (0.2049 => 0.2514, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 22.60% (0.3098 => 0.3798, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.59% (0.2107 => 0.2583, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.55% (0.5569 => 0.6825, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/football/football: 22.53% (0.8921 => 1.0931, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.41% (0.2758 => 0.3376, std.dev.: 0.0052) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 22.29% (2.0273 => 2.4792, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.24% (5.0018 => 6.1141, std.dev.: 0.0092) MultiSource/Benchmarks/McCat/18-imp/imp: 22.14% (0.3423 => 0.4181, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.05% (0.6450 => 0.7872, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 21.96% (3.8723 => 4.7226, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.82% (1.1861 => 1.4449, std.dev.: 0.0046) SingleSource/UnitTests/SignlessTypes/rem: 21.77% (0.1144 => 0.1393, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Towers: 21.66% (0.0471 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.47% (0.9765 => 1.1862, std.dev.: 0.0035) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.41% (0.0467 => 0.0567, std.dev.: 0.0009) MultiSource/Applications/lambda-0_1_3/lambda: 20.85% (0.7433 => 0.8983, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.69% (0.0759 => 0.0916, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.68% (0.0648 => 0.0782, std.dev.: 0.0023) MultiSource/Applications/siod/siod: 20.64% (2.2969 => 2.7709, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.60% (0.3441 => 0.4150, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.52% (0.0770 => 0.0928, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.50% (0.1117 => 0.1346, std.dev.: 0.0038) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.36% (0.0933 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.27% (0.1268 => 0.1525, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.11% (0.8101 => 0.9730, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.90% (0.0834 => 0.1000, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.39% (0.5981 => 0.7141, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.27% (0.4203 => 0.5013, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.05% (0.2603 => 0.3099, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.84% (0.2065 => 0.2454, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.68% (0.1044 => 0.1239, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 18.46% (0.0818 => 0.0969, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 18.31% (0.3283 => 0.3884, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 18.08% (0.3180 => 0.3755, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.83% (0.8067 => 0.9505, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/ary: 17.76% (0.3232 => 0.3806, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 17.74% (0.3387 => 0.3988, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fbench: 17.57% (0.0592 => 0.0696, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.47% (0.0704 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.71% (0.0838 => 0.0978, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: 16.34% (0.3379 => 0.3931, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.30% (0.3865 => 0.4495, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 16.03% (1.5603 => 1.8104, std.dev.: 0.0032) MultiSource/Applications/sqlite3/sqlite3: 15.97% (17.1811 => 19.9249, std.dev.: 0.0127) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.47% (0.4636 => 0.5353, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.09% (0.4103 => 0.4722, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 14.59% (0.3092 => 0.3543, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 14.58% (0.4048 => 0.4638, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.56% (0.2905 => 0.3328, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.32% (0.2430 => 0.2778, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 14.09% (0.3422 => 0.3904, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 14.04% (0.3427 => 0.3908, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/oourafft: 14.02% (0.3282 => 0.3742, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists1: 13.95% (0.3684 => 0.4198, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: 13.93% (0.3927 => 0.4474, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/sieve: 13.82% (0.3603 => 0.4101, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.67% (14.3668 => 16.3311, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.55% (0.1114 => 0.1265, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: 13.43% (0.3886 => 0.4408, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.24% (0.4064 => 0.4602, std.dev.: 0.0007) SingleSource/Benchmarks/Stanford/Puzzle: 13.01% (0.1268 => 0.1433, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions: 12.72% (0.3828 => 0.4315, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.70% (0.3826 => 0.4312, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: 12.47% (0.3473 => 0.3906, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.36% (0.3543 => 0.3981, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: 12.33% (0.3543 => 0.3980, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/for-in: 12.32% (0.3694 => 0.4149, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-3: 12.20% (0.3516 => 0.3945, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 12.18% (0.3497 => 0.3923, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 11.13% (0.2831 => 0.3146, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/except: 11.08% (0.2871 => 0.3189, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: 10.85% (1.2842 => 1.4235, std.dev.: 0.0023) MultiSource/Benchmarks/Bullet/bullet: 10.48% (63.2438 => 69.8745, std.dev.: 0.0481) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.47% (0.3935 => 0.4347, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.43% (2.0665 => 2.2821, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2877 => 0.3174, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.98% (0.2756 => 0.3031, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.95% (0.3650 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.91% (0.1625 => 0.1786, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.85% (0.2793 => 0.3068, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 9.80% (0.2725 => 0.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.77% (0.3162 => 0.3471, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.58% (0.2714 => 0.2974, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.51% (0.2891 => 0.3166, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wc: 9.37% (0.3052 => 0.3338, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.26% (0.2872 => 0.3138, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/random: 9.24% (0.2802 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 9.20% (10.3673 => 11.3206, std.dev.: 0.0090) SingleSource/UnitTests/ObjC++/property-reference-object: 9.12% (0.6030 => 0.6580, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.09% (2.2022 => 2.4023, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.02% (0.1330 => 0.1450, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 8.94% (0.7326 => 0.7981, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.87% (0.2266 => 0.2467, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.81% (0.4879 => 0.5309, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.74% (0.3136 => 0.3410, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.72% (0.3177 => 0.3454, std.dev.: 0.0022) SingleSource/UnitTests/ObjC++/Hello: 8.62% (0.5925 => 0.6436, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.44% (0.1438 => 0.1545, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.82% (0.3817 => 0.4001, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.69% (7.9617 => 8.3349, std.dev.: 0.0145) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3123, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4782, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (1.1145 => 1.2933, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.24% (1.1396 => 1.2449, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.92% (11.6436 => 12.4490, std.dev.: 0.2034) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.62% (4.2280 => 4.4655, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.89% (0.3316 => 0.3445, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (2.0360 => 2.1061, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.12% (0.9957 => 1.0268, std.dev.: 0.0094) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.79% (8.6802 => 8.9221, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.40% (3.6395 => 3.7269, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 2.00% (0.8333 => 0.8500, std.dev.: 0.0005) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/llubenchmark/llu: 1.75% (3.7781 => 3.8442, std.dev.: 0.0173) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3088, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 1.65% (9.1159 => 9.2662, std.dev.: 0.0522) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4529, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.78% (6.6874 => 0.1484, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.47% (5.2763 => 1.1886, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -41.74% (0.1622 => 0.0945, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.02% (5.3855 => 4.5226, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.33% (5.3526 => 4.5320, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: -11.11% (10.4361 => 9.2769, std.dev.: 0.0135) SingleSource/UnitTests/Vector/constpool: -7.66% (54.1659 => 50.0142, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.50% (1.7609 => 1.6465, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.25% (1.9577 => 0.6608, std.dev.: 0.0107) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3063, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -33.37% (1.5373 => 1.0243, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4338, std.dev.: 0.0083) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1356, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.29% (2.6546 => 2.0098, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5890, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0913, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.80% (1.2258 => 0.9586, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -18.60% (0.2161 => 0.1759, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/flops-6: -16.02% (1.6925 => 1.4213, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.00% (3.1443 => 2.7354, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.93% (0.9540 => 0.8402, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4917, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7058, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.82% (19.9488 => 18.5881, std.dev.: 0.0096) SingleSource/Benchmarks/McGill/chomp: -6.27% (1.2373 => 1.1597, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.04% (0.3463 => 0.3254) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.65% (8.1563 => 7.6958, std.dev.: 0.0136) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.56% (1.6805 => 1.5870, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-5: -4.76% (1.5835 => 1.5082, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7997, std.dev.: 0.0050) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1546, std.dev.: 0.0028) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops: -1.77% (8.8334 => 8.6768, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.68% (3.6994 => 3.6373, std.dev.: 0.0216) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3287, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7221 => 3.6760, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2351, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8592, std.dev.: 0.0060) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.11% (0.2116 => 0.0696, std.dev.: 0.0017) Report Time: 1.31s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 10:08:27 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 12:08:27 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130180827.54BCF2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8116?compare_to=8112&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8116, Order: 173941, Start Time: 2013-01-30 16:33:31, End Time: 2013-01-30 18:07:48 To: 8112, Order: 173927, Start Time: 2013-01-30 14:34:30, End Time: 2013-01-30 16:09:46 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (116 on baseline) Performance Improvements: 0 (93 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.40% (0.0315 => 0.0710, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.46% (0.0717 => 0.1215, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.46% (0.0514 => 0.0871) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.87% (0.6395 => 0.8817, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.15% (0.6395 => 0.8707, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.88% (0.5688 => 0.7558, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.70% (0.5456 => 0.7240, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.61% (0.5805 => 0.7698, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.57% (0.6260 => 0.8299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.16% (0.5849 => 0.7730, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.09% (0.5575 => 0.7364, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.03% (0.5567 => 0.7350, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.98% (0.5581 => 0.7366, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.94% (0.6230 => 0.8220, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.87% (0.5802 => 0.7651, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.87% (0.5941 => 0.7775, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.66% (0.5705 => 0.7454, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.54% (0.5478 => 0.7151, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.43% (0.5857 => 0.7639, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.38% (0.5569 => 0.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.36% (0.5859 => 0.7638, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.14% (0.5570 => 0.7249, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.13% (0.6033 => 0.7851, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.05% (0.5591 => 0.7271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.69% (0.5925 => 0.7684, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.64% (1.6474 => 2.1357, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.08% (0.6189 => 0.7989, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.54% (0.6676 => 0.8581, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.42% (0.5863 => 0.7529, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.33% (0.6304 => 0.8090, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.27% (0.6052 => 0.7763, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.85% (0.6446 => 0.8241, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.24% (0.6194 => 0.7881, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.15% (0.6681 => 0.8495, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.97% (0.6660 => 0.8456, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.84% (0.6297 => 0.7987, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.50% (0.6667 => 0.8367, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.32% (0.0699 => 0.0869, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.11% (0.7524 => 0.9338, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.54% (0.0582 => 0.0719, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.46% (0.7339 => 0.9061, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.50% (2.2587 => 2.7670, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.30% (0.0634 => 0.0750, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.55% (0.0621 => 0.0730, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.49% (0.1146 => 0.1335, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 15.91% (0.3357 => 0.3891, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.14% (1.1450 => 1.3184, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.43% (0.1081 => 0.1237, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.92% (0.1982 => 0.2238, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (4.5069 => 5.0659, std.dev.: 0.0044) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.07% (1.6364 => 1.8339, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.96% (0.4916 => 0.5504, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.80% (3.5339 => 3.9508, std.dev.: 0.0141) MultiSource/Benchmarks/McCat/05-eks/eks: 11.32% (0.4515 => 0.5026, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.31% (0.2385 => 0.2631, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.67% (9.2283 => 10.1211, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/hash: 9.20% (0.4524 => 0.4940, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.04% (0.5329 => 0.5811, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.90% (0.1731 => 0.1885, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.78% (0.1230 => 0.1338, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.52% (0.7021 => 0.7619, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.27% (1.2515 => 1.3550, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.27% (0.4861 => 0.5263, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.85% (0.2001 => 0.2158, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.65% (1.2784 => 1.3762, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.17% (1.4642 => 1.5692, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: 6.87% (0.6750 => 0.7214, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3255 => 0.3462, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.89% (5.4682 => 5.7903, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.79% (0.3319 => 0.3478, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.41% (22.4056 => 23.3941, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/ary3: 3.80% (0.3446 => 0.3577, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.47% (5.0226 => 5.1970, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/ary: 3.42% (0.3394 => 0.3510, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.40% (0.9557 => 0.9882, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 3.33% (0.7447 => 0.7695, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.10% (15.5079 => 15.9894, std.dev.: 0.0189) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.09% (0.3491 => 0.3599, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.07% (1.3864 => 1.4289, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.4427 => 0.4557, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 2.65% (0.8418 => 0.8641, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5168 => 0.5276, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.84% (1.3722 => 1.3975, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: 1.26% (34.0927 => 34.5225, std.dev.: 0.0127) MultiSource/Applications/kimwitu++/kc: 1.10% (18.2933 => 18.4943, std.dev.: 0.0183) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.81% (31.3723 => 55.7837, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.90% (0.9531 => 1.0284, std.dev.: 0.0010) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4811, std.dev.: 0.0640) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.86% (2.0478 => 2.1064, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3027, std.dev.: 0.0020) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.51% (18.2231 => 18.4986, std.dev.: 0.0193) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5320 => 4.5975, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.40% (5.1955 => 5.2681, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.29% (79.7170 => 80.7493, std.dev.: 0.0799) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3489 => 10.4526, std.dev.: 0.0199) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.49% (0.1281 => 0.1121, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.49% (0.7198 => 0.6803, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/trivial-interface: -4.67% (0.3812 => 0.3634, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.57% (0.3194 => 0.3048, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.56% (0.3884 => 0.3707, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -4.52% (0.3896 => 0.3720, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.52% (0.3831 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.50% (0.3848 => 0.3675, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.47% (0.3891 => 0.3717, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.44% (0.4033 => 0.3854, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-4: -4.36% (0.3880 => 0.3711, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions: -4.21% (0.4176 => 0.4000, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.11% (0.3821 => 0.3664, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.72% (0.4199 => 0.4043, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9852 => 0.9491, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.57% (2.4924 => 2.4035, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -3.32% (0.4280 => 0.4138, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.28% (0.3142 => 0.3039, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.13% (0.3837 => 0.3717, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.99% (0.6347 => 0.6157, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.76% (0.6441 => 0.6263, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.75% (0.9542 => 0.9280, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.59% (0.6484 => 0.6316, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.33% (2.1713 => 2.1208, std.dev.: 0.0144) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.11% (14.2083 => 13.9079, std.dev.: 0.0166) SingleSource/UnitTests/Vector/constpool: -2.06% (20.7746 => 20.3462, std.dev.: 0.0445) SingleSource/UnitTests/ObjC++/property-reference: -1.95% (0.7779 => 0.7627, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.83% (6.7716 => 6.6475, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.50% (0.7919 => 0.7800, std.dev.: 0.0024) MultiSource/Applications/JM/lencod/lencod: -1.44% (16.1920 => 15.9589, std.dev.: 0.0088) MultiSource/Applications/JM/ldecod/ldecod: -1.25% (7.0961 => 7.0073, std.dev.: 0.0035) MultiSource/Benchmarks/MallocBench/gs/gs: -1.23% (4.3330 => 4.2796, std.dev.: 0.0134) MultiSource/Applications/sqlite3/sqlite3: -1.15% (17.1032 => 16.9068, std.dev.: 0.0148) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.65% (1.8100 => 0.6942, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3160, std.dev.: 0.0070) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.76% (1.3643 => 1.0265, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7553, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4498, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2054, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.39% (2.5106 => 2.1243, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -13.91% (0.4092 => 0.3523, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7264, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3573, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1687, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6336, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3344, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.44% (1.3096 => 1.2645, std.dev.: 0.0114) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3986, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (7.9763 => 7.7566, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/ary3: -2.67% (3.7241 => 3.6246, std.dev.: 0.0112) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1179, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1717, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7089, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4712, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5883, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary3: -1.25% (3.7092 => 3.6629, std.dev.: 0.0158) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.15% (1.6219 => 1.6032, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 11:07:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 13:07:13 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130190713.D26472A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8117?compare_to=8113&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8117, Order: 173943, Start Time: 2013-01-30 17:04:30, End Time: 2013-01-30 19:07:37 To: 8113, Order: 173927, Start Time: 2013-01-30 14:39:48, End Time: 2013-01-30 16:45:51 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 8 (90 on baseline) Performance Improvements: 12 (64 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1044 (909 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.52% (1.4581 => 1.8594, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.26% (6.7919 => 7.4211, std.dev.: 0.2126) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.71% (0.3282 => 0.3568, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.53% (0.4353 => 0.4463, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.26% (15.7406 => 16.0968, std.dev.: 0.0588) MultiSource/Applications/sqlite3/sqlite3: 2.05% (4.3801 => 4.4698, std.dev.: 0.0079) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.82% (2.7627 => 2.8129, std.dev.: 0.0060) SingleSource/Benchmarks/Linpack/linpack-pc: 1.52% (53.1698 => 53.9801, std.dev.: 0.0838) Performance Improvements - Compile Time --------------------------------------- SingleSource/Regression/C/2003-05-21-BitfieldHandling: -59.65% (0.0171 => 0.0069, std.dev.: 0.0039) SingleSource/UnitTests/2007-04-10-BitfieldTest: -51.56% (0.0256 => 0.0124, std.dev.: 0.0032) SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -45.88% (0.0255 => 0.0138, std.dev.: 0.0011) SingleSource/Regression/C/PR1386: -44.88% (0.0254 => 0.0140, std.dev.: 0.0016) SingleSource/Regression/C/2003-05-21-UnionTest: -42.22% (0.0270 => 0.0156, std.dev.: 0.0002) SingleSource/Regression/C++/EH/simple_throw: -41.76% (0.0261 => 0.0152, std.dev.: 0.0003) SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -39.92% (0.0263 => 0.0158, std.dev.: 0.0002) SingleSource/Regression/C++/global_ctor: -39.78% (0.0372 => 0.0224, std.dev.: 0.0008) SingleSource/Regression/C++/EH/ConditionalExpr: -32.14% (0.0336 => 0.0228, std.dev.: 0.0005) SingleSource/Regression/C++/EH/function_try_block: -28.54% (0.0438 => 0.0313, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: -25.69% (4.2254 => 3.1400, std.dev.: 0.4075) SingleSource/Benchmarks/CoyoteBench/lpbench: -14.74% (4.7933 => 4.0869, std.dev.: 0.2426) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.15% (1.2155 => 1.2173, std.dev.: 0.0494) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -6.33% (0.0237 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.67% (0.0450 => 0.0438, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.62% (0.0356 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -3.52% (0.0341 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.96% (0.0455 => 0.0437, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -5.05% (0.0218 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -31.76% (0.0233 => 0.0159, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.80% (0.0251 => 0.0249, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1455 => 0.1446, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: 2.55% (1.1482 => 1.1775, std.dev.: 0.2872) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.79% (0.3916 => 0.3986, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.56% (0.1435 => 0.1427, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0653 => 0.0653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.93% (0.0273 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.18% (0.0560 => 0.0531, std.dev.: 0.0033) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.29% (1.2883 => 1.2845, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0608 => 0.0605, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.96% (0.0357 => 0.0364, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.93% (1.7570 => 1.6880, std.dev.: 0.0523) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -2.60% (0.0077 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.29% (34.4910 => 33.3564, std.dev.: 0.3184) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.51% (0.0336 => 0.1675, std.dev.: 0.0097) SingleSource/Regression/C/sumarraymalloc: 111.26% (0.0293 => 0.0619, std.dev.: 0.0010) SingleSource/Regression/C/sumarray2d: 87.23% (0.0274 => 0.0513, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 60.44% (0.1638 => 0.2628, std.dev.: 0.0027) SingleSource/Regression/C/sumarray: 54.72% (0.0265 => 0.0410, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.99% (0.8893 => 1.2627, std.dev.: 0.1003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.48% (0.9120 => 1.2903, std.dev.: 0.1080) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 41.35% (0.8926 => 1.2617, std.dev.: 0.1034) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.81% (0.9612 => 1.3535, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.72% (0.9061 => 1.2751, std.dev.: 0.0482) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.49% (0.9381 => 1.3179, std.dev.: 0.1268) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.15% (0.9564 => 1.3404, std.dev.: 0.0922) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.86% (0.9588 => 1.3410, std.dev.: 0.0350) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.18% (0.8990 => 1.2512, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.10% (0.9091 => 1.2646, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.06% (0.9855 => 1.3704, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.24% (0.9998 => 1.3821, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.78% (0.9422 => 1.2982, std.dev.: 0.0887) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 37.64% (0.9403 => 1.2942, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.46% (0.9512 => 1.3075, std.dev.: 0.0473) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.94% (0.9010 => 1.2338, std.dev.: 0.0302) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.41% (0.8912 => 1.2157, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.39% (1.0119 => 1.3801, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.82% (0.8736 => 1.1865, std.dev.: 0.0240) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 35.57% (1.0052 => 1.3627, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 35.50% (1.0867 => 1.4725, std.dev.: 0.0521) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.55% (0.8732 => 1.1749, std.dev.: 0.0226) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 34.46% (0.8846 => 1.1894, std.dev.: 0.0382) SingleSource/Benchmarks/Stanford/IntMM: 34.34% (0.0431 => 0.0579, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/exptree: 33.88% (0.0859 => 0.1150, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.54% (0.9867 => 1.3176, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 32.60% (1.0017 => 1.3283, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.58% (0.9788 => 1.2977, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.01% (0.9488 => 1.2525, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.98% (0.9507 => 1.2547, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.41% (1.0088 => 1.3257, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.77% (0.9127 => 1.1935, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.67% (0.9685 => 1.2655, std.dev.: 0.0397) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.15% (0.9993 => 1.3006, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.52% (0.9405 => 1.2181, std.dev.: 0.0783) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.65% (0.9550 => 1.2286, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.12% (1.0860 => 1.3805, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 23.17% (0.0738 => 0.0909, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 18.22% (0.0642 => 0.0759, std.dev.: 0.0018) MultiSource/Applications/sgefa/sgefa: 18.09% (0.3598 => 0.4249, std.dev.: 0.0182) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 18.07% (0.0963 => 0.1137, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 16.55% (0.0707 => 0.0824, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 14.51% (3.6295 => 4.1561, std.dev.: 0.1597) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.44% (1.0986 => 1.2572, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.79% (0.1240 => 0.1411, std.dev.: 0.0059) MultiSource/Benchmarks/mafft/pairlocalalign: 12.95% (9.5202 => 10.7530, std.dev.: 0.3436) SingleSource/Benchmarks/Misc/ReedSolomon: 12.20% (0.2050 => 0.2300, std.dev.: 0.0064) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1793 => 0.1986, std.dev.: 0.0041) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.70% (0.4596 => 0.5088, std.dev.: 0.0171) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.17% (0.5369 => 0.5915, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/matrix: 10.10% (0.2385 => 0.2626, std.dev.: 0.0071) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.36% (0.1955 => 0.2138, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 8.68% (1.8651 => 2.0270, std.dev.: 0.0299) SingleSource/Benchmarks/Linpack/linpack-pc: 8.65% (0.2566 => 0.2788, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 6.98% (0.2879 => 0.3080, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.31% (0.2372 => 0.2498, std.dev.: 0.0038) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106362.50% (0.0008 => 0.8517, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/matrix: 354.07% (1.5825 => 7.1856, std.dev.: 0.0204) SingleSource/Benchmarks/Shootout/ary3: 282.64% (2.2304 => 8.5345, std.dev.: 1.8921) MultiSource/Applications/sgefa/sgefa: 257.52% (0.3515 => 1.2567, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.61% (1.1825 => 4.0277, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 234.06% (4.8185 => 16.0968, std.dev.: 0.0588) SingleSource/Benchmarks/Shootout-C++/ary2: 206.20% (0.0129 => 0.0395, std.dev.: 0.0054) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 192.54% (0.0228 => 0.0667, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary: 140.52% (0.0232 => 0.0558, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 65.22% (2.9083 => 4.8051, std.dev.: 0.1453) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.61% (0.2562 => 0.3423, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.44% (5.6033 => 7.4211, std.dev.: 0.2126) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 32.38% (1.4588 => 1.9311, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.72% (3.1254 => 4.1169, std.dev.: 0.0070) SingleSource/Regression/C/uint64_to_float: 25.44% (1.5397 => 1.9314, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/salsa20: 21.85% (7.4497 => 9.0775, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.30% (4.8112 => 5.7878, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.13% (5.1752 => 5.8547, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6498, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.91% (3.6477 => 3.9726, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.99% (4.7473 => 5.0792, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/chomp: 6.86% (1.0425 => 1.1140, std.dev.: 0.0154) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.30% (0.6211 => 0.6602, std.dev.: 0.0116) SingleSource/Benchmarks/Linpack/linpack-pc: 6.06% (50.8945 => 53.9801, std.dev.: 0.0838) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.19% (4.1836 => 4.4008, std.dev.: 0.0262) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2298, std.dev.: 0.0129) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.07% (4.7254 => 4.8703, std.dev.: 0.0102) MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.77% (2.7640 => 2.8129, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8624, std.dev.: 0.0149) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.86% (0.0808 => 0.0494, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.50% (0.0727 => 0.0498, std.dev.: 0.0016) MultiSource/Benchmarks/BitBench/drop3/drop3: -26.88% (0.0692 => 0.0506, std.dev.: 0.0023) SingleSource/Benchmarks/SmallPT/smallpt: -23.83% (0.1888 => 0.1438, std.dev.: 0.0124) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -20.86% (0.0676 => 0.0535, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.34% (1.0960 => 0.9169, std.dev.: 0.0203) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.27% (0.1684 => 0.1410, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.05% (0.7686 => 0.6606, std.dev.: 0.0243) MultiSource/Applications/spiff/spiff: -12.05% (1.0220 => 0.8988, std.dev.: 0.0226) MultiSource/Applications/treecc/treecc: -8.65% (2.4719 => 2.2582, std.dev.: 0.0253) SingleSource/Benchmarks/Shootout-C++/hash: -6.33% (0.4689 => 0.4392, std.dev.: 0.0076) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.33% (0.2481 => 0.2324, std.dev.: 0.0014) MultiSource/Applications/lambda-0_1_3/lambda: -6.30% (0.8653 => 0.8108, std.dev.: 0.0178) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.25% (1.0234 => 0.9594, std.dev.: 0.0067) MultiSource/Applications/ClamAV/clamscan: -5.32% (17.4365 => 16.5090, std.dev.: 0.2921) MultiSource/Applications/d/make_dparser: -5.01% (3.7840 => 3.5946, std.dev.: 0.0704) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.97% (0.2615 => 0.2485, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/moments: -4.05% (0.4002 => 0.3840, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.79% (11.5523 => 3.9517, std.dev.: 0.0193) SingleSource/Benchmarks/Misc/fp-convert: -61.63% (15.6525 => 6.0051, std.dev.: 0.0150) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.57% (0.4146 => 0.1842, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.43% (0.4578 => 0.2361, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.11% (11.3868 => 6.3644, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.87% (5.4023 => 3.6263, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: -30.98% (0.9372 => 0.6469, std.dev.: 0.1035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.77% (0.4452 => 0.3082, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/heapsort: -29.82% (4.4739 => 3.1400, std.dev.: 0.4075) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.72% (0.5495 => 0.4027, std.dev.: 0.0422) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.07% (5.2605 => 3.8891, std.dev.: 0.0037) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.36% (4.4467 => 3.3192, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.00% (0.5897 => 0.4482, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.41% (4.9921 => 3.8233, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.40% (0.5826 => 0.4463, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: -21.74% (7.9891 => 6.2525, std.dev.: 0.2286) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.66% (16.6791 => 13.3993, std.dev.: 0.1908) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7921, std.dev.: 0.0136) MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.57% (2.8778 => 2.3723, std.dev.: 0.0943) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.10% (3.1921 => 2.7740, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9938, std.dev.: 0.0316) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.01% (9.7992 => 8.6228, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.32% (0.4081 => 0.3660, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout/hash: -9.58% (4.5259 => 4.0921, std.dev.: 0.0495) MultiSource/Benchmarks/mafft/pairlocalalign: -9.00% (63.1520 => 57.4682, std.dev.: 0.7331) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.57% (5.5974 => 5.2294, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2490, std.dev.: 0.0109) MultiSource/Benchmarks/Olden/health/health: -6.32% (0.3654 => 0.3423, std.dev.: 0.0058) MultiSource/Applications/SIBsim4/SIBsim4: -5.78% (3.5443 => 3.3396, std.dev.: 0.0368) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.59% (4.9799 => 4.7017, std.dev.: 0.0817) SingleSource/Benchmarks/McGill/queens: -5.35% (1.7443 => 1.6510, std.dev.: 0.0144) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.35% (3.5127 => 3.3599, std.dev.: 0.0268) SingleSource/Benchmarks/Shootout-C++/hash2: -4.28% (3.6768 => 3.5193, std.dev.: 0.0280) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.74% (3.5691 => 3.4357, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.69% (5.8973 => 5.6799, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/lists: -3.58% (17.2182 => 16.6014, std.dev.: 0.0951) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.38% (2.5170 => 2.4318, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.89% (8.7327 => 8.5679, std.dev.: 0.0103) SingleSource/Benchmarks/Misc/mandel-2: -1.85% (0.8521 => 0.8363, std.dev.: 0.0028) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.72% (85.3042 => 83.8385, std.dev.: 0.0571) SingleSource/Benchmarks/Shootout-C++/methcall: -1.67% (8.7416 => 8.5956, std.dev.: 0.0433) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.54% (8.8249 => 8.6887, std.dev.: 0.0219) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3596 => 3.3159, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.14% (6.8262 => 6.7481, std.dev.: 0.0131) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (3.7450 => 3.7028, std.dev.: 0.0019) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.05% (1.2047 => 1.2173, std.dev.: 0.0494) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.72% (0.0394 => 0.0336, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.30% (0.0328 => 0.0329, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.80% (0.0445 => 0.0437, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/test1: -29.96% (0.0227 => 0.0159, std.dev.: 0.0032) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.35% (0.0255 => 0.0249, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.49% (0.1530 => 0.1446, std.dev.: 0.0038) MultiSource/Applications/lemon/lemon: -38.97% (1.9293 => 1.1775, std.dev.: 0.2872) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.56% (0.4049 => 0.3986, std.dev.: 0.0455) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.50% (0.1510 => 0.1427, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.23% (0.0978 => 0.0653, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.99% (0.0276 => 0.0265, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.00% (0.0590 => 0.0531, std.dev.: 0.0033) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.57% (1.1617 => 1.2845, std.dev.: 0.0348) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.82% (0.0610 => 0.0605, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.82% (0.0268 => 0.0364, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 126.97% (0.7437 => 1.6880, std.dev.: 0.0523) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -18.48% (0.0092 => 0.0075, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 161.04% (12.7781 => 33.3564, std.dev.: 0.3184) Report Time: 0.75s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 12:06:34 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 14:06:34 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130200634.4D9DC2A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8118?compare_to=8116&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8118, Order: 173950, Start Time: 2013-01-30 18:32:40, End Time: 2013-01-30 20:06:56 To: 8116, Order: 173941, Start Time: 2013-01-30 16:33:31, End Time: 2013-01-30 18:07:48 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (94 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (880 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.08% (0.0315 => 0.0709, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/lowercase: 78.93% (0.0280 => 0.0501, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.02% (0.0974 => 0.1617, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.73% (0.1500 => 0.2186, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 42.70% (0.0267 => 0.0381, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.14% (0.1132 => 0.1609, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.90% (0.0599 => 0.0832, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.01% (0.6395 => 0.8826, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.39% (0.6395 => 0.8722, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.78% (0.5805 => 0.7708, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.63% (0.5688 => 0.7544, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.60% (0.6260 => 0.8301, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.51% (0.5456 => 0.7230, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.09% (0.5849 => 0.7726, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.96% (0.6230 => 0.8221, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.86% (0.5575 => 0.7351, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.82% (0.5581 => 0.7357, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.23% (0.5802 => 0.7614, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.74% (0.5941 => 0.7767, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.73% (0.5705 => 0.7458, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.38% (0.5478 => 0.7142, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.33% (0.5859 => 0.7636, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.29% (0.5857 => 0.7631, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.27% (0.5569 => 0.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.10% (0.6033 => 0.7849, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.87% (0.5591 => 0.7261, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.76% (1.6474 => 2.1376, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.49% (0.6440 => 0.8339, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.00% (0.6189 => 0.7984, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.59% (0.6676 => 0.8585, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.55% (0.6304 => 0.8104, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.52% (0.5863 => 0.7535, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.14% (0.6052 => 0.7755, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.86% (0.6446 => 0.8242, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.24% (0.6681 => 0.8501, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.14% (0.6194 => 0.7875, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.06% (0.6660 => 0.8462, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.82% (0.6297 => 0.7986, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.33% (0.6667 => 0.8356, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.32% (0.0699 => 0.0869, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.10% (0.7524 => 0.9337, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.34% (0.7339 => 0.9052, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.61% (2.2587 => 2.7695, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.58% (0.1146 => 0.1336, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.00% (0.3357 => 0.3894, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 15.17% (1.1450 => 1.3187, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.76% (0.1982 => 0.2235, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.40% (4.5069 => 5.0659, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.00% (1.6364 => 1.8328, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.93% (3.5339 => 3.9554, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 11.92% (0.0864 => 0.0967, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.92% (0.4916 => 0.5502, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/05-eks/eks: 11.41% (0.4515 => 0.5030, std.dev.: 0.0010) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.22% (0.1230 => 0.1368, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.23% (0.2385 => 0.2629, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.65% (9.2283 => 10.1184, std.dev.: 0.0224) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.24% (0.1731 => 0.1891, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 9.04% (0.4524 => 0.4933, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.97% (0.5329 => 0.5807, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 8.65% (1.2515 => 1.3597, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.62% (0.7021 => 0.7626, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hash2: 7.96% (0.4861 => 0.5248, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.80% (0.2001 => 0.2157, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.70% (1.2784 => 1.3769, std.dev.: 0.0102) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.4642 => 1.5720, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 6.77% (0.6750 => 0.7207, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.26% (5.4682 => 5.8107, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/matrix: 5.84% (0.3255 => 0.3445, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ReedSolomon: 5.59% (0.1879 => 0.1984, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.06% (0.3319 => 0.3487, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.33% (22.4056 => 23.3762, std.dev.: 0.0224) MultiSource/Applications/oggenc/oggenc: 3.54% (5.0226 => 5.2002, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 3.41% (0.7447 => 0.7701, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.37% (0.3446 => 0.3562, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.31% (0.9557 => 0.9873, std.dev.: 0.0008) MultiSource/Applications/SPASS/SPASS: 3.14% (15.5079 => 15.9951, std.dev.: 0.0165) MultiSource/Applications/SIBsim4/SIBsim4: 3.11% (1.3864 => 1.4295, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3394 => 0.3499, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.99% (0.8418 => 0.8670, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.95% (0.3491 => 0.3594, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.78% (0.4427 => 0.4550, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.87% (1.3722 => 1.3979, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 1.44% (18.2933 => 18.5573, std.dev.: 0.0186) MultiSource/Benchmarks/Bullet/bullet: 1.19% (34.0927 => 34.4994, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.17% (1.2300 => 1.2444, std.dev.: 0.0006) MultiSource/Applications/d/make_dparser: 1.02% (3.5154 => 3.5514, std.dev.: 0.0014) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7980, std.dev.: 0.0126) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.56% (0.9531 => 1.0252, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 7.41% (0.5692 => 0.6114, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.59% (54.5751 => 56.5357, std.dev.: 0.1215) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1044, std.dev.: 0.0126) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3040, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.59% (18.2231 => 18.5120, std.dev.: 0.0125) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2708, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5967, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.12% (79.7170 => 80.6085, std.dev.: 0.1608) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.41% (0.1281 => 0.1122, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.50% (0.7198 => 0.6802, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/trivial-interface: -5.09% (0.3812 => 0.3618, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -5.05% (0.3884 => 0.3688, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.99% (0.3831 => 0.3640, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: -4.98% (0.3194 => 0.3035, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.95% (0.3880 => 0.3688, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.91% (0.3848 => 0.3659, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.90% (0.3896 => 0.3705, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.83% (0.3891 => 0.3703, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -4.81% (0.4033 => 0.3839, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.57% (0.4176 => 0.3985, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: -4.00% (0.4199 => 0.4031, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.93% (0.3821 => 0.3671, std.dev.: 0.0005) MultiSource/Benchmarks/PAQ8p/paq8p: -3.70% (2.4924 => 2.4002, std.dev.: 0.0149) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9852 => 0.9491, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -3.62% (0.4280 => 0.4125, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/Hello: -3.53% (0.6347 => 0.6123, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.31% (0.3142 => 0.3038, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: -3.17% (0.6441 => 0.6237, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.16% (0.3323 => 0.3218, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.81% (0.9542 => 0.9274, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.72% (2.1713 => 2.1123, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.70% (1.3148 => 1.2793, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.59% (0.6484 => 0.6316, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: -2.38% (0.7779 => 0.7594, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.21% (14.2083 => 13.8946, std.dev.: 0.0119) SingleSource/UnitTests/Vector/constpool: -2.06% (20.7746 => 20.3463, std.dev.: 0.0277) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.71% (6.7716 => 6.6561, std.dev.: 0.0066) MultiSource/Applications/JM/lencod/lencod: -1.50% (16.1920 => 15.9493, std.dev.: 0.0111) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.35% (1.0544 => 1.0402, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: -1.19% (17.1032 => 16.8993, std.dev.: 0.0195) MultiSource/Applications/JM/ldecod/ldecod: -1.17% (7.0961 => 7.0128, std.dev.: 0.0091) MultiSource/Benchmarks/Prolangs-C/football/football: -1.13% (0.9179 => 0.9075, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.03% (1.2221 => 1.2095, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.23% (1.8100 => 0.6837, std.dev.: 0.0136) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.98% (8.0445 => 5.3113, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.64% (0.2151 => 0.1578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel-2: -25.10% (1.3643 => 1.0219, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7513, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.84% (83.5423 => 64.4581, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.90% (4.1024 => 3.2038, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.35% (2.5106 => 2.1253, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7255, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.34% (4.9100 => 4.3533, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8191, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1074, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.73% (2.2633 => 2.1789, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.70% (7.9763 => 7.7609, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.30% (3.1919 => 3.1185, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.7241 => 3.6526, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.89% (7.3040 => 7.1662, std.dev.: 0.0118) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.68% (6.5735 => 6.4630, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.63% (1.6219 => 1.5955, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.99s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 12:10:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 14:10:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130201051.2ECF92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8119?compare_to=8115&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8119, Order: 173943, Start Time: 2013-01-30 17:58:42, End Time: 2013-01-30 20:11:12 To: 8115, Order: 173931, Start Time: 2013-01-30 15:15:20, End Time: 2013-01-30 17:27:55 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (230 on baseline) Performance Improvements: 2 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (642 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.51% (11.3206 => 11.1493, std.dev.: 0.0036) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/llubenchmark/llu: -1.08% (3.8442 => 3.8028, std.dev.: 0.0104) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.08% (0.1326 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.01% (0.0696 => 0.0703, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8535 => 499.8608, std.dev.: 0.0041) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44225.69% (1.1277 => 499.8608, std.dev.: 0.0041) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 228.02% (0.5229 => 1.7152, std.dev.: 0.0172) MultiSource/Applications/SPASS/SPASS: 26.40% (14.9895 => 18.9469, std.dev.: 0.0062) MultiSource/Applications/kimwitu++/kc: 47.49% (14.1553 => 20.8781, std.dev.: 0.0059) MultiSource/Benchmarks/MallocBench/gs/gs: 21.25% (4.1105 => 4.9840, std.dev.: 0.0090) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.82% (1.1048 => 1.7988, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.14% (7.1582 => 39.3801, std.dev.: 0.0138) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.76% (3.4629 => 6.6058, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.06% (0.6222 => 1.1390, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10239.58% (0.0720 => 7.4445, std.dev.: 0.0113) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 11096700.00% (0.0001 => 11.0968, std.dev.: 0.0143) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488500.00% (0.0001 => 5.4886, std.dev.: 0.0185) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.48% (1.1194 => 10.3038, std.dev.: 0.0075) MultiSource/Applications/ClamAV/clamscan: 151.49% (22.1758 => 55.7706, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.66% (0.0929 => 0.1892, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.79% (0.1463 => 0.2645, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 67.67% (0.0730 => 0.1224, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/IntMM: 66.24% (0.0394 => 0.0655, std.dev.: 0.0002) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.15% (1.5859 => 2.4922, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.12% (2.9384 => 4.6167, std.dev.: 0.0104) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.32% (7.0540 => 10.9562, std.dev.: 0.0056) MultiSource/Benchmarks/FreeBench/distray/distray: 53.98% (0.1056 => 0.1626, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.60% (8.1363 => 12.2531, std.dev.: 0.0095) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.66% (0.0439 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.70% (2.2024 => 3.2309, std.dev.: 0.0029) MultiSource/Applications/sgefa/sgefa: 45.03% (0.3109 => 0.4509, std.dev.: 0.0012) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 42.18% (0.1432 => 0.2036, std.dev.: 0.0002) MultiSource/Applications/JM/lencod/lencod: 40.88% (21.9371 => 30.9052, std.dev.: 0.0041) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.87% (0.1062 => 0.1496, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 39.18% (1.5415 => 2.1455, std.dev.: 0.0117) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.00% (4.2646 => 5.8850, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.36% (0.4615 => 0.6339, std.dev.: 0.0041) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.55% (0.2271 => 0.3101, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.10% (0.5105 => 0.6948, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 34.88% (1.1642 => 1.5703, std.dev.: 0.0058) MultiSource/Benchmarks/McCat/05-eks/eks: 34.26% (0.4299 => 0.5772, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.04% (0.1892 => 0.2536, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.95% (0.6675 => 0.8941, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.48% (0.0457 => 0.0610, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.57% (0.0479 => 0.0635) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: 32.27% (0.1655 => 0.2189, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 32.08% (0.0636 => 0.0840) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.64% (0.1125 => 0.1481, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.15% (0.1695 => 0.2223, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 30.94% (9.4845 => 12.4191, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout/hash: 30.31% (0.0485 => 0.0632, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.19% (3.8922 => 5.0674, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 29.09% (1.0722 => 1.3841, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 28.76% (0.1151 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 28.74% (0.2554 => 0.3288, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 28.68% (0.1555 => 0.2001, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.63% (0.0793 => 0.1020, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.62% (1.4186 => 1.8246, std.dev.: 0.0018) MultiSource/Applications/minisat/minisat: 28.43% (0.7115 => 0.9138, std.dev.: 0.0106) SingleSource/UnitTests/2006-12-11-LoadConstants: 28.35% (0.1143 => 0.1467, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 27.89% (0.4289 => 0.5485, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.70% (0.0408 => 0.0521, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.67% (0.1337 => 0.1707, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.23% (0.3121 => 0.3971, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.12% (0.1906 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 26.98% (0.1175 => 0.1492, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 26.93% (0.4620 => 0.5864, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.63% (0.1566 => 0.1983, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.44% (0.0730 => 0.0923, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.36% (0.1032 => 0.1304, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.34% (0.0672 => 0.0849, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.08% (0.5020 => 0.6329, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: 25.96% (0.7835 => 0.9869, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 25.96% (0.6456 => 0.8132, std.dev.: 0.0136) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 25.81% (0.0527 => 0.0663, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.65% (0.0842 => 0.1058, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 25.28% (0.0443 => 0.0555, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.24% (0.1236 => 0.1548, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.16% (1.3050 => 1.6334, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/bisort/bisort: 24.92% (0.0614 => 0.0767, std.dev.: 0.0016) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.89% (0.2700 => 0.3372, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 24.76% (0.1163 => 0.1451, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout/lists: 24.76% (0.0626 => 0.0781, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.72% (0.0886 => 0.1105, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 24.64% (0.0491 => 0.0612, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 24.48% (1.1840 => 1.4739, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/em3d/em3d: 24.48% (0.1695 => 0.2110, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.45% (0.0871 => 0.1084, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.34% (0.0953 => 0.1185, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 24.12% (3.3354 => 4.1399, std.dev.: 0.0094) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.00% (0.1029 => 0.1276, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.00% (0.0675 => 0.0837, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 23.79% (5.7591 => 7.1293, std.dev.: 0.0173) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.48% (0.1584 => 0.1956, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.19% (0.5860 => 0.7219, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/messages-2: 23.11% (0.0662 => 0.0815, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.91% (4.9449 => 6.0778, std.dev.: 0.0113) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.89% (0.1940 => 0.2384, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.73% (0.2107 => 0.2586, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.69% (0.8172 => 1.0026, std.dev.: 0.0111) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.68% (0.3307 => 0.4057, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.65% (0.1510 => 0.1852, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 22.55% (0.2049 => 0.2511, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 22.36% (0.8921 => 1.0916, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 22.05% (2.0273 => 2.4744, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.04% (0.2758 => 0.3366, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.99% (5.0018 => 6.1016, std.dev.: 0.0059) MultiSource/Benchmarks/BitBench/five11/five11: 21.87% (0.0567 => 0.0691, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.81% (0.6450 => 0.7857, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 21.76% (0.3423 => 0.4168, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.76% (0.5569 => 0.6781, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/matrix: 21.72% (0.3098 => 0.3771, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 21.48% (3.8723 => 4.7040, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.47% (1.1861 => 1.4407, std.dev.: 0.0099) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.40% (0.0528 => 0.0641, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/rem: 21.33% (0.1144 => 0.1388, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.08% (0.9765 => 1.1823, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.73% (0.2065 => 0.2493, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.68% (0.1117 => 0.1348, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.68% (0.0648 => 0.0782, std.dev.: 0.0017) MultiSource/Applications/lambda-0_1_3/lambda: 20.56% (0.7433 => 0.8961, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.39% (0.0770 => 0.0927, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.29% (0.0759 => 0.0913, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.26% (0.0933 => 0.1122, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/health/health: 20.11% (0.1268 => 0.1523, std.dev.: 0.0017) MultiSource/Applications/siod/siod: 20.07% (2.2969 => 2.7578, std.dev.: 0.0142) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.78% (0.0834 => 0.0999, std.dev.: 0.0008) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.53% (0.8101 => 0.9683, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.30% (0.3441 => 0.4105, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.21% (0.5981 => 0.7130, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.82% (0.2603 => 0.3093, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.61% (0.4203 => 0.4985, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.91% (0.1044 => 0.1231, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: 17.91% (0.0592 => 0.0698) MultiSource/Benchmarks/sim/sim: 17.66% (0.3387 => 0.3985, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 17.61% (0.3180 => 0.3740, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.47% (0.0704 => 0.0827, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.44% (0.8067 => 0.9474, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary3: 17.39% (0.3283 => 0.3854, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 17.05% (0.3232 => 0.3783, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 15.98% (1.5603 => 1.8097, std.dev.: 0.0046) MultiSource/Applications/sqlite3/sqlite3: 15.82% (17.1811 => 19.8997, std.dev.: 0.0173) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.73% (0.3865 => 0.4473, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.60% (0.3379 => 0.3906, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.01% (0.4636 => 0.5332, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.60% (0.4103 => 0.4702, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/bh/bh: 14.26% (0.3092 => 0.3533, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/moments: 13.93% (0.4048 => 0.4612, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/oourafft: 13.92% (0.3282 => 0.3739, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.91% (0.2430 => 0.2768, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 13.91% (0.2905 => 0.3309, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.63% (0.3427 => 0.3894, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.57% (0.3684 => 0.4184, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: 13.53% (0.3422 => 0.3885, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 13.50% (0.3927 => 0.4457, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.46% (14.3668 => 16.2999, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/property: 13.23% (0.3886 => 0.4400, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.04% (0.3603 => 0.4073, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.92% (0.4064 => 0.4589, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.84% (0.1114 => 0.1257, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: 12.57% (0.3828 => 0.4309, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 12.10% (0.3694 => 0.4141, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/trivial-interface: 12.09% (0.3473 => 0.3893, std.dev.: 0.0076) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.05% (0.3826 => 0.4287, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/synchronized: 12.02% (0.3561 => 0.3989, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.00% (0.3543 => 0.3968, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/exceptions-2: 11.92% (0.3497 => 0.3914, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.89% (0.3516 => 0.3934, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 11.67% (0.1268 => 0.1416, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3935 => 0.4345, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/strcat: 10.39% (0.2831 => 0.3125, std.dev.: 0.0013) MultiSource/Applications/hexxagon/hexxagon: 10.33% (1.2842 => 1.4168, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: 10.14% (63.2438 => 69.6593, std.dev.: 0.0367) SingleSource/Benchmarks/Shootout-C++/except: 10.10% (0.2871 => 0.3161, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.84% (2.0665 => 2.2698, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.51% (0.3650 => 0.3997, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1625 => 0.1778, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 9.38% (0.2877 => 0.3147, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.36% (0.2756 => 0.3014, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.32% (0.6030 => 0.6592, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.30% (0.3162 => 0.3456, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.25% (0.1330 => 0.1453, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.17% (0.2793 => 0.3049, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/fibo: 9.03% (0.2725 => 0.2971, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 8.92% (0.2891 => 0.3149, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 8.88% (0.3052 => 0.3323, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 8.84% (0.2714 => 0.2954, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.74% (0.7326 => 0.7966, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.60% (0.2872 => 0.3119, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 8.57% (0.2802 => 0.3042, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 8.56% (0.5925 => 0.6432, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.55% (2.2022 => 2.3904, std.dev.: 0.0060) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.50% (0.3177 => 0.3447, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.44% (0.4879 => 0.5291, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.38% (0.2266 => 0.2456, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.20% (0.3136 => 0.3393, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 7.54% (10.3673 => 11.1493, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.65% (7.9617 => 8.3316, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.61% (0.3817 => 0.3993, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4765, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6973, std.dev.: 0.0002) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.87% (11.6436 => 12.4437, std.dev.: 0.0482) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.26% (4.2280 => 4.4506, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (3.1578 => 3.3099, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/ffbench: 4.12% (0.9505 => 0.9897, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0005) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.53% (0.9957 => 1.0308, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.83% (8.6802 => 8.9260, std.dev.: 0.0132) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7205, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2199, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.73% (9.1159 => 9.2735, std.dev.: 0.0343) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3102, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.04% (10.3460 => 10.4531, std.dev.: 0.0109) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.77% (6.6874 => 0.1491, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.69% (5.2763 => 1.1770, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -74.88% (0.8651 => 0.2173, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.23% (0.1622 => 0.0937, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.25% (5.3855 => 4.5104, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.51% (5.3526 => 4.5224, std.dev.: 0.0022) MultiSource/Applications/JM/ldecod/ldecod: -11.36% (10.4361 => 9.2505, std.dev.: 0.0098) SingleSource/UnitTests/Vector/constpool: -7.71% (54.1659 => 49.9875, std.dev.: 0.0200) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.61% (1.7609 => 1.6445, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -67.13% (1.9577 => 0.6435, std.dev.: 0.0123) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3064, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0216, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.56% (10.7105 => 7.4375, std.dev.: 0.0278) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1328, std.dev.: 0.0101) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0034, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0915, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -18.51% (0.2161 => 0.1761, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1265, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.82% (1.6925 => 1.4247, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: -13.11% (3.1443 => 2.7322, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.77% (0.9540 => 0.8417, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4941, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7063, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.71% (19.9488 => 18.6094, std.dev.: 0.0217) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.09% (0.3463 => 0.3252, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: -6.03% (1.2373 => 1.1627, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5867, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7011, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-5: -4.72% (1.5835 => 1.5087, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.8002, std.dev.: 0.0024) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.43% (0.4808 => 0.4595, std.dev.: 0.0034) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0009) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3285, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -1.47% (3.7221 => 3.6672, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/ary3: -1.34% (3.6994 => 3.6498, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout/lists: -1.29% (6.2999 => 6.2185, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0104) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.78% (0.2116 => 0.0703, std.dev.: 0.0015) Report Time: 1.44s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 13:36:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 15:36:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130130213611.55DC72A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8120?compare_to=8117&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8120, Order: 173952, Start Time: 2013-01-30 19:27:34, End Time: 2013-01-30 21:36:35 To: 8117, Order: 173943, Start Time: 2013-01-30 17:04:30, End Time: 2013-01-30 19:07:37 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 42 (101 on baseline) Performance Improvements: 7 (50 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1015 (912 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/15-trie/trie: 68.03% (0.0610 => 0.1025, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 47.67% (0.0837 => 0.1236, std.dev.: 0.0057) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 42.80% (0.0979 => 0.1398, std.dev.: 0.0104) MultiSource/Benchmarks/FreeBench/neural/neural: 31.81% (0.2628 => 0.3464, std.dev.: 0.0317) MultiSource/Benchmarks/Olden/bh/bh: 20.30% (0.3325 => 0.4000, std.dev.: 0.0106) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.63% (1.2655 => 1.5012, std.dev.: 0.0232) MultiSource/Benchmarks/Olden/tsp/tsp: 13.20% (0.1333 => 0.1509, std.dev.: 0.0062) MultiSource/Benchmarks/Olden/em3d/em3d: 12.98% (0.1941 => 0.2193, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.18% (4.1561 => 4.6209, std.dev.: 0.0847) MultiSource/Applications/JM/lencod/lencod: 10.15% (16.9666 => 18.6882, std.dev.: 0.4503) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.12% (24.7050 => 27.2060, std.dev.: 0.0556) MultiSource/Benchmarks/Bullet/bullet: 9.99% (34.2097 => 37.6284, std.dev.: 0.7562) MultiSource/Benchmarks/mafft/pairlocalalign: 9.11% (10.7530 => 11.7326, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 9.07% (1.3805 => 1.5057, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 8.44% (1.3535 => 1.4678, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.83% (1.2572 => 1.3556, std.dev.: 0.0341) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 7.73% (1.2942 => 1.3943, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.13% (1.3627 => 1.4599, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.01% (1.3176 => 1.4099, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 6.87% (0.5426 => 0.5799, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.36% (1.2903 => 1.3724, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.93% (1.3404 => 1.4199, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.97% (1.2617 => 1.3244, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.57% (1.2512 => 1.3084, std.dev.: 0.0164) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.32% (0.2939 => 0.3066, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 4.30% (1.3410 => 1.3986, std.dev.: 0.0213) MultiSource/Applications/d/make_dparser: 2.83% (3.5946 => 3.6965, std.dev.: 0.0183) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.46% (0.7116 => 0.7220, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: 62.26% (0.1672 => 0.2713, std.dev.: 0.0122) MultiSource/Benchmarks/Olden/bisort/bisort: 46.61% (0.6469 => 0.9484, std.dev.: 0.0191) MultiSource/Benchmarks/Ptrdist/ft/ft: 42.53% (0.8727 => 1.2439, std.dev.: 0.0517) SingleSource/Benchmarks/Shootout/ary3: 41.15% (8.5345 => 12.0463, std.dev.: 0.5283) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.80% (1.2550 => 1.5160, std.dev.: 0.0782) MultiSource/Applications/minisat/minisat: 14.05% (6.2525 => 7.1310, std.dev.: 0.2820) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.95% (0.1749 => 0.1958, std.dev.: 0.0059) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 7.88% (0.4482 => 0.4835, std.dev.: 0.0123) MultiSource/Benchmarks/Bullet/bullet: 7.00% (7.0347 => 7.5269, std.dev.: 0.1429) MultiSource/Benchmarks/Olden/tsp/tsp: 4.84% (1.4934 => 1.5657, std.dev.: 0.0144) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.18% (13.3993 => 13.9588, std.dev.: 0.1455) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.09% (39.0441 => 40.2522, std.dev.: 0.4407) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.66% (0.5294 => 0.5435, std.dev.: 0.0014) MultiSource/Applications/viterbi/viterbi: 1.68% (3.6418 => 3.7030, std.dev.: 0.0109) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.10% (7.4211 => 6.8943, std.dev.: 0.1000) SingleSource/Benchmarks/Linpack/linpack-pc: -4.95% (53.9801 => 51.3080, std.dev.: 0.7755) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.68% (1.9311 => 1.8408, std.dev.: 0.0096) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.18% (2.8129 => 2.7515, std.dev.: 0.0160) SingleSource/Regression/C/uint64_to_float: -2.01% (1.9314 => 1.8926, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/matrix: -1.90% (4.8051 => 4.7136, std.dev.: 0.0297) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.25% (16.0968 => 15.8954, std.dev.: 0.0743) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.55% (1.2173 => 1.2970, std.dev.: 0.1415) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.01% (0.0222 => 0.0242, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.16% (0.0438 => 0.0465, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.55% (0.0336 => 0.0358, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.56% (0.0329 => 0.0344, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.35% (0.0437 => 0.0456, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 3.86% (0.0207 => 0.0215, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: 48.43% (0.0159 => 0.0236, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.01% (0.0249 => 0.0244, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 2.70% (0.1446 => 0.1485, std.dev.: 0.0210) MultiSource/Applications/lemon/lemon: 3.13% (1.1775 => 1.2144, std.dev.: 0.2686) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 13.87% (0.3986 => 0.4539, std.dev.: 0.0667) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.25% (0.1427 => 0.1559, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -12.50% (0.0008 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.98% (0.0653 => 0.0627, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.47% (0.0265 => 0.0224, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 13.18% (0.0531 => 0.0601, std.dev.: 0.0006) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.47% (1.2845 => 1.2906, std.dev.: 0.0345) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.48% (0.0605 => 0.0620, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.67% (0.0364 => 0.0347, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: 4.85% (1.6880 => 1.7699, std.dev.: 0.0220) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.33% (0.0075 => 0.0056, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.22% (33.3564 => 34.4296, std.dev.: 0.0146) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 404.76% (0.0336 => 0.1696, std.dev.: 0.0464) MultiSource/Benchmarks/FreeBench/neural/neural: 111.48% (0.1638 => 0.3464, std.dev.: 0.0317) MultiSource/Benchmarks/McCat/15-trie/trie: 72.85% (0.0593 => 0.1025, std.dev.: 0.0021) SingleSource/Regression/C/sumarray: 62.64% (0.0265 => 0.0431, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 59.28% (0.0776 => 0.1236, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 52.70% (0.9612 => 1.4678, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 51.68% (0.9381 => 1.4229, std.dev.: 0.0465) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 50.48% (0.9120 => 1.3724, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 48.46% (0.9564 => 1.4199, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 48.38% (0.8926 => 1.3244, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 48.28% (0.9403 => 1.3943, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 45.87% (0.9588 => 1.3986, std.dev.: 0.0213) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 45.54% (0.8990 => 1.3084, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 45.23% (1.0052 => 1.4599, std.dev.: 0.0312) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 45.04% (0.9998 => 1.4501, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.98% (0.8893 => 1.2804, std.dev.: 0.0630) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 43.82% (0.8732 => 1.2558, std.dev.: 0.0374) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 43.61% (0.8846 => 1.2704, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 43.25% (0.9422 => 1.3497, std.dev.: 0.0595) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 43.23% (0.9061 => 1.2978, std.dev.: 0.1445) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 42.89% (0.9867 => 1.4099, std.dev.: 0.0149) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 41.91% (0.9091 => 1.2901, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 41.84% (0.8912 => 1.2641, std.dev.: 0.0443) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 41.49% (0.9512 => 1.3459, std.dev.: 0.0758) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 41.18% (0.9788 => 1.3819, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 40.49% (0.8736 => 1.2273, std.dev.: 0.0944) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.42% (0.9855 => 1.3838, std.dev.: 0.1202) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.41% (0.9010 => 1.2651, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 39.82% (1.0017 => 1.4006, std.dev.: 0.0569) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 39.45% (1.0119 => 1.4111, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 38.65% (1.0860 => 1.5057, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 37.73% (0.9507 => 1.3094, std.dev.: 0.0410) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 36.39% (0.1025 => 0.1398, std.dev.: 0.0104) SingleSource/Benchmarks/McGill/exptree: 35.86% (0.0859 => 0.1167, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 35.66% (0.9127 => 1.2382, std.dev.: 0.0251) SingleSource/Benchmarks/Stanford/IntMM: 35.50% (0.0431 => 0.0584, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 34.35% (1.0088 => 1.3553, std.dev.: 0.0554) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 33.80% (0.9993 => 1.3371, std.dev.: 0.1012) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 33.78% (0.9685 => 1.2957, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.16% (0.9488 => 1.2634, std.dev.: 0.0946) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 33.13% (0.9550 => 1.2714, std.dev.: 0.0430) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.87% (0.9405 => 1.2496, std.dev.: 0.0603) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 27.32% (3.6295 => 4.6209, std.dev.: 0.0847) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.39% (1.0986 => 1.3556, std.dev.: 0.0341) MultiSource/Benchmarks/mafft/pairlocalalign: 23.24% (9.5202 => 11.7326, std.dev.: 0.0530) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.72% (0.0669 => 0.0821, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bh/bh: 22.21% (0.3273 => 0.4000, std.dev.: 0.0106) MultiSource/Applications/sgefa/sgefa: 20.82% (0.3598 => 0.4347, std.dev.: 0.0067) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.55% (5.0381 => 5.9726, std.dev.: 0.3139) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.39% (1.2680 => 1.5012, std.dev.: 0.0232) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.35% (23.5861 => 27.2060, std.dev.: 0.0556) SingleSource/Benchmarks/Misc/ReedSolomon: 14.78% (0.2050 => 0.2353, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 13.80% (0.1927 => 0.2193, std.dev.: 0.0081) MultiSource/Benchmarks/Bullet/bullet: 13.19% (33.2440 => 37.6284, std.dev.: 0.7562) SingleSource/Benchmarks/Shootout-C++/matrix: 11.99% (0.2385 => 0.2671, std.dev.: 0.0045) MultiSource/Applications/JM/lencod/lencod: 11.90% (16.7012 => 18.6882, std.dev.: 0.4503) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.15% (0.1955 => 0.2173, std.dev.: 0.0055) SingleSource/Benchmarks/McGill/chomp: 11.10% (0.1793 => 0.1992, std.dev.: 0.0050) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.17% (44.1538 => 48.6436, std.dev.: 1.5335) SingleSource/Benchmarks/Linpack/linpack-pc: 10.13% (0.2566 => 0.2826, std.dev.: 0.0059) MultiSource/Applications/oggenc/oggenc: 5.91% (5.3553 => 5.6720, std.dev.: 0.0755) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.08% (0.3702 => 0.3890, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.99% (0.7693 => 0.8000, std.dev.: 0.0119) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.26% (0.3374 => 0.3484, std.dev.: 0.0010) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107450.00% (0.0008 => 0.8604, std.dev.: 0.0135) SingleSource/Benchmarks/Shootout/ary3: 440.10% (2.2304 => 12.0463, std.dev.: 0.5283) SingleSource/Benchmarks/Shootout/matrix: 358.60% (1.5825 => 7.2574, std.dev.: 0.0338) MultiSource/Applications/sgefa/sgefa: 258.52% (0.3515 => 1.2602, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.88% (4.8185 => 15.8954, std.dev.: 0.0743) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 221.83% (1.1825 => 3.8056, std.dev.: 0.1267) SingleSource/Benchmarks/Shootout-C++/ary2: 204.65% (0.0129 => 0.0393, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 199.12% (0.0228 => 0.0682, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/ary: 139.66% (0.0232 => 0.0556, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/mst/mst: 81.96% (0.1491 => 0.2713, std.dev.: 0.0122) SingleSource/Benchmarks/Shootout-C++/matrix: 62.07% (2.9083 => 4.7136, std.dev.: 0.0297) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.80% (0.2562 => 0.3428, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.81% (3.1254 => 4.1197, std.dev.: 0.0155) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.19% (1.4588 => 1.8408, std.dev.: 0.0096) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.04% (5.6033 => 6.8943, std.dev.: 0.1000) SingleSource/Regression/C/uint64_to_float: 22.92% (1.5397 => 1.8926, std.dev.: 0.0099) SingleSource/Benchmarks/Misc/salsa20: 22.45% (7.4497 => 9.1218, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.32% (4.8112 => 5.7889, std.dev.: 0.0164) MultiSource/Applications/JM/lencod/lencod: 15.84% (6.8159 => 7.8957, std.dev.: 0.1378) MultiSource/Benchmarks/Ptrdist/ft/ft: 15.01% (1.0816 => 1.2439, std.dev.: 0.0517) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.19% (5.1752 => 5.8578, std.dev.: 0.0579) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.05% (5.0033 => 5.6560, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.45% (0.1789 => 0.1958, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.96% (3.6477 => 3.9745, std.dev.: 0.1048) SingleSource/Benchmarks/Misc/ReedSolomon: 8.38% (8.6447 => 9.3688, std.dev.: 0.0682) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.76% (4.7473 => 5.0680, std.dev.: 0.0485) SingleSource/Benchmarks/McGill/chomp: 6.54% (1.0425 => 1.1107, std.dev.: 0.0133) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.01% (0.6211 => 0.6584, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.40% (4.1836 => 4.4096, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.65% (5.0310 => 5.2650, std.dev.: 0.0327) MultiSource/Benchmarks/Olden/tsp/tsp: 4.26% (1.5017 => 1.5657, std.dev.: 0.0144) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.04% (0.5224 => 0.5435, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2159, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.86% (4.7254 => 4.8607, std.dev.: 0.0079) MultiSource/Applications/viterbi/viterbi: 1.74% (3.6397 => 3.7030, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.21% (4.8076 => 4.8657, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (2.5681 => 2.5990, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.54% (0.0727 => 0.0505, std.dev.: 0.0015) SingleSource/Benchmarks/SmallPT/smallpt: -24.74% (0.1888 => 0.1421, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.21% (0.1684 => 0.1411, std.dev.: 0.0046) MultiSource/Applications/spiff/spiff: -9.28% (1.0220 => 0.9272, std.dev.: 0.0237) MultiSource/Applications/treecc/treecc: -8.17% (2.4719 => 2.2699, std.dev.: 0.0603) SingleSource/Benchmarks/Shootout-C++/hash2: -7.50% (0.5134 => 0.4749, std.dev.: 0.0053) MultiSource/Applications/siod/siod: -6.14% (2.6437 => 2.4814, std.dev.: 0.0415) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.42% (0.9124 => 0.8721, std.dev.: 0.0120) MultiSource/Applications/d/make_dparser: -2.31% (3.7840 => 3.6965, std.dev.: 0.0183) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.68% (11.5523 => 3.9652, std.dev.: 0.0633) SingleSource/Benchmarks/Misc/fp-convert: -61.84% (15.6525 => 5.9727, std.dev.: 0.2003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.56% (0.4146 => 0.1801, std.dev.: 0.0065) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.62% (0.4578 => 0.2352, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.71% (11.3868 => 6.4100, std.dev.: 0.0219) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.07% (5.4023 => 3.6160, std.dev.: 0.0207) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.06% (0.4452 => 0.3069, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.07% (5.2605 => 3.8889, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.79% (0.5495 => 0.4078, std.dev.: 0.0172) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.15% (0.5826 => 0.4361, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.01% (4.4467 => 3.3348, std.dev.: 0.0301) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8226, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout/heapsort: -21.33% (4.4739 => 3.5194, std.dev.: 0.2449) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.04% (5.8755 => 4.8156, std.dev.: 0.1123) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -18.01% (0.5897 => 0.4835, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/heapsort: -17.39% (4.2042 => 3.4729, std.dev.: 0.1484) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.63% (7.0016 => 5.8372, std.dev.: 0.1151) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.31% (16.6791 => 13.9588, std.dev.: 0.1455) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.86% (3.1921 => 2.7816, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.75% (5.3626 => 4.6789, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.59% (9.7992 => 8.5655, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.00% (5.7056 => 5.0209, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout/nestedloop: -11.59% (0.2200 => 0.1945, std.dev.: 0.0056) MultiSource/Applications/minisat/minisat: -10.74% (7.9891 => 7.1310, std.dev.: 0.2820) MultiSource/Benchmarks/mafft/pairlocalalign: -8.88% (63.1520 => 57.5427, std.dev.: 0.1763) SingleSource/Benchmarks/Shootout-C++/lists1: -8.03% (0.6628 => 0.6096, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.21% (5.5974 => 5.2496, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.73% (4.5424 => 4.2822, std.dev.: 0.0331) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.29% (3.5127 => 3.3270, std.dev.: 0.0228) SingleSource/Benchmarks/McGill/queens: -5.18% (1.7443 => 1.6539, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash2: -4.91% (3.6768 => 3.4964, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: -3.65% (3.5443 => 3.4151, std.dev.: 0.0442) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.55% (5.8973 => 5.6882, std.dev.: 0.0188) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.54% (3.5691 => 3.4427, std.dev.: 0.0179) MultiSource/Applications/spiff/spiff: -2.45% (2.8571 => 2.7872, std.dev.: 0.0114) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8932, std.dev.: 0.2122) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.65% (8.7327 => 8.5888, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel-2: -1.61% (0.8521 => 0.8384, std.dev.: 0.0041) MultiSource/Benchmarks/BitBench/five11/five11: -1.31% (5.7021 => 5.6274, std.dev.: 0.0178) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7022, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -1.03% (8.7416 => 8.6515, std.dev.: 0.0312) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 7.66% (1.2047 => 1.2970, std.dev.: 0.1415) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.86% (0.0233 => 0.0242, std.dev.: 0.0014) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.10% (0.0451 => 0.0465, std.dev.: 0.0131) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.14% (0.0394 => 0.0358, std.dev.: 0.0099) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 4.88% (0.0328 => 0.0344, std.dev.: 0.0100) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.47% (0.0445 => 0.0456, std.dev.: 0.0110) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0053) SingleSource/UnitTests/Vector/Altivec/test1: 3.96% (0.0227 => 0.0236, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.31% (0.0255 => 0.0244, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -2.94% (0.1530 => 0.1485, std.dev.: 0.0210) MultiSource/Applications/lemon/lemon: -37.05% (1.9293 => 1.2144, std.dev.: 0.2686) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.10% (0.4049 => 0.4539, std.dev.: 0.0667) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.25% (0.1510 => 0.1559, std.dev.: 0.0196) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -22.22% (0.0009 => 0.0007, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -35.89% (0.0978 => 0.0627, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.84% (0.0276 => 0.0224, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.86% (0.0590 => 0.0601, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.10% (1.1617 => 1.2906, std.dev.: 0.0345) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.64% (0.0610 => 0.0620, std.dev.: 0.0094) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.48% (0.0268 => 0.0347, std.dev.: 0.0092) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.99% (0.7437 => 1.7699, std.dev.: 0.0220) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -39.13% (0.0092 => 0.0056, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.44% (12.7781 => 34.4296, std.dev.: 0.0146) Report Time: 0.88s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 14:04:21 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 16:04:21 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130130220421.E92A92A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8121?compare_to=8118&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8121, Order: 173963, Start Time: 2013-01-30 20:30:44, End Time: 2013-01-30 22:04:44 To: 8118, Order: 173950, Start Time: 2013-01-30 18:32:40, End Time: 2013-01-30 20:06:56 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (117 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.60% (0.0717 => 0.1216, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.46% (0.0514 => 0.0871, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 65.81% (0.0974 => 0.1615, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 45.80% (0.1500 => 0.2187, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.87% (0.6395 => 0.8817, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.32% (0.0418 => 0.0574, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.08% (0.6395 => 0.8702, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.79% (0.5688 => 0.7553, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.44% (0.6260 => 0.8291, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.37% (0.5456 => 0.7222, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.00% (0.5575 => 0.7359, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.94% (0.5567 => 0.7345, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.92% (0.5849 => 0.7716, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.83% (0.6230 => 0.8213, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.46% (0.5581 => 0.7337, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.27% (0.5802 => 0.7616, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.82% (0.5941 => 0.7772, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.53% (0.5705 => 0.7447, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.38% (0.5859 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.15% (0.5857 => 0.7623, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.14% (0.5570 => 0.7249, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.03% (0.6033 => 0.7845, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.01% (0.5569 => 0.7240, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.96% (0.5478 => 0.7119, std.dev.: 0.0058) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.63% (1.6474 => 2.1356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.58% (0.5591 => 0.7245, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.47% (0.6440 => 0.8338, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.08% (0.5925 => 0.7648, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.87% (0.6189 => 0.7976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.62% (0.5863 => 0.7541, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.57% (0.6676 => 0.8583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.22% (0.6304 => 0.8083, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.91% (0.6052 => 0.7741, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.82% (0.6446 => 0.8239, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.14% (0.6194 => 0.7875, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.02% (0.6681 => 0.8486, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.97% (0.6660 => 0.8456, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.65% (0.6297 => 0.7975, std.dev.: 0.0074) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.36% (0.6667 => 0.8358, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.18% (0.0699 => 0.0868, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.95% (0.7524 => 0.9326, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.19% (0.7339 => 0.9041, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.66% (0.0790 => 0.0969, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.39% (2.2587 => 2.7644, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.22% (0.0622 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.04% (0.0621 => 0.0733, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.17% (0.0833 => 0.0976, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 15.94% (0.3357 => 0.3892, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.08% (1.1450 => 1.3177, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.47% (0.1982 => 0.2249, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (4.5069 => 5.0818, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.14% (1.6364 => 1.8350, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.00% (0.4916 => 0.5506, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.79% (3.5339 => 3.9507, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/05-eks/eks: 11.65% (0.4515 => 0.5041, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.36% (0.2385 => 0.2632, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 9.78% (9.2283 => 10.1311, std.dev.: 0.0147) SingleSource/Benchmarks/Shootout-C++/hash: 9.20% (0.4524 => 0.4940, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.78% (0.1230 => 0.1338, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.67% (0.1731 => 0.1881, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.56% (0.5329 => 0.5785, std.dev.: 0.0006) MultiSource/Applications/Burg/burg: 8.55% (1.2515 => 1.3585, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.22% (0.7021 => 0.7598, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.21% (0.4861 => 0.5260, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.15% (0.2001 => 0.2164, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.69% (1.2784 => 1.3767, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.27% (1.4642 => 1.5706, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/bigfib: 6.86% (0.6750 => 0.7213, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.48% (0.3255 => 0.3466, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 5.69% (0.1879 => 0.1986, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.54% (5.4682 => 5.7712, std.dev.: 0.0137) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.03% (0.3319 => 0.3486, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.19% (22.4056 => 23.3435, std.dev.: 0.0064) MultiSource/Applications/oggenc/oggenc: 3.92% (5.0226 => 5.2196, std.dev.: 0.0121) SingleSource/Benchmarks/Shootout-C++/ary3: 3.77% (0.3446 => 0.3576, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 3.51% (0.3394 => 0.3513, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.28% (0.7447 => 0.7691, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.20% (0.9557 => 0.9863, std.dev.: 0.0001) MultiSource/Applications/SPASS/SPASS: 3.12% (15.5079 => 15.9910, std.dev.: 0.0160) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4427 => 0.4562, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 3.03% (1.3864 => 1.4284, std.dev.: 0.0016) MultiSource/Applications/spiff/spiff: 3.01% (0.8418 => 0.8671, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.09% (0.5168 => 0.5276, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.98% (1.3722 => 1.3994, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.23% (34.0927 => 34.5134, std.dev.: 0.0092) MultiSource/Applications/kimwitu++/kc: 1.17% (18.2933 => 18.5079, std.dev.: 0.0174) MultiSource/Applications/d/make_dparser: 1.07% (3.5154 => 3.5530, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.01% (1.2300 => 1.2424, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.92% (31.3723 => 55.8168, std.dev.: 0.0110) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.08% (0.9531 => 1.0301, std.dev.: 0.0033) SingleSource/Regression/C/uint64_to_float: 7.41% (0.5692 => 0.6114, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.09% (1.2783 => 1.3689, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1481, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.86% (54.5751 => 56.6820, std.dev.: 0.0614) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.61% (2.0478 => 2.1012, std.dev.: 0.0083) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3039, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.66% (18.2231 => 18.5260, std.dev.: 0.0073) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9563, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.41% (4.5320 => 4.5958, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.35% (5.1955 => 5.2656, std.dev.: 0.0031) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3489 => 10.4525, std.dev.: 0.0122) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: -4.14% (0.3812 => 0.3654, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.14% (0.7198 => 0.6900, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.98% (0.3848 => 0.3695, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.94% (0.4033 => 0.3874, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3896 => 0.3743, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/exceptions-2: -3.89% (0.3831 => 0.3682, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.84% (0.3880 => 0.3731, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.77% (0.3821 => 0.3677, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.71% (0.4176 => 0.4021, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.70% (0.3891 => 0.3747, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.65% (0.9852 => 0.9492, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.55% (2.4924 => 2.4040, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.48% (0.3884 => 0.3749, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.21% (0.3837 => 0.3714, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/property: -3.19% (0.4199 => 0.4065, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4280 => 0.4158, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -2.82% (0.6347 => 0.6168, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.82% (0.9542 => 0.9273, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.77% (20.7746 => 20.1993, std.dev.: 0.0100) SingleSource/UnitTests/ObjC++/property-reference-object: -2.45% (0.6441 => 0.6283, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.44% (0.6484 => 0.6326, std.dev.: 0.0020) MultiSource/Applications/hexxagon/hexxagon: -2.37% (1.3148 => 1.2836, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.23% (2.1713 => 2.1228, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -1.97% (0.7779 => 0.7626, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.95% (14.2083 => 13.9317, std.dev.: 0.0136) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.64% (6.7716 => 6.6607, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.28% (1.0544 => 1.0409, std.dev.: 0.0021) MultiSource/Applications/JM/lencod/lencod: -1.26% (16.1920 => 15.9879, std.dev.: 0.0148) MultiSource/Applications/sqlite3/sqlite3: -1.22% (17.1032 => 16.8944, std.dev.: 0.0198) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.30% (1.8100 => 0.6823, std.dev.: 0.0060) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/lowercase: -33.92% (8.0445 => 5.3158, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2498, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.95% (1.3643 => 1.0239, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/methcall: -23.44% (7.5137 => 5.7526, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4498, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2051, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1737, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1260, std.dev.: 0.0037) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3563, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.65% (0.5142 => 0.4646, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -9.02% (1.2842 => 1.1684, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8205, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0032) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.98% (2.2633 => 2.1732, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.86% (1.3096 => 1.2722, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.66% (7.9763 => 7.7644, std.dev.: 0.0157) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -1.85% (7.3040 => 7.1688, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7081, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.41% (1.6307 => 1.6077, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.35% (1.6086 => 1.5869, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.23% (3.7092 => 3.6635, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.09% (1.6219 => 1.6043, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.07s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 14:06:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 16:06:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130130220652.521042A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8122?compare_to=8114&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8122, Order: 173943, Start Time: 2013-01-30 18:27:09, End Time: 2013-01-30 22:07:14 To: 8114, Order: 173925, Start Time: 2013-01-30 13:43:51, End Time: 2013-01-30 17:19:57 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 5 (189 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (747 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.05% (0.7541 => 0.7922, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.57% (0.6406 => 0.6635, std.dev.: 0.0036) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.16% (71.9346 => 74.9272, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.32% (2.0732 => 2.1213, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 1.40% (54.1581 => 54.9159, std.dev.: 0.0695) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 51.36% (0.0625 => 0.0946, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 44.35% (0.0239 => 0.0345, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.59% (0.1063 => 0.1452, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 35.79% (0.0475 => 0.0645, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/dbms/dbms: 34.27% (0.5900 => 0.7922, std.dev.: 0.0066) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.86% (0.4994 => 0.6635, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 30.38% (0.1106 => 0.1442, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 29.97% (0.0714 => 0.0928, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.44% (0.2969 => 0.3843, std.dev.: 0.0023) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.25% (0.0547 => 0.0707, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.00% (0.4139 => 0.5298, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 27.88% (0.0452 => 0.0578, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.46% (0.1107 => 0.1411, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.14% (0.5000 => 0.6357, std.dev.: 0.0030) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.11% (0.4253 => 0.5406, std.dev.: 0.0024) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.71% (0.0584 => 0.0740, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.51% (0.0415 => 0.0525, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 26.22% (0.1003 => 0.1266, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/em3d/em3d: 26.16% (0.0948 => 0.1196, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 25.92% (1.5932 => 2.0061, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/tsp/tsp: 25.88% (0.0599 => 0.0754, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 25.66% (0.1021 => 0.1283, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.62% (0.1620 => 0.2035, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.97% (0.0897 => 0.1121, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.85% (0.1549 => 0.1934, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.49% (0.0584 => 0.0727, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 24.33% (0.0633 => 0.0787, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.99% (0.0642 => 0.0796, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.75% (0.1103 => 0.1365, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.69% (0.1604 => 0.1984, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 23.51% (0.0604 => 0.0746, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 23.48% (0.0822 => 0.1015, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.43% (0.0495 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 23.41% (0.1619 => 0.1998, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 23.14% (0.0821 => 0.1011, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 23.11% (0.0541 => 0.0666, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.06% (0.3903 => 0.4803, std.dev.: 0.0017) MultiSource/Applications/spiff/spiff: 22.78% (0.4029 => 0.4947, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 22.39% (0.1505 => 0.1842, std.dev.: 0.0003) MultiSource/Applications/viterbi/viterbi: 22.39% (0.0947 => 0.1159, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 22.17% (0.1218 => 0.1488, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.15% (0.1088 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.02% (0.2866 => 0.3497, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: 21.66% (0.0808 => 0.0983, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.55% (0.1462 => 0.1777, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.54% (0.3890 => 0.4728, std.dev.: 0.0022) MultiSource/Applications/aha/aha: 21.41% (0.0481 => 0.0584, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 21.35% (0.0698 => 0.0847, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.21% (1.3152 => 1.5942, std.dev.: 0.0121) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.15% (0.2014 => 0.2440, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.02% (0.2736 => 0.3311, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.82% (0.3271 => 0.3952, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.45% (0.0572 => 0.0689, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 20.23% (1.8794 => 2.2596, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 20.16% (0.4658 => 0.5597, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.90% (0.0573 => 0.0687, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.88% (0.0513 => 0.0615, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 19.82% (0.5546 => 0.6645, std.dev.: 0.0051) SingleSource/UnitTests/ObjC++/Hello: 19.81% (0.5826 => 0.6980, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.61% (0.1968 => 0.2354, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.47% (3.5627 => 4.2564, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/bh/bh: 19.47% (0.1284 => 0.1534, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.42% (0.4361 => 0.5208, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.38% (0.5026 => 0.6000, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/espresso/espresso: 19.32% (1.6211 => 1.9343, std.dev.: 0.0075) SingleSource/UnitTests/ObjC++/property-reference-object: 19.31% (0.5889 => 0.7026, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.14% (0.1160 => 0.1382, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 19.07% (0.0582 => 0.0693, std.dev.: 0.0036) MultiSource/Applications/hbd/hbd: 18.92% (0.9697 => 1.1532, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.85% (0.2875 => 0.3417, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.81% (0.1090 => 0.1295, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 18.76% (0.7171 => 0.8516, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 18.65% (0.1421 => 0.1686, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 18.56% (0.2823 => 0.3347, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.56% (1.9966 => 2.3671, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/strcat: 18.44% (0.2750 => 0.3257, std.dev.: 0.0085) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.40% (0.3930 => 0.4653, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 18.35% (0.2714 => 0.3212, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: 18.28% (0.9909 => 1.1720, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/fibo: 18.28% (0.2725 => 0.3223, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 18.27% (0.2813 => 0.3327, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.23% (0.2792 => 0.3301, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 18.23% (0.2803 => 0.3314) SingleSource/Benchmarks/Shootout-C++/except: 18.21% (0.2811 => 0.3323, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.15% (0.2738 => 0.3235, std.dev.: 0.0013) MultiSource/Applications/d/make_dparser: 18.10% (1.0781 => 1.2732, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.07% (0.2729 => 0.3222, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.04% (0.3060 => 0.3612, std.dev.: 0.0004) MultiSource/Applications/ClamAV/clamscan: 17.99% (4.2109 => 4.9685, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/matrix: 17.99% (0.2780 => 0.3280, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.97% (0.2911 => 0.3434, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.96% (2.0673 => 2.4385, std.dev.: 0.0072) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.89% (1.9694 => 2.3218, std.dev.: 0.0104) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.87% (0.3195 => 0.3766, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 17.81% (0.3004 => 0.3539, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 17.73% (0.2566 => 0.3021, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.68% (0.3625 => 0.4266, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary3: 17.66% (0.3267 => 0.3844, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: 17.64% (0.3096 => 0.3642, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.61% (2.7292 => 3.2099, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 17.56% (0.3258 => 0.3830, std.dev.: 0.0012) MultiSource/Applications/lua/lua: 17.35% (1.4269 => 1.6745, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/ary2: 17.18% (0.3317 => 0.3887, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.16% (0.3362 => 0.3939, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 17.12% (0.3446 => 0.4036, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/exceptions-3: 17.08% (0.3460 => 0.4051, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/exceptions-4: 17.06% (0.3465 => 0.4056, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.03% (0.3488 => 0.4082, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 17.02% (0.3496 => 0.4091, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/sieve: 17.02% (0.3726 => 0.4360, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 17.01% (0.3469 => 0.4059, std.dev.: 0.0002) MultiSource/Benchmarks/Bullet/bullet: 16.98% (23.5202 => 27.5146, std.dev.: 0.0149) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.97% (0.3124 => 0.3654, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 16.88% (0.3442 => 0.4023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 16.88% (0.3348 => 0.3913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 16.77% (0.3477 => 0.4060, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.76% (0.3282 => 0.3832, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: 16.63% (0.3650 => 0.4257, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.49% (4.4195 => 5.1481, std.dev.: 0.0195) SingleSource/Benchmarks/Shootout-C++/moments: 16.45% (0.3678 => 0.4283, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 16.44% (0.3643 => 0.4242, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 16.43% (0.4146 => 0.4827, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/parameter-passing: 16.38% (0.3724 => 0.4334, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.35% (0.3981 => 0.4632, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hash2: 16.35% (0.4251 => 0.4946, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.26% (0.3690 => 0.4290, std.dev.: 0.0021) MultiSource/Applications/treecc/treecc: 16.00% (0.7875 => 0.9135, std.dev.: 0.0044) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.84% (0.3845 => 0.4454, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: 15.66% (0.5012 => 0.5797, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.45% (0.0673 => 0.0777, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 15.27% (5.5417 => 6.3880, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C/football/football: 15.18% (0.2075 => 0.2390, std.dev.: 0.0013) MultiSource/Applications/JM/ldecod/ldecod: 15.10% (2.1653 => 2.4923, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.89% (0.6435 => 0.7393, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 14.88% (4.6177 => 5.3046, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.79% (0.1028 => 0.1180, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 14.75% (0.2691 => 0.3088, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 14.46% (2.1013 => 2.4052, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 14.38% (0.0758 => 0.0867, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.07% (0.2737 => 0.3122, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.02% (0.2068 => 0.2358, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.01% (0.5361 => 0.6112, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 13.64% (0.6634 => 0.7539, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.33% (0.2040 => 0.2312, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.31% (0.0804 => 0.0911) MultiSource/Applications/lambda-0_1_3/lambda: 13.18% (0.3498 => 0.3959, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.07% (11.6398 => 13.1606, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.04% (0.3084 => 0.3486, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.65% (0.2103 => 0.2369, std.dev.: 0.0008) MultiSource/Applications/minisat/minisat: 12.59% (0.3336 => 0.3756, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.38% (0.7426 => 0.8345, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 12.21% (0.4847 => 0.5439, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 11.64% (0.1383 => 0.1544, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 11.17% (0.2391 => 0.2658, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.74% (4.6926 => 5.1968, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 10.72% (2.0346 => 2.2528, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.10% (0.5584 => 0.6092, std.dev.: 0.0028) MultiSource/Applications/kimwitu++/kc: 8.65% (11.9555 => 12.9899, std.dev.: 0.0104) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.38% (0.3792 => 0.4072, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.85% (29.0505 => 181.5209, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0296) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 11.28% (0.2802 => 0.3118, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.48% (0.3693 => 0.4080, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.54% (3.3903 => 3.6120, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.15% (12.0509 => 12.6714, std.dev.: 0.0065) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2364, std.dev.: 0.0038) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6905, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/flops-2: 4.69% (1.8057 => 1.8903, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5016, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/health/health: 2.98% (0.6276 => 0.6463, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1947, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.89% (2.0820 => 2.1213, std.dev.: 0.0084) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3149, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2900, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: 1.23% (4.0317 => 4.0813, std.dev.: 0.0022) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.08% (3.1722 => 3.2066, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5935, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.05% (1.2451 => 1.2582, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4785, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.10% (2.4764 => 2.4243, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.91% (25.4195 => 16.5444, std.dev.: 0.0351) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.14% (17.2379 => 14.2827, std.dev.: 0.0113) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -10.74% (0.2402 => 0.2144, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9745, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8039, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9579, std.dev.: 0.0008) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0003) SingleSource/Benchmarks/Dhrystone/dry: -4.54% (14.0481 => 13.4106, std.dev.: 0.2025) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.77% (41.7953 => 40.2205, std.dev.: 0.0176) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -3.68% (11.2080 => 10.7957, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.08% (0.6293 => 0.6099, std.dev.: 0.0065) MultiSource/Applications/siod/siod: -3.00% (6.9842 => 6.7744, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.19% (197.4719 => 193.1422, std.dev.: 0.0745) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.71% (10.7630 => 10.5785, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/bh/bh: -1.48% (5.5810 => 5.4986, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7154, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.22% (105.3826 => 104.0962, std.dev.: 0.0845) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0444, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 14:54:02 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 16:54:02 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130130225402.238C62A6C06D@llvm.org> http://llvm.org/perf/db_default/v4/nts/8123?compare_to=8119&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8123, Order: 173963, Start Time: 2013-01-30 20:42:06, End Time: 2013-01-30 22:54:23 To: 8119, Order: 173943, Start Time: 2013-01-30 17:58:42, End Time: 2013-01-30 20:11:12 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (228 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (643 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.87% (11.1493 => 11.3579, std.dev.: 0.0081) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.12% (4.5224 => 4.4718, std.dev.: 0.0061) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.23% (1.3070 => 1.2909, std.dev.: 0.0041) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1327 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.56% (0.0703 => 0.0678, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/power/power: -0.01% (499.8608 => 499.8351, std.dev.: 0.0081) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44223.41% (1.1277 => 499.8351, std.dev.: 0.0081) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.79% (0.5229 => 1.7140, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 26.93% (14.9895 => 19.0264, std.dev.: 0.0020) MultiSource/Applications/kimwitu++/kc: 47.99% (14.1553 => 20.9490, std.dev.: 0.0095) MultiSource/Benchmarks/MallocBench/gs/gs: 21.20% (4.1105 => 4.9818, std.dev.: 0.0185) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.87% (1.1048 => 1.7994, std.dev.: 0.0040) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.09% (7.1582 => 39.3768, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.43% (3.4629 => 6.6289, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.25% (0.6222 => 1.1464, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10238.19% (0.0720 => 7.4435, std.dev.: 0.0038) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 11104100.00% (0.0001 => 11.1042, std.dev.: 0.0178) MultiSource/Applications/kimwitu++/kc: 51500.00% (0.0001 => 0.0516, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575400.00% (0.0001 => 0.5755, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493800.00% (0.0001 => 5.4939, std.dev.: 0.0102) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.86% (1.1194 => 10.2298, std.dev.: 0.0176) MultiSource/Applications/ClamAV/clamscan: 149.66% (22.1758 => 55.3651, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.88% (0.0929 => 0.1894, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 80.93% (0.1463 => 0.2647, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.26% (0.0730 => 0.1221, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 67.26% (0.0394 => 0.0659) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.47% (1.5859 => 2.4973, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.92% (2.9384 => 4.6109, std.dev.: 0.0130) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.09% (7.0540 => 10.9404, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/distray/distray: 53.60% (0.1056 => 0.1622, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.89% (0.0439 => 0.0658, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.67% (8.1363 => 12.1776, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.91% (2.2024 => 3.2356, std.dev.: 0.0021) MultiSource/Applications/sgefa/sgefa: 46.06% (0.3109 => 0.4541, std.dev.: 0.0010) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0022) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.87% (0.1062 => 0.1496, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 40.71% (21.9371 => 30.8683, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 39.03% (1.5415 => 2.1432, std.dev.: 0.0043) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.21% (4.2646 => 5.8942, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.18% (0.4615 => 0.6331, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 36.73% (0.0814 => 0.1113, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.57% (0.5105 => 0.6972, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.58% (0.2271 => 0.3079, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.22% (0.6675 => 0.8959, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 34.01% (1.1642 => 1.5602, std.dev.: 0.0069) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.77% (0.1892 => 0.2531, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/05-eks/eks: 33.57% (0.4299 => 0.5742, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 33.26% (0.0457 => 0.0609, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 32.99% (0.1655 => 0.2201, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.72% (0.1143 => 0.1517, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 32.70% (0.0636 => 0.0844, std.dev.: 0.0001) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.36% (0.0479 => 0.0634, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.74% (0.1695 => 0.2233, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.11% (0.1125 => 0.1475, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 30.89% (9.4845 => 12.4139, std.dev.: 0.0103) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.40% (3.8922 => 5.0756, std.dev.: 0.0031) MultiSource/Applications/viterbi/viterbi: 29.77% (0.1555 => 0.2018, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 29.63% (0.0793 => 0.1028, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 29.33% (1.0722 => 1.3867, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 29.07% (0.4289 => 0.5536, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/08-main/main: 28.86% (0.2554 => 0.3291, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.50% (1.4186 => 1.8229, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 28.07% (0.4620 => 0.5917, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 27.87% (0.7115 => 0.9098, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.70% (0.0408 => 0.0521, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.60% (0.1337 => 0.1706, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.53% (0.0730 => 0.0931, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.27% (0.3121 => 0.3972, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/tsp/tsp: 27.15% (0.1175 => 0.1494, std.dev.: 0.0040) MultiSource/Benchmarks/Fhourstones/fhourstones: 27.01% (0.1566 => 0.1989, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.93% (0.0672 => 0.0853) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.81% (0.1906 => 0.2417, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 26.63% (0.6456 => 0.8175, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.41% (0.5020 => 0.6346, std.dev.: 0.0029) MultiSource/Applications/aha/aha: 26.24% (0.1151 => 0.1453, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 25.91% (0.7835 => 0.9865, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout/hash: 25.77% (0.0485 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 25.62% (0.0527 => 0.0662) SingleSource/Benchmarks/Misc/whetstone: 25.61% (0.0660 => 0.0829, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/lists: 25.56% (0.0626 => 0.0786, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.43% (1.3050 => 1.6369, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.40% (0.1236 => 0.1550, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (0.1032 => 0.1291, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.52% (0.2700 => 0.3362, std.dev.: 0.0005) MultiSource/Benchmarks/nbench/nbench: 24.43% (1.1840 => 1.4733, std.dev.: 0.0049) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.30% (0.0675 => 0.0839, std.dev.: 0.0011) MultiSource/Applications/d/make_dparser: 24.22% (3.3354 => 4.1433, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/messages-2: 23.87% (0.0662 => 0.0820, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.80% (5.7591 => 7.1297, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.71% (0.1029 => 0.1273, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.65% (0.5860 => 0.7246, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 23.56% (0.1163 => 0.1437, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.56% (0.1940 => 0.2397, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.56% (0.3307 => 0.4086, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.50% (0.0953 => 0.1177, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/em3d/em3d: 23.30% (0.1695 => 0.2090, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 23.18% (0.1510 => 0.1860, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.92% (0.0842 => 0.1035, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ReedSolomon: 22.74% (0.2049 => 0.2515, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.66% (0.3098 => 0.3800, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 22.64% (0.0614 => 0.0753, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.62% (4.9449 => 6.0634, std.dev.: 0.0105) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.35% (0.0886 => 0.1084, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 22.32% (0.8921 => 1.0912, std.dev.: 0.0010) MultiSource/Applications/treecc/treecc: 22.25% (2.0273 => 2.4783, std.dev.: 0.0018) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0567 => 0.0693, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.22% (0.1584 => 0.1936, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.87% (5.0018 => 6.0955, std.dev.: 0.0046) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.78% (0.2107 => 0.2566, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.78% (0.8172 => 0.9952, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.76% (1.1861 => 1.4442, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.45% (0.9765 => 1.1860, std.dev.: 0.0032) SingleSource/Benchmarks/Stanford/Towers: 21.44% (0.0471 => 0.0572, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.36% (0.2758 => 0.3347, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/18-imp/imp: 21.33% (0.3423 => 0.4153, std.dev.: 0.0013) MultiSource/Applications/lua/lua: 21.30% (3.8723 => 4.6971, std.dev.: 0.0048) SingleSource/UnitTests/SignlessTypes/rem: 21.24% (0.1144 => 0.1387, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.15% (0.5569 => 0.6747, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.04% (0.6450 => 0.7807, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.79% (0.0933 => 0.1127, std.dev.: 0.0006) MultiSource/Applications/lambda-0_1_3/lambda: 20.79% (0.7433 => 0.8978, std.dev.: 0.0164) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.69% (0.0759 => 0.0916, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 20.58% (0.1268 => 0.1529, std.dev.: 0.0008) MultiSource/Applications/siod/siod: 20.55% (2.2969 => 2.7689, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.26% (0.0770 => 0.0926, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.23% (0.1117 => 0.1343, std.dev.: 0.0025) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.06% (0.0648 => 0.0778, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.03% (0.4203 => 0.5045, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.48% (0.8101 => 0.9679, std.dev.: 0.0047) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.30% (0.3441 => 0.4105, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.21% (0.5981 => 0.7130, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.21% (0.2603 => 0.3103, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 18.94% (0.0834 => 0.0992, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.74% (0.2065 => 0.2452, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary3: 18.64% (0.3283 => 0.3895, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.58% (0.1044 => 0.1238, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 18.58% (0.0818 => 0.0970, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 18.04% (0.3232 => 0.3815, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.3180 => 0.3744, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.71% (0.8067 => 0.9496, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.19% (0.0704 => 0.0825) MultiSource/Benchmarks/sim/sim: 17.18% (0.3387 => 0.3969, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.93% (0.3379 => 0.3951, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.71% (0.3865 => 0.4511, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 16.47% (0.0838 => 0.0976, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.22% (0.4636 => 0.5388, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 15.97% (17.1811 => 19.9248, std.dev.: 0.0032) SingleSource/Regression/C++/ofstream_ctor: 15.73% (0.2905 => 0.3362, std.dev.: 0.0051) MultiSource/Applications/hbd/hbd: 15.22% (1.5603 => 1.7977, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/moments: 15.09% (0.4048 => 0.4659, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.92% (0.4103 => 0.4715, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 14.73% (0.3422 => 0.3926, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/lists1: 14.63% (0.3684 => 0.4223, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.52% (0.3603 => 0.4126, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/bh/bh: 13.84% (0.3092 => 0.3520, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.80% (0.3427 => 0.3900, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.75% (0.4064 => 0.4623, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.71% (14.3668 => 16.3367, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.38% (0.1114 => 0.1263, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.29% (0.2430 => 0.2753, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/oourafft: 13.28% (0.3282 => 0.3718, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.96% (0.3826 => 0.4322, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 12.68% (0.3927 => 0.4425, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 11.68% (0.3828 => 0.4275, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/strcat: 11.59% (0.2831 => 0.3159, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/except: 11.25% (0.2871 => 0.3194, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.12% (0.3543 => 0.3937, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.12% (0.3561 => 0.3957, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.09% (0.3543 => 0.3936, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.09% (0.3516 => 0.3906, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.85% (2.0665 => 2.2907, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.74% (0.2756 => 0.3052, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 10.66% (1.2842 => 1.4211, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.62% (0.3935 => 0.4353, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 10.57% (0.2877 => 0.3181, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.52% (0.3650 => 0.4034, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.49% (0.2793 => 0.3086, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 10.39% (0.2725 => 0.3008, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.34% (0.3162 => 0.3489, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2872 => 0.3168, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 10.29% (0.3052 => 0.3366, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.27% (0.2891 => 0.3188, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 10.24% (0.2714 => 0.2992, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1625 => 0.1789, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 9.92% (0.2802 => 0.3080, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: 9.81% (63.2438 => 69.4475, std.dev.: 0.0137) MultiSource/Benchmarks/PAQ8p/paq8p: 9.56% (10.3673 => 11.3579, std.dev.: 0.0081) SingleSource/UnitTests/ObjC++/property-reference-object: 9.42% (0.6030 => 0.6598, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.32% (0.1330 => 0.1454, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.12% (0.3136 => 0.3422, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference: 8.65% (0.7326 => 0.7960, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.63% (0.4879 => 0.5300, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 8.29% (0.5925 => 0.6416, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.97% (2.2022 => 2.3778, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/objinst: 5.30% (0.3131 => 0.3297, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.31% (7.9617 => 8.3049, std.dev.: 0.0061) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.75% (0.3817 => 0.3960, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.53% (5.3999 => 13.3122, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4742, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.03% (1.1145 => 1.2931, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6970, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 13.04% (0.5413 => 0.6119, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.16% (1.1396 => 1.2440, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.95% (11.6436 => 12.4523, std.dev.: 0.1920) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.29% (4.2280 => 4.4515, std.dev.: 0.0136) SingleSource/Benchmarks/Shootout-C++/hash2: 4.94% (3.1578 => 3.3138, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.59% (0.3316 => 0.3435, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.50% (2.0360 => 2.1072, std.dev.: 0.0097) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.59% (8.6802 => 8.9047, std.dev.: 0.0064) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (3.6395 => 3.7207, std.dev.: 0.0096) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.79% (9.1159 => 9.2793, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.77% (1.7254 => 1.7559, std.dev.: 0.0006) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3124, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1472, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.66% (5.2763 => 1.1787, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -75.09% (0.8651 => 0.2155, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -41.92% (0.1622 => 0.0942) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -17.08% (5.3855 => 4.4659, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.46% (5.3526 => 4.4718, std.dev.: 0.0061) MultiSource/Applications/JM/ldecod/ldecod: -11.58% (10.4361 => 9.2277, std.dev.: 0.0115) SingleSource/UnitTests/Vector/constpool: -7.60% (54.1659 => 50.0517, std.dev.: 0.0484) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.99% (1.7609 => 1.6379, std.dev.: 0.0016) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.22% (1.9577 => 0.6614, std.dev.: 0.0124) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3081, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel-2: -33.60% (1.5373 => 1.0208, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7645, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4294, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1355, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0049, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3453 => 2.5894, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -15.88% (1.6925 => 1.4237, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.87% (0.9540 => 0.8408, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4951, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.91% (1.8329 => 1.7062, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5972, std.dev.: 0.0253) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.69% (1.2373 => 1.1669, std.dev.: 0.0022) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5865, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.48% (8.1563 => 7.7095, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -4.73% (10.2830 => 9.7968, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0015) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1554, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.67% (3.6994 => 3.6377, std.dev.: 0.0094) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.52% (3.7221 => 3.6656, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: -1.13% (6.2999 => 6.2284, std.dev.: 0.0052) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.04% (1.3045 => 1.2909, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8583, std.dev.: 0.0074) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0022) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 16:02:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 18:02:04 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131000204.952E92A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8124?compare_to=8121&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8124, Order: 173979, Start Time: 2013-01-30 22:28:22, End Time: 2013-01-31 00:02:27 To: 8121, Order: 173963, Start Time: 2013-01-30 20:30:44, End Time: 2013-01-30 22:04:44 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (118 on baseline) Performance Improvements: 0 (90 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0035) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.14% (0.1132 => 0.1609, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.12% (0.6395 => 0.8833, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.42% (0.6395 => 0.8724, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.79% (0.5688 => 0.7553, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.76% (0.5805 => 0.7707, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.72% (0.5456 => 0.7241, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.64% (0.6260 => 0.8303, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.23% (0.5849 => 0.7734, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.20% (0.5575 => 0.7370, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.14% (0.5567 => 0.7356, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.97% (0.5581 => 0.7365, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.85% (0.6230 => 0.8214, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.20% (0.5802 => 0.7612, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.85% (0.5941 => 0.7774, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.62% (0.5705 => 0.7452, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.33% (0.5569 => 0.7258, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.31% (0.5857 => 0.7632, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.31% (0.5570 => 0.7258, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.30% (0.5478 => 0.7138, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.24% (0.5859 => 0.7631, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.15% (0.6033 => 0.7852, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.87% (0.5591 => 0.7261, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.66% (1.6474 => 2.1360, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.23% (0.5925 => 0.7657, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.05% (0.6189 => 0.7987, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.54% (0.6676 => 0.8581, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.42% (0.5863 => 0.7529, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.38% (0.6304 => 0.8093, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.12% (0.6052 => 0.7754, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.88% (0.6446 => 0.8243, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.51% (0.6194 => 0.7898, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.45% (0.6681 => 0.8515, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.88% (0.6660 => 0.8450, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.82% (0.6297 => 0.7986, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.27% (0.6667 => 0.8352, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.46% (0.0699 => 0.0870, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.12% (0.7524 => 0.9339, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.31% (0.7339 => 0.9050, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.78% (0.0790 => 0.0970, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.46% (2.2587 => 2.7660, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.50% (0.0693 => 0.0842, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.26% (0.3357 => 0.3903, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785) MultiSource/Applications/lemon/lemon: 15.39% (1.1450 => 1.3212, std.dev.: 0.0046) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.62% (0.1081 => 0.1239, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.67% (0.1982 => 0.2253, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.76% (4.5069 => 5.0821, std.dev.: 0.0086) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.34% (1.6364 => 1.8383, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.29% (0.4916 => 0.5520, std.dev.: 0.0028) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.95% (3.5339 => 3.9563, std.dev.: 0.0136) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.03% (0.2385 => 0.2648, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 10.05% (9.2283 => 10.1562, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4524 => 0.4926, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 8.69% (1.2515 => 1.3603, std.dev.: 0.0066) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.67% (0.1731 => 0.1881, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.60% (0.2001 => 0.2173, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.56% (0.5329 => 0.5785, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.35% (0.7021 => 0.7607, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout-C++/hash2: 8.19% (0.4861 => 0.5259, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.96% (1.2784 => 1.3802, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.43% (1.4642 => 1.5730, std.dev.: 0.0033) SingleSource/Benchmarks/Misc-C++/bigfib: 6.89% (0.6750 => 0.7215, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.73% (0.3255 => 0.3474, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.85% (0.1879 => 0.1989, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.50% (5.4682 => 5.7692, std.dev.: 0.0054) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.09% (0.3319 => 0.3488, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 4.09% (0.3446 => 0.3587, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 4.03% (5.0226 => 5.2251, std.dev.: 0.0062) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.93% (22.4056 => 23.2854, std.dev.: 0.0199) SingleSource/Benchmarks/Shootout-C++/ary: 3.92% (0.3394 => 0.3527) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.41% (0.9557 => 0.9883, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 3.34% (0.7447 => 0.7696, std.dev.: 0.0012) MultiSource/Applications/spiff/spiff: 3.28% (0.8418 => 0.8694, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.27% (1.3864 => 1.4317, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.23% (0.4427 => 0.4570, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.16% (15.5079 => 15.9979, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.12% (0.3491 => 0.3600, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.34% (0.5168 => 0.5289, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.3722 => 1.4030, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: 1.39% (34.0927 => 34.5657, std.dev.: 0.0090) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.24% (1.2300 => 1.2452, std.dev.: 0.0016) MultiSource/Applications/d/make_dparser: 1.21% (3.5154 => 3.5579, std.dev.: 0.0114) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.96% (31.3723 => 55.8293, std.dev.: 0.0059) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0117) SingleSource/Regression/C/uint64_to_float: 7.54% (0.5692 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.66% (54.5751 => 56.5751, std.dev.: 0.0411) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.27% (2.0478 => 2.1147, std.dev.: 0.0037) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.89% (79.7170 => 81.2271, std.dev.: 0.0176) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3035, std.dev.: 0.0018) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.46% (18.2231 => 18.4898, std.dev.: 0.0137) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2705, std.dev.: 0.0016) MultiSource/Applications/sqlite3/sqlite3: 1.41% (4.5320 => 4.5961, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.16% (0.3194 => 0.3061, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.04% (0.7198 => 0.6907, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.69% (0.3821 => 0.3680, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.45% (2.4924 => 2.4065, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.42% (0.9852 => 0.9515, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/trivial-interface: -3.23% (0.3812 => 0.3689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.16% (0.3831 => 0.3710, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.14% (0.3884 => 0.3762, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.08% (0.3891 => 0.3771, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.07% (0.3848 => 0.3730, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -3.05% (0.3896 => 0.3777, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.05% (0.4033 => 0.3910, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -2.97% (0.3837 => 0.3723, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: -2.91% (0.6347 => 0.6162, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -2.90% (0.4176 => 0.4055, std.dev.: 0.0014) SingleSource/UnitTests/Vector/constpool: -2.79% (20.7746 => 20.1951, std.dev.: 0.0376) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.64% (0.9542 => 0.9290, std.dev.: 0.0044) SingleSource/UnitTests/ObjC++/property-reference-object: -2.56% (0.6441 => 0.6276, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.48% (0.4199 => 0.4095, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.36% (0.6484 => 0.6331, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.09% (1.3148 => 1.2873, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.03% (2.1713 => 2.1273, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/property-reference: -1.80% (0.7779 => 0.7639, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.74% (14.2083 => 13.9610, std.dev.: 0.0151) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.30% (0.7919 => 0.7816, std.dev.: 0.0025) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.29% (6.7716 => 6.6845, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.17% (1.0544 => 1.0421, std.dev.: 0.0019) MultiSource/Applications/JM/lencod/lencod: -1.08% (16.1920 => 16.0178, std.dev.: 0.0130) MultiSource/Applications/sqlite3/sqlite3: -1.00% (17.1032 => 16.9318, std.dev.: 0.0310) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.71% (1.8100 => 0.6931, std.dev.: 0.0082) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3128, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.84% (1.3643 => 1.0254, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7555, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3639, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: -22.86% (83.5423 => 64.4484, std.dev.: 0.0058) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.88% (4.1024 => 3.2047, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.88% (5.3397 => 4.1714, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.26% (0.3418 => 0.2828, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.11% (2.5106 => 2.1312, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3568, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8201, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.78% (0.9021 => 0.8409, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.77% (2.2633 => 2.1779, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.77% (1.3096 => 1.2733, std.dev.: 0.0111) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.63% (7.9763 => 7.7662, std.dev.: 0.0224) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/ary3: -2.17% (3.7241 => 3.6434, std.dev.: 0.0069) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1725, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.58% (3.7092 => 3.6506, std.dev.: 0.0099) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4725, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.07% (1.6307 => 1.6132, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.03s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 16:06:42 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 18:06:42 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131000642.528B02A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8125?compare_to=8120&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8125, Order: 173975, Start Time: 2013-01-30 21:57:13, End Time: 2013-01-31 00:07:05 To: 8120, Order: 173952, Start Time: 2013-01-30 19:27:34, End Time: 2013-01-30 21:36:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 26 (113 on baseline) Performance Improvements: 20 (40 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1018 (910 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/McGill/exptree: 55.87% (0.1167 => 0.1819, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 51.33% (0.0867 => 0.1312, std.dev.: 0.0038) MultiSource/Applications/spiff/spiff: 30.45% (0.9272 => 1.2095, std.dev.: 0.0884) MultiSource/Applications/treecc/treecc: 22.34% (2.2699 => 2.7769, std.dev.: 0.0825) MultiSource/Applications/Burg/burg: 21.08% (1.5421 => 1.8672, std.dev.: 0.0755) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.83% (0.6073 => 0.6913, std.dev.: 0.0308) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.73% (0.2359 => 0.2683, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 1.77% (0.7194 => 0.7321, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: 43.88% (0.0711 => 0.1023, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 38.16% (3.4729 => 4.7981, std.dev.: 0.0565) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 33.12% (0.1591 => 0.2118, std.dev.: 0.0145) SingleSource/Benchmarks/Shootout/heapsort: 26.86% (3.5194 => 4.4647, std.dev.: 0.1204) SingleSource/Benchmarks/Shootout-C++/ary3: 22.02% (1.4059 => 1.7155, std.dev.: 0.0783) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.68% (1.6337 => 1.8735, std.dev.: 0.0838) MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.86% (2.7105 => 3.0863, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout-C++/ackermann: 12.03% (3.7030 => 4.1483, std.dev.: 0.1492) MultiSource/Benchmarks/BitBench/drop3/drop3: 9.45% (0.2996 => 0.3279, std.dev.: 0.0103) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.57% (9.7739 => 10.5137, std.dev.: 0.1568) SingleSource/Benchmarks/Misc-C++/bigfib: 6.51% (0.3423 => 0.3646, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 6.18% (3.8056 => 4.0406, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.22% (21.7432 => 22.6617, std.dev.: 0.0537) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 4.12% (1.0849 => 1.1296, std.dev.: 0.0017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.45% (6.8943 => 7.1320, std.dev.: 0.0195) SingleSource/Benchmarks/Linpack/linpack-pc: 2.69% (51.3080 => 52.6893, std.dev.: 0.2514) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.84% (5.8725 => 5.9804, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.07% (3.3270 => 3.3626, std.dev.: 0.0038) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/15-trie/trie: -40.98% (0.1025 => 0.0605, std.dev.: 0.0136) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -32.04% (0.1236 => 0.0840, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -28.54% (0.1398 => 0.0999, std.dev.: 0.0040) MultiSource/Benchmarks/McCat/04-bisect/bisect: -26.01% (0.2038 => 0.1508, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/neural/neural: -23.12% (0.3464 => 0.2663, std.dev.: 0.0163) MultiSource/Benchmarks/McCat/08-main/main: -17.98% (0.3587 => 0.2942, std.dev.: 0.0179) MultiSource/Benchmarks/Ptrdist/ft/ft: -15.12% (0.2613 => 0.2218, std.dev.: 0.0118) MultiSource/Benchmarks/Ptrdist/bc/bc: -12.36% (1.5012 => 1.3157, std.dev.: 0.0370) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -7.25% (1.8410 => 1.7075, std.dev.: 0.0478) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.07% (27.2060 => 25.5547, std.dev.: 0.1742) MultiSource/Benchmarks/Bullet/bullet: -5.31% (37.6284 => 35.6298, std.dev.: 0.4751) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.63% (1.3943 => 1.3297, std.dev.: 0.0235) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.04% (0.3890 => 0.3733, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.92% (0.7230 => 0.7091, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/bisort/bisort: -17.00% (0.9484 => 0.7872, std.dev.: 0.0576) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -16.25% (1.5160 => 1.2696, std.dev.: 0.0795) MultiSource/Benchmarks/McCat/09-vor/vor: -10.51% (0.1446 => 0.1294, std.dev.: 0.0053) MultiSource/Benchmarks/FreeBench/mason/mason: -9.54% (0.6025 => 0.5450, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.10% (4.4733 => 4.3794, std.dev.: 0.0271) MultiSource/Benchmarks/Olden/bh/bh: -1.84% (2.4655 => 2.4202, std.dev.: 0.0118) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -5.68% (1.2970 => 1.2233, std.dev.: 0.0867) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.02% (0.0242 => 0.0225, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.95% (0.0465 => 0.0442, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -3.91% (0.0358 => 0.0344, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -4.65% (0.0344 => 0.0328, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.85% (0.0456 => 0.0443, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0215 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: -2.54% (0.0236 => 0.0230, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 4.10% (0.0244 => 0.0254, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 26.67% (0.0015 => 0.0019, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1485 => 0.1430, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -0.12% (1.2144 => 1.2129, std.dev.: 0.2347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.99% (0.4539 => 0.4040, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.82% (0.1559 => 0.1515, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 28.57% (0.0007 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.10% (0.0627 => 0.0659, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 33.04% (0.0224 => 0.0298, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.50% (0.0601 => 0.0598, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.37% (1.2906 => 1.2858, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.33% (0.0030 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.85% (0.0026 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0620 => 0.0620, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.07% (0.0347 => 0.0375, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.29% (1.7699 => 1.7750, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: 23.21% (0.0056 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.14% (34.4296 => 34.3797, std.dev.: 0.1354) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 400.00% (0.0336 => 0.1680, std.dev.: 0.0049) SingleSource/Benchmarks/McGill/exptree: 111.76% (0.0859 => 0.1819, std.dev.: 0.0026) MultiSource/Benchmarks/NPB-serial/is/is: 64.62% (0.0797 => 0.1312, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/neural/neural: 62.58% (0.1638 => 0.2663, std.dev.: 0.0163) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 56.75% (0.8990 => 1.4092, std.dev.: 0.0478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 50.68% (0.0738 => 0.1112, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 46.98% (0.9612 => 1.4128, std.dev.: 0.0215) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 46.55% (0.8926 => 1.3081, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 45.53% (0.8893 => 1.2942, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 45.41% (0.9061 => 1.3176, std.dev.: 0.0680) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 43.84% (0.9564 => 1.3757, std.dev.: 0.1604) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 43.68% (0.9120 => 1.3104, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 42.96% (0.8736 => 1.2489, std.dev.: 0.0324) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 42.61% (0.9381 => 1.3378, std.dev.: 0.0510) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 42.45% (0.9588 => 1.3658, std.dev.: 0.0574) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 42.01% (0.9091 => 1.2910, std.dev.: 0.1126) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 41.91% (0.9855 => 1.3985, std.dev.: 0.0703) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 41.90% (0.9998 => 1.4187, std.dev.: 0.0985) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 41.41% (0.9403 => 1.3297, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 41.21% (1.0867 => 1.5345, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 40.23% (0.9010 => 1.2635, std.dev.: 0.0239) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 40.08% (0.9993 => 1.3998, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 40.03% (0.9422 => 1.3194, std.dev.: 0.0249) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 39.80% (0.9512 => 1.3298, std.dev.: 0.0309) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 39.55% (0.9788 => 1.3659, std.dev.: 0.0193) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 39.48% (0.9507 => 1.3260, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 39.30% (0.8912 => 1.2414, std.dev.: 0.0230) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 38.98% (1.0119 => 1.4063, std.dev.: 0.0839) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 38.02% (1.0017 => 1.3825, std.dev.: 0.0201) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 37.58% (0.9550 => 1.3139, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 37.46% (0.8846 => 1.2160, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.42% (1.0052 => 1.3713, std.dev.: 0.0634) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 36.31% (1.0088 => 1.3751, std.dev.: 0.0471) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 35.61% (0.9867 => 1.3381, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 35.34% (0.9405 => 1.2729, std.dev.: 0.0187) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.21% (0.9488 => 1.2829, std.dev.: 0.0865) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 35.03% (0.9127 => 1.2324, std.dev.: 0.1239) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 34.71% (1.0860 => 1.4630, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 34.07% (0.9685 => 1.2985, std.dev.: 0.0458) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.76% (0.5369 => 0.6913, std.dev.: 0.0308) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.70% (1.0986 => 1.4029, std.dev.: 0.0228) MultiSource/Applications/sgefa/sgefa: 24.43% (0.3598 => 0.4477, std.dev.: 0.0190) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 24.39% (0.0492 => 0.0612, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.40% (0.2577 => 0.3180, std.dev.: 0.0229) MultiSource/Benchmarks/mafft/pairlocalalign: 21.63% (9.5202 => 11.5791, std.dev.: 0.2257) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.01% (1.4110 => 1.7075, std.dev.: 0.0478) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.68% (0.0669 => 0.0794, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.88% (0.0783 => 0.0923, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.06% (0.0762 => 0.0892, std.dev.: 0.0026) MultiSource/Applications/Burg/burg: 16.85% (1.5979 => 1.8672, std.dev.: 0.0755) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.97% (1.8651 => 2.1630, std.dev.: 0.0955) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 14.99% (0.0707 => 0.0813, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.80% (4.9104 => 5.5388, std.dev.: 0.1397) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.75% (0.4596 => 0.5182, std.dev.: 0.0152) SingleSource/Benchmarks/Misc/ReedSolomon: 12.49% (0.2050 => 0.2306, std.dev.: 0.0058) MultiSource/Applications/treecc/treecc: 12.34% (2.4719 => 2.7769, std.dev.: 0.0825) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.22% (5.0381 => 5.6539, std.dev.: 0.1772) MultiSource/Applications/oggenc/oggenc: 12.20% (5.3553 => 6.0085, std.dev.: 0.1572) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.87% (44.1538 => 48.0694, std.dev.: 1.2218) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.35% (23.5861 => 25.5547, std.dev.: 0.1742) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.14% (0.2481 => 0.2683, std.dev.: 0.0069) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.43% (0.2879 => 0.3093, std.dev.: 0.0074) MultiSource/Benchmarks/Bullet/bullet: 7.18% (33.2440 => 35.6298, std.dev.: 0.4751) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.72% (0.7693 => 0.8210, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/ary2: 4.05% (0.2665 => 0.2773, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.94% (0.3981 => 0.4098, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/football/football: 2.80% (0.9759 => 1.0032, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.26% (0.6934 => 0.7091, std.dev.: 0.0022) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107500.00% (0.0008 => 0.8608, std.dev.: 0.0178) SingleSource/Benchmarks/Shootout/ary3: 418.18% (2.2304 => 11.5575, std.dev.: 0.8242) SingleSource/Benchmarks/Shootout/matrix: 357.76% (1.5825 => 7.2441, std.dev.: 0.0192) MultiSource/Applications/sgefa/sgefa: 259.52% (0.3515 => 1.2637, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.70% (1.1825 => 4.0406, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 232.47% (4.8185 => 16.0202, std.dev.: 0.0376) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 206.14% (0.0228 => 0.0698, std.dev.: 0.0095) SingleSource/Benchmarks/Shootout-C++/ary2: 175.97% (0.0129 => 0.0356, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 156.03% (0.0232 => 0.0594, std.dev.: 0.0111) MultiSource/Benchmarks/Olden/mst/mst: 73.11% (0.1491 => 0.2581, std.dev.: 0.0399) SingleSource/Benchmarks/Shootout-C++/matrix: 64.45% (2.9083 => 4.7826, std.dev.: 0.1020) SingleSource/Benchmarks/Stanford/Treesort: 42.88% (0.0716 => 0.1023, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.23% (0.2562 => 0.3439, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 32.62% (0.1597 => 0.2118, std.dev.: 0.0145) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.60% (3.1254 => 4.1129, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 27.28% (5.6033 => 7.1320, std.dev.: 0.0195) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.86% (1.4588 => 1.8360, std.dev.: 0.0374) SingleSource/Regression/C/uint64_to_float: 24.41% (1.5397 => 1.9156, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/salsa20: 22.13% (7.4497 => 9.0982, std.dev.: 0.0906) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 21.39% (4.8112 => 5.8404, std.dev.: 0.0494) MultiSource/Benchmarks/7zip/7zip-benchmark: 16.71% (9.0082 => 10.5137, std.dev.: 0.1568) MultiSource/Applications/JM/lencod/lencod: 14.25% (6.8159 => 7.7871, std.dev.: 0.3008) SingleSource/Benchmarks/Shootout-C++/heapsort: 14.13% (4.2042 => 4.7981, std.dev.: 0.0565) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.02% (5.1752 => 5.9010, std.dev.: 0.2784) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.22% (1.6547 => 1.8735, std.dev.: 0.0838) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.02% (5.0033 => 5.6547, std.dev.: 0.0107) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.89% (3.7074 => 4.1483, std.dev.: 0.1492) SingleSource/Benchmarks/McGill/chomp: 10.21% (1.0425 => 1.1489, std.dev.: 0.0181) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.00% (3.6477 => 3.9759, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/ReedSolomon: 8.14% (8.6447 => 9.3482, std.dev.: 0.0388) MultiSource/Benchmarks/VersaBench/dbms/dbms: 7.25% (2.8778 => 3.0863, std.dev.: 0.0211) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.05% (4.7473 => 5.0818, std.dev.: 0.0988) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.84% (0.6211 => 0.6574, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.41% (4.1836 => 4.4101, std.dev.: 0.0234) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.40% (5.0310 => 5.2523, std.dev.: 0.0697) SingleSource/Benchmarks/Linpack/linpack-pc: 3.53% (50.8945 => 52.6893, std.dev.: 0.2514) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.17% (4.7254 => 4.8750, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 3.02% (1.5017 => 1.5471, std.dev.: 0.0103) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.74% (1.0995 => 1.1296, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.53% (2.7432 => 2.7851, std.dev.: 0.0145) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.47% (61.0379 => 61.9323, std.dev.: 0.2627) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.26% (4.8076 => 4.8681, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.25% (5.9063 => 5.9804, std.dev.: 0.0104) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.12% (5.9115 => 5.9779, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.4534 => 6.5208, std.dev.: 0.0227) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.37% (0.1079 => 0.0924, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.19% (0.7686 => 0.6595, std.dev.: 0.0273) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.09% (0.4074 => 0.3663, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.84% (0.7693 => 0.7321, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.71% (11.5523 => 3.9611, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/fp-convert: -62.07% (15.6525 => 5.9369, std.dev.: 0.0828) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -53.71% (0.4146 => 0.1919, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.71% (0.4578 => 0.2348, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.75% (11.3868 => 6.4056, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.80% (5.4023 => 3.6305, std.dev.: 0.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.64% (0.4452 => 0.3088, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.33% (0.5495 => 0.4048, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8822, std.dev.: 0.0181) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.16% (0.5826 => 0.4360, std.dev.: 0.0244) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.82% (4.4467 => 3.3430, std.dev.: 0.0277) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.37% (0.5897 => 0.4460, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.30% (4.9921 => 3.8290, std.dev.: 0.1233) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.38% (5.8755 => 4.7954, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.55% (7.0016 => 5.8431, std.dev.: 0.0773) MultiSource/Benchmarks/Olden/bisort/bisort: -16.01% (0.9372 => 0.7872, std.dev.: 0.0576) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.25% (16.6791 => 14.3018, std.dev.: 0.2310) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.93% (3.1921 => 2.7794, std.dev.: 0.0721) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.73% (5.3626 => 4.6798, std.dev.: 0.0415) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.42% (5.7056 => 4.9968, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.38% (9.7992 => 8.5861, std.dev.: 0.0139) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.31% (0.1164 => 0.1044, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: -8.25% (63.1520 => 57.9445, std.dev.: 0.6695) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.39% (4.5424 => 4.2523, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.38% (5.5974 => 5.2404, std.dev.: 0.0367) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.23% (4.9799 => 4.7195, std.dev.: 0.0448) SingleSource/Benchmarks/McGill/queens: -5.07% (1.7443 => 1.6558, std.dev.: 0.0299) SingleSource/Benchmarks/Shootout-C++/hash2: -4.37% (3.6768 => 3.5162, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.27% (3.5127 => 3.3626, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.49% (5.8973 => 5.6914, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.42% (3.5691 => 3.4472, std.dev.: 0.0451) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.15% (23.3986 => 22.6617, std.dev.: 0.0537) SingleSource/Benchmarks/Shootout-C++/lists: -2.58% (17.2182 => 16.7736, std.dev.: 0.1636) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.66% (8.7327 => 8.5881, std.dev.: 0.0152) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.58% (85.3042 => 83.9551, std.dev.: 0.2120) SingleSource/Benchmarks/Misc/whetstone: -1.10% (1.6251 => 1.6073, std.dev.: 0.0056) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.54% (1.2047 => 1.2233, std.dev.: 0.0867) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.43% (0.0233 => 0.0225, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.00% (0.0451 => 0.0442, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0394 => 0.0344, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0328 => 0.0328, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.45% (0.0445 => 0.0443, std.dev.: 0.0040) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/test1: 1.32% (0.0227 => 0.0230, std.dev.: 0.0043) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.39% (0.0255 => 0.0254, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 26.67% (0.0015 => 0.0019, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.54% (0.1530 => 0.1430, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: -37.13% (1.9293 => 1.2129, std.dev.: 0.2347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.22% (0.4049 => 0.4040, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.33% (0.1510 => 0.1515, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.62% (0.0978 => 0.0659, std.dev.: 0.0137) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 7.97% (0.0276 => 0.0298, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.36% (0.0590 => 0.0598, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.68% (1.1617 => 1.2858, std.dev.: 0.0280) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.13% (0.0032 => 0.0031, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.64% (0.0610 => 0.0620, std.dev.: 0.0144) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.93% (0.0268 => 0.0375, std.dev.: 0.0022) SingleSource/Benchmarks/BenchmarkGame/puzzle: 138.67% (0.7437 => 1.7750, std.dev.: 0.0021) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -25.00% (0.0092 => 0.0069, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.05% (12.7781 => 34.3797, std.dev.: 0.1354) Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 17:36:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 19:36:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131013653.DB3B12A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8126?compare_to=8123&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8126, Order: 173984, Start Time: 2013-01-30 23:24:58, End Time: 2013-01-31 01:37:16 To: 8123, Order: 173963, Start Time: 2013-01-30 20:42:06, End Time: 2013-01-30 22:54:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (227 on baseline) Performance Improvements: 7 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1092 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.15% (1.2909 => 1.3058, std.dev.: 0.0021) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -2.46% (11.3579 => 11.0781, std.dev.: 0.0157) MultiSource/Applications/siod/siod: -1.22% (2.7689 => 2.7352, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.16% (0.9496 => 0.9386, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/bc/bc: -1.05% (1.4442 => 1.4290, std.dev.: 0.0023) MultiSource/Applications/spiff/spiff: -1.03% (0.9865 => 0.9763, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.03% (6.6289 => 6.5605, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.00% (1.1464 => 1.1349, std.dev.: 0.0013) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1327 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.24% (0.0678 => 0.0656, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8351 => 499.8514, std.dev.: 0.0039) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44224.86% (1.1277 => 499.8514, std.dev.: 0.0039) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.58% (0.5229 => 1.7077, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 25.71% (14.9895 => 18.8426, std.dev.: 0.0124) MultiSource/Applications/kimwitu++/kc: 46.88% (14.1553 => 20.7907, std.dev.: 0.0143) MultiSource/Benchmarks/MallocBench/gs/gs: 20.66% (4.1105 => 4.9598, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.67% (1.1048 => 1.7861, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 447.90% (7.1582 => 39.2196, std.dev.: 0.0275) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.45% (3.4629 => 6.5605, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.40% (0.6222 => 1.1349, std.dev.: 0.0013) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.92% (0.0720 => 7.4433, std.dev.: 0.0139) MultiSource/Applications/SIBsim4/SIBsim4: 3833800.00% (0.0001 => 3.8339, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11135800.00% (0.0001 => 11.1359, std.dev.: 0.0321) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493100.00% (0.0001 => 5.4932, std.dev.: 0.0036) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.20% (1.1194 => 10.2895, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: 150.16% (22.1758 => 55.4754, std.dev.: 0.0308) SingleSource/Benchmarks/Misc/lowercase: 131.64% (0.0256 => 0.0593, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.80% (0.0929 => 0.1884, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 80.04% (0.1463 => 0.2634, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 65.74% (0.0394 => 0.0653, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 64.07% (0.0231 => 0.0379, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.09% (2.9384 => 4.6160, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 56.27% (1.5859 => 2.4783, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.01% (7.0540 => 10.9343, std.dev.: 0.0063) MultiSource/Benchmarks/FreeBench/distray/distray: 53.03% (0.1056 => 0.1616, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.52% (8.1363 => 12.1652, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.20% (0.0439 => 0.0655, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.02% (2.2024 => 3.2159, std.dev.: 0.0014) MultiSource/Applications/sgefa/sgefa: 45.26% (0.3109 => 0.4516, std.dev.: 0.0011) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 41.48% (0.1432 => 0.2026, std.dev.: 0.0027) MultiSource/Applications/JM/lencod/lencod: 40.61% (21.9371 => 30.8450, std.dev.: 0.0099) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.30% (0.1062 => 0.1490, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 37.90% (1.5415 => 2.1258, std.dev.: 0.0092) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.17% (4.2646 => 5.8499, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 36.76% (0.0457 => 0.0625, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.12% (0.4615 => 0.6282, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 35.75% (0.0814 => 0.1105, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.49% (0.5105 => 0.6917, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.92% (0.2271 => 0.3064, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.56% (0.1892 => 0.2527, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.20% (0.6675 => 0.8891, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 32.86% (1.1642 => 1.5467, std.dev.: 0.0068) MultiSource/Benchmarks/McCat/05-eks/eks: 32.82% (0.4299 => 0.5710, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 31.90% (0.1655 => 0.2183, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: 31.71% (0.0719 => 0.0947, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 31.45% (0.0636 => 0.0836, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/dot-syntax-1: 31.32% (0.0479 => 0.0629, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 30.93% (0.1125 => 0.1473, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 30.42% (9.4845 => 12.3693, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.21% (0.1695 => 0.2207, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.65% (3.8922 => 5.0461, std.dev.: 0.0076) MultiSource/Applications/viterbi/viterbi: 29.26% (0.1555 => 0.2010, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 28.78% (1.0722 => 1.3808, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.55% (0.0746 => 0.0959, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 27.88% (0.2554 => 0.3266) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.87% (0.0793 => 0.1014, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.73% (1.4186 => 1.8120, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash: 27.65% (0.4289 => 0.5475, std.dev.: 0.0013) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 27.03% (0.1143 => 0.1452, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.85% (0.1337 => 0.1696, std.dev.: 0.0012) MultiSource/Applications/minisat/minisat: 26.82% (0.7115 => 0.9023, std.dev.: 0.0052) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.81% (0.1906 => 0.2417, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 26.80% (0.4620 => 0.5858, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.66% (0.3121 => 0.3953, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 26.55% (0.1175 => 0.1487, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.44% (0.1566 => 0.1980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.60% (0.0672 => 0.0844, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.50% (0.5020 => 0.6300, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 25.48% (0.6456 => 0.8101, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.93% (0.0730 => 0.0912, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 24.85% (0.0660 => 0.0824, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/hash: 24.74% (0.0485 => 0.0605, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.70% (0.0842 => 0.1050, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 24.61% (0.7835 => 0.9763, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.54% (1.3050 => 1.6253, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.38% (0.0886 => 0.1102, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.35% (0.1236 => 0.1537, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/lists: 24.28% (0.0626 => 0.0778, std.dev.: 0.0007) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.23% (0.0871 => 0.1082, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (0.1032 => 0.1282, std.dev.: 0.0007) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 23.91% (0.0527 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.81% (0.2700 => 0.3343, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 23.59% (1.1840 => 1.4633, std.dev.: 0.0020) MultiSource/Applications/oggenc/oggenc: 23.59% (5.7591 => 7.1174, std.dev.: 0.0034) MultiSource/Applications/d/make_dparser: 23.45% (3.3354 => 4.1175, std.dev.: 0.0051) MultiSource/Applications/aha/aha: 23.37% (0.1151 => 0.1420, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.13% (0.1029 => 0.1267, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.11% (0.0675 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 22.96% (0.1163 => 0.1430, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.88% (0.0953 => 0.1171, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.60% (0.1695 => 0.2078, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.56% (0.5860 => 0.7182, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 22.51% (0.0662 => 0.0811, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.22% (0.1940 => 0.2371, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.21% (4.9449 => 6.0433, std.dev.: 0.0061) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.20% (0.3307 => 0.4041, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 22.11% (0.2049 => 0.2502, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 21.85% (0.3098 => 0.3775, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.72% (0.1510 => 0.1838, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/football/football: 21.66% (0.8921 => 1.0853, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.65% (0.1584 => 0.1927, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 21.50% (0.0614 => 0.0746, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.34% (5.0018 => 6.0690, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.26% (0.2107 => 0.2555, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.26% (0.8172 => 0.9909, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 21.16% (0.0567 => 0.0687, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/18-imp/imp: 21.15% (0.3423 => 0.4147, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 21.10% (2.0273 => 2.4551, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.96% (0.2758 => 0.3336, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.82% (0.9765 => 1.1798, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 20.64% (0.0528 => 0.0637) SingleSource/UnitTests/SignlessTypes/rem: 20.63% (0.1144 => 0.1380, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.60% (0.6450 => 0.7779, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.48% (1.1861 => 1.4290, std.dev.: 0.0023) MultiSource/Applications/lua/lua: 20.24% (3.8723 => 4.6562, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.17% (0.5569 => 0.6692, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.89% (0.0759 => 0.0910, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.61% (0.0933 => 0.1116, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.61% (0.0770 => 0.0921, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.61% (0.1117 => 0.1336, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 19.60% (0.7433 => 0.8890, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/health/health: 19.48% (0.1268 => 0.1515) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.42% (0.0834 => 0.0996, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 19.40% (0.0536 => 0.0640, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.18% (0.8101 => 0.9655, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 19.08% (2.2969 => 2.7352, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.96% (0.0770 => 0.0916, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.81% (0.5981 => 0.7106, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.71% (0.2603 => 0.3090, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.63% (0.4203 => 0.4986, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.63% (0.3441 => 0.4082, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 18.48% (0.0633 => 0.0750, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 17.97% (0.2065 => 0.2436, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: 17.85% (0.0818 => 0.0964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 17.33% (0.3283 => 0.3852, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 16.98% (0.3180 => 0.3720, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 16.86% (0.3232 => 0.3777, std.dev.: 0.0005) MultiSource/Benchmarks/sim/sim: 16.86% (0.3387 => 0.3958, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.86% (0.1044 => 0.1220, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.48% (0.0704 => 0.0820, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.35% (0.8067 => 0.9386, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.60% (0.3865 => 0.4468, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: 15.54% (0.3379 => 0.3904, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 15.39% (17.1811 => 19.8255, std.dev.: 0.0083) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.27% (0.0838 => 0.0966, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 14.86% (0.4636 => 0.5325, std.dev.: 0.0019) SingleSource/Regression/C++/ofstream_ctor: 14.60% (0.2905 => 0.3329, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 14.36% (1.5603 => 1.7844, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/moments: 14.13% (0.4048 => 0.4620, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.58% (0.4103 => 0.4660, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.53% (0.0798 => 0.0906, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/lists1: 13.41% (0.3684 => 0.4178, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: 13.35% (0.3422 => 0.3879, std.dev.: 0.0091) SingleSource/Benchmarks/Misc/oourafft: 13.35% (0.3282 => 0.3720, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/sieve: 13.24% (0.3603 => 0.4080, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.10% (0.3427 => 0.3876, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/bh/bh: 13.10% (0.3092 => 0.3497, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.97% (14.3668 => 16.2297, std.dev.: 0.0135) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.80% (0.2430 => 0.2741, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.60% (0.4064 => 0.4576, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/parameter-passing: 12.17% (0.3927 => 0.4405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.03% (0.1114 => 0.1248, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 11.97% (0.3826 => 0.4284, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.91% (0.1268 => 0.1419, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 11.84% (0.3886 => 0.4346, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 11.23% (0.3828 => 0.4258, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 10.84% (0.3543 => 0.3927, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: 10.83% (0.3694 => 0.4094, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/trivial-interface: 10.83% (0.3473 => 0.3849, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.81% (0.3543 => 0.3926, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 10.76% (0.3561 => 0.3944, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 10.64% (0.3497 => 0.3869, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 10.58% (0.3516 => 0.3888, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.31% (0.2831 => 0.3123, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 10.24% (0.2871 => 0.3165, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 9.89% (63.2438 => 69.5005, std.dev.: 0.0288) MultiSource/Applications/hexxagon/hexxagon: 9.86% (1.2842 => 1.4108, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.78% (0.3935 => 0.4320, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: 9.76% (2.0665 => 2.2681, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.51% (0.2756 => 0.3018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 9.49% (0.2877 => 0.3150, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2725 => 0.2979, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.30% (0.3162 => 0.3456, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2793 => 0.3052, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.15% (0.3650 => 0.3984, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/hello: 9.14% (0.2714 => 0.2962, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.10% (0.2891 => 0.3154, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.04% (0.3052 => 0.3328, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 8.84% (0.2872 => 0.3126, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 8.77% (0.6030 => 0.6559, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/random: 8.74% (0.2802 => 0.3047, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.62% (0.1625 => 0.1765, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.50% (0.1330 => 0.1443, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 8.30% (0.7326 => 0.7934, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.26% (0.3136 => 0.3395, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.19% (2.2022 => 2.3825, std.dev.: 0.0020) SingleSource/UnitTests/ObjC++/Hello: 8.00% (0.5925 => 0.6399, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.94% (0.2266 => 0.2446, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.91% (0.4879 => 0.5265, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0034) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.16% (0.1438 => 0.1541, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 6.86% (10.3673 => 11.0781, std.dev.: 0.0157) SingleSource/Benchmarks/Shootout-C++/objinst: 4.15% (0.3131 => 0.3261, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (7.9617 => 8.2766, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.27% (0.3817 => 0.3942, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4770, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 13.12% (0.5413 => 0.6123, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2436, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.83% (11.6436 => 12.5549, std.dev.: 0.1654) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.18% (4.2280 => 4.4471, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout-C++/hash2: 4.95% (3.1578 => 3.3140, std.dev.: 0.0111) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.11% (0.9957 => 1.0366, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.92% (0.3316 => 0.3446, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.49% (2.0360 => 2.1070, std.dev.: 0.0150) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.67% (3.6395 => 3.7367, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.64% (8.6802 => 8.9092, std.dev.: 0.0102) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.40% (1.0313 => 1.0560, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.79% (9.1159 => 9.2791, std.dev.: 0.0273) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3102, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.09% (6.5088 => 6.5796, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.05% (10.3460 => 10.4542, std.dev.: 0.0103) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.80% (6.6874 => 0.1474, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1748, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.42% (0.1622 => 0.0934, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.80% (5.3855 => 4.4808, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.12% (5.3526 => 4.4896, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: -11.72% (10.4361 => 9.2131, std.dev.: 0.0064) SingleSource/UnitTests/Vector/constpool: -7.75% (54.1659 => 49.9681, std.dev.: 0.0391) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.02% (1.7609 => 1.6373, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.84% (1.9577 => 0.6688, std.dev.: 0.0071) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.05% (8.0499 => 5.3089, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/mandel-2: -33.39% (1.5373 => 1.0240, std.dev.: 0.0026) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4330, std.dev.: 0.0313) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1353, std.dev.: 0.0066) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0067, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0911, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.10% (3.1443 => 2.7324, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.91% (0.9540 => 0.8404, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.18% (9.5636 => 8.4946, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9123, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0012) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7045, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.84% (19.9488 => 18.5838, std.dev.: 0.0087) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.70% (0.3463 => 0.3231, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0012) SingleSource/Benchmarks/McGill/chomp: -5.91% (1.2373 => 1.1642, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5860, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7013, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.96% (1.5835 => 1.5050, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.78% (0.4808 => 0.4578, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/salsa20: -4.73% (10.2830 => 9.7971, std.dev.: 0.0058) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.79% (8.8334 => 8.6755, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -1.63% (12.5348 => 12.3304, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary3: -1.42% (3.7221 => 3.6694, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -1.36% (3.6994 => 3.6491, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout/lists: -1.05% (6.2999 => 6.2340, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout/hash: -1.02% (4.9088 => 4.8585, std.dev.: 0.0080) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0027) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 17:59:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 19:59:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131015956.B1A8C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8127?compare_to=8124&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8127, Order: 173994, Start Time: 2013-01-31 00:26:10, End Time: 2013-01-31 02:00:19 To: 8124, Order: 173979, Start Time: 2013-01-30 22:28:22, End Time: 2013-01-31 00:02:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (112 on baseline) Performance Improvements: 0 (96 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 69.87% (0.0717 => 0.1218, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.05% (0.1132 => 0.1608, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 38.73% (0.0599 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.98% (0.6395 => 0.8824, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 37.56% (0.0418 => 0.0575) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.17% (0.6395 => 0.8708, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.66% (0.5456 => 0.7238, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.64% (0.5805 => 0.7700, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.59% (0.5688 => 0.7542, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.59% (0.6260 => 0.8300, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.14% (0.5567 => 0.7356, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.04% (0.5849 => 0.7723, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.89% (0.5575 => 0.7353, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.88% (0.6230 => 0.8216, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.70% (0.5581 => 0.7350, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.14% (0.5802 => 0.7609, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.60% (0.5941 => 0.7759, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.59% (0.5705 => 0.7450, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.31% (0.5570 => 0.7258, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.25% (1.6474 => 2.1457, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.15% (0.5569 => 0.7248, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.08% (0.5478 => 0.7126, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.96% (0.5857 => 0.7612, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.91% (0.5591 => 0.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.89% (0.5859 => 0.7610, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.80% (0.6033 => 0.7831, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.35% (0.6440 => 0.8330, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.86% (0.6189 => 0.7975, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.46% (0.6676 => 0.8576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.43% (0.5863 => 0.7530, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.22% (0.6304 => 0.8083, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.02% (0.6052 => 0.7748, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.58% (0.6446 => 0.8224, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.45% (0.6194 => 0.7894, std.dev.: 0.0103) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.24% (0.6681 => 0.8501, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.76% (0.6297 => 0.7982, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.76% (0.6660 => 0.8442, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.09% (0.6667 => 0.8340, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.46% (0.0699 => 0.0870, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.92% (0.7524 => 0.9324, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.91% (0.7339 => 0.9020, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.80% (2.2587 => 2.7737, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.53% (0.0790 => 0.0968, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.38% (0.0622 => 0.0755) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.36% (0.0693 => 0.0841, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.45% (0.0634 => 0.0751, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 17.87% (0.0621 => 0.0732, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.29% (0.0833 => 0.0977, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 16.89% (0.3357 => 0.3924, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.75% (0.1146 => 0.1338, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.29% (0.0680 => 0.0784) MultiSource/Applications/lemon/lemon: 15.20% (1.1450 => 1.3190, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.52% (0.1081 => 0.1238, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.87% (0.1982 => 0.2257, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.49% (4.5069 => 5.0698, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.14% (1.6364 => 1.8350, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.04% (0.4916 => 0.5508, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.83% (3.5339 => 3.9519, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 11.72% (0.4515 => 0.5044, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.31% (0.2385 => 0.2631, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 9.78% (9.2283 => 10.1308, std.dev.: 0.0063) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.63% (0.5329 => 0.5789, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.55% (0.1731 => 0.1879, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.33% (0.4524 => 0.4901, std.dev.: 0.0031) MultiSource/Applications/Burg/burg: 8.29% (1.2515 => 1.3553, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.28% (0.7021 => 0.7602, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.05% (0.2001 => 0.2162, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 7.94% (0.4861 => 0.5247, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.70% (1.2784 => 1.3768, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.16% (1.4642 => 1.5691, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.67% (0.6750 => 0.7200, std.dev.: 0.0049) SingleSource/Benchmarks/Shootout-C++/matrix: 6.08% (0.3255 => 0.3453, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 5.64% (0.1879 => 0.1985, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.46% (5.4682 => 5.7669, std.dev.: 0.0068) MultiSource/Benchmarks/SciMark2-C/scimark2: 4.91% (0.3319 => 0.3482, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 3.99% (5.0226 => 5.2228, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.92% (22.4056 => 23.2829, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (0.3446 => 0.3573, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.36% (0.3394 => 0.3508, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 3.32% (0.7447 => 0.7694, std.dev.: 0.0001) MultiSource/Applications/SIBsim4/SIBsim4: 3.20% (1.3864 => 1.4307, std.dev.: 0.0039) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.17% (0.9557 => 0.9860, std.dev.: 0.0002) MultiSource/Applications/SPASS/SPASS: 3.06% (15.5079 => 15.9823, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.69% (0.4427 => 0.4546, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: 2.66% (0.8418 => 0.8642, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5168 => 0.5275, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.96% (1.3722 => 1.3991, std.dev.: 0.0034) MultiSource/Benchmarks/Bullet/bullet: 1.25% (34.0927 => 34.5180, std.dev.: 0.0114) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.12% (1.2300 => 1.2438, std.dev.: 0.0030) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.93% (31.3723 => 55.8195, std.dev.: 0.0056) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.13% (0.9531 => 1.0306, std.dev.: 0.0018) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1496, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.81% (54.5751 => 56.6545, std.dev.: 0.0452) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.0478 => 2.1106, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3045, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (18.2231 => 18.5052, std.dev.: 0.0132) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2704, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5971, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.00% (10.3489 => 10.4528, std.dev.: 0.0156) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.33% (0.1281 => 0.1123, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.70% (0.3194 => 0.3044, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.39% (0.7198 => 0.6882, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/trivial-interface: -4.22% (0.3812 => 0.3651, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.12% (0.3880 => 0.3720, std.dev.: 0.0023) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3848 => 0.3690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.06% (0.3891 => 0.3733, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.06% (0.3896 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -4.04% (0.4033 => 0.3870, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.02% (0.3831 => 0.3677, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -3.90% (0.4176 => 0.4013, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.85% (0.3821 => 0.3674, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.75% (0.9852 => 0.9483, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.61% (2.4924 => 2.4024, std.dev.: 0.0127) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.53% (0.3884 => 0.3747, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.26% (0.4199 => 0.4062, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.25% (0.3142 => 0.3040, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.90% (0.4280 => 0.4156, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -2.69% (0.6347 => 0.6176, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.66% (0.9542 => 0.9288, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.66% (2.1713 => 2.1136, std.dev.: 0.0028) MultiSource/Applications/hexxagon/hexxagon: -2.62% (1.3148 => 1.2803, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -2.45% (0.6441 => 0.6283, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.45% (0.6484 => 0.6325, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.40% (20.7746 => 20.2752, std.dev.: 0.0354) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9256, std.dev.: 0.0106) SingleSource/UnitTests/ObjC++/property-reference: -1.95% (0.7779 => 0.7627, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (6.7716 => 6.6625, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.39% (0.7919 => 0.7809, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.38% (1.0544 => 1.0399, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -1.20% (16.1920 => 15.9972, std.dev.: 0.0140) MultiSource/Benchmarks/MallocBench/gs/gs: -1.17% (4.3330 => 4.2823, std.dev.: 0.0140) MultiSource/Applications/sqlite3/sqlite3: -1.08% (17.1032 => 16.9183, std.dev.: 0.0180) MultiSource/Applications/JM/ldecod/ldecod: -1.07% (7.0961 => 7.0205, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.08% (1.8100 => 0.6863, std.dev.: 0.0141) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3094, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/mandel-2: -25.27% (1.3643 => 1.0195, std.dev.: 0.0068) SingleSource/Benchmarks/Shootout-C++/methcall: -23.51% (7.5137 => 5.7471, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4501, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2054, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0069) SingleSource/UnitTests/Vector/multiplies: -14.99% (2.5106 => 2.1342, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.64% (4.7378 => 4.0917, std.dev.: 0.0072) SingleSource/Benchmarks/Shootout/matrix: -13.29% (3.1443 => 2.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.33% (4.9100 => 4.3535, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.04% (1.2842 => 1.1681, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8193, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.25% (1.7753 => 1.6998, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1738, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.89% (1.3096 => 1.2718, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2764, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6292, std.dev.: 0.0123) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.52% (7.9763 => 7.7750, std.dev.: 0.0111) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.27% (3.1919 => 3.1194, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1740, std.dev.: 0.0266) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4651, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.56% (1.6307 => 1.6052, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6012, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.27% (1.6086 => 1.5881, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.00% (3.2107 => 3.1785, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.20s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 18:40:55 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 20:40:55 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131024055.4560F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8128?compare_to=8125&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8128, Order: 173995, Start Time: 2013-01-31 00:29:31, End Time: 2013-01-31 02:41:19 To: 8125, Order: 173975, Start Time: 2013-01-30 21:57:13, End Time: 2013-01-31 00:07:05 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 34 (117 on baseline) Performance Improvements: 17 (35 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1013 (911 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: 52.96% (0.0338 => 0.0517, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 48.32% (0.0892 => 0.1323, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/treeadd/treeadd: 46.59% (0.0498 => 0.0730, std.dev.: 0.0035) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 43.30% (0.1007 => 0.1443, std.dev.: 0.0160) MultiSource/Benchmarks/Ptrdist/ft/ft: 39.13% (0.2218 => 0.3086, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/voronoi/voronoi: 33.60% (0.2845 => 0.3801, std.dev.: 0.0155) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.73% (0.1754 => 0.2258, std.dev.: 0.0127) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 20.29% (1.4834 => 1.7844, std.dev.: 0.0531) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.17% (9.8649 => 11.7564, std.dev.: 0.5631) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.61% (1.5146 => 1.7661, std.dev.: 0.0858) MultiSource/Benchmarks/Bullet/bullet: 14.33% (35.6298 => 40.7368, std.dev.: 1.3192) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 11.80% (0.7321 => 0.8185, std.dev.: 0.0312) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.30% (1.9187 => 2.0972, std.dev.: 0.0435) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.64% (2.6683 => 2.8721, std.dev.: 0.0407) MultiSource/Applications/kimwitu++/kc: 7.04% (19.1104 => 20.4563, std.dev.: 0.3614) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.04% (6.0857 => 6.4530, std.dev.: 0.1415) MultiSource/Benchmarks/FreeBench/pifft/pifft: 5.61% (0.9679 => 1.0222, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.21% (1.2910 => 1.3583, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.07% (0.5106 => 0.5365, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.87% (1.3825 => 1.4360, std.dev.: 0.0063) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 26.50% (0.1732 => 0.2191, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/mst/mst: 22.70% (0.2581 => 0.3167, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.93% (4.7022 => 5.6394, std.dev.: 0.2096) MultiSource/Benchmarks/Fhourstones/fhourstones: 19.36% (1.3828 => 1.6505, std.dev.: 0.0456) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 18.20% (1.2696 => 1.5007, std.dev.: 0.0356) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.27% (0.3365 => 0.3778, std.dev.: 0.0104) SingleSource/Benchmarks/Misc/pi: 7.40% (2.0503 => 2.2021, std.dev.: 0.0061) MultiSource/Benchmarks/llubenchmark/llu: 7.18% (2.0324 => 2.1783, std.dev.: 0.0334) MultiSource/Benchmarks/Olden/tsp/tsp: 4.91% (1.5471 => 1.6230, std.dev.: 0.0212) MultiSource/Benchmarks/Bullet/bullet: 4.87% (7.1747 => 7.5244, std.dev.: 0.0492) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.70% (1.3771 => 1.4280, std.dev.: 0.0137) MultiSource/Applications/lua/lua: 1.40% (29.2828 => 29.6938, std.dev.: 0.1015) SingleSource/Benchmarks/Shootout-C++/sieve: 1.30% (3.4599 => 3.5049, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.04% (16.0202 => 16.1872, std.dev.: 0.0646) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/NPB-serial/is/is: -33.54% (0.1312 => 0.0872, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/exptree: -30.90% (0.1819 => 0.1257, std.dev.: 0.0099) MultiSource/Applications/spiff/spiff: -18.99% (1.2095 => 0.9798, std.dev.: 0.0325) MultiSource/Applications/Burg/burg: -18.96% (1.8672 => 1.5132, std.dev.: 0.0790) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -15.16% (0.4104 => 0.3482, std.dev.: 0.0134) MultiSource/Applications/treecc/treecc: -15.14% (2.7769 => 2.3565, std.dev.: 0.1303) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -13.76% (0.1112 => 0.0959, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.20% (0.1363 => 0.1224, std.dev.: 0.0030) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -6.96% (1.7075 => 1.5887, std.dev.: 0.0153) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Stanford/Treesort: -29.33% (0.1023 => 0.0723, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout/heapsort: -13.21% (4.4647 => 3.8749, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.11% (7.1320 => 6.9099, std.dev.: 0.0630) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.36% (1.9816 => 1.9348, std.dev.: 0.0159) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.75% (2.5875 => 2.5422, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.53% (1.5920 => 1.5677, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/fib2: -1.45% (4.4024 => 4.3385, std.dev.: 0.0131) MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.12% (2.8170 => 2.7855, std.dev.: 0.0060) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 18.17% (1.2233 => 1.4456, std.dev.: 0.1090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.56% (0.0225 => 0.0242, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.68% (0.0442 => 0.0445, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 1.16% (0.0344 => 0.0348, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.91% (0.0328 => 0.0331, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.35% (0.0443 => 0.0437, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: -1.40% (0.0215 => 0.0212, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 0.43% (0.0230 => 0.0231, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0254 => 0.0254, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -26.32% (0.0019 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 2.52% (0.1430 => 0.1466, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: 10.59% (1.2129 => 1.3413, std.dev.: 0.4399) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.38% (0.4040 => 0.4823, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.13% (0.1515 => 0.1513, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.52% (0.0659 => 0.0669, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -7.05% (0.0298 => 0.0277, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.36% (0.0598 => 0.0554, std.dev.: 0.0061) MultiSource/Benchmarks/PAQ8p/paq8p: 6.67% (0.0015 => 0.0016, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.63% (1.2858 => 1.3325, std.dev.: 0.0657) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.23% (0.0031 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.45% (0.0620 => 0.0611, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.67% (0.0375 => 0.0365, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.30% (1.7750 => 1.7519, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 42.03% (0.0069 => 0.0098, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.06% (34.3797 => 34.4014, std.dev.: 0.2006) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0016, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 412.20% (0.0336 => 0.1721, std.dev.: 0.0022) SingleSource/UnitTests/printargs: 126.09% (0.0092 => 0.0208, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 121.84% (0.0293 => 0.0650, std.dev.: 0.0093) SingleSource/Regression/C/sumarray2d: 97.08% (0.0274 => 0.0540, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/neural/neural: 78.82% (0.1638 => 0.2929, std.dev.: 0.0129) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 73.62% (0.0762 => 0.1323, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 58.08% (0.9564 => 1.5119, std.dev.: 0.0746) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 56.16% (0.9403 => 1.4684, std.dev.: 0.1686) SingleSource/Benchmarks/BenchmarkGame/partialsums: 55.72% (0.0332 => 0.0517, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 55.37% (0.8990 => 1.3968, std.dev.: 0.1381) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 52.61% (0.9381 => 1.4316, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 52.51% (0.9120 => 1.3909, std.dev.: 0.0882) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 52.04% (1.0052 => 1.5283, std.dev.: 0.0691) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 51.52% (0.9612 => 1.4564, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 51.19% (0.9855 => 1.4900, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 50.44% (0.8926 => 1.3428, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 49.65% (0.9588 => 1.4348, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 49.41% (0.9091 => 1.3583, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 49.11% (0.9998 => 1.4908, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 49.00% (0.9010 => 1.3425, std.dev.: 0.0605) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 48.26% (0.9507 => 1.4095, std.dev.: 0.1494) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 48.15% (0.0974 => 0.1443, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 47.06% (0.8893 => 1.3078, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 46.68% (0.9061 => 1.3291, std.dev.: 0.0985) SingleSource/Benchmarks/McGill/exptree: 46.33% (0.0859 => 0.1257, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 46.09% (0.9512 => 1.3896, std.dev.: 0.0530) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 45.90% (1.0867 => 1.5855, std.dev.: 0.0477) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 45.68% (1.0119 => 1.4741, std.dev.: 0.1281) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 44.27% (0.8732 => 1.2598, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 43.36% (1.0017 => 1.4360, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 42.52% (0.9422 => 1.3428, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 42.17% (0.8736 => 1.2420, std.dev.: 0.0981) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 39.89% (0.8846 => 1.2375, std.dev.: 0.0926) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 37.05% (0.9788 => 1.3414, std.dev.: 0.0724) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 36.79% (0.0492 => 0.0673, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 36.64% (0.9488 => 1.2964, std.dev.: 0.0730) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 35.56% (1.0088 => 1.3675, std.dev.: 0.0375) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 35.36% (0.9127 => 1.2354, std.dev.: 0.0528) MultiSource/Benchmarks/Ptrdist/ft/ft: 35.17% (0.2283 => 0.3086, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 34.90% (0.9993 => 1.3481, std.dev.: 0.0772) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 34.78% (0.9405 => 1.2676, std.dev.: 0.0466) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 34.51% (0.9685 => 1.3027, std.dev.: 0.0343) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 33.08% (1.0860 => 1.4453, std.dev.: 0.0568) MultiSource/Benchmarks/Olden/treeadd/treeadd: 32.97% (0.0549 => 0.0730, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 32.74% (0.9550 => 1.2677, std.dev.: 0.0677) MultiSource/Benchmarks/Olden/voronoi/voronoi: 31.80% (0.2884 => 0.3801, std.dev.: 0.0155) MultiSource/Benchmarks/Olden/mst/mst: 31.61% (0.1335 => 0.1757, std.dev.: 0.0155) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 29.95% (0.0738 => 0.0959, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 29.03% (0.3273 => 0.4223, std.dev.: 0.0343) MultiSource/Benchmarks/McCat/05-eks/eks: 28.39% (0.4776 => 0.6132, std.dev.: 0.0477) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 26.03% (3.6295 => 4.5741, std.dev.: 0.2239) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.58% (0.1798 => 0.2258, std.dev.: 0.0127) MultiSource/Benchmarks/Olden/power/power: 25.30% (0.1435 => 0.1798, std.dev.: 0.0126) MultiSource/Applications/sgefa/sgefa: 23.51% (0.3598 => 0.4444, std.dev.: 0.0291) MultiSource/Benchmarks/Bullet/bullet: 22.54% (33.2440 => 40.7368, std.dev.: 1.3192) MultiSource/Benchmarks/Prolangs-C++/city/city: 19.29% (1.4805 => 1.7661, std.dev.: 0.0858) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 18.82% (1.0986 => 1.3054, std.dev.: 0.0692) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.96% (0.0963 => 0.1136, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.93% (1.5131 => 1.7844, std.dev.: 0.0531) SingleSource/Benchmarks/Shootout-C++/ary2: 17.90% (0.2665 => 0.3142, std.dev.: 0.0150) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.14% (2.4519 => 2.8721, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.83% (0.0713 => 0.0833, std.dev.: 0.0045) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 16.39% (0.2618 => 0.3047, std.dev.: 0.0128) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.69% (1.8127 => 2.0972, std.dev.: 0.0435) MultiSource/Benchmarks/7zip/7zip-benchmark: 15.46% (44.1538 => 50.9783, std.dev.: 2.4543) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.47% (10.2703 => 11.7564, std.dev.: 0.5631) SingleSource/Benchmarks/Misc/ReedSolomon: 13.71% (0.2050 => 0.2331, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.59% (1.4110 => 1.5887, std.dev.: 0.0153) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.91% (23.5861 => 26.3954, std.dev.: 0.6690) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.82% (0.1955 => 0.2186, std.dev.: 0.0034) SingleSource/Benchmarks/Linpack/linpack-pc: 11.07% (0.2566 => 0.2850, std.dev.: 0.0037) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.60% (0.1274 => 0.1409, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 10.09% (1.4392 => 1.5844, std.dev.: 0.0454) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 8.98% (0.2372 => 0.2585, std.dev.: 0.0051) MultiSource/Applications/kimwitu++/kc: 8.02% (18.9377 => 20.4563, std.dev.: 0.3614) SingleSource/Benchmarks/Shootout-C++/ary3: 6.79% (0.2564 => 0.2738, std.dev.: 0.0056) SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.05% (0.5059 => 0.5365, std.dev.: 0.0069) MultiSource/Benchmarks/PAQ8p/paq8p: 5.91% (2.5772 => 2.7294, std.dev.: 0.0493) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.38% (0.2993 => 0.3124, std.dev.: 0.0022) MultiSource/Benchmarks/nbench/nbench: 2.23% (1.2708 => 1.2991, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107962.50% (0.0008 => 0.8645, std.dev.: 0.0242) SingleSource/Benchmarks/Shootout/ary3: 427.33% (2.2304 => 11.7615, std.dev.: 0.9544) SingleSource/Benchmarks/Shootout/matrix: 356.95% (1.5825 => 7.2313, std.dev.: 0.1791) MultiSource/Applications/sgefa/sgefa: 259.20% (0.3515 => 1.2626, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary2: 248.06% (0.0129 => 0.0449, std.dev.: 0.0037) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.53% (1.1825 => 4.0622, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 235.94% (4.8185 => 16.1872, std.dev.: 0.0646) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 194.30% (0.0228 => 0.0671, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/ary: 161.64% (0.0232 => 0.0607, std.dev.: 0.0059) MultiSource/Benchmarks/Olden/mst/mst: 112.41% (0.1491 => 0.3167, std.dev.: 0.0099) SingleSource/Benchmarks/Shootout-C++/matrix: 63.97% (2.9083 => 4.7687, std.dev.: 0.1474) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.08% (0.1622 => 0.2191, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 34.00% (0.2562 => 0.3433, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.78% (3.1254 => 4.1185, std.dev.: 0.0275) SingleSource/Regression/C/uint64_to_float: 25.09% (1.5397 => 1.9260, std.dev.: 0.0245) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.04% (1.4588 => 1.8241, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.32% (5.6033 => 6.9099, std.dev.: 0.0630) SingleSource/Benchmarks/Misc/salsa20: 22.07% (7.4497 => 9.0942, std.dev.: 0.2018) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.51% (4.8112 => 5.7978, std.dev.: 0.0767) MultiSource/Benchmarks/7zip/7zip-benchmark: 18.08% (9.0082 => 10.6365, std.dev.: 0.0616) MultiSource/Applications/JM/lencod/lencod: 15.25% (6.8159 => 7.8554, std.dev.: 0.1137) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.37% (5.1752 => 5.8672, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.12% (5.0033 => 5.6596, std.dev.: 0.0811) SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.85% (5.0421 => 5.6394, std.dev.: 0.2096) MultiSource/Benchmarks/Olden/voronoi/voronoi: 10.92% (0.3406 => 0.3778, std.dev.: 0.0104) MultiSource/Benchmarks/Olden/tsp/tsp: 8.08% (1.5017 => 1.6230, std.dev.: 0.0212) MultiSource/Benchmarks/llubenchmark/llu: 7.32% (2.0298 => 2.1783, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.05% (4.7473 => 5.0818, std.dev.: 0.0949) MultiSource/Benchmarks/MallocBench/espresso/espresso: 6.36% (0.6211 => 0.6606, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.66% (4.1836 => 4.4204, std.dev.: 0.0355) MultiSource/Benchmarks/Bullet/bullet: 4.45% (7.2040 => 7.5244, std.dev.: 0.0492) SingleSource/Benchmarks/Linpack/linpack-pc: 3.71% (50.8945 => 52.7809, std.dev.: 0.5433) SingleSource/Benchmarks/Misc/pi: 2.95% (2.1390 => 2.2021, std.dev.: 0.0061) MultiSource/Applications/lua/lua: 2.28% (29.0327 => 29.6938, std.dev.: 0.1015) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.34% (5.9115 => 5.9908, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/sieve: 1.13% (3.4656 => 3.5049, std.dev.: 0.0098) SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.01% (6.4534 => 6.5189, std.dev.: 0.0087) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -36.14% (0.0808 => 0.0516, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -31.36% (0.0727 => 0.0499, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.73% (11.5523 => 3.9590, std.dev.: 0.0359) SingleSource/Benchmarks/Misc/fp-convert: -61.84% (15.6525 => 5.9729, std.dev.: 0.1233) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.14% (0.4146 => 0.1860, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.58% (0.4578 => 0.2354, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.74% (11.3868 => 6.4062, std.dev.: 0.0728) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.86% (5.4023 => 3.6272, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.09% (0.4452 => 0.3068, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.46% (0.5495 => 0.4041, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.12% (5.2605 => 3.8866, std.dev.: 0.0290) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.93% (4.4467 => 3.3382, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.50% (0.5826 => 0.4457, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.07% (4.9921 => 3.8405, std.dev.: 0.1638) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -22.62% (0.5897 => 0.4563, std.dev.: 0.0289) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.25% (5.8755 => 4.8031, std.dev.: 0.0551) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.18% (7.0016 => 5.8686, std.dev.: 0.0822) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.44% (16.6791 => 14.1033, std.dev.: 0.2548) SingleSource/Benchmarks/Shootout/heapsort: -13.39% (4.4739 => 3.8749, std.dev.: 0.0257) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.90% (3.1921 => 2.7802, std.dev.: 0.0359) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.63% (5.3626 => 4.6854, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.24% (5.7056 => 5.0070, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.07% (9.7992 => 8.6160, std.dev.: 0.0855) SingleSource/Benchmarks/Shootout/hash: -9.13% (4.5259 => 4.1125, std.dev.: 0.0821) MultiSource/Benchmarks/mafft/pairlocalalign: -8.75% (63.1520 => 57.6258, std.dev.: 0.3408) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.45% (5.5974 => 5.2361, std.dev.: 0.1129) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.92% (4.5424 => 4.2733, std.dev.: 0.0558) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.07% (4.9799 => 4.7272, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.24% (3.5127 => 3.3637, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.42% (5.8973 => 5.6958, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.06% (3.5691 => 3.4600, std.dev.: 0.0153) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.53% (85.3042 => 84.0031, std.dev.: 0.0218) SingleSource/Benchmarks/Misc/mandel-2: -1.31% (0.8521 => 0.8409, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.16% (1.6251 => 1.6062, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (3.7450 => 3.7037, std.dev.: 0.0038) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 20.00% (1.2047 => 1.4456, std.dev.: 0.1090) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.86% (0.0233 => 0.0242, std.dev.: 0.0056) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.33% (0.0451 => 0.0445, std.dev.: 0.0130) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.68% (0.0394 => 0.0348, std.dev.: 0.0111) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.91% (0.0328 => 0.0331, std.dev.: 0.0079) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.80% (0.0445 => 0.0437, std.dev.: 0.0133) SingleSource/UnitTests/Vector/Altivec/casts: -0.47% (0.0213 => 0.0212, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: 1.76% (0.0227 => 0.0231, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.39% (0.0255 => 0.0254, std.dev.: 0.0064) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -4.18% (0.1530 => 0.1466, std.dev.: 0.0074) MultiSource/Applications/lemon/lemon: -30.48% (1.9293 => 1.3413, std.dev.: 0.4399) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 19.12% (0.4049 => 0.4823, std.dev.: 0.0252) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.20% (0.1510 => 0.1513, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.60% (0.0978 => 0.0669, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.10% (0.0590 => 0.0554, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 14.70% (1.1617 => 1.3325, std.dev.: 0.0657) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -70.37% (0.0027 => 0.0008, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.19% (0.0268 => 0.0365, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.57% (0.7437 => 1.7519, std.dev.: 0.0081) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 6.52% (0.0092 => 0.0098, std.dev.: 0.0041) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.22% (12.7781 => 34.4014, std.dev.: 0.2006) Report Time: 1.14s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 19:27:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 21:27:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130131032726.887E72A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8129?compare_to=8122&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8129, Order: 173981, Start Time: 2013-01-30 23:52:05, End Time: 2013-01-31 03:27:44 To: 8122, Order: 173943, Start Time: 2013-01-30 18:27:09, End Time: 2013-01-30 22:07:14 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (187 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/oggenc/oggenc: 1.28% (2.0061 => 2.0317, std.dev.: 0.0026) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary: 6.04% (0.2102 => 0.2229, std.dev.: 0.0029) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.94% (0.7922 => 0.7531, std.dev.: 0.0142) MultiSource/Applications/siod/siod: -1.41% (0.7539 => 0.7433, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -1.35% (14.2827 => 14.0902, std.dev.: 0.0535) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 52.00% (0.0625 => 0.0950, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 45.61% (0.0239 => 0.0348) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 38.95% (0.1063 => 0.1477, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.60% (0.4994 => 0.6622, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 31.16% (0.0475 => 0.0623, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 29.00% (0.1107 => 0.1428, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.97% (0.2969 => 0.3829, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.46% (0.4139 => 0.5317, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 27.97% (0.0547 => 0.0700, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.76% (0.1106 => 0.1413, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.73% (0.0714 => 0.0912, std.dev.: 0.0022) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.64% (0.5900 => 0.7531, std.dev.: 0.0142) MultiSource/Applications/oggenc/oggenc: 27.52% (1.5932 => 2.0317, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.99% (0.0452 => 0.0574, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 26.43% (0.0541 => 0.0684, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.20% (0.5000 => 0.6310, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.20% (0.0584 => 0.0737, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.05% (0.4253 => 0.5361, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.02% (0.0415 => 0.0523, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.82% (0.1549 => 0.1918, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.53% (0.1003 => 0.1239, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.38% (0.0633 => 0.0781, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.94% (0.1604 => 0.1972, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.94% (0.1103 => 0.1356, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.87% (0.0822 => 0.1010, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/health/health: 22.53% (0.0821 => 0.1006, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.47% (0.3903 => 0.4780, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 22.42% (0.1619 => 0.1982, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 21.82% (0.0582 => 0.0709, std.dev.: 0.0024) MultiSource/Applications/viterbi/viterbi: 21.65% (0.0947 => 0.1152, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.32% (0.1088 => 0.1320, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.16% (0.3890 => 0.4713, std.dev.: 0.0038) MultiSource/Benchmarks/McCat/08-main/main: 21.10% (0.1218 => 0.1475) MultiSource/Applications/aha/aha: 20.79% (0.0481 => 0.0581, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 20.70% (0.4029 => 0.4863, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.66% (0.1462 => 0.1764, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 20.63% (0.0698 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.56% (0.2014 => 0.2428, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.55% (0.2866 => 0.3455, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 20.54% (0.0808 => 0.0974, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.54% (0.2736 => 0.3298, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.43% (1.3152 => 1.5839, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.24% (0.3271 => 0.3933, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.76% (0.0572 => 0.0685, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 19.75% (1.8794 => 2.2505, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 19.35% (0.5546 => 0.6619, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: 19.21% (0.5826 => 0.6945, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.14% (0.5026 => 0.5988, std.dev.: 0.0052) SingleSource/UnitTests/ObjC++/property-reference-object: 18.95% (0.5889 => 0.7005, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: 18.87% (0.9697 => 1.1527, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.85% (0.4658 => 0.5536, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/bh/bh: 18.85% (0.1284 => 0.1526, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.70% (3.5627 => 4.2289, std.dev.: 0.0044) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.64% (1.6211 => 1.9232, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.57% (0.2875 => 0.3409, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.55% (0.1968 => 0.2333, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.34% (0.2792 => 0.3304, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 18.32% (0.2811 => 0.3326, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 18.18% (0.7171 => 0.8475, std.dev.: 0.0039) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 18.15% (1.9966 => 2.3589, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/matrix: 18.09% (0.2780 => 0.3283, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 18.03% (0.2823 => 0.3332, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/strcat: 18.00% (0.2750 => 0.3245, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 17.95% (0.2803 => 0.3306, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hello: 17.91% (0.2714 => 0.3200, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.90% (0.2738 => 0.3228, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 17.80% (0.2725 => 0.3210, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 17.74% (0.2813 => 0.3312, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.74% (0.3930 => 0.4627, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.70% (0.2729 => 0.3212, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.64% (2.0673 => 2.4320, std.dev.: 0.0010) MultiSource/Applications/d/make_dparser: 17.61% (1.0781 => 1.2679, std.dev.: 0.0068) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.59% (0.2911 => 0.3423, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 17.54% (0.3096 => 0.3639, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.49% (1.9694 => 2.3139, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.40% (0.4361 => 0.5120, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: 17.40% (0.9909 => 1.1633, std.dev.: 0.0059) SingleSource/Regression/C++/ofstream_ctor: 17.24% (0.3004 => 0.3522, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 17.17% (0.3267 => 0.3828, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: 17.16% (0.3258 => 0.3817, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sieve: 17.15% (0.3726 => 0.4365, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.12% (0.3195 => 0.3742, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.06% (0.3060 => 0.3582, std.dev.: 0.0008) MultiSource/Applications/ClamAV/clamscan: 16.95% (4.2109 => 4.9247, std.dev.: 0.0352) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.91% (2.7292 => 3.1906, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 16.76% (0.3317 => 0.3873, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.71% (4.4195 => 5.1581, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.65% (0.3124 => 0.3644, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 16.61% (23.5202 => 27.4274, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/lists1: 16.59% (0.3477 => 0.4054, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.58% (0.3282 => 0.3826, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.54% (0.3362 => 0.3918, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.51% (0.1090 => 0.1270, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 16.43% (0.3348 => 0.3898, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.39% (0.3625 => 0.4219, std.dev.: 0.0010) MultiSource/Applications/lua/lua: 16.32% (1.4269 => 1.6597, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/exceptions-2: 16.16% (0.3446 => 0.4003, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.15% (0.3981 => 0.4624, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/moments: 16.15% (0.3678 => 0.4272, std.dev.: 0.0009) MultiSource/Benchmarks/nbench/nbench: 16.13% (0.2566 => 0.2980, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/for-in: 16.13% (0.3496 => 0.4060, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/hash: 16.11% (0.4146 => 0.4814, std.dev.: 0.0097) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.08% (0.3488 => 0.4049, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 16.08% (0.3465 => 0.4022, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 16.04% (0.3460 => 0.4015, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: 16.00% (0.3469 => 0.4024, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.98% (0.3442 => 0.3992, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.91% (0.3690 => 0.4277, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 15.88% (0.4251 => 0.4926, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/property: 15.73% (0.3650 => 0.4224, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 15.59% (0.3643 => 0.4211, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 15.52% (0.3724 => 0.4302, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.45% (0.0673 => 0.0777) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.32% (0.3845 => 0.4434, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 15.31% (0.7875 => 0.9081, std.dev.: 0.0114) SingleSource/Benchmarks/Misc-C++/bigfib: 15.12% (0.5012 => 0.5770, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.69% (0.1028 => 0.1179, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 14.59% (5.5417 => 6.3505, std.dev.: 0.0242) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.55% (0.6435 => 0.7371, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 14.22% (0.2068 => 0.2362, std.dev.: 0.0017) MultiSource/Applications/JM/ldecod/ldecod: 14.20% (2.1653 => 2.4727, std.dev.: 0.0225) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.96% (0.2737 => 0.3119, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 13.75% (0.2691 => 0.3061, std.dev.: 0.0017) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 13.68% (4.6177 => 5.2496, std.dev.: 0.0348) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.50% (0.2103 => 0.2387, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 13.40% (0.2075 => 0.2353, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: 13.40% (2.1013 => 2.3828, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.08% (0.5361 => 0.6062, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.06% (0.0804 => 0.0909, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.78% (0.3498 => 0.3945, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.71% (0.3084 => 0.3476, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.63% (11.6398 => 13.1097, std.dev.: 0.0091) MultiSource/Applications/minisat/minisat: 12.44% (0.3336 => 0.3751, std.dev.: 0.0006) MultiSource/Applications/siod/siod: 12.04% (0.6634 => 0.7433, std.dev.: 0.0017) MultiSource/Benchmarks/PAQ8p/paq8p: 11.99% (0.4847 => 0.5428, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.96% (0.2040 => 0.2284, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.59% (0.7426 => 0.8287, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 10.56% (0.1383 => 0.1529, std.dev.: 0.0013) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.43% (4.6926 => 5.1821, std.dev.: 0.0026) MultiSource/Applications/sqlite3/sqlite3: 9.86% (2.0346 => 2.2353, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.15% (0.5584 => 0.6095, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 8.48% (11.9555 => 12.9697, std.dev.: 0.0117) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.75% (0.3792 => 0.4048, std.dev.: 0.0008) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.82% (29.0505 => 181.5144, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.71% (0.0734 => 0.0842) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0091) MultiSource/Applications/ClamAV/clamscan: 11.53% (0.2802 => 0.3125, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.70% (0.3693 => 0.4088, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6101, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6743, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/flops: 5.13% (15.4430 => 16.2357, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary: 5.04% (0.2122 => 0.2229, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6803, std.dev.: 0.0064) SingleSource/Benchmarks/Misc/flops-2: 4.57% (1.8057 => 1.8882, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5015, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 2.82% (0.6276 => 0.6453, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 2.06% (15.8721 => 16.1985, std.dev.: 0.0063) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.48% (7.1849 => 7.2911, std.dev.: 0.0018) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3068, std.dev.: 0.0043) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 1.18% (4.0317 => 4.0792, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.15% (1.0927 => 1.1053, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5398, std.dev.: 0.0005) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.10% (3.1722 => 3.2071, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6858, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5902, std.dev.: 0.0047) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.03% (1.2451 => 1.2579, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.03% (10.3705 => 10.4769, std.dev.: 0.0027) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.16% (2.4764 => 2.4228, std.dev.: 0.0055) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5671, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -18.26% (17.2379 => 14.0902, std.dev.: 0.0535) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9752, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8038, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/tsp/tsp: -7.30% (2.1113 => 1.9571, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.78% (1.5554 => 1.4810, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.74% (41.7953 => 40.2316, std.dev.: 0.0042) SingleSource/Benchmarks/Dhrystone/dry: -3.71% (14.0481 => 13.5273, std.dev.: 0.0616) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.61% (11.2080 => 10.8031, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.07% (0.6293 => 0.6100, std.dev.: 0.0032) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7733, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.12% (197.4719 => 193.2928, std.dev.: 0.0619) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.75% (10.7630 => 10.5750, std.dev.: 0.0041) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5003, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7160, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.19% (105.3826 => 104.1264, std.dev.: 0.0293) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.03% (16.2163 => 16.0490, std.dev.: 0.0014) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.21s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 19:57:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 21:57:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131035740.4B9052A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8130?compare_to=8127&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8130, Order: 174023, Start Time: 2013-01-31 02:23:58, End Time: 2013-01-31 03:58:02 To: 8127, Order: 173994, Start Time: 2013-01-31 00:26:10, End Time: 2013-01-31 02:00:19 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (124 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 71.41% (0.0717 => 0.1229, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.04% (0.0974 => 0.1627, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.49% (0.1132 => 0.1613, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.98% (0.6395 => 0.8824, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.31% (0.6395 => 0.8717, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.76% (0.5805 => 0.7707, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.68% (0.5688 => 0.7547, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.55% (0.5456 => 0.7232, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.54% (0.6260 => 0.8297, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.14% (0.5567 => 0.7356, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.96% (0.6230 => 0.8221, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.95% (0.5849 => 0.7718, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.95% (0.5575 => 0.7356, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.88% (0.5581 => 0.7360, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.13% (0.5802 => 0.7608, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.03% (1.6474 => 2.1586, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.75% (0.5941 => 0.7768, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.62% (0.5705 => 0.7452, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.38% (0.5570 => 0.7262, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.15% (0.5857 => 0.7623, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.13% (0.5569 => 0.7247, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.07% (0.5478 => 0.7125, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.04% (0.5859 => 0.7619, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.00% (0.6033 => 0.7843, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.64% (0.5591 => 0.7248, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.58% (0.6440 => 0.8345, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.08% (0.5925 => 0.7648, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.81% (0.6189 => 0.7972, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.40% (0.5863 => 0.7528, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.13% (0.6304 => 0.8077, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.99% (0.6052 => 0.7746, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.75% (0.6446 => 0.8235, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.26% (0.6681 => 0.8502, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.17% (0.6194 => 0.7877, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.85% (0.6660 => 0.8448, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.66% (0.6297 => 0.7976, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.35% (0.6667 => 0.8357, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.04% (0.0699 => 0.0874, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.40% (0.0582 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.7524 => 0.9335, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.39% (2.2587 => 2.7870, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.15% (0.7339 => 0.9038, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.22% (0.0693 => 0.0847, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.71% (0.0556 => 0.0660, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.52% (0.0621 => 0.0736, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.20% (0.0566 => 0.0669, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.89% (0.0833 => 0.0982) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.36% (0.1146 => 0.1345, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.32% (0.3357 => 0.3905, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.88% (0.0680 => 0.0788, std.dev.: 0.0008) MultiSource/Applications/lemon/lemon: 15.69% (1.1450 => 1.3246, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.80% (0.1081 => 0.1241, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.87% (0.1982 => 0.2257, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.79% (4.5069 => 5.0834, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.53% (0.4916 => 0.5532, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.52% (1.6364 => 1.8413, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 12.20% (0.4515 => 0.5066, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.15% (3.5339 => 3.9633, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.30% (0.1230 => 0.1369, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.61% (0.2385 => 0.2638, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.13% (9.2283 => 10.1627, std.dev.: 0.0087) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.30% (0.1731 => 0.1892, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.18% (0.5329 => 0.5818, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 9.09% (1.2515 => 1.3652, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.90% (0.7021 => 0.7646, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 8.55% (0.4524 => 0.4911, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.40% (0.2001 => 0.2169, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.17% (0.4861 => 0.5258, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.95% (1.2784 => 1.3800, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.71% (1.4642 => 1.5771, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.76% (0.6750 => 0.7206, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.96% (0.3255 => 0.3449, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.79% (5.4682 => 5.7849, std.dev.: 0.0043) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.42% (0.3319 => 0.3499, std.dev.: 0.0044) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.77% (22.4056 => 23.4735, std.dev.: 0.0119) MultiSource/Applications/oggenc/oggenc: 4.25% (5.0226 => 5.2363, std.dev.: 0.0132) MultiSource/Applications/SPASS/SPASS: 3.60% (15.5079 => 16.0658, std.dev.: 0.0195) MultiSource/Applications/minisat/minisat: 3.50% (0.7447 => 0.7708, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.49% (0.9557 => 0.9891, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.48% (1.3864 => 1.4346, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 3.18% (0.3394 => 0.3502, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.09% (0.3491 => 0.3599, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 3.09% (0.8418 => 0.8678, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.80% (0.4427 => 0.4551, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.44% (0.5168 => 0.5294, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.36% (1.3722 => 1.4046, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.80% (0.6293 => 0.6406, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: 1.70% (18.2933 => 18.6042, std.dev.: 0.0137) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.49% (1.2300 => 1.2483, std.dev.: 0.0008) MultiSource/Applications/d/make_dparser: 1.36% (3.5154 => 3.5631, std.dev.: 0.0033) MultiSource/Applications/treecc/treecc: 1.14% (2.1401 => 2.1646, std.dev.: 0.0042) MultiSource/Benchmarks/Bullet/bullet: 1.06% (34.0927 => 34.4539, std.dev.: 0.0119) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8041, std.dev.: 0.0127) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.54% (0.9531 => 1.0250, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 7.29% (0.5692 => 0.6107, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.05% (1.2783 => 1.3684, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5045, std.dev.: 0.0975) SingleSource/Benchmarks/Misc-C++/bigfib: 3.03% (0.3328 => 0.3429, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.72% (2.0478 => 2.1035, std.dev.: 0.0072) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3026, std.dev.: 0.0021) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.54% (18.2231 => 18.5031, std.dev.: 0.0185) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5320 => 4.5986, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.14% (3.6551 => 3.6966, std.dev.: 0.0046) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.12% (10.3489 => 10.4645, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/objinst: -4.63% (0.3194 => 0.3046, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.56% (0.7198 => 0.6870, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.28% (0.3812 => 0.3649, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.25% (0.3831 => 0.3668, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: -4.24% (0.3848 => 0.3685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.23% (0.3880 => 0.3716, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.20% (0.3884 => 0.3721, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: -4.13% (0.3896 => 0.3735, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.97% (0.4033 => 0.3873, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.81% (0.4176 => 0.4017, std.dev.: 0.0013) SingleSource/UnitTests/ObjC++/Hello: -3.77% (0.6347 => 0.6108, std.dev.: 0.0010) MultiSource/Benchmarks/PAQ8p/paq8p: -3.74% (2.4924 => 2.3993, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3821 => 0.3681, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: -3.45% (0.6441 => 0.6219, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.26% (0.3837 => 0.3712, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.18% (0.9852 => 0.9539, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -3.07% (0.4199 => 0.4070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.07% (0.3323 => 0.3221, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference: -2.84% (0.7779 => 0.7558, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/parameter-passing: -2.66% (0.4280 => 0.4166, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.65% (2.1713 => 2.1138, std.dev.: 0.0125) MultiSource/Applications/hexxagon/hexxagon: -2.58% (1.3148 => 1.2809, std.dev.: 0.0010) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2694, std.dev.: 0.0124) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.38% (0.6484 => 0.6330, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.37% (0.9542 => 0.9316, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.83% (14.2083 => 13.9479, std.dev.: 0.0125) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.22% (6.7716 => 6.6887, std.dev.: 0.0007) MultiSource/Applications/JM/lencod/lencod: -1.06% (16.1920 => 16.0209, std.dev.: 0.0143) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.03% (1.0544 => 1.0435, std.dev.: 0.0005) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.80% (1.8100 => 0.6914, std.dev.: 0.0210) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0012) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3122, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.56% (1.3643 => 1.0292, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: -23.37% (7.5137 => 5.7580, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.86% (83.5423 => 64.4480, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.92% (4.1024 => 3.2030, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1722, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -16.97% (0.3418 => 0.2838, std.dev.: 0.0010) SingleSource/UnitTests/Vector/multiplies: -15.14% (2.5106 => 2.1306, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3542, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.82% (0.5142 => 0.4637, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.05% (4.1534 => 3.8192, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.92% (2.2633 => 2.1746, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.37% (1.0557 => 1.0201, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4009, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.79% (1.3096 => 1.2730, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout/ary3: -2.68% (3.7241 => 3.6242, std.dev.: 0.0073) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.64% (7.9763 => 7.7654, std.dev.: 0.0137) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0000) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1721, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4714, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.42% (1.6219 => 1.5989, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.35% (1.6307 => 1.6087, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7092 => 3.6638, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.00% (1.6086 => 1.5925, std.dev.: 0.0009) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.05s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 20:19:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 22:19:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131041931.DA8CE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8131?compare_to=8126&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8131, Order: 174019, Start Time: 2013-01-31 02:07:57, End Time: 2013-01-31 04:19:54 To: 8126, Order: 173984, Start Time: 2013-01-30 23:24:58, End Time: 2013-01-31 01:37:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (227 on baseline) Performance Improvements: 0 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 2.19% (11.0781 => 11.3208, std.dev.: 0.0023) MultiSource/Applications/JM/lencod/lencod: 1.87% (30.8450 => 31.4228, std.dev.: 0.0245) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1326 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0418 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.44% (0.0656 => 0.0672, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8514 => 499.8386, std.dev.: 0.0182) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44223.72% (1.1277 => 499.8386, std.dev.: 0.0182) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.41% (0.5229 => 1.7068, std.dev.: 0.0107) MultiSource/Applications/SPASS/SPASS: 26.15% (14.9895 => 18.9095, std.dev.: 0.0058) MultiSource/Applications/kimwitu++/kc: 47.64% (14.1553 => 20.8992, std.dev.: 0.0070) MultiSource/Benchmarks/MallocBench/gs/gs: 20.63% (4.1105 => 4.9585, std.dev.: 0.0105) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.94% (1.1048 => 1.7891, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 450.41% (7.1582 => 39.3996, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.13% (3.4629 => 6.5839, std.dev.: 0.0040) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.84% (0.6222 => 1.1376, std.dev.: 0.0014) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.03% (0.0720 => 7.4405, std.dev.: 0.0131) MultiSource/Applications/SIBsim4/SIBsim4: 3833300.00% (0.0001 => 3.8334, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11093000.00% (0.0001 => 11.0931, std.dev.: 0.0589) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576300.00% (0.0001 => 0.5764, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494800.00% (0.0001 => 5.4949, std.dev.: 0.0108) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.27% (1.1194 => 10.2903, std.dev.: 0.0071) MultiSource/Applications/ClamAV/clamscan: 150.51% (22.1758 => 55.5523, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/lowercase: 132.03% (0.0256 => 0.0594, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.37% (0.0929 => 0.1880, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 80.52% (0.1463 => 0.2641, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.60% (1.5859 => 2.4994, std.dev.: 0.0057) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.04% (2.9384 => 4.6145, std.dev.: 0.0075) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 56.43% (7.0540 => 11.0344, std.dev.: 0.0004) SingleSource/Regression/C/sumarray: 55.84% (0.0231 => 0.0360, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/distray/distray: 53.60% (0.1056 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.75% (8.1363 => 12.1838, std.dev.: 0.0070) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.43% (0.0439 => 0.0656, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.52% (2.2024 => 3.2269, std.dev.: 0.0028) MultiSource/Applications/sgefa/sgefa: 45.51% (0.3109 => 0.4524, std.dev.: 0.0004) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 43.24% (21.9371 => 31.4228, std.dev.: 0.0245) SingleSource/Benchmarks/Misc/flops: 41.69% (0.1432 => 0.2029, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.30% (0.1062 => 0.1490, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.34% (1.5415 => 2.1325, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.60% (4.2646 => 5.8681, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/exptree: 36.00% (0.0814 => 0.1107, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.97% (0.4615 => 0.6275, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.49% (0.2271 => 0.3077, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.02% (0.5105 => 0.6893, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.59% (0.6675 => 0.8917, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.30% (0.1892 => 0.2522, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 33.28% (1.1642 => 1.5516, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/05-eks/eks: 32.50% (0.4299 => 0.5696, std.dev.: 0.0030) MultiSource/Benchmarks/NPB-serial/is/is: 32.41% (0.0719 => 0.0952, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/chomp: 31.66% (0.1655 => 0.2179, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/Oscar: 31.45% (0.0636 => 0.0836, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.86% (0.1695 => 0.2218, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 30.56% (9.4845 => 12.3825, std.dev.: 0.0027) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.26% (0.0793 => 0.1033, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.89% (3.8922 => 5.0555, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.44% (0.0479 => 0.0620, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.07% (0.1125 => 0.1452, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.95% (0.0746 => 0.0962, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 28.74% (1.0722 => 1.3804, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 28.45% (0.0457 => 0.0587, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/08-main/main: 28.43% (0.2554 => 0.3280, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 28.03% (0.4289 => 0.5491, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.99% (1.4186 => 1.8156, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 27.14% (0.4620 => 0.5874, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 27.06% (0.7115 => 0.9040, std.dev.: 0.0045) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.96% (0.0408 => 0.0518, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: 26.72% (0.1175 => 0.1489, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.59% (0.3121 => 0.3951, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.55% (0.1906 => 0.2412, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.48% (0.1337 => 0.1691, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.42% (0.1143 => 0.1445) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.19% (0.0672 => 0.0848, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.18% (0.1566 => 0.1976, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 26.10% (0.6456 => 0.8141, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.89% (0.0730 => 0.0919, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.77% (0.0842 => 0.1059, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.72% (0.5020 => 0.6311, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout/hash: 25.36% (0.0485 => 0.0608) SingleSource/Benchmarks/Misc/whetstone: 25.15% (0.0660 => 0.0826, std.dev.: 0.0008) MultiSource/Applications/viterbi/viterbi: 24.76% (0.1555 => 0.1940, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.74% (1.3050 => 1.6279, std.dev.: 0.0059) MultiSource/Benchmarks/McCat/15-trie/trie: 24.67% (0.0527 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.67% (0.2700 => 0.3366, std.dev.: 0.0073) MultiSource/Applications/spiff/spiff: 24.53% (0.7835 => 0.9757, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.51% (0.1236 => 0.1539, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.34% (0.0871 => 0.1083, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/lists: 24.28% (0.0626 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.27% (0.0886 => 0.1101, std.dev.: 0.0003) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.22% (0.1032 => 0.1282, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.88% (5.7591 => 7.1345, std.dev.: 0.0114) MultiSource/Applications/d/make_dparser: 23.74% (3.3354 => 4.1272, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 23.67% (1.1840 => 1.4643, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/messages-2: 23.56% (0.0662 => 0.0818, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.42% (0.1029 => 0.1270, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.40% (0.0953 => 0.1176) MultiSource/Applications/aha/aha: 23.37% (0.1151 => 0.1420, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.26% (0.0675 => 0.0832, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.88% (0.5860 => 0.7201, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/mst/mst: 22.87% (0.1163 => 0.1429, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/em3d/em3d: 22.65% (0.1695 => 0.2079, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.65% (0.3307 => 0.4056, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.53% (0.1940 => 0.2377, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.29% (4.9449 => 6.0470, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 22.18% (0.3098 => 0.3785, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.12% (0.1510 => 0.1844) SingleSource/Benchmarks/Misc/ReedSolomon: 22.01% (0.2049 => 0.2500, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.89% (0.8172 => 0.9961, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/bisort/bisort: 21.82% (0.0614 => 0.0748, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 21.71% (0.8921 => 1.0858, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 21.53% (0.3423 => 0.4160, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.53% (0.1584 => 0.1925, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.46% (5.0018 => 6.0752, std.dev.: 0.0029) MultiSource/Benchmarks/BitBench/five11/five11: 21.34% (0.0567 => 0.0688, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 21.33% (2.0273 => 2.4597, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.31% (0.2107 => 0.2556, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.21% (0.0528 => 0.0640, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.10% (0.2758 => 0.3340, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.79% (1.1861 => 1.4327, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.76% (0.9765 => 1.1792, std.dev.: 0.0005) SingleSource/UnitTests/SignlessTypes/rem: 20.63% (0.1144 => 0.1380, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.60% (0.6450 => 0.7779, std.dev.: 0.0015) MultiSource/Applications/lua/lua: 20.45% (3.8723 => 4.6640, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.31% (0.5569 => 0.6700, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.96% (0.1117 => 0.1340, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 19.92% (0.7433 => 0.8914, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.83% (0.0933 => 0.1118, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.74% (0.0770 => 0.0922, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 19.72% (0.1268 => 0.1518, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 19.22% (2.2969 => 2.7384, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.22% (0.0770 => 0.0918, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.06% (0.0834 => 0.0993, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.06% (0.8101 => 0.9645, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.06% (0.4203 => 0.5004, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.88% (0.5981 => 0.7110, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: 18.80% (0.0633 => 0.0752, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.71% (0.2603 => 0.3090, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.63% (0.3441 => 0.4082, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.26% (0.2065 => 0.2442, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 17.97% (0.0818 => 0.0965, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.82% (0.1044 => 0.1230, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 17.79% (0.3283 => 0.3867, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 17.36% (0.3232 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 17.33% (0.3180 => 0.3731, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 17.23% (0.0592 => 0.0694, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 16.92% (0.3387 => 0.3960, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.76% (0.0704 => 0.0822, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.72% (0.8067 => 0.9416, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/ary2: 16.04% (0.3379 => 0.3921, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.99% (0.0838 => 0.0972) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.96% (0.4636 => 0.5376, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.81% (0.3865 => 0.4476, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 15.61% (17.1811 => 19.8624, std.dev.: 0.0064) MultiSource/Applications/hbd/hbd: 14.91% (1.5603 => 1.7929, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 14.48% (0.4048 => 0.4634, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.09% (0.4103 => 0.4681, std.dev.: 0.0002) SingleSource/Regression/C++/ofstream_ctor: 14.08% (0.2905 => 0.3314, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.86% (0.3282 => 0.3737, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists: 13.82% (0.3422 => 0.3895, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists1: 13.63% (0.3684 => 0.4186, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 13.52% (0.3603 => 0.4090, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 13.49% (0.3092 => 0.3509, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.42% (14.3668 => 16.2946, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.22% (0.3427 => 0.3880, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.13% (0.2430 => 0.2749, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.94% (0.4064 => 0.4590, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 12.66% (0.3927 => 0.4424, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.52% (0.3826 => 0.4305, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.39% (0.1114 => 0.1252, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/property: 12.35% (0.3886 => 0.4366, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: 11.49% (0.3828 => 0.4268, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.18% (0.3694 => 0.4107, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: 11.14% (0.3473 => 0.3860, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 11.06% (0.3543 => 0.3935, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/synchronized: 10.98% (0.3561 => 0.3952, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 10.98% (0.3543 => 0.3932, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-2: 10.92% (0.3497 => 0.3879, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 10.84% (0.3516 => 0.3897, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 10.81% (0.2831 => 0.3137, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 10.55% (0.2871 => 0.3174, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.34% (0.3935 => 0.4342, std.dev.: 0.0003) MultiSource/Applications/hexxagon/hexxagon: 10.17% (1.2842 => 1.4148, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 10.07% (63.2438 => 69.6119, std.dev.: 0.0210) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.07% (2.0665 => 2.2745, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/methcall: 9.98% (0.2877 => 0.3164, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.84% (0.3650 => 0.4009, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.76% (0.2756 => 0.3025, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.61% (0.3162 => 0.3466, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.54% (0.1625 => 0.1780, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 9.50% (0.2725 => 0.2984, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.49% (0.2793 => 0.3058, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.47% (0.3136 => 0.3433, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.40% (0.3052 => 0.3339, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.37% (0.2891 => 0.3162, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.32% (0.2714 => 0.2967, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 9.24% (0.6030 => 0.6587, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: 9.20% (10.3673 => 11.3208, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.16% (0.2872 => 0.3135, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.04% (2.2022 => 2.4013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 8.99% (0.2802 => 0.3054, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 8.71% (0.7326 => 0.7964, std.dev.: 0.0031) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.30% (0.2266 => 0.2454, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/Hello: 8.20% (0.5925 => 0.6411, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.60% (0.4879 => 0.5250, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.40% (0.3177 => 0.3412, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0010) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.28% (7.9617 => 8.3025, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/block-byref-aggr: 3.59% (0.3817 => 0.3954, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4745, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.06% (1.1145 => 1.2935, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6961, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 12.97% (0.5413 => 0.6115, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.82% (11.6436 => 12.5547, std.dev.: 0.1527) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.17% (4.2280 => 4.4466, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3114, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.11% (0.9957 => 1.0267, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.74% (8.6802 => 8.9177, std.dev.: 0.0079) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.49% (3.6395 => 3.7300, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0004) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 1.89% (9.1159 => 9.2879, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bisort/bisort: 1.88% (0.8333 => 0.8490, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3097, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/tsp/tsp: 1.41% (1.0785 => 1.0937, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1477, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1760, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/salsa20: -74.85% (0.8651 => 0.2176, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.29% (0.1622 => 0.0936, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.48% (5.3855 => 4.4979, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.77% (5.3526 => 4.5084, std.dev.: 0.0068) MultiSource/Applications/JM/ldecod/ldecod: -11.75% (10.4361 => 9.2097, std.dev.: 0.0169) SingleSource/UnitTests/Vector/constpool: -7.78% (54.1659 => 49.9497, std.dev.: 0.0234) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.35% (1.7609 => 1.6315, std.dev.: 0.0022) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.63% (1.9577 => 0.6729, std.dev.: 0.0034) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3078, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -33.76% (1.5373 => 1.0183, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/mandel: -33.47% (1.1492 => 0.7646, std.dev.: 0.0014) MultiSource/Benchmarks/Bullet/bullet: -30.60% (10.7105 => 7.4336, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1367, std.dev.: 0.0042) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0038, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.94% (2.6778 => 2.0904, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.40% (0.0757 => 0.0595, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops-6: -15.99% (1.6925 => 1.4219, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7348, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4929, std.dev.: 0.0073) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.01% (1.8329 => 1.7044, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.77% (19.9488 => 18.5982, std.dev.: 0.0102) SingleSource/Benchmarks/McGill/chomp: -6.52% (1.2373 => 1.1566, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.66% (8.1563 => 7.6947, std.dev.: 0.0071) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.63% (1.6805 => 1.5859, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161) SingleSource/Benchmarks/Misc/flops-5: -4.73% (1.5835 => 1.5086, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7995, std.dev.: 0.0037) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.55% (0.4808 => 0.4589, std.dev.: 0.0031) MultiSource/Applications/siod/siod: -3.85% (3.2827 => 3.1563, std.dev.: 0.0017) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -2.08% (1.0554 => 1.0335, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.6994 => 3.6274, std.dev.: 0.0231) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6758, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: -1.75% (3.7221 => 3.6570, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/lists: -1.59% (12.5348 => 12.3360, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: -1.26% (6.2999 => 6.2205, std.dev.: 0.0086) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8582, std.dev.: 0.0005) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.24% (0.2116 => 0.0672, std.dev.: 0.0015) Report Time: 1.46s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 21:55:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Wed, 30 Jan 2013 23:55:36 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131055536.7AE3E2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8132?compare_to=8130&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8132, Order: 174035, Start Time: 2013-01-31 04:21:55, End Time: 2013-01-31 05:55:58 To: 8130, Order: 174023, Start Time: 2013-01-31 02:23:58, End Time: 2013-01-31 03:58:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (121 on baseline) Performance Improvements: 0 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC++/property-reference: 1.44% (0.7558 => 0.7667, std.dev.: 0.0001) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.32% (0.0974 => 0.1620, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.14% (0.6395 => 0.8834, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.15% (0.6395 => 0.8707, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.64% (0.5456 => 0.7237, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.38% (0.6260 => 0.8287, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.27% (0.5581 => 0.7382, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.23% (0.5567 => 0.7361, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.11% (0.5575 => 0.7365, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.99% (0.5849 => 0.7720, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.83% (0.6230 => 0.8213, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.04% (0.5802 => 0.7603, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.74% (0.5705 => 0.7459, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.67% (1.6474 => 2.1527, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.55% (0.5941 => 0.7756, std.dev.: 0.0057) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.26% (0.5859 => 0.7632, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.17% (0.5569 => 0.7249, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.10% (0.5857 => 0.7620, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.08% (0.5478 => 0.7126, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.00% (0.6033 => 0.7843, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.76% (0.5591 => 0.7255, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.55% (0.6440 => 0.8343, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.10% (0.5925 => 0.7649, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.83% (0.6189 => 0.7973, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.37% (0.6676 => 0.8570, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.36% (0.5863 => 0.7526, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.16% (0.6304 => 0.8079, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.94% (0.6052 => 0.7743, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.86% (0.6446 => 0.8242, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.24% (0.6194 => 0.7881, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.18% (0.6681 => 0.8497, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.92% (0.6660 => 0.8453, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.62% (0.6297 => 0.7973, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.14% (0.6667 => 0.8343, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.89% (0.0699 => 0.0873, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.7524 => 0.9335, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.10% (0.7339 => 0.9034, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.99% (2.2587 => 2.7780, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.47% (0.0445 => 0.0545) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.54% (0.1146 => 0.1347, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.32% (0.3357 => 0.3905, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.56% (1.1450 => 1.3232, std.dev.: 0.0070) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.72% (0.1982 => 0.2254, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.86% (4.5069 => 5.0866, std.dev.: 0.0067) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.66% (1.6364 => 1.8435, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.55% (0.4916 => 0.5533, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.07% (3.5339 => 3.9603, std.dev.: 0.0054) MultiSource/Benchmarks/McCat/05-eks/eks: 11.87% (0.4515 => 0.5051, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.99% (0.2385 => 0.2647, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 10.25% (9.2283 => 10.1742, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.24% (0.1731 => 0.1891, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.21% (0.5329 => 0.5820, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 8.97% (1.2515 => 1.3637, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout-C++/hash: 8.95% (0.4524 => 0.4929, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.87% (0.7021 => 0.7644, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.55% (0.2001 => 0.2172, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4861 => 0.5269, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.13% (1.2784 => 1.3823, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.4642 => 1.5750, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/bigfib: 7.11% (0.6750 => 0.7230, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.57% (0.3255 => 0.3469, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.76% (5.4682 => 5.7831, std.dev.: 0.0167) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.39% (0.3319 => 0.3498, std.dev.: 0.0007) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.70% (22.4056 => 23.4583, std.dev.: 0.0179) SingleSource/Benchmarks/Shootout-C++/ary3: 4.00% (0.3446 => 0.3584, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: 3.85% (5.0226 => 5.2160, std.dev.: 0.0059) MultiSource/Applications/minisat/minisat: 3.80% (0.7447 => 0.7730, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 3.68% (0.3394 => 0.3519, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 3.58% (15.5079 => 16.0636, std.dev.: 0.0208) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.3864 => 1.4329, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.35% (0.3491 => 0.3608, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.28% (0.4427 => 0.4572, std.dev.: 0.0003) MultiSource/Applications/spiff/spiff: 3.20% (0.8418 => 0.8687, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.52% (0.5168 => 0.5298, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.33% (1.3722 => 1.4042, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.72% (1.2300 => 1.2512, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.70% (0.6293 => 0.6400, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.55% (34.0927 => 34.6214, std.dev.: 0.0089) MultiSource/Applications/d/make_dparser: 1.43% (3.5154 => 3.5657, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 1.36% (18.2933 => 18.5417, std.dev.: 0.0067) MultiSource/Applications/treecc/treecc: 1.13% (2.1401 => 2.1642, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 1.07% (1.1530 => 1.1653, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8109, std.dev.: 0.0064) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.61% (0.9531 => 1.0352, std.dev.: 0.0025) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.73% (54.5751 => 56.6105, std.dev.: 0.1290) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.95% (2.0478 => 2.1083, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3045, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.48% (18.2231 => 18.4923, std.dev.: 0.0177) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5970, std.dev.: 0.0048) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0004) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.94% (0.1281 => 0.1128, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.42% (0.7198 => 0.6880, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/objinst: -4.38% (0.3194 => 0.3054, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -3.57% (0.3812 => 0.3676, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -3.50% (0.3831 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.45% (0.3880 => 0.3746, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: -3.44% (0.3896 => 0.3762, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.43% (0.9852 => 0.9514, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.38% (0.3848 => 0.3718, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/for-in: -3.35% (0.4033 => 0.3898, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.25% (0.3821 => 0.3697, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.24% (0.3891 => 0.3765, std.dev.: 0.0008) MultiSource/Benchmarks/PAQ8p/paq8p: -3.23% (2.4924 => 2.4119, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.21% (0.4176 => 0.4042, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.08% (0.3837 => 0.3719, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.99% (0.3884 => 0.3768, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.58% (0.9542 => 0.9296, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/property: -2.55% (0.4199 => 0.4092, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.30% (0.6441 => 0.6293, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.18% (2.1713 => 2.1240, std.dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: -2.15% (1.3148 => 1.2865, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.05% (0.6484 => 0.6351, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.01% (20.7746 => 20.3575, std.dev.: 0.0199) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.51% (14.2083 => 13.9937, std.dev.: 0.0126) SingleSource/UnitTests/ObjC++/property-reference: -1.44% (0.7779 => 0.7667, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.03% (1.0544 => 1.0435, std.dev.: 0.0006) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.03% (6.7716 => 6.7020, std.dev.: 0.0071) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.75% (1.8100 => 0.6923, std.dev.: 0.0133) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0051) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.73% (0.2151 => 0.1576, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -25.08% (1.3643 => 1.0222, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0065) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4492, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.90% (4.1024 => 3.2038, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.23% (0.3418 => 0.2829, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.38% (2.5106 => 2.1245, std.dev.: 0.0049) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6678, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3549, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.98% (0.5142 => 0.4629, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/richards_benchmark: -9.00% (1.2842 => 1.1686, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.73% (0.9021 => 0.8414, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0031) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.31% (1.7753 => 1.6987, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -4.01% (2.2633 => 2.1725, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.55% (1.3096 => 1.2631, std.dev.: 0.0166) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4005, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2764, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.56% (7.9763 => 7.7718, std.dev.: 0.0143) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: -2.20% (3.7241 => 3.6422, std.dev.: 0.0112) MultiSource/Benchmarks/Bullet/bullet: -1.73% (7.3040 => 7.1777, std.dev.: 0.0093) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7085, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.57% (6.5735 => 6.4706, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.40% (1.6086 => 1.5860, std.dev.: 0.0084) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.31% (1.6219 => 1.6006, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.21% (1.6307 => 1.6110, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: -1.15% (3.7092 => 3.6665, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.27s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 22:28:43 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 00:28:43 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131062843.8E00D2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8133?compare_to=8128&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8133, Order: 174035, Start Time: 2013-01-31 04:23:37, End Time: 2013-01-31 06:29:08 To: 8128, Order: 173995, Start Time: 2013-01-31 00:29:31, End Time: 2013-01-31 02:41:19 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 7 (99 on baseline) Performance Improvements: 79 (57 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 978 (907 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Shootout-C++/moments: 4.95% (0.3858 => 0.4049, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.80% (17.2601 => 17.7428, std.dev.: 0.0462) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/heapsort: 10.98% (3.8749 => 4.3003, std.dev.: 0.1538) SingleSource/Benchmarks/Shootout/hash: 6.40% (4.1125 => 4.3759, std.dev.: 0.0374) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.96% (0.4177 => 0.4384, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.73% (4.2377 => 4.3535, std.dev.: 0.0407) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.29% (4.7272 => 4.7882, std.dev.: 0.0111) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/BenchmarkGame/partialsums: -34.24% (0.0517 => 0.0340, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -33.47% (0.1443 => 0.0960, std.dev.: 0.0049) MultiSource/Benchmarks/Olden/treeadd/treeadd: -30.82% (0.0730 => 0.0505, std.dev.: 0.0059) MultiSource/Benchmarks/Ptrdist/ft/ft: -27.97% (0.3086 => 0.2223, std.dev.: 0.0200) MultiSource/Benchmarks/McCat/15-trie/trie: -26.72% (0.0827 => 0.0606, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -26.67% (0.1350 => 0.0990, std.dev.: 0.0076) MultiSource/Benchmarks/Olden/voronoi/voronoi: -25.23% (0.3801 => 0.2842, std.dev.: 0.0218) MultiSource/Benchmarks/SciMark2-C/scimark2: -22.93% (0.4832 => 0.3724, std.dev.: 0.0409) SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -22.46% (0.0779 => 0.0604, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: -22.25% (0.1757 => 0.1366, std.dev.: 0.0044) MultiSource/Benchmarks/Olden/bh/bh: -21.97% (0.4223 => 0.3295, std.dev.: 0.0137) MultiSource/Benchmarks/Olden/power/power: -21.47% (0.1798 => 0.1412, std.dev.: 0.0102) MultiSource/Benchmarks/McCat/05-eks/eks: -20.30% (0.6132 => 0.4887, std.dev.: 0.0303) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -19.64% (0.3585 => 0.2881, std.dev.: 0.0197) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -19.22% (0.8512 => 0.6876, std.dev.: 0.0589) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -17.83% (11.7564 => 9.6600, std.dev.: 0.3946) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -17.10% (1.7844 => 1.4792, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.49% (0.1091 => 0.0922, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -15.33% (0.0907 => 0.0768, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/city/city: -14.67% (1.7661 => 1.5070, std.dev.: 0.0410) SingleSource/Benchmarks/Shootout-C++/ary2: -14.10% (0.3142 => 0.2699, std.dev.: 0.0043) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -13.96% (0.2486 => 0.2139, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -13.34% (0.8185 => 0.7093, std.dev.: 0.0024) MultiSource/Benchmarks/Prolangs-C++/garage/garage: -13.12% (0.0846 => 0.0735, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.79% (1.0105 => 0.8813, std.dev.: 0.0110) MultiSource/Benchmarks/McCat/17-bintr/bintr: -11.69% (0.0881 => 0.0778, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -11.05% (1.5119 => 1.3448, std.dev.: 0.0407) MultiSource/Benchmarks/Bullet/bullet: -10.80% (40.7368 => 36.3361, std.dev.: 0.2229) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -10.63% (1.4095 => 1.2596, std.dev.: 0.0381) SingleSource/Benchmarks/Shootout-C++/nestedloop: -10.54% (0.2229 => 0.1994, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/loader/loader: -10.49% (0.3833 => 0.3431, std.dev.: 0.0044) MultiSource/Applications/lua/lua: -10.48% (4.8932 => 4.3802, std.dev.: 0.1106) MultiSource/Benchmarks/MallocBench/gs/gs: -9.95% (5.1263 => 4.6161, std.dev.: 0.1706) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -9.69% (1.5283 => 1.3802, std.dev.: 0.0408) MultiSource/Benchmarks/FreeBench/neural/neural: -8.74% (0.2929 => 0.2673, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/08-main/main: -8.12% (0.3130 => 0.2876, std.dev.: 0.0092) MultiSource/Benchmarks/7zip/7zip-benchmark: -7.97% (50.9783 => 46.9145, std.dev.: 1.4514) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.85% (6.4530 => 5.9464, std.dev.: 0.1459) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -7.76% (1.3425 => 1.2383, std.dev.: 0.0346) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -7.75% (0.7274 => 0.6710, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.06% (2.0972 => 1.9492, std.dev.: 0.0435) SingleSource/Benchmarks/Shootout-C++/ary: -7.04% (0.2757 => 0.2563, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: -6.67% (0.8455 => 0.7891, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C++/office/office: -6.64% (0.2438 => 0.2276, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -6.55% (0.6000 => 0.5607, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/bigfib: -6.11% (0.7626 => 0.7160, std.dev.: 0.0093) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.97% (1.7605 => 1.6554, std.dev.: 0.0135) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.90% (1.4900 => 1.4021, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -5.90% (1.2598 => 1.1855, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.73% (1.3896 => 1.3100, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.77% (4.5741 => 4.3559, std.dev.: 0.0306) MultiSource/Applications/lemon/lemon: -4.72% (1.3995 => 1.3335, std.dev.: 0.0252) SingleSource/Benchmarks/Shootout-C++/hash2: -4.63% (0.4987 => 0.4756, std.dev.: 0.0083) MultiSource/Applications/kimwitu++/kc: -4.52% (20.4563 => 19.5309, std.dev.: 0.3482) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.39% (0.6599 => 0.6309, std.dev.: 0.0093) SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.36% (0.5365 => 0.5131, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.25% (0.8291 => 0.7939, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.24% (1.3786 => 1.3202, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.58% (1.4453 => 1.3935, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.08% (1.3414 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.04% (0.3482 => 0.3376, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.31% (1.3362 => 1.3053, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.02% (4.8456 => 4.7477, std.dev.: 0.0262) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Olden/mst/mst: -54.53% (0.3167 => 0.1440, std.dev.: 0.0611) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -28.06% (0.0360 => 0.0259, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -21.63% (0.2191 => 0.1717, std.dev.: 0.0035) MultiSource/Benchmarks/Fhourstones/fhourstones: -20.28% (1.6505 => 1.3157, std.dev.: 0.1272) SingleSource/Benchmarks/CoyoteBench/fftbench: -18.19% (1.9011 => 1.5552, std.dev.: 0.0677) MultiSource/Benchmarks/Olden/tsp/tsp: -7.75% (1.6230 => 1.4972, std.dev.: 0.0241) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.73% (2.8397 => 2.6485, std.dev.: 0.0392) MultiSource/Benchmarks/7zip/7zip-benchmark: -5.95% (10.6365 => 10.0033, std.dev.: 0.0400) SingleSource/Benchmarks/McGill/chomp: -5.89% (1.1711 => 1.1021, std.dev.: 0.0217) MultiSource/Benchmarks/llubenchmark/llu: -5.38% (2.1783 => 2.0611, std.dev.: 0.0415) SingleSource/Benchmarks/Shootout-C++/lists1: -4.30% (0.6517 => 0.6237, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.95% (1.1374 => 1.0925, std.dev.: 0.0121) MultiSource/Applications/lua/lua: -3.63% (29.6938 => 28.6160, std.dev.: 0.2340) SingleSource/Benchmarks/Shootout-C++/hash: -3.08% (0.6619 => 0.6415, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/perlin: -1.02% (4.5965 => 4.5495, std.dev.: 0.0148) SingleSource/Benchmarks/Shootout-C++/sieve: -1.02% (3.5049 => 3.4692, std.dev.: 0.0115) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -14.82% (1.4456 => 1.2313, std.dev.: 0.0318) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.72% (0.0242 => 0.0233, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.57% (0.0445 => 0.0438, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.86% (0.0348 => 0.0345, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.60% (0.0331 => 0.0329, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 1.37% (0.0437 => 0.0443, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -38.21% (0.0212 => 0.0131, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: -0.87% (0.0231 => 0.0229, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.06% (0.0254 => 0.0231, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: - (0.0014 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1466 => 0.1464, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: -9.76% (1.3413 => 1.2104, std.dev.: 0.0582) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.73% (0.4823 => 0.4161, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.30% (0.1513 => 0.1463, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.0669 => 0.0632, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.89% (0.0277 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.26% (0.0554 => 0.0561, std.dev.: 0.0020) MultiSource/Benchmarks/PAQ8p/paq8p: -6.25% (0.0016 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.17% (1.3325 => 1.2902, std.dev.: 0.0619) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.00% (0.0030 => 0.0018, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 225.00% (0.0008 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0611 => 0.0616, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.47% (0.0365 => 0.0374, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.35% (1.7519 => 1.7457, std.dev.: 0.0102) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -36.73% (0.0098 => 0.0062, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.24% (34.4014 => 34.3180, std.dev.: 0.0585) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 399.11% (0.0336 => 0.1677, std.dev.: 0.0017) SingleSource/Regression/C/sumarraymalloc: 119.11% (0.0293 => 0.0642, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 93.07% (0.0274 => 0.0529, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/neural/neural: 63.19% (0.1638 => 0.2673, std.dev.: 0.0026) SingleSource/Regression/C/sumarray: 58.87% (0.0265 => 0.0421, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 44.50% (0.8893 => 1.2850, std.dev.: 0.0769) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 43.17% (0.9061 => 1.2973, std.dev.: 0.0621) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.61% (0.9120 => 1.3006, std.dev.: 0.0727) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 42.54% (0.9381 => 1.3372, std.dev.: 0.0386) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 42.27% (0.9855 => 1.4021, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.11% (0.8926 => 1.2685, std.dev.: 0.1142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 42.01% (0.9422 => 1.3380, std.dev.: 0.0134) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 41.68% (0.8990 => 1.2737, std.dev.: 0.0601) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 41.52% (0.9091 => 1.2866, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.38% (0.9612 => 1.3589, std.dev.: 0.0902) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.61% (0.9564 => 1.3448, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 40.47% (0.9588 => 1.3468, std.dev.: 0.0479) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 39.00% (1.0867 => 1.5105, std.dev.: 0.1081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.70% (0.9998 => 1.3867, std.dev.: 0.0649) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.80% (0.8912 => 1.2281, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.72% (0.9512 => 1.3100, std.dev.: 0.0256) SingleSource/Benchmarks/McGill/exptree: 37.49% (0.0859 => 0.1181, std.dev.: 0.0083) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.44% (0.9010 => 1.2383, std.dev.: 0.0346) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.38% (1.0119 => 1.3901, std.dev.: 0.0669) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 37.31% (1.0052 => 1.3802, std.dev.: 0.0408) SingleSource/Benchmarks/Stanford/IntMM: 36.89% (0.0431 => 0.0590, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 36.71% (0.8736 => 1.1943, std.dev.: 0.0248) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.77% (0.8732 => 1.1855, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.03% (0.8846 => 1.1945, std.dev.: 0.0229) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.80% (0.9867 => 1.3202, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 33.47% (0.9127 => 1.2182, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.03% (1.0017 => 1.3326, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.98% (1.0088 => 1.3415, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.83% (0.9788 => 1.3001, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.49% (0.9507 => 1.2596, std.dev.: 0.0381) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.20% (0.9685 => 1.2804, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.58% (0.9550 => 1.2566, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.42% (0.9405 => 1.2266, std.dev.: 0.0446) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.39% (0.9993 => 1.3030, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.31% (1.0860 => 1.3935, std.dev.: 0.0059) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.01% (3.6295 => 4.3559, std.dev.: 0.0306) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.76% (0.0963 => 0.1134, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/matrix: 15.22% (0.2385 => 0.2748, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.93% (1.0986 => 1.2626, std.dev.: 0.0625) MultiSource/Benchmarks/mafft/pairlocalalign: 14.82% (9.5202 => 10.9310, std.dev.: 0.2644) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.63% (2.4519 => 2.7371, std.dev.: 0.0750) SingleSource/Benchmarks/Misc/himenobmtxpa: 11.25% (0.1955 => 0.2175, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.52% (5.0381 => 5.5682, std.dev.: 0.1795) SingleSource/Benchmarks/Misc/ReedSolomon: 10.39% (0.2050 => 0.2263, std.dev.: 0.0069) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.24% (1.8651 => 2.0561, std.dev.: 0.0390) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.65% (23.5861 => 25.8627, std.dev.: 0.4203) MultiSource/Benchmarks/Bullet/bullet: 9.30% (33.2440 => 36.3361, std.dev.: 0.2229) MultiSource/Applications/SPASS/SPASS: 7.87% (16.4479 => 17.7428, std.dev.: 0.0462) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.53% (1.8127 => 1.9492, std.dev.: 0.0435) SingleSource/Benchmarks/Misc-C++/bigfib: 6.69% (0.6711 => 0.7160, std.dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: 6.66% (0.2042 => 0.2178, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C++/office/office: 4.79% (0.2172 => 0.2276, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/sieve: 3.81% (0.2913 => 0.3024, std.dev.: 0.0033) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.20% (0.7693 => 0.7939, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.93% (4.6579 => 4.7477, std.dev.: 0.0262) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107050.00% (0.0008 => 0.8572, std.dev.: 0.0211) SingleSource/Benchmarks/Shootout/ary3: 466.19% (2.2304 => 12.6284, std.dev.: 0.5500) SingleSource/Benchmarks/Shootout/matrix: 356.64% (1.5825 => 7.2264, std.dev.: 0.0439) MultiSource/Applications/sgefa/sgefa: 259.15% (0.3515 => 1.2624, std.dev.: 0.0184) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.43% (1.1825 => 4.0611, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 230.09% (4.8185 => 15.9052, std.dev.: 0.1635) SingleSource/Benchmarks/Shootout-C++/ary2: 207.75% (0.0129 => 0.0397, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 185.53% (0.0228 => 0.0651, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout-C++/ary: 149.57% (0.0232 => 0.0579, std.dev.: 0.0082) SingleSource/Benchmarks/Shootout-C++/matrix: 62.98% (2.9083 => 4.7399, std.dev.: 0.0186) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.65% (0.2562 => 0.3424, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (3.1254 => 4.0910, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.76% (1.4588 => 1.8346, std.dev.: 0.0211) SingleSource/Benchmarks/Misc/salsa20: 21.85% (7.4497 => 9.0774, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.59% (4.8112 => 5.8020, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.32% (5.6033 => 6.6857, std.dev.: 0.3106) SingleSource/Regression/C/uint64_to_float: 15.99% (1.5397 => 1.7859, std.dev.: 0.0707) MultiSource/Applications/JM/lencod/lencod: 15.70% (6.8159 => 7.8863, std.dev.: 0.1487) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.58% (5.1752 => 5.8780, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6497, std.dev.: 0.0126) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.05% (9.0082 => 10.0033, std.dev.: 0.0400) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.93% (3.6477 => 3.9734, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 7.91% (8.6447 => 9.3288, std.dev.: 0.0405) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.89% (0.6211 => 0.6577, std.dev.: 0.0134) SingleSource/Benchmarks/McGill/chomp: 5.72% (1.0425 => 1.1021, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.57% (4.1836 => 4.4165, std.dev.: 0.0160) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.55% (3.0082 => 3.1752, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 5.36% (0.4161 => 0.4384, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.48% (4.1668 => 4.3535, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.00% (5.0310 => 5.2322, std.dev.: 0.0142) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.67% (61.0379 => 63.2789, std.dev.: 0.8348) SingleSource/Benchmarks/Misc/pi: 3.47% (2.1390 => 2.2133, std.dev.: 0.0040) SingleSource/Benchmarks/Linpack/linpack-pc: 3.33% (50.8945 => 52.5873, std.dev.: 0.6004) MultiSource/Benchmarks/Ptrdist/bc/bc: 3.19% (1.1060 => 1.1413, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.81% (4.7254 => 4.8582, std.dev.: 0.0090) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.43% (2.4753 => 2.5108, std.dev.: 0.0136) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8625, std.dev.: 0.0056) MultiSource/Applications/siod/siod: 1.09% (3.5910 => 3.6300, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.04% (5.9115 => 5.9729, std.dev.: 0.0119) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/SmallPT/smallpt: -23.83% (0.1888 => 0.1438, std.dev.: 0.0127) MultiSource/Applications/hbd/hbd: -17.64% (1.8964 => 1.5618, std.dev.: 0.1278) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.46% (0.0676 => 0.0558, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.96% (0.1684 => 0.1432, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.55% (0.1079 => 0.0922, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.70% (0.7686 => 0.6710, std.dev.: 0.0030) MultiSource/Applications/hexxagon/hexxagon: -9.17% (1.1433 => 1.0385, std.dev.: 0.0191) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.80% (0.7693 => 0.7093, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.43% (6.4235 => 5.9464, std.dev.: 0.1459) SingleSource/Benchmarks/Shootout-C++/hash2: -7.36% (0.5134 => 0.4756, std.dev.: 0.0083) MultiSource/Applications/lambda-0_1_3/lambda: -6.73% (0.8653 => 0.8071, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/hash: -5.61% (0.4689 => 0.4426, std.dev.: 0.0085) MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.62% (0.3560 => 0.3431, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.41% (0.9124 => 0.8813, std.dev.: 0.0110) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.24% (1.5131 => 1.4792, std.dev.: 0.0061) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.26% (1.3220 => 1.3053, std.dev.: 0.0049) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.89% (11.5523 => 3.9407, std.dev.: 0.3374) SingleSource/Benchmarks/Misc/fp-convert: -62.43% (15.6525 => 5.8814, std.dev.: 0.0550) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.71% (0.4146 => 0.1795, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.60% (0.4578 => 0.2353, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.07% (11.3868 => 6.3685, std.dev.: 0.0238) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.87% (5.4023 => 3.6267, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -29.92% (0.4452 => 0.3120, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.52% (0.5495 => 0.4038, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.23% (5.2605 => 3.8808, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.14% (4.4467 => 3.3290, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.73% (0.5826 => 0.4385, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8225, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -20.52% (0.5897 => 0.4687, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.43% (5.8755 => 4.7926, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -17.30% (9.7992 => 8.1041, std.dev.: 0.2428) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.56% (16.6791 => 13.9168, std.dev.: 0.2272) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.10% (3.1921 => 2.7740, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6742, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.82% (7.0016 => 6.1037, std.dev.: 0.1485) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9941, std.dev.: 0.0426) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.14% (0.4081 => 0.3667, std.dev.: 0.0131) MultiSource/Benchmarks/mafft/pairlocalalign: -9.12% (63.1520 => 57.3916, std.dev.: 0.0864) SingleSource/Benchmarks/Shootout/nestedloop: -8.45% (0.2200 => 0.2014, std.dev.: 0.0060) MultiSource/Applications/SIBsim4/SIBsim4: -7.43% (3.5443 => 3.2808, std.dev.: 0.0418) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.62% (5.5974 => 5.2271, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.44% (4.5424 => 4.2500, std.dev.: 0.0809) SingleSource/Benchmarks/Shootout-C++/lists1: -5.90% (0.6628 => 0.6237, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.42% (3.5127 => 3.3224, std.dev.: 0.0195) SingleSource/Benchmarks/McGill/queens: -5.02% (1.7443 => 1.6567, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout-C++/ary3: -4.88% (1.8123 => 1.7239, std.dev.: 0.0180) SingleSource/Benchmarks/Shootout-C++/hash2: -4.30% (3.6768 => 3.5186, std.dev.: 0.0271) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -3.85% (4.9799 => 4.7882, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4361, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.39% (5.8973 => 5.6971, std.dev.: 0.0330) SingleSource/Benchmarks/Shootout/hash: -3.31% (4.5259 => 4.3759, std.dev.: 0.0374) SingleSource/Benchmarks/Misc/mandel-2: -2.36% (0.8521 => 0.8320, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5763, std.dev.: 0.0060) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.67% (85.3042 => 83.8769, std.dev.: 0.0586) SingleSource/Benchmarks/Misc/ffbench: -1.45% (1.4244 => 1.4037, std.dev.: 0.0047) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.39% (8.8249 => 8.7019, std.dev.: 0.0407) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.12% (3.7450 => 3.7032, std.dev.: 0.0013) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.21% (1.2047 => 1.2313, std.dev.: 0.0318) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0233 => 0.0233, std.dev.: 0.0013) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.88% (0.0451 => 0.0438, std.dev.: 0.0049) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.44% (0.0394 => 0.0345, std.dev.: 0.0095) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.30% (0.0328 => 0.0329, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.45% (0.0445 => 0.0443, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/casts: -38.50% (0.0213 => 0.0131, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: 0.88% (0.0227 => 0.0229, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.41% (0.0255 => 0.0231, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -6.67% (0.0015 => 0.0014, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.31% (0.1530 => 0.1464, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: -37.26% (1.9293 => 1.2104, std.dev.: 0.0582) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 2.77% (0.4049 => 0.4161, std.dev.: 0.0269) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.11% (0.1510 => 0.1463, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -35.38% (0.0978 => 0.0632, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.92% (0.0590 => 0.0561, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.06% (1.1617 => 1.2902, std.dev.: 0.0619) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -43.75% (0.0032 => 0.0018, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.98% (0.0610 => 0.0616, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.73% (0.7437 => 1.7457, std.dev.: 0.0102) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.61% (0.0092 => 0.0062, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 168.57% (12.7781 => 34.3180, std.dev.: 0.0585) Report Time: 1.01s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 22:52:18 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 00:52:18 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130131065218.3FA522A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8134?compare_to=8129&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8134, Order: 174033, Start Time: 2013-01-31 04:22:58, End Time: 2013-01-31 06:52:40 To: 8129, Order: 173981, Start Time: 2013-01-30 23:52:05, End Time: 2013-01-31 03:27:44 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Failures: 155 (155 on baseline) Performance Regressions: 15 (117 on baseline) Performance Improvements: 10 (17 on baseline) Added Tests: 0 (137 on baseline) Unchanged Tests: 924 (678 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Failures - Compile Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.63% (0.5040 => 0.4504, std.dev.: 0.0011) MultiSource/Applications/ALAC/encode/alacconvert-encode: -10.83% (0.5040 => 0.4494, std.dev.: 0.0019) MultiSource/Applications/ClamAV/clamscan: -1.08% (4.9247 => 4.8716, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: -6.75% (2.4727 => 2.3058, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: -0.14% (5.2496 => 5.2423, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: -0.55% (6.3505 => 6.3153, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 2.87% (1.1527 => 1.1858, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 2.66% (1.1633 => 1.1943, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -25.64% (12.9697 => 9.6438, std.dev.: 0.0122) MultiSource/Applications/lua/lua: -4.18% (1.6597 => 1.5903, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: -35.64% (0.3751 => 0.2414, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -29.03% (2.0317 => 1.4419, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -23.42% (0.7433 => 0.5692, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -46.58% (2.2353 => 1.1940, std.dev.: 0.0013) MultiSource/Benchmarks/7zip/7zip-benchmark: -19.61% (25.3211 => 20.3549, std.dev.: 0.0142) MultiSource/Benchmarks/Bullet/bullet: -17.83% (27.4274 => 22.5381, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/mason/mason: -8.26% (0.0363 => 0.0333, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -3.39% (2.2505 => 2.1742, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: -0.07% (0.1475 => 0.1474, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -37.48% (0.1529 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -0.26% (1.5839 => 1.5798, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.31% (5.1581 => 4.7813, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -2.09% (0.5988 => 0.5863, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 19.23% (0.0260 => 0.0310, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.66% (0.6622 => 0.6247, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/bh/bh: -11.86% (0.1526 => 0.1345, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.35% (0.1320 => 0.1223, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -48.05% (0.5428 => 0.2820, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -39.05% (0.0909 => 0.0554, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.25% (0.4627 => 0.4523, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.45% (0.1118 => 0.1113, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.01% (0.6310 => 0.6246, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -19.23% (0.2980 => 0.2407, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -40.34% (13.1097 => 7.8206, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/functionobjects: -19.90% (0.2362 => 0.1892, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -58.46% (0.6095 => 0.2532, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -59.21% (0.8287 => 0.3380, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 27.40% (0.6062 => 0.7723, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -43.61% (0.2387 => 0.1346, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -28.16% (0.3476 => 0.2497, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: -1.78% (0.4434 => 0.4355, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: -46.13% (5.1821 => 2.7915, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.22% (0.4219 => 0.4083, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.99% (0.3742 => 0.3854, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -14.11% (0.5770 => 0.4956, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -22.72% (0.7371 => 0.5696, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 11.28% (0.0195 => 0.0217, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: -7.19% (0.4814 => 0.4468, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: -8.38% (0.4926 => 0.4513, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: -0.56% (0.3898 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: -2.91% (0.4054 => 0.3936, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 8.09% (0.3312 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: -1.24% (0.4272 => 0.4219, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 8.25% (0.3332 => 0.3607, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.46% (0.4277 => 0.4129, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: -3.34% (0.4365 => 0.4219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.87% (0.4624 => 0.4445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -18.98% (0.3119 => 0.2527, std.dev.: 0.0012) SingleSource/Benchmarks/SmallPT/smallpt: -14.08% (0.0618 => 0.0531, std.dev.: 0.0008) SingleSource/Regression/C++/BuiltinTypeInfo: 29.22% (0.0219 => 0.0283, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ConditionalExpr: 2.60% (0.0192 => 0.0197, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 17.07% (0.0328 => 0.0384, std.dev.: 0.0000) SingleSource/Regression/C++/short_circuit_dtor: 7.91% (0.0177 => 0.0191) SingleSource/UnitTests/2003-05-31-CastToBool: 10.30% (0.0165 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-10-SignConversions: 21.53% (0.0144 => 0.0175) SingleSource/UnitTests/ObjC++/property-reference: 12.91% (0.8475 => 0.9569, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 15.87% (0.7005 => 0.8117, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: -11.99% (0.0492 => 0.0433, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 23.01% (0.4302 => 0.5292, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 24.98% (0.4224 => 0.5279, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/cast2: 27.08% (0.0144 => 0.0183, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/ccc: 26.57% (0.0207 => 0.0262, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 19.07% (0.0561 => 0.0668, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: 26.57% (0.0429 => 0.0543, std.dev.: 0.0002) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.02% (0.4526 => 0.4480, std.dev.: 0.0048) SingleSource/UnitTests/blockstret: -4.43% (0.0158 => 0.0151) SingleSource/UnitTests/stmtexpr: -27.75% (0.0227 => 0.0164, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ALAC/decode/alacconvert-decode: -99.85% (0.0663 => 0.0001) MultiSource/Applications/ALAC/encode/alacconvert-encode: -99.92% (0.1331 => 0.0001) MultiSource/Applications/ClamAV/clamscan: -99.97% (0.3125 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.96% (0.2432 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (22.5736 => 0.0001) MultiSource/Applications/SPASS/SPASS: -100.00% (30.1799 => 0.0001) MultiSource/Applications/hbd/hbd: -96.15% (0.0026 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: -100.00% (25.9752 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.85% (0.0660 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (50.5902 => 0.0001) MultiSource/Applications/minisat/minisat: -100.00% (48.1408 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.97% (0.3286 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (6.7733 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (10.4769 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (40.3665 => 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -99.99% (0.7866 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.91% (0.1096 => 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -99.89% (0.0871 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -99.95% (0.2091 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.98% (0.6219 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.98% (0.4088 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -99.97% (0.3527 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.99% (0.6696 => 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -100.00% (5.5003 => 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.98% (0.6115 => 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (276.2871 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -99.92% (0.1261 => 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.99% (1.2579 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -99.93% (0.1493 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.88% (0.0842 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (41.1782 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (40.2316 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -100.00% (7.4922 => 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -100.00% (29.0066 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -100.00% (28.6267 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -100.00% (12.7618 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -100.00% (139.8771 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -100.00% (104.1264 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (5.6753 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (83.6803 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (16.0490 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -100.00% (13.7652 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -99.99% (1.5190 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -100.00% (12.2801 => 0.0001) SingleSource/Benchmarks/Misc/lowercase: -100.00% (65.7462 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -99.99% (1.2799 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -100.00% (9.5380 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -100.00% (28.1924 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -99.99% (1.0937 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -100.00% (16.5671 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -99.98% (0.4456 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (12.6743 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -66.67% (0.0003 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -100.00% (9.0122 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -66.67% (0.0003 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -50.00% (0.0002 => 0.0001) SingleSource/Benchmarks/SmallPT/smallpt: -100.00% (33.9989 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/EH/ConditionalExpr: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/short_circuit_dtor: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0002 => 0.0002) SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0002 => 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/property: -94.44% (0.0018 => 0.0001) SingleSource/UnitTests/SignlessTypes/cast2: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/SignlessTypes/ccc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: -100.00% (46.4424 => 0.0001) SingleSource/UnitTests/blockstret: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/stmtexpr: -50.00% (0.0002 => 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: 49.63% (3.2071 => 4.7987, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 44.07% (2.7492 => 3.9608, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/matmul_f64_4x4: 26.27% (7.3229 => 9.2464, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary: 23.33% (0.2229 => 0.2749, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 17.29% (0.0642 => 0.0753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/salsa20: 9.67% (32.8038 => 35.9747, std.dev.: 0.0135) MultiSource/Benchmarks/Olden/tsp/tsp: 7.46% (1.9571 => 2.1031, std.dev.: 0.0040) MultiSource/Benchmarks/FreeBench/distray/distray: 4.75% (0.2442 => 0.2558) MultiSource/Applications/sgefa/sgefa: 4.40% (1.4810 => 1.5461, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.36% (1.5863 => 1.6555, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 4.15% (3.2417 => 3.3763, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.66% (2.0667 => 2.1217, std.dev.: 0.0156) SingleSource/Benchmarks/Shootout-C++/ary3: 1.60% (16.1985 => 16.4573, std.dev.: 0.0030) SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.55% (0.6596 => 0.6698, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.04% (5.7030 => 5.7621, std.dev.: 0.0017) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -100.00% (19.9098 => 0.0001) MultiSource/Benchmarks/Olden/health/health: -6.01% (0.6453 => 0.6065, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: -5.05% (0.3324 => 0.3156, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/n-body: -4.20% (3.6101 => 3.4586, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.09% (21.9950 => 21.3152, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.51% (4.6367 => 4.5202, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -1.53% (1.1053 => 1.0884, std.dev.: 0.0019) MultiSource/Applications/lambda-0_1_3/lambda: -1.42% (12.0451 => 11.8746, std.dev.: 0.0013) MultiSource/Applications/viterbi/viterbi: -1.39% (47.3068 => 46.6491, std.dev.: 0.0145) SingleSource/Benchmarks/Linpack/linpack-pc: -1.33% (66.1840 => 65.3046, std.dev.: 0.0232) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Compile Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ClamAV/clamscan: 15.69% (4.2109 => 4.8716, std.dev.: 0.0116) MultiSource/Applications/JM/ldecod/ldecod: 6.49% (2.1653 => 2.3058, std.dev.: 0.0098) MultiSource/Applications/JM/lencod/lencod: 13.53% (4.6177 => 5.2423, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 13.96% (5.5417 => 6.3153, std.dev.: 0.0060) MultiSource/Applications/hbd/hbd: 22.29% (0.9697 => 1.1858, std.dev.: 0.0041) MultiSource/Applications/hexxagon/hexxagon: 20.53% (0.9909 => 1.1943, std.dev.: 0.0080) MultiSource/Applications/kimwitu++/kc: -19.34% (11.9555 => 9.6438, std.dev.: 0.0122) MultiSource/Applications/lua/lua: 11.45% (1.4269 => 1.5903, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: -27.64% (0.3336 => 0.2414, std.dev.: 0.0004) MultiSource/Applications/oggenc/oggenc: -9.50% (1.5932 => 1.4419, std.dev.: 0.0012) MultiSource/Applications/siod/siod: -14.20% (0.6634 => 0.5692, std.dev.: 0.0071) MultiSource/Applications/sqlite3/sqlite3: -41.32% (2.0346 => 1.1940, std.dev.: 0.0013) MultiSource/Benchmarks/Bullet/bullet: -4.18% (23.5202 => 22.5381, std.dev.: 0.0090) MultiSource/Benchmarks/FreeBench/mason/mason: 9.54% (0.0304 => 0.0333, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 15.69% (1.8794 => 2.1742, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/08-main/main: 21.02% (0.1218 => 0.1474, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -30.87% (0.1383 => 0.0956, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.12% (1.3152 => 1.5798, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.19% (4.4195 => 4.7813, std.dev.: 0.0166) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.65% (0.5026 => 0.5863, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 47.62% (0.0210 => 0.0310, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.09% (0.4994 => 0.6247, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/bh/bh: 4.75% (0.1284 => 0.1345, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/voronoi/voronoi: 12.41% (0.1088 => 0.1223, std.dev.: 0.0012) MultiSource/Benchmarks/PAQ8p/paq8p: -41.82% (0.4847 => 0.2820, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -31.09% (0.0804 => 0.0554, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 15.09% (0.3930 => 0.4523, std.dev.: 0.0015) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.08% (0.0897 => 0.1113, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 24.92% (0.5000 => 0.6246, std.dev.: 0.0024) MultiSource/Benchmarks/nbench/nbench: -6.20% (0.2566 => 0.2407, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -32.81% (11.6398 => 7.8206, std.dev.: 0.0168) SingleSource/Benchmarks/Adobe-C++/functionobjects: -8.51% (0.2068 => 0.1892, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -54.66% (0.5584 => 0.2532, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -54.48% (0.7426 => 0.3380, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 44.06% (0.5361 => 0.7723, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -36.00% (0.2103 => 0.1346, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -19.03% (0.3084 => 0.2497, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/fftbench: 13.26% (0.3845 => 0.4355, std.dev.: 0.0090) SingleSource/Benchmarks/Misc-C++-EH/spirit: -40.51% (4.6926 => 2.7915, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.63% (0.3625 => 0.4083, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 20.63% (0.3195 => 0.3854, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/bigfib: -1.12% (0.5012 => 0.4956, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.48% (0.6435 => 0.5696, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/lowercase: 40.00% (0.0155 => 0.0217, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 7.77% (0.4146 => 0.4468, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash2: 6.16% (0.4251 => 0.4513, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 15.77% (0.3348 => 0.3876, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.20% (0.3477 => 0.3936, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/methcall: 27.27% (0.2813 => 0.3580, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/moments: 14.71% (0.3678 => 0.4219, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/objinst: 27.77% (0.2823 => 0.3607, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/reversefile: 11.90% (0.3690 => 0.4129, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/sieve: 13.23% (0.3726 => 0.4219, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.66% (0.3981 => 0.4445, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: -7.67% (0.2737 => 0.2527, std.dev.: 0.0012) SingleSource/Regression/C++/BuiltinTypeInfo: 60.80% (0.0176 => 0.0283, std.dev.: 0.0000) SingleSource/Regression/C++/EH/ConditionalExpr: 28.76% (0.0153 => 0.0197, std.dev.: 0.0000) SingleSource/Regression/C++/EH/exception_spec_test: 40.15% (0.0274 => 0.0384, std.dev.: 0.0000) SingleSource/Regression/C++/short_circuit_dtor: 36.43% (0.0140 => 0.0191) SingleSource/UnitTests/2003-05-31-CastToBool: 41.09% (0.0129 => 0.0182, std.dev.: 0.0006) SingleSource/UnitTests/2003-07-10-SignConversions: 59.09% (0.0110 => 0.0175) SingleSource/UnitTests/ObjC++/property-reference: 33.44% (0.7171 => 0.9569, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference-object: 37.83% (0.5889 => 0.8117, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/messages-2: 3.34% (0.0419 => 0.0433, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/parameter-passing: 42.11% (0.3724 => 0.5292, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 44.63% (0.3650 => 0.5279, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/cast2: 66.36% (0.0110 => 0.0183, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/ccc: 59.76% (0.0164 => 0.0262, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 44.59% (0.0462 => 0.0668, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: 54.26% (0.0352 => 0.0543, std.dev.: 0.0002) SingleSource/UnitTests/blockstret: 23.77% (0.0122 => 0.0151) SingleSource/UnitTests/stmtexpr: -13.68% (0.0190 => 0.0164, std.dev.: 0.0002) New Failures - Execution Time ----------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ClamAV/clamscan: -99.96% (0.2802 => 0.0001) MultiSource/Applications/JM/ldecod/ldecod: -99.96% (0.2412 => 0.0001) MultiSource/Applications/JM/lencod/lencod: -100.00% (22.6020 => 0.0001) MultiSource/Applications/SPASS/SPASS: -100.00% (30.1672 => 0.0001) MultiSource/Applications/hbd/hbd: -96.15% (0.0026 => 0.0001) MultiSource/Applications/hexxagon/hexxagon: -100.00% (28.1477 => 0.0001) MultiSource/Applications/kimwitu++/kc: -99.85% (0.0648 => 0.0001) MultiSource/Applications/lua/lua: -100.00% (50.0626 => 0.0001) MultiSource/Applications/minisat/minisat: -100.00% (47.9434 => 0.0001) MultiSource/Applications/oggenc/oggenc: -99.97% (0.3283 => 0.0001) MultiSource/Applications/siod/siod: -100.00% (6.9842 => 0.0001) MultiSource/Applications/sqlite3/sqlite3: -100.00% (10.3705 => 0.0001) MultiSource/Benchmarks/Bullet/bullet: -100.00% (40.4859 => 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -99.99% (0.7910 => 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: -99.91% (0.1079 => 0.0001) MultiSource/Benchmarks/McCat/08-main/main: -99.88% (0.0856 => 0.0001) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -99.95% (0.2089 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.98% (0.6244 => 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.97% (0.3693 => 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -50.00% (0.0002 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -99.95% (0.2162 => 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.98% (0.5917 => 0.0001) MultiSource/Benchmarks/Olden/bh/bh: -100.00% (5.5810 => 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: -99.98% (0.6140 => 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (275.8669 => 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -99.92% (0.1239 => 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: -99.99% (1.2451 => 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -99.93% (0.1475 => 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -99.86% (0.0734 => 0.0001) MultiSource/Benchmarks/nbench/nbench: -100.00% (41.0499 => 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -100.00% (41.7953 => 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: -100.00% (7.4874 => 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -100.00% (28.9224 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -100.00% (28.6733 => 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -100.00% (12.7713 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -100.00% (140.0071 => 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -100.00% (105.3826 => 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: -100.00% (5.6814 => 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: -100.00% (79.9355 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: -100.00% (16.2163 => 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -100.00% (13.7764 => 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: -99.99% (1.5170 => 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: -100.00% (12.2456 => 0.0001) SingleSource/Benchmarks/Misc/lowercase: -100.00% (65.7822 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: -99.99% (1.2804 => 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: -100.00% (9.6268 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -100.00% (28.0362 => 0.0001) SingleSource/Benchmarks/Shootout-C++/lists1: -99.99% (1.0962 => 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -100.00% (25.4195 => 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: -99.98% (0.4438 => 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (12.0509 => 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: -66.67% (0.0003 => 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: -100.00% (9.0432 => 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: -66.67% (0.0003 => 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/BuiltinTypeInfo: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/EH/ConditionalExpr: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/EH/exception_spec_test: -50.00% (0.0002 => 0.0001) SingleSource/Regression/C++/short_circuit_dtor: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0002 => 0.0002) SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-07-10-SignConversions: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0002 => 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -93.75% (0.0016 => 0.0001) SingleSource/UnitTests/ObjC/messages-2: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/ObjC/property: -94.12% (0.0017 => 0.0001) SingleSource/UnitTests/SignlessTypes/cast2: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/SignlessTypes/ccc: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/Vector/SSE/sse_shift: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/blockstret: -50.00% (0.0002 => 0.0001) SingleSource/UnitTests/stmtexpr: -50.00% (0.0002 => 0.0001) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.60% (0.0625 => 0.0910, std.dev.: 0.0031) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.12% (0.1063 => 0.1447, std.dev.: 0.0033) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.44% (0.0547 => 0.0719, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.17% (0.2969 => 0.3835, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.73% (0.0714 => 0.0912, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.66% (0.4139 => 0.5284, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.40% (0.1106 => 0.1409, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.31% (0.5900 => 0.7511, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.74% (0.0475 => 0.0602, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.82% (0.1549 => 0.1949, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.68% (0.0584 => 0.0734, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.65% (0.1107 => 0.1391, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.16% (0.4253 => 0.5323, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.58% (0.1021 => 0.1272, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 24.23% (0.1003 => 0.1246, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.14% (0.0584 => 0.0725, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 23.84% (0.0604 => 0.0748, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/em3d/em3d: 23.63% (0.0948 => 0.1172, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.11% (0.3903 => 0.4805, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.03% (0.0495 => 0.0609) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.03% (0.1103 => 0.1357, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.00% (0.1604 => 0.1973, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.99% (0.0822 => 0.1011, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 22.92% (0.1619 => 0.1990, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.55% (0.0541 => 0.0663, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 21.44% (0.0947 => 0.1150, std.dev.: 0.0011) MultiSource/Applications/spiff/spiff: 21.39% (0.4029 => 0.4891, std.dev.: 0.0031) MultiSource/Applications/sgefa/sgefa: 21.16% (0.0808 => 0.0979, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.07% (0.1462 => 0.1770, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.80% (0.2014 => 0.2433, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/mst/mst: 20.77% (0.0698 => 0.0843, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.73% (0.2866 => 0.3460, std.dev.: 0.0018) MultiSource/Benchmarks/McCat/09-vor/vor: 20.53% (0.1505 => 0.1814, std.dev.: 0.0014) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 20.47% (0.0513 => 0.0618, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.30% (0.3271 => 0.3935, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.21% (0.3890 => 0.4676, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.18% (0.2736 => 0.3288, std.dev.: 0.0019) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.93% (0.0572 => 0.0686, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.82% (0.1968 => 0.2358, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.69% (0.4658 => 0.5575, std.dev.: 0.0017) MultiSource/Applications/Burg/burg: 19.17% (0.5546 => 0.6609, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.97% (3.5627 => 4.2385, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/Hello: 18.90% (0.5826 => 0.6927, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.82% (1.6211 => 1.9262, std.dev.: 0.0055) MultiSource/Benchmarks/McCat/18-imp/imp: 18.30% (0.1421 => 0.1681, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.28% (0.1160 => 0.1372, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/strcat: 18.11% (0.2750 => 0.3248, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.02% (0.2875 => 0.3393, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 17.87% (0.0582 => 0.0686) SingleSource/Benchmarks/Shootout-C++/ary3: 17.85% (0.3267 => 0.3850, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 17.80% (0.3258 => 0.3838, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.80% (0.2792 => 0.3289, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 17.64% (0.2811 => 0.3307, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.63% (0.4361 => 0.5130, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.59% (0.2911 => 0.3423, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.43% (0.3282 => 0.3854, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 17.43% (0.2714 => 0.3187, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ary2: 17.43% (0.3317 => 0.3895, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/matrix: 17.41% (0.2780 => 0.3264, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/random: 17.41% (0.2803 => 0.3291, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 17.39% (1.0781 => 1.2656, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.39% (0.3060 => 0.3592, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/fibo: 17.36% (0.2725 => 0.3198, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.31% (0.2738 => 0.3212, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.30% (0.2729 => 0.3201, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.24% (2.0673 => 2.4237, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.09% (0.3124 => 0.3658, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wc: 17.09% (0.3096 => 0.3625, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.04% (0.3362 => 0.3935, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.98% (1.9694 => 2.3038, std.dev.: 0.0145) SingleSource/Regression/C++/ofstream_ctor: 16.98% (0.3004 => 0.3514, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.86% (1.9966 => 2.3333, std.dev.: 0.0173) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.76% (2.7292 => 3.1866, std.dev.: 0.0218) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.06% (0.1090 => 0.1265, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 15.63% (0.7875 => 0.9106, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.62% (0.3488 => 0.4033, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 15.53% (0.3465 => 0.4003, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: 15.50% (0.3446 => 0.3980, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 15.40% (0.3460 => 0.3993, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.39% (0.3496 => 0.4034, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/trivial-interface: 15.37% (0.3442 => 0.3971, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/synchronized: 15.36% (0.3469 => 0.4002, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 15.24% (0.3498 => 0.4031, std.dev.: 0.0036) SingleSource/UnitTests/ObjC/exceptions: 14.93% (0.3643 => 0.4187, std.dev.: 0.0007) MultiSource/Applications/SIBsim4/SIBsim4: 14.79% (0.2691 => 0.3089, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.44% (2.1013 => 2.3837, std.dev.: 0.0045) MultiSource/Benchmarks/Prolangs-C/football/football: 13.35% (0.2075 => 0.2352, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.01% (0.2040 => 0.2285, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 10.46% (0.2391 => 0.2641, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.01% (0.3792 => 0.4020, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 525.62% (29.0505 => 181.7448, std.dev.: 0.0078) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 51.27% (3.1722 => 4.7987, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 44.02% (2.7502 => 3.9608, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 29.55% (0.2122 => 0.2749, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 16.93% (0.0644 => 0.0753, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 5.15% (15.4430 => 16.2386, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-2: 4.67% (1.8057 => 1.8901, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.51% (1.5841 => 1.6555, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.69% (15.8721 => 16.4573, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.01% (3.3991 => 3.5013, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.01% (3.3903 => 3.4586, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.38% (7.1849 => 7.2839, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: 1.33% (35.5013 => 35.9747, std.dev.: 0.0135) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.19% (1.0142 => 1.0263, std.dev.: 0.0012) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.16% (5.6959 => 5.7621, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.15% (8.4155 => 8.5124, std.dev.: 0.0012) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.90% (2.4764 => 2.4293, std.dev.: 0.0040) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.48% (17.2379 => 14.2243, std.dev.: 0.0851) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/ary2: -10.45% (0.2402 => 0.2151, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/except: -4.33% (0.3299 => 0.3156, std.dev.: 0.0015) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8061, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: -3.36% (0.6276 => 0.6065, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.11% (0.6293 => 0.6097, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.82% (21.9346 => 21.3152, std.dev.: 0.0113) MultiSource/Benchmarks/Prolangs-C++/life/life: -2.49% (4.6356 => 4.5202, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/dry: -2.44% (14.0481 => 13.7056, std.dev.: 0.0751) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.17% (197.4719 => 193.1827, std.dev.: 0.0334) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.76% (10.7630 => 10.5739, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.65% (5.7935 => 5.6978, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -1.49% (49.7329 => 48.9925, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: -1.26% (1.3650 => 1.3478, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Added Tests - Execution Time ---------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/UnitTests/ObjC/BoolLiteralTest Report Time: 1.55s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 23:02:31 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 01:02:31 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131070231.3C09C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8135?compare_to=8131&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8135, Order: 174036, Start Time: 2013-01-31 04:51:03, End Time: 2013-01-31 07:02:53 To: 8131, Order: 174019, Start Time: 2013-01-31 02:07:57, End Time: 2013-01-31 04:19:54 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 6 (230 on baseline) Performance Improvements: 3 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1091 (641 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/lambda-0_1_3/lambda: 1.78% (0.8914 => 0.9073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.28% (0.7964 => 0.8066, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.15% (2.2745 => 2.3006, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 1.04% (1.4148 => 1.4295, std.dev.: 0.0018) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.35% (1.0267 => 1.0406, std.dev.: 0.0033) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.2913 => 1.3084, std.dev.: 0.0017) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -4.22% (11.3208 => 10.8431, std.dev.: 0.0055) MultiSource/Applications/JM/lencod/lencod: -2.45% (31.4228 => 30.6517, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.32% (11.0344 => 10.8883, std.dev.: 0.0004) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1326 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.72% (0.0418 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.04% (0.0672 => 0.0679, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8386 => 499.8427, std.dev.: 0.0080) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0415, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 44224.08% (1.1277 => 499.8427, std.dev.: 0.0080) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.74% (0.5229 => 1.7085, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 26.28% (14.9895 => 18.9286, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 48.72% (14.1553 => 21.0520, std.dev.: 0.0105) MultiSource/Benchmarks/MallocBench/gs/gs: 21.13% (4.1105 => 4.9791, std.dev.: 0.0058) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.73% (1.1048 => 1.7868, std.dev.: 0.0043) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 449.75% (7.1582 => 39.3524, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 91.21% (3.4629 => 6.6213, std.dev.: 0.0031) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.78% (0.6222 => 1.1435, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10250.42% (0.0720 => 7.4523, std.dev.: 0.0075) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 11146800.00% (0.0001 => 11.1469, std.dev.: 0.0478) MultiSource/Applications/kimwitu++/kc: 51200.00% (0.0001 => 0.0513, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 66100.00% (0.0001 => 0.0662, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 576100.00% (0.0001 => 0.5762, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5492200.00% (0.0001 => 5.4923, std.dev.: 0.0114) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 819.66% (1.1194 => 10.2947, std.dev.: 0.0017) MultiSource/Applications/ClamAV/clamscan: 150.48% (22.1758 => 55.5460, std.dev.: 0.0115) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.91% (0.0929 => 0.1885, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.04% (0.1463 => 0.2634, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 74.17% (0.0271 => 0.0472, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 66.24% (0.0394 => 0.0655, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.97% (1.5859 => 2.5052, std.dev.: 0.0055) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.60% (2.9384 => 4.6016, std.dev.: 0.0056) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.36% (7.0540 => 10.8883, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/distray/distray: 53.41% (0.1056 => 0.1620, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.81% (8.1363 => 12.1893, std.dev.: 0.0127) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.75% (0.0439 => 0.0653, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.71% (2.2024 => 3.2311, std.dev.: 0.0117) MultiSource/Applications/sgefa/sgefa: 45.42% (0.3109 => 0.4521, std.dev.: 0.0003) SingleSource/UnitTests/vla: 44.51% (0.0355 => 0.0513, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.96% (0.1062 => 0.1497, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.73% (21.9371 => 30.6517, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.32% (1.5415 => 2.1322, std.dev.: 0.0076) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.70% (4.2646 => 5.8722, std.dev.: 0.0031) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.42% (0.4615 => 0.6296, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.62% (0.2271 => 0.3080, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.46% (0.5105 => 0.6915, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.30% (0.1892 => 0.2541, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.75% (0.6675 => 0.8928, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 33.34% (1.1642 => 1.5524, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/05-eks/eks: 32.64% (0.4299 => 0.5702, std.dev.: 0.0023) MultiSource/Benchmarks/NPB-serial/is/is: 32.55% (0.0719 => 0.0953, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 32.28% (0.1143 => 0.1512, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.15% (0.0479 => 0.0633, std.dev.: 0.0010) SingleSource/Benchmarks/Stanford/Oscar: 31.92% (0.0636 => 0.0839, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: 31.90% (0.1655 => 0.2183, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.78% (0.0793 => 0.1045, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.21% (0.1695 => 0.2224, std.dev.: 0.0004) MultiSource/Benchmarks/mafft/pairlocalalign: 30.55% (9.4845 => 12.3818, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.81% (3.8922 => 5.0524, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.51% (0.1125 => 0.1457, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash: 29.47% (0.4289 => 0.5553, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.04% (0.0730 => 0.0942, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.95% (0.0746 => 0.0962, std.dev.: 0.0023) MultiSource/Applications/lemon/lemon: 28.88% (1.0722 => 1.3819, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 28.82% (0.2554 => 0.3290, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 28.67% (0.0457 => 0.0588, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.32% (1.4186 => 1.8203, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/hash2: 28.07% (0.4620 => 0.5917, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.45% (0.0408 => 0.0520, std.dev.: 0.0001) MultiSource/Applications/minisat/minisat: 27.42% (0.7115 => 0.9066, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.37% (0.1337 => 0.1703, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.17% (0.3121 => 0.3969, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.12% (0.1906 => 0.2423, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/tsp/tsp: 26.98% (0.1175 => 0.1492, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.93% (0.0672 => 0.0853, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 26.69% (0.6456 => 0.8179, std.dev.: 0.0004) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.44% (0.1566 => 0.1980, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.25% (0.0842 => 0.1063, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.04% (0.5020 => 0.6327, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/hash: 25.77% (0.0485 => 0.0610, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 25.62% (0.0527 => 0.0662, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 25.61% (0.0660 => 0.0829, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.58% (0.1032 => 0.1296, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.57% (0.1236 => 0.1552, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 25.53% (0.0662 => 0.0831, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/mst/mst: 25.37% (0.1163 => 0.1458, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.26% (0.2700 => 0.3382, std.dev.: 0.0065) MultiSource/Applications/viterbi/viterbi: 24.95% (0.1555 => 0.1943, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.94% (1.3050 => 1.6305, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/lists: 24.92% (0.0626 => 0.0782, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 24.83% (0.0886 => 0.1106, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 24.79% (0.7835 => 0.9777, std.dev.: 0.0026) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.45% (0.0871 => 0.1084, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.44% (0.0675 => 0.0840) MultiSource/Applications/aha/aha: 24.41% (0.1151 => 0.1432, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.91% (0.1029 => 0.1275, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.82% (0.0953 => 0.1180, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: 23.80% (3.3354 => 4.1292, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.75% (0.5860 => 0.7252, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 23.67% (1.1840 => 1.4642, std.dev.: 0.0006) MultiSource/Applications/oggenc/oggenc: 23.66% (5.7591 => 7.1215, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.65% (0.3307 => 0.4089) SingleSource/Benchmarks/Shootout-C++/matrix: 23.37% (0.3098 => 0.3822, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 23.24% (0.1695 => 0.2089, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.14% (0.1940 => 0.2389, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.38% (0.1510 => 0.1848, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.37% (4.9449 => 6.0513, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.35% (0.0528 => 0.0646, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 22.31% (0.0614 => 0.0751, std.dev.: 0.0014) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0567 => 0.0693, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.15% (0.8172 => 0.9982, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 22.06% (0.7433 => 0.9073, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 21.95% (0.8921 => 1.0879, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.91% (0.1584 => 0.1931, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 21.77% (0.2049 => 0.2495, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.69% (0.2107 => 0.2564, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 21.68% (2.0273 => 2.4669, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.68% (0.2758 => 0.3356, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.51% (5.0018 => 6.0777, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.46% (0.5569 => 0.6764, std.dev.: 0.0007) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.41% (0.0467 => 0.0567, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 21.27% (0.3423 => 0.4151, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.23% (0.9765 => 1.1838, std.dev.: 0.0028) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.93% (1.1861 => 1.4344, std.dev.: 0.0139) SingleSource/UnitTests/SignlessTypes/rem: 20.89% (0.1144 => 0.1383, std.dev.: 0.0003) MultiSource/Applications/lua/lua: 20.86% (3.8723 => 4.6802, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.74% (0.6450 => 0.7788, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.50% (0.0834 => 0.1005, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.50% (0.1117 => 0.1346, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.37% (0.0491 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.36% (0.0933 => 0.1123, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/health/health: 20.19% (0.1268 => 0.1524, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.18% (0.4203 => 0.5051, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.16% (0.0759 => 0.0912, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.13% (0.0770 => 0.0925, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.06% (0.0648 => 0.0778, std.dev.: 0.0001) MultiSource/Applications/siod/siod: 19.93% (2.2969 => 2.7546, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.61% (0.0770 => 0.0921, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.49% (0.8101 => 0.9680, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.14% (0.5981 => 0.7126, std.dev.: 0.0030) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: 19.10% (0.3283 => 0.3910, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.06% (0.1044 => 0.1243, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.98% (0.2065 => 0.2457, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.90% (0.2603 => 0.3095, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.80% (0.3441 => 0.4088, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary: 18.72% (0.3232 => 0.3837, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.86% (0.3180 => 0.3748, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 17.85% (0.0818 => 0.0964, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.76% (0.8067 => 0.9500, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: 17.37% (0.3379 => 0.3966, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.19% (0.0704 => 0.0825, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.05% (0.3865 => 0.4524, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 16.98% (0.3387 => 0.3962, std.dev.: 0.0006) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.74% (0.4636 => 0.5412, std.dev.: 0.0011) MultiSource/Applications/sqlite3/sqlite3: 15.54% (17.1811 => 19.8507, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.50% (1.5603 => 1.8022, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.33% (0.4103 => 0.4732, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.32% (0.4048 => 0.4668, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 15.15% (0.2905 => 0.3345, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/lists: 15.08% (0.3422 => 0.3938, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/lists1: 14.90% (0.3684 => 0.4233, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 14.68% (0.3603 => 0.4132, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.47% (0.4064 => 0.4652, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 14.01% (0.3927 => 0.4477, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bh/bh: 13.78% (0.3092 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.67% (0.3826 => 0.4349, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.64% (0.1114 => 0.1266, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.48% (0.3427 => 0.3889, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.35% (14.3668 => 16.2846, std.dev.: 0.0032) SingleSource/UnitTests/ObjC/property: 13.33% (0.3886 => 0.4404, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.09% (0.2430 => 0.2748, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/strcat: 12.47% (0.2831 => 0.3184, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.46% (0.3828 => 0.4305, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.25% (0.3543 => 0.3977, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 12.24% (0.3694 => 0.4146, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/trivial-interface: 12.06% (0.3473 => 0.3892, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/exceptions-4: 12.02% (0.3543 => 0.3969, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/except: 12.02% (0.2871 => 0.3216, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions-2: 11.98% (0.3497 => 0.3916, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 11.96% (0.3561 => 0.3987, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.83% (0.3516 => 0.3932, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.33% (2.0665 => 2.3006, std.dev.: 0.0026) MultiSource/Applications/hexxagon/hexxagon: 11.31% (1.2842 => 1.4295, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.26% (0.3935 => 0.4378, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 11.16% (0.2877 => 0.3198, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.12% (0.3650 => 0.4056, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.07% (0.2756 => 0.3061, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.92% (0.2793 => 0.3098, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 10.86% (0.2725 => 0.3021, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 10.80% (0.1268 => 0.1405, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.76% (0.2891 => 0.3202, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.75% (0.3162 => 0.3502, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.46% (0.1625 => 0.1795, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.45% (0.2872 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: 10.42% (0.3052 => 0.3370, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 10.31% (0.2802 => 0.3091, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 10.10% (0.7326 => 0.8066, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hello: 10.10% (0.2714 => 0.2988, std.dev.: 0.0011) MultiSource/Benchmarks/Bullet/bullet: 9.89% (63.2438 => 69.4978, std.dev.: 0.0040) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.76% (0.3136 => 0.3442, std.dev.: 0.0005) SingleSource/UnitTests/ObjC++/property-reference-object: 9.65% (0.6030 => 0.6612, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 9.54% (0.5925 => 0.6490, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.72% (0.1330 => 0.1446, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.65% (0.2266 => 0.2462, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.23% (2.2022 => 2.3835, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 7.85% (0.1440 => 0.1553, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.30% (0.4879 => 0.5235, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 5.88% (0.3131 => 0.3315, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 4.59% (10.3673 => 10.8431, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.53% (0.3817 => 0.3990, std.dev.: 0.0003) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.02% (7.9617 => 8.2818, std.dev.: 0.0095) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3118, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4730, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (1.1145 => 1.2933, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6966, std.dev.: 0.0003) SingleSource/Regression/C/uint64_to_float: 13.08% (0.5413 => 0.6121, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.2944 => 0.3258, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1492, std.dev.: 0.0007) MultiSource/Benchmarks/nbench/nbench: 6.89% (11.6436 => 12.4456, std.dev.: 0.2211) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (4.2280 => 4.4600, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3118, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.51% (0.9957 => 1.0406, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.43% (2.0360 => 2.1059, std.dev.: 0.0050) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.58% (8.6802 => 8.9043, std.dev.: 0.0257) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.03% (3.6395 => 3.7132, std.dev.: 0.0070) MultiSource/Applications/aha/aha: 1.94% (3.1595 => 3.2207, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 1.83% (9.1159 => 9.2826, std.dev.: 0.0047) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.79% (1.7254 => 1.7562, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3094, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 1.46% (1.0785 => 1.0942, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.04% (6.5088 => 6.5764, std.dev.: 0.0060) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1477, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.92% (5.2763 => 1.1652, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/salsa20: -74.88% (0.8651 => 0.2173, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.29% (0.1622 => 0.0936, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.81% (5.3855 => 4.4801, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.01% (5.3526 => 4.4956, std.dev.: 0.0053) MultiSource/Applications/JM/ldecod/ldecod: -12.03% (10.4361 => 9.1806, std.dev.: 0.0036) SingleSource/UnitTests/Vector/constpool: -7.77% (54.1659 => 49.9566, std.dev.: 0.0660) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.48% (1.7609 => 1.6292, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.04% (1.9577 => 0.6649, std.dev.: 0.0075) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.01% (0.6962 => 0.3411, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3065, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0195, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel: -33.56% (1.1492 => 0.7635, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -30.93% (10.7105 => 7.3982, std.dev.: 0.0196) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1278, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.51% (2.6546 => 2.0040, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5895, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0032) MultiSource/Benchmarks/FreeBench/mason/mason: -19.90% (0.2161 => 0.1731, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -19.20% (0.6223 => 0.5028, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.73% (2.5528 => 2.1258, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: -15.90% (1.6925 => 1.4234, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7334, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.22% (9.5636 => 8.4910, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9120, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -7.07% (1.8329 => 1.7034, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4818, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.78% (19.9488 => 18.5954, std.dev.: 0.0178) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) SingleSource/Benchmarks/McGill/chomp: -5.86% (1.2373 => 1.1648, std.dev.: 0.0009) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5861, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7015, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5785, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops-5: -4.86% (1.5835 => 1.5066, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/salsa20: -4.73% (10.2830 => 9.7971, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.37% (0.4808 => 0.4598, std.dev.: 0.0023) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1551, std.dev.: 0.0004) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9545, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -1.76% (3.7221 => 3.6567, std.dev.: 0.0126) SingleSource/Benchmarks/Shootout-C++/lists: -1.58% (12.5348 => 12.3362, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.15% (6.2999 => 6.2277, std.dev.: 0.0066) SingleSource/Benchmarks/Shootout/ary3: -1.14% (3.6994 => 3.6572, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout/hash: -1.07% (4.9088 => 4.8565, std.dev.: 0.0022) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.91% (0.2116 => 0.0679, std.dev.: 0.0012) Report Time: 1.49s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Wed Jan 30 23:53:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 01:53:11 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131075311.41F722A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8136?compare_to=8132&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8136, Order: 174041, Start Time: 2013-01-31 06:19:28, End Time: 2013-01-31 07:53:34 To: 8132, Order: 174035, Start Time: 2013-01-31 04:21:55, End Time: 2013-01-31 05:55:58 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (124 on baseline) Performance Improvements: 0 (91 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.22% (1.2631 => 1.2911, std.dev.: 0.0030) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.97% (0.6395 => 0.8823, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.08% (0.6395 => 0.8702, std.dev.: 0.0031) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.66% (0.5456 => 0.7238, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.63% (0.5805 => 0.7699, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.49% (0.6260 => 0.8294, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.14% (0.5567 => 0.7356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.98% (0.5575 => 0.7358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.90% (0.5849 => 0.7715, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.86% (0.5581 => 0.7359, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.67% (0.6230 => 0.8203, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.21% (0.5802 => 0.7613, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.75% (0.5941 => 0.7768, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.63% (1.6474 => 2.1520, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.57% (0.5705 => 0.7449, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.15% (0.5569 => 0.7248, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.13% (0.5570 => 0.7248, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.08% (0.6033 => 0.7848, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.08% (0.5478 => 0.7126, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.03% (0.5857 => 0.7616, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.95% (0.5859 => 0.7614, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.91% (0.5591 => 0.7263, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.22% (0.5925 => 0.7656, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.91% (0.6189 => 0.7978, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.62% (0.5863 => 0.7541, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.40% (0.6676 => 0.8572, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.16% (0.6304 => 0.8079, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.07% (0.6052 => 0.7751, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.61% (0.6446 => 0.8226, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.27% (0.6194 => 0.7883, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.03% (0.6681 => 0.8487, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.83% (0.6660 => 0.8447, std.dev.: 0.0139) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.60% (0.6297 => 0.7972, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.17% (0.6667 => 0.8345, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.75% (0.0699 => 0.0872, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.40% (0.0582 => 0.0724, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.07% (0.7524 => 0.9335, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.13% (2.2587 => 2.7811, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.04% (0.7339 => 0.9030, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.47% (0.0445 => 0.0545, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.36% (0.0621 => 0.0735, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.36% (0.1146 => 0.1345, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 16.59% (0.3357 => 0.3914, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.55% (1.1450 => 1.3230, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (4.5069 => 5.0875, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.56% (1.6364 => 1.8420, std.dev.: 0.0090) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.51% (0.4916 => 0.5531, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.02% (3.5339 => 3.9586, std.dev.: 0.0127) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0021) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.90% (0.2385 => 0.2645, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 10.25% (9.2283 => 10.1746, std.dev.: 0.0040) MultiSource/Applications/Burg/burg: 9.14% (1.2515 => 1.3659, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.5329 => 0.5812, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.95% (0.1731 => 0.1886, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.86% (0.1230 => 0.1339, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.73% (0.7021 => 0.7634, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash: 8.66% (0.4524 => 0.4916, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hash2: 8.04% (0.4861 => 0.5252, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.00% (1.2784 => 1.3807, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.4642 => 1.5750, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.58% (0.6750 => 0.7194, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 6.30% (0.3255 => 0.3460, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.84% (5.4682 => 5.7875, std.dev.: 0.0078) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.33% (0.3319 => 0.3496, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.67% (22.4056 => 23.4509, std.dev.: 0.0300) MultiSource/Applications/SPASS/SPASS: 3.68% (15.5079 => 16.0785, std.dev.: 0.0029) MultiSource/Applications/oggenc/oggenc: 3.60% (5.0226 => 5.2032, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 3.56% (0.7447 => 0.7712, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.49% (0.9557 => 0.9891, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary3: 3.42% (0.3446 => 0.3564, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.37% (1.3864 => 1.4331, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 3.25% (0.8418 => 0.8692, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary: 3.21% (0.3394 => 0.3503, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.01% (0.3491 => 0.3596, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.00% (0.4427 => 0.4560, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.55% (0.5168 => 0.5300, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.39% (1.3722 => 1.4050, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.99% (0.6293 => 0.6418, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.45% (3.5154 => 3.5663, std.dev.: 0.0079) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.45% (1.2300 => 1.2478, std.dev.: 0.0023) MultiSource/Applications/kimwitu++/kc: 1.36% (18.2933 => 18.5422, std.dev.: 0.0240) MultiSource/Benchmarks/Bullet/bullet: 1.27% (34.0927 => 34.5254, std.dev.: 0.0066) MultiSource/Benchmarks/nbench/nbench: 1.02% (1.1530 => 1.1648, std.dev.: 0.0029) MultiSource/Applications/treecc/treecc: 1.02% (2.1401 => 2.1619, std.dev.: 0.0084) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8048, std.dev.: 0.0109) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.80% (0.9531 => 1.0274, std.dev.: 0.0007) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.26% (54.5751 => 56.3519, std.dev.: 0.1388) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.78% (2.0478 => 2.1048, std.dev.: 0.0114) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3026, std.dev.: 0.0022) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.68% (18.2231 => 18.5294, std.dev.: 0.0089) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5972, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4538, std.dev.: 0.0220) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.66% (0.3194 => 0.3045, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.61% (0.7198 => 0.6866, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: -4.04% (0.3812 => 0.3658, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -3.94% (0.3831 => 0.3680, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.92% (0.3880 => 0.3728, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.90% (0.3848 => 0.3698, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.88% (0.3896 => 0.3745, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.83% (0.3891 => 0.3742, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.82% (0.4033 => 0.3879, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.69% (0.4176 => 0.4022, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.45% (0.6347 => 0.6128, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.44% (0.9852 => 0.9513, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.42% (0.3884 => 0.3751, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.37% (2.4924 => 2.4084, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.35% (0.3821 => 0.3693, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -3.21% (0.6441 => 0.6234, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.95% (0.4199 => 0.4075, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.64% (2.1713 => 2.1140, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.62% (0.9542 => 0.9292, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: -2.62% (0.4280 => 0.4168, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.49% (0.7779 => 0.7585, std.dev.: 0.0010) MultiSource/Applications/hexxagon/hexxagon: -2.42% (1.3148 => 1.2830, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.22% (0.6484 => 0.6340, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.04% (20.7746 => 20.3506, std.dev.: 0.0149) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.61% (14.2083 => 13.9791, std.dev.: 0.0084) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.02% (6.7716 => 6.7022, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.02% (1.0544 => 1.0436, std.dev.: 0.0027) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.83% (1.8100 => 0.6908, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.93% (0.1622 => 0.1023, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3123, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.24% (0.1983 => 0.1423, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2499, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -24.42% (1.3643 => 1.0311, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: -23.41% (7.5137 => 5.7547, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4526, std.dev.: 0.0329) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2051, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1728, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.32% (2.5106 => 2.1261, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.17% (0.4092 => 0.3512, std.dev.: 0.0109) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3556, std.dev.: 0.0016) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.94% (0.5142 => 0.4631, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: -8.98% (1.2842 => 1.1689, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0036) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (1.7753 => 1.6995, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.78% (2.2633 => 2.1778, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4000, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.04% (1.0557 => 1.0236, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.81% (4.4002 => 4.2764, std.dev.: 0.0016) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.72% (7.9763 => 7.7592, std.dev.: 0.0254) SingleSource/Benchmarks/Shootout/ary3: -2.36% (3.7241 => 3.6362, std.dev.: 0.0100) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1178, std.dev.: 0.0012) MultiSource/Benchmarks/Bullet/bullet: -1.80% (7.3040 => 7.1723, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.54% (6.5735 => 6.4723, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.41% (1.3096 => 1.2911, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.32% (1.6086 => 1.5873, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.27% (1.6307 => 1.6100, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.16% (1.6219 => 1.6031, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: -1.07% (3.7092 => 3.6696, std.dev.: 0.0111) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 00:51:11 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 02:51:11 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131085111.AF0082A6C071@llvm.org> http://llvm.org/perf/db_default/v4/nts/8137?compare_to=8133&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8137, Order: 174044, Start Time: 2013-01-31 06:49:15, End Time: 2013-01-31 08:51:35 To: 8133, Order: 174035, Start Time: 2013-01-31 04:23:37, End Time: 2013-01-31 06:29:08 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 16 (104 on baseline) Performance Improvements: 24 (97 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1024 (862 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.75% (1.1420 => 1.1734, std.dev.: 0.0094) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.43% (1.2628 => 1.2935, std.dev.: 0.0055) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 1.47% (0.6876 => 0.6977, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.16% (1.2383 => 1.2527, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.01% (1.3030 => 1.3162, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.29% (1.4604 => 1.8590, std.dev.: 0.0100) SingleSource/Benchmarks/Shootout-C++/nestedloop: 22.40% (0.2000 => 0.2448, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/ft/ft: 10.85% (0.7770 => 0.8613, std.dev.: 0.0063) SingleSource/Regression/C/uint64_to_float: 6.58% (1.7859 => 1.9034, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.67% (8.1041 => 8.5639, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.89% (4.8430 => 5.0798, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.35% (1.8346 => 1.8961, std.dev.: 0.0137) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 3.33% (2.6485 => 2.7368, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/bigfib: 2.98% (0.3491 => 0.3595, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.63% (1.5872 => 1.6130, std.dev.: 0.0094) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.10% (3.3224 => 3.3591, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Bullet/bullet: -5.97% (36.3361 => 34.1681, std.dev.: 0.3347) SingleSource/Benchmarks/Shootout-C++/random: -5.47% (0.2158 => 0.2040, std.dev.: 0.0046) MultiSource/Applications/siod/siod: -5.21% (2.6214 => 2.4847, std.dev.: 0.0076) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.17% (25.8627 => 24.5245, std.dev.: 0.1347) MultiSource/Applications/SPASS/SPASS: -4.70% (17.7428 => 16.9092, std.dev.: 0.0557) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.17% (0.2659 => 0.2548, std.dev.: 0.0007) MultiSource/Applications/sgefa/sgefa: -3.26% (0.4445 => 0.4300, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.23% (0.9426 => 0.9122, std.dev.: 0.0116) MultiSource/Applications/kimwitu++/kc: -3.00% (19.5309 => 18.9443, std.dev.: 0.0578) MultiSource/Applications/SIBsim4/SIBsim4: -2.86% (1.5061 => 1.4630, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.72% (1.3380 => 1.3150, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.53% (1.4021 => 1.3806, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.21% (1.2182 => 1.2035, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.03% (1.2566 => 1.2436, std.dev.: 0.0010) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: -8.51% (10.0033 => 9.1518, std.dev.: 0.3305) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.14% (63.2789 => 59.3955, std.dev.: 1.1017) MultiSource/Benchmarks/nbench/nbench: -6.00% (22.0106 => 20.6899, std.dev.: 0.4453) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.73% (0.4384 => 0.4133, std.dev.: 0.0069) MultiSource/Benchmarks/Olden/health/health: -3.53% (0.3546 => 0.3421, std.dev.: 0.0043) MultiSource/Benchmarks/llubenchmark/llu: -3.13% (2.0611 => 1.9966, std.dev.: 0.0130) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.72% (1.1413 => 1.1102, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: -1.66% (7.8863 => 7.7556, std.dev.: 0.0120) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.39% (2.5108 => 2.4758, std.dev.: 0.0100) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.16% (0.9709 => 0.9596, std.dev.: 0.0039) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.12% (1.2313 => 1.2328, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.15% (0.0233 => 0.0228, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 0.91% (0.0438 => 0.0442, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0345 => 0.0345, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.43% (0.0329 => 0.0321, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.45% (0.0443 => 0.0441, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/casts: 64.12% (0.0131 => 0.0215, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: -3.06% (0.0229 => 0.0222, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.09% (0.0231 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -7.14% (0.0014 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -2.39% (0.1464 => 0.1429, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: -4.76% (1.2104 => 1.1528, std.dev.: 0.0994) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.76% (0.4161 => 0.4046, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.28% (0.1463 => 0.1511, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.42% (0.0632 => 0.0623, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 2.97% (0.0269 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.95% (0.0561 => 0.0522, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.13% (1.2902 => 1.2885, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -5.56% (0.0018 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.22% (0.0616 => 0.0590, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -7.49% (0.0374 => 0.0346, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.24% (1.7457 => 1.7499, std.dev.: 0.0053) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: 100.00% (0.0001 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: 40.32% (0.0062 => 0.0087, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.39% (34.3180 => 34.1846, std.dev.: 0.2036) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 395.83% (0.0336 => 0.1666, std.dev.: 0.0200) SingleSource/Regression/C/sumarraymalloc: 118.43% (0.0293 => 0.0640, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 87.96% (0.0274 => 0.0515, std.dev.: 0.0019) MultiSource/Benchmarks/FreeBench/neural/neural: 62.03% (0.1638 => 0.2654, std.dev.: 0.0068) SingleSource/Regression/C/sumarray: 60.38% (0.0265 => 0.0425, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.60% (0.8893 => 1.2770, std.dev.: 0.0147) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 43.51% (0.9120 => 1.3088, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.95% (0.8926 => 1.2760, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.32% (0.9061 => 1.2896, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 42.05% (0.9564 => 1.3586, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.01% (0.9612 => 1.3650, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.98% (0.9381 => 1.3319, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.59% (0.9588 => 1.3576, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.82% (0.8990 => 1.2660, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.40% (0.9091 => 1.2764, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.09% (0.9855 => 1.3806, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 40.03% (0.9998 => 1.4000, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.57% (0.9422 => 1.3150, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.04% (0.9403 => 1.3074, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.03% (0.9010 => 1.2527, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 38.68% (0.8912 => 1.2359, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.47% (0.9512 => 1.3171, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.94% (1.0119 => 1.3958, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.51% (0.8736 => 1.2013, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 37.10% (1.0867 => 1.4899, std.dev.: 0.0095) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.75% (0.8732 => 1.1941, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.64% (1.0052 => 1.3735, std.dev.: 0.0155) SingleSource/Benchmarks/Stanford/IntMM: 35.96% (0.0431 => 0.0586, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.84% (0.8846 => 1.2016, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/exptree: 35.27% (0.0859 => 0.1162, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.71% (0.9867 => 1.3292, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 34.32% (1.0017 => 1.3455, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.19% (0.9507 => 1.2662, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.13% (0.9788 => 1.3031, std.dev.: 0.0164) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.05% (0.9488 => 1.2624, std.dev.: 0.0155) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.42% (1.0088 => 1.3359, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.09% (0.9685 => 1.2793, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 31.86% (0.9127 => 1.2035, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.71% (0.9993 => 1.3162, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.07% (0.9405 => 1.2327, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.22% (0.9550 => 1.2436, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.65% (1.0860 => 1.3971, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.63% (0.0738 => 0.0905, std.dev.: 0.0022) MultiSource/Applications/sgefa/sgefa: 19.51% (0.3598 => 0.4300, std.dev.: 0.0032) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.83% (0.0669 => 0.0795, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.84% (3.6295 => 4.2044, std.dev.: 0.1389) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.65% (1.0986 => 1.2705, std.dev.: 0.0047) MultiSource/Benchmarks/McCat/04-bisect/bisect: 15.54% (0.1332 => 0.1539, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.06% (0.0963 => 0.1108, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.94% (0.0783 => 0.0900, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.16% (0.0805 => 0.0919, std.dev.: 0.0038) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.39% (0.1240 => 0.1406, std.dev.: 0.0027) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.41% (1.4110 => 1.5861, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.99% (0.5369 => 0.5959, std.dev.: 0.0153) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.98% (0.2577 => 0.2860, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/chomp: 10.76% (0.1793 => 0.1986, std.dev.: 0.0023) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.30% (5.0381 => 5.5570, std.dev.: 0.0220) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.77% (1.8651 => 2.0473, std.dev.: 0.0106) SingleSource/Benchmarks/Misc/ReedSolomon: 9.56% (0.2050 => 0.2246, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.48% (0.2879 => 0.3123, std.dev.: 0.0008) MultiSource/Applications/oggenc/oggenc: 6.75% (5.3553 => 5.7170, std.dev.: 0.0339) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.44% (0.2372 => 0.2501, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 5.13% (0.3702 => 0.3892, std.dev.: 0.0046) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.98% (23.5861 => 24.5245, std.dev.: 0.1347) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.35% (0.3374 => 0.3487, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/football/football: 3.07% (0.9759 => 1.0059, std.dev.: 0.0046) MultiSource/Applications/JM/lencod/lencod: 2.96% (16.7012 => 17.1949, std.dev.: 0.0863) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.81% (0.7693 => 0.7909, std.dev.: 0.0079) MultiSource/Applications/SPASS/SPASS: 2.80% (16.4479 => 16.9092, std.dev.: 0.0557) MultiSource/Benchmarks/Bullet/bullet: 2.78% (33.2440 => 34.1681, std.dev.: 0.3347) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.01% (1.2680 => 1.2935, std.dev.: 0.0055) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.92% (0.6934 => 0.7067, std.dev.: 0.0031) MultiSource/Applications/SIBsim4/SIBsim4: 1.65% (1.4392 => 1.4630, std.dev.: 0.0060) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106650.00% (0.0008 => 0.8540, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/matrix: 355.81% (1.5825 => 7.2132, std.dev.: 0.0314) SingleSource/Benchmarks/Shootout/ary3: 299.92% (2.2304 => 8.9198, std.dev.: 2.1868) MultiSource/Applications/sgefa/sgefa: 258.92% (0.3515 => 1.2616, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.11% (1.1825 => 4.0691, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.44% (4.8185 => 15.8258, std.dev.: 0.1445) SingleSource/Benchmarks/Shootout-C++/ary2: 206.98% (0.0129 => 0.0396, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 202.19% (0.0228 => 0.0689, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/ary: 139.22% (0.0232 => 0.0555, std.dev.: 0.0056) SingleSource/Benchmarks/Shootout-C++/matrix: 66.96% (2.9083 => 4.8556, std.dev.: 0.1091) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.80% (0.2562 => 0.3428, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.47% (3.1254 => 4.1091, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 29.98% (1.4588 => 1.8961, std.dev.: 0.0137) SingleSource/Regression/C/uint64_to_float: 23.62% (1.5397 => 1.9034, std.dev.: 0.0168) SingleSource/Benchmarks/Misc/salsa20: 21.91% (7.4497 => 9.0819, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.46% (4.8112 => 5.7958, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.26% (0.2070 => 0.2448, std.dev.: 0.0036) MultiSource/Applications/JM/lencod/lencod: 13.79% (6.8159 => 7.7556, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8566, std.dev.: 0.0286) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.94% (5.0033 => 5.6509, std.dev.: 0.0243) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.87% (3.6477 => 3.9712, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/ReedSolomon: 8.39% (8.6447 => 9.3697, std.dev.: 0.0052) MultiSource/Benchmarks/MallocBench/espresso/espresso: 8.05% (0.6211 => 0.6711, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.00% (4.7473 => 5.0798, std.dev.: 0.0026) SingleSource/Benchmarks/McGill/chomp: 5.68% (1.0425 => 1.1017, std.dev.: 0.0123) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.26% (4.1836 => 4.4037, std.dev.: 0.0068) SingleSource/Benchmarks/Linpack/linpack-pc: 4.68% (50.8945 => 53.2762, std.dev.: 0.2893) SingleSource/Benchmarks/Misc/pi: 3.38% (2.1390 => 2.2113, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.33% (4.7254 => 4.8826, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.20% (2.5681 => 2.5990, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8629, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0808 => 0.0505, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.67% (0.0727 => 0.0504, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/drop3/drop3: -26.88% (0.0692 => 0.0506, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: -24.58% (0.1888 => 0.1424, std.dev.: 0.0072) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.20% (0.0676 => 0.0553, std.dev.: 0.0011) MultiSource/Applications/hbd/hbd: -17.14% (1.8964 => 1.5714, std.dev.: 0.0645) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.97% (0.1684 => 0.1415, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: -14.87% (0.1009 => 0.0859, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/dbms/dbms: -14.53% (1.0960 => 0.9368, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -13.35% (0.1079 => 0.0935, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.94% (0.7686 => 0.6768, std.dev.: 0.0005) MultiSource/Applications/spiff/spiff: -9.06% (1.0220 => 0.9294, std.dev.: 0.0179) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.84% (6.4235 => 5.8555, std.dev.: 0.2062) MultiSource/Benchmarks/SciMark2-C/scimark2: -8.84% (0.4074 => 0.3714, std.dev.: 0.0048) MultiSource/Applications/Burg/burg: -8.40% (1.5979 => 1.4636, std.dev.: 0.0232) MultiSource/Applications/treecc/treecc: -8.19% (2.4719 => 2.2694, std.dev.: 0.0477) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.69% (0.1366 => 0.1261, std.dev.: 0.0026) MultiSource/Applications/aha/aha: -7.62% (0.1378 => 0.1273, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.45% (0.7693 => 0.7120, std.dev.: 0.0055) MultiSource/Benchmarks/Olden/health/health: -6.96% (0.1610 => 0.1498, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/hash: -6.27% (0.4689 => 0.4395, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -6.16% (10.2703 => 9.6377, std.dev.: 0.0303) MultiSource/Applications/lua/lua: -6.13% (4.6406 => 4.3562, std.dev.: 0.0315) MultiSource/Applications/siod/siod: -6.01% (2.6437 => 2.4847, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.23% (1.0234 => 0.9699, std.dev.: 0.0145) MultiSource/Benchmarks/Prolangs-C/loader/loader: -5.06% (0.3560 => 0.3380, std.dev.: 0.0005) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.86% (0.9588 => 0.9122, std.dev.: 0.0116) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.59% (0.6885 => 0.6569, std.dev.: 0.0032) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.39% (1.2154 => 1.1621, std.dev.: 0.0063) MultiSource/Applications/ClamAV/clamscan: -3.84% (17.4365 => 16.7662, std.dev.: 0.2387) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.73% (0.3462 => 0.3333, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.67% (0.9124 => 0.8789, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -3.45% (1.1498 => 1.1101, std.dev.: 0.0078) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.84% (1.5131 => 1.4701, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.59% (1.3220 => 1.3010, std.dev.: 0.0065) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.26% (1.3924 => 1.3748, std.dev.: 0.0047) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.79% (11.5523 => 3.9518, std.dev.: 0.0112) SingleSource/Benchmarks/Misc/fp-convert: -61.97% (15.6525 => 5.9524, std.dev.: 0.1184) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.10% (0.4146 => 0.1820, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.41% (0.4578 => 0.2362, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.91% (11.3868 => 6.3869, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.86% (5.4023 => 3.6269, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bisort/bisort: -30.88% (0.9372 => 0.6478, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.66% (0.4452 => 0.3087, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.52% (0.5495 => 0.4038, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.19% (5.2605 => 3.8826, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.35% (4.4467 => 3.3193, std.dev.: 0.2226) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.53% (0.5826 => 0.4397, std.dev.: 0.0041) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.22% (0.5897 => 0.4469, std.dev.: 0.0111) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8228, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: -21.57% (7.9891 => 6.2659, std.dev.: 0.1944) MultiSource/Benchmarks/Ptrdist/ft/ft: -20.37% (1.0816 => 0.8613, std.dev.: 0.0063) MultiSource/Benchmarks/Fhourstones/fhourstones: -18.39% (1.5623 => 1.2750, std.dev.: 0.0328) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.37% (5.8755 => 4.7960, std.dev.: 0.0101) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.32% (16.6791 => 13.6240, std.dev.: 0.2062) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.28% (2.8778 => 2.3518, std.dev.: 0.1219) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.62% (7.0016 => 6.0481, std.dev.: 0.1611) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.14% (3.1921 => 2.7728, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6751, std.dev.: 0.0082) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.61% (9.7992 => 8.5639, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9941, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.30% (5.0421 => 4.4722, std.dev.: 0.1826) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.10% (1.4235 => 1.2655, std.dev.: 0.0138) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.49% (0.4081 => 0.3653, std.dev.: 0.0036) MultiSource/Benchmarks/mafft/pairlocalalign: -9.40% (63.1520 => 57.2130, std.dev.: 0.2294) MultiSource/Applications/SPASS/SPASS: -7.59% (9.0650 => 8.3774, std.dev.: 0.2298) MultiSource/Applications/SIBsim4/SIBsim4: -7.45% (3.5443 => 3.2804, std.dev.: 0.0124) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.09% (0.3217 => 0.2989, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/nestedloop: -6.82% (0.2200 => 0.2050, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.62% (5.5974 => 5.2269, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.44% (4.5424 => 4.2497, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/health/health: -6.38% (0.3654 => 0.3421, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.71% (4.9799 => 4.6953, std.dev.: 0.0966) SingleSource/Benchmarks/McGill/queens: -5.69% (1.7443 => 1.6450, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.84% (0.3349 => 0.3187, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.49% (3.7662 => 3.5972, std.dev.: 0.0502) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3591, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.24% (1.4446 => 1.3833, std.dev.: 0.0147) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.96% (23.3986 => 22.4714, std.dev.: 0.3315) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.77% (2.5170 => 2.4220, std.dev.: 0.0098) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4362, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.59% (5.8973 => 5.6853, std.dev.: 0.0042) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.31% (40.4729 => 39.1351, std.dev.: 0.1454) SingleSource/Benchmarks/Shootout-C++/lists: -3.25% (17.2182 => 16.6594, std.dev.: 0.0726) MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.14% (0.3406 => 0.3299, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: -2.59% (2.8571 => 2.7832, std.dev.: 0.0134) MultiSource/Applications/lua/lua: -2.15% (29.0327 => 28.4082, std.dev.: 0.0321) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5785, std.dev.: 0.0018) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.64% (85.3042 => 83.9011, std.dev.: 0.0448) SingleSource/Benchmarks/Misc/whetstone: -1.56% (1.6251 => 1.5998, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.47% (8.8249 => 8.6948, std.dev.: 0.0106) SingleSource/Benchmarks/Shootout-C++/methcall: -1.35% (8.7416 => 8.6233, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.23% (6.8262 => 6.7424, std.dev.: 0.0032) SingleSource/Benchmarks/BenchmarkGame/recursive: -1.22% (2.4498 => 2.4200, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/dt: -1.03% (0.9870 => 0.9768, std.dev.: 0.0039) MultiSource/Benchmarks/Olden/bh/bh: -1.03% (2.4120 => 2.3871, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.33% (1.2047 => 1.2328, std.dev.: 0.0054) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.15% (0.0233 => 0.0228, std.dev.: 0.0045) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.00% (0.0451 => 0.0442, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.44% (0.0394 => 0.0345, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0077) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.90% (0.0445 => 0.0441, std.dev.: 0.0074) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.60% (0.1530 => 0.1429, std.dev.: 0.0058) MultiSource/Applications/lemon/lemon: -40.25% (1.9293 => 1.1528, std.dev.: 0.0994) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.07% (0.4049 => 0.4046, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 0.07% (0.1510 => 0.1511, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.30% (0.0978 => 0.0623, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.53% (0.0590 => 0.0522, std.dev.: 0.0050) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.92% (1.1617 => 1.2885, std.dev.: 0.0059) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.28% (0.0610 => 0.0590, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.10% (0.0268 => 0.0346, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.30% (0.7437 => 1.7499, std.dev.: 0.0053) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -75.00% (0.0008 => 0.0002, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -5.43% (0.0092 => 0.0087, std.dev.: 0.0033) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 167.52% (12.7781 => 34.1846, std.dev.: 0.2036) Report Time: 1.23s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 01:48:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 03:48:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131094803.9DF482A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8138?compare_to=8135&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8138, Order: 174044, Start Time: 2013-01-31 07:33:31, End Time: 2013-01-31 09:48:23 To: 8135, Order: 174036, Start Time: 2013-01-31 04:51:03, End Time: 2013-01-31 07:02:53 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 3 (227 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1097 (646 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: 27.12% (0.4134 => 0.5255, std.dev.: 0.0234) MultiSource/Benchmarks/PAQ8p/paq8p: 1.72% (10.8431 => 11.0300, std.dev.: 0.0071) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.46% (10.2947 => 10.4448, std.dev.: 0.0047) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.23% (0.1329 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.41% (0.0415 => 0.0425, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.24% (0.0679 => 0.0657, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/power/power: -0.52% (499.8427 => 497.2379, std.dev.: 1.2347) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.03% (4.3882 => 0.0425, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 43993.10% (1.1277 => 497.2379, std.dev.: 1.2347) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.39% (0.5229 => 1.7119, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 26.92% (14.9895 => 19.0241, std.dev.: 0.0188) MultiSource/Applications/kimwitu++/kc: 49.03% (14.1553 => 21.0960, std.dev.: 0.0128) MultiSource/Benchmarks/MallocBench/gs/gs: 22.06% (4.1105 => 5.0172, std.dev.: 0.1342) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.47% (1.1048 => 1.7950, std.dev.: 0.0351) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 454.53% (7.1582 => 39.6945, std.dev.: 0.0165) SingleSource/Benchmarks/Misc-C++-EH/spirit: 92.55% (3.4629 => 6.6677, std.dev.: 0.0178) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.35% (0.6222 => 1.1470, std.dev.: 0.0004) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10247.64% (0.0720 => 7.4503, std.dev.: 0.0112) MultiSource/Applications/SIBsim4/SIBsim4: 3834400.00% (0.0001 => 3.8345, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11110000.00% (0.0001 => 11.1101, std.dev.: 0.0355) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/gs/gs: 66400.00% (0.0001 => 0.0665, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14400.00% (0.0001 => 0.0145, std.dev.: 0.0017) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575800.00% (0.0001 => 0.5759, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9847600.00% (0.0001 => 9.8477, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5491800.00% (0.0001 => 5.4919, std.dev.: 0.0293) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.07% (1.1194 => 10.4448, std.dev.: 0.0047) MultiSource/Applications/ClamAV/clamscan: 152.10% (22.1758 => 55.9050, std.dev.: 0.0254) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.12% (0.0929 => 0.1887, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.52% (0.1463 => 0.2641, std.dev.: 0.0047) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 67.67% (0.0730 => 0.1224, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 66.75% (0.0394 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.42% (1.5859 => 2.5124, std.dev.: 0.0022) SingleSource/Regression/C/sumarray: 57.14% (0.0231 => 0.0363, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.81% (2.9384 => 4.6077, std.dev.: 0.0236) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.54% (7.0540 => 10.9717, std.dev.: 0.1882) MultiSource/Benchmarks/FreeBench/distray/distray: 54.07% (0.1056 => 0.1627, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.05% (8.1363 => 12.2086, std.dev.: 0.2531) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.41% (2.2024 => 3.2466, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 45.83% (0.3109 => 0.4534, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 45.33% (0.0439 => 0.0638, std.dev.: 0.0009) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 42.46% (0.1432 => 0.2040, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.24% (0.1062 => 0.1500, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 40.34% (21.9371 => 30.7874, std.dev.: 0.0578) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.79% (1.5415 => 2.1394, std.dev.: 0.0141) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.49% (4.2646 => 5.9062, std.dev.: 0.1445) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 37.36% (0.4615 => 0.6339, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.55% (0.2271 => 0.3101, std.dev.: 0.0085) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 35.95% (0.5105 => 0.6940, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.88% (0.1892 => 0.2552, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.31% (0.6675 => 0.8965, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/05-eks/eks: 34.10% (0.4299 => 0.5765, std.dev.: 0.0061) MultiSource/Applications/Burg/burg: 33.99% (1.1642 => 1.5599, std.dev.: 0.0112) SingleSource/UnitTests/2006-12-11-LoadConstants: 33.77% (0.1143 => 0.1529, std.dev.: 0.0009) MultiSource/Benchmarks/NPB-serial/is/is: 32.96% (0.0719 => 0.0956, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/dot-syntax-1: 32.78% (0.0479 => 0.0636, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 32.74% (0.0730 => 0.0969, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.41% (0.0793 => 0.1050, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.64% (0.1125 => 0.1481, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 31.12% (0.1655 => 0.2170, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.80% (0.1695 => 0.2217, std.dev.: 0.0010) MultiSource/Benchmarks/mafft/pairlocalalign: 30.80% (9.4845 => 12.4053, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.35% (3.8922 => 5.0733, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 29.89% (0.4289 => 0.5571, std.dev.: 0.0113) MultiSource/Applications/lemon/lemon: 29.41% (1.0722 => 1.3875, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.32% (0.0457 => 0.0591, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/08-main/main: 29.13% (0.2554 => 0.3298, std.dev.: 0.0019) MultiSource/Benchmarks/SciMark2-C/scimark2: 28.90% (0.3121 => 0.4023, std.dev.: 0.0166) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.70% (1.4186 => 1.8257, std.dev.: 0.0515) SingleSource/Benchmarks/Shootout-C++/hash2: 28.35% (0.4620 => 0.5930, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 28.24% (0.7115 => 0.9124, std.dev.: 0.0028) SingleSource/Benchmarks/BenchmarkGame/puzzle: 28.19% (0.0408 => 0.0523, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.97% (0.1337 => 0.1711, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/tsp/tsp: 27.83% (0.1175 => 0.1502, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.53% (0.0672 => 0.0857, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 27.52% (0.0614 => 0.0783, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/bigfib: 27.17% (0.6456 => 0.8210, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.12% (0.1906 => 0.2423, std.dev.: 0.0040) MultiSource/Applications/aha/aha: 27.11% (0.1151 => 0.1463, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/15-trie/trie: 26.94% (0.0527 => 0.0669, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 26.84% (0.0842 => 0.1068, std.dev.: 0.0008) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.82% (0.1566 => 0.1986, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/messages-2: 26.28% (0.0662 => 0.0836, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/hash: 26.19% (0.0485 => 0.0612, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.14% (0.5020 => 0.6332, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.97% (0.1236 => 0.1557, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/voronoi/voronoi: 25.96% (0.2700 => 0.3401, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/whetstone: 25.91% (0.0660 => 0.0831, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/mst/mst: 25.88% (0.1163 => 0.1464, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/lists: 25.72% (0.0626 => 0.0787, std.dev.: 0.0008) MultiSource/Applications/spiff/spiff: 25.44% (0.7835 => 0.9828, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.33% (1.3050 => 1.6356, std.dev.: 0.0398) MultiSource/Benchmarks/nbench/nbench: 25.23% (1.1840 => 1.4827, std.dev.: 0.0303) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 25.17% (0.0886 => 0.1109, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.10% (0.1032 => 0.1291, std.dev.: 0.0037) MultiSource/Applications/viterbi/viterbi: 25.08% (0.1555 => 0.1945, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/em3d/em3d: 25.01% (0.1695 => 0.2119, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.89% (0.0675 => 0.0843, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.57% (0.0871 => 0.1085, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.34% (0.0953 => 0.1185, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 24.29% (3.3354 => 4.1456, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 24.23% (0.5860 => 0.7280, std.dev.: 0.0270) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.20% (0.1029 => 0.1278, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 24.17% (5.7591 => 7.1513, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.95% (0.3307 => 0.4099, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.71% (0.1940 => 0.2400, std.dev.: 0.0129) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 23.70% (0.0443 => 0.0548, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.68% (0.2758 => 0.3411, std.dev.: 0.0117) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.55% (0.1584 => 0.1957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 23.37% (0.3098 => 0.3822, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 23.25% (0.0770 => 0.0949, std.dev.: 0.0037) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 23.08% (4.9449 => 6.0862, std.dev.: 0.1414) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.01% (0.8172 => 1.0052, std.dev.: 0.0160) MultiSource/Benchmarks/McCat/18-imp/imp: 22.96% (0.3423 => 0.4209, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.92% (0.0528 => 0.0649, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.72% (0.1510 => 0.1853, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 22.64% (0.2107 => 0.2584, std.dev.: 0.0084) MultiSource/Benchmarks/BitBench/five11/five11: 22.57% (0.0567 => 0.0695, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.52% (0.5569 => 0.6823, std.dev.: 0.0227) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.44% (5.0018 => 6.1240, std.dev.: 0.1443) MultiSource/Applications/lambda-0_1_3/lambda: 22.37% (0.7433 => 0.9096, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/football/football: 22.21% (0.8921 => 1.0902, std.dev.: 0.0251) MultiSource/Applications/treecc/treecc: 22.07% (2.0273 => 2.4748, std.dev.: 0.0060) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.85% (1.1861 => 1.4453, std.dev.: 0.0345) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.84% (0.0467 => 0.0569, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.58% (0.0834 => 0.1014, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.40% (0.9765 => 1.1855, std.dev.: 0.0401) MultiSource/Applications/lua/lua: 21.38% (3.8723 => 4.7002, std.dev.: 0.0127) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.32% (0.6450 => 0.7825, std.dev.: 0.0235) SingleSource/Benchmarks/Misc/ReedSolomon: 21.13% (0.2049 => 0.2482, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 21.07% (0.1144 => 0.1385, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.79% (0.0933 => 0.1127, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/health/health: 20.74% (0.1268 => 0.1531, std.dev.: 0.0083) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.55% (0.0759 => 0.0915, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.52% (0.0648 => 0.0781, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 20.50% (0.5981 => 0.7207, std.dev.: 0.0169) MultiSource/Applications/siod/siod: 20.47% (2.2969 => 2.7671, std.dev.: 0.0034) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 20.37% (0.8101 => 0.9751, std.dev.: 0.0261) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.37% (0.4203 => 0.5059, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.34% (0.3441 => 0.4141, std.dev.: 0.0082) MultiSource/Benchmarks/Olden/perimeter/perimeter: 20.00% (0.0770 => 0.0924, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/perlin: 19.78% (0.0536 => 0.0642, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.73% (0.1044 => 0.1250, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: 19.27% (0.0633 => 0.0755, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.21% (0.2603 => 0.3103, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 19.19% (0.3283 => 0.3913, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 18.72% (0.3232 => 0.3837, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/09-vor/vor: 18.58% (0.3180 => 0.3771, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.07% (0.8067 => 0.9525, std.dev.: 0.0302) SingleSource/Benchmarks/Misc/fbench: 17.74% (0.0592 => 0.0697, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.61% (0.0704 => 0.0828, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.17% (0.4636 => 0.5432, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.02% (0.3865 => 0.4523, std.dev.: 0.0012) MultiSource/Benchmarks/sim/sim: 16.95% (0.3387 => 0.3961, std.dev.: 0.0110) SingleSource/Benchmarks/Shootout-C++/ary2: 16.93% (0.3379 => 0.3951, std.dev.: 0.0007) MultiSource/Applications/hbd/hbd: 16.25% (1.5603 => 1.8139, std.dev.: 0.0052) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.04% (0.4103 => 0.4761, std.dev.: 0.0027) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.99% (0.0838 => 0.0972, std.dev.: 0.0009) MultiSource/Applications/sqlite3/sqlite3: 15.85% (17.1811 => 19.9040, std.dev.: 0.0228) SingleSource/Benchmarks/Shootout-C++/moments: 15.39% (0.4048 => 0.4671, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 15.20% (0.3422 => 0.3942, std.dev.: 0.0004) SingleSource/Regression/C++/ofstream_ctor: 15.11% (0.2905 => 0.3344, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 15.04% (0.3092 => 0.3557, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sieve: 14.99% (0.3603 => 0.4143, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/lists1: 14.96% (0.3684 => 0.4235, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.30% (0.3826 => 0.4373, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.30% (0.4064 => 0.4645, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 14.23% (0.3282 => 0.3749, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.09% (0.1114 => 0.1271, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.04% (0.0798 => 0.0910, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.91% (0.2430 => 0.2768, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.89% (0.3427 => 0.3903, std.dev.: 0.0108) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.76% (14.3668 => 16.3441, std.dev.: 0.1755) SingleSource/UnitTests/ObjC/parameter-passing: 13.73% (0.3927 => 0.4466, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: 13.36% (0.3886 => 0.4405, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.29% (0.1625 => 0.1841, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.38% (0.3828 => 0.4302, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/strcat: 12.26% (0.2831 => 0.3178, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.97% (0.3543 => 0.3967, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/for-in: 11.91% (0.3694 => 0.4134, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/exceptions-4: 11.77% (0.3543 => 0.3960, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/exceptions-3: 11.75% (0.3516 => 0.3929, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.71% (0.3561 => 0.3978, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/except: 11.53% (0.2871 => 0.3202, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.51% (2.0665 => 2.3043, std.dev.: 0.0050) MultiSource/Applications/hexxagon/hexxagon: 11.50% (1.2842 => 1.4319, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/exceptions-2: 11.50% (0.3497 => 0.3899, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.44% (0.1268 => 0.1413, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.36% (0.3935 => 0.4382, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 11.26% (0.2877 => 0.3201, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.04% (0.3162 => 0.3511, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.01% (0.3650 => 0.4052, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.67% (0.2756 => 0.3050, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.55% (0.2891 => 0.3196, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 10.53% (63.2438 => 69.9053, std.dev.: 0.0505) SingleSource/UnitTests/ObjC++/property-reference: 10.37% (0.7326 => 0.8086, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/wc: 10.32% (0.3052 => 0.3367, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2872 => 0.3168, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/random: 10.17% (0.2802 => 0.3087, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hello: 10.17% (0.2714 => 0.2990, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.13% (0.2793 => 0.3076, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/fibo: 10.06% (0.2725 => 0.2999, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.82% (0.3136 => 0.3444, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.73% (0.6030 => 0.6617, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 9.40% (0.5925 => 0.6482, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 9.25% (0.3177 => 0.3471, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.75% (2.2022 => 2.3948, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.16% (0.2266 => 0.2451, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 8.06% (0.1440 => 0.1556, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0017) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.30% (0.1438 => 0.1543, std.dev.: 0.0013) MultiSource/Benchmarks/PAQ8p/paq8p: 6.39% (10.3673 => 11.0300, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/objinst: 5.94% (0.3131 => 0.3317, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.49% (7.9617 => 8.3190, std.dev.: 0.1337) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.40% (0.3817 => 0.3985, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8955, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3116, std.dev.: 0.0013) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4659, std.dev.: 0.0348) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (1.1145 => 1.2933, std.dev.: 0.0057) SingleSource/Benchmarks/Misc/oourafft: 15.82% (6.6465 => 7.6978, std.dev.: 0.0009) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/richards_benchmark: 9.12% (1.1396 => 1.2435, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0011) MultiSource/Benchmarks/nbench/nbench: 6.93% (11.6436 => 12.4508, std.dev.: 0.2281) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.21% (4.2280 => 4.4483, std.dev.: 0.0117) SingleSource/Benchmarks/Shootout-C++/hash2: 4.89% (3.1578 => 3.3123, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.43% (0.9957 => 1.0398, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/ffbench: 4.13% (0.9505 => 0.9898, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.86% (0.3316 => 0.3444, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1054, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.60% (8.6802 => 8.9061, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.37% (3.6395 => 3.7256, std.dev.: 0.0076) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3109, std.dev.: 0.0015) MultiSource/Applications/minisat/minisat: 1.54% (9.1159 => 9.2559, std.dev.: 0.0241) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.11% (10.3460 => 10.4606, std.dev.: 0.0158) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.78% (6.6874 => 0.1485, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.77% (5.2763 => 1.1729, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/salsa20: -75.03% (0.8651 => 0.2160, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/richards_benchmark: -41.99% (0.1622 => 0.0941, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.50% (5.3855 => 4.4970, std.dev.: 0.0716) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.73% (5.3526 => 4.5106, std.dev.: 0.0060) MultiSource/Applications/JM/ldecod/ldecod: -11.70% (10.4361 => 9.2149, std.dev.: 0.0180) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9733, std.dev.: 0.0403) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.30% (1.7609 => 1.6323, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.98% (1.9577 => 0.6660, std.dev.: 0.0070) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -35.74% (0.3987 => 0.2562, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3067, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -33.55% (1.5373 => 1.0215, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/mandel: -33.36% (1.1492 => 0.7658, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: -30.62% (10.7105 => 7.4312, std.dev.: 0.0215) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1316, std.dev.: 0.0073) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.32% (2.6546 => 2.0090, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0912, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -18.97% (0.2161 => 0.1751, std.dev.: 0.0007) SingleSource/UnitTests/Vector/multiplies: -16.69% (2.5528 => 2.1268, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/flops-6: -15.97% (1.6925 => 1.4222, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/matrix: -13.07% (3.1443 => 2.7332, std.dev.: 0.0011) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.84% (0.9540 => 0.8410, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4914, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.08% (19.9488 => 18.5371, std.dev.: 0.0308) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.04% (0.3463 => 0.3254, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.01% (1.2373 => 1.1629, std.dev.: 0.0072) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.62% (1.6805 => 1.5860, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.58% (8.1563 => 7.7008, std.dev.: 0.0063) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -4.74% (10.2830 => 9.7957, std.dev.: 0.0033) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.39% (0.4808 => 0.4597, std.dev.: 0.0008) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1545, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9547, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3293, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -1.51% (3.7221 => 3.6660, std.dev.: 0.0187) SingleSource/Benchmarks/Shootout/lists: -1.43% (6.2999 => 6.2100, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout/ary3: -1.23% (3.6994 => 3.6540, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std.dev.: 0.0010) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.95% (0.2116 => 0.0657, std.dev.: 0.0040) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 01:56:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 03:56:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131095603.F254C2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8139?compare_to=8136&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8139, Order: 174044, Start Time: 2013-01-31 08:22:02, End Time: 2013-01-31 09:56:26 To: 8136, Order: 174041, Start Time: 2013-01-31 06:19:28, End Time: 2013-01-31 07:53:34 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (119 on baseline) Performance Improvements: 0 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.20% (0.6908 => 0.7129, std.dev.: 0.0035) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.22% (0.0974 => 0.1619, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 46.33% (0.1500 => 0.2195, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.05% (0.6395 => 0.8828, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.26% (0.6395 => 0.8714, std.dev.: 0.0020) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.81% (0.5688 => 0.7554, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.80% (0.5805 => 0.7709, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.61% (0.5456 => 0.7235, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.56% (0.6260 => 0.8298, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.07% (0.5849 => 0.7725, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.01% (0.6230 => 0.8224, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.96% (0.5567 => 0.7346, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.95% (0.5575 => 0.7356, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.77% (0.5581 => 0.7354, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.20% (0.5802 => 0.7612, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.01% (0.5705 => 0.7474, std.dev.: 0.0054) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.95% (1.6474 => 2.1572, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.57% (0.5941 => 0.7757, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.36% (0.5570 => 0.7261, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.32% (0.5857 => 0.7633, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.31% (0.5569 => 0.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.20% (0.6033 => 0.7855, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.16% (0.5478 => 0.7130, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 29.94% (0.5859 => 0.7613, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.91% (0.5591 => 0.7263, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.52% (0.6440 => 0.8341, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.25% (0.5925 => 0.7658, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.76% (0.6189 => 0.7969, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.59% (0.5863 => 0.7539, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.43% (0.6676 => 0.8574, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.25% (0.6304 => 0.8085, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.09% (0.6052 => 0.7752, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.89% (0.6446 => 0.8244, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.40% (0.6194 => 0.7891, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.38% (0.6681 => 0.8510, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.95% (0.6660 => 0.8455, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.76% (0.6297 => 0.7982, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.17% (0.6667 => 0.8345, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 24.89% (0.0699 => 0.0873, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.14% (0.7524 => 0.9340, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.34% (2.2587 => 2.7858, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.20% (0.7339 => 0.9042, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 22.91% (0.0790 => 0.0971, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.03% (0.0622 => 0.0759, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.93% (0.0634 => 0.0754) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.52% (0.0621 => 0.0736, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.02% (0.1146 => 0.1341, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.32% (0.3357 => 0.3905, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 15.66% (1.1450 => 1.3243, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.59% (0.0680 => 0.0786, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.52% (0.1982 => 0.2250, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.78% (4.5069 => 5.0830, std.dev.: 0.0104) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.53% (0.4916 => 0.5532, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.51% (1.6364 => 1.8411, std.dev.: 0.0119) MultiSource/Benchmarks/McCat/05-eks/eks: 12.16% (0.4515 => 0.5064, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.06% (3.5339 => 3.9602, std.dev.: 0.0189) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.86% (0.2385 => 0.2644, std.dev.: 0.0016) MultiSource/Benchmarks/mafft/pairlocalalign: 10.37% (9.2283 => 10.1849, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.33% (0.5329 => 0.5826, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.30% (0.1731 => 0.1892, std.dev.: 0.0009) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.27% (0.1230 => 0.1344, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.93% (0.7021 => 0.7648, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: 8.69% (1.2515 => 1.3603, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/hash: 8.55% (0.4524 => 0.4911, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.35% (0.2001 => 0.2168, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/hash2: 8.17% (0.4861 => 0.5258, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.00% (1.2784 => 1.3807, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.68% (1.4642 => 1.5767, std.dev.: 0.0073) SingleSource/Benchmarks/Misc-C++/bigfib: 6.76% (0.6750 => 0.7206, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 6.39% (0.3255 => 0.3463, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.95% (5.4682 => 5.7934, std.dev.: 0.0020) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.3319 => 0.3490, std.dev.: 0.0051) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.73% (22.4056 => 23.4650, std.dev.: 0.0112) MultiSource/Applications/oggenc/oggenc: 3.77% (5.0226 => 5.2121, std.dev.: 0.0018) MultiSource/Applications/SPASS/SPASS: 3.76% (15.5079 => 16.0911, std.dev.: 0.0076) MultiSource/Applications/minisat/minisat: 3.67% (0.7447 => 0.7720, std.dev.: 0.0032) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.58% (0.9557 => 0.9899, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary3: 3.54% (0.3446 => 0.3568, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.3864 => 1.4339, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary: 3.24% (0.3394 => 0.3504, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.18% (0.3491 => 0.3602, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 3.08% (0.8418 => 0.8677, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.98% (0.4427 => 0.4559, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.88% (0.5168 => 0.5317, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.27% (1.3722 => 1.4034, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 1.41% (34.0927 => 34.5746, std.dev.: 0.1187) MultiSource/Applications/kimwitu++/kc: 1.40% (18.2933 => 18.5502, std.dev.: 0.0201) MultiSource/Applications/d/make_dparser: 1.40% (3.5154 => 3.5646, std.dev.: 0.0098) MultiSource/Benchmarks/nbench/nbench: 1.06% (1.1530 => 1.1652, std.dev.: 0.0047) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7986, std.dev.: 0.0122) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.83% (0.9531 => 1.0277, std.dev.: 0.0031) SingleSource/Regression/C/uint64_to_float: 7.43% (0.5692 => 0.6115, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.02% (1.2783 => 1.3680, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1494, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.63% (54.5751 => 56.5542, std.dev.: 0.0469) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1413, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.70% (2.0478 => 2.1030, std.dev.: 0.0061) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3024, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.57% (18.2231 => 18.5086, std.dev.: 0.0094) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.47% (4.5320 => 4.5988, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2707, std.dev.: 0.0006) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.82% (0.3194 => 0.3040, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.67% (0.7198 => 0.6862, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.15% (0.3831 => 0.3672, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.13% (0.3848 => 0.3689, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.12% (0.3884 => 0.3724, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-4: -4.02% (0.3880 => 0.3724, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.93% (0.3891 => 0.3738, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.93% (0.3896 => 0.3743, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: -3.92% (0.4033 => 0.3875, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.4176 => 0.4019, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.51% (0.3821 => 0.3687, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.49% (0.3837 => 0.3703, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.37% (0.9852 => 0.9520, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.29% (2.4924 => 2.4104, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/Hello: -3.20% (0.6347 => 0.6144, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -3.12% (0.4199 => 0.4068, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.01% (0.3323 => 0.3223, std.dev.: 0.0021) SingleSource/UnitTests/ObjC++/property-reference: -2.97% (0.7779 => 0.7548, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: -2.87% (0.6441 => 0.6256, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.76% (0.4280 => 0.4162, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.68% (20.7746 => 20.2184, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.65% (0.9542 => 0.9289, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.63% (2.1713 => 2.1141, std.dev.: 0.0133) MultiSource/Applications/hexxagon/hexxagon: -2.42% (1.3148 => 1.2830, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.11% (0.6484 => 0.6347, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.58% (14.2083 => 13.9832, std.dev.: 0.0087) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.05% (6.7716 => 6.7007, std.dev.: 0.0086) MultiSource/Applications/JM/lencod/lencod: -1.01% (16.1920 => 16.0277, std.dev.: 0.0222) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -60.61% (1.8100 => 0.7129, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.87% (0.1622 => 0.1024, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.94% (8.0445 => 5.3138, std.dev.: 0.0015) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2492, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.42% (1.3643 => 1.0312, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -23.40% (7.5137 => 5.7556, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.18% (0.2274 => 0.1747, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4515, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.82% (4.1024 => 3.2073, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.03% (0.6299 => 0.5037, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.26% (2.5106 => 2.1276, std.dev.: 0.0057) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3551, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.11% (0.5142 => 0.4622, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/richards_benchmark: -9.10% (1.2842 => 1.1674, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ffbench: -6.75% (0.9021 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3340, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.61% (2.2633 => 2.1815, std.dev.: 0.0032) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.96% (1.0557 => 1.0244, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.76% (7.9763 => 7.7563, std.dev.: 0.0209) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.24% (3.1919 => 3.1203, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -1.95% (3.7241 => 3.6515, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: -1.89% (7.3040 => 7.1662, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.59% (2.7523 => 2.7086, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.53% (6.5735 => 6.4732, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.52% (1.6086 => 1.5841, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.38% (3.7092 => 3.6580, std.dev.: 0.0128) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.22% (1.6219 => 1.6021, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.08% (1.6307 => 1.6131, std.dev.: 0.0015) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.24s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 03:13:12 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 05:13:12 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131111312.45CE52A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8140?compare_to=8137&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8140, Order: 174048, Start Time: 2013-01-31 09:09:03, End Time: 2013-01-31 11:13:36 To: 8137, Order: 174044, Start Time: 2013-01-31 06:49:15, End Time: 2013-01-31 08:51:35 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 2 (85 on baseline) Performance Improvements: 6 (58 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (920 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 4.65% (20.6899 => 21.6515, std.dev.: 0.3082) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.21% (0.8804 => 0.8999, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/ary3: -21.89% (1.8332 => 1.4319, std.dev.: 0.1400) SingleSource/Benchmarks/Shootout-C++/nestedloop: -16.26% (0.2448 => 0.2050, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/himenobmtxpa: -4.05% (4.2904 => 4.1168, std.dev.: 0.0588) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.66% (1.8961 => 1.8457, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/matrix: -2.18% (4.8556 => 4.7499, std.dev.: 0.0193) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.25% (1.6130 => 1.5928, std.dev.: 0.0049) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.21% (1.2328 => 1.2477, std.dev.: 0.1212) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -2.63% (0.0228 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0442 => 0.0442, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -2.03% (0.0345 => 0.0338, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.25% (0.0321 => 0.0325, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.81% (0.0441 => 0.0433, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0215 => 0.0215, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -38.74% (0.0222 => 0.0136, std.dev.: 0.0095) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.54% (0.0252 => 0.0233, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1429 => 0.1445, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -0.85% (1.1528 => 1.1430, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.13% (0.4046 => 0.4213, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.19% (0.1511 => 0.1493, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 5.62% (0.0623 => 0.0658, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0277 => 0.0276, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.73% (0.0522 => 0.0578, std.dev.: 0.0161) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.35% (1.2885 => 1.2840, std.dev.: 0.0589) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 70.59% (0.0017 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 2.88% (0.0590 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0346 => 0.0346, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.49% (1.7499 => 1.7413, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -50.00% (0.0002 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -42.53% (0.0087 => 0.0050, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.39% (34.1846 => 34.0512, std.dev.: 0.2193) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 388.99% (0.0336 => 0.1643, std.dev.: 0.0065) SingleSource/Regression/C/sumarraymalloc: 118.43% (0.0293 => 0.0640, std.dev.: 0.0017) MultiSource/Benchmarks/FreeBench/neural/neural: 61.54% (0.1638 => 0.2646, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.15% (0.8893 => 1.2730, std.dev.: 0.0192) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.98% (0.9120 => 1.3040, std.dev.: 0.0927) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.75% (0.8926 => 1.2742, std.dev.: 0.0604) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.29% (0.9061 => 1.2893, std.dev.: 0.0295) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 42.26% (0.9612 => 1.3674, std.dev.: 0.0962) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.50% (0.9381 => 1.3274, std.dev.: 0.0200) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 41.43% (0.9564 => 1.3526, std.dev.: 0.0619) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.19% (0.9588 => 1.3537, std.dev.: 0.0790) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.79% (0.8990 => 1.2657, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.39% (0.9091 => 1.2763, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.02% (0.9855 => 1.3799, std.dev.: 0.0613) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 39.66% (0.9403 => 1.3132, std.dev.: 0.0700) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 39.34% (0.9422 => 1.3129, std.dev.: 0.0833) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.44% (0.9512 => 1.3168, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.29% (0.9010 => 1.2460, std.dev.: 0.0528) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.66% (0.8736 => 1.2026, std.dev.: 0.0191) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.40% (0.8912 => 1.2245, std.dev.: 0.0571) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.28% (1.0119 => 1.3891, std.dev.: 0.0722) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.84% (1.0052 => 1.3755, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.81% (1.0867 => 1.4867, std.dev.: 0.0742) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.09% (0.8732 => 1.1883, std.dev.: 0.0202) SingleSource/Benchmarks/Stanford/IntMM: 34.80% (0.0431 => 0.0581, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.62% (0.9867 => 1.3283, std.dev.: 0.0337) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.88% (1.0017 => 1.3411, std.dev.: 0.0494) SingleSource/Benchmarks/McGill/exptree: 33.64% (0.0859 => 0.1148, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.55% (0.9788 => 1.3072, std.dev.: 0.1031) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.50% (0.9507 => 1.2692, std.dev.: 0.0217) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.01% (0.9488 => 1.2620, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.22% (1.0088 => 1.3338, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 32.19% (0.9127 => 1.2065, std.dev.: 0.0831) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.13% (0.9685 => 1.2797, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.48% (0.9993 => 1.3139, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.41% (0.9405 => 1.2359, std.dev.: 0.0205) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.24% (0.9550 => 1.2533, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.54% (1.0860 => 1.3959, std.dev.: 0.0244) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.90% (0.0738 => 0.0907, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 20.60% (0.0738 => 0.0890, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 17.82% (0.1240 => 0.1461, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.14% (0.1332 => 0.1547, std.dev.: 0.0065) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.71% (3.6295 => 4.1998, std.dev.: 0.2026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.57% (1.0986 => 1.2697, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 14.18% (9.5202 => 10.8705, std.dev.: 0.2633) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 12.57% (0.2577 => 0.2901, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 12.45% (0.2385 => 0.2682, std.dev.: 0.0110) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.35% (1.4110 => 1.5853, std.dev.: 0.0380) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.34% (0.5369 => 0.5978, std.dev.: 0.0156) SingleSource/Benchmarks/Misc/ReedSolomon: 10.78% (0.2050 => 0.2271, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.13% (0.1955 => 0.2153, std.dev.: 0.0032) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.83% (5.0381 => 5.5335, std.dev.: 0.1116) SingleSource/Benchmarks/McGill/chomp: 9.59% (0.1793 => 0.1965, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.44% (0.2879 => 0.3122, std.dev.: 0.0093) SingleSource/Regression/C++/ofstream_ctor: 6.46% (0.2042 => 0.2174, std.dev.: 0.0049) MultiSource/Benchmarks/Bullet/bullet: 5.01% (33.2440 => 34.9084, std.dev.: 0.5239) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106300.00% (0.0008 => 0.8512, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout/matrix: 353.90% (1.5825 => 7.1830, std.dev.: 0.0280) SingleSource/Benchmarks/Shootout/ary3: 283.03% (2.2304 => 8.5431, std.dev.: 1.3062) MultiSource/Applications/sgefa/sgefa: 258.35% (0.3515 => 1.2596, std.dev.: 0.0040) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.13% (1.1825 => 4.0693, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.36% (4.8185 => 15.8700, std.dev.: 0.0818) SingleSource/Benchmarks/Shootout-C++/ary2: 205.43% (0.0129 => 0.0394, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 191.23% (0.0228 => 0.0664, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout-C++/ary: 144.83% (0.0232 => 0.0568, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: 63.32% (2.9083 => 4.7499, std.dev.: 0.0193) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.41% (0.2562 => 0.3418, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.49% (3.1254 => 4.1096, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 26.52% (1.4588 => 1.8457, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.40% (5.6033 => 6.9147, std.dev.: 0.3478) SingleSource/Benchmarks/Misc/salsa20: 21.80% (7.4497 => 9.0735, std.dev.: 0.0451) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.29% (4.8112 => 5.7874, std.dev.: 0.0163) SingleSource/Regression/C/uint64_to_float: 15.72% (1.5397 => 1.7818, std.dev.: 0.0681) MultiSource/Applications/JM/lencod/lencod: 13.87% (6.8159 => 7.7614, std.dev.: 0.1262) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.31% (5.1752 => 5.8640, std.dev.: 0.0485) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.93% (5.0033 => 5.6504, std.dev.: 0.0452) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.95% (3.6477 => 3.9740, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ReedSolomon: 8.02% (8.6447 => 9.3379, std.dev.: 0.2125) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.01% (4.7473 => 5.0802, std.dev.: 0.0053) MultiSource/Benchmarks/nbench/nbench: 5.56% (20.5117 => 21.6515, std.dev.: 0.3082) SingleSource/Benchmarks/McGill/chomp: 5.50% (1.0425 => 1.0998, std.dev.: 0.0097) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.24% (4.1836 => 4.4028, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/pi: 3.60% (2.1390 => 2.2159, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.26% (0.8800 => 0.8999, std.dev.: 0.0065) MultiSource/Applications/siod/siod: 1.06% (3.5910 => 3.6289, std.dev.: 0.0043) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.25% (0.0808 => 0.0507, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: -17.46% (1.8964 => 1.5652, std.dev.: 0.0163) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.46% (0.0676 => 0.0558, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.68% (0.1009 => 0.0871, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.83% (6.4235 => 5.8560, std.dev.: 0.1896) MultiSource/Applications/hexxagon/hexxagon: -8.56% (1.1433 => 1.0454, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hash2: -7.99% (0.5134 => 0.4724, std.dev.: 0.0106) MultiSource/Applications/lambda-0_1_3/lambda: -6.55% (0.8653 => 0.8086, std.dev.: 0.0083) MultiSource/Applications/sqlite3/sqlite3: -5.85% (17.5634 => 16.5355, std.dev.: 0.3388) MultiSource/Applications/lemon/lemon: -5.16% (1.3979 => 1.3258, std.dev.: 0.0142) SingleSource/Benchmarks/Shootout-C++/moments: -4.10% (0.4002 => 0.3838, std.dev.: 0.0018) SingleSource/Benchmarks/Misc-C++/Large/ray: -3.09% (0.3462 => 0.3355, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.80% (11.5523 => 3.9505, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/fp-convert: -61.84% (15.6525 => 5.9734, std.dev.: 0.1176) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.32% (0.4146 => 0.1811, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.54% (0.4578 => 0.2356, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.97% (11.3868 => 6.3804, std.dev.: 0.0788) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.68% (5.4023 => 3.6366, std.dev.: 0.0088) MultiSource/Benchmarks/Olden/bisort/bisort: -30.91% (0.9372 => 0.6475, std.dev.: 0.0941) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.59% (0.4452 => 0.3090, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/heapsort: -30.27% (4.4739 => 3.1197, std.dev.: 0.2445) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.97% (0.5495 => 0.4013, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.16% (5.2605 => 3.8845, std.dev.: 0.1497) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3285, std.dev.: 0.0108) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.89% (0.5826 => 0.4376, std.dev.: 0.0543) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.34% (4.9921 => 3.8268, std.dev.: 0.0030) MultiSource/Applications/minisat/minisat: -22.38% (7.9891 => 6.2012, std.dev.: 0.6114) SingleSource/Benchmarks/Shootout-C++/ary3: -20.99% (1.8123 => 1.4319, std.dev.: 0.1400) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.61% (16.6791 => 13.5750, std.dev.: 0.4018) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.58% (5.8755 => 4.7838, std.dev.: 0.0417) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.21% (7.0016 => 6.0067, std.dev.: 0.2133) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.19% (3.1921 => 2.7712, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.82% (5.3626 => 4.6749, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.51% (9.7992 => 8.5738, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.36% (5.7056 => 5.0004, std.dev.: 0.0942) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.34% (0.4081 => 0.3659, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout/hash: -9.74% (4.5259 => 4.0851, std.dev.: 0.0260) MultiSource/Benchmarks/mafft/pairlocalalign: -9.34% (63.1520 => 57.2561, std.dev.: 0.1352) SingleSource/Benchmarks/Shootout-C++/lists1: -8.90% (0.6628 => 0.6038, std.dev.: 0.0178) MultiSource/Applications/SIBsim4/SIBsim4: -7.93% (3.5443 => 3.2632, std.dev.: 0.0497) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.44% (4.2843 => 3.9656, std.dev.: 0.1004) MultiSource/Benchmarks/Olden/health/health: -6.65% (0.3654 => 0.3411, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.62% (5.5974 => 5.2269, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.46% (4.5424 => 4.2488, std.dev.: 0.0259) SingleSource/Benchmarks/McGill/queens: -5.69% (1.7443 => 1.6451, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.41% (4.9799 => 4.7106, std.dev.: 0.0295) SingleSource/Benchmarks/Shootout-C++/hash2: -4.80% (3.6768 => 3.5002, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -4.06% (1.4446 => 1.3859, std.dev.: 0.0185) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.72% (3.5691 => 3.4362, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.63% (5.8973 => 5.6831, std.dev.: 0.0089) SingleSource/Benchmarks/Misc/mandel-2: -2.46% (0.8521 => 0.8311, std.dev.: 0.0044) MultiSource/Applications/spiff/spiff: -2.41% (2.8571 => 2.7883, std.dev.: 0.0204) MultiSource/Applications/sqlite3/sqlite3: -2.09% (4.4730 => 4.3793, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.76% (8.7327 => 8.5791, std.dev.: 0.0029) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.63% (85.3042 => 83.9109, std.dev.: 0.2649) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.60% (8.8249 => 8.6833, std.dev.: 0.0206) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.16% (3.7450 => 3.7015, std.dev.: 0.0132) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.03% (6.6336 => 6.5656, std.dev.: 0.0109) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.57% (1.2047 => 1.2477, std.dev.: 0.1212) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.72% (0.0233 => 0.0222, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.00% (0.0451 => 0.0442, std.dev.: 0.0037) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.91% (0.0328 => 0.0325, std.dev.: 0.0091) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/casts: 0.94% (0.0213 => 0.0215, std.dev.: 0.0055) SingleSource/UnitTests/Vector/Altivec/test1: -40.09% (0.0227 => 0.0136, std.dev.: 0.0095) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -8.63% (0.0255 => 0.0233, std.dev.: 0.0075) MultiSource/Applications/Burg/burg: -40.00% (0.0015 => 0.0009, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.56% (0.1530 => 0.1445, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: -40.76% (1.9293 => 1.1430, std.dev.: 0.0347) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 4.05% (0.4049 => 0.4213, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.13% (0.1510 => 0.1493, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.72% (0.0978 => 0.0658, std.dev.: 0.0113) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.03% (0.0590 => 0.0578, std.dev.: 0.0161) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.53% (1.1617 => 1.2840, std.dev.: 0.0589) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.10% (0.0268 => 0.0346, std.dev.: 0.0046) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.14% (0.7437 => 1.7413, std.dev.: 0.0056) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -45.65% (0.0092 => 0.0050, std.dev.: 0.0061) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 166.48% (12.7781 => 34.0512, std.dev.: 0.2193) Report Time: 0.85s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 03:27:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 05:27:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130131112741.B71F52A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8141?compare_to=8134&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8141, Order: 174044, Start Time: 2013-01-31 07:48:34, End Time: 2013-01-31 11:28:03 To: 8134, Order: 174033, Start Time: 2013-01-31 04:22:58, End Time: 2013-01-31 06:52:40 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== New Passes: 155 (0 on baseline) Performance Regressions: 12 (180 on baseline) Performance Improvements: 14 (20 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 923 (758 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== New Passes - Compile Time ------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ALAC/decode/alacconvert-decode: 12.26% (0.4504 => 0.5056, std.dev.: 0.0012) MultiSource/Applications/ALAC/encode/alacconvert-encode: 12.51% (0.4494 => 0.5056, std.dev.: 0.0027) MultiSource/Applications/ClamAV/clamscan: 1.54% (4.8716 => 4.9465, std.dev.: 0.1072) MultiSource/Applications/JM/ldecod/ldecod: 7.43% (2.3058 => 2.4772, std.dev.: 0.0435) MultiSource/Applications/JM/lencod/lencod: 0.76% (5.2423 => 5.2823, std.dev.: 0.0608) MultiSource/Applications/SPASS/SPASS: 0.88% (6.3153 => 6.3707, std.dev.: 0.0030) MultiSource/Applications/hbd/hbd: -3.51% (1.1858 => 1.1442, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -2.91% (1.1943 => 1.1595, std.dev.: 0.0165) MultiSource/Applications/kimwitu++/kc: 34.43% (9.6438 => 12.9637, std.dev.: 0.0194) MultiSource/Applications/lua/lua: 4.19% (1.5903 => 1.6570, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 56.34% (0.2414 => 0.3774, std.dev.: 0.0067) MultiSource/Applications/oggenc/oggenc: 39.41% (1.4419 => 2.0102, std.dev.: 0.0041) MultiSource/Applications/siod/siod: 31.08% (0.5692 => 0.7461, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 88.01% (1.1940 => 2.2448, std.dev.: 0.0091) MultiSource/Benchmarks/7zip/7zip-benchmark: 23.83% (20.3549 => 25.2045, std.dev.: 0.0665) MultiSource/Benchmarks/Bullet/bullet: 21.88% (22.5381 => 27.4690, std.dev.: 0.0751) MultiSource/Benchmarks/FreeBench/mason/mason: 9.61% (0.0333 => 0.0365, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 3.33% (2.1742 => 2.2465, std.dev.: 0.0187) MultiSource/Benchmarks/McCat/08-main/main: 0.34% (0.1474 => 0.1479, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 63.28% (0.0956 => 0.1561, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -0.42% (1.5798 => 1.5732, std.dev.: 0.0359) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.77% (4.7813 => 5.1530, std.dev.: 0.0476) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.16% (0.5863 => 0.5931, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -5.81% (0.0310 => 0.0292, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.18% (0.6247 => 0.6321, std.dev.: 0.0175) MultiSource/Benchmarks/Olden/bh/bh: 13.53% (0.1345 => 0.1527, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/voronoi/voronoi: 8.34% (0.1223 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 92.20% (0.2820 => 0.5420, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 64.62% (0.0554 => 0.0912, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.85% (0.4523 => 0.4652, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.36% (0.1113 => 0.1117, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.04% (0.6246 => 0.6311, std.dev.: 0.0181) MultiSource/Benchmarks/nbench/nbench: 25.38% (0.2407 => 0.3018, std.dev.: 0.0010) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 67.64% (7.8206 => 13.1101, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.58% (0.1892 => 0.2357, std.dev.: 0.0139) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 140.88% (0.2532 => 0.6099, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 152.13% (0.3380 => 0.8522, std.dev.: 0.0106) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -17.14% (0.7723 => 0.6399, std.dev.: 0.0162) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 77.27% (0.1346 => 0.2386, std.dev.: 0.0090) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 40.53% (0.2497 => 0.3509, std.dev.: 0.0287) SingleSource/Benchmarks/CoyoteBench/fftbench: 1.84% (0.4355 => 0.4435, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++-EH/spirit: 85.58% (2.7915 => 5.1805, std.dev.: 0.0849) SingleSource/Benchmarks/Misc-C++/Large/ray: 3.21% (0.4083 => 0.4214, std.dev.: 0.0394) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.98% (0.3854 => 0.3739, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++/bigfib: 16.40% (0.4956 => 0.5769, std.dev.: 0.0243) SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.55% (0.5696 => 0.7379, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/lowercase: -9.68% (0.0217 => 0.0196, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/hash: 7.34% (0.4468 => 0.4796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 9.11% (0.4513 => 0.4924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 0.39% (0.3876 => 0.3891, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 2.41% (0.3936 => 0.4031, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: -7.51% (0.3580 => 0.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 1.11% (0.4219 => 0.4266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: -7.85% (0.3607 => 0.3324, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/reversefile: 3.03% (0.4129 => 0.4254, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/sieve: 2.51% (0.4219 => 0.4325, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.46% (0.4445 => 0.4599, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.27% (0.2527 => 0.3115, std.dev.: 0.0003) SingleSource/Benchmarks/SmallPT/smallpt: 18.27% (0.0531 => 0.0628, std.dev.: 0.0031) SingleSource/Regression/C++/BuiltinTypeInfo: -22.61% (0.0283 => 0.0219, std.dev.: 0.0001) SingleSource/Regression/C++/EH/ConditionalExpr: -2.54% (0.0197 => 0.0192, std.dev.: 0.0009) SingleSource/Regression/C++/EH/exception_spec_test: -14.32% (0.0384 => 0.0329, std.dev.: 0.0000) SingleSource/Regression/C++/short_circuit_dtor: -7.33% (0.0191 => 0.0177, std.dev.: 0.0002) SingleSource/UnitTests/2003-05-31-CastToBool: -8.24% (0.0182 => 0.0167, std.dev.: 0.0000) SingleSource/UnitTests/2003-07-10-SignConversions: -17.71% (0.0175 => 0.0144, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: -11.89% (0.9569 => 0.8431, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: -14.19% (0.8117 => 0.6965, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/messages-2: 13.86% (0.0433 => 0.0493, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/parameter-passing: -19.60% (0.5292 => 0.4255, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/property: -20.93% (0.5279 => 0.4174, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/cast2: -21.86% (0.0183 => 0.0143, std.dev.: 0.0008) SingleSource/UnitTests/SignlessTypes/ccc: -20.99% (0.0262 => 0.0207, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: -16.02% (0.0668 => 0.0561, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_shift: -20.63% (0.0543 => 0.0431, std.dev.: 0.0008) SingleSource/UnitTests/Vectorizer/gcc-loops: 0.85% (0.4480 => 0.4518, std.dev.: 0.0019) SingleSource/UnitTests/blockstret: 4.64% (0.0151 => 0.0158) SingleSource/UnitTests/stmtexpr: 37.80% (0.0164 => 0.0226, std.dev.: 0.0000) New Passes - Execution Time --------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/JM/ldecod/ldecod MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SPASS/SPASS MultiSource/Applications/hbd/hbd MultiSource/Applications/hexxagon/hexxagon MultiSource/Applications/kimwitu++/kc MultiSource/Applications/lua/lua MultiSource/Applications/minisat/minisat MultiSource/Applications/oggenc/oggenc MultiSource/Applications/siod/siod MultiSource/Applications/sqlite3/sqlite3 MultiSource/Benchmarks/Bullet/bullet MultiSource/Benchmarks/FreeBench/mason/mason MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/McCat/08-main/main MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32 MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm MultiSource/Benchmarks/Olden/bh/bh MultiSource/Benchmarks/Olden/voronoi/voronoi MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Prolangs-C++/ocean/ocean MultiSource/Benchmarks/Ptrdist/bc/bc MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast MultiSource/Benchmarks/nbench/nbench MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Adobe-C++/functionobjects SingleSource/Benchmarks/Adobe-C++/loop_unroll SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction SingleSource/Benchmarks/Adobe-C++/stepanov_vector SingleSource/Benchmarks/CoyoteBench/fftbench SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/Large/ray SingleSource/Benchmarks/Misc-C++/Large/sphereflake SingleSource/Benchmarks/Misc-C++/bigfib SingleSource/Benchmarks/Misc-C++/stepanov_container SingleSource/Benchmarks/Misc/lowercase SingleSource/Benchmarks/Shootout-C++/hash SingleSource/Benchmarks/Shootout-C++/hash2 SingleSource/Benchmarks/Shootout-C++/lists SingleSource/Benchmarks/Shootout-C++/lists1 SingleSource/Benchmarks/Shootout-C++/methcall SingleSource/Benchmarks/Shootout-C++/moments SingleSource/Benchmarks/Shootout-C++/objinst SingleSource/Benchmarks/Shootout-C++/reversefile SingleSource/Benchmarks/Shootout-C++/sieve SingleSource/Benchmarks/Shootout-C++/spellcheck SingleSource/Benchmarks/Shootout-C++/wordfreq SingleSource/Benchmarks/SmallPT/smallpt SingleSource/Regression/C++/BuiltinTypeInfo SingleSource/Regression/C++/EH/ConditionalExpr SingleSource/Regression/C++/EH/exception_spec_test SingleSource/Regression/C++/short_circuit_dtor SingleSource/UnitTests/2003-05-07-VarArgs SingleSource/UnitTests/2003-05-31-CastToBool SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-08-11-VaListArg SingleSource/UnitTests/ObjC++/property-reference SingleSource/UnitTests/ObjC++/property-reference-object SingleSource/UnitTests/ObjC/messages-2 SingleSource/UnitTests/ObjC/parameter-passing SingleSource/UnitTests/ObjC/property SingleSource/UnitTests/SignlessTypes/cast2 SingleSource/UnitTests/SignlessTypes/ccc SingleSource/UnitTests/Vector/SSE/sse_isamax SingleSource/UnitTests/Vector/SSE/sse_shift SingleSource/UnitTests/Vectorizer/gcc-loops SingleSource/UnitTests/blockstret SingleSource/UnitTests/stmtexpr MultiSource/Applications/ALAC/decode/alacconvert-decode: 66200.00% (0.0001 => 0.0663, std.dev.: 0.0002) MultiSource/Applications/ALAC/encode/alacconvert-encode: 132900.00% (0.0001 => 0.1330, std.dev.: 0.0013) MultiSource/Applications/ClamAV/clamscan: 309300.00% (0.0001 => 0.3094, std.dev.: 0.0023) MultiSource/Applications/JM/ldecod/ldecod: 243200.00% (0.0001 => 0.2433, std.dev.: 0.0128) MultiSource/Applications/JM/lencod/lencod: 22575400.00% (0.0001 => 22.5755, std.dev.: 0.0140) MultiSource/Applications/SPASS/SPASS: 30127500.00% (0.0001 => 30.1276, std.dev.: 0.1207) MultiSource/Applications/hbd/hbd: 2500.00% (0.0001 => 0.0026) MultiSource/Applications/hexxagon/hexxagon: 25978300.00% (0.0001 => 25.9784, std.dev.: 0.0014) MultiSource/Applications/kimwitu++/kc: 65500.00% (0.0001 => 0.0656, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 50589600.00% (0.0001 => 50.5897, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 48142500.00% (0.0001 => 48.1426, std.dev.: 0.0127) MultiSource/Applications/oggenc/oggenc: 328500.00% (0.0001 => 0.3286, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 6773700.00% (0.0001 => 6.7738, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 10483100.00% (0.0001 => 10.4832, std.dev.: 0.0047) MultiSource/Benchmarks/Bullet/bullet: 40356500.00% (0.0001 => 40.3566, std.dev.: 0.0136) MultiSource/Benchmarks/FreeBench/mason/mason: 786800.00% (0.0001 => 0.7869, std.dev.: 0.0013) MultiSource/Benchmarks/MallocBench/gs/gs: 109600.00% (0.0001 => 0.1097, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/08-main/main: 87000.00% (0.0001 => 0.0871, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 209000.00% (0.0001 => 0.2091, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 621900.00% (0.0001 => 0.6220, std.dev.: 0.0107) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 404500.00% (0.0001 => 0.4046, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 100.00% (0.0001 => 0.0002, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 352500.00% (0.0001 => 0.3526, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 689800.00% (0.0001 => 0.6899, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 5498900.00% (0.0001 => 5.4990, std.dev.: 0.0034) MultiSource/Benchmarks/Olden/voronoi/voronoi: 611300.00% (0.0001 => 0.6114, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 276278200.00% (0.0001 => 276.2783, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 125700.00% (0.0001 => 0.1258, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 1257900.00% (0.0001 => 1.2580, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 149200.00% (0.0001 => 0.1493, std.dev.: 0.0073) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 84200.00% (0.0001 => 0.0843, std.dev.: 0.0065) MultiSource/Benchmarks/nbench/nbench: 41181000.00% (0.0001 => 41.1811, std.dev.: 0.0012) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 40206900.00% (0.0001 => 40.2070, std.dev.: 0.0222) SingleSource/Benchmarks/Adobe-C++/functionobjects: 7491800.00% (0.0001 => 7.4919, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29008400.00% (0.0001 => 29.0085, std.dev.: 0.0737) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 28621800.00% (0.0001 => 28.6219, std.dev.: 0.0072) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12767600.00% (0.0001 => 12.7677, std.dev.: 0.0114) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 139970500.00% (0.0001 => 139.9706, std.dev.: 0.4600) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 104174200.00% (0.0001 => 104.1743, std.dev.: 0.6032) SingleSource/Benchmarks/CoyoteBench/fftbench: 5677800.00% (0.0001 => 5.6779, std.dev.: 0.0258) SingleSource/Benchmarks/Misc-C++-EH/spirit: 83679500.00% (0.0001 => 83.6796, std.dev.: 0.0940) SingleSource/Benchmarks/Misc-C++/Large/ray: 16044500.00% (0.0001 => 16.0446, std.dev.: 0.0938) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 13765000.00% (0.0001 => 13.7651, std.dev.: 0.1980) SingleSource/Benchmarks/Misc-C++/bigfib: 1518800.00% (0.0001 => 1.5189, std.dev.: 0.0055) SingleSource/Benchmarks/Misc-C++/stepanov_container: 12281300.00% (0.0001 => 12.2814, std.dev.: 0.2823) SingleSource/Benchmarks/Misc/lowercase: 65845600.00% (0.0001 => 65.8457, std.dev.: 0.0878) SingleSource/Benchmarks/Shootout-C++/hash: 1279800.00% (0.0001 => 1.2799, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 9538500.00% (0.0001 => 9.5386, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/lists: 28193100.00% (0.0001 => 28.1932, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 1094300.00% (0.0001 => 1.0944, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/methcall: 16557000.00% (0.0001 => 16.5571, std.dev.: 0.0163) SingleSource/Benchmarks/Shootout-C++/moments: 446300.00% (0.0001 => 0.4464, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/objinst: 12679800.00% (0.0001 => 12.6799, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/reversefile: 200.00% (0.0001 => 0.0003) SingleSource/Benchmarks/Shootout-C++/sieve: 9012100.00% (0.0001 => 9.0122, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/spellcheck: 200.00% (0.0001 => 0.0003) SingleSource/Benchmarks/Shootout-C++/wordfreq: 100.00% (0.0001 => 0.0002) SingleSource/Benchmarks/SmallPT/smallpt: 33999700.00% (0.0001 => 33.9998, std.dev.: 0.0005) SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0001 => 0.0002) SingleSource/Regression/C++/EH/ConditionalExpr: 100.00% (0.0001 => 0.0002) SingleSource/Regression/C++/EH/exception_spec_test: 100.00% (0.0001 => 0.0002) SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/2003-05-07-VarArgs: - (0.0002 => 0.0002) SingleSource/UnitTests/2003-05-31-CastToBool: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/2003-07-10-SignConversions: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/2003-08-11-VaListArg: - (0.0002 => 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 1500.00% (0.0001 => 0.0016) SingleSource/UnitTests/ObjC/messages-2: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 1600.00% (0.0001 => 0.0017) SingleSource/UnitTests/ObjC/property: 1700.00% (0.0001 => 0.0018, std.dev.: 0.0000) SingleSource/UnitTests/SignlessTypes/cast2: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/SignlessTypes/ccc: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/Vector/SSE/sse_shift: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/Vectorizer/gcc-loops: 46438700.00% (0.0001 => 46.4388, std.dev.: 0.0025) SingleSource/UnitTests/blockstret: 100.00% (0.0001 => 0.0002) SingleSource/UnitTests/stmtexpr: 100.00% (0.0001 => 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/7zip/7zip-benchmark: 19911700.00% (0.0001 => 19.9118, std.dev.: 0.0054) MultiSource/Benchmarks/Olden/health/health: 6.33% (0.6065 => 0.6449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: 5.25% (0.2151 => 0.2264, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 4.63% (0.3156 => 0.3302, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/n-body: 4.37% (3.4586 => 3.6099, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 3.14% (21.3152 => 21.9851, std.dev.: 0.0278) MultiSource/Benchmarks/Prolangs-C++/life/life: 2.57% (4.5202 => 4.6365, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.95% (0.5480 => 0.5587, std.dev.: 0.0034) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.58% (1.0884 => 1.1056, std.dev.: 0.0013) MultiSource/Applications/lambda-0_1_3/lambda: 1.46% (11.8746 => 12.0474, std.dev.: 0.0017) MultiSource/Applications/viterbi/viterbi: 1.43% (46.6491 => 47.3155, std.dev.: 0.0010) SingleSource/Benchmarks/Linpack/linpack-pc: 1.26% (65.3046 => 66.1279, std.dev.: 0.0439) Performance Improvements - Execution Time ----------------------------------------- SingleSource/UnitTests/Vector/SSE/sse_stepfft: -33.15% (4.7987 => 3.2079, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_expandfft: -30.70% (3.9608 => 2.7449, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -20.82% (9.2464 => 7.3212, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: -18.73% (0.2749 => 0.2234, std.dev.: 0.0031) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.87% (0.0753 => 0.0641, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/salsa20: -8.78% (35.9747 => 32.8146, std.dev.: 0.0297) MultiSource/Benchmarks/Olden/tsp/tsp: -6.91% (2.1031 => 1.9577, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/distray/distray: -4.50% (0.2558 => 0.2443, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: -4.22% (1.5461 => 1.4808, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: -3.99% (3.3763 => 3.2417, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.95% (128.4422 => 124.6484, std.dev.: 0.8697) SingleSource/Benchmarks/Shootout-C++/ary3: -1.60% (16.4573 => 16.1946, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.55% (0.6698 => 0.6594, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.01% (5.7621 => 5.7037, std.dev.: 0.0075) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 52.16% (0.0625 => 0.0951, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.25% (0.1063 => 0.1459, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.90% (0.0547 => 0.0716, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.21% (0.0331 => 0.0431, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.66% (0.2969 => 0.3820, std.dev.: 0.0108) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.08% (0.5900 => 0.7557, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.58% (0.1106 => 0.1411, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.45% (0.0714 => 0.0910, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.25% (0.4139 => 0.5267, std.dev.: 0.0076) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.01% (0.1107 => 0.1406, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.57% (0.4994 => 0.6321, std.dev.: 0.0175) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0025) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.22% (0.5000 => 0.6311, std.dev.: 0.0181) MultiSource/Applications/oggenc/oggenc: 26.17% (1.5932 => 2.0102, std.dev.: 0.0041) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 25.89% (0.0475 => 0.0598, std.dev.: 0.0020) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.86% (0.0584 => 0.0735, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 24.92% (0.4253 => 0.5313, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/tsp/tsp: 24.71% (0.0599 => 0.0747, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.68% (0.1021 => 0.1273, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.57% (0.1620 => 0.2018, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.53% (0.0897 => 0.1117, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/em3d/em3d: 23.52% (0.0948 => 0.1171, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.36% (0.0642 => 0.0792, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.94% (0.1103 => 0.1356, std.dev.: 0.0024) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.88% (0.1604 => 0.1971, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.83% (0.1003 => 0.1232, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.72% (0.1549 => 0.1901, std.dev.: 0.0033) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.63% (0.0495 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.57% (0.3903 => 0.4784, std.dev.: 0.0057) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 22.36% (0.1619 => 0.1981, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.18% (0.0541 => 0.0661, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.82% (0.2736 => 0.3333, std.dev.: 0.0086) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.78% (0.1088 => 0.1325, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 21.43% (0.1218 => 0.1479, std.dev.: 0.0036) MultiSource/Applications/spiff/spiff: 21.42% (0.4029 => 0.4892, std.dev.: 0.0131) MultiSource/Applications/viterbi/viterbi: 21.33% (0.0947 => 0.1149, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.90% (0.3890 => 0.4703, std.dev.: 0.0108) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.79% (0.1462 => 0.1766, std.dev.: 0.0035) MultiSource/Applications/sgefa/sgefa: 20.79% (0.0808 => 0.0976, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.49% (0.0698 => 0.0841, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.31% (0.2014 => 0.2423, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 20.27% (0.1505 => 0.1810, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.85% (0.2866 => 0.3435, std.dev.: 0.0054) MultiSource/Applications/Burg/burg: 19.80% (0.5546 => 0.6644, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.76% (0.0572 => 0.0685, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.62% (1.3152 => 1.5732, std.dev.: 0.0359) MultiSource/Benchmarks/MallocBench/gs/gs: 19.53% (1.8794 => 2.2465, std.dev.: 0.0187) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.36% (0.5361 => 0.6399, std.dev.: 0.0162) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.17% (0.0605 => 0.0721, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.95% (0.3271 => 0.3891, std.dev.: 0.0133) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.76% (3.5627 => 4.2309, std.dev.: 0.0779) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.55% (0.4658 => 0.5522, std.dev.: 0.0089) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0039) SingleSource/UnitTests/ObjC++/Hello: 18.50% (0.5826 => 0.6904, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 18.45% (0.1968 => 0.2331, std.dev.: 0.0022) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.43% (1.6211 => 1.9198, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.37% (0.3930 => 0.4652, std.dev.: 0.0016) SingleSource/UnitTests/ObjC++/property-reference-object: 18.27% (0.5889 => 0.6965, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 18.19% (1.0781 => 1.2742, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.01% (0.5026 => 0.5931, std.dev.: 0.0020) MultiSource/Applications/hbd/hbd: 18.00% (0.9697 => 1.1442, std.dev.: 0.0034) MultiSource/Benchmarks/McCat/18-imp/imp: 17.87% (0.1421 => 0.1675, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 17.75% (0.2823 => 0.3324, std.dev.: 0.0062) SingleSource/Benchmarks/Shootout-C++/methcall: 17.70% (0.2813 => 0.3311, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 17.67% (0.2875 => 0.3383, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.63% (0.4361 => 0.5130, std.dev.: 0.0072) MultiSource/Benchmarks/nbench/nbench: 17.61% (0.2566 => 0.3018, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/property-reference: 17.57% (0.7171 => 0.8431, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.47% (4.2109 => 4.9465, std.dev.: 0.1072) SingleSource/Benchmarks/Shootout-C++/strcat: 17.42% (0.2750 => 0.3229, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.28% (0.2911 => 0.3414, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.23% (0.2792 => 0.3273, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/except: 17.22% (0.2811 => 0.3295, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: 17.03% (0.2725 => 0.3189, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.03% (0.3195 => 0.3739, std.dev.: 0.0075) SingleSource/Benchmarks/Shootout-C++/hello: 17.02% (0.2714 => 0.3176, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/random: 17.02% (0.2803 => 0.3280, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 17.01% (0.9909 => 1.1595, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ackermann: 16.98% (0.2738 => 0.3203, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 16.94% (1.9694 => 2.3031, std.dev.: 0.0530) SingleSource/Benchmarks/Shootout-C++/matrix: 16.91% (0.2780 => 0.3250, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 16.79% (23.5202 => 27.4690, std.dev.: 0.0751) SingleSource/Benchmarks/Shootout-C++/nestedloop: 16.78% (0.2729 => 0.3187, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 16.78% (2.0673 => 2.4141, std.dev.: 0.0024) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.73% (1.9966 => 2.3306, std.dev.: 0.0581) SingleSource/Regression/C++/ofstream_ctor: 16.71% (0.3004 => 0.3506, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.61% (2.7292 => 3.1825, std.dev.: 0.0223) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.60% (4.4195 => 5.1530, std.dev.: 0.0476) SingleSource/Benchmarks/Shootout-C++/ary3: 16.56% (0.3267 => 0.3808, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 16.51% (0.3096 => 0.3607, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 16.42% (0.1090 => 0.1269, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary: 16.42% (0.3258 => 0.3793, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary2: 16.37% (0.3317 => 0.3860, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.31% (0.3060 => 0.3559, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/lists: 16.22% (0.3348 => 0.3891, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.18% (0.3362 => 0.3906, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 16.13% (1.4269 => 1.6570, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.10% (0.3124 => 0.3627, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 16.08% (0.3726 => 0.4325, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/moments: 15.99% (0.3678 => 0.4266, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.93% (0.3477 => 0.4031, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 15.90% (0.3282 => 0.3804, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 15.90% (0.7875 => 0.9127, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash2: 15.83% (0.4251 => 0.4924, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 15.68% (0.4146 => 0.4796, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.52% (0.3981 => 0.4599, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.34% (0.3845 => 0.4435, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.28% (0.3690 => 0.4254, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++/bigfib: 15.10% (0.5012 => 0.5769, std.dev.: 0.0243) MultiSource/Applications/SPASS/SPASS: 14.96% (5.5417 => 6.3707, std.dev.: 0.0030) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.76% (0.7426 => 0.8522, std.dev.: 0.0106) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.67% (0.6435 => 0.7379, std.dev.: 0.0195) SingleSource/UnitTests/ObjC/exceptions-2: 14.63% (0.3446 => 0.3950, std.dev.: 0.0043) SingleSource/UnitTests/ObjC/trivial-interface: 14.61% (0.3442 => 0.3945, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-4: 14.57% (0.3465 => 0.3970, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.54% (0.3488 => 0.3995, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/for-in: 14.53% (0.3496 => 0.4004, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/synchronized: 14.53% (0.3469 => 0.3973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 14.45% (0.3460 => 0.3960, std.dev.: 0.0064) MultiSource/Applications/JM/ldecod/ldecod: 14.40% (2.1653 => 2.4772, std.dev.: 0.0435) MultiSource/Applications/JM/lencod/lencod: 14.39% (4.6177 => 5.2823, std.dev.: 0.0608) SingleSource/UnitTests/ObjC/property: 14.36% (0.3650 => 0.4174, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 14.25% (0.0758 => 0.0866, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 14.08% (0.3643 => 0.4156, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 14.01% (0.2691 => 0.3068, std.dev.: 0.0061) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.01% (0.1028 => 0.1172, std.dev.: 0.0030) MultiSource/Benchmarks/Prolangs-C/football/football: 13.98% (0.2075 => 0.2365, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.81% (0.2737 => 0.3115, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.47% (2.1013 => 2.3843, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.46% (0.2103 => 0.2386, std.dev.: 0.0090) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.43% (0.0804 => 0.0912, std.dev.: 0.0009) MultiSource/Applications/minisat/minisat: 13.13% (0.3336 => 0.3774, std.dev.: 0.0067) MultiSource/Applications/lambda-0_1_3/lambda: 13.09% (0.3498 => 0.3956, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.87% (0.1383 => 0.1561, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.70% (0.2040 => 0.2299, std.dev.: 0.0008) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.63% (11.6398 => 13.1101, std.dev.: 0.0074) MultiSource/Applications/siod/siod: 12.47% (0.6634 => 0.7461, std.dev.: 0.0052) MultiSource/Benchmarks/PAQ8p/paq8p: 11.82% (0.4847 => 0.5420, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.75% (0.2391 => 0.2648, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.40% (4.6926 => 5.1805, std.dev.: 0.0849) MultiSource/Applications/sqlite3/sqlite3: 10.33% (2.0346 => 2.2448, std.dev.: 0.0091) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.22% (0.5584 => 0.6099, std.dev.: 0.0067) MultiSource/Applications/kimwitu++/kc: 8.43% (11.9555 => 12.9637, std.dev.: 0.0194) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.30% (0.3792 => 0.3993, std.dev.: 0.0057) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5202, std.dev.: 0.0098) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0184) SingleSource/Benchmarks/Misc/flops-1: 22.63% (6.2401 => 7.6525, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.60% (0.5917 => 0.6899, std.dev.: 0.0012) MultiSource/Applications/ClamAV/clamscan: 10.42% (0.2802 => 0.3094, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.56% (0.3693 => 0.4046, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.48% (3.3903 => 3.6099, std.dev.: 0.0041) SingleSource/Benchmarks/Shootout-C++/ary: 5.28% (0.2122 => 0.2234, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/objinst: 5.22% (12.0509 => 12.6799, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2394, std.dev.: 0.0082) SingleSource/Benchmarks/Misc/flops-2: 4.72% (1.8057 => 1.8909, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.68% (79.9355 => 83.6796, std.dev.: 0.0940) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1946, std.dev.: 0.0090) MultiSource/Applications/viterbi/viterbi: 1.48% (46.6247 => 47.3155, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.45% (1.0142 => 1.0289, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.35% (7.1849 => 7.2817, std.dev.: 0.0035) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.18% (1.0927 => 1.1056, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 1.17% (4.0317 => 4.0790, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.13% (3.1722 => 3.2079, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5395, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 1.09% (10.3705 => 10.4832, std.dev.: 0.0047) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 1.05% (50.0626 => 50.5897, std.dev.: 0.0041) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2580, std.dev.: 0.0001) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.27% (2.4764 => 2.4202, std.dev.: 0.0044) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.86% (25.4195 => 16.5571, std.dev.: 0.0163) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0018) SingleSource/Benchmarks/Dhrystone/fldry: -17.38% (17.2379 => 14.2421, std.dev.: 0.1260) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9784, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/salsa20: -7.57% (35.5013 => 32.8146, std.dev.: 0.0297) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary2: -5.75% (0.2402 => 0.2264, std.dev.: 0.0019) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2070, std.dev.: 0.0222) SingleSource/Benchmarks/Dhrystone/dry: -3.78% (14.0481 => 13.5166, std.dev.: 0.1629) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0005) SingleSource/UnitTests/Vector/build2: -3.55% (11.2080 => 10.8096, std.dev.: 0.0035) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7738, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.20% (197.4719 => 193.1333, std.dev.: 0.9845) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5725, std.dev.: 0.0065) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.70% (0.6293 => 0.6186, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4990, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7157, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 2.52s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 03:55:00 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 05:55:00 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131115500.0A4242A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8142?compare_to=8139&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8142, Order: 174049, Start Time: 2013-01-31 10:20:21, End Time: 2013-01-31 11:55:22 To: 8139, Order: 174044, Start Time: 2013-01-31 08:22:02, End Time: 2013-01-31 09:56:26 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (120 on baseline) Performance Improvements: 1 (89 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (883 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/Vector/constpool: 1.90% (20.2184 => 20.6031, std.dev.: 0.0253) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.36% (0.7129 => 0.6961, std.dev.: 0.0062) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.03% (0.0315 => 0.0712, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/lowercase: 80.00% (0.0280 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0036) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/neural/neural: 46.20% (0.1500 => 0.2193, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.40% (0.1132 => 0.1612, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.08% (0.6395 => 0.8830, std.dev.: 0.0055) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.12% (0.6395 => 0.8705, std.dev.: 0.0006) SingleSource/Regression/C/sumarray2d: 34.13% (0.0293 => 0.0393, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.70% (0.5688 => 0.7548, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.64% (0.5805 => 0.7700, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.61% (0.5456 => 0.7235, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.41% (0.6260 => 0.8289, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.98% (0.5575 => 0.7358, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.94% (0.6230 => 0.8220, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 31.94% (0.5849 => 0.7717, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.84% (0.5581 => 0.7358, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.81% (0.5567 => 0.7338, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.01% (0.5802 => 0.7601, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.72% (1.6474 => 2.1535, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.69% (0.5705 => 0.7456, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.48% (0.5941 => 0.7752, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.34% (0.5570 => 0.7260, std.dev.: 0.0080) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.29% (0.5857 => 0.7631, std.dev.: 0.0112) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.27% (0.5569 => 0.7255, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.07% (0.6033 => 0.7847, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.01% (0.5478 => 0.7122, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.01% (0.5859 => 0.7617, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.69% (0.5591 => 0.7251, std.dev.: 0.0053) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.39% (0.6440 => 0.8333, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.05% (0.5925 => 0.7646, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.62% (0.6189 => 0.7960, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.34% (0.6676 => 0.8568, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.33% (0.5863 => 0.7524, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.03% (0.6304 => 0.8071, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 27.94% (0.6052 => 0.7743, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.66% (0.6681 => 0.8529, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.20% (0.6194 => 0.7879, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.85% (0.6660 => 0.8448, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.71% (0.6297 => 0.7979, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.05% (0.6667 => 0.8337, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.04% (0.0699 => 0.0874, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.98% (0.7524 => 0.9328, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.18% (2.2587 => 2.7822, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.12% (0.7339 => 0.9036, std.dev.: 0.0048) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.77% (0.0634 => 0.0753, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0556 => 0.0659, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.20% (0.0621 => 0.0734, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.28% (0.1146 => 0.1344) MultiSource/Applications/sgefa/sgefa: 16.44% (0.3357 => 0.3909, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 15.53% (1.1450 => 1.3228, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.71% (0.1081 => 0.1240, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.17% (0.1982 => 0.2243, std.dev.: 0.0010) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.81% (4.5069 => 5.0842, std.dev.: 0.0132) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.51% (0.4916 => 0.5531, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.37% (1.6364 => 1.8388, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/exptree: 12.04% (0.0864 => 0.0968, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.00% (3.5339 => 3.9579, std.dev.: 0.0061) MultiSource/Benchmarks/McCat/05-eks/eks: 11.94% (0.4515 => 0.5054, std.dev.: 0.0021) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.73% (0.2385 => 0.2641, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 10.17% (9.2283 => 10.1665, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.19% (0.1731 => 0.1890, std.dev.: 0.0009) MultiSource/Applications/Burg/burg: 9.09% (1.2515 => 1.3653, std.dev.: 0.0074) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.06% (0.5329 => 0.5812, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4524 => 0.4926, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.79% (0.7021 => 0.7638, std.dev.: 0.0006) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.78% (0.1230 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.50% (0.2001 => 0.2171, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash2: 8.02% (0.4861 => 0.5251, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.94% (1.2784 => 1.3799, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.63% (1.4642 => 1.5759, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/bigfib: 6.62% (0.6750 => 0.7197, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/matrix: 6.05% (0.3255 => 0.3452, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.01% (0.1879 => 0.1992, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.77% (5.4682 => 5.7837, std.dev.: 0.0031) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.30% (0.3319 => 0.3495, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.67% (22.4056 => 23.4518, std.dev.: 0.0205) MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (1.3864 => 1.4380, std.dev.: 0.0017) MultiSource/Applications/oggenc/oggenc: 3.67% (5.0226 => 5.2069, std.dev.: 0.0152) MultiSource/Applications/SPASS/SPASS: 3.62% (15.5079 => 16.0697, std.dev.: 0.0097) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.35% (0.9557 => 0.9877, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/ary3: 3.31% (0.3446 => 0.3560, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 3.20% (0.8418 => 0.8687, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.12% (0.3394 => 0.3500, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/wordfreq: 2.89% (0.3491 => 0.3592, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.80% (0.4427 => 0.4551) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.50% (0.5168 => 0.5297, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.31% (1.3722 => 1.4039, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.44% (1.2300 => 1.2477, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 1.34% (3.5154 => 3.5624, std.dev.: 0.0048) MultiSource/Benchmarks/Bullet/bullet: 1.27% (34.0927 => 34.5269, std.dev.: 0.0128) MultiSource/Applications/kimwitu++/kc: 1.25% (18.2933 => 18.5216, std.dev.: 0.0202) MultiSource/Applications/treecc/treecc: 1.05% (2.1401 => 2.1626, std.dev.: 0.0023) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.7990, std.dev.: 0.0104) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.19% (0.9531 => 1.0312, std.dev.: 0.0020) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.44% (54.5751 => 56.4551, std.dev.: 0.1134) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.0478 => 2.1127, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3029, std.dev.: 0.0016) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.66% (18.2231 => 18.5248, std.dev.: 0.0102) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.45% (4.5320 => 4.5975, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0009) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.87% (0.1281 => 0.1129, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.7198 => 0.6846, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/trivial-interface: -4.88% (0.3812 => 0.3626, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-2: -4.86% (0.3831 => 0.3645, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.76% (0.3848 => 0.3665, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -4.72% (0.3880 => 0.3697, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.70% (0.3896 => 0.3713, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -4.61% (0.4033 => 0.3847, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.57% (0.3891 => 0.3713, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: -4.41% (0.4176 => 0.3992, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -4.25% (0.3884 => 0.3719, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.88% (0.6347 => 0.6101, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/property: -3.74% (0.4199 => 0.4042, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.63% (0.6441 => 0.6207, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.60% (0.3837 => 0.3699, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.51% (0.3821 => 0.3687, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/parameter-passing: -3.46% (0.4280 => 0.4132, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.39% (0.9852 => 0.9518, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.36% (2.4924 => 2.4086, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -3.07% (0.7779 => 0.7540, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.04% (0.3323 => 0.3222, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.76% (2.1713 => 2.1113, std.dev.: 0.0097) MultiSource/Applications/hexxagon/hexxagon: -2.65% (1.3148 => 1.2800, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.57% (0.9542 => 0.9297, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.16% (0.6484 => 0.6344, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.56% (14.2083 => 13.9860, std.dev.: 0.0198) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.32% (6.7716 => 6.6819, std.dev.: 0.0099) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.54% (1.8100 => 0.6961, std.dev.: 0.0062) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0013) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3114, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0021) SingleSource/Benchmarks/Misc/mandel-2: -25.02% (1.3643 => 1.0229, std.dev.: 0.0043) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7512, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.91% (0.2274 => 0.1753, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4505, std.dev.: 0.0055) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.89% (4.1024 => 3.2045, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3246, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.06% (0.3418 => 0.2835, std.dev.: 0.0014) SingleSource/UnitTests/Vector/multiplies: -15.15% (2.5106 => 2.1302, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.05% (0.4092 => 0.3517, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.27% (4.9100 => 4.3567, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/richards_benchmark: -8.90% (1.2842 => 1.1699, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8204, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fbench: -3.83% (2.2633 => 2.1767, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3343, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -3.41% (1.3096 => 1.2649, std.dev.: 0.0138) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3994, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.18% (1.0557 => 1.0221, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.65% (7.9763 => 7.7650, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1200, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1740, std.dev.: 0.0304) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (2.7523 => 2.7074, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4686, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.50% (1.6086 => 1.5844, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.43% (1.6307 => 1.6073, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.40% (2.1154 => 2.0857, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.33% (3.7092 => 3.6600, std.dev.: 0.0153) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.28% (1.6219 => 1.6012, std.dev.: 0.0078) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0336, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.97s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 04:31:52 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 06:31:52 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131123152.E2A7F2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8143?compare_to=8138&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8143, Order: 174048, Start Time: 2013-01-31 10:19:20, End Time: 2013-01-31 12:32:16 To: 8138, Order: 174044, Start Time: 2013-01-31 07:33:31, End Time: 2013-01-31 09:48:23 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (228 on baseline) Performance Improvements: 0 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.23% (0.1326 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.88% (0.0425 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.89% (0.0657 => 0.0676, std.dev.: 0.0028) MultiSource/Benchmarks/Olden/power/power: 0.52% (497.2379 => 499.8477, std.dev.: 0.0090) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44224.53% (1.1277 => 499.8477, std.dev.: 0.0090) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.40% (0.5229 => 1.7120, std.dev.: 0.0024) MultiSource/Applications/SPASS/SPASS: 26.89% (14.9895 => 19.0200, std.dev.: 0.0290) MultiSource/Applications/kimwitu++/kc: 48.91% (14.1553 => 21.0787, std.dev.: 0.0103) MultiSource/Benchmarks/MallocBench/gs/gs: 21.80% (4.1105 => 5.0065, std.dev.: 0.0212) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.54% (1.1048 => 1.7957, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 453.72% (7.1582 => 39.6364, std.dev.: 0.0059) SingleSource/Benchmarks/Misc-C++-EH/spirit: 92.09% (3.4629 => 6.6520, std.dev.: 0.0064) SingleSource/Benchmarks/Misc-C++/stepanov_container: 84.43% (0.6222 => 1.1475, std.dev.: 0.0151) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.83% (0.0720 => 7.4454, std.dev.: 0.0155) MultiSource/Applications/SIBsim4/SIBsim4: 3833400.00% (0.0001 => 3.8335, std.dev.: 0.0014) MultiSource/Applications/SPASS/SPASS: 11093600.00% (0.0001 => 11.0937, std.dev.: 0.0731) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849700.00% (0.0001 => 9.8498, std.dev.: 0.0016) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5487300.00% (0.0001 => 5.4874, std.dev.: 0.0065) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.96% (1.1194 => 10.4547, std.dev.: 0.0030) MultiSource/Applications/ClamAV/clamscan: 152.23% (22.1758 => 55.9338, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.12% (0.0929 => 0.1887, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.59% (0.1463 => 0.2642, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 72.32% (0.0271 => 0.0467, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 67.81% (0.0730 => 0.1225, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 64.94% (0.0231 => 0.0381, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.81% (1.5859 => 2.5185, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.84% (2.9384 => 4.6087, std.dev.: 0.0225) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.77% (7.0540 => 10.9174, std.dev.: 0.0198) MultiSource/Benchmarks/FreeBench/distray/distray: 53.98% (0.1056 => 0.1626, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.19% (8.1363 => 12.2202, std.dev.: 0.0077) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.66% (0.0439 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 47.38% (2.2024 => 3.2459, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 45.32% (0.3109 => 0.4518, std.dev.: 0.0005) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 41.76% (0.1432 => 0.2030, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.62% (0.1062 => 0.1504, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 40.40% (21.9371 => 30.8007, std.dev.: 0.0173) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.71% (1.5415 => 2.1382, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/espresso/espresso: 38.00% (4.2646 => 5.8852, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 36.98% (0.0814 => 0.1115, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.71% (0.4615 => 0.6309, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.51% (0.5105 => 0.6969, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/dot-syntax-1: 36.33% (0.0479 => 0.0653, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.26% (0.1892 => 0.2578, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.76% (0.2271 => 0.3083, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.49% (0.6675 => 0.8977, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 34.01% (1.1642 => 1.5602, std.dev.: 0.0072) MultiSource/Benchmarks/McCat/05-eks/eks: 33.47% (0.4299 => 0.5738, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 33.33% (0.1143 => 0.1524, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 32.96% (0.0719 => 0.0956, std.dev.: 0.0021) SingleSource/Benchmarks/Stanford/Oscar: 32.39% (0.0636 => 0.0842, std.dev.: 0.0039) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.28% (0.0793 => 0.1049, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/chomp: 32.21% (0.1655 => 0.2188, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.74% (0.1695 => 0.2233, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.56% (0.1125 => 0.1480, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 30.76% (9.4845 => 12.4024, std.dev.: 0.0175) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.41% (3.8922 => 5.0757, std.dev.: 0.0022) MultiSource/Applications/viterbi/viterbi: 30.35% (0.1555 => 0.2027, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 30.19% (0.2554 => 0.3325, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 29.86% (0.0730 => 0.0948, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 29.40% (1.0722 => 1.3874, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash: 29.28% (0.4289 => 0.5545, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.22% (0.0746 => 0.0964, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 29.10% (0.0457 => 0.0590, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.88% (1.4186 => 1.8283, std.dev.: 0.0041) MultiSource/Applications/minisat/minisat: 28.69% (0.7115 => 0.9156, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.42% (0.1337 => 0.1717, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/hash2: 28.40% (0.4620 => 0.5932, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 27.53% (0.0672 => 0.0857, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.49% (0.3121 => 0.3979, std.dev.: 0.0068) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.18% (0.1906 => 0.2424, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/tsp/tsp: 27.15% (0.1175 => 0.1494, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++/bigfib: 27.08% (0.6456 => 0.8204, std.dev.: 0.0068) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.95% (0.1566 => 0.1988, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.94% (0.1032 => 0.1310, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.61% (0.5020 => 0.6356, std.dev.: 0.0024) SingleSource/UnitTests/ObjC/messages-2: 26.44% (0.0662 => 0.0837, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.21% (0.1236 => 0.1560, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/15-trie/trie: 26.19% (0.0527 => 0.0665, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/voronoi/voronoi: 26.11% (0.2700 => 0.3405, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: 26.06% (0.0660 => 0.0832, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 25.98% (0.0485 => 0.0611, std.dev.: 0.0011) MultiSource/Applications/aha/aha: 25.98% (0.1151 => 0.1450, std.dev.: 0.0022) MultiSource/Applications/spiff/spiff: 25.46% (0.7835 => 0.9830, std.dev.: 0.0054) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.33% (1.3050 => 1.6355, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/lists: 25.24% (0.0626 => 0.0784, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.74% (0.0675 => 0.0842, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.68% (0.0871 => 0.1086, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 24.38% (3.3354 => 4.1485, std.dev.: 0.0046) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.34% (0.0953 => 0.1185, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 24.27% (1.1840 => 1.4714, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 24.22% (0.0834 => 0.1036, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 24.11% (5.7591 => 7.1479, std.dev.: 0.0033) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.10% (0.1029 => 0.1277, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout-C++/wordfreq: 24.01% (0.3307 => 0.4101, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.99% (0.0842 => 0.1044, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/em3d/em3d: 23.89% (0.1695 => 0.2100, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/mst/mst: 23.73% (0.1163 => 0.1439, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.70% (0.0886 => 0.1096, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.67% (0.5860 => 0.7247, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/matrix: 23.66% (0.3098 => 0.3831, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.66% (0.1940 => 0.2399, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.87% (4.9449 => 6.0758, std.dev.: 0.0187) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.78% (0.1510 => 0.1854, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/five11/five11: 22.75% (0.0567 => 0.0696, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 22.73% (0.0528 => 0.0648, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 22.70% (0.8921 => 1.0946, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.70% (0.2758 => 0.3384, std.dev.: 0.0032) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.66% (0.8172 => 1.0024, std.dev.: 0.0162) MultiSource/Benchmarks/Olden/bisort/bisort: 22.64% (0.0614 => 0.0753, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.47% (0.1117 => 0.1368, std.dev.: 0.0054) MultiSource/Applications/treecc/treecc: 22.27% (2.0273 => 2.4788, std.dev.: 0.0034) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.22% (0.1584 => 0.1936, std.dev.: 0.0008) MultiSource/Applications/lua/lua: 22.11% (3.8723 => 4.7286, std.dev.: 0.0081) SingleSource/Benchmarks/Misc/ReedSolomon: 22.11% (0.2049 => 0.2502, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.98% (0.5569 => 0.6793, std.dev.: 0.0044) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.89% (5.0018 => 6.0967, std.dev.: 0.0092) MultiSource/Applications/lambda-0_1_3/lambda: 21.78% (0.7433 => 0.9052, std.dev.: 0.0069) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.64% (1.1861 => 1.4428, std.dev.: 0.0028) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.63% (0.0467 => 0.0568, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 21.50% (0.3423 => 0.4159, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.42% (0.9765 => 1.1857, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.12% (0.6450 => 0.7812, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: 21.07% (0.1144 => 0.1385, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/health/health: 21.06% (0.1268 => 0.1535, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.03% (0.2107 => 0.2550, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.79% (0.0933 => 0.1127, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 20.68% (2.2969 => 2.7718, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.57% (0.0491 => 0.0592, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/spellcheck: 20.44% (0.4203 => 0.5062, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.39% (0.0770 => 0.0927, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.37% (0.0648 => 0.0780, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.87% (0.0770 => 0.0923, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.85% (0.8101 => 0.9709, std.dev.: 0.0049) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 19.85% (0.3441 => 0.4124, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 19.54% (0.1044 => 0.1248, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.34% (0.5981 => 0.7138, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ary3: 19.34% (0.3283 => 0.3918, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.29% (0.2603 => 0.3105, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.27% (0.2065 => 0.2463, std.dev.: 0.0103) SingleSource/Benchmarks/Shootout-C++/ary: 18.94% (0.3232 => 0.3844, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 18.74% (0.8067 => 0.9579, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout/matrix: 18.22% (0.0818 => 0.0967, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/09-vor/vor: 18.14% (0.3180 => 0.3757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: 17.74% (0.0592 => 0.0697) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.61% (0.0704 => 0.0828, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: 17.54% (0.3387 => 0.3981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: 17.40% (0.3379 => 0.3967, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 17.31% (0.3865 => 0.4534, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 16.54% (1.5603 => 1.8183, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.39% (0.4636 => 0.5396, std.dev.: 0.0022) MultiSource/Applications/sqlite3/sqlite3: 15.90% (17.1811 => 19.9137, std.dev.: 0.0214) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.87% (0.4103 => 0.4754, std.dev.: 0.0007) SingleSource/Regression/C++/ofstream_ctor: 15.83% (0.2905 => 0.3365, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.75% (0.0838 => 0.0970, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/moments: 15.69% (0.4048 => 0.4683, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 15.25% (0.3422 => 0.3944, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 15.17% (0.3684 => 0.4243, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 14.96% (0.3603 => 0.4142, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/ray: 14.59% (0.4064 => 0.4657, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 14.36% (0.1114 => 0.1274, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 14.23% (0.3092 => 0.3532, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.95% (0.2430 => 0.2769, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 13.92% (0.3282 => 0.3739, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.83% (0.3826 => 0.4355, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.80% (0.3427 => 0.3900, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: 13.75% (0.3927 => 0.4467, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.50% (14.3668 => 16.3059, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/property: 13.18% (0.3886 => 0.4398, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 12.79% (0.2831 => 0.3193, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 12.20% (0.3828 => 0.4295, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 12.19% (0.2871 => 0.3221, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.74% (0.3543 => 0.3959, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 11.72% (0.3473 => 0.3880, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std.dev.: 0.0008) MultiSource/Applications/hexxagon/hexxagon: 11.70% (1.2842 => 1.4344, std.dev.: 0.0055) SingleSource/UnitTests/ObjC/exceptions-3: 11.58% (0.3516 => 0.3923, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.54% (2.0665 => 2.3050, std.dev.: 0.0027) SingleSource/Benchmarks/Stanford/Puzzle: 11.51% (0.1268 => 0.1414, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 11.40% (0.2877 => 0.3205, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 11.23% (0.3650 => 0.4060, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.21% (0.3935 => 0.4376, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ackermann: 11.14% (0.2756 => 0.3063, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.04% (0.3162 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.95% (0.1625 => 0.1803, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/fibo: 10.90% (0.2725 => 0.3022, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/hello: 10.87% (0.2714 => 0.3009, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.85% (0.2793 => 0.3096, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.65% (0.2872 => 0.3178, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 10.65% (0.3052 => 0.3377, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/random: 10.64% (0.2802 => 0.3100, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.62% (0.2891 => 0.3198, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: 10.38% (63.2438 => 69.8077, std.dev.: 0.0803) MultiSource/Benchmarks/Prolangs-C++/office/office: 10.20% (0.3136 => 0.3456, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: 9.71% (0.7326 => 0.8037, std.dev.: 0.0037) SingleSource/UnitTests/ObjC++/property-reference-object: 9.70% (0.6030 => 0.6615, std.dev.: 0.0100) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 9.32% (0.1330 => 0.1454, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/Hello: 9.28% (0.5925 => 0.6475, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.65% (2.2022 => 2.3927, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 8.12% (0.4879 => 0.5275, std.dev.: 0.0044) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.08% (0.2266 => 0.2449, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.77% (0.3177 => 0.3424, std.dev.: 0.0029) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std.dev.: 0.0009) MultiSource/Benchmarks/PAQ8p/paq8p: 6.10% (10.3673 => 10.9998, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/objinst: 6.04% (0.3131 => 0.3320) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.39% (7.9617 => 8.3114, std.dev.: 0.0149) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.30% (0.3817 => 0.3981, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: 146.51% (5.3999 => 13.3115, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4741, std.dev.: 0.0036) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.04% (1.1145 => 1.2933, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2429, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0010) MultiSource/Benchmarks/nbench/nbench: 7.84% (11.6436 => 12.5565, std.dev.: 0.0663) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.34% (4.2280 => 4.4539, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/hash2: 4.97% (3.1578 => 3.3146, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0056) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.41% (2.0360 => 2.1055, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.41% (0.4162 => 0.4304, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.82% (8.6802 => 8.9248, std.dev.: 0.0035) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.29% (3.6395 => 3.7230, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.78% (9.1159 => 9.2785, std.dev.: 0.0107) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3095, std.dev.: 0.0037) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.03% (10.3460 => 10.4523, std.dev.: 0.0014) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1480, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.77% (5.2763 => 1.1731, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/salsa20: -74.79% (0.8651 => 0.2181, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -41.92% (0.1622 => 0.0942, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.43% (5.3855 => 4.5007, std.dev.: 0.0089) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.85% (5.3526 => 4.5042, std.dev.: 0.0089) MultiSource/Applications/JM/ldecod/ldecod: -11.62% (10.4361 => 9.2230, std.dev.: 0.0195) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9752, std.dev.: 0.0159) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.23% (1.7609 => 1.6335, std.dev.: 0.0041) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.69% (1.9577 => 0.6717, std.dev.: 0.0057) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3070, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/mandel-2: -33.78% (1.5373 => 1.0180, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/mandel: -33.49% (1.1492 => 0.7643, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -30.61% (10.7105 => 7.4317, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1362, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.36% (2.6546 => 2.0079, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.92% (2.6778 => 2.0907, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3254, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.57% (0.2161 => 0.1738, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1251, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops-6: -15.83% (1.6925 => 1.4246, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7352, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.82% (0.9540 => 0.8412, std.dev.: 0.0002) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4922, std.dev.: 0.0159) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9122, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.83% (19.9488 => 18.5858, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.99% (1.2373 => 1.1632, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.65% (1.6805 => 1.5856, std.dev.: 0.0025) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.57% (8.1563 => 7.7016, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.8614 => 0.8160, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.75% (10.2830 => 9.7947, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-5: -4.65% (1.5835 => 1.5099, std.dev.: 0.0017) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0006) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1550, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3280, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (3.7221 => 3.6614, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/lists: -1.17% (6.2999 => 6.2259, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/hash: -1.04% (4.9088 => 4.8578, std.dev.: 0.0062) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.05% (0.2116 => 0.0676, std.dev.: 0.0028) Report Time: 1.33s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 05:35:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 07:35:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131133525.EF5B62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8144?compare_to=8140&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8144, Order: 174052, Start Time: 2013-01-31 11:30:52, End Time: 2013-01-31 13:35:49 To: 8140, Order: 174048, Start Time: 2013-01-31 09:09:03, End Time: 2013-01-31 11:13:36 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 34 (101 on baseline) Performance Improvements: 1 (56 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1029 (906 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 44.49% (0.0735 => 0.1062, std.dev.: 0.0119) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 37.96% (0.0893 => 0.1232, std.dev.: 0.0088) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 26.74% (0.2577 => 0.3266, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 21.93% (0.5541 => 0.6756, std.dev.: 0.0389) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 18.95% (0.6851 => 0.8149, std.dev.: 0.0104) MultiSource/Applications/ALAC/decode/alacconvert-decode: 14.05% (1.1719 => 1.3366, std.dev.: 0.0394) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 12.90% (0.8721 => 0.9846, std.dev.: 0.0288) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.94% (1.1090 => 1.1971, std.dev.: 0.0170) MultiSource/Applications/kimwitu++/kc: 7.66% (18.7388 => 20.1734, std.dev.: 0.1271) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 7.24% (2.0499 => 2.1984, std.dev.: 0.0304) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 5.84% (1.9432 => 2.0566, std.dev.: 0.0408) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.90% (5.5335 => 5.8044, std.dev.: 0.0942) MultiSource/Applications/sqlite3/sqlite3: 4.85% (16.5355 => 17.3379, std.dev.: 0.1548) MultiSource/Applications/ClamAV/clamscan: 3.35% (16.4979 => 17.0504, std.dev.: 0.1849) MultiSource/Applications/JM/lencod/lencod: 3.01% (17.0943 => 17.6081, std.dev.: 0.1616) MultiSource/Applications/SIBsim4/SIBsim4: 2.24% (1.4606 => 1.4933, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Applications/minisat/minisat: 27.44% (6.2012 => 7.9028, std.dev.: 0.1273) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.02% (1.2668 => 1.5964, std.dev.: 0.0286) MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.30% (2.5706 => 2.9640, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.26% (44.2023 => 50.0653, std.dev.: 0.8010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 11.36% (0.4013 => 0.4469, std.dev.: 0.0118) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.47% (0.3338 => 0.3654, std.dev.: 0.0071) MultiSource/Applications/SPASS/SPASS: 9.34% (8.5156 => 9.3108, std.dev.: 0.2408) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.49% (2.9519 => 3.2024, std.dev.: 0.0235) SingleSource/Regression/C/uint64_to_float: 7.18% (1.7818 => 1.9097, std.dev.: 0.0168) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.88% (40.2781 => 43.0490, std.dev.: 0.7687) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.42% (22.4531 => 23.8953, std.dev.: 0.1115) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.42% (59.6159 => 62.8470, std.dev.: 1.2491) MultiSource/Applications/lua/lua: 4.09% (28.2453 => 29.4010, std.dev.: 0.2442) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 2.71% (3.5945 => 3.6920, std.dev.: 0.0378) SingleSource/Benchmarks/Dhrystone/fldry: 2.02% (0.6599 => 0.6732, std.dev.: 0.0044) MultiSource/Applications/SIBsim4/SIBsim4: 1.86% (3.2632 => 3.3239, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.73% (3.4926 => 3.5529, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.11% (15.8700 => 16.0456, std.dev.: 0.0636) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.17% (6.9147 => 6.7649, std.dev.: 0.0481) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.43% (1.2477 => 1.3279, std.dev.: 0.0510) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 0.45% (0.0222 => 0.0223, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.58% (0.0442 => 0.0435, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.78% (0.0338 => 0.0332, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 0.62% (0.0325 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.46% (0.0433 => 0.0431, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -3.72% (0.0215 => 0.0207, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: 62.50% (0.0136 => 0.0221, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.44% (0.0233 => 0.0255, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: 44.44% (0.0009 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.90% (0.1445 => 0.1432, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 7.79% (1.1430 => 1.2320, std.dev.: 0.2636) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -5.44% (0.4213 => 0.3984, std.dev.: 0.0854) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -2.21% (0.1493 => 0.1460, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.46% (0.0658 => 0.0661, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 1.21% (0.0578 => 0.0585, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.53% (1.2840 => 1.2908, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.45% (0.0029 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0026 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.49% (0.0607 => 0.0610, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 4.91% (0.0346 => 0.0363, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.74% (1.7413 => 1.7542, std.dev.: 0.0209) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.00% (0.0050 => 0.0047, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.02% (34.0512 => 34.0429, std.dev.: 0.0355) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 388.69% (0.0336 => 0.1642, std.dev.: 0.0019) SingleSource/Regression/C/sumarraymalloc: 116.04% (0.0293 => 0.0633, std.dev.: 0.0012) SingleSource/Regression/C/sumarray2d: 83.21% (0.0274 => 0.0502, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/neural/neural: 66.30% (0.1638 => 0.2724, std.dev.: 0.0338) SingleSource/Regression/C/sumarray: 53.21% (0.0265 => 0.0406, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 47.91% (0.0718 => 0.1062, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 43.07% (0.9588 => 1.3718, std.dev.: 0.0525) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.72% (0.9120 => 1.3016, std.dev.: 0.1163) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.52% (0.8893 => 1.2674, std.dev.: 0.1067) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.47% (0.8926 => 1.2717, std.dev.: 0.1441) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.66% (0.9612 => 1.3616, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.62% (0.9061 => 1.2832, std.dev.: 0.0915) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.92% (0.9381 => 1.3220, std.dev.: 0.0524) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 39.86% (0.8990 => 1.2573, std.dev.: 0.0327) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 39.75% (0.9855 => 1.3772, std.dev.: 0.0387) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 39.51% (0.9091 => 1.2683, std.dev.: 0.0703) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.93% (0.9998 => 1.3890, std.dev.: 0.0906) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.60% (0.9422 => 1.3059, std.dev.: 0.0419) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 38.54% (0.8736 => 1.2103, std.dev.: 0.0718) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.35% (0.9403 => 1.3009, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 37.57% (0.9010 => 1.2395, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 37.55% (0.9512 => 1.3084, std.dev.: 0.1142) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.21% (0.8912 => 1.2228, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 36.83% (1.0119 => 1.3846, std.dev.: 0.0404) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.15% (0.8732 => 1.1889, std.dev.: 0.0370) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.00% (1.0052 => 1.3671, std.dev.: 0.0154) SingleSource/Benchmarks/McGill/exptree: 35.86% (0.0859 => 0.1167, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.35% (0.8846 => 1.1973, std.dev.: 0.0363) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 34.55% (0.9488 => 1.2766, std.dev.: 0.0631) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 34.20% (0.0918 => 0.1232, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 34.05% (0.9993 => 1.3396, std.dev.: 0.0851) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.52% (1.0017 => 1.3375, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.40% (0.9788 => 1.3057, std.dev.: 0.0247) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 33.18% (0.9685 => 1.2898, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.00% (0.9507 => 1.2644, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 32.68% (0.9405 => 1.2479, std.dev.: 0.0862) SingleSource/Benchmarks/Stanford/IntMM: 32.02% (0.0431 => 0.0569, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.85% (1.0088 => 1.3301, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.72% (0.9550 => 1.2579, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 31.53% (0.9127 => 1.2005, std.dev.: 0.0369) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 28.59% (0.0738 => 0.0949, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.84% (1.0860 => 1.3883, std.dev.: 0.0332) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 24.75% (0.2618 => 0.3266, std.dev.: 0.0118) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.58% (0.0783 => 0.0952, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 21.38% (0.0669 => 0.0812, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.95% (3.6295 => 4.3897, std.dev.: 0.0850) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 19.38% (0.0805 => 0.0961, std.dev.: 0.0058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.53% (0.0707 => 0.0838, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.87% (1.8651 => 2.1984, std.dev.: 0.0304) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 17.58% (0.5746 => 0.6756, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.17% (1.0986 => 1.2872, std.dev.: 0.0180) MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.21% (5.0381 => 5.8044, std.dev.: 0.0942) MultiSource/Applications/ALAC/decode/alacconvert-decode: 13.94% (1.1731 => 1.3366, std.dev.: 0.0394) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.46% (1.8127 => 2.0566, std.dev.: 0.0408) MultiSource/Benchmarks/mafft/pairlocalalign: 13.42% (9.5202 => 10.7979, std.dev.: 0.0932) SingleSource/Benchmarks/Shootout-C++/matrix: 12.37% (0.2385 => 0.2680, std.dev.: 0.0018) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.21% (1.4110 => 1.5833, std.dev.: 0.0406) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.95% (0.4596 => 0.5145, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.04% (0.5369 => 0.5962, std.dev.: 0.0128) SingleSource/Benchmarks/McGill/chomp: 10.60% (0.1793 => 0.1983, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/ReedSolomon: 10.15% (0.2050 => 0.2258, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/himenobmtxpa: 9.92% (0.1955 => 0.2149, std.dev.: 0.0031) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.85% (2.4519 => 2.6935, std.dev.: 0.0849) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.29% (0.3702 => 0.4046, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/football/football: 8.62% (0.9759 => 1.0600, std.dev.: 0.0308) SingleSource/Regression/C++/ofstream_ctor: 6.71% (0.2042 => 0.2179, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 6.53% (18.9377 => 20.1734, std.dev.: 0.1271) MultiSource/Applications/oggenc/oggenc: 6.21% (5.3553 => 5.6879, std.dev.: 0.1013) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.02% (0.7686 => 0.8149, std.dev.: 0.0104) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 5.59% (0.7693 => 0.8123, std.dev.: 0.0152) MultiSource/Applications/JM/lencod/lencod: 5.43% (16.7012 => 17.6081, std.dev.: 0.1616) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 4.11% (1.1498 => 1.1971, std.dev.: 0.0170) MultiSource/Applications/SIBsim4/SIBsim4: 3.76% (1.4392 => 1.4933, std.dev.: 0.0065) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106525.00% (0.0008 => 0.8530, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/matrix: 353.87% (1.5825 => 7.1825, std.dev.: 0.0498) SingleSource/Benchmarks/Shootout/ary3: 281.68% (2.2304 => 8.5130, std.dev.: 1.2914) MultiSource/Applications/sgefa/sgefa: 258.58% (0.3515 => 1.2604, std.dev.: 0.0365) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.64% (1.1825 => 4.0399, std.dev.: 0.0353) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 233.00% (4.8185 => 16.0456, std.dev.: 0.0636) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 215.35% (0.0228 => 0.0719, std.dev.: 0.0113) SingleSource/Benchmarks/Shootout-C++/ary2: 203.88% (0.0129 => 0.0392, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 137.93% (0.0232 => 0.0552, std.dev.: 0.0046) SingleSource/Benchmarks/Shootout-C++/matrix: 64.38% (2.9083 => 4.7807, std.dev.: 0.0596) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.96% (0.2562 => 0.3432, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.94% (3.1254 => 4.1236, std.dev.: 0.0784) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.41% (1.4588 => 1.8587, std.dev.: 0.0348) SingleSource/Regression/C/uint64_to_float: 24.03% (1.5397 => 1.9097, std.dev.: 0.0168) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.73% (5.6033 => 6.7649, std.dev.: 0.0481) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.53% (4.8112 => 5.7991, std.dev.: 0.0042) MultiSource/Applications/JM/lencod/lencod: 14.16% (6.8159 => 7.7808, std.dev.: 0.0279) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.09% (5.1752 => 5.8524, std.dev.: 0.0175) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.94% (5.0033 => 5.6508, std.dev.: 0.0083) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.71% (3.6477 => 3.9653, std.dev.: 0.1153) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.60% (46.0987 => 50.0653, std.dev.: 0.8010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.46% (3.0082 => 3.2024, std.dev.: 0.0235) SingleSource/Benchmarks/McGill/chomp: 5.75% (1.0425 => 1.1024, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.93% (5.0310 => 5.2285, std.dev.: 0.0195) SingleSource/Benchmarks/Misc/pi: 3.25% (2.1390 => 2.2086, std.dev.: 0.0029) MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.00% (2.8778 => 2.9640, std.dev.: 0.0140) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.12% (23.3986 => 23.8953, std.dev.: 0.1115) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (4.8076 => 4.8629, std.dev.: 0.0127) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.99% (0.0808 => 0.0493, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.26% (0.0727 => 0.0507, std.dev.: 0.0079) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.02% (0.0692 => 0.0505, std.dev.: 0.0029) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -16.72% (0.0676 => 0.0563, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.09% (0.1684 => 0.1413, std.dev.: 0.0077) MultiSource/Applications/hbd/hbd: -12.26% (1.8964 => 1.6639, std.dev.: 0.0627) SingleSource/UnitTests/Vector/constpool: -10.98% (9.8875 => 8.8014, std.dev.: 0.2205) SingleSource/Benchmarks/Shootout-C++/hash2: -7.93% (0.5134 => 0.4727, std.dev.: 0.0155) SingleSource/Benchmarks/Shootout-C++/moments: -3.70% (0.4002 => 0.3854, std.dev.: 0.0038) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.80% (11.5523 => 3.9514, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/fp-convert: -62.20% (15.6525 => 5.9169, std.dev.: 0.1308) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.73% (0.4146 => 0.1794, std.dev.: 0.0125) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.51% (0.4578 => 0.2357, std.dev.: 0.0087) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.26% (11.3868 => 6.3465, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.26% (5.4023 => 3.6054, std.dev.: 0.0524) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.80% (0.4452 => 0.3081, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout/heapsort: -29.62% (4.4739 => 3.1486, std.dev.: 0.0810) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.20% (5.2605 => 3.8825, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.97% (4.4467 => 3.3365, std.dev.: 0.0362) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.00% (0.5897 => 0.4482, std.dev.: 0.0107) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.79% (0.5826 => 0.4440, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.42% (4.9921 => 3.8230, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/ary3: -23.00% (1.8123 => 1.3954, std.dev.: 0.0349) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.82% (16.6791 => 13.5395, std.dev.: 0.4592) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -18.67% (0.5495 => 0.4469, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.41% (5.8755 => 4.7940, std.dev.: 0.0753) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.94% (7.0016 => 6.0254, std.dev.: 0.1627) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.23% (0.1164 => 0.1010, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.99% (3.1921 => 2.7773, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6745, std.dev.: 0.0364) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.62% (9.7992 => 8.5624, std.dev.: 0.0235) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9933, std.dev.: 0.0279) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.92% (1.6547 => 1.4575, std.dev.: 0.0731) SingleSource/Benchmarks/Shootout/hash: -10.32% (4.5259 => 4.0588, std.dev.: 0.0368) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.02% (0.4081 => 0.3672, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout/nestedloop: -9.68% (0.2200 => 0.1987, std.dev.: 0.0022) MultiSource/Benchmarks/mafft/pairlocalalign: -9.31% (63.1520 => 57.2700, std.dev.: 0.0604) SingleSource/Benchmarks/Shootout-C++/lists1: -8.92% (0.6628 => 0.6037, std.dev.: 0.0158) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.35% (4.4540 => 4.0821, std.dev.: 0.0345) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.58% (5.5974 => 5.2292, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2485, std.dev.: 0.0101) MultiSource/Applications/SIBsim4/SIBsim4: -6.22% (3.5443 => 3.3239, std.dev.: 0.0045) SingleSource/Benchmarks/McGill/queens: -5.85% (1.7443 => 1.6422, std.dev.: 0.0042) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.41% (4.2843 => 4.0527, std.dev.: 0.0789) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -5.40% (3.5127 => 3.3230, std.dev.: 0.0505) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.39% (4.9799 => 4.7113, std.dev.: 0.0362) SingleSource/Benchmarks/Shootout-C++/hash2: -4.94% (3.6768 => 3.4951, std.dev.: 0.0166) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.62% (5.8973 => 5.6839, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.20% (3.5691 => 3.4548, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists: -2.40% (17.2182 => 16.8052, std.dev.: 0.0753) SingleSource/Benchmarks/Misc/mandel-2: -2.26% (0.8521 => 0.8328, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.96% (8.7327 => 8.5612, std.dev.: 0.0228) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.59% (85.3042 => 83.9471, std.dev.: 0.1019) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.13% (3.7450 => 3.7027, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.12% (6.8262 => 6.7495, std.dev.: 0.0262) SingleSource/Benchmarks/Misc/whetstone: -1.00% (1.6251 => 1.6088, std.dev.: 0.0051) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 10.23% (1.2047 => 1.3279, std.dev.: 0.0510) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -15.74% (0.0394 => 0.0332, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.30% (0.0328 => 0.0327, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -3.15% (0.0445 => 0.0431, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/casts: -2.82% (0.0213 => 0.0207, std.dev.: 0.0018) SingleSource/UnitTests/Vector/Altivec/test1: -2.64% (0.0227 => 0.0221, std.dev.: 0.0003) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: - (0.0255 => 0.0255, std.dev.: 0.0055) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -6.41% (0.1530 => 0.1432, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: -36.14% (1.9293 => 1.2320, std.dev.: 0.2636) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.61% (0.4049 => 0.3984, std.dev.: 0.0854) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.31% (0.1510 => 0.1460, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -32.41% (0.0978 => 0.0661, std.dev.: 0.0032) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.36% (0.0276 => 0.0277, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -0.85% (0.0590 => 0.0585, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.11% (1.1617 => 1.2908, std.dev.: 0.0253) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -51.85% (0.0027 => 0.0013, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0092) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 35.45% (0.0268 => 0.0363, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.87% (0.7437 => 1.7542, std.dev.: 0.0209) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0002) SingleSource/UnitTests/SignlessTypes/Large/cast: -48.91% (0.0092 => 0.0047, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 166.42% (12.7781 => 34.0429, std.dev.: 0.0355) Report Time: 0.80s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 05:52:58 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 07:52:58 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131135258.773802A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8145?compare_to=8142&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8145, Order: 174053, Start Time: 2013-01-31 12:19:10, End Time: 2013-01-31 13:53:21 To: 8142, Order: 174049, Start Time: 2013-01-31 10:20:21, End Time: 2013-01-31 11:55:22 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (115 on baseline) Performance Improvements: 1 (95 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1101 (882 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.00% (40.4225 => 42.8482, std.dev.: 0.0857) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.98% (1.2649 => 1.2899, std.dev.: 0.0078) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.09% (20.6031 => 20.3790, std.dev.: 0.0293) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 125.71% (0.0315 => 0.0711, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.43% (0.0514 => 0.0876, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.12% (0.0974 => 0.1618, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.13% (0.1500 => 0.2192, std.dev.: 0.0007) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.23% (0.0599 => 0.0834, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.11% (0.6395 => 0.8832, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 37.80% (0.0418 => 0.0576, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.28% (0.6395 => 0.8715, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.76% (0.5805 => 0.7707, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.72% (0.5688 => 0.7549, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.65% (0.6260 => 0.8304, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.51% (0.5456 => 0.7230, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.09% (0.5575 => 0.7364, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.03% (0.5567 => 0.7350, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.01% (0.5849 => 0.7721, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.94% (0.6230 => 0.8220, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.88% (0.5581 => 0.7360, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.16% (0.5802 => 0.7610, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.78% (0.5705 => 0.7461, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.57% (0.5941 => 0.7757, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 30.55% (1.6474 => 2.1506, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.36% (0.5570 => 0.7261, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.26% (0.5569 => 0.7254, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.19% (0.5857 => 0.7625, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.12% (0.5478 => 0.7128, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.02% (0.5859 => 0.7618, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.99% (0.6033 => 0.7842, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.74% (0.5591 => 0.7254, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.61% (0.6440 => 0.8347, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.06% (0.5925 => 0.7647, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.92% (0.6189 => 0.7979, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.53% (0.5863 => 0.7536, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.51% (0.6676 => 0.8579, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.33% (0.6304 => 0.8090, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.22% (0.6052 => 0.7760, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.69% (0.6446 => 0.8231, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.29% (0.6681 => 0.8504, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.25% (0.6194 => 0.7882, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.00% (0.6660 => 0.8458, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.76% (0.6297 => 0.7982, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.17% (0.6667 => 0.8345, std.dev.: 0.0071) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.04% (0.0699 => 0.0874, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.11% (0.7524 => 0.9338, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.05% (0.7339 => 0.9031, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.04% (2.2587 => 2.7790, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.09% (0.0634 => 0.0755, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 18.36% (0.0621 => 0.0735, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.89% (0.0833 => 0.0982, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.36% (0.1146 => 0.1345, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: 16.18% (0.3357 => 0.3900, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.28% (1.1450 => 1.3199, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.89% (0.1081 => 0.1242, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.42% (0.1982 => 0.2248, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.71% (4.5069 => 5.0799, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.47% (1.6364 => 1.8404, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.35% (0.4916 => 0.5523, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 12.05% (0.4515 => 0.5059, std.dev.: 0.0027) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.88% (3.5339 => 3.9538, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 11.81% (0.0864 => 0.0966) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.94% (0.2385 => 0.2646, std.dev.: 0.0020) MultiSource/Benchmarks/mafft/pairlocalalign: 10.11% (9.2283 => 10.1610, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.13% (0.1731 => 0.1889, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.01% (0.5329 => 0.5809, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.81% (1.2515 => 1.3617, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.80% (0.7021 => 0.7639, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.60% (0.2001 => 0.2173, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 8.16% (0.4524 => 0.4893, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.93% (1.2784 => 1.3798, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.61% (0.4861 => 0.5231, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.48% (1.4642 => 1.5737, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.6750 => 0.7175, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 5.96% (0.1879 => 0.1991, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.65% (0.3255 => 0.3439, std.dev.: 0.0058) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.56% (5.4682 => 5.7721, std.dev.: 0.0128) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.18% (0.3319 => 0.3491, std.dev.: 0.0011) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.41% (22.4056 => 23.3928, std.dev.: 0.0082) MultiSource/Applications/oggenc/oggenc: 3.70% (5.0226 => 5.2086, std.dev.: 0.0042) MultiSource/Applications/SPASS/SPASS: 3.45% (15.5079 => 16.0425, std.dev.: 0.0070) MultiSource/Applications/SIBsim4/SIBsim4: 3.43% (1.3864 => 1.4340, std.dev.: 0.0140) MultiSource/Applications/minisat/minisat: 3.41% (0.7447 => 0.7701, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.21% (0.9557 => 0.9864, std.dev.: 0.0013) MultiSource/Applications/spiff/spiff: 3.20% (0.8418 => 0.8687, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary3: 3.02% (0.3446 => 0.3550, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.34% (0.5168 => 0.5289, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.30% (0.4427 => 0.4529, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.18% (1.3722 => 1.4021, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.50% (1.2300 => 1.2484, std.dev.: 0.0005) MultiSource/Applications/d/make_dparser: 1.32% (3.5154 => 3.5619, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 1.21% (34.0927 => 34.5038, std.dev.: 0.0098) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8047, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.67% (0.9531 => 1.0262, std.dev.: 0.0047) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.05% (11.6767 => 12.1491, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.53% (54.5751 => 56.5014, std.dev.: 0.0914) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.05% (2.0478 => 2.1102, std.dev.: 0.0041) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3053, std.dev.: 0.0015) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.63% (18.2231 => 18.5204, std.dev.: 0.0268) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5320 => 4.5980, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2695, std.dev.: 0.0011) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.23% (0.3194 => 0.3027, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.96% (0.3837 => 0.3685, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.91% (0.3812 => 0.3663, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.83% (0.6347 => 0.6104, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -3.82% (0.3848 => 0.3701, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -3.78% (0.3831 => 0.3686, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -3.77% (0.3896 => 0.3749, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -3.74% (0.3880 => 0.3735, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.69% (0.3821 => 0.3680, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.66% (0.9852 => 0.9491, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.64% (0.4033 => 0.3886, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.64% (2.4924 => 2.4016, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.62% (0.3891 => 0.3750, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.62% (0.2871 => 0.2767, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.58% (0.3323 => 0.3204, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.50% (0.4176 => 0.4030, std.dev.: 0.0030) SingleSource/UnitTests/ObjC++/property-reference-object: -3.49% (0.6441 => 0.6216, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.48% (0.3016 => 0.2911, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.30% (0.3057 => 0.2956, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.30% (0.3884 => 0.3756, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.16% (2.1713 => 2.1027, std.dev.: 0.0063) SingleSource/Benchmarks/Shootout-C++/wc: -3.12% (0.3205 => 0.3105, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -3.05% (0.7779 => 0.7542, std.dev.: 0.0024) MultiSource/Applications/hexxagon/hexxagon: -2.94% (1.3148 => 1.2761, std.dev.: 0.0098) SingleSource/UnitTests/ObjC/property: -2.93% (0.4199 => 0.4076, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.68% (0.9542 => 0.9286, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/parameter-passing: -2.55% (0.4280 => 0.4171, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.36% (0.6484 => 0.6331, std.dev.: 0.0006) SingleSource/UnitTests/Vector/constpool: -1.90% (20.7746 => 20.3790, std.dev.: 0.0293) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.85% (14.2083 => 13.9456, std.dev.: 0.0111) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.30% (6.7716 => 6.6833, std.dev.: 0.0072) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.28% (0.7919 => 0.7818, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.13% (1.0544 => 1.0425, std.dev.: 0.0045) MultiSource/Applications/sqlite3/sqlite3: -1.04% (17.1032 => 16.9248, std.dev.: 0.0237) MultiSource/Applications/JM/lencod/lencod: -1.03% (16.1920 => 16.0252, std.dev.: 0.0091) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.75% (1.8100 => 0.6743, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3117, std.dev.: 0.0050) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.98% (1.3643 => 1.0235, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7534, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0021) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4502, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.19% (0.0757 => 0.0589, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2051, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1734, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.63% (1.2237 => 0.9590) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1288, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7262, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.31% (4.9100 => 4.3545, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.15% (0.5142 => 0.4620, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.80% (0.9021 => 0.8408, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6991, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.94% (2.2633 => 2.1741, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.22% (5.5807 => 5.4010, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (7.9763 => 7.7520, std.dev.: 0.0235) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1177, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/ary3: -2.06% (3.7241 => 3.6473, std.dev.: 0.0070) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1751, std.dev.: 0.0214) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7084, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4708, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.29% (3.7092 => 3.6615, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.15% (1.6307 => 1.6119, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.89s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 07:15:17 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 09:15:17 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131151517.E13432A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8146?compare_to=8143&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8146, Order: 174055, Start Time: 2013-01-31 13:03:18, End Time: 2013-01-31 15:15:41 To: 8143, Order: 174048, Start Time: 2013-01-31 10:19:20, End Time: 2013-01-31 12:32:16 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (226 on baseline) Performance Improvements: 14 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1085 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.60% (80.0261 => 81.3094, std.dev.: 0.2301) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.87% (10.9998 => 10.7945, std.dev.: 0.0047) MultiSource/Applications/lua/lua: -1.54% (4.7286 => 4.6559, std.dev.: 0.0166) MultiSource/Applications/hbd/hbd: -1.51% (1.8183 => 1.7909, std.dev.: 0.0073) MultiSource/Applications/minisat/minisat: -1.50% (0.9156 => 0.9019, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.43% (0.6969 => 0.6869, std.dev.: 0.0020) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.40% (6.6520 => 6.5590, std.dev.: 0.0112) MultiSource/Applications/kimwitu++/kc: -1.40% (21.0787 => 20.7843, std.dev.: 0.0048) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.37% (39.6364 => 39.0934, std.dev.: 0.0147) MultiSource/Applications/siod/siod: -1.31% (2.7718 => 2.7355, std.dev.: 0.0101) MultiSource/Applications/hexxagon/hexxagon: -1.26% (1.4344 => 1.4163, std.dev.: 0.0038) MultiSource/Applications/lambda-0_1_3/lambda: -1.25% (0.9052 => 0.8939, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/bigfib: -1.23% (0.8204 => 0.8103, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.14% (1.1475 => 1.1344, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.06% (2.3050 => 2.2805, std.dev.: 0.0033) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1329 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: - (0.0417 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 0.59% (0.0676 => 0.0680, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/power/power: -0.02% (499.8477 => 499.7554, std.dev.: 0.0511) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44216.34% (1.1277 => 499.7554, std.dev.: 0.0511) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.14% (0.5229 => 1.7054, std.dev.: 0.0065) MultiSource/Applications/SPASS/SPASS: 25.63% (14.9895 => 18.8308, std.dev.: 0.0257) MultiSource/Applications/kimwitu++/kc: 46.83% (14.1553 => 20.7843, std.dev.: 0.0048) MultiSource/Benchmarks/MallocBench/gs/gs: 20.61% (4.1105 => 4.9576, std.dev.: 0.0167) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.44% (1.1048 => 1.7836, std.dev.: 0.0018) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 446.13% (7.1582 => 39.0934, std.dev.: 0.0147) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.41% (3.4629 => 6.5590, std.dev.: 0.0112) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.32% (0.6222 => 1.1344, std.dev.: 0.0008) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10241.67% (0.0720 => 7.4460, std.dev.: 0.0013) MultiSource/Applications/SIBsim4/SIBsim4: 3834100.00% (0.0001 => 3.8342, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11111100.00% (0.0001 => 11.1112, std.dev.: 0.0135) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 65900.00% (0.0001 => 0.0660, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575600.00% (0.0001 => 0.5757, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850300.00% (0.0001 => 9.8504, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5489300.00% (0.0001 => 5.4894, std.dev.: 0.0249) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.39% (1.1194 => 10.4484, std.dev.: 0.0381) MultiSource/Applications/ClamAV/clamscan: 151.87% (22.1758 => 55.8531, std.dev.: 0.0124) SingleSource/Benchmarks/Misc/lowercase: 130.86% (0.0256 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.48% (0.0929 => 0.1881, std.dev.: 0.0007) SingleSource/Regression/C/sumarraymalloc: 92.59% (0.0243 => 0.0468, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/neural/neural: 79.70% (0.1463 => 0.2629, std.dev.: 0.0000) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.26% (0.0730 => 0.1221, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.34% (1.5859 => 2.4952, std.dev.: 0.0164) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 56.83% (2.9384 => 4.6084, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.33% (7.0540 => 10.8864, std.dev.: 0.0148) MultiSource/Benchmarks/FreeBench/distray/distray: 53.13% (0.1056 => 0.1617, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.54% (8.1363 => 12.1674, std.dev.: 0.0106) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.97% (0.0439 => 0.0654) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.22% (2.2024 => 3.2204, std.dev.: 0.0102) MultiSource/Applications/sgefa/sgefa: 44.74% (0.3109 => 0.4500, std.dev.: 0.0002) SingleSource/UnitTests/vla: 44.23% (0.0355 => 0.0512, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.49% (0.1062 => 0.1492, std.dev.: 0.0000) MultiSource/Applications/JM/lencod/lencod: 39.76% (21.9371 => 30.6593, std.dev.: 0.0226) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.11% (1.5415 => 2.1290, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.20% (4.2646 => 5.8509, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.99% (0.4615 => 0.6276, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 35.87% (0.0814 => 0.1106, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.79% (0.2271 => 0.3061, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.73% (0.1892 => 0.2549, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 34.55% (0.5105 => 0.6869, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.24% (0.0479 => 0.0643, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 34.19% (1.1642 => 1.5622, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.44% (0.6675 => 0.8907, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 32.75% (0.4299 => 0.5707, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.39% (0.0457 => 0.0605, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 31.85% (0.0719 => 0.0948, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/chomp: 31.48% (0.1655 => 0.2176, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/Oscar: 31.29% (0.0636 => 0.0835, std.dev.: 0.0004) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 30.93% (0.1125 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.52% (0.0793 => 0.1035, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 30.26% (9.4845 => 12.3548, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.03% (0.1695 => 0.2204, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.68% (3.8922 => 5.0475, std.dev.: 0.0068) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 28.61% (0.1143 => 0.1470, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 28.44% (1.0722 => 1.3771, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 28.28% (0.4289 => 0.5502, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 28.23% (0.2554 => 0.3275, std.dev.: 0.0077) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.08% (1.4186 => 1.8170, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 26.99% (0.4620 => 0.5867, std.dev.: 0.0051) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.85% (0.3121 => 0.3959, std.dev.: 0.0049) MultiSource/Applications/minisat/minisat: 26.76% (0.7115 => 0.9019, std.dev.: 0.0018) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.71% (0.1906 => 0.2415, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.70% (0.1337 => 0.1694, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.58% (0.0730 => 0.0924, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/tsp/tsp: 26.47% (0.1175 => 0.1486, std.dev.: 0.0017) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.05% (0.1566 => 0.1974, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.04% (0.0672 => 0.0847) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.58% (0.5020 => 0.6304, std.dev.: 0.0026) SingleSource/Benchmarks/Misc-C++/bigfib: 25.51% (0.6456 => 0.8103, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/hash: 25.15% (0.0485 => 0.0607, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: 25.00% (0.0660 => 0.0825, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/15-trie/trie: 24.86% (0.0527 => 0.0658, std.dev.: 0.0006) MultiSource/Applications/spiff/spiff: 24.80% (0.7835 => 0.9778, std.dev.: 0.0044) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.54% (1.3050 => 1.6252, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.51% (0.1236 => 0.1539, std.dev.: 0.0000) MultiSource/Applications/viterbi/viterbi: 24.50% (0.1555 => 0.1936, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.41% (0.2700 => 0.3359, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/messages-2: 24.32% (0.0662 => 0.0823, std.dev.: 0.0001) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 24.12% (0.0626 => 0.0777, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.00% (0.0871 => 0.1080, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.93% (0.1032 => 0.1279, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.62% (0.1029 => 0.1272, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/mst/mst: 23.56% (0.1163 => 0.1437, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.56% (0.0675 => 0.0834, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 23.54% (0.1151 => 0.1422, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.40% (0.0953 => 0.1176, std.dev.: 0.0004) MultiSource/Applications/d/make_dparser: 23.35% (3.3354 => 4.1142, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 23.29% (1.1840 => 1.4598, std.dev.: 0.0042) MultiSource/Applications/oggenc/oggenc: 23.15% (5.7591 => 7.0921, std.dev.: 0.0031) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.92% (0.0842 => 0.1035, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.83% (0.5860 => 0.7198, std.dev.: 0.0046) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.78% (0.1940 => 0.2382, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 22.65% (0.1695 => 0.2079, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.50% (0.3307 => 0.4051, std.dev.: 0.0080) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 22.42% (0.0834 => 0.1021, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.37% (0.3098 => 0.3791, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.25% (0.1510 => 0.1846, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.12% (0.0886 => 0.1082, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.07% (4.9449 => 6.0363, std.dev.: 0.0188) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.90% (0.2758 => 0.3362, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.87% (0.8172 => 0.9959, std.dev.: 0.0132) MultiSource/Benchmarks/Prolangs-C/football/football: 21.70% (0.8921 => 1.0857, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/bisort/bisort: 21.66% (0.0614 => 0.0747, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/ReedSolomon: 21.57% (0.2049 => 0.2491, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.56% (0.9765 => 1.1870, std.dev.: 0.0034) MultiSource/Benchmarks/BitBench/five11/five11: 21.52% (0.0567 => 0.0689, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.46% (0.1584 => 0.1924, std.dev.: 0.0021) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.28% (5.0018 => 6.0661, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.21% (0.0528 => 0.0640) MultiSource/Applications/treecc/treecc: 21.10% (2.0273 => 2.4550, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.92% (0.5569 => 0.6734, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/18-imp/imp: 20.65% (0.3423 => 0.4130, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.46% (1.1861 => 1.4288, std.dev.: 0.0027) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.33% (0.6450 => 0.7761, std.dev.: 0.0022) SingleSource/UnitTests/SignlessTypes/rem: 20.28% (0.1144 => 0.1376, std.dev.: 0.0002) MultiSource/Applications/lambda-0_1_3/lambda: 20.26% (0.7433 => 0.8939, std.dev.: 0.0011) MultiSource/Applications/lua/lua: 20.24% (3.8723 => 4.6559, std.dev.: 0.0166) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.12% (0.2107 => 0.2531, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.96% (0.1117 => 0.1340, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.74% (0.0770 => 0.0922, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 19.72% (0.1268 => 0.1518, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.61% (0.0933 => 0.1116, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 19.40% (0.0536 => 0.0640, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0003) MultiSource/Applications/siod/siod: 19.10% (2.2969 => 2.7355, std.dev.: 0.0101) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.06% (0.8101 => 0.9645, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.01% (0.4203 => 0.5002, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.69% (0.3441 => 0.4084, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.64% (0.2065 => 0.2450, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/misr: 18.64% (0.0633 => 0.0751, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.63% (0.5981 => 0.7095, std.dev.: 0.0052) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.59% (0.2603 => 0.3087, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.91% (0.1044 => 0.1231, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.88% (0.3283 => 0.3870, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/matrix: 17.73% (0.0818 => 0.0963, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary: 17.48% (0.3232 => 0.3797, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.20% (0.3180 => 0.3727, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.05% (0.0704 => 0.0824) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.59% (0.8067 => 0.9405, std.dev.: 0.0078) MultiSource/Benchmarks/sim/sim: 16.39% (0.3387 => 0.3942, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary2: 16.37% (0.3379 => 0.3932, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.76% (0.3865 => 0.4474, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.68% (0.4636 => 0.5363, std.dev.: 0.0020) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 15.26% (17.1811 => 19.8025, std.dev.: 0.0233) MultiSource/Applications/hbd/hbd: 14.78% (1.5603 => 1.7909, std.dev.: 0.0073) SingleSource/Regression/C++/ofstream_ctor: 14.66% (0.2905 => 0.3331, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 14.38% (0.4048 => 0.4630, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.28% (0.4103 => 0.4689, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 13.88% (0.3422 => 0.3897, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists1: 13.71% (0.3684 => 0.4189, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/sieve: 13.63% (0.3603 => 0.4094, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.57% (0.3927 => 0.4460, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bh/bh: 13.49% (0.3092 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 13.22% (0.3282 => 0.3716, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.19% (0.4064 => 0.4600, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: 13.12% (0.3886 => 0.4396, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.93% (0.3427 => 0.3870, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.83% (14.3668 => 16.2095, std.dev.: 0.0112) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.67% (0.2430 => 0.2738, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.47% (0.3826 => 0.4303, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions: 12.30% (0.3828 => 0.4299, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.30% (0.1114 => 0.1251, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 12.25% (0.3543 => 0.3977, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/for-in: 11.88% (0.3694 => 0.4133, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.88% (0.3543 => 0.3964, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.78% (0.3497 => 0.3909, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.74% (0.3561 => 0.3979, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/Puzzle: 11.28% (0.1268 => 0.1411, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/except: 11.11% (0.2871 => 0.3190, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.09% (0.2831 => 0.3145, std.dev.: 0.0060) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.50% (0.3935 => 0.4348, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.36% (2.0665 => 2.2805, std.dev.: 0.0033) MultiSource/Applications/hexxagon/hexxagon: 10.29% (1.2842 => 1.4163, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/methcall: 10.15% (0.2877 => 0.3169, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.09% (0.2756 => 0.3034) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.05% (0.3650 => 0.4017, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.00% (0.6030 => 0.6633, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.84% (0.3162 => 0.3473, std.dev.: 0.0047) SingleSource/UnitTests/ObjC++/property-reference: 9.83% (0.7326 => 0.8046, std.dev.: 0.0040) MultiSource/Benchmarks/Bullet/bullet: 9.74% (63.2438 => 69.4036, std.dev.: 0.0103) SingleSource/UnitTests/ObjC++/Hello: 9.70% (0.5925 => 0.6500, std.dev.: 0.0084) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.70% (0.2793 => 0.3064, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hello: 9.65% (0.2714 => 0.2976, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.62% (0.2891 => 0.3169, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.61% (0.2872 => 0.3148, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 9.47% (0.2725 => 0.2983, std.dev.: 0.0043) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.42% (0.1625 => 0.1778, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.34% (0.3052 => 0.3337, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/random: 9.21% (0.2802 => 0.3060, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.77% (0.3136 => 0.3411, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.47% (0.2266 => 0.2458, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.05% (2.2022 => 2.3794, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.44% (0.4879 => 0.5242, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.38% (0.3817 => 0.3984, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 4.12% (10.3673 => 10.7945, std.dev.: 0.0047) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.66% (7.9617 => 8.2530, std.dev.: 0.0064) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4736, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6963, std.dev.: 0.0008) SingleSource/Regression/C/uint64_to_float: 13.02% (0.5413 => 0.6118, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.18% (1.1396 => 1.2442, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.93% (2.8904 => 3.1486, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.93% (11.6436 => 12.4502, std.dev.: 0.0480) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.31% (4.2280 => 4.4527, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3119, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0054) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.10% (0.9957 => 1.0266, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (8.6802 => 8.9399, std.dev.: 0.0134) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.06% (3.6395 => 3.7145, std.dev.: 0.0102) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0004) MultiSource/Applications/minisat/minisat: 1.82% (9.1159 => 9.2814, std.dev.: 0.0138) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7565, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3091, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 1.42% (1.0785 => 1.0938, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.08% (10.3460 => 10.4573, std.dev.: 0.0142) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1477, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.71% (5.2763 => 1.1760, std.dev.: 0.0026) SingleSource/Benchmarks/Misc/salsa20: -74.86% (0.8651 => 0.2175, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.42% (0.1622 => 0.0934, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.57% (5.3855 => 4.4931, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.90% (5.3526 => 4.5013, std.dev.: 0.0070) MultiSource/Applications/JM/ldecod/ldecod: -12.16% (10.4361 => 9.1675, std.dev.: 0.0132) SingleSource/UnitTests/Vector/constpool: -7.65% (54.1659 => 50.0233, std.dev.: 0.0174) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.14% (1.7609 => 1.6352, std.dev.: 0.0033) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.10% (1.9577 => 0.6832, std.dev.: 0.0058) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5623, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.37% (0.3987 => 0.2537, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3080, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.73% (1.5373 => 1.0187, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/mandel: -33.38% (1.1492 => 0.7656, std.dev.: 0.0008) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4285, std.dev.: 0.0050) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1297, std.dev.: 0.0100) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.49% (2.6546 => 2.0045, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5889, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/mason/mason: -19.94% (0.2161 => 0.1730, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029) SingleSource/UnitTests/Vector/multiplies: -16.74% (2.5528 => 2.1254, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/flops-6: -15.86% (1.6925 => 1.4240, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7353, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.01% (0.9540 => 0.8394, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: -11.16% (9.5636 => 8.4964, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7556, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) SingleSource/Benchmarks/CoyoteBench/huffbench: -7.00% (19.9488 => 18.5532, std.dev.: 0.0398) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.83% (1.8329 => 1.7077, std.dev.: 0.0102) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.82% (1.2373 => 1.1653, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5867, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.53% (8.1563 => 7.7054, std.dev.: 0.0021) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.27% (0.8614 => 0.8160, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.93% (0.4808 => 0.4571, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops-5: -4.91% (1.5835 => 1.5058, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.73% (10.2830 => 9.7966, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.91% (3.2827 => 3.1544, std.dev.: 0.0019) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.05% (1.0554 => 1.0338, std.dev.: 0.0002) MultiSource/Benchmarks/sim/sim: -1.86% (5.0483 => 4.9546, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.28% (3.7221 => 3.6745, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0042) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.57% (0.1485 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.86% (0.2116 => 0.0680, std.dev.: 0.0025) Report Time: 1.22s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 07:50:44 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 09:50:44 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131155044.C150A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8147?compare_to=8145&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8147, Order: 174057, Start Time: 2013-01-31 14:16:56, End Time: 2013-01-31 15:51:08 To: 8145, Order: 174053, Start Time: 2013-01-31 12:19:10, End Time: 2013-01-31 13:53:21 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (129 on baseline) Performance Improvements: 0 (86 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (877 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.42% (5.7721 => 5.8542, std.dev.: 0.0033) MultiSource/Applications/kimwitu++/kc: 1.21% (18.4567 => 18.6801, std.dev.: 0.0184) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 81.07% (0.0280 => 0.0507, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 71.40% (0.0514 => 0.0881) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 71.27% (0.0717 => 0.1228) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.15% (0.0974 => 0.1628, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 47.00% (0.1500 => 0.2205, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.93% (0.1132 => 0.1618, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.07% (0.0599 => 0.0839, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.83% (0.6395 => 0.8878, std.dev.: 0.0072) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 37.15% (0.6395 => 0.8771, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 35.15% (0.0293 => 0.0396, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.61% (0.5805 => 0.7756, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.49% (0.5688 => 0.7593, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.43% (0.6260 => 0.8353, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.38% (0.5456 => 0.7277, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 33.03% (0.5567 => 0.7406, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.94% (0.6230 => 0.8282, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.88% (0.5849 => 0.7772, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.81% (0.5575 => 0.7404, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.65% (0.5581 => 0.7403, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.92% (0.5802 => 0.7654, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.78% (1.6474 => 2.1709, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.55% (0.5705 => 0.7505, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.54% (0.5941 => 0.7815, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 31.18% (0.5570 => 0.7307, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.18% (0.5857 => 0.7683, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.03% (0.5569 => 0.7297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 31.01% (0.5478 => 0.7177, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.93% (0.5859 => 0.7671, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.81% (0.6033 => 0.7892, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.62% (0.5591 => 0.7303, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 30.19% (0.6440 => 0.8384, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 30.01% (0.5925 => 0.7703, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.76% (0.6189 => 0.8031, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.42% (0.5863 => 0.7588, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.39% (0.6676 => 0.8638, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 29.01% (0.6304 => 0.8133, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.98% (0.6052 => 0.7806, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.54% (0.6446 => 0.8286, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.27% (0.6681 => 0.8570, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.14% (0.6194 => 0.7937, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.73% (0.6660 => 0.8507, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.46% (0.6297 => 0.8026, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.11% (0.6667 => 0.8408, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.46% (0.0699 => 0.0877, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.09% (0.0582 => 0.0728, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.92% (0.7524 => 0.9399, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.16% (2.2587 => 2.8044, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 24.10% (0.7339 => 0.9108, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.70% (0.0445 => 0.0546) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.66% (0.0693 => 0.0850, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.51% (0.0622 => 0.0762, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.56% (0.0634 => 0.0758, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.06% (0.0556 => 0.0662, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.00% (0.0621 => 0.0739, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.73% (0.0566 => 0.0672) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.37% (0.0833 => 0.0986, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.63% (0.1146 => 0.1348, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.98% (0.3357 => 0.3927, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.32% (0.0680 => 0.0791, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 16.11% (1.1450 => 1.3295, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.26% (0.1081 => 0.1246, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.52% (0.1982 => 0.2250, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.35% (4.5069 => 5.1085, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.01% (1.6364 => 1.8493, std.dev.: 0.0060) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.88% (0.4916 => 0.5549, std.dev.: 0.0078) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.77% (3.5339 => 3.9852, std.dev.: 0.0016) SingleSource/Benchmarks/McGill/exptree: 12.62% (0.0864 => 0.0973, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.43% (0.4515 => 0.5076, std.dev.: 0.0033) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.71% (0.1230 => 0.1374, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.57% (0.2385 => 0.2661, std.dev.: 0.0007) MultiSource/Benchmarks/mafft/pairlocalalign: 10.71% (9.2283 => 10.2169, std.dev.: 0.0119) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.28% (0.1731 => 0.1909, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.15% (0.5329 => 0.5870, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 9.57% (1.2515 => 1.3713, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.56% (0.7021 => 0.7692, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.91% (1.2784 => 1.3923, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash: 8.89% (0.4524 => 0.4926, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.80% (0.2001 => 0.2177, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 8.31% (0.4861 => 0.5265, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.06% (1.4642 => 1.5822, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.29% (0.6750 => 0.7242, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.06% (5.4682 => 5.8542, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/BoolLiteralTest: 6.39% (0.3834 => 0.4079, std.dev.: 0.0073) SingleSource/Benchmarks/Misc/ReedSolomon: 6.39% (0.1879 => 0.1999, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/matrix: 5.99% (0.3255 => 0.3450, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/chomp: 5.85% (0.1761 => 0.1864, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.82% (0.3319 => 0.3512, std.dev.: 0.0061) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.44% (22.4056 => 23.6236, std.dev.: 0.0205) MultiSource/Applications/minisat/minisat: 4.27% (0.7447 => 0.7765, std.dev.: 0.0039) MultiSource/Applications/SPASS/SPASS: 4.23% (15.5079 => 16.1635, std.dev.: 0.0129) MultiSource/Applications/oggenc/oggenc: 4.16% (5.0226 => 5.2314, std.dev.: 0.0141) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.14% (0.9557 => 0.9953, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.95% (1.3864 => 1.4411, std.dev.: 0.0029) MultiSource/Applications/spiff/spiff: 3.86% (0.8418 => 0.8743, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.67% (0.3491 => 0.3619, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 3.40% (0.3446 => 0.3563, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.27% (0.5168 => 0.5337, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.15% (0.3394 => 0.3501, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.12% (0.4427 => 0.4565, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.62% (1.3722 => 1.4081, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.18% (0.6293 => 0.6430, std.dev.: 0.0024) MultiSource/Applications/kimwitu++/kc: 2.11% (18.2933 => 18.6801, std.dev.: 0.0184) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.11% (1.2300 => 1.2560, std.dev.: 0.0035) MultiSource/Applications/d/make_dparser: 1.79% (3.5154 => 3.5782, std.dev.: 0.0038) MultiSource/Applications/treecc/treecc: 1.75% (2.1401 => 2.1775, std.dev.: 0.0119) MultiSource/Benchmarks/nbench/nbench: 1.60% (1.1530 => 1.1714, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: 1.49% (34.0927 => 34.6013, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.27% (4.0323 => 4.0835, std.dev.: 0.0084) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.23% (4.8161 => 4.8755, std.dev.: 0.0149) MultiSource/Applications/siod/siod: 1.03% (2.4021 => 2.4269, std.dev.: 0.0076) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.87% (31.3723 => 55.8017, std.dev.: 0.0091) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.73% (0.9531 => 1.0268, std.dev.: 0.0077) SingleSource/Regression/C/uint64_to_float: 7.47% (0.5692 => 0.6117, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.08% (1.2783 => 1.3688, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1486, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.43% (54.5751 => 56.4485, std.dev.: 0.1364) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.58% (2.0478 => 2.1006, std.dev.: 0.0067) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3035, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.55% (18.2231 => 18.5056, std.dev.: 0.0135) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.5320 => 4.5966, std.dev.: 0.0032) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.76% (0.3194 => 0.3042, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.18% (0.7198 => 0.6897, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/trivial-interface: -3.75% (0.3812 => 0.3669, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions-3: -3.66% (0.3848 => 0.3707, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: -3.65% (0.3831 => 0.3691, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.55% (0.3891 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -3.52% (0.4033 => 0.3891, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.52% (0.3837 => 0.3702, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/synchronized: -3.52% (0.3896 => 0.3759, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -3.48% (0.3880 => 0.3745, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.43% (0.3821 => 0.3690, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.33% (0.4176 => 0.4037, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.30% (0.3884 => 0.3756, std.dev.: 0.0009) SingleSource/UnitTests/ObjC++/Hello: -3.23% (0.6347 => 0.6142, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -2.96% (2.4924 => 2.4187, std.dev.: 0.0014) SingleSource/UnitTests/ObjC++/property-reference-object: -2.89% (0.6441 => 0.6255, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.88% (0.9852 => 0.9568, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.73% (2.1713 => 2.1121, std.dev.: 0.0112) SingleSource/UnitTests/ObjC/property: -2.64% (0.4199 => 0.4088, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: -2.50% (1.3148 => 1.2819, std.dev.: 0.0011) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2704, std.dev.: 0.0167) SingleSource/UnitTests/ObjC++/property-reference: -2.37% (0.7779 => 0.7595, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.05% (0.9542 => 0.9346, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.84% (0.6484 => 0.6365, std.dev.: 0.0036) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.33% (14.2083 => 14.0188, std.dev.: 0.0236) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.59% (1.8100 => 0.6953, std.dev.: 0.0166) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.04% (8.0445 => 5.3062, std.dev.: 0.0106) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.54% (0.1983 => 0.1417, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.36% (0.2151 => 0.1584, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/mandel-2: -24.70% (1.3643 => 1.0273, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/methcall: -23.46% (7.5137 => 5.7509, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.00% (0.2274 => 0.1751, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4549, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.89% (4.1024 => 3.2044, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.14% (0.3418 => 0.2832, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1333, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.08% (0.4092 => 0.3516, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3540, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.00% (0.5142 => 0.4628, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8202, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8042, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1071, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6990, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/fbench: -3.95% (2.2633 => 2.1739, std.dev.: 0.0060) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.30% (5.5807 => 5.3967, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.16% (1.0557 => 1.0223, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.45% (7.9763 => 7.7806, std.dev.: 0.0121) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.08% (3.7241 => 3.6467, std.dev.: 0.0168) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1730, std.dev.: 0.0088) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.61% (1.3096 => 1.2885, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7080, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.53% (1.6307 => 1.6058, std.dev.: 0.0024) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.51% (6.5735 => 6.4742, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.15% (1.6086 => 1.5901, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6219 => 1.6035, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.90s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 07:55:35 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 09:55:35 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131155535.2EE242A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8148?compare_to=8144&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8148, Order: 174057, Start Time: 2013-01-31 13:53:45, End Time: 2013-01-31 15:56:00 To: 8144, Order: 174052, Start Time: 2013-01-31 11:30:52, End Time: 2013-01-31 13:35:49 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 13 (99 on baseline) Performance Improvements: 69 (94 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 982 (870 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Olden/treeadd/treeadd: 57.50% (0.0320 => 0.0504, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.15% (1.2395 => 1.2537, std.dev.: 0.0052) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout-C++/ackermann: 9.25% (3.8435 => 4.1989, std.dev.: 0.0715) SingleSource/Benchmarks/Linpack/linpack-pc: 4.69% (50.7613 => 53.1433, std.dev.: 0.3652) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.22% (1.2456 => 1.2982, std.dev.: 0.0042) MultiSource/Applications/siod/siod: 3.27% (3.5177 => 3.6329, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/ffbench: 3.26% (1.3674 => 1.4120, std.dev.: 0.0130) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.67% (2.7648 => 2.8386, std.dev.: 0.0158) SingleSource/Benchmarks/Misc/flops: 2.30% (8.6623 => 8.8617, std.dev.: 0.0080) SingleSource/Regression/C/uint64_to_float: 1.80% (1.9097 => 1.9441, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel: 1.73% (1.0409 => 1.0589, std.dev.: 0.0033) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.27% (1.2257 => 1.2413, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.09% (3.3230 => 3.3592, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -30.89% (0.1062 => 0.0734, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -26.95% (0.1232 => 0.0900, std.dev.: 0.0008) MultiSource/Benchmarks/SciMark2-C/scimark2: -23.49% (0.4755 => 0.3638, std.dev.: 0.0111) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -21.95% (0.3266 => 0.2549, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -21.61% (0.1152 => 0.0903, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -19.43% (0.6756 => 0.5443, std.dev.: 0.0101) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -18.75% (0.8149 => 0.6621, std.dev.: 0.0018) MultiSource/Benchmarks/Fhourstones/fhourstones: -13.52% (0.2005 => 0.1734, std.dev.: 0.0067) MultiSource/Applications/ALAC/decode/alacconvert-decode: -13.33% (1.3366 => 1.1584, std.dev.: 0.0083) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -12.86% (0.7830 => 0.6823, std.dev.: 0.0158) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.59% (0.9846 => 0.8606, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -12.18% (0.7981 => 0.7009, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -11.02% (1.8292 => 1.6277, std.dev.: 0.0112) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -10.84% (0.7244 => 0.6459, std.dev.: 0.0061) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.10% (1.0187 => 0.9158, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -8.70% (1.5907 => 1.4523, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.31% (1.1971 => 1.0976, std.dev.: 0.0069) MultiSource/Applications/kimwitu++/kc: -7.71% (20.1734 => 18.6177, std.dev.: 0.0816) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.25% (0.2676 => 0.2482, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -7.11% (2.1984 => 2.0420, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.10% (10.2388 => 9.5122, std.dev.: 0.0601) MultiSource/Applications/minisat/minisat: -7.07% (0.8463 => 0.7865, std.dev.: 0.0033) MultiSource/Benchmarks/Prolangs-C/loader/loader: -7.06% (0.3586 => 0.3333, std.dev.: 0.0034) MultiSource/Applications/hbd/hbd: -6.83% (1.6639 => 1.5502, std.dev.: 0.0151) MultiSource/Benchmarks/McCat/08-main/main: -6.79% (0.3080 => 0.2871, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.68% (0.2753 => 0.2569, std.dev.: 0.0027) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.74% (0.3013 => 0.2840, std.dev.: 0.0035) MultiSource/Benchmarks/Prolangs-C/football/football: -5.67% (1.0600 => 0.9999, std.dev.: 0.0013) MultiSource/Applications/treecc/treecc: -5.58% (2.4051 => 2.2710, std.dev.: 0.0200) MultiSource/Applications/SPASS/SPASS: -5.43% (17.7687 => 16.8044, std.dev.: 0.1304) MultiSource/Applications/lua/lua: -5.32% (4.5542 => 4.3117, std.dev.: 0.0134) MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.28% (5.8044 => 5.4979, std.dev.: 0.0140) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -5.23% (0.5049 => 0.4785, std.dev.: 0.0007) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.11% (0.9542 => 0.9054, std.dev.: 0.0098) MultiSource/Applications/hexxagon/hexxagon: -4.99% (1.0791 => 1.0253, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.97% (0.4046 => 0.3845, std.dev.: 0.0034) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.75% (1.2184 => 1.1605, std.dev.: 0.0056) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.47% (0.7292 => 0.6966, std.dev.: 0.0051) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.44% (0.4276 => 0.4086, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.78% (0.9991 => 0.9613, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.61% (0.3105 => 0.2993, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/bc/bc: -2.86% (1.3171 => 1.2794, std.dev.: 0.0043) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.58% (1.3396 => 1.3051, std.dev.: 0.0114) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.53% (1.5354 => 1.4965, std.dev.: 0.0075) MultiSource/Applications/d/make_dparser: -2.53% (3.7023 => 3.6088, std.dev.: 0.0255) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.97% (1.2872 => 1.2619, std.dev.: 0.0016) MultiSource/Applications/JM/lencod/lencod: -1.84% (17.6081 => 17.2844, std.dev.: 0.0821) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.71% (1.2579 => 1.2364, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.54% (1.3406 => 1.3199, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -1.54% (1.2479 => 1.2287, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -1.43% (4.7526 => 4.6847, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.42% (1.2766 => 1.2585, std.dev.: 0.0014) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.33% (15.1776 => 14.9752, std.dev.: 0.0475) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.29% (1.2898 => 1.2732, std.dev.: 0.0019) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.17% (7.2920 => 7.2064, std.dev.: 0.0189) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Applications/minisat/minisat: -21.86% (7.9028 => 6.1752, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -21.19% (1.5964 => 1.2582, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: -21.01% (2.9640 => 2.3412, std.dev.: 0.1101) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -17.95% (0.1939 => 0.1591, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/ft/ft: -12.89% (0.8912 => 0.7763, std.dev.: 0.0426) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -12.42% (50.0653 => 43.8452, std.dev.: 1.9523) MultiSource/Applications/SPASS/SPASS: -11.56% (9.3108 => 8.2344, std.dev.: 0.4042) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.99% (1.3658 => 1.2567, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -6.85% (0.4469 => 0.4163, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -6.37% (23.8953 => 22.3740, std.dev.: 0.3273) MultiSource/Benchmarks/Olden/bisort/bisort: -5.38% (0.6819 => 0.6452, std.dev.: 0.0034) MultiSource/Applications/lua/lua: -3.82% (29.4010 => 28.2788, std.dev.: 0.0886) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.71% (62.8470 => 61.1452, std.dev.: 0.1877) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.00% (39.8226 => 39.0272, std.dev.: 0.1033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -7.48% (1.3279 => 1.2286, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -14.80% (0.0223 => 0.0190, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0435 => 0.0435, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 3.31% (0.0332 => 0.0343, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.31% (0.0327 => 0.0326, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.23% (0.0431 => 0.0432, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/casts: 0.97% (0.0207 => 0.0209, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 4.52% (0.0221 => 0.0231, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: 0.21% (0.1432 => 0.1435, std.dev.: 0.0198) MultiSource/Applications/lemon/lemon: -5.90% (1.2320 => 1.1593, std.dev.: 0.1089) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.53% (0.3984 => 0.4005, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 10.96% (0.1460 => 0.1620, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.42% (0.0661 => 0.0645, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.72% (0.0277 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.52% (0.0585 => 0.0541, std.dev.: 0.0021) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.65% (1.2908 => 1.2824, std.dev.: 0.0530) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 100.00% (0.0013 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (0.0363 => 0.0368, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.11% (1.7542 => 1.7348, std.dev.: 0.0179) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 153.19% (0.0047 => 0.0119, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.54% (34.0429 => 34.5670, std.dev.: 0.0565) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0005) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 387.20% (0.0336 => 0.1637, std.dev.: 0.0348) SingleSource/Regression/C/sumarraymalloc: 113.99% (0.0293 => 0.0627, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/neural/neural: 61.54% (0.1638 => 0.2646, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 42.83% (0.9061 => 1.2942, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 42.83% (0.8893 => 1.2702, std.dev.: 0.0051) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.66% (0.9120 => 1.3011, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.40% (0.8926 => 1.2711, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.71% (0.9612 => 1.3621, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.13% (0.9588 => 1.3532, std.dev.: 0.0088) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 40.92% (0.9564 => 1.3478, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 40.76% (0.9381 => 1.3205, std.dev.: 0.0141) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.24% (0.9855 => 1.3821, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.11% (0.8990 => 1.2596, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.08% (0.9091 => 1.2735, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.77% (0.9998 => 1.3974, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.15% (0.9010 => 1.2537, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.62% (0.9422 => 1.3061, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.40% (0.9403 => 1.3014, std.dev.: 0.0130) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 38.29% (0.9512 => 1.3154, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.68% (0.8736 => 1.2028, std.dev.: 0.0059) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 37.28% (1.0119 => 1.3891, std.dev.: 0.0123) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 37.15% (0.8912 => 1.2223, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.56% (0.8732 => 1.1924, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.31% (1.0867 => 1.4813, std.dev.: 0.0086) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 36.29% (0.8846 => 1.2056, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.17% (1.0052 => 1.3688, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 34.10% (1.0017 => 1.3433, std.dev.: 0.0105) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 33.77% (0.9867 => 1.3199, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.03% (0.9507 => 1.2647, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.83% (0.9788 => 1.3001, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/exptree: 32.71% (0.0859 => 0.1140, std.dev.: 0.0038) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 32.64% (0.9488 => 1.2585, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.72% (1.0088 => 1.3288, std.dev.: 0.0018) SingleSource/Benchmarks/Stanford/IntMM: 31.55% (0.0431 => 0.0567, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 31.54% (0.9127 => 1.2006, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 31.46% (0.9685 => 1.2732, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.64% (0.9405 => 1.2287, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 30.60% (0.9993 => 1.3051, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.47% (0.9550 => 1.2364, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 27.61% (1.0860 => 1.3858, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.87% (0.0738 => 0.0892, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 20.40% (0.3598 => 0.4332, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 19.00% (0.0642 => 0.0764, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.45% (0.0963 => 0.1131, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 17.09% (3.6295 => 4.2498, std.dev.: 0.1017) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.15% (0.0805 => 0.0935, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.86% (1.0986 => 1.2619, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.68% (0.1240 => 0.1422, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 14.46% (9.5202 => 10.8965, std.dev.: 0.2088) MultiSource/Benchmarks/McCat/04-bisect/bisect: 13.06% (0.1332 => 0.1506, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.66% (1.4110 => 1.5897, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/matrix: 11.28% (0.2385 => 0.2654, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/ReedSolomon: 10.88% (0.2050 => 0.2273, std.dev.: 0.0037) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.21% (0.2577 => 0.2840, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.08% (0.1955 => 0.2152, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.83% (0.5369 => 0.5897, std.dev.: 0.0071) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 9.48% (1.8651 => 2.0420, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.13% (5.0381 => 5.4979, std.dev.: 0.0140) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.07% (2.4519 => 2.6744, std.dev.: 0.0615) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.90% (1.8127 => 1.9559, std.dev.: 0.0456) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.88% (0.2879 => 0.3106, std.dev.: 0.0016) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.64% (0.2372 => 0.2482, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/bigfib: 4.51% (0.6711 => 0.7014, std.dev.: 0.0050) MultiSource/Applications/oggenc/oggenc: 4.39% (5.3553 => 5.5904, std.dev.: 0.0657) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 3.86% (0.3702 => 0.3845, std.dev.: 0.0034) MultiSource/Applications/JM/lencod/lencod: 3.49% (16.7012 => 17.2844, std.dev.: 0.0821) MultiSource/Benchmarks/Prolangs-C/football/football: 2.46% (0.9759 => 0.9999, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.17% (16.4479 => 16.8044, std.dev.: 0.1304) MultiSource/Benchmarks/nbench/nbench: 2.02% (1.2708 => 1.2965, std.dev.: 0.0053) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.39% (4.9104 => 4.9789, std.dev.: 0.0136) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107775.00% (0.0008 => 0.8630, std.dev.: 0.0123) SingleSource/Benchmarks/Shootout/matrix: 353.12% (1.5825 => 7.1707, std.dev.: 0.0439) SingleSource/Benchmarks/Shootout/ary3: 294.05% (2.2304 => 8.7890, std.dev.: 2.3429) MultiSource/Applications/sgefa/sgefa: 258.98% (0.3515 => 1.2618, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.62% (1.1825 => 4.0278, std.dev.: 0.0209) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 228.78% (4.8185 => 15.8423, std.dev.: 0.1235) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 207.02% (0.0228 => 0.0700, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 155.17% (0.0232 => 0.0592, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary2: 144.96% (0.0129 => 0.0316, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 63.18% (2.9083 => 4.7458, std.dev.: 0.0080) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.53% (0.2562 => 0.3421, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.95% (3.1254 => 4.0928, std.dev.: 0.0099) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.20% (1.4588 => 1.8702, std.dev.: 0.0280) SingleSource/Regression/C/uint64_to_float: 26.26% (1.5397 => 1.9441, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.52% (5.6033 => 6.8653, std.dev.: 0.2415) SingleSource/Benchmarks/Misc/salsa20: 21.86% (7.4497 => 9.0783, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.35% (4.8112 => 5.7901, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.63% (5.1752 => 5.8808, std.dev.: 0.0191) SingleSource/Benchmarks/Shootout-C++/ackermann: 13.26% (3.7074 => 4.1989, std.dev.: 0.0715) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.18% (5.0033 => 5.6126, std.dev.: 0.0182) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.99% (3.6477 => 3.9756, std.dev.: 0.0422) SingleSource/Benchmarks/Misc/ReedSolomon: 8.12% (8.6447 => 9.3470, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.00% (4.7473 => 5.0796, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.45% (4.1836 => 4.4115, std.dev.: 0.0046) SingleSource/Benchmarks/Linpack/linpack-pc: 4.42% (50.8945 => 53.1433, std.dev.: 0.3652) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.99% (5.0310 => 5.2317, std.dev.: 0.0253) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.30% (4.7254 => 4.8815, std.dev.: 0.0285) MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.70% (2.7640 => 2.8386, std.dev.: 0.0158) MultiSource/Applications/siod/siod: 1.17% (3.5910 => 3.6329, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -29.30% (0.0727 => 0.0514, std.dev.: 0.0006) MultiSource/Benchmarks/BitBench/drop3/drop3: -26.73% (0.0692 => 0.0507, std.dev.: 0.0000) SingleSource/Benchmarks/SmallPT/smallpt: -26.01% (0.1888 => 0.1397, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -22.04% (0.0676 => 0.0527, std.dev.: 0.0016) MultiSource/Applications/hbd/hbd: -18.26% (1.8964 => 1.5502, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.76% (0.1684 => 0.1385, std.dev.: 0.0017) MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.44% (1.0960 => 0.9158, std.dev.: 0.0169) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.31% (0.1079 => 0.0903, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/perimeter/perimeter: -15.16% (0.1009 => 0.0856, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.86% (0.7686 => 0.6621, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: -12.27% (1.0220 => 0.8966, std.dev.: 0.0229) MultiSource/Benchmarks/SciMark2-C/scimark2: -10.70% (0.4074 => 0.3638, std.dev.: 0.0111) MultiSource/Applications/hexxagon/hexxagon: -10.32% (1.1433 => 1.0253, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.89% (0.7693 => 0.7009, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/hash2: -8.22% (0.5134 => 0.4712, std.dev.: 0.0153) MultiSource/Applications/treecc/treecc: -8.13% (2.4719 => 2.2710, std.dev.: 0.0200) MultiSource/Applications/siod/siod: -7.39% (2.6437 => 2.4482, std.dev.: 0.0226) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -7.38% (10.2703 => 9.5122, std.dev.: 0.0601) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.32% (0.1366 => 0.1266, std.dev.: 0.0018) MultiSource/Applications/lua/lua: -7.09% (4.6406 => 4.3117, std.dev.: 0.0134) SingleSource/Benchmarks/Shootout-C++/hash: -6.63% (0.4689 => 0.4378, std.dev.: 0.0117) MultiSource/Benchmarks/Olden/health/health: -6.40% (0.1610 => 0.1507, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/loader/loader: -6.38% (0.3560 => 0.3333, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -6.19% (0.6885 => 0.6459, std.dev.: 0.0061) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.07% (1.0234 => 0.9613, std.dev.: 0.0061) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -5.68% (0.9124 => 0.8606, std.dev.: 0.0066) MultiSource/Applications/lemon/lemon: -5.58% (1.3979 => 1.3199, std.dev.: 0.0286) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.57% (0.9588 => 0.9054, std.dev.: 0.0098) MultiSource/Benchmarks/Ptrdist/ft/ft: -5.56% (0.2283 => 0.2156, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.27% (0.5746 => 0.5443, std.dev.: 0.0101) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.17% (0.2709 => 0.2569, std.dev.: 0.0027) MultiSource/Applications/d/make_dparser: -4.63% (3.7840 => 3.6088, std.dev.: 0.0255) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.54% (1.1498 => 1.0976, std.dev.: 0.0069) MultiSource/Applications/ALAC/encode/alacconvert-encode: -4.52% (1.2154 => 1.1605, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -4.02% (1.5131 => 1.4523, std.dev.: 0.0086) MultiSource/Benchmarks/Prolangs-C/bison/mybison: -3.54% (1.6874 => 1.6277, std.dev.: 0.0112) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.19% (1.3924 => 1.3480, std.dev.: 0.0108) MultiSource/Applications/kimwitu++/kc: -1.69% (18.9377 => 18.6177, std.dev.: 0.0816) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.84% (11.5523 => 3.9458, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/fp-convert: -61.79% (15.6525 => 5.9809, std.dev.: 0.0251) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.99% (0.4146 => 0.1783, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.89% (0.4578 => 0.2340, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -44.11% (11.3868 => 6.3643, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.85% (5.4023 => 3.6276, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: -31.16% (0.9372 => 0.6452, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.01% (0.4452 => 0.3116, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/ft/ft: -28.23% (1.0816 => 0.7763, std.dev.: 0.0426) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.24% (5.2605 => 3.8800, std.dev.: 0.0079) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.35% (4.4467 => 3.3196, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.20% (0.5826 => 0.4358, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.27% (0.5897 => 0.4466, std.dev.: 0.0035) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -24.24% (0.5495 => 0.4163, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.57% (4.9921 => 3.8155, std.dev.: 0.0053) MultiSource/Applications/minisat/minisat: -22.70% (7.9891 => 6.1752, std.dev.: 0.0033) MultiSource/Benchmarks/Fhourstones/fhourstones: -19.46% (1.5623 => 1.2582, std.dev.: 0.0058) MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.65% (2.8778 => 2.3412, std.dev.: 0.1101) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.51% (5.8755 => 4.7882, std.dev.: 0.0108) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.25% (16.6791 => 13.8012, std.dev.: 0.2032) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -13.99% (7.0016 => 6.0223, std.dev.: 0.1857) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.40% (0.1164 => 0.1008, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.40% (3.1921 => 2.7645, std.dev.: 0.0486) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.81% (5.3626 => 4.6759, std.dev.: 0.0650) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.70% (9.7992 => 8.5547, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.62% (5.7056 => 4.9856, std.dev.: 0.0069) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.72% (1.4235 => 1.2567, std.dev.: 0.0044) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.47% (5.0421 => 4.4637, std.dev.: 0.0935) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.29% (0.4081 => 0.3661, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/lists1: -9.05% (0.6628 => 0.6028, std.dev.: 0.0189) MultiSource/Benchmarks/mafft/pairlocalalign: -9.01% (63.1520 => 57.4625, std.dev.: 0.0361) MultiSource/Applications/SIBsim4/SIBsim4: -7.30% (3.5443 => 3.2856, std.dev.: 0.0651) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.62% (5.5974 => 5.2270, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2480, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: -5.86% (0.3654 => 0.3440, std.dev.: 0.0057) SingleSource/Benchmarks/McGill/queens: -5.35% (1.7443 => 1.6509, std.dev.: 0.0275) MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.23% (0.3349 => 0.3174, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.86% (4.9799 => 4.7380, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/hash2: -4.77% (3.6768 => 3.5014, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -4.38% (23.3986 => 22.3740, std.dev.: 0.3273) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4358, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.61% (5.8973 => 5.6842, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.57% (40.4729 => 39.0272, std.dev.: 0.1033) SingleSource/Benchmarks/Shootout-C++/lists: -3.33% (17.2182 => 16.6456, std.dev.: 0.1204) MultiSource/Applications/lua/lua: -2.60% (29.0327 => 28.2788, std.dev.: 0.0886) MultiSource/Benchmarks/Bullet/bullet: -2.08% (7.2040 => 7.0544, std.dev.: 0.0445) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.91% (8.7327 => 8.5655, std.dev.: 0.0072) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.73% (85.3042 => 83.8281, std.dev.: 0.0135) SingleSource/Benchmarks/Misc/whetstone: -1.42% (1.6251 => 1.6020, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.27% (3.5669 => 3.5217, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.18% (6.8262 => 6.7459, std.dev.: 0.0038) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (3.7450 => 3.7045, std.dev.: 0.0020) MultiSource/Applications/aha/aha: -1.01% (3.5321 => 3.4965, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/bh/bh: -1.01% (2.4120 => 2.3877, std.dev.: 0.0023) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.98% (1.2047 => 1.2286, std.dev.: 0.0072) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -18.45% (0.0233 => 0.0190, std.dev.: 0.0020) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.55% (0.0451 => 0.0435, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.94% (0.0394 => 0.0343, std.dev.: 0.0036) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.61% (0.0328 => 0.0326, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.92% (0.0445 => 0.0432, std.dev.: 0.0042) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/test1: 1.76% (0.0227 => 0.0231, std.dev.: 0.0044) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.18% (0.0255 => 0.0252, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0000) MultiSource/Applications/ClamAV/clamscan: -6.21% (0.1530 => 0.1435, std.dev.: 0.0198) MultiSource/Applications/lemon/lemon: -39.91% (1.9293 => 1.1593, std.dev.: 0.1089) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -1.09% (0.4049 => 0.4005, std.dev.: 0.0157) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.28% (0.1510 => 0.1620, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.05% (0.0978 => 0.0645, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.36% (0.0276 => 0.0275, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.31% (0.0590 => 0.0541, std.dev.: 0.0021) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.39% (1.1617 => 1.2824, std.dev.: 0.0530) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0610 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.31% (0.0268 => 0.0368, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 133.27% (0.7437 => 1.7348, std.dev.: 0.0179) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001) SingleSource/UnitTests/SignlessTypes/Large/cast: 29.35% (0.0092 => 0.0119, std.dev.: 0.0002) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 170.52% (12.7781 => 34.5670, std.dev.: 0.0565) Report Time: 0.95s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 07:57:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 09:57:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130131155738.09C932A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8149?compare_to=8141&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8149, Order: 174052, Start Time: 2013-01-31 12:22:16, End Time: 2013-01-31 15:58:02 To: 8141, Order: 174044, Start Time: 2013-01-31 07:48:34, End Time: 2013-01-31 11:28:03 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 6 (187 on baseline) Performance Improvements: 0 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1098 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Applications/hexxagon/hexxagon: 1.80% (1.1595 => 1.1804, std.dev.: 0.0019) SingleSource/UnitTests/ObjC++/Hello: 1.78% (0.6904 => 0.7027, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 1.72% (1.1442 => 1.1639, std.dev.: 0.0017) SingleSource/UnitTests/ObjC++/property-reference-object: 1.55% (0.6965 => 0.7073, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 1.20% (0.8431 => 0.8532, std.dev.: 0.0013) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.10% (124.6484 => 128.5069, std.dev.: 1.4094) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 49.12% (0.0625 => 0.0932, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 37.82% (0.1063 => 0.1465, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.08% (0.0547 => 0.0717, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.30% (0.2969 => 0.3839, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.75% (0.5900 => 0.7596, std.dev.: 0.0106) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.76% (0.1106 => 0.1413, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.59% (0.0714 => 0.0911, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.52% (0.4139 => 0.5278, std.dev.: 0.0026) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.28% (0.1107 => 0.1409, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.21% (0.4994 => 0.6353, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.99% (0.0415 => 0.0527, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 26.95% (0.0475 => 0.0603, std.dev.: 0.0017) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.16% (0.5000 => 0.6308, std.dev.: 0.0035) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.08% (0.4253 => 0.5362, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.03% (0.0584 => 0.0736, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 25.92% (1.5932 => 2.0062, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.69% (0.1549 => 0.1947, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.88% (0.1620 => 0.2023, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.75% (0.0897 => 0.1119, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 24.16% (0.0948 => 0.1177, std.dev.: 0.0006) MultiSource/Applications/viterbi/viterbi: 24.08% (0.0947 => 0.1175, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.80% (0.0584 => 0.0723, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.33% (0.1003 => 0.1237, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.06% (0.0633 => 0.0779, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.05% (0.0642 => 0.0790, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 23.01% (0.0604 => 0.0743, std.dev.: 0.0000) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.00% (0.1604 => 0.1973, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.92% (0.0541 => 0.0665, std.dev.: 0.0008) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.85% (0.1103 => 0.1355, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.83% (0.0495 => 0.0608, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.75% (0.0822 => 0.1009, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.73% (0.3903 => 0.4790, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/05-eks/eks: 22.17% (0.1619 => 0.1978, std.dev.: 0.0028) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.16% (0.0582 => 0.0711, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0452 => 0.0552) MultiSource/Benchmarks/McCat/08-main/main: 22.09% (0.1218 => 0.1487, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 22.07% (0.4029 => 0.4918, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.97% (0.1088 => 0.1327, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 21.86% (0.0462 => 0.0563, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.71% (0.2736 => 0.3330, std.dev.: 0.0023) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.57% (0.3890 => 0.4729, std.dev.: 0.0033) MultiSource/Applications/sgefa/sgefa: 21.04% (0.0808 => 0.0978, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.00% (0.2866 => 0.3468, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.94% (0.3271 => 0.3956, std.dev.: 0.0047) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0019) MultiSource/Applications/aha/aha: 20.79% (0.0481 => 0.0581, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 20.76% (1.3152 => 1.5882, std.dev.: 0.0152) MultiSource/Benchmarks/Olden/mst/mst: 20.63% (0.0698 => 0.0842, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: 20.61% (0.5826 => 0.7027, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 20.40% (0.1505 => 0.1812, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.36% (0.2014 => 0.2424, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 20.11% (0.5889 => 0.7073, std.dev.: 0.0003) MultiSource/Applications/hbd/hbd: 20.03% (0.9697 => 1.1639, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/gs/gs: 19.96% (1.8794 => 2.2545, std.dev.: 0.0114) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.76% (0.0572 => 0.0685, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.66% (0.1968 => 0.2355, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.58% (0.2875 => 0.3438, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.54% (0.4658 => 0.5568, std.dev.: 0.0066) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.49% (0.0513 => 0.0613, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ackermann: 19.43% (0.2738 => 0.3270, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 19.37% (0.5546 => 0.6620, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/hello: 19.27% (0.2714 => 0.3237, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/methcall: 19.16% (0.2813 => 0.3352, std.dev.: 0.0047) MultiSource/Applications/hexxagon/hexxagon: 19.12% (0.9909 => 1.1804, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/strcat: 19.05% (0.2750 => 0.3274, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.02% (0.0573 => 0.0682, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/fibo: 19.01% (0.2725 => 0.3243, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 18.98% (0.7171 => 0.8532, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 18.96% (0.2811 => 0.3344, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/objinst: 18.95% (0.2823 => 0.3358, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.95% (0.2792 => 0.3321, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.81% (3.5627 => 4.2330, std.dev.: 0.0091) MultiSource/Benchmarks/Olden/bh/bh: 18.77% (0.1284 => 0.1525, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/random: 18.77% (0.2803 => 0.3329, std.dev.: 0.0001) SingleSource/Regression/C++/ofstream_ctor: 18.74% (0.3004 => 0.3567, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.69% (0.5361 => 0.6363, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 18.67% (0.2780 => 0.3299, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.65% (0.2729 => 0.3238, std.dev.: 0.0036) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.57% (2.0673 => 2.4513, std.dev.: 0.0162) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.55% (0.2911 => 0.3451, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.36% (0.1160 => 0.1373, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.31% (1.6211 => 1.9179, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wc: 18.25% (0.3096 => 0.3661, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.19% (0.5026 => 0.5940, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.15% (0.3195 => 0.3775, std.dev.: 0.0016) MultiSource/Benchmarks/Ptrdist/bc/bc: 18.09% (0.3930 => 0.4641, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.07% (0.1090 => 0.1287, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 18.06% (0.3267 => 0.3857, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: 18.02% (0.3258 => 0.3845, std.dev.: 0.0014) MultiSource/Applications/d/make_dparser: 18.00% (1.0781 => 1.2722, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 17.85% (4.2109 => 4.9626, std.dev.: 0.0463) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.84% (0.3060 => 0.3606, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary2: 17.76% (0.3317 => 0.3906, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/18-imp/imp: 17.73% (0.1421 => 0.1673, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.54% (0.4361 => 0.5126, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.52% (0.3362 => 0.3951, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.48% (0.3124 => 0.3670, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 17.43% (23.5202 => 27.6189, std.dev.: 0.0257) SingleSource/Benchmarks/Shootout-C++/lists: 17.38% (0.3348 => 0.3930, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 17.36% (0.3726 => 0.4373, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.35% (0.3625 => 0.4254, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.34% (0.3282 => 0.3851, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/hash: 17.27% (0.4146 => 0.4862, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.18% (1.9694 => 2.3078, std.dev.: 0.0139) SingleSource/Benchmarks/Shootout-C++/lists1: 17.11% (0.3477 => 0.4072, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 17.11% (0.3496 => 0.4094, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/moments: 17.07% (0.3678 => 0.4306, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 17.00% (0.3488 => 0.4081, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 16.98% (0.4251 => 0.4973, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 16.94% (0.3465 => 0.4052, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.70% (1.9966 => 2.3300, std.dev.: 0.0170) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.67% (0.3690 => 0.4305, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.63% (0.3981 => 0.4643, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: 16.54% (0.3446 => 0.4016, std.dev.: 0.0011) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.50% (2.7292 => 3.1794, std.dev.: 0.0172) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.49% (0.3845 => 0.4479, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/trivial-interface: 16.41% (0.3442 => 0.4007, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 16.33% (0.2566 => 0.2985, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/synchronized: 16.32% (0.3469 => 0.4035, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 16.24% (0.3460 => 0.4022, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/property: 16.22% (0.3650 => 0.4242, std.dev.: 0.0001) MultiSource/Applications/lua/lua: 16.14% (1.4269 => 1.6572, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.12% (4.4195 => 5.1318, std.dev.: 0.0375) SingleSource/UnitTests/ObjC/parameter-passing: 16.00% (0.3724 => 0.4320, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 15.86% (0.5012 => 0.5807, std.dev.: 0.0014) MultiSource/Applications/treecc/treecc: 15.76% (0.7875 => 0.9116, std.dev.: 0.0087) SingleSource/UnitTests/ObjC/exceptions: 15.76% (0.3643 => 0.4217, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 15.16% (0.0673 => 0.0775, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.09% (0.2068 => 0.2380, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 15.05% (0.2691 => 0.3096, std.dev.: 0.0024) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.04% (0.6435 => 0.7403, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 14.74% (5.5417 => 6.3586, std.dev.: 0.0067) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.47% (0.2737 => 0.3133, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 14.35% (2.1653 => 2.4761, std.dev.: 0.0231) MultiSource/Applications/JM/lencod/lencod: 14.26% (4.6177 => 5.2761, std.dev.: 0.0397) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.23% (0.7426 => 0.8483, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.20% (0.1028 => 0.1174, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 14.17% (0.2075 => 0.2369, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.88% (0.3084 => 0.3512, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 13.72% (0.0758 => 0.0862, std.dev.: 0.0004) MultiSource/Applications/lambda-0_1_3/lambda: 13.46% (0.3498 => 0.3969, std.dev.: 0.0049) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.46% (0.2103 => 0.2386, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 13.34% (2.1013 => 2.3816, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.06% (0.0804 => 0.0909, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 12.95% (0.3336 => 0.3768, std.dev.: 0.0054) MultiSource/Benchmarks/FreeBench/pifft/pifft: 12.55% (0.2040 => 0.2296, std.dev.: 0.0009) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.38% (11.6398 => 13.0806, std.dev.: 0.0091) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.08% (0.1383 => 0.1550, std.dev.: 0.0011) MultiSource/Applications/siod/siod: 11.97% (0.6634 => 0.7428, std.dev.: 0.0030) MultiSource/Benchmarks/PAQ8p/paq8p: 11.90% (0.4847 => 0.5424, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.38% (4.6926 => 5.1799, std.dev.: 0.0127) MultiSource/Applications/lemon/lemon: 10.37% (0.2391 => 0.2639, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 9.99% (2.0346 => 2.2379, std.dev.: 0.0022) MultiSource/Applications/kimwitu++/kc: 8.88% (11.9555 => 13.0174, std.dev.: 0.0210) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.74% (0.5584 => 0.6072, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/block-byref-aggr: 7.36% (0.3792 => 0.4071, std.dev.: 0.0003) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.81% (29.0505 => 181.5113, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.14% (0.2162 => 0.3527, std.dev.: 0.0164) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6527, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.23% (0.5917 => 0.6700, std.dev.: 0.0100) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.40% (0.3693 => 0.4077, std.dev.: 0.0014) MultiSource/Applications/ClamAV/clamscan: 10.10% (0.2802 => 0.3085, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/ary: 7.40% (0.2122 => 0.2279, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6775, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2400, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6809, std.dev.: 0.0056) SingleSource/Benchmarks/Misc/flops-2: 4.47% (1.8057 => 1.8865, std.dev.: 0.0047) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.03% (3.3991 => 3.5021, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 2.80% (0.6276 => 0.6452, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.03% (15.8721 => 16.1940, std.dev.: 0.0618) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3119, std.dev.: 0.0047) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.32% (7.1849 => 7.2798, std.dev.: 0.0038) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.22% (1.0927 => 1.1060, std.dev.: 0.0009) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0012) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.19% (3.1722 => 3.2099, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 1.16% (4.0317 => 4.0786, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.07% (3.6465 => 3.6856, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.07% (10.3705 => 10.4810, std.dev.: 0.0060) MultiSource/Applications/lua/lua: 1.06% (50.0626 => 50.5944, std.dev.: 0.0083) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.06% (1.2451 => 1.2583, std.dev.: 0.0000) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -2.15% (2.4764 => 2.4231, std.dev.: 0.0065) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.81% (25.4195 => 16.5698, std.dev.: 0.0139) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8690, std.dev.: 0.0001) SingleSource/Benchmarks/Dhrystone/fldry: -17.12% (17.2379 => 14.2866, std.dev.: 0.0266) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1012, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -8.83% (0.2402 => 0.2190, std.dev.: 0.0049) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9748, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -7.59% (35.5013 => 32.8067, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/tsp/tsp: -7.28% (2.1113 => 1.9577, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4807, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -4.21% (14.0481 => 13.4567, std.dev.: 0.0813) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.79% (41.7953 => 40.2132, std.dev.: 0.0189) MultiSource/Benchmarks/Olden/power/power: -3.70% (3.3665 => 3.2418, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.58% (11.2080 => 10.8065, std.dev.: 0.0103) MultiSource/Applications/siod/siod: -3.03% (6.9842 => 6.7728, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/perimeter/perimeter: -2.59% (0.6293 => 0.6130, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.18% (197.4719 => 193.1611, std.dev.: 0.0463) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.73% (10.7630 => 10.5771, std.dev.: 0.0025) MultiSource/Benchmarks/Olden/bh/bh: -1.45% (5.5810 => 5.5000, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.35% (5.7935 => 5.7155, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1483, std.dev.: 0.0904) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (16.2163 => 16.0484, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.18s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 09:48:40 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 11:48:40 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131174840.E5FC62A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8150?compare_to=8147&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8150, Order: 174061, Start Time: 2013-01-31 16:14:48, End Time: 2013-01-31 17:49:04 To: 8147, Order: 174057, Start Time: 2013-01-31 14:16:56, End Time: 2013-01-31 15:51:08 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (129 on baseline) Performance Improvements: 0 (88 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (875 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 81.07% (0.0280 => 0.0507) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 71.27% (0.0717 => 0.1228, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 71.21% (0.0514 => 0.0880, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.25% (0.0974 => 0.1629, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.80% (0.1500 => 0.2202, std.dev.: 0.0006) SingleSource/Regression/C/sumarraymalloc: 43.82% (0.0267 => 0.0384) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.93% (0.1132 => 0.1618, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.07% (0.0599 => 0.0839, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.98% (0.6395 => 0.8888, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 37.19% (0.6395 => 0.8773, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.50% (0.6260 => 0.8357, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.42% (0.5688 => 0.7589, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.39% (0.5805 => 0.7743, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.27% (0.5456 => 0.7271, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 33.00% (0.5567 => 0.7404, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.79% (0.6230 => 0.8273, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.74% (0.5849 => 0.7764, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.66% (0.5575 => 0.7396, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.54% (0.5581 => 0.7397, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 32.09% (0.5802 => 0.7664, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.64% (0.5705 => 0.7510, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.57% (1.6474 => 2.1675, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.49% (0.5941 => 0.7812, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 31.15% (0.5570 => 0.7305, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.03% (0.5569 => 0.7297, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.01% (0.5857 => 0.7673, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.89% (0.5478 => 0.7170, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.77% (0.5859 => 0.7662, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.76% (0.6033 => 0.7889, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.73% (0.5591 => 0.7309, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 30.33% (0.6440 => 0.8393, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.96% (0.5925 => 0.7700, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.54% (0.6189 => 0.8017, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.37% (0.6676 => 0.8637, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.23% (0.5863 => 0.7577, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 29.08% (0.6304 => 0.8137, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.87% (0.6052 => 0.7799, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.59% (0.6446 => 0.8289, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.09% (0.6681 => 0.8558, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.09% (0.6194 => 0.7934, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.69% (0.6660 => 0.8504, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.47% (0.6297 => 0.8027, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.07% (0.6667 => 0.8405, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.61% (0.0699 => 0.0878) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.09% (0.0582 => 0.0728, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.91% (0.7524 => 0.9398, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.11% (2.2587 => 2.8032, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.87% (0.7339 => 0.9091, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.67% (0.0790 => 0.0977, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.70% (0.0445 => 0.0546, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.66% (0.0693 => 0.0850, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.35% (0.0622 => 0.0761, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.40% (0.0634 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.06% (0.0556 => 0.0662, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.00% (0.0621 => 0.0739) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.73% (0.0566 => 0.0672, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.37% (0.0833 => 0.0986, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.63% (0.1146 => 0.1348, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 16.83% (0.3357 => 0.3922, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.18% (0.0680 => 0.0790, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 16.03% (1.1450 => 1.3286, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.45% (0.1081 => 0.1248, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.72% (0.1982 => 0.2254, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.33% (4.5069 => 5.1078, std.dev.: 0.0152) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.00% (1.6364 => 1.8491, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.92% (0.4916 => 0.5551, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.80% (3.5339 => 3.9863, std.dev.: 0.0011) MultiSource/Benchmarks/McCat/05-eks/eks: 12.51% (0.4515 => 0.5080, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 12.38% (0.0864 => 0.0971, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.49% (0.2385 => 0.2659, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.46% (0.1230 => 0.1371, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 10.75% (9.2283 => 10.2203, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.23% (0.1731 => 0.1908, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.10% (0.5329 => 0.5867, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.50% (0.7021 => 0.7688, std.dev.: 0.0005) MultiSource/Applications/Burg/burg: 9.49% (1.2515 => 1.3703, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.80% (0.2001 => 0.2177, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash: 8.78% (0.4524 => 0.4921, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.73% (1.2784 => 1.3900, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 8.39% (0.4861 => 0.5269, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.05% (1.4642 => 1.5821, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 7.29% (0.6750 => 0.7242, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.06% (5.4682 => 5.8544, std.dev.: 0.0084) SingleSource/Benchmarks/Misc/ReedSolomon: 6.65% (0.1879 => 0.2004, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.12% (0.3319 => 0.3522, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/matrix: 6.05% (0.3255 => 0.3452, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/chomp: 5.96% (0.1761 => 0.1866, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.41% (22.4056 => 23.6179, std.dev.: 0.0145) MultiSource/Applications/SPASS/SPASS: 4.27% (15.5079 => 16.1695, std.dev.: 0.0189) MultiSource/Applications/minisat/minisat: 4.16% (0.7447 => 0.7757, std.dev.: 0.0009) MultiSource/Applications/oggenc/oggenc: 4.15% (5.0226 => 5.2308, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 4.08% (1.3864 => 1.4429, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.00% (0.9557 => 0.9939, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 3.92% (0.8418 => 0.8748, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.55% (0.3491 => 0.3615, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary3: 3.48% (0.3446 => 0.3566, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.15% (0.5168 => 0.5331, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 3.06% (0.3394 => 0.3498, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4427 => 0.4562, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.59% (1.3722 => 1.4077, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.11% (0.6293 => 0.6426, std.dev.: 0.0004) MultiSource/Applications/kimwitu++/kc: 2.07% (18.2933 => 18.6711, std.dev.: 0.0194) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.85% (1.2300 => 1.2527, std.dev.: 0.0021) MultiSource/Applications/d/make_dparser: 1.81% (3.5154 => 3.5792, std.dev.: 0.0062) MultiSource/Applications/treecc/treecc: 1.74% (2.1401 => 2.1773, std.dev.: 0.0032) MultiSource/Benchmarks/nbench/nbench: 1.55% (1.1530 => 1.1709, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 1.50% (34.0927 => 34.6056, std.dev.: 0.0198) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.23% (4.0323 => 4.0817, std.dev.: 0.0172) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.15% (4.8161 => 4.8714, std.dev.: 0.0018) MultiSource/Applications/lua/lua: 1.13% (4.0594 => 4.1052, std.dev.: 0.0063) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.12% (0.9077 => 0.9179, std.dev.: 0.0011) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7899, std.dev.: 0.0078) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0042) SingleSource/Regression/C/uint64_to_float: 7.31% (0.5692 => 0.6108, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1483, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.21% (54.5751 => 56.3259, std.dev.: 0.1238) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.76% (2.0478 => 2.1043, std.dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3026, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.65% (18.2231 => 18.5237, std.dev.: 0.0046) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0013) MultiSource/Applications/sqlite3/sqlite3: 1.44% (4.5320 => 4.5972, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2698, std.dev.: 0.0052) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3489 => 10.4531, std.dev.: 0.0113) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.22% (0.7198 => 0.6894, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.71% (0.3831 => 0.3689, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: -3.69% (0.3880 => 0.3737, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -3.66% (0.3848 => 0.3707, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -3.62% (0.3896 => 0.3755, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0036) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.56% (0.3821 => 0.3685, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: -3.50% (0.4033 => 0.3892, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.50% (0.3891 => 0.3755, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions: -3.38% (0.4176 => 0.4035, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/Hello: -3.23% (0.6347 => 0.6142, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.17% (0.3884 => 0.3761, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.10% (0.3323 => 0.3220, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.01% (0.9852 => 0.9555, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -2.96% (2.4924 => 2.4187, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: -2.92% (0.6441 => 0.6253, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.80% (2.1713 => 2.1105, std.dev.: 0.0026) SingleSource/UnitTests/ObjC/property: -2.62% (0.4199 => 0.4089, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.42% (1.3148 => 1.2830, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.39% (0.7779 => 0.7593, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.37% (20.7746 => 20.2827, std.dev.: 0.0038) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.01% (0.9542 => 0.9350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.00% (0.6484 => 0.6354, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.38% (14.2083 => 14.0123, std.dev.: 0.0151) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.25% (1.8100 => 0.6832, std.dev.: 0.0090) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0011) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3964, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.97% (8.0445 => 5.3121, std.dev.: 0.0014) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.44% (0.1983 => 0.1419, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.29% (4.3504 => 3.2500, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/mandel-2: -24.65% (1.3643 => 1.0280, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.09% (0.2274 => 0.1749, std.dev.: 0.0016) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4488, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5893, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2055, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.11% (0.6299 => 0.5032, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.06% (2.5106 => 2.1325, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.25% (0.4092 => 0.3509, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7257, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.05% (0.5142 => 0.4625, std.dev.: 0.0052) SingleSource/Benchmarks/Misc/richards_benchmark: -8.97% (1.2842 => 1.1690, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0071) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3998, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2761, std.dev.: 0.0003) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.75% (7.9763 => 7.7571, std.dev.: 0.0109) SingleSource/Benchmarks/Shootout/ary3: -2.48% (3.7241 => 3.6318, std.dev.: 0.0087) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1739, std.dev.: 0.0081) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.55% (6.5735 => 6.4719, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.51% (1.6307 => 1.6061, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.39% (1.6086 => 1.5862, std.dev.: 0.0055) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.12% (1.6219 => 1.6038, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ary3: -1.03% (3.7092 => 3.6711, std.dev.: 0.0139) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.93s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 09:58:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 11:58:41 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131175841.A69372A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8151?compare_to=8146&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8151, Order: 174061, Start Time: 2013-01-31 15:46:36, End Time: 2013-01-31 17:59:05 To: 8146, Order: 174055, Start Time: 2013-01-31 13:03:18, End Time: 2013-01-31 15:15:41 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (227 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (645 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.15% (81.3094 => 80.3757, std.dev.: 0.3538) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1328 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0417 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.97% (0.0680 => 0.0707, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.7554 => 499.7909, std.dev.: 0.0358) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0416, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44219.49% (1.1277 => 499.7909, std.dev.: 0.0358) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.03% (0.5229 => 1.7048, std.dev.: 0.0025) MultiSource/Applications/SPASS/SPASS: 25.72% (14.9895 => 18.8447, std.dev.: 0.0213) MultiSource/Applications/kimwitu++/kc: 47.04% (14.1553 => 20.8142, std.dev.: 0.0177) MultiSource/Benchmarks/MallocBench/gs/gs: 20.78% (4.1105 => 4.9647, std.dev.: 0.0235) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.90% (1.1048 => 1.7887, std.dev.: 0.0027) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 446.49% (7.1582 => 39.1185, std.dev.: 0.0022) SingleSource/Benchmarks/Misc-C++-EH/spirit: 89.63% (3.4629 => 6.5668, std.dev.: 0.0052) SingleSource/Benchmarks/Misc-C++/stepanov_container: 82.32% (0.6222 => 1.1344, std.dev.: 0.0005) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10235.69% (0.0720 => 7.4417, std.dev.: 0.0056) MultiSource/Applications/SIBsim4/SIBsim4: 3834000.00% (0.0001 => 3.8341, std.dev.: 0.0035) MultiSource/Applications/SPASS/SPASS: 11087200.00% (0.0001 => 11.0873, std.dev.: 0.0371) MultiSource/Applications/kimwitu++/kc: 51400.00% (0.0001 => 0.0515, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63400.00% (0.0001 => 0.0635, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9850200.00% (0.0001 => 9.8503, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488000.00% (0.0001 => 5.4881, std.dev.: 0.0013) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 833.12% (1.1194 => 10.4453, std.dev.: 0.0083) MultiSource/Applications/ClamAV/clamscan: 152.10% (22.1758 => 55.9045, std.dev.: 0.0170) SingleSource/Benchmarks/Misc/lowercase: 131.25% (0.0256 => 0.0592, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.48% (0.0929 => 0.1881, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 93.00% (0.0243 => 0.0469, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 79.70% (0.1463 => 0.2629, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0008) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0000) SingleSource/Regression/C/sumarray: 64.50% (0.0231 => 0.0380, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 57.49% (1.5859 => 2.4977, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.23% (2.9384 => 4.6199, std.dev.: 0.0169) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.40% (7.0540 => 10.8913, std.dev.: 0.0074) MultiSource/Benchmarks/FreeBench/distray/distray: 53.13% (0.1056 => 0.1617, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.77% (8.1363 => 12.1860, std.dev.: 0.0073) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 48.97% (0.0439 => 0.0654, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.28% (2.2024 => 3.2217, std.dev.: 0.0142) MultiSource/Applications/sgefa/sgefa: 44.55% (0.3109 => 0.4494, std.dev.: 0.0009) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 41.13% (0.1432 => 0.2021, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.49% (0.1062 => 0.1492, std.dev.: 0.0012) MultiSource/Applications/JM/lencod/lencod: 39.86% (21.9371 => 30.6805, std.dev.: 0.0115) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.37% (1.5415 => 2.1329, std.dev.: 0.0037) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.31% (4.2646 => 5.8558, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.20% (0.2271 => 0.3093, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.12% (0.4615 => 0.6282, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/exptree: 36.00% (0.0814 => 0.1107, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 34.79% (0.5105 => 0.6881, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.45% (0.0479 => 0.0644) MultiSource/Applications/Burg/burg: 34.23% (1.1642 => 1.5627, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/05-eks/eks: 33.64% (0.4299 => 0.5745, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.51% (0.1892 => 0.2526, std.dev.: 0.0035) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 33.50% (0.6675 => 0.8911, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.39% (0.0457 => 0.0605, std.dev.: 0.0010) MultiSource/Benchmarks/NPB-serial/is/is: 32.13% (0.0719 => 0.0950, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/chomp: 31.48% (0.1655 => 0.2176, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 31.29% (0.0636 => 0.0835, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.02% (0.1125 => 0.1474, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.64% (0.0793 => 0.1036, std.dev.: 0.0015) MultiSource/Benchmarks/mafft/pairlocalalign: 30.22% (9.4845 => 12.3511, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.09% (0.1695 => 0.2205, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 29.95% (3.8922 => 5.0578, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout/hash: 29.69% (0.0485 => 0.0629, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.82% (0.0746 => 0.0961, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 28.65% (0.4289 => 0.5518, std.dev.: 0.0025) SingleSource/UnitTests/2006-12-11-LoadConstants: 28.61% (0.1143 => 0.1470, std.dev.: 0.0010) MultiSource/Applications/lemon/lemon: 28.44% (1.0722 => 1.3771, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/08-main/main: 28.27% (0.2554 => 0.3276, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.70% (1.4186 => 1.8116, std.dev.: 0.0069) MultiSource/Applications/minisat/minisat: 27.56% (0.7115 => 0.9076, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.21% (0.0408 => 0.0519, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 26.97% (0.4620 => 0.5866, std.dev.: 0.0012) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.72% (0.3121 => 0.3955, std.dev.: 0.0083) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.71% (0.1906 => 0.2415, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 26.58% (0.0730 => 0.0924, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 26.48% (0.1337 => 0.1691, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 26.47% (0.1175 => 0.1486, std.dev.: 0.0016) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.25% (0.1566 => 0.1977, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 25.97% (0.1032 => 0.1300, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.89% (0.0672 => 0.0846, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 25.80% (0.1151 => 0.1448, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/functionobjects: 25.64% (0.5020 => 0.6307, std.dev.: 0.0027) SingleSource/Benchmarks/Misc-C++/bigfib: 25.48% (0.6456 => 0.8101, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/em3d/em3d: 25.37% (0.1695 => 0.2125, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/whetstone: 25.00% (0.0660 => 0.0825, std.dev.: 0.0001) MultiSource/Applications/spiff/spiff: 24.88% (0.7835 => 0.9784, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/15-trie/trie: 24.86% (0.0527 => 0.0658, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.84% (0.1236 => 0.1543, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.78% (1.3050 => 1.6284, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bisort/bisort: 24.76% (0.0614 => 0.0766, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 24.63% (0.1555 => 0.1938, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.63% (0.2700 => 0.3365, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/lists: 24.60% (0.0626 => 0.0780, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/messages-2: 24.47% (0.0662 => 0.0824, std.dev.: 0.0006) MultiSource/Benchmarks/llubenchmark/llu: 24.24% (0.0462 => 0.0574) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.11% (0.0871 => 0.1081, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.71% (0.1029 => 0.1273, std.dev.: 0.0035) MultiSource/Benchmarks/nbench/nbench: 23.62% (1.1840 => 1.4637, std.dev.: 0.0043) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.56% (0.0675 => 0.0834, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 23.50% (0.0953 => 0.1177, std.dev.: 0.0000) MultiSource/Applications/d/make_dparser: 23.43% (3.3354 => 4.1168, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.29% (0.5860 => 0.7225, std.dev.: 0.0049) MultiSource/Applications/oggenc/oggenc: 23.17% (5.7591 => 7.0932, std.dev.: 0.0032) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.16% (0.0842 => 0.1037, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/mst/mst: 22.96% (0.1163 => 0.1430, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.85% (0.1584 => 0.1946, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.84% (0.2758 => 0.3388, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.84% (0.1940 => 0.2383, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.66% (0.8172 => 1.0024, std.dev.: 0.0096) SingleSource/Benchmarks/Shootout-C++/wordfreq: 22.59% (0.3307 => 0.4054, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 22.43% (0.3098 => 0.3793, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.16% (4.9449 => 6.0405, std.dev.: 0.0103) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.01% (0.0886 => 0.1081, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.85% (0.1510 => 0.1840, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 21.78% (0.2107 => 0.2566, std.dev.: 0.0008) MultiSource/Benchmarks/BitBench/five11/five11: 21.69% (0.0567 => 0.0690, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/18-imp/imp: 21.53% (0.3423 => 0.4160, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/ReedSolomon: 21.52% (0.2049 => 0.2490, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 21.48% (0.8921 => 1.0837, std.dev.: 0.0043) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.46% (5.0018 => 6.0750, std.dev.: 0.0044) MultiSource/Applications/treecc/treecc: 21.23% (2.0273 => 2.4577, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.21% (0.0528 => 0.0640) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.10% (0.6450 => 0.7811, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.08% (0.9765 => 1.1823, std.dev.: 0.0039) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.94% (1.1861 => 1.4345, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.74% (0.5569 => 0.6724, std.dev.: 0.0094) MultiSource/Applications/lua/lua: 20.37% (3.8723 => 4.6610, std.dev.: 0.0131) SingleSource/UnitTests/SignlessTypes/rem: 20.37% (0.1144 => 0.1377) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.32% (0.1117 => 0.1344, std.dev.: 0.0030) MultiSource/Applications/lambda-0_1_3/lambda: 20.25% (0.7433 => 0.8938, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/health/health: 19.95% (0.1268 => 0.1521, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.89% (0.0759 => 0.0910, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.75% (0.0648 => 0.0776, std.dev.: 0.0026) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.74% (0.0770 => 0.0922, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.51% (0.0933 => 0.1115, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.42% (0.2065 => 0.2466, std.dev.: 0.0020) SingleSource/Benchmarks/Misc/perlin: 19.40% (0.0536 => 0.0640) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 19.30% (2.2969 => 2.7401, std.dev.: 0.0163) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.22% (0.8101 => 0.9658, std.dev.: 0.0062) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 19.18% (0.0834 => 0.0994, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.99% (0.4203 => 0.5001, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.89% (0.3441 => 0.4091, std.dev.: 0.0020) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.71% (0.5981 => 0.7100, std.dev.: 0.0050) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.71% (0.2603 => 0.3090, std.dev.: 0.0009) SingleSource/Benchmarks/McGill/misr: 18.48% (0.0633 => 0.0750, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.10% (0.1044 => 0.1233, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: 18.09% (0.3283 => 0.3877, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/matrix: 17.85% (0.0818 => 0.0964, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 17.51% (0.3232 => 0.3798, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fbench: 17.23% (0.0592 => 0.0694, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/09-vor/vor: 17.20% (0.3180 => 0.3727, std.dev.: 0.0004) MultiSource/Benchmarks/sim/sim: 17.12% (0.3387 => 0.3967, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.05% (0.0704 => 0.0824, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.49% (0.8067 => 0.9397, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/ary2: 16.31% (0.3379 => 0.3930, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.71% (0.3865 => 0.4472, std.dev.: 0.0012) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.53% (0.4636 => 0.5356, std.dev.: 0.0033) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.39% (0.0838 => 0.0967, std.dev.: 0.0010) MultiSource/Applications/sqlite3/sqlite3: 15.36% (17.1811 => 19.8194, std.dev.: 0.0189) MultiSource/Applications/hbd/hbd: 14.97% (1.5603 => 1.7939, std.dev.: 0.0068) SingleSource/Regression/C++/ofstream_ctor: 14.60% (0.2905 => 0.3329, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.31% (0.4103 => 0.4690, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/moments: 14.28% (0.4048 => 0.4626, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: 14.17% (0.3422 => 0.3907, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 14.00% (0.3092 => 0.3525, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/lists1: 13.68% (0.3684 => 0.4188, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 13.66% (0.3603 => 0.4095, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/parameter-passing: 13.45% (0.3927 => 0.4455, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/oourafft: 13.41% (0.3282 => 0.3722, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.28% (0.0798 => 0.0904, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.16% (0.3427 => 0.3878, std.dev.: 0.0035) SingleSource/UnitTests/ObjC/property: 12.97% (0.3886 => 0.4390, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.97% (0.4064 => 0.4591, std.dev.: 0.0095) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.92% (14.3668 => 16.2223, std.dev.: 0.0061) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.80% (0.2430 => 0.2741, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 12.48% (0.1114 => 0.1253, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.44% (0.3826 => 0.4302, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions: 12.15% (0.3828 => 0.4293, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 11.94% (0.3694 => 0.4135, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0033) SingleSource/UnitTests/ObjC/synchronized: 11.82% (0.3561 => 0.3982, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.80% (0.3543 => 0.3961, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-3: 11.72% (0.3516 => 0.3928, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions-4: 11.71% (0.3543 => 0.3958, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 11.55% (0.3497 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/Puzzle: 11.20% (0.1268 => 0.1410, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 10.99% (0.2831 => 0.3142, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/except: 10.94% (0.2871 => 0.3185, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 10.67% (1.2842 => 1.4212, std.dev.: 0.0032) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.42% (2.0665 => 2.2818, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.32% (0.3935 => 0.4341, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 10.11% (0.2877 => 0.3168, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/fibo: 10.06% (0.2725 => 0.2999, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.91% (0.2756 => 0.3029, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.90% (0.3162 => 0.3475, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.89% (0.3650 => 0.4011, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.88% (0.6030 => 0.6626, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.76% (0.7326 => 0.8041, std.dev.: 0.0033) MultiSource/Benchmarks/Bullet/bullet: 9.75% (63.2438 => 69.4124, std.dev.: 0.0331) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.74% (0.2793 => 0.3065, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: 9.65% (0.5925 => 0.6497, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.55% (0.2891 => 0.3167, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hello: 9.54% (0.2714 => 0.2973, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.47% (0.2872 => 0.3144, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 9.29% (0.1625 => 0.1776, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 9.28% (0.2802 => 0.3062, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 9.27% (0.3052 => 0.3335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.83% (0.3136 => 0.3413, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.42% (0.1330 => 0.1442, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.15% (2.2022 => 2.3817, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.68% (0.2266 => 0.2440, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.34% (0.4879 => 0.5237, std.dev.: 0.0047) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.33% (0.3177 => 0.3410, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/objinst: 4.85% (0.3131 => 0.3283, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.35% (0.3817 => 0.3983, std.dev.: 0.0028) MultiSource/Benchmarks/PAQ8p/paq8p: 4.15% (10.3673 => 10.7976, std.dev.: 0.0079) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.82% (7.9617 => 8.2659, std.dev.: 0.0151) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.91% (4.3953 => 10.8962, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3121, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.94% (32.5116 => 59.4758, std.dev.: 0.0037) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.13% (1.1145 => 1.2943, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/oourafft: 15.78% (6.6465 => 7.6956, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 12.99% (0.5413 => 0.6116, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: 9.06% (1.1396 => 1.2428, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 6.88% (11.6436 => 12.4444, std.dev.: 0.0528) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4696, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 4.78% (3.1578 => 3.3086, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.84% (0.4162 => 0.4322, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1063, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.00% (0.9957 => 1.0256, std.dev.: 0.0021) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.62% (8.6802 => 8.9072, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.28% (3.6395 => 3.7225, std.dev.: 0.0061) MultiSource/Applications/minisat/minisat: 2.08% (9.1159 => 9.3055, std.dev.: 0.0212) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.91% (3.1595 => 3.2200, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 1.90% (0.8333 => 0.8491, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7566, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3109, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.08% (6.5088 => 6.5792, std.dev.: 0.0052) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1478, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.75% (5.2763 => 1.1740, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/salsa20: -74.87% (0.8651 => 0.2174, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -42.36% (0.1622 => 0.0935, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.56% (5.3855 => 4.4935, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.77% (5.3526 => 4.5084, std.dev.: 0.0091) MultiSource/Applications/JM/ldecod/ldecod: -11.88% (10.4361 => 9.1967, std.dev.: 0.0112) SingleSource/UnitTests/Vector/constpool: -7.68% (54.1659 => 50.0038, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.29% (1.7609 => 1.6325, std.dev.: 0.0048) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.39% (1.9577 => 0.6579, std.dev.: 0.0188) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3061, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/mandel: -33.48% (1.1492 => 0.7644, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/mandel-2: -33.38% (1.5373 => 1.0242, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4338, std.dev.: 0.0256) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1434, std.dev.: 0.0050) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.59% (2.6546 => 2.0018, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.91% (2.6778 => 2.0910, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0010) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/mason/mason: -18.60% (0.2161 => 0.1759, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1261, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops-6: -15.98% (1.6925 => 1.4221, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/matrix: -13.06% (3.1443 => 2.7338, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.80% (0.9540 => 0.8414, std.dev.: 0.0000) MultiSource/Benchmarks/NPB-serial/is/is: -11.21% (9.5636 => 8.4919, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9119, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.41% (0.1592 => 0.1474, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.74% (19.9488 => 18.6036, std.dev.: 0.0259) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.06% (0.3463 => 0.3253, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.77% (1.2373 => 1.1659, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.60% (8.1563 => 7.6992, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5866, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161) SingleSource/Benchmarks/Misc/salsa20: -4.84% (10.2830 => 9.7855, std.dev.: 0.0094) SingleSource/Benchmarks/Misc/flops-5: -4.74% (1.5835 => 1.5084, std.dev.: 0.0023) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0009) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0078) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.07% (1.0554 => 1.0336, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.80% (3.7221 => 3.6550, std.dev.: 0.0048) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6766, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.66% (3.6994 => 3.6381, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/lists: -1.04% (6.2999 => 6.2344, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout/hash: -1.03% (4.9088 => 4.8581, std.dev.: 0.0089) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -66.59% (0.2116 => 0.0707, std.dev.: 0.0018) Report Time: 1.40s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 10:20:08 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 12:20:08 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131182008.62C262A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8152?compare_to=8148&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8152, Order: 174061, Start Time: 2013-01-31 16:15:01, End Time: 2013-01-31 18:20:33 To: 8148, Order: 174057, Start Time: 2013-01-31 13:53:45, End Time: 2013-01-31 15:56:00 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 10 (66 on baseline) Performance Improvements: 4 (50 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1050 (947 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.73% (1.3051 => 1.4451, std.dev.: 0.0429) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc-C++/bigfib: 6.93% (0.3407 => 0.3643, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 4.66% (0.2320 => 0.2428, std.dev.: 0.0027) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.49% (1.0689 => 1.0955, std.dev.: 0.0055) MultiSource/Applications/lua/lua: 2.23% (28.2788 => 28.9103, std.dev.: 0.2223) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.93% (3.5217 => 3.5898, std.dev.: 0.0099) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.68% (15.8423 => 16.1087, std.dev.: 0.0370) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.25% (1.8585 => 1.8817, std.dev.: 0.0087) SingleSource/Benchmarks/Misc/pi: 1.21% (2.1795 => 2.2058, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.10% (4.0278 => 4.0721, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -3.70% (0.4163 => 0.4009, std.dev.: 0.0049) MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.84% (2.8386 => 2.7581, std.dev.: 0.0137) SingleSource/Benchmarks/Misc/ffbench: -2.25% (1.4120 => 1.3802, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.09% (61.1452 => 59.8661, std.dev.: 0.1657) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.69% (1.2286 => 1.2494, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 21.05% (0.0190 => 0.0230, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.23% (0.0435 => 0.0434, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 0.29% (0.0343 => 0.0344, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.53% (0.0326 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2.08% (0.0432 => 0.0441, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: 0.48% (0.0209 => 0.0210, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -0.87% (0.0231 => 0.0229, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -0.40% (0.0252 => 0.0251, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1435 => 0.1445, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 6.14% (1.1593 => 1.2305, std.dev.: 0.4601) MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.32% (0.4005 => 0.4018, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.06% (0.1620 => 0.1538, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.81% (0.0645 => 0.0614, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.18% (0.0275 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 12.20% (0.0541 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.46% (1.2824 => 1.3139, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.82% (0.0607 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.20% (0.0368 => 0.0290, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.56% (1.7348 => 1.7445, std.dev.: 0.0088) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 1.68% (0.0119 => 0.0121, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: -2.15% (34.5670 => 33.8231, std.dev.: 0.1971) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0001) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 395.83% (0.0336 => 0.1666, std.dev.: 0.0063) SingleSource/Regression/C/sumarraymalloc: 110.92% (0.0293 => 0.0618, std.dev.: 0.0076) MultiSource/Benchmarks/FreeBench/neural/neural: 60.81% (0.1638 => 0.2634, std.dev.: 0.0069) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 44.61% (0.9993 => 1.4451, std.dev.: 0.0429) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 41.33% (0.9612 => 1.3585, std.dev.: 0.0578) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.06% (0.9588 => 1.3525, std.dev.: 0.0888) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.27% (0.9010 => 1.2548, std.dev.: 0.0416) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 38.98% (0.9998 => 1.3895, std.dev.: 0.0905) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.23% (0.8736 => 1.1988, std.dev.: 0.1023) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 37.17% (0.9405 => 1.2901, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 36.95% (0.8912 => 1.2205, std.dev.: 0.0474) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 36.06% (0.9127 => 1.2418, std.dev.: 0.0664) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 35.28% (0.8732 => 1.1813, std.dev.: 0.0580) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.02% (0.8846 => 1.1944, std.dev.: 0.0589) SingleSource/Benchmarks/Stanford/IntMM: 34.80% (0.0431 => 0.0581, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 34.70% (0.9685 => 1.3046, std.dev.: 0.0212) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 34.09% (0.9867 => 1.3231, std.dev.: 0.0707) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.23% (1.0017 => 1.3346, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.00% (0.9788 => 1.3018, std.dev.: 0.0520) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 32.98% (0.9550 => 1.2700, std.dev.: 0.1004) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 32.93% (0.9507 => 1.2638, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 32.38% (1.0860 => 1.4377, std.dev.: 0.0775) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 31.51% (1.0088 => 1.3267, std.dev.: 0.0838) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 23.58% (0.0738 => 0.0912, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 19.65% (0.0738 => 0.0883, std.dev.: 0.0053) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 17.55% (0.0963 => 0.1132, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.53% (3.6295 => 4.1933, std.dev.: 0.1395) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.45% (0.0783 => 0.0904, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.16% (1.0986 => 1.2651, std.dev.: 0.0432) MultiSource/Benchmarks/mafft/pairlocalalign: 13.90% (9.5202 => 10.8438, std.dev.: 0.1086) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.79% (0.1240 => 0.1411, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/04-bisect/bisect: 12.54% (0.1332 => 0.1499, std.dev.: 0.0038) SingleSource/UnitTests/Vectorizer/gcc-loops: 11.18% (0.4596 => 0.5110, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 10.59% (0.2050 => 0.2267, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/himenobmtxpa: 10.13% (0.1955 => 0.2153, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.09% (0.2577 => 0.2837, std.dev.: 0.0076) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.28% (1.8127 => 1.9447, std.dev.: 0.0495) SingleSource/Benchmarks/Misc-C++/bigfib: 4.26% (0.6711 => 0.6997, std.dev.: 0.0053) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 105987.50% (0.0008 => 0.8487, std.dev.: 0.0125) SingleSource/Benchmarks/Shootout/matrix: 343.93% (1.5825 => 7.0252, std.dev.: 0.1405) MultiSource/Applications/sgefa/sgefa: 259.37% (0.3515 => 1.2632, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 244.36% (1.1825 => 4.0721, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 234.31% (4.8185 => 16.1087, std.dev.: 0.0370) SingleSource/Benchmarks/Shootout-C++/ary2: 204.65% (0.0129 => 0.0393, std.dev.: 0.0062) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 183.33% (0.0228 => 0.0646, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/ary: 140.52% (0.0232 => 0.0558, std.dev.: 0.0054) SingleSource/Benchmarks/Shootout-C++/matrix: 62.54% (2.9083 => 4.7271, std.dev.: 0.0366) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.29% (0.2562 => 0.3415, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.90% (3.1254 => 4.1225, std.dev.: 0.0261) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.76% (5.6033 => 6.9345, std.dev.: 0.3352) SingleSource/Regression/C/uint64_to_float: 23.73% (1.5397 => 1.9050, std.dev.: 0.0307) SingleSource/Benchmarks/Misc/salsa20: 21.86% (7.4497 => 9.0785, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.44% (4.8112 => 5.7946, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.14% (5.1752 => 5.8550, std.dev.: 0.1588) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6497, std.dev.: 0.1909) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.11% (3.6477 => 3.9801, std.dev.: 0.0442) SingleSource/Benchmarks/Misc/ReedSolomon: 8.05% (8.6447 => 9.3408, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.36% (4.7473 => 5.0492, std.dev.: 0.0512) MultiSource/Benchmarks/nbench/nbench: 5.83% (20.5117 => 21.7081, std.dev.: 0.0753) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.81% (0.6211 => 0.6572, std.dev.: 0.0101) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (4.1836 => 4.4066, std.dev.: 0.0159) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (5.0310 => 5.2281, std.dev.: 0.0258) SingleSource/Benchmarks/Misc/himenobmtxpa: 3.72% (4.1668 => 4.3220, std.dev.: 0.0226) SingleSource/Benchmarks/Linpack/linpack-pc: 3.70% (50.8945 => 52.7764, std.dev.: 0.2570) SingleSource/Benchmarks/Misc/pi: 3.12% (2.1390 => 2.2058, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.11% (4.7254 => 4.8722, std.dev.: 0.0531) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.50% (0.0808 => 0.0505, std.dev.: 0.0029) MultiSource/Applications/hbd/hbd: -17.77% (1.8964 => 1.5594, std.dev.: 0.0667) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.52% (0.7686 => 0.6570, std.dev.: 0.0329) SingleSource/Benchmarks/Shootout-C++/hash2: -8.18% (0.5134 => 0.4714, std.dev.: 0.0135) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.83% (0.1366 => 0.1259, std.dev.: 0.0026) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.77% (1.0234 => 0.9643, std.dev.: 0.0228) SingleSource/Benchmarks/Misc-C++/Large/ray: -4.42% (0.3462 => 0.3309, std.dev.: 0.0028) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.67% (11.5523 => 3.9663, std.dev.: 0.0720) SingleSource/Benchmarks/Misc/fp-convert: -62.42% (15.6525 => 5.8827, std.dev.: 0.0420) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.81% (0.4146 => 0.1832, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.67% (0.4578 => 0.2350, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.94% (11.3868 => 6.3829, std.dev.: 0.1082) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -31.98% (5.4023 => 3.6746, std.dev.: 0.0373) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.24% (0.4452 => 0.3061, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/bisort/bisort: -30.99% (0.9372 => 0.6468, std.dev.: 0.0971) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.04% (0.5495 => 0.4009, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.25% (5.2605 => 3.8798, std.dev.: 0.0077) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.27% (0.5826 => 0.4354, std.dev.: 0.0340) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.97% (4.4467 => 3.3364, std.dev.: 0.0092) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.05% (0.5897 => 0.4479, std.dev.: 0.0143) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8223, std.dev.: 0.0079) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.81% (16.6791 => 13.5413, std.dev.: 0.3958) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.44% (5.8755 => 4.7920, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -15.07% (7.0016 => 5.9462, std.dev.: 0.2385) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.49% (0.1164 => 0.1007, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.06% (3.1921 => 2.7752, std.dev.: 0.0620) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.83% (5.3626 => 4.6746, std.dev.: 0.0904) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.47% (5.7056 => 4.9939, std.dev.: 0.0116) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.32% (9.7992 => 8.5924, std.dev.: 0.0282) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.38% (5.0421 => 4.4681, std.dev.: 0.0975) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.75% (1.4235 => 1.2705, std.dev.: 0.0209) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.68% (0.4081 => 0.3645, std.dev.: 0.0071) SingleSource/Benchmarks/Shootout/hash: -10.35% (4.5259 => 4.0573, std.dev.: 0.1387) MultiSource/Benchmarks/mafft/pairlocalalign: -8.93% (63.1520 => 57.5126, std.dev.: 0.4888) SingleSource/Benchmarks/CoyoteBench/lpbench: -7.68% (4.4540 => 4.1120, std.dev.: 0.0368) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.84% (4.2843 => 3.9914, std.dev.: 0.0742) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2285, std.dev.: 0.0066) MultiSource/Applications/SIBsim4/SIBsim4: -6.51% (3.5443 => 3.3134, std.dev.: 0.0603) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.68% (4.9799 => 4.6968, std.dev.: 0.0504) SingleSource/Benchmarks/McGill/queens: -5.46% (1.7443 => 1.6491, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hash2: -4.74% (3.6768 => 3.5025, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.54% (3.7662 => 3.5953, std.dev.: 0.0516) SingleSource/Benchmarks/Misc/ffbench: -3.10% (1.4244 => 1.3802, std.dev.: 0.0112) SingleSource/Benchmarks/Shootout-C++/lists: -2.92% (17.2182 => 16.7156, std.dev.: 0.0921) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.84% (1.4446 => 1.4036, std.dev.: 0.0151) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.92% (61.0379 => 59.8661, std.dev.: 0.1657) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5778, std.dev.: 0.0189) SingleSource/Benchmarks/Misc/mandel-2: -1.53% (0.8521 => 0.8391, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.44% (8.8249 => 8.6982, std.dev.: 0.0127) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.32% (3.3596 => 3.3154, std.dev.: 0.0004) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.71% (1.2047 => 1.2494, std.dev.: 0.0119) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -1.29% (0.0233 => 0.0230, std.dev.: 0.0004) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0008) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.69% (0.0394 => 0.0344, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -2.13% (0.0328 => 0.0321, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.90% (0.0445 => 0.0441, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/casts: -1.41% (0.0213 => 0.0210, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 0.88% (0.0227 => 0.0229, std.dev.: 0.0002) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: -5.56% (0.1530 => 0.1445, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: -36.22% (1.9293 => 1.2305, std.dev.: 0.4601) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.77% (0.4049 => 0.4018, std.dev.: 0.0195) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 1.85% (0.1510 => 0.1538, std.dev.: 0.0493) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.22% (0.0978 => 0.0614, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.54% (0.0276 => 0.0269, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 2.88% (0.0590 => 0.0607, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.10% (1.1617 => 1.3139, std.dev.: 0.0033) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -46.88% (0.0032 => 0.0017, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.33% (0.0610 => 0.0612, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.21% (0.0268 => 0.0290, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.57% (0.7437 => 1.7445, std.dev.: 0.0088) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 31.52% (0.0092 => 0.0121, std.dev.: 0.0011) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0001) SingleSource/UnitTests/Vectorizer/gcc-loops: 164.70% (12.7781 => 33.8231, std.dev.: 0.1971) Report Time: 0.79s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 11:46:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 13:46:53 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131194653.C04B42A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8153?compare_to=8150&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8153, Order: 174067, Start Time: 2013-01-31 18:13:15, End Time: 2013-01-31 19:47:17 To: 8150, Order: 174061, Start Time: 2013-01-31 16:14:48, End Time: 2013-01-31 17:49:04 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (130 on baseline) Performance Improvements: 1 (88 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (874 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/ObjC/BoolLiteralTest: -6.77% (0.4197 => 0.3913, std.dev.: 0.0077) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 81.07% (0.0280 => 0.0507, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 71.60% (0.0514 => 0.0882, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 71.41% (0.0717 => 0.1229, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.25% (0.0974 => 0.1629, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.93% (0.1500 => 0.2204, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 43.20% (0.1132 => 0.1621, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.23% (0.0599 => 0.0840) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.95% (0.6395 => 0.8886, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 38.52% (0.0418 => 0.0579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 37.20% (0.6395 => 0.8774, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 35.15% (0.0293 => 0.0396, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.68% (0.5688 => 0.7604, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.63% (0.5805 => 0.7757, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.59% (0.6260 => 0.8363, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.52% (0.5456 => 0.7285, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.99% (0.6230 => 0.8285, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.95% (0.5849 => 0.7776, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.94% (0.5567 => 0.7401, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.79% (0.5575 => 0.7403, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.72% (0.5581 => 0.7407, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 32.08% (0.5802 => 0.7663, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.80% (1.6474 => 2.1713, std.dev.: 0.0169) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.66% (0.5705 => 0.7511, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.41% (0.5941 => 0.7807, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 31.17% (0.5570 => 0.7306, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 31.13% (0.5857 => 0.7680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 31.11% (0.5478 => 0.7182, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.06% (0.5569 => 0.7299, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.98% (0.5859 => 0.7674, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.86% (0.6033 => 0.7895, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.64% (0.5591 => 0.7304, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 30.39% (0.6440 => 0.8397, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 30.04% (0.5925 => 0.7705, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.67% (0.6189 => 0.8025, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.51% (0.5863 => 0.7593, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.43% (0.6676 => 0.8641, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.85% (0.6304 => 0.8123, std.dev.: 0.0041) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.80% (0.6052 => 0.7795, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.64% (0.6446 => 0.8292, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.23% (0.6681 => 0.8567, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.08% (0.6194 => 0.7933, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.79% (0.6660 => 0.8511, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.51% (0.6297 => 0.8029, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.17% (0.6667 => 0.8412, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.75% (0.0699 => 0.0879, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.26% (0.0582 => 0.0729, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.97% (0.7524 => 0.9403, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.17% (2.2587 => 2.8046, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 24.09% (0.7339 => 0.9107, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.80% (0.0790 => 0.0978, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.70% (0.0445 => 0.0546, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.67% (0.0622 => 0.0763) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.51% (0.0693 => 0.0849, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.72% (0.0634 => 0.0759, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.24% (0.0556 => 0.0663, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.00% (0.0621 => 0.0739, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.90% (0.0566 => 0.0673, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.49% (0.0833 => 0.0987, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.80% (0.1146 => 0.1350, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: 17.55% (0.3357 => 0.3946, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.32% (0.0680 => 0.0791, std.dev.: 0.0022) MultiSource/Applications/lemon/lemon: 16.26% (1.1450 => 1.3312, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.63% (0.1081 => 0.1250, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.77% (0.1982 => 0.2255, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.47% (4.5069 => 5.1139, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.08% (0.4916 => 0.5559, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.04% (1.6364 => 1.8498, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.91% (3.5339 => 3.9903, std.dev.: 0.0022) SingleSource/Benchmarks/McGill/exptree: 12.50% (0.0864 => 0.0972, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.43% (0.4515 => 0.5076, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.49% (0.2385 => 0.2659, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.06% (0.1230 => 0.1366, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.80% (9.2283 => 10.2249, std.dev.: 0.0051) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.34% (0.1731 => 0.1910, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.11% (0.5329 => 0.5868, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.60% (0.7021 => 0.7695, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 9.55% (1.2515 => 1.3710, std.dev.: 0.0030) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.95% (0.2001 => 0.2180, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 8.84% (0.4524 => 0.4924, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.67% (1.2784 => 1.3892, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash2: 8.21% (0.4861 => 0.5260) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.13% (1.4642 => 1.5832, std.dev.: 0.0029) SingleSource/Benchmarks/Misc-C++/bigfib: 7.21% (0.6750 => 0.7237, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.02% (5.4682 => 5.8522, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/ReedSolomon: 6.44% (0.1879 => 0.2000, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 5.96% (0.1761 => 0.1866, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.88% (0.3319 => 0.3514, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: 5.78% (0.3255 => 0.3443, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.50% (22.4056 => 23.6374, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 4.45% (15.5079 => 16.1984, std.dev.: 0.0129) MultiSource/Applications/minisat/minisat: 4.38% (0.7447 => 0.7773, std.dev.: 0.0005) MultiSource/Applications/SIBsim4/SIBsim4: 4.28% (1.3864 => 1.4457, std.dev.: 0.0052) MultiSource/Applications/oggenc/oggenc: 4.16% (5.0226 => 5.2315, std.dev.: 0.0053) MultiSource/Applications/spiff/spiff: 4.06% (0.8418 => 0.8760, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.02% (0.9557 => 0.9941, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.58% (0.3491 => 0.3616, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 3.11% (0.3446 => 0.3553, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.10% (0.5168 => 0.5328, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary: 3.09% (0.3394 => 0.3499, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.05% (0.4427 => 0.4562, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.72% (1.3722 => 1.4095, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.16% (0.6293 => 0.6429, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.13% (18.2933 => 18.6834, std.dev.: 0.0051) MultiSource/Applications/d/make_dparser: 1.90% (3.5154 => 3.5823, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.86% (1.2300 => 1.2529, std.dev.: 0.0018) MultiSource/Applications/treecc/treecc: 1.83% (2.1401 => 2.1793, std.dev.: 0.0006) MultiSource/Benchmarks/nbench/nbench: 1.69% (1.1530 => 1.1725, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: 1.64% (34.0927 => 34.6505, std.dev.: 0.0189) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.40% (4.8161 => 4.8835, std.dev.: 0.0059) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.26% (4.0323 => 4.0833, std.dev.: 0.0053) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.23% (0.9077 => 0.9189, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 1.18% (4.0594 => 4.1072, std.dev.: 0.0107) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.07% (4.8802 => 4.9325, std.dev.: 0.0069) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.91% (31.3723 => 55.8145, std.dev.: 0.0097) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 8.60% (0.9531 => 1.0351, std.dev.: 0.0079) SingleSource/Regression/C/uint64_to_float: 7.41% (0.5692 => 0.6114, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1487, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.49% (54.5751 => 56.4797, std.dev.: 0.0789) SingleSource/Benchmarks/Misc-C++/bigfib: 3.06% (0.3328 => 0.3430, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.68% (2.0478 => 2.1026, std.dev.: 0.0045) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3028, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5113, std.dev.: 0.0130) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0006) MultiSource/Applications/sqlite3/sqlite3: 1.50% (4.5320 => 4.6002, std.dev.: 0.0106) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.42% (5.1955 => 5.2692, std.dev.: 0.0007) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.55% (0.1281 => 0.1133, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -4.92% (0.3194 => 0.3037, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.35% (0.7198 => 0.6885, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.62% (0.3837 => 0.3698, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.45% (0.3821 => 0.3689, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.43% (0.3057 => 0.2952, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.34% (0.3831 => 0.3703, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.23% (0.3812 => 0.3689, std.dev.: 0.0037) SingleSource/UnitTests/ObjC/exceptions-3: -3.22% (0.3848 => 0.3724, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.22% (0.3880 => 0.3755, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.19% (0.3323 => 0.3217, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: -3.10% (0.6347 => 0.6150, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/synchronized: -3.08% (0.3896 => 0.3776, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/for-in: -3.07% (0.4033 => 0.3909, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.06% (0.3891 => 0.3772, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.92% (2.1713 => 2.1078, std.dev.: 0.0043) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.92% (0.9852 => 0.9564, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -2.90% (2.4924 => 2.4201, std.dev.: 0.0056) SingleSource/UnitTests/ObjC/exceptions: -2.83% (0.4176 => 0.4058, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -2.73% (0.6441 => 0.6265, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/instance-method-metadata: -2.70% (0.3884 => 0.3779, std.dev.: 0.0004) SingleSource/UnitTests/Vector/constpool: -2.43% (20.7746 => 20.2708, std.dev.: 0.0393) MultiSource/Applications/hexxagon/hexxagon: -2.31% (1.3148 => 1.2844, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.11% (0.9542 => 0.9341, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -2.06% (0.7779 => 0.7619, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.99% (0.6484 => 0.6355, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.24% (14.2083 => 14.0327, std.dev.: 0.0187) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.87% (1.8100 => 0.6902, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3147, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.92% (1.3643 => 1.0243, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/methcall: -23.42% (7.5137 => 5.7538, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.04% (0.2274 => 0.1750, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4520, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2055, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.03% (2.5106 => 2.1333, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0924, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.30% (4.9100 => 4.3554, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.74% (0.5142 => 0.4641, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6330, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.76% (0.9021 => 0.8411, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.97% (2.2633 => 2.1734, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.67% (7.9763 => 7.7633, std.dev.: 0.0277) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1201, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.11% (3.7241 => 3.6454, std.dev.: 0.0187) MultiSource/Benchmarks/Bullet/bullet: -2.03% (7.3040 => 7.1557, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.56% (6.5735 => 6.4709, std.dev.: 0.0045) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0052) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.28% (1.6307 => 1.6098, std.dev.: 0.0056) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.26% (1.6086 => 1.5883, std.dev.: 0.0042) SingleSource/Benchmarks/Shootout-C++/ary3: -1.20% (3.7092 => 3.6648, std.dev.: 0.0089) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1782, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0004) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.96s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 12:27:28 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 14:27:28 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130131202728.9E0602A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8154?compare_to=8149&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8154, Order: 174061, Start Time: 2013-01-31 16:52:47, End Time: 2013-01-31 20:27:50 To: 8149, Order: 174052, Start Time: 2013-01-31 12:22:16, End Time: 2013-01-31 15:58:02 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 1 (188 on baseline) Performance Improvements: 2 (21 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1101 (749 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.16% (1.5882 => 1.6066, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -1.61% (2.4231 => 2.3842, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.17% (1.3706 => 1.3545, std.dev.: 0.0054) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.88% (0.0625 => 0.0918, std.dev.: 0.0013) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 36.69% (0.1063 => 0.1453, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 32.00% (0.0475 => 0.0627, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.26% (0.0547 => 0.0718, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.51% (0.0331 => 0.0432, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.27% (0.2969 => 0.3838, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.46% (0.5900 => 0.7579, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.95% (0.4139 => 0.5296, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.85% (0.1106 => 0.1414, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 27.53% (0.4253 => 0.5424, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 27.21% (0.4994 => 0.6353, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.17% (0.0714 => 0.0908, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.62% (0.5000 => 0.6331, std.dev.: 0.0037) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 25.56% (1.5932 => 2.0005, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 25.21% (0.0599 => 0.0750, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.11% (0.1107 => 0.1385, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 25.00% (0.1620 => 0.2025, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.98% (0.1021 => 0.1276, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.97% (0.0897 => 0.1121, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 24.85% (0.1549 => 0.1934, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.32% (0.0584 => 0.0726, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/em3d/em3d: 23.73% (0.0948 => 0.1173, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/04-bisect/bisect: 23.54% (0.0633 => 0.0782, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 23.39% (0.1103 => 0.1361, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.33% (0.1003 => 0.1237, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 23.25% (0.1604 => 0.1977, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.21% (0.0642 => 0.0791, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 23.18% (0.0604 => 0.0744, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 23.06% (0.3903 => 0.4803, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 22.96% (0.3271 => 0.4022, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 22.80% (0.3890 => 0.4777, std.dev.: 0.0020) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 22.74% (0.0541 => 0.0664, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.63% (0.0822 => 0.1008, std.dev.: 0.0000) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 22.51% (0.0582 => 0.0713, std.dev.: 0.0025) MultiSource/Benchmarks/McCat/05-eks/eks: 22.42% (0.1619 => 0.1982, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/health/health: 22.41% (0.0821 => 0.1005, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.35% (0.0452 => 0.0553, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 22.33% (0.1088 => 0.1331, std.dev.: 0.0001) SingleSource/UnitTests/Vector/SSE/sse_isamax: 22.29% (0.0462 => 0.0565, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 22.19% (0.4029 => 0.4923, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 22.16% (1.3152 => 1.6066, std.dev.: 0.0049) MultiSource/Applications/viterbi/viterbi: 21.75% (0.0947 => 0.1153, std.dev.: 0.0020) MultiSource/Benchmarks/McCat/08-main/main: 21.67% (0.1218 => 0.1482, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 21.42% (0.2866 => 0.3480, std.dev.: 0.0015) MultiSource/Applications/aha/aha: 21.21% (0.0481 => 0.0583, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 21.16% (0.0808 => 0.0979, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 20.93% (0.1462 => 0.1768, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/mst/mst: 20.92% (0.0698 => 0.0844, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.87% (0.2736 => 0.3307, std.dev.: 0.0023) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.80% (0.2014 => 0.2433, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 20.73% (0.1505 => 0.1817, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 20.32% (0.5546 => 0.6673, std.dev.: 0.0009) MultiSource/Benchmarks/MallocBench/gs/gs: 20.27% (1.8794 => 2.2604, std.dev.: 0.0041) MultiSource/Applications/hbd/hbd: 20.14% (0.9697 => 1.1650, std.dev.: 0.0033) SingleSource/UnitTests/ObjC++/Hello: 19.96% (0.5826 => 0.6989, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 19.83% (0.0605 => 0.0725, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.76% (0.0572 => 0.0685, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.75% (0.5361 => 0.6420, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 19.69% (0.0513 => 0.0614, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference-object: 19.58% (0.5889 => 0.7042, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.54% (0.4658 => 0.5568, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.41% (0.2875 => 0.3433, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/objinst: 19.38% (0.2823 => 0.3370, std.dev.: 0.0038) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.37% (0.0573 => 0.0684, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/bc/bc: 19.34% (0.3930 => 0.4690, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/except: 19.32% (0.2811 => 0.3354, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/methcall: 19.23% (0.2813 => 0.3354, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/strcat: 19.20% (0.2750 => 0.3278, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.19% (3.5627 => 4.2465, std.dev.: 0.0069) SingleSource/Benchmarks/Shootout-C++/heapsort: 19.09% (0.2792 => 0.3325, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.00% (0.1968 => 0.2342, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.97% (1.6211 => 1.9287, std.dev.: 0.0089) SingleSource/Benchmarks/Shootout-C++/matrix: 18.96% (0.2780 => 0.3307, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bh/bh: 18.93% (0.1284 => 0.1527, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference: 18.90% (0.7171 => 0.8526, std.dev.: 0.0023) MultiSource/Applications/hexxagon/hexxagon: 18.84% (0.9909 => 1.1776, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.81% (0.2738 => 0.3253, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.80% (2.0673 => 2.4560, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/hello: 18.79% (0.2714 => 0.3224, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.76% (0.2911 => 0.3457, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 18.75% (0.2725 => 0.3236, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 18.73% (0.2803 => 0.3328, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.70% (0.5026 => 0.5966, std.dev.: 0.0022) MultiSource/Applications/d/make_dparser: 18.63% (1.0781 => 1.2790, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.50% (0.2729 => 0.3234, std.dev.: 0.0013) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.45% (0.1160 => 0.1374, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.44% (0.1090 => 0.1291, std.dev.: 0.0014) SingleSource/Regression/C++/ofstream_ctor: 18.41% (0.3004 => 0.3557, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 18.40% (0.3195 => 0.3783, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 18.28% (0.3096 => 0.3662, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 18.16% (0.1421 => 0.1679, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 18.12% (0.3267 => 0.3859, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.09% (0.3124 => 0.3689, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 18.07% (0.3060 => 0.3613, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 17.96% (0.3258 => 0.3843, std.dev.: 0.0063) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.86% (0.4361 => 0.5140, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.85% (0.3362 => 0.3962, std.dev.: 0.0120) SingleSource/Benchmarks/Shootout-C++/ary2: 17.82% (0.3317 => 0.3908, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 17.73% (0.3678 => 0.4330, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 17.69% (0.2566 => 0.3020, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/sieve: 17.66% (0.3726 => 0.4384, std.dev.: 0.0002) MultiSource/Applications/ClamAV/clamscan: 17.59% (4.2109 => 4.9514, std.dev.: 0.0304) SingleSource/Benchmarks/Shootout-C++/lists1: 17.57% (0.3477 => 0.4088, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 17.57% (0.3625 => 0.4262, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 17.53% (23.5202 => 27.6428, std.dev.: 0.0471) SingleSource/Benchmarks/Shootout-C++/lists: 17.50% (0.3348 => 0.3934, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.43% (0.3282 => 0.3854, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.42% (1.9694 => 2.3125, std.dev.: 0.0157) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.31% (2.7292 => 3.2017, std.dev.: 0.0081) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.30% (1.9966 => 2.3420, std.dev.: 0.0149) SingleSource/Benchmarks/Shootout-C++/hash: 17.29% (0.4146 => 0.4863, std.dev.: 0.0022) SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.21% (0.2068 => 0.2424, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.09% (4.4195 => 5.1746, std.dev.: 0.0316) SingleSource/Benchmarks/Shootout-C++/hash2: 17.08% (0.4251 => 0.4977, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.91% (0.3981 => 0.4654, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 16.81% (1.4269 => 1.6667, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.75% (0.3690 => 0.4308, std.dev.: 0.0011) MultiSource/Applications/treecc/treecc: 16.36% (0.7875 => 0.9163, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/fftbench: 16.20% (0.3845 => 0.4468, std.dev.: 0.0034) SingleSource/UnitTests/ObjC/instance-method-metadata: 16.06% (0.3488 => 0.4048, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.05% (0.0673 => 0.0781, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 16.02% (0.3465 => 0.4020, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 15.96% (0.5012 => 0.5812, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/for-in: 15.90% (0.3496 => 0.4052, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/exceptions-2: 15.90% (0.3446 => 0.3994, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 15.83% (0.3442 => 0.3987, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.77% (0.3469 => 0.4016, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 15.76% (0.2075 => 0.2402, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 15.70% (0.3650 => 0.4223, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 15.49% (0.3724 => 0.4301, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.49% (0.6435 => 0.7432, std.dev.: 0.0015) SingleSource/UnitTests/ObjC/exceptions: 15.32% (0.3643 => 0.4201, std.dev.: 0.0003) MultiSource/Applications/SPASS/SPASS: 15.27% (5.5417 => 6.3880, std.dev.: 0.0137) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.20% (0.7426 => 0.8555, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 14.98% (0.1028 => 0.1182, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.98% (0.2737 => 0.3147, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 14.84% (0.3498 => 0.4017, std.dev.: 0.0019) MultiSource/Applications/JM/ldecod/ldecod: 14.61% (2.1653 => 2.4816, std.dev.: 0.0097) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 14.46% (0.2691 => 0.3080, std.dev.: 0.0031) MultiSource/Applications/JM/lencod/lencod: 14.42% (4.6177 => 5.2836, std.dev.: 0.0123) MultiSource/Applications/minisat/minisat: 14.42% (0.3336 => 0.3817, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.98% (0.3084 => 0.3515, std.dev.: 0.0008) MultiSource/Benchmarks/mafft/pairlocalalign: 13.90% (2.1013 => 2.3934, std.dev.: 0.0024) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 13.84% (0.2103 => 0.2394, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 13.68% (0.0804 => 0.0914, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.23% (0.1383 => 0.1566, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.19% (0.2040 => 0.2309, std.dev.: 0.0020) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.11% (11.6398 => 13.1652, std.dev.: 0.0172) MultiSource/Applications/siod/siod: 12.63% (0.6634 => 0.7472, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: 12.42% (0.4847 => 0.5449, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 11.21% (0.2391 => 0.2659, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++-EH/spirit: 11.03% (4.6926 => 5.2104, std.dev.: 0.0139) MultiSource/Applications/sqlite3/sqlite3: 10.86% (2.0346 => 2.2555, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.71% (0.5584 => 0.6126, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 8.91% (11.9555 => 13.0212, std.dev.: 0.0129) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.46% (0.3792 => 0.4037, std.dev.: 0.0002) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.68% (29.0505 => 181.4723, std.dev.: 0.0243) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 63.09% (0.2162 => 0.3526, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0299) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.17% (0.5917 => 0.6696, std.dev.: 0.0096) MultiSource/Applications/ClamAV/clamscan: 10.35% (0.2802 => 0.3092, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.94% (0.3693 => 0.4060, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary: 7.12% (0.2122 => 0.2273, std.dev.: 0.0012) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.47% (3.3903 => 3.6097, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/objinst: 5.16% (12.0509 => 12.6726, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/flops: 5.14% (15.4430 => 16.2372, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.69% (79.9355 => 83.6845, std.dev.: 0.0051) SingleSource/Benchmarks/Misc/flops-2: 4.49% (1.8057 => 1.8868, std.dev.: 0.0057) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5019, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/health/health: 2.76% (0.6276 => 0.6449, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: 2.05% (15.8721 => 16.1975, std.dev.: 0.0073) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3058, std.dev.: 0.0041) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.44% (7.1849 => 7.2884, std.dev.: 0.0039) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0826, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.16% (1.0927 => 1.1054, std.dev.: 0.0010) SingleSource/Benchmarks/CoyoteBench/almabench: 1.11% (12.4025 => 12.5396, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.08% (10.3705 => 10.4830, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0008) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.07% (3.1722 => 3.2060, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0014) MultiSource/Applications/lua/lua: 1.04% (50.0626 => 50.5809, std.dev.: 0.0086) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.72% (2.4764 => 2.3842, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.83% (25.4195 => 16.5657, std.dev.: 0.0247) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8691, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.26% (17.2379 => 14.2633, std.dev.: 0.0896) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary2: -7.91% (0.2402 => 0.2212, std.dev.: 0.0045) MultiSource/Applications/hexxagon/hexxagon: -7.71% (28.1477 => 25.9765, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8026, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0013) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -3.81% (14.0481 => 13.5133, std.dev.: 0.0888) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.80% (41.7953 => 40.2059, std.dev.: 0.0145) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -3.54% (11.2080 => 10.8107, std.dev.: 0.0041) MultiSource/Applications/siod/siod: -3.01% (6.9842 => 6.7741, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2264, std.dev.: 0.0815) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.77% (10.7630 => 10.5724, std.dev.: 0.0046) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4987, std.dev.: 0.0008) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (105.3826 => 104.1796, std.dev.: 0.0715) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.05% (16.2163 => 16.0460, std.dev.: 0.0019) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.41s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 12:42:06 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 14:42:06 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131204206.99DA82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8155?compare_to=8151&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8155, Order: 174067, Start Time: 2013-01-31 18:30:06, End Time: 2013-01-31 20:42:28 To: 8151, Order: 174061, Start Time: 2013-01-31 15:46:36, End Time: 2013-01-31 17:59:05 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (232 on baseline) Performance Improvements: 1 (65 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1098 (640 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.66% (10.7976 => 10.9765, std.dev.: 0.0093) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.33% (10.4453 => 10.3063, std.dev.: 0.0055) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: 0.15% (0.1327 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0416 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.37% (0.0707 => 0.0669, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.7909 => 499.8137, std.dev.: 0.0171) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/power/power: 44221.51% (1.1277 => 499.8137, std.dev.: 0.0171) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 226.93% (0.5229 => 1.7095, std.dev.: 0.0022) MultiSource/Applications/SPASS/SPASS: 26.61% (14.9895 => 18.9783, std.dev.: 0.0036) MultiSource/Applications/kimwitu++/kc: 47.76% (14.1553 => 20.9158, std.dev.: 0.0045) MultiSource/Benchmarks/MallocBench/gs/gs: 21.78% (4.1105 => 5.0056, std.dev.: 0.0190) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.64% (1.1048 => 1.7969, std.dev.: 0.0091) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 447.31% (7.1582 => 39.1776, std.dev.: 0.0105) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.74% (3.4629 => 6.6051, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.48% (0.6222 => 1.1416, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10240.69% (0.0720 => 7.4453, std.dev.: 0.0062) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0007) MultiSource/Applications/SPASS/SPASS: 11110900.00% (0.0001 => 11.1110, std.dev.: 0.0338) MultiSource/Applications/kimwitu++/kc: 51800.00% (0.0001 => 0.0519, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0014) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849500.00% (0.0001 => 9.8496, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494600.00% (0.0001 => 5.4947, std.dev.: 0.0060) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 820.70% (1.1194 => 10.3063, std.dev.: 0.0055) MultiSource/Applications/ClamAV/clamscan: 150.83% (22.1758 => 55.6227, std.dev.: 0.0153) SingleSource/Benchmarks/Misc/lowercase: 132.42% (0.0256 => 0.0595, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.01% (0.0929 => 0.1886, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 94.24% (0.0243 => 0.0472, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 80.38% (0.1463 => 0.2639, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 67.81% (0.0730 => 0.1225, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.13% (1.5859 => 2.5078, std.dev.: 0.0070) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.13% (2.9384 => 4.6170, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.14% (7.0540 => 10.9435, std.dev.: 0.0023) MultiSource/Benchmarks/FreeBench/distray/distray: 53.60% (0.1056 => 0.1622, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 50.18% (8.1363 => 12.2192, std.dev.: 0.0485) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.66% (0.0439 => 0.0657, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.91% (2.2024 => 3.2356, std.dev.: 0.0017) MultiSource/Applications/sgefa/sgefa: 45.29% (0.3109 => 0.4517, std.dev.: 0.0005) SingleSource/UnitTests/vla: 45.07% (0.0355 => 0.0515, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 41.69% (0.1432 => 0.2029, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.34% (0.1062 => 0.1501, std.dev.: 0.0003) MultiSource/Applications/JM/lencod/lencod: 40.45% (21.9371 => 30.8096, std.dev.: 0.0049) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.83% (1.5415 => 2.1401, std.dev.: 0.0019) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.96% (4.2646 => 5.8833, std.dev.: 0.0038) SingleSource/Benchmarks/McGill/exptree: 36.73% (0.0814 => 0.1113, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.73% (0.4615 => 0.6310, std.dev.: 0.0019) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.06% (0.5105 => 0.6946, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 36.02% (0.2271 => 0.3089, std.dev.: 0.0022) SingleSource/UnitTests/ObjC/dot-syntax-1: 35.28% (0.0479 => 0.0648, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.25% (0.1892 => 0.2540, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.23% (0.6675 => 0.8960, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/05-eks/eks: 33.78% (0.4299 => 0.5751, std.dev.: 0.0014) MultiSource/Applications/Burg/burg: 33.61% (1.1642 => 1.5555, std.dev.: 0.0081) MultiSource/Benchmarks/NPB-serial/is/is: 32.82% (0.0719 => 0.0955, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.82% (0.0457 => 0.0607, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 32.15% (0.1655 => 0.2187, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.03% (0.0793 => 0.1047, std.dev.: 0.0010) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.56% (0.1125 => 0.1480, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 31.21% (0.1695 => 0.2224, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 30.66% (9.4845 => 12.3927, std.dev.: 0.0082) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.53% (0.1143 => 0.1492, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 30.16% (0.1555 => 0.2024, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.13% (3.8922 => 5.0650, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.62% (0.0746 => 0.0967) MultiSource/Benchmarks/McCat/08-main/main: 29.21% (0.2554 => 0.3300, std.dev.: 0.0013) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.77% (1.4186 => 1.8268, std.dev.: 0.0045) MultiSource/Applications/lemon/lemon: 28.76% (1.0722 => 1.3806, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hash: 28.75% (0.4289 => 0.5522, std.dev.: 0.0054) MultiSource/Applications/minisat/minisat: 28.01% (0.7115 => 0.9108, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.95% (0.0730 => 0.0934, std.dev.: 0.0015) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.82% (0.1337 => 0.1709, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash2: 27.64% (0.4620 => 0.5897, std.dev.: 0.0006) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.52% (0.3121 => 0.3980, std.dev.: 0.0066) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.44% (0.1906 => 0.2429, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.93% (0.0672 => 0.0853, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 26.89% (0.1175 => 0.1491, std.dev.: 0.0019) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.88% (0.1566 => 0.1987, std.dev.: 0.0009) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.55% (0.1032 => 0.1306, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 26.38% (0.1236 => 0.1562, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 26.29% (0.6456 => 0.8153, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.27% (0.5020 => 0.6339, std.dev.: 0.0029) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.24% (0.1029 => 0.1299, std.dev.: 0.0024) MultiSource/Applications/spiff/spiff: 25.95% (0.7835 => 0.9868, std.dev.: 0.0028) SingleSource/Benchmarks/Shootout/hash: 25.77% (0.0485 => 0.0610, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/whetstone: 25.76% (0.0660 => 0.0830) SingleSource/UnitTests/ObjC/messages-2: 25.68% (0.0662 => 0.0832, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/15-trie/trie: 25.43% (0.0527 => 0.0661, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.26% (1.3050 => 1.6346, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.93% (0.2700 => 0.3373, std.dev.: 0.0011) MultiSource/Benchmarks/llubenchmark/llu: 24.89% (0.0462 => 0.0577, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 24.76% (0.0626 => 0.0781, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.68% (0.0871 => 0.1086, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.44% (0.0675 => 0.0840, std.dev.: 0.0010) MultiSource/Applications/aha/aha: 24.33% (0.1151 => 0.1431, std.dev.: 0.0015) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.13% (0.0953 => 0.1183, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 24.06% (1.1840 => 1.4689, std.dev.: 0.0042) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.99% (0.0842 => 0.1044, std.dev.: 0.0009) MultiSource/Applications/d/make_dparser: 23.84% (3.3354 => 4.1304, std.dev.: 0.0089) MultiSource/Benchmarks/Olden/em3d/em3d: 23.83% (0.1695 => 0.2099, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 23.82% (0.1163 => 0.1440, std.dev.: 0.0030) SingleSource/Benchmarks/Stanford/Towers: 23.78% (0.0471 => 0.0583, std.dev.: 0.0007) MultiSource/Applications/oggenc/oggenc: 23.59% (5.7591 => 7.1176, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.54% (0.8172 => 1.0096, std.dev.: 0.0138) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.47% (0.3307 => 0.4083, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.40% (0.5860 => 0.7231, std.dev.: 0.0043) MultiSource/Benchmarks/Ptrdist/ft/ft: 23.25% (0.1940 => 0.2391, std.dev.: 0.0016) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.91% (0.0886 => 0.1089, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/matrix: 22.82% (0.3098 => 0.3805, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 22.80% (0.0443 => 0.0544, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/bisort/bisort: 22.64% (0.0614 => 0.0753, std.dev.: 0.0016) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.55% (4.9449 => 6.0599, std.dev.: 0.0106) MultiSource/Benchmarks/BitBench/five11/five11: 22.40% (0.0567 => 0.0694, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.38% (0.1510 => 0.1848, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/ReedSolomon: 22.25% (0.2049 => 0.2505, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 22.17% (0.8921 => 1.0899, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.12% (0.5569 => 0.6801, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/loader/loader: 22.04% (0.2758 => 0.3366, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.97% (0.0528 => 0.0644) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.97% (0.1584 => 0.1932, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.90% (5.0018 => 6.0974, std.dev.: 0.0068) MultiSource/Benchmarks/BitBench/uuencode/uuencode: 21.84% (0.0467 => 0.0569, std.dev.: 0.0008) MultiSource/Applications/treecc/treecc: 21.81% (2.0273 => 2.4694, std.dev.: 0.0020) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.36% (1.1861 => 1.4394, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.31% (0.9765 => 1.1846, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/18-imp/imp: 21.24% (0.3423 => 0.4150, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.13% (0.6450 => 0.7813, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.13% (0.1117 => 0.1353, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 20.93% (0.7433 => 0.8989, std.dev.: 0.0010) SingleSource/UnitTests/SignlessTypes/rem: 20.89% (0.1144 => 0.1383, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 20.88% (3.8723 => 4.6810, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.88% (0.2107 => 0.2547, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.77% (0.0491 => 0.0593, std.dev.: 0.0018) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.68% (0.0648 => 0.0782, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.68% (0.2065 => 0.2492, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.52% (0.0770 => 0.0928, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/health/health: 20.50% (0.1268 => 0.1528, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.38% (0.0834 => 0.1004, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.26% (0.0933 => 0.1122, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/perlin: 19.96% (0.0536 => 0.0643, std.dev.: 0.0000) MultiSource/Applications/siod/siod: 19.92% (2.2969 => 2.7544, std.dev.: 0.0026) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.74% (0.0770 => 0.0922, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.65% (0.8101 => 0.9693, std.dev.: 0.0058) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.56% (0.4203 => 0.5025, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 19.43% (0.0633 => 0.0756, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.36% (0.5981 => 0.7139, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 19.13% (0.2603 => 0.3101, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.95% (0.3441 => 0.4093, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.58% (0.1044 => 0.1238, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 18.46% (0.3283 => 0.3889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/matrix: 18.09% (0.0818 => 0.0966, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary: 18.01% (0.3232 => 0.3814, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 17.90% (0.0704 => 0.0830, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: 17.74% (0.0592 => 0.0697, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/09-vor/vor: 17.74% (0.3180 => 0.3744, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.59% (0.8067 => 0.9486, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 17.30% (0.3387 => 0.3973, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 17.08% (0.4636 => 0.5428, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/ary2: 16.75% (0.3379 => 0.3945, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.56% (0.3865 => 0.4505, std.dev.: 0.0009) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.99% (0.0838 => 0.0972, std.dev.: 0.0010) MultiSource/Applications/hbd/hbd: 15.69% (1.5603 => 1.8051, std.dev.: 0.0079) MultiSource/Applications/sqlite3/sqlite3: 15.55% (17.1811 => 19.8525, std.dev.: 0.0105) SingleSource/Regression/C++/ofstream_ctor: 15.42% (0.2905 => 0.3353, std.dev.: 0.0056) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.94% (0.4103 => 0.4716, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/moments: 14.82% (0.4048 => 0.4648, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/parameter-passing: 14.69% (0.3927 => 0.4504, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: 14.58% (0.3422 => 0.3921, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 14.39% (0.3684 => 0.4214, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: 14.28% (0.3886 => 0.4441, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sieve: 14.24% (0.3603 => 0.4116, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 13.95% (0.3282 => 0.3740, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.91% (0.0798 => 0.0909, std.dev.: 0.0038) MultiSource/Benchmarks/Olden/bh/bh: 13.75% (0.3092 => 0.3517, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.58% (0.4064 => 0.4616, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.45% (0.3427 => 0.3888, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/exceptions: 13.43% (0.3828 => 0.4342, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.38% (0.1114 => 0.1263, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/for-in: 13.37% (0.3694 => 0.4188, std.dev.: 0.0007) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.29% (0.2430 => 0.2753, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.20% (14.3668 => 16.2638, std.dev.: 0.0155) SingleSource/UnitTests/ObjC/trivial-interface: 13.19% (0.3473 => 0.3931, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 13.17% (0.3826 => 0.4330, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 13.14% (0.3561 => 0.4029, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 13.12% (0.3543 => 0.4008, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 13.05% (0.3516 => 0.3975, std.dev.: 0.0029) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.98% (0.3543 => 0.4003, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-2: 12.90% (0.3497 => 0.3948, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 12.30% (0.1268 => 0.1424, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/strcat: 11.90% (0.2831 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/except: 11.29% (0.2871 => 0.3195, std.dev.: 0.0006) MultiSource/Applications/hexxagon/hexxagon: 11.28% (1.2842 => 1.4291, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.03% (2.0665 => 2.2945, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.72% (0.3935 => 0.4357, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.66% (0.3162 => 0.3499, std.dev.: 0.0012) SingleSource/UnitTests/ObjC++/property-reference: 10.65% (0.7326 => 0.8106, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/methcall: 10.64% (0.2877 => 0.3183, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference-object: 10.61% (0.6030 => 0.6670, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 10.51% (0.5925 => 0.6548, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/ackermann: 10.45% (0.2756 => 0.3044, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.38% (0.3650 => 0.4029, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/nestedloop: 10.35% (0.2793 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 10.17% (0.2725 => 0.3002, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.10% (0.2891 => 0.3183, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 10.09% (63.2438 => 69.6225, std.dev.: 0.0362) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.03% (0.1625 => 0.1788, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/wc: 9.80% (0.3052 => 0.3351, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.71% (0.2872 => 0.3151, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/random: 9.64% (0.2802 => 0.3072, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/hello: 9.47% (0.2714 => 0.2971, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.22% (0.3136 => 0.3425, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.95% (0.1330 => 0.1449, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.70% (2.2022 => 2.3937, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.37% (0.3177 => 0.3443, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.16% (0.2266 => 0.2451, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.97% (0.4879 => 0.5268, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.51% (0.1438 => 0.1546, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: 5.88% (10.3673 => 10.9765, std.dev.: 0.0093) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.53% (0.3817 => 0.4028, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.24% (0.3131 => 0.3295, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.18% (7.9617 => 8.2947, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8956, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3120, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.92% (32.5116 => 59.4708, std.dev.: 0.0087) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.08% (1.1145 => 1.2937, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 15.80% (6.6465 => 7.6968, std.dev.: 0.0014) SingleSource/Regression/C/uint64_to_float: 13.01% (0.5413 => 0.6117, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.13% (1.1396 => 1.2437, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.91% (11.6436 => 12.4487, std.dev.: 0.0502) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.07% (4.2280 => 4.4425, std.dev.: 0.0165) SingleSource/Benchmarks/Shootout-C++/hash2: 4.86% (3.1578 => 3.3113, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/ffbench: 4.10% (0.9505 => 0.9895, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.77% (0.3316 => 0.3441, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.75% (0.4162 => 0.4318, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.45% (2.0360 => 2.1062, std.dev.: 0.0156) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.94% (0.9957 => 1.0250, std.dev.: 0.0046) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.49% (8.6802 => 8.8961, std.dev.: 0.0135) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.48% (1.0313 => 1.0569, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.24% (3.6395 => 3.7210, std.dev.: 0.0075) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960, std.dev.: 0.0001) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/bisort/bisort: 1.86% (0.8333 => 0.8488, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.83% (1.7254 => 1.7569, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2807, std.dev.: 0.0155) MultiSource/Benchmarks/mafft/pairlocalalign: 1.68% (27.8444 => 28.3133, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/tsp/tsp: 1.44% (1.0785 => 1.0940, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.09% (10.3460 => 10.4587, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1481, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1777, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/salsa20: -74.82% (0.8651 => 0.2178, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: -42.11% (0.1622 => 0.0939, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.51% (5.3855 => 4.4963, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.76% (5.3526 => 4.5092, std.dev.: 0.0072) MultiSource/Applications/JM/ldecod/ldecod: -11.46% (10.4361 => 9.2401, std.dev.: 0.0047) SingleSource/UnitTests/Vector/constpool: -7.74% (54.1659 => 49.9708, std.dev.: 0.0235) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.04% (1.7609 => 1.6370, std.dev.: 0.0030) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.88% (1.9577 => 0.6484, std.dev.: 0.0138) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.11% (0.6962 => 0.3404, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206, std.dev.: 0.0023) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.07% (4.5009 => 2.5622, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -42.04% (0.0628 => 0.0364, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/lowercase: -34.07% (8.0499 => 5.3073, std.dev.: 0.0023) SingleSource/Benchmarks/Misc/mandel-2: -33.47% (1.5373 => 1.0228, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/mandel: -33.41% (1.1492 => 0.7653, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: -30.64% (10.7105 => 7.4289, std.dev.: 0.0123) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1395, std.dev.: 0.0029) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.41% (2.6546 => 2.0065, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3250, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.71% (0.2161 => 0.1735, std.dev.: 0.0016) MultiSource/Applications/sgefa/sgefa: -19.17% (0.6223 => 0.5030) SingleSource/UnitTests/Vector/multiplies: -16.70% (2.5528 => 2.1264, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.61% (1.6925 => 1.4283, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7341, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.11% (0.9540 => 0.8385, std.dev.: 0.0014) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4930, std.dev.: 0.0015) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0012) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.93% (1.8329 => 1.7059, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4821, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0013) SingleSource/Benchmarks/McGill/chomp: -6.63% (1.2373 => 1.1553, std.dev.: 0.0045) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.60% (19.9488 => 18.6319, std.dev.: 0.0801) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.69% (8.1563 => 7.6919, std.dev.: 0.0135) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5868, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5788, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/flops-5: -4.70% (1.5835 => 1.5090, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/salsa20: -4.70% (10.2830 => 9.7994, std.dev.: 0.0068) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.51% (0.4808 => 0.4591, std.dev.: 0.0011) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6761, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3288, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.42% (3.6994 => 3.6470, std.dev.: 0.0203) SingleSource/Benchmarks/Shootout-C++/ary3: -1.41% (3.7221 => 3.6696, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/hash: -1.05% (4.9088 => 4.8573, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout/lists: -1.00% (6.2999 => 6.2366, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.51% (0.1485 => 0.1329, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.38% (0.2116 => 0.0669, std.dev.: 0.0030) Report Time: 1.53s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 12:47:25 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 14:47:25 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131204725.8B9AA2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8156?compare_to=8152&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8156, Order: 174073, Start Time: 2013-01-31 18:40:29, End Time: 2013-01-31 20:47:50 To: 8152, Order: 174061, Start Time: 2013-01-31 16:15:01, End Time: 2013-01-31 18:20:33 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 24 (83 on baseline) Performance Improvements: 0 (47 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1040 (933 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.61% (0.1521 => 0.1728, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 13.24% (1.2703 => 1.4385, std.dev.: 0.0380) MultiSource/Benchmarks/Bullet/bullet: 9.97% (34.1582 => 37.5647, std.dev.: 1.2201) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 9.46% (1.3461 => 1.4735, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 9.38% (1.4796 => 1.6184, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.20% (1.3084 => 1.4288, std.dev.: 0.0354) MultiSource/Benchmarks/7zip/7zip-benchmark: 8.35% (45.6019 => 49.4105, std.dev.: 0.7362) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 7.79% (1.3346 => 1.4386, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.63% (1.3012 => 1.3875, std.dev.: 0.0306) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.07% (0.2125 => 0.2254, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.94% (1.3756 => 1.4573, std.dev.: 0.0275) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.88% (0.3624 => 0.3837, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 3.91% (1.0856 => 1.1280, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.60% (2.0303 => 2.0831, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 2.28% (1.6300 => 1.6671, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 2.13% (0.8987 => 0.9178, std.dev.: 0.0048) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/ary3: 49.42% (8.1179 => 12.1301, std.dev.: 0.5423) SingleSource/Benchmarks/Shootout/heapsort: 15.37% (3.1608 => 3.6466, std.dev.: 0.1216) MultiSource/Benchmarks/Bullet/bullet: 7.07% (7.0673 => 7.5672, std.dev.: 0.0143) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.82% (13.5413 => 14.3300, std.dev.: 0.2879) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.23% (5.9650 => 6.2175, std.dev.: 0.0587) SingleSource/Benchmarks/Shootout/matrix: 3.02% (7.0252 => 7.2374, std.dev.: 0.0334) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.82% (4.7920 => 4.8793, std.dev.: 0.0246) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.80% (1.8406 => 1.8738, std.dev.: 0.0117) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 0.23% (1.2494 => 1.2523, std.dev.: 0.2075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.43% (0.0230 => 0.0254, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.53% (0.0434 => 0.0458, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.69% (0.0344 => 0.0367, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.48% (0.0321 => 0.0345, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 6.80% (0.0441 => 0.0471, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: 6.67% (0.0210 => 0.0224, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 5.24% (0.0229 => 0.0241, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.99% (0.0251 => 0.0246, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: 4.64% (0.1445 => 0.1512, std.dev.: 0.0307) MultiSource/Applications/lemon/lemon: 0.80% (1.2305 => 1.2403, std.dev.: 0.3004) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.05% (0.4018 => 0.4060, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.79% (0.1538 => 0.1449, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 14.17% (0.0614 => 0.0701, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.68% (0.0269 => 0.0208, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.61% (0.0607 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -2.13% (1.3139 => 1.2859, std.dev.: 0.0455) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 11.76% (0.0017 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0612 => 0.0610, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 27.93% (0.0290 => 0.0371, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.18% (1.7445 => 1.7650, std.dev.: 0.0627) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -60.33% (0.0121 => 0.0048, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: -100.00% (0.0001 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.57% (33.8231 => 33.2914, std.dev.: 0.5401) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 397.92% (0.0336 => 0.1673, std.dev.: 0.0376) SingleSource/Regression/C/sumarraymalloc: 118.77% (0.0293 => 0.0641, std.dev.: 0.0119) SingleSource/Regression/C/sumarray2d: 89.05% (0.0274 => 0.0518, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 61.16% (0.8926 => 1.4385, std.dev.: 0.0380) SingleSource/Regression/C/sumarray: 61.13% (0.0265 => 0.0427, std.dev.: 0.0015) MultiSource/Benchmarks/FreeBench/neural/neural: 59.34% (0.1638 => 0.2610, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 57.21% (0.9061 => 1.4245, std.dev.: 0.0570) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 56.95% (0.8893 => 1.3958, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 54.07% (0.9564 => 1.4735, std.dev.: 0.0269) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 52.14% (0.9120 => 1.3875, std.dev.: 0.0306) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 51.82% (0.9091 => 1.3802, std.dev.: 0.0631) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 51.65% (0.9422 => 1.4288, std.dev.: 0.0354) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 50.08% (0.9612 => 1.4426, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 49.29% (0.9381 => 1.4005, std.dev.: 0.0808) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 48.93% (1.0867 => 1.6184, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 48.48% (0.9403 => 1.3962, std.dev.: 0.1739) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 48.00% (0.9512 => 1.4078, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 47.87% (0.9855 => 1.4573, std.dev.: 0.0275) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 46.45% (0.9588 => 1.4042, std.dev.: 0.0484) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 44.67% (0.8990 => 1.3006, std.dev.: 0.1018) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 44.25% (1.0052 => 1.4500, std.dev.: 0.0371) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 43.74% (0.9998 => 1.4371, std.dev.: 0.0260) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 43.62% (1.0017 => 1.4386, std.dev.: 0.0084) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 43.23% (1.0119 => 1.4493, std.dev.: 0.0780) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 41.40% (0.9010 => 1.2740, std.dev.: 0.0329) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 40.70% (0.8732 => 1.2286, std.dev.: 0.0541) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 39.86% (0.8912 => 1.2464, std.dev.: 0.0545) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 39.46% (0.8736 => 1.2183, std.dev.: 0.0895) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 38.29% (0.8846 => 1.2233, std.dev.: 0.0562) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 36.99% (0.9867 => 1.3517, std.dev.: 0.0970) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 36.42% (0.9488 => 1.2944, std.dev.: 0.0750) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 36.15% (0.9788 => 1.3326, std.dev.: 0.1207) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 36.04% (0.9507 => 1.2933, std.dev.: 0.0885) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.66% (0.9993 => 1.3557, std.dev.: 0.0463) SingleSource/Benchmarks/Stanford/IntMM: 35.27% (0.0431 => 0.0583, std.dev.: 0.0022) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 35.20% (1.0088 => 1.3639, std.dev.: 0.1019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 33.92% (0.9127 => 1.2223, std.dev.: 0.0460) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.87% (0.9550 => 1.2498, std.dev.: 0.0794) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 29.15% (1.0860 => 1.4026, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 20.87% (0.0738 => 0.0892, std.dev.: 0.0027) MultiSource/Applications/sgefa/sgefa: 20.12% (0.3598 => 0.4322, std.dev.: 0.0274) MultiSource/Benchmarks/mafft/pairlocalalign: 16.48% (9.5202 => 11.0894, std.dev.: 0.3361) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.48% (3.6295 => 4.2276, std.dev.: 0.2164) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 16.26% (1.0986 => 1.2772, std.dev.: 0.0448) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.97% (0.1240 => 0.1438, std.dev.: 0.0022) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 15.42% (0.5369 => 0.6197, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/ReedSolomon: 13.46% (0.2050 => 0.2326, std.dev.: 0.0032) MultiSource/Benchmarks/Bullet/bullet: 13.00% (33.2440 => 37.5647, std.dev.: 1.2201) SingleSource/UnitTests/Vectorizer/gcc-loops: 12.79% (0.4596 => 0.5184, std.dev.: 0.0114) MultiSource/Benchmarks/7zip/7zip-benchmark: 11.91% (44.1538 => 49.4105, std.dev.: 0.7362) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.69% (1.8651 => 2.0831, std.dev.: 0.0074) MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.12% (5.0381 => 5.5983, std.dev.: 0.1640) SingleSource/Benchmarks/McGill/chomp: 11.10% (0.1793 => 0.1992, std.dev.: 0.0059) SingleSource/Benchmarks/Linpack/linpack-pc: 10.41% (0.2566 => 0.2833, std.dev.: 0.0043) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.48% (0.1274 => 0.1382, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 5.13% (0.2144 => 0.2254, std.dev.: 0.0028) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.31% (0.4762 => 0.4872, std.dev.: 0.0017) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107312.50% (0.0008 => 0.8593, std.dev.: 0.0207) SingleSource/Benchmarks/Shootout/ary3: 443.85% (2.2304 => 12.1301, std.dev.: 0.5423) SingleSource/Benchmarks/Shootout/matrix: 357.34% (1.5825 => 7.2374, std.dev.: 0.0334) MultiSource/Applications/sgefa/sgefa: 257.38% (0.3515 => 1.2562, std.dev.: 0.0019) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.13% (1.1825 => 4.0575, std.dev.: 0.0035) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.63% (4.8185 => 15.9797, std.dev.: 0.0159) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 225.00% (0.0228 => 0.0741, std.dev.: 0.0093) SingleSource/Benchmarks/Shootout-C++/ary2: 187.60% (0.0129 => 0.0371, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 113.36% (0.0232 => 0.0495, std.dev.: 0.0047) SingleSource/Benchmarks/Shootout-C++/matrix: 65.58% (2.9083 => 4.8155, std.dev.: 0.0350) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.57% (0.2562 => 0.3422, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 32.13% (3.1254 => 4.1297, std.dev.: 0.0549) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 28.45% (1.4588 => 1.8738, std.dev.: 0.0117) SingleSource/Regression/C/uint64_to_float: 24.46% (1.5397 => 1.9163, std.dev.: 0.0085) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.26% (5.6033 => 6.9067, std.dev.: 0.2149) SingleSource/Benchmarks/Misc/salsa20: 21.93% (7.4497 => 9.0833, std.dev.: 0.0952) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.50% (4.8112 => 5.7977, std.dev.: 0.1887) MultiSource/Applications/JM/lencod/lencod: 13.94% (6.8159 => 7.7658, std.dev.: 0.0941) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.72% (5.1752 => 5.8852, std.dev.: 0.0457) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.31% (5.0033 => 5.6693, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.71% (3.6477 => 3.9653, std.dev.: 0.1083) SingleSource/Benchmarks/Misc/ReedSolomon: 8.29% (8.6447 => 9.3617, std.dev.: 0.0348) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.04% (4.7473 => 5.0815, std.dev.: 0.0559) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (0.6211 => 0.6560, std.dev.: 0.0114) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.18% (5.9115 => 6.2175, std.dev.: 0.0587) MultiSource/Benchmarks/Bullet/bullet: 5.04% (7.2040 => 7.5672, std.dev.: 0.0143) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -39.36% (0.0808 => 0.0490, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.12% (0.0727 => 0.0508, std.dev.: 0.0022) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.17% (0.0692 => 0.0504, std.dev.: 0.0009) SingleSource/Benchmarks/SmallPT/smallpt: -24.47% (0.1888 => 0.1426, std.dev.: 0.0037) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.93% (0.0676 => 0.0548, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.21% (0.1684 => 0.1411, std.dev.: 0.0082) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -14.92% (0.1079 => 0.0918, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -12.22% (0.7686 => 0.6747, std.dev.: 0.0108) MultiSource/Applications/spiff/spiff: -10.20% (1.0220 => 0.9178, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.14% (0.7693 => 0.7067, std.dev.: 0.0073) MultiSource/Benchmarks/SciMark2-C/scimark2: -5.82% (0.4074 => 0.3837, std.dev.: 0.0058) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.90% (1.1498 => 1.1280, std.dev.: 0.0023) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.77% (11.5523 => 3.9540, std.dev.: 0.0818) SingleSource/Benchmarks/Misc/fp-convert: -62.13% (15.6525 => 5.9281, std.dev.: 0.2058) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.91% (0.4146 => 0.1828, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.34% (0.4578 => 0.2365, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.50% (11.3868 => 6.4339, std.dev.: 0.1623) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.94% (5.4023 => 3.6226, std.dev.: 0.0288) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -30.73% (0.4452 => 0.3084, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.21% (0.5495 => 0.4000, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.27% (5.2605 => 3.8785, std.dev.: 0.0217) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.28% (0.5826 => 0.4353, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -24.63% (4.4467 => 3.3517, std.dev.: 0.0406) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -24.33% (0.5897 => 0.4462, std.dev.: 0.0464) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.37% (4.9921 => 3.8256, std.dev.: 0.0461) SingleSource/Benchmarks/Shootout/heapsort: -18.49% (4.4739 => 3.6466, std.dev.: 0.1216) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.59% (7.0016 => 5.7700, std.dev.: 0.3214) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.96% (5.8755 => 4.8793, std.dev.: 0.0246) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.08% (16.6791 => 14.3300, std.dev.: 0.2879) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.89% (0.1164 => 0.1014, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -12.75% (3.1921 => 2.7850, std.dev.: 0.0150) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.73% (5.3626 => 4.6802, std.dev.: 0.0373) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.47% (9.7992 => 8.5777, std.dev.: 0.0204) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -11.90% (5.7056 => 5.0267, std.dev.: 0.0451) MultiSource/Benchmarks/mafft/pairlocalalign: -9.20% (63.1520 => 57.3413, std.dev.: 0.3242) SingleSource/Benchmarks/Shootout/hash: -8.39% (4.5259 => 4.1464, std.dev.: 0.1206) MultiSource/Applications/SIBsim4/SIBsim4: -7.74% (3.5443 => 3.2699, std.dev.: 0.0606) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.79% (4.2843 => 3.9934, std.dev.: 0.0553) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.55% (5.5974 => 5.2308, std.dev.: 0.0165) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.61% (4.5424 => 4.2877, std.dev.: 0.0342) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -5.44% (4.9799 => 4.7088, std.dev.: 0.0700) SingleSource/Benchmarks/McGill/queens: -5.31% (1.7443 => 1.6517, std.dev.: 0.0089) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.10% (3.5691 => 3.4584, std.dev.: 0.0197) MultiSource/Applications/spiff/spiff: -1.74% (2.8571 => 2.8075, std.dev.: 0.0034) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.59% (85.3042 => 83.9514, std.dev.: 0.0753) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.32% (8.8249 => 8.7084, std.dev.: 0.0305) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.08% (3.7450 => 3.7044, std.dev.: 0.0033) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 3.95% (1.2047 => 1.2523, std.dev.: 0.2075) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 9.01% (0.0233 => 0.0254, std.dev.: 0.0051) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 1.55% (0.0451 => 0.0458, std.dev.: 0.0136) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.85% (0.0394 => 0.0367, std.dev.: 0.0086) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.18% (0.0328 => 0.0345, std.dev.: 0.0093) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 5.84% (0.0445 => 0.0471, std.dev.: 0.0105) SingleSource/UnitTests/Vector/Altivec/casts: 5.16% (0.0213 => 0.0224, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/test1: 6.17% (0.0227 => 0.0241, std.dev.: 0.0063) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.53% (0.0255 => 0.0246, std.dev.: 0.0025) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -1.18% (0.1530 => 0.1512, std.dev.: 0.0307) MultiSource/Applications/lemon/lemon: -35.71% (1.9293 => 1.2403, std.dev.: 0.3004) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 0.27% (0.4049 => 0.4060, std.dev.: 0.0296) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -4.04% (0.1510 => 0.1449, std.dev.: 0.0101) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.32% (0.0978 => 0.0701, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -24.64% (0.0276 => 0.0208, std.dev.: 0.0054) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.86% (0.0590 => 0.0579, std.dev.: 0.0018) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.69% (1.1617 => 1.2859, std.dev.: 0.0455) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -40.63% (0.0032 => 0.0019, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: - (0.0610 => 0.0610, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 38.43% (0.0268 => 0.0371, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 137.33% (0.7437 => 1.7650, std.dev.: 0.0627) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -47.83% (0.0092 => 0.0048, std.dev.: 0.0034) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 160.53% (12.7781 => 33.2914, std.dev.: 0.5401) Report Time: 0.78s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 13:44:46 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 15:44:46 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131214446.76DF32A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8157?compare_to=8153&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8157, Order: 174077, Start Time: 2013-01-31 20:10:52, End Time: 2013-01-31 21:45:10 To: 8153, Order: 174067, Start Time: 2013-01-31 18:13:15, End Time: 2013-01-31 19:47:17 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (123 on baseline) Performance Improvements: 0 (85 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (884 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 80.36% (0.0280 => 0.0505, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 71.21% (0.0514 => 0.0880, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.99% (0.0717 => 0.1226, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 66.63% (0.0974 => 0.1623, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 46.53% (0.1500 => 0.2198, std.dev.: 0.0003) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.76% (0.1132 => 0.1616, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.90% (0.0599 => 0.0838, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.30% (0.6395 => 0.8844, std.dev.: 0.0005) SingleSource/Benchmarks/Stanford/IntMM: 38.04% (0.0418 => 0.0577, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.59% (0.6395 => 0.8735, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.10% (0.5688 => 0.7571, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.06% (0.5456 => 0.7260, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.04% (0.5805 => 0.7723, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.84% (0.6260 => 0.8316, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.40% (0.5849 => 0.7744, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.36% (0.6230 => 0.8246, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.25% (0.5575 => 0.7373, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.23% (0.5567 => 0.7361, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.11% (0.5581 => 0.7373, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.45% (0.5802 => 0.7627, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.13% (1.6474 => 2.1603, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.11% (0.5705 => 0.7480, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.82% (0.5941 => 0.7772, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.56% (0.5857 => 0.7647, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.50% (0.5570 => 0.7269, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.49% (0.5569 => 0.7267, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.43% (0.5478 => 0.7145, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.38% (0.6033 => 0.7866, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.36% (0.5859 => 0.7638, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.03% (0.5591 => 0.7270, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.72% (0.6440 => 0.8354, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.32% (0.5925 => 0.7662, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.10% (0.6189 => 0.7990, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.85% (0.6676 => 0.8602, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.74% (0.5863 => 0.7548, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.47% (0.6304 => 0.8099, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.40% (0.6052 => 0.7771, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.20% (0.6446 => 0.8264, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.66% (0.6194 => 0.7907, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.65% (0.6681 => 0.8528, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.37% (0.6660 => 0.8483, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.85% (0.6297 => 0.7988, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.95% (0.0582 => 0.0733, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 25.46% (0.0699 => 0.0877, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.45% (0.6667 => 0.8364, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.55% (0.7524 => 0.9371, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 23.76% (2.2587 => 2.7953, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.59% (0.7339 => 0.9070, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.54% (0.0790 => 0.0976, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.51% (0.0693 => 0.0849, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.35% (0.0622 => 0.0761, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.40% (0.0634 => 0.0757, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.24% (0.0556 => 0.0663, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 19.00% (0.0621 => 0.0739, std.dev.: 0.0013) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.73% (0.0566 => 0.0672, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.13% (0.0833 => 0.0984, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.71% (0.1146 => 0.1349, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 17.31% (0.3357 => 0.3938, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.18% (0.0680 => 0.0790, std.dev.: 0.0011) MultiSource/Applications/lemon/lemon: 15.82% (1.1450 => 1.3261, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.26% (0.1081 => 0.1246, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.47% (0.1982 => 0.2249, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.30% (4.5069 => 5.1062, std.dev.: 0.0037) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.94% (0.4916 => 0.5552, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.81% (1.6364 => 1.8461, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.41% (3.5339 => 3.9726, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/05-eks/eks: 12.40% (0.4515 => 0.5075, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 12.15% (0.0864 => 0.0969, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.24% (0.2385 => 0.2653, std.dev.: 0.0000) SingleSource/UnitTests/2006-12-11-LoadConstants: 10.98% (0.1230 => 0.1365, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 10.52% (9.2283 => 10.1991, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.53% (0.1731 => 0.1896, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 9.44% (0.5329 => 0.5832, std.dev.: 0.0099) MultiSource/Applications/Burg/burg: 9.16% (1.2515 => 1.3661, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/hash: 9.15% (0.4524 => 0.4938, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.03% (0.7021 => 0.7655, std.dev.: 0.0005) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.90% (0.2001 => 0.2179, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.43% (1.2784 => 1.3862, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/hash2: 8.29% (0.4861 => 0.5264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.90% (1.4642 => 1.5798, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/bigfib: 7.08% (0.6750 => 0.7228, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.13% (5.4682 => 5.8036, std.dev.: 0.0133) SingleSource/Benchmarks/Misc/ReedSolomon: 6.12% (0.1879 => 0.1994, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 6.11% (0.3255 => 0.3454, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.57% (0.3319 => 0.3504, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.88% (22.4056 => 23.4987, std.dev.: 0.0033) MultiSource/Applications/spiff/spiff: 4.22% (0.8418 => 0.8773, std.dev.: 0.0009) MultiSource/Applications/SPASS/SPASS: 4.01% (15.5079 => 16.1298, std.dev.: 0.0143) MultiSource/Applications/SIBsim4/SIBsim4: 3.92% (1.3864 => 1.4408, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: 3.92% (0.7447 => 0.7739, std.dev.: 0.0002) MultiSource/Applications/oggenc/oggenc: 3.89% (5.0226 => 5.2179, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.64% (0.9557 => 0.9905, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 3.51% (0.3446 => 0.3567, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.07% (0.4427 => 0.4563, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.63% (0.5168 => 0.5304, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.52% (1.3722 => 1.4068, std.dev.: 0.0129) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 1.94% (0.6293 => 0.6415, std.dev.: 0.0003) MultiSource/Applications/kimwitu++/kc: 1.88% (18.2933 => 18.6367, std.dev.: 0.0057) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.80% (1.2300 => 1.2522, std.dev.: 0.0020) MultiSource/Applications/treecc/treecc: 1.60% (2.1401 => 2.1744, std.dev.: 0.0043) MultiSource/Benchmarks/Bullet/bullet: 1.58% (34.0927 => 34.6328, std.dev.: 0.0180) MultiSource/Applications/d/make_dparser: 1.57% (3.5154 => 3.5707, std.dev.: 0.0019) MultiSource/Benchmarks/nbench/nbench: 1.21% (1.1530 => 1.1669, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (4.0323 => 4.0793, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.09% (4.8161 => 4.8688, std.dev.: 0.0075) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.88% (31.3723 => 55.8052, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.69% (0.9531 => 1.0264, std.dev.: 0.0044) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.07% (1.2783 => 1.3687, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1480, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.62% (54.5751 => 56.5492, std.dev.: 0.0937) SingleSource/Benchmarks/Misc-C++/bigfib: 3.09% (0.3328 => 0.3431, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.59% (2.0478 => 2.1009, std.dev.: 0.0055) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3031, std.dev.: 0.0023) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.60% (18.2231 => 18.5138, std.dev.: 0.0045) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.44% (5.1955 => 5.2702, std.dev.: 0.0007) MultiSource/Applications/sqlite3/sqlite3: 1.41% (4.5320 => 4.5957, std.dev.: 0.0049) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.71% (0.1281 => 0.1131, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: -4.73% (0.3194 => 0.3043, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.11% (0.7198 => 0.6902, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.43% (0.3821 => 0.3690, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.31% (0.3837 => 0.3710, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.07% (0.9852 => 0.9550, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.99% (0.3812 => 0.3698, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -2.90% (0.3831 => 0.3720, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: -2.86% (0.3880 => 0.3769, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -2.84% (2.4924 => 2.4217, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -2.81% (0.3848 => 0.3740, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.80% (0.3896 => 0.3787, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/Hello: -2.73% (0.6347 => 0.6174, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/for-in: -2.70% (0.4033 => 0.3924, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.70% (0.3891 => 0.3786, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: -2.62% (0.6441 => 0.6272, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/exceptions: -2.51% (0.4176 => 0.4071, std.dev.: 0.0025) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.45% (2.1713 => 2.1182, std.dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -2.39% (20.7746 => 20.2780, std.dev.: 0.0242) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.34% (0.9542 => 0.9319, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.21% (0.6484 => 0.6341, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.16% (1.3148 => 1.2864, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference: -1.65% (0.7779 => 0.7651, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.34% (14.2083 => 14.0172, std.dev.: 0.0150) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.85% (1.8100 => 0.6906, std.dev.: 0.0129) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3967, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.68% (0.1622 => 0.1027, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -33.96% (8.0445 => 5.3125, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2493, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/mandel-2: -24.75% (1.3643 => 1.0267, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/methcall: -23.43% (7.5137 => 5.7531, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4563, std.dev.: 0.0018) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5895, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -22.35% (0.0756 => 0.0587, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.89% (4.1024 => 3.2042, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.66% (1.2237 => 0.9587, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.07% (0.6299 => 0.5035, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0002) SingleSource/UnitTests/Vector/multiplies: -15.07% (2.5106 => 2.1323, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.03% (0.4092 => 0.3518, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6682, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0922, std.dev.: 0.0080) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.29% (4.9100 => 4.3555, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.02% (0.5142 => 0.4627, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/richards_benchmark: -8.92% (1.2842 => 1.1697, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8198, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6331, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.63% (2.2633 => 2.1811, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: -3.23% (5.5807 => 5.4002, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.97% (1.0557 => 1.0243, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.39% (3.7241 => 3.6352, std.dev.: 0.0041) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.33% (7.9763 => 7.7906, std.dev.: 0.0177) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.31% (1.3096 => 1.2793, std.dev.: 0.0078) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1182, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.77% (7.3040 => 7.1744, std.dev.: 0.0155) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.74% (6.5735 => 6.4593, std.dev.: 0.0068) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.29% (1.6307 => 1.6096, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout-C++/ary3: -1.26% (3.7092 => 3.6623, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.08% (1.6086 => 1.5912, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.19s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 15:13:41 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 17:13:41 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130131231341.A07A12A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8158?compare_to=8156&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8158, Order: 174085, Start Time: 2013-01-31 21:08:11, End Time: 2013-01-31 23:14:06 To: 8156, Order: 174073, Start Time: 2013-01-31 18:40:29, End Time: 2013-01-31 20:47:50 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 6 (88 on baseline) Performance Improvements: 10 (56 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1048 (919 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.09% (0.2859 => 0.2976, std.dev.: 0.0026) MultiSource/Benchmarks/mafft/pairlocalalign: 3.51% (11.0894 => 11.4784, std.dev.: 0.1219) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/nbench/nbench: 14.78% (20.7294 => 23.7926, std.dev.: 1.0170) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.5823 => 1.6115, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.63% (1.8399 => 1.8699, std.dev.: 0.0087) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.08% (3.4978 => 3.5357, std.dev.: 0.0107) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -11.38% (1.4385 => 1.2748, std.dev.: 0.0414) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -9.69% (1.4245 => 1.2864, std.dev.: 0.0436) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.38% (0.1728 => 0.1566, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -8.83% (1.3958 => 1.2726, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -8.48% (1.4288 => 1.3076, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -7.67% (1.3802 => 1.2744, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/ft/ft: -7.28% (0.2334 => 0.2164, std.dev.: 0.0061) MultiSource/Benchmarks/Ptrdist/bc/bc: -4.91% (1.3468 => 1.2807, std.dev.: 0.0160) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.49% (6.2175 => 6.0007, std.dev.: 0.0755) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.58% (4.8793 => 4.8023, std.dev.: 0.0067) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -1.79% (1.2523 => 1.2299, std.dev.: 0.0998) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -11.81% (0.0254 => 0.0224, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.24% (0.0458 => 0.0434, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -7.90% (0.0367 => 0.0338, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -6.38% (0.0345 => 0.0323, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -8.07% (0.0471 => 0.0433, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/casts: -6.70% (0.0224 => 0.0209, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: -4.56% (0.0241 => 0.0230, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.03% (0.0246 => 0.0251, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.63% (0.1512 => 0.1442, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -4.65% (1.2403 => 1.1826, std.dev.: 0.0590) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.74% (0.4060 => 0.3908, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.80% (0.1449 => 0.1504, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.57% (0.0701 => 0.0683, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 29.81% (0.0208 => 0.0270, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.66% (0.0579 => 0.0552, std.dev.: 0.0091) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.17% (1.2859 => 1.2837, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 57.89% (0.0019 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 0.81% (0.0371 => 0.0374, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.21% (1.7650 => 1.7436, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 154.17% (0.0048 => 0.0122, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 3.65% (33.2914 => 34.5077, std.dev.: 0.1820) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0004) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 387.50% (0.0336 => 0.1638, std.dev.: 0.0152) SingleSource/Regression/C/sumarraymalloc: 112.97% (0.0293 => 0.0624, std.dev.: 0.0012) SingleSource/Regression/C/sumarray2d: 93.07% (0.0274 => 0.0529, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/neural/neural: 61.84% (0.1638 => 0.2651, std.dev.: 0.0078) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 43.10% (0.8893 => 1.2726, std.dev.: 0.0424) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 42.82% (0.8926 => 1.2748, std.dev.: 0.0414) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 42.80% (0.9120 => 1.3023, std.dev.: 0.0495) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 41.97% (0.9061 => 1.2864, std.dev.: 0.0436) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 41.74% (0.9564 => 1.3556, std.dev.: 0.1122) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 41.37% (0.9588 => 1.3555, std.dev.: 0.0700) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 41.27% (0.9381 => 1.3253, std.dev.: 0.0602) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 40.78% (0.9512 => 1.3391, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 40.55% (0.8990 => 1.2635, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.52% (0.9855 => 1.3848, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 40.18% (0.9091 => 1.2744, std.dev.: 0.0146) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 40.07% (0.8912 => 1.2483, std.dev.: 0.0469) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.58% (0.9998 => 1.3955, std.dev.: 0.0507) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 38.87% (0.9403 => 1.3058, std.dev.: 0.0399) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 38.78% (0.9422 => 1.3076, std.dev.: 0.0220) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 38.72% (1.0119 => 1.4037, std.dev.: 0.0988) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 38.70% (0.9010 => 1.2497, std.dev.: 0.0694) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 37.52% (0.8736 => 1.2014, std.dev.: 0.0628) SingleSource/Benchmarks/McGill/exptree: 37.49% (0.0859 => 0.1181, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 37.01% (0.9867 => 1.3519, std.dev.: 0.0983) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 36.71% (1.0052 => 1.3742, std.dev.: 0.1089) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 36.61% (1.0867 => 1.4845, std.dev.: 0.1191) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 36.25% (0.8732 => 1.1897, std.dev.: 0.0949) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 35.94% (0.8846 => 1.2025, std.dev.: 0.0405) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 33.94% (1.0017 => 1.3417, std.dev.: 0.0666) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.45% (0.9788 => 1.3062, std.dev.: 0.0369) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 33.40% (0.9507 => 1.2682, std.dev.: 0.1228) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.23% (0.9488 => 1.2641, std.dev.: 0.0571) SingleSource/Benchmarks/Stanford/IntMM: 33.18% (0.0431 => 0.0574, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.58% (0.9685 => 1.2840, std.dev.: 0.0896) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.28% (1.0088 => 1.3344, std.dev.: 0.0500) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.28% (0.9993 => 1.3119, std.dev.: 0.0439) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 31.03% (0.9405 => 1.2323, std.dev.: 0.0516) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 29.98% (0.9550 => 1.2413, std.dev.: 0.0650) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.12% (1.0860 => 1.3914, std.dev.: 0.0454) MultiSource/Benchmarks/mafft/pairlocalalign: 20.57% (9.5202 => 11.4784, std.dev.: 0.1219) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 19.52% (0.0963 => 0.1151, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 17.27% (0.0805 => 0.0944, std.dev.: 0.0042) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.05% (3.6295 => 4.2122, std.dev.: 0.1217) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.48% (0.2577 => 0.2976, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 15.41% (1.0986 => 1.2679, std.dev.: 0.0599) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 13.91% (0.0762 => 0.0868, std.dev.: 0.0024) SingleSource/UnitTests/Vectorizer/gcc-loops: 13.49% (0.4596 => 0.5216, std.dev.: 0.0097) SingleSource/Benchmarks/Shootout-C++/matrix: 12.33% (0.2385 => 0.2679, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/chomp: 11.71% (0.1793 => 0.2003, std.dev.: 0.0023) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.48% (23.5861 => 26.0573, std.dev.: 0.5310) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.33% (1.8651 => 2.0578, std.dev.: 0.0411) SingleSource/Benchmarks/Linpack/linpack-pc: 9.70% (0.2566 => 0.2815, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.27% (0.2879 => 0.3146, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.79% (2.4519 => 2.6675, std.dev.: 0.0487) MultiSource/Applications/oggenc/oggenc: 7.82% (5.3553 => 5.7740, std.dev.: 0.1493) MultiSource/Benchmarks/PAQ8p/paq8p: 2.82% (2.5772 => 2.6499, std.dev.: 0.0205) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107112.50% (0.0008 => 0.8577, std.dev.: 0.0070) SingleSource/Benchmarks/Shootout/matrix: 354.89% (1.5825 => 7.1987, std.dev.: 0.0243) SingleSource/Benchmarks/Shootout/ary3: 283.57% (2.2304 => 8.5551, std.dev.: 2.3022) MultiSource/Applications/sgefa/sgefa: 259.69% (0.3515 => 1.2643, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 243.19% (1.1825 => 4.0582, std.dev.: 0.0058) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 233.67% (4.8185 => 16.0777, std.dev.: 0.1731) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 214.91% (0.0228 => 0.0718, std.dev.: 0.0078) SingleSource/Benchmarks/Shootout-C++/ary2: 192.25% (0.0129 => 0.0377, std.dev.: 0.0027) SingleSource/Benchmarks/Shootout-C++/ary: 130.17% (0.0232 => 0.0534, std.dev.: 0.0038) SingleSource/Benchmarks/Shootout-C++/matrix: 62.72% (2.9083 => 4.7323, std.dev.: 0.0470) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.53% (0.2562 => 0.3421, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.49% (3.1254 => 4.1097, std.dev.: 0.0190) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 25.87% (5.6033 => 7.0526, std.dev.: 0.2325) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.67% (1.4588 => 1.8333, std.dev.: 0.0567) SingleSource/Regression/C/uint64_to_float: 24.67% (1.5397 => 1.9196, std.dev.: 0.0118) SingleSource/Benchmarks/Misc/salsa20: 21.64% (7.4497 => 9.0621, std.dev.: 0.0339) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.63% (4.8112 => 5.8036, std.dev.: 0.0303) MultiSource/Benchmarks/nbench/nbench: 16.00% (20.5117 => 23.7926, std.dev.: 1.0170) MultiSource/Applications/JM/lencod/lencod: 13.59% (6.8159 => 7.7422, std.dev.: 0.0715) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.25% (5.1752 => 5.8611, std.dev.: 0.0546) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.05% (5.0033 => 5.6563, std.dev.: 0.0040) MultiSource/Benchmarks/7zip/7zip-benchmark: 10.67% (9.0082 => 9.9695, std.dev.: 0.3303) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.76% (3.6477 => 3.9671, std.dev.: 0.0198) SingleSource/Benchmarks/Misc/ReedSolomon: 8.27% (8.6447 => 9.3595, std.dev.: 0.1291) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.08% (4.7473 => 5.0835, std.dev.: 0.0264) SingleSource/Benchmarks/McGill/chomp: 6.26% (1.0425 => 1.1078, std.dev.: 0.0068) MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.54% (0.6211 => 0.6555, std.dev.: 0.0132) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.32% (4.1836 => 4.4063, std.dev.: 0.0167) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.46% (5.0310 => 5.2554, std.dev.: 0.0658) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.54% (4.7254 => 4.8928, std.dev.: 0.0517) SingleSource/Benchmarks/Linpack/linpack-pc: 3.21% (50.8945 => 52.5296, std.dev.: 0.6169) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.09% (1.5942 => 1.6115, std.dev.: 0.0034) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -37.00% (0.0808 => 0.0509, std.dev.: 0.0084) SingleSource/Benchmarks/SmallPT/smallpt: -25.90% (0.1888 => 0.1399, std.dev.: 0.0111) MultiSource/Applications/hbd/hbd: -16.88% (1.8964 => 1.5762, std.dev.: 0.0395) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -15.48% (0.1079 => 0.0912, std.dev.: 0.0017) MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.58% (0.1009 => 0.0872, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.39% (0.7686 => 0.6657, std.dev.: 0.0154) MultiSource/Applications/hexxagon/hexxagon: -9.19% (1.1433 => 1.0382, std.dev.: 0.0197) SingleSource/Benchmarks/Shootout-C++/hash2: -7.95% (0.5134 => 0.4726, std.dev.: 0.0097) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -7.66% (0.7693 => 0.7104, std.dev.: 0.0102) SingleSource/Benchmarks/Shootout-C++/hash: -6.10% (0.4689 => 0.4403, std.dev.: 0.0068) MultiSource/Benchmarks/FreeBench/pifft/pifft: -5.41% (1.0234 => 0.9680, std.dev.: 0.0205) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.77% (11.5523 => 3.9546, std.dev.: 0.0079) SingleSource/Benchmarks/Misc/fp-convert: -61.93% (15.6525 => 5.9585, std.dev.: 0.1238) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.78% (0.4146 => 0.1792, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.54% (0.4578 => 0.2356, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.90% (11.3868 => 6.3876, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -33.01% (5.4023 => 3.6190, std.dev.: 0.0086) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -28.08% (0.4452 => 0.3202, std.dev.: 0.0063) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.24% (5.2605 => 3.8802, std.dev.: 0.0141) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -25.91% (0.5495 => 0.4071, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.41% (4.4467 => 3.3169, std.dev.: 0.0562) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.01% (0.5826 => 0.4427, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.94% (0.5897 => 0.4485, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.30% (4.9921 => 3.8288, std.dev.: 0.0011) MultiSource/Applications/minisat/minisat: -21.61% (7.9891 => 6.2623, std.dev.: 0.4071) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.27% (5.8755 => 4.8023, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.97% (7.0016 => 5.7434, std.dev.: 0.1559) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.73% (16.6791 => 13.8889, std.dev.: 0.2053) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.07% (3.1921 => 2.7749, std.dev.: 0.0065) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.79% (5.3626 => 4.6767, std.dev.: 0.0256) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.45% (5.7056 => 4.9950, std.dev.: 0.0365) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.34% (9.7992 => 8.5895, std.dev.: 0.0115) MultiSource/Benchmarks/Olden/treeadd/treeadd: -10.10% (0.4081 => 0.3669, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/lists1: -9.07% (0.6628 => 0.6027, std.dev.: 0.0183) MultiSource/Benchmarks/mafft/pairlocalalign: -8.95% (63.1520 => 57.4999, std.dev.: 0.1808) MultiSource/Applications/SIBsim4/SIBsim4: -7.86% (3.5443 => 3.2658, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.40% (5.5974 => 5.2394, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: -6.19% (0.3654 => 0.3428, std.dev.: 0.0073) SingleSource/Benchmarks/McGill/queens: -5.84% (1.7443 => 1.6424, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hash2: -4.73% (3.6768 => 3.5030, std.dev.: 0.0040) MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.63% (0.3349 => 0.3194, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/ffbench: -4.47% (1.4244 => 1.3607, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.21% (3.5127 => 3.3648, std.dev.: 0.0569) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.65% (1.4446 => 1.3919, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.56% (5.8973 => 5.6874, std.dev.: 0.0189) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.27% (3.5691 => 3.4524, std.dev.: 0.0015) MultiSource/Benchmarks/Olden/voronoi/voronoi: -2.99% (0.3406 => 0.3304, std.dev.: 0.0025) MultiSource/Applications/spiff/spiff: -2.38% (2.8571 => 2.7892, std.dev.: 0.0168) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.65% (8.8249 => 8.6791, std.dev.: 0.0483) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.62% (85.3042 => 83.9228, std.dev.: 0.0552) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.58% (8.7327 => 8.5949, std.dev.: 0.0173) SingleSource/Benchmarks/Misc/mandel: -1.49% (1.0604 => 1.0446, std.dev.: 0.0050) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.29% (3.3596 => 3.3161, std.dev.: 0.0108) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7023, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/methcall: -1.09% (8.7416 => 8.6461, std.dev.: 0.0179) SingleSource/Benchmarks/Misc/flops-7: -1.03% (1.7446 => 1.7267, std.dev.: 0.0054) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 2.09% (1.2047 => 1.2299, std.dev.: 0.0998) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -3.86% (0.0233 => 0.0224, std.dev.: 0.0069) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.77% (0.0451 => 0.0434, std.dev.: 0.0023) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -14.21% (0.0394 => 0.0338, std.dev.: 0.0097) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.52% (0.0328 => 0.0323, std.dev.: 0.0087) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -2.70% (0.0445 => 0.0433, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/casts: -1.88% (0.0213 => 0.0209, std.dev.: 0.0058) SingleSource/UnitTests/Vector/Altivec/test1: 1.32% (0.0227 => 0.0230, std.dev.: 0.0012) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.57% (0.0255 => 0.0251, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -5.75% (0.1530 => 0.1442, std.dev.: 0.0005) MultiSource/Applications/lemon/lemon: -38.70% (1.9293 => 1.1826, std.dev.: 0.0590) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.48% (0.4049 => 0.3908, std.dev.: 0.0401) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.40% (0.1510 => 0.1504, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.16% (0.0978 => 0.0683, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.17% (0.0276 => 0.0270, std.dev.: 0.0023) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.44% (0.0590 => 0.0552, std.dev.: 0.0091) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.50% (1.1617 => 1.2837, std.dev.: 0.0143) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.16% (0.0610 => 0.0611, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.55% (0.0268 => 0.0374, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.45% (0.7437 => 1.7436, std.dev.: 0.0057) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 32.61% (0.0092 => 0.0122, std.dev.: 0.0031) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 170.05% (12.7781 => 34.5077, std.dev.: 0.1820) Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 15:25:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 17:25:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130131232519.D7B272A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8159?compare_to=8155&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8159, Order: 174085, Start Time: 2013-01-31 21:13:26, End Time: 2013-01-31 23:25:43 To: 8155, Order: 174067, Start Time: 2013-01-31 18:30:06, End Time: 2013-01-31 20:42:28 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (229 on baseline) Performance Improvements: 1 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1099 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: -1.62% (10.9765 => 10.7992, std.dev.: 0.0017) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1329 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.35% (0.0669 => 0.0678, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/power/power: 0.01% (499.8137 => 499.8493, std.dev.: 0.0091) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 44224.67% (1.1277 => 499.8493, std.dev.: 0.0091) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 227.77% (0.5229 => 1.7139, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 26.53% (14.9895 => 18.9657, std.dev.: 0.0120) MultiSource/Applications/kimwitu++/kc: 47.53% (14.1553 => 20.8839, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 20.97% (4.1105 => 4.9723, std.dev.: 0.0181) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 62.33% (1.1048 => 1.7934, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 449.24% (7.1582 => 39.3158, std.dev.: 0.0075) SingleSource/Benchmarks/Misc-C++-EH/spirit: 90.52% (3.4629 => 6.5976, std.dev.: 0.0045) SingleSource/Benchmarks/Misc-C++/stepanov_container: 83.14% (0.6222 => 1.1395, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10237.22% (0.0720 => 7.4428, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3833700.00% (0.0001 => 3.8338, std.dev.: 0.0011) MultiSource/Applications/SPASS/SPASS: 11094000.00% (0.0001 => 11.0941, std.dev.: 0.0243) MultiSource/Applications/kimwitu++/kc: 51300.00% (0.0001 => 0.0514, std.dev.: 0.0003) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575900.00% (0.0001 => 0.5760, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9848900.00% (0.0001 => 9.8490, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5494700.00% (0.0001 => 5.4948, std.dev.: 0.0396) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 817.37% (1.1194 => 10.2690, std.dev.: 0.0200) MultiSource/Applications/ClamAV/clamscan: 150.08% (22.1758 => 55.4565, std.dev.: 0.0066) SingleSource/Benchmarks/Misc/lowercase: 132.81% (0.0256 => 0.0596, std.dev.: 0.0003) SingleSource/Benchmarks/CoyoteBench/lpbench: 103.66% (0.0929 => 0.1892, std.dev.: 0.0043) SingleSource/Regression/C/sumarraymalloc: 93.83% (0.0243 => 0.0471, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 80.59% (0.1463 => 0.2642, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 73.06% (0.0271 => 0.0469, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0009) SingleSource/Benchmarks/Stanford/IntMM: 66.50% (0.0394 => 0.0656) SingleSource/Regression/C/sumarray: 65.37% (0.0231 => 0.0382, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 58.25% (1.5859 => 2.5097, std.dev.: 0.0152) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.02% (2.9384 => 4.6139, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 55.60% (7.0540 => 10.9763, std.dev.: 0.0095) MultiSource/Benchmarks/FreeBench/distray/distray: 53.13% (0.1056 => 0.1617, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout/ary3: 51.72% (0.0232 => 0.0352, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 49.66% (0.0439 => 0.0657, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.49% (8.1363 => 12.1626, std.dev.: 0.0067) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.93% (2.2024 => 3.2359, std.dev.: 0.0156) MultiSource/Applications/sgefa/sgefa: 45.13% (0.3109 => 0.4512, std.dev.: 0.0010) SingleSource/UnitTests/vla: 44.79% (0.0355 => 0.0514, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/flops: 41.20% (0.1432 => 0.2022, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.87% (0.1062 => 0.1496, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 40.86% (21.9371 => 30.9013, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 38.74% (1.5415 => 2.1387, std.dev.: 0.0050) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.91% (4.2646 => 5.8811, std.dev.: 0.0019) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 36.73% (0.4615 => 0.6310, std.dev.: 0.0006) SingleSource/Benchmarks/McGill/exptree: 36.61% (0.0814 => 0.1112, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 36.12% (0.5105 => 0.6949, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 35.40% (0.2271 => 0.3075, std.dev.: 0.0028) SingleSource/UnitTests/ObjC/dot-syntax-1: 34.86% (0.0479 => 0.0646, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 34.20% (0.6675 => 0.8958, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.20% (0.1892 => 0.2539, std.dev.: 0.0013) MultiSource/Applications/Burg/burg: 33.82% (1.1642 => 1.5579, std.dev.: 0.0064) MultiSource/Benchmarks/McCat/05-eks/eks: 33.19% (0.4299 => 0.5726, std.dev.: 0.0065) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 32.60% (0.0457 => 0.0606, std.dev.: 0.0011) MultiSource/Benchmarks/NPB-serial/is/is: 32.41% (0.0719 => 0.0952, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Oscar: 32.23% (0.0636 => 0.0841, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/chomp: 32.15% (0.1655 => 0.2187, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.47% (0.1125 => 0.1479, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.15% (0.0793 => 0.1040, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 30.97% (0.1695 => 0.2220, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 30.78% (9.4845 => 12.4035, std.dev.: 0.0217) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 30.10% (3.8922 => 5.0637, std.dev.: 0.0012) SingleSource/UnitTests/2006-12-11-LoadConstants: 30.10% (0.1143 => 0.1487, std.dev.: 0.0010) MultiSource/Applications/viterbi/viterbi: 29.20% (0.1555 => 0.2009, std.dev.: 0.0009) SingleSource/Benchmarks/BenchmarkGame/n-body: 29.09% (0.0746 => 0.0963, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 29.05% (1.0722 => 1.3837, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/08-main/main: 28.66% (0.2554 => 0.3286, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 28.15% (1.4186 => 1.8180, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.05% (0.1337 => 0.1712, std.dev.: 0.0017) SingleSource/Benchmarks/BenchmarkGame/puzzle: 27.94% (0.0408 => 0.0522, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash: 27.75% (0.4289 => 0.5479, std.dev.: 0.0033) MultiSource/Applications/minisat/minisat: 27.74% (0.7115 => 0.9089, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 27.53% (0.0730 => 0.0931, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/hash2: 27.49% (0.4620 => 0.5890, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.23% (0.1906 => 0.2425, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 27.17% (0.3121 => 0.3969, std.dev.: 0.0027) MultiSource/Benchmarks/Olden/tsp/tsp: 26.81% (0.1175 => 0.1490, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.69% (0.1566 => 0.1984, std.dev.: 0.0050) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 26.64% (0.0672 => 0.0851, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 26.26% (0.1032 => 0.1303, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 26.25% (0.5020 => 0.6338, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/bigfib: 26.07% (0.6456 => 0.8139, std.dev.: 0.0032) MultiSource/Applications/aha/aha: 25.89% (0.1151 => 0.1449, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/hash: 25.57% (0.0485 => 0.0609, std.dev.: 0.0000) MultiSource/Applications/spiff/spiff: 25.56% (0.7835 => 0.9838, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/whetstone: 25.45% (0.0660 => 0.0828, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/15-trie/trie: 25.43% (0.0527 => 0.0661, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 25.29% (1.3050 => 1.6350, std.dev.: 0.0034) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 25.24% (0.1236 => 0.1548, std.dev.: 0.0051) SingleSource/UnitTests/ObjC/messages-2: 24.92% (0.0662 => 0.0827, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 24.85% (0.2700 => 0.3371, std.dev.: 0.0012) MultiSource/Benchmarks/llubenchmark/llu: 24.68% (0.0462 => 0.0576, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/lists: 24.60% (0.0626 => 0.0780, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 24.45% (0.0871 => 0.1084, std.dev.: 0.0001) MultiSource/Applications/d/make_dparser: 24.07% (3.3354 => 4.1382, std.dev.: 0.0027) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 24.03% (0.0953 => 0.1182, std.dev.: 0.0004) MultiSource/Benchmarks/nbench/nbench: 24.01% (1.1840 => 1.4683, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/17-bintr/bintr: 24.00% (0.0675 => 0.0837, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.81% (0.1029 => 0.1274, std.dev.: 0.0021) MultiSource/Applications/oggenc/oggenc: 23.68% (5.7591 => 7.1229, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.46% (0.5860 => 0.7235, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/mst/mst: 23.30% (0.1163 => 0.1434, std.dev.: 0.0014) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.28% (0.0842 => 0.1038, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wordfreq: 23.13% (0.3307 => 0.4072, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/em3d/em3d: 23.13% (0.1695 => 0.2087, std.dev.: 0.0012) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.89% (0.1940 => 0.2384, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/matrix: 22.72% (0.3098 => 0.3802, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.69% (4.9449 => 6.0669, std.dev.: 0.0156) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.61% (0.8172 => 1.0020, std.dev.: 0.0023) MultiSource/Benchmarks/Ptrdist/ks/ks: 22.32% (0.1510 => 0.1847, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 22.31% (0.0614 => 0.0751, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 22.23% (0.0886 => 0.1083, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/five11/five11: 22.22% (0.0567 => 0.0693, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 22.06% (0.2049 => 0.2501, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/football/football: 21.87% (0.8921 => 1.0872, std.dev.: 0.0014) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.84% (0.1584 => 0.1930, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.79% (5.0018 => 6.0915, std.dev.: 0.0016) MultiSource/Applications/treecc/treecc: 21.73% (2.0273 => 2.4679, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 21.59% (0.0528 => 0.0642, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.46% (0.2758 => 0.3350, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/bc/bc: 21.41% (1.1861 => 1.4401, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 21.40% (0.6450 => 0.7830, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/18-imp/imp: 21.27% (0.3423 => 0.4151, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.24% (0.9765 => 1.1839, std.dev.: 0.0042) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 21.22% (0.1117 => 0.1354, std.dev.: 0.0034) MultiSource/Applications/lua/lua: 21.03% (3.8723 => 4.6868, std.dev.: 0.0080) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.99% (0.5569 => 0.6738, std.dev.: 0.0047) SingleSource/UnitTests/SignlessTypes/rem: 20.80% (0.1144 => 0.1382, std.dev.: 0.0003) MultiSource/Applications/lambda-0_1_3/lambda: 20.80% (0.7433 => 0.8979, std.dev.: 0.0024) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 20.69% (0.2107 => 0.2543, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/bmm/bmm: 20.42% (0.0759 => 0.0914, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/life/life: 20.26% (0.0933 => 0.1122, std.dev.: 0.0010) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 20.05% (0.2603 => 0.3125, std.dev.: 0.0063) MultiSource/Benchmarks/Olden/health/health: 20.03% (0.1268 => 0.1522, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.02% (0.0834 => 0.1001, std.dev.: 0.0012) MultiSource/Applications/siod/siod: 19.94% (2.2969 => 2.7548, std.dev.: 0.0039) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.91% (0.0648 => 0.0777, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.87% (0.0770 => 0.0923, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/perlin: 19.59% (0.0536 => 0.0641, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 19.43% (0.8101 => 0.9675, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 19.35% (0.0770 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/spellcheck: 19.32% (0.4203 => 0.5015, std.dev.: 0.0011) SingleSource/Benchmarks/McGill/misr: 19.12% (0.0633 => 0.0754, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.01% (0.5981 => 0.7118, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.89% (0.3441 => 0.4091, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.79% (0.2065 => 0.2453, std.dev.: 0.0014) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.68% (0.1044 => 0.1239) SingleSource/Benchmarks/Shootout/matrix: 18.34% (0.0818 => 0.0968, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/ary3: 18.06% (0.3283 => 0.3876, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_isamax: 18.04% (0.0704 => 0.0831, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 17.92% (0.3180 => 0.3750, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.64% (0.3232 => 0.3802, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 17.57% (0.3387 => 0.3982, std.dev.: 0.0075) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 17.44% (0.8067 => 0.9474, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/fbench: 17.40% (0.0592 => 0.0695, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: 16.40% (0.3379 => 0.3933, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.99% (0.3865 => 0.4483, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 15.83% (17.1811 => 19.9012, std.dev.: 0.0111) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.75% (0.4636 => 0.5366, std.dev.: 0.0030) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0009) MultiSource/Applications/hbd/hbd: 15.20% (1.5603 => 1.7975, std.dev.: 0.0035) SingleSource/Regression/C++/ofstream_ctor: 14.73% (0.2905 => 0.3333, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.67% (0.4103 => 0.4705, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/moments: 14.58% (0.4048 => 0.4638, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/lists: 14.38% (0.3422 => 0.3914, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 14.29% (0.0798 => 0.0912, std.dev.: 0.0025) SingleSource/Benchmarks/Shootout-C++/lists1: 14.20% (0.3684 => 0.4207, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 13.94% (0.3092 => 0.3523, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/sieve: 13.88% (0.3603 => 0.4103, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/parameter-passing: 13.85% (0.3927 => 0.4471, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.53% (14.3668 => 16.3110, std.dev.: 0.0068) SingleSource/UnitTests/ObjC/property: 13.43% (0.3886 => 0.4408, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 13.42% (0.3427 => 0.3887, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/Large/ray: 13.29% (0.4064 => 0.4604, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/oourafft: 13.25% (0.3282 => 0.3717, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 13.11% (0.1114 => 0.1260, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.09% (0.2430 => 0.2748, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.70% (0.3826 => 0.4312, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: 12.62% (0.3828 => 0.4311, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: 12.42% (0.3543 => 0.3983, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/for-in: 12.37% (0.3694 => 0.4151, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: 12.27% (0.3473 => 0.3899, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 12.19% (0.3561 => 0.3995, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: 12.16% (0.3543 => 0.3974, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 12.12% (0.3497 => 0.3921, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 12.03% (0.3516 => 0.3939, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Puzzle: 11.75% (0.1268 => 0.1417, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.13% (0.2831 => 0.3146, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/except: 11.04% (0.2871 => 0.3188, std.dev.: 0.0005) MultiSource/Applications/hexxagon/hexxagon: 10.67% (1.2842 => 1.4212, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.66% (2.0665 => 2.2867, std.dev.: 0.0023) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.55% (0.3935 => 0.4350, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.22% (0.3650 => 0.4023, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/methcall: 10.18% (0.2877 => 0.3170, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.18% (0.3162 => 0.3484, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 10.09% (0.1625 => 0.1789, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: 10.08% (0.6030 => 0.6638, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.99% (0.7326 => 0.8058, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2756 => 0.3030, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.85% (0.2793 => 0.3068, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.83% (0.2725 => 0.2993, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/Hello: 9.76% (0.5925 => 0.6503, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.75% (0.2872 => 0.3152, std.dev.: 0.0007) MultiSource/Benchmarks/Bullet/bullet: 9.74% (63.2438 => 69.4055, std.dev.: 0.0275) SingleSource/Benchmarks/Shootout-C++/hello: 9.65% (0.2714 => 0.2976, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.58% (0.2891 => 0.3168, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/wc: 9.37% (0.3052 => 0.3338, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/random: 9.35% (0.2802 => 0.3064, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.93% (0.3136 => 0.3416, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.87% (0.1330 => 0.1448, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.26% (2.2022 => 2.3842, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.08% (0.2266 => 0.2449, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.42% (0.4879 => 0.5241, std.dev.: 0.0028) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.27% (0.3177 => 0.3408, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.23% (0.1438 => 0.1542, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.01% (0.3131 => 0.3288, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.77% (0.3817 => 0.3999, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 4.17% (10.3673 => 10.7992, std.dev.: 0.0017) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 4.11% (7.9617 => 8.2892, std.dev.: 0.0128) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0004) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4672, std.dev.: 0.0035) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.07% (1.1145 => 1.2936, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/oourafft: 15.79% (6.6465 => 7.6962, std.dev.: 0.0005) SingleSource/Regression/C/uint64_to_float: 13.17% (0.5413 => 0.6126, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.29% (1.1396 => 1.2455, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1488, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 7.05% (11.6436 => 12.4643, std.dev.: 0.0907) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.57% (4.2280 => 4.4635, std.dev.: 0.0076) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3134, std.dev.: 0.0031) SingleSource/Benchmarks/Misc/ffbench: 4.11% (0.9505 => 0.9896, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.46% (2.0360 => 2.1065, std.dev.: 0.0013) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.06% (0.9957 => 1.0262, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.50% (1.0313 => 1.0571, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.44% (8.6802 => 8.8924, std.dev.: 0.0199) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Benchmarks/Olden/bisort/bisort: 2.03% (0.8333 => 0.8502, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (3.6395 => 3.7117, std.dev.: 0.0059) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.81% (1.7254 => 1.7567, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.77% (9.1159 => 9.2777, std.dev.: 0.0172) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3085, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: 1.38% (2.2771 => 2.3086, std.dev.: 0.0055) SingleSource/Benchmarks/CoyoteBench/lpbench: 1.01% (10.3460 => 10.4509, std.dev.: 0.0176) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.79% (6.6874 => 0.1475, std.dev.: 0.0028) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.73% (5.2763 => 1.1750, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/salsa20: -75.16% (0.8651 => 0.2149, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/richards_benchmark: -42.11% (0.1622 => 0.0939, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.84% (5.3855 => 4.4787, std.dev.: 0.0021) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.12% (5.3526 => 4.4900, std.dev.: 0.0028) MultiSource/Applications/JM/ldecod/ldecod: -11.67% (10.4361 => 9.2177, std.dev.: 0.0059) SingleSource/UnitTests/Vector/constpool: -7.57% (54.1659 => 50.0663, std.dev.: 0.0184) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.16% (1.7609 => 1.6348, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.81% (1.9577 => 0.6498, std.dev.: 0.0113) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0460 => 1.0510) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0016) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5620, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.09% (8.0499 => 5.3057, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -33.58% (1.5373 => 1.0211, std.dev.: 0.0040) SingleSource/Benchmarks/Misc/mandel: -33.40% (1.1492 => 0.7654, std.dev.: 0.0005) MultiSource/Benchmarks/Bullet/bullet: -30.63% (10.7105 => 7.4300, std.dev.: 0.0092) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1303, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.53% (2.6546 => 2.0034, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/fp-convert: -22.61% (3.3453 => 2.5889, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: -21.96% (0.0756 => 0.0590, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -21.27% (0.0757 => 0.0596, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/mason/mason: -19.44% (0.2161 => 0.1741, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -16.68% (2.5528 => 2.1271, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops-6: -16.11% (1.6925 => 1.4199, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.02% (3.1443 => 2.7349, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.83% (0.9540 => 0.8411, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.20% (9.5636 => 8.4920, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7558, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.17% (3.2416 => 2.9118, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0047) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.99% (19.9488 => 18.5540, std.dev.: 0.0463) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.79% (0.3463 => 0.3228, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.85% (1.2373 => 1.1649, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.64% (8.1563 => 7.6965, std.dev.: 0.0048) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.58% (1.6805 => 1.5867, std.dev.: 0.0029) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.87% (1.5835 => 1.5064, std.dev.: 0.0039) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8015, std.dev.: 0.0031) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.60% (0.4808 => 0.4587, std.dev.: 0.0007) MultiSource/Applications/siod/siod: -3.88% (3.2827 => 3.1553, std.dev.: 0.0027) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9549, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6762, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/ary3: -1.74% (3.6994 => 3.6350, std.dev.: 0.0083) SingleSource/Benchmarks/Shootout-C++/lists: -1.65% (12.5348 => 12.3286, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout/lists: -1.03% (6.2999 => 6.2353, std.dev.: 0.0055) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.57% (0.1485 => 0.1328, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.96% (0.2116 => 0.0678, std.dev.: 0.0020) Report Time: 1.54s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 15:42:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 17:42:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130131234238.BA2602A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8160?compare_to=8157&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8160, Order: 174094, Start Time: 2013-01-31 22:08:53, End Time: 2013-01-31 23:43:02 To: 8157, Order: 174077, Start Time: 2013-01-31 20:10:52, End Time: 2013-01-31 21:45:10 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (131 on baseline) Performance Improvements: 0 (85 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1102 (876 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.00% (5.8036 => 5.8619, std.dev.: 0.0085) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.07% (79.9044 => 80.7631, std.dev.: 0.3314) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.98% (0.0315 => 0.0715, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 81.07% (0.0280 => 0.0507, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 71.79% (0.0514 => 0.0883, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 71.69% (0.0717 => 0.1231, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.35% (0.0974 => 0.1630, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/neural/neural: 47.07% (0.1500 => 0.2206, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 44.19% (0.0267 => 0.0385, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 43.29% (0.1132 => 0.1622, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 40.40% (0.0599 => 0.0841, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.92% (0.6395 => 0.8884, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 38.76% (0.0418 => 0.0580, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 37.06% (0.6395 => 0.8765, std.dev.: 0.0003) SingleSource/Regression/C/sumarray2d: 35.15% (0.0293 => 0.0396) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 33.49% (0.5805 => 0.7749, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.47% (0.5688 => 0.7592, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.42% (0.6260 => 0.8352, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.25% (0.5456 => 0.7270, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.91% (0.5567 => 0.7399, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.79% (0.6230 => 0.8273, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.64% (0.5849 => 0.7758, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.63% (0.5575 => 0.7394, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.57% (0.5581 => 0.7399, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 32.20% (0.5802 => 0.7670, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 31.69% (1.6474 => 2.1694, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.67% (0.5705 => 0.7512, std.dev.: 0.0152) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.41% (0.5941 => 0.7807, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 31.10% (0.5570 => 0.7302, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.03% (0.5569 => 0.7297, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.92% (0.5857 => 0.7668, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.81% (0.5478 => 0.7166, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.71% (0.6033 => 0.7886, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.70% (0.5859 => 0.7658, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.55% (0.5591 => 0.7299, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 30.26% (0.6440 => 0.8389, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 30.01% (0.5925 => 0.7703, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.70% (0.6189 => 0.8027, std.dev.: 0.0148) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.29% (0.5863 => 0.7580, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 29.18% (0.0699 => 0.0903, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.16% (0.6676 => 0.8623, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.97% (0.6304 => 0.8130, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.78% (0.6052 => 0.7794, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.61% (0.6446 => 0.8290, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 28.12% (0.6194 => 0.7936, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 28.08% (0.6681 => 0.8557, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.75% (0.6660 => 0.8508, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.43% (0.6297 => 0.8024, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.08% (0.6667 => 0.8406, std.dev.: 0.0066) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 25.43% (0.0582 => 0.0730, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.84% (0.7524 => 0.9393, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 24.15% (2.2587 => 2.8042, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.92% (0.0790 => 0.0979, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.87% (0.7339 => 0.9091, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 23.03% (0.0621 => 0.0764, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 22.94% (0.0693 => 0.0852, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.83% (0.0622 => 0.0764, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 22.70% (0.0445 => 0.0546, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.87% (0.0634 => 0.0760, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 19.60% (0.0556 => 0.0665, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 19.26% (0.0566 => 0.0675, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 18.73% (0.0833 => 0.0989, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 18.41% (0.1146 => 0.1357, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 16.80% (0.3357 => 0.3921, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.76% (0.0680 => 0.0794, std.dev.: 0.0003) MultiSource/Applications/lemon/lemon: 15.95% (1.1450 => 1.3276, std.dev.: 0.0078) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.82% (0.1081 => 0.1252, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.77% (0.0731 => 0.0839, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 14.28% (0.1982 => 0.2265, std.dev.: 0.0012) MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.37% (4.5069 => 5.1095, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/exptree: 13.31% (0.0864 => 0.0979, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 13.12% (0.4916 => 0.5561, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.03% (1.6364 => 1.8497, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.85% (0.4515 => 0.5095, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.75% (3.5339 => 3.9845, std.dev.: 0.0055) SingleSource/UnitTests/2006-12-11-LoadConstants: 11.71% (0.1230 => 0.1374, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.70% (0.2385 => 0.2664, std.dev.: 0.0009) MultiSource/Benchmarks/mafft/pairlocalalign: 10.80% (9.2283 => 10.2247, std.dev.: 0.0188) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.34% (0.1731 => 0.1910, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.13% (0.5329 => 0.5869, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hash: 9.64% (0.4524 => 0.4960, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 9.57% (1.2515 => 1.3713, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 9.51% (0.7021 => 0.7689, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 9.00% (0.2001 => 0.2181, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 8.71% (1.2784 => 1.3898, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 8.54% (0.4861 => 0.5276, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 8.11% (1.4642 => 1.5829, std.dev.: 0.0089) SingleSource/Benchmarks/Misc-C++/bigfib: 7.41% (0.6750 => 0.7250, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.20% (5.4682 => 5.8619, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/ReedSolomon: 6.71% (0.1879 => 0.2005, std.dev.: 0.0005) MultiSource/Benchmarks/SciMark2-C/scimark2: 6.36% (0.3319 => 0.3530, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/matrix: 6.33% (0.3255 => 0.3461, std.dev.: 0.0003) SingleSource/Benchmarks/McGill/chomp: 5.96% (0.1761 => 0.1866, std.dev.: 0.0006) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.53% (22.4056 => 23.6436, std.dev.: 0.0109) MultiSource/Applications/SPASS/SPASS: 4.62% (15.5079 => 16.2238, std.dev.: 0.0013) MultiSource/Applications/minisat/minisat: 4.40% (0.7447 => 0.7775, std.dev.: 0.0012) MultiSource/Applications/oggenc/oggenc: 4.35% (5.0226 => 5.2409, std.dev.: 0.0042) SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.13% (0.9557 => 0.9952, std.dev.: 0.0002) MultiSource/Applications/spiff/spiff: 4.09% (0.8418 => 0.8762, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.92% (0.3491 => 0.3628, std.dev.: 0.0024) MultiSource/Applications/SIBsim4/SIBsim4: 3.82% (1.3864 => 1.4393, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/ary3: 3.74% (0.3446 => 0.3575, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.50% (0.4427 => 0.4582, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/ary: 3.42% (0.3394 => 0.3510, std.dev.: 0.0026) SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.29% (0.5168 => 0.5338, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.84% (1.3722 => 1.4112, std.dev.: 0.0005) MultiSource/Applications/kimwitu++/kc: 2.25% (18.2933 => 18.7051, std.dev.: 0.0053) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.21% (0.6293 => 0.6432, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/bc/bc: 2.10% (1.2300 => 1.2558, std.dev.: 0.0015) MultiSource/Benchmarks/Bullet/bullet: 1.89% (34.0927 => 34.7380, std.dev.: 0.0173) MultiSource/Applications/d/make_dparser: 1.85% (3.5154 => 3.5804, std.dev.: 0.0020) MultiSource/Benchmarks/nbench/nbench: 1.66% (1.1530 => 1.1721, std.dev.: 0.0003) MultiSource/Applications/treecc/treecc: 1.64% (2.1401 => 2.1751, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.60% (4.0323 => 4.0970, std.dev.: 0.0077) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.38% (4.8161 => 4.8826, std.dev.: 0.0057) MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.21% (0.9077 => 0.9187, std.dev.: 0.0009) MultiSource/Applications/siod/siod: 1.06% (2.4021 => 2.4275, std.dev.: 0.0035) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.04% (4.8802 => 4.9310, std.dev.: 0.0027) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.86% (31.3723 => 55.8002, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.53% (0.9531 => 1.0249, std.dev.: 0.0036) SingleSource/Regression/C/uint64_to_float: 7.34% (0.5692 => 0.6110, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.29% (54.5751 => 56.3692, std.dev.: 0.1878) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.97% (2.0478 => 2.1086, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3031, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.56% (18.2231 => 18.5082, std.dev.: 0.0138) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9565, std.dev.: 0.0012) MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.5320 => 4.5981, std.dev.: 0.0028) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2709, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.31% (79.7170 => 80.7631, std.dev.: 0.3314) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.40% (0.1281 => 0.1135) SingleSource/Benchmarks/Shootout-C++/objinst: -4.51% (0.3194 => 0.3050, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.74% (0.7198 => 0.6929, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.26% (0.3837 => 0.3712, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.20% (0.6347 => 0.6144, std.dev.: 0.0025) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.19% (0.3821 => 0.3699, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (2.4924 => 2.4152, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: -2.84% (0.6441 => 0.6258, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -2.83% (0.3812 => 0.3704, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -2.83% (0.3848 => 0.3739, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.83% (0.9852 => 0.9573, std.dev.: 0.0035) SingleSource/UnitTests/Vector/constpool: -2.81% (20.7746 => 20.1898, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/exceptions-2: -2.79% (0.3831 => 0.3724, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -2.77% (0.3896 => 0.3788, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -2.72% (0.3891 => 0.3785, std.dev.: 0.0021) SingleSource/UnitTests/ObjC/exceptions-4: -2.71% (0.3880 => 0.3775, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: -2.70% (0.4033 => 0.3924, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.53% (2.1713 => 2.1164, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -2.51% (0.4176 => 0.4071, std.dev.: 0.0000) MultiSource/Applications/hexxagon/hexxagon: -2.26% (1.3148 => 1.2851, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.95% (0.9542 => 0.9356, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: -1.92% (0.7779 => 0.7630, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.87% (0.6484 => 0.6363, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.32% (14.2083 => 14.0211, std.dev.: 0.0135) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.51% (1.8100 => 0.6785, std.dev.: 0.0138) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0002) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.11% (6.6713 => 3.3953, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0510, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.93% (8.0445 => 5.3151, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.29% (0.1983 => 0.1422, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.55% (0.2151 => 0.1580, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.41% (1.3643 => 1.0313, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/methcall: -23.39% (7.5137 => 5.7564, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.22% (0.2274 => 0.1746, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4526, std.dev.: 0.0036) SingleSource/Benchmarks/Misc/fp-convert: -22.60% (3.3454 => 2.5894, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.06% (0.0757 => 0.0590, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.86% (4.1024 => 3.2058, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.86% (5.3397 => 4.1727, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -20.05% (0.6299 => 0.5036, std.dev.: 0.0049) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -15.17% (2.5106 => 2.1297, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.13% (0.4092 => 0.3514, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0921, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7260, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3569, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.19% (0.5142 => 0.4618, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/richards_benchmark: -8.89% (1.2842 => 1.1700, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8195, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6333, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8041, std.dev.: 0.0019) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.82% (0.9021 => 0.8406, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1072, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.26% (1.7753 => 1.6996, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3345, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/fbench: -3.64% (2.2633 => 2.1809, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3997, std.dev.: 0.0023) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -3.00% (1.0557 => 1.0240, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.83% (1.3096 => 1.2726, std.dev.: 0.0090) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.81% (7.9763 => 7.7522, std.dev.: 0.0201) SingleSource/Benchmarks/Shootout/ary3: -2.55% (3.7241 => 3.6290, std.dev.: 0.0184) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1197, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -1.76% (7.3040 => 7.1756, std.dev.: 0.0034) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.72% (6.5735 => 6.4603, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7088, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0856, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary3: -1.30% (3.7092 => 3.6609, std.dev.: 0.0097) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.24% (1.6307 => 1.6104, std.dev.: 0.0038) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.11% (1.6086 => 1.5908, std.dev.: 0.0031) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.03% (1.6219 => 1.6052, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.0443 => 1.0337, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 16:56:13 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 18:56:13 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130201005613.DDC242A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8161?compare_to=8154&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8161, Order: 174085, Start Time: 2013-01-31 21:21:03, End Time: 2013-02-01 00:56:37 To: 8154, Order: 174061, Start Time: 2013-01-31 16:52:47, End Time: 2013-01-31 20:27:50 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (180 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (756 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.89% (0.0642 => 0.0744, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 14.83% (0.3526 => 0.4049, std.dev.: 0.0054) Performance Improvements - Compile Time --------------------------------------- MultiSource/Applications/hbd/hbd: -1.77% (1.1650 => 1.1444, std.dev.: 0.0034) MultiSource/Applications/hexxagon/hexxagon: -1.44% (1.1776 => 1.1607, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: -1.41% (2.4560 => 2.4213, std.dev.: 0.0040) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 42.88% (0.0625 => 0.0893, std.dev.: 0.0038) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.05% (0.1063 => 0.1425, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 30.71% (0.0547 => 0.0715, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/dbms/dbms: 28.92% (0.5900 => 0.7606, std.dev.: 0.0118) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.73% (0.2969 => 0.3822, std.dev.: 0.0146) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.81% (0.4139 => 0.5290, std.dev.: 0.0092) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 27.67% (0.1106 => 0.1412, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.58% (0.0475 => 0.0606, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.31% (0.0714 => 0.0909, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 27.10% (0.1107 => 0.1407, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.87% (0.4994 => 0.6336, std.dev.: 0.0167) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 26.64% (0.4253 => 0.5386, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.52% (0.0822 => 0.1040, std.dev.: 0.0010) MultiSource/Applications/oggenc/oggenc: 25.89% (1.5932 => 2.0056, std.dev.: 0.0019) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 25.78% (0.0415 => 0.0522, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 25.51% (0.0541 => 0.0679, std.dev.: 0.0008) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.48% (0.5000 => 0.6274, std.dev.: 0.0157) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.34% (0.0584 => 0.0732, std.dev.: 0.0021) MultiSource/Benchmarks/Olden/tsp/tsp: 24.87% (0.0599 => 0.0748, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.20% (0.1620 => 0.2012, std.dev.: 0.0010) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 23.80% (0.1021 => 0.1264, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.76% (0.1549 => 0.1917, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.63% (0.0584 => 0.0722, std.dev.: 0.0037) MultiSource/Benchmarks/Olden/em3d/em3d: 23.10% (0.0948 => 0.1167, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/power/power: 22.68% (0.0604 => 0.0741, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/perimeter/perimeter: 22.63% (0.0495 => 0.0607, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.59% (0.0633 => 0.0776, std.dev.: 0.0026) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.43% (0.1003 => 0.1228, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.39% (0.3903 => 0.4777, std.dev.: 0.0042) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.38% (0.1604 => 0.1963, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.30% (0.1103 => 0.1349, std.dev.: 0.0055) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.12% (0.0642 => 0.0784, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 22.02% (0.1462 => 0.1784, std.dev.: 0.0024) MultiSource/Benchmarks/Olden/health/health: 21.68% (0.0821 => 0.0999, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/05-eks/eks: 21.68% (0.1619 => 0.1970, std.dev.: 0.0018) MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.60% (0.1088 => 0.1323, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 21.55% (0.3271 => 0.3976, std.dev.: 0.0103) MultiSource/Applications/viterbi/viterbi: 21.54% (0.0947 => 0.1151, std.dev.: 0.0041) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.42% (1.3152 => 1.5969, std.dev.: 0.0115) MultiSource/Applications/spiff/spiff: 21.02% (0.4029 => 0.4876, std.dev.: 0.0149) MultiSource/Applications/sgefa/sgefa: 20.92% (0.0808 => 0.0977, std.dev.: 0.0029) MultiSource/Benchmarks/McCat/08-main/main: 20.85% (0.1218 => 0.1472, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 20.69% (0.3890 => 0.4695, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.69% (0.2736 => 0.3302, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/mst/mst: 20.34% (0.0698 => 0.0840, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/09-vor/vor: 20.20% (0.1505 => 0.1809, std.dev.: 0.0017) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 20.17% (0.0605 => 0.0727, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.91% (0.2014 => 0.2415, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.75% (0.4658 => 0.5578, std.dev.: 0.0025) MultiSource/Benchmarks/MallocBench/gs/gs: 19.73% (1.8794 => 2.2502, std.dev.: 0.0233) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.44% (0.5026 => 0.6003, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.41% (0.1968 => 0.2350, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.40% (0.2866 => 0.3422, std.dev.: 0.0086) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 19.36% (0.5361 => 0.6399, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 19.29% (0.5546 => 0.6616, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.06% (0.0572 => 0.0681, std.dev.: 0.0027) SingleSource/UnitTests/ObjC++/Hello: 19.04% (0.5826 => 0.6935, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 18.85% (0.0573 => 0.0681, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 18.69% (0.1284 => 0.1524, std.dev.: 0.0015) SingleSource/UnitTests/ObjC++/property-reference-object: 18.58% (0.5889 => 0.6983, std.dev.: 0.0003) MultiSource/Applications/d/make_dparser: 18.42% (1.0781 => 1.2767, std.dev.: 0.0045) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.38% (0.0582 => 0.0689, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.32% (3.5627 => 4.2153, std.dev.: 0.0776) SingleSource/Benchmarks/Shootout-C++/sumcol: 18.26% (0.2875 => 0.3400, std.dev.: 0.0047) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.19% (0.1160 => 0.1371, std.dev.: 0.0029) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.09% (1.6211 => 1.9144, std.dev.: 0.0115) SingleSource/Benchmarks/Shootout-C++/methcall: 18.02% (0.2813 => 0.3320, std.dev.: 0.0001) MultiSource/Applications/hbd/hbd: 18.02% (0.9697 => 1.1444, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 17.98% (0.1090 => 0.1286, std.dev.: 0.0013) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.94% (0.3930 => 0.4635, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/objinst: 17.85% (0.2823 => 0.3327, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference: 17.72% (0.7171 => 0.8442, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.70% (1.9694 => 2.3179, std.dev.: 0.0326) SingleSource/Benchmarks/Shootout-C++/except: 17.64% (0.2811 => 0.3307, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/18-imp/imp: 17.59% (0.1421 => 0.1671, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 17.49% (0.2750 => 0.3231, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 17.44% (0.2792 => 0.3279, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 17.41% (0.2780 => 0.3264, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 17.40% (0.4361 => 0.5120, std.dev.: 0.0053) SingleSource/Benchmarks/Shootout-C++/hello: 17.35% (0.2714 => 0.3185, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/office/office: 17.31% (0.2911 => 0.3415, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 17.25% (0.2725 => 0.3195, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.25% (0.3195 => 0.3746, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 17.24% (1.9966 => 2.3409, std.dev.: 0.0334) MultiSource/Benchmarks/Bullet/bullet: 17.22% (23.5202 => 27.5703, std.dev.: 0.0245) MultiSource/Applications/ClamAV/clamscan: 17.20% (4.2109 => 4.9351, std.dev.: 0.1027) SingleSource/Benchmarks/Shootout-C++/ackermann: 17.17% (0.2738 => 0.3208, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/random: 17.16% (0.2803 => 0.3284, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 17.14% (0.9909 => 1.1607, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C++/city/city: 17.12% (2.0673 => 2.4213, std.dev.: 0.0040) SingleSource/Regression/C++/ofstream_ctor: 17.11% (0.3004 => 0.3518, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.06% (4.4195 => 5.1736, std.dev.: 0.0162) SingleSource/Benchmarks/Shootout-C++/nestedloop: 17.00% (0.2729 => 0.3193, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.86% (0.3060 => 0.3576, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 16.80% (0.3267 => 0.3816, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 16.76% (0.3096 => 0.3615, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 16.64% (0.3258 => 0.3800, std.dev.: 0.0004) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.42% (2.7292 => 3.1772, std.dev.: 0.0186) SingleSource/Benchmarks/Shootout-C++/sieve: 16.40% (0.3726 => 0.4337, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 16.37% (0.2566 => 0.2986, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 16.36% (0.3124 => 0.3635, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/ary2: 16.25% (0.3317 => 0.3856, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/lists: 16.22% (0.3348 => 0.3891, std.dev.: 0.0060) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 16.15% (0.3282 => 0.3812, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.08% (0.3625 => 0.4208, std.dev.: 0.0005) MultiSource/Applications/treecc/treecc: 16.05% (0.7875 => 0.9139, std.dev.: 0.0176) SingleSource/Benchmarks/Shootout-C++/lists1: 16.05% (0.3477 => 0.4035, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 16.03% (0.3362 => 0.3901, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/moments: 15.93% (0.3678 => 0.4264, std.dev.: 0.0005) MultiSource/Applications/lua/lua: 15.91% (1.4269 => 1.6539, std.dev.: 0.0023) MultiSource/Benchmarks/sim/sim: 15.70% (0.0758 => 0.0877, std.dev.: 0.0026) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.68% (0.3845 => 0.4448, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash: 15.68% (0.4146 => 0.4796, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.65% (0.3981 => 0.4604, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: 15.64% (0.4251 => 0.4916, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.50% (0.3690 => 0.4262, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/football/football: 15.37% (0.2075 => 0.2394, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++/bigfib: 14.88% (0.5012 => 0.5758, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/instance-method-metadata: 14.85% (0.3488 => 0.4006, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 14.83% (0.3460 => 0.3973, std.dev.: 0.0000) MultiSource/Applications/SPASS/SPASS: 14.76% (5.5417 => 6.3599, std.dev.: 0.0039) SingleSource/UnitTests/ObjC/for-in: 14.76% (0.3496 => 0.4012, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-4: 14.72% (0.3465 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: 14.71% (0.3446 => 0.3953, std.dev.: 0.0003) MultiSource/Applications/JM/ldecod/ldecod: 14.68% (2.1653 => 2.4832, std.dev.: 0.0328) SingleSource/UnitTests/ObjC/synchronized: 14.59% (0.3469 => 0.3975, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 14.58% (0.3442 => 0.3944, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/property: 14.52% (0.3650 => 0.4180, std.dev.: 0.0004) MultiSource/Applications/JM/lencod/lencod: 14.33% (4.6177 => 5.2794, std.dev.: 0.0537) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.30% (0.7426 => 0.8488, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.30% (0.6435 => 0.7355, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/parameter-passing: 14.26% (0.3724 => 0.4255, std.dev.: 0.0004) MultiSource/Applications/SIBsim4/SIBsim4: 14.23% (0.2691 => 0.3074, std.dev.: 0.0058) SingleSource/UnitTests/ObjC/exceptions: 14.19% (0.3643 => 0.4160, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wordfreq: 14.03% (0.2737 => 0.3121, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.91% (0.1028 => 0.1171, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.83% (0.2068 => 0.2354, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.67% (0.1383 => 0.1572, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.38% (0.2040 => 0.2313, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 13.24% (2.1013 => 2.3795, std.dev.: 0.0015) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 13.20% (0.3084 => 0.3491, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 12.92% (0.3336 => 0.3767, std.dev.: 0.0047) MultiSource/Applications/lambda-0_1_3/lambda: 12.89% (0.3498 => 0.3949, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.69% (0.0804 => 0.0906, std.dev.: 0.0002) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.58% (11.6398 => 13.1039, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.46% (0.2103 => 0.2365, std.dev.: 0.0002) MultiSource/Applications/siod/siod: 12.27% (0.6634 => 0.7448, std.dev.: 0.0032) MultiSource/Benchmarks/PAQ8p/paq8p: 11.97% (0.4847 => 0.5427, std.dev.: 0.0004) MultiSource/Applications/lemon/lemon: 10.83% (0.2391 => 0.2650, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 10.47% (2.0346 => 2.2476, std.dev.: 0.0068) SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.45% (4.6926 => 5.1829, std.dev.: 0.0018) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.63% (0.5584 => 0.6066, std.dev.: 0.0007) MultiSource/Applications/kimwitu++/kc: 8.21% (11.9555 => 12.9373, std.dev.: 0.0049) SingleSource/UnitTests/ObjC/block-byref-aggr: 5.27% (0.3792 => 0.3992, std.dev.: 0.0001) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.62% (29.0505 => 181.4559, std.dev.: 0.0382) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 87.28% (0.2162 => 0.4049, std.dev.: 0.0054) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6526, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 17.58% (2.5769 => 3.0298, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0108) MultiSource/Applications/ClamAV/clamscan: 11.74% (0.2802 => 0.3131, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.91% (0.3693 => 0.4059, std.dev.: 0.0048) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.56% (3.3903 => 3.6128, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/objinst: 5.20% (12.0509 => 12.6777, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops: 5.16% (15.4430 => 16.2391, std.dev.: 0.0043) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6916, std.dev.: 0.0035) SingleSource/Benchmarks/Misc/flops-2: 4.31% (1.8057 => 1.8836, std.dev.: 0.0054) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5017, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (15.8721 => 16.2036, std.dev.: 0.0434) MultiSource/Applications/viterbi/viterbi: 1.47% (46.6247 => 47.3087, std.dev.: 0.0116) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2897, std.dev.: 0.0032) MultiSource/Applications/spiff/spiff: 1.25% (4.0317 => 4.0820, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.20% (1.0927 => 1.1058, std.dev.: 0.0020) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5391, std.dev.: 0.0007) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.08% (3.1722 => 3.2066, std.dev.: 0.0017) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6859, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 1.07% (50.0626 => 50.5969, std.dev.: 0.0212) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0001) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4783, std.dev.: 0.0031) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.49% (2.4764 => 2.3900, std.dev.: 0.0217) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.94% (25.4195 => 16.5385, std.dev.: 0.0320) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -16.87% (17.2379 => 14.3291, std.dev.: 0.0230) SingleSource/UnitTests/Vector/multiplies: -11.39% (2.3713 => 2.1013, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -7.74% (0.2402 => 0.2216, std.dev.: 0.0016) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9735, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/salsa20: -7.61% (35.5013 => 32.7999, std.dev.: 0.0031) MultiSource/Benchmarks/Olden/tsp/tsp: -7.25% (2.1113 => 1.9582, std.dev.: 0.0006) SingleSource/Benchmarks/Dhrystone/dry: -5.16% (14.0481 => 13.3238, std.dev.: 0.1326) MultiSource/Applications/sgefa/sgefa: -4.80% (1.5554 => 1.4808, std.dev.: 0.0001) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.78% (41.7953 => 40.2157, std.dev.: 0.0087) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0000) SingleSource/UnitTests/Vector/build2: -3.59% (11.2080 => 10.8052, std.dev.: 0.0066) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.15% (197.4719 => 193.2201, std.dev.: 0.0279) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.79% (10.7630 => 10.5704, std.dev.: 0.0068) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.78% (0.6293 => 0.6181, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4989, std.dev.: 0.0059) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1524, std.dev.: 0.0474) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.07% (16.2163 => 16.0421, std.dev.: 0.0059) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.37s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 17:40:19 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 19:40:19 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130201014019.36F072A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8162?compare_to=8160&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8162, Order: 174116, Start Time: 2013-02-01 00:06:30, End Time: 2013-02-01 01:40:41 To: 8160, Order: 174094, Start Time: 2013-01-31 22:08:53, End Time: 2013-01-31 23:43:02 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 2 (116 on baseline) Performance Improvements: 10 (90 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1092 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 22.96% (7.3686 => 9.0602, std.dev.: 0.0091) SingleSource/Benchmarks/McGill/chomp: 1.21% (1.1521 => 1.1660, std.dev.: 0.0023) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.62% (23.6436 => 23.0233, std.dev.: 0.0104) MultiSource/Applications/SPASS/SPASS: -2.01% (16.2238 => 15.8972, std.dev.: 0.0120) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.98% (5.8619 => 5.7457, std.dev.: 0.0039) MultiSource/Applications/minisat/minisat: -1.43% (0.7775 => 0.7664, std.dev.: 0.0009) MultiSource/Benchmarks/Bullet/bullet: -1.42% (34.7380 => 34.2456, std.dev.: 0.0472) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.34% (2.1694 => 2.1403, std.dev.: 0.0008) MultiSource/Applications/kimwitu++/kc: -1.23% (18.7051 => 18.4745, std.dev.: 0.0069) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.21% (2.8042 => 2.7703, std.dev.: 0.0078) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.18% (0.9952 => 0.9835, std.dev.: 0.0003) MultiSource/Applications/siod/siod: -1.16% (2.4275 => 2.3993, std.dev.: 0.0006) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.85% (0.0717 => 0.1225, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.62% (0.0514 => 0.0877, std.dev.: 0.0014) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.56% (0.0974 => 0.1632, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/neural/neural: 46.33% (0.1500 => 0.2195, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.49% (0.1132 => 0.1613, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.08% (0.6395 => 0.8830, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.50% (0.6395 => 0.8729, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.07% (0.5688 => 0.7569, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.72% (0.5456 => 0.7241, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.65% (0.6260 => 0.8304, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.58% (0.5805 => 0.7696, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.33% (0.5849 => 0.7740, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.10% (0.6230 => 0.8230, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.05% (0.5567 => 0.7351, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.04% (0.5581 => 0.7369, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.98% (0.5575 => 0.7358, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.14% (0.5802 => 0.7609, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.85% (0.5941 => 0.7774, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.74% (0.5705 => 0.7459, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.56% (0.5569 => 0.7271, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.43% (0.5859 => 0.7642, std.dev.: 0.0033) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.38% (0.5570 => 0.7262, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.31% (0.5857 => 0.7632, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.27% (0.5478 => 0.7136, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.17% (0.6033 => 0.7853, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.92% (1.6474 => 2.1403, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.75% (0.6440 => 0.8356, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.74% (0.5591 => 0.7254, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.20% (0.5925 => 0.7655, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.97% (0.6189 => 0.7982, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.86% (0.6676 => 0.8603, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.71% (0.5863 => 0.7546, std.dev.: 0.0042) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.39% (0.6304 => 0.8094, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.04% (0.6052 => 0.7749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.04% (0.0699 => 0.0895, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.96% (0.6446 => 0.8248, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.41% (0.6681 => 0.8512, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.27% (0.6194 => 0.7883, std.dev.: 0.0154) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.03% (0.6660 => 0.8460, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.87% (0.6297 => 0.7989, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.56% (0.6667 => 0.8371, std.dev.: 0.0018) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 24.23% (0.0582 => 0.0723) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.18% (0.7524 => 0.9343, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.63% (0.7339 => 0.9073, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.42% (0.0790 => 0.0975, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.65% (2.2587 => 2.7703, std.dev.: 0.0078) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.86% (0.0622 => 0.0758, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.74% (0.0621 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.09% (0.0634 => 0.0755, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.35% (0.0556 => 0.0658, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 18.02% (0.0566 => 0.0668, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.89% (0.0833 => 0.0982) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: 16.65% (0.3357 => 0.3916, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787, std.dev.: 0.0000) MultiSource/Applications/lemon/lemon: 15.41% (1.1450 => 1.3215, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.26% (0.1081 => 0.1246, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.17% (0.1982 => 0.2243, std.dev.: 0.0000) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.88% (4.5069 => 5.0874, std.dev.: 0.0116) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.65% (0.4916 => 0.5538, std.dev.: 0.0045) MultiSource/Benchmarks/McCat/05-eks/eks: 12.43% (0.4515 => 0.5076, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.34% (1.6364 => 1.8384, std.dev.: 0.0098) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.03% (3.5339 => 3.9591, std.dev.: 0.0043) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.82% (0.2385 => 0.2643, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.38% (9.2283 => 10.1865, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.71% (0.5329 => 0.5793, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.70% (0.2001 => 0.2175, std.dev.: 0.0002) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.62% (0.1230 => 0.1336, std.dev.: 0.0001) MultiSource/Applications/Burg/burg: 8.49% (1.2515 => 1.3578, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 8.38% (0.4524 => 0.4903, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.25% (0.7021 => 0.7600, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.15% (0.1731 => 0.1872, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.87% (1.2784 => 1.3790, std.dev.: 0.0033) SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4861 => 0.5235, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.57% (1.4642 => 1.5751, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 6.36% (0.3255 => 0.3462, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 6.34% (0.6750 => 0.7178, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 6.33% (0.1879 => 0.1998, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.45% (0.3319 => 0.3500, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.07% (5.4682 => 5.7457, std.dev.: 0.0039) MultiSource/Applications/oggenc/oggenc: 3.67% (5.0226 => 5.2067, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/ary3: 3.45% (0.3446 => 0.3565, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary: 3.42% (0.3394 => 0.3510, std.dev.: 0.0002) MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.3864 => 1.4329, std.dev.: 0.0015) MultiSource/Applications/spiff/spiff: 3.09% (0.8418 => 0.8678, std.dev.: 0.0023) MultiSource/Applications/minisat/minisat: 2.91% (0.7447 => 0.7664, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.91% (0.9557 => 0.9835, std.dev.: 0.0003) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.76% (22.4056 => 23.0233, std.dev.: 0.0104) SingleSource/Benchmarks/Shootout-C++/spellcheck: 2.58% (0.4427 => 0.4541, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 2.51% (15.5079 => 15.8972, std.dev.: 0.0120) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.36% (0.5168 => 0.5290, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.3722 => 1.4043, std.dev.: 0.0074) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.25% (1.2300 => 1.2454, std.dev.: 0.0033) MultiSource/Applications/d/make_dparser: 1.21% (3.5154 => 3.5578, std.dev.: 0.0006) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.85% (31.3723 => 55.7963, std.dev.: 0.0079) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0022) SingleSource/Regression/C/uint64_to_float: 7.55% (0.5692 => 0.6122, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1482, std.dev.: 0.0016) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.69% (54.5751 => 56.5867, std.dev.: 0.0151) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1410, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.67% (2.0478 => 2.1024, std.dev.: 0.0093) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3040, std.dev.: 0.0016) MultiSource/Benchmarks/sim/sim: 1.55% (4.8812 => 4.9567, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.53% (18.2231 => 18.5027, std.dev.: 0.0113) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.43% (5.1955 => 5.2696, std.dev.: 0.0055) MultiSource/Applications/sqlite3/sqlite3: 1.42% (4.5320 => 4.5964, std.dev.: 0.0010) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.10% (0.1281 => 0.1126, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: -4.79% (0.3194 => 0.3041, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.7198 => 0.6904, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -3.83% (0.3812 => 0.3666, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-4: -3.71% (0.3880 => 0.3736, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -3.68% (0.3831 => 0.3690, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/synchronized: -3.67% (0.3896 => 0.3753, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -3.66% (0.3848 => 0.3707, std.dev.: 0.0003) MultiSource/Benchmarks/PAQ8p/paq8p: -3.60% (2.4924 => 2.4027, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: -3.60% (0.4033 => 0.3888, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.57% (0.3837 => 0.3700, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.55% (0.3891 => 0.3753, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions: -3.45% (0.4176 => 0.4032, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.31% (0.6347 => 0.6137, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.27% (0.3821 => 0.3696, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.19% (0.3884 => 0.3760, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.18% (0.9852 => 0.9539, std.dev.: 0.0121) SingleSource/UnitTests/ObjC++/property-reference-object: -3.03% (0.6441 => 0.6246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/property: -2.74% (0.4199 => 0.4084, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.67% (0.7779 => 0.7571, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/city/city: -2.50% (2.1713 => 2.1171, std.dev.: 0.0018) MultiSource/Applications/hexxagon/hexxagon: -2.47% (1.3148 => 1.2823, std.dev.: 0.0017) SingleSource/UnitTests/ObjC/parameter-passing: -2.43% (0.4280 => 0.4176, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.29% (20.7746 => 20.2987, std.dev.: 0.0183) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.24% (0.6484 => 0.6339, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.92% (0.9542 => 0.9359, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.74% (14.2083 => 13.9607, std.dev.: 0.0050) MultiSource/Applications/sqlite3/sqlite3: -1.31% (17.1032 => 16.8785, std.dev.: 0.0054) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.14% (6.7716 => 6.6943, std.dev.: 0.0041) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.04% (1.0544 => 1.0434, std.dev.: 0.0013) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.16% (1.8100 => 0.6849, std.dev.: 0.0229) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.09% (0.6962 => 0.3405, std.dev.: 0.0010) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -34.00% (8.0445 => 5.3097, std.dev.: 0.0028) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.49% (0.1983 => 0.1418, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.69% (0.2151 => 0.1577, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2495, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/mandel-2: -24.67% (1.3643 => 1.0277, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7514, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3641, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4503, std.dev.: 0.0043) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.78% (0.2274 => 0.1756, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/ary2: -22.62% (0.0756 => 0.0585, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.85% (4.1024 => 3.2059, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.84% (5.3397 => 4.1733, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.65% (1.2237 => 0.9588, std.dev.: 0.0004) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.20% (0.3418 => 0.2830, std.dev.: 0.0006) SingleSource/UnitTests/Vector/multiplies: -15.29% (2.5106 => 2.1267, std.dev.: 0.0019) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.10% (0.4092 => 0.3515, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0923, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.28% (4.9100 => 4.3560, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7481, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.13% (0.5142 => 0.4621, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/richards_benchmark: -8.99% (1.2842 => 1.1688, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8199, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.66% (7.1848 => 6.6341, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0005) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.12% (5.3830 => 5.1073, std.dev.: 0.0024) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6994, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fbench: -3.86% (2.2633 => 2.1759, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.4001, std.dev.: 0.0011) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -3.03% (7.9763 => 7.7350, std.dev.: 0.0265) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout/ary3: -2.31% (3.7241 => 3.6382, std.dev.: 0.0304) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.25% (3.1919 => 3.1202, std.dev.: 0.0001) MultiSource/Benchmarks/Bullet/bullet: -1.81% (7.3040 => 7.1721, std.dev.: 0.0120) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.60% (6.5735 => 6.4680, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7082, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0853, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7092 => 3.6590, std.dev.: 0.0156) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.31% (1.6086 => 1.5875, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.17% (1.6219 => 1.6029, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.03% (4.8776 => 4.8272, std.dev.: 0.0100) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1783, std.dev.: 0.0003) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.13s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 17:44:04 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 19:44:04 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130201014404.09D902A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8163?compare_to=8158&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8163, Order: 174108, Start Time: 2013-01-31 23:34:37, End Time: 2013-02-01 01:44:29 To: 8158, Order: 174085, Start Time: 2013-01-31 21:08:11, End Time: 2013-01-31 23:14:06 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 55 (111 on baseline) Performance Improvements: 2 (40 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1007 (912 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: 67.76% (0.0791 => 0.1327, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/family/family: 53.79% (0.0448 => 0.0689, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 47.47% (0.0990 => 0.1460, std.dev.: 0.0122) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 46.94% (0.0914 => 0.1343, std.dev.: 0.0064) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 36.49% (0.0496 => 0.0677, std.dev.: 0.0062) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 35.12% (0.6657 => 0.8995, std.dev.: 0.0410) SingleSource/UnitTests/Vector/constpool: 30.11% (9.0729 => 11.8051, std.dev.: 0.9464) MultiSource/Benchmarks/MallocBench/gs/gs: 22.25% (4.5718 => 5.5892, std.dev.: 0.2854) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.14% (0.2142 => 0.2552, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.94% (9.5927 => 11.4092, std.dev.: 0.2205) SingleSource/Benchmarks/Stanford/Puzzle: 14.45% (0.1107 => 0.1267, std.dev.: 0.0051) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.49% (0.7945 => 0.8937, std.dev.: 0.0318) MultiSource/Applications/sqlite3/sqlite3: 11.30% (16.5478 => 18.4171, std.dev.: 0.1625) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.98% (5.8667 => 6.4520, std.dev.: 0.0218) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 9.41% (1.3955 => 1.5268, std.dev.: 0.0389) MultiSource/Benchmarks/Bullet/bullet: 9.03% (35.0945 => 38.2624, std.dev.: 1.1705) MultiSource/Applications/kimwitu++/kc: 7.78% (18.7741 => 20.2346, std.dev.: 0.1577) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.66% (1.9513 => 2.1008, std.dev.: 0.0268) MultiSource/Benchmarks/7zip/7zip-benchmark: 7.57% (47.6751 => 51.2857, std.dev.: 1.2332) MultiSource/Applications/ClamAV/clamscan: 7.20% (16.4602 => 17.6461, std.dev.: 0.1587) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.00% (14.9807 => 16.0289, std.dev.: 0.2061) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.87% (2.6675 => 2.8507, std.dev.: 0.0246) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.75% (1.3023 => 1.3902, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.75% (1.3417 => 1.4322, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.70% (1.2744 => 1.3598, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.43% (1.3556 => 1.4427, std.dev.: 0.0091) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.56% (1.2635 => 1.3338, std.dev.: 0.0055) SingleSource/Benchmarks/Misc/himenobmtxpa: 4.83% (0.2132 => 0.2235, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.42% (0.9359 => 0.9773, std.dev.: 0.0122) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.6258 => 0.6521, std.dev.: 0.0030) MultiSource/Benchmarks/sim/sim: 3.91% (0.3661 => 0.3804, std.dev.: 0.0009) MultiSource/Applications/JM/ldecod/ldecod: 2.06% (7.4409 => 7.5940, std.dev.: 0.0592) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.37% (1.3163 => 1.3343, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 46.88% (0.8682 => 1.2752, std.dev.: 0.0277) MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.81% (0.0906 => 0.1321, std.dev.: 0.0025) SingleSource/Benchmarks/CoyoteBench/fftbench: 45.63% (1.4636 => 2.1314, std.dev.: 0.0777) SingleSource/Benchmarks/Shootout/ary3: 40.55% (8.5551 => 12.0239, std.dev.: 0.7826) MultiSource/Benchmarks/Fhourstones/fhourstones: 28.70% (1.2679 => 1.6318, std.dev.: 0.0465) SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.18% (4.4954 => 5.7620, std.dev.: 0.1070) SingleSource/Benchmarks/Shootout/heapsort: 24.30% (3.1420 => 3.9056, std.dev.: 0.2833) MultiSource/Applications/minisat/minisat: 24.00% (6.2623 => 7.7651, std.dev.: 0.2170) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.25% (0.3290 => 0.3693, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout/hash: 7.61% (4.0398 => 4.3471, std.dev.: 0.0125) MultiSource/Benchmarks/llubenchmark/llu: 7.12% (2.0215 => 2.1655, std.dev.: 0.0115) MultiSource/Benchmarks/VersaBench/dbms/dbms: 6.23% (2.5873 => 2.7484, std.dev.: 0.0356) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.91% (41.2723 => 43.7095, std.dev.: 0.2284) MultiSource/Benchmarks/Bullet/bullet: 5.64% (7.1082 => 7.5090, std.dev.: 0.0665) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.27% (60.1495 => 62.7158, std.dev.: 0.5247) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.15% (1.3919 => 1.4496, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.00% (5.7434 => 5.9732, std.dev.: 0.0172) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.08% (39.1351 => 40.3421, std.dev.: 0.1353) MultiSource/Applications/lua/lua: 2.98% (28.3924 => 29.2376, std.dev.: 0.2540) SingleSource/Benchmarks/Misc/pi: 2.11% (2.1651 => 2.2108, std.dev.: 0.0034) SingleSource/UnitTests/Vector/multiplies: 1.96% (0.5556 => 0.5665, std.dev.: 0.0007) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.32% (4.7046 => 4.7665, std.dev.: 0.0215) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.96% (2.3858 => 2.3391, std.dev.: 0.0107) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.61% (2.5808 => 2.5393, std.dev.: 0.0055) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 4.52% (1.2299 => 1.2855, std.dev.: 0.0708) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 7.59% (0.0224 => 0.0241, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.14% (0.0434 => 0.0465, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: 8.88% (0.0338 => 0.0368, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 5.57% (0.0323 => 0.0341, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.62% (0.0433 => 0.0466, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 13.40% (0.0209 => 0.0237, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: 2.61% (0.0230 => 0.0236, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.20% (0.0251 => 0.0248, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -38.46% (0.0013 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 18.59% (0.1442 => 0.1710, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: 4.94% (1.1826 => 1.2410, std.dev.: 0.3008) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.53% (0.3908 => 0.4124, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.72% (0.1504 => 0.1560, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.81% (0.0683 => 0.0616, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.59% (0.0270 => 0.0236, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 4.35% (0.0552 => 0.0576, std.dev.: 0.0022) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.20% (1.2837 => 1.2863, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.49% (0.0611 => 0.0608, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -12.30% (0.0374 => 0.0328, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.37% (1.7436 => 1.7500, std.dev.: 0.0381) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -49.18% (0.0122 => 0.0062, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -0.33% (34.5077 => 34.3932, std.dev.: 0.1120) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 410.71% (0.0336 => 0.1716, std.dev.: 0.0015) MultiSource/Benchmarks/McCat/17-bintr/bintr: 71.23% (0.0775 => 0.1327, std.dev.: 0.0022) MultiSource/Benchmarks/Prolangs-C++/family/family: 58.03% (0.0436 => 0.0689, std.dev.: 0.0030) SingleSource/Regression/C/sumarray: 55.85% (0.0265 => 0.0413, std.dev.: 0.0014) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 53.52% (0.8926 => 1.3703, std.dev.: 0.0430) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 52.96% (0.0878 => 0.1343, std.dev.: 0.0064) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 52.71% (0.9998 => 1.5268, std.dev.: 0.0389) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 52.43% (0.9120 => 1.3902, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 51.28% (0.9612 => 1.4541, std.dev.: 0.0425) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 50.85% (0.9564 => 1.4427, std.dev.: 0.0091) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 49.90% (0.0974 => 0.1460, std.dev.: 0.0122) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 49.58% (0.9091 => 1.3598, std.dev.: 0.0291) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 49.52% (0.9403 => 1.4059, std.dev.: 0.1011) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 49.02% (0.9061 => 1.3503, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 48.39% (0.9588 => 1.4228, std.dev.: 0.0614) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 48.36% (0.8990 => 1.3338, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 45.59% (0.8732 => 1.2713, std.dev.: 0.0501) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 44.51% (0.8893 => 1.2851, std.dev.: 0.0347) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 43.45% (0.9381 => 1.3457, std.dev.: 0.0704) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 42.98% (1.0017 => 1.4322, std.dev.: 0.0025) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 42.91% (0.9010 => 1.2876, std.dev.: 0.0228) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 42.57% (0.9507 => 1.3554, std.dev.: 0.0423) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 42.12% (0.9422 => 1.3391, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 41.63% (0.9512 => 1.3472, std.dev.: 0.0618) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 41.34% (0.0479 => 0.0677, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 41.21% (0.8912 => 1.2585, std.dev.: 0.0681) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 41.15% (0.8736 => 1.2331, std.dev.: 0.0265) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.66% (0.9855 => 1.3862, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 40.36% (1.0052 => 1.4109, std.dev.: 0.0270) MultiSource/Benchmarks/FreeBench/mason/mason: 39.60% (0.0793 => 0.1107, std.dev.: 0.0120) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 37.05% (0.9488 => 1.3003, std.dev.: 0.0325) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 36.84% (0.9788 => 1.3394, std.dev.: 0.0392) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 36.57% (0.9867 => 1.3475, std.dev.: 0.0692) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 35.67% (0.9993 => 1.3558, std.dev.: 0.0447) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 35.42% (0.9685 => 1.3115, std.dev.: 0.1110) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 35.32% (0.9127 => 1.2351, std.dev.: 0.0449) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 34.41% (0.9405 => 1.2641, std.dev.: 0.0203) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.96% (1.0088 => 1.3413, std.dev.: 0.0785) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 31.76% (1.0860 => 1.4309, std.dev.: 0.0659) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.95% (0.9550 => 1.2506, std.dev.: 0.0349) MultiSource/Applications/sgefa/sgefa: 23.93% (0.3598 => 0.4459, std.dev.: 0.0041) MultiSource/Benchmarks/MallocBench/gs/gs: 21.67% (4.5936 => 5.5892, std.dev.: 0.2854) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 20.18% (0.0669 => 0.0804, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.52% (3.6295 => 4.3380, std.dev.: 0.1724) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.50% (0.5369 => 0.6416, std.dev.: 0.0385) MultiSource/Benchmarks/mafft/pairlocalalign: 19.47% (9.5202 => 11.3741, std.dev.: 0.5832) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 19.03% (0.2144 => 0.2552, std.dev.: 0.0079) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.03% (0.7686 => 0.8995, std.dev.: 0.0410) SingleSource/Benchmarks/Misc/ReedSolomon: 16.88% (0.2050 => 0.2396, std.dev.: 0.0068) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.26% (2.4519 => 2.8507, std.dev.: 0.0246) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 16.17% (0.7693 => 0.8937, std.dev.: 0.0318) MultiSource/Benchmarks/7zip/7zip-benchmark: 16.15% (44.1538 => 51.2857, std.dev.: 1.2332) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.89% (1.8127 => 2.1008, std.dev.: 0.0268) MultiSource/Benchmarks/Bullet/bullet: 15.10% (33.2440 => 38.2624, std.dev.: 1.1705) SingleSource/Benchmarks/Stanford/Puzzle: 14.87% (0.1103 => 0.1267, std.dev.: 0.0051) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.60% (0.1240 => 0.1421, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/himenobmtxpa: 14.32% (0.1955 => 0.2235, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 13.71% (0.2385 => 0.2712, std.dev.: 0.0038) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.88% (1.4110 => 1.5928, std.dev.: 0.0526) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.75% (23.5861 => 26.5943, std.dev.: 0.9033) MultiSource/Applications/minisat/minisat: 12.19% (0.7776 => 0.8724, std.dev.: 0.0325) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.09% (10.2703 => 11.4092, std.dev.: 0.2205) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.09% (1.8651 => 2.0719, std.dev.: 0.0344) SingleSource/UnitTests/SignlessTypes/rem: 10.32% (0.1163 => 0.1283, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/bigfib: 7.96% (0.6711 => 0.7245, std.dev.: 0.0097) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.03% (14.9757 => 16.0289, std.dev.: 0.2061) MultiSource/Applications/kimwitu++/kc: 6.85% (18.9377 => 20.2346, std.dev.: 0.1577) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 6.29% (0.6135 => 0.6521, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/ary3: 4.95% (0.2564 => 0.2691, std.dev.: 0.0034) MultiSource/Applications/sqlite3/sqlite3: 4.86% (17.5634 => 18.4171, std.dev.: 0.1625) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.78% (0.2993 => 0.3106, std.dev.: 0.0017) MultiSource/Applications/JM/lencod/lencod: 3.39% (16.7012 => 17.2673, std.dev.: 0.1804) MultiSource/Applications/JM/ldecod/ldecod: 3.28% (7.3529 => 7.5940, std.dev.: 0.0592) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107187.50% (0.0008 => 0.8583, std.dev.: 0.0306) SingleSource/Benchmarks/Shootout/ary3: 439.09% (2.2304 => 12.0239, std.dev.: 0.7826) SingleSource/Benchmarks/Shootout/matrix: 354.69% (1.5825 => 7.1954, std.dev.: 0.1680) MultiSource/Applications/sgefa/sgefa: 257.75% (0.3515 => 1.2575, std.dev.: 0.0026) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 241.82% (1.1825 => 4.0420, std.dev.: 0.0133) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 233.44% (4.8185 => 16.0667, std.dev.: 0.0624) SingleSource/Benchmarks/Shootout-C++/ary2: 217.05% (0.0129 => 0.0409, std.dev.: 0.0063) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 202.63% (0.0228 => 0.0690, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/ary: 148.28% (0.0232 => 0.0576, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/matrix: 63.37% (2.9083 => 4.7513, std.dev.: 0.0125) MultiSource/Benchmarks/McCat/17-bintr/bintr: 45.64% (0.0907 => 0.1321, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.57% (0.2562 => 0.3422, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.55% (3.1254 => 4.1115, std.dev.: 0.0066) SingleSource/Benchmarks/CoyoteBench/fftbench: 28.81% (1.6547 => 2.1314, std.dev.: 0.0777) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.55% (1.4588 => 1.8607, std.dev.: 0.0461) SingleSource/Regression/C/uint64_to_float: 23.90% (1.5397 => 1.9077, std.dev.: 0.0034) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.49% (5.6033 => 6.9196, std.dev.: 0.1019) SingleSource/Benchmarks/Misc/salsa20: 22.58% (7.4497 => 9.1319, std.dev.: 0.1660) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.52% (4.8112 => 5.7985, std.dev.: 0.0205) MultiSource/Benchmarks/Ptrdist/ft/ft: 17.90% (1.0816 => 1.2752, std.dev.: 0.0277) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.28% (5.0421 => 5.7620, std.dev.: 0.1070) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.29% (5.1752 => 5.8630, std.dev.: 0.0396) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.15% (5.0033 => 5.6614, std.dev.: 0.0023) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.30% (3.6477 => 3.9870, std.dev.: 0.0206) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.13% (2.2499 => 2.4329, std.dev.: 0.0311) SingleSource/Benchmarks/Misc/ReedSolomon: 8.10% (8.6447 => 9.3449, std.dev.: 0.1074) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.25% (4.7473 => 5.0914, std.dev.: 0.0259) MultiSource/Benchmarks/llubenchmark/llu: 6.69% (2.0298 => 2.1655, std.dev.: 0.0115) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.32% (4.1836 => 4.4063, std.dev.: 0.0085) SingleSource/Benchmarks/Linpack/linpack-pc: 4.45% (50.8945 => 53.1607, std.dev.: 0.8210) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.41% (5.0310 => 5.2530, std.dev.: 0.0501) MultiSource/Benchmarks/Bullet/bullet: 4.23% (7.2040 => 7.5090, std.dev.: 0.0665) SingleSource/Benchmarks/Misc/pi: 3.36% (2.1390 => 2.2108, std.dev.: 0.0034) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.28% (42.3194 => 43.7095, std.dev.: 0.2284) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.23% (4.7254 => 4.8780, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.75% (61.0379 => 62.7158, std.dev.: 0.5247) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.31% (5.9115 => 5.9887, std.dev.: 0.0215) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.04% (6.8135 => 6.8841, std.dev.: 0.0041) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -32.87% (0.0727 => 0.0488, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -18.23% (0.1684 => 0.1377, std.dev.: 0.0043) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.83% (1.0960 => 0.9773, std.dev.: 0.0122) MultiSource/Applications/siod/siod: -3.88% (2.6437 => 2.5410, std.dev.: 0.0306) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.82% (11.5523 => 3.9482, std.dev.: 0.0428) SingleSource/Benchmarks/Misc/fp-convert: -61.73% (15.6525 => 5.9903, std.dev.: 0.0552) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -55.60% (0.4146 => 0.1841, std.dev.: 0.0074) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.25% (0.4578 => 0.2369, std.dev.: 0.0056) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.77% (11.3868 => 6.4031, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.87% (5.4023 => 3.6266, std.dev.: 0.0022) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.00% (0.4452 => 0.3072, std.dev.: 0.0144) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.06% (0.5495 => 0.4063, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.02% (5.2605 => 3.8918, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.07% (4.4467 => 3.3319, std.dev.: 0.0068) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.55% (0.5826 => 0.4396, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.94% (0.5897 => 0.4485, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.33% (4.9921 => 3.8273, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.31% (5.8755 => 4.7999, std.dev.: 0.0059) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.77% (16.6791 => 14.2157, std.dev.: 0.2374) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.69% (7.0016 => 5.9732, std.dev.: 0.0172) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.12% (3.1921 => 2.7734, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.76% (5.3626 => 4.6782, std.dev.: 0.0052) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.13% (9.7992 => 8.6103, std.dev.: 0.0139) MultiSource/Benchmarks/mafft/pairlocalalign: -8.99% (63.1520 => 57.4746, std.dev.: 0.2045) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.27% (0.3217 => 0.2983, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/lists1: -6.89% (0.6628 => 0.6171, std.dev.: 0.0160) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.50% (5.5974 => 5.2338, std.dev.: 0.0796) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.15% (4.5424 => 4.2630, std.dev.: 0.0045) MultiSource/Applications/SIBsim4/SIBsim4: -6.07% (3.5443 => 3.3292, std.dev.: 0.0250) SingleSource/Benchmarks/McGill/queens: -5.54% (1.7443 => 1.6477, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.28% (4.2843 => 4.0583, std.dev.: 0.0811) SingleSource/Benchmarks/Shootout-C++/hash2: -4.75% (3.6768 => 3.5020, std.dev.: 0.0064) MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.50% (2.8778 => 2.7484, std.dev.: 0.0356) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.33% (3.5127 => 3.3605, std.dev.: 0.0064) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.29% (4.9799 => 4.7665, std.dev.: 0.0215) SingleSource/Benchmarks/Shootout/hash: -3.95% (4.5259 => 4.3471, std.dev.: 0.0125) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.44% (5.8973 => 5.6946, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.38% (3.5691 => 3.4485, std.dev.: 0.0281) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.79% (8.7327 => 8.5761, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.03% (3.7450 => 3.7064, std.dev.: 0.0073) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 6.71% (1.2047 => 1.2855, std.dev.: 0.0708) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 3.43% (0.0233 => 0.0241, std.dev.: 0.0062) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.10% (0.0451 => 0.0465, std.dev.: 0.0135) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.60% (0.0394 => 0.0368, std.dev.: 0.0089) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 3.96% (0.0328 => 0.0341, std.dev.: 0.0044) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 4.72% (0.0445 => 0.0466, std.dev.: 0.0030) SingleSource/UnitTests/Vector/Altivec/casts: 11.27% (0.0213 => 0.0237, std.dev.: 0.0025) SingleSource/UnitTests/Vector/Altivec/test1: 3.96% (0.0227 => 0.0236, std.dev.: 0.0074) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.75% (0.0255 => 0.0248, std.dev.: 0.0065) MultiSource/Applications/Burg/burg: -46.67% (0.0015 => 0.0008, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 11.76% (0.1530 => 0.1710, std.dev.: 0.0128) MultiSource/Applications/lemon/lemon: -35.68% (1.9293 => 1.2410, std.dev.: 0.3008) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 1.85% (0.4049 => 0.4124, std.dev.: 0.0177) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.31% (0.1510 => 0.1560, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -37.01% (0.0978 => 0.0616, std.dev.: 0.0058) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.49% (0.0276 => 0.0236, std.dev.: 0.0017) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -2.37% (0.0590 => 0.0576, std.dev.: 0.0022) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.73% (1.1617 => 1.2863, std.dev.: 0.0022) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -6.25% (0.0032 => 0.0030, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0610 => 0.0608, std.dev.: 0.0125) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.39% (0.0268 => 0.0328, std.dev.: 0.0019) SingleSource/Benchmarks/BenchmarkGame/puzzle: 135.31% (0.7437 => 1.7500, std.dev.: 0.0381) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/Large/cast: -32.61% (0.0092 => 0.0062, std.dev.: 0.0057) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.16% (12.7781 => 34.3932, std.dev.: 0.1120) Report Time: 0.86s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 18:08:51 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 20:08:51 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130201020851.E458A2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8164?compare_to=8159&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8164, Order: 174111, Start Time: 2013-01-31 23:56:34, End Time: 2013-02-01 02:08:37 To: 8159, Order: 174085, Start Time: 2013-01-31 21:13:26, End Time: 2013-01-31 23:25:43 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 1 (227 on baseline) Performance Improvements: 13 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1086 (646 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: 3.09% (0.6498 => 0.6699, std.dev.: 0.0020) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.84% (39.3158 => 37.8062, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.96% (6.5976 => 6.4680, std.dev.: 0.0067) MultiSource/Applications/SPASS/SPASS: -1.79% (18.9657 => 18.6269, std.dev.: 0.0094) MultiSource/Applications/minisat/minisat: -1.60% (0.9089 => 0.8944, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.52% (2.5097 => 2.4715, std.dev.: 0.0081) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.52% (0.8958 => 0.8822, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.48% (0.6949 => 0.6846, std.dev.: 0.0014) MultiSource/Applications/siod/siod: -1.30% (2.7548 => 2.7191, std.dev.: 0.0042) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.21% (0.9474 => 0.9359, std.dev.: 0.0032) MultiSource/Applications/Burg/burg: -1.07% (1.5579 => 1.5412, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.05% (1.1395 => 1.1275, std.dev.: 0.0012) MultiSource/Applications/lua/lua: -1.02% (4.6868 => 4.6392, std.dev.: 0.0105) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Misc/fbench: -1.05% (2.3086 => 2.2844, std.dev.: 0.0056) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1328 => 0.1327, std.dev.: 0.0012) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -0.24% (0.0418 => 0.0417, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.10% (0.0678 => 0.0657, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/power/power: -0.00% (499.8493 => 499.8445, std.dev.: 0.0085) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0417, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/power/power: 44224.24% (1.1277 => 499.8445, std.dev.: 0.0085) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 224.88% (0.5229 => 1.6988, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 24.27% (14.9895 => 18.6269, std.dev.: 0.0094) MultiSource/Applications/kimwitu++/kc: 46.06% (14.1553 => 20.6755, std.dev.: 0.0064) MultiSource/Benchmarks/MallocBench/gs/gs: 20.04% (4.1105 => 4.9342, std.dev.: 0.0117) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 61.06% (1.1048 => 1.7794, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 428.15% (7.1582 => 37.8062, std.dev.: 0.0019) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.78% (3.4629 => 6.4680, std.dev.: 0.0067) SingleSource/Benchmarks/Misc-C++/stepanov_container: 81.21% (0.6222 => 1.1275, std.dev.: 0.0012) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10242.08% (0.0720 => 7.4463, std.dev.: 0.0025) MultiSource/Applications/SIBsim4/SIBsim4: 3833900.00% (0.0001 => 3.8340, std.dev.: 0.0004) MultiSource/Applications/SPASS/SPASS: 11103700.00% (0.0001 => 11.1038, std.dev.: 0.0311) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/gs/gs: 63200.00% (0.0001 => 0.0633, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575700.00% (0.0001 => 0.5758, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9851000.00% (0.0001 => 9.8511, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5493900.00% (0.0001 => 5.4940, std.dev.: 0.0012) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.68% (1.1194 => 10.2277, std.dev.: 0.0458) MultiSource/Applications/ClamAV/clamscan: 149.94% (22.1758 => 55.4261, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/lowercase: 130.47% (0.0256 => 0.0590, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.58% (0.0929 => 0.1882, std.dev.: 0.0001) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 79.63% (0.1463 => 0.2628, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 71.59% (0.0271 => 0.0465, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/almabench: 66.99% (0.0730 => 0.1219, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 65.74% (0.0394 => 0.0653, std.dev.: 0.0001) SingleSource/Regression/C/sumarray: 58.44% (0.0231 => 0.0366, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 57.94% (2.9384 => 4.6408, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.84% (1.5859 => 2.4715, std.dev.: 0.0081) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.42% (7.0540 => 10.8930, std.dev.: 0.0119) MultiSource/Benchmarks/FreeBench/distray/distray: 51.99% (0.1056 => 0.1605, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.70% (8.1363 => 12.1799, std.dev.: 0.0044) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 46.39% (2.2024 => 3.2241, std.dev.: 0.0044) MultiSource/Applications/sgefa/sgefa: 44.74% (0.3109 => 0.4500, std.dev.: 0.0004) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.65% (0.0439 => 0.0635, std.dev.: 0.0009) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 40.43% (0.1432 => 0.2011, std.dev.: 0.0010) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.11% (0.1062 => 0.1488, std.dev.: 0.0001) MultiSource/Applications/JM/lencod/lencod: 39.80% (21.9371 => 30.6684, std.dev.: 0.0070) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 37.47% (1.5415 => 2.1191, std.dev.: 0.0040) MultiSource/Benchmarks/MallocBench/espresso/espresso: 37.03% (4.2646 => 5.8438, std.dev.: 0.0080) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.71% (0.4615 => 0.6263, std.dev.: 0.0010) SingleSource/Benchmarks/McGill/exptree: 35.38% (0.0814 => 0.1102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.96% (0.2271 => 0.3065, std.dev.: 0.0025) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 34.10% (0.5105 => 0.6846, std.dev.: 0.0014) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 34.09% (0.1892 => 0.2537, std.dev.: 0.0048) MultiSource/Benchmarks/McCat/05-eks/eks: 32.78% (0.4299 => 0.5708, std.dev.: 0.0007) MultiSource/Applications/Burg/burg: 32.38% (1.1642 => 1.5412, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.16% (0.6675 => 0.8822, std.dev.: 0.0006) MultiSource/Benchmarks/NPB-serial/is/is: 31.99% (0.0719 => 0.0949, std.dev.: 0.0000) SingleSource/Benchmarks/Stanford/Oscar: 31.29% (0.0636 => 0.0835, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 30.51% (0.1655 => 0.2160, std.dev.: 0.0013) MultiSource/Benchmarks/mafft/pairlocalalign: 30.19% (9.4845 => 12.3477, std.dev.: 0.0100) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 29.69% (0.1125 => 0.1459, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.02% (0.0479 => 0.0618, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.90% (3.8922 => 5.0169, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.69% (0.0746 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.50% (0.0793 => 0.1019, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/hash: 28.14% (0.4289 => 0.5496, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 27.79% (0.0457 => 0.0584, std.dev.: 0.0021) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 27.79% (0.1695 => 0.2166, std.dev.: 0.0012) MultiSource/Applications/lemon/lemon: 27.78% (1.0722 => 1.3701, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.67% (0.1337 => 0.1707, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.49% (1.4186 => 1.8086, std.dev.: 0.0024) MultiSource/Benchmarks/McCat/08-main/main: 27.45% (0.2554 => 0.3255, std.dev.: 0.0011) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.96% (0.0408 => 0.0518, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.71% (0.1906 => 0.2415, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.66% (0.3121 => 0.3953, std.dev.: 0.0036) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/hash2: 26.45% (0.4620 => 0.5842, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/tsp/tsp: 26.13% (0.1175 => 0.1482, std.dev.: 0.0003) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.12% (0.1566 => 0.1975, std.dev.: 0.0019) MultiSource/Applications/minisat/minisat: 25.71% (0.7115 => 0.8944, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.30% (0.0672 => 0.0842, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.21% (0.0730 => 0.0914, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.92% (0.5020 => 0.6271, std.dev.: 0.0033) SingleSource/Benchmarks/Misc/whetstone: 24.85% (0.0660 => 0.0824, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 24.80% (0.6456 => 0.8057, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/mst/mst: 24.76% (0.1163 => 0.1451, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 24.54% (0.0485 => 0.0604, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.27% (0.1236 => 0.1536, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.23% (1.3050 => 1.6212, std.dev.: 0.0019) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0002) MultiSource/Applications/viterbi/viterbi: 23.99% (0.1555 => 0.1928, std.dev.: 0.0040) MultiSource/Applications/spiff/spiff: 23.78% (0.7835 => 0.9698, std.dev.: 0.0089) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.77% (0.0871 => 0.1078, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.64% (0.1032 => 0.1276, std.dev.: 0.0008) MultiSource/Benchmarks/McCat/15-trie/trie: 23.53% (0.0527 => 0.0651, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/lists: 23.48% (0.0626 => 0.0773, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.41% (0.0675 => 0.0833, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.33% (0.2700 => 0.3330, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/messages-2: 23.26% (0.0662 => 0.0816, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.23% (0.1029 => 0.1268, std.dev.: 0.0013) MultiSource/Applications/aha/aha: 23.11% (0.1151 => 0.1417, std.dev.: 0.0001) MultiSource/Applications/oggenc/oggenc: 23.07% (5.7591 => 7.0879, std.dev.: 0.0015) MultiSource/Benchmarks/nbench/nbench: 22.90% (1.1840 => 1.4551, std.dev.: 0.0015) MultiSource/Applications/d/make_dparser: 22.90% (3.3354 => 4.0991, std.dev.: 0.0101) SingleSource/Benchmarks/Shootout-C++/matrix: 22.69% (0.3098 => 0.3801, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 22.68% (0.0842 => 0.1033, std.dev.: 0.0029) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.67% (0.0953 => 0.1169, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 22.36% (0.1695 => 0.2074, std.dev.: 0.0010) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.32% (0.1940 => 0.2373, std.dev.: 0.0012) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.27% (0.5860 => 0.7165, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.88% (4.9449 => 6.0269, std.dev.: 0.0139) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.67% (0.0886 => 0.1078, std.dev.: 0.0036) MultiSource/Benchmarks/Olden/bisort/bisort: 21.66% (0.0614 => 0.0747, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.66% (0.1510 => 0.1837, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.54% (0.8172 => 0.9932, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.41% (0.3307 => 0.4015, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/football/football: 21.33% (0.8921 => 1.0824, std.dev.: 0.0009) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.29% (5.0018 => 6.0666, std.dev.: 0.0028) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 21.22% (0.0834 => 0.1011, std.dev.: 0.0026) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.15% (0.1584 => 0.1919, std.dev.: 0.0004) MultiSource/Benchmarks/BitBench/five11/five11: 20.99% (0.0567 => 0.0686, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/ReedSolomon: 20.79% (0.2049 => 0.2475, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/18-imp/imp: 20.71% (0.3423 => 0.4132, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 20.64% (0.0528 => 0.0637, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.56% (0.2758 => 0.3325, std.dev.: 0.0012) MultiSource/Applications/treecc/treecc: 20.55% (2.0273 => 2.4439, std.dev.: 0.0081) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.54% (0.9765 => 1.1771, std.dev.: 0.0032) MultiSource/Applications/lambda-0_1_3/lambda: 20.53% (0.7433 => 0.8959, std.dev.: 0.0004) SingleSource/UnitTests/SignlessTypes/rem: 20.28% (0.1144 => 0.1376, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.25% (0.6450 => 0.7756, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.12% (1.1861 => 1.4248, std.dev.: 0.0074) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 19.84% (0.5569 => 0.6674, std.dev.: 0.0020) MultiSource/Applications/lua/lua: 19.80% (3.8723 => 4.6392, std.dev.: 0.0105) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.79% (0.2107 => 0.2524, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.79% (0.1117 => 0.1338, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.61% (0.0770 => 0.0921, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.60% (0.0648 => 0.0775, std.dev.: 0.0020) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/health/health: 19.40% (0.1268 => 0.1514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/life/life: 19.19% (0.0933 => 0.1112, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/perlin: 19.03% (0.0536 => 0.0638, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.94% (0.8101 => 0.9635, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.83% (0.0770 => 0.0915, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.78% (0.5981 => 0.7104, std.dev.: 0.0030) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.58% (0.4203 => 0.4984, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.45% (0.2065 => 0.2446, std.dev.: 0.0020) MultiSource/Applications/siod/siod: 18.38% (2.2969 => 2.7191, std.dev.: 0.0042) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.29% (0.2603 => 0.3079, std.dev.: 0.0087) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.13% (0.3441 => 0.4065, std.dev.: 0.0002) SingleSource/Benchmarks/McGill/misr: 18.01% (0.0633 => 0.0747, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 17.91% (0.3283 => 0.3871, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/ary: 17.70% (0.3232 => 0.3804, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.92% (0.3180 => 0.3718, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.86% (0.1044 => 0.1220, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: 16.15% (0.3387 => 0.3934, std.dev.: 0.0011) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.05% (0.0704 => 0.0817, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.8067 => 0.9359, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary2: 15.77% (0.3379 => 0.3912, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.38% (0.4636 => 0.5349, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.29% (0.3865 => 0.4456, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.16% (0.0838 => 0.0965, std.dev.: 0.0019) MultiSource/Applications/hbd/hbd: 14.93% (1.5603 => 1.7932, std.dev.: 0.0068) MultiSource/Applications/sqlite3/sqlite3: 14.80% (17.1811 => 19.7234, std.dev.: 0.0005) SingleSource/Regression/C++/ofstream_ctor: 14.42% (0.2905 => 0.3324, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 14.06% (0.4103 => 0.4680, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/moments: 13.93% (0.4048 => 0.4612, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/oourafft: 13.68% (0.3282 => 0.3731, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/lists: 13.68% (0.3422 => 0.3890, std.dev.: 0.0050) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.66% (0.0798 => 0.0907, std.dev.: 0.0035) SingleSource/Benchmarks/Shootout-C++/lists1: 13.27% (0.3684 => 0.4173, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/sieve: 13.27% (0.3603 => 0.4081, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/parameter-passing: 13.14% (0.3927 => 0.4443, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.79% (14.3668 => 16.2048, std.dev.: 0.0095) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.75% (0.3427 => 0.3864, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/property: 12.71% (0.3886 => 0.4380, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.63% (0.2430 => 0.2737, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/bh/bh: 12.58% (0.3092 => 0.3481, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.55% (0.3826 => 0.4306, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.33% (0.4064 => 0.4565, std.dev.: 0.0012) SingleSource/Benchmarks/Stanford/Puzzle: 12.22% (0.1268 => 0.1423, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: 12.02% (0.3828 => 0.4288, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/for-in: 11.99% (0.3694 => 0.4137, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/synchronized: 11.85% (0.3561 => 0.3983, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.85% (0.1114 => 0.1246, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: 11.78% (0.3473 => 0.3882, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-3: 11.77% (0.3516 => 0.3930, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std.dev.: 0.0008) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0013) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 11.34% (0.2831 => 0.3152, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.62% (2.0665 => 2.2860, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: 10.47% (1.2842 => 1.4187, std.dev.: 0.0019) SingleSource/Benchmarks/Shootout-C++/except: 10.38% (0.2871 => 0.3169, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout-C++/methcall: 10.32% (0.2877 => 0.3174, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.17% (0.3935 => 0.4335, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.97% (0.3650 => 0.4014, std.dev.: 0.0004) SingleSource/UnitTests/ObjC++/property-reference-object: 9.93% (0.6030 => 0.6629, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.80% (0.3162 => 0.3472, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.69% (0.2756 => 0.3023, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.68% (0.2872 => 0.3150, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.65% (0.2891 => 0.3170, std.dev.: 0.0008) SingleSource/UnitTests/ObjC++/property-reference: 9.58% (0.7326 => 0.8028, std.dev.: 0.0098) SingleSource/UnitTests/ObjC++/Hello: 9.45% (0.5925 => 0.6485, std.dev.: 0.0090) SingleSource/Benchmarks/Shootout-C++/wc: 9.44% (0.3052 => 0.3340, std.dev.: 0.0004) MultiSource/Benchmarks/Bullet/bullet: 9.39% (63.2438 => 69.1825, std.dev.: 0.0190) SingleSource/Benchmarks/Shootout-C++/random: 9.35% (0.2802 => 0.3064, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: 9.32% (0.2725 => 0.2979, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/hello: 9.29% (0.2714 => 0.2966, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.27% (0.2793 => 0.3052, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.90% (0.3136 => 0.3415, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.50% (2.2022 => 2.3894, std.dev.: 0.0004) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.35% (0.1330 => 0.1441, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.63% (0.2266 => 0.2439, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.24% (0.4879 => 0.5232, std.dev.: 0.0040) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.18% (0.3177 => 0.3405, std.dev.: 0.0000) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/objinst: 4.82% (0.3131 => 0.3282, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.45% (0.3817 => 0.3987, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: 3.85% (10.3673 => 10.7668, std.dev.: 0.0052) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.69% (7.9617 => 8.2552, std.dev.: 0.0061) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8957, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.57% (5.3999 => 13.3146, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4742, std.dev.: 0.0040) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.03% (1.1145 => 1.2931, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0006) SingleSource/Regression/C/uint64_to_float: 12.95% (0.5413 => 0.6114, std.dev.: 0.0007) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.77% (0.2944 => 0.3261, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/richards_benchmark: 9.19% (1.1396 => 1.2443, std.dev.: 0.0008) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1489, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 7.01% (11.6436 => 12.4599, std.dev.: 0.0447) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.15% (4.2280 => 4.4456, std.dev.: 0.0158) SingleSource/Benchmarks/Shootout-C++/hash2: 4.88% (3.1578 => 3.3119, std.dev.: 0.0046) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.83% (0.3316 => 0.3443, std.dev.: 0.0005) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.59% (0.9957 => 1.0314, std.dev.: 0.0062) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.47% (2.0360 => 2.1066, std.dev.: 0.0127) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.52% (3.6395 => 3.7311, std.dev.: 0.0020) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0006) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.40% (8.6802 => 8.8882, std.dev.: 0.0332) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2201, std.dev.: 0.0003) MultiSource/Benchmarks/Olden/bisort/bisort: 1.87% (0.8333 => 0.8489, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0003) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2811, std.dev.: 0.0021) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3088, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/tsp/tsp: 1.45% (1.0785 => 1.0941, std.dev.: 0.0007) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.07% (6.5088 => 6.5785, std.dev.: 0.0022) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.81% (6.6874 => 0.1465, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1779, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/salsa20: -75.05% (0.8651 => 0.2158, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/richards_benchmark: -42.48% (0.1622 => 0.0933, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.67% (5.3855 => 4.4875, std.dev.: 0.0045) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.04% (5.3526 => 4.4940, std.dev.: 0.0039) MultiSource/Applications/JM/ldecod/ldecod: -12.11% (10.4361 => 9.1720, std.dev.: 0.0063) SingleSource/UnitTests/Vector/constpool: -7.50% (54.1659 => 50.1057, std.dev.: 0.0202) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.31% (1.7609 => 1.6322, std.dev.: 0.0007) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.78% (1.9577 => 0.6699, std.dev.: 0.0020) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5621, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3079, std.dev.: 0.0027) SingleSource/Benchmarks/Misc/mandel-2: -33.68% (1.5373 => 1.0196, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/mandel: -33.45% (1.1492 => 0.7648, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: -30.59% (10.7105 => 7.4343, std.dev.: 0.0035) MultiSource/Benchmarks/PAQ8p/paq8p: -24.60% (85.0658 => 64.1408, std.dev.: 0.0023) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.45% (2.6546 => 2.0056, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/fp-convert: -22.58% (3.3453 => 2.5898) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.90% (2.6778 => 2.0914, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.70% (2.9695 => 2.3252, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary: -21.69% (0.0756 => 0.0592, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0006) MultiSource/Benchmarks/FreeBench/mason/mason: -19.76% (0.2161 => 0.1734, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -16.77% (2.5528 => 2.1246, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-6: -15.76% (1.6925 => 1.4258, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout/matrix: -13.05% (3.1443 => 2.7339, std.dev.: 0.0015) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.03% (0.9540 => 0.8392, std.dev.: 0.0005) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4934, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0021) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7047, std.dev.: 0.0189) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4819, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.84% (0.3463 => 0.3226, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.60% (19.9488 => 18.6328, std.dev.: 0.0146) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.83% (1.2373 => 1.1652, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.61% (8.1563 => 7.6990, std.dev.: 0.0065) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.60% (1.6805 => 1.5864, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.25% (0.8614 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -4.99% (1.5835 => 1.5045, std.dev.: 0.0045) SingleSource/Benchmarks/Misc/salsa20: -4.72% (10.2830 => 9.7976, std.dev.: 0.0044) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.66% (0.4808 => 0.4584, std.dev.: 0.0004) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1548, std.dev.: 0.0003) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0001) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9550, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3290, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: -1.35% (3.7221 => 3.6720, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout/hash: -1.06% (4.9088 => 4.8570, std.dev.: 0.0013) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -68.95% (0.2116 => 0.0657, std.dev.: 0.0032) Report Time: 1.60s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 19:38:03 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 21:38:03 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130201033803.205852A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8165?compare_to=8162&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8165, Order: 174133, Start Time: 2013-02-01 02:04:12, End Time: 2013-02-01 03:38:27 To: 8162, Order: 174116, Start Time: 2013-02-01 00:06:30, End Time: 2013-02-01 01:40:41 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 0 (99 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1104 (879 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.35% (0.0315 => 0.0713, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.29% (0.0717 => 0.1221, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 69.84% (0.0514 => 0.0873, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.45% (0.0974 => 0.1631, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.31% (0.1132 => 0.1611, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.07% (0.0599 => 0.0833, std.dev.: 0.0011) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.17% (0.6395 => 0.8836, std.dev.: 0.0070) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.50% (0.6395 => 0.8729, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 34.47% (0.0293 => 0.0394) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.00% (0.5688 => 0.7565, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.54% (0.5805 => 0.7694, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.53% (0.5456 => 0.7231, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.52% (0.6260 => 0.8296, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.11% (0.5849 => 0.7727, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 31.96% (0.5575 => 0.7357, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.81% (0.6230 => 0.8212, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 31.81% (0.5567 => 0.7338, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.77% (0.5581 => 0.7354, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.90% (0.5802 => 0.7595, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 30.80% (0.5941 => 0.7771, std.dev.: 0.0040) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.64% (0.5705 => 0.7453, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.44% (0.5569 => 0.7264, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.28% (0.5478 => 0.7137, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.27% (0.5857 => 0.7630, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.27% (0.5570 => 0.7256, std.dev.: 0.0060) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.26% (0.5859 => 0.7632, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 29.97% (0.6033 => 0.7841, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.67% (0.5591 => 0.7250, std.dev.: 0.0142) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.59% (1.6474 => 2.1349, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.55% (0.6440 => 0.8343, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.84% (0.5925 => 0.7634, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.79% (0.6676 => 0.8598, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.76% (0.6189 => 0.7969, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.43% (0.5863 => 0.7530, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.13% (0.6304 => 0.8077, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.06% (0.6446 => 0.8255, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.04% (0.6052 => 0.7749, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.61% (0.0699 => 0.0892, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.18% (0.6681 => 0.8497, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.11% (0.6194 => 0.7873, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.84% (0.6297 => 0.7987, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 26.71% (0.6660 => 0.8439, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.35% (0.6667 => 0.8357, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.96% (0.7524 => 0.9327, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.71% (0.0582 => 0.0720, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.37% (0.7339 => 0.9054, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.04% (0.0790 => 0.0972, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.26% (2.2587 => 2.7614, std.dev.: 0.0162) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.54% (0.0622 => 0.0756, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.42% (0.0621 => 0.0754, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 17.99% (0.0556 => 0.0656, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.67% (0.0566 => 0.0666, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.53% (0.0833 => 0.0979, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/04-bisect/bisect: 16.84% (0.1146 => 0.1339, std.dev.: 0.0011) MultiSource/Applications/sgefa/sgefa: 16.44% (0.3357 => 0.3909, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.15% (0.0680 => 0.0783, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 15.00% (1.1450 => 1.3167, std.dev.: 0.0009) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.99% (0.1081 => 0.1243, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.52% (0.1982 => 0.2250, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.75% (4.5069 => 5.0814, std.dev.: 0.0028) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.43% (0.4916 => 0.5527, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 12.05% (0.4515 => 0.5059, std.dev.: 0.0024) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.90% (1.6364 => 1.8311, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.74% (3.5339 => 3.9487, std.dev.: 0.0058) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.31% (0.2385 => 0.2631, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 10.10% (9.2283 => 10.1606, std.dev.: 0.0063) SingleSource/UnitTests/2006-12-11-LoadConstants: 9.84% (0.1230 => 0.1351, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.45% (0.2001 => 0.2170, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.44% (0.5329 => 0.5779, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 8.44% (1.2515 => 1.3571, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/hash: 8.20% (0.4524 => 0.4895, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1731 => 0.1870, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.90% (0.7021 => 0.7576, std.dev.: 0.0004) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.63% (1.2784 => 1.3759, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.36% (1.4642 => 1.5719, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 7.24% (0.4861 => 0.5213, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/ReedSolomon: 6.17% (0.1879 => 0.1995, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/bigfib: 5.88% (0.6750 => 0.7147, std.dev.: 0.0133) SingleSource/Benchmarks/Shootout-C++/matrix: 5.62% (0.3255 => 0.3438, std.dev.: 0.0003) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.15% (0.3319 => 0.3490, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.74% (5.4682 => 5.7272, std.dev.: 0.0227) MultiSource/Applications/oggenc/oggenc: 3.90% (5.0226 => 5.2183, std.dev.: 0.0033) MultiSource/Applications/SIBsim4/SIBsim4: 3.30% (1.3864 => 1.4322, std.dev.: 0.0007) MultiSource/Applications/spiff/spiff: 2.78% (0.8418 => 0.8652, std.dev.: 0.0022) MultiSource/Applications/minisat/minisat: 2.63% (0.7447 => 0.7643, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.49% (22.4056 => 22.9636, std.dev.: 0.0133) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.9557 => 0.9792, std.dev.: 0.0021) MultiSource/Applications/SPASS/SPASS: 2.21% (15.5079 => 15.8503, std.dev.: 0.0103) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.15% (1.3722 => 1.4017, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.07% (0.5168 => 0.5275, std.dev.: 0.0006) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.35% (1.2300 => 1.2466, std.dev.: 0.0009) MultiSource/Applications/kimwitu++/kc: 1.02% (18.2933 => 18.4793, std.dev.: 0.0088) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.83% (31.3723 => 55.7887, std.dev.: 0.0143) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.76% (0.9531 => 1.0271, std.dev.: 0.0067) SingleSource/Regression/C/uint64_to_float: 7.38% (0.5692 => 0.6112, std.dev.: 0.0008) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.22% (0.2380 => 0.2528) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1488, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.55% (54.5751 => 56.5125, std.dev.: 0.1050) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.0478 => 2.1015, std.dev.: 0.0124) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3032, std.dev.: 0.0025) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9566, std.dev.: 0.0005) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.49% (18.2231 => 18.4946, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.45% (5.1955 => 5.2710, std.dev.: 0.0015) MultiSource/Applications/sqlite3/sqlite3: 1.35% (4.5320 => 4.5930, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/himenobmtxpa: 1.07% (3.6551 => 3.6943, std.dev.: 0.0028) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.26% (0.1281 => 0.1124, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.35% (0.3194 => 0.3023, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.63% (0.7198 => 0.6865, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/trivial-interface: -4.25% (0.3812 => 0.3650, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-2: -4.15% (0.3831 => 0.3672, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.12% (0.3880 => 0.3720, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/exceptions-3: -4.11% (0.3848 => 0.3690, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -4.01% (0.3837 => 0.3683, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: -4.00% (0.3896 => 0.3740, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/block-byref-aggr: -3.98% (0.3891 => 0.3736, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: -3.76% (0.4176 => 0.4019, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: -3.73% (0.2871 => 0.2764, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -3.69% (2.4924 => 2.4005, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.60% (0.3884 => 0.3744, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: -3.58% (0.2903 => 0.2799, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.57% (0.3057 => 0.2948, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/hello: -3.55% (0.2849 => 0.2748, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: -3.48% (0.2933 => 0.2831, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -3.46% (0.3323 => 0.3208, std.dev.: 0.0010) SingleSource/UnitTests/ObjC++/Hello: -3.42% (0.6347 => 0.6130, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: -3.40% (0.3205 => 0.3096, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/heapsort: -3.38% (0.3016 => 0.2914, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.32% (0.3821 => 0.3694, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference-object: -3.20% (0.6441 => 0.6235, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.17% (0.9852 => 0.9540, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.12% (2.1713 => 2.1036, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/property: -3.02% (0.4199 => 0.4072, std.dev.: 0.0022) MultiSource/Applications/hexxagon/hexxagon: -2.86% (1.3148 => 1.2772, std.dev.: 0.0091) SingleSource/UnitTests/ObjC/parameter-passing: -2.76% (0.4280 => 0.4162, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: -2.74% (0.7779 => 0.7566, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.47% (0.6484 => 0.6324, std.dev.: 0.0003) SingleSource/UnitTests/Vector/constpool: -2.46% (20.7746 => 20.2640, std.dev.: 0.0491) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.18% (0.9542 => 0.9334, std.dev.: 0.0040) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.99% (14.2083 => 13.9260, std.dev.: 0.0246) MultiSource/Applications/sqlite3/sqlite3: -1.46% (17.1032 => 16.8530, std.dev.: 0.0110) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.44% (6.7716 => 6.6741, std.dev.: 0.0057) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.29% (0.7919 => 0.7817, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.25% (1.0544 => 1.0412, std.dev.: 0.0008) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -63.28% (1.8100 => 0.6646, std.dev.: 0.0201) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0105) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.99% (0.1622 => 0.1022, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3104, std.dev.: 0.0098) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.50% (0.2151 => 0.1581, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2494, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.65% (1.3643 => 1.0280, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/methcall: -23.36% (7.5137 => 5.7585, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -23.26% (0.2274 => 0.1745, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3642, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: -22.86% (83.5423 => 64.4452, std.dev.: 0.0037) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.91% (4.1024 => 3.2034, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1730, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0061) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.29% (0.3418 => 0.2827, std.dev.: 0.0001) SingleSource/UnitTests/Vector/multiplies: -15.10% (2.5106 => 2.1316, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.20% (0.4092 => 0.3511, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.69% (4.2493 => 3.6677, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0920, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: -13.32% (3.1443 => 2.7256, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.32% (4.9100 => 4.3541, std.dev.: 0.0018) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.07% (0.5142 => 0.4624, std.dev.: 0.0014) SingleSource/Benchmarks/Misc/richards_benchmark: -9.08% (1.2842 => 1.1676, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.04% (4.1534 => 3.8196, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6335, std.dev.: 0.0050) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.71% (0.9021 => 0.8416, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1069, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.49% (0.8545 => 0.8161, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.28% (1.7753 => 1.6993, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/fbench: -3.90% (2.2633 => 2.1751, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3342, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.25% (5.5807 => 5.3995, std.dev.: 0.0007) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.99% (1.0557 => 1.0241, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.83% (4.4002 => 4.2758, std.dev.: 0.0004) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.39% (7.9763 => 7.7858, std.dev.: 0.0039) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.26% (3.1919 => 3.1199, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/ary3: -1.82% (3.7241 => 3.6564, std.dev.: 0.0017) MultiSource/Benchmarks/Bullet/bullet: -1.78% (7.3040 => 7.1741, std.dev.: 0.0173) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.61% (2.7523 => 2.7079, std.dev.: 0.0072) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.61% (6.5735 => 6.4677, std.dev.: 0.0046) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.50% (1.6219 => 1.5976, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.22% (1.6307 => 1.6108, std.dev.: 0.0072) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.14% (1.6086 => 1.5903, std.dev.: 0.0048) SingleSource/Benchmarks/Shootout-C++/ary3: -1.05% (3.7092 => 3.6703, std.dev.: 0.0098) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0011) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 0.98s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 20:06:36 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 22:06:36 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130201040636.7ED622A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8166?compare_to=8163&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8166, Order: 174133, Start Time: 2013-02-01 02:03:12, End Time: 2013-02-01 04:07:01 To: 8163, Order: 174108, Start Time: 2013-01-31 23:34:37, End Time: 2013-02-01 01:44:29 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 0 (84 on baseline) Performance Improvements: 44 (69 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1020 (910 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/McCat/17-bintr/bintr: -41.90% (0.1327 => 0.0771, std.dev.: 0.0168) MultiSource/Benchmarks/Prolangs-C++/family/family: -39.77% (0.0689 => 0.0415, std.dev.: 0.0030) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -32.40% (0.1460 => 0.0987, std.dev.: 0.0071) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -28.95% (0.0677 => 0.0481, std.dev.: 0.0017) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -27.44% (0.8995 => 0.6527, std.dev.: 0.0354) SingleSource/UnitTests/Vector/constpool: -25.33% (11.8051 => 8.8154, std.dev.: 0.1067) SingleSource/Regression/C/casts: -25.06% (0.0423 => 0.0317, std.dev.: 0.0035) SingleSource/Benchmarks/Stanford/Perm: -24.37% (0.0439 => 0.0332, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -23.54% (0.9120 => 0.6973, std.dev.: 0.0575) SingleSource/Benchmarks/Stanford/IntMM: -20.14% (0.0730 => 0.0583, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/stepanov_container: -14.53% (1.0633 => 0.9088, std.dev.: 0.0290) MultiSource/Applications/sqlite3/sqlite3: -12.09% (18.4171 => 16.1907, std.dev.: 0.7775) SingleSource/Benchmarks/Stanford/Puzzle: -12.08% (0.1267 => 0.1114, std.dev.: 0.0008) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -11.86% (0.1012 => 0.0892, std.dev.: 0.0008) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.64% (2.1008 => 1.8772, std.dev.: 0.0734) MultiSource/Benchmarks/FreeBench/distray/distray: -10.01% (0.1109 => 0.0998, std.dev.: 0.0023) SingleSource/UnitTests/SignlessTypes/rem: -8.89% (0.1283 => 0.1169, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.41% (1.4059 => 1.2877, std.dev.: 0.0398) MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.06% (1.0275 => 0.9550, std.dev.: 0.0217) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.39% (0.3178 => 0.2975, std.dev.: 0.0071) SingleSource/Benchmarks/Misc-C++/Large/ray: -6.35% (0.3542 => 0.3317, std.dev.: 0.0066) MultiSource/Benchmarks/Prolangs-C++/employ/employ: -6.21% (0.3510 => 0.3292, std.dev.: 0.0077) MultiSource/Applications/treecc/treecc: -6.21% (2.3773 => 2.2297, std.dev.: 0.0130) MultiSource/Applications/SPASS/SPASS: -6.12% (17.3781 => 16.3153, std.dev.: 0.1200) MultiSource/Benchmarks/mafft/pairlocalalign: -5.96% (11.3741 => 10.6965, std.dev.: 0.0772) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -5.83% (0.6521 => 0.6141, std.dev.: 0.0085) SingleSource/Benchmarks/Misc/himenobmtxpa: -5.68% (0.2235 => 0.2108, std.dev.: 0.0048) MultiSource/Benchmarks/sim/sim: -5.05% (0.3804 => 0.3612, std.dev.: 0.0067) SingleSource/Benchmarks/CoyoteBench/fftbench: -4.32% (0.4007 => 0.3834, std.dev.: 0.0018) MultiSource/Applications/d/make_dparser: -3.74% (3.6887 => 3.5506, std.dev.: 0.0271) SingleSource/UnitTests/Vectorizer/gcc-loops: -3.47% (0.5249 => 0.5067, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/hash2: -2.62% (0.4771 => 0.4646, std.dev.: 0.0045) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: -39.08% (1.2752 => 0.7769, std.dev.: 0.1816) SingleSource/Benchmarks/CoyoteBench/fftbench: -31.31% (2.1314 => 1.4640, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout/heapsort: -20.62% (3.9056 => 3.1004, std.dev.: 0.0782) SingleSource/Benchmarks/Shootout/ary3: -7.58% (12.0239 => 11.1127, std.dev.: 0.3505) MultiSource/Benchmarks/llubenchmark/llu: -7.35% (2.1655 => 2.0064, std.dev.: 0.0412) SingleSource/Benchmarks/Shootout/hash: -6.31% (4.3471 => 4.0730, std.dev.: 0.0314) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -4.17% (1.1287 => 1.0816, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.52% (6.9196 => 6.6757, std.dev.: 0.0682) SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.18% (1.4891 => 1.4418, std.dev.: 0.0043) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.63% (2.6382 => 2.5952, std.dev.: 0.0064) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.45% (14.2157 => 14.0091, std.dev.: 0.0221) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.07% (5.0465 => 4.9923, std.dev.: 0.0138) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -6.32% (1.2855 => 1.2043, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -7.47% (0.0241 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -16.77% (0.0465 => 0.0387, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -5.71% (0.0368 => 0.0347, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -5.57% (0.0341 => 0.0322, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.15% (0.0466 => 0.0442, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -12.24% (0.0237 => 0.0208, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -5.93% (0.0236 => 0.0222, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.66% (0.0248 => 0.0229, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: 62.50% (0.0008 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -14.85% (0.1710 => 0.1456, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -4.99% (1.2410 => 1.1791, std.dev.: 0.2645) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.72% (0.4124 => 0.4012, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.77% (0.1560 => 0.1548, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.76% (0.0616 => 0.0599, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -4.24% (0.0236 => 0.0226, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -3.30% (0.0576 => 0.0557, std.dev.: 0.0144) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.03% (1.2863 => 1.2867, std.dev.: 0.0772) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -3.33% (0.0030 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.33% (0.0608 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.10% (0.0328 => 0.0348, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.70% (1.7500 => 1.7622, std.dev.: 0.0736) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: 30.65% (0.0062 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: -1.00% (34.3932 => 34.0497, std.dev.: 0.1221) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0002) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 388.99% (0.0336 => 0.1643, std.dev.: 0.0012) SingleSource/Regression/C/sumarraymalloc: 111.60% (0.0293 => 0.0620, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 85.40% (0.0274 => 0.0508, std.dev.: 0.0003) SingleSource/Regression/C/sumarray: 52.83% (0.0265 => 0.0405, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 41.37% (0.9120 => 1.2893, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.30% (0.8893 => 1.2566, std.dev.: 0.0672) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.99% (0.8926 => 1.2585, std.dev.: 0.0695) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 40.51% (0.9612 => 1.3506, std.dev.: 0.0496) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 40.43% (0.9855 => 1.3839, std.dev.: 0.0433) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.34% (0.9061 => 1.2716, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 39.96% (0.9998 => 1.3993, std.dev.: 0.0869) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.49% (0.9381 => 1.3086, std.dev.: 0.1064) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.28% (0.9564 => 1.3321, std.dev.: 0.0716) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.11% (0.9588 => 1.3338, std.dev.: 0.0786) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.69% (0.8990 => 1.2468, std.dev.: 0.0444) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.06% (0.9091 => 1.2551, std.dev.: 0.0885) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.35% (0.9422 => 1.2941, std.dev.: 0.0754) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 36.95% (0.9403 => 1.2877, std.dev.: 0.0398) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.40% (0.9010 => 1.2290, std.dev.: 0.0509) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.12% (0.9512 => 1.2948, std.dev.: 0.0740) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.82% (0.8912 => 1.2104, std.dev.: 0.0314) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.54% (1.0119 => 1.3715, std.dev.: 0.0561) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.53% (0.8736 => 1.1840, std.dev.: 0.0766) SingleSource/Benchmarks/Stanford/IntMM: 35.27% (0.0431 => 0.0583, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.40% (1.0052 => 1.3510, std.dev.: 0.0359) SingleSource/Benchmarks/McGill/exptree: 34.34% (0.0859 => 0.1154, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.13% (0.8732 => 1.1712, std.dev.: 0.0504) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.81% (0.8846 => 1.1837, std.dev.: 0.0678) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 33.79% (0.9788 => 1.3095, std.dev.: 0.0303) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 33.55% (0.9488 => 1.2671, std.dev.: 0.0330) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.76% (0.9867 => 1.3099, std.dev.: 0.0456) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 31.93% (1.0017 => 1.3215, std.dev.: 0.0600) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 31.42% (0.9993 => 1.3133, std.dev.: 0.0822) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 30.88% (0.9507 => 1.2443, std.dev.: 0.0435) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.14% (1.0088 => 1.3129, std.dev.: 0.0710) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.02% (0.9685 => 1.2592, std.dev.: 0.0636) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.98% (0.9127 => 1.1863, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.62% (0.9405 => 1.2191, std.dev.: 0.0401) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.08% (0.9550 => 1.2232, std.dev.: 0.0379) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.48% (1.0860 => 1.3736, std.dev.: 0.0484) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.41% (0.0738 => 0.0896, std.dev.: 0.0003) MultiSource/Applications/sgefa/sgefa: 18.20% (0.3598 => 0.4253, std.dev.: 0.0115) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 18.16% (0.0738 => 0.0872, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.64% (0.0669 => 0.0787, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 14.53% (0.0805 => 0.0922, std.dev.: 0.0030) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.92% (0.0783 => 0.0892, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.57% (1.0986 => 1.2477, std.dev.: 0.0360) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.23% (3.6295 => 4.1097, std.dev.: 0.1405) MultiSource/Benchmarks/mafft/pairlocalalign: 12.36% (9.5202 => 10.6965, std.dev.: 0.0772) SingleSource/Benchmarks/Shootout-C++/matrix: 10.61% (0.2385 => 0.2638, std.dev.: 0.0016) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.25% (0.4596 => 0.5067, std.dev.: 0.0020) SingleSource/Benchmarks/Linpack/linpack-pc: 9.39% (0.2566 => 0.2807, std.dev.: 0.0092) SingleSource/Benchmarks/McGill/chomp: 9.20% (0.1793 => 0.1958, std.dev.: 0.0049) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.83% (0.1955 => 0.2108, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.05% (0.2879 => 0.3082, std.dev.: 0.0062) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 106350.00% (0.0008 => 0.8516, std.dev.: 0.0424) SingleSource/Benchmarks/Shootout/ary3: 398.24% (2.2304 => 11.1127, std.dev.: 0.3505) SingleSource/Benchmarks/Shootout/matrix: 355.44% (1.5825 => 7.2074, std.dev.: 0.0354) MultiSource/Applications/sgefa/sgefa: 259.00% (0.3515 => 1.2619, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 240.42% (1.1825 => 4.0255, std.dev.: 0.0402) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 231.69% (4.8185 => 15.9827, std.dev.: 0.0763) SingleSource/Benchmarks/Shootout-C++/ary2: 201.55% (0.0129 => 0.0389, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 192.98% (0.0228 => 0.0668, std.dev.: 0.0044) SingleSource/Benchmarks/Shootout-C++/ary: 138.79% (0.0232 => 0.0554, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/matrix: 63.16% (2.9083 => 4.7452, std.dev.: 0.0856) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.57% (3.1254 => 4.1121, std.dev.: 0.0584) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 27.95% (1.4588 => 1.8666, std.dev.: 0.0240) SingleSource/Regression/C/uint64_to_float: 25.00% (1.5397 => 1.9246, std.dev.: 0.0130) SingleSource/Benchmarks/Misc/salsa20: 21.76% (7.4497 => 9.0710, std.dev.: 0.0514) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.50% (4.8112 => 5.7974, std.dev.: 0.1017) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.14% (5.6033 => 6.6757, std.dev.: 0.0682) MultiSource/Applications/JM/lencod/lencod: 13.70% (6.8159 => 7.7496, std.dev.: 0.0663) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.17% (5.1752 => 5.8566, std.dev.: 0.1218) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6497, std.dev.: 0.0446) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.81% (3.6477 => 3.9692, std.dev.: 0.0043) SingleSource/Benchmarks/Misc/ReedSolomon: 8.14% (8.6447 => 9.3484, std.dev.: 0.0222) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.05% (4.7473 => 5.0822, std.dev.: 0.0237) SingleSource/Benchmarks/McGill/chomp: 5.40% (1.0425 => 1.0988, std.dev.: 0.0205) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.23% (4.1836 => 4.4023, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.95% (5.0310 => 5.2298, std.dev.: 0.0276) SingleSource/Benchmarks/Misc/pi: 3.21% (2.1390 => 2.2077, std.dev.: 0.0067) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.17% (4.7254 => 4.8754, std.dev.: 0.0008) SingleSource/Benchmarks/Linpack/linpack-pc: 3.11% (50.8945 => 52.4760, std.dev.: 0.4263) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.06% (2.5681 => 2.5952, std.dev.: 0.0064) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -38.00% (0.0808 => 0.0501, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -30.95% (0.0727 => 0.0502, std.dev.: 0.0073) SingleSource/Benchmarks/SmallPT/smallpt: -27.49% (0.1888 => 0.1369, std.dev.: 0.0074) MultiSource/Benchmarks/BitBench/drop3/drop3: -27.17% (0.0692 => 0.0504, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -18.34% (0.0676 => 0.0552, std.dev.: 0.0046) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -17.46% (0.1684 => 0.1390, std.dev.: 0.0094) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -15.08% (0.7686 => 0.6527, std.dev.: 0.0354) MultiSource/Applications/spiff/spiff: -10.85% (1.0220 => 0.9111, std.dev.: 0.0190) SingleSource/UnitTests/Vector/constpool: -10.84% (9.8875 => 8.8154, std.dev.: 0.1067) MultiSource/Applications/aha/aha: -10.23% (0.1378 => 0.1237, std.dev.: 0.0046) MultiSource/Applications/treecc/treecc: -9.80% (2.4719 => 2.2297, std.dev.: 0.0130) SingleSource/Benchmarks/Shootout-C++/hash2: -9.51% (0.5134 => 0.4646, std.dev.: 0.0045) MultiSource/Applications/siod/siod: -8.80% (2.6437 => 2.4111, std.dev.: 0.0595) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.71% (0.1366 => 0.1247, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/hash: -7.23% (0.4689 => 0.4350, std.dev.: 0.0020) MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.68% (1.0234 => 0.9550, std.dev.: 0.0217) MultiSource/Applications/d/make_dparser: -6.17% (3.7840 => 3.5506, std.dev.: 0.0271) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.79% (11.5523 => 3.9515, std.dev.: 0.0257) SingleSource/Benchmarks/Misc/fp-convert: -62.38% (15.6525 => 5.8889, std.dev.: 0.2444) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.85% (0.4146 => 0.1789, std.dev.: 0.0039) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.47% (0.4578 => 0.2359, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.98% (11.3868 => 6.3793, std.dev.: 0.0766) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.82% (5.4023 => 3.6295, std.dev.: 0.0045) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.11% (0.4452 => 0.3067, std.dev.: 0.0059) SingleSource/Benchmarks/Shootout/heapsort: -30.70% (4.4739 => 3.1004, std.dev.: 0.0782) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.22% (0.5495 => 0.3999, std.dev.: 0.0072) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.31% (5.2605 => 3.8766, std.dev.: 0.0198) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.15% (4.4467 => 3.3283, std.dev.: 0.0471) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.61% (0.5826 => 0.4392, std.dev.: 0.0027) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.64% (0.5897 => 0.4503, std.dev.: 0.0061) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8225, std.dev.: 0.0198) SingleSource/Benchmarks/Shootout-C++/heapsort: -21.73% (4.2042 => 3.2905, std.dev.: 0.3502) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.41% (5.8755 => 4.7938, std.dev.: 0.0216) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.52% (7.0016 => 5.8446, std.dev.: 0.2007) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.01% (16.6791 => 14.0091, std.dev.: 0.0221) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.83% (0.1164 => 0.1003, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.08% (3.1921 => 2.7746, std.dev.: 0.0555) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6742, std.dev.: 0.0333) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.50% (5.7056 => 4.9923, std.dev.: 0.0138) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.49% (9.7992 => 8.5755, std.dev.: 0.0383) SingleSource/Benchmarks/CoyoteBench/fftbench: -11.52% (1.6547 => 1.4640, std.dev.: 0.0374) SingleSource/Benchmarks/Shootout/hash: -10.01% (4.5259 => 4.0730, std.dev.: 0.0314) MultiSource/Benchmarks/Olden/treeadd/treeadd: -9.95% (0.4081 => 0.3675, std.dev.: 0.0011) MultiSource/Benchmarks/mafft/pairlocalalign: -9.30% (63.1520 => 57.2759, std.dev.: 0.0989) SingleSource/Benchmarks/Shootout-C++/lists1: -8.92% (0.6628 => 0.6037, std.dev.: 0.0073) SingleSource/Benchmarks/CoyoteBench/lpbench: -8.15% (4.4540 => 4.0909, std.dev.: 0.1169) MultiSource/Applications/SIBsim4/SIBsim4: -7.96% (3.5443 => 3.2622, std.dev.: 0.0472) SingleSource/Benchmarks/Shootout/nestedloop: -7.91% (0.2200 => 0.2026, std.dev.: 0.0020) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.80% (0.3217 => 0.2966, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.99% (4.2843 => 3.9848, std.dev.: 0.0587) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.59% (5.5974 => 5.2283, std.dev.: 0.0216) MultiSource/Benchmarks/Olden/health/health: -6.51% (0.3654 => 0.3416, std.dev.: 0.0092) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.48% (4.5424 => 4.2482, std.dev.: 0.0146) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.45% (4.9799 => 4.6587, std.dev.: 0.0562) SingleSource/Benchmarks/McGill/queens: -5.46% (1.7443 => 1.6490, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/hash2: -4.80% (3.6768 => 3.5002, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.37% (3.5127 => 3.3591, std.dev.: 0.0188) SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.13% (3.7662 => 3.6108, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.77% (3.5691 => 3.4344, std.dev.: 0.0323) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.67% (5.8973 => 5.6810, std.dev.: 0.0336) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.61% (23.3986 => 22.5542, std.dev.: 0.2541) SingleSource/Benchmarks/Shootout-C++/lists: -2.55% (17.2182 => 16.7792, std.dev.: 0.1051) MultiSource/Applications/spiff/spiff: -2.37% (2.8571 => 2.7894, std.dev.: 0.0259) MultiSource/Benchmarks/BitBench/five11/five11: -1.89% (5.7021 => 5.5942, std.dev.: 0.0344) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.78% (8.7327 => 8.5774, std.dev.: 0.0146) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.60% (85.3042 => 83.9396, std.dev.: 0.2442) SingleSource/Benchmarks/Shootout-C++/methcall: -1.15% (8.7416 => 8.6410, std.dev.: 0.0224) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.15% (6.8262 => 6.7477, std.dev.: 0.0116) SingleSource/Benchmarks/Misc/whetstone: -1.02% (1.6251 => 1.6085, std.dev.: 0.0010) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: -0.03% (1.2047 => 1.2043, std.dev.: 0.0126) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -4.29% (0.0233 => 0.0223, std.dev.: 0.0005) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -14.19% (0.0451 => 0.0387, std.dev.: 0.0029) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -11.93% (0.0394 => 0.0347, std.dev.: 0.0003) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.83% (0.0328 => 0.0322, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.67% (0.0445 => 0.0442, std.dev.: 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: -2.35% (0.0213 => 0.0208, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/test1: -2.20% (0.0227 => 0.0222, std.dev.: 0.0006) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.20% (0.0255 => 0.0229, std.dev.: 0.0010) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0001) MultiSource/Applications/ClamAV/clamscan: -4.84% (0.1530 => 0.1456, std.dev.: 0.0041) MultiSource/Applications/lemon/lemon: -38.88% (1.9293 => 1.1791, std.dev.: 0.2645) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -0.91% (0.4049 => 0.4012, std.dev.: 0.0362) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.52% (0.1510 => 0.1548, std.dev.: 0.0139) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.75% (0.0978 => 0.0599, std.dev.: 0.0052) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.12% (0.0276 => 0.0226, std.dev.: 0.0039) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.59% (0.0590 => 0.0557, std.dev.: 0.0144) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.76% (1.1617 => 1.2867, std.dev.: 0.0772) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0000) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.66% (0.0610 => 0.0606, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.85% (0.0268 => 0.0348, std.dev.: 0.0056) SingleSource/Benchmarks/BenchmarkGame/puzzle: 136.95% (0.7437 => 1.7622, std.dev.: 0.0736) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -11.96% (0.0092 => 0.0081, std.dev.: 0.0019) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0001) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 166.47% (12.7781 => 34.0497, std.dev.: 0.1221) Report Time: 0.94s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 20:51:38 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 22:51:38 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130201045138.1A4612A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8167?compare_to=8164&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8167, Order: 174133, Start Time: 2013-02-01 02:40:19, End Time: 2013-02-01 04:52:00 To: 8164, Order: 174111, Start Time: 2013-01-31 23:56:34, End Time: 2013-02-01 02:08:37 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 2 (227 on baseline) Performance Improvements: 2 (66 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1096 (644 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/PAQ8p/paq8p: 1.01% (10.7668 => 10.8755, std.dev.: 0.0108) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.22% (1.0314 => 1.0440, std.dev.: 0.0047) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.21% (3.2241 => 3.1850, std.dev.: 0.0024) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -2.06% (0.6699 => 0.6561, std.dev.: 0.0031) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: - (0.1327 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0417 => 0.0418) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.65% (0.0657 => 0.0681, std.dev.: 0.0019) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8445 => 499.8460, std.dev.: 0.0105) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0418) MultiSource/Benchmarks/Olden/power/power: 44224.38% (1.1277 => 499.8460, std.dev.: 0.0105) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 224.98% (0.5229 => 1.6993, std.dev.: 0.0019) MultiSource/Applications/SPASS/SPASS: 24.33% (14.9895 => 18.6358, std.dev.: 0.0163) MultiSource/Applications/kimwitu++/kc: 45.97% (14.1553 => 20.6626, std.dev.: 0.0158) MultiSource/Benchmarks/MallocBench/gs/gs: 20.61% (4.1105 => 4.9576, std.dev.: 0.0084) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.63% (1.1048 => 1.7746, std.dev.: 0.0013) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 430.27% (7.1582 => 37.9577, std.dev.: 0.0269) SingleSource/Benchmarks/Misc-C++-EH/spirit: 86.79% (3.4629 => 6.4684, std.dev.: 0.0255) SingleSource/Benchmarks/Misc-C++/stepanov_container: 80.65% (0.6222 => 1.1240, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10234.86% (0.0720 => 7.4411, std.dev.: 0.0096) MultiSource/Applications/SIBsim4/SIBsim4: 3834200.00% (0.0001 => 3.8343, std.dev.: 0.0005) MultiSource/Applications/SPASS/SPASS: 11100600.00% (0.0001 => 11.1007, std.dev.: 0.0450) MultiSource/Applications/kimwitu++/kc: 51900.00% (0.0001 => 0.0520, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575500.00% (0.0001 => 0.5756, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849600.00% (0.0001 => 9.8497, std.dev.: 0.0017) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488600.00% (0.0001 => 5.4887, std.dev.: 0.0033) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.18% (1.1194 => 10.2221, std.dev.: 0.0053) MultiSource/Applications/ClamAV/clamscan: 149.52% (22.1758 => 55.3337, std.dev.: 0.0180) SingleSource/Benchmarks/Misc/lowercase: 130.47% (0.0256 => 0.0590, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.26% (0.0929 => 0.1879, std.dev.: 0.0002) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/neural/neural: 79.36% (0.1463 => 0.2624, std.dev.: 0.0002) SingleSource/Regression/C/sumarray2d: 72.69% (0.0271 => 0.0468, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/almabench: 67.12% (0.0730 => 0.1220, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/IntMM: 65.74% (0.0394 => 0.0653, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.33% (2.9384 => 4.6524, std.dev.: 0.0034) SingleSource/Regression/C/sumarray: 56.71% (0.0231 => 0.0362, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.75% (1.5859 => 2.4701, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 54.57% (7.0540 => 10.9037, std.dev.: 0.0065) MultiSource/Benchmarks/FreeBench/distray/distray: 51.61% (0.1056 => 0.1601, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: 51.29% (0.0232 => 0.0351, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.68% (8.1363 => 12.1785, std.dev.: 0.0069) MultiSource/Applications/sgefa/sgefa: 44.84% (0.3109 => 0.4503, std.dev.: 0.0003) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 44.61% (2.2024 => 3.1850, std.dev.: 0.0024) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.42% (0.0439 => 0.0634, std.dev.: 0.0000) SingleSource/UnitTests/vla: 43.94% (0.0355 => 0.0511, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: 40.71% (0.1432 => 0.2015, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.40% (0.1062 => 0.1491, std.dev.: 0.0010) MultiSource/Applications/JM/lencod/lencod: 40.15% (21.9371 => 30.7456, std.dev.: 0.0087) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 37.61% (1.5415 => 2.1213, std.dev.: 0.0028) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.80% (4.2646 => 5.8339, std.dev.: 0.0026) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.88% (0.4615 => 0.6271, std.dev.: 0.0023) SingleSource/Benchmarks/McGill/exptree: 35.38% (0.0814 => 0.1102, std.dev.: 0.0000) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.43% (0.2271 => 0.3053, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.93% (0.1892 => 0.2534, std.dev.: 0.0020) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 33.91% (0.5105 => 0.6836, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/05-eks/eks: 33.10% (0.4299 => 0.5722, std.dev.: 0.0003) MultiSource/Applications/Burg/burg: 32.35% (1.1642 => 1.5408, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.09% (0.6675 => 0.8817, std.dev.: 0.0051) MultiSource/Benchmarks/NPB-serial/is/is: 31.71% (0.0719 => 0.0947, std.dev.: 0.0001) SingleSource/Benchmarks/Stanford/Oscar: 31.29% (0.0636 => 0.0835, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/chomp: 31.24% (0.1655 => 0.2172, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 30.07% (9.4845 => 12.3361, std.dev.: 0.0019) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.23% (0.0479 => 0.0619, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.82% (0.0746 => 0.0961, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.80% (3.8922 => 5.0132, std.dev.: 0.0030) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 28.71% (0.1125 => 0.1448, std.dev.: 0.0006) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.63% (0.0793 => 0.1020, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 28.45% (0.0457 => 0.0587, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.70% (1.4186 => 1.8116, std.dev.: 0.0040) MultiSource/Applications/lemon/lemon: 27.63% (1.0722 => 1.3685, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.52% (0.1337 => 0.1705, std.dev.: 0.0028) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 27.43% (0.1695 => 0.2160, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/08-main/main: 27.41% (0.2554 => 0.3254, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash: 27.23% (0.4289 => 0.5457, std.dev.: 0.0015) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 27.02% (0.1906 => 0.2421, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.96% (0.0408 => 0.0518, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/hash2: 26.77% (0.4620 => 0.5857, std.dev.: 0.0032) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.59% (0.3121 => 0.3951, std.dev.: 0.0003) SingleSource/UnitTests/2006-12-11-LoadConstants: 26.51% (0.1143 => 0.1446, std.dev.: 0.0000) MultiSource/Applications/minisat/minisat: 26.37% (0.7115 => 0.8991, std.dev.: 0.0013) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.18% (0.1566 => 0.1976, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 26.13% (0.1175 => 0.1482, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 25.18% (0.0842 => 0.1054, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.15% (0.0672 => 0.0841, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 25.07% (0.0730 => 0.0913, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 24.90% (0.1032 => 0.1289, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/mst/mst: 24.85% (0.1163 => 0.1452, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/whetstone: 24.70% (0.0660 => 0.0823, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 24.58% (0.6456 => 0.8043, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.36% (0.5020 => 0.6243, std.dev.: 0.0029) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.34% (1.3050 => 1.6226, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/hash: 24.33% (0.0485 => 0.0603, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 24.20% (0.1029 => 0.1278, std.dev.: 0.0014) MultiSource/Benchmarks/llubenchmark/llu: 24.03% (0.0462 => 0.0573, std.dev.: 0.0000) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 23.95% (0.1236 => 0.1532, std.dev.: 0.0004) MultiSource/Applications/viterbi/viterbi: 23.92% (0.1555 => 0.1927, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/15-trie/trie: 23.91% (0.0527 => 0.0653, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 23.82% (0.7835 => 0.9701, std.dev.: 0.0010) SingleSource/UnitTests/ObjC/messages-2: 23.56% (0.0662 => 0.0818, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.56% (0.2700 => 0.3336, std.dev.: 0.0011) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.54% (0.0871 => 0.1076, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/lists: 23.48% (0.0626 => 0.0773, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.26% (0.0675 => 0.0832, std.dev.: 0.0000) MultiSource/Applications/oggenc/oggenc: 23.17% (5.7591 => 7.0937, std.dev.: 0.0002) MultiSource/Applications/d/make_dparser: 22.94% (3.3354 => 4.1005, std.dev.: 0.0053) MultiSource/Applications/aha/aha: 22.85% (0.1151 => 0.1414, std.dev.: 0.0013) MultiSource/Benchmarks/nbench/nbench: 22.82% (1.1840 => 1.4542, std.dev.: 0.0009) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.77% (0.0953 => 0.1170, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.48% (0.1695 => 0.2076, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/matrix: 22.30% (0.3098 => 0.3789, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.16% (0.1940 => 0.2370, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.16% (0.8172 => 0.9983, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 22.15% (0.5860 => 0.7158, std.dev.: 0.0025) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.06% (4.9449 => 6.0358, std.dev.: 0.0066) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.78% (0.0886 => 0.1079, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.72% (0.1510 => 0.1838, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/ReedSolomon: 21.72% (0.2049 => 0.2494, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/loader/loader: 21.61% (0.2758 => 0.3354, std.dev.: 0.0017) MultiSource/Benchmarks/McCat/18-imp/imp: 21.56% (0.3423 => 0.4161, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/bisort/bisort: 21.50% (0.0614 => 0.0746, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.17% (0.3307 => 0.4007, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.12% (5.0018 => 6.0584, std.dev.: 0.0103) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.09% (0.1584 => 0.1918, std.dev.: 0.0010) MultiSource/Benchmarks/BitBench/five11/five11: 20.99% (0.0567 => 0.0686, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/football/football: 20.96% (0.8921 => 1.0791, std.dev.: 0.0036) MultiSource/Applications/lambda-0_1_3/lambda: 20.64% (0.7433 => 0.8967, std.dev.: 0.0039) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.53% (0.9765 => 1.1770, std.dev.: 0.0009) MultiSource/Applications/treecc/treecc: 20.47% (2.0273 => 2.4423, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.47% (0.5569 => 0.6709, std.dev.: 0.0010) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 20.45% (0.0528 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.39% (0.0770 => 0.0927, std.dev.: 0.0018) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.38% (0.0834 => 0.1004, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 20.22% (0.0648 => 0.0779, std.dev.: 0.0018) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 20.14% (0.1117 => 0.1342, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.06% (0.6450 => 0.7744, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.02% (1.1861 => 1.4236, std.dev.: 0.0020) SingleSource/UnitTests/SignlessTypes/rem: 19.93% (0.1144 => 0.1372, std.dev.: 0.0002) MultiSource/Applications/lua/lua: 19.92% (3.8723 => 4.6438, std.dev.: 0.0030) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.79% (0.2107 => 0.2524, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.76% (0.0759 => 0.0909, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 19.48% (0.5981 => 0.7146, std.dev.: 0.0016) MultiSource/Benchmarks/Olden/health/health: 19.40% (0.1268 => 0.1514, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 19.03% (0.2065 => 0.2458, std.dev.: 0.0031) MultiSource/Benchmarks/Prolangs-C++/life/life: 18.97% (0.0933 => 0.1110, std.dev.: 0.0007) SingleSource/Benchmarks/Misc/perlin: 18.84% (0.0536 => 0.0637) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.74% (0.8101 => 0.9619, std.dev.: 0.0052) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.70% (0.0770 => 0.0914, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.53% (0.4203 => 0.4982, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 18.32% (2.2969 => 2.7178, std.dev.: 0.0040) SingleSource/Benchmarks/McGill/misr: 18.17% (0.0633 => 0.0748) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 18.16% (0.3441 => 0.4066, std.dev.: 0.0007) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 18.09% (0.2603 => 0.3074, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/ary3: 17.85% (0.3283 => 0.3869, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: 17.51% (0.3232 => 0.3798, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout/matrix: 17.36% (0.0818 => 0.0960, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 17.05% (0.1044 => 0.1222, std.dev.: 0.0004) MultiSource/Benchmarks/McCat/09-vor/vor: 17.01% (0.3180 => 0.3721, std.dev.: 0.0003) MultiSource/Benchmarks/sim/sim: 16.71% (0.3387 => 0.3953, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.34% (0.0704 => 0.0819) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.21% (0.8067 => 0.9375, std.dev.: 0.0112) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.63% (0.0838 => 0.0969, std.dev.: 0.0008) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.60% (0.4636 => 0.5359, std.dev.: 0.0052) SingleSource/Benchmarks/Shootout-C++/ary2: 15.45% (0.3379 => 0.3901, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.37% (0.3865 => 0.4459, std.dev.: 0.0012) MultiSource/Applications/hbd/hbd: 14.50% (1.5603 => 1.7865, std.dev.: 0.0011) SingleSource/Regression/C++/ofstream_ctor: 14.49% (0.2905 => 0.3326, std.dev.: 0.0008) MultiSource/Applications/sqlite3/sqlite3: 14.28% (17.1811 => 19.6340, std.dev.: 0.0065) SingleSource/Benchmarks/Shootout-C++/moments: 13.86% (0.4048 => 0.4609, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 13.82% (0.4103 => 0.4670, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (0.3422 => 0.3887, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sieve: 13.41% (0.3603 => 0.4086, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists1: 13.27% (0.3684 => 0.4173, std.dev.: 0.0003) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.25% (0.2430 => 0.2752, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: 13.19% (0.3927 => 0.4445, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 13.16% (0.0798 => 0.0903, std.dev.: 0.0028) SingleSource/Benchmarks/Misc/oourafft: 13.10% (0.3282 => 0.3712, std.dev.: 0.0014) MultiSource/Benchmarks/Olden/bh/bh: 12.87% (0.3092 => 0.3490, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.79% (14.3668 => 16.2047, std.dev.: 0.0086) SingleSource/UnitTests/ObjC/property: 12.71% (0.3886 => 0.4380, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.63% (0.3427 => 0.3860, std.dev.: 0.0002) SingleSource/Benchmarks/Stanford/Puzzle: 12.54% (0.1268 => 0.1427, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.42% (0.3826 => 0.4301, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.16% (0.4064 => 0.4558, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions: 12.07% (0.3828 => 0.4290, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.85% (0.1114 => 0.1246, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 11.83% (0.3473 => 0.3884, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/for-in: 11.83% (0.3694 => 0.4131, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: 11.74% (0.3543 => 0.3959, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.71% (0.3543 => 0.3958, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: 11.68% (0.3561 => 0.3977, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: 11.60% (0.3516 => 0.3924, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 11.58% (0.3497 => 0.3902, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/strcat: 10.88% (0.2831 => 0.3139, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 10.69% (1.2842 => 1.4215, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 10.65% (2.0665 => 2.2865, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/methcall: 10.25% (0.2877 => 0.3172, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/except: 10.21% (0.2871 => 0.3164, std.dev.: 0.0004) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.14% (0.3935 => 0.4334, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/sumcol: 9.93% (0.2891 => 0.3178, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 9.92% (0.3650 => 0.4012, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.88% (0.2793 => 0.3069, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hello: 9.80% (0.2714 => 0.2980, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.77% (0.3162 => 0.3471, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/heapsort: 9.54% (0.2872 => 0.3146, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.47% (0.2756 => 0.3017, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/random: 9.35% (0.2802 => 0.3064, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wc: 9.34% (0.3052 => 0.3337, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.34% (0.6030 => 0.6593, std.dev.: 0.0003) MultiSource/Benchmarks/Bullet/bullet: 9.31% (63.2438 => 69.1327, std.dev.: 0.0219) SingleSource/Benchmarks/Shootout-C++/fibo: 9.21% (0.2725 => 0.2976, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/property-reference: 9.05% (0.7326 => 0.7989, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/office/office: 8.93% (0.3136 => 0.3416, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 8.91% (0.5925 => 0.6453, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.43% (0.1625 => 0.1762, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.35% (0.1330 => 0.1441, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.34% (0.2266 => 0.2455, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.24% (2.2022 => 2.3837, std.dev.: 0.0010) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.65% (0.3177 => 0.3420, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.52% (0.4879 => 0.5246, std.dev.: 0.0035) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.09% (0.1438 => 0.1540, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: 4.95% (0.3131 => 0.3286, std.dev.: 0.0007) MultiSource/Benchmarks/PAQ8p/paq8p: 4.90% (10.3673 => 10.8755, std.dev.: 0.0108) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.27% (0.3817 => 0.3980, std.dev.: 0.0002) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.70% (7.9617 => 8.2560, std.dev.: 0.0050) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.89% (4.3953 => 10.8954, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.93% (32.5116 => 59.4737, std.dev.: 0.0032) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.03% (1.1145 => 1.2932, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6971, std.dev.: 0.0012) SingleSource/Regression/C/uint64_to_float: 13.08% (0.5413 => 0.6121, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.70% (0.2944 => 0.3259, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: 9.17% (1.1396 => 1.2441, std.dev.: 0.0010) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.95% (2.8904 => 3.1490, std.dev.: 0.0001) MultiSource/Benchmarks/nbench/nbench: 6.87% (11.6436 => 12.4439, std.dev.: 0.0083) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (4.2280 => 4.4602, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/hash2: 4.92% (3.1578 => 3.3132, std.dev.: 0.0010) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.85% (0.9957 => 1.0440, std.dev.: 0.0047) SingleSource/Benchmarks/Misc/ffbench: 4.09% (0.9505 => 0.9894, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 3.95% (0.3316 => 0.3447, std.dev.: 0.0002) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0007) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.85% (8.6802 => 8.9275, std.dev.: 0.0018) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.47% (1.0313 => 1.0568, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.42% (3.6395 => 3.7277, std.dev.: 0.0050) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.07% (1.3677 => 1.3960) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2202, std.dev.: 0.0002) MultiSource/Applications/minisat/minisat: 1.87% (9.1159 => 9.2867, std.dev.: 0.0124) MultiSource/Benchmarks/Olden/bisort/bisort: 1.82% (0.8333 => 0.8485, std.dev.: 0.0013) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (1.7254 => 1.7568, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3093, std.dev.: 0.0022) MultiSource/Benchmarks/Olden/tsp/tsp: 1.40% (1.0785 => 1.0936, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 1.00% (6.5088 => 6.5742, std.dev.: 0.0070) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.81% (6.6874 => 0.1467, std.dev.: 0.0019) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.66% (5.2763 => 1.1788, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -75.01% (0.8651 => 0.2162, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/richards_benchmark: -42.42% (0.1622 => 0.0934, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.49% (5.3855 => 4.4974, std.dev.: 0.0011) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.87% (5.3526 => 4.5032, std.dev.: 0.0029) MultiSource/Applications/JM/ldecod/ldecod: -11.95% (10.4361 => 9.1886, std.dev.: 0.0072) SingleSource/UnitTests/Vector/constpool: -7.41% (54.1659 => 50.1523, std.dev.: 0.0179) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.09% (1.7609 => 1.6361, std.dev.: 0.0006) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -66.49% (1.9577 => 0.6561, std.dev.: 0.0031) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.05% (0.6962 => 0.3408, std.dev.: 0.0010) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5619, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/lowercase: -34.06% (8.0499 => 5.3084, std.dev.: 0.0017) SingleSource/Benchmarks/Misc/mandel-2: -33.62% (1.5373 => 1.0205, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/mandel: -33.43% (1.1492 => 0.7650, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: -30.54% (10.7105 => 7.4398, std.dev.: 0.0209) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1342, std.dev.: 0.0087) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.52% (2.6546 => 2.0036, std.dev.: 0.0019) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.89% (2.6778 => 2.0917, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary: -21.83% (0.0756 => 0.0591, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.77% (1.2258 => 0.9589) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -21.00% (0.0757 => 0.0598, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/mason/mason: -19.53% (0.2161 => 0.1739, std.dev.: 0.0000) MultiSource/Applications/sgefa/sgefa: -19.19% (0.6223 => 0.5029, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.75% (2.5528 => 2.1253, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/flops-6: -16.05% (1.6925 => 1.4208, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout/matrix: -12.99% (3.1443 => 2.7358, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -11.87% (0.9540 => 0.8408, std.dev.: 0.0004) MultiSource/Benchmarks/NPB-serial/is/is: -11.19% (9.5636 => 8.4932, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.18% (3.2416 => 2.9117, std.dev.: 0.0005) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.11% (1.5660 => 1.4234) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.99% (1.8329 => 1.7048, std.dev.: 0.0051) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.97% (19.9488 => 18.5586, std.dev.: 0.0479) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4820, std.dev.: 0.0002) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -6.47% (1.2373 => 1.1572, std.dev.: 0.0256) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.59% (1.6805 => 1.5865, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.59% (8.1563 => 7.7007, std.dev.: 0.0068) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.53% (2.7294 => 2.5786, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/salsa20: -4.71% (10.2830 => 9.7988, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-5: -4.69% (1.5835 => 1.5093, std.dev.: 0.0006) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.45% (0.4808 => 0.4594, std.dev.: 0.0000) MultiSource/Applications/siod/siod: -3.89% (3.2827 => 3.1549, std.dev.: 0.0023) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout/ary3: -1.94% (3.6994 => 3.6277, std.dev.: 0.0192) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6765, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3289, std.dev.: 0.0009) SingleSource/Benchmarks/Shootout-C++/ary3: -1.63% (3.7221 => 3.6615, std.dev.: 0.0166) SingleSource/Benchmarks/Shootout/lists: -1.02% (6.2999 => 6.2359, std.dev.: 0.0029) SingleSource/Benchmarks/Shootout/hash: -1.01% (4.9088 => 4.8591, std.dev.: 0.0096) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.64% (0.1485 => 0.1327, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -67.82% (0.2116 => 0.0681, std.dev.: 0.0019) Report Time: 1.67s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 21:25:26 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 23:25:26 -0600 (CST) Subject: [llvm-testresults] lab-mini-03__O0-g__clang_DEV__x86_64 test results Message-ID: <20130201052526.2D4622A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8168?compare_to=8161&baseline=999 Nickname: lab-mini-03__O0-g__clang_DEV__x86_64:3 Comparing: Run: 8168, Order: 174131, Start Time: 2013-02-01 01:50:40, End Time: 2013-02-01 05:25:50 To: 8161, Order: 174085, Start Time: 2013-01-31 21:21:03, End Time: 2013-02-01 00:56:37 Baseline: 999, Order: 158324, Start Time: 2012-06-11 20:29:30, End Time: 2012-06-11 22:44:50 =============== Tests Summary =============== Performance Regressions: 2 (182 on baseline) Performance Improvements: 3 (22 on baseline) Added Tests: 0 (146 on baseline) Unchanged Tests: 1099 (754 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Prolangs-C++/city/city: 1.03% (2.4213 => 2.4462, std.dev.: 0.0031) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 3.01% (0.4049 => 0.4171, std.dev.: 0.0013) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.20% (0.6399 => 0.6130, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.33% (0.8488 => 0.8290, std.dev.: 0.0004) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.45% (13.1039 => 12.9144, std.dev.: 0.0052) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 45.12% (0.0625 => 0.0907, std.dev.: 0.0012) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 35.65% (0.1063 => 0.1442, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/treeadd/treeadd: 30.82% (0.0331 => 0.0433, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 29.10% (0.2969 => 0.3833, std.dev.: 0.0026) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.70% (0.0547 => 0.0704, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 28.21% (0.1106 => 0.1418, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 28.01% (0.0714 => 0.0914, std.dev.: 0.0011) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 27.79% (0.0475 => 0.0607, std.dev.: 0.0014) MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.53% (0.5900 => 0.7524, std.dev.: 0.0238) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 27.40% (0.4139 => 0.5273, std.dev.: 0.0003) MultiSource/Applications/oggenc/oggenc: 26.81% (1.5932 => 2.0203, std.dev.: 0.0010) MultiSource/Benchmarks/Fhourstones/fhourstones: 26.37% (0.0584 => 0.0738, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 26.27% (0.0415 => 0.0524) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 26.06% (0.0541 => 0.0682, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 25.96% (0.4253 => 0.5357, std.dev.: 0.0026) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 25.83% (0.4994 => 0.6284, std.dev.: 0.0042) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.42% (0.5000 => 0.6271, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/tsp/tsp: 25.04% (0.0599 => 0.0749, std.dev.: 0.0000) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 25.02% (0.1107 => 0.1384, std.dev.: 0.0036) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 24.64% (0.0897 => 0.1118, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.57% (0.1620 => 0.2018, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1021 => 0.1271, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/loader/loader: 23.69% (0.1549 => 0.1916, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 23.46% (0.0584 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/em3d/em3d: 23.42% (0.0948 => 0.1170, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/perimeter/perimeter: 23.23% (0.0495 => 0.0610, std.dev.: 0.0014) MultiSource/Benchmarks/SciMark2-C/scimark2: 22.94% (0.1604 => 0.1972, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/ft/ft: 22.93% (0.1003 => 0.1233, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.91% (0.0633 => 0.0778, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 22.90% (0.0642 => 0.0789, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.83% (0.3903 => 0.4794, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 22.76% (0.1103 => 0.1354, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/power/power: 22.68% (0.0604 => 0.0741, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.51% (0.0822 => 0.1007, std.dev.: 0.0009) MultiSource/Benchmarks/McCat/05-eks/eks: 22.17% (0.1619 => 0.1978, std.dev.: 0.0020) MultiSource/Benchmarks/Olden/health/health: 22.17% (0.0821 => 0.1003, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 21.96% (0.1462 => 0.1783, std.dev.: 0.0009) MultiSource/Applications/viterbi/viterbi: 21.44% (0.0947 => 0.1150, std.dev.: 0.0012) MultiSource/Applications/sgefa/sgefa: 21.16% (0.0808 => 0.0979) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 21.11% (0.3890 => 0.4711, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.05% (0.2736 => 0.3312, std.dev.: 0.0010) MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.86% (0.1088 => 0.1315, std.dev.: 0.0012) MultiSource/Benchmarks/McCat/08-main/main: 20.85% (0.1218 => 0.1472, std.dev.: 0.0009) MultiSource/Applications/spiff/spiff: 20.82% (0.4029 => 0.4868, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.55% (0.2866 => 0.3455, std.dev.: 0.0014) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.41% (0.2014 => 0.2425, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/mst/mst: 20.34% (0.0698 => 0.0840, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/09-vor/vor: 20.27% (0.1505 => 0.1810, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 20.18% (0.3271 => 0.3931, std.dev.: 0.0022) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.80% (1.3152 => 1.5756, std.dev.: 0.0146) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 19.77% (0.1968 => 0.2357, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 19.68% (1.8794 => 2.2492, std.dev.: 0.0037) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 19.58% (0.0572 => 0.0684, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/sumcol: 19.41% (0.2875 => 0.3433, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: 19.33% (0.5826 => 0.6952, std.dev.: 0.0003) MultiSource/Benchmarks/Ptrdist/ks/ks: 19.20% (0.0573 => 0.0683, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 19.15% (0.5546 => 0.6608, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 19.04% (0.4658 => 0.5545, std.dev.: 0.0026) MultiSource/Applications/hbd/hbd: 18.99% (0.9697 => 1.1538, std.dev.: 0.0015) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.97% (3.5627 => 4.2384, std.dev.: 0.0079) SingleSource/Benchmarks/Shootout-C++/heapsort: 18.84% (0.2792 => 0.3318, std.dev.: 0.0001) SingleSource/UnitTests/ObjC++/property-reference-object: 18.80% (0.5889 => 0.6996, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 18.70% (0.5026 => 0.5966, std.dev.: 0.0023) SingleSource/Benchmarks/Shootout-C++/strcat: 18.69% (0.2750 => 0.3264, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/except: 18.68% (0.2811 => 0.3336, std.dev.: 0.0040) SingleSource/Benchmarks/Shootout-C++/objinst: 18.67% (0.2823 => 0.3350, std.dev.: 0.0000) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 18.62% (0.1090 => 0.1293, std.dev.: 0.0012) SingleSource/Benchmarks/Shootout-C++/random: 18.62% (0.2803 => 0.3325, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/matrix: 18.60% (0.2780 => 0.3297, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/fibo: 18.57% (0.2725 => 0.3231, std.dev.: 0.0003) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 18.56% (0.0582 => 0.0690, std.dev.: 0.0025) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.53% (0.1160 => 0.1375, std.dev.: 0.0026) SingleSource/Benchmarks/Shootout-C++/hello: 18.53% (0.2714 => 0.3217, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/methcall: 18.52% (0.2813 => 0.3334, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/espresso/espresso: 18.51% (1.6211 => 1.9211, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/ackermann: 18.48% (0.2738 => 0.3244, std.dev.: 0.0005) MultiSource/Benchmarks/Olden/bh/bh: 18.46% (0.1284 => 0.1521, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/office/office: 18.45% (0.2911 => 0.3448, std.dev.: 0.0006) SingleSource/Regression/C++/ofstream_ctor: 18.41% (0.3004 => 0.3557, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/nestedloop: 18.40% (0.2729 => 0.3231, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C++/city/city: 18.33% (2.0673 => 2.4462, std.dev.: 0.0031) MultiSource/Applications/hexxagon/hexxagon: 18.31% (0.9909 => 1.1723, std.dev.: 0.0122) MultiSource/Applications/d/make_dparser: 18.08% (1.0781 => 1.2730, std.dev.: 0.0023) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 18.02% (0.4361 => 0.5147, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: 18.02% (0.3096 => 0.3654, std.dev.: 0.0054) MultiSource/Benchmarks/Ptrdist/bc/bc: 17.81% (0.3930 => 0.4630, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 17.81% (0.3195 => 0.3764, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: 17.81% (0.7171 => 0.8448, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/18-imp/imp: 17.80% (0.1421 => 0.1674, std.dev.: 0.0046) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 17.75% (0.3060 => 0.3603, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/ary3: 17.69% (0.3267 => 0.3845, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: 17.68% (0.3258 => 0.3834, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 17.40% (0.3317 => 0.3894, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 17.25% (0.3124 => 0.3663, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 17.19% (0.0605 => 0.0709, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 17.12% (0.3282 => 0.3844, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/sieve: 17.12% (0.3726 => 0.4364, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 17.10% (0.3362 => 0.3937, std.dev.: 0.0009) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 17.10% (1.9694 => 2.3062, std.dev.: 0.0085) SingleSource/Benchmarks/Shootout-C++/lists: 17.03% (0.3348 => 0.3918, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: 17.01% (4.2109 => 4.9273, std.dev.: 0.0057) SingleSource/Benchmarks/Shootout-C++/lists1: 17.00% (0.3477 => 0.4068, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.96% (1.9966 => 2.3353, std.dev.: 0.0053) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.91% (4.4195 => 5.1668, std.dev.: 0.0310) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.89% (2.7292 => 3.1902, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/moments: 16.88% (0.3678 => 0.4299, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/Large/ray: 16.63% (0.3625 => 0.4228, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/spellcheck: 16.43% (0.3981 => 0.4635, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/reversefile: 16.42% (0.3690 => 0.4296, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 16.42% (0.4251 => 0.4949, std.dev.: 0.0006) MultiSource/Benchmarks/Bullet/bullet: 16.34% (23.5202 => 27.3626, std.dev.: 0.0268) MultiSource/Benchmarks/nbench/nbench: 16.17% (0.2566 => 0.2981, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 16.04% (0.4146 => 0.4811, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: 15.99% (0.3496 => 0.4055, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-4: 15.99% (0.3465 => 0.4019, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: 15.98% (0.3442 => 0.3992, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: 15.96% (0.3446 => 0.3996, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/synchronized: 15.85% (0.3469 => 0.4019, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/instance-method-metadata: 15.85% (0.3488 => 0.4041, std.dev.: 0.0009) SingleSource/UnitTests/ObjC/exceptions-3: 15.81% (0.3460 => 0.4007, std.dev.: 0.0004) MultiSource/Applications/lua/lua: 15.68% (1.4269 => 1.6507, std.dev.: 0.0040) SingleSource/UnitTests/ObjC/property: 15.62% (0.3650 => 0.4220, std.dev.: 0.0002) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.58% (0.3845 => 0.4444, std.dev.: 0.0020) SingleSource/UnitTests/ObjC/parameter-passing: 15.47% (0.3724 => 0.4300, std.dev.: 0.0001) SingleSource/Benchmarks/Misc-C++/bigfib: 15.30% (0.5012 => 0.5779, std.dev.: 0.0006) SingleSource/UnitTests/ObjC/exceptions: 15.29% (0.3643 => 0.4200, std.dev.: 0.0022) MultiSource/Applications/treecc/treecc: 15.09% (0.7875 => 0.9063, std.dev.: 0.0048) MultiSource/Benchmarks/Prolangs-C/football/football: 14.94% (0.2075 => 0.2385, std.dev.: 0.0008) MultiSource/Applications/JM/ldecod/ldecod: 14.70% (2.1653 => 2.4836, std.dev.: 0.0052) MultiSource/Benchmarks/sim/sim: 14.51% (0.0758 => 0.0868, std.dev.: 0.0000) MultiSource/Applications/SIBsim4/SIBsim4: 14.42% (0.2691 => 0.3079, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.34% (0.5361 => 0.6130, std.dev.: 0.0007) SingleSource/Benchmarks/Misc-C++/stepanov_container: 14.17% (0.6435 => 0.7347, std.dev.: 0.0006) MultiSource/Applications/JM/lencod/lencod: 14.14% (4.6177 => 5.2707, std.dev.: 0.0162) MultiSource/Applications/SPASS/SPASS: 13.85% (5.5417 => 6.3090, std.dev.: 0.0133) MultiSource/Benchmarks/mafft/pairlocalalign: 13.79% (2.1013 => 2.3911, std.dev.: 0.0014) MultiSource/Benchmarks/FreeBench/pifft/pifft: 13.73% (0.2040 => 0.2320, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.67% (0.1383 => 0.1572, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.45% (0.2737 => 0.3105, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.35% (0.2068 => 0.2344, std.dev.: 0.0025) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 13.04% (0.1028 => 0.1162, std.dev.: 0.0001) MultiSource/Applications/lambda-0_1_3/lambda: 12.69% (0.3498 => 0.3942, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.16% (0.3084 => 0.3459, std.dev.: 0.0000) MultiSource/Benchmarks/PAQ8p/paq8p: 11.92% (0.4847 => 0.5425, std.dev.: 0.0007) MultiSource/Applications/minisat/minisat: 11.81% (0.3336 => 0.3730, std.dev.: 0.0014) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 11.63% (0.7426 => 0.8290, std.dev.: 0.0004) MultiSource/Applications/siod/siod: 11.50% (0.6634 => 0.7397, std.dev.: 0.0016) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.36% (0.2103 => 0.2342, std.dev.: 0.0002) MultiSource/Applications/lemon/lemon: 10.96% (0.2391 => 0.2653, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.95% (11.6398 => 12.9144, std.dev.: 0.0052) MultiSource/Applications/sqlite3/sqlite3: 10.25% (2.0346 => 2.2432, std.dev.: 0.0047) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.62% (4.6926 => 5.1439, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.60% (0.5584 => 0.6064, std.dev.: 0.0000) MultiSource/Applications/kimwitu++/kc: 7.90% (11.9555 => 12.9003, std.dev.: 0.0044) SingleSource/UnitTests/ObjC/block-byref-aggr: 6.41% (0.3792 => 0.4035, std.dev.: 0.0000) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 524.84% (29.0505 => 181.5192, std.dev.: 0.0062) MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 92.92% (0.2162 => 0.4171, std.dev.: 0.0013) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.79% (0.0734 => 0.0960, std.dev.: 0.0013) SingleSource/Benchmarks/Misc/flops-1: 22.64% (6.2401 => 7.6528, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: 17.57% (2.5769 => 3.0297, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.18% (0.5917 => 0.6697, std.dev.: 0.0106) MultiSource/Applications/ClamAV/clamscan: 11.03% (0.2802 => 0.3111, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/n-body: 6.51% (3.3903 => 3.6109, std.dev.: 0.0007) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.28% (0.3693 => 0.3925, std.dev.: 0.0076) SingleSource/Benchmarks/Misc/flops: 5.17% (15.4430 => 16.2418, std.dev.: 0.0016) SingleSource/Benchmarks/Shootout-C++/objinst: 5.17% (12.0509 => 12.6737, std.dev.: 0.0038) SingleSource/Benchmarks/Misc/flops-2: 4.83% (1.8057 => 1.8929, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.70% (79.9355 => 83.6900, std.dev.: 0.0030) MultiSource/Benchmarks/Olden/health/health: 3.03% (0.6276 => 0.6466, std.dev.: 0.0002) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 3.02% (3.3991 => 3.5018, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary3: 2.02% (15.8721 => 16.1920, std.dev.: 0.0102) MultiSource/Applications/viterbi/viterbi: 1.46% (46.6247 => 47.3074, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 1.46% (7.1849 => 7.2896, std.dev.: 0.0035) MultiSource/Applications/spiff/spiff: 1.26% (4.0317 => 4.0825, std.dev.: 0.0011) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 1.21% (1.0927 => 1.1059) MultiSource/Benchmarks/BitBench/drop3/drop3: 1.20% (1.0142 => 1.0264) SingleSource/Benchmarks/CoyoteBench/almabench: 1.10% (12.4025 => 12.5393, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 1.08% (3.1722 => 3.2066, std.dev.: 0.0015) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.08% (3.6465 => 3.6857, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.04% (1.2451 => 1.2581, std.dev.: 0.0002) MultiSource/Applications/sqlite3/sqlite3: 1.04% (10.3705 => 10.4780, std.dev.: 0.0124) MultiSource/Applications/lua/lua: 1.03% (50.0626 => 50.5766, std.dev.: 0.0160) Performance Improvements - Compile Time --------------------------------------- SingleSource/UnitTests/Vector/constpool: -3.36% (2.4764 => 2.3932, std.dev.: 0.0053) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/methcall: -34.87% (25.4195 => 16.5551, std.dev.: 0.0216) SingleSource/Benchmarks/Misc/mandel-2: -20.88% (3.6262 => 2.8692, std.dev.: 0.0000) SingleSource/Benchmarks/Dhrystone/fldry: -17.84% (17.2379 => 14.1623, std.dev.: 0.1533) SingleSource/UnitTests/Vector/multiplies: -11.38% (2.3713 => 2.1014, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/ary2: -10.82% (0.2402 => 0.2142, std.dev.: 0.0039) MultiSource/Applications/hexxagon/hexxagon: -7.72% (28.1477 => 25.9742, std.dev.: 0.0022) SingleSource/Benchmarks/Misc/salsa20: -7.60% (35.5013 => 32.8045, std.dev.: 0.0035) MultiSource/Benchmarks/Olden/tsp/tsp: -7.27% (2.1113 => 1.9578, std.dev.: 0.0009) SingleSource/Benchmarks/Dhrystone/dry: -6.26% (14.0481 => 13.1684, std.dev.: 0.1462) MultiSource/Applications/sgefa/sgefa: -4.81% (1.5554 => 1.4806, std.dev.: 0.0028) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.71% (41.7953 => 40.2454, std.dev.: 0.0050) MultiSource/Benchmarks/Olden/power/power: -3.71% (3.3665 => 3.2417, std.dev.: 0.0001) SingleSource/UnitTests/Vector/build2: -3.53% (11.2080 => 10.8126, std.dev.: 0.0013) MultiSource/Applications/siod/siod: -3.02% (6.9842 => 6.7731, std.dev.: 0.0013) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -2.21% (197.4719 => 193.1144, std.dev.: 0.0567) MultiSource/Benchmarks/Olden/perimeter/perimeter: -1.81% (0.6293 => 0.6179, std.dev.: 0.0025) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.72% (10.7630 => 10.5781, std.dev.: 0.0032) MultiSource/Benchmarks/Olden/bh/bh: -1.47% (5.5810 => 5.4988, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.34% (5.7935 => 5.7156, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.17% (105.3826 => 104.1495, std.dev.: 0.0960) SingleSource/Benchmarks/Misc-C++/Large/ray: -1.06% (16.2163 => 16.0447, std.dev.: 0.0025) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.28s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 21:35:56 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Thu, 31 Jan 2013 23:35:56 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130201053556.6EBD82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8169?compare_to=8165&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8169, Order: 174143, Start Time: 2013-02-01 04:02:15, End Time: 2013-02-01 05:36:20 To: 8165, Order: 174133, Start Time: 2013-02-01 02:04:12, End Time: 2013-02-01 03:38:27 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 0 (114 on baseline) Performance Improvements: 1 (92 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (886 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.6564 => 3.6194, std.dev.: 0.0140) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 127.62% (0.0315 => 0.0717, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: 79.29% (0.0280 => 0.0502, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.57% (0.0717 => 0.1223, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.23% (0.0514 => 0.0875, std.dev.: 0.0013) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.76% (0.0974 => 0.1634, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 46.07% (0.1500 => 0.2191, std.dev.: 0.0004) SingleSource/Regression/C/sumarraymalloc: 43.07% (0.0267 => 0.0382) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.67% (0.1132 => 0.1615, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 39.47% (0.0418 => 0.0583, std.dev.: 0.0017) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.58% (0.6395 => 0.8862, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.84% (0.6395 => 0.8751, std.dev.: 0.0001) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 33.32% (0.5688 => 0.7583, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 33.12% (0.5456 => 0.7263, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 33.00% (0.6260 => 0.8326, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.83% (0.5805 => 0.7711, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.54% (0.5849 => 0.7752, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.36% (0.6230 => 0.8246, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.29% (0.5575 => 0.7375, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.26% (0.5567 => 0.7363, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 32.16% (0.5581 => 0.7376, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.49% (0.5802 => 0.7629, std.dev.: 0.0075) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.16% (0.5941 => 0.7792, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 31.01% (0.5569 => 0.7296, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.99% (0.5705 => 0.7473, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.73% (0.5857 => 0.7657, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.70% (0.5478 => 0.7160, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.65% (0.5570 => 0.7277, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.60% (0.6033 => 0.7879, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.45% (0.5859 => 0.7643, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 30.03% (0.5591 => 0.7270, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.83% (0.6440 => 0.8361, std.dev.: 0.0011) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.62% (1.6474 => 2.1353, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 29.33% (0.5925 => 0.7663, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 29.23% (0.6189 => 0.7998, std.dev.: 0.0121) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 29.13% (0.6676 => 0.8621, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.76% (0.5863 => 0.7549, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.70% (0.6304 => 0.8113, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.30% (0.6052 => 0.7765, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.17% (0.6446 => 0.8262, std.dev.: 0.0127) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 27.90% (0.0699 => 0.0894, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.54% (0.6194 => 0.7900, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.50% (0.6681 => 0.8518, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.24% (0.6660 => 0.8474, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.17% (0.6297 => 0.8008, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.74% (0.6667 => 0.8383, std.dev.: 0.0044) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.44% (0.7524 => 0.9363, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.78% (0.7339 => 0.9084, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.23% (2.2587 => 2.7608, std.dev.: 0.0163) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.93% (0.0693 => 0.0845, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.74% (0.0621 => 0.0756, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.77% (0.0833 => 0.0981, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0009) MultiSource/Applications/sgefa/sgefa: 16.68% (0.3357 => 0.3917, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.74% (0.0680 => 0.0787) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.17% (0.1081 => 0.1245, std.dev.: 0.0001) MultiSource/Applications/lemon/lemon: 15.14% (1.1450 => 1.3183, std.dev.: 0.0052) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.22% (0.1982 => 0.2244, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.73% (4.5069 => 5.0805, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.47% (0.4916 => 0.5529, std.dev.: 0.0003) MultiSource/Benchmarks/McCat/05-eks/eks: 12.27% (0.4515 => 0.5069, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.02% (3.5339 => 3.9588, std.dev.: 0.0006) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.00% (1.6364 => 1.8328, std.dev.: 0.0048) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.48% (0.2385 => 0.2635, std.dev.: 0.0003) MultiSource/Benchmarks/mafft/pairlocalalign: 10.23% (9.2283 => 10.1724, std.dev.: 0.0024) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.85% (0.2001 => 0.2178, std.dev.: 0.0001) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.78% (0.1230 => 0.1338, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.52% (0.5329 => 0.5783, std.dev.: 0.0004) MultiSource/Applications/Burg/burg: 8.30% (1.2515 => 1.3554, std.dev.: 0.0012) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.03% (0.7021 => 0.7585, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.03% (0.1731 => 0.1870, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/hash: 7.85% (0.4524 => 0.4879, std.dev.: 0.0011) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.80% (1.2784 => 1.3781, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/hash2: 7.51% (0.4861 => 0.5226, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.46% (1.4642 => 1.5734, std.dev.: 0.0030) SingleSource/Benchmarks/Misc/ReedSolomon: 6.39% (0.1879 => 0.1999, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: 5.93% (0.3255 => 0.3448, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 5.90% (0.6750 => 0.7148, std.dev.: 0.0001) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.36% (0.3319 => 0.3497, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.54% (5.4682 => 5.7164, std.dev.: 0.0121) MultiSource/Applications/oggenc/oggenc: 3.70% (5.0226 => 5.2085, std.dev.: 0.0051) MultiSource/Applications/SIBsim4/SIBsim4: 3.32% (1.3864 => 1.4324, std.dev.: 0.0010) MultiSource/Applications/spiff/spiff: 2.89% (0.8418 => 0.8661, std.dev.: 0.0046) MultiSource/Applications/minisat/minisat: 2.74% (0.7447 => 0.7651, std.dev.: 0.0010) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.39% (0.9557 => 0.9785, std.dev.: 0.0041) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.39% (22.4056 => 22.9400, std.dev.: 0.0228) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.24% (1.3722 => 1.4029, std.dev.: 0.0013) MultiSource/Applications/SPASS/SPASS: 2.15% (15.5079 => 15.8415, std.dev.: 0.0046) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.11% (0.5168 => 0.5277, std.dev.: 0.0005) MultiSource/Benchmarks/Ptrdist/bc/bc: 1.54% (1.2300 => 1.2490, std.dev.: 0.0009) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.90% (31.3723 => 55.8107, std.dev.: 0.0090) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.58% (0.9531 => 1.0253, std.dev.: 0.0028) SingleSource/Regression/C/uint64_to_float: 7.36% (0.5692 => 0.6111, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3686, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1489, std.dev.: 0.0029) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.45% (54.5751 => 56.4571, std.dev.: 0.1455) SingleSource/Benchmarks/Misc-C++/bigfib: 3.22% (0.3328 => 0.3435, std.dev.: 0.0014) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.16% (2.0478 => 2.1126, std.dev.: 0.0069) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1412, std.dev.: 0.0000) MultiSource/Benchmarks/mafft/pairlocalalign: 1.73% (27.8210 => 28.3022, std.dev.: 0.0028) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9563, std.dev.: 0.0004) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.49% (18.2231 => 18.4944, std.dev.: 0.0215) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.42% (79.7170 => 80.8480, std.dev.: 0.2944) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.41% (5.1955 => 5.2687, std.dev.: 0.0021) MultiSource/Applications/sqlite3/sqlite3: 1.38% (4.5320 => 4.5947, std.dev.: 0.0016) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.02% (0.1281 => 0.1127, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.26% (0.3194 => 0.3026, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.50% (0.7198 => 0.6874, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/trivial-interface: -4.30% (0.3812 => 0.3648, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/exceptions-2: -4.23% (0.3831 => 0.3669, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-4: -4.23% (0.3880 => 0.3716, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-3: -4.21% (0.3848 => 0.3686, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/synchronized: -4.18% (0.3896 => 0.3733, std.dev.: 0.0025) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.14% (0.3891 => 0.3730, std.dev.: 0.0004) SingleSource/UnitTests/ObjC/for-in: -3.99% (0.4033 => 0.3872, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.96% (0.3837 => 0.3685, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions: -3.90% (0.4176 => 0.4013, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.68% (0.3884 => 0.3741, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.53% (0.3057 => 0.2949, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/fibo: -3.48% (0.2871 => 0.2771, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -3.39% (2.4924 => 2.4078, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/wc: -3.24% (0.3205 => 0.3101, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/property: -3.24% (0.4199 => 0.4063, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/Hello: -3.18% (0.6347 => 0.6145, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.11% (0.3821 => 0.3702, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.08% (0.9852 => 0.9549, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.06% (2.1713 => 2.1048, std.dev.: 0.0006) SingleSource/UnitTests/ObjC++/property-reference-object: -2.87% (0.6441 => 0.6256, std.dev.: 0.0059) SingleSource/UnitTests/ObjC/parameter-passing: -2.85% (0.4280 => 0.4158, std.dev.: 0.0004) MultiSource/Applications/hexxagon/hexxagon: -2.78% (1.3148 => 1.2782, std.dev.: 0.0012) SingleSource/UnitTests/Vector/constpool: -2.58% (20.7746 => 20.2385, std.dev.: 0.0490) SingleSource/UnitTests/ObjC++/property-reference: -2.56% (0.7779 => 0.7580, std.dev.: 0.0003) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.24% (0.6484 => 0.6339, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.83% (14.2083 => 13.9480, std.dev.: 0.0151) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.76% (0.9542 => 0.9374, std.dev.: 0.0003) MultiSource/Applications/sqlite3/sqlite3: -1.35% (17.1032 => 16.8716, std.dev.: 0.0193) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.24% (6.7716 => 6.6875, std.dev.: 0.0062) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -61.21% (1.8100 => 0.7021, std.dev.: 0.0171) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.73% (0.6962 => 0.3430, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.09% (6.6713 => 3.3966, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.81% (0.1622 => 0.1025, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: -33.95% (8.0445 => 5.3131, std.dev.: 0.0012) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.39% (0.1983 => 0.1420, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.45% (0.2151 => 0.1582, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.30% (4.3504 => 3.2496, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/mandel-2: -24.49% (1.3643 => 1.0302, std.dev.: 0.0020) SingleSource/Benchmarks/Shootout-C++/methcall: -23.47% (7.5137 => 5.7506, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.16% (4.3779 => 3.3640, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: -22.85% (83.5423 => 64.4568, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.82% (0.2274 => 0.1755, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5898) SingleSource/Benchmarks/Shootout-C++/ary2: -22.49% (0.0756 => 0.0586, std.dev.: 0.0021) SingleSource/Benchmarks/Shootout-C++/ary: -22.32% (0.0757 => 0.0588, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.89% (4.1024 => 3.2042, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.74% (2.9703 => 2.3245) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: -20.10% (0.6299 => 0.5033, std.dev.: 0.0004) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.17% (0.3418 => 0.2831, std.dev.: 0.0004) SingleSource/UnitTests/Vector/multiplies: -15.19% (2.5106 => 2.1292, std.dev.: 0.0009) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6681, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.62% (4.7378 => 4.0925, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.30% (3.1443 => 2.7261, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.24% (4.9100 => 4.3580, std.dev.: 0.0029) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.06% (0.3626 => 0.3225, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7480, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.84% (0.5142 => 0.4636, std.dev.: 0.0012) SingleSource/Benchmarks/Misc/richards_benchmark: -8.95% (1.2842 => 1.1692, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.03% (4.1534 => 3.8200, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.67% (7.1848 => 6.6334, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.67% (5.2027 => 4.8039, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.74% (0.9021 => 0.8413, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0049) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.29% (1.7753 => 1.6992, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/fbench: -3.82% (2.2633 => 2.1769, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/oourafft: -3.24% (5.5807 => 5.3999, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2763, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout/ary3: -2.81% (3.7241 => 3.6194, std.dev.: 0.0140) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.31% (3.1919 => 3.1183, std.dev.: 0.0009) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.17% (7.9763 => 7.8036, std.dev.: 0.0054) MultiSource/Benchmarks/Bullet/bullet: -1.79% (7.3040 => 7.1730, std.dev.: 0.0242) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.60% (2.7523 => 2.7083, std.dev.: 0.0015) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.52% (6.5735 => 6.4736, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.50% (1.6307 => 1.6063, std.dev.: 0.0039) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.42% (2.1154 => 2.0854, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/ary3: -1.24% (3.7092 => 3.6632, std.dev.: 0.0099) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.21% (1.6086 => 1.5891, std.dev.: 0.0040) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.13% (1.6219 => 1.6035, std.dev.: 0.0025) SingleSource/Benchmarks/Misc/whetstone: -1.01% (1.0443 => 1.0338, std.dev.: 0.0001) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.09s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 22:29:53 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Feb 2013 00:29:53 -0600 (CST) Subject: [llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results Message-ID: <20130201062953.6AED82A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8170?compare_to=8166&baseline=7471 Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:8 Comparing: Run: 8170, Order: 174144, Start Time: 2013-02-01 04:27:46, End Time: 2013-02-01 06:30:19 To: 8166, Order: 174133, Start Time: 2013-02-01 02:03:12, End Time: 2013-02-01 04:07:01 Baseline: 7471, Order: 172102, Start Time: 2013-01-10 21:00:57, End Time: 2013-01-10 22:47:14 =============== Tests Summary =============== New Failures: 0 (1 on baseline) New Passes: 0 (1 on baseline) Performance Regressions: 5 (87 on baseline) Performance Improvements: 3 (70 on baseline) Existing Failures: 40 (39 on baseline) Unchanged Tests: 1056 (906 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Ptrdist/ft/ft: 4.89% (0.2125 => 0.2229, std.dev.: 0.0039) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.77% (1.4589 => 1.8494, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.43% (5.8446 => 6.3958, std.dev.: 0.0314) MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.53% (0.6551 => 0.6848, std.dev.: 0.0017) MultiSource/Benchmarks/BitBench/five11/five11: 1.13% (5.5942 => 5.6576, std.dev.: 0.0244) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.78% (1.3839 => 1.3593, std.dev.: 0.0021) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.58% (2.8366 => 2.7350, std.dev.: 0.0241) SingleSource/Benchmarks/Shootout-C++/lists: -1.29% (16.7792 => 16.5634, std.dev.: 0.0568) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.37% (1.2043 => 1.2208, std.dev.: 0.0585) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 4.04% (0.0223 => 0.0232, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.25% (0.0387 => 0.0446, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -1.73% (0.0347 => 0.0341, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1.24% (0.0322 => 0.0326, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -0.45% (0.0442 => 0.0440, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/casts: 3.85% (0.0208 => 0.0216, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: 1.35% (0.0222 => 0.0225, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.44% (0.0229 => 0.0230, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -0.21% (0.1456 => 0.1453, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -2.99% (1.1791 => 1.1439, std.dev.: 0.0859) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.82% (0.4012 => 0.3899, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.81% (0.1548 => 0.1458, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.34% (0.0599 => 0.0619, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: 22.12% (0.0226 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.54% (0.0557 => 0.0560, std.dev.: 0.0025) MultiSource/Benchmarks/PAQ8p/paq8p: - (0.0015 => 0.0015, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.17% (1.2867 => 1.2889, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0026 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.32% (0.0606 => 0.0614, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.98% (0.0348 => 0.0275, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: -1.23% (1.7622 => 1.7406, std.dev.: 0.0149) SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -6.17% (0.0081 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 1.03% (34.0497 => 34.3995, std.dev.: 0.1201) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/PAQ8p/paq8p MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.0843 => 0.0015, std.dev.: 0.0000) New Passes - Execution Time --------------------------- SingleSource/UnitTests/2003-07-10-SignConversions SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003) Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 398.51% (0.0336 => 0.1675, std.dev.: 0.0014) SingleSource/Regression/C/sumarraymalloc: 118.77% (0.0293 => 0.0641, std.dev.: 0.0023) SingleSource/Regression/C/sumarray2d: 92.34% (0.0274 => 0.0527, std.dev.: 0.0005) SingleSource/Regression/C/sumarray: 59.62% (0.0265 => 0.0423, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/neural/neural: 58.12% (0.1638 => 0.2590, std.dev.: 0.0046) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 41.19% (0.8893 => 1.2556, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 40.98% (0.9120 => 1.2857, std.dev.: 0.0024) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 40.78% (0.8926 => 1.2566, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 40.28% (0.9061 => 1.2711, std.dev.: 0.0011) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 39.90% (0.9612 => 1.3447, std.dev.: 0.0015) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 39.31% (0.9564 => 1.3324, std.dev.: 0.0026) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 39.28% (0.9588 => 1.3354, std.dev.: 0.0107) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 39.20% (0.9381 => 1.3058, std.dev.: 0.0126) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 38.42% (0.8990 => 1.2444, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 38.15% (0.9091 => 1.2559, std.dev.: 0.0019) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 37.93% (0.9855 => 1.3593, std.dev.: 0.0021) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 37.88% (0.9998 => 1.3785, std.dev.: 0.0100) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 37.32% (0.9422 => 1.2938, std.dev.: 0.0110) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 36.88% (0.9403 => 1.2871, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 36.18% (0.9010 => 1.2270, std.dev.: 0.0118) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 36.02% (0.9512 => 1.2938, std.dev.: 0.0128) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 35.82% (0.8736 => 1.1865, std.dev.: 0.0377) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 35.44% (1.0119 => 1.3705, std.dev.: 0.0140) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 35.44% (0.8912 => 1.2070, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 34.88% (1.0867 => 1.4657, std.dev.: 0.0003) SingleSource/Benchmarks/Stanford/IntMM: 34.80% (0.0431 => 0.0581, std.dev.: 0.0008) SingleSource/Benchmarks/McGill/exptree: 34.69% (0.0859 => 0.1157, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 34.37% (1.0052 => 1.3507, std.dev.: 0.0016) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 34.21% (0.8732 => 1.1719, std.dev.: 0.0427) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.68% (0.8846 => 1.1825, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 32.56% (0.9867 => 1.3080, std.dev.: 0.0270) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 31.95% (1.0017 => 1.3217, std.dev.: 0.0018) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.30% (0.9788 => 1.2852, std.dev.: 0.0410) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 31.10% (0.9488 => 1.2439, std.dev.: 0.0318) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.03% (0.9507 => 1.2457, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.01% (0.9685 => 1.2591, std.dev.: 0.0407) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.00% (1.0088 => 1.3114, std.dev.: 0.0921) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.98% (0.9127 => 1.1863, std.dev.: 0.0489) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 29.13% (0.9405 => 1.2145, std.dev.: 0.0513) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 28.03% (0.9550 => 1.2227, std.dev.: 0.0233) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.47% (1.0860 => 1.3735, std.dev.: 0.0462) MultiSource/Applications/sgefa/sgefa: 18.23% (0.3598 => 0.4254, std.dev.: 0.0088) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 13.63% (0.1240 => 0.1409, std.dev.: 0.0036) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 13.58% (1.0986 => 1.2478, std.dev.: 0.0361) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.30% (3.6295 => 4.1124, std.dev.: 0.0012) MultiSource/Benchmarks/mafft/pairlocalalign: 12.33% (9.5202 => 10.6945, std.dev.: 0.0779) SingleSource/Benchmarks/Misc/ReedSolomon: 10.49% (0.2050 => 0.2265, std.dev.: 0.0038) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.24% (0.5369 => 0.5919, std.dev.: 0.0135) SingleSource/UnitTests/Vectorizer/gcc-loops: 10.10% (0.4596 => 0.5060, std.dev.: 0.0128) SingleSource/Benchmarks/Shootout-C++/matrix: 9.77% (0.2385 => 0.2618, std.dev.: 0.0027) SingleSource/Benchmarks/McGill/chomp: 9.59% (0.1793 => 0.1965, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/himenobmtxpa: 8.75% (0.1955 => 0.2126, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.82% (0.2879 => 0.3104, std.dev.: 0.0010) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.12% (2.4519 => 2.5774, std.dev.: 0.0039) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.75% (1.8127 => 1.8806, std.dev.: 0.0162) SingleSource/Benchmarks/Misc-C++/bigfib: 2.70% (0.6711 => 0.6892, std.dev.: 0.0006) MultiSource/Benchmarks/Prolangs-C++/city/city: 1.50% (1.4805 => 1.5027, std.dev.: 0.0071) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Misc/lowercase: 107112.50% (0.0008 => 0.8577, std.dev.: 0.0092) SingleSource/Benchmarks/Shootout/matrix: 354.94% (1.5825 => 7.1994, std.dev.: 0.0428) SingleSource/Benchmarks/Shootout/ary3: 286.39% (2.2304 => 8.6180, std.dev.: 2.1815) MultiSource/Applications/sgefa/sgefa: 258.86% (0.3515 => 1.2614, std.dev.: 0.0084) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 242.17% (1.1825 => 4.0462, std.dev.: 0.0153) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 229.49% (4.8185 => 15.8764, std.dev.: 0.0883) SingleSource/Benchmarks/Shootout-C++/ary2: 197.67% (0.0129 => 0.0384, std.dev.: 0.0053) SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 191.67% (0.0228 => 0.0665, std.dev.: 0.0032) SingleSource/Benchmarks/Shootout-C++/ary: 128.88% (0.0232 => 0.0531, std.dev.: 0.0024) SingleSource/Benchmarks/Shootout-C++/matrix: 62.12% (2.9083 => 4.7149, std.dev.: 0.1843) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 33.45% (0.2562 => 0.3419, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 31.66% (3.1254 => 4.1150, std.dev.: 0.0081) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 25.71% (1.4588 => 1.8338, std.dev.: 0.0231) SingleSource/Benchmarks/Misc/salsa20: 21.68% (7.4497 => 9.0650, std.dev.: 0.0174) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.49% (4.8112 => 5.7971, std.dev.: 0.0148) SingleSource/Regression/C/uint64_to_float: 14.78% (1.5397 => 1.7672, std.dev.: 0.0826) MultiSource/Applications/JM/lencod/lencod: 13.83% (6.8159 => 7.7584, std.dev.: 0.1766) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.13% (5.1752 => 5.8548, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.92% (5.0033 => 5.6499, std.dev.: 0.0001) MultiSource/Benchmarks/MallocBench/espresso/espresso: 10.26% (0.6211 => 0.6848, std.dev.: 0.0017) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.83% (3.6477 => 3.9698, std.dev.: 0.0015) SingleSource/Benchmarks/Misc/ReedSolomon: 8.10% (8.6447 => 9.3450, std.dev.: 0.1847) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.70% (4.7473 => 5.0652, std.dev.: 0.0087) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.27% (4.1836 => 4.4042, std.dev.: 0.0017) SingleSource/Benchmarks/McGill/chomp: 4.91% (1.0425 => 1.0937, std.dev.: 0.0055) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.92% (5.0310 => 5.2280, std.dev.: 0.0007) SingleSource/Benchmarks/Linpack/linpack-pc: 3.62% (50.8945 => 52.7348, std.dev.: 0.5976) SingleSource/Benchmarks/Misc/pi: 3.50% (2.1390 => 2.2138, std.dev.: 0.0013) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.21% (4.7254 => 4.8773, std.dev.: 0.0023) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.14% (4.8076 => 4.8622, std.dev.: 0.0003) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/BitBench/drop3/drop3: -28.47% (0.0692 => 0.0495, std.dev.: 0.0004) MultiSource/Applications/hbd/hbd: -19.15% (1.8964 => 1.5332, std.dev.: 0.0902) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -17.75% (0.0676 => 0.0556, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/perimeter/perimeter: -16.65% (0.1009 => 0.0841, std.dev.: 0.0034) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.57% (0.1684 => 0.1405, std.dev.: 0.0044) MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.01% (1.0960 => 0.9315, std.dev.: 0.0067) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.78% (0.7686 => 0.6627, std.dev.: 0.0236) SingleSource/Benchmarks/Misc-C++-EH/spirit: -10.92% (6.4235 => 5.7219, std.dev.: 0.0033) MultiSource/Applications/aha/aha: -8.49% (0.1378 => 0.1261, std.dev.: 0.0034) SingleSource/Benchmarks/Shootout-C++/hash2: -8.34% (0.5134 => 0.4706, std.dev.: 0.0019) MultiSource/Applications/sqlite3/sqlite3: -8.01% (17.5634 => 16.1568, std.dev.: 0.4933) SingleSource/Benchmarks/Shootout-C++/hash: -6.74% (0.4689 => 0.4373, std.dev.: 0.0029) MultiSource/Applications/d/make_dparser: -5.79% (3.7840 => 3.5649, std.dev.: 0.0826) MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.89% (1.0234 => 0.9734, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.84% (0.2709 => 0.2578, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/reversefile: -3.66% (0.3665 => 0.3531, std.dev.: 0.0051) SingleSource/Benchmarks/Shootout-C++/moments: -3.32% (0.4002 => 0.3869, std.dev.: 0.0015) Performance Improvements - Execution Time ----------------------------------------- MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -65.80% (11.5523 => 3.9514, std.dev.: 0.0061) SingleSource/Benchmarks/Misc/fp-convert: -61.77% (15.6525 => 5.9839, std.dev.: 0.1764) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -56.15% (0.4146 => 0.1818, std.dev.: 0.0047) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -48.25% (0.4578 => 0.2369, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -43.93% (11.3868 => 6.3847, std.dev.: 0.0811) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -32.98% (5.4023 => 3.6207, std.dev.: 0.0504) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -31.00% (0.4452 => 0.3072, std.dev.: 0.0020) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.72% (0.5495 => 0.4027, std.dev.: 0.0030) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -26.28% (5.2605 => 3.8780, std.dev.: 0.0073) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -25.24% (4.4467 => 3.3244, std.dev.: 0.0301) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.92% (0.5826 => 0.4374, std.dev.: 0.0158) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -23.43% (4.9921 => 3.8224, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: -23.24% (1.8123 => 1.3912, std.dev.: 0.0112) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -22.93% (0.5897 => 0.4545, std.dev.: 0.0085) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.55% (16.6791 => 13.4188, std.dev.: 0.5276) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -18.47% (5.8755 => 4.7904, std.dev.: 0.0011) MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.83% (0.1164 => 0.1003, std.dev.: 0.0020) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -13.02% (3.1921 => 2.7765, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -12.84% (5.3626 => 4.6743, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -12.53% (9.7992 => 8.5711, std.dev.: 0.0062) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -12.48% (5.7056 => 4.9937, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.78% (5.0421 => 4.4481, std.dev.: 0.0389) MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.65% (2.8778 => 2.5713, std.dev.: 0.0126) MultiSource/Applications/SPASS/SPASS: -9.27% (9.0650 => 8.2247, std.dev.: 0.1328) MultiSource/Benchmarks/mafft/pairlocalalign: -8.98% (63.1520 => 57.4828, std.dev.: 0.1143) SingleSource/Benchmarks/Shootout-C++/lists1: -8.92% (0.6628 => 0.6037, std.dev.: 0.0078) MultiSource/Benchmarks/Olden/treeadd/treeadd: -8.75% (0.4081 => 0.3724, std.dev.: 0.0119) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.65% (7.0016 => 6.3958, std.dev.: 0.0314) MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.3217 => 0.2970, std.dev.: 0.0008) MultiSource/Applications/SIBsim4/SIBsim4: -7.00% (3.5443 => 3.2962, std.dev.: 0.0559) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -6.50% (5.5974 => 5.2333, std.dev.: 0.0029) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -6.47% (4.5424 => 4.2485, std.dev.: 0.0008) MultiSource/Benchmarks/Olden/health/health: -6.27% (0.3654 => 0.3425, std.dev.: 0.0070) SingleSource/Benchmarks/McGill/queens: -5.39% (1.7443 => 1.6503, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/hash2: -4.84% (3.6768 => 3.4990, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.64% (4.9799 => 4.7489, std.dev.: 0.0435) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.95% (1.4446 => 1.3876, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/lists: -3.80% (17.2182 => 16.5634, std.dev.: 0.0568) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.73% (3.5691 => 3.4358, std.dev.: 0.0001) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.98% (40.4729 => 39.2665, std.dev.: 0.3940) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.72% (1.0995 => 1.0696, std.dev.: 0.0077) SingleSource/Benchmarks/Shootout-C++/hash: -2.37% (0.6254 => 0.6106, std.dev.: 0.0042) SingleSource/Benchmarks/Misc/mandel-2: -1.96% (0.8521 => 0.8354, std.dev.: 0.0043) MultiSource/Applications/spiff/spiff: -1.87% (2.8571 => 2.8037, std.dev.: 0.0142) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.77% (8.7327 => 8.5780, std.dev.: 0.0017) MultiSource/Benchmarks/SciMark2-C/scimark2: -1.65% (85.3042 => 83.8960, std.dev.: 0.0295) SingleSource/Benchmarks/Misc/whetstone: -1.43% (1.6251 => 1.6019, std.dev.: 0.0036) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.41% (8.8249 => 8.7004, std.dev.: 0.0200) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.30% (3.3596 => 3.3159, std.dev.: 0.0098) SingleSource/Benchmarks/BenchmarkGame/n-body: -1.16% (1.5476 => 1.5296, std.dev.: 0.0066) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.16% (6.8262 => 6.7473, std.dev.: 0.0041) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.14% (3.7450 => 3.7022, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.10% (3.5669 => 3.5277, std.dev.: 0.0146) Existing Failures - Compile Time -------------------------------- MultiSource/Applications/obsequi/Obsequi SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 MultiSource/Applications/obsequi/Obsequi: 1.34% (1.2047 => 1.2208, std.dev.: 0.0585) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.43% (0.0233 => 0.0232, std.dev.: 0.0017) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.11% (0.0451 => 0.0446, std.dev.: 0.0071) SingleSource/UnitTests/Vector/Altivec/alti_isamax: -13.45% (0.0394 => 0.0341, std.dev.: 0.0010) SingleSource/UnitTests/Vector/Altivec/alti_sdot: -0.61% (0.0328 => 0.0326, std.dev.: 0.0006) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -1.12% (0.0445 => 0.0440, std.dev.: 0.0128) SingleSource/UnitTests/Vector/Altivec/casts: 1.41% (0.0213 => 0.0216, std.dev.: 0.0007) SingleSource/UnitTests/Vector/Altivec/test1: -0.88% (0.0227 => 0.0225, std.dev.: 0.0010) Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/Burg/burg MultiSource/Applications/ClamAV/clamscan MultiSource/Applications/lemon/lemon MultiSource/Applications/obsequi/Obsequi MultiSource/Benchmarks/McCat/12-IOtest/iotest MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount MultiSource/Benchmarks/MiBench/office-ispell/office-ispell MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael MultiSource/Benchmarks/MiBench/security-sha/security-sha MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft MultiSource/Benchmarks/Ptrdist/anagram/anagram MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio MultiSource/Benchmarks/mediabench/g721/g721encode/encode MultiSource/Benchmarks/mediabench/gsm/toast/toast SingleSource/Benchmarks/BenchmarkGame/puzzle SingleSource/Regression/C/2003-05-21-UnionBitfields SingleSource/Regression/C/2003-05-21-UnionTest SingleSource/UnitTests/2005-07-15-Bitfield-ABI SingleSource/UnitTests/2006-01-23-UnionInit SingleSource/UnitTests/2007-04-10-BitfieldTest SingleSource/UnitTests/SignlessTypes/Large/cast SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression SingleSource/UnitTests/Vector/Altivec/alti_expandfft SingleSource/UnitTests/Vector/Altivec/alti_isamax SingleSource/UnitTests/Vector/Altivec/alti_sdot SingleSource/UnitTests/Vector/Altivec/alti_stepfft SingleSource/UnitTests/Vector/Altivec/casts SingleSource/UnitTests/Vector/Altivec/test1 SingleSource/UnitTests/Vectorizer/gcc-loops MultiSource/Applications/ALAC/decode/alacconvert-decode: -9.80% (0.0255 => 0.0230, std.dev.: 0.0036) MultiSource/Applications/Burg/burg: -13.33% (0.0015 => 0.0013, std.dev.: 0.0003) MultiSource/Applications/ClamAV/clamscan: -5.03% (0.1530 => 0.1453, std.dev.: 0.0016) MultiSource/Applications/lemon/lemon: -40.71% (1.9293 => 1.1439, std.dev.: 0.0859) MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.70% (0.4049 => 0.3899, std.dev.: 0.0402) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.44% (0.1510 => 0.1458, std.dev.: 0.0191) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.11% (0.0009 => 0.0008, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -36.71% (0.0978 => 0.0619, std.dev.: 0.0073) MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0276 => 0.0276, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -5.08% (0.0590 => 0.0560, std.dev.: 0.0025) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.95% (1.1617 => 1.2889, std.dev.: 0.0080) MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -9.38% (0.0032 => 0.0029, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0005) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.66% (0.0610 => 0.0614, std.dev.: 0.0098) MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.61% (0.0268 => 0.0275, std.dev.: 0.0047) SingleSource/Benchmarks/BenchmarkGame/puzzle: 134.05% (0.7437 => 1.7406, std.dev.: 0.0149) SingleSource/Regression/C/2003-05-21-UnionBitfields: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/Regression/C/2003-05-21-UnionTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0001) SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000) SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004) SingleSource/UnitTests/2007-04-10-BitfieldTest: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003) SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0022) SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000) SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000) SingleSource/UnitTests/Vectorizer/gcc-loops: 169.21% (12.7781 => 34.3995, std.dev.: 0.1201) Report Time: 0.82s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 23:34:07 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Feb 2013 01:34:07 -0600 (CST) Subject: [llvm-testresults] lab-mini-01__O3-plain__clang_DEV__x86_64 test results Message-ID: <20130201073407.7F8092A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8171?compare_to=8169&baseline=5138 Nickname: lab-mini-01__O3-plain__clang_DEV__x86_64:7 Comparing: Run: 8171, Order: 174146, Start Time: 2013-02-01 06:00:19, End Time: 2013-02-01 07:34:31 To: 8169, Order: 174143, Start Time: 2013-02-01 04:02:15, End Time: 2013-02-01 05:36:20 Baseline: 5138, Order: 166492, Start Time: 2012-10-23 19:35:42, End Time: 2012-10-23 21:01:39 =============== Tests Summary =============== Performance Regressions: 1 (111 on baseline) Performance Improvements: 0 (92 on baseline) Added Tests: 0 (12 on baseline) Unchanged Tests: 1103 (889 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.85% (29.1357 => 29.6749, std.dev.: 0.1520) ================================ Run-Over-Baseline Changes Detail ================================ Performance Regressions - Compile Time -------------------------------------- SingleSource/UnitTests/SignlessTypes/factor: 126.67% (0.0315 => 0.0714, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/lowercase: 79.64% (0.0280 => 0.0503, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 70.43% (0.0717 => 0.1222, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 70.04% (0.0514 => 0.0874, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/lpbench: 67.66% (0.0974 => 0.1633, std.dev.: 0.0003) MultiSource/Benchmarks/FreeBench/neural/neural: 45.87% (0.1500 => 0.2188, std.dev.: 0.0005) SingleSource/Regression/C/sumarraymalloc: 43.45% (0.0267 => 0.0383) SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 42.23% (0.1132 => 0.1610, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 39.40% (0.0599 => 0.0835, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 38.30% (0.6395 => 0.8844, std.dev.: 0.0054) SingleSource/Benchmarks/Stanford/IntMM: 38.28% (0.0418 => 0.0578, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 36.53% (0.6395 => 0.8731, std.dev.: 0.0004) SingleSource/Regression/C/sumarray2d: 34.81% (0.0293 => 0.0395) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 32.95% (0.5688 => 0.7562, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 32.89% (0.6260 => 0.8319, std.dev.: 0.0117) MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 32.72% (0.5456 => 0.7241, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 32.70% (0.5805 => 0.7703, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 32.45% (0.5849 => 0.7747, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 32.12% (0.5567 => 0.7355, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 32.00% (0.5575 => 0.7359, std.dev.: 0.0161) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 31.97% (0.6230 => 0.8222, std.dev.: 0.0102) MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 31.86% (0.5581 => 0.7359, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 31.07% (0.5941 => 0.7787, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 30.95% (0.5802 => 0.7598, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 30.74% (0.5705 => 0.7459, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.53% (0.5569 => 0.7269, std.dev.: 0.0012) MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 30.52% (0.5570 => 0.7270, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 30.49% (0.5857 => 0.7643, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 30.36% (0.5478 => 0.7141, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 30.19% (0.5859 => 0.7628, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 30.17% (0.6033 => 0.7853, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 29.94% (0.5591 => 0.7265, std.dev.: 0.0004) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 29.64% (0.6440 => 0.8349, std.dev.: 0.0005) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 29.37% (1.6474 => 2.1313, std.dev.: 0.0010) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 28.98% (0.6676 => 0.8611, std.dev.: 0.0006) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 28.95% (0.5925 => 0.7640, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 28.86% (0.6189 => 0.7975, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 28.43% (0.6304 => 0.8096, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.42% (0.5863 => 0.7529, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 28.18% (0.0699 => 0.0896, std.dev.: 0.0007) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 28.07% (0.6052 => 0.7751, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.02% (0.6446 => 0.8252, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.35% (0.6194 => 0.7888, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.33% (0.6681 => 0.8507, std.dev.: 0.0077) MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.03% (0.6660 => 0.8460, std.dev.: 0.0170) MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 26.97% (0.6297 => 0.7995, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 25.48% (0.6667 => 0.8366, std.dev.: 0.0005) MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.35% (0.7524 => 0.9356, std.dev.: 0.0006) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 23.88% (0.0582 => 0.0721) MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 23.46% (0.7339 => 0.9061, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/stencils/adi/adi: 23.16% (0.0790 => 0.0973, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.06% (2.2587 => 2.7569, std.dev.: 0.0025) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 21.79% (0.0693 => 0.0844, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 21.70% (0.0622 => 0.0757, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 21.58% (0.0621 => 0.0755, std.dev.: 0.0002) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.61% (0.0634 => 0.0752, std.dev.: 0.0003) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 18.17% (0.0556 => 0.0657, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 17.84% (0.0566 => 0.0667, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 17.65% (0.0833 => 0.0980, std.dev.: 0.0002) MultiSource/Benchmarks/McCat/04-bisect/bisect: 17.19% (0.1146 => 0.1343, std.dev.: 0.0001) MultiSource/Applications/sgefa/sgefa: 17.04% (0.3357 => 0.3929, std.dev.: 0.0011) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 15.44% (0.0680 => 0.0785, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.08% (0.1081 => 0.1244) MultiSource/Applications/lemon/lemon: 14.86% (1.1450 => 1.3152, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 13.27% (0.1982 => 0.2245, std.dev.: 0.0011) MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.68% (4.5069 => 5.0783, std.dev.: 0.0095) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.41% (0.4916 => 0.5526, std.dev.: 0.0005) MultiSource/Benchmarks/McCat/05-eks/eks: 12.23% (0.4515 => 0.5067, std.dev.: 0.0043) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 11.84% (1.6364 => 1.8302, std.dev.: 0.0006) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.70% (3.5339 => 3.9474, std.dev.: 0.0007) SingleSource/Benchmarks/McGill/exptree: 11.69% (0.0864 => 0.0965, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.61% (0.2385 => 0.2638, std.dev.: 0.0018) MultiSource/Benchmarks/mafft/pairlocalalign: 10.10% (9.2283 => 10.1600, std.dev.: 0.0015) SingleSource/UnitTests/2006-12-11-LoadConstants: 8.86% (0.1230 => 0.1339, std.dev.: 0.0008) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 8.65% (0.2001 => 0.2174, std.dev.: 0.0004) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.26% (0.5329 => 0.5769, std.dev.: 0.0000) MultiSource/Applications/Burg/burg: 8.10% (1.2515 => 1.3529, std.dev.: 0.0050) SingleSource/Benchmarks/Shootout-C++/hash: 7.89% (0.4524 => 0.4881, std.dev.: 0.0008) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.74% (0.1731 => 0.1865, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.73% (0.7021 => 0.7564, std.dev.: 0.0006) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 7.63% (1.2784 => 1.3760, std.dev.: 0.0018) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 7.41% (1.4642 => 1.5727, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/hash2: 7.22% (0.4861 => 0.5212, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/ReedSolomon: 6.17% (0.1879 => 0.1995) SingleSource/Benchmarks/Misc-C++/bigfib: 5.72% (0.6750 => 0.7136, std.dev.: 0.0011) SingleSource/Benchmarks/Shootout-C++/matrix: 5.68% (0.3255 => 0.3440, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 5.27% (0.3319 => 0.3494, std.dev.: 0.0049) SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.41% (5.4682 => 5.7091, std.dev.: 0.0018) MultiSource/Applications/oggenc/oggenc: 3.50% (5.0226 => 5.1982, std.dev.: 0.0006) MultiSource/Applications/SIBsim4/SIBsim4: 3.27% (1.3864 => 1.4318, std.dev.: 0.0018) MultiSource/Applications/spiff/spiff: 2.87% (0.8418 => 0.8660, std.dev.: 0.0025) MultiSource/Applications/minisat/minisat: 2.56% (0.7447 => 0.7638, std.dev.: 0.0035) SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.9557 => 0.9776, std.dev.: 0.0005) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.19% (22.4056 => 22.8968, std.dev.: 0.0146) SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.15% (0.5168 => 0.5279, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.11% (1.3722 => 1.4011, std.dev.: 0.0020) MultiSource/Applications/SPASS/SPASS: 2.01% (15.5079 => 15.8197, std.dev.: 0.0124) Performance Regressions - Execution Time ---------------------------------------- MultiSource/Benchmarks/SciMark2-C/scimark2: 77.82% (31.3723 => 55.7857, std.dev.: 0.0117) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.68% (0.9531 => 1.0263, std.dev.: 0.0016) SingleSource/Regression/C/uint64_to_float: 7.33% (0.5692 => 0.6109, std.dev.: 0.0007) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.06% (1.2783 => 1.3685, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.18% (0.2380 => 0.2527, std.dev.: 0.0000) MultiSource/Benchmarks/nbench/nbench: 4.04% (11.6767 => 12.1485, std.dev.: 0.0005) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.54% (54.5751 => 56.5094, std.dev.: 0.1088) SingleSource/Benchmarks/BenchmarkGame/recursive: 3.31% (2.0478 => 2.1155, std.dev.: 0.0100) SingleSource/Benchmarks/Misc/perlin: 2.85% (5.9709 => 6.1411, std.dev.: 0.0001) MultiSource/Benchmarks/mafft/pairlocalalign: 1.74% (27.8210 => 28.3040, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/huffbench: 1.58% (18.2231 => 18.5110, std.dev.: 0.0075) MultiSource/Benchmarks/sim/sim: 1.54% (4.8812 => 4.9564, std.dev.: 0.0014) MultiSource/Applications/sqlite3/sqlite3: 1.33% (4.5320 => 4.5924, std.dev.: 0.0032) MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.24% (5.1955 => 5.2598, std.dev.: 0.0048) Performance Improvements - Compile Time --------------------------------------- SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -12.18% (0.1281 => 0.1125, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/objinst: -5.20% (0.3194 => 0.3028, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.71% (0.7198 => 0.6859, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/trivial-interface: -4.49% (0.3812 => 0.3641, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-2: -4.39% (0.3831 => 0.3663, std.dev.: 0.0002) SingleSource/UnitTests/ObjC/exceptions-3: -4.37% (0.3848 => 0.3680, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/exceptions-4: -4.30% (0.3880 => 0.3713, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: -4.29% (0.3896 => 0.3729, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/block-byref-aggr: -4.14% (0.3891 => 0.3730, std.dev.: 0.0011) SingleSource/UnitTests/ObjC/for-in: -4.12% (0.4033 => 0.3867, std.dev.: 0.0030) SingleSource/UnitTests/ObjC/exceptions: -4.00% (0.4176 => 0.4009, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.99% (0.3837 => 0.3684, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/instance-method-metadata: -3.86% (0.3884 => 0.3734, std.dev.: 0.0002) MultiSource/Benchmarks/PAQ8p/paq8p: -3.55% (2.4924 => 2.4040, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/fibo: -3.52% (0.2871 => 0.2770, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/sumcol: -3.50% (0.3057 => 0.2950, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/property: -3.41% (0.4199 => 0.4056, std.dev.: 0.0003) SingleSource/UnitTests/ObjC++/Hello: -3.25% (0.6347 => 0.6141, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: -3.21% (0.9852 => 0.9536, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/wc: -3.15% (0.3205 => 0.3104, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: -3.00% (2.1713 => 2.1061, std.dev.: 0.0040) SingleSource/UnitTests/ObjC++/property-reference-object: -2.98% (0.6441 => 0.6249, std.dev.: 0.0001) SingleSource/UnitTests/ObjC/parameter-passing: -2.97% (0.4280 => 0.4153, std.dev.: 0.0001) MultiSource/Applications/hexxagon/hexxagon: -2.69% (1.3148 => 1.2794, std.dev.: 0.0007) SingleSource/UnitTests/ObjC++/property-reference: -2.65% (0.7779 => 0.7573, std.dev.: 0.0002) SingleSource/UnitTests/Vector/constpool: -2.56% (20.7746 => 20.2431, std.dev.: 0.0265) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -2.38% (0.6484 => 0.6330, std.dev.: 0.0015) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.15% (0.9542 => 0.9337, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.07% (14.2083 => 13.9145, std.dev.: 0.0035) MultiSource/Applications/sqlite3/sqlite3: -1.62% (17.1032 => 16.8253, std.dev.: 0.0230) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.35% (0.7919 => 0.7812, std.dev.: 0.0027) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.34% (6.7716 => 6.6810, std.dev.: 0.0034) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.13% (1.0544 => 1.0425, std.dev.: 0.0018) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Dhrystone/fldry: -62.32% (1.8100 => 0.6820, std.dev.: 0.0115) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.06% (0.6962 => 0.3407, std.dev.: 0.0099) SingleSource/Benchmarks/Dhrystone/dry: -50.80% (2.3742 => 1.1680) MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -49.08% (6.6713 => 3.3968, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/dt: -48.63% (2.0459 => 1.0509, std.dev.: 0.0000) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -36.74% (0.1622 => 0.1026, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/lowercase: -33.99% (8.0445 => 5.3102, std.dev.: 0.0026) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -28.34% (0.1983 => 0.1421, std.dev.: 0.0010) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -26.59% (0.2151 => 0.1579, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -25.31% (4.3504 => 3.2492, std.dev.: 0.0034) SingleSource/Benchmarks/Misc/mandel-2: -25.03% (1.3643 => 1.0228, std.dev.: 0.0022) SingleSource/Benchmarks/Shootout-C++/methcall: -23.45% (7.5137 => 5.7519, std.dev.: 0.0049) MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -23.15% (4.3779 => 3.3643) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -22.96% (0.2274 => 0.1752, std.dev.: 0.0001) MultiSource/Benchmarks/PAQ8p/paq8p: -22.84% (83.5423 => 64.4575, std.dev.: 0.0060) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3454 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary2: -22.22% (0.0756 => 0.0588, std.dev.: 0.0015) SingleSource/Benchmarks/Shootout-C++/ary: -21.93% (0.0757 => 0.0591, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.87% (4.1024 => 3.2052, std.dev.: 0.0009) MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -21.85% (5.3397 => 4.1731, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.75% (2.9703 => 2.3244, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.64% (1.2237 => 0.9589) MultiSource/Applications/sgefa/sgefa: -20.08% (0.6299 => 0.5034, std.dev.: 0.0003) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -17.31% (1.0217 => 0.8448, std.dev.: 0.0060) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.12% (0.3418 => 0.2833, std.dev.: 0.0000) SingleSource/UnitTests/Vector/multiplies: -15.21% (2.5106 => 2.1288, std.dev.: 0.0023) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.15% (0.4092 => 0.3513, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -13.68% (4.2493 => 3.6680, std.dev.: 0.0003) MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -13.63% (4.7378 => 4.0919, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/matrix: -13.31% (3.1443 => 2.7258, std.dev.: 0.0002) MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.26% (4.9100 => 4.3570, std.dev.: 0.0005) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -11.03% (0.3626 => 0.3226, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/matrix: -10.43% (3.0680 => 2.7479, std.dev.: 0.0004) SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.86% (0.5142 => 0.4635, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/richards_benchmark: -9.03% (1.2842 => 1.1683, std.dev.: 0.0008) MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.02% (4.1534 => 3.8203, std.dev.: 0.0000) MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -7.68% (7.1848 => 6.6332, std.dev.: 0.0027) MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -7.66% (5.2027 => 4.8040, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/misr: -7.00% (0.1586 => 0.1475) SingleSource/Benchmarks/Misc/ffbench: -6.72% (0.9021 => 0.8415, std.dev.: 0.0001) MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.13% (5.3830 => 5.1070, std.dev.: 0.0001) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.48% (0.8545 => 0.8162, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.30% (1.7753 => 1.6989, std.dev.: 0.0005) SingleSource/Benchmarks/Misc/fbench: -3.96% (2.2633 => 2.1737, std.dev.: 0.0064) SingleSource/Benchmarks/Shootout/fib2: -3.74% (6.5803 => 6.3341, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/oourafft: -3.26% (5.5807 => 5.3988, std.dev.: 0.0005) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -2.98% (1.0557 => 1.0242, std.dev.: 0.0001) SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.87% (1.3096 => 1.2720, std.dev.: 0.0127) MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.82% (4.4002 => 4.2762, std.dev.: 0.0002) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -2.32% (7.9763 => 7.7911, std.dev.: 0.0114) SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.32% (3.1919 => 3.1180, std.dev.: 0.0018) MultiSource/Benchmarks/Bullet/bullet: -1.88% (7.3040 => 7.1666, std.dev.: 0.0158) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -1.65% (6.5735 => 6.4653, std.dev.: 0.0054) MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.58% (2.7523 => 2.7087, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.44% (1.6307 => 1.6072, std.dev.: 0.0031) MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.41% (2.1154 => 2.0855, std.dev.: 0.0001) SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.41% (1.6219 => 1.5990, std.dev.: 0.0044) SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.17% (1.6086 => 1.5898, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: -1.01% (3.2107 => 3.1784, std.dev.: 0.0002) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/Vectorizer/gcc-loops Report Time: 1.32s -------------- next part -------------- An HTML attachment was scrubbed... URL: From llvm-testresults at cs.uiuc.edu Thu Jan 31 23:34:14 2013 From: llvm-testresults at cs.uiuc.edu (llvm-testresults at cs.uiuc.edu) Date: Fri, 1 Feb 2013 01:34:14 -0600 (CST) Subject: [llvm-testresults] lab-mini-02__O3-vectorize__clang_DEV__x86_64 test results Message-ID: <20130201073414.164DE2A6C070@llvm.org> http://llvm.org/perf/db_default/v4/nts/8172?compare_to=8167&baseline=1011 Nickname: lab-mini-02__O3-vectorize__clang_DEV__x86_64:4 Comparing: Run: 8172, Order: 174144, Start Time: 2013-02-01 05:22:53, End Time: 2013-02-01 07:34:37 To: 8167, Order: 174133, Start Time: 2013-02-01 02:40:19, End Time: 2013-02-01 04:52:00 Baseline: 1011, Order: 158353, Start Time: 2012-06-12 08:08:24, End Time: 2012-06-12 09:09:35 =============== Tests Summary =============== New Failures: 0 (2 on baseline) New Passes: 0 (17 on baseline) Performance Regressions: 0 (226 on baseline) Performance Improvements: 0 (64 on baseline) Added Tests: 0 (146 on baseline) Existing Failures: 4 (2 on baseline) Unchanged Tests: 1100 (647 on baseline) Total Tests: 1104 =========================== Run-Over-Run Changes Detail =========================== Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Benchmarks/Olden/power/power MultiSource/Applications/oggenc/oggenc: -0.08% (0.1327 => 0.1326, std.dev.: 0.0000) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 0.24% (0.0418 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.67% (0.0681 => 0.0656, std.dev.: 0.0013) MultiSource/Benchmarks/Olden/power/power: 0.00% (499.8460 => 499.8566, std.dev.: 0.0076) ================================ Run-Over-Baseline Changes Detail ================================ New Failures - Execution Time ----------------------------- MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000 MultiSource/Benchmarks/Olden/power/power MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -99.05% (4.3882 => 0.0419, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/power/power: 44225.32% (1.1277 => 499.8566, std.dev.: 0.0076) New Passes - Compile Time ------------------------- MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/SIBsim4/SIBsim4: 224.23% (0.5229 => 1.6954, std.dev.: 0.0015) MultiSource/Applications/SPASS/SPASS: 24.18% (14.9895 => 18.6147, std.dev.: 0.0097) MultiSource/Applications/kimwitu++/kc: 45.98% (14.1553 => 20.6643, std.dev.: 0.0021) MultiSource/Benchmarks/MallocBench/gs/gs: 19.97% (4.1105 => 4.9315, std.dev.: 0.0020) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 60.68% (1.1048 => 1.7752, std.dev.: 0.0016) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 431.04% (7.1582 => 38.0126, std.dev.: 0.0168) SingleSource/Benchmarks/Misc-C++-EH/spirit: 87.29% (3.4629 => 6.4855, std.dev.: 0.0012) SingleSource/Benchmarks/Misc-C++/stepanov_container: 81.58% (0.6222 => 1.1298, std.dev.: 0.0016) New Passes - Execution Time --------------------------- MultiSource/Applications/JM/lencod/lencod MultiSource/Applications/SIBsim4/SIBsim4 MultiSource/Applications/SPASS/SPASS MultiSource/Applications/kimwitu++/kc MultiSource/Benchmarks/MallocBench/gs/gs MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 SingleSource/Benchmarks/Misc-C++-EH/spirit SingleSource/Benchmarks/Misc-C++/stepanov_container MultiSource/Applications/JM/lencod/lencod: 10246.94% (0.0720 => 7.4498, std.dev.: 0.0022) MultiSource/Applications/SIBsim4/SIBsim4: 3835200.00% (0.0001 => 3.8353, std.dev.: 0.0017) MultiSource/Applications/SPASS/SPASS: 11138300.00% (0.0001 => 11.1384, std.dev.: 0.0059) MultiSource/Applications/kimwitu++/kc: 51600.00% (0.0001 => 0.0517, std.dev.: 0.0002) MultiSource/Benchmarks/MallocBench/gs/gs: 63300.00% (0.0001 => 0.0634, std.dev.: 0.0012) MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 14200.00% (0.0001 => 0.0143, std.dev.: 0.0000) MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 575300.00% (0.0001 => 0.5754, std.dev.: 0.0006) SingleSource/Benchmarks/Misc-C++-EH/spirit: 9849300.00% (0.0001 => 9.8494, std.dev.: 0.0005) SingleSource/Benchmarks/Misc-C++/stepanov_container: 5488900.00% (0.0001 => 5.4890, std.dev.: 0.0071) Performance Regressions - Compile Time -------------------------------------- MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 813.38% (1.1194 => 10.2244, std.dev.: 0.0111) MultiSource/Applications/ClamAV/clamscan: 149.43% (22.1758 => 55.3140, std.dev.: 0.0102) SingleSource/Benchmarks/Misc/lowercase: 130.47% (0.0256 => 0.0590, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/lpbench: 102.26% (0.0929 => 0.1879, std.dev.: 0.0000) SingleSource/Regression/C/sumarraymalloc: 93.42% (0.0243 => 0.0470, std.dev.: 0.0009) MultiSource/Benchmarks/FreeBench/neural/neural: 79.90% (0.1463 => 0.2632, std.dev.: 0.0005) SingleSource/Regression/C/sumarray2d: 71.96% (0.0271 => 0.0466, std.dev.: 0.0001) SingleSource/Benchmarks/CoyoteBench/almabench: 66.85% (0.0730 => 0.1218, std.dev.: 0.0004) SingleSource/Benchmarks/Stanford/IntMM: 65.48% (0.0394 => 0.0652, std.dev.: 0.0001) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 58.64% (2.9384 => 4.6616, std.dev.: 0.0118) SingleSource/Regression/C/sumarray: 56.28% (0.0231 => 0.0361, std.dev.: 0.0009) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 55.44% (1.5859 => 2.4651, std.dev.: 0.0020) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 53.90% (7.0540 => 10.8558, std.dev.: 0.0031) MultiSource/Benchmarks/FreeBench/distray/distray: 51.52% (0.1056 => 0.1600, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout/ary3: 50.86% (0.0232 => 0.0350, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 49.55% (8.1363 => 12.1678, std.dev.: 0.0117) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 45.02% (2.2024 => 3.1939, std.dev.: 0.0047) MultiSource/Applications/sgefa/sgefa: 44.64% (0.3109 => 0.4497, std.dev.: 0.0006) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 44.42% (0.0439 => 0.0634) SingleSource/UnitTests/vla: 43.66% (0.0355 => 0.0510, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/flops: 40.78% (0.1432 => 0.2016, std.dev.: 0.0009) MultiSource/Applications/JM/lencod/lencod: 40.41% (21.9371 => 30.8014, std.dev.: 0.0124) MultiSource/Benchmarks/McCat/04-bisect/bisect: 40.11% (0.1062 => 0.1488, std.dev.: 0.0003) MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 37.20% (1.5415 => 2.1150, std.dev.: 0.0016) MultiSource/Benchmarks/MallocBench/espresso/espresso: 36.98% (4.2646 => 5.8416, std.dev.: 0.0039) MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 35.62% (0.4615 => 0.6259, std.dev.: 0.0001) SingleSource/Benchmarks/McGill/exptree: 35.38% (0.0814 => 0.1102, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.48% (0.2271 => 0.3054, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 33.81% (0.5105 => 0.6831, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 33.56% (0.1892 => 0.2527, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/05-eks/eks: 33.05% (0.4299 => 0.5720, std.dev.: 0.0002) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 32.28% (0.6675 => 0.8830, std.dev.: 0.0002) MultiSource/Applications/Burg/burg: 32.25% (1.1642 => 1.5396, std.dev.: 0.0003) MultiSource/Benchmarks/NPB-serial/is/is: 31.85% (0.0719 => 0.0948) SingleSource/Benchmarks/Stanford/Oscar: 31.13% (0.0636 => 0.0834, std.dev.: 0.0002) SingleSource/UnitTests/Vector/SSE/sse_expandfft: 31.02% (0.1125 => 0.1474, std.dev.: 0.0005) MultiSource/Benchmarks/mafft/pairlocalalign: 30.12% (9.4845 => 12.3417, std.dev.: 0.0119) SingleSource/Benchmarks/McGill/chomp: 29.91% (0.1655 => 0.2150, std.dev.: 0.0016) SingleSource/UnitTests/ObjC/dot-syntax-1: 29.23% (0.0479 => 0.0619, std.dev.: 0.0009) SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 28.85% (0.1695 => 0.2184, std.dev.: 0.0007) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.70% (3.8922 => 5.0091, std.dev.: 0.0173) SingleSource/Benchmarks/BenchmarkGame/n-body: 28.55% (0.0746 => 0.0959) MultiSource/Benchmarks/McCat/12-IOtest/iotest: 28.25% (0.0793 => 0.1017, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash: 28.24% (0.4289 => 0.5500, std.dev.: 0.0016) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 28.23% (0.0457 => 0.0586, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/bison/mybison: 27.55% (1.4186 => 1.8094, std.dev.: 0.0049) MultiSource/Applications/lemon/lemon: 27.49% (1.0722 => 1.3670, std.dev.: 0.0010) MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 27.45% (0.1337 => 0.1704, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/08-main/main: 27.21% (0.2554 => 0.3249, std.dev.: 0.0002) SingleSource/Benchmarks/BenchmarkGame/puzzle: 26.96% (0.0408 => 0.0518, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/hash2: 26.77% (0.4620 => 0.5857, std.dev.: 0.0013) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 26.71% (0.1906 => 0.2415, std.dev.: 0.0002) MultiSource/Benchmarks/SciMark2-C/scimark2: 26.40% (0.3121 => 0.3945, std.dev.: 0.0001) MultiSource/Benchmarks/Fhourstones/fhourstones: 25.99% (0.1566 => 0.1973, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/tsp/tsp: 25.79% (0.1175 => 0.1478, std.dev.: 0.0005) MultiSource/Applications/minisat/minisat: 25.75% (0.7115 => 0.8947, std.dev.: 0.0004) SingleSource/UnitTests/2006-12-11-LoadConstants: 25.37% (0.1143 => 0.1433) SingleSource/Benchmarks/Misc-C++/bigfib: 25.05% (0.6456 => 0.8073, std.dev.: 0.0037) MultiSource/Benchmarks/Prolangs-C++/garage/garage: 25.00% (0.0672 => 0.0840, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/functionobjects: 24.98% (0.5020 => 0.6274, std.dev.: 0.0078) MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 24.94% (0.0842 => 0.1052, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/whetstone: 24.70% (0.0660 => 0.0823, std.dev.: 0.0012) MultiSource/Benchmarks/Olden/mst/mst: 24.68% (0.1163 => 0.1450, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout/hash: 24.33% (0.0485 => 0.0603) MultiSource/Benchmarks/Prolangs-C++/simul/simul: 24.25% (0.0730 => 0.0907, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 24.16% (1.3050 => 1.6203, std.dev.: 0.0011) SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 24.03% (0.1236 => 0.1533, std.dev.: 0.0021) MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 23.93% (0.0886 => 0.1098, std.dev.: 0.0001) MultiSource/Applications/viterbi/viterbi: 23.92% (0.1555 => 0.1927, std.dev.: 0.0000) MultiSource/Benchmarks/llubenchmark/llu: 23.81% (0.0462 => 0.0572, std.dev.: 0.0000) SingleSource/Benchmarks/CoyoteBench/huffbench: 23.65% (0.0871 => 0.1077, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 23.64% (0.1032 => 0.1276, std.dev.: 0.0007) MultiSource/Benchmarks/McCat/15-trie/trie: 23.53% (0.0527 => 0.0651, std.dev.: 0.0001) MultiSource/Benchmarks/Olden/voronoi/voronoi: 23.48% (0.2700 => 0.3334, std.dev.: 0.0004) MultiSource/Applications/spiff/spiff: 23.47% (0.7835 => 0.9674, std.dev.: 0.0027) MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 23.42% (0.1029 => 0.1270, std.dev.: 0.0010) SingleSource/Benchmarks/Shootout/lists: 23.16% (0.0626 => 0.0771, std.dev.: 0.0001) MultiSource/Benchmarks/McCat/17-bintr/bintr: 23.11% (0.0675 => 0.0831) SingleSource/Benchmarks/Shootout-C++/matrix: 23.05% (0.3098 => 0.3812, std.dev.: 0.0083) MultiSource/Applications/oggenc/oggenc: 23.00% (5.7591 => 7.0839, std.dev.: 0.0131) SingleSource/UnitTests/Vector/SSE/sse_stepfft: 22.88% (0.0953 => 0.1171, std.dev.: 0.0003) MultiSource/Benchmarks/nbench/nbench: 22.78% (1.1840 => 1.4537, std.dev.: 0.0057) MultiSource/Applications/d/make_dparser: 22.76% (3.3354 => 4.0945, std.dev.: 0.0123) SingleSource/UnitTests/ObjC/messages-2: 22.66% (0.0662 => 0.0812) MultiSource/Applications/aha/aha: 22.59% (0.1151 => 0.1411, std.dev.: 0.0002) MultiSource/Benchmarks/Olden/em3d/em3d: 22.24% (0.1695 => 0.2072, std.dev.: 0.0011) MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 21.98% (0.5860 => 0.7148, std.dev.: 0.0014) MultiSource/Benchmarks/Ptrdist/ft/ft: 21.96% (0.1940 => 0.2366, std.dev.: 0.0013) MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.72% (4.9449 => 6.0189, std.dev.: 0.0116) SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.59% (0.3307 => 0.4021, std.dev.: 0.0004) MultiSource/Benchmarks/Ptrdist/ks/ks: 21.52% (0.1510 => 0.1835, std.dev.: 0.0002) MultiSource/Benchmarks/VersaBench/dbms/dbms: 21.43% (0.8172 => 0.9923, std.dev.: 0.0056) MultiSource/Benchmarks/Olden/bisort/bisort: 21.34% (0.0614 => 0.0745, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/football/football: 21.15% (0.8921 => 1.0808, std.dev.: 0.0016) MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.09% (5.0018 => 6.0567, std.dev.: 0.0032) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.02% (0.1584 => 0.1917, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/ReedSolomon: 20.69% (0.2049 => 0.2473, std.dev.: 0.0012) MultiSource/Benchmarks/BitBench/five11/five11: 20.63% (0.0567 => 0.0684, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/18-imp/imp: 20.63% (0.3423 => 0.4129, std.dev.: 0.0016) MultiSource/Benchmarks/Prolangs-C/loader/loader: 20.49% (0.2758 => 0.3323, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 20.45% (0.0528 => 0.0636, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 20.40% (0.9765 => 1.1757, std.dev.: 0.0046) MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 20.26% (0.0834 => 0.1003, std.dev.: 0.0001) MultiSource/Applications/treecc/treecc: 20.23% (2.0273 => 2.4374, std.dev.: 0.0075) MultiSource/Applications/lambda-0_1_3/lambda: 20.22% (0.7433 => 0.8936, std.dev.: 0.0006) SingleSource/UnitTests/SignlessTypes/rem: 20.19% (0.1144 => 0.1375, std.dev.: 0.0002) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 20.06% (0.6450 => 0.7744, std.dev.: 0.0073) MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 20.02% (0.5569 => 0.6684, std.dev.: 0.0011) MultiSource/Benchmarks/Ptrdist/bc/bc: 20.01% (1.1861 => 1.4234, std.dev.: 0.0088) MultiSource/Applications/lua/lua: 19.83% (3.8723 => 4.6403, std.dev.: 0.0072) MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 19.70% (0.2107 => 0.2522, std.dev.: 0.0001) MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 19.70% (0.1117 => 0.1337, std.dev.: 0.0003) MultiSource/Benchmarks/VersaBench/bmm/bmm: 19.50% (0.0759 => 0.0907, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 19.44% (0.0648 => 0.0774, std.dev.: 0.0011) MultiSource/Benchmarks/Olden/health/health: 19.40% (0.1268 => 0.1514, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 19.35% (0.0770 => 0.0919, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/perlin: 19.03% (0.0536 => 0.0638, std.dev.: 0.0018) SingleSource/Benchmarks/Shootout-C++/spellcheck: 18.94% (0.4203 => 0.4999, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/life/life: 18.86% (0.0933 => 0.1109, std.dev.: 0.0005) MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 18.60% (0.2065 => 0.2449, std.dev.: 0.0029) MultiSource/Benchmarks/Olden/perimeter/perimeter: 18.44% (0.0770 => 0.0912, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/ary3: 18.40% (0.3283 => 0.3887, std.dev.: 0.0004) MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.33% (0.8101 => 0.9586, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 18.32% (0.5981 => 0.7077, std.dev.: 0.0037) MultiSource/Applications/siod/siod: 18.15% (2.2969 => 2.7139, std.dev.: 0.0135) MultiSource/Benchmarks/Prolangs-C++/trees/trees: 18.10% (0.1044 => 0.1233, std.dev.: 0.0004) SingleSource/Benchmarks/McGill/misr: 18.01% (0.0633 => 0.0747, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ary: 17.95% (0.3232 => 0.3812, std.dev.: 0.0004) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.94% (0.2603 => 0.3070, std.dev.: 0.0002) MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.87% (0.3441 => 0.4056, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout/matrix: 17.24% (0.0818 => 0.0959, std.dev.: 0.0000) MultiSource/Benchmarks/McCat/09-vor/vor: 16.82% (0.3180 => 0.3715, std.dev.: 0.0010) MultiSource/Benchmarks/sim/sim: 16.71% (0.3387 => 0.3953, std.dev.: 0.0026) SingleSource/UnitTests/Vector/SSE/sse_isamax: 16.48% (0.0704 => 0.0820, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/ary2: 16.07% (0.3379 => 0.3922, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 16.02% (0.8067 => 0.9359, std.dev.: 0.0017) SingleSource/Benchmarks/CoyoteBench/fftbench: 15.75% (0.4636 => 0.5366, std.dev.: 0.0017) SingleSource/Benchmarks/Shootout-C++/reversefile: 15.65% (0.3865 => 0.4470, std.dev.: 0.0013) SingleSource/Regression/C++/ofstream_ctor: 15.08% (0.2905 => 0.3343, std.dev.: 0.0008) MultiSource/Benchmarks/Prolangs-C++/employ/employ: 15.06% (0.4103 => 0.4721, std.dev.: 0.0006) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 15.04% (0.0838 => 0.0964, std.dev.: 0.0002) MultiSource/Applications/hbd/hbd: 14.46% (1.5603 => 1.7859, std.dev.: 0.0037) SingleSource/Benchmarks/Shootout-C++/moments: 14.45% (0.4048 => 0.4633, std.dev.: 0.0005) MultiSource/Applications/sqlite3/sqlite3: 14.27% (17.1811 => 19.6332, std.dev.: 0.0214) SingleSource/Benchmarks/Shootout-C++/lists: 14.17% (0.3422 => 0.3907, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/lists1: 13.76% (0.3684 => 0.4191, std.dev.: 0.0088) SingleSource/Benchmarks/Shootout-C++/sieve: 13.71% (0.3603 => 0.4097, std.dev.: 0.0014) SingleSource/UnitTests/ObjC/parameter-passing: 12.99% (0.3927 => 0.4437, std.dev.: 0.0099) SingleSource/Benchmarks/Misc-C++/Large/ray: 12.87% (0.4064 => 0.4587, std.dev.: 0.0009) MultiSource/Benchmarks/Olden/bh/bh: 12.84% (0.3092 => 0.3489, std.dev.: 0.0021) MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 12.81% (0.3826 => 0.4316, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/oourafft: 12.80% (0.3282 => 0.3702, std.dev.: 0.0012) MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.78% (0.0798 => 0.0900, std.dev.: 0.0012) SingleSource/UnitTests/ObjC/property: 12.74% (0.3886 => 0.4381, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.55% (14.3668 => 16.1700, std.dev.: 0.0027) MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 12.49% (0.3427 => 0.3855, std.dev.: 0.0006) SingleSource/Benchmarks/Stanford/Puzzle: 12.46% (0.1268 => 0.1426, std.dev.: 0.0001) MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.26% (0.2430 => 0.2728, std.dev.: 0.0007) SingleSource/UnitTests/ObjC/exceptions: 12.10% (0.3828 => 0.4291, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/exceptions-2: 11.75% (0.3497 => 0.3908, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/for-in: 11.69% (0.3694 => 0.4126, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/trivial-interface: 11.66% (0.3473 => 0.3878, std.dev.: 0.0000) SingleSource/UnitTests/ObjC/exceptions-3: 11.63% (0.3516 => 0.3925, std.dev.: 0.0003) SingleSource/UnitTests/ObjC/instance-method-metadata: 11.63% (0.3543 => 0.3955, std.dev.: 0.0018) SingleSource/UnitTests/ObjC/exceptions-4: 11.60% (0.3543 => 0.3954, std.dev.: 0.0007) MultiSource/Benchmarks/Prolangs-C++/objects/objects: 11.58% (0.1114 => 0.1243, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/strcat: 11.55% (0.2831 => 0.3158, std.dev.: 0.0005) SingleSource/UnitTests/ObjC/synchronized: 11.51% (0.3561 => 0.3971, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.21% (0.3935 => 0.4376, std.dev.: 0.0005) MultiSource/Benchmarks/Prolangs-C++/city/city: 11.05% (2.0665 => 2.2948, std.dev.: 0.0031) SingleSource/Benchmarks/Shootout-C++/except: 10.90% (0.2871 => 0.3184, std.dev.: 0.0002) MultiSource/Applications/hexxagon/hexxagon: 10.78% (1.2842 => 1.4227, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout-C++/methcall: 10.78% (0.2877 => 0.3187, std.dev.: 0.0004) MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 10.36% (0.3650 => 0.4028, std.dev.: 0.0001) SingleSource/Benchmarks/Shootout-C++/heapsort: 10.31% (0.2872 => 0.3168, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/sumcol: 10.27% (0.2891 => 0.3188, std.dev.: 0.0009) MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 10.25% (0.3162 => 0.3486, std.dev.: 0.0002) SingleSource/Benchmarks/Shootout-C++/wc: 10.19% (0.3052 => 0.3363) SingleSource/Benchmarks/Shootout-C++/hello: 10.06% (0.2714 => 0.2987, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/random: 9.99% (0.2802 => 0.3082, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/ackermann: 9.94% (0.2756 => 0.3030, std.dev.: 0.0004) SingleSource/Benchmarks/Shootout-C++/fibo: 9.87% (0.2725 => 0.2994, std.dev.: 0.0005) SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.85% (0.2793 => 0.3068, std.dev.: 0.0011) SingleSource/UnitTests/ObjC++/property-reference-object: 9.65% (0.6030 => 0.6612, std.dev.: 0.0001) MultiSource/Benchmarks/Prolangs-C++/office/office: 9.41% (0.3136 => 0.3431, std.dev.: 0.0002) SingleSource/UnitTests/ObjC++/property-reference: 9.34% (0.7326 => 0.8010, std.dev.: 0.0026) SingleSource/UnitTests/ObjC++/Hello: 9.25% (0.5925 => 0.6473, std.dev.: 0.0028) MultiSource/Benchmarks/Bullet/bullet: 9.20% (63.2438 => 69.0636, std.dev.: 0.0193) MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 8.31% (0.1625 => 0.1760, std.dev.: 0.0019) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.20% (0.1330 => 0.1439, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.01% (2.2022 => 2.3787, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/himenobmtxpa: 7.41% (0.2266 => 0.2434, std.dev.: 0.0004) MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.32% (0.4879 => 0.5236, std.dev.: 0.0001) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.30% (0.3177 => 0.3409, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 7.02% (0.1438 => 0.1539, std.dev.: 0.0006) SingleSource/Benchmarks/Shootout-C++/objinst: 5.27% (0.3131 => 0.3296, std.dev.: 0.0004) MultiSource/Benchmarks/PAQ8p/paq8p: 5.24% (10.3673 => 10.9105, std.dev.: 0.0038) SingleSource/UnitTests/ObjC/block-byref-aggr: 4.06% (0.3817 => 0.3972, std.dev.: 0.0009) MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.81% (7.9617 => 8.2648, std.dev.: 0.0096) Performance Regressions - Execution Time ---------------------------------------- SingleSource/Benchmarks/Shootout/methcall: 147.90% (4.3953 => 10.8959, std.dev.: 0.0036) SingleSource/Benchmarks/Shootout-C++/methcall: 146.52% (5.3999 => 13.3117, std.dev.: 0.0015) MultiSource/Benchmarks/SciMark2-C/scimark2: 82.91% (32.5116 => 59.4662, std.dev.: 0.0088) MultiSource/Benchmarks/Ptrdist/anagram/anagram: 16.05% (1.1145 => 1.2934, std.dev.: 0.0016) SingleSource/Benchmarks/Misc/oourafft: 15.81% (6.6465 => 7.6976, std.dev.: 0.0004) SingleSource/Regression/C/uint64_to_float: 13.02% (0.5413 => 0.6118, std.dev.: 0.0004) MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.73% (0.2944 => 0.3260, std.dev.: 0.0001) SingleSource/Benchmarks/Misc/richards_benchmark: 9.30% (1.1396 => 1.2456, std.dev.: 0.0003) SingleSource/Benchmarks/BenchmarkGame/fannkuch: 8.94% (2.8904 => 3.1487, std.dev.: 0.0002) MultiSource/Benchmarks/nbench/nbench: 6.89% (11.6436 => 12.4457, std.dev.: 0.0475) SingleSource/Benchmarks/Misc-C++/Large/ray: 5.71% (4.2280 => 4.4696, std.dev.: 0.0039) SingleSource/Benchmarks/Shootout-C++/hash2: 4.93% (3.1578 => 3.3134, std.dev.: 0.0008) SingleSource/Benchmarks/Misc/ffbench: 4.08% (0.9505 => 0.9893, std.dev.: 0.0002) SingleSource/Benchmarks/Misc-C++/bigfib: 3.80% (0.3316 => 0.3442, std.dev.: 0.0008) MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.80% (0.9957 => 1.0335, std.dev.: 0.0073) MultiSource/Benchmarks/BitBench/drop3/drop3: 3.39% (0.4162 => 0.4303, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/fftbench: 3.38% (2.0360 => 2.1049, std.dev.: 0.0103) MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.77% (8.6802 => 8.9209, std.dev.: 0.0131) SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.49% (1.0313 => 1.0570, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/himenobmtxpa: 2.48% (3.6395 => 3.7297, std.dev.: 0.0029) SingleSource/Benchmarks/BenchmarkGame/n-body: 2.06% (1.3677 => 1.3959, std.dev.: 0.0000) MultiSource/Benchmarks/Olden/bisort/bisort: 1.94% (0.8333 => 0.8495, std.dev.: 0.0006) MultiSource/Applications/aha/aha: 1.92% (3.1595 => 3.2203, std.dev.: 0.0006) MultiSource/Applications/minisat/minisat: 1.81% (9.1159 => 9.2806, std.dev.: 0.0333) SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.80% (1.7254 => 1.7564, std.dev.: 0.0002) MultiSource/Benchmarks/mafft/pairlocalalign: 1.67% (27.8444 => 28.3082, std.dev.: 0.0006) MultiSource/Benchmarks/Olden/tsp/tsp: 1.36% (1.0785 => 1.0932, std.dev.: 0.0008) Performance Improvements - Compile Time --------------------------------------- MultiSource/Benchmarks/MiBench/security-sha/security-sha: -97.81% (6.6874 => 0.1463, std.dev.: 0.0002) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -77.68% (5.2763 => 1.1779, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/salsa20: -75.04% (0.8651 => 0.2159, std.dev.: 0.0011) SingleSource/Benchmarks/Misc/richards_benchmark: -42.48% (0.1622 => 0.0933, std.dev.: 0.0010) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.57% (5.3855 => 4.4930, std.dev.: 0.0008) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -15.97% (5.3526 => 4.4978, std.dev.: 0.0121) MultiSource/Applications/JM/ldecod/ldecod: -12.01% (10.4361 => 9.1832, std.dev.: 0.0070) SingleSource/UnitTests/Vector/constpool: -7.41% (54.1659 => 50.1542, std.dev.: 0.0141) MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.33% (1.7609 => 1.6318, std.dev.: 0.0078) Performance Improvements - Execution Time ----------------------------------------- SingleSource/Benchmarks/Shootout-C++/objinst: -100.00% (8.4136 => 0.0003) SingleSource/Benchmarks/Dhrystone/fldry: -65.86% (1.9577 => 0.6684, std.dev.: 0.0090) SingleSource/Benchmarks/Dhrystone/dry: -51.57% (2.4116 => 1.1680, std.dev.: 0.0000) SingleSource/Benchmarks/BenchmarkGame/puzzle: -51.08% (0.6962 => 0.3406, std.dev.: 0.0107) SingleSource/Benchmarks/Misc/dt: -48.64% (2.0460 => 1.0509, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/security-sha/security-sha: -48.50% (0.0400 => 0.0206) MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -45.06% (0.0628 => 0.0345) MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.08% (4.5009 => 2.5618, std.dev.: 0.0002) MultiSource/Benchmarks/mediabench/gsm/toast/toast: -36.56% (0.0506 => 0.0321) MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -36.34% (0.3987 => 0.2538, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/lowercase: -34.08% (8.0499 => 5.3061, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel-2: -33.79% (1.5373 => 1.0178, std.dev.: 0.0024) SingleSource/Benchmarks/Misc/mandel: -33.31% (1.1492 => 0.7664, std.dev.: 0.0010) MultiSource/Benchmarks/Bullet/bullet: -30.58% (10.7105 => 7.4354, std.dev.: 0.0024) MultiSource/Benchmarks/PAQ8p/paq8p: -24.61% (85.0658 => 64.1343, std.dev.: 0.0048) MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -24.47% (2.6546 => 2.0051, std.dev.: 0.0006) SingleSource/Benchmarks/Misc/fp-convert: -22.59% (3.3453 => 2.5897, std.dev.: 0.0000) SingleSource/Benchmarks/Shootout-C++/ary: -22.09% (0.0756 => 0.0589, std.dev.: 0.0002) MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -21.88% (2.6778 => 2.0918, std.dev.: 0.0001) SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -21.78% (1.2258 => 0.9588, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -21.69% (2.9695 => 2.3253) SingleSource/Benchmarks/Shootout-C++/ary2: -21.14% (0.0757 => 0.0597, std.dev.: 0.0001) MultiSource/Benchmarks/FreeBench/mason/mason: -19.62% (0.2161 => 0.1737, std.dev.: 0.0002) MultiSource/Applications/sgefa/sgefa: -19.15% (0.6223 => 0.5031, std.dev.: 0.0003) SingleSource/UnitTests/Vector/multiplies: -16.71% (2.5528 => 2.1263, std.dev.: 0.0004) SingleSource/Benchmarks/Misc/flops-6: -15.57% (1.6925 => 1.4289, std.dev.: 0.0013) SingleSource/Benchmarks/Shootout/matrix: -13.01% (3.1443 => 2.7353, std.dev.: 0.0007) MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -12.13% (0.9540 => 0.8383, std.dev.: 0.0017) MultiSource/Benchmarks/NPB-serial/is/is: -11.17% (9.5636 => 8.4952, std.dev.: 0.0014) SingleSource/Benchmarks/Shootout-C++/matrix: -10.18% (3.0680 => 2.7557, std.dev.: 0.0003) SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.16% (3.2416 => 2.9121, std.dev.: 0.0006) MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.10% (1.5660 => 1.4235) MultiSource/Benchmarks/FreeBench/distray/distray: -7.47% (0.1592 => 0.1473, std.dev.: 0.0000) MultiSource/Benchmarks/Fhourstones/fhourstones: -6.90% (1.8329 => 1.7064, std.dev.: 0.0009) SingleSource/Benchmarks/CoyoteBench/huffbench: -6.90% (19.9488 => 18.5722, std.dev.: 0.0256) SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.90% (4.8142 => 4.4822) MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.81% (0.3463 => 0.3227, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -6.25% (0.2497 => 0.2341, std.dev.: 0.0000) SingleSource/Benchmarks/McGill/chomp: -5.78% (1.2373 => 1.1658, std.dev.: 0.0012) MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.64% (8.1563 => 7.6960, std.dev.: 0.0030) MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.61% (1.6805 => 1.5863, std.dev.: 0.0002) SingleSource/Benchmarks/Misc/flops-8: -5.56% (1.8525 => 1.7495, std.dev.: 0.0000) SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -5.52% (2.7294 => 2.5787, std.dev.: 0.0000) MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.26% (0.8614 => 0.8161, std.dev.: 0.0000) SingleSource/Benchmarks/Misc/flops-5: -5.06% (1.5835 => 1.5034, std.dev.: 0.0043) SingleSource/UnitTests/Vector/SSE/sse_stepfft: -4.72% (0.4808 => 0.4581, std.dev.: 0.0009) SingleSource/Benchmarks/Misc/salsa20: -4.68% (10.2830 => 9.8018, std.dev.: 0.0028) MultiSource/Applications/siod/siod: -3.90% (3.2827 => 3.1547, std.dev.: 0.0002) SingleSource/UnitTests/Vector/build2: -2.14% (1.3861 => 1.3564) SingleSource/Benchmarks/Misc/whetstone: -2.06% (1.0554 => 1.0337, std.dev.: 0.0008) SingleSource/Benchmarks/Shootout/ary3: -1.92% (3.6994 => 3.6284, std.dev.: 0.0217) MultiSource/Benchmarks/sim/sim: -1.85% (5.0483 => 4.9548, std.dev.: 0.0003) SingleSource/Benchmarks/Misc/flops: -1.78% (8.8334 => 8.6764, std.dev.: 0.0003) SingleSource/Benchmarks/Shootout-C++/lists: -1.64% (12.5348 => 12.3294, std.dev.: 0.0007) SingleSource/Benchmarks/Shootout-C++/ary3: -1.22% (3.7221 => 3.6768, std.dev.: 0.0033) Added Tests - Compile Time -------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Added Tests - Execution Time ---------------------------- MultiSource/Applications/ALAC/decode/alacconvert-decode MultiSource/Applications/ALAC/encode/alacconvert-encode MultiSource/Benchmarks/7zip/7zip-benchmark MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt SingleSource/Benchmarks/Linpack/linpack-pc SingleSource/Benchmarks/Misc/matmul_f64_4x4 SingleSource/Benchmarks/Polybench/datamining/correlation/correlation SingleSource/Benchmarks/Polybench/datamining/covariance/covariance SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect SingleSource/Benchmarks/Polybench/stencils/adi/adi SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d SingleSource/Benchmarks/SmallPT/smallpt SingleSource/UnitTests/ObjC/BoolLiteralTest SingleSource/UnitTests/Vectorizer/gcc-loops Existing Failures - Execution Time ---------------------------------- MultiSource/Applications/oggenc/oggenc MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset MultiSource/Applications/oggenc/oggenc: -10.71% (0.1485 => 0.1326, std.dev.: 0.0000) MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -69.00% (0.2116 => 0.0656, std.dev.: 0.0013) Report Time: 1.70s -------------- next part -------------- An HTML attachment was scrubbed... URL: